2024-05-08T23:40:56.648 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T23:40:56.648 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/test_o_trunc}} --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199 -- /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199/orig.config.yaml 2024-05-08T23:40:56.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T23:40:56.824 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199 branch: wip-pdonnell-testing-20240508.150423-reef description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/test_o_trunc}} email: pdonnell@redhat.com first_in_suite: false job_id: '7698199' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true name: pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-pdonnell-testing-20240508.150423-reef ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.150423-reef sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 2738 sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 sleep_before_teardown: 0 subset: 17/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.150423-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNvnyY9SdEF1vET/NvsnBl35lV0JNdfjh9RJwX3BrskyKAxcMeqxv2kK0aAPqDW5cPSYePLRlTDesT1h/BpMNM= smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1KTSzvTbkbExEDHGow7EXYLBy+RUKvswAimCy7mfEnPWUlvw/USJFj4kFi8tpvTTFeB0fxHdGXkbDo14Om0CY= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCVacWXTUPxzX80vucqQPjnjO/JXFHvpGvKR8guHxwo61jKHGA4N2DtUdbKLHEKm5QGUN4GQv+jDL2goVgfDx74= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/test_o_trunc.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_19:22:21 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T23:40:56.824 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa; will attempt to use it 2024-05-08T23:40:56.825 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa/tasks 2024-05-08T23:40:56.825 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T23:40:56.826 INFO:teuthology.task.internal:Checking packages... 2024-05-08T23:40:56.849 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'd21e4f961318b56f0d915caa2490c3711bf13c34' 2024-05-08T23:40:56.850 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T23:40:56.850 INFO:teuthology.packaging:ref: None 2024-05-08T23:40:56.850 INFO:teuthology.packaging:tag: None 2024-05-08T23:40:56.850 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.150423-reef 2024-05-08T23:40:56.850 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:40:56.850 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20240508.150423-reef 2024-05-08T23:40:56.992 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1322.gd21e4f96 2024-05-08T23:40:56.994 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T23:40:57.000 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T23:40:57.000 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T23:40:57.006 INFO:teuthology.task.internal:Saving configuration 2024-05-08T23:40:57.027 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T23:40:57.033 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T23:40:57.055 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 23:35:28.095405', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNvnyY9SdEF1vET/NvsnBl35lV0JNdfjh9RJwX3BrskyKAxcMeqxv2kK0aAPqDW5cPSYePLRlTDesT1h/BpMNM='} 2024-05-08T23:40:57.077 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 23:35:28.096875', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL1KTSzvTbkbExEDHGow7EXYLBy+RUKvswAimCy7mfEnPWUlvw/USJFj4kFi8tpvTTFeB0fxHdGXkbDo14Om0CY='} 2024-05-08T23:40:57.098 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 23:35:28.098118', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCVacWXTUPxzX80vucqQPjnjO/JXFHvpGvKR8guHxwo61jKHGA4N2DtUdbKLHEKm5QGUN4GQv+jDL2goVgfDx74='} 2024-05-08T23:40:57.098 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T23:40:57.104 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-08T23:40:57.104 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-08T23:40:57.104 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-08T23:40:57.104 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T23:40:57.209 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f41d52d8160>, signals=[15]) 2024-05-08T23:40:57.209 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T23:40:57.216 INFO:teuthology.task.internal:Opening connections... 2024-05-08T23:40:57.216 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-05-08T23:40:57.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:40:57.297 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2024-05-08T23:40:57.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:40:57.374 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-05-08T23:40:57.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:40:57.452 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T23:40:57.458 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-05-08T23:40:57.480 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-05-08T23:40:57.481 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-05-08T23:40:57.540 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T23:40:57.540 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T23:40:57.540 INFO:teuthology.orchestra.run.smithi081.stdout:ID="rhel" 2024-05-08T23:40:57.540 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="fedora" 2024-05-08T23:40:57.540 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8.6" 2024-05-08T23:40:57.540 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8" 2024-05-08T23:40:57.540 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T23:40:57.540 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-05-08T23:40:57.540 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T23:40:57.540 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T23:40:57.540 INFO:teuthology.orchestra.run.smithi081.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T23:40:57.541 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T23:40:57.541 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:40:57.541 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T23:40:57.541 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T23:40:57.541 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T23:40:57.541 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T23:40:57.542 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-05-08T23:40:57.569 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2024-05-08T23:40:57.590 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2024-05-08T23:40:57.590 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2024-05-08T23:40:57.650 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T23:40:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T23:40:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:ID="rhel" 2024-05-08T23:40:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="fedora" 2024-05-08T23:40:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="8.6" 2024-05-08T23:40:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el8" 2024-05-08T23:40:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T23:40:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31" 2024-05-08T23:40:57.651 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T23:40:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T23:40:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T23:40:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T23:40:57.652 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-08T23:40:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T23:40:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T23:40:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T23:40:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T23:40:57.653 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2024-05-08T23:40:57.677 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-05-08T23:40:57.697 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-05-08T23:40:57.698 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-05-08T23:40:57.757 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T23:40:57.757 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T23:40:57.757 INFO:teuthology.orchestra.run.smithi171.stdout:ID="rhel" 2024-05-08T23:40:57.757 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="fedora" 2024-05-08T23:40:57.757 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="8.6" 2024-05-08T23:40:57.757 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el8" 2024-05-08T23:40:57.757 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T23:40:57.757 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-05-08T23:40:57.757 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T23:40:57.757 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T23:40:57.758 INFO:teuthology.orchestra.run.smithi171.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T23:40:57.758 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T23:40:57.758 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:40:57.758 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T23:40:57.758 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T23:40:57.758 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T23:40:57.758 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T23:40:57.758 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-05-08T23:40:57.777 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T23:40:57.789 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T23:40:57.795 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T23:40:57.795 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-05-08T23:40:57.797 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2024-05-08T23:40:57.800 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-05-08T23:40:57.818 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T23:40:57.825 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T23:40:57.825 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-05-08T23:40:57.858 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2024-05-08T23:40:57.860 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-05-08T23:40:57.887 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T23:40:57.966 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T23:40:57.980 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-08T23:40:57.981 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-05-08T23:40:57.981 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-05-08T23:40:57.981 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T23:40:58.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:40:58.000 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-05-08T23:40:58.060 INFO:teuthology.orchestra.run.smithi081.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-05-08T23:40:58.060 INFO:teuthology.task.kernel:Running kernel on smithi081: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T23:40:58.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2024-05-08T23:40:59.559 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2024-05-08T23:40:59.559 INFO:teuthology.orchestra.run.smithi081.stdout:Unable to read consumer identity 2024-05-08T23:40:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:40:59.871 INFO:teuthology.orchestra.run.smithi081.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T23:40:59.871 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:41:01.679 INFO:teuthology.orchestra.run.smithi081.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-05-08T23:41:03.582 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 8.7 MB/s | 16 MB 00:01 2024-05-08T23:41:07.222 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 504 kB/s | 24 kB 00:00 2024-05-08T23:41:08.017 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-05-08T23:41:08.017 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-05-08T23:41:08.103 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-05-08T23:41:08.104 INFO:teuthology.orchestra.run.smithi081.stdout:Nothing to do. 2024-05-08T23:41:08.105 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-05-08T23:41:08.283 DEBUG:teuthology.orchestra.run.smithi081:> echo no | sudo yum reinstall kernel || true 2024-05-08T23:41:08.617 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2024-05-08T23:41:08.618 INFO:teuthology.orchestra.run.smithi081.stdout:Unable to read consumer identity 2024-05-08T23:41:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:41:08.905 INFO:teuthology.orchestra.run.smithi081.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T23:41:08.905 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:41:09.209 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:02 ago on Wed 08 May 2024 11:41:07 PM UTC. 2024-05-08T23:41:09.289 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T23:41:09.289 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T23:41:09.334 INFO:teuthology.orchestra.run.smithi081.stderr:Error: No packages marked for reinstall. 2024-05-08T23:41:09.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum reinstall -y kernel || true 2024-05-08T23:41:09.716 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2024-05-08T23:41:09.716 INFO:teuthology.orchestra.run.smithi081.stdout:Unable to read consumer identity 2024-05-08T23:41:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:41:09.942 INFO:teuthology.orchestra.run.smithi081.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T23:41:09.942 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:41:10.242 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:00:03 ago on Wed 08 May 2024 11:41:07 PM UTC. 2024-05-08T23:41:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T23:41:10.307 INFO:teuthology.orchestra.run.smithi081.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T23:41:10.348 INFO:teuthology.orchestra.run.smithi081.stderr:Error: No packages marked for reinstall. 2024-05-08T23:41:10.401 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T23:41:10.561 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-05-08T23:41:10.562 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T23:41:10.562 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-08T23:41:10.562 DEBUG:teuthology.parallel:result is None 2024-05-08T23:41:10.562 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T23:41:10.611 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T23:41:10.611 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T23:41:10.614 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T23:41:10.617 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T23:41:10.639 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T23:41:10.668 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T23:41:10.711 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T23:41:10.712 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T23:41:10.714 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T23:41:10.716 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T23:41:10.756 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T23:41:10.762 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T23:41:10.762 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T23:41:10.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:41:10.798 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T23:41:10.817 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:41:10.817 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T23:41:10.819 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T23:41:10.841 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T23:41:10.861 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T23:41:10.875 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T23:41:10.877 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T23:41:10.896 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T23:41:10.903 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T23:41:10.923 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T23:41:10.925 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T23:41:10.932 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T23:41:10.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T23:41:10.934 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T23:41:10.941 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T23:41:10.970 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T23:41:10.978 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T23:41:10.978 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T23:41:11.002 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T23:41:11.010 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T23:41:11.028 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T23:41:11.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T23:41:11.150 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T23:41:11.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T23:41:11.277 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T23:41:11.277 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T23:41:11.343 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T23:41:11.389 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T23:41:11.447 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T23:41:11.527 DEBUG:teuthology.orchestra.run.smithi150:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T23:41:11.575 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-08T23:41:11.575 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T23:41:11.643 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T23:41:11.693 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T23:41:11.741 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T23:41:11.828 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T23:41:11.874 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-08T23:41:11.874 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T23:41:11.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-05-08T23:41:11.945 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2024-05-08T23:41:11.948 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-05-08T23:41:12.014 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T23:41:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T23:41:12.057 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T23:41:12.387 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T23:41:12.394 INFO:teuthology.task.internal:Starting timer... 2024-05-08T23:41:12.394 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T23:41:12.409 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T23:41:12.417 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2024-05-08T23:41:12.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-05-08T23:41:12.493 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-05-08T23:41:12.495 DEBUG:teuthology.orchestra.run.smithi150:> sudo service auditd rotate 2024-05-08T23:41:12.563 INFO:teuthology.orchestra.run.smithi150.stdout:Rotating logs: 2024-05-08T23:41:12.564 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2024-05-08T23:41:12.619 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: 2024-05-08T23:41:12.620 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T23:41:12.621 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-05-08T23:41:12.648 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-05-08T23:41:12.648 DEBUG:teuthology.orchestra.run.smithi150:> /usr/sbin/getenforce 2024-05-08T23:41:12.672 INFO:teuthology.orchestra.run.smithi150.stdout:Permissive 2024-05-08T23:41:12.673 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2024-05-08T23:41:12.703 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2024-05-08T23:41:12.703 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi150.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2024-05-08T23:41:12.704 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T23:41:12.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:41:12.732 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T23:41:12.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:41:12.760 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T23:41:12.787 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T23:41:12.787 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T23:41:12.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-05-08T23:41:12.817 DEBUG:teuthology.orchestra.run.smithi150:> sudo /usr/sbin/setenforce permissive 2024-05-08T23:41:12.846 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2024-05-08T23:41:12.873 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T23:41:12.886 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-08T23:41:12.893 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-08T23:41:13.059 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T23:41:13.076 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T23:41:13.077 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi150.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T23:51:28.680 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-05-08T23:51:28.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-08T23:51:28.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:51:28.807 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-05-08T23:51:28.876 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-05-08T23:51:28.876 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-05-08T23:51:28.877 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:51:28.949 DEBUG:teuthology.orchestra.run.smithi150:> true 2024-05-08T23:51:29.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2024-05-08T23:51:29.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-08T23:51:29.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T23:51:29.097 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-05-08T23:51:29.165 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-05-08T23:51:29.165 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T23:51:29.175 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T23:51:29.175 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T23:51:29.175 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T23:51:29.178 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T23:51:29.178 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T23:51:29.180 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T23:51:29.180 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T23:51:29.211 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T23:51:29.212 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T23:51:29.226 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T23:51:29.228 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T23:51:29.239 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T23:51:29.255 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T23:51:29.290 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-05-08T23:51:29.292 INFO:teuthology.orchestra.run.smithi150.stderr:sudo: ntpd: command not found 2024-05-08T23:51:29.303 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-05-08T23:51:29.304 INFO:teuthology.orchestra.run.smithi150.stdout:506 Cannot talk to daemon 2024-05-08T23:51:29.318 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T23:51:29.320 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T23:51:29.332 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T23:51:29.334 INFO:teuthology.orchestra.run.smithi150.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T23:51:29.335 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2024-05-08T23:51:29.347 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2024-05-08T23:51:29.363 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T23:51:29.377 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T23:51:29.394 INFO:teuthology.orchestra.run.smithi081.stderr:bash: ntpq: command not found 2024-05-08T23:51:29.398 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T23:51:29.398 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-05-08T23:51:29.398 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:51:29.398 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:51:29.398 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:51:29.398 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:51:29.419 INFO:teuthology.orchestra.run.smithi150.stderr:bash: ntpq: command not found 2024-05-08T23:51:29.423 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T23:51:29.423 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-05-08T23:51:29.423 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:51:29.423 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:51:29.423 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:51:29.423 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:51:29.446 INFO:teuthology.orchestra.run.smithi171.stderr:bash: ntpq: command not found 2024-05-08T23:51:29.451 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T23:51:29.451 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-05-08T23:51:29.451 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:51:29.451 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:51:29.451 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:51:29.451 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T23:51:29.451 INFO:teuthology.run_tasks:Running task pexec... 2024-05-08T23:51:29.462 INFO:teuthology.task.pexec:Executing custom commands... 2024-05-08T23:51:29.462 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi081.front.sepia.ceph.com 2024-05-08T23:51:29.462 DEBUG:teuthology.orchestra.run.smithi081:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-05-08T23:51:29.463 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi150.front.sepia.ceph.com 2024-05-08T23:51:29.463 DEBUG:teuthology.orchestra.run.smithi150:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-05-08T23:51:29.463 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi171.front.sepia.ceph.com 2024-05-08T23:51:29.463 DEBUG:teuthology.orchestra.run.smithi171:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-05-08T23:51:29.839 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2024-05-08T23:51:29.844 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2024-05-08T23:51:29.868 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-05-08T23:51:31.677 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 43 kB/s | 4.5 kB 00:00 2024-05-08T23:51:31.699 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 kB/s | 4.1 kB 00:00 2024-05-08T23:51:31.766 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 37 kB/s | 4.1 kB 00:00 2024-05-08T23:51:32.122 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 32 kB/s | 4.5 kB 00:00 2024-05-08T23:51:32.160 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 28 kB/s | 4.5 kB 00:00 2024-05-08T23:51:32.323 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 29 kB/s | 4.1 kB 00:00 2024-05-08T23:51:35.059 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-05-08T23:51:35.060 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-05-08T23:51:35.060 INFO:teuthology.orchestra.run.smithi171.stdout: Package Architecture Version Repository Size 2024-05-08T23:51:35.061 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-05-08T23:51:35.061 INFO:teuthology.orchestra.run.smithi171.stdout:Resetting modules: 2024-05-08T23:51:35.061 INFO:teuthology.orchestra.run.smithi171.stdout: container-tools 2024-05-08T23:51:35.061 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:51:35.061 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-05-08T23:51:35.061 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-05-08T23:51:35.061 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:51:35.253 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-05-08T23:51:35.254 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-05-08T23:51:35.254 INFO:teuthology.orchestra.run.smithi150.stdout: Package Architecture Version Repository Size 2024-05-08T23:51:35.254 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-05-08T23:51:35.254 INFO:teuthology.orchestra.run.smithi150.stdout:Resetting modules: 2024-05-08T23:51:35.254 INFO:teuthology.orchestra.run.smithi150.stdout: container-tools 2024-05-08T23:51:35.254 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-08T23:51:35.254 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-05-08T23:51:35.254 INFO:teuthology.orchestra.run.smithi150.stdout:================================================================================ 2024-05-08T23:51:35.254 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-08T23:51:35.405 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-05-08T23:51:35.406 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-05-08T23:51:35.407 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-05-08T23:51:35.407 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-05-08T23:51:35.407 INFO:teuthology.orchestra.run.smithi081.stdout:Resetting modules: 2024-05-08T23:51:35.407 INFO:teuthology.orchestra.run.smithi081.stdout: container-tools 2024-05-08T23:51:35.407 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:51:35.407 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-05-08T23:51:35.407 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-05-08T23:51:35.407 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:51:48.528 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-05-08T23:51:48.566 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-05-08T23:51:49.013 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-05-08T23:51:49.058 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2024-05-08T23:51:49.625 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-05-08T23:51:50.091 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2024-05-08T23:51:50.835 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 43 kB/s | 4.1 kB 00:00 2024-05-08T23:51:50.843 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 34 kB/s | 4.1 kB 00:00 2024-05-08T23:51:51.210 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 51 kB/s | 4.5 kB 00:00 2024-05-08T23:51:51.237 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 25 kB/s | 4.5 kB 00:00 2024-05-08T23:51:52.168 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 28 kB/s | 4.5 kB 00:00 2024-05-08T23:51:52.816 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 29 kB/s | 4.1 kB 00:00 2024-05-08T23:51:54.129 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-05-08T23:51:54.241 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-05-08T23:51:54.292 INFO:teuthology.orchestra.run.smithi171.stdout:========================================================================================================== 2024-05-08T23:51:54.292 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-05-08T23:51:54.292 INFO:teuthology.orchestra.run.smithi171.stdout:========================================================================================================== 2024-05-08T23:51:54.292 INFO:teuthology.orchestra.run.smithi171.stdout:Installing group/module packages: 2024-05-08T23:51:54.292 INFO:teuthology.orchestra.run.smithi171.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-05-08T23:51:54.292 INFO:teuthology.orchestra.run.smithi171.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-05-08T23:51:54.292 INFO:teuthology.orchestra.run.smithi171.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-05-08T23:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-05-08T23:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T23:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-05-08T23:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-05-08T23:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-05-08T23:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-05-08T23:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-05-08T23:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-05-08T23:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-05-08T23:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-05-08T23:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout:Installing weak dependencies: 2024-05-08T23:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T23:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout:Installing module profiles: 2024-05-08T23:51:54.293 INFO:teuthology.orchestra.run.smithi171.stdout: container-tools/common 2024-05-08T23:51:54.294 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:51:54.294 INFO:teuthology.orchestra.run.smithi171.stdout:Enabling module streams: 2024-05-08T23:51:54.294 INFO:teuthology.orchestra.run.smithi171.stdout: container-tools rhel8 2024-05-08T23:51:54.294 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:51:54.294 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-05-08T23:51:54.294 INFO:teuthology.orchestra.run.smithi171.stdout:========================================================================================================== 2024-05-08T23:51:54.294 INFO:teuthology.orchestra.run.smithi171.stdout:Install 13 Packages 2024-05-08T23:51:54.294 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:51:54.295 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 26 M 2024-05-08T23:51:54.295 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 87 M 2024-05-08T23:51:54.295 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-05-08T23:51:54.407 INFO:teuthology.orchestra.run.smithi171.stdout:(1/13): python3-pyxdg-0.25-16.el8.noarch.rpm 844 kB/s | 94 kB 00:00 2024-05-08T23:51:54.410 INFO:teuthology.orchestra.run.smithi150.stdout:========================================================================================================== 2024-05-08T23:51:54.410 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-05-08T23:51:54.410 INFO:teuthology.orchestra.run.smithi150.stdout:========================================================================================================== 2024-05-08T23:51:54.410 INFO:teuthology.orchestra.run.smithi150.stdout:Installing group/module packages: 2024-05-08T23:51:54.411 INFO:teuthology.orchestra.run.smithi150.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-05-08T23:51:54.411 INFO:teuthology.orchestra.run.smithi150.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-05-08T23:51:54.411 INFO:teuthology.orchestra.run.smithi150.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-05-08T23:51:54.411 INFO:teuthology.orchestra.run.smithi150.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-05-08T23:51:54.411 INFO:teuthology.orchestra.run.smithi150.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T23:51:54.411 INFO:teuthology.orchestra.run.smithi150.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-05-08T23:51:54.411 INFO:teuthology.orchestra.run.smithi150.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-05-08T23:51:54.411 INFO:teuthology.orchestra.run.smithi150.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-05-08T23:51:54.411 INFO:teuthology.orchestra.run.smithi150.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-05-08T23:51:54.411 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-05-08T23:51:54.411 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-05-08T23:51:54.411 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-05-08T23:51:54.411 INFO:teuthology.orchestra.run.smithi150.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-05-08T23:51:54.411 INFO:teuthology.orchestra.run.smithi150.stdout:Installing weak dependencies: 2024-05-08T23:51:54.412 INFO:teuthology.orchestra.run.smithi150.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T23:51:54.412 INFO:teuthology.orchestra.run.smithi150.stdout:Installing module profiles: 2024-05-08T23:51:54.412 INFO:teuthology.orchestra.run.smithi150.stdout: container-tools/common 2024-05-08T23:51:54.412 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-08T23:51:54.412 INFO:teuthology.orchestra.run.smithi150.stdout:Enabling module streams: 2024-05-08T23:51:54.412 INFO:teuthology.orchestra.run.smithi150.stdout: container-tools rhel8 2024-05-08T23:51:54.412 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-08T23:51:54.412 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-05-08T23:51:54.412 INFO:teuthology.orchestra.run.smithi150.stdout:========================================================================================================== 2024-05-08T23:51:54.412 INFO:teuthology.orchestra.run.smithi150.stdout:Install 13 Packages 2024-05-08T23:51:54.412 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-08T23:51:54.413 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 26 M 2024-05-08T23:51:54.413 INFO:teuthology.orchestra.run.smithi150.stdout:Installed size: 87 M 2024-05-08T23:51:54.413 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-05-08T23:51:54.431 INFO:teuthology.orchestra.run.smithi171.stdout:(2/13): python3-pytoml-0.1.14-5.git7dea353.el8. 182 kB/s | 25 kB 00:00 2024-05-08T23:51:54.457 INFO:teuthology.orchestra.run.smithi171.stdout:(3/13): criu-libs-3.18-4.module+el8.9.0+20326+3 244 kB/s | 39 kB 00:00 2024-05-08T23:51:54.580 INFO:teuthology.orchestra.run.smithi150.stdout:(1/13): criu-libs-3.18-4.module+el8.9.0+20326+3 237 kB/s | 39 kB 00:00 2024-05-08T23:51:54.590 INFO:teuthology.orchestra.run.smithi171.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 223 kB/s | 41 kB 00:00 2024-05-08T23:51:54.596 INFO:teuthology.orchestra.run.smithi150.stdout:(2/13): python3-pytoml-0.1.14-5.git7dea353.el8. 136 kB/s | 25 kB 00:00 2024-05-08T23:51:54.630 INFO:teuthology.orchestra.run.smithi150.stdout:(3/13): python3-pyxdg-0.25-16.el8.noarch.rpm 434 kB/s | 94 kB 00:00 2024-05-08T23:51:54.641 INFO:teuthology.orchestra.run.smithi171.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 4.8 MB/s | 1.0 MB 00:00 2024-05-08T23:51:54.664 INFO:teuthology.orchestra.run.smithi150.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 489 kB/s | 41 kB 00:00 2024-05-08T23:51:54.750 INFO:teuthology.orchestra.run.smithi171.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2169 4.5 MB/s | 739 kB 00:00 2024-05-08T23:51:54.783 INFO:teuthology.orchestra.run.smithi171.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 1.6 MB/s | 239 kB 00:00 2024-05-08T23:51:54.839 INFO:teuthology.orchestra.run.smithi150.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 4.2 MB/s | 1.0 MB 00:00 2024-05-08T23:51:54.873 INFO:teuthology.orchestra.run.smithi150.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2169 3.5 MB/s | 739 kB 00:00 2024-05-08T23:51:54.925 INFO:teuthology.orchestra.run.smithi171.stdout:(8/13): buildah-1.31.5-1.module+el8.9.0+21697+6 19 MB/s | 8.8 MB 00:00 2024-05-08T23:51:54.950 INFO:teuthology.orchestra.run.smithi171.stdout:(9/13): python3-podman-4.6.0-2.module+el8.9.0+2 919 kB/s | 154 kB 00:00 2024-05-08T23:51:54.965 INFO:teuthology.orchestra.run.smithi150.stdout:(7/13): buildah-1.31.5-1.module+el8.9.0+21697+6 26 MB/s | 8.8 MB 00:00 2024-05-08T23:51:54.990 INFO:teuthology.orchestra.run.smithi150.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 1.6 MB/s | 239 kB 00:00 2024-05-08T23:51:55.034 INFO:teuthology.orchestra.run.smithi171.stdout:(10/13): netavark-1.7.0-2.module+el8.9.0+21697+ 13 MB/s | 3.7 MB 00:00 2024-05-08T23:51:55.098 INFO:teuthology.orchestra.run.smithi150.stdout:(9/13): python3-podman-4.6.0-2.module+el8.9.0+2 1.1 MB/s | 154 kB 00:00 2024-05-08T23:51:55.159 INFO:teuthology.orchestra.run.smithi171.stdout:(11/13): udica-0.2.6-20.module+el8.9.0+21697+6a 396 kB/s | 49 kB 00:00 2024-05-08T23:51:55.190 INFO:teuthology.orchestra.run.smithi150.stdout:(10/13): netavark-1.7.0-2.module+el8.9.0+21697+ 12 MB/s | 3.7 MB 00:00 2024-05-08T23:51:55.260 INFO:teuthology.orchestra.run.smithi171.stdout:(12/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 24 MB/s | 8.1 MB 00:00 2024-05-08T23:51:55.266 INFO:teuthology.orchestra.run.smithi150.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 15 MB/s | 2.5 MB 00:00 2024-05-08T23:51:55.301 INFO:teuthology.orchestra.run.smithi171.stdout:(13/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 7.2 MB/s | 2.5 MB 00:00 2024-05-08T23:51:55.302 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:51:55.302 INFO:teuthology.orchestra.run.smithi171.stdout:Total 25 MB/s | 26 MB 00:01 2024-05-08T23:51:55.331 INFO:teuthology.orchestra.run.smithi150.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+21697+6a 353 kB/s | 49 kB 00:00 2024-05-08T23:51:55.424 INFO:teuthology.orchestra.run.smithi150.stdout:(13/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 19 MB/s | 8.1 MB 00:00 2024-05-08T23:51:55.425 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:51:55.425 INFO:teuthology.orchestra.run.smithi150.stdout:Total 25 MB/s | 26 MB 00:01 2024-05-08T23:51:55.586 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-05-08T23:51:55.607 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-05-08T23:51:55.607 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-05-08T23:51:55.642 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-05-08T23:51:55.707 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-05-08T23:51:55.728 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-05-08T23:51:55.728 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-05-08T23:51:55.806 INFO:teuthology.orchestra.run.smithi081.stdout:========================================================================================================== 2024-05-08T23:51:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-05-08T23:51:55.806 INFO:teuthology.orchestra.run.smithi081.stdout:========================================================================================================== 2024-05-08T23:51:55.806 INFO:teuthology.orchestra.run.smithi081.stdout:Installing group/module packages: 2024-05-08T23:51:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-05-08T23:51:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-05-08T23:51:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-05-08T23:51:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-05-08T23:51:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T23:51:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-05-08T23:51:55.806 INFO:teuthology.orchestra.run.smithi081.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-05-08T23:51:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-05-08T23:51:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-05-08T23:51:55.807 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-05-08T23:51:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-05-08T23:51:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-05-08T23:51:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-05-08T23:51:55.807 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-05-08T23:51:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T23:51:55.807 INFO:teuthology.orchestra.run.smithi081.stdout:Installing module profiles: 2024-05-08T23:51:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: container-tools/common 2024-05-08T23:51:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:51:55.807 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling module streams: 2024-05-08T23:51:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: container-tools rhel8 2024-05-08T23:51:55.807 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:51:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-05-08T23:51:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:========================================================================================================== 2024-05-08T23:51:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:Install 13 Packages 2024-05-08T23:51:55.808 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:51:55.808 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 26 M 2024-05-08T23:51:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 87 M 2024-05-08T23:51:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-05-08T23:51:55.837 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-05-08T23:51:55.846 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-05-08T23:51:55.956 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-05-08T23:51:55.965 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-05-08T23:51:55.999 INFO:teuthology.orchestra.run.smithi081.stdout:(1/13): criu-libs-3.18-4.module+el8.9.0+20326+3 207 kB/s | 39 kB 00:00 2024-05-08T23:51:56.015 INFO:teuthology.orchestra.run.smithi081.stdout:(2/13): python3-pytoml-0.1.14-5.git7dea353.el8. 120 kB/s | 25 kB 00:00 2024-05-08T23:51:56.074 INFO:teuthology.orchestra.run.smithi081.stdout:(3/13): python3-pyxdg-0.25-16.el8.noarch.rpm 354 kB/s | 94 kB 00:00 2024-05-08T23:51:56.099 INFO:teuthology.orchestra.run.smithi081.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 408 kB/s | 41 kB 00:00 2024-05-08T23:51:56.167 INFO:teuthology.orchestra.run.smithi081.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 6.7 MB/s | 1.0 MB 00:00 2024-05-08T23:51:56.225 INFO:teuthology.orchestra.run.smithi081.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2169 5.8 MB/s | 739 kB 00:00 2024-05-08T23:51:56.375 INFO:teuthology.orchestra.run.smithi081.stdout:(7/13): buildah-1.31.5-1.module+el8.9.0+21697+6 29 MB/s | 8.8 MB 00:00 2024-05-08T23:51:56.400 INFO:teuthology.orchestra.run.smithi081.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 1.0 MB/s | 239 kB 00:00 2024-05-08T23:51:56.517 INFO:teuthology.orchestra.run.smithi081.stdout:(9/13): netavark-1.7.0-2.module+el8.9.0+21697+6 13 MB/s | 3.7 MB 00:00 2024-05-08T23:51:56.543 INFO:teuthology.orchestra.run.smithi081.stdout:(10/13): python3-podman-4.6.0-2.module+el8.9.0+ 919 kB/s | 154 kB 00:00 2024-05-08T23:51:56.630 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-05-08T23:51:56.702 INFO:teuthology.orchestra.run.smithi081.stdout:(11/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 27 MB/s | 8.1 MB 00:00 2024-05-08T23:51:56.727 INFO:teuthology.orchestra.run.smithi081.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+21697+6a 269 kB/s | 49 kB 00:00 2024-05-08T23:51:56.772 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-05-08T23:51:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:(13/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 8.4 MB/s | 2.5 MB 00:00 2024-05-08T23:51:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:51:56.819 INFO:teuthology.orchestra.run.smithi081.stdout:Total 25 MB/s | 26 MB 00:01 2024-05-08T23:51:57.101 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-05-08T23:51:57.122 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-05-08T23:51:57.122 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-05-08T23:51:57.131 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-05-08T23:51:57.308 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-05-08T23:51:57.344 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-05-08T23:51:57.352 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-05-08T23:51:57.361 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-05-08T23:51:57.531 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-05-08T23:51:57.538 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-05-08T23:51:57.680 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-05-08T23:51:57.707 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-05-08T23:51:57.874 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-05-08T23:51:57.910 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-05-08T23:51:58.085 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-05-08T23:51:58.128 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-05-08T23:51:58.154 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-05-08T23:51:58.278 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-05-08T23:51:58.414 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-05-08T23:51:58.505 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-05-08T23:51:58.643 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-05-08T23:51:58.847 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-05-08T23:51:58.991 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-05-08T23:51:59.176 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-05-08T23:51:59.299 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T23:51:59.372 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-05-08T23:51:59.415 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T23:51:59.558 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T23:51:59.566 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-05-08T23:51:59.694 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T23:51:59.817 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-05-08T23:51:59.948 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-05-08T23:52:00.114 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-05-08T23:52:00.724 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T23:52:00.841 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-05-08T23:52:00.994 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-05-08T23:52:01.068 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T23:52:01.075 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-05-08T23:52:01.225 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-05-08T23:52:01.283 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T23:52:01.434 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-05-08T23:52:01.475 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T23:52:01.720 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T23:52:01.720 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-05-08T23:52:01.720 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-05-08T23:52:01.720 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-05-08T23:52:01.720 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-05-08T23:52:01.720 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-05-08T23:52:01.720 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-05-08T23:52:01.720 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-05-08T23:52:01.720 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T23:52:01.720 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T23:52:01.721 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-05-08T23:52:01.721 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-05-08T23:52:01.721 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-05-08T23:52:01.881 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T23:52:01.881 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-05-08T23:52:01.881 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-05-08T23:52:01.881 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-05-08T23:52:01.881 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-05-08T23:52:01.881 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-05-08T23:52:01.882 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-05-08T23:52:01.882 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-05-08T23:52:01.882 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T23:52:01.882 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T23:52:01.882 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-05-08T23:52:01.882 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-05-08T23:52:01.882 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-05-08T23:52:02.335 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-05-08T23:52:02.554 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-05-08T23:52:02.778 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T23:52:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T23:52:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-05-08T23:52:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-05-08T23:52:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-05-08T23:52:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-05-08T23:52:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-05-08T23:52:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-05-08T23:52:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-05-08T23:52:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T23:52:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T23:52:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-05-08T23:52:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-05-08T23:52:03.204 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-05-08T23:52:15.953 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-05-08T23:52:15.953 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-05-08T23:52:16.272 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-05-08T23:52:16.272 INFO:teuthology.orchestra.run.smithi150.stdout:Installed products updated. 2024-05-08T23:52:16.513 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:52:16.513 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-05-08T23:52:16.513 INFO:teuthology.orchestra.run.smithi171.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:16.513 INFO:teuthology.orchestra.run.smithi171.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:16.514 INFO:teuthology.orchestra.run.smithi171.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:52:16.514 INFO:teuthology.orchestra.run.smithi171.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-05-08T23:52:16.514 INFO:teuthology.orchestra.run.smithi171.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:16.514 INFO:teuthology.orchestra.run.smithi171.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:16.514 INFO:teuthology.orchestra.run.smithi171.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:52:16.514 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-05-08T23:52:16.514 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-05-08T23:52:16.514 INFO:teuthology.orchestra.run.smithi171.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:16.514 INFO:teuthology.orchestra.run.smithi171.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:16.514 INFO:teuthology.orchestra.run.smithi171.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:52:16.514 INFO:teuthology.orchestra.run.smithi171.stdout: yajl-2.1.0-12.el8.x86_64 2024-05-08T23:52:16.514 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:52:16.514 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-05-08T23:52:16.700 DEBUG:teuthology.parallel:result is None 2024-05-08T23:52:16.875 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-08T23:52:16.875 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-05-08T23:52:16.875 INFO:teuthology.orchestra.run.smithi150.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:16.875 INFO:teuthology.orchestra.run.smithi150.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:16.875 INFO:teuthology.orchestra.run.smithi150.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:52:16.876 INFO:teuthology.orchestra.run.smithi150.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-05-08T23:52:16.876 INFO:teuthology.orchestra.run.smithi150.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:16.876 INFO:teuthology.orchestra.run.smithi150.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:16.876 INFO:teuthology.orchestra.run.smithi150.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:52:16.876 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-05-08T23:52:16.876 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-05-08T23:52:16.876 INFO:teuthology.orchestra.run.smithi150.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:16.876 INFO:teuthology.orchestra.run.smithi150.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:16.876 INFO:teuthology.orchestra.run.smithi150.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:52:16.876 INFO:teuthology.orchestra.run.smithi150.stdout: yajl-2.1.0-12.el8.x86_64 2024-05-08T23:52:16.876 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-08T23:52:16.876 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-05-08T23:52:17.055 DEBUG:teuthology.parallel:result is None 2024-05-08T23:52:17.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-05-08T23:52:17.393 INFO:teuthology.orchestra.run.smithi081.stdout:Installed products updated. 2024-05-08T23:52:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:52:17.964 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-05-08T23:52:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:52:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-05-08T23:52:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:17.964 INFO:teuthology.orchestra.run.smithi081.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:52:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-05-08T23:52:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-05-08T23:52:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T23:52:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T23:52:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: yajl-2.1.0-12.el8.x86_64 2024-05-08T23:52:17.965 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:52:17.965 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-05-08T23:52:18.138 DEBUG:teuthology.parallel:result is None 2024-05-08T23:52:18.138 INFO:teuthology.run_tasks:Running task install... 2024-05-08T23:52:18.147 DEBUG:teuthology.task.install:project ceph 2024-05-08T23:52:18.147 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}} 2024-05-08T23:52:18.147 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'} 2024-05-08T23:52:18.147 INFO:teuthology.task.install:Using flavor: default 2024-05-08T23:52:18.154 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T23:52:18.154 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T23:52:18.154 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T23:52:18.155 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:52:18.157 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T23:52:18.157 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:52:18.158 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T23:52:18.158 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:52:18.304 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T23:52:18.305 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T23:52:18.372 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T23:52:18.372 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T23:52:18.386 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T23:52:18.386 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T23:52:18.482 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T23:52:18.482 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-08T23:52:18.482 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T23:52:18.516 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T23:52:18.516 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T23:52:18.554 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T23:52:18.554 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-08T23:52:18.554 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T23:52:18.587 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T23:52:18.587 DEBUG:teuthology.orchestra.run.smithi150:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T23:52:18.588 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T23:52:18.624 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T23:52:18.624 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T23:52:18.624 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T23:52:18.653 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T23:52:18.653 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T23:52:18.659 DEBUG:teuthology.orchestra.run.smithi150:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T23:52:18.669 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T23:52:18.722 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T23:52:18.736 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2024-05-08T23:52:18.737 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2024-05-08T23:52:18.740 DEBUG:teuthology.orchestra.run.smithi150:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T23:52:18.800 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T23:52:18.807 INFO:teuthology.orchestra.run.smithi150.stdout:check_obsoletes = 1 2024-05-08T23:52:18.809 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum clean all 2024-05-08T23:52:18.866 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-05-08T23:52:18.868 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-05-08T23:52:19.115 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-05-08T23:52:19.185 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2024-05-08T23:52:19.243 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2024-05-08T23:52:20.549 INFO:teuthology.orchestra.run.smithi171.stdout:63 files removed 2024-05-08T23:52:20.606 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T23:52:20.625 INFO:teuthology.orchestra.run.smithi150.stdout:63 files removed 2024-05-08T23:52:20.627 INFO:teuthology.orchestra.run.smithi081.stdout:63 files removed 2024-05-08T23:52:20.678 DEBUG:teuthology.orchestra.run.smithi150:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T23:52:20.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T23:52:20.941 INFO:teuthology.orchestra.run.smithi171.stdout:Updating Subscription Management repositories. 2024-05-08T23:52:21.015 INFO:teuthology.orchestra.run.smithi081.stdout:Updating Subscription Management repositories. 2024-05-08T23:52:21.015 INFO:teuthology.orchestra.run.smithi150.stdout:Updating Subscription Management repositories. 2024-05-08T23:52:22.923 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 209 kB/s | 80 kB 00:00 2024-05-08T23:52:23.067 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 220 kB/s | 80 kB 00:00 2024-05-08T23:52:23.089 INFO:teuthology.orchestra.run.smithi150.stdout:ceph packages for x86_64 278 kB/s | 80 kB 00:00 2024-05-08T23:52:23.224 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 43 kB/s | 11 kB 00:00 2024-05-08T23:52:23.398 INFO:teuthology.orchestra.run.smithi150.stdout:ceph noarch packages 42 kB/s | 11 kB 00:00 2024-05-08T23:52:23.501 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 28 kB/s | 11 kB 00:00 2024-05-08T23:52:23.541 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 5.1 kB/s | 1.5 kB 00:00 2024-05-08T23:52:23.682 INFO:teuthology.orchestra.run.smithi150.stdout:ceph source packages 5.8 kB/s | 1.5 kB 00:00 2024-05-08T23:52:23.709 INFO:teuthology.orchestra.run.smithi171.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-05-08T23:52:23.793 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 5.6 kB/s | 1.5 kB 00:00 2024-05-08T23:52:23.824 INFO:teuthology.orchestra.run.smithi150.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2024-05-08T23:52:23.935 INFO:teuthology.orchestra.run.smithi081.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2024-05-08T23:52:24.653 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 24 MB/s | 16 MB 00:00 2024-05-08T23:52:24.754 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2024-05-08T23:52:25.508 INFO:teuthology.orchestra.run.smithi150.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 16 MB 00:01 2024-05-08T23:52:28.295 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 416 kB/s | 24 kB 00:00 2024-05-08T23:52:28.433 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 192 kB/s | 24 kB 00:00 2024-05-08T23:52:29.178 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2024-05-08T23:52:29.200 INFO:teuthology.orchestra.run.smithi150.stdout:lab-extras 288 kB/s | 24 kB 00:00 2024-05-08T23:52:29.697 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 61 MB 00:01 2024-05-08T23:52:30.735 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 46 MB/s | 67 MB 00:01 2024-05-08T23:52:32.138 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 48 MB/s | 67 MB 00:01 2024-05-08T23:52:40.970 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2024-05-08T23:52:41.073 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 67 MB 00:01 2024-05-08T23:52:43.389 INFO:teuthology.orchestra.run.smithi171.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 MB/s | 61 MB 00:01 2024-05-08T23:52:43.979 INFO:teuthology.orchestra.run.smithi150.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 61 MB 00:01 2024-05-08T23:52:51.607 INFO:teuthology.orchestra.run.smithi081.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-05-08T23:52:58.597 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T23:52:58.599 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T23:52:58.617 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T23:52:58.619 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T23:52:58.620 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T23:52:58.622 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T23:52:58.625 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T23:52:58.629 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T23:52:58.631 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T23:52:58.850 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-05-08T23:52:58.864 INFO:teuthology.orchestra.run.smithi081.stdout:=================================================================================================================================== 2024-05-08T23:52:58.864 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-05-08T23:52:58.864 INFO:teuthology.orchestra.run.smithi081.stdout:=================================================================================================================================== 2024-05-08T23:52:58.864 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-05-08T23:52:58.864 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T23:52:58.864 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T23:52:58.864 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T23:52:58.864 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T23:52:58.864 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T23:52:58.865 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T23:52:58.865 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T23:52:58.865 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T23:52:58.865 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T23:52:58.865 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T23:52:58.865 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T23:52:58.865 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T23:52:58.865 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T23:52:58.865 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T23:52:58.865 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T23:52:58.865 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T23:52:58.865 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T23:52:58.865 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T23:52:58.865 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T23:52:58.866 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T23:52:58.866 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T23:52:58.866 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T23:52:58.866 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T23:52:58.866 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T23:52:58.866 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T23:52:58.866 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T23:52:58.866 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T23:52:58.866 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T23:52:58.866 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T23:52:58.866 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T23:52:58.867 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T23:52:58.867 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T23:52:58.867 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T23:52:58.867 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T23:52:58.867 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T23:52:58.867 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T23:52:58.867 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T23:52:58.867 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-05-08T23:52:58.867 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T23:52:58.867 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T23:52:58.867 INFO:teuthology.orchestra.run.smithi081.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T23:52:58.867 INFO:teuthology.orchestra.run.smithi081.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T23:52:58.867 INFO:teuthology.orchestra.run.smithi081.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T23:52:58.868 INFO:teuthology.orchestra.run.smithi081.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T23:52:58.868 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T23:52:58.868 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T23:52:58.868 INFO:teuthology.orchestra.run.smithi081.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T23:52:58.868 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T23:52:58.868 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T23:52:58.868 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T23:52:58.868 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T23:52:58.868 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T23:52:58.868 INFO:teuthology.orchestra.run.smithi081.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T23:52:58.868 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T23:52:58.868 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-05-08T23:52:58.868 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T23:52:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T23:52:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T23:52:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T23:52:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T23:52:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T23:52:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T23:52:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T23:52:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T23:52:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T23:52:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T23:52:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T23:52:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T23:52:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T23:52:58.869 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T23:52:58.870 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T23:52:58.870 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T23:52:58.870 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T23:52:58.870 INFO:teuthology.orchestra.run.smithi081.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T23:52:58.870 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T23:52:58.870 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T23:52:58.871 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T23:52:58.871 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T23:52:58.871 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T23:52:58.871 INFO:teuthology.orchestra.run.smithi081.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T23:52:58.871 INFO:teuthology.orchestra.run.smithi081.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T23:52:58.871 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T23:52:58.871 INFO:teuthology.orchestra.run.smithi081.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T23:52:58.871 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T23:52:58.871 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T23:52:58.871 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T23:52:58.871 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T23:52:58.871 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T23:52:58.871 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T23:52:58.871 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T23:52:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T23:52:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T23:52:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T23:52:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T23:52:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T23:52:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T23:52:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T23:52:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T23:52:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T23:52:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T23:52:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T23:52:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T23:52:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T23:52:58.872 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T23:52:58.873 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T23:52:58.873 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T23:52:58.873 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T23:52:58.873 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T23:52:58.873 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T23:52:58.873 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T23:52:58.873 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T23:52:58.873 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T23:52:58.873 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T23:52:58.873 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T23:52:58.873 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T23:52:58.873 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T23:52:58.873 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T23:52:58.874 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T23:52:58.874 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T23:52:58.874 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T23:52:58.874 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T23:52:58.874 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T23:52:58.875 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T23:52:58.875 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T23:52:58.875 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T23:52:58.875 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T23:52:58.875 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T23:52:58.875 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T23:52:58.875 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T23:52:58.875 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T23:52:58.875 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T23:52:58.875 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T23:52:58.875 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T23:52:58.875 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T23:52:58.875 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T23:52:58.876 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T23:52:58.876 INFO:teuthology.orchestra.run.smithi081.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T23:52:58.876 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T23:52:58.876 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T23:52:58.876 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T23:52:58.876 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T23:52:58.876 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T23:52:58.876 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T23:52:58.876 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T23:52:58.876 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T23:52:58.876 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T23:52:58.876 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T23:52:58.876 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T23:52:58.876 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling module streams: 2024-05-08T23:52:58.877 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql 10 2024-05-08T23:52:58.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:52:58.877 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-05-08T23:52:58.877 INFO:teuthology.orchestra.run.smithi081.stdout:=================================================================================================================================== 2024-05-08T23:52:58.877 INFO:teuthology.orchestra.run.smithi081.stdout:Install 130 Packages 2024-05-08T23:52:58.877 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 16 Packages 2024-05-08T23:52:58.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:52:58.877 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 215 M 2024-05-08T23:52:58.878 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-05-08T23:52:58.937 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T23:52:58.938 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T23:52:58.958 INFO:teuthology.orchestra.run.smithi171.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T23:52:58.962 INFO:teuthology.orchestra.run.smithi171.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T23:52:58.962 INFO:teuthology.orchestra.run.smithi171.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T23:52:58.963 INFO:teuthology.orchestra.run.smithi171.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T23:52:58.966 INFO:teuthology.orchestra.run.smithi171.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T23:52:58.971 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T23:52:58.972 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T23:52:59.191 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-05-08T23:52:59.206 INFO:teuthology.orchestra.run.smithi171.stdout:=================================================================================================================================== 2024-05-08T23:52:59.206 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-05-08T23:52:59.206 INFO:teuthology.orchestra.run.smithi171.stdout:=================================================================================================================================== 2024-05-08T23:52:59.206 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-05-08T23:52:59.206 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T23:52:59.206 INFO:teuthology.orchestra.run.smithi171.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T23:52:59.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T23:52:59.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T23:52:59.206 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T23:52:59.207 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T23:52:59.207 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T23:52:59.207 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T23:52:59.207 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T23:52:59.207 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T23:52:59.207 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T23:52:59.207 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T23:52:59.207 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T23:52:59.207 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T23:52:59.208 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T23:52:59.208 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T23:52:59.208 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T23:52:59.208 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T23:52:59.208 INFO:teuthology.orchestra.run.smithi171.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T23:52:59.208 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T23:52:59.208 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T23:52:59.208 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T23:52:59.208 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T23:52:59.208 INFO:teuthology.orchestra.run.smithi171.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T23:52:59.208 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T23:52:59.208 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T23:52:59.209 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T23:52:59.209 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T23:52:59.209 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T23:52:59.209 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T23:52:59.209 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T23:52:59.209 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T23:52:59.209 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T23:52:59.209 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T23:52:59.209 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T23:52:59.209 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T23:52:59.209 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T23:52:59.209 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-05-08T23:52:59.209 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T23:52:59.210 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T23:52:59.210 INFO:teuthology.orchestra.run.smithi171.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T23:52:59.210 INFO:teuthology.orchestra.run.smithi171.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T23:52:59.210 INFO:teuthology.orchestra.run.smithi171.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T23:52:59.210 INFO:teuthology.orchestra.run.smithi171.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T23:52:59.210 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T23:52:59.210 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T23:52:59.210 INFO:teuthology.orchestra.run.smithi171.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T23:52:59.210 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T23:52:59.210 INFO:teuthology.orchestra.run.smithi171.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T23:52:59.210 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T23:52:59.210 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T23:52:59.210 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T23:52:59.211 INFO:teuthology.orchestra.run.smithi171.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T23:52:59.211 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T23:52:59.211 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-05-08T23:52:59.211 INFO:teuthology.orchestra.run.smithi171.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T23:52:59.211 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T23:52:59.211 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T23:52:59.211 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T23:52:59.211 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T23:52:59.211 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T23:52:59.211 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T23:52:59.211 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T23:52:59.211 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T23:52:59.211 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T23:52:59.211 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T23:52:59.212 INFO:teuthology.orchestra.run.smithi171.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T23:52:59.212 INFO:teuthology.orchestra.run.smithi171.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T23:52:59.212 INFO:teuthology.orchestra.run.smithi171.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T23:52:59.212 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T23:52:59.212 INFO:teuthology.orchestra.run.smithi171.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T23:52:59.212 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T23:52:59.212 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T23:52:59.212 INFO:teuthology.orchestra.run.smithi171.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T23:52:59.212 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T23:52:59.212 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T23:52:59.212 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T23:52:59.212 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T23:52:59.212 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T23:52:59.213 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T23:52:59.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T23:52:59.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T23:52:59.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T23:52:59.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T23:52:59.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T23:52:59.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T23:52:59.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T23:52:59.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T23:52:59.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T23:52:59.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T23:52:59.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T23:52:59.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T23:52:59.214 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T23:52:59.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T23:52:59.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T23:52:59.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T23:52:59.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T23:52:59.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T23:52:59.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T23:52:59.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T23:52:59.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T23:52:59.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T23:52:59.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T23:52:59.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T23:52:59.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T23:52:59.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T23:52:59.215 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T23:52:59.216 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T23:52:59.216 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T23:52:59.216 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T23:52:59.216 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T23:52:59.216 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T23:52:59.216 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T23:52:59.216 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T23:52:59.216 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T23:52:59.216 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T23:52:59.216 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T23:52:59.216 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T23:52:59.216 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T23:52:59.216 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T23:52:59.217 INFO:teuthology.orchestra.run.smithi171.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T23:52:59.217 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T23:52:59.217 INFO:teuthology.orchestra.run.smithi171.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T23:52:59.217 INFO:teuthology.orchestra.run.smithi171.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T23:52:59.217 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T23:52:59.217 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T23:52:59.217 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T23:52:59.217 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T23:52:59.217 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T23:52:59.217 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T23:52:59.217 INFO:teuthology.orchestra.run.smithi171.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T23:52:59.217 INFO:teuthology.orchestra.run.smithi171.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T23:52:59.217 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T23:52:59.217 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T23:52:59.218 INFO:teuthology.orchestra.run.smithi171.stdout:Enabling module streams: 2024-05-08T23:52:59.218 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql 10 2024-05-08T23:52:59.218 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:52:59.218 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-05-08T23:52:59.218 INFO:teuthology.orchestra.run.smithi171.stdout:=================================================================================================================================== 2024-05-08T23:52:59.218 INFO:teuthology.orchestra.run.smithi171.stdout:Install 130 Packages 2024-05-08T23:52:59.218 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 16 Packages 2024-05-08T23:52:59.218 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:52:59.219 INFO:teuthology.orchestra.run.smithi081.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 33 kB/s | 6.4 kB 00:00 2024-05-08T23:52:59.219 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 215 M 2024-05-08T23:52:59.219 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-05-08T23:52:59.412 INFO:teuthology.orchestra.run.smithi171.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 41 kB/s | 6.4 kB 00:00 2024-05-08T23:52:59.641 INFO:teuthology.orchestra.run.smithi081.stdout:(2/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.9 MB/s | 860 kB 00:00 2024-05-08T23:52:59.745 INFO:teuthology.orchestra.run.smithi150.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T23:52:59.746 INFO:teuthology.orchestra.run.smithi150.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T23:52:59.766 INFO:teuthology.orchestra.run.smithi150.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T23:52:59.767 INFO:teuthology.orchestra.run.smithi150.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T23:52:59.769 INFO:teuthology.orchestra.run.smithi150.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T23:52:59.771 INFO:teuthology.orchestra.run.smithi150.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T23:52:59.773 INFO:teuthology.orchestra.run.smithi150.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T23:52:59.778 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T23:52:59.779 INFO:teuthology.orchestra.run.smithi150.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T23:52:59.914 INFO:teuthology.orchestra.run.smithi081.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 610 kB/s | 166 kB 00:00 2024-05-08T23:52:59.986 INFO:teuthology.orchestra.run.smithi081.stdout:(4/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 5.7 MB/s | 5.5 MB 00:00 2024-05-08T23:52:59.996 INFO:teuthology.orchestra.run.smithi150.stdout:Dependencies resolved. 2024-05-08T23:53:00.004 INFO:teuthology.orchestra.run.smithi171.stdout:(2/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.4 MB/s | 860 kB 00:00 2024-05-08T23:53:00.010 INFO:teuthology.orchestra.run.smithi150.stdout:=================================================================================================================================== 2024-05-08T23:53:00.010 INFO:teuthology.orchestra.run.smithi150.stdout: Package Arch Version Repository Size 2024-05-08T23:53:00.011 INFO:teuthology.orchestra.run.smithi150.stdout:=================================================================================================================================== 2024-05-08T23:53:00.011 INFO:teuthology.orchestra.run.smithi150.stdout:Installing: 2024-05-08T23:53:00.011 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T23:53:00.011 INFO:teuthology.orchestra.run.smithi150.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T23:53:00.011 INFO:teuthology.orchestra.run.smithi150.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T23:53:00.011 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T23:53:00.011 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T23:53:00.011 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T23:53:00.011 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T23:53:00.011 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T23:53:00.011 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T23:53:00.011 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T23:53:00.011 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T23:53:00.012 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T23:53:00.012 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T23:53:00.012 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T23:53:00.012 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T23:53:00.012 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T23:53:00.012 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T23:53:00.012 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T23:53:00.012 INFO:teuthology.orchestra.run.smithi150.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T23:53:00.012 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T23:53:00.012 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T23:53:00.012 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T23:53:00.012 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T23:53:00.012 INFO:teuthology.orchestra.run.smithi150.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T23:53:00.013 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T23:53:00.013 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T23:53:00.013 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T23:53:00.013 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T23:53:00.013 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T23:53:00.013 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T23:53:00.013 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T23:53:00.013 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T23:53:00.013 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T23:53:00.013 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T23:53:00.013 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T23:53:00.013 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T23:53:00.013 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T23:53:00.013 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrading: 2024-05-08T23:53:00.014 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T23:53:00.014 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T23:53:00.014 INFO:teuthology.orchestra.run.smithi150.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T23:53:00.014 INFO:teuthology.orchestra.run.smithi150.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T23:53:00.014 INFO:teuthology.orchestra.run.smithi150.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T23:53:00.014 INFO:teuthology.orchestra.run.smithi150.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T23:53:00.014 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T23:53:00.014 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T23:53:00.014 INFO:teuthology.orchestra.run.smithi150.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T23:53:00.014 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T23:53:00.014 INFO:teuthology.orchestra.run.smithi150.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T23:53:00.014 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T23:53:00.015 INFO:teuthology.orchestra.run.smithi150.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T23:53:00.015 INFO:teuthology.orchestra.run.smithi150.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T23:53:00.015 INFO:teuthology.orchestra.run.smithi150.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T23:53:00.015 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T23:53:00.015 INFO:teuthology.orchestra.run.smithi150.stdout:Installing dependencies: 2024-05-08T23:53:00.015 INFO:teuthology.orchestra.run.smithi150.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T23:53:00.015 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T23:53:00.015 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T23:53:00.015 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T23:53:00.015 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T23:53:00.015 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T23:53:00.015 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T23:53:00.015 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T23:53:00.016 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T23:53:00.016 INFO:teuthology.orchestra.run.smithi150.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T23:53:00.016 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T23:53:00.016 INFO:teuthology.orchestra.run.smithi150.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T23:53:00.016 INFO:teuthology.orchestra.run.smithi150.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T23:53:00.016 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T23:53:00.016 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T23:53:00.016 INFO:teuthology.orchestra.run.smithi150.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T23:53:00.016 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T23:53:00.016 INFO:teuthology.orchestra.run.smithi150.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T23:53:00.016 INFO:teuthology.orchestra.run.smithi150.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T23:53:00.016 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T23:53:00.017 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T23:53:00.017 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T23:53:00.017 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T23:53:00.017 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T23:53:00.017 INFO:teuthology.orchestra.run.smithi150.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T23:53:00.017 INFO:teuthology.orchestra.run.smithi150.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T23:53:00.017 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T23:53:00.017 INFO:teuthology.orchestra.run.smithi150.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T23:53:00.017 INFO:teuthology.orchestra.run.smithi150.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T23:53:00.017 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T23:53:00.017 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T23:53:00.017 INFO:teuthology.orchestra.run.smithi150.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T23:53:00.018 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T23:53:00.018 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T23:53:00.018 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T23:53:00.018 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T23:53:00.018 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T23:53:00.018 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T23:53:00.018 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T23:53:00.018 INFO:teuthology.orchestra.run.smithi150.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T23:53:00.018 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T23:53:00.018 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T23:53:00.018 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T23:53:00.018 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T23:53:00.018 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T23:53:00.019 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T23:53:00.019 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T23:53:00.019 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T23:53:00.019 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T23:53:00.019 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T23:53:00.019 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T23:53:00.019 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T23:53:00.019 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T23:53:00.019 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T23:53:00.019 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T23:53:00.019 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T23:53:00.019 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T23:53:00.019 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T23:53:00.020 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T23:53:00.020 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T23:53:00.020 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T23:53:00.020 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T23:53:00.020 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T23:53:00.020 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T23:53:00.020 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T23:53:00.020 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T23:53:00.020 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T23:53:00.020 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T23:53:00.020 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T23:53:00.020 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T23:53:00.020 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T23:53:00.021 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T23:53:00.022 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T23:53:00.022 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T23:53:00.022 INFO:teuthology.orchestra.run.smithi150.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T23:53:00.022 INFO:teuthology.orchestra.run.smithi150.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T23:53:00.022 INFO:teuthology.orchestra.run.smithi150.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T23:53:00.022 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T23:53:00.022 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T23:53:00.022 INFO:teuthology.orchestra.run.smithi150.stdout:Enabling module streams: 2024-05-08T23:53:00.022 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql 10 2024-05-08T23:53:00.022 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-08T23:53:00.022 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction Summary 2024-05-08T23:53:00.022 INFO:teuthology.orchestra.run.smithi150.stdout:=================================================================================================================================== 2024-05-08T23:53:00.023 INFO:teuthology.orchestra.run.smithi150.stdout:Install 130 Packages 2024-05-08T23:53:00.023 INFO:teuthology.orchestra.run.smithi150.stdout:Upgrade 16 Packages 2024-05-08T23:53:00.023 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-08T23:53:00.023 INFO:teuthology.orchestra.run.smithi150.stdout:Total download size: 215 M 2024-05-08T23:53:00.023 INFO:teuthology.orchestra.run.smithi150.stdout:Downloading Packages: 2024-05-08T23:53:00.234 INFO:teuthology.orchestra.run.smithi081.stdout:(5/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 6.2 MB/s | 1.6 MB 00:00 2024-05-08T23:53:00.388 INFO:teuthology.orchestra.run.smithi171.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 432 kB/s | 166 kB 00:00 2024-05-08T23:53:00.596 INFO:teuthology.orchestra.run.smithi150.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 13 kB/s | 6.4 kB 00:00 2024-05-08T23:53:01.005 INFO:teuthology.orchestra.run.smithi081.stdout:(6/146): ceph-common-18.2.2-1322.gd21e4f96.el8. 11 MB/s | 22 MB 00:01 2024-05-08T23:53:01.068 INFO:teuthology.orchestra.run.smithi081.stdout:(7/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 2.0 MB/s | 2.3 MB 00:01 2024-05-08T23:53:01.134 INFO:teuthology.orchestra.run.smithi081.stdout:(8/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 5.4 MB/s | 4.8 MB 00:00 2024-05-08T23:53:01.227 INFO:teuthology.orchestra.run.smithi081.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 265 kB/s | 24 kB 00:00 2024-05-08T23:53:01.238 INFO:teuthology.orchestra.run.smithi150.stdout:(2/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.3 MB/s | 860 kB 00:00 2024-05-08T23:53:01.438 INFO:teuthology.orchestra.run.smithi150.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 830 kB/s | 166 kB 00:00 2024-05-08T23:53:02.316 INFO:teuthology.orchestra.run.smithi171.stdout:(4/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 1.2 MB/s | 2.3 MB 00:01 2024-05-08T23:53:02.756 INFO:teuthology.orchestra.run.smithi171.stdout:(5/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 1.6 MB/s | 5.5 MB 00:03 2024-05-08T23:53:02.855 INFO:teuthology.orchestra.run.smithi150.stdout:(4/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 1.6 MB/s | 2.3 MB 00:01 2024-05-08T23:53:02.960 INFO:teuthology.orchestra.run.smithi081.stdout:(10/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x8 9.4 MB/s | 18 MB 00:01 2024-05-08T23:53:03.069 INFO:teuthology.orchestra.run.smithi081.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 2.4 MB/s | 261 kB 00:00 2024-05-08T23:53:03.161 INFO:teuthology.orchestra.run.smithi081.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 337 kB/s | 31 kB 00:00 2024-05-08T23:53:03.389 INFO:teuthology.orchestra.run.smithi150.stdout:(5/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 2.9 MB/s | 1.6 MB 00:00 2024-05-08T23:53:03.694 INFO:teuthology.orchestra.run.smithi081.stdout:(13/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 1.4 MB/s | 782 kB 00:00 2024-05-08T23:53:03.761 INFO:teuthology.orchestra.run.smithi171.stdout:(6/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 4.8 MB/s | 4.8 MB 00:01 2024-05-08T23:53:03.769 INFO:teuthology.orchestra.run.smithi081.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 1.9 MB/s | 142 kB 00:00 2024-05-08T23:53:03.806 INFO:teuthology.orchestra.run.smithi171.stdout:(7/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 1.0 MB/s | 1.6 MB 00:01 2024-05-08T23:53:03.861 INFO:teuthology.orchestra.run.smithi081.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 1.5 MB/s | 139 kB 00:00 2024-05-08T23:53:03.987 INFO:teuthology.orchestra.run.smithi081.stdout:(16/146): libradosstriper1-18.2.2-1322.gd21e4f9 3.7 MB/s | 474 kB 00:00 2024-05-08T23:53:04.339 INFO:teuthology.orchestra.run.smithi150.stdout:(6/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 5.1 MB/s | 4.8 MB 00:00 2024-05-08T23:53:05.420 INFO:teuthology.orchestra.run.smithi081.stdout:(17/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 4.6 MB/s | 6.5 MB 00:01 2024-05-08T23:53:05.456 INFO:teuthology.orchestra.run.smithi171.stdout:(8/146): ceph-common-18.2.2-1322.gd21e4f96.el8. 3.5 MB/s | 22 MB 00:06 2024-05-08T23:53:05.487 INFO:teuthology.orchestra.run.smithi081.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 671 kB/s | 45 kB 00:00 2024-05-08T23:53:05.540 INFO:teuthology.orchestra.run.smithi171.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 293 kB/s | 24 kB 00:00 2024-05-08T23:53:05.571 INFO:teuthology.orchestra.run.smithi081.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 1.5 MB/s | 129 kB 00:00 2024-05-08T23:53:05.663 INFO:teuthology.orchestra.run.smithi081.stdout:(20/146): python3-cephfs-18.2.2-1322.gd21e4f96. 2.1 MB/s | 197 kB 00:00 2024-05-08T23:53:05.816 INFO:teuthology.orchestra.run.smithi081.stdout:(21/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el 2.8 MB/s | 13 MB 00:04 2024-05-08T23:53:05.855 INFO:teuthology.orchestra.run.smithi081.stdout:(22/146): python3-rados-18.2.2-1322.gd21e4f96.e 1.9 MB/s | 370 kB 00:00 2024-05-08T23:53:05.947 INFO:teuthology.orchestra.run.smithi081.stdout:(23/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 1.1 MB/s | 107 kB 00:00 2024-05-08T23:53:05.981 INFO:teuthology.orchestra.run.smithi081.stdout:(24/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 2.2 MB/s | 365 kB 00:00 2024-05-08T23:53:06.056 INFO:teuthology.orchestra.run.smithi081.stdout:(25/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 875 kB/s | 95 kB 00:00 2024-05-08T23:53:06.139 INFO:teuthology.orchestra.run.smithi081.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 2.1 MB/s | 181 kB 00:00 2024-05-08T23:53:06.240 INFO:teuthology.orchestra.run.smithi081.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1322.g 242 kB/s | 24 kB 00:00 2024-05-08T23:53:06.340 INFO:teuthology.orchestra.run.smithi081.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 1.4 MB/s | 138 kB 00:00 2024-05-08T23:53:06.880 INFO:teuthology.orchestra.run.smithi150.stdout:(7/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x86 7.2 MB/s | 18 MB 00:02 2024-05-08T23:53:07.257 INFO:teuthology.orchestra.run.smithi081.stdout:(29/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 3.8 MB/s | 3.5 MB 00:00 2024-05-08T23:53:07.457 INFO:teuthology.orchestra.run.smithi081.stdout:(30/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 2.3 MB/s | 3.5 MB 00:01 2024-05-08T23:53:07.649 INFO:teuthology.orchestra.run.smithi081.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 1.3 MB/s | 245 kB 00:00 2024-05-08T23:53:07.749 INFO:teuthology.orchestra.run.smithi081.stdout:(32/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 491 kB/s | 49 kB 00:00 2024-05-08T23:53:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1322.gd 150 kB/s | 16 kB 00:00 2024-05-08T23:53:08.079 INFO:teuthology.orchestra.run.smithi081.stdout:(34/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 1.2 MB/s | 263 kB 00:00 2024-05-08T23:53:08.200 INFO:teuthology.orchestra.run.smithi081.stdout:(35/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 1.4 MB/s | 170 kB 00:00 2024-05-08T23:53:08.300 INFO:teuthology.orchestra.run.smithi081.stdout:(36/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 181 kB/s | 18 kB 00:00 2024-05-08T23:53:08.565 INFO:teuthology.orchestra.run.smithi171.stdout:(10/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x8 3.8 MB/s | 18 MB 00:04 2024-05-08T23:53:08.715 INFO:teuthology.orchestra.run.smithi171.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 1.7 MB/s | 261 kB 00:00 2024-05-08T23:53:08.722 INFO:teuthology.orchestra.run.smithi150.stdout:(8/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el8 7.1 MB/s | 13 MB 00:01 2024-05-08T23:53:08.782 INFO:teuthology.orchestra.run.smithi171.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 465 kB/s | 31 kB 00:00 2024-05-08T23:53:08.806 INFO:teuthology.orchestra.run.smithi150.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 292 kB/s | 24 kB 00:00 2024-05-08T23:53:08.826 INFO:teuthology.orchestra.run.smithi081.stdout:(37/146): gperftools-libs-2.7-9.el8.x86_64.rpm 583 kB/s | 306 kB 00:00 2024-05-08T23:53:08.944 INFO:teuthology.orchestra.run.smithi081.stdout:(38/146): ceph-mgr-diskprediction-local-18.2.2- 4.4 MB/s | 7.4 MB 00:01 2024-05-08T23:53:08.956 INFO:teuthology.orchestra.run.smithi150.stdout:(10/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x 637 kB/s | 5.5 MB 00:08 2024-05-08T23:53:08.968 INFO:teuthology.orchestra.run.smithi081.stdout:(39/146): liboath-2.6.2-3.el8.x86_64.rpm 415 kB/s | 59 kB 00:00 2024-05-08T23:53:09.015 INFO:teuthology.orchestra.run.smithi171.stdout:(13/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 3.3 MB/s | 782 kB 00:00 2024-05-08T23:53:09.099 INFO:teuthology.orchestra.run.smithi171.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 1.7 MB/s | 142 kB 00:00 2024-05-08T23:53:09.152 INFO:teuthology.orchestra.run.smithi081.stdout:(40/146): python3-asyncssh-2.7.0-2.el8.noarch.r 2.5 MB/s | 476 kB 00:00 2024-05-08T23:53:09.173 INFO:teuthology.orchestra.run.smithi150.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 1.2 MB/s | 261 kB 00:00 2024-05-08T23:53:09.174 INFO:teuthology.orchestra.run.smithi171.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 1.8 MB/s | 139 kB 00:00 2024-05-08T23:53:09.261 INFO:teuthology.orchestra.run.smithi081.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 402 kB/s | 44 kB 00:00 2024-05-08T23:53:09.294 INFO:teuthology.orchestra.run.smithi081.stdout:(42/146): libunwind-1.3.1-3.el8.x86_64.rpm 215 kB/s | 75 kB 00:00 2024-05-08T23:53:09.333 INFO:teuthology.orchestra.run.smithi150.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 194 kB/s | 31 kB 00:00 2024-05-08T23:53:09.341 INFO:teuthology.orchestra.run.smithi171.stdout:(16/146): libradosstriper1-18.2.2-1322.gd21e4f9 2.8 MB/s | 474 kB 00:00 2024-05-08T23:53:09.361 INFO:teuthology.orchestra.run.smithi081.stdout:(43/146): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2024-05-08T23:53:09.411 INFO:teuthology.orchestra.run.smithi081.stdout:(44/146): python3-cachetools-3.1.1-4.el8.noarch 282 kB/s | 33 kB 00:00 2024-05-08T23:53:09.453 INFO:teuthology.orchestra.run.smithi081.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 177 kB/s | 16 kB 00:00 2024-05-08T23:53:09.579 INFO:teuthology.orchestra.run.smithi081.stdout:(46/146): python3-cherrypy-18.4.0-1.el8.noarch. 3.0 MB/s | 384 kB 00:00 2024-05-08T23:53:09.629 INFO:teuthology.orchestra.run.smithi081.stdout:(47/146): python3-cheroot-8.5.2-1.el8.noarch.rp 794 kB/s | 173 kB 00:00 2024-05-08T23:53:09.671 INFO:teuthology.orchestra.run.smithi081.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 886 kB/s | 81 kB 00:00 2024-05-08T23:53:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2024-05-08T23:53:09.798 INFO:teuthology.orchestra.run.smithi081.stdout:(50/146): python3-jaraco-functools-2.0-4.el8.no 138 kB/s | 18 kB 00:00 2024-05-08T23:53:09.824 INFO:teuthology.orchestra.run.smithi150.stdout:(13/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 1.6 MB/s | 782 kB 00:00 2024-05-08T23:53:09.905 INFO:teuthology.orchestra.run.smithi081.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 458 kB/s | 49 kB 00:00 2024-05-08T23:53:09.932 INFO:teuthology.orchestra.run.smithi150.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 1.3 MB/s | 142 kB 00:00 2024-05-08T23:53:09.997 INFO:teuthology.orchestra.run.smithi081.stdout:(52/146): python3-more-itertools-7.2.0-3.el8.no 641 kB/s | 59 kB 00:00 2024-05-08T23:53:10.024 INFO:teuthology.orchestra.run.smithi150.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 1.5 MB/s | 139 kB 00:00 2024-05-08T23:53:10.316 INFO:teuthology.orchestra.run.smithi150.stdout:(16/146): libradosstriper1-18.2.2-1322.gd21e4f9 1.6 MB/s | 474 kB 00:00 2024-05-08T23:53:10.522 INFO:teuthology.orchestra.run.smithi081.stdout:(53/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 5.1 MB/s | 47 MB 00:09 2024-05-08T23:53:10.808 INFO:teuthology.orchestra.run.smithi171.stdout:(17/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 4.5 MB/s | 6.5 MB 00:01 2024-05-08T23:53:10.822 INFO:teuthology.orchestra.run.smithi081.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 73 kB/s | 60 kB 00:00 2024-05-08T23:53:10.889 INFO:teuthology.orchestra.run.smithi081.stdout:(55/146): python3-kubernetes-11.0.0-6.el8.noarc 1.0 MB/s | 1.2 MB 00:01 2024-05-08T23:53:10.915 INFO:teuthology.orchestra.run.smithi081.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2024-05-08T23:53:11.006 INFO:teuthology.orchestra.run.smithi081.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 289 kB/s | 34 kB 00:00 2024-05-08T23:53:11.040 INFO:teuthology.orchestra.run.smithi081.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2024-05-08T23:53:11.099 INFO:teuthology.orchestra.run.smithi081.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 693 kB/s | 64 kB 00:00 2024-05-08T23:53:11.132 INFO:teuthology.orchestra.run.smithi081.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 204 kB/s | 19 kB 00:00 2024-05-08T23:53:11.191 INFO:teuthology.orchestra.run.smithi081.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 261 kB/s | 24 kB 00:00 2024-05-08T23:53:11.191 INFO:teuthology.orchestra.run.smithi171.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 116 kB/s | 45 kB 00:00 2024-05-08T23:53:11.225 INFO:teuthology.orchestra.run.smithi081.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 318 kB/s | 29 kB 00:00 2024-05-08T23:53:11.250 INFO:teuthology.orchestra.run.smithi081.stdout:(63/146): python3-pecan-1.3.2-9.el8.noarch.rpm 389 kB/s | 283 kB 00:00 2024-05-08T23:53:11.283 INFO:teuthology.orchestra.run.smithi171.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 1.4 MB/s | 129 kB 00:00 2024-05-08T23:53:11.317 INFO:teuthology.orchestra.run.smithi081.stdout:(64/146): python3-trustme-0.6.0-4.el8.noarch.rp 219 kB/s | 27 kB 00:00 2024-05-08T23:53:11.342 INFO:teuthology.orchestra.run.smithi081.stdout:(65/146): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2024-05-08T23:53:11.375 INFO:teuthology.orchestra.run.smithi171.stdout:(20/146): python3-cephfs-18.2.2-1322.gd21e4f96. 2.1 MB/s | 197 kB 00:00 2024-05-08T23:53:11.392 INFO:teuthology.orchestra.run.smithi081.stdout:(66/146): python3-webob-1.8.5-1.el8.1.noarch.rp 1.7 MB/s | 251 kB 00:00 2024-05-08T23:53:11.418 INFO:teuthology.orchestra.run.smithi081.stdout:(67/146): python3-websocket-client-0.56.0-5.el8 610 kB/s | 61 kB 00:00 2024-05-08T23:53:11.443 INFO:teuthology.orchestra.run.smithi081.stdout:(68/146): python3-webtest-2.0.33-1.el8.noarch.r 851 kB/s | 85 kB 00:00 2024-05-08T23:53:11.477 INFO:teuthology.orchestra.run.smithi081.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.0 MB/s | 70 kB 00:00 2024-05-08T23:53:11.511 INFO:teuthology.orchestra.run.smithi081.stdout:(70/146): python3-zc-lockfile-2.0-2.el8.noarch. 195 kB/s | 23 kB 00:00 2024-05-08T23:53:11.542 INFO:teuthology.orchestra.run.smithi171.stdout:(21/146): python3-rados-18.2.2-1322.gd21e4f96.e 2.2 MB/s | 370 kB 00:00 2024-05-08T23:53:11.627 INFO:teuthology.orchestra.run.smithi081.stdout:(71/146): thrift-0.13.0-2.el8.x86_64.rpm 8.3 MB/s | 1.7 MB 00:00 2024-05-08T23:53:11.661 INFO:teuthology.orchestra.run.smithi081.stdout:(72/146): python3-prettytable-0.7.2-14.el8.noar 293 kB/s | 44 kB 00:00 2024-05-08T23:53:11.667 INFO:teuthology.orchestra.run.smithi171.stdout:(22/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 2.9 MB/s | 365 kB 00:00 2024-05-08T23:53:11.686 INFO:teuthology.orchestra.run.smithi081.stdout:(73/146): python3-jsonpointer-1.10-11.el8.noarc 96 kB/s | 20 kB 00:00 2024-05-08T23:53:11.687 INFO:teuthology.orchestra.run.smithi150.stdout:(17/146): ceph-common-18.2.2-1322.gd21e4f96.el8 1.9 MB/s | 22 MB 00:11 2024-05-08T23:53:11.775 INFO:teuthology.orchestra.run.smithi150.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 511 kB/s | 45 kB 00:00 2024-05-08T23:53:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:(74/146): python3-pyasn1-modules-0.3.7-6.el8.no 731 kB/s | 110 kB 00:00 2024-05-08T23:53:11.804 INFO:teuthology.orchestra.run.smithi081.stdout:(75/146): python3-jsonpatch-1.21-2.el8.noarch.r 194 kB/s | 27 kB 00:00 2024-05-08T23:53:11.818 INFO:teuthology.orchestra.run.smithi171.stdout:(23/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el 1.6 MB/s | 13 MB 00:08 2024-05-08T23:53:11.843 INFO:teuthology.orchestra.run.smithi171.stdout:(24/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 609 kB/s | 107 kB 00:00 2024-05-08T23:53:11.862 INFO:teuthology.orchestra.run.smithi081.stdout:(76/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 720 kB/s | 126 kB 00:00 2024-05-08T23:53:11.896 INFO:teuthology.orchestra.run.smithi081.stdout:(77/146): python3-werkzeug-0.12.2-4.el8.noarch. 3.8 MB/s | 457 kB 00:00 2024-05-08T23:53:11.904 INFO:teuthology.orchestra.run.smithi171.stdout:(25/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.1 MB/s | 95 kB 00:00 2024-05-08T23:53:11.908 INFO:teuthology.orchestra.run.smithi150.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 969 kB/s | 129 kB 00:00 2024-05-08T23:53:11.963 INFO:teuthology.orchestra.run.smithi081.stdout:(78/146): bison-3.0.4-10.el8.x86_64.rpm 4.2 MB/s | 688 kB 00:00 2024-05-08T23:53:12.021 INFO:teuthology.orchestra.run.smithi171.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 1.6 MB/s | 181 kB 00:00 2024-05-08T23:53:12.038 INFO:teuthology.orchestra.run.smithi081.stdout:(79/146): libtool-2.4.6-25.el8.x86_64.rpm 4.9 MB/s | 709 kB 00:00 2024-05-08T23:53:12.063 INFO:teuthology.orchestra.run.smithi081.stdout:(80/146): flex-2.6.1-9.el8.x86_64.rpm 1.6 MB/s | 320 kB 00:00 2024-05-08T23:53:12.069 INFO:teuthology.orchestra.run.smithi171.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1322.g 486 kB/s | 24 kB 00:00 2024-05-08T23:53:12.126 INFO:teuthology.orchestra.run.smithi150.stdout:(20/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 3.6 MB/s | 6.5 MB 00:01 2024-05-08T23:53:12.127 INFO:teuthology.orchestra.run.smithi171.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 2.3 MB/s | 138 kB 00:00 2024-05-08T23:53:12.142 INFO:teuthology.orchestra.run.smithi150.stdout:(21/146): python3-cephfs-18.2.2-1322.gd21e4f96. 842 kB/s | 197 kB 00:00 2024-05-08T23:53:12.205 INFO:teuthology.orchestra.run.smithi081.stdout:(81/146): python3-markupsafe-0.23-19.el8.x86_64 160 kB/s | 39 kB 00:00 2024-05-08T23:53:12.230 INFO:teuthology.orchestra.run.smithi081.stdout:(82/146): uuid-1.6.2-43.el8.x86_64.rpm 384 kB/s | 64 kB 00:00 2024-05-08T23:53:12.259 INFO:teuthology.orchestra.run.smithi150.stdout:(22/146): python3-rados-18.2.2-1322.gd21e4f96.e 2.7 MB/s | 370 kB 00:00 2024-05-08T23:53:12.293 INFO:teuthology.orchestra.run.smithi150.stdout:(23/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 2.4 MB/s | 365 kB 00:00 2024-05-08T23:53:12.297 INFO:teuthology.orchestra.run.smithi081.stdout:(83/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.0 MB/s | 259 kB 00:00 2024-05-08T23:53:12.331 INFO:teuthology.orchestra.run.smithi081.stdout:(84/146): python3-pyOpenSSL-19.0.0-1.el8.noarch 825 kB/s | 103 kB 00:00 2024-05-08T23:53:12.343 INFO:teuthology.orchestra.run.smithi150.stdout:(24/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 1.2 MB/s | 107 kB 00:00 2024-05-08T23:53:12.377 INFO:teuthology.orchestra.run.smithi150.stdout:(25/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.1 MB/s | 95 kB 00:00 2024-05-08T23:53:12.423 INFO:teuthology.orchestra.run.smithi081.stdout:(85/146): python3-jinja2-2.10.1-3.el8.noarch.rp 4.2 MB/s | 538 kB 00:00 2024-05-08T23:53:12.494 INFO:teuthology.orchestra.run.smithi150.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 1.5 MB/s | 181 kB 00:00 2024-05-08T23:53:12.506 INFO:teuthology.orchestra.run.smithi081.stdout:(86/146): python3-babel-2.5.1-7.el8.noarch.rpm 17 MB/s | 4.8 MB 00:00 2024-05-08T23:53:12.557 INFO:teuthology.orchestra.run.smithi081.stdout:(87/146): socat-1.7.4.1-1.el8.x86_64.rpm 2.4 MB/s | 323 kB 00:00 2024-05-08T23:53:12.569 INFO:teuthology.orchestra.run.smithi171.stdout:(29/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 4.8 MB/s | 3.5 MB 00:00 2024-05-08T23:53:12.577 INFO:teuthology.orchestra.run.smithi150.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1322.g 291 kB/s | 24 kB 00:00 2024-05-08T23:53:12.632 INFO:teuthology.orchestra.run.smithi081.stdout:(88/146): python3-numpy-1.14.3-10.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2024-05-08T23:53:12.658 INFO:teuthology.orchestra.run.smithi081.stdout:(89/146): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.5 MB/s | 225 kB 00:00 2024-05-08T23:53:12.670 INFO:teuthology.orchestra.run.smithi150.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 1.5 MB/s | 138 kB 00:00 2024-05-08T23:53:12.716 INFO:teuthology.orchestra.run.smithi081.stdout:(90/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.2 MB/s | 354 kB 00:00 2024-05-08T23:53:12.783 INFO:teuthology.orchestra.run.smithi081.stdout:(91/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2024-05-08T23:53:12.867 INFO:teuthology.orchestra.run.smithi081.stdout:(92/146): openblas-threads-0.3.15-6.el8.x86_64. 22 MB/s | 5.2 MB 00:00 2024-05-08T23:53:12.925 INFO:teuthology.orchestra.run.smithi081.stdout:(93/146): automake-1.16.1-8.el8.noarch.rpm 4.9 MB/s | 714 kB 00:00 2024-05-08T23:53:13.025 INFO:teuthology.orchestra.run.smithi081.stdout:(94/146): openblas-0.3.15-6.el8.x86_64.rpm 16 MB/s | 5.0 MB 00:00 2024-05-08T23:53:13.051 INFO:teuthology.orchestra.run.smithi081.stdout:(95/146): libpq-13.11-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2024-05-08T23:53:13.078 INFO:teuthology.orchestra.run.smithi081.stdout:(96/146): jq-1.6-7.el8.x86_64.rpm 1.3 MB/s | 202 kB 00:00 2024-05-08T23:53:13.161 INFO:teuthology.orchestra.run.smithi150.stdout:(29/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 4.2 MB/s | 3.5 MB 00:00 2024-05-08T23:53:13.168 INFO:teuthology.orchestra.run.smithi081.stdout:(97/146): python3-pytz-2017.2-11.el8.noarch.rpm 382 kB/s | 54 kB 00:00 2024-05-08T23:53:13.277 INFO:teuthology.orchestra.run.smithi081.stdout:(98/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 938 kB/s | 188 kB 00:00 2024-05-08T23:53:13.311 INFO:teuthology.orchestra.run.smithi171.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 3.0 MB/s | 3.5 MB 00:01 2024-05-08T23:53:13.336 INFO:teuthology.orchestra.run.smithi081.stdout:(99/146): postgresql-10.23-4.module+el8.9.0+213 9.0 MB/s | 1.5 MB 00:00 2024-05-08T23:53:13.395 INFO:teuthology.orchestra.run.smithi171.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 2.9 MB/s | 245 kB 00:00 2024-05-08T23:53:13.453 INFO:teuthology.orchestra.run.smithi171.stdout:(32/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 844 kB/s | 49 kB 00:00 2024-05-08T23:53:13.502 INFO:teuthology.orchestra.run.smithi081.stdout:(100/146): python3-scipy-1.0.0-21.module+el8.9. 30 MB/s | 14 MB 00:00 2024-05-08T23:53:13.512 INFO:teuthology.orchestra.run.smithi171.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1322.gd 280 kB/s | 16 kB 00:00 2024-05-08T23:53:13.561 INFO:teuthology.orchestra.run.smithi081.stdout:(101/146): postgresql-contrib-10.23-4.module+el 2.8 MB/s | 812 kB 00:00 2024-05-08T23:53:13.586 INFO:teuthology.orchestra.run.smithi081.stdout:(102/146): libverto-devel-0.3.0-5.el8.x86_64.rp 215 kB/s | 18 kB 00:00 2024-05-08T23:53:13.603 INFO:teuthology.orchestra.run.smithi150.stdout:(30/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 9.8 MB/s | 47 MB 00:04 2024-05-08T23:53:13.604 INFO:teuthology.orchestra.run.smithi171.stdout:(34/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 2.8 MB/s | 263 kB 00:00 2024-05-08T23:53:13.653 INFO:teuthology.orchestra.run.smithi081.stdout:(103/146): python3-jwt-1.6.1-2.el8.noarch.rpm 463 kB/s | 43 kB 00:00 2024-05-08T23:53:13.678 INFO:teuthology.orchestra.run.smithi081.stdout:(104/146): python3-oauthlib-2.1.0-1.el8.noarch. 1.6 MB/s | 155 kB 00:00 2024-05-08T23:53:13.695 INFO:teuthology.orchestra.run.smithi150.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 2.6 MB/s | 245 kB 00:00 2024-05-08T23:53:13.738 INFO:teuthology.orchestra.run.smithi171.stdout:(35/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 1.2 MB/s | 170 kB 00:00 2024-05-08T23:53:13.754 INFO:teuthology.orchestra.run.smithi081.stdout:(105/146): postgresql-server-10.23-4.module+el8 12 MB/s | 5.1 MB 00:00 2024-05-08T23:53:13.787 INFO:teuthology.orchestra.run.smithi150.stdout:(32/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 3.2 MB/s | 3.5 MB 00:01 2024-05-08T23:53:13.796 INFO:teuthology.orchestra.run.smithi171.stdout:(36/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 311 kB/s | 18 kB 00:00 2024-05-08T23:53:13.844 INFO:teuthology.orchestra.run.smithi150.stdout:(33/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 332 kB/s | 49 kB 00:00 2024-05-08T23:53:13.845 INFO:teuthology.orchestra.run.smithi081.stdout:(106/146): python3-requests-oauthlib-1.0.0-1.el 255 kB/s | 43 kB 00:00 2024-05-08T23:53:13.871 INFO:teuthology.orchestra.run.smithi081.stdout:(107/146): python3-pycparser-2.14-14.el8.noarch 502 kB/s | 109 kB 00:00 2024-05-08T23:53:13.871 INFO:teuthology.orchestra.run.smithi150.stdout:(34/146): ceph-prometheus-alerts-18.2.2-1322.gd 195 kB/s | 16 kB 00:00 2024-05-08T23:53:13.888 INFO:teuthology.orchestra.run.smithi081.stdout:(108/146): libaio-devel-0.3.112-1.el8.x86_64.rp 140 kB/s | 19 kB 00:00 2024-05-08T23:53:13.921 INFO:teuthology.orchestra.run.smithi150.stdout:(35/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 3.3 MB/s | 263 kB 00:00 2024-05-08T23:53:13.922 INFO:teuthology.orchestra.run.smithi081.stdout:(109/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 580 kB/s | 44 kB 00:00 2024-05-08T23:53:13.947 INFO:teuthology.orchestra.run.smithi150.stdout:(36/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 2.2 MB/s | 170 kB 00:00 2024-05-08T23:53:13.963 INFO:teuthology.orchestra.run.smithi081.stdout:(110/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2024-05-08T23:53:13.980 INFO:teuthology.orchestra.run.smithi150.stdout:(37/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 308 kB/s | 18 kB 00:00 2024-05-08T23:53:13.997 INFO:teuthology.orchestra.run.smithi171.stdout:(37/146): ceph-mgr-diskprediction-local-18.2.2- 5.2 MB/s | 7.4 MB 00:01 2024-05-08T23:53:13.997 INFO:teuthology.orchestra.run.smithi081.stdout:(111/146): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2024-05-08T23:53:14.022 INFO:teuthology.orchestra.run.smithi081.stdout:(112/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.1 MB/s | 220 kB 00:00 2024-05-08T23:53:14.047 INFO:teuthology.orchestra.run.smithi171.stdout:(38/146): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2024-05-08T23:53:14.072 INFO:teuthology.orchestra.run.smithi081.stdout:(113/146): libselinux-devel-2.9-5.el8.x86_64.rp 1.8 MB/s | 200 kB 00:00 2024-05-08T23:53:14.106 INFO:teuthology.orchestra.run.smithi171.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2024-05-08T23:53:14.131 INFO:teuthology.orchestra.run.smithi081.stdout:(114/146): keyutils-libs-devel-1.5.10-9.el8.x86 359 kB/s | 48 kB 00:00 2024-05-08T23:53:14.147 INFO:teuthology.orchestra.run.smithi171.stdout:(40/146): liboath-2.6.2-3.el8.x86_64.rpm 391 kB/s | 59 kB 00:00 2024-05-08T23:53:14.156 INFO:teuthology.orchestra.run.smithi081.stdout:(115/146): libsepol-devel-2.9-3.el8.x86_64.rpm 650 kB/s | 87 kB 00:00 2024-05-08T23:53:14.223 INFO:teuthology.orchestra.run.smithi081.stdout:(116/146): zlib-devel-1.2.11-18.el8_5.x86_64.rp 383 kB/s | 58 kB 00:00 2024-05-08T23:53:14.231 INFO:teuthology.orchestra.run.smithi171.stdout:(41/146): python3-asyncssh-2.7.0-2.el8.noarch.r 3.7 MB/s | 476 kB 00:00 2024-05-08T23:53:14.249 INFO:teuthology.orchestra.run.smithi081.stdout:(117/146): fuse-2.9.7-17.el8.x86_64.rpm 904 kB/s | 83 kB 00:00 2024-05-08T23:53:14.256 INFO:teuthology.orchestra.run.smithi171.stdout:(42/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 402 kB/s | 44 kB 00:00 2024-05-08T23:53:14.281 INFO:teuthology.orchestra.run.smithi171.stdout:(43/146): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2024-05-08T23:53:14.307 INFO:teuthology.orchestra.run.smithi150.stdout:(38/146): ceph-mgr-diskprediction-local-18.2.2- 6.5 MB/s | 7.4 MB 00:01 2024-05-08T23:53:14.315 INFO:teuthology.orchestra.run.smithi171.stdout:(44/146): python3-cachetools-3.1.1-4.el8.noarch 565 kB/s | 33 kB 00:00 2024-05-08T23:53:14.315 INFO:teuthology.orchestra.run.smithi081.stdout:(118/146): libcom_err-devel-1.45.6-4.el8.x86_64 210 kB/s | 39 kB 00:00 2024-05-08T23:53:14.340 INFO:teuthology.orchestra.run.smithi171.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 278 kB/s | 16 kB 00:00 2024-05-08T23:53:14.341 INFO:teuthology.orchestra.run.smithi081.stdout:(119/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.8 MB/s | 172 kB 00:00 2024-05-08T23:53:14.359 INFO:teuthology.orchestra.run.smithi150.stdout:(39/146): liboath-2.6.2-3.el8.x86_64.rpm 155 kB/s | 59 kB 00:00 2024-05-08T23:53:14.399 INFO:teuthology.orchestra.run.smithi171.stdout:(46/146): python3-cherrypy-18.4.0-1.el8.noarch. 6.5 MB/s | 384 kB 00:00 2024-05-08T23:53:14.407 INFO:teuthology.orchestra.run.smithi081.stdout:(120/146): libgfortran-8.5.0-20.el8.x86_64.rpm 3.4 MB/s | 645 kB 00:00 2024-05-08T23:53:14.442 INFO:teuthology.orchestra.run.smithi081.stdout:(121/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 238 kB 00:00 2024-05-08T23:53:14.465 INFO:teuthology.orchestra.run.smithi150.stdout:(40/146): gperftools-libs-2.7-9.el8.x86_64.rpm 591 kB/s | 306 kB 00:00 2024-05-08T23:53:14.475 INFO:teuthology.orchestra.run.smithi081.stdout:(122/146): xfsprogs-devel-5.0.0-12.el8.x86_64.r 543 kB/s | 73 kB 00:00 2024-05-08T23:53:14.509 INFO:teuthology.orchestra.run.smithi081.stdout:(123/146): elfutils-libelf-devel-0.189-3.el8.x8 610 kB/s | 62 kB 00:00 2024-05-08T23:53:14.584 INFO:teuthology.orchestra.run.smithi081.stdout:(124/146): krb5-devel-1.18.2-26.el8_9.x86_64.rp 3.9 MB/s | 562 kB 00:00 2024-05-08T23:53:14.609 INFO:teuthology.orchestra.run.smithi081.stdout:(125/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 470 kB/s | 47 kB 00:00 2024-05-08T23:53:14.648 INFO:teuthology.orchestra.run.smithi150.stdout:(41/146): libunwind-1.3.1-3.el8.x86_64.rpm 219 kB/s | 75 kB 00:00 2024-05-08T23:53:14.726 INFO:teuthology.orchestra.run.smithi081.stdout:(126/146): openssl-devel-1.1.1k-12.el8_9.x86_64 9.3 MB/s | 2.3 MB 00:00 2024-05-08T23:53:14.751 INFO:teuthology.orchestra.run.smithi081.stdout:(127/146): NetworkManager-initscripts-updown-1. 1.0 MB/s | 144 kB 00:00 2024-05-08T23:53:14.785 INFO:teuthology.orchestra.run.smithi081.stdout:(128/146): python3-cryptography-3.2.1-7.el8_9.x 2.7 MB/s | 559 kB 00:00 2024-05-08T23:53:14.807 INFO:teuthology.orchestra.run.smithi150.stdout:(42/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 127 kB/s | 44 kB 00:00 2024-05-08T23:53:14.827 INFO:teuthology.orchestra.run.smithi081.stdout:(129/146): libuuid-devel-2.32.1-44.el8_9.1.x86_ 992 kB/s | 100 kB 00:00 2024-05-08T23:53:14.850 INFO:teuthology.orchestra.run.smithi171.stdout:(47/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 5.1 MB/s | 47 MB 00:09 2024-05-08T23:53:14.875 INFO:teuthology.orchestra.run.smithi171.stdout:(48/146): python3-cheroot-8.5.2-1.el8.noarch.rp 309 kB/s | 173 kB 00:00 2024-05-08T23:53:14.900 INFO:teuthology.orchestra.run.smithi171.stdout:(49/146): python3-google-auth-1.1.1-10.el8.noar 162 kB/s | 81 kB 00:00 2024-05-08T23:53:14.925 INFO:teuthology.orchestra.run.smithi171.stdout:(50/146): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2024-05-08T23:53:14.951 INFO:teuthology.orchestra.run.smithi171.stdout:(51/146): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2024-05-08T23:53:14.976 INFO:teuthology.orchestra.run.smithi171.stdout:(52/146): python3-logutils-0.3.5-11.el8.noarch. 972 kB/s | 49 kB 00:00 2024-05-08T23:53:14.994 INFO:teuthology.orchestra.run.smithi081.stdout:(130/146): python3-packaging-16.8-9.el8.noarch. 199 kB/s | 48 kB 00:00 2024-05-08T23:53:15.018 INFO:teuthology.orchestra.run.smithi171.stdout:(53/146): python3-kubernetes-11.0.0-6.el8.noarc 9.9 MB/s | 1.2 MB 00:00 2024-05-08T23:53:15.041 INFO:teuthology.orchestra.run.smithi150.stdout:(43/146): python3-beautifulsoup4-4.6.3-2.el8.1. 473 kB/s | 185 kB 00:00 2024-05-08T23:53:15.043 INFO:teuthology.orchestra.run.smithi171.stdout:(54/146): python3-more-itertools-7.2.0-3.el8.no 639 kB/s | 59 kB 00:00 2024-05-08T23:53:15.066 INFO:teuthology.orchestra.run.smithi150.stdout:(44/146): python3-asyncssh-2.7.0-2.el8.noarch.r 674 kB/s | 476 kB 00:00 2024-05-08T23:53:15.068 INFO:teuthology.orchestra.run.smithi171.stdout:(55/146): python3-natsort-7.1.1-2.el8.noarch.rp 654 kB/s | 60 kB 00:00 2024-05-08T23:53:15.091 INFO:teuthology.orchestra.run.smithi150.stdout:(45/146): python3-cachetools-3.1.1-4.el8.noarch 116 kB/s | 33 kB 00:00 2024-05-08T23:53:15.117 INFO:teuthology.orchestra.run.smithi171.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 212 kB/s | 16 kB 00:00 2024-05-08T23:53:15.144 INFO:teuthology.orchestra.run.smithi081.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.5 MB/s | 232 kB 00:00 2024-05-08T23:53:15.152 INFO:teuthology.orchestra.run.smithi171.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 403 kB/s | 34 kB 00:00 2024-05-08T23:53:15.178 INFO:teuthology.orchestra.run.smithi171.stdout:(58/146): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2024-05-08T23:53:15.203 INFO:teuthology.orchestra.run.smithi171.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2024-05-08T23:53:15.228 INFO:teuthology.orchestra.run.smithi171.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 374 kB/s | 19 kB 00:00 2024-05-08T23:53:15.253 INFO:teuthology.orchestra.run.smithi171.stdout:(61/146): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2024-05-08T23:53:15.278 INFO:teuthology.orchestra.run.smithi171.stdout:(62/146): python3-singledispatch-3.4.0.3-18.el8 318 kB/s | 24 kB 00:00 2024-05-08T23:53:15.291 INFO:teuthology.orchestra.run.smithi150.stdout:(46/146): python3-certifi-2018.10.15-7.el8.noar 65 kB/s | 16 kB 00:00 2024-05-08T23:53:15.303 INFO:teuthology.orchestra.run.smithi081.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.9 MB/s | 303 kB 00:00 2024-05-08T23:53:15.303 INFO:teuthology.orchestra.run.smithi171.stdout:(63/146): python3-tempora-1.14.1-5.el8.noarch.r 388 kB/s | 29 kB 00:00 2024-05-08T23:53:15.329 INFO:teuthology.orchestra.run.smithi171.stdout:(64/146): python3-trustme-0.6.0-4.el8.noarch.rp 551 kB/s | 27 kB 00:00 2024-05-08T23:53:15.363 INFO:teuthology.orchestra.run.smithi171.stdout:(65/146): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2024-05-08T23:53:15.420 INFO:teuthology.orchestra.run.smithi171.stdout:(66/146): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2024-05-08T23:53:15.437 INFO:teuthology.orchestra.run.smithi081.stdout:(133/146): iproute-6.2.0-5.el8_9.x86_64.rpm 6.3 MB/s | 854 kB 00:00 2024-05-08T23:53:15.447 INFO:teuthology.orchestra.run.smithi171.stdout:(67/146): python3-websocket-client-0.56.0-5.el8 521 kB/s | 61 kB 00:00 2024-05-08T23:53:15.472 INFO:teuthology.orchestra.run.smithi171.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 445 kB/s | 23 kB 00:00 2024-05-08T23:53:15.487 INFO:teuthology.orchestra.run.smithi081.stdout:(134/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 5.4 MB/s | 3.6 MB 00:00 2024-05-08T23:53:15.497 INFO:teuthology.orchestra.run.smithi171.stdout:(69/146): python3-webtest-2.0.33-1.el8.noarch.r 637 kB/s | 85 kB 00:00 2024-05-08T23:53:15.514 INFO:teuthology.orchestra.run.smithi171.stdout:(70/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2024-05-08T23:53:15.516 INFO:teuthology.orchestra.run.smithi150.stdout:(47/146): python3-cheroot-8.5.2-1.el8.noarch.rp 383 kB/s | 173 kB 00:00 2024-05-08T23:53:15.587 INFO:teuthology.orchestra.run.smithi081.stdout:(135/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 4.6 MB/s | 711 kB 00:00 2024-05-08T23:53:15.606 INFO:teuthology.orchestra.run.smithi171.stdout:(71/146): thrift-0.13.0-2.el8.x86_64.rpm 11 MB/s | 1.7 MB 00:00 2024-05-08T23:53:15.640 INFO:teuthology.orchestra.run.smithi171.stdout:(72/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 143 kB/s | 18 kB 00:00 2024-05-08T23:53:15.654 INFO:teuthology.orchestra.run.smithi081.stdout:(136/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 8.8 MB/s | 1.5 MB 00:00 2024-05-08T23:53:15.670 INFO:teuthology.orchestra.run.smithi150.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 215 kB/s | 81 kB 00:00 2024-05-08T23:53:15.673 INFO:teuthology.orchestra.run.smithi171.stdout:(73/146): python3-packaging-16.8-9.el8.noarch.r 274 kB/s | 48 kB 00:00 2024-05-08T23:53:15.696 INFO:teuthology.orchestra.run.smithi081.stdout:(137/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 3.0 MB/s | 333 kB 00:00 2024-05-08T23:53:15.700 INFO:teuthology.orchestra.run.smithi150.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 60 kB/s | 11 kB 00:00 2024-05-08T23:53:15.767 INFO:teuthology.orchestra.run.smithi150.stdout:(50/146): python3-cherrypy-18.4.0-1.el8.noarch. 569 kB/s | 384 kB 00:00 2024-05-08T23:53:15.773 INFO:teuthology.orchestra.run.smithi171.stdout:(74/146): python3-oauthlib-2.1.0-1.el8.noarch.r 1.2 MB/s | 155 kB 00:00 2024-05-08T23:53:15.790 INFO:teuthology.orchestra.run.smithi171.stdout:(75/146): python3-jwt-1.6.1-2.el8.noarch.rpm 231 kB/s | 43 kB 00:00 2024-05-08T23:53:15.846 INFO:teuthology.orchestra.run.smithi081.stdout:(138/146): librados2-18.2.2-1322.gd21e4f96.el8. 3.5 MB/s | 3.7 MB 00:01 2024-05-08T23:53:15.857 INFO:teuthology.orchestra.run.smithi171.stdout:(76/146): python3-requests-oauthlib-1.0.0-1.el8 512 kB/s | 43 kB 00:00 2024-05-08T23:53:15.888 INFO:teuthology.orchestra.run.smithi081.stdout:(139/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.6 MB/s | 1.1 MB 00:00 2024-05-08T23:53:15.899 INFO:teuthology.orchestra.run.smithi171.stdout:(77/146): python3-pycparser-2.14-14.el8.noarch. 483 kB/s | 109 kB 00:00 2024-05-08T23:53:15.925 INFO:teuthology.orchestra.run.smithi171.stdout:(78/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 140 kB/s | 19 kB 00:00 2024-05-08T23:53:15.947 INFO:teuthology.orchestra.run.smithi081.stdout:(140/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 881 kB/s | 221 kB 00:00 2024-05-08T23:53:15.951 INFO:teuthology.orchestra.run.smithi150.stdout:(51/146): python3-jaraco-functools-2.0-4.el8.no 63 kB/s | 18 kB 00:00 2024-05-08T23:53:16.005 INFO:teuthology.orchestra.run.smithi081.stdout:(141/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 2.0 MB/s | 237 kB 00:00 2024-05-08T23:53:16.025 INFO:teuthology.orchestra.run.smithi171.stdout:(79/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 262 kB/s | 44 kB 00:00 2024-05-08T23:53:16.031 INFO:teuthology.orchestra.run.smithi081.stdout:(142/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.3 MB/s | 254 kB 00:00 2024-05-08T23:53:16.067 INFO:teuthology.orchestra.run.smithi171.stdout:(80/146): pcre2-devel-10.32-2.el8.x86_64.rpm 3.5 MB/s | 605 kB 00:00 2024-05-08T23:53:16.076 INFO:teuthology.orchestra.run.smithi150.stdout:(52/146): python3-logutils-0.3.5-11.el8.noarch. 158 kB/s | 49 kB 00:00 2024-05-08T23:53:16.109 INFO:teuthology.orchestra.run.smithi171.stdout:(81/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.2 MB/s | 229 kB 00:00 2024-05-08T23:53:16.156 INFO:teuthology.orchestra.run.smithi081.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 861 kB/s | 180 kB 00:00 2024-05-08T23:53:16.181 INFO:teuthology.orchestra.run.smithi081.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 564 kB/s | 99 kB 00:00 2024-05-08T23:53:16.209 INFO:teuthology.orchestra.run.smithi171.stdout:(82/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 482 kB/s | 48 kB 00:00 2024-05-08T23:53:16.234 INFO:teuthology.orchestra.run.smithi171.stdout:(83/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2024-05-08T23:53:16.248 INFO:teuthology.orchestra.run.smithi081.stdout:(145/146): util-linux-2.32.1-44.el8_9.1.x86_64. 11 MB/s | 2.5 MB 00:00 2024-05-08T23:53:16.277 INFO:teuthology.orchestra.run.smithi150.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 180 kB/s | 59 kB 00:00 2024-05-08T23:53:16.288 INFO:teuthology.orchestra.run.smithi171.stdout:(84/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 838 kB/s | 220 kB 00:00 2024-05-08T23:53:16.290 INFO:teuthology.orchestra.run.smithi081.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 770 kB/s | 103 kB 00:00 2024-05-08T23:53:16.293 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:53:16.293 INFO:teuthology.orchestra.run.smithi081.stdout:Total 12 MB/s | 215 MB 00:17 2024-05-08T23:53:16.385 INFO:teuthology.orchestra.run.smithi150.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 195 kB/s | 60 kB 00:00 2024-05-08T23:53:16.426 INFO:teuthology.orchestra.run.smithi171.stdout:(85/146): libcom_err-devel-1.45.6-4.el8.x86_64. 280 kB/s | 39 kB 00:00 2024-05-08T23:53:16.452 INFO:teuthology.orchestra.run.smithi171.stdout:(86/146): libsepol-devel-2.9-3.el8.x86_64.rpm 359 kB/s | 87 kB 00:00 2024-05-08T23:53:16.477 INFO:teuthology.orchestra.run.smithi171.stdout:(87/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 238 kB/s | 58 kB 00:00 2024-05-08T23:53:16.619 INFO:teuthology.orchestra.run.smithi150.stdout:(55/146): python3-portend-2.6-1.el8.noarch.rpm 67 kB/s | 16 kB 00:00 2024-05-08T23:53:16.644 INFO:teuthology.orchestra.run.smithi171.stdout:(88/146): fuse-2.9.7-17.el8.x86_64.rpm 382 kB/s | 83 kB 00:00 2024-05-08T23:53:16.661 INFO:teuthology.orchestra.run.smithi171.stdout:(89/146): libquadmath-8.5.0-20.el8.x86_64.rpm 938 kB/s | 172 kB 00:00 2024-05-08T23:53:16.695 INFO:teuthology.orchestra.run.smithi171.stdout:(90/146): libgfortran-8.5.0-20.el8.x86_64.rpm 2.6 MB/s | 645 kB 00:00 2024-05-08T23:53:16.728 INFO:teuthology.orchestra.run.smithi171.stdout:(91/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2024-05-08T23:53:16.753 INFO:teuthology.orchestra.run.smithi171.stdout:(92/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 789 kB/s | 73 kB 00:00 2024-05-08T23:53:16.820 INFO:teuthology.orchestra.run.smithi171.stdout:(93/146): elfutils-libelf-devel-0.189-3.el8.x86 493 kB/s | 62 kB 00:00 2024-05-08T23:53:16.844 INFO:teuthology.orchestra.run.smithi150.stdout:(56/146): python3-kubernetes-11.0.0-6.el8.noarc 1.0 MB/s | 1.2 MB 00:01 2024-05-08T23:53:16.869 INFO:teuthology.orchestra.run.smithi150.stdout:(57/146): python3-pecan-1.3.2-9.el8.noarch.rpm 477 kB/s | 283 kB 00:00 2024-05-08T23:53:16.886 INFO:teuthology.orchestra.run.smithi150.stdout:(58/146): python3-repoze-lru-0.7-6.el8.noarch.r 126 kB/s | 34 kB 00:00 2024-05-08T23:53:16.912 INFO:teuthology.orchestra.run.smithi171.stdout:(94/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 3.0 MB/s | 562 kB 00:00 2024-05-08T23:53:16.980 INFO:teuthology.orchestra.run.smithi171.stdout:(95/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 10 MB/s | 2.3 MB 00:00 2024-05-08T23:53:16.996 INFO:teuthology.orchestra.run.smithi171.stdout:(96/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 268 kB/s | 47 kB 00:00 2024-05-08T23:53:17.030 INFO:teuthology.orchestra.run.smithi171.stdout:(97/146): python3-cryptography-3.2.1-7.el8_9.x8 4.7 MB/s | 559 kB 00:00 2024-05-08T23:53:17.128 INFO:teuthology.orchestra.run.smithi150.stdout:(59/146): python3-simplegeneric-0.8.1-17.el8.no 77 kB/s | 19 kB 00:00 2024-05-08T23:53:17.147 INFO:teuthology.orchestra.run.smithi171.stdout:(98/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 665 kB/s | 100 kB 00:00 2024-05-08T23:53:17.206 INFO:teuthology.orchestra.run.smithi171.stdout:(99/146): NetworkManager-initscripts-updown-1.4 640 kB/s | 144 kB 00:00 2024-05-08T23:53:17.222 INFO:teuthology.orchestra.run.smithi171.stdout:(100/146): python3-jsonpointer-1.10-11.el8.noar 104 kB/s | 20 kB 00:00 2024-05-08T23:53:17.229 INFO:teuthology.orchestra.run.smithi150.stdout:(60/146): python3-rsa-4.9-2.el8.noarch.rpm 178 kB/s | 64 kB 00:00 2024-05-08T23:53:17.239 INFO:teuthology.orchestra.run.smithi171.stdout:(101/146): python3-prettytable-0.7.2-14.el8.noa 478 kB/s | 44 kB 00:00 2024-05-08T23:53:17.315 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-05-08T23:53:17.320 INFO:teuthology.orchestra.run.smithi150.stdout:(61/146): python3-routes-2.4.1-12.el8.noarch.rp 413 kB/s | 196 kB 00:00 2024-05-08T23:53:17.357 INFO:teuthology.orchestra.run.smithi171.stdout:(102/146): python3-pyasn1-modules-0.3.7-6.el8.n 732 kB/s | 110 kB 00:00 2024-05-08T23:53:17.404 INFO:teuthology.orchestra.run.smithi150.stdout:(62/146): python3-singledispatch-3.4.0.3-18.el8 87 kB/s | 24 kB 00:00 2024-05-08T23:53:17.498 INFO:teuthology.orchestra.run.smithi171.stdout:(103/146): python3-werkzeug-0.12.2-4.el8.noarch 3.2 MB/s | 457 kB 00:00 2024-05-08T23:53:17.512 INFO:teuthology.orchestra.run.smithi150.stdout:(63/146): python3-tempora-1.14.1-5.el8.noarch.r 103 kB/s | 29 kB 00:00 2024-05-08T23:53:17.524 INFO:teuthology.orchestra.run.smithi171.stdout:(104/146): python3-jsonpatch-1.21-2.el8.noarch. 88 kB/s | 27 kB 00:00 2024-05-08T23:53:17.549 INFO:teuthology.orchestra.run.smithi171.stdout:(105/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 409 kB/s | 126 kB 00:00 2024-05-08T23:53:17.579 INFO:teuthology.orchestra.run.smithi150.stdout:(64/146): python3-trustme-0.6.0-4.el8.noarch.rp 106 kB/s | 27 kB 00:00 2024-05-08T23:53:17.624 INFO:teuthology.orchestra.run.smithi171.stdout:(106/146): bison-3.0.4-10.el8.x86_64.rpm 5.4 MB/s | 688 kB 00:00 2024-05-08T23:53:17.708 INFO:teuthology.orchestra.run.smithi171.stdout:(107/146): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2024-05-08T23:53:17.710 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-05-08T23:53:17.710 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-05-08T23:53:17.755 INFO:teuthology.orchestra.run.smithi171.stdout:(108/146): flex-2.6.1-9.el8.x86_64.rpm 1.4 MB/s | 320 kB 00:00 2024-05-08T23:53:17.783 INFO:teuthology.orchestra.run.smithi171.stdout:(109/146): python3-markupsafe-0.23-19.el8.x86_6 244 kB/s | 39 kB 00:00 2024-05-08T23:53:17.825 INFO:teuthology.orchestra.run.smithi171.stdout:(110/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.2 MB/s | 259 kB 00:00 2024-05-08T23:53:17.884 INFO:teuthology.orchestra.run.smithi171.stdout:(111/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.0 MB/s | 103 kB 00:00 2024-05-08T23:53:17.896 INFO:teuthology.orchestra.run.smithi150.stdout:(65/146): python3-waitress-1.4.3-1.el8.noarch.r 519 kB/s | 255 kB 00:00 2024-05-08T23:53:17.909 INFO:teuthology.orchestra.run.smithi171.stdout:(112/146): uuid-1.6.2-43.el8.x86_64.rpm 417 kB/s | 64 kB 00:00 2024-05-08T23:53:17.913 INFO:teuthology.orchestra.run.smithi150.stdout:(66/146): python3-websocket-client-0.56.0-5.el8 183 kB/s | 61 kB 00:00 2024-05-08T23:53:17.972 INFO:teuthology.orchestra.run.smithi150.stdout:(67/146): python3-webob-1.8.5-1.el8.1.noarch.rp 547 kB/s | 251 kB 00:00 2024-05-08T23:53:18.084 INFO:teuthology.orchestra.run.smithi171.stdout:(113/146): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2024-05-08T23:53:18.118 INFO:teuthology.orchestra.run.smithi171.stdout:(114/146): python3-jinja2-2.10.1-3.el8.noarch.r 2.2 MB/s | 538 kB 00:00 2024-05-08T23:53:18.164 INFO:teuthology.orchestra.run.smithi150.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 92 kB/s | 23 kB 00:00 2024-05-08T23:53:18.176 INFO:teuthology.orchestra.run.smithi171.stdout:(115/146): socat-1.7.4.1-1.el8.x86_64.rpm 3.4 MB/s | 323 kB 00:00 2024-05-08T23:53:18.189 INFO:teuthology.orchestra.run.smithi150.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-05-08T23:53:18.214 INFO:teuthology.orchestra.run.smithi150.stdout:(70/146): python3-webtest-2.0.33-1.el8.noarch.r 268 kB/s | 85 kB 00:00 2024-05-08T23:53:18.235 INFO:teuthology.orchestra.run.smithi171.stdout:(116/146): python3-numpy-1.14.3-10.el8.x86_64.r 11 MB/s | 3.7 MB 00:00 2024-05-08T23:53:18.260 INFO:teuthology.orchestra.run.smithi171.stdout:(117/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.5 MB/s | 225 kB 00:00 2024-05-08T23:53:18.340 INFO:teuthology.orchestra.run.smithi171.stdout:(118/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.1 MB/s | 354 kB 00:00 2024-05-08T23:53:18.356 INFO:teuthology.orchestra.run.smithi150.stdout:(71/146): python3-jwt-1.6.1-2.el8.noarch.rpm 301 kB/s | 43 kB 00:00 2024-05-08T23:53:18.386 INFO:teuthology.orchestra.run.smithi171.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2024-05-08T23:53:18.457 INFO:teuthology.orchestra.run.smithi150.stdout:(72/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 67 kB/s | 18 kB 00:00 2024-05-08T23:53:18.490 INFO:teuthology.orchestra.run.smithi150.stdout:(73/146): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2024-05-08T23:53:18.503 INFO:teuthology.orchestra.run.smithi171.stdout:(120/146): openblas-threads-0.3.15-6.el8.x86_64 19 MB/s | 5.2 MB 00:00 2024-05-08T23:53:18.545 INFO:teuthology.orchestra.run.smithi171.stdout:(121/146): automake-1.16.1-8.el8.noarch.rpm 4.4 MB/s | 714 kB 00:00 2024-05-08T23:53:18.627 INFO:teuthology.orchestra.run.smithi171.stdout:(122/146): libpq-13.11-1.el8.x86_64.rpm 1.6 MB/s | 198 kB 00:00 2024-05-08T23:53:18.640 INFO:teuthology.orchestra.run.smithi150.stdout:(74/146): python3-pycparser-2.14-14.el8.noarch. 595 kB/s | 109 kB 00:00 2024-05-08T23:53:18.674 INFO:teuthology.orchestra.run.smithi150.stdout:(75/146): python3-requests-oauthlib-1.0.0-1.el8 233 kB/s | 43 kB 00:00 2024-05-08T23:53:18.703 INFO:teuthology.orchestra.run.smithi171.stdout:(123/146): openblas-0.3.15-6.el8.x86_64.rpm 14 MB/s | 5.0 MB 00:00 2024-05-08T23:53:18.720 INFO:teuthology.orchestra.run.smithi171.stdout:(124/146): jq-1.6-7.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2024-05-08T23:53:18.746 INFO:teuthology.orchestra.run.smithi171.stdout:(125/146): python3-pytz-2017.2-11.el8.noarch.rp 459 kB/s | 54 kB 00:00 2024-05-08T23:53:18.802 INFO:teuthology.orchestra.run.smithi150.stdout:(76/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 116 kB/s | 19 kB 00:00 2024-05-08T23:53:18.833 INFO:teuthology.orchestra.run.smithi150.stdout:(77/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 276 kB/s | 44 kB 00:00 2024-05-08T23:53:18.855 INFO:teuthology.orchestra.run.smithi171.stdout:(126/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-05-08T23:53:18.908 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-05-08T23:53:18.919 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-05-08T23:53:18.933 INFO:teuthology.orchestra.run.smithi150.stdout:(78/146): pcre2-devel-10.32-2.el8.x86_64.rpm 4.5 MB/s | 605 kB 00:00 2024-05-08T23:53:18.963 INFO:teuthology.orchestra.run.smithi171.stdout:(127/146): postgresql-10.23-4.module+el8.9.0+21 6.9 MB/s | 1.5 MB 00:00 2024-05-08T23:53:18.975 INFO:teuthology.orchestra.run.smithi150.stdout:(79/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2024-05-08T23:53:19.092 INFO:teuthology.orchestra.run.smithi150.stdout:(80/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2024-05-08T23:53:19.134 INFO:teuthology.orchestra.run.smithi150.stdout:(81/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2024-05-08T23:53:19.155 INFO:teuthology.orchestra.run.smithi171.stdout:(128/146): python3-scipy-1.0.0-21.module+el8.9. 30 MB/s | 14 MB 00:00 2024-05-08T23:53:19.226 INFO:teuthology.orchestra.run.smithi150.stdout:(82/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 360 kB/s | 48 kB 00:00 2024-05-08T23:53:19.230 INFO:teuthology.orchestra.run.smithi171.stdout:(129/146): postgresql-contrib-10.23-4.module+el 2.1 MB/s | 812 kB 00:00 2024-05-08T23:53:19.243 INFO:teuthology.orchestra.run.smithi150.stdout:(83/146): libsepol-devel-2.9-3.el8.x86_64.rpm 801 kB/s | 87 kB 00:00 2024-05-08T23:53:19.331 INFO:teuthology.orchestra.run.smithi171.stdout:(130/146): postgresql-server-10.23-4.module+el8 14 MB/s | 5.1 MB 00:00 2024-05-08T23:53:19.377 INFO:teuthology.orchestra.run.smithi150.stdout:(84/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 384 kB/s | 58 kB 00:00 2024-05-08T23:53:19.402 INFO:teuthology.orchestra.run.smithi150.stdout:(85/146): libcom_err-devel-1.45.6-4.el8.x86_64. 243 kB/s | 39 kB 00:00 2024-05-08T23:53:19.497 INFO:teuthology.orchestra.run.smithi171.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.4 MB/s | 232 kB 00:00 2024-05-08T23:53:19.536 INFO:teuthology.orchestra.run.smithi150.stdout:(86/146): fuse-2.9.7-17.el8.x86_64.rpm 524 kB/s | 83 kB 00:00 2024-05-08T23:53:19.603 INFO:teuthology.orchestra.run.smithi150.stdout:(87/146): libgfortran-8.5.0-20.el8.x86_64.rpm 3.1 MB/s | 645 kB 00:00 2024-05-08T23:53:19.622 INFO:teuthology.orchestra.run.smithi171.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 2.4 MB/s | 303 kB 00:00 2024-05-08T23:53:19.644 INFO:teuthology.orchestra.run.smithi150.stdout:(88/146): thrift-0.13.0-2.el8.x86_64.rpm 1.0 MB/s | 1.7 MB 00:01 2024-05-08T23:53:19.678 INFO:teuthology.orchestra.run.smithi150.stdout:(89/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.2 MB/s | 172 kB 00:00 2024-05-08T23:53:19.778 INFO:teuthology.orchestra.run.smithi150.stdout:(90/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.3 MB/s | 238 kB 00:00 2024-05-08T23:53:19.831 INFO:teuthology.orchestra.run.smithi171.stdout:(133/146): iproute-6.2.0-5.el8_9.x86_64.rpm 4.0 MB/s | 854 kB 00:00 2024-05-08T23:53:19.833 INFO:teuthology.orchestra.run.smithi150.stdout:(91/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 385 kB/s | 73 kB 00:00 2024-05-08T23:53:19.862 INFO:teuthology.orchestra.run.smithi150.stdout:(92/146): elfutils-libelf-devel-0.189-3.el8.x86 346 kB/s | 62 kB 00:00 2024-05-08T23:53:19.890 INFO:teuthology.orchestra.run.smithi171.stdout:(134/146): librados2-18.2.2-1322.gd21e4f96.el8. 5.0 MB/s | 3.7 MB 00:00 2024-05-08T23:53:19.938 INFO:teuthology.orchestra.run.smithi150.stdout:(93/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 3.5 MB/s | 562 kB 00:00 2024-05-08T23:53:19.948 INFO:teuthology.orchestra.run.smithi171.stdout:(135/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 5.0 MB/s | 3.6 MB 00:00 2024-05-08T23:53:19.971 INFO:teuthology.orchestra.run.smithi150.stdout:(94/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 433 kB/s | 47 kB 00:00 2024-05-08T23:53:19.990 INFO:teuthology.orchestra.run.smithi171.stdout:(136/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 4.4 MB/s | 711 kB 00:00 2024-05-08T23:53:20.079 INFO:teuthology.orchestra.run.smithi171.stdout:(137/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 7.8 MB/s | 1.5 MB 00:00 2024-05-08T23:53:20.116 INFO:teuthology.orchestra.run.smithi171.stdout:(138/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 1.9 MB/s | 333 kB 00:00 2024-05-08T23:53:20.138 INFO:teuthology.orchestra.run.smithi150.stdout:(95/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 7.6 MB/s | 2.3 MB 00:00 2024-05-08T23:53:20.163 INFO:teuthology.orchestra.run.smithi150.stdout:(96/146): NetworkManager-initscripts-updown-1.4 751 kB/s | 144 kB 00:00 2024-05-08T23:53:20.183 INFO:teuthology.orchestra.run.smithi171.stdout:(139/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 3.7 MB/s | 254 kB 00:00 2024-05-08T23:53:20.197 INFO:teuthology.orchestra.run.smithi150.stdout:(97/146): python3-cryptography-3.2.1-7.el8_9.x8 2.1 MB/s | 559 kB 00:00 2024-05-08T23:53:20.208 INFO:teuthology.orchestra.run.smithi171.stdout:(140/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.7 MB/s | 221 kB 00:00 2024-05-08T23:53:20.250 INFO:teuthology.orchestra.run.smithi171.stdout:(141/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.1 MB/s | 1.1 MB 00:00 2024-05-08T23:53:20.272 INFO:teuthology.orchestra.run.smithi150.stdout:(98/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 745 kB/s | 100 kB 00:00 2024-05-08T23:53:20.298 INFO:teuthology.orchestra.run.smithi150.stdout:(99/146): python3-jsonpointer-1.10-11.el8.noarc 200 kB/s | 20 kB 00:00 2024-05-08T23:53:20.323 INFO:teuthology.orchestra.run.smithi150.stdout:(100/146): python3-packaging-16.8-9.el8.noarch. 303 kB/s | 48 kB 00:00 2024-05-08T23:53:20.391 INFO:teuthology.orchestra.run.smithi171.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.1 MB/s | 237 kB 00:00 2024-05-08T23:53:20.417 INFO:teuthology.orchestra.run.smithi171.stdout:(143/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 594 kB/s | 99 kB 00:00 2024-05-08T23:53:20.431 INFO:teuthology.orchestra.run.smithi150.stdout:(101/146): python3-prettytable-0.7.2-14.el8.noa 277 kB/s | 44 kB 00:00 2024-05-08T23:53:20.434 INFO:teuthology.orchestra.run.smithi171.stdout:(144/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 796 kB/s | 180 kB 00:00 2024-05-08T23:53:20.457 INFO:teuthology.orchestra.run.smithi150.stdout:(102/146): python3-pyasn1-modules-0.3.7-6.el8.n 693 kB/s | 110 kB 00:00 2024-05-08T23:53:20.482 INFO:teuthology.orchestra.run.smithi150.stdout:(103/146): python3-jsonpatch-1.21-2.el8.noarch. 167 kB/s | 27 kB 00:00 2024-05-08T23:53:20.551 INFO:teuthology.orchestra.run.smithi171.stdout:(145/146): util-linux-user-2.32.1-44.el8_9.1.x8 770 kB/s | 103 kB 00:00 2024-05-08T23:53:20.626 INFO:teuthology.orchestra.run.smithi171.stdout:(146/146): util-linux-2.32.1-44.el8_9.1.x86_64. 11 MB/s | 2.5 MB 00:00 2024-05-08T23:53:20.629 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:53:20.630 INFO:teuthology.orchestra.run.smithi171.stdout:Total 10 MB/s | 215 MB 00:21 2024-05-08T23:53:20.649 INFO:teuthology.orchestra.run.smithi150.stdout:(104/146): bison-3.0.4-10.el8.x86_64.rpm 4.0 MB/s | 688 kB 00:00 2024-05-08T23:53:20.674 INFO:teuthology.orchestra.run.smithi150.stdout:(105/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 521 kB/s | 126 kB 00:00 2024-05-08T23:53:20.708 INFO:teuthology.orchestra.run.smithi150.stdout:(106/146): python3-werkzeug-0.12.2-4.el8.noarch 1.8 MB/s | 457 kB 00:00 2024-05-08T23:53:20.841 INFO:teuthology.orchestra.run.smithi150.stdout:(107/146): python3-markupsafe-0.23-19.el8.x86_6 291 kB/s | 39 kB 00:00 2024-05-08T23:53:20.900 INFO:teuthology.orchestra.run.smithi150.stdout:(108/146): flex-2.6.1-9.el8.x86_64.rpm 1.2 MB/s | 320 kB 00:00 2024-05-08T23:53:20.934 INFO:teuthology.orchestra.run.smithi150.stdout:(109/146): libtool-2.4.6-25.el8.x86_64.rpm 2.7 MB/s | 709 kB 00:00 2024-05-08T23:53:21.009 INFO:teuthology.orchestra.run.smithi150.stdout:(110/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.5 MB/s | 259 kB 00:00 2024-05-08T23:53:21.034 INFO:teuthology.orchestra.run.smithi150.stdout:(111/146): uuid-1.6.2-43.el8.x86_64.rpm 478 kB/s | 64 kB 00:00 2024-05-08T23:53:21.077 INFO:teuthology.orchestra.run.smithi150.stdout:(112/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 728 kB/s | 103 kB 00:00 2024-05-08T23:53:21.276 INFO:teuthology.orchestra.run.smithi150.stdout:(113/146): python3-numpy-1.14.3-10.el8.x86_64.r 19 MB/s | 3.7 MB 00:00 2024-05-08T23:53:21.302 INFO:teuthology.orchestra.run.smithi150.stdout:(114/146): python3-jinja2-2.10.1-3.el8.noarch.r 2.0 MB/s | 538 kB 00:00 2024-05-08T23:53:21.403 INFO:teuthology.orchestra.run.smithi150.stdout:(115/146): python3-babel-2.5.1-7.el8.noarch.rpm 12 MB/s | 4.8 MB 00:00 2024-05-08T23:53:21.444 INFO:teuthology.orchestra.run.smithi150.stdout:(116/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.9 MB/s | 323 kB 00:00 2024-05-08T23:53:21.469 INFO:teuthology.orchestra.run.smithi150.stdout:(117/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.3 MB/s | 225 kB 00:00 2024-05-08T23:53:21.503 INFO:teuthology.orchestra.run.smithi150.stdout:(118/146): librdkafka-0.11.4-3.el8.x86_64.rpm 3.5 MB/s | 354 kB 00:00 2024-05-08T23:53:21.586 INFO:teuthology.orchestra.run.smithi150.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.3 MB/s | 157 kB 00:00 2024-05-08T23:53:21.703 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-05-08T23:53:21.745 INFO:teuthology.orchestra.run.smithi150.stdout:(120/146): openblas-0.3.15-6.el8.x86_64.rpm 21 MB/s | 5.0 MB 00:00 2024-05-08T23:53:21.778 INFO:teuthology.orchestra.run.smithi150.stdout:(121/146): automake-1.16.1-8.el8.noarch.rpm 3.6 MB/s | 714 kB 00:00 2024-05-08T23:53:21.854 INFO:teuthology.orchestra.run.smithi150.stdout:(122/146): openblas-threads-0.3.15-6.el8.x86_64 13 MB/s | 5.2 MB 00:00 2024-05-08T23:53:21.879 INFO:teuthology.orchestra.run.smithi150.stdout:(123/146): libpq-13.11-1.el8.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2024-05-08T23:53:21.954 INFO:teuthology.orchestra.run.smithi150.stdout:(124/146): jq-1.6-7.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2024-05-08T23:53:21.979 INFO:teuthology.orchestra.run.smithi150.stdout:(125/146): python3-pytz-2017.2-11.el8.noarch.rp 432 kB/s | 54 kB 00:00 2024-05-08T23:53:22.098 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-05-08T23:53:22.098 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-05-08T23:53:22.289 INFO:teuthology.orchestra.run.smithi150.stdout:(126/146): python3-scipy-1.0.0-21.module+el8.9. 33 MB/s | 14 MB 00:00 2024-05-08T23:53:22.314 INFO:teuthology.orchestra.run.smithi150.stdout:(127/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 524 kB/s | 188 kB 00:00 2024-05-08T23:53:22.347 INFO:teuthology.orchestra.run.smithi150.stdout:(128/146): postgresql-10.23-4.module+el8.9.0+21 4.1 MB/s | 1.5 MB 00:00 2024-05-08T23:53:22.464 INFO:teuthology.orchestra.run.smithi150.stdout:(129/146): postgresql-contrib-10.23-4.module+el 4.5 MB/s | 812 kB 00:00 2024-05-08T23:53:22.598 INFO:teuthology.orchestra.run.smithi150.stdout:(130/146): postgresql-server-10.23-4.module+el8 18 MB/s | 5.1 MB 00:00 2024-05-08T23:53:22.748 INFO:teuthology.orchestra.run.smithi150.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.5 MB/s | 232 kB 00:00 2024-05-08T23:53:22.961 INFO:teuthology.orchestra.run.smithi150.stdout:(132/146): librados2-18.2.2-1322.gd21e4f96.el8. 6.0 MB/s | 3.7 MB 00:00 2024-05-08T23:53:22.999 INFO:teuthology.orchestra.run.smithi150.stdout:(133/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.2 MB/s | 303 kB 00:00 2024-05-08T23:53:23.066 INFO:teuthology.orchestra.run.smithi150.stdout:(134/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 5.9 MB/s | 3.6 MB 00:00 2024-05-08T23:53:23.133 INFO:teuthology.orchestra.run.smithi150.stdout:(135/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 5.2 MB/s | 711 kB 00:00 2024-05-08T23:53:23.158 INFO:teuthology.orchestra.run.smithi150.stdout:(136/146): iproute-6.2.0-5.el8_9.x86_64.rpm 4.2 MB/s | 854 kB 00:00 2024-05-08T23:53:23.266 INFO:teuthology.orchestra.run.smithi150.stdout:(137/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 7.3 MB/s | 1.5 MB 00:00 2024-05-08T23:53:23.300 INFO:teuthology.orchestra.run.smithi150.stdout:(138/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 1.9 MB/s | 333 kB 00:00 2024-05-08T23:53:23.304 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-05-08T23:53:23.314 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-05-08T23:53:23.342 INFO:teuthology.orchestra.run.smithi150.stdout:(139/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.8 MB/s | 1.1 MB 00:00 2024-05-08T23:53:23.409 INFO:teuthology.orchestra.run.smithi150.stdout:(140/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 2.3 MB/s | 254 kB 00:00 2024-05-08T23:53:23.434 INFO:teuthology.orchestra.run.smithi150.stdout:(141/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.3 MB/s | 221 kB 00:00 2024-05-08T23:53:23.501 INFO:teuthology.orchestra.run.smithi150.stdout:(142/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.5 MB/s | 237 kB 00:00 2024-05-08T23:53:23.535 INFO:teuthology.orchestra.run.smithi150.stdout:(143/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.4 MB/s | 180 kB 00:00 2024-05-08T23:53:23.568 INFO:teuthology.orchestra.run.smithi150.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 740 kB/s | 99 kB 00:00 2024-05-08T23:53:23.760 INFO:teuthology.orchestra.run.smithi150.stdout:(145/146): util-linux-2.32.1-44.el8_9.1.x86_64. 9.6 MB/s | 2.5 MB 00:00 2024-05-08T23:53:23.785 INFO:teuthology.orchestra.run.smithi150.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 411 kB/s | 103 kB 00:00 2024-05-08T23:53:23.789 INFO:teuthology.orchestra.run.smithi150.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:53:23.789 INFO:teuthology.orchestra.run.smithi150.stdout:Total 9.1 MB/s | 215 MB 00:23 2024-05-08T23:53:24.807 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction check 2024-05-08T23:53:25.106 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-05-08T23:53:25.201 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction check succeeded. 2024-05-08T23:53:25.201 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction test 2024-05-08T23:53:25.240 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T23:53:25.503 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T23:53:25.721 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T23:53:25.947 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T23:53:26.118 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T23:53:26.216 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T23:53:26.393 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T23:53:26.427 INFO:teuthology.orchestra.run.smithi150.stdout:Transaction test succeeded. 2024-05-08T23:53:26.438 INFO:teuthology.orchestra.run.smithi150.stdout:Running transaction 2024-05-08T23:53:26.461 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T23:53:26.699 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T23:53:27.002 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/162 2024-05-08T23:53:27.087 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/162 2024-05-08T23:53:27.261 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 7/162 2024-05-08T23:53:27.460 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T23:53:27.870 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T23:53:28.101 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:53:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:53:28.693 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:53:28.844 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:53:29.103 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:53:29.184 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-05-08T23:53:29.198 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:53:29.318 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T23:53:29.564 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T23:53:29.613 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T23:53:29.816 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T23:53:29.834 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T23:53:29.914 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T23:53:30.015 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T23:53:30.116 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T23:53:30.219 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T23:53:30.295 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T23:53:30.404 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T23:53:30.478 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T23:53:30.547 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T23:53:30.596 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T23:53:30.749 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T23:53:30.954 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T23:53:30.994 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-08T23:53:31.178 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T23:53:31.196 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T23:53:31.314 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T23:53:31.326 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:53:31.460 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:53:31.519 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T23:53:31.634 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T23:53:31.732 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T23:53:31.884 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/162 2024-05-08T23:53:31.916 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T23:53:32.064 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/162 2024-05-08T23:53:32.145 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:53:32.293 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/162 2024-05-08T23:53:32.293 INFO:teuthology.orchestra.run.smithi150.stdout: Preparing : 1/1 2024-05-08T23:53:32.428 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T23:53:32.519 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:53:32.695 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T23:53:32.728 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:53:32.847 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:53:32.909 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T23:53:32.916 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/162 2024-05-08T23:53:33.089 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:53:33.126 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-05-08T23:53:33.126 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T23:53:33.185 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:53:33.322 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T23:53:33.420 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T23:53:33.525 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T23:53:33.589 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T23:53:33.690 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T23:53:33.731 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 23/162 2024-05-08T23:53:33.794 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T23:53:33.860 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T23:53:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.15-6.el8.x86_64 24/162 2024-05-08T23:53:33.909 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T23:53:34.079 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-08T23:53:34.167 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T23:53:34.297 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T23:53:34.397 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T23:53:34.482 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T23:53:34.606 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T23:53:34.609 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 24/162 2024-05-08T23:53:34.647 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T23:53:34.923 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/162 2024-05-08T23:53:35.040 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T23:53:35.041 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T23:53:35.064 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 26/162 2024-05-08T23:53:35.247 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T23:53:35.254 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/162 2024-05-08T23:53:35.255 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:53:35.419 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:53:35.525 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/162 2024-05-08T23:53:35.527 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:53:35.636 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:53:35.727 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T23:53:35.808 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T23:53:35.814 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 29/162 2024-05-08T23:53:35.847 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:53:35.957 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:53:35.998 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-08T23:53:36.086 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T23:53:36.215 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:53:36.282 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T23:53:36.296 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-08T23:53:36.344 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:53:36.411 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T23:53:36.549 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-08T23:53:36.662 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T23:53:36.676 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T23:53:36.701 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T23:53:36.864 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T23:53:36.964 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T23:53:37.035 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T23:53:37.052 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T23:53:37.270 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T23:53:37.584 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T23:53:37.607 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 34/162 2024-05-08T23:53:37.653 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T23:53:37.775 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T23:53:37.827 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T23:53:37.973 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 35/162 2024-05-08T23:53:38.184 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T23:53:38.263 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 36/162 2024-05-08T23:53:38.458 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T23:53:38.469 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-05-08T23:53:38.476 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T23:53:38.635 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T23:53:38.672 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:53:38.762 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:53:38.964 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T23:53:39.026 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T23:53:39.217 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-08T23:53:39.312 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T23:53:39.490 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-08T23:53:39.591 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-08T23:53:39.743 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-08T23:53:39.831 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-08T23:53:39.896 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T23:53:40.012 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T23:53:40.130 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T23:53:40.155 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T23:53:40.210 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 37/162 2024-05-08T23:53:40.324 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T23:53:40.479 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T23:53:40.556 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 38/162 2024-05-08T23:53:40.757 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T23:53:40.778 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T23:53:40.807 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T23:53:40.955 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T23:53:40.973 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T23:53:40.977 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T23:53:41.205 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T23:53:41.424 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T23:53:41.595 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T23:53:41.644 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T23:53:41.710 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T23:53:41.780 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T23:53:41.958 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T23:53:42.030 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T23:53:42.272 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T23:53:42.499 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T23:53:42.510 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T23:53:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T23:53:42.737 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T23:53:42.778 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-08T23:53:43.010 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-08T23:53:43.136 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-08T23:53:43.167 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T23:53:43.299 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T23:53:43.486 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T23:53:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T23:53:43.559 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T23:53:43.615 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T23:53:43.759 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-16.8-9.el8.noarch 49/162 2024-05-08T23:53:43.883 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T23:53:43.953 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.7-17.el8.x86_64 50/162 2024-05-08T23:53:44.129 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 51/162 2024-05-08T23:53:44.132 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T23:53:44.168 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-08T23:53:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 52/162 2024-05-08T23:53:44.523 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-08T23:53:44.536 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 53/162 2024-05-08T23:53:44.720 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 54/162 2024-05-08T23:53:44.796 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-08T23:53:45.045 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 55/162 2024-05-08T23:53:45.045 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T23:53:45.286 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T23:53:45.305 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/162 2024-05-08T23:53:45.506 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T23:53:45.546 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/162 2024-05-08T23:53:45.650 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T23:53:45.728 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 58/162 2024-05-08T23:53:45.867 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T23:53:45.882 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T23:53:45.950 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T23:53:45.985 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 59/162 2024-05-08T23:53:46.175 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T23:53:46.235 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T23:53:46.273 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-08T23:53:46.331 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 60/162 2024-05-08T23:53:46.464 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T23:53:46.652 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 61/162 2024-05-08T23:53:46.678 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T23:53:46.850 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T23:53:46.965 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/162 2024-05-08T23:53:47.208 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 63/162 2024-05-08T23:53:47.246 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-08T23:53:47.323 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T23:53:47.450 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T23:53:47.609 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-08T23:53:47.617 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T23:53:47.645 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T23:53:47.663 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 65/162 2024-05-08T23:53:47.858 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T23:53:47.879 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 66/162 2024-05-08T23:53:47.900 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-08T23:53:47.923 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T23:53:48.124 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 67/162 2024-05-08T23:53:48.157 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T23:53:48.210 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-05-08T23:53:48.351 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 68/162 2024-05-08T23:53:48.406 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T23:53:48.450 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-05-08T23:53:48.599 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 69/162 2024-05-08T23:53:48.634 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T23:53:48.664 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T23:53:48.742 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T23:53:48.836 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T23:53:48.878 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 70/162 2024-05-08T23:53:48.973 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-05-08T23:53:49.062 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T23:53:49.074 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 71/162 2024-05-08T23:53:49.137 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T23:53:49.155 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 71/162 2024-05-08T23:53:49.157 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-05-08T23:53:49.368 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-05-08T23:53:49.387 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T23:53:49.455 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T23:53:49.483 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : jq-1.6-7.el8.x86_64 72/162 2024-05-08T23:53:49.580 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/162 2024-05-08T23:53:49.691 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T23:53:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.1-8.el8.noarch 73/162 2024-05-08T23:53:49.782 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/162 2024-05-08T23:53:49.890 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-43.el8.x86_64 74/162 2024-05-08T23:53:49.947 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T23:53:49.966 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 74/162 2024-05-08T23:53:50.005 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/162 2024-05-08T23:53:50.147 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 75/162 2024-05-08T23:53:50.170 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T23:53:50.211 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/162 2024-05-08T23:53:50.365 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 76/162 2024-05-08T23:53:50.445 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/162 2024-05-08T23:53:50.609 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 77/162 2024-05-08T23:53:50.623 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T23:53:50.729 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/162 2024-05-08T23:53:50.806 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T23:53:50.988 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/162 2024-05-08T23:53:51.013 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T23:53:51.023 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T23:53:51.040 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T23:53:51.213 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/162 2024-05-08T23:53:51.270 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T23:53:51.354 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T23:53:51.363 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T23:53:51.404 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/162 2024-05-08T23:53:51.589 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T23:53:51.631 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-05-08T23:53:51.660 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/162 2024-05-08T23:53:51.803 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T23:53:51.896 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-05-08T23:53:52.002 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T23:53:52.008 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/162 2024-05-08T23:53:52.112 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T23:53:52.179 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T23:53:52.189 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T23:53:52.319 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 67/162 2024-05-08T23:53:52.385 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-05-08T23:53:52.398 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T23:53:52.560 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-05-08T23:53:52.624 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/162 2024-05-08T23:53:52.738 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-05-08T23:53:52.907 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 69/162 2024-05-08T23:53:52.930 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-packaging-16.8-9.el8.noarch 56/162 2024-05-08T23:53:53.026 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T23:53:53.100 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/162 2024-05-08T23:53:53.141 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : fuse-2.9.7-17.el8.x86_64 57/162 2024-05-08T23:53:53.243 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T23:53:53.335 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 58/162 2024-05-08T23:53:53.336 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 71/162 2024-05-08T23:53:53.404 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T23:53:53.550 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 59/162 2024-05-08T23:53:53.587 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2024-05-08T23:53:53.660 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T23:53:53.765 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 60/162 2024-05-08T23:53:53.859 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2024-05-08T23:53:53.902 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T23:53:53.991 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 61/162 2024-05-08T23:53:54.104 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T23:53:54.110 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/162 2024-05-08T23:53:54.317 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 62/162 2024-05-08T23:53:54.333 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/162 2024-05-08T23:53:54.410 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T23:53:54.609 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 63/162 2024-05-08T23:53:54.620 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/162 2024-05-08T23:53:54.656 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T23:53:54.822 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T23:53:54.834 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-05-08T23:53:54.866 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 64/162 2024-05-08T23:53:54.983 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T23:53:55.074 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 65/162 2024-05-08T23:53:55.098 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T23:53:55.202 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T23:53:55.322 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 66/162 2024-05-08T23:53:55.522 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T23:53:55.701 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 67/162 2024-05-08T23:53:55.806 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T23:53:55.998 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 68/162 2024-05-08T23:53:56.028 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T23:53:56.177 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T23:53:56.215 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T23:53:56.327 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 69/162 2024-05-08T23:53:56.404 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T23:53:56.577 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T23:53:56.619 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 70/162 2024-05-08T23:53:56.654 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T23:53:56.805 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 71/162 2024-05-08T23:53:56.828 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T23:53:56.883 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T23:53:57.060 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T23:53:57.064 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 72/162 2024-05-08T23:53:57.148 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T23:53:57.238 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T23:53:57.332 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 73/162 2024-05-08T23:53:57.423 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T23:53:57.454 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T23:53:57.553 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/162 2024-05-08T23:53:57.647 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T23:53:57.669 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T23:53:57.788 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 75/162 2024-05-08T23:53:57.862 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T23:53:58.033 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 76/162 2024-05-08T23:53:58.329 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 77/162 2024-05-08T23:53:58.436 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T23:53:58.527 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T23:53:58.552 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T23:53:58.647 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T23:53:58.720 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T23:53:58.752 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T23:53:58.822 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T23:53:58.940 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T23:53:59.023 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T23:53:59.037 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T23:53:59.271 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T23:53:59.282 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T23:53:59.448 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T23:53:59.663 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T23:53:59.897 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T23:54:00.148 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T23:54:00.411 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T23:54:00.431 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T23:54:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T23:54:00.743 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T23:54:00.791 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T23:54:00.964 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T23:54:01.056 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T23:54:01.258 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T23:54:01.306 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T23:54:01.499 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T23:54:01.684 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T23:54:01.739 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T23:54:02.280 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T23:54:02.521 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T23:54:02.559 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T23:54:02.673 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T23:54:02.751 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:54:02.760 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T23:54:02.793 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T23:54:02.965 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T23:54:03.022 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:54:03.027 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T23:54:03.613 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:54:04.138 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T23:54:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T23:54:04.490 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T23:54:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T23:54:04.694 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T23:54:04.713 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T23:54:05.019 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T23:54:05.302 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T23:54:05.502 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T23:54:06.292 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T23:54:06.493 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T23:54:06.571 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T23:54:06.769 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T23:54:07.241 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:54:07.505 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:54:08.095 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:54:08.424 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T23:54:08.495 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T23:54:08.630 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T23:54:10.951 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:54:11.217 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:54:11.810 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T23:54:12.107 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T23:54:12.181 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T23:54:12.359 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T23:54:24.124 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T23:54:24.124 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-05-08T23:54:24.124 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-05-08T23:54:24.124 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /dev 2024-05-08T23:54:24.124 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /run 2024-05-08T23:54:24.124 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-05-08T23:54:24.124 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-05-08T23:54:24.125 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-05-08T23:54:24.125 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-05-08T23:54:24.125 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /dev 2024-05-08T23:54:24.125 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:54:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T23:54:26.136 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T23:54:26.329 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T23:54:26.547 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T23:54:26.735 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T23:54:27.210 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T23:54:27.394 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T23:54:27.411 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T23:54:28.459 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T23:54:28.459 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2024-05-08T23:54:28.459 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2024-05-08T23:54:28.459 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /dev 2024-05-08T23:54:28.459 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /run 2024-05-08T23:54:28.459 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2024-05-08T23:54:28.459 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2024-05-08T23:54:28.459 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2024-05-08T23:54:28.460 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2024-05-08T23:54:28.460 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /dev 2024-05-08T23:54:28.460 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:54:28.861 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T23:54:29.321 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T23:54:29.481 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T23:54:29.658 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T23:54:29.903 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T23:54:30.187 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T23:54:30.498 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T23:54:30.687 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T23:54:30.905 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T23:54:31.109 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T23:54:31.213 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T23:54:31.504 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T23:54:31.584 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T23:54:31.793 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T23:54:31.811 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T23:54:32.054 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T23:54:32.054 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /sys 2024-05-08T23:54:32.054 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /proc 2024-05-08T23:54:32.054 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /dev 2024-05-08T23:54:32.054 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /run 2024-05-08T23:54:32.054 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /mnt 2024-05-08T23:54:32.055 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /var/tmp 2024-05-08T23:54:32.055 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /home 2024-05-08T23:54:32.055 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /tmp 2024-05-08T23:54:32.055 INFO:teuthology.orchestra.run.smithi150.stdout:skipping the directory /dev 2024-05-08T23:54:32.055 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-08T23:54:32.424 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T23:54:32.469 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T23:54:32.618 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T23:54:32.711 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T23:54:33.049 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T23:54:33.228 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T23:54:33.267 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T23:54:33.426 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T23:54:33.437 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T23:54:33.644 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T23:54:33.806 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T23:54:33.924 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T23:54:34.064 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T23:54:34.153 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T23:54:34.279 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T23:54:34.433 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T23:54:34.497 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T23:54:34.681 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T23:54:34.717 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T23:54:34.928 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T23:54:34.962 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T23:54:35.158 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T23:54:35.168 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T23:54:35.211 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T23:54:35.348 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T23:54:35.366 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T23:54:35.385 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T23:54:35.466 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T23:54:35.731 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T23:54:35.769 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T23:54:35.935 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T23:54:36.735 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T23:54:36.959 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T23:54:37.054 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T23:54:37.164 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T23:54:37.323 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T23:54:37.449 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T23:54:37.488 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T23:54:37.662 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T23:54:37.700 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T23:54:37.732 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T23:54:37.900 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T23:54:37.912 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T23:54:38.013 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T23:54:39.041 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T23:54:39.167 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T23:54:39.328 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T23:54:39.377 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T23:54:39.412 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T23:54:39.642 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T23:54:39.686 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T23:54:39.900 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T23:54:40.249 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T23:54:40.298 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T23:54:40.398 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T23:54:40.476 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T23:54:40.497 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T23:54:40.590 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T23:54:40.902 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T23:54:40.957 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T23:54:41.170 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T23:54:41.208 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T23:54:41.219 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 127/162 2024-05-08T23:54:41.405 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T23:54:41.417 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T23:54:41.458 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-25.el8.x86_64 128/162 2024-05-08T23:54:42.141 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 128/162 2024-05-08T23:54:42.488 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 129/162 2024-05-08T23:54:42.684 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T23:54:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 130/162 2024-05-08T23:54:42.878 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T23:54:42.912 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T23:54:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T23:54:43.139 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T23:54:43.182 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T23:54:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T23:54:43.380 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T23:54:43.513 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T23:54:43.676 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T23:54:43.729 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T23:54:43.939 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T23:54:44.921 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T23:54:45.893 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T23:54:46.100 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:54:46.220 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-08T23:54:46.417 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:54:46.457 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:54:46.532 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-08T23:54:46.908 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T23:54:46.945 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 129/162 2024-05-08T23:54:47.268 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-08T23:54:47.307 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T23:54:47.513 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T23:54:47.526 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T23:54:47.571 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T23:54:47.750 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T23:54:47.767 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T23:54:47.945 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T23:54:47.991 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T23:54:48.158 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T23:54:48.297 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T23:54:48.406 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T23:54:48.568 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T23:54:48.741 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-05-08T23:54:48.752 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 143/162 2024-05-08T23:54:48.913 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 144/162 2024-05-08T23:54:49.149 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.1-9.el8.x86_64 145/162 2024-05-08T23:54:49.230 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 145/162 2024-05-08T23:54:49.365 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T23:54:49.458 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.0.4-10.el8.x86_64 146/162 2024-05-08T23:54:49.471 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 146/162 2024-05-08T23:54:49.680 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T23:54:49.700 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-08T23:54:49.885 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T23:54:50.030 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-08T23:54:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T23:54:50.103 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T23:54:50.402 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T23:54:50.403 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T23:54:50.466 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 129/162 2024-05-08T23:54:50.473 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:54:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T23:54:50.620 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T23:54:50.807 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-08T23:54:50.815 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:54:50.854 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:54:50.889 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T23:54:51.084 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T23:54:51.099 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T23:54:51.143 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T23:54:51.305 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T23:54:51.343 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T23:54:51.348 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T23:54:51.583 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T23:54:51.617 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T23:54:51.617 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:54:51.663 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T23:54:51.797 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T23:54:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:54:51.885 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T23:54:51.927 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T23:54:52.122 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T23:54:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T23:54:52.160 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:54:52.313 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T23:54:52.410 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:54:52.410 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T23:54:52.614 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T23:54:52.635 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T23:54:52.635 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:54:52.877 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:54:52.967 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T23:54:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T23:54:53.085 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T23:54:53.205 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T23:54:53.282 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T23:54:53.514 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T23:54:53.527 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T23:54:53.714 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T23:54:53.723 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T23:54:53.916 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-08T23:54:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T23:54:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T23:54:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T23:54:54.060 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T23:54:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T23:54:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T23:54:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T23:54:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T23:54:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T23:54:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:54:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:54:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:54:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T23:54:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T23:54:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T23:54:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T23:54:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T23:54:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T23:54:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T23:54:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:54:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T23:54:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T23:54:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T23:54:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T23:54:54.062 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T23:54:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T23:54:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T23:54:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T23:54:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T23:54:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T23:54:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T23:54:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T23:54:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T23:54:54.063 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T23:54:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T23:54:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T23:54:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T23:54:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T23:54:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T23:54:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T23:54:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T23:54:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T23:54:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T23:54:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T23:54:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T23:54:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T23:54:54.064 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T23:54:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T23:54:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T23:54:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T23:54:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T23:54:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T23:54:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T23:54:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T23:54:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T23:54:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T23:54:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T23:54:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T23:54:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T23:54:54.065 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T23:54:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T23:54:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T23:54:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T23:54:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T23:54:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T23:54:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T23:54:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T23:54:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T23:54:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T23:54:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T23:54:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T23:54:54.066 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T23:54:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 72/162 2024-05-08T23:54:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/162 2024-05-08T23:54:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 74/162 2024-05-08T23:54:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 75/162 2024-05-08T23:54:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 76/162 2024-05-08T23:54:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/162 2024-05-08T23:54:54.067 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/162 2024-05-08T23:54:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.1-9.el8.x86_64 79/162 2024-05-08T23:54:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 80/162 2024-05-08T23:54:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 81/162 2024-05-08T23:54:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 82/162 2024-05-08T23:54:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 83/162 2024-05-08T23:54:54.068 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 84/162 2024-05-08T23:54:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 85/162 2024-05-08T23:54:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 86/162 2024-05-08T23:54:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/162 2024-05-08T23:54:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 88/162 2024-05-08T23:54:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/162 2024-05-08T23:54:54.069 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 90/162 2024-05-08T23:54:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 91/162 2024-05-08T23:54:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 92/162 2024-05-08T23:54:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 93/162 2024-05-08T23:54:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.1-8.el8.noarch 94/162 2024-05-08T23:54:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpq-13.11-1.el8.x86_64 95/162 2024-05-08T23:54:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : jq-1.6-7.el8.x86_64 96/162 2024-05-08T23:54:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 97/162 2024-05-08T23:54:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 98/162 2024-05-08T23:54:54.070 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 99/162 2024-05-08T23:54:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 100/162 2024-05-08T23:54:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 101/162 2024-05-08T23:54:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 102/162 2024-05-08T23:54:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 103/162 2024-05-08T23:54:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 104/162 2024-05-08T23:54:54.071 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 105/162 2024-05-08T23:54:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 106/162 2024-05-08T23:54:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 107/162 2024-05-08T23:54:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 108/162 2024-05-08T23:54:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 109/162 2024-05-08T23:54:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 110/162 2024-05-08T23:54:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/162 2024-05-08T23:54:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 112/162 2024-05-08T23:54:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 113/162 2024-05-08T23:54:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 114/162 2024-05-08T23:54:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 115/162 2024-05-08T23:54:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 116/162 2024-05-08T23:54:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 117/162 2024-05-08T23:54:54.072 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 118/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 119/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 120/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 121/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 122/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 123/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 124/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 125/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 126/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 127/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 128/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 129/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 130/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T23:54:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T23:54:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T23:54:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T23:54:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T23:54:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T23:54:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T23:54:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T23:54:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T23:54:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T23:54:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T23:54:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T23:54:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T23:54:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T23:54:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T23:54:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T23:54:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T23:54:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T23:54:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T23:54:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T23:54:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T23:54:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T23:54:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T23:54:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T23:54:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:54:54.075 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T23:54:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:54:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T23:54:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:54:54.076 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T23:54:54.078 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T23:54:54.083 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:54:54.291 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T23:54:54.446 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:54:54.476 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T23:54:54.476 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T23:54:54.485 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T23:54:54.792 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T23:54:54.792 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T23:54:54.933 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T23:54:55.051 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T23:54:55.051 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T23:54:55.311 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T23:54:55.320 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T23:54:55.541 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T23:54:55.558 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T23:54:55.741 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T23:54:55.787 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T23:54:55.991 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T23:54:55.991 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:54:56.011 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T23:54:56.233 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:54:56.233 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T23:54:56.300 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T23:54:56.491 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T23:54:56.492 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:54:56.641 INFO:teuthology.orchestra.run.smithi150.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T23:54:56.716 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:54:56.717 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T23:54:56.886 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T23:54:56.966 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T23:54:56.974 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T23:54:56.974 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:54:57.203 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T23:54:57.216 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:54:57.218 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T23:54:57.391 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T23:54:57.392 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T23:54:57.420 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T23:54:57.431 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T23:54:57.639 INFO:teuthology.orchestra.run.smithi150.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-08T23:54:57.814 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T23:54:58.030 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T23:54:58.233 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T23:54:58.278 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T23:54:58.288 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T23:54:58.288 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T23:54:58.288 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T23:54:58.288 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T23:54:58.288 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T23:54:58.288 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T23:54:58.289 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T23:54:58.289 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T23:54:58.289 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T23:54:58.289 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:54:58.289 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:54:58.289 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:54:58.289 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T23:54:58.289 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T23:54:58.289 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T23:54:58.289 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T23:54:58.289 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T23:54:58.289 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T23:54:58.289 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T23:54:58.290 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:54:58.290 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T23:54:58.290 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T23:54:58.290 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T23:54:58.290 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T23:54:58.290 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T23:54:58.290 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T23:54:58.290 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T23:54:58.290 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T23:54:58.291 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T23:54:58.291 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T23:54:58.291 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T23:54:58.291 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T23:54:58.306 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T23:54:58.306 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T23:54:58.306 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T23:54:58.306 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T23:54:58.306 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T23:54:58.306 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T23:54:58.306 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T23:54:58.306 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T23:54:58.306 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T23:54:58.306 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T23:54:58.307 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T23:54:58.307 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T23:54:58.307 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T23:54:58.307 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T23:54:58.307 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T23:54:58.307 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T23:54:58.307 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T23:54:58.307 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T23:54:58.307 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T23:54:58.307 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T23:54:58.307 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T23:54:58.307 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T23:54:58.307 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T23:54:58.308 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T23:54:58.308 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T23:54:58.308 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T23:54:58.308 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T23:54:58.308 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T23:54:58.308 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T23:54:58.308 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T23:54:58.308 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T23:54:58.308 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T23:54:58.308 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T23:54:58.308 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T23:54:58.308 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T23:54:58.308 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T23:54:58.309 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T23:54:58.309 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T23:54:58.309 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T23:54:58.309 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T23:54:58.309 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-05-08T23:54:58.309 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2024-05-08T23:54:58.309 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2024-05-08T23:54:58.309 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2024-05-08T23:54:58.309 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2024-05-08T23:54:58.309 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2024-05-08T23:54:58.309 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2024-05-08T23:54:58.309 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2024-05-08T23:54:58.309 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2024-05-08T23:54:58.309 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2024-05-08T23:54:58.310 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2024-05-08T23:54:58.310 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2024-05-08T23:54:58.310 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2024-05-08T23:54:58.310 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2024-05-08T23:54:58.310 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2024-05-08T23:54:58.310 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2024-05-08T23:54:58.310 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/162 2024-05-08T23:54:58.310 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/162 2024-05-08T23:54:58.310 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/162 2024-05-08T23:54:58.310 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/162 2024-05-08T23:54:58.310 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 92/162 2024-05-08T23:54:58.310 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 93/162 2024-05-08T23:54:58.310 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 94/162 2024-05-08T23:54:58.311 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 95/162 2024-05-08T23:54:58.311 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 96/162 2024-05-08T23:54:58.311 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 97/162 2024-05-08T23:54:58.311 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 98/162 2024-05-08T23:54:58.311 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 99/162 2024-05-08T23:54:58.311 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-05-08T23:54:58.311 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-05-08T23:54:58.311 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-05-08T23:54:58.311 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-05-08T23:54:58.311 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-05-08T23:54:58.311 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-05-08T23:54:58.311 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-05-08T23:54:58.311 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-05-08T23:54:58.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-05-08T23:54:58.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-05-08T23:54:58.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-05-08T23:54:58.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-05-08T23:54:58.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-05-08T23:54:58.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-05-08T23:54:58.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-05-08T23:54:58.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-05-08T23:54:58.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-05-08T23:54:58.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-05-08T23:54:58.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-05-08T23:54:58.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-05-08T23:54:58.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-05-08T23:54:58.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-05-08T23:54:58.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-05-08T23:54:58.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-05-08T23:54:58.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-05-08T23:54:58.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-05-08T23:54:58.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-05-08T23:54:58.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-05-08T23:54:58.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-05-08T23:54:58.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-05-08T23:54:58.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-05-08T23:54:58.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T23:54:58.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T23:54:58.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T23:54:58.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T23:54:58.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T23:54:58.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T23:54:58.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T23:54:58.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T23:54:58.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T23:54:58.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T23:54:58.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T23:54:58.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T23:54:58.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T23:54:58.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T23:54:58.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T23:54:58.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T23:54:58.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T23:54:58.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T23:54:58.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T23:54:58.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T23:54:58.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T23:54:58.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T23:54:58.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T23:54:58.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T23:54:58.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T23:54:58.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:54:58.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T23:54:58.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:54:58.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T23:54:58.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:54:58.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T23:54:58.531 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T23:54:58.532 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T23:54:58.815 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T23:54:58.816 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T23:54:59.110 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T23:54:59.355 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T23:54:59.564 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T23:54:59.830 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T23:54:59.830 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:55:00.089 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:55:00.089 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T23:55:00.347 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T23:55:00.347 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:55:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:55:00.589 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T23:55:00.838 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T23:55:00.838 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:55:01.055 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:55:01.239 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T23:55:01.239 INFO:teuthology.orchestra.run.smithi150.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T23:55:02.209 INFO:teuthology.orchestra.run.smithi150.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T23:55:02.209 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T23:55:02.209 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T23:55:02.209 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T23:55:02.209 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T23:55:02.209 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T23:55:02.210 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T23:55:02.210 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T23:55:02.210 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T23:55:02.210 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T23:55:02.210 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T23:55:02.210 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T23:55:02.211 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T23:55:02.211 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T23:55:02.211 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T23:55:02.211 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T23:55:02.211 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T23:55:02.211 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T23:55:02.211 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T23:55:02.212 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T23:55:02.212 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T23:55:02.212 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T23:55:02.212 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T23:55:02.212 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T23:55:02.212 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T23:55:02.213 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T23:55:02.213 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T23:55:02.213 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T23:55:02.213 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T23:55:02.213 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T23:55:02.213 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T23:55:02.214 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T23:55:02.214 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T23:55:02.214 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T23:55:02.214 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T23:55:02.214 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T23:55:02.214 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T23:55:02.215 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T23:55:02.215 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T23:55:02.215 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T23:55:02.215 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T23:55:02.215 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T23:55:02.215 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T23:55:02.216 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T23:55:02.216 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T23:55:02.216 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T23:55:02.216 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T23:55:02.216 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T23:55:02.216 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T23:55:02.217 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T23:55:02.217 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T23:55:02.217 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T23:55:02.217 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T23:55:02.217 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T23:55:02.217 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T23:55:02.217 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T23:55:02.218 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T23:55:02.218 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T23:55:02.218 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T23:55:02.218 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T23:55:02.218 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T23:55:02.218 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T23:55:02.219 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T23:55:02.219 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T23:55:02.219 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T23:55:02.219 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T23:55:02.219 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T23:55:02.219 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T23:55:02.220 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T23:55:02.220 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T23:55:02.220 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T23:55:02.220 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T23:55:02.220 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/162 2024-05-08T23:55:02.220 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/162 2024-05-08T23:55:02.221 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/162 2024-05-08T23:55:02.221 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/162 2024-05-08T23:55:02.221 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/162 2024-05-08T23:55:02.221 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/162 2024-05-08T23:55:02.221 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/162 2024-05-08T23:55:02.221 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/162 2024-05-08T23:55:02.222 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/162 2024-05-08T23:55:02.222 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/162 2024-05-08T23:55:02.222 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/162 2024-05-08T23:55:02.222 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/162 2024-05-08T23:55:02.222 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/162 2024-05-08T23:55:02.222 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/162 2024-05-08T23:55:02.223 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/162 2024-05-08T23:55:02.223 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 87/162 2024-05-08T23:55:02.223 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 88/162 2024-05-08T23:55:02.223 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 89/162 2024-05-08T23:55:02.223 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 90/162 2024-05-08T23:55:02.223 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 91/162 2024-05-08T23:55:02.223 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 92/162 2024-05-08T23:55:02.224 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 93/162 2024-05-08T23:55:02.224 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 94/162 2024-05-08T23:55:02.224 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 95/162 2024-05-08T23:55:02.224 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 96/162 2024-05-08T23:55:02.224 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 97/162 2024-05-08T23:55:02.224 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 98/162 2024-05-08T23:55:02.225 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 99/162 2024-05-08T23:55:02.225 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-05-08T23:55:02.225 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-05-08T23:55:02.225 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-05-08T23:55:02.225 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-05-08T23:55:02.225 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-05-08T23:55:02.226 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-05-08T23:55:02.226 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-05-08T23:55:02.226 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-05-08T23:55:02.226 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-05-08T23:55:02.226 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-05-08T23:55:02.226 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-05-08T23:55:02.227 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-05-08T23:55:02.227 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-05-08T23:55:02.227 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-05-08T23:55:02.227 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-05-08T23:55:02.227 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-05-08T23:55:02.227 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-05-08T23:55:02.228 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-05-08T23:55:02.228 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-05-08T23:55:02.228 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-05-08T23:55:02.228 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-05-08T23:55:02.228 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-05-08T23:55:02.228 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-05-08T23:55:02.228 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-05-08T23:55:02.229 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-05-08T23:55:02.229 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-05-08T23:55:02.229 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-05-08T23:55:02.229 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-05-08T23:55:02.230 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-05-08T23:55:02.230 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-05-08T23:55:02.230 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-05-08T23:55:02.230 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T23:55:02.230 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T23:55:02.231 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T23:55:02.231 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T23:55:02.231 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T23:55:02.231 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T23:55:02.231 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T23:55:02.231 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T23:55:02.231 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T23:55:02.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T23:55:02.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T23:55:02.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T23:55:02.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T23:55:02.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T23:55:02.232 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T23:55:02.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T23:55:02.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T23:55:02.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T23:55:02.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T23:55:02.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T23:55:02.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T23:55:02.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T23:55:02.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T23:55:02.233 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T23:55:02.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T23:55:02.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T23:55:02.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T23:55:02.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T23:55:02.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T23:55:02.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T23:55:02.234 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T23:55:09.973 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T23:55:09.974 INFO:teuthology.orchestra.run.smithi081.stdout:Installed products updated. 2024-05-08T23:55:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:55:10.585 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-05-08T23:55:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T23:55:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T23:55:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T23:55:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.585 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:55:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:55:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T23:55:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T23:55:10.586 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-05-08T23:55:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T23:55:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T23:55:10.586 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T23:55:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:10.587 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:10.588 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T23:55:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T23:55:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T23:55:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T23:55:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: jq-1.6-7.el8.x86_64 2024-05-08T23:55:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T23:55:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T23:55:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T23:55:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T23:55:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T23:55:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T23:55:10.589 INFO:teuthology.orchestra.run.smithi081.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T23:55:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T23:55:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T23:55:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T23:55:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T23:55:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T23:55:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T23:55:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T23:55:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T23:55:10.590 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T23:55:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T23:55:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T23:55:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T23:55:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T23:55:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:55:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T23:55:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T23:55:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T23:55:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:55:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:55:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:55:10.591 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T23:55:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T23:55:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T23:55:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T23:55:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T23:55:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T23:55:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T23:55:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T23:55:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T23:55:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T23:55:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T23:55:10.592 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T23:55:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T23:55:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T23:55:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T23:55:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T23:55:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T23:55:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T23:55:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T23:55:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T23:55:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T23:55:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T23:55:10.593 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T23:55:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T23:55:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T23:55:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T23:55:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T23:55:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T23:55:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T23:55:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T23:55:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T23:55:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T23:55:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T23:55:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T23:55:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T23:55:10.594 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T23:55:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T23:55:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T23:55:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T23:55:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T23:55:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T23:55:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T23:55:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T23:55:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T23:55:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T23:55:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T23:55:10.595 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T23:55:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T23:55:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T23:55:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T23:55:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T23:55:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T23:55:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T23:55:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T23:55:10.596 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T23:55:10.597 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T23:55:10.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:55:10.597 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-05-08T23:55:10.799 DEBUG:teuthology.parallel:result is None 2024-05-08T23:55:14.388 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T23:55:14.389 INFO:teuthology.orchestra.run.smithi171.stdout:Installed products updated. 2024-05-08T23:55:15.025 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:55:15.025 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-05-08T23:55:15.025 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T23:55:15.025 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T23:55:15.025 INFO:teuthology.orchestra.run.smithi171.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T23:55:15.025 INFO:teuthology.orchestra.run.smithi171.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:15.025 INFO:teuthology.orchestra.run.smithi171.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:15.025 INFO:teuthology.orchestra.run.smithi171.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:15.025 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.025 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.025 INFO:teuthology.orchestra.run.smithi171.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:15.025 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:15.026 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:55:15.026 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:55:15.026 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:15.026 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:15.026 INFO:teuthology.orchestra.run.smithi171.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T23:55:15.026 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T23:55:15.026 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-05-08T23:55:15.026 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T23:55:15.026 INFO:teuthology.orchestra.run.smithi171.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T23:55:15.026 INFO:teuthology.orchestra.run.smithi171.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T23:55:15.026 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.027 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.027 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.027 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.027 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:15.027 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.027 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.027 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.027 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:15.027 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:15.027 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:15.027 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:15.027 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:15.027 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.028 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.028 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:15.028 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.028 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.028 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.028 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:15.028 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:15.028 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.028 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:15.028 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T23:55:15.028 INFO:teuthology.orchestra.run.smithi171.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T23:55:15.028 INFO:teuthology.orchestra.run.smithi171.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T23:55:15.028 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T23:55:15.029 INFO:teuthology.orchestra.run.smithi171.stdout: jq-1.6-7.el8.x86_64 2024-05-08T23:55:15.029 INFO:teuthology.orchestra.run.smithi171.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T23:55:15.029 INFO:teuthology.orchestra.run.smithi171.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T23:55:15.029 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T23:55:15.029 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.029 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.029 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.029 INFO:teuthology.orchestra.run.smithi171.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T23:55:15.029 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T23:55:15.029 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T23:55:15.029 INFO:teuthology.orchestra.run.smithi171.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T23:55:15.029 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T23:55:15.029 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T23:55:15.029 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.030 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.030 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T23:55:15.030 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.030 INFO:teuthology.orchestra.run.smithi171.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T23:55:15.030 INFO:teuthology.orchestra.run.smithi171.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T23:55:15.030 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T23:55:15.030 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T23:55:15.030 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:15.030 INFO:teuthology.orchestra.run.smithi171.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T23:55:15.030 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T23:55:15.030 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T23:55:15.030 INFO:teuthology.orchestra.run.smithi171.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T23:55:15.030 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T23:55:15.030 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T23:55:15.031 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:55:15.031 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T23:55:15.031 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T23:55:15.031 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T23:55:15.031 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:55:15.031 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:55:15.031 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:55:15.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T23:55:15.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T23:55:15.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T23:55:15.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T23:55:15.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T23:55:15.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.031 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.032 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.032 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T23:55:15.032 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T23:55:15.032 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T23:55:15.032 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T23:55:15.032 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T23:55:15.032 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T23:55:15.033 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T23:55:15.033 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T23:55:15.033 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T23:55:15.033 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T23:55:15.033 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T23:55:15.033 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T23:55:15.033 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T23:55:15.033 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T23:55:15.033 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T23:55:15.033 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T23:55:15.033 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T23:55:15.033 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T23:55:15.033 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T23:55:15.034 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T23:55:15.034 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T23:55:15.034 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T23:55:15.034 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T23:55:15.034 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T23:55:15.034 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T23:55:15.034 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T23:55:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T23:55:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T23:55:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T23:55:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T23:55:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T23:55:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T23:55:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T23:55:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T23:55:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T23:55:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T23:55:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T23:55:15.036 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T23:55:15.037 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T23:55:15.037 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T23:55:15.037 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:55:15.037 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-05-08T23:55:15.247 DEBUG:teuthology.parallel:result is None 2024-05-08T23:55:15.387 INFO:teuthology.orchestra.run.smithi150.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T23:55:15.387 INFO:teuthology.orchestra.run.smithi150.stdout:Installed products updated. 2024-05-08T23:55:16.792 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-08T23:55:16.793 INFO:teuthology.orchestra.run.smithi150.stdout:Upgraded: 2024-05-08T23:55:16.793 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T23:55:16.793 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T23:55:16.793 INFO:teuthology.orchestra.run.smithi150.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T23:55:16.793 INFO:teuthology.orchestra.run.smithi150.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:16.793 INFO:teuthology.orchestra.run.smithi150.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:16.793 INFO:teuthology.orchestra.run.smithi150.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:16.793 INFO:teuthology.orchestra.run.smithi150.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.793 INFO:teuthology.orchestra.run.smithi150.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.793 INFO:teuthology.orchestra.run.smithi150.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:16.793 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:16.794 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:55:16.794 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:55:16.794 INFO:teuthology.orchestra.run.smithi150.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:16.794 INFO:teuthology.orchestra.run.smithi150.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:16.794 INFO:teuthology.orchestra.run.smithi150.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T23:55:16.794 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T23:55:16.794 INFO:teuthology.orchestra.run.smithi150.stdout:Installed: 2024-05-08T23:55:16.794 INFO:teuthology.orchestra.run.smithi150.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T23:55:16.794 INFO:teuthology.orchestra.run.smithi150.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T23:55:16.794 INFO:teuthology.orchestra.run.smithi150.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T23:55:16.794 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.794 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.794 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.795 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.795 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:16.795 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.795 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.795 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.795 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:16.795 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:16.795 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:16.795 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:16.795 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:16.795 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.795 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.795 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:16.796 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.796 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.796 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.796 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:16.796 INFO:teuthology.orchestra.run.smithi150.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:16.796 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.796 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T23:55:16.796 INFO:teuthology.orchestra.run.smithi150.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T23:55:16.796 INFO:teuthology.orchestra.run.smithi150.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T23:55:16.796 INFO:teuthology.orchestra.run.smithi150.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T23:55:16.796 INFO:teuthology.orchestra.run.smithi150.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T23:55:16.796 INFO:teuthology.orchestra.run.smithi150.stdout: jq-1.6-7.el8.x86_64 2024-05-08T23:55:16.796 INFO:teuthology.orchestra.run.smithi150.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T23:55:16.797 INFO:teuthology.orchestra.run.smithi150.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T23:55:16.797 INFO:teuthology.orchestra.run.smithi150.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T23:55:16.797 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.797 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.797 INFO:teuthology.orchestra.run.smithi150.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.797 INFO:teuthology.orchestra.run.smithi150.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T23:55:16.797 INFO:teuthology.orchestra.run.smithi150.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T23:55:16.797 INFO:teuthology.orchestra.run.smithi150.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T23:55:16.797 INFO:teuthology.orchestra.run.smithi150.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T23:55:16.797 INFO:teuthology.orchestra.run.smithi150.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T23:55:16.797 INFO:teuthology.orchestra.run.smithi150.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T23:55:16.797 INFO:teuthology.orchestra.run.smithi150.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.797 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.798 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T23:55:16.798 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.798 INFO:teuthology.orchestra.run.smithi150.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T23:55:16.798 INFO:teuthology.orchestra.run.smithi150.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T23:55:16.798 INFO:teuthology.orchestra.run.smithi150.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T23:55:16.798 INFO:teuthology.orchestra.run.smithi150.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T23:55:16.798 INFO:teuthology.orchestra.run.smithi150.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T23:55:16.798 INFO:teuthology.orchestra.run.smithi150.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T23:55:16.798 INFO:teuthology.orchestra.run.smithi150.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T23:55:16.798 INFO:teuthology.orchestra.run.smithi150.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T23:55:16.798 INFO:teuthology.orchestra.run.smithi150.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T23:55:16.798 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T23:55:16.798 INFO:teuthology.orchestra.run.smithi150.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T23:55:16.798 INFO:teuthology.orchestra.run.smithi150.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T23:55:16.799 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T23:55:16.799 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T23:55:16.799 INFO:teuthology.orchestra.run.smithi150.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T23:55:16.799 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:55:16.799 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:55:16.799 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T23:55:16.799 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T23:55:16.799 INFO:teuthology.orchestra.run.smithi150.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T23:55:16.799 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T23:55:16.799 INFO:teuthology.orchestra.run.smithi150.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T23:55:16.799 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T23:55:16.799 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.799 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.799 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T23:55:16.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T23:55:16.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T23:55:16.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T23:55:16.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T23:55:16.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T23:55:16.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T23:55:16.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T23:55:16.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T23:55:16.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T23:55:16.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T23:55:16.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T23:55:16.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T23:55:16.800 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T23:55:16.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T23:55:16.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T23:55:16.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T23:55:16.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T23:55:16.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T23:55:16.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T23:55:16.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T23:55:16.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T23:55:16.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T23:55:16.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T23:55:16.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T23:55:16.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T23:55:16.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T23:55:16.801 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T23:55:16.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T23:55:16.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T23:55:16.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T23:55:16.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T23:55:16.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T23:55:16.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T23:55:16.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T23:55:16.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T23:55:16.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T23:55:16.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T23:55:16.802 INFO:teuthology.orchestra.run.smithi150.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T23:55:16.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T23:55:16.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T23:55:16.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T23:55:16.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T23:55:16.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T23:55:16.803 INFO:teuthology.orchestra.run.smithi150.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T23:55:16.803 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.803 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.803 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T23:55:16.803 INFO:teuthology.orchestra.run.smithi150.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T23:55:16.803 INFO:teuthology.orchestra.run.smithi150.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T23:55:16.803 INFO:teuthology.orchestra.run.smithi150.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T23:55:16.803 INFO:teuthology.orchestra.run.smithi150.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T23:55:16.803 INFO:teuthology.orchestra.run.smithi150.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T23:55:16.804 INFO:teuthology.orchestra.run.smithi150.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T23:55:16.804 INFO:teuthology.orchestra.run.smithi150.stdout: 2024-05-08T23:55:16.804 INFO:teuthology.orchestra.run.smithi150.stdout:Complete! 2024-05-08T23:55:17.285 DEBUG:teuthology.parallel:result is None 2024-05-08T23:55:17.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:55:17.438 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T23:55:17.467 INFO:teuthology.orchestra.run.smithi081.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T23:55:17.467 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T23:55:17.468 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T23:55:17.469 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:55:17.615 DEBUG:teuthology.orchestra.run.smithi150:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T23:55:17.640 INFO:teuthology.orchestra.run.smithi150.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T23:55:17.640 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T23:55:17.640 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T23:55:17.642 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:55:17.783 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T23:55:17.811 INFO:teuthology.orchestra.run.smithi171.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T23:55:17.812 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T23:55:17.812 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T23:55:17.813 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T23:55:17.814 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T23:55:17.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T23:55:17.863 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-08T23:55:17.863 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T23:55:17.907 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-08T23:55:17.907 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T23:55:17.956 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T23:55:17.956 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T23:55:17.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T23:55:17.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T23:55:18.057 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-08T23:55:18.058 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T23:55:18.085 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T23:55:18.153 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-08T23:55:18.153 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T23:55:18.187 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T23:55:18.257 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T23:55:18.258 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T23:55:18.258 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T23:55:18.288 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T23:55:18.358 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-08T23:55:18.358 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T23:55:18.386 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T23:55:18.454 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-08T23:55:18.454 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T23:55:18.486 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T23:55:18.557 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T23:55:18.558 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T23:55:18.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T23:55:18.590 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T23:55:18.662 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-08T23:55:18.663 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T23:55:18.690 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T23:55:18.788 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-08T23:55:18.789 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T23:55:18.823 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T23:55:18.859 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-08T23:55:18.965 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-05-08T23:55:18.965 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:55:18.966 INFO:tasks.cephadm:Cluster fsid is 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:55:18.966 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-08T23:55:18.966 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.81', 'mon.b': '172.21.15.150', 'mon.c': '172.21.15.171'} 2024-05-08T23:55:18.966 INFO:tasks.cephadm:First mon is mon.a on smithi081 2024-05-08T23:55:18.966 INFO:tasks.cephadm:First mgr is x 2024-05-08T23:55:18.966 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-08T23:55:18.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname $(hostname -s) 2024-05-08T23:55:19.064 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname $(hostname -s) 2024-05-08T23:55:19.093 DEBUG:teuthology.orchestra.run.smithi171:> sudo hostname $(hostname -s) 2024-05-08T23:55:19.126 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-08T23:55:19.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:55:19.359 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/79222/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.2-1322-gd21e4f96', 'node_name': '172.21.2.4+braggi04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.2-1322.gd21e4f96'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2024-05-08 19:11:17.581213', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240508.150423-reef', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/', 'archs': ['arm64', 'source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/79220/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.2-1322-gd21e4f96', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.2-1322.gd21e4f96'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2024-05-08 18:26:58.979379', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240508.150423-reef', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-05-08T23:55:19.505 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20240508.150423-reef, sha1 d21e4f961318b56f0d915caa2490c3711bf13c34 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T23:55:19.506 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/x86_64/flavors/default/cephadm 2024-05-08T23:55:19.506 DEBUG:teuthology.orchestra.run.smithi081:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T23:55:20.019 INFO:teuthology.orchestra.run.smithi081.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 May 8 23:55 /home/ubuntu/cephtest/cephadm 2024-05-08T23:55:20.019 DEBUG:teuthology.orchestra.run.smithi150:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T23:55:20.390 INFO:teuthology.orchestra.run.smithi150.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 May 8 23:55 /home/ubuntu/cephtest/cephadm 2024-05-08T23:55:20.390 DEBUG:teuthology.orchestra.run.smithi171:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T23:55:20.751 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 May 8 23:55 /home/ubuntu/cephtest/cephadm 2024-05-08T23:55:20.752 DEBUG:teuthology.orchestra.run.smithi081:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T23:55:20.774 DEBUG:teuthology.orchestra.run.smithi150:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T23:55:20.795 DEBUG:teuthology.orchestra.run.smithi171:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T23:55:20.834 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 on all hosts... 2024-05-08T23:55:20.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 pull 2024-05-08T23:55:20.837 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 pull 2024-05-08T23:55:20.839 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 pull 2024-05-08T23:55:21.881 INFO:teuthology.orchestra.run.smithi081.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T23:55:22.439 INFO:teuthology.orchestra.run.smithi171.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T23:55:23.110 INFO:teuthology.orchestra.run.smithi150.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T23:55:50.313 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-05-08T23:55:50.313 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T23:55:50.313 INFO:teuthology.orchestra.run.smithi150.stdout: "image_id": "af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c", 2024-05-08T23:55:50.313 INFO:teuthology.orchestra.run.smithi150.stdout: "repo_digests": [ 2024-05-08T23:55:50.313 INFO:teuthology.orchestra.run.smithi150.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985" 2024-05-08T23:55:50.313 INFO:teuthology.orchestra.run.smithi150.stdout: ] 2024-05-08T23:55:50.314 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-05-08T23:55:52.506 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-08T23:55:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T23:55:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "image_id": "af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c", 2024-05-08T23:55:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "repo_digests": [ 2024-05-08T23:55:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985" 2024-05-08T23:55:52.506 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-08T23:55:52.507 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-08T23:55:52.755 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-05-08T23:55:52.755 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T23:55:52.755 INFO:teuthology.orchestra.run.smithi171.stdout: "image_id": "af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c", 2024-05-08T23:55:52.755 INFO:teuthology.orchestra.run.smithi171.stdout: "repo_digests": [ 2024-05-08T23:55:52.755 INFO:teuthology.orchestra.run.smithi171.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985" 2024-05-08T23:55:52.756 INFO:teuthology.orchestra.run.smithi171.stdout: ] 2024-05-08T23:55:52.756 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-05-08T23:55:52.775 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph 2024-05-08T23:55:52.807 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph 2024-05-08T23:55:52.846 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph 2024-05-08T23:55:52.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /etc/ceph 2024-05-08T23:55:52.903 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /etc/ceph 2024-05-08T23:55:52.937 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /etc/ceph 2024-05-08T23:55:52.965 INFO:tasks.cephadm:Writing seed config... 2024-05-08T23:55:52.967 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-08T23:55:52.967 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-08T23:55:52.967 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-08T23:55:52.967 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-08T23:55:52.968 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-08T23:55:52.968 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-05-08T23:55:52.968 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-08T23:55:52.968 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-08T23:55:52.968 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-08T23:55:52.968 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-08T23:55:52.968 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-08T23:55:52.969 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-08T23:55:52.969 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-08T23:55:52.969 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-08T23:55:52.969 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-08T23:55:52.969 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-08T23:55:52.969 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-08T23:55:52.969 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-05-08T23:55:52.969 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-05-08T23:55:52.969 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-08T23:55:52.969 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-08T23:55:52.969 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-08T23:55:52.970 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-08T23:55:52.970 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-05-08T23:55:52.970 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-08T23:55:52.970 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-08T23:55:52.970 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-08T23:55:52.970 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-08T23:55:52.970 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-08T23:55:52.970 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-08T23:55:52.970 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-08T23:55:52.970 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-05-08T23:55:52.970 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-08T23:55:52.970 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-05-08T23:55:52.971 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-05-08T23:55:52.971 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-08T23:55:52.971 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-08T23:55:52.971 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-05-08T23:55:52.971 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-08T23:55:52.971 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-08T23:55:52.971 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-08T23:55:52.971 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-08T23:55:52.971 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-08T23:55:52.971 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-08T23:55:52.971 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-08T23:55:52.971 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-05-08T23:55:52.972 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T23:55:52.972 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-08T23:55:52.990 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 6c93ddc4-0d96-11ef-bc97-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-08T23:55:52.991 DEBUG:teuthology.orchestra.run.smithi081:mon.a> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mon.a.service 2024-05-08T23:55:53.032 DEBUG:teuthology.orchestra.run.smithi081:mgr.x> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.x.service 2024-05-08T23:55:53.059 INFO:journalctl@ceph.mon.a.smithi081.stdout:-- Logs begin at Wed 2024-05-08 23:39:48 UTC. -- 2024-05-08T23:55:53.059 INFO:tasks.cephadm:Bootstrapping... 2024-05-08T23:55:53.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 -v bootstrap --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.81 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:55:53.085 INFO:journalctl@ceph.mgr.x.smithi081.stdout:-- Logs begin at Wed 2024-05-08 23:39:48 UTC. -- 2024-05-08T23:55:53.218 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-05-08T23:55:53.219 INFO:teuthology.orchestra.run.smithi081.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34', '-v', 'bootstrap', '--fsid', '6c93ddc4-0d96-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.81', '--skip-admin-label'] 2024-05-08T23:55:53.254 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 4.6.1 2024-05-08T23:55:53.255 INFO:teuthology.orchestra.run.smithi081.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-08T23:55:53.255 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying podman|docker is present... 2024-05-08T23:55:53.292 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 4.6.1 2024-05-08T23:55:53.292 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying lvm2 is present... 2024-05-08T23:55:53.292 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying time synchronization is in place... 2024-05-08T23:55:53.299 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-08T23:55:53.299 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-08T23:55:53.305 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-08T23:55:53.305 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-05-08T23:55:53.311 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout enabled 2024-05-08T23:55:53.317 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout active 2024-05-08T23:55:53.317 INFO:teuthology.orchestra.run.smithi081.stdout:Unit chronyd.service is enabled and running 2024-05-08T23:55:53.317 INFO:teuthology.orchestra.run.smithi081.stdout:Repeating the final host check... 2024-05-08T23:55:53.354 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout 4.6.1 2024-05-08T23:55:53.354 INFO:teuthology.orchestra.run.smithi081.stdout:podman (/bin/podman) version 4.6.1 is present 2024-05-08T23:55:53.354 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl is present 2024-05-08T23:55:53.354 INFO:teuthology.orchestra.run.smithi081.stdout:lvcreate is present 2024-05-08T23:55:53.360 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-08T23:55:53.360 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-08T23:55:53.366 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-08T23:55:53.366 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-05-08T23:55:53.372 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout enabled 2024-05-08T23:55:53.378 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout active 2024-05-08T23:55:53.378 INFO:teuthology.orchestra.run.smithi081.stdout:Unit chronyd.service is enabled and running 2024-05-08T23:55:53.379 INFO:teuthology.orchestra.run.smithi081.stdout:Host looks OK 2024-05-08T23:55:53.379 INFO:teuthology.orchestra.run.smithi081.stdout:Cluster fsid: 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:55:53.379 INFO:teuthology.orchestra.run.smithi081.stdout:Acquiring lock 140165791934952 on /run/cephadm/6c93ddc4-0d96-11ef-bc97-c7b262605968.lock 2024-05-08T23:55:53.379 INFO:teuthology.orchestra.run.smithi081.stdout:Lock 140165791934952 acquired on /run/cephadm/6c93ddc4-0d96-11ef-bc97-c7b262605968.lock 2024-05-08T23:55:53.379 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying IP 172.21.15.81 port 3300 ... 2024-05-08T23:55:53.379 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying IP 172.21.15.81 port 6789 ... 2024-05-08T23:55:53.379 INFO:teuthology.orchestra.run.smithi081.stdout:Base mon IP(s) is [172.21.15.81:3300, 172.21.15.81:6789], mon addrv is [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-05-08T23:55:53.383 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2024-05-08T23:55:53.383 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.81 metric 100 2024-05-08T23:55:53.386 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-08T23:55:53.386 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-05-08T23:55:53.386 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-05-08T23:55:53.389 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-08T23:55:53.389 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-08T23:55:53.389 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-08T23:55:53.389 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-08T23:55:53.389 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout inet6 fe80::2c08:76e3:a549:1524/64 scope link noprefixroute 2024-05-08T23:55:53.389 INFO:teuthology.orchestra.run.smithi081.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-08T23:55:53.390 INFO:teuthology.orchestra.run.smithi081.stdout:Mon IP `172.21.15.81` is in CIDR network `172.21.0.0/20` 2024-05-08T23:55:53.390 INFO:teuthology.orchestra.run.smithi081.stdout:Mon IP `172.21.15.81` is in CIDR network `172.21.0.0/20` 2024-05-08T23:55:53.390 INFO:teuthology.orchestra.run.smithi081.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-08T23:55:53.390 INFO:teuthology.orchestra.run.smithi081.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-08T23:55:53.391 INFO:teuthology.orchestra.run.smithi081.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T23:55:53.764 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stdout af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c 2024-05-08T23:55:53.764 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T23:55:53.764 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Getting image source signatures 2024-05-08T23:55:53.764 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying blob sha256:7850648fa4707607dddc5eec7674b8c9296086cf87f20a8b1acf1b014b952e9f 2024-05-08T23:55:53.764 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-08T23:55:53.764 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Copying config sha256:af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c 2024-05-08T23:55:53.764 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-08T23:55:54.451 INFO:teuthology.orchestra.run.smithi081.stdout:ceph: stdout ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable) 2024-05-08T23:55:54.451 INFO:teuthology.orchestra.run.smithi081.stdout:Ceph version: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable) 2024-05-08T23:55:54.451 INFO:teuthology.orchestra.run.smithi081.stdout:Extracting ceph user uid/gid from container image... 2024-05-08T23:55:55.054 INFO:teuthology.orchestra.run.smithi081.stdout:stat: stdout 167 167 2024-05-08T23:55:55.055 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial keys... 2024-05-08T23:55:55.641 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQALETxmv5x5EhAAdyhSJz7OE3RZi12ZUv0iOQ== 2024-05-08T23:55:56.207 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQALETxm4ddENBAAt78qbu1EQeNMKttQih+LRQ== 2024-05-08T23:55:56.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph-authtool: stdout AQAMETxmKwrvGRAA6m0L9+X1cq+j+yp+3Mc5NQ== 2024-05-08T23:55:56.776 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial monmap... 2024-05-08T23:55:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-08T23:55:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-05-08T23:55:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:55:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-08T23:55:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool for a [v2:172.21.15.81:3300,v1:172.21.15.81:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-08T23:55:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = pacific 2024-05-08T23:55:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: set fsid to 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:55:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-08T23:55:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:55:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:Creating mon... 2024-05-08T23:55:57.942 INFO:teuthology.orchestra.run.smithi081.stdout:create mon.a on 2024-05-08T23:55:58.066 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-05-08T23:55:58.156 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-08T23:55:58.281 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968.target. 2024-05-08T23:55:58.281 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968.target. 2024-05-08T23:55:58.433 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mon.a 2024-05-08T23:55:58.433 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mon.a.service: Unit ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mon.a.service not loaded. 2024-05-08T23:55:58.522 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968.target.wants/ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mon.a.service → /etc/systemd/system/ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@.service. 2024-05-08T23:55:58.884 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T23:55:58.884 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-05-08T23:55:58.893 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T23:55:58.893 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-05-08T23:55:58.893 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-05-08T23:55:58.893 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to enable service . firewalld.service is not available 2024-05-08T23:55:58.893 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mon to start... 2024-05-08T23:55:58.893 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mon... 2024-05-08T23:55:59.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:55:58 smithi081 ceph-mon[41991]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T23:55:59.656 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout cluster: 2024-05-08T23:55:59.656 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout id: 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:55:59.656 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-08T23:55:59.656 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-08T23:55:59.656 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout services: 2024-05-08T23:55:59.656 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.429709s) 2024-05-08T23:55:59.656 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-08T23:55:59.656 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-08T23:55:59.657 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-08T23:55:59.657 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout data: 2024-05-08T23:55:59.657 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-08T23:55:59.657 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-08T23:55:59.657 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-08T23:55:59.657 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout pgs: 2024-05-08T23:55:59.657 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-08T23:55:59.657 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.275+0000 7ff497ac0700 1 Processor -- start 2024-05-08T23:55:59.657 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.275+0000 7ff497ac0700 1 -- start start 2024-05-08T23:55:59.657 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.275+0000 7ff497ac0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4901072e0 0x7ff4901096d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:55:59.657 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.275+0000 7ff497ac0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff490079e90 con 0x7ff4901072e0 2024-05-08T23:55:59.657 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.276+0000 7ff49585c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4901072e0 0x7ff4901096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:55:59.658 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.276+0000 7ff49585c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4901072e0 0x7ff4901096d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43648/0 (socket says 172.21.15.81:43648) 2024-05-08T23:55:59.658 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.276+0000 7ff49585c700 1 -- 172.21.15.81:0/1145456556 learned_addr learned my addr 172.21.15.81:0/1145456556 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:55:59.658 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.276+0000 7ff49585c700 1 -- 172.21.15.81:0/1145456556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff490109c10 con 0x7ff4901072e0 2024-05-08T23:55:59.658 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.276+0000 7ff49585c700 1 --2- 172.21.15.81:0/1145456556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4901072e0 0x7ff4901096d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0098a0 tx=0x7ff48c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6220b3d319ad25b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:55:59.658 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.276+0000 7ff49485a700 1 -- 172.21.15.81:0/1145456556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff48c004160 con 0x7ff4901072e0 2024-05-08T23:55:59.658 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.276+0000 7ff49485a700 1 -- 172.21.15.81:0/1145456556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c0042c0 con 0x7ff4901072e0 2024-05-08T23:55:59.658 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.276+0000 7ff49485a700 1 -- 172.21.15.81:0/1145456556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff48c0045a0 con 0x7ff4901072e0 2024-05-08T23:55:59.658 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.277+0000 7ff497ac0700 1 -- 172.21.15.81:0/1145456556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4901072e0 msgr2=0x7ff4901096d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:55:59.658 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.277+0000 7ff497ac0700 1 --2- 172.21.15.81:0/1145456556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4901072e0 0x7ff4901096d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0098a0 tx=0x7ff48c009bb0 comp rx=0 tx=0).stop 2024-05-08T23:55:59.658 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.277+0000 7ff497ac0700 1 -- 172.21.15.81:0/1145456556 shutdown_connections 2024-05-08T23:55:59.658 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.277+0000 7ff497ac0700 1 --2- 172.21.15.81:0/1145456556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4901072e0 0x7ff4901096d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:55:59.658 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.277+0000 7ff497ac0700 1 -- 172.21.15.81:0/1145456556 >> 172.21.15.81:0/1145456556 conn(0x7ff490100cf0 msgr2=0x7ff490103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:55:59.659 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.277+0000 7ff497ac0700 1 -- 172.21.15.81:0/1145456556 shutdown_connections 2024-05-08T23:55:59.659 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.277+0000 7ff497ac0700 1 -- 172.21.15.81:0/1145456556 wait complete. 2024-05-08T23:55:59.659 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.278+0000 7ff497ac0700 1 Processor -- start 2024-05-08T23:55:59.659 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.278+0000 7ff497ac0700 1 -- start start 2024-05-08T23:55:59.659 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.278+0000 7ff497ac0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4901072e0 0x7ff490106b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:55:59.659 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.278+0000 7ff497ac0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff490107050 con 0x7ff4901072e0 2024-05-08T23:55:59.659 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.278+0000 7ff49585c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4901072e0 0x7ff490106b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:55:59.659 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.278+0000 7ff49585c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4901072e0 0x7ff490106b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43658/0 (socket says 172.21.15.81:43658) 2024-05-08T23:55:59.659 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.278+0000 7ff49585c700 1 -- 172.21.15.81:0/877810592 learned_addr learned my addr 172.21.15.81:0/877810592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:55:59.659 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.278+0000 7ff49585c700 1 -- 172.21.15.81:0/877810592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c009550 con 0x7ff4901072e0 2024-05-08T23:55:59.660 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.278+0000 7ff49585c700 1 --2- 172.21.15.81:0/877810592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4901072e0 0x7ff490106b10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff4900792d0 tx=0x7ff48c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:55:59.660 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.278+0000 7ff486ffd700 1 -- 172.21.15.81:0/877810592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff48c011630 con 0x7ff4901072e0 2024-05-08T23:55:59.660 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.278+0000 7ff486ffd700 1 -- 172.21.15.81:0/877810592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c011790 con 0x7ff4901072e0 2024-05-08T23:55:59.660 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.278+0000 7ff486ffd700 1 -- 172.21.15.81:0/877810592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff48c011a30 con 0x7ff4901072e0 2024-05-08T23:55:59.660 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.278+0000 7ff497ac0700 1 -- 172.21.15.81:0/877810592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff490105290 con 0x7ff4901072e0 2024-05-08T23:55:59.660 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.279+0000 7ff497ac0700 1 -- 172.21.15.81:0/877810592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff490105730 con 0x7ff4901072e0 2024-05-08T23:55:59.660 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.279+0000 7ff486ffd700 1 -- 172.21.15.81:0/877810592 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff48c021070 con 0x7ff4901072e0 2024-05-08T23:55:59.660 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.279+0000 7ff486ffd700 1 -- 172.21.15.81:0/877810592 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff48c01b440 con 0x7ff4901072e0 2024-05-08T23:55:59.660 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.279+0000 7ff497ac0700 1 -- 172.21.15.81:0/877810592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff490068030 con 0x7ff4901072e0 2024-05-08T23:55:59.660 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.282+0000 7ff486ffd700 1 -- 172.21.15.81:0/877810592 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7ff48c01a460 con 0x7ff4901072e0 2024-05-08T23:55:59.661 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.351+0000 7ff497ac0700 1 -- 172.21.15.81:0/877810592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ff49010a0f0 con 0x7ff4901072e0 2024-05-08T23:55:59.661 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.351+0000 7ff486ffd700 1 -- 172.21.15.81:0/877810592 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7ff48c01a600 con 0x7ff4901072e0 2024-05-08T23:55:59.661 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.352+0000 7ff497ac0700 1 -- 172.21.15.81:0/877810592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4901072e0 msgr2=0x7ff490106b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:55:59.661 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.352+0000 7ff497ac0700 1 --2- 172.21.15.81:0/877810592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4901072e0 0x7ff490106b10 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff4900792d0 tx=0x7ff48c004750 comp rx=0 tx=0).stop 2024-05-08T23:55:59.661 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.352+0000 7ff497ac0700 1 -- 172.21.15.81:0/877810592 shutdown_connections 2024-05-08T23:55:59.661 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.352+0000 7ff497ac0700 1 --2- 172.21.15.81:0/877810592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff4901072e0 0x7ff490106b10 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:55:59.661 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.352+0000 7ff497ac0700 1 -- 172.21.15.81:0/877810592 >> 172.21.15.81:0/877810592 conn(0x7ff490100cf0 msgr2=0x7ff490103050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:55:59.661 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.352+0000 7ff497ac0700 1 -- 172.21.15.81:0/877810592 shutdown_connections 2024-05-08T23:55:59.661 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:55:59.352+0000 7ff497ac0700 1 -- 172.21.15.81:0/877810592 wait complete. 2024-05-08T23:55:59.662 INFO:teuthology.orchestra.run.smithi081.stdout:mon is available 2024-05-08T23:55:59.662 INFO:teuthology.orchestra.run.smithi081.stdout:Assimilating anything we can from ceph.conf... 2024-05-08T23:56:00.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:55:59 smithi081 ceph-mon[41991]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T23:56:00.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:55:59 smithi081 ceph-mon[41991]: monmap e1: 1 mons at {a=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:56:00.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:55:59 smithi081 ceph-mon[41991]: fsmap 2024-05-08T23:56:00.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:55:59 smithi081 ceph-mon[41991]: osdmap e1: 0 total, 0 up, 0 in 2024-05-08T23:56:00.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:55:59 smithi081 ceph-mon[41991]: mgrmap e1: no daemons active 2024-05-08T23:56:00.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:55:59 smithi081 ceph-mon[41991]: from='client.? 172.21.15.81:0/877810592' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-08T23:56:00.485 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-08T23:56:00.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [global] 2024-05-08T23:56:00.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout fsid = 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:56:00.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.81:3300,v1:172.21.15.81:6789] 2024-05-08T23:56:00.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-08T23:56:00.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-08T23:56:00.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-08T23:56:00.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-08T23:56:00.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-08T23:56:00.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-08T23:56:00.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-08T23:56:00.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-08T23:56:00.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [osd] 2024-05-08T23:56:00.486 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-08T23:56:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-08T23:56:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-08T23:56:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-08T23:56:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-08T23:56:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.067+0000 7f6f0ad68700 1 Processor -- start 2024-05-08T23:56:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.067+0000 7f6f0ad68700 1 -- start start 2024-05-08T23:56:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.068+0000 7f6f0ad68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f04105730 0x7f6f04105b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.068+0000 7f6f0ad68700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f04106120 con 0x7f6f04105730 2024-05-08T23:56:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.068+0000 7f6f08b04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f04105730 0x7f6f04105b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.068+0000 7f6f08b04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f04105730 0x7f6f04105b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43674/0 (socket says 172.21.15.81:43674) 2024-05-08T23:56:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.068+0000 7f6f08b04700 1 -- 172.21.15.81:0/1371342303 learned_addr learned my addr 172.21.15.81:0/1371342303 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.068+0000 7f6f08b04700 1 -- 172.21.15.81:0/1371342303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f04106930 con 0x7f6f04105730 2024-05-08T23:56:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.068+0000 7f6f08b04700 1 --2- 172.21.15.81:0/1371342303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f04105730 0x7f6f04105b50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800bb40 tx=0x7f6ef800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad34d3f419bddf63 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:00.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.068+0000 7f6f037fe700 1 -- 172.21.15.81:0/1371342303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ef800dbe0 con 0x7f6f04105730 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.068+0000 7f6f037fe700 1 -- 172.21.15.81:0/1371342303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef800dd40 con 0x7f6f04105730 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.068+0000 7f6f037fe700 1 -- 172.21.15.81:0/1371342303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ef8004030 con 0x7f6f04105730 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.069+0000 7f6f0ad68700 1 -- 172.21.15.81:0/1371342303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f04105730 msgr2=0x7f6f04105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.069+0000 7f6f0ad68700 1 --2- 172.21.15.81:0/1371342303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f04105730 0x7f6f04105b50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800bb40 tx=0x7f6ef800be50 comp rx=0 tx=0).stop 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.069+0000 7f6f0ad68700 1 -- 172.21.15.81:0/1371342303 shutdown_connections 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.069+0000 7f6f0ad68700 1 --2- 172.21.15.81:0/1371342303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f04105730 0x7f6f04105b50 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.069+0000 7f6f0ad68700 1 -- 172.21.15.81:0/1371342303 >> 172.21.15.81:0/1371342303 conn(0x7f6f04100cf0 msgr2=0x7f6f04103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.069+0000 7f6f0ad68700 1 -- 172.21.15.81:0/1371342303 shutdown_connections 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.069+0000 7f6f0ad68700 1 -- 172.21.15.81:0/1371342303 wait complete. 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.069+0000 7f6f0ad68700 1 Processor -- start 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.070+0000 7f6f0ad68700 1 -- start start 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.070+0000 7f6f0ad68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f04105730 0x7f6f0419bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.070+0000 7f6f0ad68700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0419c4b0 con 0x7f6f04105730 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.070+0000 7f6f08b04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f04105730 0x7f6f0419bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:00.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.070+0000 7f6f08b04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f04105730 0x7f6f0419bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43690/0 (socket says 172.21.15.81:43690) 2024-05-08T23:56:00.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.070+0000 7f6f08b04700 1 -- 172.21.15.81:0/829648824 learned_addr learned my addr 172.21.15.81:0/829648824 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:00.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.070+0000 7f6f08b04700 1 -- 172.21.15.81:0/829648824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef800b7f0 con 0x7f6f04105730 2024-05-08T23:56:00.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.070+0000 7f6f08b04700 1 --2- 172.21.15.81:0/829648824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f04105730 0x7f6f0419bf70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800b340 tx=0x7f6ef8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:00.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.070+0000 7f6f01ffb700 1 -- 172.21.15.81:0/829648824 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ef8003d80 con 0x7f6f04105730 2024-05-08T23:56:00.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.070+0000 7f6f01ffb700 1 -- 172.21.15.81:0/829648824 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8010470 con 0x7f6f04105730 2024-05-08T23:56:00.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.070+0000 7f6f01ffb700 1 -- 172.21.15.81:0/829648824 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ef8010750 con 0x7f6f04105730 2024-05-08T23:56:00.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.070+0000 7f6f0ad68700 1 -- 172.21.15.81:0/829648824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0419c6b0 con 0x7f6f04105730 2024-05-08T23:56:00.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.071+0000 7f6f0ad68700 1 -- 172.21.15.81:0/829648824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f0419cb50 con 0x7f6f04105730 2024-05-08T23:56:00.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.071+0000 7f6f01ffb700 1 -- 172.21.15.81:0/829648824 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6ef8010c00 con 0x7f6f04105730 2024-05-08T23:56:00.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.071+0000 7f6f01ffb700 1 -- 172.21.15.81:0/829648824 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6ef802c3f0 con 0x7f6f04105730 2024-05-08T23:56:00.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.072+0000 7f6f0ad68700 1 -- 172.21.15.81:0/829648824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f041918f0 con 0x7f6f04105730 2024-05-08T23:56:00.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.074+0000 7f6f01ffb700 1 -- 172.21.15.81:0/829648824 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f6ef8023440 con 0x7f6f04105730 2024-05-08T23:56:00.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.141+0000 7f6f0ad68700 1 -- 172.21.15.81:0/829648824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f6f04106e90 con 0x7f6f04105730 2024-05-08T23:56:00.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.145+0000 7f6f01ffb700 1 -- 172.21.15.81:0/829648824 <== mon.0 v2:172.21.15.81:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ef80235e0 con 0x7f6f04105730 2024-05-08T23:56:00.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.145+0000 7f6f01ffb700 1 -- 172.21.15.81:0/829648824 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f6ef802c600 con 0x7f6f04105730 2024-05-08T23:56:00.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.146+0000 7f6f0ad68700 1 -- 172.21.15.81:0/829648824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f04105730 msgr2=0x7f6f0419bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:00.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.146+0000 7f6f0ad68700 1 --2- 172.21.15.81:0/829648824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f04105730 0x7f6f0419bf70 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800b340 tx=0x7f6ef8004750 comp rx=0 tx=0).stop 2024-05-08T23:56:00.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.146+0000 7f6f0ad68700 1 -- 172.21.15.81:0/829648824 shutdown_connections 2024-05-08T23:56:00.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.146+0000 7f6f0ad68700 1 --2- 172.21.15.81:0/829648824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f04105730 0x7f6f0419bf70 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:00.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.146+0000 7f6f0ad68700 1 -- 172.21.15.81:0/829648824 >> 172.21.15.81:0/829648824 conn(0x7f6f04100cf0 msgr2=0x7f6f0418ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:00.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.147+0000 7f6f0ad68700 1 -- 172.21.15.81:0/829648824 shutdown_connections 2024-05-08T23:56:00.490 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.147+0000 7f6f0ad68700 1 -- 172.21.15.81:0/829648824 wait complete. 2024-05-08T23:56:00.490 INFO:teuthology.orchestra.run.smithi081.stdout:Generating new minimal ceph.conf... 2024-05-08T23:56:01.217 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.806+0000 7f929ce48700 1 Processor -- start 2024-05-08T23:56:01.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.806+0000 7f929ce48700 1 -- start start 2024-05-08T23:56:01.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.807+0000 7f929ce48700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92981072d0 0x7f92981096c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:01.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.807+0000 7f929ce48700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9298079e90 con 0x7f92981072d0 2024-05-08T23:56:01.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.807+0000 7f929659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92981072d0 0x7f92981096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:01.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.807+0000 7f929659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92981072d0 0x7f92981096c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43700/0 (socket says 172.21.15.81:43700) 2024-05-08T23:56:01.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.807+0000 7f929659c700 1 -- 172.21.15.81:0/3211710807 learned_addr learned my addr 172.21.15.81:0/3211710807 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:01.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.807+0000 7f929659c700 1 -- 172.21.15.81:0/3211710807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298109c00 con 0x7f92981072d0 2024-05-08T23:56:01.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.807+0000 7f929659c700 1 --2- 172.21.15.81:0/3211710807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92981072d0 0x7f92981096c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f928c0098a0 tx=0x7f928c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31a0b6b79620411 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:01.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.807+0000 7f929559a700 1 -- 172.21.15.81:0/3211710807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f928c004160 con 0x7f92981072d0 2024-05-08T23:56:01.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.807+0000 7f929559a700 1 -- 172.21.15.81:0/3211710807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f928c0042c0 con 0x7f92981072d0 2024-05-08T23:56:01.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.807+0000 7f929559a700 1 -- 172.21.15.81:0/3211710807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f928c011a00 con 0x7f92981072d0 2024-05-08T23:56:01.218 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.808+0000 7f929ce48700 1 -- 172.21.15.81:0/3211710807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92981072d0 msgr2=0x7f92981096c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:01.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.808+0000 7f929ce48700 1 --2- 172.21.15.81:0/3211710807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92981072d0 0x7f92981096c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f928c0098a0 tx=0x7f928c009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:01.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.808+0000 7f929ce48700 1 -- 172.21.15.81:0/3211710807 shutdown_connections 2024-05-08T23:56:01.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.808+0000 7f929ce48700 1 --2- 172.21.15.81:0/3211710807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92981072d0 0x7f92981096c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:01.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.808+0000 7f929ce48700 1 -- 172.21.15.81:0/3211710807 >> 172.21.15.81:0/3211710807 conn(0x7f9298100ca0 msgr2=0x7f9298103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:01.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.808+0000 7f929ce48700 1 -- 172.21.15.81:0/3211710807 shutdown_connections 2024-05-08T23:56:01.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.808+0000 7f929ce48700 1 -- 172.21.15.81:0/3211710807 wait complete. 2024-05-08T23:56:01.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.809+0000 7f929ce48700 1 Processor -- start 2024-05-08T23:56:01.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.809+0000 7f929ce48700 1 -- start start 2024-05-08T23:56:01.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.809+0000 7f929ce48700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92981072d0 0x7f929819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:01.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.809+0000 7f929ce48700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929819aa50 con 0x7f92981072d0 2024-05-08T23:56:01.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.809+0000 7f929659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92981072d0 0x7f929819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:01.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.809+0000 7f929659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92981072d0 0x7f929819a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43710/0 (socket says 172.21.15.81:43710) 2024-05-08T23:56:01.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.809+0000 7f929659c700 1 -- 172.21.15.81:0/1833283630 learned_addr learned my addr 172.21.15.81:0/1833283630 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:01.219 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.809+0000 7f929659c700 1 -- 172.21.15.81:0/1833283630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928c009550 con 0x7f92981072d0 2024-05-08T23:56:01.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.810+0000 7f929659c700 1 --2- 172.21.15.81:0/1833283630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92981072d0 0x7f929819a510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f928c009fb0 tx=0x7f928c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:01.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.810+0000 7f92877fe700 1 -- 172.21.15.81:0/1833283630 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f928c003a40 con 0x7f92981072d0 2024-05-08T23:56:01.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.810+0000 7f92877fe700 1 -- 172.21.15.81:0/1833283630 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f928c003ba0 con 0x7f92981072d0 2024-05-08T23:56:01.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.810+0000 7f929ce48700 1 -- 172.21.15.81:0/1833283630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929819ac50 con 0x7f92981072d0 2024-05-08T23:56:01.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.810+0000 7f92877fe700 1 -- 172.21.15.81:0/1833283630 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f928c01a750 con 0x7f92981072d0 2024-05-08T23:56:01.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.810+0000 7f929ce48700 1 -- 172.21.15.81:0/1833283630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929819b0f0 con 0x7f92981072d0 2024-05-08T23:56:01.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.810+0000 7f92877fe700 1 -- 172.21.15.81:0/1833283630 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f928c01ac80 con 0x7f92981072d0 2024-05-08T23:56:01.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.810+0000 7f92877fe700 1 -- 172.21.15.81:0/1833283630 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f928c0193c0 con 0x7f92981072d0 2024-05-08T23:56:01.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.811+0000 7f929ce48700 1 -- 172.21.15.81:0/1833283630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929810a9a0 con 0x7f92981072d0 2024-05-08T23:56:01.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.813+0000 7f92877fe700 1 -- 172.21.15.81:0/1833283630 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f928c024b60 con 0x7f92981072d0 2024-05-08T23:56:01.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.880+0000 7f929ce48700 1 -- 172.21.15.81:0/1833283630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f929810ab60 con 0x7f92981072d0 2024-05-08T23:56:01.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.880+0000 7f92877fe700 1 -- 172.21.15.81:0/1833283630 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f928c024d00 con 0x7f92981072d0 2024-05-08T23:56:01.220 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.881+0000 7f929ce48700 1 -- 172.21.15.81:0/1833283630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92981072d0 msgr2=0x7f929819a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:01.221 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.881+0000 7f929ce48700 1 --2- 172.21.15.81:0/1833283630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92981072d0 0x7f929819a510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f928c009fb0 tx=0x7f928c011ad0 comp rx=0 tx=0).stop 2024-05-08T23:56:01.221 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.881+0000 7f929ce48700 1 -- 172.21.15.81:0/1833283630 shutdown_connections 2024-05-08T23:56:01.221 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.881+0000 7f929ce48700 1 --2- 172.21.15.81:0/1833283630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92981072d0 0x7f929819a510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:01.221 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.881+0000 7f929ce48700 1 -- 172.21.15.81:0/1833283630 >> 172.21.15.81:0/1833283630 conn(0x7f9298100ca0 msgr2=0x7f92981017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:01.221 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.881+0000 7f929ce48700 1 -- 172.21.15.81:0/1833283630 shutdown_connections 2024-05-08T23:56:01.221 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:00.881+0000 7f929ce48700 1 -- 172.21.15.81:0/1833283630 wait complete. 2024-05-08T23:56:01.221 INFO:teuthology.orchestra.run.smithi081.stdout:Restarting the monitor... 2024-05-08T23:56:01.221 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:00 smithi081 ceph-mon[41991]: from='client.? 172.21.15.81:0/829648824' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-08T23:56:01.222 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:00 smithi081 ceph-mon[41991]: from='client.? 172.21.15.81:0/829648824' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-08T23:56:01.222 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:00 smithi081 ceph-mon[41991]: from='client.? 172.21.15.81:0/1833283630' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:56:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:01 smithi081 systemd[1]: Stopping Ceph mon.a for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-08T23:56:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:01 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mon-a[41968]: 2024-05-08T23:56:01.403+0000 7f59a261f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T23:56:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:01 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mon-a[41968]: 2024-05-08T23:56:01.403+0000 7f59a261f700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-08T23:56:01.996 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:01 smithi081 bash[42316]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mon-a 2024-05-08T23:56:02.253 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 systemd[1]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mon.a.service: Succeeded. 2024-05-08T23:56:02.253 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 systemd[1]: Stopped Ceph mon.a for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-08T23:56:02.253 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 systemd[1]: Starting Ceph mon.a for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-08T23:56:02.305 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: set uid:gid to 167:167 (ceph:ceph) 2024-05-08T23:56:02.330 INFO:teuthology.orchestra.run.smithi081.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-08T23:56:02.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable), process ceph-mon, pid 7 2024-05-08T23:56:02.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: pidfile_write: ignore empty --pid-file 2024-05-08T23:56:02.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: load: jerasure load: lrc 2024-05-08T23:56:02.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: RocksDB version: 7.9.2 2024-05-08T23:56:02.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Git sha 0 2024-05-08T23:56:02.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Compile date 2024-05-08 17:55:50 2024-05-08T23:56:02.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: DB SUMMARY 2024-05-08T23:56:02.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: DB Session ID: 5KIMI107YC6RR50INFZH 2024-05-08T23:56:02.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: CURRENT file: CURRENT 2024-05-08T23:56:02.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: IDENTITY file: IDENTITY 2024-05-08T23:56:02.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-08T23:56:02.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-08T23:56:02.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99677 ; 2024-05-08T23:56:02.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.error_if_exists: 0 2024-05-08T23:56:02.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.create_if_missing: 0 2024-05-08T23:56:02.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.paranoid_checks: 1 2024-05-08T23:56:02.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-08T23:56:02.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-08T23:56:02.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-08T23:56:02.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.env: 0x55cba0678820 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.fs: PosixFileSystem 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.info_log: 0x55cba3ae1520 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_file_opening_threads: 16 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.statistics: (nil) 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.use_fsync: 0 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_log_file_size: 0 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.keep_log_file_num: 1000 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.recycle_log_file_num: 0 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.allow_fallocate: 1 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.allow_mmap_reads: 0 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.allow_mmap_writes: 0 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.use_direct_reads: 0 2024-05-08T23:56:02.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-08T23:56:02.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.create_missing_column_families: 0 2024-05-08T23:56:02.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.db_log_dir: 2024-05-08T23:56:02.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.wal_dir: 2024-05-08T23:56:02.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-08T23:56:02.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-08T23:56:02.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-08T23:56:02.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-08T23:56:02.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-08T23:56:02.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-08T23:56:02.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.advise_random_on_open: 1 2024-05-08T23:56:02.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.db_write_buffer_size: 0 2024-05-08T23:56:02.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.write_buffer_manager: 0x55cba2d76320 2024-05-08T23:56:02.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-08T23:56:02.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.rate_limiter: (nil) 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.wal_recovery_mode: 2 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.enable_thread_tracking: 0 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.enable_pipelined_write: 0 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.unordered_write: 0 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.row_cache: None 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.wal_filter: None 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-08T23:56:02.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.allow_ingest_behind: 0 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.two_write_queues: 0 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.manual_wal_flush: 0 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.wal_compression: 0 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.atomic_flush: 0 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.log_readahead_size: 0 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.best_efforts_recovery: 0 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.allow_data_in_errors: 0 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.db_host_id: __hostname__ 2024-05-08T23:56:02.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-08T23:56:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_background_jobs: 2 2024-05-08T23:56:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_background_compactions: -1 2024-05-08T23:56:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_subcompactions: 1 2024-05-08T23:56:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-08T23:56:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-08T23:56:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-08T23:56:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_total_wal_size: 0 2024-05-08T23:56:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-08T23:56:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-08T23:56:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-08T23:56:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-08T23:56:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_open_files: -1 2024-05-08T23:56:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.bytes_per_sync: 0 2024-05-08T23:56:02.628 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-08T23:56:02.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-08T23:56:02.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compaction_readahead_size: 0 2024-05-08T23:56:02.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_background_flushes: -1 2024-05-08T23:56:02.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Compression algorithms supported: 2024-05-08T23:56:02.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-08T23:56:02.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: kZSTD supported: 0 2024-05-08T23:56:02.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: kXpressCompression supported: 0 2024-05-08T23:56:02.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: kLZ4HCCompression supported: 1 2024-05-08T23:56:02.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: kZlibCompression supported: 1 2024-05-08T23:56:02.629 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: kSnappyCompression supported: 1 2024-05-08T23:56:02.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: kLZ4Compression supported: 1 2024-05-08T23:56:02.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: kBZip2Compression supported: 0 2024-05-08T23:56:02.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-08T23:56:02.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-08T23:56:02.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-08T23:56:02.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-08T23:56:02.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-08T23:56:02.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.merge_operator: 2024-05-08T23:56:02.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compaction_filter: None 2024-05-08T23:56:02.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compaction_filter_factory: None 2024-05-08T23:56:02.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.sst_partitioner_factory: None 2024-05-08T23:56:02.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-08T23:56:02.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-08T23:56:02.630 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cba3ae1620) 2024-05-08T23:56:02.631 INFO:journalctl@ceph.mon.a.smithi081.stdout: cache_index_and_filter_blocks: 1 2024-05-08T23:56:02.631 INFO:journalctl@ceph.mon.a.smithi081.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-08T23:56:02.631 INFO:journalctl@ceph.mon.a.smithi081.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-08T23:56:02.631 INFO:journalctl@ceph.mon.a.smithi081.stdout: pin_top_level_index_and_filter: 1 2024-05-08T23:56:02.631 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_type: 0 2024-05-08T23:56:02.631 INFO:journalctl@ceph.mon.a.smithi081.stdout: data_block_index_type: 0 2024-05-08T23:56:02.631 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_shortening: 1 2024-05-08T23:56:02.631 INFO:journalctl@ceph.mon.a.smithi081.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-08T23:56:02.631 INFO:journalctl@ceph.mon.a.smithi081.stdout: checksum: 4 2024-05-08T23:56:02.631 INFO:journalctl@ceph.mon.a.smithi081.stdout: no_block_cache: 0 2024-05-08T23:56:02.631 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache: 0x55cba2df91f0 2024-05-08T23:56:02.631 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_name: BinnedLRUCache 2024-05-08T23:56:02.631 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_options: 2024-05-08T23:56:02.631 INFO:journalctl@ceph.mon.a.smithi081.stdout: capacity : 536870912 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: num_shard_bits : 4 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: strict_capacity_limit : 0 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: high_pri_pool_ratio: 0.000 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_cache_compressed: (nil) 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: persistent_cache: (nil) 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_size: 4096 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_size_deviation: 10 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_restart_interval: 16 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: index_block_restart_interval: 1 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: metadata_block_size: 4096 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: partition_filters: 0 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: use_delta_encoding: 1 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: filter_policy: bloomfilter 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: whole_key_filtering: 1 2024-05-08T23:56:02.632 INFO:journalctl@ceph.mon.a.smithi081.stdout: verify_compression: 0 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout: read_amp_bytes_per_bit: 0 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout: format_version: 5 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout: enable_index_compression: 1 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout: block_align: 0 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout: max_auto_readahead_size: 262144 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout: prepopulate_block_cache: 0 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout: initial_auto_readahead_size: 8192 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout: num_file_reads_for_auto_readahead: 2 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.write_buffer_size: 33554432 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_write_buffer_number: 2 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compression: NoCompression 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.bottommost_compression: Disabled 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.prefix_extractor: nullptr 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-08T23:56:02.633 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.num_levels: 7 2024-05-08T23:56:02.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-08T23:56:02.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-08T23:56:02.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-08T23:56:02.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-08T23:56:02.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-08T23:56:02.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-08T23:56:02.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-08T23:56:02.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-08T23:56:02.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-08T23:56:02.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-08T23:56:02.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-08T23:56:02.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-08T23:56:02.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-08T23:56:02.634 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compression_opts.level: 32767 2024-05-08T23:56:02.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compression_opts.strategy: 0 2024-05-08T23:56:02.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-08T23:56:02.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-08T23:56:02.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-08T23:56:02.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-08T23:56:02.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compression_opts.enabled: false 2024-05-08T23:56:02.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-08T23:56:02.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-08T23:56:02.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-08T23:56:02.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-08T23:56:02.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.target_file_size_base: 67108864 2024-05-08T23:56:02.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-08T23:56:02.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-08T23:56:02.635 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.arena_block_size: 1048576 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-08T23:56:02.636 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.disable_auto_compactions: 0 2024-05-08T23:56:02.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-08T23:56:02.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-08T23:56:02.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-08T23:56:02.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-08T23:56:02.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-08T23:56:02.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-08T23:56:02.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-08T23:56:02.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-08T23:56:02.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-08T23:56:02.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-08T23:56:02.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.table_properties_collectors: 2024-05-08T23:56:02.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.inplace_update_support: 0 2024-05-08T23:56:02.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-08T23:56:02.637 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.bloom_locality: 0 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.max_successive_merges: 0 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.paranoid_file_checks: 0 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.force_consistency_checks: 1 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.report_bg_io_stats: 0 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.ttl: 2592000 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.enable_blob_files: false 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.min_blob_size: 0 2024-05-08T23:56:02.638 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.blob_file_size: 268435456 2024-05-08T23:56:02.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-08T23:56:02.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-08T23:56:02.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-08T23:56:02.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-08T23:56:02.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-08T23:56:02.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.blob_file_starting_level: 0 2024-05-08T23:56:02.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-08T23:56:02.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-08T23:56:02.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-08T23:56:02.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 43d2fb88-634f-4a95-8ee5-6abdc3bc6209 2024-05-08T23:56:02.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715212562317862, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-08T23:56:02.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-08T23:56:02.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715212562318895, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 95005, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 312, "table_properties": {"data_size": 92993, "index_size": 294, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13885, "raw_average_key_size": 50, "raw_value_size": 85407, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715212562, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "43d2fb88-634f-4a95-8ee5-6abdc3bc6209", "db_session_id": "5KIMI107YC6RR50INFZH", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-08T23:56:02.639 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715212562318964, "job": 1, "event": "recovery_finished"} 2024-05-08T23:56:02.640 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-08T23:56:02.640 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-08T23:56:02.640 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55cba2e96000 2024-05-08T23:56:02.640 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: DB pointer 0x55cba2e84000 2024-05-08T23:56:02.640 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-08T23:56:02.640 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-08T23:56:02.640 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** DB Stats ** 2024-05-08T23:56:02.640 INFO:journalctl@ceph.mon.a.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T23:56:02.640 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-08T23:56:02.640 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T23:56:02.640 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T23:56:02.640 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-08T23:56:02.640 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T23:56:02.640 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T23:56:02.641 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-05-08T23:56:02.641 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** Compaction Stats [default] ** 2024-05-08T23:56:02.641 INFO:journalctl@ceph.mon.a.smithi081.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T23:56:02.641 INFO:journalctl@ceph.mon.a.smithi081.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-08T23:56:02.641 INFO:journalctl@ceph.mon.a.smithi081.stdout: L0 2/0 94.61 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T23:56:02.641 INFO:journalctl@ceph.mon.a.smithi081.stdout: Sum 2/0 94.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T23:56:02.641 INFO:journalctl@ceph.mon.a.smithi081.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T23:56:02.641 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-05-08T23:56:02.641 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** Compaction Stats [default] ** 2024-05-08T23:56:02.641 INFO:journalctl@ceph.mon.a.smithi081.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T23:56:02.641 INFO:journalctl@ceph.mon.a.smithi081.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T23:56:02.641 INFO:journalctl@ceph.mon.a.smithi081.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 137.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T23:56:02.641 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-05-08T23:56:02.641 INFO:journalctl@ceph.mon.a.smithi081.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout: Cumulative compaction: 0.00 GB write, 27.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout: Interval compaction: 0.00 GB write, 27.93 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout: Block cache BinnedLRUCache@0x55cba2df91f0#7 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-08T23:56:02.642 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: starting mon.a rank 0 at public addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] at bind addrs [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:56:02.643 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: mon.a@-1(???) e1 preinit fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:56:02.643 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: mon.a@-1(???).mds e1 new map 2024-05-08T23:56:02.643 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: mon.a@-1(???).mds e1 print_map 2024-05-08T23:56:02.643 INFO:journalctl@ceph.mon.a.smithi081.stdout: e1 2024-05-08T23:56:02.643 INFO:journalctl@ceph.mon.a.smithi081.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T23:56:02.643 INFO:journalctl@ceph.mon.a.smithi081.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-08T23:56:02.643 INFO:journalctl@ceph.mon.a.smithi081.stdout: legacy client fscid: -1 2024-05-08T23:56:02.643 INFO:journalctl@ceph.mon.a.smithi081.stdout: 2024-05-08T23:56:02.643 INFO:journalctl@ceph.mon.a.smithi081.stdout: No filesystems configured 2024-05-08T23:56:02.643 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-08T23:56:02.643 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:56:02.643 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:56:02.643 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:56:02.643 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-08T23:56:02.644 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 bash[42436]: 5c248f71de16de9c8f6e3ff221d448eca52b956d130a5113358a81019b0b8427 2024-05-08T23:56:02.644 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 systemd[1]: Started Ceph mon.a for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-08T23:56:02.644 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T23:56:02.644 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: monmap e1: 1 mons at {a=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:56:02.644 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: fsmap 2024-05-08T23:56:02.644 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: osdmap e1: 0 total, 0 up, 0 in 2024-05-08T23:56:02.644 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:02 smithi081 ceph-mon[42474]: mgrmap e1: no daemons active 2024-05-08T23:56:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.708+0000 7f83f482e700 1 Processor -- start 2024-05-08T23:56:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.708+0000 7f83f482e700 1 -- start start 2024-05-08T23:56:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.708+0000 7f83f482e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0104b60 0x7f83f0104f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.708+0000 7f83f482e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f0105550 con 0x7f83f0104b60 2024-05-08T23:56:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.708+0000 7f83ee59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0104b60 0x7f83f0104f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.708+0000 7f83ee59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0104b60 0x7f83f0104f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43722/0 (socket says 172.21.15.81:43722) 2024-05-08T23:56:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.708+0000 7f83ee59c700 1 -- 172.21.15.81:0/284730586 learned_addr learned my addr 172.21.15.81:0/284730586 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.709+0000 7f83ee59c700 1 -- 172.21.15.81:0/284730586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f0105690 con 0x7f83f0104b60 2024-05-08T23:56:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.709+0000 7f83ee59c700 1 --2- 172.21.15.81:0/284730586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0104b60 0x7f83f0104f80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f83e00098a0 tx=0x7f83e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2355e21d2988daed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.709+0000 7f83ed59a700 1 -- 172.21.15.81:0/284730586 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83e0004160 con 0x7f83f0104b60 2024-05-08T23:56:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.709+0000 7f83ed59a700 1 -- 172.21.15.81:0/284730586 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f83e00042c0 con 0x7f83f0104b60 2024-05-08T23:56:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.709+0000 7f83ed59a700 1 -- 172.21.15.81:0/284730586 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83e0011a00 con 0x7f83f0104b60 2024-05-08T23:56:03.464 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.710+0000 7f83f482e700 1 -- 172.21.15.81:0/284730586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0104b60 msgr2=0x7f83f0104f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.710+0000 7f83f482e700 1 --2- 172.21.15.81:0/284730586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0104b60 0x7f83f0104f80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f83e00098a0 tx=0x7f83e0009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.710+0000 7f83f482e700 1 -- 172.21.15.81:0/284730586 shutdown_connections 2024-05-08T23:56:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.710+0000 7f83f482e700 1 --2- 172.21.15.81:0/284730586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0104b60 0x7f83f0104f80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.710+0000 7f83f482e700 1 -- 172.21.15.81:0/284730586 >> 172.21.15.81:0/284730586 conn(0x7f83f01004e0 msgr2=0x7f83f0102900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.710+0000 7f83f482e700 1 -- 172.21.15.81:0/284730586 shutdown_connections 2024-05-08T23:56:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.710+0000 7f83f482e700 1 -- 172.21.15.81:0/284730586 wait complete. 2024-05-08T23:56:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.711+0000 7f83f482e700 1 Processor -- start 2024-05-08T23:56:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.711+0000 7f83f482e700 1 -- start start 2024-05-08T23:56:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.711+0000 7f83f482e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0104b60 0x7f83f0107410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.711+0000 7f83f482e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f0107950 con 0x7f83f0104b60 2024-05-08T23:56:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.711+0000 7f83ee59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0104b60 0x7f83f0107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.711+0000 7f83ee59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0104b60 0x7f83f0107410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43726/0 (socket says 172.21.15.81:43726) 2024-05-08T23:56:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.711+0000 7f83ee59c700 1 -- 172.21.15.81:0/1373699528 learned_addr learned my addr 172.21.15.81:0/1373699528 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:03.465 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.711+0000 7f83ee59c700 1 -- 172.21.15.81:0/1373699528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e0009550 con 0x7f83f0104b60 2024-05-08T23:56:03.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.711+0000 7f83ee59c700 1 --2- 172.21.15.81:0/1373699528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0104b60 0x7f83f0107410 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009fb0 tx=0x7f83e0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:03.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.712+0000 7f83df7fe700 1 -- 172.21.15.81:0/1373699528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83e0003a40 con 0x7f83f0104b60 2024-05-08T23:56:03.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.712+0000 7f83df7fe700 1 -- 172.21.15.81:0/1373699528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f83e0003ba0 con 0x7f83f0104b60 2024-05-08T23:56:03.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.712+0000 7f83df7fe700 1 -- 172.21.15.81:0/1373699528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83e001a750 con 0x7f83f0104b60 2024-05-08T23:56:03.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.712+0000 7f83f482e700 1 -- 172.21.15.81:0/1373699528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f0105b90 con 0x7f83f0104b60 2024-05-08T23:56:03.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.712+0000 7f83f482e700 1 -- 172.21.15.81:0/1373699528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f0106090 con 0x7f83f0104b60 2024-05-08T23:56:03.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.712+0000 7f83df7fe700 1 -- 172.21.15.81:0/1373699528 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f83e001ac80 con 0x7f83f0104b60 2024-05-08T23:56:03.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.712+0000 7f83df7fe700 1 -- 172.21.15.81:0/1373699528 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f83e002de20 con 0x7f83f0104b60 2024-05-08T23:56:03.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.713+0000 7f83f482e700 1 -- 172.21.15.81:0/1373699528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f00625d0 con 0x7f83f0104b60 2024-05-08T23:56:03.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.715+0000 7f83df7fe700 1 -- 172.21.15.81:0/1373699528 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f83e0024b60 con 0x7f83f0104b60 2024-05-08T23:56:03.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.782+0000 7f83f482e700 1 -- 172.21.15.81:0/1373699528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f83f01087e0 con 0x7f83f0104b60 2024-05-08T23:56:03.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.787+0000 7f83df7fe700 1 -- 172.21.15.81:0/1373699528 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f83e0024d00 con 0x7f83f0104b60 2024-05-08T23:56:03.466 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.788+0000 7f83f482e700 1 -- 172.21.15.81:0/1373699528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0104b60 msgr2=0x7f83f0107410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:03.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.788+0000 7f83f482e700 1 --2- 172.21.15.81:0/1373699528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0104b60 0x7f83f0107410 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f83e0009fb0 tx=0x7f83e0011ad0 comp rx=0 tx=0).stop 2024-05-08T23:56:03.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.788+0000 7f83f482e700 1 -- 172.21.15.81:0/1373699528 shutdown_connections 2024-05-08T23:56:03.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.788+0000 7f83f482e700 1 --2- 172.21.15.81:0/1373699528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83f0104b60 0x7f83f0107410 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:03.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.788+0000 7f83f482e700 1 -- 172.21.15.81:0/1373699528 >> 172.21.15.81:0/1373699528 conn(0x7f83f01004e0 msgr2=0x7f83f0100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:03.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.788+0000 7f83f482e700 1 -- 172.21.15.81:0/1373699528 shutdown_connections 2024-05-08T23:56:03.467 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:02.788+0000 7f83f482e700 1 -- 172.21.15.81:0/1373699528 wait complete. 2024-05-08T23:56:03.467 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-08T23:56:03.619 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:56:03.619 INFO:teuthology.orchestra.run.smithi081.stdout:Creating mgr... 2024-05-08T23:56:03.620 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-08T23:56:03.620 INFO:teuthology.orchestra.run.smithi081.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-08T23:56:04.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:03 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1373699528' entity='client.admin' 2024-05-08T23:56:04.518 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.x 2024-05-08T23:56:04.518 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Failed to reset failed state of unit ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.x.service: Unit ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.x.service not loaded. 2024-05-08T23:56:04.607 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968.target.wants/ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@.service. 2024-05-08T23:56:04.871 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:04 smithi081 systemd[1]: Starting Ceph mgr.x for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-08T23:56:06.049 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T23:56:06.049 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-05-08T23:56:06.058 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T23:56:06.058 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-05-08T23:56:06.058 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-05-08T23:56:06.058 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to enable service . firewalld.service is not available 2024-05-08T23:56:06.067 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T23:56:06.067 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-05-08T23:56:06.075 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T23:56:06.075 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-05-08T23:56:06.075 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-05-08T23:56:06.076 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-08T23:56:06.076 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr to start... 2024-05-08T23:56:06.076 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr... 2024-05-08T23:56:06.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:06 smithi081 bash[42711]: bafa97db1e7f43c15841a165897d04f9fc4a0efd2769d9239eae3148269a36d5 2024-05-08T23:56:06.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:06 smithi081 systemd[1]: Started Ceph mgr.x for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-08T23:56:06.745 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:06 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/909019198' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T23:56:06.745 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:06 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:06.471+0000 7f1bc6f77200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T23:56:06.745 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:06 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:06.567+0000 7f1bc6f77200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T23:56:06.745 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:06 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:06.662+0000 7f1bc6f77200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T23:56:06.745 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:06 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:06.750+0000 7f1bc6f77200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T23:56:06.879 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-08T23:56:06.879 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:56:06.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "6c93ddc4-0d96-11ef-bc97-c7b262605968", 2024-05-08T23:56:06.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T23:56:06.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T23:56:06.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T23:56:06.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T23:56:06.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:06.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T23:56:06.880 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T23:56:06.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-05-08T23:56:06.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:56:06.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T23:56:06.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T23:56:06.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:56:06.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-05-08T23:56:06.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T23:56:06.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:06.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-08T23:56:06.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T23:56:06.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:06.881 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T23:56:06.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:06.882 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T23:56:06.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T23:56:06.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T23:56:06.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T23:56:06.890 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T23:56:06.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T23:56:06.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:06.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T23:56:06.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T23:56:06.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T23:56:06.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T23:56:06.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T23:56:06.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T23:56:06.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T23:56:06.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T23:56:06.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T23:56:06.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:06.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T23:56:06.891 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T23:56:06.892 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:06.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T23:55:58.924001+0000", 2024-05-08T23:56:06.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:56:06.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:06.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T23:56:06.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:56:06.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.452+0000 7f294f81c700 1 Processor -- start 2024-05-08T23:56:06.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.452+0000 7f294f81c700 1 -- start start 2024-05-08T23:56:06.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.452+0000 7f294f81c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29481072e0 0x7f29481096d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:06.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.452+0000 7f294f81c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2948079e90 con 0x7f29481072e0 2024-05-08T23:56:06.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.453+0000 7f294d5b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29481072e0 0x7f29481096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:06.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.453+0000 7f294d5b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29481072e0 0x7f29481096d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43752/0 (socket says 172.21.15.81:43752) 2024-05-08T23:56:06.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.453+0000 7f294d5b8700 1 -- 172.21.15.81:0/1479152433 learned_addr learned my addr 172.21.15.81:0/1479152433 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:06.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.453+0000 7f294d5b8700 1 -- 172.21.15.81:0/1479152433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2948109c10 con 0x7f29481072e0 2024-05-08T23:56:06.893 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.453+0000 7f294d5b8700 1 --2- 172.21.15.81:0/1479152433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29481072e0 0x7f29481096d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f29440098a0 tx=0x7f2944009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce135eaefb104f75 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:06.894 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.453+0000 7f293ffff700 1 -- 172.21.15.81:0/1479152433 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2944004160 con 0x7f29481072e0 2024-05-08T23:56:06.894 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.453+0000 7f293ffff700 1 -- 172.21.15.81:0/1479152433 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29440042c0 con 0x7f29481072e0 2024-05-08T23:56:06.894 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.453+0000 7f293ffff700 1 -- 172.21.15.81:0/1479152433 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2944011a00 con 0x7f29481072e0 2024-05-08T23:56:06.894 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.454+0000 7f294f81c700 1 -- 172.21.15.81:0/1479152433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29481072e0 msgr2=0x7f29481096d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:06.894 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.454+0000 7f294f81c700 1 --2- 172.21.15.81:0/1479152433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29481072e0 0x7f29481096d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f29440098a0 tx=0x7f2944009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:06.894 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.454+0000 7f294f81c700 1 -- 172.21.15.81:0/1479152433 shutdown_connections 2024-05-08T23:56:06.894 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.454+0000 7f294f81c700 1 --2- 172.21.15.81:0/1479152433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29481072e0 0x7f29481096d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:06.894 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.454+0000 7f294f81c700 1 -- 172.21.15.81:0/1479152433 >> 172.21.15.81:0/1479152433 conn(0x7f2948100cf0 msgr2=0x7f2948103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:06.894 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.454+0000 7f294f81c700 1 -- 172.21.15.81:0/1479152433 shutdown_connections 2024-05-08T23:56:06.894 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.454+0000 7f294f81c700 1 -- 172.21.15.81:0/1479152433 wait complete. 2024-05-08T23:56:06.894 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.454+0000 7f294f81c700 1 Processor -- start 2024-05-08T23:56:06.894 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.455+0000 7f294f81c700 1 -- start start 2024-05-08T23:56:06.895 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.455+0000 7f294f81c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29481072e0 0x7f294819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:06.896 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.455+0000 7f294f81c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294819aad0 con 0x7f29481072e0 2024-05-08T23:56:06.896 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.455+0000 7f294d5b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29481072e0 0x7f294819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:06.896 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.455+0000 7f294d5b8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29481072e0 0x7f294819a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43768/0 (socket says 172.21.15.81:43768) 2024-05-08T23:56:06.896 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.455+0000 7f294d5b8700 1 -- 172.21.15.81:0/909019198 learned_addr learned my addr 172.21.15.81:0/909019198 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:06.896 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.455+0000 7f294d5b8700 1 -- 172.21.15.81:0/909019198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2944009550 con 0x7f29481072e0 2024-05-08T23:56:06.897 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.455+0000 7f294d5b8700 1 --2- 172.21.15.81:0/909019198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29481072e0 0x7f294819a590 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2944011a20 tx=0x7f2944011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:06.897 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.455+0000 7f293e7fc700 1 -- 172.21.15.81:0/909019198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2944003af0 con 0x7f29481072e0 2024-05-08T23:56:06.897 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.455+0000 7f293e7fc700 1 -- 172.21.15.81:0/909019198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2944003c50 con 0x7f29481072e0 2024-05-08T23:56:06.898 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.455+0000 7f294f81c700 1 -- 172.21.15.81:0/909019198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294819acd0 con 0x7f29481072e0 2024-05-08T23:56:06.898 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.455+0000 7f293e7fc700 1 -- 172.21.15.81:0/909019198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2944019760 con 0x7f29481072e0 2024-05-08T23:56:06.898 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.455+0000 7f294f81c700 1 -- 172.21.15.81:0/909019198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294819b170 con 0x7f29481072e0 2024-05-08T23:56:06.898 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.456+0000 7f294f81c700 1 -- 172.21.15.81:0/909019198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294810a9b0 con 0x7f29481072e0 2024-05-08T23:56:06.898 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.456+0000 7f293e7fc700 1 -- 172.21.15.81:0/909019198 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f294401a430 con 0x7f29481072e0 2024-05-08T23:56:06.898 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.456+0000 7f293e7fc700 1 -- 172.21.15.81:0/909019198 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2944025b00 con 0x7f29481072e0 2024-05-08T23:56:06.898 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.458+0000 7f293e7fc700 1 -- 172.21.15.81:0/909019198 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f294402a060 con 0x7f29481072e0 2024-05-08T23:56:06.898 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.530+0000 7f294f81c700 1 -- 172.21.15.81:0/909019198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f294810abf0 con 0x7f29481072e0 2024-05-08T23:56:06.898 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.531+0000 7f293e7fc700 1 -- 172.21.15.81:0/909019198 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f294401a8d0 con 0x7f29481072e0 2024-05-08T23:56:06.898 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.532+0000 7f294f81c700 1 -- 172.21.15.81:0/909019198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29481072e0 msgr2=0x7f294819a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:06.898 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.532+0000 7f294f81c700 1 --2- 172.21.15.81:0/909019198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29481072e0 0x7f294819a590 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2944011a20 tx=0x7f2944011b00 comp rx=0 tx=0).stop 2024-05-08T23:56:06.899 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.532+0000 7f294f81c700 1 -- 172.21.15.81:0/909019198 shutdown_connections 2024-05-08T23:56:06.899 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.532+0000 7f294f81c700 1 --2- 172.21.15.81:0/909019198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29481072e0 0x7f294819a590 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:06.899 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.532+0000 7f294f81c700 1 -- 172.21.15.81:0/909019198 >> 172.21.15.81:0/909019198 conn(0x7f2948100cf0 msgr2=0x7f29481018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:06.899 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.532+0000 7f294f81c700 1 -- 172.21.15.81:0/909019198 shutdown_connections 2024-05-08T23:56:06.899 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:06.532+0000 7f294f81c700 1 -- 172.21.15.81:0/909019198 wait complete. 2024-05-08T23:56:06.899 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (1/15)... 2024-05-08T23:56:07.714 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:07 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:07.389+0000 7f1bc6f77200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:56:07.714 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:07 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:07.636+0000 7f1bc6f77200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T23:56:07.714 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:07 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:07.719+0000 7f1bc6f77200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T23:56:07.975 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:07 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:07.827+0000 7f1bc6f77200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T23:56:07.975 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:07 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:07.981+0000 7f1bc6f77200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T23:56:08.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:08 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:08.106+0000 7f1bc6f77200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T23:56:08.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:08 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:08.189+0000 7f1bc6f77200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T23:56:08.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:08 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:08.555+0000 7f1bc6f77200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T23:56:09.247 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:08 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:08.943+0000 7f1bc6f77200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T23:56:09.247 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:09 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:09.154+0000 7f1bc6f77200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T23:56:09.247 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:09 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:09.252+0000 7f1bc6f77200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T23:56:09.501 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:09 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2509693130' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T23:56:09.720 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-08T23:56:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:56:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "6c93ddc4-0d96-11ef-bc97-c7b262605968", 2024-05-08T23:56:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T23:56:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T23:56:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T23:56:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T23:56:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T23:56:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T23:56:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-05-08T23:56:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:56:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T23:56:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T23:56:09.721 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T23:56:09.722 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T23:56:09.723 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T23:55:58.924001+0000", 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:56:09.724 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:09.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T23:56:09.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:56:09.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.234+0000 7f0215c40700 1 Processor -- start 2024-05-08T23:56:09.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.234+0000 7f0215c40700 1 -- start start 2024-05-08T23:56:09.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.234+0000 7f0215c40700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02101050f0 0x7f0210105510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:09.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.234+0000 7f0215c40700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0210079e70 con 0x7f02101050f0 2024-05-08T23:56:09.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.234+0000 7f020f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02101050f0 0x7f0210105510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:09.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.234+0000 7f020f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02101050f0 0x7f0210105510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38156/0 (socket says 172.21.15.81:38156) 2024-05-08T23:56:09.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.234+0000 7f020f7fe700 1 -- 172.21.15.81:0/496434136 learned_addr learned my addr 172.21.15.81:0/496434136 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:09.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.235+0000 7f020f7fe700 1 -- 172.21.15.81:0/496434136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0210105a50 con 0x7f02101050f0 2024-05-08T23:56:09.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.235+0000 7f020f7fe700 1 --2- 172.21.15.81:0/496434136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02101050f0 0x7f0210105510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f02000098a0 tx=0x7f0200009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733310b76e5279f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:09.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.235+0000 7f020e7fc700 1 -- 172.21.15.81:0/496434136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0200004160 con 0x7f02101050f0 2024-05-08T23:56:09.725 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.235+0000 7f020e7fc700 1 -- 172.21.15.81:0/496434136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f02000042c0 con 0x7f02101050f0 2024-05-08T23:56:09.726 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.235+0000 7f020e7fc700 1 -- 172.21.15.81:0/496434136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0200011a00 con 0x7f02101050f0 2024-05-08T23:56:09.726 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.235+0000 7f0215c40700 1 -- 172.21.15.81:0/496434136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02101050f0 msgr2=0x7f0210105510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:09.726 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.235+0000 7f0215c40700 1 --2- 172.21.15.81:0/496434136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02101050f0 0x7f0210105510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f02000098a0 tx=0x7f0200009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:09.726 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.236+0000 7f0215c40700 1 -- 172.21.15.81:0/496434136 shutdown_connections 2024-05-08T23:56:09.726 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.236+0000 7f0215c40700 1 --2- 172.21.15.81:0/496434136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02101050f0 0x7f0210105510 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:09.726 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.236+0000 7f0215c40700 1 -- 172.21.15.81:0/496434136 >> 172.21.15.81:0/496434136 conn(0x7f0210100cf0 msgr2=0x7f0210103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:09.726 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.236+0000 7f0215c40700 1 -- 172.21.15.81:0/496434136 shutdown_connections 2024-05-08T23:56:09.726 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.236+0000 7f0215c40700 1 -- 172.21.15.81:0/496434136 wait complete. 2024-05-08T23:56:09.726 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.236+0000 7f0215c40700 1 Processor -- start 2024-05-08T23:56:09.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.236+0000 7f0215c40700 1 -- start start 2024-05-08T23:56:09.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.237+0000 7f0215c40700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02101050f0 0x7f021019c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:09.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.237+0000 7f0215c40700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021019ccd0 con 0x7f02101050f0 2024-05-08T23:56:09.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.237+0000 7f020f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02101050f0 0x7f021019c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:09.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.237+0000 7f020f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02101050f0 0x7f021019c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38164/0 (socket says 172.21.15.81:38164) 2024-05-08T23:56:09.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.237+0000 7f020f7fe700 1 -- 172.21.15.81:0/2509693130 learned_addr learned my addr 172.21.15.81:0/2509693130 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:09.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.237+0000 7f020f7fe700 1 -- 172.21.15.81:0/2509693130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0200009550 con 0x7f02101050f0 2024-05-08T23:56:09.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.237+0000 7f020f7fe700 1 --2- 172.21.15.81:0/2509693130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02101050f0 0x7f021019c790 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0200011a20 tx=0x7f0200011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:09.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.237+0000 7f020cff9700 1 -- 172.21.15.81:0/2509693130 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0200003af0 con 0x7f02101050f0 2024-05-08T23:56:09.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.237+0000 7f020cff9700 1 -- 172.21.15.81:0/2509693130 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0200003c50 con 0x7f02101050f0 2024-05-08T23:56:09.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.237+0000 7f0215c40700 1 -- 172.21.15.81:0/2509693130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021019ced0 con 0x7f02101050f0 2024-05-08T23:56:09.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.237+0000 7f020cff9700 1 -- 172.21.15.81:0/2509693130 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0200019760 con 0x7f02101050f0 2024-05-08T23:56:09.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.237+0000 7f0215c40700 1 -- 172.21.15.81:0/2509693130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021019d370 con 0x7f02101050f0 2024-05-08T23:56:09.727 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.237+0000 7f020cff9700 1 -- 172.21.15.81:0/2509693130 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0200019950 con 0x7f02101050f0 2024-05-08T23:56:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.237+0000 7f020cff9700 1 -- 172.21.15.81:0/2509693130 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f020000b3e0 con 0x7f02101050f0 2024-05-08T23:56:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.238+0000 7f0215c40700 1 -- 172.21.15.81:0/2509693130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0210196460 con 0x7f02101050f0 2024-05-08T23:56:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.240+0000 7f020cff9700 1 -- 172.21.15.81:0/2509693130 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f020002a060 con 0x7f02101050f0 2024-05-08T23:56:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.313+0000 7f0215c40700 1 -- 172.21.15.81:0/2509693130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f02101068c0 con 0x7f02101050f0 2024-05-08T23:56:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.314+0000 7f020cff9700 1 -- 172.21.15.81:0/2509693130 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f0200019d90 con 0x7f02101050f0 2024-05-08T23:56:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.314+0000 7f0215c40700 1 -- 172.21.15.81:0/2509693130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02101050f0 msgr2=0x7f021019c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.314+0000 7f0215c40700 1 --2- 172.21.15.81:0/2509693130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02101050f0 0x7f021019c790 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0200011a20 tx=0x7f0200011b00 comp rx=0 tx=0).stop 2024-05-08T23:56:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.314+0000 7f0215c40700 1 -- 172.21.15.81:0/2509693130 shutdown_connections 2024-05-08T23:56:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.314+0000 7f0215c40700 1 --2- 172.21.15.81:0/2509693130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02101050f0 0x7f021019c790 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.314+0000 7f0215c40700 1 -- 172.21.15.81:0/2509693130 >> 172.21.15.81:0/2509693130 conn(0x7f0210100cf0 msgr2=0x7f02101935a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.315+0000 7f0215c40700 1 -- 172.21.15.81:0/2509693130 shutdown_connections 2024-05-08T23:56:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:09.315+0000 7f0215c40700 1 -- 172.21.15.81:0/2509693130 wait complete. 2024-05-08T23:56:09.728 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (2/15)... 2024-05-08T23:56:10.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:10 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:10.029+0000 7f1bc6f77200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T23:56:10.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:10 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:10.125+0000 7f1bc6f77200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T23:56:10.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:10 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:10.273+0000 7f1bc6f77200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T23:56:11.259 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:10 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:10.894+0000 7f1bc6f77200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T23:56:11.259 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:11 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:11.074+0000 7f1bc6f77200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T23:56:11.259 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:11 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:11.264+0000 7f1bc6f77200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T23:56:12.512 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:12 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3926580019' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T23:56:12.513 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:12 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:12.221+0000 7f1bc6f77200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T23:56:12.530 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-08T23:56:12.531 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:56:12.531 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "6c93ddc4-0d96-11ef-bc97-c7b262605968", 2024-05-08T23:56:12.531 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T23:56:12.531 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T23:56:12.531 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T23:56:12.531 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T23:56:12.531 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:12.531 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T23:56:12.531 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T23:56:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:12.533 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T23:56:12.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:12.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T23:56:12.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T23:56:12.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:12.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T23:56:12.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T23:56:12.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T23:56:12.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T23:56:12.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T23:56:12.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T23:56:12.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T23:56:12.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:56:12.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:56:12.534 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:12.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T23:56:12.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:12.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T23:55:58.924001+0000", 2024-05-08T23:56:12.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:56:12.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:12.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T23:56:12.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:56:12.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.055+0000 7f8f2507a700 1 Processor -- start 2024-05-08T23:56:12.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.055+0000 7f8f2507a700 1 -- start start 2024-05-08T23:56:12.535 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.056+0000 7f8f2507a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f20105730 0x7f8f20105b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:12.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.056+0000 7f8f2507a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f20106120 con 0x7f8f20105730 2024-05-08T23:56:12.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.056+0000 7f8f1ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f20105730 0x7f8f20105b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:12.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.056+0000 7f8f1ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f20105730 0x7f8f20105b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38166/0 (socket says 172.21.15.81:38166) 2024-05-08T23:56:12.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.056+0000 7f8f1ed9d700 1 -- 172.21.15.81:0/4016422815 learned_addr learned my addr 172.21.15.81:0/4016422815 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:12.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.056+0000 7f8f1ed9d700 1 -- 172.21.15.81:0/4016422815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f20106930 con 0x7f8f20105730 2024-05-08T23:56:12.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.056+0000 7f8f1ed9d700 1 --2- 172.21.15.81:0/4016422815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f20105730 0x7f8f20105b50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f18009e80 tx=0x7f8f1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112bd4fe64aa2055 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:12.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.056+0000 7f8f1dd9b700 1 -- 172.21.15.81:0/4016422815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f1800e070 con 0x7f8f20105730 2024-05-08T23:56:12.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.056+0000 7f8f1dd9b700 1 -- 172.21.15.81:0/4016422815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f1800b8c0 con 0x7f8f20105730 2024-05-08T23:56:12.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.056+0000 7f8f1dd9b700 1 -- 172.21.15.81:0/4016422815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f180044c0 con 0x7f8f20105730 2024-05-08T23:56:12.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.057+0000 7f8f2507a700 1 -- 172.21.15.81:0/4016422815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f20105730 msgr2=0x7f8f20105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:12.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.057+0000 7f8f2507a700 1 --2- 172.21.15.81:0/4016422815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f20105730 0x7f8f20105b50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f18009e80 tx=0x7f8f1800b330 comp rx=0 tx=0).stop 2024-05-08T23:56:12.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.057+0000 7f8f2507a700 1 -- 172.21.15.81:0/4016422815 shutdown_connections 2024-05-08T23:56:12.536 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.057+0000 7f8f2507a700 1 --2- 172.21.15.81:0/4016422815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f20105730 0x7f8f20105b50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.057+0000 7f8f2507a700 1 -- 172.21.15.81:0/4016422815 >> 172.21.15.81:0/4016422815 conn(0x7f8f20100cf0 msgr2=0x7f8f20103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.057+0000 7f8f2507a700 1 -- 172.21.15.81:0/4016422815 shutdown_connections 2024-05-08T23:56:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.057+0000 7f8f2507a700 1 -- 172.21.15.81:0/4016422815 wait complete. 2024-05-08T23:56:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.058+0000 7f8f2507a700 1 Processor -- start 2024-05-08T23:56:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.058+0000 7f8f2507a700 1 -- start start 2024-05-08T23:56:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.058+0000 7f8f2507a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f20105730 0x7f8f2019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.058+0000 7f8f2507a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2019aaf0 con 0x7f8f20105730 2024-05-08T23:56:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.058+0000 7f8f1ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f20105730 0x7f8f2019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.058+0000 7f8f1ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f20105730 0x7f8f2019a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38172/0 (socket says 172.21.15.81:38172) 2024-05-08T23:56:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.058+0000 7f8f1ed9d700 1 -- 172.21.15.81:0/3926580019 learned_addr learned my addr 172.21.15.81:0/3926580019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.059+0000 7f8f1ed9d700 1 -- 172.21.15.81:0/3926580019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f18009b30 con 0x7f8f20105730 2024-05-08T23:56:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.059+0000 7f8f1ed9d700 1 --2- 172.21.15.81:0/3926580019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f20105730 0x7f8f2019a5b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f18009e50 tx=0x7f8f18004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.059+0000 7f8f17fff700 1 -- 172.21.15.81:0/3926580019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f1800e040 con 0x7f8f20105730 2024-05-08T23:56:12.537 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.059+0000 7f8f17fff700 1 -- 172.21.15.81:0/3926580019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f1800bd70 con 0x7f8f20105730 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.059+0000 7f8f2507a700 1 -- 172.21.15.81:0/3926580019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2019acf0 con 0x7f8f20105730 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.059+0000 7f8f17fff700 1 -- 172.21.15.81:0/3926580019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f1801c730 con 0x7f8f20105730 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.059+0000 7f8f2507a700 1 -- 172.21.15.81:0/3926580019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2019b1f0 con 0x7f8f20105730 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.060+0000 7f8f2507a700 1 -- 172.21.15.81:0/3926580019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f00005320 con 0x7f8f20105730 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.060+0000 7f8f17fff700 1 -- 172.21.15.81:0/3926580019 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8f18012430 con 0x7f8f20105730 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.060+0000 7f8f17fff700 1 -- 172.21.15.81:0/3926580019 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8f18025790 con 0x7f8f20105730 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.062+0000 7f8f17fff700 1 -- 172.21.15.81:0/3926580019 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f8f1802a060 con 0x7f8f20105730 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.143+0000 7f8f2507a700 1 -- 172.21.15.81:0/3926580019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f8f00005190 con 0x7f8f20105730 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.143+0000 7f8f17fff700 1 -- 172.21.15.81:0/3926580019 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f8f18020070 con 0x7f8f20105730 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.144+0000 7f8f2507a700 1 -- 172.21.15.81:0/3926580019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f20105730 msgr2=0x7f8f2019a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.144+0000 7f8f2507a700 1 --2- 172.21.15.81:0/3926580019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f20105730 0x7f8f2019a5b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f18009e50 tx=0x7f8f18004610 comp rx=0 tx=0).stop 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.144+0000 7f8f2507a700 1 -- 172.21.15.81:0/3926580019 shutdown_connections 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.144+0000 7f8f2507a700 1 --2- 172.21.15.81:0/3926580019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f20105730 0x7f8f2019a5b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.144+0000 7f8f2507a700 1 -- 172.21.15.81:0/3926580019 >> 172.21.15.81:0/3926580019 conn(0x7f8f20100cf0 msgr2=0x7f8f20101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:12.538 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.144+0000 7f8f2507a700 1 -- 172.21.15.81:0/3926580019 shutdown_connections 2024-05-08T23:56:12.539 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:12.144+0000 7f8f2507a700 1 -- 172.21.15.81:0/3926580019 wait complete. 2024-05-08T23:56:12.539 INFO:teuthology.orchestra.run.smithi081.stdout:mgr not available, waiting (3/15)... 2024-05-08T23:56:12.792 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:12 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:12.518+0000 7f1bc6f77200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:56:12.792 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:12 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:12.608+0000 7f1bc6f77200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T23:56:12.792 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:12 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:12.798+0000 7f1bc6f77200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T23:56:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:13 smithi081 ceph-mon[42474]: Activating manager daemon x 2024-05-08T23:56:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:13 smithi081 ceph-mon[42474]: mgrmap e2: x(active, starting, since 0.00296791s) 2024-05-08T23:56:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:13 smithi081 ceph-mon[42474]: from='mgr.14100 172.21.15.81:0/1219904817' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T23:56:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:13 smithi081 ceph-mon[42474]: from='mgr.14100 172.21.15.81:0/1219904817' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T23:56:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:13 smithi081 ceph-mon[42474]: from='mgr.14100 172.21.15.81:0/1219904817' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T23:56:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:13 smithi081 ceph-mon[42474]: from='mgr.14100 172.21.15.81:0/1219904817' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:56:13.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:13 smithi081 ceph-mon[42474]: from='mgr.14100 172.21.15.81:0/1219904817' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T23:56:13.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:13 smithi081 ceph-mon[42474]: Manager daemon x is now available 2024-05-08T23:56:13.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:13 smithi081 ceph-mon[42474]: from='mgr.14100 172.21.15.81:0/1219904817' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T23:56:13.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:13 smithi081 ceph-mon[42474]: from='mgr.14100 172.21.15.81:0/1219904817' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T23:56:13.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:13 smithi081 ceph-mon[42474]: from='mgr.14100 172.21.15.81:0/1219904817' entity='mgr.x' 2024-05-08T23:56:13.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:13 smithi081 ceph-mon[42474]: from='mgr.14100 172.21.15.81:0/1219904817' entity='mgr.x' 2024-05-08T23:56:13.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:13 smithi081 ceph-mon[42474]: from='mgr.14100 172.21.15.81:0/1219904817' entity='mgr.x' 2024-05-08T23:56:15.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:14 smithi081 ceph-mon[42474]: mgrmap e3: x(active, since 1.00643s) 2024-05-08T23:56:15.487 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-08T23:56:15.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:56:15.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsid": "6c93ddc4-0d96-11ef-bc97-c7b262605968", 2024-05-08T23:56:15.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T23:56:15.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T23:56:15.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T23:56:15.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T23:56:15.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:15.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T23:56:15.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T23:56:15.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 0 2024-05-08T23:56:15.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:56:15.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T23:56:15.488 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T23:56:15.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:56:15.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2024-05-08T23:56:15.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T23:56:15.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:15.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-08T23:56:15.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T23:56:15.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:15.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T23:56:15.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:15.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T23:56:15.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T23:56:15.489 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T23:56:15.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T23:56:15.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T23:56:15.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T23:56:15.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:15.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T23:56:15.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T23:56:15.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T23:56:15.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T23:56:15.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T23:56:15.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T23:56:15.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T23:56:15.498 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T23:56:15.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T23:56:15.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:15.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T23:56:15.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:15.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T23:56:15.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T23:56:15.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:15.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T23:56:15.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T23:56:15.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T23:56:15.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T23:56:15.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T23:56:15.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T23:56:15.499 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T23:56:15.500 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ], 2024-05-08T23:56:15.500 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:56:15.500 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:15.500 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T23:56:15.500 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T23:56:15.500 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T23:55:58.924001+0000", 2024-05-08T23:56:15.500 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T23:56:15.500 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout }, 2024-05-08T23:56:15.500 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T23:56:15.500 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:56:15.500 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.863+0000 7f83165fb700 1 Processor -- start 2024-05-08T23:56:15.500 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.863+0000 7f83165fb700 1 -- start start 2024-05-08T23:56:15.500 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.863+0000 7f83165fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83101050d0 0x7f83101054f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:15.501 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.863+0000 7f83165fb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8310079e90 con 0x7f83101050d0 2024-05-08T23:56:15.501 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.864+0000 7f830ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83101050d0 0x7f83101054f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:15.501 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.864+0000 7f830ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83101050d0 0x7f83101054f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38234/0 (socket says 172.21.15.81:38234) 2024-05-08T23:56:15.501 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.864+0000 7f830ffff700 1 -- 172.21.15.81:0/1616240018 learned_addr learned my addr 172.21.15.81:0/1616240018 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:15.501 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.864+0000 7f830ffff700 1 -- 172.21.15.81:0/1616240018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8310105a30 con 0x7f83101050d0 2024-05-08T23:56:15.501 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.864+0000 7f830ffff700 1 --2- 172.21.15.81:0/1616240018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83101050d0 0x7f83101054f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f83000098a0 tx=0x7f8300009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d14dab1f41589f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:15.501 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.864+0000 7f830effd700 1 -- 172.21.15.81:0/1616240018 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8300004160 con 0x7f83101050d0 2024-05-08T23:56:15.501 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.864+0000 7f830effd700 1 -- 172.21.15.81:0/1616240018 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f83000042c0 con 0x7f83101050d0 2024-05-08T23:56:15.501 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.864+0000 7f830effd700 1 -- 172.21.15.81:0/1616240018 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8300011a00 con 0x7f83101050d0 2024-05-08T23:56:15.501 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.865+0000 7f83165fb700 1 -- 172.21.15.81:0/1616240018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83101050d0 msgr2=0x7f83101054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:15.501 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.865+0000 7f83165fb700 1 --2- 172.21.15.81:0/1616240018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83101050d0 0x7f83101054f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f83000098a0 tx=0x7f8300009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:15.501 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.865+0000 7f83165fb700 1 -- 172.21.15.81:0/1616240018 shutdown_connections 2024-05-08T23:56:15.501 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.865+0000 7f83165fb700 1 --2- 172.21.15.81:0/1616240018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83101050d0 0x7f83101054f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:15.501 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.865+0000 7f83165fb700 1 -- 172.21.15.81:0/1616240018 >> 172.21.15.81:0/1616240018 conn(0x7f8310100cf0 msgr2=0x7f8310103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.865+0000 7f83165fb700 1 -- 172.21.15.81:0/1616240018 shutdown_connections 2024-05-08T23:56:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.865+0000 7f83165fb700 1 -- 172.21.15.81:0/1616240018 wait complete. 2024-05-08T23:56:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.865+0000 7f83165fb700 1 Processor -- start 2024-05-08T23:56:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.865+0000 7f83165fb700 1 -- start start 2024-05-08T23:56:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.866+0000 7f83165fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83101050d0 0x7f831019c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.866+0000 7f83165fb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831019cd10 con 0x7f83101050d0 2024-05-08T23:56:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.866+0000 7f830ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83101050d0 0x7f831019c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.866+0000 7f830ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83101050d0 0x7f831019c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38248/0 (socket says 172.21.15.81:38248) 2024-05-08T23:56:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.866+0000 7f830ffff700 1 -- 172.21.15.81:0/2745730369 learned_addr learned my addr 172.21.15.81:0/2745730369 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.866+0000 7f830ffff700 1 -- 172.21.15.81:0/2745730369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8300009550 con 0x7f83101050d0 2024-05-08T23:56:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.866+0000 7f830ffff700 1 --2- 172.21.15.81:0/2745730369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83101050d0 0x7f831019c7d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8300011a20 tx=0x7f8300011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.866+0000 7f830d7fa700 1 -- 172.21.15.81:0/2745730369 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8300003af0 con 0x7f83101050d0 2024-05-08T23:56:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.866+0000 7f830d7fa700 1 -- 172.21.15.81:0/2745730369 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8300003c50 con 0x7f83101050d0 2024-05-08T23:56:15.502 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.866+0000 7f830d7fa700 1 -- 172.21.15.81:0/2745730369 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8300019760 con 0x7f83101050d0 2024-05-08T23:56:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.866+0000 7f83165fb700 1 -- 172.21.15.81:0/2745730369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831019cf10 con 0x7f83101050d0 2024-05-08T23:56:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.867+0000 7f83165fb700 1 -- 172.21.15.81:0/2745730369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831019d3b0 con 0x7f83101050d0 2024-05-08T23:56:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.867+0000 7f830d7fa700 1 -- 172.21.15.81:0/2745730369 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 3) v1 ==== 45424+0+0 (secure 0 0 0) 0x7f83000199a0 con 0x7f83101050d0 2024-05-08T23:56:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.867+0000 7f830d7fa700 1 --2- 172.21.15.81:0/2745730369 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f82fc038580 0x7f82fc03aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.867+0000 7f830d7fa700 1 -- 172.21.15.81:0/2745730369 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f830004c6b0 con 0x7f83101050d0 2024-05-08T23:56:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.867+0000 7f83165fb700 1 -- 172.21.15.81:0/2745730369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83101964a0 con 0x7f83101050d0 2024-05-08T23:56:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.868+0000 7f830f7fe700 1 --2- 172.21.15.81:0/2745730369 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f82fc038580 0x7f82fc03aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.868+0000 7f830f7fe700 1 --2- 172.21.15.81:0/2745730369 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f82fc038580 0x7f82fc03aa40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f82f8006fd0 tx=0x7f82f8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:14.872+0000 7f830d7fa700 1 -- 172.21.15.81:0/2745730369 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8300018b80 con 0x7f83101050d0 2024-05-08T23:56:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.139+0000 7f83165fb700 1 -- 172.21.15.81:0/2745730369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f83101068a0 con 0x7f83101050d0 2024-05-08T23:56:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.139+0000 7f830d7fa700 1 -- 172.21.15.81:0/2745730369 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f83000187c0 con 0x7f83101050d0 2024-05-08T23:56:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.141+0000 7f83165fb700 1 -- 172.21.15.81:0/2745730369 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f82fc038580 msgr2=0x7f82fc03aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.141+0000 7f83165fb700 1 --2- 172.21.15.81:0/2745730369 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f82fc038580 0x7f82fc03aa40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f82f8006fd0 tx=0x7f82f8006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:15.503 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.141+0000 7f83165fb700 1 -- 172.21.15.81:0/2745730369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83101050d0 msgr2=0x7f831019c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:15.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.141+0000 7f83165fb700 1 --2- 172.21.15.81:0/2745730369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83101050d0 0x7f831019c7d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8300011a20 tx=0x7f8300011b00 comp rx=0 tx=0).stop 2024-05-08T23:56:15.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.142+0000 7f83165fb700 1 -- 172.21.15.81:0/2745730369 shutdown_connections 2024-05-08T23:56:15.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.142+0000 7f83165fb700 1 --2- 172.21.15.81:0/2745730369 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f82fc038580 0x7f82fc03aa40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:15.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.142+0000 7f83165fb700 1 --2- 172.21.15.81:0/2745730369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83101050d0 0x7f831019c7d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:15.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.142+0000 7f83165fb700 1 -- 172.21.15.81:0/2745730369 >> 172.21.15.81:0/2745730369 conn(0x7f8310100cf0 msgr2=0x7f83101935e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:15.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.142+0000 7f83165fb700 1 -- 172.21.15.81:0/2745730369 shutdown_connections 2024-05-08T23:56:15.504 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.142+0000 7f83165fb700 1 -- 172.21.15.81:0/2745730369 wait complete. 2024-05-08T23:56:15.504 INFO:teuthology.orchestra.run.smithi081.stdout:mgr is available 2024-05-08T23:56:16.083 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:15 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2745730369' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T23:56:16.969 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-08T23:56:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [global] 2024-05-08T23:56:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout fsid = 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:56:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-08T23:56:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-08T23:56:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-08T23:56:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-08T23:56:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-08T23:56:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-08T23:56:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-08T23:56:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 2024-05-08T23:56:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout [osd] 2024-05-08T23:56:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-08T23:56:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-08T23:56:16.970 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-08T23:56:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-08T23:56:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-08T23:56:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.865+0000 7f81fcd9b700 1 Processor -- start 2024-05-08T23:56:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.865+0000 7f81fcd9b700 1 -- start start 2024-05-08T23:56:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.865+0000 7f81fcd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f8105730 0x7f81f8105b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.865+0000 7f81fcd9b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8106120 con 0x7f81f8105730 2024-05-08T23:56:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.865+0000 7f81f659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f8105730 0x7f81f8105b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.865+0000 7f81f659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f8105730 0x7f81f8105b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38264/0 (socket says 172.21.15.81:38264) 2024-05-08T23:56:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.866+0000 7f81f659c700 1 -- 172.21.15.81:0/2076370257 learned_addr learned my addr 172.21.15.81:0/2076370257 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.866+0000 7f81f659c700 1 -- 172.21.15.81:0/2076370257 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f8106930 con 0x7f81f8105730 2024-05-08T23:56:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.866+0000 7f81f659c700 1 --2- 172.21.15.81:0/2076370257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f8105730 0x7f81f8105b50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f81f000bb40 tx=0x7f81f000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fdec2e61431ca9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.866+0000 7f81f559a700 1 -- 172.21.15.81:0/2076370257 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81f000dbe0 con 0x7f81f8105730 2024-05-08T23:56:16.971 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.866+0000 7f81f559a700 1 -- 172.21.15.81:0/2076370257 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81f00044d0 con 0x7f81f8105730 2024-05-08T23:56:16.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.866+0000 7f81f559a700 1 -- 172.21.15.81:0/2076370257 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81f0010470 con 0x7f81f8105730 2024-05-08T23:56:16.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.867+0000 7f81fcd9b700 1 -- 172.21.15.81:0/2076370257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f8105730 msgr2=0x7f81f8105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:16.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.867+0000 7f81fcd9b700 1 --2- 172.21.15.81:0/2076370257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f8105730 0x7f81f8105b50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f81f000bb40 tx=0x7f81f000be50 comp rx=0 tx=0).stop 2024-05-08T23:56:16.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.867+0000 7f81fcd9b700 1 -- 172.21.15.81:0/2076370257 shutdown_connections 2024-05-08T23:56:16.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.867+0000 7f81fcd9b700 1 --2- 172.21.15.81:0/2076370257 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f8105730 0x7f81f8105b50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:16.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.867+0000 7f81fcd9b700 1 -- 172.21.15.81:0/2076370257 >> 172.21.15.81:0/2076370257 conn(0x7f81f8100cf0 msgr2=0x7f81f8103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:16.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.867+0000 7f81fcd9b700 1 -- 172.21.15.81:0/2076370257 shutdown_connections 2024-05-08T23:56:16.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.867+0000 7f81fcd9b700 1 -- 172.21.15.81:0/2076370257 wait complete. 2024-05-08T23:56:16.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.868+0000 7f81fcd9b700 1 Processor -- start 2024-05-08T23:56:16.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.868+0000 7f81fcd9b700 1 -- start start 2024-05-08T23:56:16.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.868+0000 7f81fcd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f8105730 0x7f81f8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:16.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.868+0000 7f81fcd9b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8198950 con 0x7f81f8105730 2024-05-08T23:56:16.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.868+0000 7f81f659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f8105730 0x7f81f8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:16.972 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.868+0000 7f81f659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f8105730 0x7f81f8198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38272/0 (socket says 172.21.15.81:38272) 2024-05-08T23:56:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.868+0000 7f81f659c700 1 -- 172.21.15.81:0/3656282285 learned_addr learned my addr 172.21.15.81:0/3656282285 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.868+0000 7f81f659c700 1 -- 172.21.15.81:0/3656282285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f000b7f0 con 0x7f81f8105730 2024-05-08T23:56:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.868+0000 7f81f659c700 1 --2- 172.21.15.81:0/3656282285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f8105730 0x7f81f8198410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f81f0003c60 tx=0x7f81f0003980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.869+0000 7f81ef7fe700 1 -- 172.21.15.81:0/3656282285 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81f001e070 con 0x7f81f8105730 2024-05-08T23:56:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.869+0000 7f81fcd9b700 1 -- 172.21.15.81:0/3656282285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f8198b50 con 0x7f81f8105730 2024-05-08T23:56:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.869+0000 7f81ef7fe700 1 -- 172.21.15.81:0/3656282285 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81f0004250 con 0x7f81f8105730 2024-05-08T23:56:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.869+0000 7f81ef7fe700 1 -- 172.21.15.81:0/3656282285 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81f0022900 con 0x7f81f8105730 2024-05-08T23:56:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.869+0000 7f81fcd9b700 1 -- 172.21.15.81:0/3656282285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f8198ff0 con 0x7f81f8105730 2024-05-08T23:56:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.869+0000 7f81ef7fe700 1 -- 172.21.15.81:0/3656282285 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f81f002c440 con 0x7f81f8105730 2024-05-08T23:56:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.870+0000 7f81ef7fe700 1 --2- 172.21.15.81:0/3656282285 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f81e40386b0 0x7f81e403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.870+0000 7f81ef7fe700 1 -- 172.21.15.81:0/3656282285 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f81f004e620 con 0x7f81f8105730 2024-05-08T23:56:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.870+0000 7f81fcd9b700 1 -- 172.21.15.81:0/3656282285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f8078ff0 con 0x7f81f8105730 2024-05-08T23:56:16.973 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.870+0000 7f81f5d9b700 1 --2- 172.21.15.81:0/3656282285 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f81e40386b0 0x7f81e403ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:16.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.870+0000 7f81f5d9b700 1 --2- 172.21.15.81:0/3656282285 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f81e40386b0 0x7f81e403ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f81e0006fd0 tx=0x7f81e0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:16.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:15.875+0000 7f81ef7fe700 1 -- 172.21.15.81:0/3656282285 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f81f0027070 con 0x7f81f8105730 2024-05-08T23:56:16.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:16.065+0000 7f81fcd9b700 1 -- 172.21.15.81:0/3656282285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f81f819b830 con 0x7f81f8105730 2024-05-08T23:56:16.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:16.065+0000 7f81ef7fe700 1 -- 172.21.15.81:0/3656282285 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f81f002a950 con 0x7f81f8105730 2024-05-08T23:56:16.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:16.068+0000 7f81fcd9b700 1 -- 172.21.15.81:0/3656282285 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f81e40386b0 msgr2=0x7f81e403ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:16.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:16.068+0000 7f81fcd9b700 1 --2- 172.21.15.81:0/3656282285 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f81e40386b0 0x7f81e403ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f81e0006fd0 tx=0x7f81e0006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:16.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:16.068+0000 7f81fcd9b700 1 -- 172.21.15.81:0/3656282285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f8105730 msgr2=0x7f81f8198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:16.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:16.068+0000 7f81fcd9b700 1 --2- 172.21.15.81:0/3656282285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f8105730 0x7f81f8198410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f81f0003c60 tx=0x7f81f0003980 comp rx=0 tx=0).stop 2024-05-08T23:56:16.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:16.068+0000 7f81fcd9b700 1 -- 172.21.15.81:0/3656282285 shutdown_connections 2024-05-08T23:56:16.974 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:16.068+0000 7f81fcd9b700 1 --2- 172.21.15.81:0/3656282285 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f81e40386b0 0x7f81e403ab70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:16.975 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:16.068+0000 7f81fcd9b700 1 --2- 172.21.15.81:0/3656282285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81f8105730 0x7f81f8198410 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:16.975 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:16.068+0000 7f81fcd9b700 1 -- 172.21.15.81:0/3656282285 >> 172.21.15.81:0/3656282285 conn(0x7f81f8100cf0 msgr2=0x7f81f818ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:16.975 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:16.068+0000 7f81fcd9b700 1 -- 172.21.15.81:0/3656282285 shutdown_connections 2024-05-08T23:56:16.975 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:16.068+0000 7f81fcd9b700 1 -- 172.21.15.81:0/3656282285 wait complete. 2024-05-08T23:56:16.975 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling cephadm module... 2024-05-08T23:56:17.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:16 smithi081 ceph-mon[42474]: mgrmap e4: x(active, since 3s) 2024-05-08T23:56:17.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:16 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3656282285' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-08T23:56:18.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:18 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/603704916' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-08T23:56:18.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:18 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: ignoring --setuser ceph since I am not root 2024-05-08T23:56:18.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:18 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: ignoring --setgroup ceph since I am not root 2024-05-08T23:56:19.152 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:18 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:18.890+0000 7f56ee160200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T23:56:19.152 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:18 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:18.984+0000 7f56ee160200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T23:56:19.152 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:19 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:19.072+0000 7f56ee160200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T23:56:19.152 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:19 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:19.157+0000 7f56ee160200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T23:56:19.785 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:19 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/603704916' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-08T23:56:19.785 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:19 smithi081 ceph-mon[42474]: mgrmap e5: x(active, since 5s) 2024-05-08T23:56:19.813 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.153+0000 7f8f65d7c700 1 Processor -- start 2024-05-08T23:56:19.813 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.153+0000 7f8f65d7c700 1 -- start start 2024-05-08T23:56:19.813 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.153+0000 7f8f65d7c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f601072b0 0x7f8f601096a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:19.813 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.153+0000 7f8f65d7c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f60079ed0 con 0x7f8f601072b0 2024-05-08T23:56:19.813 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.153+0000 7f8f5f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f601072b0 0x7f8f601096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:19.813 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.153+0000 7f8f5f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f601072b0 0x7f8f601096a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43076/0 (socket says 172.21.15.81:43076) 2024-05-08T23:56:19.814 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.153+0000 7f8f5f7fe700 1 -- 172.21.15.81:0/4008956272 learned_addr learned my addr 172.21.15.81:0/4008956272 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:19.814 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.153+0000 7f8f5f7fe700 1 -- 172.21.15.81:0/4008956272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f60109be0 con 0x7f8f601072b0 2024-05-08T23:56:19.814 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.153+0000 7f8f5f7fe700 1 --2- 172.21.15.81:0/4008956272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f601072b0 0x7f8f601096a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8f500098a0 tx=0x7f8f50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728a8f2a03519de0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:19.814 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.154+0000 7f8f5e7fc700 1 -- 172.21.15.81:0/4008956272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f50004160 con 0x7f8f601072b0 2024-05-08T23:56:19.814 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.154+0000 7f8f5e7fc700 1 -- 172.21.15.81:0/4008956272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f500042c0 con 0x7f8f601072b0 2024-05-08T23:56:19.814 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.154+0000 7f8f5e7fc700 1 -- 172.21.15.81:0/4008956272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f50011a00 con 0x7f8f601072b0 2024-05-08T23:56:19.814 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.154+0000 7f8f65d7c700 1 -- 172.21.15.81:0/4008956272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f601072b0 msgr2=0x7f8f601096a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:19.814 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.154+0000 7f8f65d7c700 1 --2- 172.21.15.81:0/4008956272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f601072b0 0x7f8f601096a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8f500098a0 tx=0x7f8f50009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:19.814 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.154+0000 7f8f65d7c700 1 -- 172.21.15.81:0/4008956272 shutdown_connections 2024-05-08T23:56:19.814 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.154+0000 7f8f65d7c700 1 --2- 172.21.15.81:0/4008956272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f601072b0 0x7f8f601096a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:19.814 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.154+0000 7f8f65d7c700 1 -- 172.21.15.81:0/4008956272 >> 172.21.15.81:0/4008956272 conn(0x7f8f60100d80 msgr2=0x7f8f601031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:19.814 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.154+0000 7f8f65d7c700 1 -- 172.21.15.81:0/4008956272 shutdown_connections 2024-05-08T23:56:19.815 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.154+0000 7f8f65d7c700 1 -- 172.21.15.81:0/4008956272 wait complete. 2024-05-08T23:56:19.815 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.155+0000 7f8f65d7c700 1 Processor -- start 2024-05-08T23:56:19.815 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.155+0000 7f8f65d7c700 1 -- start start 2024-05-08T23:56:19.815 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.155+0000 7f8f65d7c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f601072b0 0x7f8f6019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:19.815 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.155+0000 7f8f65d7c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6019aa90 con 0x7f8f601072b0 2024-05-08T23:56:19.815 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.155+0000 7f8f5f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f601072b0 0x7f8f6019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:19.815 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.155+0000 7f8f5f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f601072b0 0x7f8f6019a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43090/0 (socket says 172.21.15.81:43090) 2024-05-08T23:56:19.815 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.155+0000 7f8f5f7fe700 1 -- 172.21.15.81:0/603704916 learned_addr learned my addr 172.21.15.81:0/603704916 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:19.815 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.156+0000 7f8f5f7fe700 1 -- 172.21.15.81:0/603704916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f50009550 con 0x7f8f601072b0 2024-05-08T23:56:19.815 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.156+0000 7f8f5f7fe700 1 --2- 172.21.15.81:0/603704916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f601072b0 0x7f8f6019a550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8f50011a20 tx=0x7f8f50011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:19.815 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.156+0000 7f8f5cff9700 1 -- 172.21.15.81:0/603704916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f50003af0 con 0x7f8f601072b0 2024-05-08T23:56:19.815 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.156+0000 7f8f5cff9700 1 -- 172.21.15.81:0/603704916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f50003c50 con 0x7f8f601072b0 2024-05-08T23:56:19.815 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.156+0000 7f8f5cff9700 1 -- 172.21.15.81:0/603704916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8f50019760 con 0x7f8f601072b0 2024-05-08T23:56:19.815 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.156+0000 7f8f65d7c700 1 -- 172.21.15.81:0/603704916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6019ac90 con 0x7f8f601072b0 2024-05-08T23:56:19.816 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.156+0000 7f8f65d7c700 1 -- 172.21.15.81:0/603704916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6019b130 con 0x7f8f601072b0 2024-05-08T23:56:19.816 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.157+0000 7f8f5cff9700 1 -- 172.21.15.81:0/603704916 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7f8f50019950 con 0x7f8f601072b0 2024-05-08T23:56:19.816 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.157+0000 7f8f5cff9700 1 --2- 172.21.15.81:0/603704916 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f8f48038700 0x7f8f4803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:19.816 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.157+0000 7f8f65d7c700 1 -- 172.21.15.81:0/603704916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6010a9e0 con 0x7f8f601072b0 2024-05-08T23:56:19.816 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.157+0000 7f8f5cff9700 1 -- 172.21.15.81:0/603704916 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f8f5004c800 con 0x7f8f601072b0 2024-05-08T23:56:19.816 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.157+0000 7f8f5effd700 1 --2- 172.21.15.81:0/603704916 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f8f48038700 0x7f8f4803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:19.816 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.157+0000 7f8f5effd700 1 --2- 172.21.15.81:0/603704916 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f8f48038700 0x7f8f4803abc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8f54006fd0 tx=0x7f8f54006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:19.816 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.162+0000 7f8f5cff9700 1 -- 172.21.15.81:0/603704916 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8f50018d90 con 0x7f8f601072b0 2024-05-08T23:56:19.816 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.409+0000 7f8f65d7c700 1 -- 172.21.15.81:0/603704916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f8f6019d9c0 con 0x7f8f601072b0 2024-05-08T23:56:19.816 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.461+0000 7f8f5cff9700 1 -- 172.21.15.81:0/603704916 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f8f5000b900 con 0x7f8f601072b0 2024-05-08T23:56:19.816 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.463+0000 7f8f5cff9700 1 -- 172.21.15.81:0/603704916 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f8f5004c220 con 0x7f8f601072b0 2024-05-08T23:56:19.816 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.465+0000 7f8f65d7c700 1 -- 172.21.15.81:0/603704916 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f8f48038700 msgr2=0x7f8f4803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:19.816 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.465+0000 7f8f65d7c700 1 --2- 172.21.15.81:0/603704916 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f8f48038700 0x7f8f4803abc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8f54006fd0 tx=0x7f8f54006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:19.817 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.465+0000 7f8f65d7c700 1 -- 172.21.15.81:0/603704916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f601072b0 msgr2=0x7f8f6019a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:19.817 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.465+0000 7f8f65d7c700 1 --2- 172.21.15.81:0/603704916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f601072b0 0x7f8f6019a550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8f50011a20 tx=0x7f8f50011b00 comp rx=0 tx=0).stop 2024-05-08T23:56:19.817 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.465+0000 7f8f65d7c700 1 -- 172.21.15.81:0/603704916 shutdown_connections 2024-05-08T23:56:19.817 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.465+0000 7f8f65d7c700 1 --2- 172.21.15.81:0/603704916 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f8f48038700 0x7f8f4803abc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:19.817 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.465+0000 7f8f65d7c700 1 --2- 172.21.15.81:0/603704916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f601072b0 0x7f8f6019a550 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:19.817 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.465+0000 7f8f65d7c700 1 -- 172.21.15.81:0/603704916 >> 172.21.15.81:0/603704916 conn(0x7f8f60100d80 msgr2=0x7f8f601018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:19.817 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.466+0000 7f8f65d7c700 1 -- 172.21.15.81:0/603704916 shutdown_connections 2024-05-08T23:56:19.817 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:18.466+0000 7f8f65d7c700 1 -- 172.21.15.81:0/603704916 wait complete. 2024-05-08T23:56:20.042 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:19 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:19.790+0000 7f56ee160200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:56:20.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:20 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:20.047+0000 7f56ee160200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T23:56:20.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:20 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:20.134+0000 7f56ee160200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T23:56:20.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:20 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:20.243+0000 7f56ee160200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T23:56:20.703 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:20 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:20.399+0000 7f56ee160200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T23:56:20.704 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:20 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:20.530+0000 7f56ee160200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T23:56:20.704 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:20 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:20.618+0000 7f56ee160200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T23:56:21.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:20 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:20.988+0000 7f56ee160200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T23:56:21.670 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:21 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3849256027' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-08T23:56:21.670 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:21 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:21.382+0000 7f56ee160200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T23:56:21.671 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:21 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:21.583+0000 7f56ee160200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T23:56:22.120 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:21 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:21.675+0000 7f56ee160200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T23:56:22.758 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:22 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:22.436+0000 7f56ee160200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T23:56:22.758 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:22 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:22.532+0000 7f56ee160200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T23:56:22.758 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:22 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:22.682+0000 7f56ee160200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T23:56:23.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:56:23.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-08T23:56:23.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T23:56:23.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-08T23:56:23.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-08T23:56:23.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:56:23.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.239+0000 7f26a993f700 1 Processor -- start 2024-05-08T23:56:23.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.239+0000 7f26a993f700 1 -- start start 2024-05-08T23:56:23.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.239+0000 7f26a993f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a41050d0 0x7f26a41054f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:23.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.239+0000 7f26a993f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a4079e90 con 0x7f26a41050d0 2024-05-08T23:56:23.592 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.239+0000 7f26a2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a41050d0 0x7f26a41054f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:23.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.239+0000 7f26a2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a41050d0 0x7f26a41054f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43122/0 (socket says 172.21.15.81:43122) 2024-05-08T23:56:23.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.239+0000 7f26a2ffd700 1 -- 172.21.15.81:0/2447911888 learned_addr learned my addr 172.21.15.81:0/2447911888 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:23.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.240+0000 7f26a2ffd700 1 -- 172.21.15.81:0/2447911888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a4105a30 con 0x7f26a41050d0 2024-05-08T23:56:23.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.240+0000 7f26a2ffd700 1 --2- 172.21.15.81:0/2447911888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a41050d0 0x7f26a41054f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f26980098a0 tx=0x7f2698009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b363e5cffba89a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:23.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.240+0000 7f26a1ffb700 1 -- 172.21.15.81:0/2447911888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2698004160 con 0x7f26a41050d0 2024-05-08T23:56:23.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.240+0000 7f26a1ffb700 1 -- 172.21.15.81:0/2447911888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f26980042c0 con 0x7f26a41050d0 2024-05-08T23:56:23.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.240+0000 7f26a1ffb700 1 -- 172.21.15.81:0/2447911888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2698011a00 con 0x7f26a41050d0 2024-05-08T23:56:23.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.241+0000 7f26a993f700 1 -- 172.21.15.81:0/2447911888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a41050d0 msgr2=0x7f26a41054f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:23.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.241+0000 7f26a993f700 1 --2- 172.21.15.81:0/2447911888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a41050d0 0x7f26a41054f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f26980098a0 tx=0x7f2698009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:23.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.241+0000 7f26a993f700 1 -- 172.21.15.81:0/2447911888 shutdown_connections 2024-05-08T23:56:23.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.241+0000 7f26a993f700 1 --2- 172.21.15.81:0/2447911888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a41050d0 0x7f26a41054f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:23.593 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.241+0000 7f26a993f700 1 -- 172.21.15.81:0/2447911888 >> 172.21.15.81:0/2447911888 conn(0x7f26a4100cf0 msgr2=0x7f26a4103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:23.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.241+0000 7f26a993f700 1 -- 172.21.15.81:0/2447911888 shutdown_connections 2024-05-08T23:56:23.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.241+0000 7f26a993f700 1 -- 172.21.15.81:0/2447911888 wait complete. 2024-05-08T23:56:23.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.241+0000 7f26a993f700 1 Processor -- start 2024-05-08T23:56:23.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.241+0000 7f26a993f700 1 -- start start 2024-05-08T23:56:23.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.241+0000 7f26a993f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a41050d0 0x7f26a419c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:23.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.242+0000 7f26a993f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a419cd10 con 0x7f26a41050d0 2024-05-08T23:56:23.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.242+0000 7f26a2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a41050d0 0x7f26a419c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:23.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.242+0000 7f26a2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a41050d0 0x7f26a419c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43126/0 (socket says 172.21.15.81:43126) 2024-05-08T23:56:23.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.242+0000 7f26a2ffd700 1 -- 172.21.15.81:0/3849256027 learned_addr learned my addr 172.21.15.81:0/3849256027 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:23.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.242+0000 7f26a2ffd700 1 -- 172.21.15.81:0/3849256027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2698009550 con 0x7f26a41050d0 2024-05-08T23:56:23.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.242+0000 7f26a2ffd700 1 --2- 172.21.15.81:0/3849256027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a41050d0 0x7f26a419c7d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2698011a20 tx=0x7f2698011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:23.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.242+0000 7f26a893d700 1 -- 172.21.15.81:0/3849256027 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2698003af0 con 0x7f26a41050d0 2024-05-08T23:56:23.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.242+0000 7f26a893d700 1 -- 172.21.15.81:0/3849256027 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2698003c50 con 0x7f26a41050d0 2024-05-08T23:56:23.594 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.242+0000 7f26a993f700 1 -- 172.21.15.81:0/3849256027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a419cf10 con 0x7f26a41050d0 2024-05-08T23:56:23.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.242+0000 7f26a893d700 1 -- 172.21.15.81:0/3849256027 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2698019760 con 0x7f26a41050d0 2024-05-08T23:56:23.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.242+0000 7f26a993f700 1 -- 172.21.15.81:0/3849256027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a419d3b0 con 0x7f26a41050d0 2024-05-08T23:56:23.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.243+0000 7f26a893d700 1 -- 172.21.15.81:0/3849256027 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f26980199a0 con 0x7f26a41050d0 2024-05-08T23:56:23.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.243+0000 7f26a893d700 1 --2- 172.21.15.81:0/3849256027 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f268c038700 0x7f268c03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:23.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.243+0000 7f26a893d700 1 -- 172.21.15.81:0/3849256027 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f269804d8c0 con 0x7f26a41050d0 2024-05-08T23:56:23.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.243+0000 7f26a27fc700 1 -- 172.21.15.81:0/3849256027 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f268c038700 msgr2=0x7f268c03abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2902845226 2024-05-08T23:56:23.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.243+0000 7f26a27fc700 1 --2- 172.21.15.81:0/3849256027 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f268c038700 0x7f268c03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:56:23.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.243+0000 7f26a993f700 1 -- 172.21.15.81:0/3849256027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a41964a0 con 0x7f26a41050d0 2024-05-08T23:56:23.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.248+0000 7f26a893d700 1 -- 172.21.15.81:0/3849256027 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2698018db0 con 0x7f26a41050d0 2024-05-08T23:56:23.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.444+0000 7f26a27fc700 1 -- 172.21.15.81:0/3849256027 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f268c038700 msgr2=0x7f268c03abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2902845226 2024-05-08T23:56:23.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.444+0000 7f26a27fc700 1 --2- 172.21.15.81:0/3849256027 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f268c038700 0x7f268c03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T23:56:23.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.506+0000 7f26a993f700 1 -- 172.21.15.81:0/3849256027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f26a41068a0 con 0x7f26a41050d0 2024-05-08T23:56:23.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.506+0000 7f26a893d700 1 -- 172.21.15.81:0/3849256027 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f2698018350 con 0x7f26a41050d0 2024-05-08T23:56:23.595 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.509+0000 7f26a993f700 1 -- 172.21.15.81:0/3849256027 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f268c038700 msgr2=0x7f268c03abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:56:23.596 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.509+0000 7f26a993f700 1 --2- 172.21.15.81:0/3849256027 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f268c038700 0x7f268c03abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:23.596 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.509+0000 7f26a993f700 1 -- 172.21.15.81:0/3849256027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a41050d0 msgr2=0x7f26a419c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:23.596 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.509+0000 7f26a993f700 1 --2- 172.21.15.81:0/3849256027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a41050d0 0x7f26a419c7d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2698011a20 tx=0x7f2698011b00 comp rx=0 tx=0).stop 2024-05-08T23:56:23.596 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.509+0000 7f26a993f700 1 -- 172.21.15.81:0/3849256027 shutdown_connections 2024-05-08T23:56:23.596 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.509+0000 7f26a993f700 1 --2- 172.21.15.81:0/3849256027 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7f268c038700 0x7f268c03abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:23.596 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.509+0000 7f26a993f700 1 --2- 172.21.15.81:0/3849256027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26a41050d0 0x7f26a419c7d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:23.596 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.509+0000 7f26a993f700 1 -- 172.21.15.81:0/3849256027 >> 172.21.15.81:0/3849256027 conn(0x7f26a4100cf0 msgr2=0x7f26a41935e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:23.596 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.509+0000 7f26a993f700 1 -- 172.21.15.81:0/3849256027 shutdown_connections 2024-05-08T23:56:23.596 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:21.509+0000 7f26a993f700 1 -- 172.21.15.81:0/3849256027 wait complete. 2024-05-08T23:56:23.596 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:23 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:23.307+0000 7f56ee160200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T23:56:23.596 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:23 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:23.488+0000 7f56ee160200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T23:56:23.597 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for the mgr to restart... 2024-05-08T23:56:23.597 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr epoch 5... 2024-05-08T23:56:23.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:23 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:23.690+0000 7f56ee160200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T23:56:24.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:24 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:24.624+0000 7f56ee160200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T23:56:25.192 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:24 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:24.911+0000 7f56ee160200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:56:25.192 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:25 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:24.999+0000 7f56ee160200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T23:56:25.192 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:25 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:25.197+0000 7f56ee160200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T23:56:25.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:25 smithi081 ceph-mon[42474]: Active manager daemon x restarted 2024-05-08T23:56:25.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:25 smithi081 ceph-mon[42474]: Activating manager daemon x 2024-05-08T23:56:25.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:25 smithi081 ceph-mon[42474]: osdmap e2: 0 total, 0 up, 0 in 2024-05-08T23:56:25.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:25 smithi081 ceph-mon[42474]: mgrmap e6: x(active, starting, since 0.00336815s) 2024-05-08T23:56:25.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:25 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:56:25.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:25 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T23:56:25.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:25 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T23:56:25.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:25 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T23:56:25.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:25 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T23:56:25.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:25 smithi081 ceph-mon[42474]: Manager daemon x is now available 2024-05-08T23:56:25.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:25 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' 2024-05-08T23:56:25.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:25 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' 2024-05-08T23:56:25.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:25 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:56:25.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:25 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:56:26.582 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:26 smithi081 ceph-mon[42474]: Found migration_current of "None". Setting to last migration. 2024-05-08T23:56:26.582 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:26 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T23:56:26.582 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:26 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T23:56:26.582 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:26 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' 2024-05-08T23:56:26.582 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:26 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' 2024-05-08T23:56:26.582 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:26 smithi081 ceph-mon[42474]: mgrmap e7: x(active, since 1.00603s) 2024-05-08T23:56:26.582 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:26 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:56:26.773 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:56:26.773 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-08T23:56:26.773 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-08T23:56:26.773 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:56:26.773 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.106+0000 7fad06677700 1 Processor -- start 2024-05-08T23:56:26.773 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.106+0000 7fad06677700 1 -- start start 2024-05-08T23:56:26.773 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.106+0000 7fad06677700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad001072d0 0x7fad001096c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:26.773 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.106+0000 7fad06677700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad00079e90 con 0x7fad001072d0 2024-05-08T23:56:26.773 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.106+0000 7facfffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad001072d0 0x7fad001096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:26.774 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.106+0000 7facfffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad001072d0 0x7fad001096c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43138/0 (socket says 172.21.15.81:43138) 2024-05-08T23:56:26.774 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.106+0000 7facfffff700 1 -- 172.21.15.81:0/1919855548 learned_addr learned my addr 172.21.15.81:0/1919855548 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:26.774 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.106+0000 7facfffff700 1 -- 172.21.15.81:0/1919855548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad00109c00 con 0x7fad001072d0 2024-05-08T23:56:26.774 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.107+0000 7facfffff700 1 --2- 172.21.15.81:0/1919855548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad001072d0 0x7fad001096c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7facf00098a0 tx=0x7facf0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f794b66d2a5a943f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:26.774 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.107+0000 7facfeffd700 1 -- 172.21.15.81:0/1919855548 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facf0004160 con 0x7fad001072d0 2024-05-08T23:56:26.774 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.107+0000 7facfeffd700 1 -- 172.21.15.81:0/1919855548 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7facf00042c0 con 0x7fad001072d0 2024-05-08T23:56:26.774 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.107+0000 7facfeffd700 1 -- 172.21.15.81:0/1919855548 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facf0011a00 con 0x7fad001072d0 2024-05-08T23:56:26.774 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.107+0000 7fad06677700 1 -- 172.21.15.81:0/1919855548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad001072d0 msgr2=0x7fad001096c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:26.774 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.107+0000 7fad06677700 1 --2- 172.21.15.81:0/1919855548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad001072d0 0x7fad001096c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7facf00098a0 tx=0x7facf0009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:26.774 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.107+0000 7fad06677700 1 -- 172.21.15.81:0/1919855548 shutdown_connections 2024-05-08T23:56:26.774 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.107+0000 7fad06677700 1 --2- 172.21.15.81:0/1919855548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad001072d0 0x7fad001096c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:26.774 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.107+0000 7fad06677700 1 -- 172.21.15.81:0/1919855548 >> 172.21.15.81:0/1919855548 conn(0x7fad00100ca0 msgr2=0x7fad00103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:26.774 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.107+0000 7fad06677700 1 -- 172.21.15.81:0/1919855548 shutdown_connections 2024-05-08T23:56:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.107+0000 7fad06677700 1 -- 172.21.15.81:0/1919855548 wait complete. 2024-05-08T23:56:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.108+0000 7fad06677700 1 Processor -- start 2024-05-08T23:56:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.108+0000 7fad06677700 1 -- start start 2024-05-08T23:56:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.109+0000 7fad06677700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad001072d0 0x7fad0019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.109+0000 7fad06677700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0019aa50 con 0x7fad001072d0 2024-05-08T23:56:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.109+0000 7facfffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad001072d0 0x7fad0019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.109+0000 7facfffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad001072d0 0x7fad0019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43144/0 (socket says 172.21.15.81:43144) 2024-05-08T23:56:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.109+0000 7facfffff700 1 -- 172.21.15.81:0/4166299806 learned_addr learned my addr 172.21.15.81:0/4166299806 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.109+0000 7facfffff700 1 -- 172.21.15.81:0/4166299806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf0009550 con 0x7fad001072d0 2024-05-08T23:56:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.109+0000 7facfffff700 1 --2- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad001072d0 0x7fad0019a510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7facf0009130 tx=0x7facf0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.109+0000 7facfd7fa700 1 -- 172.21.15.81:0/4166299806 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facf0003b70 con 0x7fad001072d0 2024-05-08T23:56:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.109+0000 7facfd7fa700 1 -- 172.21.15.81:0/4166299806 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7facf0003cd0 con 0x7fad001072d0 2024-05-08T23:56:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.109+0000 7fad06677700 1 -- 172.21.15.81:0/4166299806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0019ac50 con 0x7fad001072d0 2024-05-08T23:56:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.109+0000 7facfd7fa700 1 -- 172.21.15.81:0/4166299806 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7facf00197d0 con 0x7fad001072d0 2024-05-08T23:56:26.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.109+0000 7fad06677700 1 -- 172.21.15.81:0/4166299806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0019b0f0 con 0x7fad001072d0 2024-05-08T23:56:26.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.110+0000 7facfd7fa700 1 -- 172.21.15.81:0/4166299806 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7facf0019a10 con 0x7fad001072d0 2024-05-08T23:56:26.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.110+0000 7facfd7fa700 1 --2- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7face8038700 0x7face803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:26.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.110+0000 7fad06677700 1 -- 172.21.15.81:0/4166299806 --> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad0010a9a0 con 0x7face8038700 2024-05-08T23:56:26.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.110+0000 7facfd7fa700 1 -- 172.21.15.81:0/4166299806 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7facf004c960 con 0x7fad001072d0 2024-05-08T23:56:26.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.110+0000 7facff7fe700 1 -- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7face8038700 msgr2=0x7face803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/2902845226 2024-05-08T23:56:26.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.110+0000 7facff7fe700 1 --2- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7face8038700 0x7face803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:56:26.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.212+0000 7facfd7fa700 1 -- 172.21.15.81:0/4166299806 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mgrmap(e 6) v1 ==== 45308+0+0 (secure 0 0 0) 0x7facf0019cc0 con 0x7fad001072d0 2024-05-08T23:56:26.776 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.212+0000 7facfd7fa700 1 -- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7face8038700 msgr2=0x7face803abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:56:26.777 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:25.212+0000 7facfd7fa700 1 --2- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7face8038700 0x7face803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:26.777 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.213+0000 7facfd7fa700 1 -- 172.21.15.81:0/4166299806 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7facf004e110 con 0x7fad001072d0 2024-05-08T23:56:26.777 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.214+0000 7facfd7fa700 1 --2- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7face803be80 0x7face803e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:26.777 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.214+0000 7facfd7fa700 1 -- 172.21.15.81:0/4166299806 --> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad0010a9a0 con 0x7face803be80 2024-05-08T23:56:26.777 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.214+0000 7facff7fe700 1 --2- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7face803be80 0x7face803e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:26.777 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.215+0000 7facff7fe700 1 --2- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7face803be80 0x7face803e270 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7facf4006fd0 tx=0x7facf4006dc0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:26.777 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.215+0000 7facfd7fa700 1 -- 172.21.15.81:0/4166299806 <== mgr.14120 v2:172.21.15.81:6800/4280496150 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7fad0010a9a0 con 0x7face803be80 2024-05-08T23:56:26.777 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.222+0000 7fad06677700 1 -- 172.21.15.81:0/4166299806 --> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fad0010ab10 con 0x7face803be80 2024-05-08T23:56:26.777 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.222+0000 7facfd7fa700 1 -- 172.21.15.81:0/4166299806 <== mgr.14120 v2:172.21.15.81:6800/4280496150 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fad0010ab10 con 0x7face803be80 2024-05-08T23:56:26.777 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.222+0000 7fad06677700 1 -- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7face803be80 msgr2=0x7face803e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:26.777 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.222+0000 7fad06677700 1 --2- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7face803be80 0x7face803e270 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7facf4006fd0 tx=0x7facf4006dc0 comp rx=0 tx=0).stop 2024-05-08T23:56:26.777 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.222+0000 7fad06677700 1 -- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad001072d0 msgr2=0x7fad0019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:26.778 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.222+0000 7fad06677700 1 --2- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad001072d0 0x7fad0019a510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7facf0009130 tx=0x7facf0011ad0 comp rx=0 tx=0).stop 2024-05-08T23:56:26.778 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.222+0000 7fad06677700 1 -- 172.21.15.81:0/4166299806 shutdown_connections 2024-05-08T23:56:26.778 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.222+0000 7fad06677700 1 --2- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7face803be80 0x7face803e270 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:26.778 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.222+0000 7fad06677700 1 --2- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad001072d0 0x7fad0019a510 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:26.778 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.222+0000 7fad06677700 1 --2- 172.21.15.81:0/4166299806 >> [v2:172.21.15.81:6800/2902845226,v1:172.21.15.81:6801/2902845226] conn(0x7face8038700 0x7face803abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:26.778 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.222+0000 7fad06677700 1 -- 172.21.15.81:0/4166299806 >> 172.21.15.81:0/4166299806 conn(0x7fad00100ca0 msgr2=0x7fad001017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:26.778 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.222+0000 7fad06677700 1 -- 172.21.15.81:0/4166299806 shutdown_connections 2024-05-08T23:56:26.778 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:26.222+0000 7fad06677700 1 -- 172.21.15.81:0/4166299806 wait complete. 2024-05-08T23:56:26.778 INFO:teuthology.orchestra.run.smithi081.stdout:mgr epoch 5 is available 2024-05-08T23:56:26.778 INFO:teuthology.orchestra.run.smithi081.stdout:Setting orchestrator backend to cephadm... 2024-05-08T23:56:27.603 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:27 smithi081 ceph-mon[42474]: [08/May/2024:23:56:25] ENGINE Bus STARTING 2024-05-08T23:56:27.603 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:27 smithi081 ceph-mon[42474]: [08/May/2024:23:56:26] ENGINE Serving on http://172.21.15.81:8765 2024-05-08T23:56:27.604 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:27 smithi081 ceph-mon[42474]: [08/May/2024:23:56:26] ENGINE Serving on https://172.21.15.81:7150 2024-05-08T23:56:27.604 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:27 smithi081 ceph-mon[42474]: [08/May/2024:23:56:26] ENGINE Bus STARTED 2024-05-08T23:56:27.604 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:27 smithi081 ceph-mon[42474]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-08T23:56:27.604 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:27 smithi081 ceph-mon[42474]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-08T23:56:27.664 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.104+0000 7f2139709700 1 Processor -- start 2024-05-08T23:56:27.664 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.104+0000 7f2139709700 1 -- start start 2024-05-08T23:56:27.664 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.104+0000 7f2139709700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2134106890 0x7f2134106cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:27.664 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.104+0000 7f2139709700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2134107280 con 0x7f2134106890 2024-05-08T23:56:27.664 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.104+0000 7f2132ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2134106890 0x7f2134106cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:27.664 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.104+0000 7f2132ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2134106890 0x7f2134106cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43236/0 (socket says 172.21.15.81:43236) 2024-05-08T23:56:27.664 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.104+0000 7f2132ffd700 1 -- 172.21.15.81:0/3035868910 learned_addr learned my addr 172.21.15.81:0/3035868910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:27.664 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.104+0000 7f2132ffd700 1 -- 172.21.15.81:0/3035868910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2134107a40 con 0x7f2134106890 2024-05-08T23:56:27.664 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.104+0000 7f2132ffd700 1 --2- 172.21.15.81:0/3035868910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2134106890 0x7f2134106cb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f21240098a0 tx=0x7f2124009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d975bb301c7614 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:27.664 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.105+0000 7f2131ffb700 1 -- 172.21.15.81:0/3035868910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2124004160 con 0x7f2134106890 2024-05-08T23:56:27.664 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.105+0000 7f2131ffb700 1 -- 172.21.15.81:0/3035868910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f21240042c0 con 0x7f2134106890 2024-05-08T23:56:27.664 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.105+0000 7f2131ffb700 1 -- 172.21.15.81:0/3035868910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2124011a00 con 0x7f2134106890 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.105+0000 7f2139709700 1 -- 172.21.15.81:0/3035868910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2134106890 msgr2=0x7f2134106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.105+0000 7f2139709700 1 --2- 172.21.15.81:0/3035868910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2134106890 0x7f2134106cb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f21240098a0 tx=0x7f2124009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.105+0000 7f2139709700 1 -- 172.21.15.81:0/3035868910 shutdown_connections 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.105+0000 7f2139709700 1 --2- 172.21.15.81:0/3035868910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2134106890 0x7f2134106cb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.105+0000 7f2139709700 1 -- 172.21.15.81:0/3035868910 >> 172.21.15.81:0/3035868910 conn(0x7f2134101e90 msgr2=0x7f21341042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.105+0000 7f2139709700 1 -- 172.21.15.81:0/3035868910 shutdown_connections 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.105+0000 7f2139709700 1 -- 172.21.15.81:0/3035868910 wait complete. 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.106+0000 7f2139709700 1 Processor -- start 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.106+0000 7f2139709700 1 -- start start 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.106+0000 7f2139709700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2134106890 0x7f213419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.106+0000 7f2139709700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213419aad0 con 0x7f2134106890 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.106+0000 7f2132ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2134106890 0x7f213419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.106+0000 7f2132ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2134106890 0x7f213419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43238/0 (socket says 172.21.15.81:43238) 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.106+0000 7f2132ffd700 1 -- 172.21.15.81:0/1273881029 learned_addr learned my addr 172.21.15.81:0/1273881029 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.107+0000 7f2132ffd700 1 -- 172.21.15.81:0/1273881029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2124009550 con 0x7f2134106890 2024-05-08T23:56:27.666 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.107+0000 7f2132ffd700 1 --2- 172.21.15.81:0/1273881029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2134106890 0x7f213419a590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2124009130 tx=0x7f2124011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:27.666 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.107+0000 7f211bfff700 1 -- 172.21.15.81:0/1273881029 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2124003ab0 con 0x7f2134106890 2024-05-08T23:56:27.666 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.107+0000 7f2139709700 1 -- 172.21.15.81:0/1273881029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213419acd0 con 0x7f2134106890 2024-05-08T23:56:27.666 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.107+0000 7f211bfff700 1 -- 172.21.15.81:0/1273881029 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2124003c10 con 0x7f2134106890 2024-05-08T23:56:27.666 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.107+0000 7f211bfff700 1 -- 172.21.15.81:0/1273881029 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21240247d0 con 0x7f2134106890 2024-05-08T23:56:27.666 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.107+0000 7f2139709700 1 -- 172.21.15.81:0/1273881029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213419b170 con 0x7f2134106890 2024-05-08T23:56:27.666 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.108+0000 7f211bfff700 1 -- 172.21.15.81:0/1273881029 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7f212402d3f0 con 0x7f2134106890 2024-05-08T23:56:27.666 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.108+0000 7f211bfff700 1 --2- 172.21.15.81:0/1273881029 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f211c0385d0 0x7f211c03aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:27.666 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.108+0000 7f2139709700 1 -- 172.21.15.81:0/1273881029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213410ac70 con 0x7f2134106890 2024-05-08T23:56:27.666 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.108+0000 7f211bfff700 1 -- 172.21.15.81:0/1273881029 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f212404c660 con 0x7f2134106890 2024-05-08T23:56:27.666 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.108+0000 7f21327fc700 1 --2- 172.21.15.81:0/1273881029 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f211c0385d0 0x7f211c03aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:27.666 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.108+0000 7f21327fc700 1 --2- 172.21.15.81:0/1273881029 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f211c0385d0 0x7f211c03aa90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2128006fd0 tx=0x7f2128006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:27.666 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.113+0000 7f211bfff700 1 -- 172.21.15.81:0/1273881029 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2124010560 con 0x7f2134106890 2024-05-08T23:56:27.667 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.268+0000 7f211bfff700 1 -- 172.21.15.81:0/1273881029 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f2124019460 con 0x7f2134106890 2024-05-08T23:56:27.667 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.321+0000 7f2139709700 1 -- 172.21.15.81:0/1273881029 --> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f2134103100 con 0x7f211c0385d0 2024-05-08T23:56:27.667 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.329+0000 7f211bfff700 1 -- 172.21.15.81:0/1273881029 <== mgr.14120 v2:172.21.15.81:6800/4280496150 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2134103100 con 0x7f211c0385d0 2024-05-08T23:56:27.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.331+0000 7f2139709700 1 -- 172.21.15.81:0/1273881029 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f211c0385d0 msgr2=0x7f211c03aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:27.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.331+0000 7f2139709700 1 --2- 172.21.15.81:0/1273881029 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f211c0385d0 0x7f211c03aa90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2128006fd0 tx=0x7f2128006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:27.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.331+0000 7f2139709700 1 -- 172.21.15.81:0/1273881029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2134106890 msgr2=0x7f213419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:27.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.331+0000 7f2139709700 1 --2- 172.21.15.81:0/1273881029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2134106890 0x7f213419a590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2124009130 tx=0x7f2124011ad0 comp rx=0 tx=0).stop 2024-05-08T23:56:27.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.331+0000 7f2139709700 1 -- 172.21.15.81:0/1273881029 shutdown_connections 2024-05-08T23:56:27.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.331+0000 7f2139709700 1 --2- 172.21.15.81:0/1273881029 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f211c0385d0 0x7f211c03aa90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:27.668 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.331+0000 7f2139709700 1 --2- 172.21.15.81:0/1273881029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2134106890 0x7f213419a590 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:27.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.331+0000 7f2139709700 1 -- 172.21.15.81:0/1273881029 >> 172.21.15.81:0/1273881029 conn(0x7f2134101e90 msgr2=0x7f21341029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:27.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.331+0000 7f2139709700 1 -- 172.21.15.81:0/1273881029 shutdown_connections 2024-05-08T23:56:27.669 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:27.331+0000 7f2139709700 1 -- 172.21.15.81:0/1273881029 wait complete. 2024-05-08T23:56:28.518 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:28 smithi081 ceph-mon[42474]: mgrmap e8: x(active, since 2s) 2024-05-08T23:56:28.518 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:28 smithi081 ceph-mon[42474]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:56:28.519 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:28 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' 2024-05-08T23:56:28.519 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:28 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:56:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-08T23:56:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.011+0000 7f1f7a1e3700 1 Processor -- start 2024-05-08T23:56:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.011+0000 7f1f7a1e3700 1 -- start start 2024-05-08T23:56:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.011+0000 7f1f7a1e3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f74104ea0 0x7f1f741052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.011+0000 7f1f7a1e3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74105800 con 0x7f1f74104ea0 2024-05-08T23:56:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.011+0000 7f1f737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f74104ea0 0x7f1f741052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:28.546 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.011+0000 7f1f737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f74104ea0 0x7f1f741052c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45876/0 (socket says 172.21.15.81:45876) 2024-05-08T23:56:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.011+0000 7f1f737fe700 1 -- 172.21.15.81:0/3711049892 learned_addr learned my addr 172.21.15.81:0/3711049892 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.011+0000 7f1f737fe700 1 -- 172.21.15.81:0/3711049892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f74105940 con 0x7f1f74104ea0 2024-05-08T23:56:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.012+0000 7f1f737fe700 1 --2- 172.21.15.81:0/3711049892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f74104ea0 0x7f1f741052c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400bb40 tx=0x7f1f6400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7734f7b891b09f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.012+0000 7f1f727fc700 1 -- 172.21.15.81:0/3711049892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f6400dad0 con 0x7f1f74104ea0 2024-05-08T23:56:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.012+0000 7f1f727fc700 1 -- 172.21.15.81:0/3711049892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1f640044d0 con 0x7f1f74104ea0 2024-05-08T23:56:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.012+0000 7f1f727fc700 1 -- 172.21.15.81:0/3711049892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f64003e40 con 0x7f1f74104ea0 2024-05-08T23:56:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.012+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/3711049892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f74104ea0 msgr2=0x7f1f741052c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.012+0000 7f1f7a1e3700 1 --2- 172.21.15.81:0/3711049892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f74104ea0 0x7f1f741052c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400bb40 tx=0x7f1f6400be50 comp rx=0 tx=0).stop 2024-05-08T23:56:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.012+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/3711049892 shutdown_connections 2024-05-08T23:56:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.012+0000 7f1f7a1e3700 1 --2- 172.21.15.81:0/3711049892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f74104ea0 0x7f1f741052c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.012+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/3711049892 >> 172.21.15.81:0/3711049892 conn(0x7f1f74100510 msgr2=0x7f1f74102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.012+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/3711049892 shutdown_connections 2024-05-08T23:56:28.547 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.012+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/3711049892 wait complete. 2024-05-08T23:56:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.013+0000 7f1f7a1e3700 1 Processor -- start 2024-05-08T23:56:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.013+0000 7f1f7a1e3700 1 -- start start 2024-05-08T23:56:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.013+0000 7f1f7a1e3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f74104ea0 0x7f1f7419c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.013+0000 7f1f7a1e3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7419cca0 con 0x7f1f74104ea0 2024-05-08T23:56:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.013+0000 7f1f737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f74104ea0 0x7f1f7419c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.013+0000 7f1f737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f74104ea0 0x7f1f7419c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45892/0 (socket says 172.21.15.81:45892) 2024-05-08T23:56:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.013+0000 7f1f737fe700 1 -- 172.21.15.81:0/2752345364 learned_addr learned my addr 172.21.15.81:0/2752345364 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.014+0000 7f1f737fe700 1 -- 172.21.15.81:0/2752345364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6400b7f0 con 0x7f1f74104ea0 2024-05-08T23:56:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.014+0000 7f1f737fe700 1 --2- 172.21.15.81:0/2752345364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f74104ea0 0x7f1f7419c760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400bfd0 tx=0x7f1f64003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.014+0000 7f1f70ff9700 1 -- 172.21.15.81:0/2752345364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f64023070 con 0x7f1f74104ea0 2024-05-08T23:56:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.014+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/2752345364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7419cea0 con 0x7f1f74104ea0 2024-05-08T23:56:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.014+0000 7f1f70ff9700 1 -- 172.21.15.81:0/2752345364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1f64017950 con 0x7f1f74104ea0 2024-05-08T23:56:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.014+0000 7f1f70ff9700 1 -- 172.21.15.81:0/2752345364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1f64009040 con 0x7f1f74104ea0 2024-05-08T23:56:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.014+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/2752345364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7419d340 con 0x7f1f74104ea0 2024-05-08T23:56:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.015+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/2752345364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f74192000 con 0x7f1f74104ea0 2024-05-08T23:56:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.015+0000 7f1f70ff9700 1 -- 172.21.15.81:0/2752345364 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f1f64015070 con 0x7f1f74104ea0 2024-05-08T23:56:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.015+0000 7f1f70ff9700 1 --2- 172.21.15.81:0/2752345364 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f1f5c0386e0 0x7f1f5c03aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.015+0000 7f1f70ff9700 1 -- 172.21.15.81:0/2752345364 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1f6404bcf0 con 0x7f1f74104ea0 2024-05-08T23:56:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.016+0000 7f1f72ffd700 1 --2- 172.21.15.81:0/2752345364 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f1f5c0386e0 0x7f1f5c03aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.016+0000 7f1f72ffd700 1 --2- 172.21.15.81:0/2752345364 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f1f5c0386e0 0x7f1f5c03aba0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1f68006fd0 tx=0x7f1f68006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.020+0000 7f1f70ff9700 1 -- 172.21.15.81:0/2752345364 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1f64050070 con 0x7f1f74104ea0 2024-05-08T23:56:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.213+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/2752345364 --> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f7402d050 con 0x7f1f5c0386e0 2024-05-08T23:56:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.214+0000 7f1f70ff9700 1 -- 172.21.15.81:0/2752345364 <== mgr.14120 v2:172.21.15.81:6800/4280496150 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f1f7402d050 con 0x7f1f5c0386e0 2024-05-08T23:56:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.216+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/2752345364 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f1f5c0386e0 msgr2=0x7f1f5c03aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.216+0000 7f1f7a1e3700 1 --2- 172.21.15.81:0/2752345364 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f1f5c0386e0 0x7f1f5c03aba0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1f68006fd0 tx=0x7f1f68006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.216+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/2752345364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f74104ea0 msgr2=0x7f1f7419c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.216+0000 7f1f7a1e3700 1 --2- 172.21.15.81:0/2752345364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f74104ea0 0x7f1f7419c760 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400bfd0 tx=0x7f1f64003f90 comp rx=0 tx=0).stop 2024-05-08T23:56:28.549 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.216+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/2752345364 shutdown_connections 2024-05-08T23:56:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.216+0000 7f1f7a1e3700 1 --2- 172.21.15.81:0/2752345364 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f1f5c0386e0 0x7f1f5c03aba0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.216+0000 7f1f7a1e3700 1 --2- 172.21.15.81:0/2752345364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f74104ea0 0x7f1f7419c760 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.216+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/2752345364 >> 172.21.15.81:0/2752345364 conn(0x7f1f74100510 msgr2=0x7f1f7418f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.216+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/2752345364 shutdown_connections 2024-05-08T23:56:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.216+0000 7f1f7a1e3700 1 -- 172.21.15.81:0/2752345364 wait complete. 2024-05-08T23:56:28.550 INFO:teuthology.orchestra.run.smithi081.stdout:Generating ssh key... 2024-05-08T23:56:29.518 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:29 smithi081 ceph-mon[42474]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:56:29.518 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:29 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' 2024-05-08T23:56:29.519 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:29 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' 2024-05-08T23:56:29.519 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: Generating public/private rsa key pair. 2024-05-08T23:56:29.519 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: Your identification has been saved in /tmp/tmpt1noy0wv/key. 2024-05-08T23:56:29.519 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: Your public key has been saved in /tmp/tmpt1noy0wv/key.pub. 2024-05-08T23:56:29.519 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: The key fingerprint is: 2024-05-08T23:56:29.519 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: SHA256:HH44jo/0CEd12q7242jAOmrYqKsKtZfmo+Dyc06P5H4 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:56:29.519 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: The key's randomart image is: 2024-05-08T23:56:29.519 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: +---[RSA 3072]----+ 2024-05-08T23:56:29.519 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: | | 2024-05-08T23:56:29.519 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: | | 2024-05-08T23:56:29.519 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: | o . | 2024-05-08T23:56:29.519 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: | + * | 2024-05-08T23:56:29.520 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: | . .. S o | 2024-05-08T23:56:29.520 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: | . . ooo + | 2024-05-08T23:56:29.520 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: |o+. B.+.. . | 2024-05-08T23:56:29.520 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: |*.+B=*E=oo. | 2024-05-08T23:56:29.520 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: |X=+B*++o=oo. | 2024-05-08T23:56:29.520 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: +----[SHA256]-----+ 2024-05-08T23:56:29.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.884+0000 7f140fcb5700 1 Processor -- start 2024-05-08T23:56:29.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.884+0000 7f140fcb5700 1 -- start start 2024-05-08T23:56:29.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.884+0000 7f140fcb5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408106dc0 0x7f14081071e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:29.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.884+0000 7f140fcb5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14081077f0 con 0x7f1408106dc0 2024-05-08T23:56:29.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.884+0000 7f140da51700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408106dc0 0x7f14081071e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:29.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.884+0000 7f140da51700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408106dc0 0x7f14081071e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45908/0 (socket says 172.21.15.81:45908) 2024-05-08T23:56:29.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.884+0000 7f140da51700 1 -- 172.21.15.81:0/745272671 learned_addr learned my addr 172.21.15.81:0/745272671 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:29.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.884+0000 7f140da51700 1 -- 172.21.15.81:0/745272671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1408107930 con 0x7f1408106dc0 2024-05-08T23:56:29.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.885+0000 7f140da51700 1 --2- 172.21.15.81:0/745272671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408106dc0 0x7f14081071e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f14040098a0 tx=0x7f1404009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee1744cebb0bf3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:29.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.885+0000 7f140ca4f700 1 -- 172.21.15.81:0/745272671 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1404004160 con 0x7f1408106dc0 2024-05-08T23:56:29.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.885+0000 7f140ca4f700 1 -- 172.21.15.81:0/745272671 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f14040042c0 con 0x7f1408106dc0 2024-05-08T23:56:29.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.885+0000 7f140ca4f700 1 -- 172.21.15.81:0/745272671 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1404011a00 con 0x7f1408106dc0 2024-05-08T23:56:29.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.885+0000 7f140fcb5700 1 -- 172.21.15.81:0/745272671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408106dc0 msgr2=0x7f14081071e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:29.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.885+0000 7f140fcb5700 1 --2- 172.21.15.81:0/745272671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408106dc0 0x7f14081071e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f14040098a0 tx=0x7f1404009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:29.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.885+0000 7f140fcb5700 1 -- 172.21.15.81:0/745272671 shutdown_connections 2024-05-08T23:56:29.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.885+0000 7f140fcb5700 1 --2- 172.21.15.81:0/745272671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408106dc0 0x7f14081071e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:29.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.885+0000 7f140fcb5700 1 -- 172.21.15.81:0/745272671 >> 172.21.15.81:0/745272671 conn(0x7f1408100480 msgr2=0x7f14081028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:29.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.885+0000 7f140fcb5700 1 -- 172.21.15.81:0/745272671 shutdown_connections 2024-05-08T23:56:29.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.885+0000 7f140fcb5700 1 -- 172.21.15.81:0/745272671 wait complete. 2024-05-08T23:56:29.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.886+0000 7f140fcb5700 1 Processor -- start 2024-05-08T23:56:29.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.886+0000 7f140fcb5700 1 -- start start 2024-05-08T23:56:29.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.886+0000 7f140fcb5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408106dc0 0x7f14081a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:29.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.886+0000 7f140fcb5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14081a1110 con 0x7f1408106dc0 2024-05-08T23:56:29.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.886+0000 7f140da51700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408106dc0 0x7f14081a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:29.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.886+0000 7f140da51700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408106dc0 0x7f14081a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45922/0 (socket says 172.21.15.81:45922) 2024-05-08T23:56:29.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.886+0000 7f140da51700 1 -- 172.21.15.81:0/4162902796 learned_addr learned my addr 172.21.15.81:0/4162902796 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:29.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.887+0000 7f140da51700 1 -- 172.21.15.81:0/4162902796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1404009550 con 0x7f1408106dc0 2024-05-08T23:56:29.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.887+0000 7f140da51700 1 --2- 172.21.15.81:0/4162902796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408106dc0 0x7f14081a0bd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1404011a20 tx=0x7f1404011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:29.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.887+0000 7f13feffd700 1 -- 172.21.15.81:0/4162902796 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1404003af0 con 0x7f1408106dc0 2024-05-08T23:56:29.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.887+0000 7f13feffd700 1 -- 172.21.15.81:0/4162902796 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1404003c50 con 0x7f1408106dc0 2024-05-08T23:56:29.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.887+0000 7f140fcb5700 1 -- 172.21.15.81:0/4162902796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14081a1310 con 0x7f1408106dc0 2024-05-08T23:56:29.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.887+0000 7f13feffd700 1 -- 172.21.15.81:0/4162902796 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1404019760 con 0x7f1408106dc0 2024-05-08T23:56:29.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.887+0000 7f140fcb5700 1 -- 172.21.15.81:0/4162902796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14081a17b0 con 0x7f1408106dc0 2024-05-08T23:56:29.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.888+0000 7f13feffd700 1 -- 172.21.15.81:0/4162902796 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f140401a430 con 0x7f1408106dc0 2024-05-08T23:56:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.888+0000 7f140fcb5700 1 -- 172.21.15.81:0/4162902796 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1408105590 con 0x7f1408106dc0 2024-05-08T23:56:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.888+0000 7f13feffd700 1 --2- 172.21.15.81:0/4162902796 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f13f4038700 0x7f13f403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.888+0000 7f13feffd700 1 -- 172.21.15.81:0/4162902796 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f140404c950 con 0x7f1408106dc0 2024-05-08T23:56:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.888+0000 7f140d250700 1 --2- 172.21.15.81:0/4162902796 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f13f4038700 0x7f13f403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.888+0000 7f140d250700 1 --2- 172.21.15.81:0/4162902796 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f13f4038700 0x7f13f403abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f13f8006fd0 tx=0x7f13f8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:28.893+0000 7f13feffd700 1 -- 172.21.15.81:0/4162902796 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f140402d9a0 con 0x7f1408106dc0 2024-05-08T23:56:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:29.083+0000 7f140fcb5700 1 -- 172.21.15.81:0/4162902796 --> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f140810b6e0 con 0x7f13f4038700 2024-05-08T23:56:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:29.236+0000 7f13feffd700 1 -- 172.21.15.81:0/4162902796 <== mgr.14120 v2:172.21.15.81:6800/4280496150 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f140810b6e0 con 0x7f13f4038700 2024-05-08T23:56:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:29.238+0000 7f140fcb5700 1 -- 172.21.15.81:0/4162902796 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f13f4038700 msgr2=0x7f13f403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:29.238+0000 7f140fcb5700 1 --2- 172.21.15.81:0/4162902796 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f13f4038700 0x7f13f403abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f13f8006fd0 tx=0x7f13f8006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:29.238+0000 7f140fcb5700 1 -- 172.21.15.81:0/4162902796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408106dc0 msgr2=0x7f14081a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:29.238+0000 7f140fcb5700 1 --2- 172.21.15.81:0/4162902796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408106dc0 0x7f14081a0bd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1404011a20 tx=0x7f1404011b00 comp rx=0 tx=0).stop 2024-05-08T23:56:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:29.238+0000 7f140fcb5700 1 -- 172.21.15.81:0/4162902796 shutdown_connections 2024-05-08T23:56:29.633 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:29.238+0000 7f140fcb5700 1 --2- 172.21.15.81:0/4162902796 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f13f4038700 0x7f13f403abc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:29.634 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:29.238+0000 7f140fcb5700 1 --2- 172.21.15.81:0/4162902796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1408106dc0 0x7f14081a0bd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:29.634 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:29.238+0000 7f140fcb5700 1 -- 172.21.15.81:0/4162902796 >> 172.21.15.81:0/4162902796 conn(0x7f1408100480 msgr2=0x7f1408109fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:29.634 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:29.238+0000 7f140fcb5700 1 -- 172.21.15.81:0/4162902796 shutdown_connections 2024-05-08T23:56:29.634 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:29.238+0000 7f140fcb5700 1 -- 172.21.15.81:0/4162902796 wait complete. 2024-05-08T23:56:30.510 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:30 smithi081 ceph-mon[42474]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:56:30.511 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:30 smithi081 ceph-mon[42474]: Generating ssh key... 2024-05-08T23:56:30.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD8z5nbWWpoZwtwkf5im/CmFGTwhY7fFE05W8RZJNJKhcFx9mFJF2+2iJ65vr521OjqjcmzVKbXF5riDqxwt4l3kQT+EfU9WxjdaCJDqbjHaxsuyb+1Obg8N/kaYvPV5gr7kcwtwFQCoP+l9R212gEhN9FRqYUtzACsd6offZ6RfZ/0EO7gxHj1NsiyAK6l8DpVTNVqHm2+9BZv3IJpoUEe7Cn8pK+AetOj3k+5jYZLCpRSFTchGjE8zIOjeFzjNTJcAmZmce7fF/xyNbeUwYYwJSpEFQQ9BzQI995yN1OPeC9aIJZMXDcCM82K/R/d5Bam4Fkrmt3Iifc3ADm0EFCCSrv/tqUEPmWZi6tk0jMKewaKayqmEfL/bJbeWvPDzjEAxRV2C36qwiJVREi8gOWMrZKG3cvpjyz1Q7QBHGA/7m1tQqSLiOS5wc9pla/uk0UQNSHlbEuP/lrshAlBvxBWQzhhLKtr5GKeZsrNarNGOCwPVJ1eXUZgd9/msCAQq6s= ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:56:30.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.009+0000 7f2342c53700 1 Processor -- start 2024-05-08T23:56:30.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.009+0000 7f2342c53700 1 -- start start 2024-05-08T23:56:30.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.009+0000 7f2342c53700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c105c40 0x7f233c106060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:30.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.009+0000 7f2342c53700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c106630 con 0x7f233c105c40 2024-05-08T23:56:30.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.010+0000 7f23409ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c105c40 0x7f233c106060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:30.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.010+0000 7f23409ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c105c40 0x7f233c106060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45926/0 (socket says 172.21.15.81:45926) 2024-05-08T23:56:30.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.010+0000 7f23409ef700 1 -- 172.21.15.81:0/1079929738 learned_addr learned my addr 172.21.15.81:0/1079929738 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:30.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.010+0000 7f23409ef700 1 -- 172.21.15.81:0/1079929738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c106960 con 0x7f233c105c40 2024-05-08T23:56:30.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.010+0000 7f23409ef700 1 --2- 172.21.15.81:0/1079929738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c105c40 0x7f233c106060 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f23300098a0 tx=0x7f2330009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71de9acd5391a4f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:30.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.010+0000 7f233b7fe700 1 -- 172.21.15.81:0/1079929738 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2330004160 con 0x7f233c105c40 2024-05-08T23:56:30.571 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.010+0000 7f233b7fe700 1 -- 172.21.15.81:0/1079929738 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f23300042c0 con 0x7f233c105c40 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.010+0000 7f233b7fe700 1 -- 172.21.15.81:0/1079929738 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2330011a00 con 0x7f233c105c40 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.011+0000 7f2342c53700 1 -- 172.21.15.81:0/1079929738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c105c40 msgr2=0x7f233c106060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.011+0000 7f2342c53700 1 --2- 172.21.15.81:0/1079929738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c105c40 0x7f233c106060 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f23300098a0 tx=0x7f2330009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.011+0000 7f2342c53700 1 -- 172.21.15.81:0/1079929738 shutdown_connections 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.011+0000 7f2342c53700 1 --2- 172.21.15.81:0/1079929738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c105c40 0x7f233c106060 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.011+0000 7f2342c53700 1 -- 172.21.15.81:0/1079929738 >> 172.21.15.81:0/1079929738 conn(0x7f233c100480 msgr2=0x7f233c1028a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.011+0000 7f2342c53700 1 -- 172.21.15.81:0/1079929738 shutdown_connections 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.011+0000 7f2342c53700 1 -- 172.21.15.81:0/1079929738 wait complete. 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.011+0000 7f2342c53700 1 Processor -- start 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.011+0000 7f2342c53700 1 -- start start 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.012+0000 7f2342c53700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c105c40 0x7f233c19a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.012+0000 7f2342c53700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c19ab50 con 0x7f233c105c40 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.012+0000 7f23409ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c105c40 0x7f233c19a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.012+0000 7f23409ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c105c40 0x7f233c19a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45942/0 (socket says 172.21.15.81:45942) 2024-05-08T23:56:30.572 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.012+0000 7f23409ef700 1 -- 172.21.15.81:0/157699604 learned_addr learned my addr 172.21.15.81:0/157699604 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:30.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.012+0000 7f23409ef700 1 -- 172.21.15.81:0/157699604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2330009550 con 0x7f233c105c40 2024-05-08T23:56:30.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.012+0000 7f23409ef700 1 --2- 172.21.15.81:0/157699604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c105c40 0x7f233c19a610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2330011a20 tx=0x7f2330011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:30.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.012+0000 7f2339ffb700 1 -- 172.21.15.81:0/157699604 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2330003af0 con 0x7f233c105c40 2024-05-08T23:56:30.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.012+0000 7f2339ffb700 1 -- 172.21.15.81:0/157699604 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2330003c50 con 0x7f233c105c40 2024-05-08T23:56:30.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.012+0000 7f2342c53700 1 -- 172.21.15.81:0/157699604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233c19ad50 con 0x7f233c105c40 2024-05-08T23:56:30.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.012+0000 7f2339ffb700 1 -- 172.21.15.81:0/157699604 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2330019760 con 0x7f233c105c40 2024-05-08T23:56:30.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.012+0000 7f2342c53700 1 -- 172.21.15.81:0/157699604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c19b1f0 con 0x7f233c105c40 2024-05-08T23:56:30.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.013+0000 7f2339ffb700 1 -- 172.21.15.81:0/157699604 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f23300199a0 con 0x7f233c105c40 2024-05-08T23:56:30.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.013+0000 7f2342c53700 1 -- 172.21.15.81:0/157699604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c194710 con 0x7f233c105c40 2024-05-08T23:56:30.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.013+0000 7f2339ffb700 1 --2- 172.21.15.81:0/157699604 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f232c038700 0x7f232c03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:30.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.013+0000 7f2339ffb700 1 -- 172.21.15.81:0/157699604 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f233004ca50 con 0x7f233c105c40 2024-05-08T23:56:30.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.014+0000 7f233bfff700 1 --2- 172.21.15.81:0/157699604 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f232c038700 0x7f232c03abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:30.573 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.014+0000 7f233bfff700 1 --2- 172.21.15.81:0/157699604 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f232c038700 0x7f232c03abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2328006fd0 tx=0x7f2328006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.018+0000 7f2339ffb700 1 -- 172.21.15.81:0/157699604 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2330018db0 con 0x7f233c105c40 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.214+0000 7f2342c53700 1 -- 172.21.15.81:0/157699604 --> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f233c02cfa0 con 0x7f232c038700 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.215+0000 7f2339ffb700 1 -- 172.21.15.81:0/157699604 <== mgr.14120 v2:172.21.15.81:6800/4280496150 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f233c02cfa0 con 0x7f232c038700 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.217+0000 7f2342c53700 1 -- 172.21.15.81:0/157699604 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f232c038700 msgr2=0x7f232c03abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.217+0000 7f2342c53700 1 --2- 172.21.15.81:0/157699604 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f232c038700 0x7f232c03abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2328006fd0 tx=0x7f2328006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.217+0000 7f2342c53700 1 -- 172.21.15.81:0/157699604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c105c40 msgr2=0x7f233c19a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.217+0000 7f2342c53700 1 --2- 172.21.15.81:0/157699604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c105c40 0x7f233c19a610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2330011a20 tx=0x7f2330011b00 comp rx=0 tx=0).stop 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.217+0000 7f2342c53700 1 -- 172.21.15.81:0/157699604 shutdown_connections 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.217+0000 7f2342c53700 1 --2- 172.21.15.81:0/157699604 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f232c038700 0x7f232c03abc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.217+0000 7f2342c53700 1 --2- 172.21.15.81:0/157699604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233c105c40 0x7f233c19a610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.217+0000 7f2342c53700 1 -- 172.21.15.81:0/157699604 >> 172.21.15.81:0/157699604 conn(0x7f233c100480 msgr2=0x7f233c1013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.217+0000 7f2342c53700 1 -- 172.21.15.81:0/157699604 shutdown_connections 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.217+0000 7f2342c53700 1 -- 172.21.15.81:0/157699604 wait complete. 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-08T23:56:30.574 INFO:teuthology.orchestra.run.smithi081.stdout:Adding key to root@localhost authorized_keys... 2024-05-08T23:56:30.575 INFO:teuthology.orchestra.run.smithi081.stdout:Adding host smithi081... 2024-05-08T23:56:31.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:31 smithi081 ceph-mon[42474]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:56:32.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:32 smithi081 ceph-mon[42474]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi081", "addr": "172.21.15.81", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:56:33.576 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:33 smithi081 ceph-mon[42474]: Deploying cephadm binary to smithi081 2024-05-08T23:56:33.600 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Added host 'smithi081' with addr '172.21.15.81' 2024-05-08T23:56:33.601 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.880+0000 7fe5cbf2f700 1 Processor -- start 2024-05-08T23:56:33.601 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.880+0000 7fe5cbf2f700 1 -- start start 2024-05-08T23:56:33.601 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.880+0000 7fe5cbf2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c41050c0 0x7fe5c41054e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:33.601 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.880+0000 7fe5cbf2f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4079e70 con 0x7fe5c41050c0 2024-05-08T23:56:33.601 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.880+0000 7fe5c9ccb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c41050c0 0x7fe5c41054e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:33.601 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.880+0000 7fe5c9ccb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c41050c0 0x7fe5c41054e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45954/0 (socket says 172.21.15.81:45954) 2024-05-08T23:56:33.601 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.881+0000 7fe5c9ccb700 1 -- 172.21.15.81:0/1788273590 learned_addr learned my addr 172.21.15.81:0/1788273590 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:33.601 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.881+0000 7fe5c9ccb700 1 -- 172.21.15.81:0/1788273590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c4105a20 con 0x7fe5c41050c0 2024-05-08T23:56:33.601 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.881+0000 7fe5c9ccb700 1 --2- 172.21.15.81:0/1788273590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c41050c0 0x7fe5c41054e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe5b40098a0 tx=0x7fe5b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a992eba93335b88 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:33.601 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.881+0000 7fe5c8cc9700 1 -- 172.21.15.81:0/1788273590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5b4004160 con 0x7fe5c41050c0 2024-05-08T23:56:33.601 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.881+0000 7fe5c8cc9700 1 -- 172.21.15.81:0/1788273590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe5b40042c0 con 0x7fe5c41050c0 2024-05-08T23:56:33.601 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.881+0000 7fe5c8cc9700 1 -- 172.21.15.81:0/1788273590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5b4011a00 con 0x7fe5c41050c0 2024-05-08T23:56:33.601 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.882+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/1788273590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c41050c0 msgr2=0x7fe5c41054e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:33.602 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.882+0000 7fe5cbf2f700 1 --2- 172.21.15.81:0/1788273590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c41050c0 0x7fe5c41054e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe5b40098a0 tx=0x7fe5b4009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:33.602 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.882+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/1788273590 shutdown_connections 2024-05-08T23:56:33.602 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.882+0000 7fe5cbf2f700 1 --2- 172.21.15.81:0/1788273590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c41050c0 0x7fe5c41054e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:33.602 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.882+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/1788273590 >> 172.21.15.81:0/1788273590 conn(0x7fe5c4100d00 msgr2=0x7fe5c4103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:33.602 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.882+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/1788273590 shutdown_connections 2024-05-08T23:56:33.602 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.882+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/1788273590 wait complete. 2024-05-08T23:56:33.602 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.882+0000 7fe5cbf2f700 1 Processor -- start 2024-05-08T23:56:33.602 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.882+0000 7fe5cbf2f700 1 -- start start 2024-05-08T23:56:33.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.882+0000 7fe5cbf2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c41050c0 0x7fe5c419c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:33.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.882+0000 7fe5cbf2f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c419cc70 con 0x7fe5c41050c0 2024-05-08T23:56:33.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.883+0000 7fe5c9ccb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c41050c0 0x7fe5c419c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:33.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.883+0000 7fe5c9ccb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c41050c0 0x7fe5c419c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45960/0 (socket says 172.21.15.81:45960) 2024-05-08T23:56:33.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.883+0000 7fe5c9ccb700 1 -- 172.21.15.81:0/3888532227 learned_addr learned my addr 172.21.15.81:0/3888532227 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:33.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.883+0000 7fe5c9ccb700 1 -- 172.21.15.81:0/3888532227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b4009550 con 0x7fe5c41050c0 2024-05-08T23:56:33.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.883+0000 7fe5c9ccb700 1 --2- 172.21.15.81:0/3888532227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c41050c0 0x7fe5c419c730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009130 tx=0x7fe5b4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:33.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.883+0000 7fe5baffd700 1 -- 172.21.15.81:0/3888532227 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5b4003b70 con 0x7fe5c41050c0 2024-05-08T23:56:33.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.883+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/3888532227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c419ce70 con 0x7fe5c41050c0 2024-05-08T23:56:33.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.883+0000 7fe5baffd700 1 -- 172.21.15.81:0/3888532227 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe5b4003cd0 con 0x7fe5c41050c0 2024-05-08T23:56:33.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.883+0000 7fe5baffd700 1 -- 172.21.15.81:0/3888532227 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe5b40197d0 con 0x7fe5c41050c0 2024-05-08T23:56:33.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.883+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/3888532227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c419d310 con 0x7fe5c41050c0 2024-05-08T23:56:33.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.884+0000 7fe5baffd700 1 -- 172.21.15.81:0/3888532227 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fe5b401abb0 con 0x7fe5c41050c0 2024-05-08T23:56:33.603 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.884+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/3888532227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c41963e0 con 0x7fe5c41050c0 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.884+0000 7fe5baffd700 1 --2- 172.21.15.81:0/3888532227 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fe5b0038700 0x7fe5b003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.884+0000 7fe5baffd700 1 -- 172.21.15.81:0/3888532227 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe5b404c930 con 0x7fe5c41050c0 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.884+0000 7fe5c94ca700 1 --2- 172.21.15.81:0/3888532227 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fe5b0038700 0x7fe5b003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.885+0000 7fe5c94ca700 1 --2- 172.21.15.81:0/3888532227 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fe5b0038700 0x7fe5b003abc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0006fd0 tx=0x7fe5c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:30.889+0000 7fe5baffd700 1 -- 172.21.15.81:0/3888532227 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe5b401a430 con 0x7fe5c41050c0 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:31.084+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/3888532227 --> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi081", "addr": "172.21.15.81", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5c402d010 con 0x7fe5b0038700 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.297+0000 7fe5baffd700 1 -- 172.21.15.81:0/3888532227 <== mgr.14120 v2:172.21.15.81:6800/4280496150 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fe5c402d010 con 0x7fe5b0038700 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.300+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/3888532227 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fe5b0038700 msgr2=0x7fe5b003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.300+0000 7fe5cbf2f700 1 --2- 172.21.15.81:0/3888532227 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fe5b0038700 0x7fe5b003abc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0006fd0 tx=0x7fe5c0006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.300+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/3888532227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c41050c0 msgr2=0x7fe5c419c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.300+0000 7fe5cbf2f700 1 --2- 172.21.15.81:0/3888532227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c41050c0 0x7fe5c419c730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009130 tx=0x7fe5b4011ad0 comp rx=0 tx=0).stop 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.300+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/3888532227 shutdown_connections 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.300+0000 7fe5cbf2f700 1 --2- 172.21.15.81:0/3888532227 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fe5b0038700 0x7fe5b003abc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.300+0000 7fe5cbf2f700 1 --2- 172.21.15.81:0/3888532227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5c41050c0 0x7fe5c419c730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:33.604 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.300+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/3888532227 >> 172.21.15.81:0/3888532227 conn(0x7fe5c4100d00 msgr2=0x7fe5c4193520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:33.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.300+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/3888532227 shutdown_connections 2024-05-08T23:56:33.605 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.300+0000 7fe5cbf2f700 1 -- 172.21.15.81:0/3888532227 wait complete. 2024-05-08T23:56:33.605 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying unmanaged mon service... 2024-05-08T23:56:34.531 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:34 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' 2024-05-08T23:56:34.531 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:34 smithi081 ceph-mon[42474]: Added host smithi081 2024-05-08T23:56:34.531 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:34 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:56:34.531 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:34 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' 2024-05-08T23:56:34.628 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-08T23:56:34.628 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.991+0000 7fb4c4878700 1 Processor -- start 2024-05-08T23:56:34.628 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.991+0000 7fb4c4878700 1 -- start start 2024-05-08T23:56:34.628 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.991+0000 7fb4c4878700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0105720 0x7fb4c0105b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:34.629 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.991+0000 7fb4c4878700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c0106110 con 0x7fb4c0105720 2024-05-08T23:56:34.629 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.992+0000 7fb4be59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0105720 0x7fb4c0105b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:34.629 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.992+0000 7fb4be59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0105720 0x7fb4c0105b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45966/0 (socket says 172.21.15.81:45966) 2024-05-08T23:56:34.629 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.992+0000 7fb4be59c700 1 -- 172.21.15.81:0/3898680586 learned_addr learned my addr 172.21.15.81:0/3898680586 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:34.629 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.992+0000 7fb4be59c700 1 -- 172.21.15.81:0/3898680586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c0106920 con 0x7fb4c0105720 2024-05-08T23:56:34.629 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.992+0000 7fb4be59c700 1 --2- 172.21.15.81:0/3898680586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0105720 0x7fb4c0105b40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00098a0 tx=0x7fb4b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5939f23071eb727 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:34.629 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.992+0000 7fb4bd59a700 1 -- 172.21.15.81:0/3898680586 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4b0004160 con 0x7fb4c0105720 2024-05-08T23:56:34.629 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.992+0000 7fb4bd59a700 1 -- 172.21.15.81:0/3898680586 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb4b00042c0 con 0x7fb4c0105720 2024-05-08T23:56:34.629 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.992+0000 7fb4bd59a700 1 -- 172.21.15.81:0/3898680586 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4b0011a00 con 0x7fb4c0105720 2024-05-08T23:56:34.629 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.993+0000 7fb4c4878700 1 -- 172.21.15.81:0/3898680586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0105720 msgr2=0x7fb4c0105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:34.629 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.993+0000 7fb4c4878700 1 --2- 172.21.15.81:0/3898680586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0105720 0x7fb4c0105b40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00098a0 tx=0x7fb4b0009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:34.629 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.993+0000 7fb4c4878700 1 -- 172.21.15.81:0/3898680586 shutdown_connections 2024-05-08T23:56:34.629 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.993+0000 7fb4c4878700 1 --2- 172.21.15.81:0/3898680586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0105720 0x7fb4c0105b40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:34.629 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.993+0000 7fb4c4878700 1 -- 172.21.15.81:0/3898680586 >> 172.21.15.81:0/3898680586 conn(0x7fb4c0100ce0 msgr2=0x7fb4c0103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:34.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.993+0000 7fb4c4878700 1 -- 172.21.15.81:0/3898680586 shutdown_connections 2024-05-08T23:56:34.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.993+0000 7fb4c4878700 1 -- 172.21.15.81:0/3898680586 wait complete. 2024-05-08T23:56:34.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.994+0000 7fb4c4878700 1 Processor -- start 2024-05-08T23:56:34.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.994+0000 7fb4c4878700 1 -- start start 2024-05-08T23:56:34.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.994+0000 7fb4c4878700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0105720 0x7fb4c0079a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:34.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.994+0000 7fb4c4878700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c0079f80 con 0x7fb4c0105720 2024-05-08T23:56:34.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.994+0000 7fb4be59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0105720 0x7fb4c0079a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:34.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.994+0000 7fb4be59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0105720 0x7fb4c0079a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45980/0 (socket says 172.21.15.81:45980) 2024-05-08T23:56:34.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.994+0000 7fb4be59c700 1 -- 172.21.15.81:0/1063514246 learned_addr learned my addr 172.21.15.81:0/1063514246 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:34.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.995+0000 7fb4be59c700 1 -- 172.21.15.81:0/1063514246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b0009550 con 0x7fb4c0105720 2024-05-08T23:56:34.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.995+0000 7fb4be59c700 1 --2- 172.21.15.81:0/1063514246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0105720 0x7fb4c0079a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0009130 tx=0x7fb4b0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:34.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.995+0000 7fb4af7fe700 1 -- 172.21.15.81:0/1063514246 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4b0003ab0 con 0x7fb4c0105720 2024-05-08T23:56:34.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.995+0000 7fb4af7fe700 1 -- 172.21.15.81:0/1063514246 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb4b0003c10 con 0x7fb4c0105720 2024-05-08T23:56:34.630 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.995+0000 7fb4af7fe700 1 -- 172.21.15.81:0/1063514246 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb4b00247d0 con 0x7fb4c0105720 2024-05-08T23:56:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.995+0000 7fb4c4878700 1 -- 172.21.15.81:0/1063514246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c019d2c0 con 0x7fb4c0105720 2024-05-08T23:56:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.995+0000 7fb4c4878700 1 -- 172.21.15.81:0/1063514246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c019d760 con 0x7fb4c0105720 2024-05-08T23:56:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.996+0000 7fb4af7fe700 1 -- 172.21.15.81:0/1063514246 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fb4b002d3f0 con 0x7fb4c0105720 2024-05-08T23:56:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.996+0000 7fb4c4878700 1 -- 172.21.15.81:0/1063514246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4c0109b50 con 0x7fb4c0105720 2024-05-08T23:56:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.996+0000 7fb4af7fe700 1 --2- 172.21.15.81:0/1063514246 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fb4a8038700 0x7fb4a803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.996+0000 7fb4af7fe700 1 -- 172.21.15.81:0/1063514246 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb4b004c880 con 0x7fb4c0105720 2024-05-08T23:56:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.996+0000 7fb4bdd9b700 1 --2- 172.21.15.81:0/1063514246 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fb4a8038700 0x7fb4a803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:33.997+0000 7fb4bdd9b700 1 --2- 172.21.15.81:0/1063514246 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fb4a8038700 0x7fb4a803abc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4006fd0 tx=0x7fb4b4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.001+0000 7fb4af7fe700 1 -- 172.21.15.81:0/1063514246 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb4b0010740 con 0x7fb4c0105720 2024-05-08T23:56:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.214+0000 7fb4c4878700 1 -- 172.21.15.81:0/1063514246 --> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fb4c0101fc0 con 0x7fb4a8038700 2024-05-08T23:56:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.218+0000 7fb4af7fe700 1 -- 172.21.15.81:0/1063514246 <== mgr.14120 v2:172.21.15.81:6800/4280496150 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb4c0101fc0 con 0x7fb4a8038700 2024-05-08T23:56:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.222+0000 7fb4c4878700 1 -- 172.21.15.81:0/1063514246 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fb4a8038700 msgr2=0x7fb4a803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.222+0000 7fb4c4878700 1 --2- 172.21.15.81:0/1063514246 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fb4a8038700 0x7fb4a803abc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4006fd0 tx=0x7fb4b4006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:34.631 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.222+0000 7fb4c4878700 1 -- 172.21.15.81:0/1063514246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0105720 msgr2=0x7fb4c0079a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:34.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.222+0000 7fb4c4878700 1 --2- 172.21.15.81:0/1063514246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0105720 0x7fb4c0079a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb4b0009130 tx=0x7fb4b0011ad0 comp rx=0 tx=0).stop 2024-05-08T23:56:34.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.222+0000 7fb4c4878700 1 -- 172.21.15.81:0/1063514246 shutdown_connections 2024-05-08T23:56:34.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.222+0000 7fb4c4878700 1 --2- 172.21.15.81:0/1063514246 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fb4a8038700 0x7fb4a803abc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:34.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.222+0000 7fb4c4878700 1 --2- 172.21.15.81:0/1063514246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c0105720 0x7fb4c0079a40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:34.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.222+0000 7fb4c4878700 1 -- 172.21.15.81:0/1063514246 >> 172.21.15.81:0/1063514246 conn(0x7fb4c0100ce0 msgr2=0x7fb4c01018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:34.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.222+0000 7fb4c4878700 1 -- 172.21.15.81:0/1063514246 shutdown_connections 2024-05-08T23:56:34.632 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.222+0000 7fb4c4878700 1 -- 172.21.15.81:0/1063514246 wait complete. 2024-05-08T23:56:34.632 INFO:teuthology.orchestra.run.smithi081.stdout:Deploying unmanaged mgr service... 2024-05-08T23:56:35.539 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:35 smithi081 ceph-mon[42474]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:56:35.539 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:35 smithi081 ceph-mon[42474]: Saving service mon spec with placement count:5 2024-05-08T23:56:35.539 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:35 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' 2024-05-08T23:56:35.539 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:35 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' 2024-05-08T23:56:35.539 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:35 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' 2024-05-08T23:56:35.678 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-08T23:56:35.678 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.973+0000 7f0e9aebd700 1 Processor -- start 2024-05-08T23:56:35.678 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.973+0000 7f0e9aebd700 1 -- start start 2024-05-08T23:56:35.678 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.973+0000 7f0e9aebd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94105760 0x7f0e94105b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:35.678 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.973+0000 7f0e9aebd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e94106150 con 0x7f0e94105760 2024-05-08T23:56:35.679 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.973+0000 7f0e98c59700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94105760 0x7f0e94105b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:35.679 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.974+0000 7f0e98c59700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94105760 0x7f0e94105b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45992/0 (socket says 172.21.15.81:45992) 2024-05-08T23:56:35.679 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.974+0000 7f0e98c59700 1 -- 172.21.15.81:0/975873095 learned_addr learned my addr 172.21.15.81:0/975873095 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:35.679 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.974+0000 7f0e98c59700 1 -- 172.21.15.81:0/975873095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e94106960 con 0x7f0e94105760 2024-05-08T23:56:35.679 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.974+0000 7f0e98c59700 1 --2- 172.21.15.81:0/975873095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94105760 0x7f0e94105b80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800bb40 tx=0x7f0e8800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1313eaaeb5167f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:35.679 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.974+0000 7f0e937fe700 1 -- 172.21.15.81:0/975873095 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e8800dbe0 con 0x7f0e94105760 2024-05-08T23:56:35.679 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.974+0000 7f0e937fe700 1 -- 172.21.15.81:0/975873095 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e880044f0 con 0x7f0e94105760 2024-05-08T23:56:35.679 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.974+0000 7f0e937fe700 1 -- 172.21.15.81:0/975873095 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e88003e60 con 0x7f0e94105760 2024-05-08T23:56:35.679 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.975+0000 7f0e9aebd700 1 -- 172.21.15.81:0/975873095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94105760 msgr2=0x7f0e94105b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:35.679 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.975+0000 7f0e9aebd700 1 --2- 172.21.15.81:0/975873095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94105760 0x7f0e94105b80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800bb40 tx=0x7f0e8800be50 comp rx=0 tx=0).stop 2024-05-08T23:56:35.679 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.975+0000 7f0e9aebd700 1 -- 172.21.15.81:0/975873095 shutdown_connections 2024-05-08T23:56:35.679 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.975+0000 7f0e9aebd700 1 --2- 172.21.15.81:0/975873095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94105760 0x7f0e94105b80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:35.679 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.975+0000 7f0e9aebd700 1 -- 172.21.15.81:0/975873095 >> 172.21.15.81:0/975873095 conn(0x7f0e94100d40 msgr2=0x7f0e94103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:35.679 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.975+0000 7f0e9aebd700 1 -- 172.21.15.81:0/975873095 shutdown_connections 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.975+0000 7f0e9aebd700 1 -- 172.21.15.81:0/975873095 wait complete. 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.975+0000 7f0e9aebd700 1 Processor -- start 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.975+0000 7f0e9aebd700 1 -- start start 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.976+0000 7f0e9aebd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94105760 0x7f0e9419c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.976+0000 7f0e9aebd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9419cd70 con 0x7f0e94105760 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.976+0000 7f0e98c59700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94105760 0x7f0e9419c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.976+0000 7f0e98c59700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94105760 0x7f0e9419c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45994/0 (socket says 172.21.15.81:45994) 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.976+0000 7f0e98c59700 1 -- 172.21.15.81:0/3989441858 learned_addr learned my addr 172.21.15.81:0/3989441858 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.976+0000 7f0e98c59700 1 -- 172.21.15.81:0/3989441858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8800b7f0 con 0x7f0e94105760 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.976+0000 7f0e98c59700 1 --2- 172.21.15.81:0/3989441858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94105760 0x7f0e9419c830 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800b340 tx=0x7f0e88003fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.976+0000 7f0e91ffb700 1 -- 172.21.15.81:0/3989441858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e88010680 con 0x7f0e94105760 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.976+0000 7f0e91ffb700 1 -- 172.21.15.81:0/3989441858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e88010ca0 con 0x7f0e94105760 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.976+0000 7f0e9aebd700 1 -- 172.21.15.81:0/3989441858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9419cf70 con 0x7f0e94105760 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.976+0000 7f0e91ffb700 1 -- 172.21.15.81:0/3989441858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e88019c00 con 0x7f0e94105760 2024-05-08T23:56:35.680 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.977+0000 7f0e9aebd700 1 -- 172.21.15.81:0/3989441858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9419d3b0 con 0x7f0e94105760 2024-05-08T23:56:35.681 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.977+0000 7f0e91ffb700 1 -- 172.21.15.81:0/3989441858 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f0e8802a450 con 0x7f0e94105760 2024-05-08T23:56:35.681 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.977+0000 7f0e91ffb700 1 --2- 172.21.15.81:0/3989441858 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f0e84038700 0x7f0e8403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:35.681 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.978+0000 7f0e91ffb700 1 -- 172.21.15.81:0/3989441858 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f0e8804cb00 con 0x7f0e94105760 2024-05-08T23:56:35.681 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.978+0000 7f0e93fff700 1 --2- 172.21.15.81:0/3989441858 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f0e84038700 0x7f0e8403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:35.681 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.978+0000 7f0e9aebd700 1 -- 172.21.15.81:0/3989441858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e940625d0 con 0x7f0e94105760 2024-05-08T23:56:35.681 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.978+0000 7f0e93fff700 1 --2- 172.21.15.81:0/3989441858 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f0e84038700 0x7f0e8403abc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0e80006fd0 tx=0x7f0e80006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:35.681 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:34.983+0000 7f0e91ffb700 1 -- 172.21.15.81:0/3989441858 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0e8802a700 con 0x7f0e94105760 2024-05-08T23:56:35.681 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:35.222+0000 7f0e9aebd700 1 -- 172.21.15.81:0/3989441858 --> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f0e940613e0 con 0x7f0e84038700 2024-05-08T23:56:35.681 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:35.227+0000 7f0e91ffb700 1 -- 172.21.15.81:0/3989441858 <== mgr.14120 v2:172.21.15.81:6800/4280496150 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f0e940613e0 con 0x7f0e84038700 2024-05-08T23:56:35.681 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:35.229+0000 7f0e9aebd700 1 -- 172.21.15.81:0/3989441858 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f0e84038700 msgr2=0x7f0e8403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:35.681 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:35.229+0000 7f0e9aebd700 1 --2- 172.21.15.81:0/3989441858 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f0e84038700 0x7f0e8403abc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0e80006fd0 tx=0x7f0e80006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:35.681 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:35.229+0000 7f0e9aebd700 1 -- 172.21.15.81:0/3989441858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94105760 msgr2=0x7f0e9419c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:35.681 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:35.229+0000 7f0e9aebd700 1 --2- 172.21.15.81:0/3989441858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94105760 0x7f0e9419c830 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800b340 tx=0x7f0e88003fb0 comp rx=0 tx=0).stop 2024-05-08T23:56:35.681 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:35.229+0000 7f0e9aebd700 1 -- 172.21.15.81:0/3989441858 shutdown_connections 2024-05-08T23:56:35.682 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:35.229+0000 7f0e9aebd700 1 --2- 172.21.15.81:0/3989441858 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f0e84038700 0x7f0e8403abc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:35.682 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:35.229+0000 7f0e9aebd700 1 --2- 172.21.15.81:0/3989441858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e94105760 0x7f0e9419c830 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:35.682 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:35.229+0000 7f0e9aebd700 1 -- 172.21.15.81:0/3989441858 >> 172.21.15.81:0/3989441858 conn(0x7f0e94100d40 msgr2=0x7f0e94193050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:35.682 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:35.230+0000 7f0e9aebd700 1 -- 172.21.15.81:0/3989441858 shutdown_connections 2024-05-08T23:56:35.682 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:35.230+0000 7f0e9aebd700 1 -- 172.21.15.81:0/3989441858 wait complete. 2024-05-08T23:56:36.583 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.051+0000 7f15afeba700 1 Processor -- start 2024-05-08T23:56:36.583 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.051+0000 7f15afeba700 1 -- start start 2024-05-08T23:56:36.583 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.051+0000 7f15afeba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a8104b30 0x7f15a8104f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:36.583 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.051+0000 7f15afeba700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a8105520 con 0x7f15a8104b30 2024-05-08T23:56:36.583 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.052+0000 7f15adc56700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a8104b30 0x7f15a8104f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:36.583 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.052+0000 7f15adc56700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a8104b30 0x7f15a8104f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46000/0 (socket says 172.21.15.81:46000) 2024-05-08T23:56:36.583 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.052+0000 7f15adc56700 1 -- 172.21.15.81:0/2526035081 learned_addr learned my addr 172.21.15.81:0/2526035081 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:36.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.052+0000 7f15adc56700 1 -- 172.21.15.81:0/2526035081 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8105660 con 0x7f15a8104b30 2024-05-08T23:56:36.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.052+0000 7f15adc56700 1 --2- 172.21.15.81:0/2526035081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a8104b30 0x7f15a8104f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f15a40098a0 tx=0x7f15a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe28b6a74d4059c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:36.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.052+0000 7f15acc54700 1 -- 172.21.15.81:0/2526035081 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15a4004160 con 0x7f15a8104b30 2024-05-08T23:56:36.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.052+0000 7f15acc54700 1 -- 172.21.15.81:0/2526035081 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15a40042c0 con 0x7f15a8104b30 2024-05-08T23:56:36.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.052+0000 7f15acc54700 1 -- 172.21.15.81:0/2526035081 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15a40119b0 con 0x7f15a8104b30 2024-05-08T23:56:36.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.053+0000 7f15afeba700 1 -- 172.21.15.81:0/2526035081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a8104b30 msgr2=0x7f15a8104f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:36.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.053+0000 7f15afeba700 1 --2- 172.21.15.81:0/2526035081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a8104b30 0x7f15a8104f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f15a40098a0 tx=0x7f15a4009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:36.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.053+0000 7f15afeba700 1 -- 172.21.15.81:0/2526035081 shutdown_connections 2024-05-08T23:56:36.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.053+0000 7f15afeba700 1 --2- 172.21.15.81:0/2526035081 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a8104b30 0x7f15a8104f50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:36.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.053+0000 7f15afeba700 1 -- 172.21.15.81:0/2526035081 >> 172.21.15.81:0/2526035081 conn(0x7f15a8100510 msgr2=0x7f15a8102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:36.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.053+0000 7f15afeba700 1 -- 172.21.15.81:0/2526035081 shutdown_connections 2024-05-08T23:56:36.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.053+0000 7f15afeba700 1 -- 172.21.15.81:0/2526035081 wait complete. 2024-05-08T23:56:36.584 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.054+0000 7f15afeba700 1 Processor -- start 2024-05-08T23:56:36.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.054+0000 7f15afeba700 1 -- start start 2024-05-08T23:56:36.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.054+0000 7f15afeba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a8104b30 0x7f15a8107390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:36.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.054+0000 7f15afeba700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a81078d0 con 0x7f15a8104b30 2024-05-08T23:56:36.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.054+0000 7f15adc56700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a8104b30 0x7f15a8107390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:36.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.054+0000 7f15adc56700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a8104b30 0x7f15a8107390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46010/0 (socket says 172.21.15.81:46010) 2024-05-08T23:56:36.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.054+0000 7f15adc56700 1 -- 172.21.15.81:0/4125062735 learned_addr learned my addr 172.21.15.81:0/4125062735 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:36.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.054+0000 7f15adc56700 1 -- 172.21.15.81:0/4125062735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a4009550 con 0x7f15a8104b30 2024-05-08T23:56:36.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.055+0000 7f15adc56700 1 --2- 172.21.15.81:0/4125062735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a8104b30 0x7f15a8107390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f15a4006af0 tx=0x7f15a4011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:36.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.055+0000 7f159effd700 1 -- 172.21.15.81:0/4125062735 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15a4003a40 con 0x7f15a8104b30 2024-05-08T23:56:36.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.055+0000 7f15afeba700 1 -- 172.21.15.81:0/4125062735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a8105b60 con 0x7f15a8104b30 2024-05-08T23:56:36.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.055+0000 7f159effd700 1 -- 172.21.15.81:0/4125062735 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15a4003ba0 con 0x7f15a8104b30 2024-05-08T23:56:36.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.055+0000 7f159effd700 1 -- 172.21.15.81:0/4125062735 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15a4019690 con 0x7f15a8104b30 2024-05-08T23:56:36.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.055+0000 7f15afeba700 1 -- 172.21.15.81:0/4125062735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a8106000 con 0x7f15a8104b30 2024-05-08T23:56:36.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.056+0000 7f159effd700 1 -- 172.21.15.81:0/4125062735 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f15a4019950 con 0x7f15a8104b30 2024-05-08T23:56:36.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.056+0000 7f159effd700 1 --2- 172.21.15.81:0/4125062735 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f15940386b0 0x7f159403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:36.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.056+0000 7f15afeba700 1 -- 172.21.15.81:0/4125062735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a8068030 con 0x7f15a8104b30 2024-05-08T23:56:36.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.056+0000 7f159effd700 1 -- 172.21.15.81:0/4125062735 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f15a404c660 con 0x7f15a8104b30 2024-05-08T23:56:36.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.056+0000 7f15ad455700 1 --2- 172.21.15.81:0/4125062735 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f15940386b0 0x7f159403ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:36.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.056+0000 7f15ad455700 1 --2- 172.21.15.81:0/4125062735 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f15940386b0 0x7f159403ab70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1598006fd0 tx=0x7f1598006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:36.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.061+0000 7f159effd700 1 -- 172.21.15.81:0/4125062735 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f15a4018350 con 0x7f15a8104b30 2024-05-08T23:56:36.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.271+0000 7f15afeba700 1 -- 172.21.15.81:0/4125062735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f15a81064b0 con 0x7f15a8104b30 2024-05-08T23:56:36.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.277+0000 7f159effd700 1 -- 172.21.15.81:0/4125062735 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f15a4018580 con 0x7f15a8104b30 2024-05-08T23:56:36.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.280+0000 7f15afeba700 1 -- 172.21.15.81:0/4125062735 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f15940386b0 msgr2=0x7f159403ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:36.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.280+0000 7f15afeba700 1 --2- 172.21.15.81:0/4125062735 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f15940386b0 0x7f159403ab70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1598006fd0 tx=0x7f1598006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:36.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.280+0000 7f15afeba700 1 -- 172.21.15.81:0/4125062735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a8104b30 msgr2=0x7f15a8107390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:36.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.280+0000 7f15afeba700 1 --2- 172.21.15.81:0/4125062735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a8104b30 0x7f15a8107390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f15a4006af0 tx=0x7f15a4011a10 comp rx=0 tx=0).stop 2024-05-08T23:56:36.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.280+0000 7f15afeba700 1 -- 172.21.15.81:0/4125062735 shutdown_connections 2024-05-08T23:56:36.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.280+0000 7f15afeba700 1 --2- 172.21.15.81:0/4125062735 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f15940386b0 0x7f159403ab70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:36.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.280+0000 7f15afeba700 1 --2- 172.21.15.81:0/4125062735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15a8104b30 0x7f15a8107390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:36.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.280+0000 7f15afeba700 1 -- 172.21.15.81:0/4125062735 >> 172.21.15.81:0/4125062735 conn(0x7f15a8100510 msgr2=0x7f15a81010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:36.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.280+0000 7f15afeba700 1 -- 172.21.15.81:0/4125062735 shutdown_connections 2024-05-08T23:56:36.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:36.280+0000 7f15afeba700 1 -- 172.21.15.81:0/4125062735 wait complete. 2024-05-08T23:56:36.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:36 smithi081 ceph-mon[42474]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:56:36.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:36 smithi081 ceph-mon[42474]: Saving service mgr spec with placement count:2 2024-05-08T23:56:36.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:36 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' 2024-05-08T23:56:36.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:36 smithi081 ceph-mon[42474]: from='mgr.14120 172.21.15.81:0/1542348236' entity='mgr.x' 2024-05-08T23:56:36.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:36 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/4125062735' entity='client.admin' 2024-05-08T23:56:37.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.198+0000 7f841c545700 1 Processor -- start 2024-05-08T23:56:37.924 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.198+0000 7f841c545700 1 -- start start 2024-05-08T23:56:37.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.198+0000 7f841c545700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8414106890 0x7f8414106cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:37.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.198+0000 7f841c545700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8414107280 con 0x7f8414106890 2024-05-08T23:56:37.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.198+0000 7f841a2e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8414106890 0x7f8414106cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:37.926 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.199+0000 7f841a2e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8414106890 0x7f8414106cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46012/0 (socket says 172.21.15.81:46012) 2024-05-08T23:56:37.926 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.199+0000 7f841a2e1700 1 -- 172.21.15.81:0/4221583867 learned_addr learned my addr 172.21.15.81:0/4221583867 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:37.926 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.199+0000 7f841a2e1700 1 -- 172.21.15.81:0/4221583867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8414107a40 con 0x7f8414106890 2024-05-08T23:56:37.926 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.199+0000 7f841a2e1700 1 --2- 172.21.15.81:0/4221583867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8414106890 0x7f8414106cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f84100098a0 tx=0x7f8410009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485e6021b67a3f03 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:37.926 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.199+0000 7f84192df700 1 -- 172.21.15.81:0/4221583867 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8410004160 con 0x7f8414106890 2024-05-08T23:56:37.926 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.199+0000 7f84192df700 1 -- 172.21.15.81:0/4221583867 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84100042c0 con 0x7f8414106890 2024-05-08T23:56:37.926 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.199+0000 7f84192df700 1 -- 172.21.15.81:0/4221583867 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84100119b0 con 0x7f8414106890 2024-05-08T23:56:37.926 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.200+0000 7f841c545700 1 -- 172.21.15.81:0/4221583867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8414106890 msgr2=0x7f8414106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:37.926 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.200+0000 7f841c545700 1 --2- 172.21.15.81:0/4221583867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8414106890 0x7f8414106cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f84100098a0 tx=0x7f8410009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:37.926 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.200+0000 7f841c545700 1 -- 172.21.15.81:0/4221583867 shutdown_connections 2024-05-08T23:56:37.926 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.200+0000 7f841c545700 1 --2- 172.21.15.81:0/4221583867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8414106890 0x7f8414106cb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:37.927 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.200+0000 7f841c545700 1 -- 172.21.15.81:0/4221583867 >> 172.21.15.81:0/4221583867 conn(0x7f8414101e90 msgr2=0x7f84141042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:37.927 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.200+0000 7f841c545700 1 -- 172.21.15.81:0/4221583867 shutdown_connections 2024-05-08T23:56:37.927 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.200+0000 7f841c545700 1 -- 172.21.15.81:0/4221583867 wait complete. 2024-05-08T23:56:37.927 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.200+0000 7f841c545700 1 Processor -- start 2024-05-08T23:56:37.927 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.201+0000 7f841c545700 1 -- start start 2024-05-08T23:56:37.927 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.201+0000 7f841c545700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8414106890 0x7f841419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:37.927 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.201+0000 7f841c545700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841419ab20 con 0x7f8414106890 2024-05-08T23:56:37.927 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.201+0000 7f841a2e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8414106890 0x7f841419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:37.927 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.201+0000 7f841a2e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8414106890 0x7f841419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46016/0 (socket says 172.21.15.81:46016) 2024-05-08T23:56:37.927 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.201+0000 7f841a2e1700 1 -- 172.21.15.81:0/1998502902 learned_addr learned my addr 172.21.15.81:0/1998502902 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:37.927 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.201+0000 7f841a2e1700 1 -- 172.21.15.81:0/1998502902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8410009550 con 0x7f8414106890 2024-05-08T23:56:37.927 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.201+0000 7f841a2e1700 1 --2- 172.21.15.81:0/1998502902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8414106890 0x7f841419a5e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8410003e60 tx=0x7f8410011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:37.927 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.201+0000 7f840b7fe700 1 -- 172.21.15.81:0/1998502902 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f84100038b0 con 0x7f8414106890 2024-05-08T23:56:37.928 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.201+0000 7f840b7fe700 1 -- 172.21.15.81:0/1998502902 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8410003a10 con 0x7f8414106890 2024-05-08T23:56:37.928 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.201+0000 7f841c545700 1 -- 172.21.15.81:0/1998502902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841419ad20 con 0x7f8414106890 2024-05-08T23:56:37.928 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.201+0000 7f840b7fe700 1 -- 172.21.15.81:0/1998502902 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8410019530 con 0x7f8414106890 2024-05-08T23:56:37.928 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.202+0000 7f841c545700 1 -- 172.21.15.81:0/1998502902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841419b1c0 con 0x7f8414106890 2024-05-08T23:56:37.928 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.202+0000 7f840b7fe700 1 -- 172.21.15.81:0/1998502902 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f84100197a0 con 0x7f8414106890 2024-05-08T23:56:37.928 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.202+0000 7f840b7fe700 1 --2- 172.21.15.81:0/1998502902 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f8400038700 0x7f840003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:37.928 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.202+0000 7f840b7fe700 1 -- 172.21.15.81:0/1998502902 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f841004c730 con 0x7f8414106890 2024-05-08T23:56:37.928 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.203+0000 7f841c545700 1 -- 172.21.15.81:0/1998502902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841410ac70 con 0x7f8414106890 2024-05-08T23:56:37.928 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.203+0000 7f8419ae0700 1 --2- 172.21.15.81:0/1998502902 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f8400038700 0x7f840003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:37.928 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.203+0000 7f8419ae0700 1 --2- 172.21.15.81:0/1998502902 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f8400038700 0x7f840003abc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8404006fd0 tx=0x7f8404006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:37.928 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.207+0000 7f840b7fe700 1 -- 172.21.15.81:0/1998502902 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8410019aa0 con 0x7f8414106890 2024-05-08T23:56:37.929 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.418+0000 7f841c545700 1 -- 172.21.15.81:0/1998502902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f841410ae80 con 0x7f8414106890 2024-05-08T23:56:37.929 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.421+0000 7f840b7fe700 1 -- 172.21.15.81:0/1998502902 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f8410018b40 con 0x7f8414106890 2024-05-08T23:56:37.929 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.424+0000 7f841c545700 1 -- 172.21.15.81:0/1998502902 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f8400038700 msgr2=0x7f840003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:37.929 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.424+0000 7f841c545700 1 --2- 172.21.15.81:0/1998502902 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f8400038700 0x7f840003abc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8404006fd0 tx=0x7f8404006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:37.929 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.424+0000 7f841c545700 1 -- 172.21.15.81:0/1998502902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8414106890 msgr2=0x7f841419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:37.929 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.424+0000 7f841c545700 1 --2- 172.21.15.81:0/1998502902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8414106890 0x7f841419a5e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8410003e60 tx=0x7f8410011a30 comp rx=0 tx=0).stop 2024-05-08T23:56:37.929 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.424+0000 7f841c545700 1 -- 172.21.15.81:0/1998502902 shutdown_connections 2024-05-08T23:56:37.929 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.424+0000 7f841c545700 1 --2- 172.21.15.81:0/1998502902 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f8400038700 0x7f840003abc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:37.929 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.424+0000 7f841c545700 1 --2- 172.21.15.81:0/1998502902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8414106890 0x7f841419a5e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:37.929 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.424+0000 7f841c545700 1 -- 172.21.15.81:0/1998502902 >> 172.21.15.81:0/1998502902 conn(0x7f8414101e90 msgr2=0x7f8414102a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:37.929 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.424+0000 7f841c545700 1 -- 172.21.15.81:0/1998502902 shutdown_connections 2024-05-08T23:56:37.930 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:37.424+0000 7f841c545700 1 -- 172.21.15.81:0/1998502902 wait complete. 2024-05-08T23:56:37.930 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling the dashboard module... 2024-05-08T23:56:38.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:38 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1998502902' entity='client.admin' 2024-05-08T23:56:39.751 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:39 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3215098632' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-08T23:56:39.751 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:39 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: ignoring --setuser ceph since I am not root 2024-05-08T23:56:39.751 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:39 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: ignoring --setgroup ceph since I am not root 2024-05-08T23:56:39.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.262+0000 7fadf06a2700 1 Processor -- start 2024-05-08T23:56:39.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.262+0000 7fadf06a2700 1 -- start start 2024-05-08T23:56:39.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.262+0000 7fadf06a2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade8105700 0x7fade8105b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:39.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.262+0000 7fadf06a2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade81060f0 con 0x7fade8105700 2024-05-08T23:56:39.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.262+0000 7fadee43e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade8105700 0x7fade8105b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:39.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.262+0000 7fadee43e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade8105700 0x7fade8105b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53274/0 (socket says 172.21.15.81:53274) 2024-05-08T23:56:39.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.262+0000 7fadee43e700 1 -- 172.21.15.81:0/2296803838 learned_addr learned my addr 172.21.15.81:0/2296803838 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:39.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.263+0000 7fadee43e700 1 -- 172.21.15.81:0/2296803838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade8106900 con 0x7fade8105700 2024-05-08T23:56:39.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.263+0000 7fadee43e700 1 --2- 172.21.15.81:0/2296803838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade8105700 0x7fade8105b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fade40098a0 tx=0x7fade4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea45a8275d3524e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:39.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.263+0000 7faded43c700 1 -- 172.21.15.81:0/2296803838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fade4004160 con 0x7fade8105700 2024-05-08T23:56:39.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.263+0000 7faded43c700 1 -- 172.21.15.81:0/2296803838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fade40042c0 con 0x7fade8105700 2024-05-08T23:56:39.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.263+0000 7faded43c700 1 -- 172.21.15.81:0/2296803838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fade40119b0 con 0x7fade8105700 2024-05-08T23:56:39.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.263+0000 7fadf06a2700 1 -- 172.21.15.81:0/2296803838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade8105700 msgr2=0x7fade8105b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:39.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.263+0000 7fadf06a2700 1 --2- 172.21.15.81:0/2296803838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade8105700 0x7fade8105b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fade40098a0 tx=0x7fade4009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:39.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.264+0000 7fadf06a2700 1 -- 172.21.15.81:0/2296803838 shutdown_connections 2024-05-08T23:56:39.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.264+0000 7fadf06a2700 1 --2- 172.21.15.81:0/2296803838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade8105700 0x7fade8105b20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:39.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.264+0000 7fadf06a2700 1 -- 172.21.15.81:0/2296803838 >> 172.21.15.81:0/2296803838 conn(0x7fade8100d00 msgr2=0x7fade8103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:39.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.264+0000 7fadf06a2700 1 -- 172.21.15.81:0/2296803838 shutdown_connections 2024-05-08T23:56:39.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.264+0000 7fadf06a2700 1 -- 172.21.15.81:0/2296803838 wait complete. 2024-05-08T23:56:39.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.264+0000 7fadf06a2700 1 Processor -- start 2024-05-08T23:56:39.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.264+0000 7fadf06a2700 1 -- start start 2024-05-08T23:56:39.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.264+0000 7fadf06a2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade8105700 0x7fade819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:39.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.264+0000 7fadf06a2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade819ab20 con 0x7fade8105700 2024-05-08T23:56:39.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.264+0000 7fadee43e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade8105700 0x7fade819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:39.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.265+0000 7fadee43e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade8105700 0x7fade819a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53276/0 (socket says 172.21.15.81:53276) 2024-05-08T23:56:39.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.265+0000 7fadee43e700 1 -- 172.21.15.81:0/3215098632 learned_addr learned my addr 172.21.15.81:0/3215098632 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:39.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.265+0000 7fadee43e700 1 -- 172.21.15.81:0/3215098632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade4009550 con 0x7fade8105700 2024-05-08T23:56:39.766 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.265+0000 7fadee43e700 1 --2- 172.21.15.81:0/3215098632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade8105700 0x7fade819a5e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fade4003e60 tx=0x7fade4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:39.766 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.265+0000 7faddf7fe700 1 -- 172.21.15.81:0/3215098632 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fade4003a60 con 0x7fade8105700 2024-05-08T23:56:39.766 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.265+0000 7faddf7fe700 1 -- 172.21.15.81:0/3215098632 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fade4003bc0 con 0x7fade8105700 2024-05-08T23:56:39.766 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.265+0000 7fadf06a2700 1 -- 172.21.15.81:0/3215098632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade819ad20 con 0x7fade8105700 2024-05-08T23:56:39.766 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.265+0000 7faddf7fe700 1 -- 172.21.15.81:0/3215098632 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fade40196c0 con 0x7fade8105700 2024-05-08T23:56:39.766 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.265+0000 7fadf06a2700 1 -- 172.21.15.81:0/3215098632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade819b1c0 con 0x7fade8105700 2024-05-08T23:56:39.766 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.266+0000 7faddf7fe700 1 -- 172.21.15.81:0/3215098632 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fade4019930 con 0x7fade8105700 2024-05-08T23:56:39.766 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.266+0000 7fadf06a2700 1 -- 172.21.15.81:0/3215098632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade81947a0 con 0x7fade8105700 2024-05-08T23:56:39.766 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.266+0000 7faddf7fe700 1 --2- 172.21.15.81:0/3215098632 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fadd4038730 0x7fadd403abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:39.766 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.266+0000 7faddf7fe700 1 -- 172.21.15.81:0/3215098632 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fade404ca30 con 0x7fade8105700 2024-05-08T23:56:39.766 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.266+0000 7fadedc3d700 1 --2- 172.21.15.81:0/3215098632 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fadd4038730 0x7fadd403abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:39.767 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.267+0000 7fadedc3d700 1 --2- 172.21.15.81:0/3215098632 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fadd4038730 0x7fadd403abf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fadd8006fd0 tx=0x7fadd8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:39.767 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.271+0000 7faddf7fe700 1 -- 172.21.15.81:0/3215098632 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fade4010560 con 0x7fade8105700 2024-05-08T23:56:39.767 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:38.525+0000 7fadf06a2700 1 -- 172.21.15.81:0/3215098632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fade8109d00 con 0x7fade8105700 2024-05-08T23:56:39.767 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:39.428+0000 7faddf7fe700 1 -- 172.21.15.81:0/3215098632 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fade404cd50 con 0x7fade8105700 2024-05-08T23:56:39.767 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:39.429+0000 7faddf7fe700 1 -- 172.21.15.81:0/3215098632 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fade4019be0 con 0x7fade8105700 2024-05-08T23:56:39.767 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:39.432+0000 7fadf06a2700 1 -- 172.21.15.81:0/3215098632 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fadd4038730 msgr2=0x7fadd403abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:39.767 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:39.432+0000 7fadf06a2700 1 --2- 172.21.15.81:0/3215098632 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fadd4038730 0x7fadd403abf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fadd8006fd0 tx=0x7fadd8006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:39.767 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:39.432+0000 7fadf06a2700 1 -- 172.21.15.81:0/3215098632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade8105700 msgr2=0x7fade819a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:39.767 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:39.432+0000 7fadf06a2700 1 --2- 172.21.15.81:0/3215098632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade8105700 0x7fade819a5e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fade4003e60 tx=0x7fade4011a30 comp rx=0 tx=0).stop 2024-05-08T23:56:39.767 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:39.432+0000 7fadf06a2700 1 -- 172.21.15.81:0/3215098632 shutdown_connections 2024-05-08T23:56:39.767 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:39.432+0000 7fadf06a2700 1 --2- 172.21.15.81:0/3215098632 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7fadd4038730 0x7fadd403abf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:39.767 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:39.432+0000 7fadf06a2700 1 --2- 172.21.15.81:0/3215098632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fade8105700 0x7fade819a5e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:39.768 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:39.432+0000 7fadf06a2700 1 -- 172.21.15.81:0/3215098632 >> 172.21.15.81:0/3215098632 conn(0x7fade8100d00 msgr2=0x7fade8101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:39.768 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:39.432+0000 7fadf06a2700 1 -- 172.21.15.81:0/3215098632 shutdown_connections 2024-05-08T23:56:39.768 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:39.432+0000 7fadf06a2700 1 -- 172.21.15.81:0/3215098632 wait complete. 2024-05-08T23:56:40.072 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:39 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:39.890+0000 7fb63639f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T23:56:40.072 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:39 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:39.985+0000 7fb63639f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T23:56:40.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:40 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:40.076+0000 7fb63639f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T23:56:40.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:40 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:40.165+0000 7fb63639f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T23:56:40.676 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:40 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3215098632' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-08T23:56:40.676 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:40 smithi081 ceph-mon[42474]: mgrmap e9: x(active, since 14s) 2024-05-08T23:56:40.676 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:40 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/4220151661' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-08T23:56:40.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:56:40.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-08T23:56:40.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T23:56:40.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-08T23:56:40.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-08T23:56:40.760 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:56:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.112+0000 7f69e22d3700 1 Processor -- start 2024-05-08T23:56:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.112+0000 7f69e22d3700 1 -- start start 2024-05-08T23:56:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.112+0000 7f69e22d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69dc1072e0 0x7f69dc1096d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.112+0000 7f69e22d3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc079e90 con 0x7f69dc1072e0 2024-05-08T23:56:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.112+0000 7f69dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69dc1072e0 0x7f69dc1096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.112+0000 7f69dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69dc1072e0 0x7f69dc1096d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53296/0 (socket says 172.21.15.81:53296) 2024-05-08T23:56:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.112+0000 7f69dbfff700 1 -- 172.21.15.81:0/2892456349 learned_addr learned my addr 172.21.15.81:0/2892456349 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.113+0000 7f69dbfff700 1 -- 172.21.15.81:0/2892456349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc109c10 con 0x7f69dc1072e0 2024-05-08T23:56:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.113+0000 7f69dbfff700 1 --2- 172.21.15.81:0/2892456349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69dc1072e0 0x7f69dc1096d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0098a0 tx=0x7f69cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6959caa066a66834 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:40.761 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.113+0000 7f69daffd700 1 -- 172.21.15.81:0/2892456349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69cc004160 con 0x7f69dc1072e0 2024-05-08T23:56:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.113+0000 7f69daffd700 1 -- 172.21.15.81:0/2892456349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69cc0042c0 con 0x7f69dc1072e0 2024-05-08T23:56:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.113+0000 7f69daffd700 1 -- 172.21.15.81:0/2892456349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69cc0119b0 con 0x7f69dc1072e0 2024-05-08T23:56:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.114+0000 7f69e22d3700 1 -- 172.21.15.81:0/2892456349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69dc1072e0 msgr2=0x7f69dc1096d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.114+0000 7f69e22d3700 1 --2- 172.21.15.81:0/2892456349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69dc1072e0 0x7f69dc1096d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0098a0 tx=0x7f69cc009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.114+0000 7f69e22d3700 1 -- 172.21.15.81:0/2892456349 shutdown_connections 2024-05-08T23:56:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.114+0000 7f69e22d3700 1 --2- 172.21.15.81:0/2892456349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69dc1072e0 0x7f69dc1096d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.114+0000 7f69e22d3700 1 -- 172.21.15.81:0/2892456349 >> 172.21.15.81:0/2892456349 conn(0x7f69dc100cf0 msgr2=0x7f69dc103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.114+0000 7f69e22d3700 1 -- 172.21.15.81:0/2892456349 shutdown_connections 2024-05-08T23:56:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.114+0000 7f69e22d3700 1 -- 172.21.15.81:0/2892456349 wait complete. 2024-05-08T23:56:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.114+0000 7f69e22d3700 1 Processor -- start 2024-05-08T23:56:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.114+0000 7f69e22d3700 1 -- start start 2024-05-08T23:56:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.115+0000 7f69e22d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69dc1072e0 0x7f69dc19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.115+0000 7f69e22d3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc19aaf0 con 0x7f69dc1072e0 2024-05-08T23:56:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.115+0000 7f69dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69dc1072e0 0x7f69dc19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.115+0000 7f69dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69dc1072e0 0x7f69dc19a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53308/0 (socket says 172.21.15.81:53308) 2024-05-08T23:56:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.115+0000 7f69dbfff700 1 -- 172.21.15.81:0/4220151661 learned_addr learned my addr 172.21.15.81:0/4220151661 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.115+0000 7f69dbfff700 1 -- 172.21.15.81:0/4220151661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc009550 con 0x7f69dc1072e0 2024-05-08T23:56:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.115+0000 7f69dbfff700 1 --2- 172.21.15.81:0/4220151661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69dc1072e0 0x7f69dc19a5b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f69cc011980 tx=0x7f69cc011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.115+0000 7f69d97fa700 1 -- 172.21.15.81:0/4220151661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69cc003af0 con 0x7f69dc1072e0 2024-05-08T23:56:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.115+0000 7f69d97fa700 1 -- 172.21.15.81:0/4220151661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69cc003c50 con 0x7f69dc1072e0 2024-05-08T23:56:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.115+0000 7f69e22d3700 1 -- 172.21.15.81:0/4220151661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69dc19acf0 con 0x7f69dc1072e0 2024-05-08T23:56:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.115+0000 7f69d97fa700 1 -- 172.21.15.81:0/4220151661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69cc019760 con 0x7f69dc1072e0 2024-05-08T23:56:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.115+0000 7f69e22d3700 1 -- 172.21.15.81:0/4220151661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69dc19b190 con 0x7f69dc1072e0 2024-05-08T23:56:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.116+0000 7f69d97fa700 1 -- 172.21.15.81:0/4220151661 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f69cc019950 con 0x7f69dc1072e0 2024-05-08T23:56:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.116+0000 7f69d97fa700 1 --2- 172.21.15.81:0/4220151661 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f69c40387a0 0x7f69c403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.116+0000 7f69d97fa700 1 -- 172.21.15.81:0/4220151661 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f69cc04d8f0 con 0x7f69dc1072e0 2024-05-08T23:56:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.116+0000 7f69db7fe700 1 -- 172.21.15.81:0/4220151661 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f69c40387a0 msgr2=0x7f69c403ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4280496150 2024-05-08T23:56:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.116+0000 7f69db7fe700 1 --2- 172.21.15.81:0/4220151661 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f69c40387a0 0x7f69c403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:56:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.117+0000 7f69e22d3700 1 -- 172.21.15.81:0/4220151661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69dc068030 con 0x7f69dc1072e0 2024-05-08T23:56:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.121+0000 7f69d97fa700 1 -- 172.21.15.81:0/4220151661 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f69cc018db0 con 0x7f69dc1072e0 2024-05-08T23:56:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.317+0000 7f69db7fe700 1 -- 172.21.15.81:0/4220151661 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f69c40387a0 msgr2=0x7f69c403ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4280496150 2024-05-08T23:56:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.317+0000 7f69db7fe700 1 --2- 172.21.15.81:0/4220151661 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f69c40387a0 0x7f69c403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T23:56:40.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.377+0000 7f69e22d3700 1 -- 172.21.15.81:0/4220151661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f69dc19dbb0 con 0x7f69dc1072e0 2024-05-08T23:56:40.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.378+0000 7f69d97fa700 1 -- 172.21.15.81:0/4220151661 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f69cc018350 con 0x7f69dc1072e0 2024-05-08T23:56:40.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.381+0000 7f69e22d3700 1 -- 172.21.15.81:0/4220151661 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f69c40387a0 msgr2=0x7f69c403ac60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:56:40.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.381+0000 7f69e22d3700 1 --2- 172.21.15.81:0/4220151661 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f69c40387a0 0x7f69c403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:40.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.381+0000 7f69e22d3700 1 -- 172.21.15.81:0/4220151661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69dc1072e0 msgr2=0x7f69dc19a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:40.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.381+0000 7f69e22d3700 1 --2- 172.21.15.81:0/4220151661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69dc1072e0 0x7f69dc19a5b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f69cc011980 tx=0x7f69cc011a60 comp rx=0 tx=0).stop 2024-05-08T23:56:40.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.381+0000 7f69e22d3700 1 -- 172.21.15.81:0/4220151661 shutdown_connections 2024-05-08T23:56:40.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.381+0000 7f69e22d3700 1 --2- 172.21.15.81:0/4220151661 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f69c40387a0 0x7f69c403ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:40.765 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.381+0000 7f69e22d3700 1 --2- 172.21.15.81:0/4220151661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69dc1072e0 0x7f69dc19a5b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:40.766 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.381+0000 7f69e22d3700 1 -- 172.21.15.81:0/4220151661 >> 172.21.15.81:0/4220151661 conn(0x7f69dc100cf0 msgr2=0x7f69dc1018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:40.766 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.381+0000 7f69e22d3700 1 -- 172.21.15.81:0/4220151661 shutdown_connections 2024-05-08T23:56:40.766 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:40.381+0000 7f69e22d3700 1 -- 172.21.15.81:0/4220151661 wait complete. 2024-05-08T23:56:40.766 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for the mgr to restart... 2024-05-08T23:56:40.766 INFO:teuthology.orchestra.run.smithi081.stdout:Waiting for mgr epoch 9... 2024-05-08T23:56:41.079 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:40 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:40.815+0000 7fb63639f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:56:41.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:41 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:41.083+0000 7fb63639f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T23:56:41.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:41 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:41.172+0000 7fb63639f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T23:56:41.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:41 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:41.283+0000 7fb63639f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T23:56:41.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:41 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:41.440+0000 7fb63639f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T23:56:41.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:41 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:41.567+0000 7fb63639f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T23:56:41.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:41 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:41.652+0000 7fb63639f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T23:56:42.370 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:42 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:42.019+0000 7fb63639f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T23:56:42.692 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:42 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:42.408+0000 7fb63639f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T23:56:42.692 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:42 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:42.604+0000 7fb63639f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T23:56:43.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:42 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:42.697+0000 7fb63639f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T23:56:43.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:43 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:43.455+0000 7fb63639f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T23:56:43.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:43 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:43.553+0000 7fb63639f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T23:56:43.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:43 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:43.702+0000 7fb63639f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T23:56:44.620 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:44 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:44.324+0000 7fb63639f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T23:56:44.620 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:44 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:44.508+0000 7fb63639f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T23:56:45.120 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:44 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:44.705+0000 7fb63639f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T23:56:45.911 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:45 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:45.629+0000 7fb63639f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T23:56:46.190 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:45 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:45.917+0000 7fb63639f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:56:46.191 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:46 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:46.005+0000 7fb63639f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T23:56:46.620 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 08 23:56:46 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-08T23:56:46.196+0000 7fb63639f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T23:56:46.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:46 smithi081 ceph-mon[42474]: Active manager daemon x restarted 2024-05-08T23:56:46.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:46 smithi081 ceph-mon[42474]: Activating manager daemon x 2024-05-08T23:56:46.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:46 smithi081 ceph-mon[42474]: osdmap e3: 0 total, 0 up, 0 in 2024-05-08T23:56:46.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:46 smithi081 ceph-mon[42474]: mgrmap e10: x(active, starting, since 0.00313677s) 2024-05-08T23:56:46.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:56:46.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T23:56:46.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T23:56:46.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T23:56:46.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T23:56:46.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:46 smithi081 ceph-mon[42474]: Manager daemon x is now available 2024-05-08T23:56:46.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:56:47.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout { 2024-05-08T23:56:47.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-08T23:56:47.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-08T23:56:47.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout } 2024-05-08T23:56:47.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.086+0000 7f9efb488700 1 Processor -- start 2024-05-08T23:56:47.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.086+0000 7f9efb488700 1 -- start start 2024-05-08T23:56:47.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.087+0000 7f9efb488700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef4105100 0x7f9ef4105520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:47.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.087+0000 7f9efb488700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef4079e70 con 0x7f9ef4105100 2024-05-08T23:56:47.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.087+0000 7f9ef9224700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef4105100 0x7f9ef4105520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:47.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.087+0000 7f9ef9224700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef4105100 0x7f9ef4105520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53320/0 (socket says 172.21.15.81:53320) 2024-05-08T23:56:47.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.087+0000 7f9ef9224700 1 -- 172.21.15.81:0/4125930356 learned_addr learned my addr 172.21.15.81:0/4125930356 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:47.585 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.087+0000 7f9ef9224700 1 -- 172.21.15.81:0/4125930356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4105a60 con 0x7f9ef4105100 2024-05-08T23:56:47.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.087+0000 7f9ef9224700 1 --2- 172.21.15.81:0/4125930356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef4105100 0x7f9ef4105520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00098a0 tx=0x7f9ef0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c2d70adc5f326b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:47.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.087+0000 7f9eebfff700 1 -- 172.21.15.81:0/4125930356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ef0004160 con 0x7f9ef4105100 2024-05-08T23:56:47.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.087+0000 7f9eebfff700 1 -- 172.21.15.81:0/4125930356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ef00042c0 con 0x7f9ef4105100 2024-05-08T23:56:47.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.087+0000 7f9eebfff700 1 -- 172.21.15.81:0/4125930356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ef00119b0 con 0x7f9ef4105100 2024-05-08T23:56:47.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.088+0000 7f9efb488700 1 -- 172.21.15.81:0/4125930356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef4105100 msgr2=0x7f9ef4105520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:47.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.088+0000 7f9efb488700 1 --2- 172.21.15.81:0/4125930356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef4105100 0x7f9ef4105520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00098a0 tx=0x7f9ef0009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:47.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.088+0000 7f9efb488700 1 -- 172.21.15.81:0/4125930356 shutdown_connections 2024-05-08T23:56:47.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.088+0000 7f9efb488700 1 --2- 172.21.15.81:0/4125930356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef4105100 0x7f9ef4105520 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:47.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.088+0000 7f9efb488700 1 -- 172.21.15.81:0/4125930356 >> 172.21.15.81:0/4125930356 conn(0x7f9ef4100d20 msgr2=0x7f9ef4103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:47.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.088+0000 7f9efb488700 1 -- 172.21.15.81:0/4125930356 shutdown_connections 2024-05-08T23:56:47.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.088+0000 7f9efb488700 1 -- 172.21.15.81:0/4125930356 wait complete. 2024-05-08T23:56:47.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.089+0000 7f9efb488700 1 Processor -- start 2024-05-08T23:56:47.586 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.089+0000 7f9efb488700 1 -- start start 2024-05-08T23:56:47.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.089+0000 7f9efb488700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef4105100 0x7f9ef419c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:47.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.089+0000 7f9efb488700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef419cca0 con 0x7f9ef4105100 2024-05-08T23:56:47.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.089+0000 7f9ef9224700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef4105100 0x7f9ef419c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:47.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.089+0000 7f9ef9224700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef4105100 0x7f9ef419c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53328/0 (socket says 172.21.15.81:53328) 2024-05-08T23:56:47.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.089+0000 7f9ef9224700 1 -- 172.21.15.81:0/2002279997 learned_addr learned my addr 172.21.15.81:0/2002279997 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:47.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.089+0000 7f9ef9224700 1 -- 172.21.15.81:0/2002279997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef0009550 con 0x7f9ef4105100 2024-05-08T23:56:47.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.089+0000 7f9ef9224700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef4105100 0x7f9ef419c760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0011670 tx=0x7f9ef0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:47.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.090+0000 7f9eea7fc700 1 -- 172.21.15.81:0/2002279997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ef0003b20 con 0x7f9ef4105100 2024-05-08T23:56:47.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.090+0000 7f9efb488700 1 -- 172.21.15.81:0/2002279997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef419cea0 con 0x7f9ef4105100 2024-05-08T23:56:47.587 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.090+0000 7f9eea7fc700 1 -- 172.21.15.81:0/2002279997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ef0003c80 con 0x7f9ef4105100 2024-05-08T23:56:47.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.090+0000 7f9eea7fc700 1 -- 172.21.15.81:0/2002279997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ef0019770 con 0x7f9ef4105100 2024-05-08T23:56:47.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.090+0000 7f9efb488700 1 -- 172.21.15.81:0/2002279997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef419d340 con 0x7f9ef4105100 2024-05-08T23:56:47.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.091+0000 7f9eea7fc700 1 -- 172.21.15.81:0/2002279997 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f9ef001ab60 con 0x7f9ef4105100 2024-05-08T23:56:47.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.091+0000 7f9eea7fc700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f9ee0038750 0x7f9ee003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:47.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.091+0000 7f9eea7fc700 1 -- 172.21.15.81:0/2002279997 --> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ee003b320 con 0x7f9ee0038750 2024-05-08T23:56:47.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.091+0000 7f9eea7fc700 1 -- 172.21.15.81:0/2002279997 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9ef004ca10 con 0x7f9ef4105100 2024-05-08T23:56:47.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.091+0000 7f9ef8a23700 1 -- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f9ee0038750 msgr2=0x7f9ee003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4280496150 2024-05-08T23:56:47.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.091+0000 7f9ef8a23700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f9ee0038750 0x7f9ee003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:56:47.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.292+0000 7f9ef8a23700 1 -- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f9ee0038750 msgr2=0x7f9ee003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4280496150 2024-05-08T23:56:47.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.292+0000 7f9ef8a23700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f9ee0038750 0x7f9ee003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T23:56:47.588 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.693+0000 7f9ef8a23700 1 -- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f9ee0038750 msgr2=0x7f9ee003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4280496150 2024-05-08T23:56:47.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:41.693+0000 7f9ef8a23700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f9ee0038750 0x7f9ee003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T23:56:47.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:42.494+0000 7f9ef8a23700 1 -- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f9ee0038750 msgr2=0x7f9ee003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4280496150 2024-05-08T23:56:47.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:42.494+0000 7f9ef8a23700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f9ee0038750 0x7f9ee003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T23:56:47.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:44.095+0000 7f9ef8a23700 1 -- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f9ee0038750 msgr2=0x7f9ee003ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/4280496150 2024-05-08T23:56:47.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:44.095+0000 7f9ef8a23700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f9ee0038750 0x7f9ee003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-08T23:56:47.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:46.211+0000 7f9eea7fc700 1 -- 172.21.15.81:0/2002279997 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mgrmap(e 10) v1 ==== 45321+0+0 (secure 0 0 0) 0x7f9ef0019a30 con 0x7f9ef4105100 2024-05-08T23:56:47.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:46.211+0000 7f9eea7fc700 1 -- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f9ee0038750 msgr2=0x7f9ee003ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:56:47.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:46.211+0000 7f9eea7fc700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f9ee0038750 0x7f9ee003ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:47.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.214+0000 7f9eea7fc700 1 -- 172.21.15.81:0/2002279997 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7f9ef004e670 con 0x7f9ef4105100 2024-05-08T23:56:47.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.215+0000 7f9eea7fc700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9ee003bff0 0x7f9ee003e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:47.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.215+0000 7f9eea7fc700 1 -- 172.21.15.81:0/2002279997 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ee003b320 con 0x7f9ee003bff0 2024-05-08T23:56:47.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.215+0000 7f9ef8a23700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9ee003bff0 0x7f9ee003e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:47.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.216+0000 7f9ef8a23700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9ee003bff0 0x7f9ee003e3e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4003a10 tx=0x7f9ee40092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:47.589 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.216+0000 7f9eea7fc700 1 -- 172.21.15.81:0/2002279997 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f9ee003b320 con 0x7f9ee003bff0 2024-05-08T23:56:47.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.229+0000 7f9efb488700 1 -- 172.21.15.81:0/2002279997 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f9ef419d4d0 con 0x7f9ee003bff0 2024-05-08T23:56:47.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.229+0000 7f9eea7fc700 1 -- 172.21.15.81:0/2002279997 <== mgr.14152 v2:172.21.15.81:6800/1458411552 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f9ee400a050 con 0x7f9ee003bff0 2024-05-08T23:56:47.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.230+0000 7f9efb488700 1 -- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9ee003bff0 msgr2=0x7f9ee003e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:47.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.230+0000 7f9efb488700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9ee003bff0 0x7f9ee003e3e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4003a10 tx=0x7f9ee40092b0 comp rx=0 tx=0).stop 2024-05-08T23:56:47.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.230+0000 7f9efb488700 1 -- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef4105100 msgr2=0x7f9ef419c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:47.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.230+0000 7f9efb488700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef4105100 0x7f9ef419c760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0011670 tx=0x7f9ef0011a30 comp rx=0 tx=0).stop 2024-05-08T23:56:47.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.230+0000 7f9efb488700 1 -- 172.21.15.81:0/2002279997 shutdown_connections 2024-05-08T23:56:47.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.230+0000 7f9efb488700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ef4105100 0x7f9ef419c760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:47.590 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.230+0000 7f9efb488700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9ee003bff0 0x7f9ee003e3e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:47.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.230+0000 7f9efb488700 1 --2- 172.21.15.81:0/2002279997 >> [v2:172.21.15.81:6800/4280496150,v1:172.21.15.81:6801/4280496150] conn(0x7f9ee0038750 0x7f9ee003ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:47.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.230+0000 7f9efb488700 1 -- 172.21.15.81:0/2002279997 >> 172.21.15.81:0/2002279997 conn(0x7f9ef4100d20 msgr2=0x7f9ef41935b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:47.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.230+0000 7f9efb488700 1 -- 172.21.15.81:0/2002279997 shutdown_connections 2024-05-08T23:56:47.591 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.230+0000 7f9efb488700 1 -- 172.21.15.81:0/2002279997 wait complete. 2024-05-08T23:56:47.591 INFO:teuthology.orchestra.run.smithi081.stdout:mgr epoch 9 is available 2024-05-08T23:56:47.591 INFO:teuthology.orchestra.run.smithi081.stdout:Generating a dashboard self-signed certificate... 2024-05-08T23:56:47.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:47 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T23:56:47.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:47 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T23:56:47.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:47 smithi081 ceph-mon[42474]: [08/May/2024:23:56:46] ENGINE Bus STARTING 2024-05-08T23:56:47.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:47 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:56:47.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:47 smithi081 ceph-mon[42474]: mgrmap e11: x(active, since 1.00775s) 2024-05-08T23:56:48.567 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:48 smithi081 ceph-mon[42474]: [08/May/2024:23:56:46] ENGINE Serving on http://172.21.15.81:8765 2024-05-08T23:56:48.567 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:48 smithi081 ceph-mon[42474]: [08/May/2024:23:56:46] ENGINE Serving on https://172.21.15.81:7150 2024-05-08T23:56:48.567 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:48 smithi081 ceph-mon[42474]: [08/May/2024:23:56:46] ENGINE Bus STARTED 2024-05-08T23:56:48.567 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:48 smithi081 ceph-mon[42474]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-08T23:56:48.567 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:48 smithi081 ceph-mon[42474]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-08T23:56:48.567 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:48 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:56:48.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:48 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:56:48.568 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:48 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:56:48.703 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-08T23:56:48.703 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.930+0000 7fa2ad18b700 1 Processor -- start 2024-05-08T23:56:48.703 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.930+0000 7fa2ad18b700 1 -- start start 2024-05-08T23:56:48.703 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.931+0000 7fa2ad18b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2a81072e0 0x7fa2a81096d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:48.703 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.931+0000 7fa2ad18b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8079e90 con 0x7fa2a81072e0 2024-05-08T23:56:48.703 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.931+0000 7fa2a6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2a81072e0 0x7fa2a81096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:48.703 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.931+0000 7fa2a6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2a81072e0 0x7fa2a81096d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57516/0 (socket says 172.21.15.81:57516) 2024-05-08T23:56:48.703 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.931+0000 7fa2a6d9d700 1 -- 172.21.15.81:0/2768741180 learned_addr learned my addr 172.21.15.81:0/2768741180 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:48.703 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.931+0000 7fa2a6d9d700 1 -- 172.21.15.81:0/2768741180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a8109c10 con 0x7fa2a81072e0 2024-05-08T23:56:48.704 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.931+0000 7fa2a6d9d700 1 --2- 172.21.15.81:0/2768741180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2a81072e0 0x7fa2a81096d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0098a0 tx=0x7fa29c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30b8ff8ac0792c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:48.704 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.931+0000 7fa2a5d9b700 1 -- 172.21.15.81:0/2768741180 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa29c004160 con 0x7fa2a81072e0 2024-05-08T23:56:48.704 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.931+0000 7fa2a5d9b700 1 -- 172.21.15.81:0/2768741180 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa29c0042c0 con 0x7fa2a81072e0 2024-05-08T23:56:48.704 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.931+0000 7fa2a5d9b700 1 -- 172.21.15.81:0/2768741180 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa29c0119b0 con 0x7fa2a81072e0 2024-05-08T23:56:48.704 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.932+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2768741180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2a81072e0 msgr2=0x7fa2a81096d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:48.704 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.932+0000 7fa2ad18b700 1 --2- 172.21.15.81:0/2768741180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2a81072e0 0x7fa2a81096d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0098a0 tx=0x7fa29c009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:48.704 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.932+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2768741180 shutdown_connections 2024-05-08T23:56:48.704 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.932+0000 7fa2ad18b700 1 --2- 172.21.15.81:0/2768741180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2a81072e0 0x7fa2a81096d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:48.704 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.932+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2768741180 >> 172.21.15.81:0/2768741180 conn(0x7fa2a8100cf0 msgr2=0x7fa2a8103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:48.704 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.932+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2768741180 shutdown_connections 2024-05-08T23:56:48.704 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.932+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2768741180 wait complete. 2024-05-08T23:56:48.704 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.933+0000 7fa2ad18b700 1 Processor -- start 2024-05-08T23:56:48.704 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.933+0000 7fa2ad18b700 1 -- start start 2024-05-08T23:56:48.704 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.933+0000 7fa2ad18b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2a81072e0 0x7fa2a819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:48.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.933+0000 7fa2ad18b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a819aaf0 con 0x7fa2a81072e0 2024-05-08T23:56:48.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.933+0000 7fa2a6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2a81072e0 0x7fa2a819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:48.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.933+0000 7fa2a6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2a81072e0 0x7fa2a819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57528/0 (socket says 172.21.15.81:57528) 2024-05-08T23:56:48.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.933+0000 7fa2a6d9d700 1 -- 172.21.15.81:0/2264471374 learned_addr learned my addr 172.21.15.81:0/2264471374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:48.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.933+0000 7fa2a6d9d700 1 -- 172.21.15.81:0/2264471374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c009550 con 0x7fa2a81072e0 2024-05-08T23:56:48.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.934+0000 7fa2a6d9d700 1 --2- 172.21.15.81:0/2264471374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2a81072e0 0x7fa2a819a5b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa29c003e60 tx=0x7fa29c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:48.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.934+0000 7fa28ffff700 1 -- 172.21.15.81:0/2264471374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa29c0038b0 con 0x7fa2a81072e0 2024-05-08T23:56:48.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.934+0000 7fa28ffff700 1 -- 172.21.15.81:0/2264471374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa29c003a10 con 0x7fa2a81072e0 2024-05-08T23:56:48.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.934+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2264471374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a819acf0 con 0x7fa2a81072e0 2024-05-08T23:56:48.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.934+0000 7fa28ffff700 1 -- 172.21.15.81:0/2264471374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa29c019530 con 0x7fa2a81072e0 2024-05-08T23:56:48.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.934+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2264471374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a819b190 con 0x7fa2a81072e0 2024-05-08T23:56:48.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.935+0000 7fa28ffff700 1 -- 172.21.15.81:0/2264471374 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7fa29c0197a0 con 0x7fa2a81072e0 2024-05-08T23:56:48.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.935+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2264471374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a810a9f0 con 0x7fa2a81072e0 2024-05-08T23:56:48.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.935+0000 7fa28ffff700 1 --2- 172.21.15.81:0/2264471374 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa290038630 0x7fa29003aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:48.706 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.935+0000 7fa28ffff700 1 -- 172.21.15.81:0/2264471374 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa29c04c6f0 con 0x7fa2a81072e0 2024-05-08T23:56:48.706 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.935+0000 7fa2a659c700 1 --2- 172.21.15.81:0/2264471374 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa290038630 0x7fa29003aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:48.706 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.935+0000 7fa2a659c700 1 --2- 172.21.15.81:0/2264471374 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa290038630 0x7fa29003aaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa298006fd0 tx=0x7fa298006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:48.706 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:47.940+0000 7fa28ffff700 1 -- 172.21.15.81:0/2264471374 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa29c02b340 con 0x7fa2a81072e0 2024-05-08T23:56:48.706 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:48.145+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2264471374 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2a819da20 con 0x7fa290038630 2024-05-08T23:56:48.706 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:48.220+0000 7fa28ffff700 1 -- 172.21.15.81:0/2264471374 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fa2a819da20 con 0x7fa290038630 2024-05-08T23:56:48.706 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:48.222+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2264471374 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa290038630 msgr2=0x7fa29003aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:48.706 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:48.222+0000 7fa2ad18b700 1 --2- 172.21.15.81:0/2264471374 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa290038630 0x7fa29003aaf0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa298006fd0 tx=0x7fa298006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:48.706 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:48.222+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2264471374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2a81072e0 msgr2=0x7fa2a819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:48.706 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:48.222+0000 7fa2ad18b700 1 --2- 172.21.15.81:0/2264471374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2a81072e0 0x7fa2a819a5b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa29c003e60 tx=0x7fa29c011a30 comp rx=0 tx=0).stop 2024-05-08T23:56:48.706 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:48.223+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2264471374 shutdown_connections 2024-05-08T23:56:48.706 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:48.223+0000 7fa2ad18b700 1 --2- 172.21.15.81:0/2264471374 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa290038630 0x7fa29003aaf0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:48.706 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:48.223+0000 7fa2ad18b700 1 --2- 172.21.15.81:0/2264471374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2a81072e0 0x7fa2a819a5b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:48.707 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:48.223+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2264471374 >> 172.21.15.81:0/2264471374 conn(0x7fa2a8100cf0 msgr2=0x7fa2a81018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:48.707 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:48.223+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2264471374 shutdown_connections 2024-05-08T23:56:48.707 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:48.223+0000 7fa2ad18b700 1 -- 172.21.15.81:0/2264471374 wait complete. 2024-05-08T23:56:48.707 INFO:teuthology.orchestra.run.smithi081.stdout:Creating initial admin user... 2024-05-08T23:56:49.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:49 smithi081 ceph-mon[42474]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:56:49.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:49 smithi081 ceph-mon[42474]: mgrmap e12: x(active, since 3s) 2024-05-08T23:56:49.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$BsTHgrovCsQ1x1bYF9c7huXGFWtJancDuHxd/pBanPNU4tg5KcRli", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715212609, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-08T23:56:49.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.179+0000 7fddd3e50700 1 Processor -- start 2024-05-08T23:56:49.961 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.179+0000 7fddd3e50700 1 -- start start 2024-05-08T23:56:49.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.179+0000 7fddd3e50700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc107360 0x7fddcc109750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:49.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.179+0000 7fddd3e50700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc079e10 con 0x7fddcc107360 2024-05-08T23:56:49.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.180+0000 7fddd1bec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc107360 0x7fddcc109750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:49.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.180+0000 7fddd1bec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc107360 0x7fddcc109750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57534/0 (socket says 172.21.15.81:57534) 2024-05-08T23:56:49.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.180+0000 7fddd1bec700 1 -- 172.21.15.81:0/3916330409 learned_addr learned my addr 172.21.15.81:0/3916330409 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:49.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.180+0000 7fddd1bec700 1 -- 172.21.15.81:0/3916330409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc079f50 con 0x7fddcc107360 2024-05-08T23:56:49.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.180+0000 7fddd1bec700 1 --2- 172.21.15.81:0/3916330409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc107360 0x7fddcc109750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fddc80098a0 tx=0x7fddc8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2aec381149b02d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:49.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.180+0000 7fddd0bea700 1 -- 172.21.15.81:0/3916330409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddc8004160 con 0x7fddcc107360 2024-05-08T23:56:49.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.180+0000 7fddd0bea700 1 -- 172.21.15.81:0/3916330409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddc80042c0 con 0x7fddcc107360 2024-05-08T23:56:49.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.180+0000 7fddd0bea700 1 -- 172.21.15.81:0/3916330409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddc80119b0 con 0x7fddcc107360 2024-05-08T23:56:49.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.181+0000 7fddd3e50700 1 -- 172.21.15.81:0/3916330409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc107360 msgr2=0x7fddcc109750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:49.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.181+0000 7fddd3e50700 1 --2- 172.21.15.81:0/3916330409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc107360 0x7fddcc109750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fddc80098a0 tx=0x7fddc8009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:49.962 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.181+0000 7fddd3e50700 1 -- 172.21.15.81:0/3916330409 shutdown_connections 2024-05-08T23:56:49.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.181+0000 7fddd3e50700 1 --2- 172.21.15.81:0/3916330409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc107360 0x7fddcc109750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:49.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.181+0000 7fddd3e50700 1 -- 172.21.15.81:0/3916330409 >> 172.21.15.81:0/3916330409 conn(0x7fddcc100cf0 msgr2=0x7fddcc103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:49.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.181+0000 7fddd3e50700 1 -- 172.21.15.81:0/3916330409 shutdown_connections 2024-05-08T23:56:49.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.181+0000 7fddd3e50700 1 -- 172.21.15.81:0/3916330409 wait complete. 2024-05-08T23:56:49.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.182+0000 7fddd3e50700 1 Processor -- start 2024-05-08T23:56:49.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.182+0000 7fddd3e50700 1 -- start start 2024-05-08T23:56:49.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.182+0000 7fddd3e50700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc107360 0x7fddcc19a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:49.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.182+0000 7fddd3e50700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc19aae0 con 0x7fddcc107360 2024-05-08T23:56:49.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.182+0000 7fddd1bec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc107360 0x7fddcc19a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:49.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.182+0000 7fddd1bec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc107360 0x7fddcc19a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57536/0 (socket says 172.21.15.81:57536) 2024-05-08T23:56:49.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.182+0000 7fddd1bec700 1 -- 172.21.15.81:0/2679705882 learned_addr learned my addr 172.21.15.81:0/2679705882 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:49.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.182+0000 7fddd1bec700 1 -- 172.21.15.81:0/2679705882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc8009550 con 0x7fddcc107360 2024-05-08T23:56:49.963 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.182+0000 7fddd1bec700 1 --2- 172.21.15.81:0/2679705882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc107360 0x7fddcc19a5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fddc8011980 tx=0x7fddc8011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:49.964 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.183+0000 7fddc2ffd700 1 -- 172.21.15.81:0/2679705882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddc8003af0 con 0x7fddcc107360 2024-05-08T23:56:49.964 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.183+0000 7fddc2ffd700 1 -- 172.21.15.81:0/2679705882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddc8003c50 con 0x7fddcc107360 2024-05-08T23:56:49.964 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.183+0000 7fddc2ffd700 1 -- 172.21.15.81:0/2679705882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fddc8019760 con 0x7fddcc107360 2024-05-08T23:56:49.964 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.183+0000 7fddd3e50700 1 -- 172.21.15.81:0/2679705882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc19ace0 con 0x7fddcc107360 2024-05-08T23:56:49.964 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.183+0000 7fddd3e50700 1 -- 172.21.15.81:0/2679705882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc19b180 con 0x7fddcc107360 2024-05-08T23:56:49.964 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.183+0000 7fddc2ffd700 1 -- 172.21.15.81:0/2679705882 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7fddc8019950 con 0x7fddcc107360 2024-05-08T23:56:49.964 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.184+0000 7fddc2ffd700 1 --2- 172.21.15.81:0/2679705882 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fddb8038670 0x7fddb803ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:49.964 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.184+0000 7fddd3e50700 1 -- 172.21.15.81:0/2679705882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc10aa00 con 0x7fddcc107360 2024-05-08T23:56:49.964 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.184+0000 7fddc2ffd700 1 -- 172.21.15.81:0/2679705882 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fddc804c870 con 0x7fddcc107360 2024-05-08T23:56:49.964 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.184+0000 7fddd13eb700 1 --2- 172.21.15.81:0/2679705882 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fddb8038670 0x7fddb803ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:49.964 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.184+0000 7fddd13eb700 1 --2- 172.21.15.81:0/2679705882 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fddb8038670 0x7fddb803ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fddbc006fd0 tx=0x7fddbc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:49.964 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.189+0000 7fddc2ffd700 1 -- 172.21.15.81:0/2679705882 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fddc802d9a0 con 0x7fddcc107360 2024-05-08T23:56:49.964 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.212+0000 7fddc2ffd700 1 -- 172.21.15.81:0/2679705882 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fddc802bd00 con 0x7fddcc107360 2024-05-08T23:56:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.396+0000 7fddd3e50700 1 -- 172.21.15.81:0/2679705882 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fddcc0623f0 con 0x7fddb8038670 2024-05-08T23:56:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.613+0000 7fddc2ffd700 1 -- 172.21.15.81:0/2679705882 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fddcc0623f0 con 0x7fddb8038670 2024-05-08T23:56:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.615+0000 7fddd3e50700 1 -- 172.21.15.81:0/2679705882 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fddb8038670 msgr2=0x7fddb803ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.615+0000 7fddd3e50700 1 --2- 172.21.15.81:0/2679705882 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fddb8038670 0x7fddb803ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fddbc006fd0 tx=0x7fddbc006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.615+0000 7fddd3e50700 1 -- 172.21.15.81:0/2679705882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc107360 msgr2=0x7fddcc19a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.615+0000 7fddd3e50700 1 --2- 172.21.15.81:0/2679705882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc107360 0x7fddcc19a5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fddc8011980 tx=0x7fddc8011a60 comp rx=0 tx=0).stop 2024-05-08T23:56:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.615+0000 7fddd3e50700 1 -- 172.21.15.81:0/2679705882 shutdown_connections 2024-05-08T23:56:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.615+0000 7fddd3e50700 1 --2- 172.21.15.81:0/2679705882 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fddb8038670 0x7fddb803ab30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.615+0000 7fddd3e50700 1 --2- 172.21.15.81:0/2679705882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fddcc107360 0x7fddcc19a5a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.615+0000 7fddd3e50700 1 -- 172.21.15.81:0/2679705882 >> 172.21.15.81:0/2679705882 conn(0x7fddcc100cf0 msgr2=0x7fddcc1018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.615+0000 7fddd3e50700 1 -- 172.21.15.81:0/2679705882 shutdown_connections 2024-05-08T23:56:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:49.615+0000 7fddd3e50700 1 -- 172.21.15.81:0/2679705882 wait complete. 2024-05-08T23:56:49.965 INFO:teuthology.orchestra.run.smithi081.stdout:Fetching dashboard port number... 2024-05-08T23:56:50.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:50 smithi081 ceph-mon[42474]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:56:50.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:56:50.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stdout 8443 2024-05-08T23:56:50.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.268+0000 7f6acb1ee700 1 Processor -- start 2024-05-08T23:56:50.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.269+0000 7f6acb1ee700 1 -- start start 2024-05-08T23:56:50.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.269+0000 7f6acb1ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac4106d40 0x7f6ac4107160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:50.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.269+0000 7f6acb1ee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac4107730 con 0x7f6ac4106d40 2024-05-08T23:56:50.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.269+0000 7f6ac8f8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac4106d40 0x7f6ac4107160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:50.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.269+0000 7f6ac8f8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac4106d40 0x7f6ac4107160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57540/0 (socket says 172.21.15.81:57540) 2024-05-08T23:56:50.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.269+0000 7f6ac8f8a700 1 -- 172.21.15.81:0/784094340 learned_addr learned my addr 172.21.15.81:0/784094340 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:50.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.269+0000 7f6ac8f8a700 1 -- 172.21.15.81:0/784094340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac41059a0 con 0x7f6ac4106d40 2024-05-08T23:56:50.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.269+0000 7f6ac8f8a700 1 --2- 172.21.15.81:0/784094340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac4106d40 0x7f6ac4107160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80098a0 tx=0x7f6ab8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467fb81d3c235e4b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:50.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.270+0000 7f6ac37fe700 1 -- 172.21.15.81:0/784094340 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ab8004160 con 0x7f6ac4106d40 2024-05-08T23:56:50.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.270+0000 7f6ac37fe700 1 -- 172.21.15.81:0/784094340 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ab80042c0 con 0x7f6ac4106d40 2024-05-08T23:56:50.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.270+0000 7f6ac37fe700 1 -- 172.21.15.81:0/784094340 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ab80119b0 con 0x7f6ac4106d40 2024-05-08T23:56:50.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.271+0000 7f6acb1ee700 1 -- 172.21.15.81:0/784094340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac4106d40 msgr2=0x7f6ac4107160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:50.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.271+0000 7f6acb1ee700 1 --2- 172.21.15.81:0/784094340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac4106d40 0x7f6ac4107160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80098a0 tx=0x7f6ab8009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:50.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.271+0000 7f6acb1ee700 1 -- 172.21.15.81:0/784094340 shutdown_connections 2024-05-08T23:56:50.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.271+0000 7f6acb1ee700 1 --2- 172.21.15.81:0/784094340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac4106d40 0x7f6ac4107160 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:50.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.271+0000 7f6acb1ee700 1 -- 172.21.15.81:0/784094340 >> 172.21.15.81:0/784094340 conn(0x7f6ac41004f0 msgr2=0x7f6ac4102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:50.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.271+0000 7f6acb1ee700 1 -- 172.21.15.81:0/784094340 shutdown_connections 2024-05-08T23:56:50.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.271+0000 7f6acb1ee700 1 -- 172.21.15.81:0/784094340 wait complete. 2024-05-08T23:56:50.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.271+0000 7f6acb1ee700 1 Processor -- start 2024-05-08T23:56:50.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.271+0000 7f6acb1ee700 1 -- start start 2024-05-08T23:56:50.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.272+0000 7f6acb1ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac4106d40 0x7f6ac4190840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:50.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.272+0000 7f6acb1ee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac4190d80 con 0x7f6ac4106d40 2024-05-08T23:56:50.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.272+0000 7f6ac8f8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac4106d40 0x7f6ac4190840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:50.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.272+0000 7f6ac8f8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac4106d40 0x7f6ac4190840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57552/0 (socket says 172.21.15.81:57552) 2024-05-08T23:56:50.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.272+0000 7f6ac8f8a700 1 -- 172.21.15.81:0/156599016 learned_addr learned my addr 172.21.15.81:0/156599016 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:50.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.272+0000 7f6ac8f8a700 1 -- 172.21.15.81:0/156599016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8009550 con 0x7f6ac4106d40 2024-05-08T23:56:50.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.272+0000 7f6ac8f8a700 1 --2- 172.21.15.81:0/156599016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac4106d40 0x7f6ac4190840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8006af0 tx=0x7f6ab8011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:50.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.272+0000 7f6ac1ffb700 1 -- 172.21.15.81:0/156599016 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ab8003a40 con 0x7f6ac4106d40 2024-05-08T23:56:50.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.272+0000 7f6acb1ee700 1 -- 172.21.15.81:0/156599016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac418efc0 con 0x7f6ac4106d40 2024-05-08T23:56:50.822 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.272+0000 7f6ac1ffb700 1 -- 172.21.15.81:0/156599016 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ab8003ba0 con 0x7f6ac4106d40 2024-05-08T23:56:50.822 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.272+0000 7f6ac1ffb700 1 -- 172.21.15.81:0/156599016 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ab80196c0 con 0x7f6ac4106d40 2024-05-08T23:56:50.822 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.273+0000 7f6acb1ee700 1 -- 172.21.15.81:0/156599016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac418f460 con 0x7f6ac4106d40 2024-05-08T23:56:50.822 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.273+0000 7f6ac1ffb700 1 -- 172.21.15.81:0/156599016 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f6ab8019980 con 0x7f6ac4106d40 2024-05-08T23:56:50.822 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.273+0000 7f6ac1ffb700 1 --2- 172.21.15.81:0/156599016 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6ab4038700 0x7f6ab403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:50.822 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.273+0000 7f6acb1ee700 1 -- 172.21.15.81:0/156599016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac40625d0 con 0x7f6ac4106d40 2024-05-08T23:56:50.822 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.274+0000 7f6ac1ffb700 1 -- 172.21.15.81:0/156599016 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6ab804cb00 con 0x7f6ac4106d40 2024-05-08T23:56:50.822 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.274+0000 7f6ac3fff700 1 --2- 172.21.15.81:0/156599016 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6ab4038700 0x7f6ab403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:50.822 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.274+0000 7f6ac3fff700 1 --2- 172.21.15.81:0/156599016 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6ab4038700 0x7f6ab403abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0006fd0 tx=0x7f6ab0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:50.822 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.278+0000 7f6ac1ffb700 1 -- 172.21.15.81:0/156599016 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6ab80243f0 con 0x7f6ac4106d40 2024-05-08T23:56:50.822 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.471+0000 7f6acb1ee700 1 -- 172.21.15.81:0/156599016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f6ac4109be0 con 0x7f6ac4106d40 2024-05-08T23:56:50.823 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.472+0000 7f6ac1ffb700 1 -- 172.21.15.81:0/156599016 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f6ab8023390 con 0x7f6ac4106d40 2024-05-08T23:56:50.823 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.474+0000 7f6acb1ee700 1 -- 172.21.15.81:0/156599016 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6ab4038700 msgr2=0x7f6ab403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:50.823 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.474+0000 7f6acb1ee700 1 --2- 172.21.15.81:0/156599016 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6ab4038700 0x7f6ab403abc0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6ab0006fd0 tx=0x7f6ab0006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:50.823 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.474+0000 7f6acb1ee700 1 -- 172.21.15.81:0/156599016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac4106d40 msgr2=0x7f6ac4190840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:50.823 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.474+0000 7f6acb1ee700 1 --2- 172.21.15.81:0/156599016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac4106d40 0x7f6ac4190840 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8006af0 tx=0x7f6ab8011a10 comp rx=0 tx=0).stop 2024-05-08T23:56:50.823 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.474+0000 7f6acb1ee700 1 -- 172.21.15.81:0/156599016 shutdown_connections 2024-05-08T23:56:50.823 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.474+0000 7f6acb1ee700 1 --2- 172.21.15.81:0/156599016 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6ab4038700 0x7f6ab403abc0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:50.824 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.474+0000 7f6acb1ee700 1 --2- 172.21.15.81:0/156599016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ac4106d40 0x7f6ac4190840 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:50.824 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.474+0000 7f6acb1ee700 1 -- 172.21.15.81:0/156599016 >> 172.21.15.81:0/156599016 conn(0x7f6ac41004f0 msgr2=0x7f6ac4101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:50.824 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.474+0000 7f6acb1ee700 1 -- 172.21.15.81:0/156599016 shutdown_connections 2024-05-08T23:56:50.824 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:50.474+0000 7f6acb1ee700 1 -- 172.21.15.81:0/156599016 wait complete. 2024-05-08T23:56:50.825 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T23:56:50.825 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout disabled 2024-05-08T23:56:50.833 INFO:teuthology.orchestra.run.smithi081.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T23:56:50.833 INFO:teuthology.orchestra.run.smithi081.stdout:systemctl: stdout inactive 2024-05-08T23:56:50.833 INFO:teuthology.orchestra.run.smithi081.stdout:firewalld.service is not enabled 2024-05-08T23:56:50.833 INFO:teuthology.orchestra.run.smithi081.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-08T23:56:50.834 INFO:teuthology.orchestra.run.smithi081.stdout:Ceph Dashboard is now available at: 2024-05-08T23:56:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:56:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: URL: https://smithi081.front.sepia.ceph.com:8443/ 2024-05-08T23:56:50.834 INFO:teuthology.orchestra.run.smithi081.stdout: User: admin 2024-05-08T23:56:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: Password: ass7lk54ff 2024-05-08T23:56:50.835 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:56:50.836 INFO:teuthology.orchestra.run.smithi081.stdout:Saving cluster configuration to /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config directory 2024-05-08T23:56:50.836 INFO:teuthology.orchestra.run.smithi081.stdout:Enabling autotune for osd_memory_target 2024-05-08T23:56:51.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:51 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/156599016' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-08T23:56:51.817 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.203+0000 7fef9d644700 1 Processor -- start 2024-05-08T23:56:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.203+0000 7fef9d644700 1 -- start start 2024-05-08T23:56:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.204+0000 7fef9d644700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98106890 0x7fef98106cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.204+0000 7fef9d644700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef98107280 con 0x7fef98106890 2024-05-08T23:56:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.204+0000 7fef96ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98106890 0x7fef98106cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.204+0000 7fef96ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98106890 0x7fef98106cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57566/0 (socket says 172.21.15.81:57566) 2024-05-08T23:56:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.204+0000 7fef96ffd700 1 -- 172.21.15.81:0/3054339450 learned_addr learned my addr 172.21.15.81:0/3054339450 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.204+0000 7fef96ffd700 1 -- 172.21.15.81:0/3054339450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef98107a40 con 0x7fef98106890 2024-05-08T23:56:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.204+0000 7fef96ffd700 1 --2- 172.21.15.81:0/3054339450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98106890 0x7fef98106cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fef880098a0 tx=0x7fef88009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b1b2cab5db9273 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.204+0000 7fef95ffb700 1 -- 172.21.15.81:0/3054339450 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef88004160 con 0x7fef98106890 2024-05-08T23:56:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.204+0000 7fef95ffb700 1 -- 172.21.15.81:0/3054339450 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef880042c0 con 0x7fef98106890 2024-05-08T23:56:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.204+0000 7fef95ffb700 1 -- 172.21.15.81:0/3054339450 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef880119b0 con 0x7fef98106890 2024-05-08T23:56:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.205+0000 7fef9d644700 1 -- 172.21.15.81:0/3054339450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98106890 msgr2=0x7fef98106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.205+0000 7fef9d644700 1 --2- 172.21.15.81:0/3054339450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98106890 0x7fef98106cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fef880098a0 tx=0x7fef88009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.205+0000 7fef9d644700 1 -- 172.21.15.81:0/3054339450 shutdown_connections 2024-05-08T23:56:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.205+0000 7fef9d644700 1 --2- 172.21.15.81:0/3054339450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98106890 0x7fef98106cb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.205+0000 7fef9d644700 1 -- 172.21.15.81:0/3054339450 >> 172.21.15.81:0/3054339450 conn(0x7fef98101e90 msgr2=0x7fef981042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.205+0000 7fef9d644700 1 -- 172.21.15.81:0/3054339450 shutdown_connections 2024-05-08T23:56:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.205+0000 7fef9d644700 1 -- 172.21.15.81:0/3054339450 wait complete. 2024-05-08T23:56:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.206+0000 7fef9d644700 1 Processor -- start 2024-05-08T23:56:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.206+0000 7fef9d644700 1 -- start start 2024-05-08T23:56:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.206+0000 7fef9d644700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98106890 0x7fef9819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.206+0000 7fef9d644700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9819aaf0 con 0x7fef98106890 2024-05-08T23:56:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.206+0000 7fef96ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98106890 0x7fef9819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.206+0000 7fef96ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98106890 0x7fef9819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57578/0 (socket says 172.21.15.81:57578) 2024-05-08T23:56:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.206+0000 7fef96ffd700 1 -- 172.21.15.81:0/1453027480 learned_addr learned my addr 172.21.15.81:0/1453027480 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.206+0000 7fef96ffd700 1 -- 172.21.15.81:0/1453027480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef88009550 con 0x7fef98106890 2024-05-08T23:56:51.819 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.207+0000 7fef96ffd700 1 --2- 172.21.15.81:0/1453027480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98106890 0x7fef9819a5b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef88006af0 tx=0x7fef88011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.207+0000 7fef8ffff700 1 -- 172.21.15.81:0/1453027480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef88003a40 con 0x7fef98106890 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.207+0000 7fef8ffff700 1 -- 172.21.15.81:0/1453027480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef88003ba0 con 0x7fef98106890 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.207+0000 7fef9d644700 1 -- 172.21.15.81:0/1453027480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9819acf0 con 0x7fef98106890 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.207+0000 7fef8ffff700 1 -- 172.21.15.81:0/1453027480 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef88019690 con 0x7fef98106890 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.207+0000 7fef9d644700 1 -- 172.21.15.81:0/1453027480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef9819b190 con 0x7fef98106890 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.208+0000 7fef8ffff700 1 -- 172.21.15.81:0/1453027480 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fef88019950 con 0x7fef98106890 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.208+0000 7fef8ffff700 1 --2- 172.21.15.81:0/1453027480 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fef84038700 0x7fef8403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.208+0000 7fef9d644700 1 -- 172.21.15.81:0/1453027480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9810ac70 con 0x7fef98106890 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.208+0000 7fef8ffff700 1 -- 172.21.15.81:0/1453027480 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fef8804cc80 con 0x7fef98106890 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.208+0000 7fef967fc700 1 --2- 172.21.15.81:0/1453027480 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fef84038700 0x7fef8403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.208+0000 7fef967fc700 1 --2- 172.21.15.81:0/1453027480 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fef84038700 0x7fef8403abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fef80006fd0 tx=0x7fef80006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.213+0000 7fef8ffff700 1 -- 172.21.15.81:0/1453027480 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fef880243f0 con 0x7fef98106890 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.436+0000 7fef9d644700 1 -- 172.21.15.81:0/1453027480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fef9819d9d0 con 0x7fef98106890 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.436+0000 7fef8ffff700 1 -- 172.21.15.81:0/1453027480 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fef8804c570 con 0x7fef98106890 2024-05-08T23:56:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.440+0000 7fef9d644700 1 -- 172.21.15.81:0/1453027480 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fef84038700 msgr2=0x7fef8403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:51.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.440+0000 7fef9d644700 1 --2- 172.21.15.81:0/1453027480 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fef84038700 0x7fef8403abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fef80006fd0 tx=0x7fef80006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:51.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.440+0000 7fef9d644700 1 -- 172.21.15.81:0/1453027480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98106890 msgr2=0x7fef9819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:51.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.440+0000 7fef9d644700 1 --2- 172.21.15.81:0/1453027480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98106890 0x7fef9819a5b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef88006af0 tx=0x7fef88011a10 comp rx=0 tx=0).stop 2024-05-08T23:56:51.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.440+0000 7fef9d644700 1 -- 172.21.15.81:0/1453027480 shutdown_connections 2024-05-08T23:56:51.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.440+0000 7fef9d644700 1 --2- 172.21.15.81:0/1453027480 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fef84038700 0x7fef8403abc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:51.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.440+0000 7fef9d644700 1 --2- 172.21.15.81:0/1453027480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef98106890 0x7fef9819a5b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:51.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.440+0000 7fef9d644700 1 -- 172.21.15.81:0/1453027480 >> 172.21.15.81:0/1453027480 conn(0x7fef98101e90 msgr2=0x7fef981029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:51.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.440+0000 7fef9d644700 1 -- 172.21.15.81:0/1453027480 shutdown_connections 2024-05-08T23:56:51.821 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:51.440+0000 7fef9d644700 1 -- 172.21.15.81:0/1453027480 wait complete. 2024-05-08T23:56:53.063 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.153+0000 7f8a2664a700 1 Processor -- start 2024-05-08T23:56:53.063 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.153+0000 7f8a2664a700 1 -- start start 2024-05-08T23:56:53.063 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.153+0000 7f8a2664a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a20105700 0x7f8a20105b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:53.063 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.153+0000 7f8a2664a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a201060f0 con 0x7f8a20105700 2024-05-08T23:56:53.064 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.153+0000 7f8a1ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a20105700 0x7f8a20105b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:53.064 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.153+0000 7f8a1ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a20105700 0x7f8a20105b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57590/0 (socket says 172.21.15.81:57590) 2024-05-08T23:56:53.064 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.153+0000 7f8a1ffff700 1 -- 172.21.15.81:0/714853432 learned_addr learned my addr 172.21.15.81:0/714853432 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:53.064 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.154+0000 7f8a1ffff700 1 -- 172.21.15.81:0/714853432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a20106900 con 0x7f8a20105700 2024-05-08T23:56:53.064 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.154+0000 7f8a1ffff700 1 --2- 172.21.15.81:0/714853432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a20105700 0x7f8a20105b20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a140098a0 tx=0x7f8a14009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3363ece47d1c1f90 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:53.064 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.154+0000 7f8a1effd700 1 -- 172.21.15.81:0/714853432 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a14004160 con 0x7f8a20105700 2024-05-08T23:56:53.064 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.154+0000 7f8a1effd700 1 -- 172.21.15.81:0/714853432 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a140042c0 con 0x7f8a20105700 2024-05-08T23:56:53.064 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.154+0000 7f8a1effd700 1 -- 172.21.15.81:0/714853432 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a14011960 con 0x7f8a20105700 2024-05-08T23:56:53.064 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.154+0000 7f8a2664a700 1 -- 172.21.15.81:0/714853432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a20105700 msgr2=0x7f8a20105b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:53.064 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.154+0000 7f8a2664a700 1 --2- 172.21.15.81:0/714853432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a20105700 0x7f8a20105b20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a140098a0 tx=0x7f8a14009bb0 comp rx=0 tx=0).stop 2024-05-08T23:56:53.064 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.155+0000 7f8a2664a700 1 -- 172.21.15.81:0/714853432 shutdown_connections 2024-05-08T23:56:53.064 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.155+0000 7f8a2664a700 1 --2- 172.21.15.81:0/714853432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a20105700 0x7f8a20105b20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:53.064 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.155+0000 7f8a2664a700 1 -- 172.21.15.81:0/714853432 >> 172.21.15.81:0/714853432 conn(0x7f8a20100d00 msgr2=0x7f8a20103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:53.065 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.155+0000 7f8a2664a700 1 -- 172.21.15.81:0/714853432 shutdown_connections 2024-05-08T23:56:53.065 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.155+0000 7f8a2664a700 1 -- 172.21.15.81:0/714853432 wait complete. 2024-05-08T23:56:53.065 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.155+0000 7f8a2664a700 1 Processor -- start 2024-05-08T23:56:53.065 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.155+0000 7f8a2664a700 1 -- start start 2024-05-08T23:56:53.065 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.156+0000 7f8a2664a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a20105700 0x7f8a201982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:53.065 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.156+0000 7f8a2664a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a20198820 con 0x7f8a20105700 2024-05-08T23:56:53.065 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.156+0000 7f8a1ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a20105700 0x7f8a201982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:53.065 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.156+0000 7f8a1ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a20105700 0x7f8a201982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57602/0 (socket says 172.21.15.81:57602) 2024-05-08T23:56:53.065 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.156+0000 7f8a1ffff700 1 -- 172.21.15.81:0/113773590 learned_addr learned my addr 172.21.15.81:0/113773590 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:53.065 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.156+0000 7f8a1ffff700 1 -- 172.21.15.81:0/113773590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14009550 con 0x7f8a20105700 2024-05-08T23:56:53.065 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.156+0000 7f8a1ffff700 1 --2- 172.21.15.81:0/113773590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a20105700 0x7f8a201982e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8a14006af0 tx=0x7f8a14011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:53.065 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.156+0000 7f8a1d7fa700 1 -- 172.21.15.81:0/113773590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a1401c040 con 0x7f8a20105700 2024-05-08T23:56:53.065 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.156+0000 7f8a1d7fa700 1 -- 172.21.15.81:0/113773590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a14003c90 con 0x7f8a20105700 2024-05-08T23:56:53.065 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.156+0000 7f8a2664a700 1 -- 172.21.15.81:0/113773590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a20198a20 con 0x7f8a20105700 2024-05-08T23:56:53.066 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.156+0000 7f8a1d7fa700 1 -- 172.21.15.81:0/113773590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a14022410 con 0x7f8a20105700 2024-05-08T23:56:53.066 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.156+0000 7f8a2664a700 1 -- 172.21.15.81:0/113773590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a20198ec0 con 0x7f8a20105700 2024-05-08T23:56:53.066 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.157+0000 7f8a1d7fa700 1 -- 172.21.15.81:0/113773590 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f8a14015070 con 0x7f8a20105700 2024-05-08T23:56:53.066 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.157+0000 7f8a2664a700 1 -- 172.21.15.81:0/113773590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a20078ff0 con 0x7f8a20105700 2024-05-08T23:56:53.066 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.157+0000 7f8a1d7fa700 1 --2- 172.21.15.81:0/113773590 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8a08038750 0x7f8a0803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:53.066 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.157+0000 7f8a1d7fa700 1 -- 172.21.15.81:0/113773590 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8a1404ede0 con 0x7f8a20105700 2024-05-08T23:56:53.066 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.157+0000 7f8a1f7fe700 1 --2- 172.21.15.81:0/113773590 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8a08038750 0x7f8a0803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:53.066 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.158+0000 7f8a1f7fe700 1 --2- 172.21.15.81:0/113773590 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8a08038750 0x7f8a0803ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8a10006fd0 tx=0x7f8a10006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:53.066 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.162+0000 7f8a1d7fa700 1 -- 172.21.15.81:0/113773590 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8a14016960 con 0x7f8a20105700 2024-05-08T23:56:53.066 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.271+0000 7f8a1d7fa700 1 -- 172.21.15.81:0/113773590 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f8a14054020 con 0x7f8a20105700 2024-05-08T23:56:53.066 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.466+0000 7f8a2664a700 1 -- 172.21.15.81:0/113773590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f8a20191a20 con 0x7f8a20105700 2024-05-08T23:56:53.066 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.468+0000 7f8a1d7fa700 1 -- 172.21.15.81:0/113773590 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f8a14018470 con 0x7f8a20105700 2024-05-08T23:56:53.067 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.470+0000 7f8a2664a700 1 -- 172.21.15.81:0/113773590 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8a08038750 msgr2=0x7f8a0803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:53.067 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.470+0000 7f8a2664a700 1 --2- 172.21.15.81:0/113773590 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8a08038750 0x7f8a0803ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8a10006fd0 tx=0x7f8a10006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:53.067 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.470+0000 7f8a2664a700 1 -- 172.21.15.81:0/113773590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a20105700 msgr2=0x7f8a201982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:53.067 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.470+0000 7f8a2664a700 1 --2- 172.21.15.81:0/113773590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a20105700 0x7f8a201982e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8a14006af0 tx=0x7f8a14011f80 comp rx=0 tx=0).stop 2024-05-08T23:56:53.067 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.471+0000 7f8a2664a700 1 -- 172.21.15.81:0/113773590 shutdown_connections 2024-05-08T23:56:53.067 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.471+0000 7f8a2664a700 1 --2- 172.21.15.81:0/113773590 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8a08038750 0x7f8a0803ac10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:53.067 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.471+0000 7f8a2664a700 1 --2- 172.21.15.81:0/113773590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a20105700 0x7f8a201982e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:53.067 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.471+0000 7f8a2664a700 1 -- 172.21.15.81:0/113773590 >> 172.21.15.81:0/113773590 conn(0x7f8a20100d00 msgr2=0x7f8a2018eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:53.067 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.471+0000 7f8a2664a700 1 -- 172.21.15.81:0/113773590 shutdown_connections 2024-05-08T23:56:53.067 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr 2024-05-08T23:56:52.471+0000 7f8a2664a700 1 -- 172.21.15.81:0/113773590 wait complete. 2024-05-08T23:56:53.067 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-08T23:56:53.067 INFO:teuthology.orchestra.run.smithi081.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-08T23:56:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:56:53.067 INFO:teuthology.orchestra.run.smithi081.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-08T23:56:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:56:53.068 INFO:teuthology.orchestra.run.smithi081.stdout:Or, if you are only running a single cluster on this host: 2024-05-08T23:56:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:56:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-08T23:56:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:56:53.068 INFO:teuthology.orchestra.run.smithi081.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-08T23:56:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:56:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: ceph telemetry on 2024-05-08T23:56:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:56:53.068 INFO:teuthology.orchestra.run.smithi081.stdout:For more information see: 2024-05-08T23:56:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:56:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-08T23:56:53.068 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:56:53.068 INFO:teuthology.orchestra.run.smithi081.stdout:Bootstrap complete. 2024-05-08T23:56:53.092 INFO:tasks.cephadm:Fetching config... 2024-05-08T23:56:53.093 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T23:56:53.093 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-08T23:56:53.111 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-08T23:56:53.111 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T23:56:53.111 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-08T23:56:53.170 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-08T23:56:53.170 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T23:56:53.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-08T23:56:53.240 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-08T23:56:53.240 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T23:56:53.241 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-08T23:56:53.297 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-08T23:56:53.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD8z5nbWWpoZwtwkf5im/CmFGTwhY7fFE05W8RZJNJKhcFx9mFJF2+2iJ65vr521OjqjcmzVKbXF5riDqxwt4l3kQT+EfU9WxjdaCJDqbjHaxsuyb+1Obg8N/kaYvPV5gr7kcwtwFQCoP+l9R212gEhN9FRqYUtzACsd6offZ6RfZ/0EO7gxHj1NsiyAK6l8DpVTNVqHm2+9BZv3IJpoUEe7Cn8pK+AetOj3k+5jYZLCpRSFTchGjE8zIOjeFzjNTJcAmZmce7fF/xyNbeUwYYwJSpEFQQ9BzQI995yN1OPeC9aIJZMXDcCM82K/R/d5Bam4Fkrmt3Iifc3ADm0EFCCSrv/tqUEPmWZi6tk0jMKewaKayqmEfL/bJbeWvPDzjEAxRV2C36qwiJVREi8gOWMrZKG3cvpjyz1Q7QBHGA/7m1tQqSLiOS5wc9pla/uk0UQNSHlbEuP/lrshAlBvxBWQzhhLKtr5GKeZsrNarNGOCwPVJ1eXUZgd9/msCAQq6s= ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T23:56:53.375 INFO:teuthology.orchestra.run.smithi081.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD8z5nbWWpoZwtwkf5im/CmFGTwhY7fFE05W8RZJNJKhcFx9mFJF2+2iJ65vr521OjqjcmzVKbXF5riDqxwt4l3kQT+EfU9WxjdaCJDqbjHaxsuyb+1Obg8N/kaYvPV5gr7kcwtwFQCoP+l9R212gEhN9FRqYUtzACsd6offZ6RfZ/0EO7gxHj1NsiyAK6l8DpVTNVqHm2+9BZv3IJpoUEe7Cn8pK+AetOj3k+5jYZLCpRSFTchGjE8zIOjeFzjNTJcAmZmce7fF/xyNbeUwYYwJSpEFQQ9BzQI995yN1OPeC9aIJZMXDcCM82K/R/d5Bam4Fkrmt3Iifc3ADm0EFCCSrv/tqUEPmWZi6tk0jMKewaKayqmEfL/bJbeWvPDzjEAxRV2C36qwiJVREi8gOWMrZKG3cvpjyz1Q7QBHGA/7m1tQqSLiOS5wc9pla/uk0UQNSHlbEuP/lrshAlBvxBWQzhhLKtr5GKeZsrNarNGOCwPVJ1eXUZgd9/msCAQq6s= ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:56:53.388 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD8z5nbWWpoZwtwkf5im/CmFGTwhY7fFE05W8RZJNJKhcFx9mFJF2+2iJ65vr521OjqjcmzVKbXF5riDqxwt4l3kQT+EfU9WxjdaCJDqbjHaxsuyb+1Obg8N/kaYvPV5gr7kcwtwFQCoP+l9R212gEhN9FRqYUtzACsd6offZ6RfZ/0EO7gxHj1NsiyAK6l8DpVTNVqHm2+9BZv3IJpoUEe7Cn8pK+AetOj3k+5jYZLCpRSFTchGjE8zIOjeFzjNTJcAmZmce7fF/xyNbeUwYYwJSpEFQQ9BzQI995yN1OPeC9aIJZMXDcCM82K/R/d5Bam4Fkrmt3Iifc3ADm0EFCCSrv/tqUEPmWZi6tk0jMKewaKayqmEfL/bJbeWvPDzjEAxRV2C36qwiJVREi8gOWMrZKG3cvpjyz1Q7QBHGA/7m1tQqSLiOS5wc9pla/uk0UQNSHlbEuP/lrshAlBvxBWQzhhLKtr5GKeZsrNarNGOCwPVJ1eXUZgd9/msCAQq6s= ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T23:56:53.433 INFO:teuthology.orchestra.run.smithi150.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD8z5nbWWpoZwtwkf5im/CmFGTwhY7fFE05W8RZJNJKhcFx9mFJF2+2iJ65vr521OjqjcmzVKbXF5riDqxwt4l3kQT+EfU9WxjdaCJDqbjHaxsuyb+1Obg8N/kaYvPV5gr7kcwtwFQCoP+l9R212gEhN9FRqYUtzACsd6offZ6RfZ/0EO7gxHj1NsiyAK6l8DpVTNVqHm2+9BZv3IJpoUEe7Cn8pK+AetOj3k+5jYZLCpRSFTchGjE8zIOjeFzjNTJcAmZmce7fF/xyNbeUwYYwJSpEFQQ9BzQI995yN1OPeC9aIJZMXDcCM82K/R/d5Bam4Fkrmt3Iifc3ADm0EFCCSrv/tqUEPmWZi6tk0jMKewaKayqmEfL/bJbeWvPDzjEAxRV2C36qwiJVREi8gOWMrZKG3cvpjyz1Q7QBHGA/7m1tQqSLiOS5wc9pla/uk0UQNSHlbEuP/lrshAlBvxBWQzhhLKtr5GKeZsrNarNGOCwPVJ1eXUZgd9/msCAQq6s= ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:56:53.446 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD8z5nbWWpoZwtwkf5im/CmFGTwhY7fFE05W8RZJNJKhcFx9mFJF2+2iJ65vr521OjqjcmzVKbXF5riDqxwt4l3kQT+EfU9WxjdaCJDqbjHaxsuyb+1Obg8N/kaYvPV5gr7kcwtwFQCoP+l9R212gEhN9FRqYUtzACsd6offZ6RfZ/0EO7gxHj1NsiyAK6l8DpVTNVqHm2+9BZv3IJpoUEe7Cn8pK+AetOj3k+5jYZLCpRSFTchGjE8zIOjeFzjNTJcAmZmce7fF/xyNbeUwYYwJSpEFQQ9BzQI995yN1OPeC9aIJZMXDcCM82K/R/d5Bam4Fkrmt3Iifc3ADm0EFCCSrv/tqUEPmWZi6tk0jMKewaKayqmEfL/bJbeWvPDzjEAxRV2C36qwiJVREi8gOWMrZKG3cvpjyz1Q7QBHGA/7m1tQqSLiOS5wc9pla/uk0UQNSHlbEuP/lrshAlBvxBWQzhhLKtr5GKeZsrNarNGOCwPVJ1eXUZgd9/msCAQq6s= ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T23:56:53.492 INFO:teuthology.orchestra.run.smithi171.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD8z5nbWWpoZwtwkf5im/CmFGTwhY7fFE05W8RZJNJKhcFx9mFJF2+2iJ65vr521OjqjcmzVKbXF5riDqxwt4l3kQT+EfU9WxjdaCJDqbjHaxsuyb+1Obg8N/kaYvPV5gr7kcwtwFQCoP+l9R212gEhN9FRqYUtzACsd6offZ6RfZ/0EO7gxHj1NsiyAK6l8DpVTNVqHm2+9BZv3IJpoUEe7Cn8pK+AetOj3k+5jYZLCpRSFTchGjE8zIOjeFzjNTJcAmZmce7fF/xyNbeUwYYwJSpEFQQ9BzQI995yN1OPeC9aIJZMXDcCM82K/R/d5Bam4Fkrmt3Iifc3ADm0EFCCSrv/tqUEPmWZi6tk0jMKewaKayqmEfL/bJbeWvPDzjEAxRV2C36qwiJVREi8gOWMrZKG3cvpjyz1Q7QBHGA/7m1tQqSLiOS5wc9pla/uk0UQNSHlbEuP/lrshAlBvxBWQzhhLKtr5GKeZsrNarNGOCwPVJ1eXUZgd9/msCAQq6s= ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:56:53.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-08T23:56:53.529 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:53 smithi081 ceph-mon[42474]: mgrmap e13: x(active, since 6s) 2024-05-08T23:56:53.529 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:53 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/113773590' entity='client.admin' 2024-05-08T23:56:53.725 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:56:54.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.789+0000 7f1339d12700 1 -- 172.21.15.81:0/814011340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1334101420 msgr2=0x7f1334103810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:54.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.789+0000 7f1339d12700 1 --2- 172.21.15.81:0/814011340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1334101420 0x7f1334103810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1324009910 tx=0x7f1324009c20 comp rx=0 tx=0).stop 2024-05-08T23:56:54.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.789+0000 7f1339d12700 1 -- 172.21.15.81:0/814011340 shutdown_connections 2024-05-08T23:56:54.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.789+0000 7f1339d12700 1 --2- 172.21.15.81:0/814011340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1334101420 0x7f1334103810 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:54.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.789+0000 7f1339d12700 1 -- 172.21.15.81:0/814011340 >> 172.21.15.81:0/814011340 conn(0x7f13340fadd0 msgr2=0x7f13340fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:54.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.789+0000 7f1339d12700 1 -- 172.21.15.81:0/814011340 shutdown_connections 2024-05-08T23:56:54.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.789+0000 7f1339d12700 1 -- 172.21.15.81:0/814011340 wait complete. 2024-05-08T23:56:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.790+0000 7f1339d12700 1 Processor -- start 2024-05-08T23:56:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.790+0000 7f1339d12700 1 -- start start 2024-05-08T23:56:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.791+0000 7f1339d12700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1334101420 0x7f1334195d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.791+0000 7f1339d12700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1334196270 con 0x7f1334101420 2024-05-08T23:56:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.791+0000 7f13337fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1334101420 0x7f1334195d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.791+0000 7f13337fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1334101420 0x7f1334195d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57620/0 (socket says 172.21.15.81:57620) 2024-05-08T23:56:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.791+0000 7f13337fe700 1 -- 172.21.15.81:0/2738165178 learned_addr learned my addr 172.21.15.81:0/2738165178 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.791+0000 7f13337fe700 1 -- 172.21.15.81:0/2738165178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13240095f0 con 0x7f1334101420 2024-05-08T23:56:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.791+0000 7f13337fe700 1 --2- 172.21.15.81:0/2738165178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1334101420 0x7f1334195d30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1324005950 tx=0x7f13240057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.791+0000 7f1330ff9700 1 -- 172.21.15.81:0/2738165178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f132401d070 con 0x7f1334101420 2024-05-08T23:56:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.791+0000 7f1330ff9700 1 -- 172.21.15.81:0/2738165178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f132400bc10 con 0x7f1334101420 2024-05-08T23:56:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.791+0000 7f1339d12700 1 -- 172.21.15.81:0/2738165178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1334196470 con 0x7f1334101420 2024-05-08T23:56:54.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.791+0000 7f1330ff9700 1 -- 172.21.15.81:0/2738165178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13240039d0 con 0x7f1334101420 2024-05-08T23:56:54.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.792+0000 7f1339d12700 1 -- 172.21.15.81:0/2738165178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1334196910 con 0x7f1334101420 2024-05-08T23:56:54.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.792+0000 7f1330ff9700 1 -- 172.21.15.81:0/2738165178 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f1324003c40 con 0x7f1334101420 2024-05-08T23:56:54.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.793+0000 7f1330ff9700 1 --2- 172.21.15.81:0/2738165178 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f131c0387f0 0x7f131c03acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:54.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.793+0000 7f1330ff9700 1 -- 172.21.15.81:0/2738165178 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f132404d510 con 0x7f1334101420 2024-05-08T23:56:54.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.793+0000 7f1339d12700 1 -- 172.21.15.81:0/2738165178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133418f650 con 0x7f1334101420 2024-05-08T23:56:54.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.793+0000 7f1332ffd700 1 --2- 172.21.15.81:0/2738165178 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f131c0387f0 0x7f131c03acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:54.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.793+0000 7f1332ffd700 1 --2- 172.21.15.81:0/2738165178 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f131c0387f0 0x7f131c03acb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1328006fd0 tx=0x7f1328006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:54.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:54.798+0000 7f1330ff9700 1 -- 172.21.15.81:0/2738165178 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1324026070 con 0x7f1334101420 2024-05-08T23:56:55.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:55.008+0000 7f1339d12700 1 -- 172.21.15.81:0/2738165178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f13340625d0 con 0x7f1334101420 2024-05-08T23:56:55.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:55.011+0000 7f1330ff9700 1 -- 172.21.15.81:0/2738165178 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1324029950 con 0x7f1334101420 2024-05-08T23:56:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:55.014+0000 7f1339d12700 1 -- 172.21.15.81:0/2738165178 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f131c0387f0 msgr2=0x7f131c03acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:55.014+0000 7f1339d12700 1 --2- 172.21.15.81:0/2738165178 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f131c0387f0 0x7f131c03acb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1328006fd0 tx=0x7f1328006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:55.014+0000 7f1339d12700 1 -- 172.21.15.81:0/2738165178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1334101420 msgr2=0x7f1334195d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:55.014+0000 7f1339d12700 1 --2- 172.21.15.81:0/2738165178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1334101420 0x7f1334195d30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1324005950 tx=0x7f13240057c0 comp rx=0 tx=0).stop 2024-05-08T23:56:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:55.014+0000 7f1339d12700 1 -- 172.21.15.81:0/2738165178 shutdown_connections 2024-05-08T23:56:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:55.014+0000 7f1339d12700 1 --2- 172.21.15.81:0/2738165178 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f131c0387f0 0x7f131c03acb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:55.014+0000 7f1339d12700 1 --2- 172.21.15.81:0/2738165178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1334101420 0x7f1334195d30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:55.014+0000 7f1339d12700 1 -- 172.21.15.81:0/2738165178 >> 172.21.15.81:0/2738165178 conn(0x7f13340fadd0 msgr2=0x7f13340fb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:55.014+0000 7f1339d12700 1 -- 172.21.15.81:0/2738165178 shutdown_connections 2024-05-08T23:56:55.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:55.014+0000 7f1339d12700 1 -- 172.21.15.81:0/2738165178 wait complete. 2024-05-08T23:56:55.369 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-08T23:56:55.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-08T23:56:55.637 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:56:56.004 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:55 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:56:56.082 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:55 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:56:56.082 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:55 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi081", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:56:56.082 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:55 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:56:56.082 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:55 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:56:56.082 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:55 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:56:56.082 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:55 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2738165178' entity='client.admin' 2024-05-08T23:56:56.082 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:55 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:56:56.082 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:55 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:56:56.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.855+0000 7f0c7f77b700 1 -- 172.21.15.81:0/557615275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c780ff830 msgr2=0x7f0c780ffc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:56.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.855+0000 7f0c7f77b700 1 --2- 172.21.15.81:0/557615275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c780ff830 0x7f0c780ffc50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009910 tx=0x7f0c68009c20 comp rx=0 tx=0).stop 2024-05-08T23:56:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.855+0000 7f0c7f77b700 1 -- 172.21.15.81:0/557615275 shutdown_connections 2024-05-08T23:56:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.855+0000 7f0c7f77b700 1 --2- 172.21.15.81:0/557615275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c780ff830 0x7f0c780ffc50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.855+0000 7f0c7f77b700 1 -- 172.21.15.81:0/557615275 >> 172.21.15.81:0/557615275 conn(0x7f0c780fadd0 msgr2=0x7f0c780fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.855+0000 7f0c7f77b700 1 -- 172.21.15.81:0/557615275 shutdown_connections 2024-05-08T23:56:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.855+0000 7f0c7f77b700 1 -- 172.21.15.81:0/557615275 wait complete. 2024-05-08T23:56:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.856+0000 7f0c7f77b700 1 Processor -- start 2024-05-08T23:56:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.856+0000 7f0c7f77b700 1 -- start start 2024-05-08T23:56:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.856+0000 7f0c7f77b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c780ff830 0x7f0c780fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.856+0000 7f0c7f77b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780fd180 con 0x7f0c780ff830 2024-05-08T23:56:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.856+0000 7f0c7d517700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c780ff830 0x7f0c780fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.856+0000 7f0c7d517700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c780ff830 0x7f0c780fcc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57634/0 (socket says 172.21.15.81:57634) 2024-05-08T23:56:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.856+0000 7f0c7d517700 1 -- 172.21.15.81:0/2085622881 learned_addr learned my addr 172.21.15.81:0/2085622881 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.857+0000 7f0c7d517700 1 -- 172.21.15.81:0/2085622881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c680095f0 con 0x7f0c780ff830 2024-05-08T23:56:56.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.857+0000 7f0c7d517700 1 --2- 172.21.15.81:0/2085622881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c780ff830 0x7f0c780fcc40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c68005950 tx=0x7f0c680057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.857+0000 7f0c6e7fc700 1 -- 172.21.15.81:0/2085622881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c6801d070 con 0x7f0c780ff830 2024-05-08T23:56:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.857+0000 7f0c6e7fc700 1 -- 172.21.15.81:0/2085622881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c6800bc10 con 0x7f0c780ff830 2024-05-08T23:56:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.857+0000 7f0c7f77b700 1 -- 172.21.15.81:0/2085622881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c780fb3c0 con 0x7f0c780ff830 2024-05-08T23:56:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.857+0000 7f0c6e7fc700 1 -- 172.21.15.81:0/2085622881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c68003a10 con 0x7f0c780ff830 2024-05-08T23:56:56.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.857+0000 7f0c7f77b700 1 -- 172.21.15.81:0/2085622881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c780fb860 con 0x7f0c780ff830 2024-05-08T23:56:56.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.858+0000 7f0c6e7fc700 1 -- 172.21.15.81:0/2085622881 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f0c68003cd0 con 0x7f0c780ff830 2024-05-08T23:56:56.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.858+0000 7f0c7f77b700 1 -- 172.21.15.81:0/2085622881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c78105e80 con 0x7f0c780ff830 2024-05-08T23:56:56.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.858+0000 7f0c6e7fc700 1 --2- 172.21.15.81:0/2085622881 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0c640387a0 0x7f0c6403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:56.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.858+0000 7f0c6e7fc700 1 -- 172.21.15.81:0/2085622881 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0c6804c5e0 con 0x7f0c780ff830 2024-05-08T23:56:56.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.858+0000 7f0c7cd16700 1 --2- 172.21.15.81:0/2085622881 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0c640387a0 0x7f0c6403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:56.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.858+0000 7f0c7cd16700 1 --2- 172.21.15.81:0/2085622881 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0c640387a0 0x7f0c6403ac60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0c74006fd0 tx=0x7f0c74006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:56.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:56.863+0000 7f0c6e7fc700 1 -- 172.21.15.81:0/2085622881 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0c6800ba70 con 0x7f0c780ff830 2024-05-08T23:56:57.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:57.058+0000 7f0c7f77b700 1 -- 172.21.15.81:0/2085622881 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c780fbaa0 con 0x7f0c640387a0 2024-05-08T23:56:57.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:57.062+0000 7f0c6e7fc700 1 -- 172.21.15.81:0/2085622881 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0c780fbaa0 con 0x7f0c640387a0 2024-05-08T23:56:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:57.064+0000 7f0c7f77b700 1 -- 172.21.15.81:0/2085622881 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0c640387a0 msgr2=0x7f0c6403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:57.064+0000 7f0c7f77b700 1 --2- 172.21.15.81:0/2085622881 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0c640387a0 0x7f0c6403ac60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0c74006fd0 tx=0x7f0c74006e40 comp rx=0 tx=0).stop 2024-05-08T23:56:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:57.064+0000 7f0c7f77b700 1 -- 172.21.15.81:0/2085622881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c780ff830 msgr2=0x7f0c780fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:57.064+0000 7f0c7f77b700 1 --2- 172.21.15.81:0/2085622881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c780ff830 0x7f0c780fcc40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c68005950 tx=0x7f0c680057c0 comp rx=0 tx=0).stop 2024-05-08T23:56:57.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:57.064+0000 7f0c7f77b700 1 -- 172.21.15.81:0/2085622881 shutdown_connections 2024-05-08T23:56:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:57.064+0000 7f0c7f77b700 1 --2- 172.21.15.81:0/2085622881 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0c640387a0 0x7f0c6403ac60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:57.064+0000 7f0c7f77b700 1 --2- 172.21.15.81:0/2085622881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c780ff830 0x7f0c780fcc40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:57.064+0000 7f0c7f77b700 1 -- 172.21.15.81:0/2085622881 >> 172.21.15.81:0/2085622881 conn(0x7f0c780fadd0 msgr2=0x7f0c78068910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:57.064+0000 7f0c7f77b700 1 -- 172.21.15.81:0/2085622881 shutdown_connections 2024-05-08T23:56:57.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:57.064+0000 7f0c7f77b700 1 -- 172.21.15.81:0/2085622881 wait complete. 2024-05-08T23:56:57.494 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi150 2024-05-08T23:56:57.494 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-08T23:56:57.494 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/etc/ceph/ceph.conf 2024-05-08T23:56:57.515 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-08T23:56:57.516 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:56:57.576 INFO:tasks.cephadm:Adding host smithi150 to orchestrator... 2024-05-08T23:56:57.576 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch host add smithi150 2024-05-08T23:56:57.815 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:56:58.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:58 smithi081 ceph-mon[42474]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:56:58.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:58 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:56:58.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:58 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:56:58.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:58 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:56:58.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:58 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:56:58.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:58 smithi081 ceph-mon[42474]: Updating smithi081:/etc/ceph/ceph.conf 2024-05-08T23:56:58.353 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:58 smithi081 ceph-mon[42474]: Updating smithi081:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:56:58.354 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:58 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:56:58.354 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:58 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:56:58.354 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:58 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:56:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.868+0000 7f834736f700 1 -- 172.21.15.81:0/3986633428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83401068c0 msgr2=0x7f8340106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:56:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.868+0000 7f834736f700 1 --2- 172.21.15.81:0/3986633428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83401068c0 0x7f8340106ca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f833c009910 tx=0x7f833c009c20 comp rx=0 tx=0).stop 2024-05-08T23:56:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.868+0000 7f834736f700 1 -- 172.21.15.81:0/3986633428 shutdown_connections 2024-05-08T23:56:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.869+0000 7f834736f700 1 --2- 172.21.15.81:0/3986633428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83401068c0 0x7f8340106ca0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:56:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.869+0000 7f834736f700 1 -- 172.21.15.81:0/3986633428 >> 172.21.15.81:0/3986633428 conn(0x7f8340075350 msgr2=0x7f8340075760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:56:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.869+0000 7f834736f700 1 -- 172.21.15.81:0/3986633428 shutdown_connections 2024-05-08T23:56:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.869+0000 7f834736f700 1 -- 172.21.15.81:0/3986633428 wait complete. 2024-05-08T23:56:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.869+0000 7f834736f700 1 Processor -- start 2024-05-08T23:56:58.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.869+0000 7f834736f700 1 -- start start 2024-05-08T23:56:58.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.869+0000 7f834736f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83401068c0 0x7f83401983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:58.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.869+0000 7f834736f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83401988f0 con 0x7f83401068c0 2024-05-08T23:56:58.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.869+0000 7f834510b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83401068c0 0x7f83401983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:58.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.870+0000 7f834510b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83401068c0 0x7f83401983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35844/0 (socket says 172.21.15.81:35844) 2024-05-08T23:56:58.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.870+0000 7f834510b700 1 -- 172.21.15.81:0/1044300332 learned_addr learned my addr 172.21.15.81:0/1044300332 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:56:58.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.870+0000 7f834510b700 1 -- 172.21.15.81:0/1044300332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c0095f0 con 0x7f83401068c0 2024-05-08T23:56:58.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.870+0000 7f834510b700 1 --2- 172.21.15.81:0/1044300332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83401068c0 0x7f83401983b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f833c004f40 tx=0x7f833c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:58.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.870+0000 7f83367fc700 1 -- 172.21.15.81:0/1044300332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f833c01d070 con 0x7f83401068c0 2024-05-08T23:56:58.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.870+0000 7f834736f700 1 -- 172.21.15.81:0/1044300332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8340198b50 con 0x7f83401068c0 2024-05-08T23:56:58.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.870+0000 7f83367fc700 1 -- 172.21.15.81:0/1044300332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f833c00bbb0 con 0x7f83401068c0 2024-05-08T23:56:58.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.870+0000 7f83367fc700 1 -- 172.21.15.81:0/1044300332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f833c003810 con 0x7f83401068c0 2024-05-08T23:56:58.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.870+0000 7f834736f700 1 -- 172.21.15.81:0/1044300332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8340198fd0 con 0x7f83401068c0 2024-05-08T23:56:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.871+0000 7f83367fc700 1 -- 172.21.15.81:0/1044300332 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f833c003a90 con 0x7f83401068c0 2024-05-08T23:56:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.871+0000 7f83367fc700 1 --2- 172.21.15.81:0/1044300332 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f832c0387a0 0x7f832c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:56:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.871+0000 7f834736f700 1 -- 172.21.15.81:0/1044300332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8340102000 con 0x7f83401068c0 2024-05-08T23:56:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.871+0000 7f83367fc700 1 -- 172.21.15.81:0/1044300332 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f833c04c660 con 0x7f83401068c0 2024-05-08T23:56:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.871+0000 7f834490a700 1 --2- 172.21.15.81:0/1044300332 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f832c0387a0 0x7f832c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:56:58.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.872+0000 7f834490a700 1 --2- 172.21.15.81:0/1044300332 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f832c0387a0 0x7f832c03ac60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8330006fd0 tx=0x7f8330006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:56:58.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:58.876+0000 7f83367fc700 1 -- 172.21.15.81:0/1044300332 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f833c029770 con 0x7f83401068c0 2024-05-08T23:56:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:56:59.075+0000 7f834736f700 1 -- 172.21.15.81:0/1044300332 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi150", "target": ["mon-mgr", ""]}) v1 -- 0x7f834010abb0 con 0x7f832c0387a0 2024-05-08T23:56:59.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:59 smithi081 ceph-mon[42474]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:56:59.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:56:59 smithi081 ceph-mon[42474]: Updating smithi081:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T23:57:00.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:00 smithi081 ceph-mon[42474]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi150", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:57:01.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:01.298+0000 7f83367fc700 1 -- 172.21.15.81:0/1044300332 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f834010abb0 con 0x7f832c0387a0 2024-05-08T23:57:01.293 INFO:teuthology.orchestra.run.smithi081.stdout:Added host 'smithi150' with addr '172.21.15.150' 2024-05-08T23:57:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:01.300+0000 7f834736f700 1 -- 172.21.15.81:0/1044300332 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f832c0387a0 msgr2=0x7f832c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:01.300+0000 7f834736f700 1 --2- 172.21.15.81:0/1044300332 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f832c0387a0 0x7f832c03ac60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f8330006fd0 tx=0x7f8330006e40 comp rx=0 tx=0).stop 2024-05-08T23:57:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:01.300+0000 7f834736f700 1 -- 172.21.15.81:0/1044300332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83401068c0 msgr2=0x7f83401983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:01.300+0000 7f834736f700 1 --2- 172.21.15.81:0/1044300332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83401068c0 0x7f83401983b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f833c004f40 tx=0x7f833c005020 comp rx=0 tx=0).stop 2024-05-08T23:57:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:01.300+0000 7f834736f700 1 -- 172.21.15.81:0/1044300332 shutdown_connections 2024-05-08T23:57:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:01.300+0000 7f834736f700 1 --2- 172.21.15.81:0/1044300332 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f832c0387a0 0x7f832c03ac60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:01.300+0000 7f834736f700 1 --2- 172.21.15.81:0/1044300332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83401068c0 0x7f83401983b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:01.300+0000 7f834736f700 1 -- 172.21.15.81:0/1044300332 >> 172.21.15.81:0/1044300332 conn(0x7f8340075350 msgr2=0x7f83400fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:01.300+0000 7f834736f700 1 -- 172.21.15.81:0/1044300332 shutdown_connections 2024-05-08T23:57:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:01.300+0000 7f834736f700 1 -- 172.21.15.81:0/1044300332 wait complete. 2024-05-08T23:57:01.318 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:01 smithi081 ceph-mon[42474]: Deploying cephadm binary to smithi150 2024-05-08T23:57:01.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-08T23:57:01.857 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:57:02.603 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:02 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:02.603 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:02 smithi081 ceph-mon[42474]: Added host smithi150 2024-05-08T23:57:02.603 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:02 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:02.603 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:02 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:02.604 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:02 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.811+0000 7f75b62f9700 1 -- 172.21.15.81:0/2012262998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b0105820 msgr2=0x7f75b0105c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.811+0000 7f75b62f9700 1 --2- 172.21.15.81:0/2012262998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b0105820 0x7f75b0105c00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f75a0009910 tx=0x7f75a0009c20 comp rx=0 tx=0).stop 2024-05-08T23:57:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.811+0000 7f75b62f9700 1 -- 172.21.15.81:0/2012262998 shutdown_connections 2024-05-08T23:57:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.811+0000 7f75b62f9700 1 --2- 172.21.15.81:0/2012262998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b0105820 0x7f75b0105c00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.811+0000 7f75b62f9700 1 -- 172.21.15.81:0/2012262998 >> 172.21.15.81:0/2012262998 conn(0x7f75b0075350 msgr2=0x7f75b0075760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.811+0000 7f75b62f9700 1 -- 172.21.15.81:0/2012262998 shutdown_connections 2024-05-08T23:57:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.811+0000 7f75b62f9700 1 -- 172.21.15.81:0/2012262998 wait complete. 2024-05-08T23:57:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.812+0000 7f75b62f9700 1 Processor -- start 2024-05-08T23:57:02.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.812+0000 7f75b62f9700 1 -- start start 2024-05-08T23:57:02.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.812+0000 7f75b62f9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b0105820 0x7f75b0195130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:02.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.812+0000 7f75b62f9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b0195670 con 0x7f75b0105820 2024-05-08T23:57:02.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.812+0000 7f75affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b0105820 0x7f75b0195130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:02.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.812+0000 7f75affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b0105820 0x7f75b0195130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35854/0 (socket says 172.21.15.81:35854) 2024-05-08T23:57:02.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.812+0000 7f75affff700 1 -- 172.21.15.81:0/3005791718 learned_addr learned my addr 172.21.15.81:0/3005791718 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:57:02.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.813+0000 7f75affff700 1 -- 172.21.15.81:0/3005791718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a00095f0 con 0x7f75b0105820 2024-05-08T23:57:02.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.813+0000 7f75affff700 1 --2- 172.21.15.81:0/3005791718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b0105820 0x7f75b0195130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f75a0004f40 tx=0x7f75a0005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:02.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.813+0000 7f75ad7fa700 1 -- 172.21.15.81:0/3005791718 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75a001d070 con 0x7f75b0105820 2024-05-08T23:57:02.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.813+0000 7f75ad7fa700 1 -- 172.21.15.81:0/3005791718 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f75a0004370 con 0x7f75b0105820 2024-05-08T23:57:02.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.813+0000 7f75b62f9700 1 -- 172.21.15.81:0/3005791718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b0195870 con 0x7f75b0105820 2024-05-08T23:57:02.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.813+0000 7f75ad7fa700 1 -- 172.21.15.81:0/3005791718 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75a0003970 con 0x7f75b0105820 2024-05-08T23:57:02.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.813+0000 7f75b62f9700 1 -- 172.21.15.81:0/3005791718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b0195c90 con 0x7f75b0105820 2024-05-08T23:57:02.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.814+0000 7f75ad7fa700 1 -- 172.21.15.81:0/3005791718 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f75a0003c30 con 0x7f75b0105820 2024-05-08T23:57:02.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.814+0000 7f75b62f9700 1 -- 172.21.15.81:0/3005791718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b0100ef0 con 0x7f75b0105820 2024-05-08T23:57:02.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.814+0000 7f75ad7fa700 1 --2- 172.21.15.81:0/3005791718 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f75980387a0 0x7f759803ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:02.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.814+0000 7f75ad7fa700 1 -- 172.21.15.81:0/3005791718 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f75a004c560 con 0x7f75b0105820 2024-05-08T23:57:02.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.814+0000 7f75af7fe700 1 --2- 172.21.15.81:0/3005791718 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f75980387a0 0x7f759803ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:02.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.814+0000 7f75af7fe700 1 --2- 172.21.15.81:0/3005791718 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f75980387a0 0x7f759803ac60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f75a4006fd0 tx=0x7f75a4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:02.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:02.819+0000 7f75ad7fa700 1 -- 172.21.15.81:0/3005791718 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f75a0029950 con 0x7f75b0105820 2024-05-08T23:57:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:03.023+0000 7f75b62f9700 1 -- 172.21.15.81:0/3005791718 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75b0196580 con 0x7f75980387a0 2024-05-08T23:57:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:03.024+0000 7f75ad7fa700 1 -- 172.21.15.81:0/3005791718 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f75b0196580 con 0x7f75980387a0 2024-05-08T23:57:03.019 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:57:03.019 INFO:teuthology.orchestra.run.smithi081.stdout:[{"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.150", "hostname": "smithi150", "labels": [], "status": ""}] 2024-05-08T23:57:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:03.026+0000 7f75b62f9700 1 -- 172.21.15.81:0/3005791718 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f75980387a0 msgr2=0x7f759803ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:03.026+0000 7f75b62f9700 1 --2- 172.21.15.81:0/3005791718 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f75980387a0 0x7f759803ac60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f75a4006fd0 tx=0x7f75a4006e40 comp rx=0 tx=0).stop 2024-05-08T23:57:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:03.026+0000 7f75b62f9700 1 -- 172.21.15.81:0/3005791718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b0105820 msgr2=0x7f75b0195130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:03.026+0000 7f75b62f9700 1 --2- 172.21.15.81:0/3005791718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b0105820 0x7f75b0195130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f75a0004f40 tx=0x7f75a0005020 comp rx=0 tx=0).stop 2024-05-08T23:57:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:03.026+0000 7f75b62f9700 1 -- 172.21.15.81:0/3005791718 shutdown_connections 2024-05-08T23:57:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:03.026+0000 7f75b62f9700 1 --2- 172.21.15.81:0/3005791718 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f75980387a0 0x7f759803ac60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:03.026+0000 7f75b62f9700 1 --2- 172.21.15.81:0/3005791718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75b0105820 0x7f75b0195130 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:03.027+0000 7f75b62f9700 1 -- 172.21.15.81:0/3005791718 >> 172.21.15.81:0/3005791718 conn(0x7f75b0075350 msgr2=0x7f75b01012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:03.027+0000 7f75b62f9700 1 -- 172.21.15.81:0/3005791718 shutdown_connections 2024-05-08T23:57:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:03.027+0000 7f75b62f9700 1 -- 172.21.15.81:0/3005791718 wait complete. 2024-05-08T23:57:03.390 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi171 2024-05-08T23:57:03.390 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-08T23:57:03.390 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/etc/ceph/ceph.conf 2024-05-08T23:57:03.411 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-08T23:57:03.411 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:57:03.471 INFO:tasks.cephadm:Adding host smithi171 to orchestrator... 2024-05-08T23:57:03.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch host add smithi171 2024-05-08T23:57:03.688 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:57:03.929 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:03 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:03.930 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:03 smithi081 ceph-mon[42474]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:57:04.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.635+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1742060039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab0105820 msgr2=0x7f5ab0105c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:04.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.635+0000 7f5ab51d0700 1 --2- 172.21.15.81:0/1742060039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab0105820 0x7f5ab0105c00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009910 tx=0x7f5aa4009c20 comp rx=0 tx=0).stop 2024-05-08T23:57:04.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.635+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1742060039 shutdown_connections 2024-05-08T23:57:04.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.635+0000 7f5ab51d0700 1 --2- 172.21.15.81:0/1742060039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab0105820 0x7f5ab0105c00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:04.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.635+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1742060039 >> 172.21.15.81:0/1742060039 conn(0x7f5ab0075350 msgr2=0x7f5ab0075760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:04.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.635+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1742060039 shutdown_connections 2024-05-08T23:57:04.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.635+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1742060039 wait complete. 2024-05-08T23:57:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.635+0000 7f5ab51d0700 1 Processor -- start 2024-05-08T23:57:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.636+0000 7f5ab51d0700 1 -- start start 2024-05-08T23:57:04.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.636+0000 7f5ab51d0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab0105820 0x7f5ab01961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:04.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.636+0000 7f5ab51d0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab01966f0 con 0x7f5ab0105820 2024-05-08T23:57:04.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.636+0000 7f5aaed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab0105820 0x7f5ab01961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:04.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.636+0000 7f5aaed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab0105820 0x7f5ab01961b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35872/0 (socket says 172.21.15.81:35872) 2024-05-08T23:57:04.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.636+0000 7f5aaed9d700 1 -- 172.21.15.81:0/1637348689 learned_addr learned my addr 172.21.15.81:0/1637348689 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:57:04.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.636+0000 7f5aaed9d700 1 -- 172.21.15.81:0/1637348689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa40095f0 con 0x7f5ab0105820 2024-05-08T23:57:04.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.636+0000 7f5aaed9d700 1 --2- 172.21.15.81:0/1637348689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab0105820 0x7f5ab01961b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4004f40 tx=0x7f5aa4005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:04.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.636+0000 7f5a97fff700 1 -- 172.21.15.81:0/1637348689 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5aa401d070 con 0x7f5ab0105820 2024-05-08T23:57:04.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.637+0000 7f5a97fff700 1 -- 172.21.15.81:0/1637348689 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5aa4004370 con 0x7f5ab0105820 2024-05-08T23:57:04.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.637+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1637348689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab01968f0 con 0x7f5ab0105820 2024-05-08T23:57:04.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.637+0000 7f5a97fff700 1 -- 172.21.15.81:0/1637348689 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5aa4003970 con 0x7f5ab0105820 2024-05-08T23:57:04.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.637+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1637348689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab0196d10 con 0x7f5ab0105820 2024-05-08T23:57:04.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.638+0000 7f5a97fff700 1 -- 172.21.15.81:0/1637348689 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f5aa4003be0 con 0x7f5ab0105820 2024-05-08T23:57:04.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.638+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1637348689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab00ff330 con 0x7f5ab0105820 2024-05-08T23:57:04.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.638+0000 7f5a97fff700 1 --2- 172.21.15.81:0/1637348689 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5a980387f0 0x7f5a9803acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:04.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.638+0000 7f5a97fff700 1 -- 172.21.15.81:0/1637348689 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5aa404c400 con 0x7f5ab0105820 2024-05-08T23:57:04.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.638+0000 7f5aae59c700 1 --2- 172.21.15.81:0/1637348689 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5a980387f0 0x7f5a9803acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:04.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.638+0000 7f5aae59c700 1 --2- 172.21.15.81:0/1637348689 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5a980387f0 0x7f5a9803acb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0006fd0 tx=0x7f5aa0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:04.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.643+0000 7f5a97fff700 1 -- 172.21.15.81:0/1637348689 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5aa4029950 con 0x7f5ab0105820 2024-05-08T23:57:04.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:04.839+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1637348689 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi171", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ab0109b30 con 0x7f5a980387f0 2024-05-08T23:57:06.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi171", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:57:06.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:06.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:06.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:06.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:06.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi150", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:57:06.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:06.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:06.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: Updating smithi150:/etc/ceph/ceph.conf 2024-05-08T23:57:06.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: Updating smithi150:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:57:06.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: Deploying cephadm binary to smithi171 2024-05-08T23:57:06.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: Updating smithi150:/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:57:06.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:06.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:06.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:05 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:06.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:06.997+0000 7f5a97fff700 1 -- 172.21.15.81:0/1637348689 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5ab0109b30 con 0x7f5a980387f0 2024-05-08T23:57:06.991 INFO:teuthology.orchestra.run.smithi081.stdout:Added host 'smithi171' with addr '172.21.15.171' 2024-05-08T23:57:06.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:06.999+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1637348689 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5a980387f0 msgr2=0x7f5a9803acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:06.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:06.999+0000 7f5ab51d0700 1 --2- 172.21.15.81:0/1637348689 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5a980387f0 0x7f5a9803acb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0006fd0 tx=0x7f5aa0006e40 comp rx=0 tx=0).stop 2024-05-08T23:57:06.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:06.999+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1637348689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab0105820 msgr2=0x7f5ab01961b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:06.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:06.999+0000 7f5ab51d0700 1 --2- 172.21.15.81:0/1637348689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab0105820 0x7f5ab01961b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4004f40 tx=0x7f5aa4005020 comp rx=0 tx=0).stop 2024-05-08T23:57:06.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:06.999+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1637348689 shutdown_connections 2024-05-08T23:57:06.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:06.999+0000 7f5ab51d0700 1 --2- 172.21.15.81:0/1637348689 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5a980387f0 0x7f5a9803acb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:06.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:06.999+0000 7f5ab51d0700 1 --2- 172.21.15.81:0/1637348689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ab0105820 0x7f5ab01961b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:06.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:06.999+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1637348689 >> 172.21.15.81:0/1637348689 conn(0x7f5ab0075350 msgr2=0x7f5ab00680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:06.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:06.999+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1637348689 shutdown_connections 2024-05-08T23:57:06.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:06.999+0000 7f5ab51d0700 1 -- 172.21.15.81:0/1637348689 wait complete. 2024-05-08T23:57:07.297 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:07 smithi081 ceph-mon[42474]: Updating smithi150:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T23:57:07.297 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:07 smithi081 ceph-mon[42474]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:07.297 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:07 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:07.297 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:07 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:07.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-08T23:57:07.571 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:57:08.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.467+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/1287483892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb41068b0 msgr2=0x7f6bb4106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:08.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.467+0000 7f6bbb5cf700 1 --2- 172.21.15.81:0/1287483892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb41068b0 0x7f6bb4106c90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009910 tx=0x7f6bb0009c20 comp rx=0 tx=0).stop 2024-05-08T23:57:08.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.467+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/1287483892 shutdown_connections 2024-05-08T23:57:08.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.467+0000 7f6bbb5cf700 1 --2- 172.21.15.81:0/1287483892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb41068b0 0x7f6bb4106c90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:08.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.467+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/1287483892 >> 172.21.15.81:0/1287483892 conn(0x7f6bb40fc3a0 msgr2=0x7f6bb40fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:08.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.467+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/1287483892 shutdown_connections 2024-05-08T23:57:08.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.467+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/1287483892 wait complete. 2024-05-08T23:57:08.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.468+0000 7f6bbb5cf700 1 Processor -- start 2024-05-08T23:57:08.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.468+0000 7f6bbb5cf700 1 -- start start 2024-05-08T23:57:08.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.468+0000 7f6bbb5cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb41068b0 0x7f6bb4196150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:08.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.468+0000 7f6bbb5cf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4196690 con 0x7f6bb41068b0 2024-05-08T23:57:08.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.468+0000 7f6bb936b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb41068b0 0x7f6bb4196150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:08.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.468+0000 7f6bb936b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb41068b0 0x7f6bb4196150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51282/0 (socket says 172.21.15.81:51282) 2024-05-08T23:57:08.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.468+0000 7f6bb936b700 1 -- 172.21.15.81:0/456783031 learned_addr learned my addr 172.21.15.81:0/456783031 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:57:08.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.468+0000 7f6bb936b700 1 -- 172.21.15.81:0/456783031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb00095f0 con 0x7f6bb41068b0 2024-05-08T23:57:08.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.468+0000 7f6bb936b700 1 --2- 172.21.15.81:0/456783031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb41068b0 0x7f6bb4196150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0006010 tx=0x7f6bb0004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:08.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.469+0000 7f6ba67fc700 1 -- 172.21.15.81:0/456783031 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bb001d070 con 0x7f6bb41068b0 2024-05-08T23:57:08.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.469+0000 7f6ba67fc700 1 -- 172.21.15.81:0/456783031 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6bb000bbb0 con 0x7f6bb41068b0 2024-05-08T23:57:08.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.469+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/456783031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb41968f0 con 0x7f6bb41068b0 2024-05-08T23:57:08.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.469+0000 7f6ba67fc700 1 -- 172.21.15.81:0/456783031 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6bb0003810 con 0x7f6bb41068b0 2024-05-08T23:57:08.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.469+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/456783031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb4196d70 con 0x7f6bb41068b0 2024-05-08T23:57:08.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.469+0000 7f6ba67fc700 1 -- 172.21.15.81:0/456783031 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f6bb0003a10 con 0x7f6bb41068b0 2024-05-08T23:57:08.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.470+0000 7f6ba67fc700 1 --2- 172.21.15.81:0/456783031 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6ba00387a0 0x7f6ba003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:08.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.470+0000 7f6ba67fc700 1 -- 172.21.15.81:0/456783031 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f6bb004c4f0 con 0x7f6bb41068b0 2024-05-08T23:57:08.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.470+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/456783031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb4101ff0 con 0x7f6bb41068b0 2024-05-08T23:57:08.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.470+0000 7f6bb8b6a700 1 --2- 172.21.15.81:0/456783031 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6ba00387a0 0x7f6ba003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:08.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.470+0000 7f6bb8b6a700 1 --2- 172.21.15.81:0/456783031 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6ba00387a0 0x7f6ba003ac60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8006fd0 tx=0x7f6ba8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:08.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.475+0000 7f6ba67fc700 1 -- 172.21.15.81:0/456783031 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6bb0026020 con 0x7f6bb41068b0 2024-05-08T23:57:08.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:08 smithi081 ceph-mon[42474]: Added host smithi171 2024-05-08T23:57:08.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:08.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.672+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/456783031 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6bb4197500 con 0x7f6ba00387a0 2024-05-08T23:57:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.673+0000 7f6ba67fc700 1 -- 172.21.15.81:0/456783031 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+240 (secure 0 0 0) 0x7f6bb4197500 con 0x7f6ba00387a0 2024-05-08T23:57:08.667 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-08T23:57:08.667 INFO:teuthology.orchestra.run.smithi081.stdout:[{"addr": "172.21.15.81", "hostname": "smithi081", "labels": [], "status": ""}, {"addr": "172.21.15.150", "hostname": "smithi150", "labels": [], "status": ""}, {"addr": "172.21.15.171", "hostname": "smithi171", "labels": [], "status": ""}] 2024-05-08T23:57:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.675+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/456783031 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6ba00387a0 msgr2=0x7f6ba003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.675+0000 7f6bbb5cf700 1 --2- 172.21.15.81:0/456783031 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6ba00387a0 0x7f6ba003ac60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8006fd0 tx=0x7f6ba8006e40 comp rx=0 tx=0).stop 2024-05-08T23:57:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.675+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/456783031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb41068b0 msgr2=0x7f6bb4196150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.675+0000 7f6bbb5cf700 1 --2- 172.21.15.81:0/456783031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb41068b0 0x7f6bb4196150 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0006010 tx=0x7f6bb0004ff0 comp rx=0 tx=0).stop 2024-05-08T23:57:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.675+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/456783031 shutdown_connections 2024-05-08T23:57:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.675+0000 7f6bbb5cf700 1 --2- 172.21.15.81:0/456783031 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6ba00387a0 0x7f6ba003ac60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.675+0000 7f6bbb5cf700 1 --2- 172.21.15.81:0/456783031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bb41068b0 0x7f6bb4196150 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.675+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/456783031 >> 172.21.15.81:0/456783031 conn(0x7f6bb40fc3a0 msgr2=0x7f6bb41084e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.675+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/456783031 shutdown_connections 2024-05-08T23:57:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:08.675+0000 7f6bbb5cf700 1 -- 172.21.15.81:0/456783031 wait complete. 2024-05-08T23:57:09.072 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-08T23:57:09.072 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-08T23:57:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:57:09.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:09 smithi081 ceph-mon[42474]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:09.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:09 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:10.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.226+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3942563572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffacc1057c0 msgr2=0x7ffacc105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:10.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.226+0000 7ffad3dc1700 1 --2- 172.21.15.81:0/3942563572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffacc1057c0 0x7ffacc105ba0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009910 tx=0x7ffac0009c20 comp rx=0 tx=0).stop 2024-05-08T23:57:10.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.226+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3942563572 shutdown_connections 2024-05-08T23:57:10.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.226+0000 7ffad3dc1700 1 --2- 172.21.15.81:0/3942563572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffacc1057c0 0x7ffacc105ba0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:10.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.226+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3942563572 >> 172.21.15.81:0/3942563572 conn(0x7ffacc0fb2b0 msgr2=0x7ffacc0fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:10.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.227+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3942563572 shutdown_connections 2024-05-08T23:57:10.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.227+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3942563572 wait complete. 2024-05-08T23:57:10.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.227+0000 7ffad3dc1700 1 Processor -- start 2024-05-08T23:57:10.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.227+0000 7ffad3dc1700 1 -- start start 2024-05-08T23:57:10.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.227+0000 7ffad3dc1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffacc1057c0 0x7ffacc196140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:10.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.227+0000 7ffad3dc1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc196680 con 0x7ffacc1057c0 2024-05-08T23:57:10.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.227+0000 7ffad1b5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffacc1057c0 0x7ffacc196140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:10.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.227+0000 7ffad1b5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffacc1057c0 0x7ffacc196140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51304/0 (socket says 172.21.15.81:51304) 2024-05-08T23:57:10.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.227+0000 7ffad1b5d700 1 -- 172.21.15.81:0/3926985490 learned_addr learned my addr 172.21.15.81:0/3926985490 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:57:10.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.228+0000 7ffad1b5d700 1 -- 172.21.15.81:0/3926985490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac00095f0 con 0x7ffacc1057c0 2024-05-08T23:57:10.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.228+0000 7ffad1b5d700 1 --2- 172.21.15.81:0/3926985490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffacc1057c0 0x7ffacc196140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffac0004f40 tx=0x7ffac0005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:10.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.228+0000 7ffabeffd700 1 -- 172.21.15.81:0/3926985490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffac001d070 con 0x7ffacc1057c0 2024-05-08T23:57:10.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.228+0000 7ffabeffd700 1 -- 172.21.15.81:0/3926985490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffac000bbb0 con 0x7ffacc1057c0 2024-05-08T23:57:10.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.228+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3926985490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc1968e0 con 0x7ffacc1057c0 2024-05-08T23:57:10.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.228+0000 7ffabeffd700 1 -- 172.21.15.81:0/3926985490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffac0003810 con 0x7ffacc1057c0 2024-05-08T23:57:10.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.228+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3926985490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc196d60 con 0x7ffacc1057c0 2024-05-08T23:57:10.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.229+0000 7ffabeffd700 1 -- 172.21.15.81:0/3926985490 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7ffac0003a40 con 0x7ffacc1057c0 2024-05-08T23:57:10.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.229+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3926985490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc100f00 con 0x7ffacc1057c0 2024-05-08T23:57:10.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.229+0000 7ffabeffd700 1 --2- 172.21.15.81:0/3926985490 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffab80387f0 0x7ffab803acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:10.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.229+0000 7ffabeffd700 1 -- 172.21.15.81:0/3926985490 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ffac004c520 con 0x7ffacc1057c0 2024-05-08T23:57:10.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.229+0000 7ffad135c700 1 --2- 172.21.15.81:0/3926985490 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffab80387f0 0x7ffab803acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:10.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.229+0000 7ffad135c700 1 --2- 172.21.15.81:0/3926985490 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffab80387f0 0x7ffab803acb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffac8006fd0 tx=0x7ffac8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:10.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.234+0000 7ffabeffd700 1 -- 172.21.15.81:0/3926985490 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ffac0029360 con 0x7ffacc1057c0 2024-05-08T23:57:10.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:10.432+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3926985490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ffacc109ac0 con 0x7ffacc1057c0 2024-05-08T23:57:10.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:10 smithi081 ceph-mon[42474]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T23:57:11.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:11.365+0000 7ffabeffd700 1 -- 172.21.15.81:0/3926985490 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7ffac0026070 con 0x7ffacc1057c0 2024-05-08T23:57:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:11.367+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3926985490 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffab80387f0 msgr2=0x7ffab803acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:11.367+0000 7ffad3dc1700 1 --2- 172.21.15.81:0/3926985490 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffab80387f0 0x7ffab803acb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffac8006fd0 tx=0x7ffac8006e40 comp rx=0 tx=0).stop 2024-05-08T23:57:11.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:11.367+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3926985490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffacc1057c0 msgr2=0x7ffacc196140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:11.367+0000 7ffad3dc1700 1 --2- 172.21.15.81:0/3926985490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffacc1057c0 0x7ffacc196140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ffac0004f40 tx=0x7ffac0005020 comp rx=0 tx=0).stop 2024-05-08T23:57:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:11.367+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3926985490 shutdown_connections 2024-05-08T23:57:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:11.367+0000 7ffad3dc1700 1 --2- 172.21.15.81:0/3926985490 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffab80387f0 0x7ffab803acb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:11.367+0000 7ffad3dc1700 1 --2- 172.21.15.81:0/3926985490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffacc1057c0 0x7ffacc196140 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:11.367+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3926985490 >> 172.21.15.81:0/3926985490 conn(0x7ffacc0fb2b0 msgr2=0x7ffacc107410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:11.368+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3926985490 shutdown_connections 2024-05-08T23:57:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:11.368+0000 7ffad3dc1700 1 -- 172.21.15.81:0/3926985490 wait complete. 2024-05-08T23:57:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-05-08T23:57:11.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:11 smithi081 ceph-mon[42474]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:11.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:11 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3926985490' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-08T23:57:11.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:11.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:11.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:11.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:11.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi171", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:57:11.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:11.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:11.709 INFO:tasks.cephadm:Adding mon.a on smithi081 2024-05-08T23:57:11.710 INFO:tasks.cephadm:Adding mon.b on smithi150 2024-05-08T23:57:11.710 INFO:tasks.cephadm:Adding mon.c on smithi171 2024-05-08T23:57:11.710 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch apply mon '3;smithi081:172.21.15.81=a;smithi150:172.21.15.150=b;smithi171:172.21.15.171=c' 2024-05-08T23:57:11.957 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:57:12.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:12 smithi081 ceph-mon[42474]: Updating smithi171:/etc/ceph/ceph.conf 2024-05-08T23:57:12.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:12 smithi081 ceph-mon[42474]: Updating smithi171:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:57:12.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:12 smithi081 ceph-mon[42474]: Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:57:12.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:12 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3926985490' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-08T23:57:12.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:12 smithi081 ceph-mon[42474]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:57:12.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:12 smithi081 ceph-mon[42474]: Updating smithi171:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T23:57:12.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:12 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:12.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:12 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:12.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:12 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:12.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.950+0000 7fd65e77d700 1 -- 172.21.15.171:0/127593177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6581057d0 msgr2=0x7fd658105bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:12.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.950+0000 7fd65e77d700 1 --2- 172.21.15.171:0/127593177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6581057d0 0x7fd658105bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd64c009910 tx=0x7fd64c009c20 comp rx=0 tx=0).stop 2024-05-08T23:57:12.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.950+0000 7fd65e77d700 1 -- 172.21.15.171:0/127593177 shutdown_connections 2024-05-08T23:57:12.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.950+0000 7fd65e77d700 1 --2- 172.21.15.171:0/127593177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6581057d0 0x7fd658105bb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:12.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.950+0000 7fd65e77d700 1 -- 172.21.15.171:0/127593177 >> 172.21.15.171:0/127593177 conn(0x7fd6580fb2e0 msgr2=0x7fd6580fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:12.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.950+0000 7fd65e77d700 1 -- 172.21.15.171:0/127593177 shutdown_connections 2024-05-08T23:57:12.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.950+0000 7fd65e77d700 1 -- 172.21.15.171:0/127593177 wait complete. 2024-05-08T23:57:12.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.951+0000 7fd65e77d700 1 Processor -- start 2024-05-08T23:57:12.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.951+0000 7fd65e77d700 1 -- start start 2024-05-08T23:57:12.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.951+0000 7fd65e77d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6581057d0 0x7fd658196160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:12.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.951+0000 7fd65e77d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6581966a0 con 0x7fd6581057d0 2024-05-08T23:57:12.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.951+0000 7fd657fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6581057d0 0x7fd658196160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:12.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.951+0000 7fd657fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6581057d0 0x7fd658196160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.171:48878/0 (socket says 172.21.15.171:48878) 2024-05-08T23:57:12.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.951+0000 7fd657fff700 1 -- 172.21.15.171:0/2230158325 learned_addr learned my addr 172.21.15.171:0/2230158325 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-08T23:57:12.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.951+0000 7fd657fff700 1 -- 172.21.15.171:0/2230158325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c0095f0 con 0x7fd6581057d0 2024-05-08T23:57:12.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.952+0000 7fd657fff700 1 --2- 172.21.15.171:0/2230158325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6581057d0 0x7fd658196160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd64c004f40 tx=0x7fd64c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:12.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.952+0000 7fd6557fa700 1 -- 172.21.15.171:0/2230158325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd64c01d070 con 0x7fd6581057d0 2024-05-08T23:57:12.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.952+0000 7fd65e77d700 1 -- 172.21.15.171:0/2230158325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd658196900 con 0x7fd6581057d0 2024-05-08T23:57:12.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.952+0000 7fd6557fa700 1 -- 172.21.15.171:0/2230158325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd64c00bbb0 con 0x7fd6581057d0 2024-05-08T23:57:12.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.952+0000 7fd6557fa700 1 -- 172.21.15.171:0/2230158325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd64c003810 con 0x7fd6581057d0 2024-05-08T23:57:12.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.952+0000 7fd65e77d700 1 -- 172.21.15.171:0/2230158325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd658196d80 con 0x7fd6581057d0 2024-05-08T23:57:12.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.953+0000 7fd6557fa700 1 -- 172.21.15.171:0/2230158325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fd64c00b6f0 con 0x7fd6581057d0 2024-05-08T23:57:12.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.953+0000 7fd65e77d700 1 -- 172.21.15.171:0/2230158325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd658100f10 con 0x7fd6581057d0 2024-05-08T23:57:12.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.953+0000 7fd6557fa700 1 --2- 172.21.15.171:0/2230158325 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd6400387a0 0x7fd64003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:12.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.953+0000 7fd6557fa700 1 -- 172.21.15.171:0/2230158325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd64c04c4a0 con 0x7fd6581057d0 2024-05-08T23:57:12.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.953+0000 7fd6577fe700 1 --2- 172.21.15.171:0/2230158325 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd6400387a0 0x7fd64003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:12.949 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.954+0000 7fd6577fe700 1 --2- 172.21.15.171:0/2230158325 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd6400387a0 0x7fd64003ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd648006fd0 tx=0x7fd648006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:12.953 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:12.958+0000 7fd6557fa700 1 -- 172.21.15.171:0/2230158325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd64c029540 con 0x7fd6581057d0 2024-05-08T23:57:13.153 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:13.158+0000 7fd65e77d700 1 -- 172.21.15.171:0/2230158325 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi081:172.21.15.81=a;smithi150:172.21.15.150=b;smithi171:172.21.15.171=c", "target": ["mon-mgr", ""]}) v1 -- 0x7fd658109b90 con 0x7fd6400387a0 2024-05-08T23:57:13.160 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:13.165+0000 7fd6557fa700 1 -- 172.21.15.171:0/2230158325 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd658109b90 con 0x7fd6400387a0 2024-05-08T23:57:13.160 INFO:teuthology.orchestra.run.smithi171.stdout:Scheduled mon update... 2024-05-08T23:57:13.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:13.167+0000 7fd65e77d700 1 -- 172.21.15.171:0/2230158325 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd6400387a0 msgr2=0x7fd64003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:13.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:13.167+0000 7fd65e77d700 1 --2- 172.21.15.171:0/2230158325 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd6400387a0 0x7fd64003ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd648006fd0 tx=0x7fd648006e40 comp rx=0 tx=0).stop 2024-05-08T23:57:13.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:13.167+0000 7fd65e77d700 1 -- 172.21.15.171:0/2230158325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6581057d0 msgr2=0x7fd658196160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:13.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:13.167+0000 7fd65e77d700 1 --2- 172.21.15.171:0/2230158325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6581057d0 0x7fd658196160 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd64c004f40 tx=0x7fd64c005020 comp rx=0 tx=0).stop 2024-05-08T23:57:13.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:13.167+0000 7fd65e77d700 1 -- 172.21.15.171:0/2230158325 shutdown_connections 2024-05-08T23:57:13.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:13.167+0000 7fd65e77d700 1 --2- 172.21.15.171:0/2230158325 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd6400387a0 0x7fd64003ac60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:13.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:13.167+0000 7fd65e77d700 1 --2- 172.21.15.171:0/2230158325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6581057d0 0x7fd658196160 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:13.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:13.167+0000 7fd65e77d700 1 -- 172.21.15.171:0/2230158325 >> 172.21.15.171:0/2230158325 conn(0x7fd6580fb2e0 msgr2=0x7fd658068980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:13.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:13.167+0000 7fd65e77d700 1 -- 172.21.15.171:0/2230158325 shutdown_connections 2024-05-08T23:57:13.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:13.167+0000 7fd65e77d700 1 -- 172.21.15.171:0/2230158325 wait complete. 2024-05-08T23:57:13.550 DEBUG:teuthology.orchestra.run.smithi150:mon.b> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mon.b.service 2024-05-08T23:57:13.553 DEBUG:teuthology.orchestra.run.smithi171:mon.c> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mon.c.service 2024-05-08T23:57:13.556 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T23:57:13.556 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T23:57:13.585 INFO:journalctl@ceph.mon.c.smithi171.stdout:-- Logs begin at Wed 2024-05-08 23:40:11 UTC. -- 2024-05-08T23:57:13.590 INFO:journalctl@ceph.mon.b.smithi150.stdout:-- Logs begin at Wed 2024-05-08 23:39:53 UTC. -- 2024-05-08T23:57:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:13 smithi081 ceph-mon[42474]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:13 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:13 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:13 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:13 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:13 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:13 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:57:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:13 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:13.911 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:57:14.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:14 smithi081 ceph-mon[42474]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi081:172.21.15.81=a;smithi150:172.21.15.150=b;smithi171:172.21.15.171=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:57:14.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:14 smithi081 ceph-mon[42474]: Saving service mon spec with placement smithi081:172.21.15.81=a;smithi150:172.21.15.150=b;smithi171:172.21.15.171=c;count:3 2024-05-08T23:57:14.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:14 smithi081 ceph-mon[42474]: Deploying daemon mon.c on smithi171 2024-05-08T23:57:15.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:15 smithi081 ceph-mon[42474]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:15.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.836+0000 7fd9ab548700 1 -- 172.21.15.171:0/3140387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a41057f0 msgr2=0x7fd9a4105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:15.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.836+0000 7fd9ab548700 1 --2- 172.21.15.171:0/3140387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a41057f0 0x7fd9a4105bd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0009910 tx=0x7fd9a0009c20 comp rx=0 tx=0).stop 2024-05-08T23:57:15.831 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.836+0000 7fd9ab548700 1 -- 172.21.15.171:0/3140387 shutdown_connections 2024-05-08T23:57:15.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.836+0000 7fd9ab548700 1 --2- 172.21.15.171:0/3140387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a41057f0 0x7fd9a4105bd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:15.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.836+0000 7fd9ab548700 1 -- 172.21.15.171:0/3140387 >> 172.21.15.171:0/3140387 conn(0x7fd9a40fb340 msgr2=0x7fd9a40fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:15.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.836+0000 7fd9ab548700 1 -- 172.21.15.171:0/3140387 shutdown_connections 2024-05-08T23:57:15.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.836+0000 7fd9ab548700 1 -- 172.21.15.171:0/3140387 wait complete. 2024-05-08T23:57:15.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.836+0000 7fd9ab548700 1 Processor -- start 2024-05-08T23:57:15.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.836+0000 7fd9ab548700 1 -- start start 2024-05-08T23:57:15.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.837+0000 7fd9ab548700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a41057f0 0x7fd9a4197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:15.832 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.837+0000 7fd9ab548700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a4069c20 con 0x7fd9a41057f0 2024-05-08T23:57:15.834 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.837+0000 7fd9a92e4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a41057f0 0x7fd9a4197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:15.834 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.837+0000 7fd9a92e4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a41057f0 0x7fd9a4197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.171:48886/0 (socket says 172.21.15.171:48886) 2024-05-08T23:57:15.834 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.837+0000 7fd9a92e4700 1 -- 172.21.15.171:0/2905385360 learned_addr learned my addr 172.21.15.171:0/2905385360 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-08T23:57:15.834 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.837+0000 7fd9a92e4700 1 -- 172.21.15.171:0/2905385360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a00095f0 con 0x7fd9a41057f0 2024-05-08T23:57:15.834 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.838+0000 7fd9a92e4700 1 --2- 172.21.15.171:0/2905385360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a41057f0 0x7fd9a4197020 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0004f40 tx=0x7fd9a0005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:15.834 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.838+0000 7fd99a7fc700 1 -- 172.21.15.171:0/2905385360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9a001d070 con 0x7fd9a41057f0 2024-05-08T23:57:15.834 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.838+0000 7fd9ab548700 1 -- 172.21.15.171:0/2905385360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a41975c0 con 0x7fd9a41057f0 2024-05-08T23:57:15.834 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.838+0000 7fd99a7fc700 1 -- 172.21.15.171:0/2905385360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd9a000bc10 con 0x7fd9a41057f0 2024-05-08T23:57:15.834 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.838+0000 7fd99a7fc700 1 -- 172.21.15.171:0/2905385360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9a00037d0 con 0x7fd9a41057f0 2024-05-08T23:57:15.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.838+0000 7fd9ab548700 1 -- 172.21.15.171:0/2905385360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a4197a40 con 0x7fd9a41057f0 2024-05-08T23:57:15.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.839+0000 7fd9ab548700 1 -- 172.21.15.171:0/2905385360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a4100f30 con 0x7fd9a41057f0 2024-05-08T23:57:15.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.839+0000 7fd99a7fc700 1 -- 172.21.15.171:0/2905385360 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fd9a000b6f0 con 0x7fd9a41057f0 2024-05-08T23:57:15.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.839+0000 7fd99a7fc700 1 --2- 172.21.15.171:0/2905385360 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd9900387a0 0x7fd99003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:15.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.839+0000 7fd99a7fc700 1 -- 172.21.15.171:0/2905385360 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd9a004c4d0 con 0x7fd9a41057f0 2024-05-08T23:57:15.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.839+0000 7fd9a8ae3700 1 --2- 172.21.15.171:0/2905385360 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd9900387a0 0x7fd99003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:15.835 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.840+0000 7fd9a8ae3700 1 --2- 172.21.15.171:0/2905385360 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd9900387a0 0x7fd99003ac60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd994006fd0 tx=0x7fd994006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:15.839 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:15.844+0000 7fd99a7fc700 1 -- 172.21.15.171:0/2905385360 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd9a0029540 con 0x7fd9a41057f0 2024-05-08T23:57:16.150 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:16.156+0000 7fd9ab548700 1 -- 172.21.15.171:0/2905385360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd9a40692e0 con 0x7fd9a41057f0 2024-05-08T23:57:16.151 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:16.156+0000 7fd99a7fc700 1 -- 172.21.15.171:0/2905385360 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7fd9a0026070 con 0x7fd9a41057f0 2024-05-08T23:57:16.151 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:57:16.151 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":1,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","modified":"2024-05-08T23:55:57.007660Z","created":"2024-05-08T23:55:57.007660Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-08T23:57:16.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:16.158+0000 7fd9ab548700 1 -- 172.21.15.171:0/2905385360 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd9900387a0 msgr2=0x7fd99003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:16.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:16.158+0000 7fd9ab548700 1 --2- 172.21.15.171:0/2905385360 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd9900387a0 0x7fd99003ac60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd994006fd0 tx=0x7fd994006e40 comp rx=0 tx=0).stop 2024-05-08T23:57:16.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:16.158+0000 7fd9ab548700 1 -- 172.21.15.171:0/2905385360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a41057f0 msgr2=0x7fd9a4197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:16.154 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:16.158+0000 7fd9ab548700 1 --2- 172.21.15.171:0/2905385360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a41057f0 0x7fd9a4197020 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0004f40 tx=0x7fd9a0005020 comp rx=0 tx=0).stop 2024-05-08T23:57:16.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:16.158+0000 7fd9ab548700 1 -- 172.21.15.171:0/2905385360 shutdown_connections 2024-05-08T23:57:16.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:16.159+0000 7fd9ab548700 1 --2- 172.21.15.171:0/2905385360 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd9900387a0 0x7fd99003ac60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:16.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:16.159+0000 7fd9ab548700 1 --2- 172.21.15.171:0/2905385360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9a41057f0 0x7fd9a4197020 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:16.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:16.159+0000 7fd9ab548700 1 -- 172.21.15.171:0/2905385360 >> 172.21.15.171:0/2905385360 conn(0x7fd9a40fb340 msgr2=0x7fd9a4107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:16.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:16.159+0000 7fd9ab548700 1 -- 172.21.15.171:0/2905385360 shutdown_connections 2024-05-08T23:57:16.155 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:16.159+0000 7fd9ab548700 1 -- 172.21.15.171:0/2905385360 wait complete. 2024-05-08T23:57:16.155 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 1 2024-05-08T23:57:16.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:16 smithi081 ceph-mon[42474]: from='client.? 172.21.15.171:0/2905385360' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:57:16.704 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:16 smithi171 ceph-mon[47351]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-08T23:57:17.706 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T23:57:17.706 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T23:57:17.936 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:57:22.035 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.040+0000 7f72e9852700 1 -- 172.21.15.171:0/2080034105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e4101c40 msgr2=0x7f72d0005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:22.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.040+0000 7f72e9852700 1 --2- 172.21.15.171:0/2080034105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e4101c40 0x7f72d0005610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f72d4005fa0 tx=0x7f72d400ffc0 comp rx=0 tx=0).stop 2024-05-08T23:57:22.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.040+0000 7f72e9852700 1 -- 172.21.15.171:0/2080034105 shutdown_connections 2024-05-08T23:57:22.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.040+0000 7f72e9852700 1 --2- 172.21.15.171:0/2080034105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e4101c40 0x7f72d0005610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:22.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.040+0000 7f72e9852700 1 -- 172.21.15.171:0/2080034105 >> 172.21.15.171:0/2080034105 conn(0x7f72e40fb450 msgr2=0x7f72e40fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:22.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.041+0000 7f72e9852700 1 -- 172.21.15.171:0/2080034105 shutdown_connections 2024-05-08T23:57:22.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.041+0000 7f72e9852700 1 -- 172.21.15.171:0/2080034105 wait complete. 2024-05-08T23:57:22.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.041+0000 7f72e9852700 1 Processor -- start 2024-05-08T23:57:22.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.042+0000 7f72e9852700 1 -- start start 2024-05-08T23:57:22.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.042+0000 7f72e9852700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e4101c40 0x7f72e41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:22.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.042+0000 7f72e9852700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72e41989f0 0x7f72e419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:22.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.042+0000 7f72e9852700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e4198f80 con 0x7f72e4101c40 2024-05-08T23:57:22.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.042+0000 7f72e9852700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e41990f0 con 0x7f72e41989f0 2024-05-08T23:57:22.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.042+0000 7f72e27fc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72e41989f0 0x7f72e419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:22.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.042+0000 7f72e2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e4101c40 0x7f72e41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:22.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.042+0000 7f72e27fc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72e41989f0 0x7f72e419cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:41390/0 (socket says 172.21.15.171:41390) 2024-05-08T23:57:22.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.042+0000 7f72e27fc700 1 -- 172.21.15.171:0/3380078988 learned_addr learned my addr 172.21.15.171:0/3380078988 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-08T23:57:22.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.042+0000 7f72e2ffd700 1 --2- 172.21.15.171:0/3380078988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e4101c40 0x7f72e41984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.171:53220/0 (socket says 172.21.15.171:53220) 2024-05-08T23:57:22.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.043+0000 7f72e27fc700 1 -- 172.21.15.171:0/3380078988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72e41989f0 msgr2=0x7f72e419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-08T23:57:22.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.043+0000 7f72e27fc700 1 -- 172.21.15.171:0/3380078988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72e41989f0 msgr2=0x7f72e419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T23:57:22.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.043+0000 7f72e27fc700 1 --2- 172.21.15.171:0/3380078988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72e41989f0 0x7f72e419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T23:57:22.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.043+0000 7f72e27fc700 1 --2- 172.21.15.171:0/3380078988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72e41989f0 0x7f72e419cda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:57:22.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.043+0000 7f72e2ffd700 1 -- 172.21.15.171:0/3380078988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72e41989f0 msgr2=0x7f72e419cda0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:57:22.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.043+0000 7f72e2ffd700 1 --2- 172.21.15.171:0/3380078988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72e41989f0 0x7f72e419cda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:22.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.043+0000 7f72e2ffd700 1 -- 172.21.15.171:0/3380078988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d400f9c0 con 0x7f72e4101c40 2024-05-08T23:57:22.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.043+0000 7f72e2ffd700 1 --2- 172.21.15.171:0/3380078988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e4101c40 0x7f72e41984b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f72d400f510 tx=0x7f72d4004d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:22.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.043+0000 7f72e8850700 1 -- 172.21.15.171:0/3380078988 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f72d4005be0 con 0x7f72e4101c40 2024-05-08T23:57:22.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.043+0000 7f72e8850700 1 -- 172.21.15.171:0/3380078988 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f72d4021040 con 0x7f72e4101c40 2024-05-08T23:57:22.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.043+0000 7f72e9852700 1 -- 172.21.15.171:0/3380078988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72e419d340 con 0x7f72e4101c40 2024-05-08T23:57:22.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.043+0000 7f72e8850700 1 -- 172.21.15.171:0/3380078988 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f72d401be80 con 0x7f72e4101c40 2024-05-08T23:57:22.040 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.043+0000 7f72e9852700 1 -- 172.21.15.171:0/3380078988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72e419d890 con 0x7f72e4101c40 2024-05-08T23:57:22.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.044+0000 7f72e8850700 1 -- 172.21.15.171:0/3380078988 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f72d40114c0 con 0x7f72e4101c40 2024-05-08T23:57:22.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.044+0000 7f72e9852700 1 -- 172.21.15.171:0/3380078988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72e4105a30 con 0x7f72e4101c40 2024-05-08T23:57:22.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.045+0000 7f72e8850700 1 --2- 172.21.15.171:0/3380078988 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f72c40385e0 0x7f72c403aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:22.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.045+0000 7f72e8850700 1 -- 172.21.15.171:0/3380078988 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f72d404d7d0 con 0x7f72e4101c40 2024-05-08T23:57:22.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.045+0000 7f72e27fc700 1 --2- 172.21.15.171:0/3380078988 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f72c40385e0 0x7f72c403aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:22.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.046+0000 7f72e27fc700 1 --2- 172.21.15.171:0/3380078988 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f72c40385e0 0x7f72c403aaa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009180 tx=0x7f72cc008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:22.045 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.050+0000 7f72e8850700 1 -- 172.21.15.171:0/3380078988 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f72d4019330 con 0x7f72e4101c40 2024-05-08T23:57:22.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:57:22.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:22.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: mon.a calling monitor election 2024-05-08T23:57:22.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:22.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:22.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:22.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: mon.c calling monitor election 2024-05-08T23:57:22.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:22.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:22.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:22.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:22.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T23:57:22.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: monmap e2: 2 mons at {a=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],c=[v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:57:22.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: fsmap 2024-05-08T23:57:22.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:57:22.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: mgrmap e13: x(active, since 35s) 2024-05-08T23:57:22.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: overall HEALTH_OK 2024-05-08T23:57:22.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:22.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:22.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:57:22.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:22.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: mon.a calling monitor election 2024-05-08T23:57:22.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:22.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:22.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:22.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: mon.c calling monitor election 2024-05-08T23:57:22.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:22.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:22.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:22.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:22.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T23:57:22.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: monmap e2: 2 mons at {a=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],c=[v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:57:22.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: fsmap 2024-05-08T23:57:22.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:57:22.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: mgrmap e13: x(active, since 35s) 2024-05-08T23:57:22.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: overall HEALTH_OK 2024-05-08T23:57:22.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:22.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:21 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:22.317 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.322+0000 7f72e9852700 1 -- 172.21.15.171:0/3380078988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f72e419dc00 con 0x7f72e4101c40 2024-05-08T23:57:22.318 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.323+0000 7f72e8850700 1 -- 172.21.15.171:0/3380078988 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7f72d4010bc0 con 0x7f72e4101c40 2024-05-08T23:57:22.318 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:57:22.318 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":2,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","modified":"2024-05-08T23:57:16.570399Z","created":"2024-05-08T23:55:57.007660Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:3300","nonce":0},{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-08T23:57:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.325+0000 7f72e9852700 1 -- 172.21.15.171:0/3380078988 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f72c40385e0 msgr2=0x7f72c403aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.325+0000 7f72e9852700 1 --2- 172.21.15.171:0/3380078988 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f72c40385e0 0x7f72c403aaa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f72cc009180 tx=0x7f72cc008040 comp rx=0 tx=0).stop 2024-05-08T23:57:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.325+0000 7f72e9852700 1 -- 172.21.15.171:0/3380078988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e4101c40 msgr2=0x7f72e41984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.325+0000 7f72e9852700 1 --2- 172.21.15.171:0/3380078988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e4101c40 0x7f72e41984b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f72d400f510 tx=0x7f72d4004d60 comp rx=0 tx=0).stop 2024-05-08T23:57:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.325+0000 7f72e9852700 1 -- 172.21.15.171:0/3380078988 shutdown_connections 2024-05-08T23:57:22.320 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.325+0000 7f72e9852700 1 --2- 172.21.15.171:0/3380078988 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f72c40385e0 0x7f72c403aaa0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.325+0000 7f72e9852700 1 --2- 172.21.15.171:0/3380078988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e4101c40 0x7f72e41984b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.325+0000 7f72e9852700 1 --2- 172.21.15.171:0/3380078988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72e41989f0 0x7f72e419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.325+0000 7f72e9852700 1 -- 172.21.15.171:0/3380078988 >> 172.21.15.171:0/3380078988 conn(0x7f72e40fb450 msgr2=0x7f72e40fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.325+0000 7f72e9852700 1 -- 172.21.15.171:0/3380078988 shutdown_connections 2024-05-08T23:57:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:22.325+0000 7f72e9852700 1 -- 172.21.15.171:0/3380078988 wait complete. 2024-05-08T23:57:22.321 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 2 2024-05-08T23:57:23.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:22 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:23.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:22 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:57:23.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:22 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:23.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:22 smithi171 ceph-mon[47351]: Deploying daemon mon.b on smithi150 2024-05-08T23:57:23.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:22 smithi171 ceph-mon[47351]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:23.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:22 smithi171 ceph-mon[47351]: from='client.? 172.21.15.171:0/3380078988' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:57:23.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:22 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:23.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:22 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:23.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:22 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:57:23.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:22 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:23.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:22 smithi081 ceph-mon[42474]: Deploying daemon mon.b on smithi150 2024-05-08T23:57:23.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:22 smithi081 ceph-mon[42474]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:23.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:22 smithi081 ceph-mon[42474]: from='client.? 172.21.15.171:0/3380078988' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:57:23.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:22 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:23.704 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T23:57:23.704 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T23:57:23.933 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:57:24.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 systemd[1]: Started Ceph mon.b for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-08T23:57:24.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.b@-1(synchronizing).mds e1 new map 2024-05-08T23:57:24.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-08T23:57:24.515 INFO:journalctl@ceph.mon.b.smithi150.stdout: e1 2024-05-08T23:57:24.515 INFO:journalctl@ceph.mon.b.smithi150.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T23:57:24.515 INFO:journalctl@ceph.mon.b.smithi150.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-08T23:57:24.515 INFO:journalctl@ceph.mon.b.smithi150.stdout: legacy client fscid: -1 2024-05-08T23:57:24.516 INFO:journalctl@ceph.mon.b.smithi150.stdout: 2024-05-08T23:57:24.516 INFO:journalctl@ceph.mon.b.smithi150.stdout: No filesystems configured 2024-05-08T23:57:24.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-08T23:57:24.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-08T23:57:24.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-08T23:57:24.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-08T23:57:24.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-08T23:57:24.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-08T23:57:24.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-08T23:57:24.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:57:24.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:57:24.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T23:57:24.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: Updating smithi171:/etc/ceph/ceph.conf 2024-05-08T23:57:24.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: Updating smithi171:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:57:24.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:57:24.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3926985490' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-08T23:57:24.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:57:24.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: Updating smithi171:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T23:57:24.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:24.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:24.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:24.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:24.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:24.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:24.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:24.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:24.518 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:24.518 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:57:24.518 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:24.518 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi081:172.21.15.81=a;smithi150:172.21.15.150=b;smithi171:172.21.15.171=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:57:24.518 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: Saving service mon spec with placement smithi081:172.21.15.81=a;smithi150:172.21.15.150=b;smithi171:172.21.15.171=c;count:3 2024-05-08T23:57:24.518 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: Deploying daemon mon.c on smithi171 2024-05-08T23:57:24.518 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:24.518 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='client.? 172.21.15.171:0/2905385360' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:57:24.518 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:57:24.518 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:24.518 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.a calling monitor election 2024-05-08T23:57:24.518 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:24.519 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:24.519 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:24.519 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.c calling monitor election 2024-05-08T23:57:24.519 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:24.519 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:24.519 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:24.519 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:24.519 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T23:57:24.519 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: monmap e2: 2 mons at {a=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],c=[v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:57:24.519 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: fsmap 2024-05-08T23:57:24.519 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:57:24.519 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mgrmap e13: x(active, since 35s) 2024-05-08T23:57:24.519 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: overall HEALTH_OK 2024-05-08T23:57:24.519 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:24.520 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:24.520 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:24.520 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:57:24.520 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:24.520 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: Deploying daemon mon.b on smithi150 2024-05-08T23:57:24.520 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:24.520 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='client.? 172.21.15.171:0/3380078988' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:57:24.520 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:24.520 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:24 smithi150 ceph-mon[46187]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-08T23:57:29.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.349+0000 7f36b0862700 1 -- 172.21.15.171:0/2521140708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36940057d0 msgr2=0x7f3694007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:29.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.349+0000 7f36b0862700 1 --2- 172.21.15.171:0/2521140708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36940057d0 0x7f3694007c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0ff7f0 tx=0x7f36a000fe60 comp rx=0 tx=0).stop 2024-05-08T23:57:29.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.350+0000 7f36b0862700 1 -- 172.21.15.171:0/2521140708 shutdown_connections 2024-05-08T23:57:29.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.350+0000 7f36b0862700 1 --2- 172.21.15.171:0/2521140708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36940057d0 0x7f3694007c60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:29.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.350+0000 7f36b0862700 1 -- 172.21.15.171:0/2521140708 >> 172.21.15.171:0/2521140708 conn(0x7f36ac076570 msgr2=0x7f36ac0fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:29.345 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.350+0000 7f36b0862700 1 -- 172.21.15.171:0/2521140708 shutdown_connections 2024-05-08T23:57:29.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.350+0000 7f36b0862700 1 -- 172.21.15.171:0/2521140708 wait complete. 2024-05-08T23:57:29.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.351+0000 7f36b0862700 1 Processor -- start 2024-05-08T23:57:29.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.351+0000 7f36b0862700 1 -- start start 2024-05-08T23:57:29.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36b0862700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36940057d0 0x7f36ac1a26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:29.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36b0862700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36ac1a2c10 0x7f36ac19c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:29.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36b0862700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36ac19cd50 0x7f36ac19d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:29.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36b0862700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac1a3280 con 0x7f36ac1a2c10 2024-05-08T23:57:29.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36b0862700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac1a94f0 con 0x7f36ac19cd50 2024-05-08T23:57:29.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36b0862700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac1a9660 con 0x7f36940057d0 2024-05-08T23:57:29.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36aa59c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36940057d0 0x7f36ac1a26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:29.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36a9d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36ac1a2c10 0x7f36ac19c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:29.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36aa59c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36940057d0 0x7f36ac1a26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:41404/0 (socket says 172.21.15.171:41404) 2024-05-08T23:57:29.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36aa59c700 1 -- 172.21.15.171:0/3127044455 learned_addr learned my addr 172.21.15.171:0/3127044455 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-08T23:57:29.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36aa59c700 1 -- 172.21.15.171:0/3127044455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36940057d0 msgr2=0x7f36ac1a26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-08T23:57:29.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36aa59c700 1 -- 172.21.15.171:0/3127044455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36940057d0 msgr2=0x7f36ac1a26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T23:57:29.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36aa59c700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36940057d0 0x7f36ac1a26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T23:57:29.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36aad9d700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36ac19cd50 0x7f36ac19d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:29.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36aa59c700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36940057d0 0x7f36ac1a26d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:57:29.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36aad9d700 1 -- 172.21.15.171:0/3127044455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36ac19cd50 msgr2=0x7f36ac19d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-05-08T23:57:29.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36aad9d700 1 -- 172.21.15.171:0/3127044455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36ac19cd50 msgr2=0x7f36ac19d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T23:57:29.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36aad9d700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36ac19cd50 0x7f36ac19d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T23:57:29.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36aad9d700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36ac19cd50 0x7f36ac19d1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:57:29.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36a9d9b700 1 -- 172.21.15.171:0/3127044455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36940057d0 msgr2=0x7f36ac1a26d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:57:29.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36a9d9b700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36940057d0 0x7f36ac1a26d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:29.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36a9d9b700 1 -- 172.21.15.171:0/3127044455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36ac19cd50 msgr2=0x7f36ac19d1d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T23:57:29.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36a9d9b700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36ac19cd50 0x7f36ac19d1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:29.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.352+0000 7f36a9d9b700 1 -- 172.21.15.171:0/3127044455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a000f8b0 con 0x7f36ac1a2c10 2024-05-08T23:57:29.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.353+0000 7f36a9d9b700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36ac1a2c10 0x7f36ac19c810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f369c00b550 tx=0x7f369c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:29.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.353+0000 7f369b7fe700 1 -- 172.21.15.171:0/3127044455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c004230 con 0x7f36ac1a2c10 2024-05-08T23:57:29.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.353+0000 7f369b7fe700 1 -- 172.21.15.171:0/3127044455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f369c004390 con 0x7f36ac1a2c10 2024-05-08T23:57:29.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.353+0000 7f369b7fe700 1 -- 172.21.15.171:0/3127044455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c011af0 con 0x7f36ac1a2c10 2024-05-08T23:57:29.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.353+0000 7f36b0862700 1 -- 172.21.15.171:0/3127044455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac1a9940 con 0x7f36ac1a2c10 2024-05-08T23:57:29.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.353+0000 7f36b0862700 1 -- 172.21.15.171:0/3127044455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac1a9e40 con 0x7f36ac1a2c10 2024-05-08T23:57:29.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.354+0000 7f369b7fe700 1 -- 172.21.15.171:0/3127044455 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f369c011c50 con 0x7f36ac1a2c10 2024-05-08T23:57:29.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.354+0000 7f369b7fe700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f368c038c20 0x7f368c03b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:29.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.354+0000 7f36b0862700 1 -- 172.21.15.171:0/3127044455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac18de40 con 0x7f36ac1a2c10 2024-05-08T23:57:29.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.355+0000 7f369b7fe700 1 -- 172.21.15.171:0/3127044455 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f369c04ad00 con 0x7f36ac1a2c10 2024-05-08T23:57:29.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.355+0000 7f36aa59c700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f368c038c20 0x7f368c03b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:29.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.355+0000 7f36aa59c700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f368c038c20 0x7f368c03b0e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f36a0005850 tx=0x7f36a0005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:29.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.361+0000 7f369b7fe700 1 -- 172.21.15.171:0/3127044455 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f369c01a400 con 0x7f36ac1a2c10 2024-05-08T23:57:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:57:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: mon.c calling monitor election 2024-05-08T23:57:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: mon.a calling monitor election 2024-05-08T23:57:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:29.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:29.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:29.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:29.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:29.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T23:57:29.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: monmap e3: 3 mons at {a=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],b=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0],c=[v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:57:29.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: fsmap 2024-05-08T23:57:29.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:57:29.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: mgrmap e13: x(active, since 43s) 2024-05-08T23:57:29.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-05-08T23:57:29.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-05-08T23:57:29.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-05-08T23:57:29.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: mon.b (rank 2) addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] is down (out of quorum) 2024-05-08T23:57:29.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:29.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:29.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:29.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:29.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.645+0000 7f36b0862700 1 -- 172.21.15.171:0/3127044455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f36ac19dcd0 con 0x7f36ac1a2c10 2024-05-08T23:57:29.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.645+0000 7f369b7fe700 1 -- 172.21.15.171:0/3127044455 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1274 (secure 0 0 0) 0x7f369c00f2e0 con 0x7f36ac1a2c10 2024-05-08T23:57:29.640 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-05-08T23:57:29.640 INFO:teuthology.orchestra.run.smithi171.stdout:{"epoch":3,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","modified":"2024-05-08T23:57:24.266448Z","created":"2024-05-08T23:55:57.007660Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:3300","nonce":0},{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-08T23:57:29.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.648+0000 7f36b0862700 1 -- 172.21.15.171:0/3127044455 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f368c038c20 msgr2=0x7f368c03b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:29.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.648+0000 7f36b0862700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f368c038c20 0x7f368c03b0e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f36a0005850 tx=0x7f36a0005a90 comp rx=0 tx=0).stop 2024-05-08T23:57:29.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.648+0000 7f36b0862700 1 -- 172.21.15.171:0/3127044455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36ac1a2c10 msgr2=0x7f36ac19c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:29.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.648+0000 7f36b0862700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36ac1a2c10 0x7f36ac19c810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f369c00b550 tx=0x7f369c00b910 comp rx=0 tx=0).stop 2024-05-08T23:57:29.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.648+0000 7f36b0862700 1 -- 172.21.15.171:0/3127044455 shutdown_connections 2024-05-08T23:57:29.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.648+0000 7f36b0862700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f368c038c20 0x7f368c03b0e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:29.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.648+0000 7f36b0862700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f36ac19cd50 0x7f36ac19d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:29.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.648+0000 7f36b0862700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36940057d0 0x7f36ac1a26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:29.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.648+0000 7f36b0862700 1 --2- 172.21.15.171:0/3127044455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36ac1a2c10 0x7f36ac19c810 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:29.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.648+0000 7f36b0862700 1 -- 172.21.15.171:0/3127044455 >> 172.21.15.171:0/3127044455 conn(0x7f36ac076570 msgr2=0x7f36ac0fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:29.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.648+0000 7f36b0862700 1 -- 172.21.15.171:0/3127044455 shutdown_connections 2024-05-08T23:57:29.643 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:29.648+0000 7f36b0862700 1 -- 172.21.15.171:0/3127044455 wait complete. 2024-05-08T23:57:29.644 INFO:teuthology.orchestra.run.smithi171.stderr:dumped monmap epoch 3 2024-05-08T23:57:29.663 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:29.663 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:57:29.663 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: mon.c calling monitor election 2024-05-08T23:57:29.663 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: mon.a calling monitor election 2024-05-08T23:57:29.663 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:29.664 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:29.664 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:29.664 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:29.664 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:29.664 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:29.664 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:29.664 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:29.664 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:29.664 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T23:57:29.664 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: monmap e3: 3 mons at {a=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],b=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0],c=[v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:57:29.664 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: fsmap 2024-05-08T23:57:29.664 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:57:29.664 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: mgrmap e13: x(active, since 43s) 2024-05-08T23:57:29.664 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-05-08T23:57:29.665 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-05-08T23:57:29.665 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-05-08T23:57:29.665 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: mon.b (rank 2) addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] is down (out of quorum) 2024-05-08T23:57:29.665 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:29.665 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:29.665 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:29.665 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:30.025 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-08T23:57:30.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-08T23:57:30.255 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:57:30.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:30 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:30.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:30 smithi081 ceph-mon[42474]: from='client.? 172.21.15.171:0/3127044455' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:57:30.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:30 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:30.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:30 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:30.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:30 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:30.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:30 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:30.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:30 smithi171 ceph-mon[47351]: from='client.? 172.21.15.171:0/3127044455' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:57:30.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:30 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:30.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:30 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:30.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:30 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.225+0000 7fd740aa2700 1 -- 172.21.15.81:0/859639256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd73c1068b0 msgr2=0x7fd73c106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.225+0000 7fd740aa2700 1 --2- 172.21.15.81:0/859639256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd73c1068b0 0x7fd73c106c90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009910 tx=0x7fd72c009c20 comp rx=0 tx=0).stop 2024-05-08T23:57:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.226+0000 7fd740aa2700 1 -- 172.21.15.81:0/859639256 shutdown_connections 2024-05-08T23:57:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.226+0000 7fd740aa2700 1 --2- 172.21.15.81:0/859639256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd73c1068b0 0x7fd73c106c90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:31.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.226+0000 7fd740aa2700 1 -- 172.21.15.81:0/859639256 >> 172.21.15.81:0/859639256 conn(0x7fd73c0fc3a0 msgr2=0x7fd73c0fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.226+0000 7fd740aa2700 1 -- 172.21.15.81:0/859639256 shutdown_connections 2024-05-08T23:57:31.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.226+0000 7fd740aa2700 1 -- 172.21.15.81:0/859639256 wait complete. 2024-05-08T23:57:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.226+0000 7fd740aa2700 1 Processor -- start 2024-05-08T23:57:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.226+0000 7fd740aa2700 1 -- start start 2024-05-08T23:57:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd740aa2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd73c1068b0 0x7fd73c1962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd740aa2700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd73c1967e0 0x7fd73c19ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd740aa2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd73c19b0d0 0x7fd73c19b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd740aa2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c196ed0 con 0x7fd73c19b0d0 2024-05-08T23:57:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd740aa2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c1a2e40 con 0x7fd73c1068b0 2024-05-08T23:57:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd740aa2700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c1a2f80 con 0x7fd73c1967e0 2024-05-08T23:57:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd73ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd73c19b0d0 0x7fd73c19b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd73ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd73c19b0d0 0x7fd73c19b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58426/0 (socket says 172.21.15.81:58426) 2024-05-08T23:57:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd73ad9d700 1 -- 172.21.15.81:0/3573838924 learned_addr learned my addr 172.21.15.81:0/3573838924 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:57:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd739d9b700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd73c1967e0 0x7fd73c19ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd73a59c700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd73c1068b0 0x7fd73c1962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd739d9b700 1 -- 172.21.15.81:0/3573838924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd73c1967e0 msgr2=0x7fd73c19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-08T23:57:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd739d9b700 1 -- 172.21.15.81:0/3573838924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd73c1967e0 msgr2=0x7fd73c19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T23:57:31.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd739d9b700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd73c1967e0 0x7fd73c19ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T23:57:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd73ad9d700 1 -- 172.21.15.81:0/3573838924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd73c1967e0 msgr2=0x7fd73c19ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd739d9b700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd73c1967e0 0x7fd73c19ab90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:57:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd73a59c700 1 -- 172.21.15.81:0/3573838924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd73c1068b0 msgr2=0x7fd73c1962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-08T23:57:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd73a59c700 1 -- 172.21.15.81:0/3573838924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd73c1068b0 msgr2=0x7fd73c1962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T23:57:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd73ad9d700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd73c1967e0 0x7fd73c19ab90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd73a59c700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd73c1068b0 0x7fd73c1962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T23:57:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd73ad9d700 1 -- 172.21.15.81:0/3573838924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd73c1068b0 msgr2=0x7fd73c1962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd73a59c700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd73c1068b0 0x7fd73c1962a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T23:57:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd73ad9d700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd73c1068b0 0x7fd73c1962a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd73ad9d700 1 -- 172.21.15.81:0/3573838924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c0095f0 con 0x7fd73c19b0d0 2024-05-08T23:57:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.227+0000 7fd73ad9d700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd73c19b0d0 0x7fd73c19b580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd73400ba50 tx=0x7fd73400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.228+0000 7fd72b7fe700 1 -- 172.21.15.81:0/3573838924 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73400cab0 con 0x7fd73c19b0d0 2024-05-08T23:57:31.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.228+0000 7fd72b7fe700 1 -- 172.21.15.81:0/3573838924 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd73400cc10 con 0x7fd73c19b0d0 2024-05-08T23:57:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.228+0000 7fd740aa2700 1 -- 172.21.15.81:0/3573838924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c1a3260 con 0x7fd73c19b0d0 2024-05-08T23:57:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.228+0000 7fd72b7fe700 1 -- 172.21.15.81:0/3573838924 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7340075b0 con 0x7fd73c19b0d0 2024-05-08T23:57:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.228+0000 7fd740aa2700 1 -- 172.21.15.81:0/3573838924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c1a3710 con 0x7fd73c19b0d0 2024-05-08T23:57:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.228+0000 7fd72b7fe700 1 -- 172.21.15.81:0/3573838924 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fd734007710 con 0x7fd73c19b0d0 2024-05-08T23:57:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.229+0000 7fd72b7fe700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd724038c20 0x7fd72403b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.229+0000 7fd72b7fe700 1 -- 172.21.15.81:0/3573838924 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd73404ac00 con 0x7fd73c19b0d0 2024-05-08T23:57:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.229+0000 7fd740aa2700 1 -- 172.21.15.81:0/3573838924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73c101ff0 con 0x7fd73c19b0d0 2024-05-08T23:57:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.229+0000 7fd73a59c700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd724038c20 0x7fd72403b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:31.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.229+0000 7fd73a59c700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd724038c20 0x7fd72403b0e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0051a0 tx=0x7fd72c00b560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:31.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.234+0000 7fd72b7fe700 1 -- 172.21.15.81:0/3573838924 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd73401b8b0 con 0x7fd73c19b0d0 2024-05-08T23:57:31.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.445+0000 7fd740aa2700 1 -- 172.21.15.81:0/3573838924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fd73c1975e0 con 0x7fd73c19b0d0 2024-05-08T23:57:31.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.446+0000 7fd72b7fe700 1 -- 172.21.15.81:0/3573838924 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+275 (secure 0 0 0) 0x7fd73401b2c0 con 0x7fd73c19b0d0 2024-05-08T23:57:31.441 INFO:teuthology.orchestra.run.smithi081.stdout:# minimal ceph.conf for 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:57:31.441 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-05-08T23:57:31.441 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-08T23:57:31.441 INFO:teuthology.orchestra.run.smithi081.stdout: mon_host = [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-05-08T23:57:31.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.448+0000 7fd740aa2700 1 -- 172.21.15.81:0/3573838924 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd724038c20 msgr2=0x7fd72403b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.448+0000 7fd740aa2700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd724038c20 0x7fd72403b0e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0051a0 tx=0x7fd72c00b560 comp rx=0 tx=0).stop 2024-05-08T23:57:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.448+0000 7fd740aa2700 1 -- 172.21.15.81:0/3573838924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd73c19b0d0 msgr2=0x7fd73c19b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.448+0000 7fd740aa2700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd73c19b0d0 0x7fd73c19b580 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd73400ba50 tx=0x7fd73400be10 comp rx=0 tx=0).stop 2024-05-08T23:57:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.448+0000 7fd740aa2700 1 -- 172.21.15.81:0/3573838924 shutdown_connections 2024-05-08T23:57:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.448+0000 7fd740aa2700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd724038c20 0x7fd72403b0e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.448+0000 7fd740aa2700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd73c1068b0 0x7fd73c1962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.448+0000 7fd740aa2700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd73c19b0d0 0x7fd73c19b580 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.448+0000 7fd740aa2700 1 --2- 172.21.15.81:0/3573838924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd73c1967e0 0x7fd73c19ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.448+0000 7fd740aa2700 1 -- 172.21.15.81:0/3573838924 >> 172.21.15.81:0/3573838924 conn(0x7fd73c0fc3a0 msgr2=0x7fd73c1023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.448+0000 7fd740aa2700 1 -- 172.21.15.81:0/3573838924 shutdown_connections 2024-05-08T23:57:31.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:31.448+0000 7fd740aa2700 1 -- 172.21.15.81:0/3573838924 wait complete. 2024-05-08T23:57:31.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:57:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: mon.c calling monitor election 2024-05-08T23:57:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: mon.a calling monitor election 2024-05-08T23:57:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:57:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T23:57:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: monmap e3: 3 mons at {a=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],b=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0],c=[v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:57:31.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: fsmap 2024-05-08T23:57:31.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:57:31.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: mgrmap e13: x(active, since 43s) 2024-05-08T23:57:31.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-05-08T23:57:31.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-05-08T23:57:31.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-05-08T23:57:31.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: mon.b (rank 2) addr [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] is down (out of quorum) 2024-05-08T23:57:31.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:31.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:31.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:31.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:31.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:31.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='client.? 172.21.15.171:0/3127044455' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T23:57:31.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:31.767 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:31.767 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:31.897 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-08T23:57:31.897 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T23:57:31.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T23:57:31.928 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T23:57:31.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:57:31.999 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-08T23:57:31.999 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T23:57:32.036 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-08T23:57:32.036 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:57:32.109 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-08T23:57:32.110 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T23:57:32.145 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-08T23:57:32.145 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T23:57:32.215 INFO:tasks.cephadm:Adding mgr.x on smithi081 2024-05-08T23:57:32.215 INFO:tasks.cephadm:Adding mgr.y on smithi150 2024-05-08T23:57:32.215 INFO:tasks.cephadm:Adding mgr.z on smithi171 2024-05-08T23:57:32.215 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch apply mgr '3;smithi081=x;smithi150=y;smithi171=z' 2024-05-08T23:57:32.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: mon.b calling monitor election 2024-05-08T23:57:32.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: Updating smithi081:/etc/ceph/ceph.conf 2024-05-08T23:57:32.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: Updating smithi150:/etc/ceph/ceph.conf 2024-05-08T23:57:32.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: Updating smithi171:/etc/ceph/ceph.conf 2024-05-08T23:57:32.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: Updating smithi171:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:57:32.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: Updating smithi150:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:57:32.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: Updating smithi081:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:57:32.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: Reconfiguring daemon mon.a on smithi081 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: mon.b calling monitor election 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: mon.c calling monitor election 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: mon.a calling monitor election 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: monmap e3: 3 mons at {a=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],b=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0],c=[v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: fsmap 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: mgrmap e13: x(active, since 45s) 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: Cluster is now healthy 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: overall HEALTH_OK 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3573838924' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:32.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:32 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:32.467 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:57:32.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: mon.b calling monitor election 2024-05-08T23:57:32.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: Updating smithi081:/etc/ceph/ceph.conf 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: Updating smithi150:/etc/ceph/ceph.conf 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: Updating smithi171:/etc/ceph/ceph.conf 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: Updating smithi171:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: Updating smithi150:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: Updating smithi081:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: Reconfiguring daemon mon.a on smithi081 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: mon.b calling monitor election 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: mon.c calling monitor election 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: mon.a calling monitor election 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: monmap e3: 3 mons at {a=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],b=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0],c=[v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: fsmap 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:57:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: mgrmap e13: x(active, since 45s) 2024-05-08T23:57:32.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-08T23:57:32.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: Cluster is now healthy 2024-05-08T23:57:32.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: overall HEALTH_OK 2024-05-08T23:57:32.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3573838924' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:32.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:32.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:32.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:32 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: mon.b calling monitor election 2024-05-08T23:57:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: Updating smithi081:/etc/ceph/ceph.conf 2024-05-08T23:57:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: Updating smithi150:/etc/ceph/ceph.conf 2024-05-08T23:57:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: Updating smithi171:/etc/ceph/ceph.conf 2024-05-08T23:57:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: Updating smithi171:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:57:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: Updating smithi150:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:57:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: Updating smithi081:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T23:57:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T23:57:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: Reconfiguring daemon mon.a on smithi081 2024-05-08T23:57:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: mon.b calling monitor election 2024-05-08T23:57:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: mon.c calling monitor election 2024-05-08T23:57:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: mon.a calling monitor election 2024-05-08T23:57:32.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T23:57:32.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: monmap e3: 3 mons at {a=[v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0],b=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0],c=[v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T23:57:32.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: fsmap 2024-05-08T23:57:32.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T23:57:32.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: mgrmap e13: x(active, since 45s) 2024-05-08T23:57:32.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-05-08T23:57:32.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: Cluster is now healthy 2024-05-08T23:57:32.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: overall HEALTH_OK 2024-05-08T23:57:32.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3573838924' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:32.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:32.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:32.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:32 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:57:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:33 smithi171 ceph-mon[47351]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:33 smithi171 ceph-mon[47351]: Reconfiguring mon.b (monmap changed)... 2024-05-08T23:57:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:57:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:57:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:33 smithi171 ceph-mon[47351]: Reconfiguring daemon mon.b on smithi150 2024-05-08T23:57:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:57:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:57:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:33.586 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.591+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3714876954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd608100a60 msgr2=0x7fd608100e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:33.586 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.591+0000 7fd60fa8d700 1 --2- 172.21.15.171:0/3714876954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd608100a60 0x7fd608100e80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd60000b0a0 tx=0x7fd60000b3b0 comp rx=0 tx=0).stop 2024-05-08T23:57:33.586 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.591+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3714876954 shutdown_connections 2024-05-08T23:57:33.586 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.591+0000 7fd60fa8d700 1 --2- 172.21.15.171:0/3714876954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd608100a60 0x7fd608100e80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:33.586 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.591+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3714876954 >> 172.21.15.171:0/3714876954 conn(0x7fd6080fc000 msgr2=0x7fd6080fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:33.586 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.591+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3714876954 shutdown_connections 2024-05-08T23:57:33.586 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.591+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3714876954 wait complete. 2024-05-08T23:57:33.588 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60fa8d700 1 Processor -- start 2024-05-08T23:57:33.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60fa8d700 1 -- start start 2024-05-08T23:57:33.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60fa8d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd608100a60 0x7fd6081982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:33.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60fa8d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd608198810 0x7fd60819d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:33.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60fa8d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd608198c90 0x7fd60819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:33.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60fa8d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6081a0560 con 0x7fd608198c90 2024-05-08T23:57:33.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60fa8d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6081a06d0 con 0x7fd608198810 2024-05-08T23:57:33.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60fa8d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6081a0890 con 0x7fd608100a60 2024-05-08T23:57:33.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60d829700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd608100a60 0x7fd6081982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:33.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60d829700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd608100a60 0x7fd6081982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:44094/0 (socket says 172.21.15.171:44094) 2024-05-08T23:57:33.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60d829700 1 -- 172.21.15.171:0/3644775935 learned_addr learned my addr 172.21.15.171:0/3644775935 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-08T23:57:33.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60e02a700 1 --2- 172.21.15.171:0/3644775935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd608198c90 0x7fd60819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:33.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60d028700 1 --2- 172.21.15.171:0/3644775935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd608198810 0x7fd60819d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:33.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60d829700 1 -- 172.21.15.171:0/3644775935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd608198810 msgr2=0x7fd60819d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:33.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60d829700 1 --2- 172.21.15.171:0/3644775935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd608198810 0x7fd60819d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:33.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60d829700 1 -- 172.21.15.171:0/3644775935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd608198c90 msgr2=0x7fd60819fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:33.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60d829700 1 --2- 172.21.15.171:0/3644775935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd608198c90 0x7fd60819fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:33.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60d829700 1 -- 172.21.15.171:0/3644775935 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd600009d00 con 0x7fd608100a60 2024-05-08T23:57:33.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.592+0000 7fd60d829700 1 --2- 172.21.15.171:0/3644775935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd608100a60 0x7fd6081982d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd600000f80 tx=0x7fd60000bd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:33.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.593+0000 7fd606ffd700 1 -- 172.21.15.171:0/3644775935 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60000e040 con 0x7fd608100a60 2024-05-08T23:57:33.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.593+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3644775935 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6081a0b10 con 0x7fd608100a60 2024-05-08T23:57:33.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.593+0000 7fd606ffd700 1 -- 172.21.15.171:0/3644775935 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd600003d70 con 0x7fd608100a60 2024-05-08T23:57:33.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.593+0000 7fd606ffd700 1 -- 172.21.15.171:0/3644775935 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd600012b00 con 0x7fd608100a60 2024-05-08T23:57:33.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.593+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3644775935 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6081a1000 con 0x7fd608100a60 2024-05-08T23:57:33.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.594+0000 7fd606ffd700 1 -- 172.21.15.171:0/3644775935 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fd600012c60 con 0x7fd608100a60 2024-05-08T23:57:33.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.594+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3644775935 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd608191b30 con 0x7fd608100a60 2024-05-08T23:57:33.590 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.594+0000 7fd606ffd700 1 --2- 172.21.15.171:0/3644775935 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd5f0038c20 0x7fd5f003b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:33.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.594+0000 7fd606ffd700 1 -- 172.21.15.171:0/3644775935 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd60004be80 con 0x7fd608100a60 2024-05-08T23:57:33.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.594+0000 7fd60d028700 1 --2- 172.21.15.171:0/3644775935 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd5f0038c20 0x7fd5f003b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:33.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.595+0000 7fd60d028700 1 --2- 172.21.15.171:0/3644775935 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd5f0038c20 0x7fd5f003b0e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009ad0 tx=0x7fd5fc009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:33.595 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.601+0000 7fd606ffd700 1 -- 172.21.15.171:0/3644775935 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd600021310 con 0x7fd608100a60 2024-05-08T23:57:33.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:33 smithi081 ceph-mon[42474]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:33.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:33 smithi081 ceph-mon[42474]: Reconfiguring mon.b (monmap changed)... 2024-05-08T23:57:33.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:57:33.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:57:33.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:33.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:33 smithi081 ceph-mon[42474]: Reconfiguring daemon mon.b on smithi150 2024-05-08T23:57:33.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:33.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:33.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:57:33.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:57:33.623 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:33 smithi150 ceph-mon[46187]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:33 smithi150 ceph-mon[46187]: Reconfiguring mon.b (monmap changed)... 2024-05-08T23:57:33.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:57:33.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:57:33.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:33.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:33 smithi150 ceph-mon[46187]: Reconfiguring daemon mon.b on smithi150 2024-05-08T23:57:33.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:33.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:33.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T23:57:33.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T23:57:33.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:33.813 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.818+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3644775935 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi150=y;smithi171=z", "target": ["mon-mgr", ""]}) v1 -- 0x7fd60802cf00 con 0x7fd5f0038c20 2024-05-08T23:57:33.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.825+0000 7fd606ffd700 1 -- 172.21.15.171:0/3644775935 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd60802cf00 con 0x7fd5f0038c20 2024-05-08T23:57:33.820 INFO:teuthology.orchestra.run.smithi171.stdout:Scheduled mgr update... 2024-05-08T23:57:33.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.827+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3644775935 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd5f0038c20 msgr2=0x7fd5f003b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:33.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.827+0000 7fd60fa8d700 1 --2- 172.21.15.171:0/3644775935 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd5f0038c20 0x7fd5f003b0e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009ad0 tx=0x7fd5fc009210 comp rx=0 tx=0).stop 2024-05-08T23:57:33.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.827+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3644775935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd608100a60 msgr2=0x7fd6081982d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:33.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.827+0000 7fd60fa8d700 1 --2- 172.21.15.171:0/3644775935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd608100a60 0x7fd6081982d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd600000f80 tx=0x7fd60000bd10 comp rx=0 tx=0).stop 2024-05-08T23:57:33.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.827+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3644775935 shutdown_connections 2024-05-08T23:57:33.822 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.827+0000 7fd60fa8d700 1 --2- 172.21.15.171:0/3644775935 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd5f0038c20 0x7fd5f003b0e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:33.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.827+0000 7fd60fa8d700 1 --2- 172.21.15.171:0/3644775935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd608198c90 0x7fd60819fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:33.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.827+0000 7fd60fa8d700 1 --2- 172.21.15.171:0/3644775935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd608100a60 0x7fd6081982d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:33.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.827+0000 7fd60fa8d700 1 --2- 172.21.15.171:0/3644775935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd608198810 0x7fd60819d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:33.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.827+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3644775935 >> 172.21.15.171:0/3644775935 conn(0x7fd6080fc000 msgr2=0x7fd6080fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:33.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.827+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3644775935 shutdown_connections 2024-05-08T23:57:33.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:57:33.827+0000 7fd60fa8d700 1 -- 172.21.15.171:0/3644775935 wait complete. 2024-05-08T23:57:34.363 DEBUG:teuthology.orchestra.run.smithi150:mgr.y> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.y.service 2024-05-08T23:57:34.366 DEBUG:teuthology.orchestra.run.smithi171:mgr.z> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.z.service 2024-05-08T23:57:34.368 INFO:tasks.cephadm:Deploying OSDs... 2024-05-08T23:57:34.368 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-08T23:57:34.368 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T23:57:34.389 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T23:57:34.390 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-05-08T23:57:34.397 INFO:journalctl@ceph.mgr.z.smithi171.stdout:-- Logs begin at Wed 2024-05-08 23:40:11 UTC. -- 2024-05-08T23:57:34.402 INFO:journalctl@ceph.mgr.y.smithi150.stdout:-- Logs begin at Wed 2024-05-08 23:39:53 UTC. -- 2024-05-08T23:57:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T23:57:34.451 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:57:34.451 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 185361 Links: 1 2024-05-08T23:57:34.451 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:57:34.451 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:57:34.451 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-05-08 23:56:55.453486549 +0000 2024-05-08T23:57:34.451 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-05-08 23:50:20.847375506 +0000 2024-05-08T23:57:34.451 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-05-08 23:50:20.847375506 +0000 2024-05-08T23:57:34.452 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-05-08T23:57:34.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T23:57:34.520 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:34 smithi081 ceph-mon[42474]: Reconfiguring mon.c (monmap changed)... 2024-05-08T23:57:34.520 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:34 smithi081 ceph-mon[42474]: Reconfiguring daemon mon.c on smithi171 2024-05-08T23:57:34.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:34 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:34.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:34 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:34.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:34 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:34.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:34 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:34.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:34 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:34.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:34 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:34.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:34 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:34.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:34 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:57:34.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:34 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T23:57:34.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:34 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:57:34.521 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:34 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-05-08T23:57:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-05-08T23:57:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000271704 s, 1.9 MB/s 2024-05-08T23:57:34.525 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T23:57:34.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:34 smithi171 ceph-mon[47351]: Reconfiguring mon.c (monmap changed)... 2024-05-08T23:57:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:34 smithi171 ceph-mon[47351]: Reconfiguring daemon mon.c on smithi171 2024-05-08T23:57:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:34 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:34 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:34 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:34 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:34 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:34 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:34 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:34 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:57:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:34 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T23:57:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:34 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:57:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:34 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:34.585 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-05-08T23:57:34.645 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T23:57:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:57:34.646 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 184461 Links: 1 2024-05-08T23:57:34.646 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:57:34.646 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:57:34.646 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-05-08 23:56:55.493485786 +0000 2024-05-08T23:57:34.646 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-05-08 23:50:21.202368681 +0000 2024-05-08T23:57:34.647 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-05-08 23:50:21.202368681 +0000 2024-05-08T23:57:34.647 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-05-08T23:57:34.647 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T23:57:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-05-08T23:57:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-05-08T23:57:34.714 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000227787 s, 2.2 MB/s 2024-05-08T23:57:34.715 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T23:57:34.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:34 smithi150 ceph-mon[46187]: Reconfiguring mon.c (monmap changed)... 2024-05-08T23:57:34.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:34 smithi150 ceph-mon[46187]: Reconfiguring daemon mon.c on smithi171 2024-05-08T23:57:34.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:34 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:34.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:34 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:34.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:34 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:34.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:34 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:34.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:34 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:34.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:34 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:34.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:34 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:34.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:34 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:57:34.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:34 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T23:57:34.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:34 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:57:34.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:34 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:34.774 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-05-08T23:57:34.832 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T23:57:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:57:34.833 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 177143 Links: 1 2024-05-08T23:57:34.833 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:57:34.833 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:57:34.833 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-05-08 23:56:55.532485041 +0000 2024-05-08T23:57:34.833 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-05-08 23:50:21.552361952 +0000 2024-05-08T23:57:34.833 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-05-08 23:50:21.552361952 +0000 2024-05-08T23:57:34.833 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-05-08T23:57:34.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T23:57:34.900 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-05-08T23:57:34.900 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-05-08T23:57:34.900 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000212211 s, 2.4 MB/s 2024-05-08T23:57:34.901 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T23:57:34.960 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-05-08T23:57:35.019 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T23:57:35.020 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:57:35.020 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 6h/6d Inode: 184565 Links: 1 2024-05-08T23:57:35.020 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:57:35.020 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:57:35.020 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-05-08 23:56:55.571484297 +0000 2024-05-08T23:57:35.020 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-05-08 23:50:21.888355492 +0000 2024-05-08T23:57:35.020 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-05-08 23:50:21.888355492 +0000 2024-05-08T23:57:35.020 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-05-08T23:57:35.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T23:57:35.086 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-05-08T23:57:35.086 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-05-08T23:57:35.086 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000212094 s, 2.4 MB/s 2024-05-08T23:57:35.087 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T23:57:35.145 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2024-05-08T23:57:35.145 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T23:57:35.166 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T23:57:35.166 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 2024-05-08T23:57:35.227 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T23:57:35.228 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:57:35.228 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 182696 Links: 1 2024-05-08T23:57:35.228 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:57:35.228 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:57:35.228 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-05-08 23:57:23.826583768 +0000 2024-05-08T23:57:35.228 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-05-08 23:50:29.501595202 +0000 2024-05-08T23:57:35.228 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-05-08 23:50:29.501595202 +0000 2024-05-08T23:57:35.228 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-05-08T23:57:35.228 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T23:57:35.296 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-05-08T23:57:35.296 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-05-08T23:57:35.296 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000339025 s, 1.5 MB/s 2024-05-08T23:57:35.298 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T23:57:35.359 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 2024-05-08T23:57:35.418 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T23:57:35.418 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:57:35.418 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 180629 Links: 1 2024-05-08T23:57:35.418 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:57:35.419 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:57:35.419 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-05-08 23:57:23.826583768 +0000 2024-05-08T23:57:35.419 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-05-08 23:50:29.844588578 +0000 2024-05-08T23:57:35.419 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-05-08 23:50:29.844588578 +0000 2024-05-08T23:57:35.419 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-05-08T23:57:35.419 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T23:57:35.486 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-05-08T23:57:35.486 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-05-08T23:57:35.487 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000231163 s, 2.2 MB/s 2024-05-08T23:57:35.488 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T23:57:35.547 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 2024-05-08T23:57:35.553 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:35 smithi171 systemd[1]: Starting Ceph mgr.z for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-08T23:57:35.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:35 smithi171 ceph-mon[47351]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi150=y;smithi171=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:57:35.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:35 smithi171 ceph-mon[47351]: Saving service mgr spec with placement smithi081=x;smithi150=y;smithi171=z;count:3 2024-05-08T23:57:35.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:35 smithi171 ceph-mon[47351]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:35.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:35 smithi171 ceph-mon[47351]: Deploying daemon mgr.z on smithi171 2024-05-08T23:57:35.606 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T23:57:35.606 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:57:35.606 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 181524 Links: 1 2024-05-08T23:57:35.606 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:57:35.606 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:57:35.606 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-05-08 23:57:23.826583768 +0000 2024-05-08T23:57:35.606 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-05-08 23:50:30.199581722 +0000 2024-05-08T23:57:35.606 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-05-08 23:50:30.199581722 +0000 2024-05-08T23:57:35.607 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-05-08T23:57:35.607 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T23:57:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:35 smithi081 ceph-mon[42474]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi150=y;smithi171=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:57:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:35 smithi081 ceph-mon[42474]: Saving service mgr spec with placement smithi081=x;smithi150=y;smithi171=z;count:3 2024-05-08T23:57:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:35 smithi081 ceph-mon[42474]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:35 smithi081 ceph-mon[42474]: Deploying daemon mgr.z on smithi171 2024-05-08T23:57:35.671 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:35 smithi150 ceph-mon[46187]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi081=x;smithi150=y;smithi171=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:57:35.672 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:35 smithi150 ceph-mon[46187]: Saving service mgr spec with placement smithi081=x;smithi150=y;smithi171=z;count:3 2024-05-08T23:57:35.672 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:35 smithi150 ceph-mon[46187]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:35.672 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:35 smithi150 ceph-mon[46187]: Deploying daemon mgr.z on smithi171 2024-05-08T23:57:35.674 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-05-08T23:57:35.674 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-05-08T23:57:35.674 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000202433 s, 2.5 MB/s 2024-05-08T23:57:35.676 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T23:57:35.735 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 2024-05-08T23:57:35.793 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T23:57:35.793 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:57:35.793 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 179546 Links: 1 2024-05-08T23:57:35.793 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:57:35.793 INFO:teuthology.orchestra.run.smithi150.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:57:35.793 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2024-05-08 23:57:23.826583768 +0000 2024-05-08T23:57:35.793 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2024-05-08 23:50:30.580574365 +0000 2024-05-08T23:57:35.793 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2024-05-08 23:50:30.580574365 +0000 2024-05-08T23:57:35.794 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2024-05-08T23:57:35.794 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T23:57:35.859 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2024-05-08T23:57:35.859 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2024-05-08T23:57:35.860 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000286498 s, 1.8 MB/s 2024-05-08T23:57:35.861 DEBUG:teuthology.orchestra.run.smithi150:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T23:57:35.920 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-05-08T23:57:35.920 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T23:57:35.939 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T23:57:35.939 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-05-08T23:57:35.998 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T23:57:35.998 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:57:35.998 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 181367 Links: 1 2024-05-08T23:57:35.998 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:57:35.998 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:57:35.998 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-05-08 23:57:35.423344693 +0000 2024-05-08T23:57:35.998 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-05-08 23:50:40.804096952 +0000 2024-05-08T23:57:35.998 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-05-08 23:50:40.804096952 +0000 2024-05-08T23:57:35.998 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-05-08T23:57:35.999 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T23:57:36.067 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-05-08T23:57:36.068 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-05-08T23:57:36.068 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000179109 s, 2.9 MB/s 2024-05-08T23:57:36.068 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T23:57:36.126 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-05-08T23:57:36.183 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T23:57:36.183 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:57:36.183 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 180818 Links: 1 2024-05-08T23:57:36.184 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:57:36.184 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:57:36.184 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-05-08 23:57:35.423344693 +0000 2024-05-08T23:57:36.184 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-05-08 23:50:41.172089803 +0000 2024-05-08T23:57:36.184 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-05-08 23:50:41.172089803 +0000 2024-05-08T23:57:36.184 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-05-08T23:57:36.185 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T23:57:36.247 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:35 smithi171 ceph-mgr[49206]: -- 172.21.15.171:0/3773082019 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5556e58801a0 con 0x5556e5856c00 2024-05-08T23:57:36.247 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:35 smithi171 bash[49168]: 668a06d6a8a78ab03b1e79b973eef6566e0aa6540cc482d3782ed1235b8ed027 2024-05-08T23:57:36.247 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:35 smithi171 systemd[1]: Started Ceph mgr.z for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-08T23:57:36.250 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-05-08T23:57:36.250 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-05-08T23:57:36.250 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000190308 s, 2.7 MB/s 2024-05-08T23:57:36.251 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T23:57:36.309 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-05-08T23:57:36.366 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T23:57:36.367 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:57:36.367 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 177022 Links: 1 2024-05-08T23:57:36.367 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:57:36.367 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:57:36.367 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-05-08 23:57:35.423344693 +0000 2024-05-08T23:57:36.367 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-05-08 23:50:41.522083004 +0000 2024-05-08T23:57:36.367 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-05-08 23:50:41.522083004 +0000 2024-05-08T23:57:36.367 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-05-08T23:57:36.367 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T23:57:36.368 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:36 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:36.277+0000 7fb74f63f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T23:57:36.393 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-05-08T23:57:36.393 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-05-08T23:57:36.394 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000178123 s, 2.9 MB/s 2024-05-08T23:57:36.395 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T23:57:36.452 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-05-08T23:57:36.510 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T23:57:36.510 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T23:57:36.510 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 180933 Links: 1 2024-05-08T23:57:36.510 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T23:57:36.510 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T23:57:36.510 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-05-08 23:57:35.424344674 +0000 2024-05-08T23:57:36.510 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-05-08 23:50:41.861076418 +0000 2024-05-08T23:57:36.510 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-05-08 23:50:41.861076418 +0000 2024-05-08T23:57:36.510 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-05-08T23:57:36.511 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T23:57:36.553 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:36 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:36.373+0000 7fb74f63f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T23:57:36.553 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:36 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:36.470+0000 7fb74f63f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T23:57:36.577 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-05-08T23:57:36.577 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-05-08T23:57:36.577 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000240198 s, 2.1 MB/s 2024-05-08T23:57:36.578 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T23:57:36.636 INFO:tasks.cephadm:Deploying osd.0 on smithi081 with /dev/vg_nvme/lv_4... 2024-05-08T23:57:36.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T23:57:36.802 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:36 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:36.560+0000 7fb74f63f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T23:57:36.864 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:57:37.202 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:36 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:37.202 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:36 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:37.203 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:36 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:37.203 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:36 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:57:37.203 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:36 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T23:57:37.203 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:36 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:57:37.203 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:36 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:37.203 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:36 smithi171 ceph-mon[47351]: Deploying daemon mgr.y on smithi150 2024-05-08T23:57:37.203 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:36 smithi171 ceph-mon[47351]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:37.264 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:37 smithi150 systemd[1]: Starting Ceph mgr.y for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-08T23:57:37.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:36 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:37.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:36 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:37.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:36 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:37.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:36 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:57:37.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:36 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T23:57:37.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:36 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:57:37.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:36 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:37.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:36 smithi150 ceph-mon[46187]: Deploying daemon mgr.y on smithi150 2024-05-08T23:57:37.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:36 smithi150 ceph-mon[46187]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:37.289 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:36 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:37.289 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:36 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:37.289 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:36 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:37.290 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:36 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:57:37.290 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:36 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T23:57:37.290 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:36 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:57:37.290 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:36 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:37.290 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:36 smithi081 ceph-mon[42474]: Deploying daemon mgr.y on smithi150 2024-05-08T23:57:37.290 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:36 smithi081 ceph-mon[42474]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:37.452 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:37.207+0000 7fb74f63f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:57:37.802 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:37.458+0000 7fb74f63f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T23:57:37.803 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:37.544+0000 7fb74f63f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T23:57:37.803 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:37.653+0000 7fb74f63f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T23:57:38.014 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:37 smithi150 ceph-mgr[47655]: -- 172.21.15.150:0/2569685418 <== mon.2 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c47d3ca1a0 con 0x55c47d3a1000 2024-05-08T23:57:38.014 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:37 smithi150 bash[47618]: 41a757e4a8e084473670b1cc9072e01ea695b6eaaa1777bc06a9a8c0895e2947 2024-05-08T23:57:38.014 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:37 smithi150 systemd[1]: Started Ceph mgr.y for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-08T23:57:38.139 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:38 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:38.034+0000 7f309e37a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T23:57:38.180 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T23:57:38.180 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T23:57:38.180 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-05-08T23:57:38.180 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-05-08T23:57:38.180 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113079 s, 927 MB/s 2024-05-08T23:57:38.180 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-05-08T23:57:38.302 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:37.812+0000 7fb74f63f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T23:57:38.303 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:37.959+0000 7fb74f63f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T23:57:38.303 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:38 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:38.049+0000 7fb74f63f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T23:57:38.332 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:38 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:38.144+0000 7f309e37a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T23:57:38.332 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:38 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:38.249+0000 7f309e37a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T23:57:38.514 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:38 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:38.336+0000 7f309e37a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T23:57:38.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_4 2024-05-08T23:57:38.695 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:38 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:38.461+0000 7fb74f63f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T23:57:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:57:38.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:38.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:38.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:38.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:38.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:38.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:38 smithi081 ceph-mon[42474]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:39.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:39.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:39.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:39.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:39.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:39.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:38 smithi150 ceph-mon[46187]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:39.052 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:38 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:38.883+0000 7fb74f63f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T23:57:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:38 smithi171 ceph-mon[47351]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:39.269 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:39 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:39.023+0000 7f309e37a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:57:39.552 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:39 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:39.082+0000 7fb74f63f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T23:57:39.553 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:39 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:39.174+0000 7fb74f63f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T23:57:39.619 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:39 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:39.274+0000 7f309e37a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T23:57:39.619 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:39 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:39.359+0000 7f309e37a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T23:57:39.619 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:39 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:39.467+0000 7f309e37a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T23:57:39.619 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:39 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:39.624+0000 7f309e37a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T23:57:39.851 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:39.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:39.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:39.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:39.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:39.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:39.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:39.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:39 smithi081 ceph-mon[42474]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T23:57:39.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:57:39.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:57:39.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:39.852 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:39 smithi081 ceph-mon[42474]: Reconfiguring daemon mgr.x on smithi081 2024-05-08T23:57:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.990+0000 7faa1fc20700 1 -- 172.21.15.81:0/2809396213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18106d30 msgr2=0x7faa18109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.990+0000 7faa1fc20700 1 --2- 172.21.15.81:0/2809396213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18106d30 0x7faa18109160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faa10009f90 tx=0x7faa1000b330 comp rx=0 tx=0).stop 2024-05-08T23:57:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.990+0000 7faa1fc20700 1 -- 172.21.15.81:0/2809396213 shutdown_connections 2024-05-08T23:57:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.990+0000 7faa1fc20700 1 --2- 172.21.15.81:0/2809396213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa18101ad0 0x7faa18103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.990+0000 7faa1fc20700 1 --2- 172.21.15.81:0/2809396213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18106d30 0x7faa18109160 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.990+0000 7faa1fc20700 1 --2- 172.21.15.81:0/2809396213 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa18104400 0x7faa181067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.990+0000 7faa1fc20700 1 -- 172.21.15.81:0/2809396213 >> 172.21.15.81:0/2809396213 conn(0x7faa180fb4a0 msgr2=0x7faa180fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.990+0000 7faa1fc20700 1 -- 172.21.15.81:0/2809396213 shutdown_connections 2024-05-08T23:57:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.990+0000 7faa1fc20700 1 -- 172.21.15.81:0/2809396213 wait complete. 2024-05-08T23:57:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1fc20700 1 Processor -- start 2024-05-08T23:57:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1fc20700 1 -- start start 2024-05-08T23:57:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1fc20700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18101ad0 0x7faa18197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1fc20700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa18104400 0x7faa181975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1fc20700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa18106d30 0x7faa1819e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1fc20700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1819ebc0 con 0x7faa18101ad0 2024-05-08T23:57:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1fc20700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1819ed00 con 0x7faa18106d30 2024-05-08T23:57:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1fc20700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1819ee90 con 0x7faa18104400 2024-05-08T23:57:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1d9bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18101ad0 0x7faa18197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1d9bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18101ad0 0x7faa18197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42222/0 (socket says 172.21.15.81:42222) 2024-05-08T23:57:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1d9bc700 1 -- 172.21.15.81:0/2450961688 learned_addr learned my addr 172.21.15.81:0/2450961688 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:57:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1d1bb700 1 --2- 172.21.15.81:0/2450961688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa18104400 0x7faa181975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1e1bd700 1 --2- 172.21.15.81:0/2450961688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa18106d30 0x7faa1819e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1d9bc700 1 -- 172.21.15.81:0/2450961688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa18104400 msgr2=0x7faa181975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1d9bc700 1 --2- 172.21.15.81:0/2450961688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa18104400 0x7faa181975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1d9bc700 1 -- 172.21.15.81:0/2450961688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa18106d30 msgr2=0x7faa1819e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.991+0000 7faa1d9bc700 1 --2- 172.21.15.81:0/2450961688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa18106d30 0x7faa1819e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.992+0000 7faa1d9bc700 1 -- 172.21.15.81:0/2450961688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa140095f0 con 0x7faa18101ad0 2024-05-08T23:57:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.992+0000 7faa1d9bc700 1 --2- 172.21.15.81:0/2450961688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18101ad0 0x7faa18197080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faa0800e9f0 tx=0x7faa0800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.992+0000 7faa0effd700 1 -- 172.21.15.81:0/2450961688 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa080097b0 con 0x7faa18101ad0 2024-05-08T23:57:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.992+0000 7faa0effd700 1 -- 172.21.15.81:0/2450961688 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa0800ee90 con 0x7faa18101ad0 2024-05-08T23:57:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.992+0000 7faa1fc20700 1 -- 172.21.15.81:0/2450961688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa10009c40 con 0x7faa18101ad0 2024-05-08T23:57:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.992+0000 7faa0effd700 1 -- 172.21.15.81:0/2450961688 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa08005520 con 0x7faa18101ad0 2024-05-08T23:57:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.992+0000 7faa1fc20700 1 -- 172.21.15.81:0/2450961688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1819f4e0 con 0x7faa18101ad0 2024-05-08T23:57:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.993+0000 7faa0effd700 1 -- 172.21.15.81:0/2450961688 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7faa08021440 con 0x7faa18101ad0 2024-05-08T23:57:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.993+0000 7faa0effd700 1 --2- 172.21.15.81:0/2450961688 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7faa040389d0 0x7faa0403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.993+0000 7faa1fc20700 1 -- 172.21.15.81:0/2450961688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa180fd020 con 0x7faa18101ad0 2024-05-08T23:57:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.993+0000 7faa0effd700 1 -- 172.21.15.81:0/2450961688 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7faa08014070 con 0x7faa18101ad0 2024-05-08T23:57:39.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.994+0000 7faa1d1bb700 1 --2- 172.21.15.81:0/2450961688 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7faa040389d0 0x7faa0403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:39.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.994+0000 7faa1d1bb700 1 --2- 172.21.15.81:0/2450961688 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7faa040389d0 0x7faa0403ae90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faa14005fd0 tx=0x7faa14009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:39.998+0000 7faa0effd700 1 -- 172.21.15.81:0/2450961688 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7faa0801f930 con 0x7faa18101ad0 2024-05-08T23:57:40.014 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:39 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:39.751+0000 7f309e37a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T23:57:40.014 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:39 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:39.834+0000 7f309e37a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T23:57:40.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:40.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:40.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:40.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:40.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:40.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:40.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:40.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:39 smithi150 ceph-mon[46187]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T23:57:40.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:57:40.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:57:40.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:40.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:39 smithi150 ceph-mon[46187]: Reconfiguring daemon mgr.x on smithi081 2024-05-08T23:57:40.026 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:39 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:39.935+0000 7fb74f63f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T23:57:40.027 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:40.027 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:40.027 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:40.027 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:40.027 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:40.027 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:40.027 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:40.027 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:39 smithi171 ceph-mon[47351]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T23:57:40.027 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T23:57:40.027 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T23:57:40.027 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:40.027 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:39 smithi171 ceph-mon[47351]: Reconfiguring daemon mgr.x on smithi081 2024-05-08T23:57:40.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:40.213+0000 7faa1fc20700 1 -- 172.21.15.81:0/2450961688 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7faa180613e0 con 0x7faa040389d0 2024-05-08T23:57:40.302 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:40 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:40.032+0000 7fb74f63f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T23:57:40.302 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:40 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:40.180+0000 7fb74f63f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T23:57:40.514 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:40 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:40.205+0000 7f309e37a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T23:57:40.875 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:40 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:40.595+0000 7f309e37a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T23:57:40.875 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:40 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:40.788+0000 7f309e37a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T23:57:41.157 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:40 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:40.880+0000 7f309e37a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T23:57:41.158 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:40 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:40.814+0000 7fb74f63f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T23:57:41.158 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:40 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:40.997+0000 7fb74f63f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T23:57:41.272 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:41.272 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:41.272 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:41.273 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:41.273 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:41.273 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:41.273 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:41 smithi081 ceph-mon[42474]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:57:41.273 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:57:41.273 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:57:41.273 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:41.273 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:41 smithi081 ceph-mon[42474]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:41.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:41.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:41.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:41.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:41.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:41.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:41.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:41 smithi150 ceph-mon[46187]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:57:41.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:57:41.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:57:41.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:41.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:41 smithi150 ceph-mon[46187]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:41.552 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:41 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:41.194+0000 7fb74f63f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T23:57:41.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:41.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:41.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:41.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:41.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:41.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:41.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:41 smithi171 ceph-mon[47351]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:57:41.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:57:41.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:57:41.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:41.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:41 smithi171 ceph-mon[47351]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:42.014 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:41 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:41.644+0000 7f309e37a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T23:57:42.014 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:41 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:41.739+0000 7f309e37a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T23:57:42.014 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:41 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:41.887+0000 7f309e37a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T23:57:42.406 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:42 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:42.124+0000 7fb74f63f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T23:57:42.406 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:42.406 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:42 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/114713921' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5eca74f4-ec24-4e6b-a18e-aff734ea3087"}]: dispatch 2024-05-08T23:57:42.406 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:42 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/114713921' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5eca74f4-ec24-4e6b-a18e-aff734ea3087"}]': finished 2024-05-08T23:57:42.406 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:42 smithi171 ceph-mon[47351]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T23:57:42.407 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:42 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/114713921' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5eca74f4-ec24-4e6b-a18e-aff734ea3087"}]: dispatch 2024-05-08T23:57:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:42 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/114713921' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5eca74f4-ec24-4e6b-a18e-aff734ea3087"}]': finished 2024-05-08T23:57:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:42 smithi081 ceph-mon[42474]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T23:57:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:42.683 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:42 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:42.411+0000 7fb74f63f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:57:42.683 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:42 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:42.499+0000 7fb74f63f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T23:57:42.690 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:42 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:42.516+0000 7f309e37a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T23:57:42.690 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:42.691 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:42 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/114713921' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5eca74f4-ec24-4e6b-a18e-aff734ea3087"}]: dispatch 2024-05-08T23:57:42.691 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:42 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/114713921' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5eca74f4-ec24-4e6b-a18e-aff734ea3087"}]': finished 2024-05-08T23:57:42.691 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:42 smithi150 ceph-mon[46187]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T23:57:42.691 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:43.014 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:42 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:42.695+0000 7f309e37a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T23:57:43.014 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:42 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:42.888+0000 7f309e37a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T23:57:43.052 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 08 23:57:42 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-08T23:57:42.689+0000 7fb74f63f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T23:57:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:43.280+0000 7faa0effd700 1 -- 172.21.15.81:0/2450961688 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 14) v1 ==== 90707+0+0 (secure 0 0 0) 0x7faa08010430 con 0x7faa18101ad0 2024-05-08T23:57:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:43 smithi171 ceph-mon[47351]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:43 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1912851410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:57:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:43 smithi171 ceph-mon[47351]: Standby manager daemon z started 2024-05-08T23:57:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:43 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.171:0/790199925' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T23:57:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:43 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.171:0/790199925' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T23:57:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:43 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.171:0/790199925' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T23:57:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:43 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.171:0/790199925' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T23:57:43.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:43 smithi081 ceph-mon[42474]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:43.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:43 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1912851410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:57:43.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:43 smithi081 ceph-mon[42474]: Standby manager daemon z started 2024-05-08T23:57:43.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:43 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.171:0/790199925' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T23:57:43.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:43 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.171:0/790199925' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T23:57:43.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:43 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.171:0/790199925' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T23:57:43.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:43 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.171:0/790199925' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T23:57:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:43 smithi150 ceph-mon[46187]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:43 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1912851410' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:57:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:43 smithi150 ceph-mon[46187]: Standby manager daemon z started 2024-05-08T23:57:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:43 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.171:0/790199925' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T23:57:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:43 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.171:0/790199925' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T23:57:43.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:43 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.171:0/790199925' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T23:57:43.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:43 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.171:0/790199925' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T23:57:44.097 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:43 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:43.819+0000 7f309e37a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T23:57:44.097 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:44 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:44.102+0000 7f309e37a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T23:57:44.376 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:44 smithi150 ceph-mon[46187]: mgrmap e14: x(active, since 57s), standbys: z 2024-05-08T23:57:44.376 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:44 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T23:57:44.376 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:44 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:44.190+0000 7f309e37a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T23:57:44.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:44 smithi171 ceph-mon[47351]: mgrmap e14: x(active, since 57s), standbys: z 2024-05-08T23:57:44.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:44 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T23:57:44.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:44 smithi081 ceph-mon[42474]: mgrmap e14: x(active, since 57s), standbys: z 2024-05-08T23:57:44.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:44 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T23:57:44.764 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 08 23:57:44 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-08T23:57:44.381+0000 7f309e37a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T23:57:45.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:45.299+0000 7faa0effd700 1 -- 172.21.15.81:0/2450961688 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7faa08021ac0 con 0x7faa18101ad0 2024-05-08T23:57:45.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:45 smithi171 ceph-mon[47351]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:45.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:45 smithi171 ceph-mon[47351]: Standby manager daemon y started 2024-05-08T23:57:45.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:45 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.150:0/3547031848' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T23:57:45.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:45 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.150:0/3547031848' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T23:57:45.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:45 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.150:0/3547031848' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T23:57:45.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:45 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.150:0/3547031848' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T23:57:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:45 smithi081 ceph-mon[42474]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:45 smithi081 ceph-mon[42474]: Standby manager daemon y started 2024-05-08T23:57:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:45 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.150:0/3547031848' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T23:57:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:45 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.150:0/3547031848' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T23:57:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:45 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.150:0/3547031848' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T23:57:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:45 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.150:0/3547031848' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T23:57:45.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:45 smithi150 ceph-mon[46187]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:45.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:45 smithi150 ceph-mon[46187]: Standby manager daemon y started 2024-05-08T23:57:45.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:45 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.150:0/3547031848' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T23:57:45.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:45 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.150:0/3547031848' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T23:57:45.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:45 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.150:0/3547031848' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T23:57:45.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:45 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.150:0/3547031848' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T23:57:46.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:46 smithi171 ceph-mon[47351]: mgrmap e15: x(active, since 59s), standbys: z, y 2024-05-08T23:57:46.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T23:57:46.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:46 smithi081 ceph-mon[42474]: mgrmap e15: x(active, since 59s), standbys: z, y 2024-05-08T23:57:46.561 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T23:57:46.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:46 smithi150 ceph-mon[46187]: mgrmap e15: x(active, since 59s), standbys: z, y 2024-05-08T23:57:46.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T23:57:47.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:47 smithi081 ceph-mon[42474]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:47.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:47 smithi171 ceph-mon[47351]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:47.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:47 smithi150 ceph-mon[46187]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:48.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:48 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T23:57:48.488 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:48 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:48.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:48 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T23:57:48.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:48 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:48.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:48 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T23:57:48.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:48 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:49.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:49 smithi171 ceph-mon[47351]: Deploying daemon osd.0 on smithi081 2024-05-08T23:57:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:49 smithi171 ceph-mon[47351]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:49.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:49 smithi081 ceph-mon[42474]: Deploying daemon osd.0 on smithi081 2024-05-08T23:57:49.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:49 smithi081 ceph-mon[42474]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:49.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:49 smithi150 ceph-mon[46187]: Deploying daemon osd.0 on smithi081 2024-05-08T23:57:49.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:49 smithi150 ceph-mon[46187]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:51.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:51 smithi081 ceph-mon[42474]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:51.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:51 smithi150 ceph-mon[46187]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:51.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:51 smithi171 ceph-mon[47351]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:52.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:52 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:52.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:52 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:52.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:52 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:52.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:52 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:52.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:52 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:52.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:52 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:52.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:52 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:52.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:52 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:52.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:52 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:53.474 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:53 smithi081 ceph-mon[42474]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:53.474 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:53.475 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:53.475 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:53.475 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:53.475 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:53.605 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 0 on host 'smithi081' 2024-05-08T23:57:53.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:53.610+0000 7faa0effd700 1 -- 172.21.15.81:0/2450961688 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7faa180613e0 con 0x7faa040389d0 2024-05-08T23:57:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:53.613+0000 7faa1fc20700 1 -- 172.21.15.81:0/2450961688 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7faa040389d0 msgr2=0x7faa0403ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:53.613+0000 7faa1fc20700 1 --2- 172.21.15.81:0/2450961688 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7faa040389d0 0x7faa0403ae90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faa14005fd0 tx=0x7faa14009310 comp rx=0 tx=0).stop 2024-05-08T23:57:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:53.613+0000 7faa1fc20700 1 -- 172.21.15.81:0/2450961688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18101ad0 msgr2=0x7faa18197080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:53.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:53.613+0000 7faa1fc20700 1 --2- 172.21.15.81:0/2450961688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18101ad0 0x7faa18197080 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faa0800e9f0 tx=0x7faa0800ed00 comp rx=0 tx=0).stop 2024-05-08T23:57:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:53.613+0000 7faa1fc20700 1 -- 172.21.15.81:0/2450961688 shutdown_connections 2024-05-08T23:57:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:53.613+0000 7faa1fc20700 1 --2- 172.21.15.81:0/2450961688 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7faa040389d0 0x7faa0403ae90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:53.613+0000 7faa1fc20700 1 --2- 172.21.15.81:0/2450961688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa18106d30 0x7faa1819e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:53.613+0000 7faa1fc20700 1 --2- 172.21.15.81:0/2450961688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18101ad0 0x7faa18197080 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:53.613+0000 7faa1fc20700 1 --2- 172.21.15.81:0/2450961688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa18104400 0x7faa181975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:53.613+0000 7faa1fc20700 1 -- 172.21.15.81:0/2450961688 >> 172.21.15.81:0/2450961688 conn(0x7faa180fb4a0 msgr2=0x7faa18102510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:53.613+0000 7faa1fc20700 1 -- 172.21.15.81:0/2450961688 shutdown_connections 2024-05-08T23:57:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:57:53.613+0000 7faa1fc20700 1 -- 172.21.15.81:0/2450961688 wait complete. 2024-05-08T23:57:53.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:53 smithi150 ceph-mon[46187]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:53.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:53.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:53.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:53.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:53.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:53.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:53 smithi171 ceph-mon[47351]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:53.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:53.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:53.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:53.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:53.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:53.978 DEBUG:teuthology.orchestra.run.smithi081:osd.0> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.0.service 2024-05-08T23:57:53.981 INFO:tasks.cephadm:Deploying osd.1 on smithi150 with /dev/vg_nvme/lv_4... 2024-05-08T23:57:53.981 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T23:57:54.013 INFO:journalctl@ceph.osd.0.smithi081.stdout:-- Logs begin at Wed 2024-05-08 23:39:48 UTC. -- 2024-05-08T23:57:54.210 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:57:54.683 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:54 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:54.683 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:54 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:54.683 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:54 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:54.683 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:54 smithi150 ceph-mon[46187]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:54.772 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:54 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:54.772 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:54 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:54.772 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:54 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:54.772 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:54 smithi081 ceph-mon[42474]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:55.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:54 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:55.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:54 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:55.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:54 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:57:55.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:54 smithi171 ceph-mon[47351]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:55.621 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T23:57:55.621 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T23:57:55.621 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10+0 records in 2024-05-08T23:57:55.622 INFO:teuthology.orchestra.run.smithi150.stderr:10+0 records out 2024-05-08T23:57:55.622 INFO:teuthology.orchestra.run.smithi150.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0159586 s, 657 MB/s 2024-05-08T23:57:55.622 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping successful for: 2024-05-08T23:57:55.676 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:55 smithi081 ceph-mon[42474]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T23:57:55.676 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 08 23:57:55 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-0[60150]: 2024-05-08T23:57:55.399+0000 7f6311de57c0 -1 osd.0 0 log_to_monitors true 2024-05-08T23:57:55.936 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:55 smithi150 ceph-mon[46187]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T23:57:55.994 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi150:vg_nvme/lv_4 2024-05-08T23:57:56.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:55 smithi171 ceph-mon[47351]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T23:57:56.216 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:57:56.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:56 smithi150 ceph-mon[46187]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T23:57:56.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:56 smithi150 ceph-mon[46187]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T23:57:56.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:56 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:56.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:56 smithi150 ceph-mon[46187]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-08T23:57:56.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:56 smithi150 ceph-mon[46187]: Detected new or changed devices on smithi081 2024-05-08T23:57:56.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:56 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:56.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:56 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:56.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:56 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:57:56.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:56 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi081 to 17114M 2024-05-08T23:57:56.724 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:56 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:56.725 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:56 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:56.725 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:56 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:56.725 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:56 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:56.725 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:56 smithi150 ceph-mon[46187]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:56.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:56 smithi081 ceph-mon[42474]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T23:57:56.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:56 smithi081 ceph-mon[42474]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T23:57:56.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:56 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:56.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:56 smithi081 ceph-mon[42474]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-08T23:57:56.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:56 smithi081 ceph-mon[42474]: Detected new or changed devices on smithi081 2024-05-08T23:57:56.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:56 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:56.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:56 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:56.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:56 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:57:56.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:56 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi081 to 17114M 2024-05-08T23:57:56.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:56 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:56.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:56 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:56.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:56 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:56.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:56 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:56.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:56 smithi081 ceph-mon[42474]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:57.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:56 smithi171 ceph-mon[47351]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T23:57:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:56 smithi171 ceph-mon[47351]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T23:57:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:56 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:56 smithi171 ceph-mon[47351]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-08T23:57:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:56 smithi171 ceph-mon[47351]: Detected new or changed devices on smithi081 2024-05-08T23:57:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:56 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:56 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:56 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:57:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:56 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi081 to 17114M 2024-05-08T23:57:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:56 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:56 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:56 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:57:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:56 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:57:57.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:56 smithi171 ceph-mon[47351]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.289+0000 7f1f6dece700 1 -- 172.21.15.150:0/1376212541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f68100fe0 msgr2=0x7f1f68101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.289+0000 7f1f6dece700 1 --2- 172.21.15.150:0/1376212541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f68100fe0 0x7f1f68101400 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1f580099c0 tx=0x7f1f58009cd0 comp rx=0 tx=0).stop 2024-05-08T23:57:57.284 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.290+0000 7f1f6dece700 1 -- 172.21.15.150:0/1376212541 shutdown_connections 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.290+0000 7f1f6dece700 1 --2- 172.21.15.150:0/1376212541 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f68100fe0 0x7f1f68101400 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.290+0000 7f1f6dece700 1 --2- 172.21.15.150:0/1376212541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f68102b80 0x7f1f68109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.290+0000 7f1f6dece700 1 --2- 172.21.15.150:0/1376212541 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f681021e0 0x7f1f68102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.290+0000 7f1f6dece700 1 -- 172.21.15.150:0/1376212541 >> 172.21.15.150:0/1376212541 conn(0x7f1f680fc580 msgr2=0x7f1f680fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.290+0000 7f1f6dece700 1 -- 172.21.15.150:0/1376212541 shutdown_connections 2024-05-08T23:57:57.285 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.290+0000 7f1f6dece700 1 -- 172.21.15.150:0/1376212541 wait complete. 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.290+0000 7f1f6dece700 1 Processor -- start 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.290+0000 7f1f6dece700 1 -- start start 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.290+0000 7f1f6dece700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f68100fe0 0x7f1f68196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f6dece700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f681021e0 0x7f1f68197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f6dece700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f68102b80 0x7f1f6819e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f6dece700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6819ea90 con 0x7f1f681021e0 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f6dece700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6819ebd0 con 0x7f1f68102b80 2024-05-08T23:57:57.287 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f6dece700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6819ed60 con 0x7f1f68100fe0 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f67fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f68102b80 0x7f1f6819e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f67fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f68102b80 0x7f1f6819e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:43434/0 (socket says 172.21.15.150:43434) 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f67fff700 1 -- 172.21.15.150:0/1922206509 learned_addr learned my addr 172.21.15.150:0/1922206509 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f66ffd700 1 --2- 172.21.15.150:0/1922206509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f681021e0 0x7f1f68197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f677fe700 1 --2- 172.21.15.150:0/1922206509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f68100fe0 0x7f1f68196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f67fff700 1 -- 172.21.15.150:0/1922206509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f68100fe0 msgr2=0x7f1f68196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f67fff700 1 --2- 172.21.15.150:0/1922206509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f68100fe0 0x7f1f68196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f67fff700 1 -- 172.21.15.150:0/1922206509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f681021e0 msgr2=0x7f1f68197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f67fff700 1 --2- 172.21.15.150:0/1922206509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f681021e0 0x7f1f68197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f67fff700 1 -- 172.21.15.150:0/1922206509 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f580095f0 con 0x7f1f68102b80 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f67fff700 1 --2- 172.21.15.150:0/1922206509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f68102b80 0x7f1f6819e4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1f60007ee0 tx=0x7f1f6000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f64ff9700 1 -- 172.21.15.150:0/1922206509 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6000ddd0 con 0x7f1f68102b80 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f64ff9700 1 -- 172.21.15.150:0/1922206509 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f6000f040 con 0x7f1f68102b80 2024-05-08T23:57:57.288 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f6dece700 1 -- 172.21.15.150:0/1922206509 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6819efe0 con 0x7f1f68102b80 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f64ff9700 1 -- 172.21.15.150:0/1922206509 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f60015400 con 0x7f1f68102b80 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.291+0000 7f1f6dece700 1 -- 172.21.15.150:0/1922206509 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6819f460 con 0x7f1f68102b80 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.292+0000 7f1f6dece700 1 -- 172.21.15.150:0/1922206509 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f681084b0 con 0x7f1f68102b80 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.293+0000 7f1f64ff9700 1 -- 172.21.15.150:0/1922206509 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f1f60003a00 con 0x7f1f68102b80 2024-05-08T23:57:57.289 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.294+0000 7f1f64ff9700 1 --2- 172.21.15.150:0/1922206509 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1f500a1110 0x7f1f500a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.294+0000 7f1f64ff9700 1 -- 172.21.15.150:0/1922206509 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1487+0+0 (secure 0 0 0) 0x7f1f600cae50 con 0x7f1f68102b80 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.294+0000 7f1f677fe700 1 --2- 172.21.15.150:0/1922206509 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1f500a1110 0x7f1f500a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:57:57.290 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.295+0000 7f1f677fe700 1 --2- 172.21.15.150:0/1922206509 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1f500a1110 0x7f1f500a35d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800b580 tx=0x7f1f58005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:57:57.292 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.298+0000 7f1f64ff9700 1 -- 172.21.15.150:0/1922206509 <== mon.2 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1f600960d0 con 0x7f1f68102b80 2024-05-08T23:57:57.370 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 08 23:57:57 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-0[60150]: 2024-05-08T23:57:57.028+0000 7f6307449700 -1 osd.0 0 waiting for initial osdmap 2024-05-08T23:57:57.370 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 08 23:57:57 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-0[60150]: 2024-05-08T23:57:57.031+0000 7f62ff236700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:57:57.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:57:57.499+0000 7f1f6dece700 1 -- 172.21.15.150:0/1922206509 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f6802ceb0 con 0x7f1f500a1110 2024-05-08T23:57:57.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:57 smithi081 ceph-mon[42474]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-08T23:57:57.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:57 smithi081 ceph-mon[42474]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T23:57:57.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:57 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:57.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:57 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:57.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:57 smithi081 ceph-mon[42474]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' 2024-05-08T23:57:57.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:57 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:57:57.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:57 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:57:57.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:57 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:57.897 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:57 smithi150 ceph-mon[46187]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-08T23:57:57.898 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:57 smithi150 ceph-mon[46187]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T23:57:57.898 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:57 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:57.898 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:57 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:57.898 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:57 smithi150 ceph-mon[46187]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' 2024-05-08T23:57:57.898 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:57 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:57:57.898 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:57 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:57:57.898 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:57 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:58.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:57 smithi171 ceph-mon[47351]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-08T23:57:58.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:57 smithi171 ceph-mon[47351]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T23:57:58.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:57 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:58.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:57 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:58.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:57 smithi171 ceph-mon[47351]: from='osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145]' entity='osd.0' 2024-05-08T23:57:58.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:57 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:57:58.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:57 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:57:58.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:57 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:57:58.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:58 smithi081 ceph-mon[42474]: purged_snaps scrub starts 2024-05-08T23:57:58.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:58 smithi081 ceph-mon[42474]: purged_snaps scrub ok 2024-05-08T23:57:58.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:58 smithi081 ceph-mon[42474]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:57:58.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:58 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:58.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:58 smithi081 ceph-mon[42474]: osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145] boot 2024-05-08T23:57:58.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:58 smithi081 ceph-mon[42474]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T23:57:58.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:58 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:58.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:57:58 smithi081 ceph-mon[42474]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:59.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:58 smithi150 ceph-mon[46187]: purged_snaps scrub starts 2024-05-08T23:57:59.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:58 smithi150 ceph-mon[46187]: purged_snaps scrub ok 2024-05-08T23:57:59.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:58 smithi150 ceph-mon[46187]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:57:59.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:58 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:59.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:58 smithi150 ceph-mon[46187]: osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145] boot 2024-05-08T23:57:59.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:58 smithi150 ceph-mon[46187]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T23:57:59.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:58 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:59.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:57:58 smithi150 ceph-mon[46187]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:57:59.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:58 smithi171 ceph-mon[47351]: purged_snaps scrub starts 2024-05-08T23:57:59.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:58 smithi171 ceph-mon[47351]: purged_snaps scrub ok 2024-05-08T23:57:59.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:58 smithi171 ceph-mon[47351]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:57:59.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:58 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:59.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:58 smithi171 ceph-mon[47351]: osd.0 [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145] boot 2024-05-08T23:57:59.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:58 smithi171 ceph-mon[47351]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T23:57:59.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:58 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T23:57:59.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:57:58 smithi171 ceph-mon[47351]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T23:58:00.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:00 smithi171 ceph-mon[47351]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T23:58:00.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:00 smithi171 ceph-mon[47351]: from='client.? 172.21.15.150:0/251086316' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6663424d-1532-4800-8fd7-b969cf177bc5"}]: dispatch 2024-05-08T23:58:00.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:00 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6663424d-1532-4800-8fd7-b969cf177bc5"}]: dispatch 2024-05-08T23:58:00.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:00 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6663424d-1532-4800-8fd7-b969cf177bc5"}]': finished 2024-05-08T23:58:00.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:00 smithi171 ceph-mon[47351]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T23:58:00.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:00 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:00.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:00 smithi171 ceph-mon[47351]: from='client.? 172.21.15.150:0/3877501355' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:58:00.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:00 smithi081 ceph-mon[42474]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T23:58:00.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:00 smithi081 ceph-mon[42474]: from='client.? 172.21.15.150:0/251086316' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6663424d-1532-4800-8fd7-b969cf177bc5"}]: dispatch 2024-05-08T23:58:00.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:00 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6663424d-1532-4800-8fd7-b969cf177bc5"}]: dispatch 2024-05-08T23:58:00.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:00 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6663424d-1532-4800-8fd7-b969cf177bc5"}]': finished 2024-05-08T23:58:00.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:00 smithi081 ceph-mon[42474]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T23:58:00.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:00 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:00.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:00 smithi081 ceph-mon[42474]: from='client.? 172.21.15.150:0/3877501355' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:58:00.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:00 smithi150 ceph-mon[46187]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T23:58:00.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:00 smithi150 ceph-mon[46187]: from='client.? 172.21.15.150:0/251086316' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6663424d-1532-4800-8fd7-b969cf177bc5"}]: dispatch 2024-05-08T23:58:00.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:00 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6663424d-1532-4800-8fd7-b969cf177bc5"}]: dispatch 2024-05-08T23:58:00.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:00 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6663424d-1532-4800-8fd7-b969cf177bc5"}]': finished 2024-05-08T23:58:00.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:00 smithi150 ceph-mon[46187]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T23:58:00.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:00 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:00.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:00 smithi150 ceph-mon[46187]: from='client.? 172.21.15.150:0/3877501355' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:58:01.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:01 smithi171 ceph-mon[47351]: pgmap v37: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:01.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:01 smithi081 ceph-mon[42474]: pgmap v37: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:01.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:01 smithi150 ceph-mon[46187]: pgmap v37: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:03.344 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:03 smithi150 ceph-mon[46187]: pgmap v38: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:03.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:03 smithi171 ceph-mon[47351]: pgmap v38: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:03 smithi081 ceph-mon[42474]: pgmap v38: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:05.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:05 smithi150 ceph-mon[46187]: pgmap v39: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:05.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:05 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T23:58:05.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:05 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:05.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:05 smithi171 ceph-mon[47351]: pgmap v39: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:05.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:05 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T23:58:05.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:05 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:05.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:05 smithi081 ceph-mon[42474]: pgmap v39: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:05.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:05 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T23:58:05.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:05 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:06.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:06 smithi171 ceph-mon[47351]: Deploying daemon osd.1 on smithi150 2024-05-08T23:58:06.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:06 smithi081 ceph-mon[42474]: Deploying daemon osd.1 on smithi150 2024-05-08T23:58:06.620 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:06 smithi150 ceph-mon[46187]: Deploying daemon osd.1 on smithi150 2024-05-08T23:58:07.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:07 smithi150 ceph-mon[46187]: pgmap v40: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:07.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:07 smithi171 ceph-mon[47351]: pgmap v40: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:07.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:07 smithi081 ceph-mon[42474]: pgmap v40: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:09.547 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:09 smithi150 ceph-mon[46187]: pgmap v41: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:09.547 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:09 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:09.547 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:09 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:09.547 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:09 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:09.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:09 smithi171 ceph-mon[47351]: pgmap v41: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:09.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:09 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:09.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:09 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:09.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:09 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:09.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:09 smithi081 ceph-mon[42474]: pgmap v41: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:09.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:09 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:09.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:09 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:09.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:09 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:11.102 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:11.107+0000 7f1f64ff9700 1 -- 172.21.15.150:0/1922206509 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1f6802ceb0 con 0x7f1f500a1110 2024-05-08T23:58:11.103 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 1 on host 'smithi150' 2024-05-08T23:58:11.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:11.109+0000 7f1f6dece700 1 -- 172.21.15.150:0/1922206509 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1f500a1110 msgr2=0x7f1f500a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:11.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:11.109+0000 7f1f6dece700 1 --2- 172.21.15.150:0/1922206509 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1f500a1110 0x7f1f500a35d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800b580 tx=0x7f1f58005fb0 comp rx=0 tx=0).stop 2024-05-08T23:58:11.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:11.109+0000 7f1f6dece700 1 -- 172.21.15.150:0/1922206509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f68102b80 msgr2=0x7f1f6819e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:11.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:11.109+0000 7f1f6dece700 1 --2- 172.21.15.150:0/1922206509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f68102b80 0x7f1f6819e4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1f60007ee0 tx=0x7f1f6000d3b0 comp rx=0 tx=0).stop 2024-05-08T23:58:11.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:11.109+0000 7f1f6dece700 1 -- 172.21.15.150:0/1922206509 shutdown_connections 2024-05-08T23:58:11.104 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:11.109+0000 7f1f6dece700 1 --2- 172.21.15.150:0/1922206509 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1f500a1110 0x7f1f500a35d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:11.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:11.109+0000 7f1f6dece700 1 --2- 172.21.15.150:0/1922206509 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1f68102b80 0x7f1f6819e4c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:11.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:11.109+0000 7f1f6dece700 1 --2- 172.21.15.150:0/1922206509 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1f68100fe0 0x7f1f68196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:11.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:11.109+0000 7f1f6dece700 1 --2- 172.21.15.150:0/1922206509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f681021e0 0x7f1f68197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:11.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:11.109+0000 7f1f6dece700 1 -- 172.21.15.150:0/1922206509 >> 172.21.15.150:0/1922206509 conn(0x7f1f680fc580 msgr2=0x7f1f681055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:11.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:11.110+0000 7f1f6dece700 1 -- 172.21.15.150:0/1922206509 shutdown_connections 2024-05-08T23:58:11.105 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:11.110+0000 7f1f6dece700 1 -- 172.21.15.150:0/1922206509 wait complete. 2024-05-08T23:58:11.422 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:11 smithi150 ceph-mon[46187]: pgmap v42: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:11.423 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:11.423 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:11.423 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:11.423 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:11.517 DEBUG:teuthology.orchestra.run.smithi150:osd.1> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.1.service 2024-05-08T23:58:11.520 INFO:tasks.cephadm:Deploying osd.2 on smithi171 with /dev/vg_nvme/lv_4... 2024-05-08T23:58:11.520 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T23:58:11.551 INFO:journalctl@ceph.osd.1.smithi150.stdout:-- Logs begin at Wed 2024-05-08 23:39:53 UTC. -- 2024-05-08T23:58:11.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:11 smithi171 ceph-mon[47351]: pgmap v42: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:11.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:11.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:11.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:11.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:11.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:11 smithi081 ceph-mon[42474]: pgmap v42: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:11.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:11.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:11.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:11.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:11.747 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:58:13.013 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T23:58:13.013 INFO:teuthology.orchestra.run.smithi171.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T23:58:13.013 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 10+0 records in 2024-05-08T23:58:13.013 INFO:teuthology.orchestra.run.smithi171.stderr:10+0 records out 2024-05-08T23:58:13.013 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110428 s, 950 MB/s 2024-05-08T23:58:13.013 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping successful for: 2024-05-08T23:58:13.264 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 08 23:58:12 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-1[51153]: 2024-05-08T23:58:12.898+0000 7f28fee197c0 -1 osd.1 0 log_to_monitors true 2024-05-08T23:58:13.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:13 smithi171 ceph-mon[47351]: pgmap v43: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:13.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:13 smithi171 ceph-mon[47351]: from='osd.1 [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T23:58:13.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:13 smithi171 ceph-mon[47351]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T23:58:13.402 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_4 2024-05-08T23:58:13.592 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:13 smithi150 ceph-mon[46187]: pgmap v43: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:13.592 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:13 smithi150 ceph-mon[46187]: from='osd.1 [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T23:58:13.592 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:13 smithi150 ceph-mon[46187]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T23:58:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:13 smithi081 ceph-mon[42474]: pgmap v43: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:13 smithi081 ceph-mon[42474]: from='osd.1 [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T23:58:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:13 smithi081 ceph-mon[42474]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T23:58:13.658 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:58:14.448 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='osd.1 [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-08T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-08T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:14.449 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:14.450 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:14.450 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:14 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T23:58:14.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T23:58:14.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:14.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='osd.1 [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-08T23:58:14.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-08T23:58:14.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:58:14.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:14.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:14.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:14.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:14.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:14.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:14 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.631+0000 7f8c23de6700 1 -- 172.21.15.171:0/3122854356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c0fff00 msgr2=0x7f8c1c100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:14.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.631+0000 7f8c23de6700 1 --2- 172.21.15.171:0/3122854356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c0fff00 0x7f8c1c100320 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c009990 tx=0x7f8c0c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:58:14.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.631+0000 7f8c23de6700 1 -- 172.21.15.171:0/3122854356 shutdown_connections 2024-05-08T23:58:14.628 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.631+0000 7f8c23de6700 1 --2- 172.21.15.171:0/3122854356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c1c101a20 0x7f8c1c108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:14.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.631+0000 7f8c23de6700 1 --2- 172.21.15.171:0/3122854356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c0fff00 0x7f8c1c100320 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:14.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.631+0000 7f8c23de6700 1 --2- 172.21.15.171:0/3122854356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c1c101060 0x7f8c1c1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:14.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.631+0000 7f8c23de6700 1 -- 172.21.15.171:0/3122854356 >> 172.21.15.171:0/3122854356 conn(0x7f8c1c0fb4c0 msgr2=0x7f8c1c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:14.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.631+0000 7f8c23de6700 1 -- 172.21.15.171:0/3122854356 shutdown_connections 2024-05-08T23:58:14.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.631+0000 7f8c23de6700 1 -- 172.21.15.171:0/3122854356 wait complete. 2024-05-08T23:58:14.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c23de6700 1 Processor -- start 2024-05-08T23:58:14.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c23de6700 1 -- start start 2024-05-08T23:58:14.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c23de6700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c0fff00 0x7f8c1c196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:58:14.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c23de6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c1c101060 0x7f8c1c197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:58:14.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c23de6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c1c101a20 0x7f8c1c19e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:58:14.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c23de6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c19ea40 con 0x7f8c1c101a20 2024-05-08T23:58:14.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c23de6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c19eb80 con 0x7f8c1c101060 2024-05-08T23:58:14.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c23de6700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c19ed10 con 0x7f8c1c0fff00 2024-05-08T23:58:14.629 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c21b82700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c0fff00 0x7f8c1c196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:58:14.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c21b82700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c0fff00 0x7f8c1c196f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:57362/0 (socket says 172.21.15.171:57362) 2024-05-08T23:58:14.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c21b82700 1 -- 172.21.15.171:0/1168887689 learned_addr learned my addr 172.21.15.171:0/1168887689 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-08T23:58:14.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c21381700 1 --2- 172.21.15.171:0/1168887689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c1c101060 0x7f8c1c197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:58:14.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c22383700 1 --2- 172.21.15.171:0/1168887689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c1c101a20 0x7f8c1c19e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:58:14.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c21b82700 1 -- 172.21.15.171:0/1168887689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c1c101060 msgr2=0x7f8c1c197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:14.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c21b82700 1 --2- 172.21.15.171:0/1168887689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c1c101060 0x7f8c1c197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:14.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c21b82700 1 -- 172.21.15.171:0/1168887689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c1c101a20 msgr2=0x7f8c1c19e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:14.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c21b82700 1 --2- 172.21.15.171:0/1168887689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c1c101a20 0x7f8c1c19e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:14.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c21b82700 1 -- 172.21.15.171:0/1168887689 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c0095f0 con 0x7f8c1c0fff00 2024-05-08T23:58:14.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.632+0000 7f8c21b82700 1 --2- 172.21.15.171:0/1168887689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c0fff00 0x7f8c1c196f00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c00b680 tx=0x7f8c0c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:14.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.633+0000 7f8c12ffd700 1 -- 172.21.15.171:0/1168887689 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c01d070 con 0x7f8c1c0fff00 2024-05-08T23:58:14.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.633+0000 7f8c12ffd700 1 -- 172.21.15.171:0/1168887689 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c0c0054f0 con 0x7f8c1c0fff00 2024-05-08T23:58:14.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.633+0000 7f8c23de6700 1 -- 172.21.15.171:0/1168887689 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c19ef90 con 0x7f8c1c0fff00 2024-05-08T23:58:14.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.633+0000 7f8c12ffd700 1 -- 172.21.15.171:0/1168887689 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c0c004c60 con 0x7f8c1c0fff00 2024-05-08T23:58:14.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.633+0000 7f8c23de6700 1 -- 172.21.15.171:0/1168887689 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c19f340 con 0x7f8c1c0fff00 2024-05-08T23:58:14.631 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.634+0000 7f8c23de6700 1 -- 172.21.15.171:0/1168887689 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1c04ec60 con 0x7f8c1c0fff00 2024-05-08T23:58:14.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.635+0000 7f8c12ffd700 1 -- 172.21.15.171:0/1168887689 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f8c0c00fb80 con 0x7f8c1c0fff00 2024-05-08T23:58:14.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.635+0000 7f8c12ffd700 1 --2- 172.21.15.171:0/1168887689 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8c080a1090 0x7f8c080a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:58:14.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.635+0000 7f8c12ffd700 1 -- 172.21.15.171:0/1168887689 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2029+0+0 (secure 0 0 0) 0x7f8c0c0cc3b0 con 0x7f8c1c0fff00 2024-05-08T23:58:14.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.635+0000 7f8c21381700 1 --2- 172.21.15.171:0/1168887689 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8c080a1090 0x7f8c080a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:58:14.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.636+0000 7f8c21381700 1 --2- 172.21.15.171:0/1168887689 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8c080a1090 0x7f8c080a3550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c18005950 tx=0x7f8c1800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:14.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.639+0000 7f8c12ffd700 1 -- 172.21.15.171:0/1168887689 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8c0c097540 con 0x7f8c1c0fff00 2024-05-08T23:58:14.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T23:58:14.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T23:58:14.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:14.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='osd.1 [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-08T23:58:14.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-08T23:58:14.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:58:14.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:14.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:14.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:14.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:14.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:14.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:14 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:14.836 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:14.841+0000 7f8c23de6700 1 -- 172.21.15.171:0/1168887689 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c1c0fc240 con 0x7f8c080a1090 2024-05-08T23:58:15.264 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 08 23:58:14 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-1[51153]: 2024-05-08T23:58:14.771+0000 7f28f447d700 -1 osd.1 0 waiting for initial osdmap 2024-05-08T23:58:15.264 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 08 23:58:14 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-1[51153]: 2024-05-08T23:58:14.774+0000 7f28ec26a700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:58:15.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:15 smithi171 ceph-mon[47351]: Detected new or changed devices on smithi150 2024-05-08T23:58:15.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:15 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi150 to 17114M 2024-05-08T23:58:15.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:15 smithi171 ceph-mon[47351]: pgmap v45: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:15.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:15 smithi171 ceph-mon[47351]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-05-08T23:58:15.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:15 smithi171 ceph-mon[47351]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T23:58:15.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:15 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:15.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:15 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:15.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:15 smithi171 ceph-mon[47351]: from='osd.1 ' entity='osd.1' 2024-05-08T23:58:15.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:15 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:58:15.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:15 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:58:15.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:15 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:15.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:15 smithi081 ceph-mon[42474]: Detected new or changed devices on smithi150 2024-05-08T23:58:15.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:15 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi150 to 17114M 2024-05-08T23:58:15.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:15 smithi081 ceph-mon[42474]: pgmap v45: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:15.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:15 smithi081 ceph-mon[42474]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-05-08T23:58:15.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:15 smithi081 ceph-mon[42474]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T23:58:15.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:15 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:15.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:15 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:15.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:15 smithi081 ceph-mon[42474]: from='osd.1 ' entity='osd.1' 2024-05-08T23:58:15.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:15 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:58:15.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:15 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:58:15.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:15 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:15.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:15 smithi150 ceph-mon[46187]: Detected new or changed devices on smithi150 2024-05-08T23:58:15.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:15 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi150 to 17114M 2024-05-08T23:58:15.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:15 smithi150 ceph-mon[46187]: pgmap v45: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:15.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:15 smithi150 ceph-mon[46187]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-05-08T23:58:15.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:15 smithi150 ceph-mon[46187]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T23:58:15.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:15 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:15.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:15 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:15.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:15 smithi150 ceph-mon[46187]: from='osd.1 ' entity='osd.1' 2024-05-08T23:58:15.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:15 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:58:15.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:15 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:58:15.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:15 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:16.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:16 smithi081 ceph-mon[42474]: purged_snaps scrub starts 2024-05-08T23:58:16.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:16 smithi081 ceph-mon[42474]: purged_snaps scrub ok 2024-05-08T23:58:16.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:16 smithi081 ceph-mon[42474]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:16.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:16 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:16.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:16 smithi081 ceph-mon[42474]: osd.1 [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112] boot 2024-05-08T23:58:16.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:16 smithi081 ceph-mon[42474]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T23:58:16.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:16 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:16.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:16 smithi150 ceph-mon[46187]: purged_snaps scrub starts 2024-05-08T23:58:16.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:16 smithi150 ceph-mon[46187]: purged_snaps scrub ok 2024-05-08T23:58:16.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:16 smithi150 ceph-mon[46187]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:16.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:16 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:16.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:16 smithi150 ceph-mon[46187]: osd.1 [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112] boot 2024-05-08T23:58:16.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:16 smithi150 ceph-mon[46187]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T23:58:16.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:16 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:16.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:16 smithi171 ceph-mon[47351]: purged_snaps scrub starts 2024-05-08T23:58:16.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:16 smithi171 ceph-mon[47351]: purged_snaps scrub ok 2024-05-08T23:58:16.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:16 smithi171 ceph-mon[47351]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:16.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:16 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:16.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:16 smithi171 ceph-mon[47351]: osd.1 [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112] boot 2024-05-08T23:58:16.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:16 smithi171 ceph-mon[47351]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T23:58:16.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:16 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T23:58:17.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:17 smithi081 ceph-mon[42474]: pgmap v48: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:17.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:17 smithi081 ceph-mon[42474]: from='client.? 172.21.15.171:0/236369849' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8943079-f99e-4886-ae7f-69ea2917b744"}]: dispatch 2024-05-08T23:58:17.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:17 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8943079-f99e-4886-ae7f-69ea2917b744"}]: dispatch 2024-05-08T23:58:17.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:17 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8943079-f99e-4886-ae7f-69ea2917b744"}]': finished 2024-05-08T23:58:17.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:17 smithi081 ceph-mon[42474]: osdmap e14: 3 total, 2 up, 3 in 2024-05-08T23:58:17.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:17 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:17.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:17 smithi150 ceph-mon[46187]: pgmap v48: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:17.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:17 smithi150 ceph-mon[46187]: from='client.? 172.21.15.171:0/236369849' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8943079-f99e-4886-ae7f-69ea2917b744"}]: dispatch 2024-05-08T23:58:17.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:17 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8943079-f99e-4886-ae7f-69ea2917b744"}]: dispatch 2024-05-08T23:58:17.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:17 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8943079-f99e-4886-ae7f-69ea2917b744"}]': finished 2024-05-08T23:58:17.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:17 smithi150 ceph-mon[46187]: osdmap e14: 3 total, 2 up, 3 in 2024-05-08T23:58:17.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:17 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:17.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:17 smithi171 ceph-mon[47351]: pgmap v48: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T23:58:17.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:17 smithi171 ceph-mon[47351]: from='client.? 172.21.15.171:0/236369849' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8943079-f99e-4886-ae7f-69ea2917b744"}]: dispatch 2024-05-08T23:58:17.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:17 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8943079-f99e-4886-ae7f-69ea2917b744"}]: dispatch 2024-05-08T23:58:17.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:17 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8943079-f99e-4886-ae7f-69ea2917b744"}]': finished 2024-05-08T23:58:17.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:17 smithi171 ceph-mon[47351]: osdmap e14: 3 total, 2 up, 3 in 2024-05-08T23:58:17.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:17 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:18 smithi081 ceph-mon[42474]: from='client.? 172.21.15.171:0/1197671461' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:58:18.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:18 smithi150 ceph-mon[46187]: from='client.? 172.21.15.171:0/1197671461' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:58:18.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:18 smithi171 ceph-mon[47351]: from='client.? 172.21.15.171:0/1197671461' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:58:19.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:19 smithi081 ceph-mon[42474]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:19.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:19 smithi150 ceph-mon[46187]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:19.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:19 smithi171 ceph-mon[47351]: pgmap v50: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:21.488 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:21 smithi171 ceph-mon[47351]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:21.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:21 smithi081 ceph-mon[42474]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:21.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:21 smithi150 ceph-mon[46187]: pgmap v51: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:23.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:23 smithi171 ceph-mon[47351]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:23.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:23 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T23:58:23.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:23 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:23.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:23 smithi081 ceph-mon[42474]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:23.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:23 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T23:58:23.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:23 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:23.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:23 smithi150 ceph-mon[46187]: pgmap v52: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:23.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:23 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T23:58:23.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:23 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:24.596 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:24 smithi171 ceph-mon[47351]: Deploying daemon osd.2 on smithi171 2024-05-08T23:58:24.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:24 smithi081 ceph-mon[42474]: Deploying daemon osd.2 on smithi171 2024-05-08T23:58:24.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:24 smithi150 ceph-mon[46187]: Deploying daemon osd.2 on smithi171 2024-05-08T23:58:25.587 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:25 smithi171 ceph-mon[47351]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:25.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:25 smithi081 ceph-mon[42474]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:25.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:25 smithi150 ceph-mon[46187]: pgmap v53: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:27.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:27 smithi081 ceph-mon[42474]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:27.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:27 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:27.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:27 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:27.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:27 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:27.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:27 smithi171 ceph-mon[47351]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:27.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:27 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:27.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:27 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:27.672 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:27 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:27.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:27 smithi150 ceph-mon[46187]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:27.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:27 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:27.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:27 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:27.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:27 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:28.589 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:28.594+0000 7f8c12ffd700 1 -- 172.21.15.171:0/1168887689 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8c1c0fc240 con 0x7f8c080a1090 2024-05-08T23:58:28.590 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 2 on host 'smithi171' 2024-05-08T23:58:28.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:28.597+0000 7f8c23de6700 1 -- 172.21.15.171:0/1168887689 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8c080a1090 msgr2=0x7f8c080a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:28.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:28.597+0000 7f8c23de6700 1 --2- 172.21.15.171:0/1168887689 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8c080a1090 0x7f8c080a3550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c18005950 tx=0x7f8c1800a300 comp rx=0 tx=0).stop 2024-05-08T23:58:28.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:28.597+0000 7f8c23de6700 1 -- 172.21.15.171:0/1168887689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c0fff00 msgr2=0x7f8c1c196f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:28.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:28.597+0000 7f8c23de6700 1 --2- 172.21.15.171:0/1168887689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c0fff00 0x7f8c1c196f00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c00b680 tx=0x7f8c0c004730 comp rx=0 tx=0).stop 2024-05-08T23:58:28.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:28.597+0000 7f8c23de6700 1 -- 172.21.15.171:0/1168887689 shutdown_connections 2024-05-08T23:58:28.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:28.597+0000 7f8c23de6700 1 --2- 172.21.15.171:0/1168887689 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8c080a1090 0x7f8c080a3550 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:28.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:28.597+0000 7f8c23de6700 1 --2- 172.21.15.171:0/1168887689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c1c101a20 0x7f8c1c19e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:28.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:28.597+0000 7f8c23de6700 1 --2- 172.21.15.171:0/1168887689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c1c0fff00 0x7f8c1c196f00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:28.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:28.597+0000 7f8c23de6700 1 --2- 172.21.15.171:0/1168887689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c1c101060 0x7f8c1c197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:28.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:28.597+0000 7f8c23de6700 1 -- 172.21.15.171:0/1168887689 >> 172.21.15.171:0/1168887689 conn(0x7f8c1c0fb4c0 msgr2=0x7f8c1c0fbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:28.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:28.597+0000 7f8c23de6700 1 -- 172.21.15.171:0/1168887689 shutdown_connections 2024-05-08T23:58:28.592 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:58:28.597+0000 7f8c23de6700 1 -- 172.21.15.171:0/1168887689 wait complete. 2024-05-08T23:58:28.981 DEBUG:teuthology.orchestra.run.smithi171:osd.2> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.2.service 2024-05-08T23:58:28.983 INFO:tasks.cephadm:Deploying osd.3 on smithi081 with /dev/vg_nvme/lv_3... 2024-05-08T23:58:28.984 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T23:58:29.015 INFO:journalctl@ceph.osd.2.smithi171.stdout:-- Logs begin at Wed 2024-05-08 23:40:11 UTC. -- 2024-05-08T23:58:29.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:28 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:29.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:28 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:29.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:28 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:29.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:28 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:29.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:28 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:29.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:28 smithi171 ceph-mon[47351]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:29.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:28 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:29.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:28 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:29.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:28 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:29.215 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:58:29.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:28 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:29.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:28 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:29.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:28 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:29.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:28 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:29.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:28 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:29.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:28 smithi150 ceph-mon[46187]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:29.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:28 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:29.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:28 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:29.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:28 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:29.339 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:28 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:29.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:28 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:29.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:28 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:29.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:28 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:29.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:28 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:29.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:28 smithi081 ceph-mon[42474]: pgmap v55: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:29.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:28 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:29.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:28 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:29.340 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:28 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:30.476 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T23:58:30.476 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T23:58:30.476 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-05-08T23:58:30.476 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-05-08T23:58:30.476 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0120948 s, 867 MB/s 2024-05-08T23:58:30.476 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-05-08T23:58:30.761 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 08 23:58:30 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-2[53103]: 2024-05-08T23:58:30.310+0000 7f19ca7e17c0 -1 osd.2 0 log_to_monitors true 2024-05-08T23:58:30.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_3 2024-05-08T23:58:31.074 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:58:31.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:31 smithi171 ceph-mon[47351]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:31.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:31 smithi171 ceph-mon[47351]: from='osd.2 [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T23:58:31.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:31 smithi171 ceph-mon[47351]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T23:58:31.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:31.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:31.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:58:31.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:31.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:31.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:31.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:31 smithi081 ceph-mon[42474]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:31 smithi081 ceph-mon[42474]: from='osd.2 [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T23:58:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:31 smithi081 ceph-mon[42474]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T23:58:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:58:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:31.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:31 smithi150 ceph-mon[46187]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:31.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:31 smithi150 ceph-mon[46187]: from='osd.2 [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T23:58:31.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:31 smithi150 ceph-mon[46187]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T23:58:31.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:58:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:31.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:32.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.183+0000 7fe74ba7f700 1 -- 172.21.15.81:0/3200277275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe744101170 msgr2=0x7fe7441015d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.183+0000 7fe74ba7f700 1 --2- 172.21.15.81:0/3200277275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe744101170 0x7fe7441015d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe7400099c0 tx=0x7fe740009cd0 comp rx=0 tx=0).stop 2024-05-08T23:58:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.183+0000 7fe74ba7f700 1 -- 172.21.15.81:0/3200277275 shutdown_connections 2024-05-08T23:58:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.183+0000 7fe74ba7f700 1 --2- 172.21.15.81:0/3200277275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7440fff70 0x7fe744100390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.183+0000 7fe74ba7f700 1 --2- 172.21.15.81:0/3200277275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe744101b10 0x7fe7441083c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.183+0000 7fe74ba7f700 1 --2- 172.21.15.81:0/3200277275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe744101170 0x7fe7441015d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.183+0000 7fe74ba7f700 1 -- 172.21.15.81:0/3200277275 >> 172.21.15.81:0/3200277275 conn(0x7fe7440fb530 msgr2=0x7fe7440fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.183+0000 7fe74ba7f700 1 -- 172.21.15.81:0/3200277275 shutdown_connections 2024-05-08T23:58:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.183+0000 7fe74ba7f700 1 -- 172.21.15.81:0/3200277275 wait complete. 2024-05-08T23:58:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.184+0000 7fe74ba7f700 1 Processor -- start 2024-05-08T23:58:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.184+0000 7fe74ba7f700 1 -- start start 2024-05-08T23:58:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.184+0000 7fe74ba7f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7440fff70 0x7fe744196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:58:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.184+0000 7fe74ba7f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe744101170 0x7fe744197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:58:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.184+0000 7fe74ba7f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe744101b10 0x7fe74419e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:58:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.184+0000 7fe74ba7f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74419ea70 con 0x7fe7440fff70 2024-05-08T23:58:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.184+0000 7fe74ba7f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74419ebb0 con 0x7fe744101b10 2024-05-08T23:58:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.184+0000 7fe74ba7f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74419ed40 con 0x7fe744101170 2024-05-08T23:58:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.184+0000 7fe74981b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7440fff70 0x7fe744196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:58:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.184+0000 7fe74981b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7440fff70 0x7fe744196f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54326/0 (socket says 172.21.15.81:54326) 2024-05-08T23:58:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.184+0000 7fe74981b700 1 -- 172.21.15.81:0/955577355 learned_addr learned my addr 172.21.15.81:0/955577355 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:58:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.184+0000 7fe74901a700 1 --2- 172.21.15.81:0/955577355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe744101170 0x7fe744197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:58:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.184+0000 7fe74a01c700 1 --2- 172.21.15.81:0/955577355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe744101b10 0x7fe74419e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:58:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.185+0000 7fe74981b700 1 -- 172.21.15.81:0/955577355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe744101170 msgr2=0x7fe744197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.185+0000 7fe74981b700 1 --2- 172.21.15.81:0/955577355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe744101170 0x7fe744197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.185+0000 7fe74981b700 1 -- 172.21.15.81:0/955577355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe744101b10 msgr2=0x7fe74419e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.185+0000 7fe74981b700 1 --2- 172.21.15.81:0/955577355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe744101b10 0x7fe74419e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:32.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.185+0000 7fe74981b700 1 -- 172.21.15.81:0/955577355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe734009520 con 0x7fe7440fff70 2024-05-08T23:58:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.185+0000 7fe74981b700 1 --2- 172.21.15.81:0/955577355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7440fff70 0x7fe744196f30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe73400ea80 tx=0x7fe73400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.185+0000 7fe73affd700 1 -- 172.21.15.81:0/955577355 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73400cc90 con 0x7fe7440fff70 2024-05-08T23:58:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.185+0000 7fe73affd700 1 -- 172.21.15.81:0/955577355 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe73400cdf0 con 0x7fe7440fff70 2024-05-08T23:58:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.185+0000 7fe74ba7f700 1 -- 172.21.15.81:0/955577355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7400095f0 con 0x7fe7440fff70 2024-05-08T23:58:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.185+0000 7fe73affd700 1 -- 172.21.15.81:0/955577355 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe734018750 con 0x7fe7440fff70 2024-05-08T23:58:32.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.185+0000 7fe74ba7f700 1 -- 172.21.15.81:0/955577355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74419f2f0 con 0x7fe7440fff70 2024-05-08T23:58:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.186+0000 7fe74ba7f700 1 -- 172.21.15.81:0/955577355 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74404ec60 con 0x7fe7440fff70 2024-05-08T23:58:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.187+0000 7fe73affd700 1 -- 172.21.15.81:0/955577355 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fe734010980 con 0x7fe7440fff70 2024-05-08T23:58:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.187+0000 7fe73affd700 1 --2- 172.21.15.81:0/955577355 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe7300a1190 0x7fe7300a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:58:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.188+0000 7fe74901a700 1 --2- 172.21.15.81:0/955577355 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe7300a1190 0x7fe7300a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:58:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.188+0000 7fe73affd700 1 -- 172.21.15.81:0/955577355 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2445+0+0 (secure 0 0 0) 0x7fe734014070 con 0x7fe7440fff70 2024-05-08T23:58:32.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.188+0000 7fe74901a700 1 --2- 172.21.15.81:0/955577355 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe7300a1190 0x7fe7300a3650 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe74000b580 tx=0x7fe74001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:32.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.192+0000 7fe73affd700 1 -- 172.21.15.81:0/955577355 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe7340965a0 con 0x7fe7440fff70 2024-05-08T23:58:32.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:32.399+0000 7fe74ba7f700 1 -- 172.21.15.81:0/955577355 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7440fd760 con 0x7fe7300a1190 2024-05-08T23:58:32.553 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 08 23:58:32 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-2[53103]: 2024-05-08T23:58:32.301+0000 7f19bfe45700 -1 osd.2 0 waiting for initial osdmap 2024-05-08T23:58:32.553 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 08 23:58:32 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-2[53103]: 2024-05-08T23:58:32.305+0000 7f19bbc3a700 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:58:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:32 smithi171 ceph-mon[47351]: Detected new or changed devices on smithi171 2024-05-08T23:58:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:32 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi171 to 17114M 2024-05-08T23:58:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:32 smithi171 ceph-mon[47351]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T23:58:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:32 smithi171 ceph-mon[47351]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T23:58:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:32 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:32 smithi171 ceph-mon[47351]: from='osd.2 [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-08T23:58:32.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:32 smithi171 ceph-mon[47351]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-08T23:58:32.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:32 smithi081 ceph-mon[42474]: Detected new or changed devices on smithi171 2024-05-08T23:58:32.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:32 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi171 to 17114M 2024-05-08T23:58:32.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:32 smithi081 ceph-mon[42474]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T23:58:32.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:32 smithi081 ceph-mon[42474]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T23:58:32.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:32 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:32.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:32 smithi081 ceph-mon[42474]: from='osd.2 [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-08T23:58:32.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:32 smithi081 ceph-mon[42474]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-08T23:58:32.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:32 smithi150 ceph-mon[46187]: Detected new or changed devices on smithi171 2024-05-08T23:58:32.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:32 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi171 to 17114M 2024-05-08T23:58:32.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:32 smithi150 ceph-mon[46187]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T23:58:32.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:32 smithi150 ceph-mon[46187]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T23:58:32.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:32 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:32.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:32 smithi150 ceph-mon[46187]: from='osd.2 [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-08T23:58:32.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:32 smithi150 ceph-mon[46187]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-08T23:58:33.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:33 smithi081 ceph-mon[42474]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:33.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:33 smithi081 ceph-mon[42474]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-08T23:58:33.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:33 smithi081 ceph-mon[42474]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T23:58:33.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:33.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:33.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:33 smithi081 ceph-mon[42474]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:33.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:58:33.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:58:33.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:33.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:33 smithi171 ceph-mon[47351]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:33 smithi171 ceph-mon[47351]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-08T23:58:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:33 smithi171 ceph-mon[47351]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T23:58:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:33 smithi171 ceph-mon[47351]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:58:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:58:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:33 smithi150 ceph-mon[46187]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:33 smithi150 ceph-mon[46187]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-08T23:58:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:33 smithi150 ceph-mon[46187]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T23:58:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:33.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:33.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:33 smithi150 ceph-mon[46187]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:33.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:58:33.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:58:33.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:34.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:34 smithi171 ceph-mon[47351]: purged_snaps scrub starts 2024-05-08T23:58:34.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:34 smithi171 ceph-mon[47351]: purged_snaps scrub ok 2024-05-08T23:58:34.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:34 smithi171 ceph-mon[47351]: osd.2 [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999] boot 2024-05-08T23:58:34.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:34 smithi171 ceph-mon[47351]: osdmap e17: 3 total, 3 up, 3 in 2024-05-08T23:58:34.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:34 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:34.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:34 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1186014631' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db48419f-e889-4126-9b11-9f40dee85d82"}]: dispatch 2024-05-08T23:58:34.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:34 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1186014631' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db48419f-e889-4126-9b11-9f40dee85d82"}]': finished 2024-05-08T23:58:34.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:34 smithi171 ceph-mon[47351]: osdmap e18: 4 total, 3 up, 4 in 2024-05-08T23:58:34.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:34 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:34.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:34 smithi081 ceph-mon[42474]: purged_snaps scrub starts 2024-05-08T23:58:34.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:34 smithi081 ceph-mon[42474]: purged_snaps scrub ok 2024-05-08T23:58:34.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:34 smithi081 ceph-mon[42474]: osd.2 [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999] boot 2024-05-08T23:58:34.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:34 smithi081 ceph-mon[42474]: osdmap e17: 3 total, 3 up, 3 in 2024-05-08T23:58:34.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:34 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:34.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:34 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1186014631' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db48419f-e889-4126-9b11-9f40dee85d82"}]: dispatch 2024-05-08T23:58:34.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:34 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1186014631' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db48419f-e889-4126-9b11-9f40dee85d82"}]': finished 2024-05-08T23:58:34.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:34 smithi081 ceph-mon[42474]: osdmap e18: 4 total, 3 up, 4 in 2024-05-08T23:58:34.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:34 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:35.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:34 smithi150 ceph-mon[46187]: purged_snaps scrub starts 2024-05-08T23:58:35.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:34 smithi150 ceph-mon[46187]: purged_snaps scrub ok 2024-05-08T23:58:35.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:34 smithi150 ceph-mon[46187]: osd.2 [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999] boot 2024-05-08T23:58:35.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:34 smithi150 ceph-mon[46187]: osdmap e17: 3 total, 3 up, 3 in 2024-05-08T23:58:35.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:34 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T23:58:35.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:34 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1186014631' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "db48419f-e889-4126-9b11-9f40dee85d82"}]: dispatch 2024-05-08T23:58:35.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:34 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1186014631' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "db48419f-e889-4126-9b11-9f40dee85d82"}]': finished 2024-05-08T23:58:35.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:34 smithi150 ceph-mon[46187]: osdmap e18: 4 total, 3 up, 4 in 2024-05-08T23:58:35.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:34 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:35.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:35 smithi171 ceph-mon[47351]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:58:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:35 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2411709055' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:58:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T23:58:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:35 smithi171 ceph-mon[47351]: osdmap e19: 4 total, 3 up, 4 in 2024-05-08T23:58:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:58:35.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:35 smithi081 ceph-mon[42474]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:35.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:58:35.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:35 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2411709055' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:58:35.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T23:58:35.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:35 smithi081 ceph-mon[42474]: osdmap e19: 4 total, 3 up, 4 in 2024-05-08T23:58:35.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:35.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:58:36.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:35 smithi150 ceph-mon[46187]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-08T23:58:36.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:58:36.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:35 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2411709055' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:58:36.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T23:58:36.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:35 smithi150 ceph-mon[46187]: osdmap e19: 4 total, 3 up, 4 in 2024-05-08T23:58:36.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:36.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T23:58:36.800 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 08 23:58:36 smithi081 sudo[66804]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T23:58:36.800 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 08 23:58:36 smithi081 sudo[66804]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:58:36.800 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 08 23:58:36 smithi081 sudo[66804]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:58:36.800 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 08 23:58:36 smithi081 sudo[66804]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:58:37.120 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 08 23:58:36 smithi081 sudo[66809]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T23:58:37.120 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 08 23:58:36 smithi081 sudo[66809]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:58:37.120 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 08 23:58:36 smithi081 sudo[66809]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:58:37.120 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 08 23:58:36 smithi081 sudo[66809]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:58:37.311 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 08 23:58:37 smithi150 sudo[56106]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T23:58:37.311 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 08 23:58:37 smithi150 sudo[56106]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:58:37.311 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 08 23:58:37 smithi150 sudo[56106]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:58:37.311 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 08 23:58:37 smithi150 sudo[56106]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:58:37.312 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 08 23:58:37 smithi150 sudo[56109]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T23:58:37.312 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T23:58:37.312 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:37 smithi150 ceph-mon[46187]: osdmap e20: 4 total, 3 up, 4 in 2024-05-08T23:58:37.312 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:37.312 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:37 smithi150 ceph-mon[46187]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:58:37.312 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:37.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T23:58:37.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:37 smithi171 ceph-mon[47351]: osdmap e20: 4 total, 3 up, 4 in 2024-05-08T23:58:37.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:37.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:37 smithi171 ceph-mon[47351]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:58:37.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:37.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T23:58:37.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:37 smithi081 ceph-mon[42474]: osdmap e20: 4 total, 3 up, 4 in 2024-05-08T23:58:37.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:37.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:37 smithi081 ceph-mon[42474]: pgmap v65: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:58:37.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:37.764 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 08 23:58:37 smithi150 sudo[56109]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:58:37.764 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 08 23:58:37 smithi150 sudo[56109]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:58:37.764 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 08 23:58:37 smithi150 sudo[56109]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:58:37.821 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 08 23:58:37 smithi171 sudo[57748]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T23:58:37.822 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 08 23:58:37 smithi171 sudo[57748]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:58:37.822 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 08 23:58:37 smithi171 sudo[57748]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:58:37.822 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 08 23:58:37 smithi171 sudo[57748]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:58:37.822 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 08 23:58:37 smithi171 sudo[57751]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T23:58:37.822 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 08 23:58:37 smithi171 sudo[57751]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:58:37.822 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 08 23:58:37 smithi171 sudo[57751]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:58:37.822 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 08 23:58:37 smithi171 sudo[57751]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:58:37.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:37.840+0000 7fe73affd700 1 -- 172.21.15.81:0/955577355 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe734096970 con 0x7fe7440fff70 2024-05-08T23:58:38.176 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:38 smithi081 sudo[67323]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T23:58:38.176 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:38 smithi081 sudo[67323]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:58:38.176 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:38 smithi081 sudo[67323]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:58:38.176 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:38 smithi081 sudo[67323]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:58:38.605 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:38 smithi081 sudo[67389]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T23:58:38.605 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:38 smithi081 sudo[67389]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:58:38.605 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:38 smithi081 sudo[67389]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:58:38.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:38 smithi081 sudo[67389]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:58:38.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:38 smithi081 ceph-mon[42474]: osdmap e21: 4 total, 3 up, 4 in 2024-05-08T23:58:38.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:38.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:38.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:38 smithi081 ceph-mon[42474]: mgrmap e16: x(active, since 111s), standbys: z, y 2024-05-08T23:58:38.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:38.606 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:38 smithi081 ceph-mon[42474]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:58:38.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:38 smithi150 ceph-mon[46187]: osdmap e21: 4 total, 3 up, 4 in 2024-05-08T23:58:38.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:38.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:38.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:38 smithi150 ceph-mon[46187]: mgrmap e16: x(active, since 111s), standbys: z, y 2024-05-08T23:58:38.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:38.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:38 smithi150 ceph-mon[46187]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:58:39.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:38 smithi171 sudo[57754]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T23:58:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:38 smithi171 sudo[57754]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:58:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:38 smithi171 sudo[57754]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:58:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:38 smithi171 sudo[57754]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:58:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:38 smithi171 sudo[57757]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T23:58:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:38 smithi171 sudo[57757]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:58:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:38 smithi171 sudo[57757]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:58:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:38 smithi171 sudo[57757]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:58:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:38 smithi171 ceph-mon[47351]: osdmap e21: 4 total, 3 up, 4 in 2024-05-08T23:58:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:38 smithi171 ceph-mon[47351]: mgrmap e16: x(active, since 111s), standbys: z, y 2024-05-08T23:58:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:39.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:38 smithi171 ceph-mon[47351]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:58:39.357 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 sudo[56112]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T23:58:39.357 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 sudo[56112]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:58:39.357 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 sudo[56112]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:58:39.357 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 sudo[56112]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:58:39.357 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 sudo[56115]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T23:58:39.357 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 sudo[56115]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T23:58:39.357 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 sudo[56115]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T23:58:39.357 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 sudo[56115]: pam_unix(sudo:session): session closed for user root 2024-05-08T23:58:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: pgmap v67: 1 pgs: 1 active+clean; 449 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:58:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:58:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:58:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:58:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:58:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:58:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:58:39.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:58:39.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:58:39.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:58:39.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:58:39.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:58:39.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:58:39.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:58:39.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:39 smithi081 ceph-mon[42474]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:58:39.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: pgmap v67: 1 pgs: 1 active+clean; 449 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:58:39.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:58:39.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:58:39.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:58:39.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:58:39.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:58:39.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:58:39.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:58:39.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:58:39.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:58:39.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:58:39.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:58:39.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:58:39.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:58:39.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:39 smithi150 ceph-mon[46187]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:58:39.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: pgmap v67: 1 pgs: 1 active+clean; 449 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:58:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:58:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:58:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:58:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:58:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:58:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:58:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:58:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:58:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:58:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T23:58:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T23:58:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T23:58:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T23:58:39.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:39 smithi171 ceph-mon[47351]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T23:58:40.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:40 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T23:58:40.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:40 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:40.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:40 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T23:58:40.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:40 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:40.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:40 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T23:58:40.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:40 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:41.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:41 smithi081 ceph-mon[42474]: Deploying daemon osd.3 on smithi081 2024-05-08T23:58:41.490 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:41 smithi081 ceph-mon[42474]: pgmap v68: 1 pgs: 1 active+clean; 449 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:58:41.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:41 smithi150 ceph-mon[46187]: Deploying daemon osd.3 on smithi081 2024-05-08T23:58:41.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:41 smithi150 ceph-mon[46187]: pgmap v68: 1 pgs: 1 active+clean; 449 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:58:41.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:41 smithi171 ceph-mon[47351]: Deploying daemon osd.3 on smithi081 2024-05-08T23:58:41.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:41 smithi171 ceph-mon[47351]: pgmap v68: 1 pgs: 1 active+clean; 449 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-08T23:58:43.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:43 smithi081 ceph-mon[42474]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 8.0 KiB/s rd, 364 KiB/s wr, 25 op/s 2024-05-08T23:58:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:43 smithi150 ceph-mon[46187]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 8.0 KiB/s rd, 364 KiB/s wr, 25 op/s 2024-05-08T23:58:43.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:43 smithi171 ceph-mon[47351]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 8.0 KiB/s rd, 364 KiB/s wr, 25 op/s 2024-05-08T23:58:44.815 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:44 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:44.815 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:44 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:44.815 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:44 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:44.815 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:44 smithi081 ceph-mon[42474]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 260 KiB/s wr, 17 op/s 2024-05-08T23:58:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:44 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:44 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:44 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:44 smithi150 ceph-mon[46187]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 260 KiB/s wr, 17 op/s 2024-05-08T23:58:45.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:44 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:45.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:44 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:45.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:44 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:45.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:44 smithi171 ceph-mon[47351]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 5.7 KiB/s rd, 260 KiB/s wr, 17 op/s 2024-05-08T23:58:45.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:45.890+0000 7fe73affd700 1 -- 172.21.15.81:0/955577355 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe7440fd760 con 0x7fe7300a1190 2024-05-08T23:58:45.885 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 3 on host 'smithi081' 2024-05-08T23:58:45.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:45.893+0000 7fe74ba7f700 1 -- 172.21.15.81:0/955577355 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe7300a1190 msgr2=0x7fe7300a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:45.893+0000 7fe74ba7f700 1 --2- 172.21.15.81:0/955577355 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe7300a1190 0x7fe7300a3650 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe74000b580 tx=0x7fe74001a040 comp rx=0 tx=0).stop 2024-05-08T23:58:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:45.893+0000 7fe74ba7f700 1 -- 172.21.15.81:0/955577355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7440fff70 msgr2=0x7fe744196f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:45.893+0000 7fe74ba7f700 1 --2- 172.21.15.81:0/955577355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7440fff70 0x7fe744196f30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe73400ea80 tx=0x7fe73400ee40 comp rx=0 tx=0).stop 2024-05-08T23:58:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:45.893+0000 7fe74ba7f700 1 -- 172.21.15.81:0/955577355 shutdown_connections 2024-05-08T23:58:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:45.893+0000 7fe74ba7f700 1 --2- 172.21.15.81:0/955577355 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe7300a1190 0x7fe7300a3650 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:45.893+0000 7fe74ba7f700 1 --2- 172.21.15.81:0/955577355 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe744101b10 0x7fe74419e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:45.893+0000 7fe74ba7f700 1 --2- 172.21.15.81:0/955577355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7440fff70 0x7fe744196f30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:45.893+0000 7fe74ba7f700 1 --2- 172.21.15.81:0/955577355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe744101170 0x7fe744197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:45.893+0000 7fe74ba7f700 1 -- 172.21.15.81:0/955577355 >> 172.21.15.81:0/955577355 conn(0x7fe7440fb530 msgr2=0x7fe7440fd050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:45.893+0000 7fe74ba7f700 1 -- 172.21.15.81:0/955577355 shutdown_connections 2024-05-08T23:58:45.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:58:45.893+0000 7fe74ba7f700 1 -- 172.21.15.81:0/955577355 wait complete. 2024-05-08T23:58:46.297 DEBUG:teuthology.orchestra.run.smithi081:osd.3> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.3.service 2024-05-08T23:58:46.299 INFO:tasks.cephadm:Deploying osd.4 on smithi150 with /dev/vg_nvme/lv_3... 2024-05-08T23:58:46.299 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T23:58:46.329 INFO:journalctl@ceph.osd.3.smithi081.stdout:-- Logs begin at Wed 2024-05-08 23:39:48 UTC. -- 2024-05-08T23:58:46.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:46.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:46.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:46.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:46.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:46.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:46.534 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:58:46.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:46.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:46.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:46.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:58:47.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:47 smithi150 ceph-mon[46187]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 203 KiB/s wr, 13 op/s 2024-05-08T23:58:47.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:47 smithi081 ceph-mon[42474]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 203 KiB/s wr, 13 op/s 2024-05-08T23:58:47.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:47 smithi171 ceph-mon[47351]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 4.4 KiB/s rd, 203 KiB/s wr, 13 op/s 2024-05-08T23:58:47.854 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T23:58:47.854 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T23:58:47.855 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10+0 records in 2024-05-08T23:58:47.855 INFO:teuthology.orchestra.run.smithi150.stderr:10+0 records out 2024-05-08T23:58:47.855 INFO:teuthology.orchestra.run.smithi150.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113355 s, 925 MB/s 2024-05-08T23:58:47.855 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping successful for: 2024-05-08T23:58:48.046 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 08 23:58:47 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-3[68226]: 2024-05-08T23:58:47.633+0000 7f2989fde7c0 -1 osd.3 0 log_to_monitors true 2024-05-08T23:58:48.222 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi150:vg_nvme/lv_3 2024-05-08T23:58:48.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:48 smithi081 ceph-mon[42474]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T23:58:48.446 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:58:48.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:48 smithi150 ceph-mon[46187]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T23:58:48.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:48 smithi171 ceph-mon[47351]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T23:58:49.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.383+0000 7f490938f700 1 -- 172.21.15.150:0/4163812199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49040fff00 msgr2=0x7f4904100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:49.380 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.383+0000 7f490938f700 1 --2- 172.21.15.150:0/4163812199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49040fff00 0x7f4904100320 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f48f4009990 tx=0x7f48f4009ca0 comp rx=0 tx=0).stop 2024-05-08T23:58:49.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.383+0000 7f490938f700 1 -- 172.21.15.150:0/4163812199 shutdown_connections 2024-05-08T23:58:49.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.383+0000 7f490938f700 1 --2- 172.21.15.150:0/4163812199 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49040fff00 0x7f4904100320 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:49.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.383+0000 7f490938f700 1 --2- 172.21.15.150:0/4163812199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4904101a20 0x7f4904108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:49.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.383+0000 7f490938f700 1 --2- 172.21.15.150:0/4163812199 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4904101060 0x7f49041014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:49.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.383+0000 7f490938f700 1 -- 172.21.15.150:0/4163812199 >> 172.21.15.150:0/4163812199 conn(0x7f49040fb4a0 msgr2=0x7f49040fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:58:49.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.383+0000 7f490938f700 1 -- 172.21.15.150:0/4163812199 shutdown_connections 2024-05-08T23:58:49.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.384+0000 7f490938f700 1 -- 172.21.15.150:0/4163812199 wait complete. 2024-05-08T23:58:49.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.384+0000 7f490938f700 1 Processor -- start 2024-05-08T23:58:49.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.384+0000 7f490938f700 1 -- start start 2024-05-08T23:58:49.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.384+0000 7f490938f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49040fff00 0x7f4904195e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:58:49.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.384+0000 7f490938f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4904101060 0x7f4904196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:58:49.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.384+0000 7f490938f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4904101a20 0x7f490419d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:58:49.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.384+0000 7f490938f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490419d990 con 0x7f4904101a20 2024-05-08T23:58:49.381 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.384+0000 7f490938f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490419dad0 con 0x7f49040fff00 2024-05-08T23:58:49.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.384+0000 7f490938f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490419dc60 con 0x7f4904101060 2024-05-08T23:58:49.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f4902ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49040fff00 0x7f4904195e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:58:49.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f4902ffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49040fff00 0x7f4904195e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:45746/0 (socket says 172.21.15.150:45746) 2024-05-08T23:58:49.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f4902ffd700 1 -- 172.21.15.150:0/300996104 learned_addr learned my addr 172.21.15.150:0/300996104 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-08T23:58:49.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f49037fe700 1 --2- 172.21.15.150:0/300996104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4904101a20 0x7f490419d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:58:49.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f49027fc700 1 --2- 172.21.15.150:0/300996104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4904101060 0x7f4904196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:58:49.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f4902ffd700 1 -- 172.21.15.150:0/300996104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4904101060 msgr2=0x7f4904196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:49.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f4902ffd700 1 --2- 172.21.15.150:0/300996104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4904101060 0x7f4904196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:49.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f4902ffd700 1 -- 172.21.15.150:0/300996104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4904101a20 msgr2=0x7f490419d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:58:49.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f4902ffd700 1 --2- 172.21.15.150:0/300996104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4904101a20 0x7f490419d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:58:49.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f4902ffd700 1 -- 172.21.15.150:0/300996104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f40095f0 con 0x7f49040fff00 2024-05-08T23:58:49.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f4902ffd700 1 --2- 172.21.15.150:0/300996104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49040fff00 0x7f4904195e50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f48f40059d0 tx=0x7f48f4005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:49.382 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f48ebfff700 1 -- 172.21.15.150:0/300996104 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f401d070 con 0x7f49040fff00 2024-05-08T23:58:49.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f48ebfff700 1 -- 172.21.15.150:0/300996104 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f48f4004020 con 0x7f49040fff00 2024-05-08T23:58:49.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f48ebfff700 1 -- 172.21.15.150:0/300996104 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f4022c80 con 0x7f49040fff00 2024-05-08T23:58:49.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f490938f700 1 -- 172.21.15.150:0/300996104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4904069660 con 0x7f49040fff00 2024-05-08T23:58:49.383 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.385+0000 7f490938f700 1 -- 172.21.15.150:0/300996104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4904069ab0 con 0x7f49040fff00 2024-05-08T23:58:49.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.386+0000 7f490938f700 1 -- 172.21.15.150:0/300996104 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490404ec60 con 0x7f49040fff00 2024-05-08T23:58:49.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.387+0000 7f48ebfff700 1 -- 172.21.15.150:0/300996104 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f48f4003b60 con 0x7f49040fff00 2024-05-08T23:58:49.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.388+0000 7f48ebfff700 1 --2- 172.21.15.150:0/300996104 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f48ec0a1120 0x7f48ec0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:58:49.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.388+0000 7f48ebfff700 1 -- 172.21.15.150:0/300996104 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3389+0+0 (secure 0 0 0) 0x7f48f40cd2c0 con 0x7f49040fff00 2024-05-08T23:58:49.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.388+0000 7f49027fc700 1 --2- 172.21.15.150:0/300996104 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f48ec0a1120 0x7f48ec0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:58:49.384 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.389+0000 7f49027fc700 1 --2- 172.21.15.150:0/300996104 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f48ec0a1120 0x7f48ec0a35e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f48f800bc30 tx=0x7f48f8006f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:58:49.386 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.392+0000 7f48ebfff700 1 -- 172.21.15.150:0/300996104 <== mon.2 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f48f4097e20 con 0x7f49040fff00 2024-05-08T23:58:49.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T23:58:49.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: osdmap e22: 4 total, 3 up, 4 in 2024-05-08T23:58:49.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:49.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-08T23:58:49.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-05-08T23:58:49.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: Detected new or changed devices on smithi081 2024-05-08T23:58:49.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:49.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:49.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:58:49.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:58:49.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi081 to 8557M 2024-05-08T23:58:49.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:49.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:49.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:49.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:49 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:49.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T23:58:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: osdmap e22: 4 total, 3 up, 4 in 2024-05-08T23:58:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-08T23:58:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-05-08T23:58:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: Detected new or changed devices on smithi081 2024-05-08T23:58:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:58:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:58:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi081 to 8557M 2024-05-08T23:58:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:49.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:49 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:49.587 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:58:49.592+0000 7f490938f700 1 -- 172.21.15.150:0/300996104 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4904069cd0 con 0x7f48ec0a1120 2024-05-08T23:58:49.591 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T23:58:49.592 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: osdmap e22: 4 total, 3 up, 4 in 2024-05-08T23:58:49.592 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:49.592 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-08T23:58:49.592 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail; 4.0 KiB/s rd, 183 KiB/s wr, 12 op/s 2024-05-08T23:58:49.592 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: Detected new or changed devices on smithi081 2024-05-08T23:58:49.592 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:49.592 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:49.592 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:58:49.592 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:58:49.592 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi081 to 8557M 2024-05-08T23:58:49.592 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:49.592 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:49.592 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:58:49.592 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:49 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:58:49.870 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 08 23:58:49 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-3[68226]: 2024-05-08T23:58:49.596+0000 7f297f642700 -1 osd.3 0 waiting for initial osdmap 2024-05-08T23:58:49.870 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 08 23:58:49 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-3[68226]: 2024-05-08T23:58:49.601+0000 7f297742f700 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:58:50.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:50 smithi150 ceph-mon[46187]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-08T23:58:50.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:50 smithi150 ceph-mon[46187]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T23:58:50.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:50 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:50.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:50 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:50.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:50 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:58:50.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:50 smithi150 ceph-mon[46187]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' 2024-05-08T23:58:50.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:50 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:58:50.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:50 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:50.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:50 smithi150 ceph-mon[46187]: osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729] boot 2024-05-08T23:58:50.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:50 smithi150 ceph-mon[46187]: osdmap e24: 4 total, 4 up, 4 in 2024-05-08T23:58:50.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:50 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:50.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:50 smithi171 ceph-mon[47351]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-08T23:58:50.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:50 smithi171 ceph-mon[47351]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T23:58:50.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:50 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:50.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:50 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:50.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:50 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:58:50.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:50 smithi171 ceph-mon[47351]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' 2024-05-08T23:58:50.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:50 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:58:50.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:50 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:50.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:50 smithi171 ceph-mon[47351]: osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729] boot 2024-05-08T23:58:50.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:50 smithi171 ceph-mon[47351]: osdmap e24: 4 total, 4 up, 4 in 2024-05-08T23:58:50.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:50 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:50.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:50 smithi081 ceph-mon[42474]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-08T23:58:50.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:50 smithi081 ceph-mon[42474]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T23:58:50.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:50.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:50.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:58:50.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:50 smithi081 ceph-mon[42474]: from='osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729]' entity='osd.3' 2024-05-08T23:58:50.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:58:50.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:50.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:50 smithi081 ceph-mon[42474]: osd.3 [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729] boot 2024-05-08T23:58:50.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:50 smithi081 ceph-mon[42474]: osdmap e24: 4 total, 4 up, 4 in 2024-05-08T23:58:50.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T23:58:51.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:51 smithi150 ceph-mon[46187]: purged_snaps scrub starts 2024-05-08T23:58:51.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:51 smithi150 ceph-mon[46187]: purged_snaps scrub ok 2024-05-08T23:58:51.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:51 smithi150 ceph-mon[46187]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:51.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:51 smithi150 ceph-mon[46187]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:58:51.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:51 smithi150 ceph-mon[46187]: osdmap e25: 4 total, 4 up, 4 in 2024-05-08T23:58:51.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:51 smithi171 ceph-mon[47351]: purged_snaps scrub starts 2024-05-08T23:58:51.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:51 smithi171 ceph-mon[47351]: purged_snaps scrub ok 2024-05-08T23:58:51.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:51 smithi171 ceph-mon[47351]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:51.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:51 smithi171 ceph-mon[47351]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:58:51.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:51 smithi171 ceph-mon[47351]: osdmap e25: 4 total, 4 up, 4 in 2024-05-08T23:58:51.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:51 smithi081 ceph-mon[42474]: purged_snaps scrub starts 2024-05-08T23:58:51.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:51 smithi081 ceph-mon[42474]: purged_snaps scrub ok 2024-05-08T23:58:51.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:51 smithi081 ceph-mon[42474]: from='client.24221 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:58:51.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:51 smithi081 ceph-mon[42474]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:58:51.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:51 smithi081 ceph-mon[42474]: osdmap e25: 4 total, 4 up, 4 in 2024-05-08T23:58:52.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:52 smithi150 ceph-mon[46187]: from='client.? 172.21.15.150:0/186163708' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72f26a22-e6f4-4e40-85e3-e4907cf5ca9d"}]: dispatch 2024-05-08T23:58:52.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:52 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72f26a22-e6f4-4e40-85e3-e4907cf5ca9d"}]: dispatch 2024-05-08T23:58:52.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:52 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72f26a22-e6f4-4e40-85e3-e4907cf5ca9d"}]': finished 2024-05-08T23:58:52.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:52 smithi150 ceph-mon[46187]: osdmap e26: 5 total, 4 up, 5 in 2024-05-08T23:58:52.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:52 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:58:52.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:52 smithi150 ceph-mon[46187]: from='client.? 172.21.15.150:0/352563028' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:58:52.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:52 smithi171 ceph-mon[47351]: from='client.? 172.21.15.150:0/186163708' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72f26a22-e6f4-4e40-85e3-e4907cf5ca9d"}]: dispatch 2024-05-08T23:58:52.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:52 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72f26a22-e6f4-4e40-85e3-e4907cf5ca9d"}]: dispatch 2024-05-08T23:58:52.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:52 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72f26a22-e6f4-4e40-85e3-e4907cf5ca9d"}]': finished 2024-05-08T23:58:52.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:52 smithi171 ceph-mon[47351]: osdmap e26: 5 total, 4 up, 5 in 2024-05-08T23:58:52.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:52 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:58:52.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:52 smithi171 ceph-mon[47351]: from='client.? 172.21.15.150:0/352563028' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:58:52.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:52 smithi081 ceph-mon[42474]: from='client.? 172.21.15.150:0/186163708' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72f26a22-e6f4-4e40-85e3-e4907cf5ca9d"}]: dispatch 2024-05-08T23:58:52.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:52 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72f26a22-e6f4-4e40-85e3-e4907cf5ca9d"}]: dispatch 2024-05-08T23:58:52.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:52 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72f26a22-e6f4-4e40-85e3-e4907cf5ca9d"}]': finished 2024-05-08T23:58:52.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:52 smithi081 ceph-mon[42474]: osdmap e26: 5 total, 4 up, 5 in 2024-05-08T23:58:52.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:52 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:58:52.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:52 smithi081 ceph-mon[42474]: from='client.? 172.21.15.150:0/352563028' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:58:53.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:53 smithi081 ceph-mon[42474]: pgmap v79: 1 pgs: 1 remapped+peering; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:58:53.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:53 smithi081 ceph-mon[42474]: osdmap e27: 5 total, 4 up, 5 in 2024-05-08T23:58:53.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:58:53.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:53 smithi150 ceph-mon[46187]: pgmap v79: 1 pgs: 1 remapped+peering; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:58:53.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:53 smithi150 ceph-mon[46187]: osdmap e27: 5 total, 4 up, 5 in 2024-05-08T23:58:53.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:58:53.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:53 smithi171 ceph-mon[47351]: pgmap v79: 1 pgs: 1 remapped+peering; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:58:53.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:53 smithi171 ceph-mon[47351]: osdmap e27: 5 total, 4 up, 5 in 2024-05-08T23:58:53.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:58:54.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:54 smithi081 ceph-mon[42474]: osdmap e28: 5 total, 4 up, 5 in 2024-05-08T23:58:54.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:54 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:58:54.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:54 smithi150 ceph-mon[46187]: osdmap e28: 5 total, 4 up, 5 in 2024-05-08T23:58:54.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:54 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:58:54.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:54 smithi171 ceph-mon[47351]: osdmap e28: 5 total, 4 up, 5 in 2024-05-08T23:58:54.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:54 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:58:55.428 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:55 smithi150 ceph-mon[46187]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:58:55.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:55 smithi081 ceph-mon[42474]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:58:55.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:55 smithi171 ceph-mon[47351]: pgmap v82: 1 pgs: 1 remapped+peering; 577 KiB data, 155 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:58:57.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:57 smithi081 ceph-mon[42474]: pgmap v83: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:58:57.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:57 smithi150 ceph-mon[46187]: pgmap v83: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:58:57.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:57 smithi171 ceph-mon[47351]: pgmap v83: 1 pgs: 1 remapped+peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:58:58.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:58 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T23:58:58.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:58 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:58.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:58 smithi081 ceph-mon[42474]: Deploying daemon osd.4 on smithi150 2024-05-08T23:58:58.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:58 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T23:58:58.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:58 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:58.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:58 smithi150 ceph-mon[46187]: Deploying daemon osd.4 on smithi150 2024-05-08T23:58:58.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:58 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T23:58:58.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:58 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:58:58.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:58 smithi171 ceph-mon[47351]: Deploying daemon osd.4 on smithi150 2024-05-08T23:58:59.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:58:59 smithi081 ceph-mon[42474]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-08T23:58:59.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:58:59 smithi150 ceph-mon[46187]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-08T23:58:59.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:58:59 smithi171 ceph-mon[47351]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-08T23:59:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:01 smithi081 ceph-mon[42474]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T23:59:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:01 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:01 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:01 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:01.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:01 smithi150 ceph-mon[46187]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T23:59:01.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:01 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:01.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:01 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:01.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:01 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:01.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:01 smithi171 ceph-mon[47351]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T23:59:01.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:01 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:01.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:01 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:01.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:01 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:03.394 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:03 smithi150 ceph-mon[46187]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:59:03.394 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:03 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:03.394 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:03 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:03.394 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:03 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:03.394 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:03 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:03.394 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:03 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:03.493 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:03.498+0000 7f48ebfff700 1 -- 172.21.15.150:0/300996104 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4904069cd0 con 0x7f48ec0a1120 2024-05-08T23:59:03.493 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 4 on host 'smithi150' 2024-05-08T23:59:03.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:03.500+0000 7f490938f700 1 -- 172.21.15.150:0/300996104 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f48ec0a1120 msgr2=0x7f48ec0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:03.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:03.500+0000 7f490938f700 1 --2- 172.21.15.150:0/300996104 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f48ec0a1120 0x7f48ec0a35e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f48f800bc30 tx=0x7f48f8006f50 comp rx=0 tx=0).stop 2024-05-08T23:59:03.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:03.500+0000 7f490938f700 1 -- 172.21.15.150:0/300996104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49040fff00 msgr2=0x7f4904195e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:03.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:03.500+0000 7f490938f700 1 --2- 172.21.15.150:0/300996104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49040fff00 0x7f4904195e50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f48f40059d0 tx=0x7f48f4005740 comp rx=0 tx=0).stop 2024-05-08T23:59:03.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:03.500+0000 7f490938f700 1 -- 172.21.15.150:0/300996104 shutdown_connections 2024-05-08T23:59:03.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:03.500+0000 7f490938f700 1 --2- 172.21.15.150:0/300996104 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f48ec0a1120 0x7f48ec0a35e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:03.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:03.500+0000 7f490938f700 1 --2- 172.21.15.150:0/300996104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f49040fff00 0x7f4904195e50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:03.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:03.500+0000 7f490938f700 1 --2- 172.21.15.150:0/300996104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4904101a20 0x7f490419d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:03.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:03.500+0000 7f490938f700 1 --2- 172.21.15.150:0/300996104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4904101060 0x7f4904196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:03.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:03.500+0000 7f490938f700 1 -- 172.21.15.150:0/300996104 >> 172.21.15.150:0/300996104 conn(0x7f49040fb4a0 msgr2=0x7f4904104470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:03.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:03.501+0000 7f490938f700 1 -- 172.21.15.150:0/300996104 shutdown_connections 2024-05-08T23:59:03.496 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:03.501+0000 7f490938f700 1 -- 172.21.15.150:0/300996104 wait complete. 2024-05-08T23:59:03.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:03 smithi171 ceph-mon[47351]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:59:03.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:03 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:03.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:03 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:03.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:03 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:03.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:03 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:03.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:03 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:03 smithi081 ceph-mon[42474]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:59:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:03 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:03 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:03 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:03 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:03 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:04.271 DEBUG:teuthology.orchestra.run.smithi150:osd.4> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.4.service 2024-05-08T23:59:04.274 INFO:tasks.cephadm:Deploying osd.5 on smithi171 with /dev/vg_nvme/lv_3... 2024-05-08T23:59:04.274 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T23:59:04.311 INFO:journalctl@ceph.osd.4.smithi150.stdout:-- Logs begin at Wed 2024-05-08 23:39:53 UTC. -- 2024-05-08T23:59:04.508 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:59:04.635 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:04 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:04.635 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:04 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:04.635 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:04 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:04.741 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:04 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:04.741 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:04 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:04.741 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:04 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:04.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:04 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:04.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:04 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:04.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:04 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:05.490 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 08 23:59:05 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-4[59216]: 2024-05-08T23:59:05.065+0000 7ff6cf6b87c0 -1 osd.4 0 log_to_monitors true 2024-05-08T23:59:05.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:05 smithi150 ceph-mon[46187]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-05-08T23:59:05.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:05 smithi150 ceph-mon[46187]: from='osd.4 [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T23:59:05.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:05 smithi150 ceph-mon[46187]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T23:59:05.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:05 smithi171 ceph-mon[47351]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-05-08T23:59:05.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:05 smithi171 ceph-mon[47351]: from='osd.4 [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T23:59:05.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:05 smithi171 ceph-mon[47351]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T23:59:05.868 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T23:59:05.868 INFO:teuthology.orchestra.run.smithi171.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T23:59:05.868 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 10+0 records in 2024-05-08T23:59:05.868 INFO:teuthology.orchestra.run.smithi171.stderr:10+0 records out 2024-05-08T23:59:05.868 INFO:teuthology.orchestra.run.smithi171.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110926 s, 945 MB/s 2024-05-08T23:59:05.868 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping successful for: 2024-05-08T23:59:05.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:05 smithi081 ceph-mon[42474]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-05-08T23:59:05.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:05 smithi081 ceph-mon[42474]: from='osd.4 [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T23:59:05.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:05 smithi081 ceph-mon[42474]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T23:59:06.271 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_3 2024-05-08T23:59:06.488 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:59:06.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:06 smithi150 ceph-mon[46187]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T23:59:06.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:06 smithi150 ceph-mon[46187]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T23:59:06.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:06 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:06.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:06 smithi150 ceph-mon[46187]: from='osd.4 [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-08T23:59:06.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:06 smithi150 ceph-mon[46187]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-08T23:59:06.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:06 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:06.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:06 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:06.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:06 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:06.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:06 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:06.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:06 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:06.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:06 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:06.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:06 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:06.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:06 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:06 smithi171 ceph-mon[47351]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T23:59:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:06 smithi171 ceph-mon[47351]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T23:59:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:06 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:06 smithi171 ceph-mon[47351]: from='osd.4 [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-08T23:59:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:06 smithi171 ceph-mon[47351]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-08T23:59:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:06 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:06.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:06 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:06 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:06 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:06 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:06 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:06 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:06.796 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:06 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:06.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:06 smithi081 ceph-mon[42474]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T23:59:06.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:06 smithi081 ceph-mon[42474]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T23:59:06.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:06 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:06.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:06 smithi081 ceph-mon[42474]: from='osd.4 [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-08T23:59:06.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:06 smithi081 ceph-mon[42474]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-08T23:59:06.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:06 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:06.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:06 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:06.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:06 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:06.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:06 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:06.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:06 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:06.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:06 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:06.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:06 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:06.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:06 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:07.264 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 08 23:59:06 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-4[59216]: 2024-05-08T23:59:06.946+0000 7ff6c4d1c700 -1 osd.4 0 waiting for initial osdmap 2024-05-08T23:59:07.264 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 08 23:59:06 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-4[59216]: 2024-05-08T23:59:06.954+0000 7ff6bcb09700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:59:07.563 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.566+0000 7f5084a7b700 1 -- 172.21.15.171:0/1930946311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50800fff00 msgr2=0x7f5080100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:07.563 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.566+0000 7f5084a7b700 1 --2- 172.21.15.171:0/1930946311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50800fff00 0x7f5080100320 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f50740098f0 tx=0x7f5074009c00 comp rx=0 tx=0).stop 2024-05-08T23:59:07.563 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.566+0000 7f5084a7b700 1 -- 172.21.15.171:0/1930946311 shutdown_connections 2024-05-08T23:59:07.563 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.566+0000 7f5084a7b700 1 --2- 172.21.15.171:0/1930946311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5080101a20 0x7f5080108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:07.563 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.566+0000 7f5084a7b700 1 --2- 172.21.15.171:0/1930946311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50800fff00 0x7f5080100320 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:07.563 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.566+0000 7f5084a7b700 1 --2- 172.21.15.171:0/1930946311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5080101060 0x7f50801014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:07.563 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.566+0000 7f5084a7b700 1 -- 172.21.15.171:0/1930946311 >> 172.21.15.171:0/1930946311 conn(0x7f50800fb4a0 msgr2=0x7f50800fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:07.563 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.566+0000 7f5084a7b700 1 -- 172.21.15.171:0/1930946311 shutdown_connections 2024-05-08T23:59:07.563 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.566+0000 7f5084a7b700 1 -- 172.21.15.171:0/1930946311 wait complete. 2024-05-08T23:59:07.563 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.567+0000 7f5084a7b700 1 Processor -- start 2024-05-08T23:59:07.564 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.567+0000 7f5084a7b700 1 -- start start 2024-05-08T23:59:07.564 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.567+0000 7f5084a7b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50800fff00 0x7f5080069480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:59:07.564 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.567+0000 7f5084a7b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5080101060 0x7f508019bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:59:07.564 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.567+0000 7f5084a7b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5080101a20 0x7f508019e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:59:07.564 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.567+0000 7f5084a7b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508019e990 con 0x7f5080101060 2024-05-08T23:59:07.564 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.567+0000 7f5084a7b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508019eb00 con 0x7f50800fff00 2024-05-08T23:59:07.564 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.567+0000 7f5084a7b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508019ecc0 con 0x7f5080101a20 2024-05-08T23:59:07.564 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.567+0000 7f507ed9d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5080101a20 0x7f508019e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:59:07.564 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.567+0000 7f507ed9d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5080101a20 0x7f508019e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:34436/0 (socket says 172.21.15.171:34436) 2024-05-08T23:59:07.564 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.567+0000 7f507ed9d700 1 -- 172.21.15.171:0/1527249102 learned_addr learned my addr 172.21.15.171:0/1527249102 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-08T23:59:07.564 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.567+0000 7f507dd9b700 1 --2- 172.21.15.171:0/1527249102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5080101060 0x7f508019bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:59:07.564 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.567+0000 7f507e59c700 1 --2- 172.21.15.171:0/1527249102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50800fff00 0x7f5080069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:59:07.564 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.568+0000 7f507ed9d700 1 -- 172.21.15.171:0/1527249102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50800fff00 msgr2=0x7f5080069480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:07.565 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.568+0000 7f507ed9d700 1 --2- 172.21.15.171:0/1527249102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50800fff00 0x7f5080069480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:07.565 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.568+0000 7f507ed9d700 1 -- 172.21.15.171:0/1527249102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5080101060 msgr2=0x7f508019bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:07.565 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.568+0000 7f507ed9d700 1 --2- 172.21.15.171:0/1527249102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5080101060 0x7f508019bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:07.565 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.568+0000 7f507ed9d700 1 -- 172.21.15.171:0/1527249102 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5074009520 con 0x7f5080101a20 2024-05-08T23:59:07.565 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.568+0000 7f507ed9d700 1 --2- 172.21.15.171:0/1527249102 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5080101a20 0x7f508019e1f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f507800ef30 tx=0x7f507800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:07.565 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.568+0000 7f506f7fe700 1 -- 172.21.15.171:0/1527249102 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5078018070 con 0x7f5080101a20 2024-05-08T23:59:07.565 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.568+0000 7f5084a7b700 1 -- 172.21.15.171:0/1527249102 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508019ef40 con 0x7f5080101a20 2024-05-08T23:59:07.565 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.568+0000 7f506f7fe700 1 -- 172.21.15.171:0/1527249102 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f507800f040 con 0x7f5080101a20 2024-05-08T23:59:07.565 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.568+0000 7f506f7fe700 1 -- 172.21.15.171:0/1527249102 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507800ccf0 con 0x7f5080101a20 2024-05-08T23:59:07.565 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.568+0000 7f5084a7b700 1 -- 172.21.15.171:0/1527249102 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508019f3b0 con 0x7f5080101a20 2024-05-08T23:59:07.566 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.569+0000 7f5084a7b700 1 -- 172.21.15.171:0/1527249102 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5080107370 con 0x7f5080101a20 2024-05-08T23:59:07.566 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.570+0000 7f506f7fe700 1 -- 172.21.15.171:0/1527249102 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5078003a00 con 0x7f5080101a20 2024-05-08T23:59:07.566 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.571+0000 7f506f7fe700 1 --2- 172.21.15.171:0/1527249102 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f50680a1120 0x7f50680a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:59:07.566 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.571+0000 7f507e59c700 1 --2- 172.21.15.171:0/1527249102 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f50680a1120 0x7f50680a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:59:07.566 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.571+0000 7f506f7fe700 1 -- 172.21.15.171:0/1527249102 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3821+0+0 (secure 0 0 0) 0x7f50780cb2d0 con 0x7f5080101a20 2024-05-08T23:59:07.566 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.571+0000 7f507e59c700 1 --2- 172.21.15.171:0/1527249102 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f50680a1120 0x7f50680a35e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5074005e90 tx=0x7f5074019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:07.570 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.575+0000 7f506f7fe700 1 -- 172.21.15.171:0/1527249102 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5078095c80 con 0x7f5080101a20 2024-05-08T23:59:07.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:07 smithi150 ceph-mon[46187]: Detected new or changed devices on smithi150 2024-05-08T23:59:07.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:07 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi150 to 8557M 2024-05-08T23:59:07.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:07 smithi150 ceph-mon[46187]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:59:07.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:07 smithi150 ceph-mon[46187]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-05-08T23:59:07.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:07 smithi150 ceph-mon[46187]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T23:59:07.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:07 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:07.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:07 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:07.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:07 smithi150 ceph-mon[46187]: from='osd.4 ' entity='osd.4' 2024-05-08T23:59:07.771 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:07.776+0000 7f5084a7b700 1 -- 172.21.15.171:0/1527249102 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f508002ce60 con 0x7f50680a1120 2024-05-08T23:59:07.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:07 smithi171 ceph-mon[47351]: Detected new or changed devices on smithi150 2024-05-08T23:59:07.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:07 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi150 to 8557M 2024-05-08T23:59:07.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:07 smithi171 ceph-mon[47351]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:59:07.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:07 smithi171 ceph-mon[47351]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-05-08T23:59:07.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:07 smithi171 ceph-mon[47351]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T23:59:07.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:07 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:07.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:07 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:07.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:07 smithi171 ceph-mon[47351]: from='osd.4 ' entity='osd.4' 2024-05-08T23:59:07.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:07 smithi081 ceph-mon[42474]: Detected new or changed devices on smithi150 2024-05-08T23:59:07.968 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:07 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi150 to 8557M 2024-05-08T23:59:07.968 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:07 smithi081 ceph-mon[42474]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:59:07.968 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:07 smithi081 ceph-mon[42474]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-05-08T23:59:07.968 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:07 smithi081 ceph-mon[42474]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T23:59:07.968 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:07 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:07.968 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:07 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:07.969 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:07 smithi081 ceph-mon[42474]: from='osd.4 ' entity='osd.4' 2024-05-08T23:59:08.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:08 smithi150 ceph-mon[46187]: purged_snaps scrub starts 2024-05-08T23:59:08.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:08 smithi150 ceph-mon[46187]: purged_snaps scrub ok 2024-05-08T23:59:08.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:08 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:08.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:08 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:59:08.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:08 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:59:08.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:08 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:08.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:08 smithi150 ceph-mon[46187]: osd.4 [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814] boot 2024-05-08T23:59:08.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:08 smithi150 ceph-mon[46187]: osdmap e31: 5 total, 5 up, 5 in 2024-05-08T23:59:08.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:08 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:08.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:08 smithi171 ceph-mon[47351]: purged_snaps scrub starts 2024-05-08T23:59:08.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:08 smithi171 ceph-mon[47351]: purged_snaps scrub ok 2024-05-08T23:59:08.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:08 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:08.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:08 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:59:08.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:08 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:59:08.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:08 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:08.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:08 smithi171 ceph-mon[47351]: osd.4 [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814] boot 2024-05-08T23:59:08.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:08 smithi171 ceph-mon[47351]: osdmap e31: 5 total, 5 up, 5 in 2024-05-08T23:59:08.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:08 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:08.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:08 smithi081 ceph-mon[42474]: purged_snaps scrub starts 2024-05-08T23:59:08.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:08 smithi081 ceph-mon[42474]: purged_snaps scrub ok 2024-05-08T23:59:08.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:08.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:59:08.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:59:08.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:08.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:08 smithi081 ceph-mon[42474]: osd.4 [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814] boot 2024-05-08T23:59:08.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:08 smithi081 ceph-mon[42474]: osdmap e31: 5 total, 5 up, 5 in 2024-05-08T23:59:08.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T23:59:09.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:09 smithi150 ceph-mon[46187]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:59:09.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:09 smithi150 ceph-mon[46187]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:59:09.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:09 smithi150 ceph-mon[46187]: osdmap e32: 5 total, 5 up, 5 in 2024-05-08T23:59:09.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:09 smithi171 ceph-mon[47351]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:59:09.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:09 smithi171 ceph-mon[47351]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:59:09.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:09 smithi171 ceph-mon[47351]: osdmap e32: 5 total, 5 up, 5 in 2024-05-08T23:59:09.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:09 smithi081 ceph-mon[42474]: from='client.24229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:59:09.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:09 smithi081 ceph-mon[42474]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-05-08T23:59:09.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:09 smithi081 ceph-mon[42474]: osdmap e32: 5 total, 5 up, 5 in 2024-05-08T23:59:10.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:10 smithi150 ceph-mon[46187]: from='client.? 172.21.15.171:0/1272879574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6eb056b-a97c-4a6e-9716-4d18d740f456"}]: dispatch 2024-05-08T23:59:10.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:10 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6eb056b-a97c-4a6e-9716-4d18d740f456"}]: dispatch 2024-05-08T23:59:10.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:10 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6eb056b-a97c-4a6e-9716-4d18d740f456"}]': finished 2024-05-08T23:59:10.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:10 smithi150 ceph-mon[46187]: osdmap e33: 6 total, 5 up, 6 in 2024-05-08T23:59:10.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:10 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:10.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:10 smithi150 ceph-mon[46187]: from='client.? 172.21.15.171:0/209123916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:59:10.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:10 smithi171 ceph-mon[47351]: from='client.? 172.21.15.171:0/1272879574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6eb056b-a97c-4a6e-9716-4d18d740f456"}]: dispatch 2024-05-08T23:59:10.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:10 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6eb056b-a97c-4a6e-9716-4d18d740f456"}]: dispatch 2024-05-08T23:59:10.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:10 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6eb056b-a97c-4a6e-9716-4d18d740f456"}]': finished 2024-05-08T23:59:10.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:10 smithi171 ceph-mon[47351]: osdmap e33: 6 total, 5 up, 6 in 2024-05-08T23:59:10.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:10 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:10.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:10 smithi171 ceph-mon[47351]: from='client.? 172.21.15.171:0/209123916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:59:10.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:10 smithi081 ceph-mon[42474]: from='client.? 172.21.15.171:0/1272879574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6eb056b-a97c-4a6e-9716-4d18d740f456"}]: dispatch 2024-05-08T23:59:10.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:10 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d6eb056b-a97c-4a6e-9716-4d18d740f456"}]: dispatch 2024-05-08T23:59:10.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:10 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d6eb056b-a97c-4a6e-9716-4d18d740f456"}]': finished 2024-05-08T23:59:10.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:10 smithi081 ceph-mon[42474]: osdmap e33: 6 total, 5 up, 6 in 2024-05-08T23:59:10.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:10 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:10.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:10 smithi081 ceph-mon[42474]: from='client.? 172.21.15.171:0/209123916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:59:11.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:11 smithi150 ceph-mon[46187]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:11.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:11 smithi171 ceph-mon[47351]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:11.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:11 smithi081 ceph-mon[42474]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:12.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:12 smithi150 ceph-mon[46187]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:12.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:12 smithi171 ceph-mon[47351]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:12.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:12 smithi081 ceph-mon[42474]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:15.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:15 smithi171 ceph-mon[47351]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:15.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:15 smithi081 ceph-mon[42474]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:15.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:15 smithi150 ceph-mon[46187]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:16.471 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:16 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T23:59:16.471 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:16 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:16.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:16 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T23:59:16.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:16 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:16.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:16 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T23:59:16.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:16 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:17.524 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:17 smithi171 ceph-mon[47351]: Deploying daemon osd.5 on smithi171 2024-05-08T23:59:17.524 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:17 smithi171 ceph-mon[47351]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:17.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:17 smithi081 ceph-mon[42474]: Deploying daemon osd.5 on smithi171 2024-05-08T23:59:17.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:17 smithi081 ceph-mon[42474]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:17.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:17 smithi150 ceph-mon[46187]: Deploying daemon osd.5 on smithi171 2024-05-08T23:59:17.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:17 smithi150 ceph-mon[46187]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:19.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:19 smithi171 ceph-mon[47351]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:19.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:19 smithi081 ceph-mon[42474]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:19.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:19 smithi150 ceph-mon[46187]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:20.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:20 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:20.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:20 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:20.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:20 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:20.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:20 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:20.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:20 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:20.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:20 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:20.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:20 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:20.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:20 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:20.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:20 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:21.530 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 5 on host 'smithi171' 2024-05-08T23:59:21.530 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:21.535+0000 7f506f7fe700 1 -- 172.21.15.171:0/1527249102 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f508002ce60 con 0x7f50680a1120 2024-05-08T23:59:21.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:21.537+0000 7f5084a7b700 1 -- 172.21.15.171:0/1527249102 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f50680a1120 msgr2=0x7f50680a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:21.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:21.537+0000 7f5084a7b700 1 --2- 172.21.15.171:0/1527249102 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f50680a1120 0x7f50680a35e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5074005e90 tx=0x7f5074019040 comp rx=0 tx=0).stop 2024-05-08T23:59:21.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:21.537+0000 7f5084a7b700 1 -- 172.21.15.171:0/1527249102 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5080101a20 msgr2=0x7f508019e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:21.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:21.537+0000 7f5084a7b700 1 --2- 172.21.15.171:0/1527249102 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5080101a20 0x7f508019e1f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f507800ef30 tx=0x7f507800c3a0 comp rx=0 tx=0).stop 2024-05-08T23:59:21.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:21.537+0000 7f5084a7b700 1 -- 172.21.15.171:0/1527249102 shutdown_connections 2024-05-08T23:59:21.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:21.537+0000 7f5084a7b700 1 --2- 172.21.15.171:0/1527249102 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f50680a1120 0x7f50680a35e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:21.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:21.537+0000 7f5084a7b700 1 --2- 172.21.15.171:0/1527249102 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50800fff00 0x7f5080069480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:21.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:21.537+0000 7f5084a7b700 1 --2- 172.21.15.171:0/1527249102 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5080101a20 0x7f508019e1f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:21.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:21.537+0000 7f5084a7b700 1 --2- 172.21.15.171:0/1527249102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5080101060 0x7f508019bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:21.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:21.537+0000 7f5084a7b700 1 -- 172.21.15.171:0/1527249102 >> 172.21.15.171:0/1527249102 conn(0x7f50800fb4a0 msgr2=0x7f50801044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:21.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:21.537+0000 7f5084a7b700 1 -- 172.21.15.171:0/1527249102 shutdown_connections 2024-05-08T23:59:21.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-08T23:59:21.537+0000 7f5084a7b700 1 -- 172.21.15.171:0/1527249102 wait complete. 2024-05-08T23:59:21.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:21 smithi150 ceph-mon[46187]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:21.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:21 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:21.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:21 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:21.770 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:21 smithi171 ceph-mon[47351]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:21.770 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:21.770 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:21.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:21 smithi081 ceph-mon[42474]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:21.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:21 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:21.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:21 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:21.971 DEBUG:teuthology.orchestra.run.smithi171:osd.5> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.5.service 2024-05-08T23:59:21.973 INFO:tasks.cephadm:Deploying osd.6 on smithi081 with /dev/vg_nvme/lv_2... 2024-05-08T23:59:21.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T23:59:22.006 INFO:journalctl@ceph.osd.5.smithi171.stdout:-- Logs begin at Wed 2024-05-08 23:40:11 UTC. -- 2024-05-08T23:59:22.203 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:59:22.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:22 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:22.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:22 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:22.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:22 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:22.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:22 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:22 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:22.795 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:22 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:23.515 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T23:59:23.516 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T23:59:23.516 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-05-08T23:59:23.516 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-05-08T23:59:23.516 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011118 s, 943 MB/s 2024-05-08T23:59:23.516 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-05-08T23:59:23.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:23 smithi150 ceph-mon[46187]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:23.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:23 smithi150 ceph-mon[46187]: from='osd.5 [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T23:59:23.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:23 smithi150 ceph-mon[46187]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T23:59:23.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:23 smithi171 ceph-mon[47351]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:23.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:23 smithi171 ceph-mon[47351]: from='osd.5 [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T23:59:23.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:23 smithi171 ceph-mon[47351]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T23:59:23.803 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 08 23:59:23 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-08T23:59:23.485+0000 7fbe646347c0 -1 osd.5 0 log_to_monitors true 2024-05-08T23:59:23.828 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:23 smithi081 ceph-mon[42474]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:23.829 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:23 smithi081 ceph-mon[42474]: from='osd.5 [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T23:59:23.829 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:23 smithi081 ceph-mon[42474]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T23:59:23.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_2 2024-05-08T23:59:24.128 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T23:59:24.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T23:59:24.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T23:59:24.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:24.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='osd.5 [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-08T23:59:24.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-08T23:59:24.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:24.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:24.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:24.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:24.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:24.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:24.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:24.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:24.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:24.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:24.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:24.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:24.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T23:59:24.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T23:59:24.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:24.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='osd.5 [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-08T23:59:24.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-08T23:59:24.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:24.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:24.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:24.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:24.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:24.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:24.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:24.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:24.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:24.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:24.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:24.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:24.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T23:59:24.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T23:59:24.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:24.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='osd.5 [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-08T23:59:24.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-08T23:59:24.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:24.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:24.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:24.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:24.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:24.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:24.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:24.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:24.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:24.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:24.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:24.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:25.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.068+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/3797290802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f8101060 msgr2=0x7fe4f81014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:25.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.068+0000 7fe4ff8c1700 1 --2- 172.21.15.81:0/3797290802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f8101060 0x7fe4f81014e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009990 tx=0x7fe4e8009ca0 comp rx=0 tx=0).stop 2024-05-08T23:59:25.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/3797290802 shutdown_connections 2024-05-08T23:59:25.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 --2- 172.21.15.81:0/3797290802 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f80fff00 0x7fe4f8100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:25.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 --2- 172.21.15.81:0/3797290802 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f8101a20 0x7fe4f8108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:25.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 --2- 172.21.15.81:0/3797290802 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f8101060 0x7fe4f81014e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:25.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/3797290802 >> 172.21.15.81:0/3797290802 conn(0x7fe4f80fb4a0 msgr2=0x7fe4f80fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:25.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/3797290802 shutdown_connections 2024-05-08T23:59:25.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/3797290802 wait complete. 2024-05-08T23:59:25.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 Processor -- start 2024-05-08T23:59:25.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 -- start start 2024-05-08T23:59:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f80fff00 0x7fe4f8103e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:59:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f8101060 0x7fe4f81024d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:59:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f8101a20 0x7fe4f8102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:59:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f81031b0 con 0x7fe4f80fff00 2024-05-08T23:59:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f8103320 con 0x7fe4f8101060 2024-05-08T23:59:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4ff8c1700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f81a0fb0 con 0x7fe4f8101a20 2024-05-08T23:59:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.069+0000 7fe4fd65d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f80fff00 0x7fe4f8103e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:59:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4fd65d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f80fff00 0x7fe4f8103e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48568/0 (socket says 172.21.15.81:48568) 2024-05-08T23:59:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4fd65d700 1 -- 172.21.15.81:0/4060944916 learned_addr learned my addr 172.21.15.81:0/4060944916 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-08T23:59:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4fde5e700 1 --2- 172.21.15.81:0/4060944916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f8101a20 0x7fe4f8102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:59:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4fce5c700 1 --2- 172.21.15.81:0/4060944916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f8101060 0x7fe4f81024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:59:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4fd65d700 1 -- 172.21.15.81:0/4060944916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f8101a20 msgr2=0x7fe4f8102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4fd65d700 1 --2- 172.21.15.81:0/4060944916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f8101a20 0x7fe4f8102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4fd65d700 1 -- 172.21.15.81:0/4060944916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f8101060 msgr2=0x7fe4f81024d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4fd65d700 1 --2- 172.21.15.81:0/4060944916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f8101060 0x7fe4f81024d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4fd65d700 1 -- 172.21.15.81:0/4060944916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e80095f0 con 0x7fe4f80fff00 2024-05-08T23:59:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4fd65d700 1 --2- 172.21.15.81:0/4060944916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f80fff00 0x7fe4f8103e30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400d950 tx=0x7fe4f400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4ee7fc700 1 -- 172.21.15.81:0/4060944916 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4009940 con 0x7fe4f80fff00 2024-05-08T23:59:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/4060944916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f81a1240 con 0x7fe4f80fff00 2024-05-08T23:59:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4ee7fc700 1 -- 172.21.15.81:0/4060944916 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4f4010460 con 0x7fe4f80fff00 2024-05-08T23:59:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4ee7fc700 1 -- 172.21.15.81:0/4060944916 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f400f620 con 0x7fe4f80fff00 2024-05-08T23:59:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.070+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/4060944916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f81a1790 con 0x7fe4f80fff00 2024-05-08T23:59:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.071+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/4060944916 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f804ec60 con 0x7fe4f80fff00 2024-05-08T23:59:25.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.072+0000 7fe4ee7fc700 1 -- 172.21.15.81:0/4060944916 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe4f40108d0 con 0x7fe4f80fff00 2024-05-08T23:59:25.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.073+0000 7fe4ee7fc700 1 --2- 172.21.15.81:0/4060944916 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe4e40a1120 0x7fe4e40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:59:25.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.073+0000 7fe4fce5c700 1 --2- 172.21.15.81:0/4060944916 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe4e40a1120 0x7fe4e40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:59:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.073+0000 7fe4ee7fc700 1 -- 172.21.15.81:0/4060944916 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4253+0+0 (secure 0 0 0) 0x7fe4f40cb7a0 con 0x7fe4f80fff00 2024-05-08T23:59:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.073+0000 7fe4fce5c700 1 --2- 172.21.15.81:0/4060944916 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe4e40a1120 0x7fe4e40a35e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800b5c0 tx=0x7fe4e8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:25.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.077+0000 7fe4ee7fc700 1 -- 172.21.15.81:0/4060944916 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe4f4095f10 con 0x7fe4f80fff00 2024-05-08T23:59:25.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:25.281+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/4060944916 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4f8069150 con 0x7fe4e40a1120 2024-05-08T23:59:25.302 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 08 23:59:25 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-08T23:59:25.003+0000 7fbe59c98700 -1 osd.5 0 waiting for initial osdmap 2024-05-08T23:59:25.302 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 08 23:59:25 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-08T23:59:25.012+0000 7fbe51a85700 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:59:25.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:25 smithi150 ceph-mon[46187]: Detected new or changed devices on smithi171 2024-05-08T23:59:25.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:25 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi171 to 8557M 2024-05-08T23:59:25.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:25 smithi150 ceph-mon[46187]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:25.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:25 smithi150 ceph-mon[46187]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-08T23:59:25.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:25 smithi150 ceph-mon[46187]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T23:59:25.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:25 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:25.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:25 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:25.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:25 smithi150 ceph-mon[46187]: from='osd.5 ' entity='osd.5' 2024-05-08T23:59:25.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:25 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:59:25.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:25 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:59:25.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:25 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:25.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:25 smithi171 ceph-mon[47351]: Detected new or changed devices on smithi171 2024-05-08T23:59:25.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:25 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi171 to 8557M 2024-05-08T23:59:25.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:25 smithi171 ceph-mon[47351]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:25.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:25 smithi171 ceph-mon[47351]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-08T23:59:25.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:25 smithi171 ceph-mon[47351]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T23:59:25.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:25 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:25.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:25 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:25.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:25 smithi171 ceph-mon[47351]: from='osd.5 ' entity='osd.5' 2024-05-08T23:59:25.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:25 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:59:25.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:25 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:59:25.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:25 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:25.808 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:25 smithi081 ceph-mon[42474]: Detected new or changed devices on smithi171 2024-05-08T23:59:25.808 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:25 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi171 to 8557M 2024-05-08T23:59:25.809 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:25 smithi081 ceph-mon[42474]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 149 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:25.809 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:25 smithi081 ceph-mon[42474]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-08T23:59:25.809 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:25 smithi081 ceph-mon[42474]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T23:59:25.809 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:25 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:25.809 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:25 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:25.809 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:25 smithi081 ceph-mon[42474]: from='osd.5 ' entity='osd.5' 2024-05-08T23:59:25.809 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:25 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:59:25.809 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:25 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:59:25.809 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:25 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:26.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:26 smithi171 ceph-mon[47351]: purged_snaps scrub starts 2024-05-08T23:59:26.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:26 smithi171 ceph-mon[47351]: purged_snaps scrub ok 2024-05-08T23:59:26.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:26 smithi171 ceph-mon[47351]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:59:26.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:26 smithi171 ceph-mon[47351]: osd.5 [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436] boot 2024-05-08T23:59:26.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:26 smithi171 ceph-mon[47351]: osdmap e36: 6 total, 6 up, 6 in 2024-05-08T23:59:26.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:26 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:26.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:26 smithi171 ceph-mon[47351]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:26.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:26 smithi081 ceph-mon[42474]: purged_snaps scrub starts 2024-05-08T23:59:26.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:26 smithi081 ceph-mon[42474]: purged_snaps scrub ok 2024-05-08T23:59:26.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:26 smithi081 ceph-mon[42474]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:59:26.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:26 smithi081 ceph-mon[42474]: osd.5 [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436] boot 2024-05-08T23:59:26.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:26 smithi081 ceph-mon[42474]: osdmap e36: 6 total, 6 up, 6 in 2024-05-08T23:59:26.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:26 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:26.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:26 smithi081 ceph-mon[42474]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:27.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:26 smithi150 ceph-mon[46187]: purged_snaps scrub starts 2024-05-08T23:59:27.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:26 smithi150 ceph-mon[46187]: purged_snaps scrub ok 2024-05-08T23:59:27.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:26 smithi150 ceph-mon[46187]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:59:27.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:26 smithi150 ceph-mon[46187]: osd.5 [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436] boot 2024-05-08T23:59:27.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:26 smithi150 ceph-mon[46187]: osdmap e36: 6 total, 6 up, 6 in 2024-05-08T23:59:27.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:26 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T23:59:27.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:26 smithi150 ceph-mon[46187]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 150 MiB used, 447 GiB / 447 GiB avail 2024-05-08T23:59:27.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:27 smithi171 ceph-mon[47351]: osdmap e37: 6 total, 6 up, 6 in 2024-05-08T23:59:27.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:27 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1721530529' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "228afbcd-479c-407b-83f2-a51afec0076c"}]: dispatch 2024-05-08T23:59:27.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:27 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1721530529' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "228afbcd-479c-407b-83f2-a51afec0076c"}]': finished 2024-05-08T23:59:27.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:27 smithi171 ceph-mon[47351]: osdmap e38: 7 total, 6 up, 7 in 2024-05-08T23:59:27.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:27 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:27.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:27 smithi081 ceph-mon[42474]: osdmap e37: 6 total, 6 up, 6 in 2024-05-08T23:59:27.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:27 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1721530529' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "228afbcd-479c-407b-83f2-a51afec0076c"}]: dispatch 2024-05-08T23:59:27.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:27 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1721530529' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "228afbcd-479c-407b-83f2-a51afec0076c"}]': finished 2024-05-08T23:59:27.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:27 smithi081 ceph-mon[42474]: osdmap e38: 7 total, 6 up, 7 in 2024-05-08T23:59:27.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:27 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:28.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:27 smithi150 ceph-mon[46187]: osdmap e37: 6 total, 6 up, 6 in 2024-05-08T23:59:28.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:27 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1721530529' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "228afbcd-479c-407b-83f2-a51afec0076c"}]: dispatch 2024-05-08T23:59:28.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:27 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1721530529' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "228afbcd-479c-407b-83f2-a51afec0076c"}]': finished 2024-05-08T23:59:28.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:27 smithi150 ceph-mon[46187]: osdmap e38: 7 total, 6 up, 7 in 2024-05-08T23:59:28.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:27 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:28.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:28 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1904550442' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:59:28.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:28 smithi171 ceph-mon[47351]: osdmap e39: 7 total, 6 up, 7 in 2024-05-08T23:59:28.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:28 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:28.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:28 smithi171 ceph-mon[47351]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:59:28.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:28 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1904550442' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:59:28.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:28 smithi081 ceph-mon[42474]: osdmap e39: 7 total, 6 up, 7 in 2024-05-08T23:59:28.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:28 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:28.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:28 smithi081 ceph-mon[42474]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:59:29.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:28 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1904550442' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:59:29.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:28 smithi150 ceph-mon[46187]: osdmap e39: 7 total, 6 up, 7 in 2024-05-08T23:59:29.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:28 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:29.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:28 smithi150 ceph-mon[46187]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:59:30.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:30 smithi081 ceph-mon[42474]: osdmap e40: 7 total, 6 up, 7 in 2024-05-08T23:59:30.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:30 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:30.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:30 smithi150 ceph-mon[46187]: osdmap e40: 7 total, 6 up, 7 in 2024-05-08T23:59:30.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:30 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:30.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:30 smithi171 ceph-mon[47351]: osdmap e40: 7 total, 6 up, 7 in 2024-05-08T23:59:30.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:30 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:31.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:31 smithi081 ceph-mon[42474]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:59:31.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:31 smithi150 ceph-mon[46187]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:59:31.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:31 smithi171 ceph-mon[47351]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 180 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:59:33.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:33 smithi171 ceph-mon[47351]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-08T23:59:33.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T23:59:33.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:33.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:33 smithi081 ceph-mon[42474]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-08T23:59:33.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T23:59:33.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:33 smithi150 ceph-mon[46187]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-05-08T23:59:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T23:59:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:34.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:34 smithi081 ceph-mon[42474]: Deploying daemon osd.6 on smithi081 2024-05-08T23:59:34.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:34 smithi171 ceph-mon[47351]: Deploying daemon osd.6 on smithi081 2024-05-08T23:59:34.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:34 smithi150 ceph-mon[46187]: Deploying daemon osd.6 on smithi081 2024-05-08T23:59:35.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:35 smithi171 ceph-mon[47351]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-05-08T23:59:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:35 smithi081 ceph-mon[42474]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-05-08T23:59:35.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:35 smithi150 ceph-mon[46187]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s, 0 objects/s recovering 2024-05-08T23:59:37.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:37 smithi081 ceph-mon[42474]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-08T23:59:37.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:37.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:37.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:37.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:37 smithi171 ceph-mon[47351]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-08T23:59:37.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:37.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:37.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:37.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:37 smithi150 ceph-mon[46187]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2024-05-08T23:59:37.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:37.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:37.766 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:39.118 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 6 on host 'smithi081' 2024-05-08T23:59:39.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:39.124+0000 7fe4ee7fc700 1 -- 172.21.15.81:0/4060944916 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe4f8069150 con 0x7fe4e40a1120 2024-05-08T23:59:39.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:39.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:39.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:39 smithi081 ceph-mon[42474]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:59:39.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:39.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:39.127+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/4060944916 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe4e40a1120 msgr2=0x7fe4e40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:39.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:39.127+0000 7fe4ff8c1700 1 --2- 172.21.15.81:0/4060944916 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe4e40a1120 0x7fe4e40a35e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4e800b5c0 tx=0x7fe4e8005fb0 comp rx=0 tx=0).stop 2024-05-08T23:59:39.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:39.127+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/4060944916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f80fff00 msgr2=0x7fe4f8103e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:39.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:39.127+0000 7fe4ff8c1700 1 --2- 172.21.15.81:0/4060944916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f80fff00 0x7fe4f8103e30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400d950 tx=0x7fe4f400dc60 comp rx=0 tx=0).stop 2024-05-08T23:59:39.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:39.127+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/4060944916 shutdown_connections 2024-05-08T23:59:39.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:39.127+0000 7fe4ff8c1700 1 --2- 172.21.15.81:0/4060944916 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe4e40a1120 0x7fe4e40a35e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:39.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:39.127+0000 7fe4ff8c1700 1 --2- 172.21.15.81:0/4060944916 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4f8101a20 0x7fe4f8102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:39.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:39.127+0000 7fe4ff8c1700 1 --2- 172.21.15.81:0/4060944916 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f80fff00 0x7fe4f8103e30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:39.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:39.127+0000 7fe4ff8c1700 1 --2- 172.21.15.81:0/4060944916 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4f8101060 0x7fe4f81024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:39.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:39.127+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/4060944916 >> 172.21.15.81:0/4060944916 conn(0x7fe4f80fb4a0 msgr2=0x7fe4f8068a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:39.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:39.127+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/4060944916 shutdown_connections 2024-05-08T23:59:39.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-08T23:59:39.127+0000 7fe4ff8c1700 1 -- 172.21.15.81:0/4060944916 wait complete. 2024-05-08T23:59:39.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:39.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:39.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:39 smithi150 ceph-mon[46187]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:59:39.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:39.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:39.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:39.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:39 smithi171 ceph-mon[47351]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T23:59:39.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:39.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:39.595 DEBUG:teuthology.orchestra.run.smithi081:osd.6> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.6.service 2024-05-08T23:59:39.597 INFO:tasks.cephadm:Deploying osd.7 on smithi150 with /dev/vg_nvme/lv_2... 2024-05-08T23:59:39.597 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T23:59:39.627 INFO:journalctl@ceph.osd.6.smithi081.stdout:-- Logs begin at Wed 2024-05-08 23:39:48 UTC. -- 2024-05-08T23:59:39.829 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:59:41.120 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 08 23:59:40 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-08T23:59:40.762+0000 7f19648f97c0 -1 osd.6 0 log_to_monitors true 2024-05-08T23:59:41.214 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T23:59:41.214 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T23:59:41.215 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10+0 records in 2024-05-08T23:59:41.215 INFO:teuthology.orchestra.run.smithi150.stderr:10+0 records out 2024-05-08T23:59:41.215 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119528 s, 877 MB/s 2024-05-08T23:59:41.215 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping successful for: 2024-05-08T23:59:41.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:41 smithi150 ceph-mon[46187]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-08T23:59:41.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:41 smithi150 ceph-mon[46187]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T23:59:41.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:41 smithi171 ceph-mon[47351]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-08T23:59:41.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:41 smithi171 ceph-mon[47351]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T23:59:41.597 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi150:vg_nvme/lv_2 2024-05-08T23:59:41.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:41 smithi081 ceph-mon[42474]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-08T23:59:41.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:41 smithi081 ceph-mon[42474]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T23:59:41.817 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T23:59:42.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T23:59:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T23:59:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-08T23:59:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:42.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:42.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-08T23:59:42.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T23:59:42.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T23:59:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T23:59:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-08T23:59:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:42.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:42.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:42.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:42.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-08T23:59:42.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T23:59:42.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:42.669 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T23:59:42.669 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T23:59:42.670 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:42.670 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-08T23:59:42.670 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:42.670 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:42.670 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:42.670 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:42.670 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T23:59:42.670 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:42.670 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:42.670 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:42.670 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:42.670 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-08T23:59:42.670 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T23:59:42.671 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:42.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.860+0000 7f8b2faff700 1 -- 172.21.15.150:0/3884415413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b28101060 msgr2=0x7f8b281014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:42.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.860+0000 7f8b2faff700 1 --2- 172.21.15.150:0/3884415413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b28101060 0x7f8b281014e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009990 tx=0x7f8b1c009ca0 comp rx=0 tx=0).stop 2024-05-08T23:59:42.857 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 -- 172.21.15.150:0/3884415413 shutdown_connections 2024-05-08T23:59:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 --2- 172.21.15.150:0/3884415413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b28101a20 0x7f8b28108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 --2- 172.21.15.150:0/3884415413 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b280fff00 0x7f8b28100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 --2- 172.21.15.150:0/3884415413 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b28101060 0x7f8b281014e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 -- 172.21.15.150:0/3884415413 >> 172.21.15.150:0/3884415413 conn(0x7f8b280fb4c0 msgr2=0x7f8b280fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 -- 172.21.15.150:0/3884415413 shutdown_connections 2024-05-08T23:59:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 -- 172.21.15.150:0/3884415413 wait complete. 2024-05-08T23:59:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 Processor -- start 2024-05-08T23:59:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 -- start start 2024-05-08T23:59:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b280fff00 0x7f8b28069d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:59:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b28101060 0x7f8b2819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:59:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b28101a20 0x7f8b2819e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:59:42.858 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2819e9b0 con 0x7f8b28101060 2024-05-08T23:59:42.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2819eb20 con 0x7f8b28101a20 2024-05-08T23:59:42.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.861+0000 7f8b2faff700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2819ece0 con 0x7f8b280fff00 2024-05-08T23:59:42.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b2e09c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b28101a20 0x7f8b2819e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:59:42.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b2e09c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b28101a20 0x7f8b2819e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:40018/0 (socket says 172.21.15.150:40018) 2024-05-08T23:59:42.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b2e09c700 1 -- 172.21.15.150:0/4178708321 learned_addr learned my addr 172.21.15.150:0/4178708321 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-08T23:59:42.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b2d09a700 1 --2- 172.21.15.150:0/4178708321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b28101060 0x7f8b2819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:59:42.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b2d89b700 1 --2- 172.21.15.150:0/4178708321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b280fff00 0x7f8b28069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:59:42.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b2e09c700 1 -- 172.21.15.150:0/4178708321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b280fff00 msgr2=0x7f8b28069d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:42.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b2e09c700 1 --2- 172.21.15.150:0/4178708321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b280fff00 0x7f8b28069d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:42.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b2e09c700 1 -- 172.21.15.150:0/4178708321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b28101060 msgr2=0x7f8b2819bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:42.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b2e09c700 1 --2- 172.21.15.150:0/4178708321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b28101060 0x7f8b2819bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:42.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b2e09c700 1 -- 172.21.15.150:0/4178708321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c0095f0 con 0x7f8b28101a20 2024-05-08T23:59:42.859 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b2e09c700 1 --2- 172.21.15.150:0/4178708321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b28101a20 0x7f8b2819e210 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8b20007d70 tx=0x7f8b2000a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:42.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b1affd700 1 -- 172.21.15.150:0/4178708321 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000ad40 con 0x7f8b28101a20 2024-05-08T23:59:42.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b1affd700 1 -- 172.21.15.150:0/4178708321 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b200128e0 con 0x7f8b28101a20 2024-05-08T23:59:42.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b2faff700 1 -- 172.21.15.150:0/4178708321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2819efc0 con 0x7f8b28101a20 2024-05-08T23:59:42.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b1affd700 1 -- 172.21.15.150:0/4178708321 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b200116b0 con 0x7f8b28101a20 2024-05-08T23:59:42.860 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.862+0000 7f8b2faff700 1 -- 172.21.15.150:0/4178708321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2819f3e0 con 0x7f8b28101a20 2024-05-08T23:59:42.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.863+0000 7f8b2faff700 1 -- 172.21.15.150:0/4178708321 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b28107380 con 0x7f8b28101a20 2024-05-08T23:59:42.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.864+0000 7f8b1affd700 1 -- 172.21.15.150:0/4178708321 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8b20012420 con 0x7f8b28101a20 2024-05-08T23:59:42.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.865+0000 7f8b1affd700 1 --2- 172.21.15.150:0/4178708321 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8b140a11a0 0x7f8b140a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T23:59:42.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.865+0000 7f8b1affd700 1 -- 172.21.15.150:0/4178708321 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4685+0+0 (secure 0 0 0) 0x7f8b200cbdd0 con 0x7f8b28101a20 2024-05-08T23:59:42.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.865+0000 7f8b2d89b700 1 --2- 172.21.15.150:0/4178708321 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8b140a11a0 0x7f8b140a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T23:59:42.861 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.865+0000 7f8b2d89b700 1 --2- 172.21.15.150:0/4178708321 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8b140a11a0 0x7f8b140a3660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b24005fd0 tx=0x7f8b2400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T23:59:42.864 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:42.869+0000 7f8b1affd700 1 -- 172.21.15.150:0/4178708321 <== mon.2 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8b200d0070 con 0x7f8b28101a20 2024-05-08T23:59:43.066 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:43.072+0000 7f8b2faff700 1 -- 172.21.15.150:0/4178708321 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b2802cf00 con 0x7f8b140a11a0 2024-05-08T23:59:43.120 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 08 23:59:42 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-08T23:59:42.750+0000 7f1959f5d700 -1 osd.6 0 waiting for initial osdmap 2024-05-08T23:59:43.120 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 08 23:59:42 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-08T23:59:42.761+0000 7f1951d4a700 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T23:59:43.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:43 smithi171 ceph-mon[47351]: Detected new or changed devices on smithi081 2024-05-08T23:59:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:43 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi081 to 5704M 2024-05-08T23:59:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:43 smithi171 ceph-mon[47351]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:59:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:43 smithi171 ceph-mon[47351]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' 2024-05-08T23:59:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:59:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:59:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:43.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:43.615 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:43 smithi150 ceph-mon[46187]: Detected new or changed devices on smithi081 2024-05-08T23:59:43.615 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:43 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi081 to 5704M 2024-05-08T23:59:43.615 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:43 smithi150 ceph-mon[46187]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:59:43.615 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:43.615 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:43 smithi150 ceph-mon[46187]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' 2024-05-08T23:59:43.615 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:59:43.615 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:59:43.615 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:43.616 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:43.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:43 smithi081 ceph-mon[42474]: Detected new or changed devices on smithi081 2024-05-08T23:59:43.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:43 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi081 to 5704M 2024-05-08T23:59:43.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:43 smithi081 ceph-mon[42474]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:59:43.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:43.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:43 smithi081 ceph-mon[42474]: from='osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822]' entity='osd.6' 2024-05-08T23:59:43.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T23:59:43.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T23:59:43.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:43.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:44.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:44 smithi081 ceph-mon[42474]: purged_snaps scrub starts 2024-05-08T23:59:44.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:44 smithi081 ceph-mon[42474]: purged_snaps scrub ok 2024-05-08T23:59:44.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:44 smithi081 ceph-mon[42474]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:59:44.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:44 smithi081 ceph-mon[42474]: osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822] boot 2024-05-08T23:59:44.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:44 smithi081 ceph-mon[42474]: osdmap e43: 7 total, 7 up, 7 in 2024-05-08T23:59:44.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:44 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:44.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:44 smithi150 ceph-mon[46187]: purged_snaps scrub starts 2024-05-08T23:59:44.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:44 smithi150 ceph-mon[46187]: purged_snaps scrub ok 2024-05-08T23:59:44.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:44 smithi150 ceph-mon[46187]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:59:44.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:44 smithi150 ceph-mon[46187]: osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822] boot 2024-05-08T23:59:44.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:44 smithi150 ceph-mon[46187]: osdmap e43: 7 total, 7 up, 7 in 2024-05-08T23:59:44.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:44 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:44.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:44 smithi171 ceph-mon[47351]: purged_snaps scrub starts 2024-05-08T23:59:44.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:44 smithi171 ceph-mon[47351]: purged_snaps scrub ok 2024-05-08T23:59:44.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:44 smithi171 ceph-mon[47351]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T23:59:44.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:44 smithi171 ceph-mon[47351]: osd.6 [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822] boot 2024-05-08T23:59:44.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:44 smithi171 ceph-mon[47351]: osdmap e43: 7 total, 7 up, 7 in 2024-05-08T23:59:44.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:44 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T23:59:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:45 smithi081 ceph-mon[42474]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:59:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:45 smithi081 ceph-mon[42474]: osdmap e44: 7 total, 7 up, 7 in 2024-05-08T23:59:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:45 smithi081 ceph-mon[42474]: from='client.? 172.21.15.150:0/3589215282' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc45d82f-490e-4708-b8c3-19befc6c6c99"}]: dispatch 2024-05-08T23:59:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:45 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc45d82f-490e-4708-b8c3-19befc6c6c99"}]: dispatch 2024-05-08T23:59:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:45 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc45d82f-490e-4708-b8c3-19befc6c6c99"}]': finished 2024-05-08T23:59:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:45 smithi081 ceph-mon[42474]: osdmap e45: 8 total, 7 up, 8 in 2024-05-08T23:59:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:45 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:59:45.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:45 smithi150 ceph-mon[46187]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:59:45.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:45 smithi150 ceph-mon[46187]: osdmap e44: 7 total, 7 up, 7 in 2024-05-08T23:59:45.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:45 smithi150 ceph-mon[46187]: from='client.? 172.21.15.150:0/3589215282' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc45d82f-490e-4708-b8c3-19befc6c6c99"}]: dispatch 2024-05-08T23:59:45.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:45 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc45d82f-490e-4708-b8c3-19befc6c6c99"}]: dispatch 2024-05-08T23:59:45.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:45 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc45d82f-490e-4708-b8c3-19befc6c6c99"}]': finished 2024-05-08T23:59:45.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:45 smithi150 ceph-mon[46187]: osdmap e45: 8 total, 7 up, 8 in 2024-05-08T23:59:45.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:45 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:59:45.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:45 smithi171 ceph-mon[47351]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-05-08T23:59:45.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:45 smithi171 ceph-mon[47351]: osdmap e44: 7 total, 7 up, 7 in 2024-05-08T23:59:45.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:45 smithi171 ceph-mon[47351]: from='client.? 172.21.15.150:0/3589215282' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc45d82f-490e-4708-b8c3-19befc6c6c99"}]: dispatch 2024-05-08T23:59:45.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:45 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fc45d82f-490e-4708-b8c3-19befc6c6c99"}]: dispatch 2024-05-08T23:59:45.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:45 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fc45d82f-490e-4708-b8c3-19befc6c6c99"}]': finished 2024-05-08T23:59:45.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:45 smithi171 ceph-mon[47351]: osdmap e45: 8 total, 7 up, 8 in 2024-05-08T23:59:45.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:45 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T23:59:46.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:46 smithi081 ceph-mon[42474]: from='client.? 172.21.15.150:0/3800083263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:59:46.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:46 smithi150 ceph-mon[46187]: from='client.? 172.21.15.150:0/3800083263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:59:46.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:46 smithi171 ceph-mon[47351]: from='client.? 172.21.15.150:0/3800083263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T23:59:47.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:47 smithi081 ceph-mon[42474]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:47.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:47 smithi150 ceph-mon[46187]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:47.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:47 smithi171 ceph-mon[47351]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:49.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:49 smithi081 ceph-mon[42474]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:49.684 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:49 smithi150 ceph-mon[46187]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:49.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:49 smithi171 ceph-mon[47351]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:51.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:51 smithi150 ceph-mon[46187]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:51.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:51 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T23:59:51.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:51 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:51.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:51 smithi081 ceph-mon[42474]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:51.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:51 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T23:59:51.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:51 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:51.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:51 smithi171 ceph-mon[47351]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:51.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:51 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T23:59:51.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:51 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:52.562 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:52 smithi150 ceph-mon[46187]: Deploying daemon osd.7 on smithi150 2024-05-08T23:59:52.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:52 smithi081 ceph-mon[42474]: Deploying daemon osd.7 on smithi150 2024-05-08T23:59:52.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:52 smithi171 ceph-mon[47351]: Deploying daemon osd.7 on smithi150 2024-05-08T23:59:53.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:53 smithi081 ceph-mon[42474]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:53.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:53 smithi150 ceph-mon[46187]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:53.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:53 smithi171 ceph-mon[47351]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:55.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:55 smithi081 ceph-mon[42474]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:55.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:55 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:55.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:55 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:55.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:55 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:55.743 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:55 smithi150 ceph-mon[46187]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:55.743 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:55 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:55.744 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:55 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:55.744 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:55 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:55.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:55 smithi171 ceph-mon[47351]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:55.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:55 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:55.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:55 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:55.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:55 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:56.868 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:56.873+0000 7f8b1affd700 1 -- 172.21.15.150:0/4178708321 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8b2802cf00 con 0x7f8b140a11a0 2024-05-08T23:59:56.868 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 7 on host 'smithi150' 2024-05-08T23:59:56.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:56.875+0000 7f8b2faff700 1 -- 172.21.15.150:0/4178708321 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8b140a11a0 msgr2=0x7f8b140a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:56.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:56.875+0000 7f8b2faff700 1 --2- 172.21.15.150:0/4178708321 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8b140a11a0 0x7f8b140a3660 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b24005fd0 tx=0x7f8b2400a560 comp rx=0 tx=0).stop 2024-05-08T23:59:56.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:56.875+0000 7f8b2faff700 1 -- 172.21.15.150:0/4178708321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b28101a20 msgr2=0x7f8b2819e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T23:59:56.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:56.875+0000 7f8b2faff700 1 --2- 172.21.15.150:0/4178708321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b28101a20 0x7f8b2819e210 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8b20007d70 tx=0x7f8b2000a340 comp rx=0 tx=0).stop 2024-05-08T23:59:56.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:56.875+0000 7f8b2faff700 1 -- 172.21.15.150:0/4178708321 shutdown_connections 2024-05-08T23:59:56.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:56.875+0000 7f8b2faff700 1 --2- 172.21.15.150:0/4178708321 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8b140a11a0 0x7f8b140a3660 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:56.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:56.875+0000 7f8b2faff700 1 --2- 172.21.15.150:0/4178708321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b28101a20 0x7f8b2819e210 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:56.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:56.875+0000 7f8b2faff700 1 --2- 172.21.15.150:0/4178708321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b280fff00 0x7f8b28069d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:56.870 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:56.875+0000 7f8b2faff700 1 --2- 172.21.15.150:0/4178708321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b28101060 0x7f8b2819bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T23:59:56.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:56.875+0000 7f8b2faff700 1 -- 172.21.15.150:0/4178708321 >> 172.21.15.150:0/4178708321 conn(0x7f8b280fb4c0 msgr2=0x7f8b281044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T23:59:56.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:56.875+0000 7f8b2faff700 1 -- 172.21.15.150:0/4178708321 shutdown_connections 2024-05-08T23:59:56.871 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-08T23:59:56.875+0000 7f8b2faff700 1 -- 172.21.15.150:0/4178708321 wait complete. 2024-05-08T23:59:57.296 DEBUG:teuthology.orchestra.run.smithi150:osd.7> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.7.service 2024-05-08T23:59:57.298 INFO:tasks.cephadm:Deploying osd.8 on smithi171 with /dev/vg_nvme/lv_2... 2024-05-08T23:59:57.298 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T23:59:57.329 INFO:journalctl@ceph.osd.7.smithi150.stdout:-- Logs begin at Wed 2024-05-08 23:39:53 UTC. -- 2024-05-08T23:59:57.407 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:57 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.408 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:57 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.408 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:57 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:57.408 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:57 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:57.408 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:57 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.408 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:57 smithi150 ceph-mon[46187]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:57.408 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:57 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.408 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:57 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.408 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:57 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:57.533 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:59:57.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:57 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:57 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:57 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:57.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:57 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:57.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:57 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:57 smithi171 ceph-mon[47351]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:57.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:57 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:57 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:57 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:57.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:57 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:57 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:57 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T23:59:57.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:57 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T23:59:57.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:57 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:57 smithi081 ceph-mon[42474]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:57.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:57 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:57 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-08T23:59:57.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:57 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T23:59:58.917 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T23:59:58.917 INFO:teuthology.orchestra.run.smithi171.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T23:59:58.917 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 10+0 records in 2024-05-08T23:59:58.918 INFO:teuthology.orchestra.run.smithi171.stderr:10+0 records out 2024-05-08T23:59:58.918 INFO:teuthology.orchestra.run.smithi171.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111335 s, 942 MB/s 2024-05-08T23:59:58.918 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 2024-05-08T23:59:58.918 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping successful for: 2024-05-08T23:59:59.012 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 08 23:59:58 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-08T23:59:58.560+0000 7f59c969e7c0 -1 osd.7 0 log_to_monitors true 2024-05-08T23:59:59.320 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_2 2024-05-08T23:59:59.540 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T23:59:59.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:59 smithi171 ceph-mon[47351]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:59.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:59 smithi171 ceph-mon[47351]: from='osd.7 [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T23:59:59.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 08 23:59:59 smithi171 ceph-mon[47351]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T23:59:59.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:59 smithi081 ceph-mon[42474]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:59.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:59 smithi081 ceph-mon[42474]: from='osd.7 [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T23:59:59.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 08 23:59:59 smithi081 ceph-mon[42474]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T23:59:59.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:59 smithi150 ceph-mon[46187]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-08T23:59:59.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:59 smithi150 ceph-mon[46187]: from='osd.7 [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T23:59:59.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 08 23:59:59 smithi150 ceph-mon[46187]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-09T00:00:00.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.518+0000 7fb2219d3700 1 -- 172.21.15.171:0/2430709697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb21c100fe0 msgr2=0x7fb21c101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:00.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.518+0000 7fb2219d3700 1 --2- 172.21.15.171:0/2430709697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb21c100fe0 0x7fb21c101400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009990 tx=0x7fb20c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:00:00.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.518+0000 7fb2219d3700 1 -- 172.21.15.171:0/2430709697 shutdown_connections 2024-05-09T00:00:00.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.518+0000 7fb2219d3700 1 --2- 172.21.15.171:0/2430709697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb21c102b80 0x7fb21c109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:00.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.518+0000 7fb2219d3700 1 --2- 172.21.15.171:0/2430709697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb21c100fe0 0x7fb21c101400 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:00.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.518+0000 7fb2219d3700 1 --2- 172.21.15.171:0/2430709697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb21c1021e0 0x7fb21c102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:00.515 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.518+0000 7fb2219d3700 1 -- 172.21.15.171:0/2430709697 >> 172.21.15.171:0/2430709697 conn(0x7fb21c0fc580 msgr2=0x7fb21c0fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:00.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.518+0000 7fb2219d3700 1 -- 172.21.15.171:0/2430709697 shutdown_connections 2024-05-09T00:00:00.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.518+0000 7fb2219d3700 1 -- 172.21.15.171:0/2430709697 wait complete. 2024-05-09T00:00:00.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.518+0000 7fb2219d3700 1 Processor -- start 2024-05-09T00:00:00.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb2219d3700 1 -- start start 2024-05-09T00:00:00.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb2219d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb21c100fe0 0x7fb21c074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:00.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb2219d3700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb21c1021e0 0x7fb21c073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:00.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb2219d3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb21c102b80 0x7fb21c0738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:00.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb2219d3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c074070 con 0x7fb21c100fe0 2024-05-09T00:00:00.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb2219d3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c0741e0 con 0x7fb21c102b80 2024-05-09T00:00:00.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb2219d3700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21c1a0f90 con 0x7fb21c1021e0 2024-05-09T00:00:00.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb21a7fc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb21c1021e0 0x7fb21c073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:00.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb21a7fc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb21c1021e0 0x7fb21c073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:43232/0 (socket says 172.21.15.171:43232) 2024-05-09T00:00:00.516 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb21a7fc700 1 -- 172.21.15.171:0/3215772213 learned_addr learned my addr 172.21.15.171:0/3215772213 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-09T00:00:00.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb21b7fe700 1 --2- 172.21.15.171:0/3215772213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb21c102b80 0x7fb21c0738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:00.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb21affd700 1 --2- 172.21.15.171:0/3215772213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb21c100fe0 0x7fb21c074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:00.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb21a7fc700 1 -- 172.21.15.171:0/3215772213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb21c102b80 msgr2=0x7fb21c0738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:00.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb21a7fc700 1 --2- 172.21.15.171:0/3215772213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb21c102b80 0x7fb21c0738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:00.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb21a7fc700 1 -- 172.21.15.171:0/3215772213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb21c100fe0 msgr2=0x7fb21c074cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:00.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb21a7fc700 1 --2- 172.21.15.171:0/3215772213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb21c100fe0 0x7fb21c074cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:00.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb21a7fc700 1 -- 172.21.15.171:0/3215772213 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c0095f0 con 0x7fb21c1021e0 2024-05-09T00:00:00.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb21a7fc700 1 --2- 172.21.15.171:0/3215772213 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb21c1021e0 0x7fb21c073390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb21000e9a0 tx=0x7fb21000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:00.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb2209d1700 1 -- 172.21.15.171:0/3215772213 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210009790 con 0x7fb21c1021e0 2024-05-09T00:00:00.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb2219d3700 1 -- 172.21.15.171:0/3215772213 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21c1a1220 con 0x7fb21c1021e0 2024-05-09T00:00:00.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb2209d1700 1 -- 172.21.15.171:0/3215772213 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb21000cbd0 con 0x7fb21c1021e0 2024-05-09T00:00:00.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.519+0000 7fb2209d1700 1 -- 172.21.15.171:0/3215772213 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb210018680 con 0x7fb21c1021e0 2024-05-09T00:00:00.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.520+0000 7fb2219d3700 1 -- 172.21.15.171:0/3215772213 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21c1a1720 con 0x7fb21c1021e0 2024-05-09T00:00:00.517 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.520+0000 7fb2219d3700 1 -- 172.21.15.171:0/3215772213 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21c1084b0 con 0x7fb21c1021e0 2024-05-09T00:00:00.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.521+0000 7fb2209d1700 1 -- 172.21.15.171:0/3215772213 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb21000cd40 con 0x7fb21c1021e0 2024-05-09T00:00:00.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.522+0000 7fb2209d1700 1 --2- 172.21.15.171:0/3215772213 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb2040a1120 0x7fb2040a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:00.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.522+0000 7fb2209d1700 1 -- 172.21.15.171:0/3215772213 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5117+0+0 (secure 0 0 0) 0x7fb210014070 con 0x7fb21c1021e0 2024-05-09T00:00:00.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.522+0000 7fb21affd700 1 --2- 172.21.15.171:0/3215772213 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb2040a1120 0x7fb2040a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:00.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.523+0000 7fb21affd700 1 --2- 172.21.15.171:0/3215772213 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb2040a1120 0x7fb2040a35e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00b680 tx=0x7fb20c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:00.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.525+0000 7fb2209d1700 1 -- 172.21.15.171:0/3215772213 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb2100965f0 con 0x7fb21c1021e0 2024-05-09T00:00:00.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-09T00:00:00.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: osdmap e46: 8 total, 7 up, 8 in 2024-05-09T00:00:00.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:00:00.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='osd.7 [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-09T00:00:00.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-09T00:00:00.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: Detected new or changed devices on smithi150 2024-05-09T00:00:00.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:00.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:00.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:00.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:00.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:00.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi150 to 5704M 2024-05-09T00:00:00.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:00.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:00.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:00.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:00.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: overall HEALTH_OK 2024-05-09T00:00:00.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-05-09T00:00:00.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: osdmap e47: 8 total, 7 up, 8 in 2024-05-09T00:00:00.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:00 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:00:00.720 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:00.725+0000 7fb2219d3700 1 -- 172.21.15.171:0/3215772213 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb21c0613e0 con 0x7fb2040a1120 2024-05-09T00:00:00.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-09T00:00:00.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: osdmap e46: 8 total, 7 up, 8 in 2024-05-09T00:00:00.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:00:00.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='osd.7 [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-09T00:00:00.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-09T00:00:00.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: Detected new or changed devices on smithi150 2024-05-09T00:00:00.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:00.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:00.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:00.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:00.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:00.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi150 to 5704M 2024-05-09T00:00:00.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:00.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:00.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:00.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:00.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: overall HEALTH_OK 2024-05-09T00:00:00.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-05-09T00:00:00.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: osdmap e47: 8 total, 7 up, 8 in 2024-05-09T00:00:00.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:00 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:00:00.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-09T00:00:00.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: osdmap e46: 8 total, 7 up, 8 in 2024-05-09T00:00:00.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:00:00.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='osd.7 [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-09T00:00:00.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-09T00:00:00.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: Detected new or changed devices on smithi150 2024-05-09T00:00:00.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:00.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:00.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:00.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:00.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:00.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi150 to 5704M 2024-05-09T00:00:00.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:00.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:00.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:00.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:00.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: overall HEALTH_OK 2024-05-09T00:00:00.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-05-09T00:00:00.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: osdmap e47: 8 total, 7 up, 8 in 2024-05-09T00:00:00.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:00 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:00:01.066 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:00:00 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:00:00.780+0000 7f59bed02700 -1 osd.7 0 waiting for initial osdmap 2024-05-09T00:00:01.066 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:00:00 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:00:00.792+0000 7f59b6aef700 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:00:01.405 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:01 smithi171 ceph-mon[47351]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:00:01.405 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:01 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:00:01.405 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:01 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:01.405 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:01 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:01.405 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:01 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:01.405 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:01 smithi171 ceph-mon[47351]: from='osd.7 ' entity='osd.7' 2024-05-09T00:00:01.406 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:01 smithi171 ceph-mon[47351]: osd.7 [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018] boot 2024-05-09T00:00:01.406 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:01 smithi171 ceph-mon[47351]: osdmap e48: 8 total, 8 up, 8 in 2024-05-09T00:00:01.406 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:01 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:00:01.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:01 smithi150 ceph-mon[46187]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:00:01.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:01 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:00:01.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:01 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:01.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:01 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:01.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:01 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:01.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:01 smithi150 ceph-mon[46187]: from='osd.7 ' entity='osd.7' 2024-05-09T00:00:01.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:01 smithi150 ceph-mon[46187]: osd.7 [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018] boot 2024-05-09T00:00:01.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:01 smithi150 ceph-mon[46187]: osdmap e48: 8 total, 8 up, 8 in 2024-05-09T00:00:01.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:01 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:00:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:01 smithi081 ceph-mon[42474]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 212 MiB used, 626 GiB / 626 GiB avail 2024-05-09T00:00:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:01 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:00:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:01 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:01 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:01 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:01 smithi081 ceph-mon[42474]: from='osd.7 ' entity='osd.7' 2024-05-09T00:00:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:01 smithi081 ceph-mon[42474]: osd.7 [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018] boot 2024-05-09T00:00:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:01 smithi081 ceph-mon[42474]: osdmap e48: 8 total, 8 up, 8 in 2024-05-09T00:00:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:01 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:00:02.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:02 smithi081 ceph-mon[42474]: purged_snaps scrub starts 2024-05-09T00:00:02.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:02 smithi081 ceph-mon[42474]: purged_snaps scrub ok 2024-05-09T00:00:02.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:02 smithi081 ceph-mon[42474]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:02.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:02 smithi150 ceph-mon[46187]: purged_snaps scrub starts 2024-05-09T00:00:02.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:02 smithi150 ceph-mon[46187]: purged_snaps scrub ok 2024-05-09T00:00:02.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:02 smithi150 ceph-mon[46187]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:02.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:02 smithi171 ceph-mon[47351]: purged_snaps scrub starts 2024-05-09T00:00:02.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:02 smithi171 ceph-mon[47351]: purged_snaps scrub ok 2024-05-09T00:00:02.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:02 smithi171 ceph-mon[47351]: from='client.24292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:03 smithi081 ceph-mon[42474]: pgmap v136: 1 pgs: 1 remapped; 577 KiB data, 268 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:03 smithi081 ceph-mon[42474]: osdmap e49: 8 total, 8 up, 8 in 2024-05-09T00:00:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:03 smithi081 ceph-mon[42474]: from='client.? 172.21.15.171:0/1515842207' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bec428c-7cf2-4eda-8fab-d2101e275491"}]: dispatch 2024-05-09T00:00:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:03 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bec428c-7cf2-4eda-8fab-d2101e275491"}]: dispatch 2024-05-09T00:00:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:03 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bec428c-7cf2-4eda-8fab-d2101e275491"}]': finished 2024-05-09T00:00:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:03 smithi081 ceph-mon[42474]: osdmap e50: 9 total, 8 up, 9 in 2024-05-09T00:00:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:03 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:03.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:03 smithi150 ceph-mon[46187]: pgmap v136: 1 pgs: 1 remapped; 577 KiB data, 268 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:03.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:03 smithi150 ceph-mon[46187]: osdmap e49: 8 total, 8 up, 8 in 2024-05-09T00:00:03.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:03 smithi150 ceph-mon[46187]: from='client.? 172.21.15.171:0/1515842207' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bec428c-7cf2-4eda-8fab-d2101e275491"}]: dispatch 2024-05-09T00:00:03.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:03 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bec428c-7cf2-4eda-8fab-d2101e275491"}]: dispatch 2024-05-09T00:00:03.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:03 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bec428c-7cf2-4eda-8fab-d2101e275491"}]': finished 2024-05-09T00:00:03.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:03 smithi150 ceph-mon[46187]: osdmap e50: 9 total, 8 up, 9 in 2024-05-09T00:00:03.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:03 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:03.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:03 smithi171 ceph-mon[47351]: pgmap v136: 1 pgs: 1 remapped; 577 KiB data, 268 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:03.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:03 smithi171 ceph-mon[47351]: osdmap e49: 8 total, 8 up, 8 in 2024-05-09T00:00:03.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:03 smithi171 ceph-mon[47351]: from='client.? 172.21.15.171:0/1515842207' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bec428c-7cf2-4eda-8fab-d2101e275491"}]: dispatch 2024-05-09T00:00:03.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:03 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bec428c-7cf2-4eda-8fab-d2101e275491"}]: dispatch 2024-05-09T00:00:03.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:03 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bec428c-7cf2-4eda-8fab-d2101e275491"}]': finished 2024-05-09T00:00:03.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:03 smithi171 ceph-mon[47351]: osdmap e50: 9 total, 8 up, 9 in 2024-05-09T00:00:03.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:03 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:04.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:04 smithi081 ceph-mon[42474]: from='client.? 172.21.15.171:0/2135210167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:04.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:04 smithi081 ceph-mon[42474]: osdmap e51: 9 total, 8 up, 9 in 2024-05-09T00:00:04.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:04 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:04.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:04 smithi150 ceph-mon[46187]: from='client.? 172.21.15.171:0/2135210167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:04.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:04 smithi150 ceph-mon[46187]: osdmap e51: 9 total, 8 up, 9 in 2024-05-09T00:00:04.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:04 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:04.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:04 smithi171 ceph-mon[47351]: from='client.? 172.21.15.171:0/2135210167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:04.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:04 smithi171 ceph-mon[47351]: osdmap e51: 9 total, 8 up, 9 in 2024-05-09T00:00:04.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:04 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:05.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:05 smithi081 ceph-mon[42474]: pgmap v140: 1 pgs: 1 remapped; 577 KiB data, 269 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:05.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:05 smithi081 ceph-mon[42474]: osdmap e52: 9 total, 8 up, 9 in 2024-05-09T00:00:05.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:05 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:05.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:05 smithi150 ceph-mon[46187]: pgmap v140: 1 pgs: 1 remapped; 577 KiB data, 269 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:05.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:05 smithi150 ceph-mon[46187]: osdmap e52: 9 total, 8 up, 9 in 2024-05-09T00:00:05.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:05 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:05.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:05 smithi171 ceph-mon[47351]: pgmap v140: 1 pgs: 1 remapped; 577 KiB data, 269 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:05.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:05 smithi171 ceph-mon[47351]: osdmap e52: 9 total, 8 up, 9 in 2024-05-09T00:00:05.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:05 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:07.520 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:07 smithi171 ceph-mon[47351]: pgmap v142: 1 pgs: 1 remapped; 577 KiB data, 269 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:07.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:07 smithi081 ceph-mon[42474]: pgmap v142: 1 pgs: 1 remapped; 577 KiB data, 269 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:07.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:07 smithi150 ceph-mon[46187]: pgmap v142: 1 pgs: 1 remapped; 577 KiB data, 269 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:09.446 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:09 smithi171 ceph-mon[47351]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:09.446 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:09 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-09T00:00:09.446 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:09 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:09.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:09 smithi081 ceph-mon[42474]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:09.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:09 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-09T00:00:09.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:09 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:09.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:09 smithi150 ceph-mon[46187]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:09.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:09 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-09T00:00:09.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:09 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:10.534 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:10 smithi171 ceph-mon[47351]: Deploying daemon osd.8 on smithi171 2024-05-09T00:00:10.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:10 smithi081 ceph-mon[42474]: Deploying daemon osd.8 on smithi171 2024-05-09T00:00:10.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:10 smithi150 ceph-mon[46187]: Deploying daemon osd.8 on smithi171 2024-05-09T00:00:11.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:11 smithi171 ceph-mon[47351]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:11.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:11 smithi081 ceph-mon[42474]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:11.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:11 smithi150 ceph-mon[46187]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:13.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:13 smithi171 ceph-mon[47351]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:13.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:13 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:13.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:13 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:13.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:13 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:13.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:13 smithi150 ceph-mon[46187]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:13.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:13 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:13.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:13 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:13.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:13 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:13.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:13 smithi081 ceph-mon[42474]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:13.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:13 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:13.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:13 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:13.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:13 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:14.977 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 8 on host 'smithi171' 2024-05-09T00:00:14.977 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:14.982+0000 7fb2209d1700 1 -- 172.21.15.171:0/3215772213 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb21c0613e0 con 0x7fb2040a1120 2024-05-09T00:00:14.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:14.984+0000 7fb2219d3700 1 -- 172.21.15.171:0/3215772213 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb2040a1120 msgr2=0x7fb2040a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:14.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:14.984+0000 7fb2219d3700 1 --2- 172.21.15.171:0/3215772213 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb2040a1120 0x7fb2040a35e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb20c00b680 tx=0x7fb20c00b260 comp rx=0 tx=0).stop 2024-05-09T00:00:14.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:14.984+0000 7fb2219d3700 1 -- 172.21.15.171:0/3215772213 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb21c1021e0 msgr2=0x7fb21c073390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:14.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:14.984+0000 7fb2219d3700 1 --2- 172.21.15.171:0/3215772213 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb21c1021e0 0x7fb21c073390 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb21000e9a0 tx=0x7fb21000ecb0 comp rx=0 tx=0).stop 2024-05-09T00:00:14.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:14.984+0000 7fb2219d3700 1 -- 172.21.15.171:0/3215772213 shutdown_connections 2024-05-09T00:00:14.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:14.984+0000 7fb2219d3700 1 --2- 172.21.15.171:0/3215772213 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb2040a1120 0x7fb2040a35e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:14.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:14.984+0000 7fb2219d3700 1 --2- 172.21.15.171:0/3215772213 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb21c102b80 0x7fb21c0738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:14.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:14.984+0000 7fb2219d3700 1 --2- 172.21.15.171:0/3215772213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb21c100fe0 0x7fb21c074cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:14.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:14.984+0000 7fb2219d3700 1 --2- 172.21.15.171:0/3215772213 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb21c1021e0 0x7fb21c073390 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:14.979 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:14.984+0000 7fb2219d3700 1 -- 172.21.15.171:0/3215772213 >> 172.21.15.171:0/3215772213 conn(0x7fb21c0fc580 msgr2=0x7fb21c1055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:14.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:14.984+0000 7fb2219d3700 1 -- 172.21.15.171:0/3215772213 shutdown_connections 2024-05-09T00:00:14.980 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:14.984+0000 7fb2219d3700 1 -- 172.21.15.171:0/3215772213 wait complete. 2024-05-09T00:00:15.220 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:15 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.220 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:15 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.220 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:15 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:15.220 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:15 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:15.220 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:15 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.220 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:15 smithi171 ceph-mon[47351]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:15.221 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:15 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.221 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:15 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.221 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:15 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:15.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:15 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:15 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:15 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:15.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:15 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:15.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:15 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:15 smithi081 ceph-mon[42474]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:15.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:15 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:15 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:15 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:15.424 DEBUG:teuthology.orchestra.run.smithi171:osd.8> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.8.service 2024-05-09T00:00:15.426 INFO:tasks.cephadm:Deploying osd.9 on smithi081 with /dev/vg_nvme/lv_1... 2024-05-09T00:00:15.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-09T00:00:15.458 INFO:journalctl@ceph.osd.8.smithi171.stdout:-- Logs begin at Wed 2024-05-08 23:40:11 UTC. -- 2024-05-09T00:00:15.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:15 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:15 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:15 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:15.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:15 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:15.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:15 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:15 smithi150 ceph-mon[46187]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:15.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:15 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:15 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:15.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:15 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:15.672 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:00:16.553 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:00:16 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:00:16.453+0000 7f9bfc6337c0 -1 osd.8 0 log_to_monitors true 2024-05-09T00:00:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-09T00:00:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-09T00:00:16.991 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10+0 records in 2024-05-09T00:00:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:10+0 records out 2024-05-09T00:00:16.991 INFO:teuthology.orchestra.run.smithi081.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114814 s, 913 MB/s 2024-05-09T00:00:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:--> Zapping successful for: 2024-05-09T00:00:17.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi081:vg_nvme/lv_1 2024-05-09T00:00:17.472 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:17 smithi171 ceph-mon[47351]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:17.472 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:17 smithi171 ceph-mon[47351]: from='osd.8 [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T00:00:17.473 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:17 smithi171 ceph-mon[47351]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T00:00:17.609 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:00:17.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:17 smithi081 ceph-mon[42474]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:17.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:17 smithi081 ceph-mon[42474]: from='osd.8 [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T00:00:17.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:17 smithi081 ceph-mon[42474]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T00:00:17.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:17 smithi150 ceph-mon[46187]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:17.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:17 smithi150 ceph-mon[46187]: from='osd.8 [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T00:00:17.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:17 smithi150 ceph-mon[46187]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-09T00:00:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.579+0000 7f55c7da2700 1 -- 172.21.15.81:0/2559723064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0101000 msgr2=0x7f55c0101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.579+0000 7f55c7da2700 1 --2- 172.21.15.81:0/2559723064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0101000 0x7f55c0101420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f55b00099c0 tx=0x7f55b0009cd0 comp rx=0 tx=0).stop 2024-05-09T00:00:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.579+0000 7f55c7da2700 1 -- 172.21.15.81:0/2559723064 shutdown_connections 2024-05-09T00:00:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.579+0000 7f55c7da2700 1 --2- 172.21.15.81:0/2559723064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55c0102ba0 0x7f55c0109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.579+0000 7f55c7da2700 1 --2- 172.21.15.81:0/2559723064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0101000 0x7f55c0101420 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.579+0000 7f55c7da2700 1 --2- 172.21.15.81:0/2559723064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55c0102200 0x7f55c0102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.579+0000 7f55c7da2700 1 -- 172.21.15.81:0/2559723064 >> 172.21.15.81:0/2559723064 conn(0x7f55c00fc5a0 msgr2=0x7f55c00fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.579+0000 7f55c7da2700 1 -- 172.21.15.81:0/2559723064 shutdown_connections 2024-05-09T00:00:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.579+0000 7f55c7da2700 1 -- 172.21.15.81:0/2559723064 wait complete. 2024-05-09T00:00:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c7da2700 1 Processor -- start 2024-05-09T00:00:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c7da2700 1 -- start start 2024-05-09T00:00:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c7da2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55c0101000 0x7f55c01970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c7da2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0102200 0x7f55c01975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c7da2700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55c0102ba0 0x7f55c019e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c7da2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c019eb40 con 0x7f55c0102200 2024-05-09T00:00:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c7da2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c019ec80 con 0x7f55c0101000 2024-05-09T00:00:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c7da2700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c019ee10 con 0x7f55c0102ba0 2024-05-09T00:00:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c533d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0102200 0x7f55c01975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c533d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0102200 0x7f55c01975e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56324/0 (socket says 172.21.15.81:56324) 2024-05-09T00:00:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c533d700 1 -- 172.21.15.81:0/2035222739 learned_addr learned my addr 172.21.15.81:0/2035222739 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:00:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c633f700 1 --2- 172.21.15.81:0/2035222739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55c0102ba0 0x7f55c019e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c5b3e700 1 --2- 172.21.15.81:0/2035222739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55c0101000 0x7f55c01970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c533d700 1 -- 172.21.15.81:0/2035222739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55c0102ba0 msgr2=0x7f55c019e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c533d700 1 --2- 172.21.15.81:0/2035222739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55c0102ba0 0x7f55c019e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c533d700 1 -- 172.21.15.81:0/2035222739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55c0101000 msgr2=0x7f55c01970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c533d700 1 --2- 172.21.15.81:0/2035222739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55c0101000 0x7f55c01970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.580+0000 7f55c533d700 1 -- 172.21.15.81:0/2035222739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b00095f0 con 0x7f55c0102200 2024-05-09T00:00:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.581+0000 7f55c533d700 1 --2- 172.21.15.81:0/2035222739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0102200 0x7f55c01975e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00b560 tx=0x7f55bc00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.581+0000 7f55b6ffd700 1 -- 172.21.15.81:0/2035222739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc011830 con 0x7f55c0102200 2024-05-09T00:00:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.581+0000 7f55b6ffd700 1 -- 172.21.15.81:0/2035222739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55bc011e50 con 0x7f55c0102200 2024-05-09T00:00:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.581+0000 7f55c7da2700 1 -- 172.21.15.81:0/2035222739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c019f0f0 con 0x7f55c0102200 2024-05-09T00:00:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.581+0000 7f55b6ffd700 1 -- 172.21.15.81:0/2035222739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc010e50 con 0x7f55c0102200 2024-05-09T00:00:18.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.581+0000 7f55c7da2700 1 -- 172.21.15.81:0/2035222739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c019f5f0 con 0x7f55c0102200 2024-05-09T00:00:18.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.582+0000 7f55c7da2700 1 -- 172.21.15.81:0/2035222739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c01084d0 con 0x7f55c0102200 2024-05-09T00:00:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.583+0000 7f55b6ffd700 1 -- 172.21.15.81:0/2035222739 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f55bc0104f0 con 0x7f55c0102200 2024-05-09T00:00:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.584+0000 7f55b6ffd700 1 --2- 172.21.15.81:0/2035222739 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f55ac0a1120 0x7f55ac0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.584+0000 7f55c5b3e700 1 --2- 172.21.15.81:0/2035222739 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f55ac0a1120 0x7f55ac0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.584+0000 7f55b6ffd700 1 -- 172.21.15.81:0/2035222739 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f55bc0cbd40 con 0x7f55c0102200 2024-05-09T00:00:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.584+0000 7f55c5b3e700 1 --2- 172.21.15.81:0/2035222739 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f55ac0a1120 0x7f55ac0a35e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009f50 tx=0x7f55b0005bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.587+0000 7f55b6ffd700 1 -- 172.21.15.81:0/2035222739 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f55bc095fa0 con 0x7f55c0102200 2024-05-09T00:00:18.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-09T00:00:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: osdmap e53: 9 total, 8 up, 9 in 2024-05-09T00:00:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: from='osd.8 [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-09T00:00:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-09T00:00:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: Detected new or changed devices on smithi171 2024-05-09T00:00:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi171 to 5704M 2024-05-09T00:00:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:18.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:18.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:18.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-09T00:00:18.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: osdmap e53: 9 total, 8 up, 9 in 2024-05-09T00:00:18.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:18.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: from='osd.8 [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-09T00:00:18.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-09T00:00:18.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: Detected new or changed devices on smithi171 2024-05-09T00:00:18.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:18.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:18.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:18.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:18.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:18.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi171 to 5704M 2024-05-09T00:00:18.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:18.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:18.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:18.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:18.773 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-09T00:00:18.773 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: osdmap e53: 9 total, 8 up, 9 in 2024-05-09T00:00:18.773 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:18.773 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: from='osd.8 [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-09T00:00:18.773 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-09T00:00:18.773 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: Detected new or changed devices on smithi171 2024-05-09T00:00:18.773 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:18.773 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:18.773 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:18.773 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:18.773 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:18.773 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi171 to 5704M 2024-05-09T00:00:18.773 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:18.774 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:18.774 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:18.774 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:18.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:18.790+0000 7f55c7da2700 1 -- 172.21.15.81:0/2035222739 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f55c00613e0 con 0x7f55ac0a1120 2024-05-09T00:00:19.052 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:00:18 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:00:18.777+0000 7f9bf1c97700 -1 osd.8 0 waiting for initial osdmap 2024-05-09T00:00:19.052 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:00:18 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:00:18.789+0000 7f9be9a84700 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:00:19.518 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:19 smithi081 ceph-mon[42474]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:19.518 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:19 smithi081 ceph-mon[42474]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-09T00:00:19.519 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:19 smithi081 ceph-mon[42474]: osdmap e54: 9 total, 8 up, 9 in 2024-05-09T00:00:19.519 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:19 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:19.519 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:19 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:19.519 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:19 smithi081 ceph-mon[42474]: from='osd.8 ' entity='osd.8' 2024-05-09T00:00:19.519 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:19 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:19.519 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:19 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:19.519 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:19 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:19.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:19 smithi150 ceph-mon[46187]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:19.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:19 smithi150 ceph-mon[46187]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-09T00:00:19.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:19 smithi150 ceph-mon[46187]: osdmap e54: 9 total, 8 up, 9 in 2024-05-09T00:00:19.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:19 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:19.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:19 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:19.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:19 smithi150 ceph-mon[46187]: from='osd.8 ' entity='osd.8' 2024-05-09T00:00:19.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:19 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:19.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:19 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:19.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:19 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:19.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:19 smithi171 ceph-mon[47351]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:19.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:19 smithi171 ceph-mon[47351]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-09T00:00:19.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:19 smithi171 ceph-mon[47351]: osdmap e54: 9 total, 8 up, 9 in 2024-05-09T00:00:19.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:19 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:19.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:19 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:19.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:19 smithi171 ceph-mon[47351]: from='osd.8 ' entity='osd.8' 2024-05-09T00:00:19.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:19 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:19.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:19 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:19.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:19 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:20.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:20 smithi081 ceph-mon[42474]: purged_snaps scrub starts 2024-05-09T00:00:20.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:20 smithi081 ceph-mon[42474]: purged_snaps scrub ok 2024-05-09T00:00:20.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:20 smithi081 ceph-mon[42474]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:20.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:20 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:20.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:20 smithi081 ceph-mon[42474]: osd.8 [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617] boot 2024-05-09T00:00:20.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:20 smithi081 ceph-mon[42474]: osdmap e55: 9 total, 9 up, 9 in 2024-05-09T00:00:20.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:20 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:20.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:20 smithi150 ceph-mon[46187]: purged_snaps scrub starts 2024-05-09T00:00:20.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:20 smithi150 ceph-mon[46187]: purged_snaps scrub ok 2024-05-09T00:00:20.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:20 smithi150 ceph-mon[46187]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:20.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:20 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:20.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:20 smithi150 ceph-mon[46187]: osd.8 [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617] boot 2024-05-09T00:00:20.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:20 smithi150 ceph-mon[46187]: osdmap e55: 9 total, 9 up, 9 in 2024-05-09T00:00:20.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:20 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:20.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:20 smithi171 ceph-mon[47351]: purged_snaps scrub starts 2024-05-09T00:00:20.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:20 smithi171 ceph-mon[47351]: purged_snaps scrub ok 2024-05-09T00:00:20.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:20 smithi171 ceph-mon[47351]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi081:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:20.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:20 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:20.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:20 smithi171 ceph-mon[47351]: osd.8 [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617] boot 2024-05-09T00:00:20.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:20 smithi171 ceph-mon[47351]: osdmap e55: 9 total, 9 up, 9 in 2024-05-09T00:00:20.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:20 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:00:21.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:21 smithi081 ceph-mon[42474]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:21.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:21 smithi081 ceph-mon[42474]: osdmap e56: 9 total, 9 up, 9 in 2024-05-09T00:00:21.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:21 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3407942712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5283c55-1261-430c-a956-40670f7470e4"}]: dispatch 2024-05-09T00:00:21.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:21 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3407942712' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5283c55-1261-430c-a956-40670f7470e4"}]': finished 2024-05-09T00:00:21.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:21 smithi081 ceph-mon[42474]: osdmap e57: 10 total, 9 up, 10 in 2024-05-09T00:00:21.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:21 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:21.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:21 smithi150 ceph-mon[46187]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:21.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:21 smithi150 ceph-mon[46187]: osdmap e56: 9 total, 9 up, 9 in 2024-05-09T00:00:21.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:21 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3407942712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5283c55-1261-430c-a956-40670f7470e4"}]: dispatch 2024-05-09T00:00:21.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:21 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3407942712' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5283c55-1261-430c-a956-40670f7470e4"}]': finished 2024-05-09T00:00:21.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:21 smithi150 ceph-mon[46187]: osdmap e57: 10 total, 9 up, 10 in 2024-05-09T00:00:21.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:21 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:21.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:21 smithi171 ceph-mon[47351]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-05-09T00:00:21.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:21 smithi171 ceph-mon[47351]: osdmap e56: 9 total, 9 up, 9 in 2024-05-09T00:00:21.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:21 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3407942712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5283c55-1261-430c-a956-40670f7470e4"}]: dispatch 2024-05-09T00:00:21.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:21 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3407942712' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5283c55-1261-430c-a956-40670f7470e4"}]': finished 2024-05-09T00:00:21.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:21 smithi171 ceph-mon[47351]: osdmap e57: 10 total, 9 up, 10 in 2024-05-09T00:00:21.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:22.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:22 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1655578797' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:22.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:22 smithi081 ceph-mon[42474]: osdmap e58: 10 total, 9 up, 10 in 2024-05-09T00:00:22.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:22 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:22.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:22 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1655578797' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:22.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:22 smithi150 ceph-mon[46187]: osdmap e58: 10 total, 9 up, 10 in 2024-05-09T00:00:22.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:22 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:22.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:22 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1655578797' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:22.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:22 smithi171 ceph-mon[47351]: osdmap e58: 10 total, 9 up, 10 in 2024-05-09T00:00:22.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:22 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:23.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:23 smithi081 ceph-mon[42474]: pgmap v156: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-05-09T00:00:23.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:23 smithi081 ceph-mon[42474]: osdmap e59: 10 total, 9 up, 10 in 2024-05-09T00:00:23.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:23 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:23.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:23 smithi150 ceph-mon[46187]: pgmap v156: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-05-09T00:00:23.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:23 smithi150 ceph-mon[46187]: osdmap e59: 10 total, 9 up, 10 in 2024-05-09T00:00:23.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:23 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:23.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:23 smithi171 ceph-mon[47351]: pgmap v156: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail; 146 KiB/s, 0 objects/s recovering 2024-05-09T00:00:23.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:23 smithi171 ceph-mon[47351]: osdmap e59: 10 total, 9 up, 10 in 2024-05-09T00:00:23.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:23 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:25.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:25 smithi081 ceph-mon[42474]: pgmap v158: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-09T00:00:25.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:25 smithi150 ceph-mon[46187]: pgmap v158: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-09T00:00:25.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:25 smithi171 ceph-mon[47351]: pgmap v158: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 274 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-09T00:00:27.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:27 smithi081 ceph-mon[42474]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-05-09T00:00:27.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:27 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-09T00:00:27.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:27 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:27.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:27 smithi150 ceph-mon[46187]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-05-09T00:00:27.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:27 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-09T00:00:27.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:27 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:27.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:27 smithi171 ceph-mon[47351]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-05-09T00:00:27.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:27 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-09T00:00:27.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:27 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:28.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:28 smithi081 ceph-mon[42474]: Deploying daemon osd.9 on smithi081 2024-05-09T00:00:28.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:28 smithi150 ceph-mon[46187]: Deploying daemon osd.9 on smithi081 2024-05-09T00:00:28.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:28 smithi171 ceph-mon[47351]: Deploying daemon osd.9 on smithi081 2024-05-09T00:00:29.602 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:29 smithi081 ceph-mon[42474]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-05-09T00:00:29.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:29 smithi150 ceph-mon[46187]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-05-09T00:00:29.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:29 smithi171 ceph-mon[47351]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-05-09T00:00:31.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:31 smithi150 ceph-mon[46187]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:00:31.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:31.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:31.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:31.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:31 smithi171 ceph-mon[47351]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:00:31.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:31.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:31.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:31 smithi081 ceph-mon[42474]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:00:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:32.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:32.587+0000 7f55b6ffd700 1 -- 172.21.15.81:0/2035222739 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f55c00613e0 con 0x7f55ac0a1120 2024-05-09T00:00:32.582 INFO:teuthology.orchestra.run.smithi081.stdout:Created osd(s) 9 on host 'smithi081' 2024-05-09T00:00:32.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:32.589+0000 7f55c7da2700 1 -- 172.21.15.81:0/2035222739 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f55ac0a1120 msgr2=0x7f55ac0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:32.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:32.589+0000 7f55c7da2700 1 --2- 172.21.15.81:0/2035222739 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f55ac0a1120 0x7f55ac0a35e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009f50 tx=0x7f55b0005bc0 comp rx=0 tx=0).stop 2024-05-09T00:00:32.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:32.589+0000 7f55c7da2700 1 -- 172.21.15.81:0/2035222739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0102200 msgr2=0x7f55c01975e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:32.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:32.589+0000 7f55c7da2700 1 --2- 172.21.15.81:0/2035222739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0102200 0x7f55c01975e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00b560 tx=0x7f55bc00b870 comp rx=0 tx=0).stop 2024-05-09T00:00:32.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:32.589+0000 7f55c7da2700 1 -- 172.21.15.81:0/2035222739 shutdown_connections 2024-05-09T00:00:32.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:32.589+0000 7f55c7da2700 1 --2- 172.21.15.81:0/2035222739 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f55ac0a1120 0x7f55ac0a35e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:32.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:32.589+0000 7f55c7da2700 1 --2- 172.21.15.81:0/2035222739 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55c0101000 0x7f55c01970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:32.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:32.589+0000 7f55c7da2700 1 --2- 172.21.15.81:0/2035222739 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f55c0102ba0 0x7f55c019e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:32.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:32.589+0000 7f55c7da2700 1 --2- 172.21.15.81:0/2035222739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55c0102200 0x7f55c01975e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:32.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:32.589+0000 7f55c7da2700 1 -- 172.21.15.81:0/2035222739 >> 172.21.15.81:0/2035222739 conn(0x7f55c00fc5a0 msgr2=0x7f55c0105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:32.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:32.589+0000 7f55c7da2700 1 -- 172.21.15.81:0/2035222739 shutdown_connections 2024-05-09T00:00:32.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:00:32.589+0000 7f55c7da2700 1 -- 172.21.15.81:0/2035222739 wait complete. 2024-05-09T00:00:32.973 DEBUG:teuthology.orchestra.run.smithi081:osd.9> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.9.service 2024-05-09T00:00:32.977 INFO:tasks.cephadm:Deploying osd.10 on smithi150 with /dev/vg_nvme/lv_1... 2024-05-09T00:00:32.977 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-09T00:00:33.013 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:32 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.013 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:32 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.013 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:32 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:33.013 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:32 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:33.013 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:32 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.013 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:32 smithi081 ceph-mon[42474]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:00:33.013 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:32 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.013 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:32 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.014 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:32 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:33.019 INFO:journalctl@ceph.osd.9.smithi081.stdout:-- Logs begin at Wed 2024-05-08 23:39:48 UTC. -- 2024-05-09T00:00:33.221 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T00:00:33.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:32 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:32 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:32 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:33.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:32 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:33.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:32 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:32 smithi150 ceph-mon[46187]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:00:33.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:32 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:32 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:32 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:33.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:32 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:32 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:32 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:33.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:32 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:33.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:32 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:32 smithi171 ceph-mon[47351]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:00:33.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:32 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:32 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:33.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:32 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:34.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:34 smithi081 ceph-mon[42474]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-09T00:00:34.371 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:00:34 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:00:34.260+0000 7f4e406b47c0 -1 osd.9 0 log_to_monitors true 2024-05-09T00:00:34.536 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-09T00:00:34.536 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-09T00:00:34.536 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10+0 records in 2024-05-09T00:00:34.536 INFO:teuthology.orchestra.run.smithi150.stderr:10+0 records out 2024-05-09T00:00:34.536 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113173 s, 927 MB/s 2024-05-09T00:00:34.536 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping successful for: 2024-05-09T00:00:34.571 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:34 smithi150 ceph-mon[46187]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-09T00:00:34.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:34 smithi171 ceph-mon[47351]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-09T00:00:34.884 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi150:vg_nvme/lv_1 2024-05-09T00:00:35.113 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T00:00:35.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:00:35.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-09T00:00:35.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: osdmap e60: 10 total, 9 up, 10 in 2024-05-09T00:00:35.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:35.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-09T00:00:35.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:35.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:35.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:35.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:35.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:35.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:35.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:35.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:35.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:35.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:00:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-09T00:00:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: osdmap e60: 10 total, 9 up, 10 in 2024-05-09T00:00:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-09T00:00:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:35.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:35.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:35.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:35.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:35.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:00:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-09T00:00:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: osdmap e60: 10 total, 9 up, 10 in 2024-05-09T00:00:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]: dispatch 2024-05-09T00:00:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:35.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:35.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:35.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:36.120 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:00:35 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:00:35.745+0000 7f4e35d18700 -1 osd.9 0 waiting for initial osdmap 2024-05-09T00:00:36.120 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:00:35 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:00:35.757+0000 7f4e2db05700 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:00:36.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.346+0000 7f2227483700 1 -- 172.21.15.150:0/770604910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2220104460 msgr2=0x7f2220106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:36.348 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.346+0000 7f2227483700 1 --2- 172.21.15.150:0/770604910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2220104460 0x7f2220106850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f221c009990 tx=0x7f221c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:00:36.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.346+0000 7f2227483700 1 -- 172.21.15.150:0/770604910 shutdown_connections 2024-05-09T00:00:36.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.346+0000 7f2227483700 1 --2- 172.21.15.150:0/770604910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2220106d90 0x7f2220109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:36.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.346+0000 7f2227483700 1 --2- 172.21.15.150:0/770604910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2220101b30 0x7f2220103f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:36.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.346+0000 7f2227483700 1 --2- 172.21.15.150:0/770604910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2220104460 0x7f2220106850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:36.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.346+0000 7f2227483700 1 -- 172.21.15.150:0/770604910 >> 172.21.15.150:0/770604910 conn(0x7f22200fb4c0 msgr2=0x7f22200fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:36.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.347+0000 7f2227483700 1 -- 172.21.15.150:0/770604910 shutdown_connections 2024-05-09T00:00:36.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.347+0000 7f2227483700 1 -- 172.21.15.150:0/770604910 wait complete. 2024-05-09T00:00:36.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.347+0000 7f2227483700 1 Processor -- start 2024-05-09T00:00:36.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.347+0000 7f2227483700 1 -- start start 2024-05-09T00:00:36.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.347+0000 7f2227483700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2220101b30 0x7f2220196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:36.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.347+0000 7f2227483700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2220104460 0x7f2220197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:36.349 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.347+0000 7f2227483700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2220106d90 0x7f222019e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:36.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.347+0000 7f2227483700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222019ea50 con 0x7f2220101b30 2024-05-09T00:00:36.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.347+0000 7f2227483700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222019eb90 con 0x7f2220106d90 2024-05-09T00:00:36.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.347+0000 7f2227483700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222019ed20 con 0x7f2220104460 2024-05-09T00:00:36.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.347+0000 7f2225a20700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2220106d90 0x7f222019e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:36.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.347+0000 7f222521f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2220101b30 0x7f2220196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:36.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.347+0000 7f2225a20700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2220106d90 0x7f222019e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.150:51536/0 (socket says 172.21.15.150:51536) 2024-05-09T00:00:36.350 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.347+0000 7f2225a20700 1 -- 172.21.15.150:0/1657841601 learned_addr learned my addr 172.21.15.150:0/1657841601 (peer_addr_for_me v2:172.21.15.150:0/0) 2024-05-09T00:00:36.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.348+0000 7f2224a1e700 1 --2- 172.21.15.150:0/1657841601 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2220104460 0x7f2220197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:36.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.348+0000 7f222521f700 1 -- 172.21.15.150:0/1657841601 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2220104460 msgr2=0x7f2220197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:36.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.348+0000 7f222521f700 1 --2- 172.21.15.150:0/1657841601 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2220104460 0x7f2220197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:36.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.348+0000 7f222521f700 1 -- 172.21.15.150:0/1657841601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2220106d90 msgr2=0x7f222019e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:36.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.348+0000 7f222521f700 1 --2- 172.21.15.150:0/1657841601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2220106d90 0x7f222019e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:36.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.348+0000 7f222521f700 1 -- 172.21.15.150:0/1657841601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c0095f0 con 0x7f2220101b30 2024-05-09T00:00:36.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.348+0000 7f2225a20700 1 --2- 172.21.15.150:0/1657841601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2220106d90 0x7f222019e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:00:36.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.348+0000 7f222521f700 1 --2- 172.21.15.150:0/1657841601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2220101b30 0x7f2220196f10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f221000d980 tx=0x7f221000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:36.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.348+0000 7f22167fc700 1 -- 172.21.15.150:0/1657841601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000f890 con 0x7f2220101b30 2024-05-09T00:00:36.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.348+0000 7f2227483700 1 -- 172.21.15.150:0/1657841601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222019efa0 con 0x7f2220101b30 2024-05-09T00:00:36.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.348+0000 7f22167fc700 1 -- 172.21.15.150:0/1657841601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2210010460 con 0x7f2220101b30 2024-05-09T00:00:36.351 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.348+0000 7f22167fc700 1 -- 172.21.15.150:0/1657841601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000e610 con 0x7f2220101b30 2024-05-09T00:00:36.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.348+0000 7f2227483700 1 -- 172.21.15.150:0/1657841601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222019f410 con 0x7f2220101b30 2024-05-09T00:00:36.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.349+0000 7f2227483700 1 -- 172.21.15.150:0/1657841601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22200fd040 con 0x7f2220101b30 2024-05-09T00:00:36.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.350+0000 7f22167fc700 1 -- 172.21.15.150:0/1657841601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2210010840 con 0x7f2220101b30 2024-05-09T00:00:36.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.351+0000 7f22167fc700 1 --2- 172.21.15.150:0/1657841601 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f220c0a1120 0x7f220c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:36.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.351+0000 7f22167fc700 1 -- 172.21.15.150:0/1657841601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5981+0+0 (secure 0 0 0) 0x7f22100cb9d0 con 0x7f2220101b30 2024-05-09T00:00:36.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.351+0000 7f2224a1e700 1 --2- 172.21.15.150:0/1657841601 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f220c0a1120 0x7f220c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:36.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.351+0000 7f2224a1e700 1 --2- 172.21.15.150:0/1657841601 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f220c0a1120 0x7f220c0a35e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f221c00b5c0 tx=0x7f221c003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:36.352 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.354+0000 7f22167fc700 1 -- 172.21.15.150:0/1657841601 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2210095a60 con 0x7f2220101b30 2024-05-09T00:00:36.548 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:36.553+0000 7f2227483700 1 -- 172.21.15.150:0/1657841601 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f222002ceb0 con 0x7f220c0a1120 2024-05-09T00:00:36.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:36 smithi081 ceph-mon[42474]: Detected new or changed devices on smithi081 2024-05-09T00:00:36.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:36 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi081 to 4278M 2024-05-09T00:00:36.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:36 smithi081 ceph-mon[42474]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-09T00:00:36.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:36 smithi081 ceph-mon[42474]: osdmap e61: 10 total, 9 up, 10 in 2024-05-09T00:00:36.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:36 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:36.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:36 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:36.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:36 smithi081 ceph-mon[42474]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' 2024-05-09T00:00:36.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:36 smithi150 ceph-mon[46187]: Detected new or changed devices on smithi081 2024-05-09T00:00:36.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:36 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi081 to 4278M 2024-05-09T00:00:36.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:36 smithi150 ceph-mon[46187]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-09T00:00:36.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:36 smithi150 ceph-mon[46187]: osdmap e61: 10 total, 9 up, 10 in 2024-05-09T00:00:36.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:36 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:36.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:36 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:36.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:36 smithi150 ceph-mon[46187]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' 2024-05-09T00:00:36.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:36 smithi171 ceph-mon[47351]: Detected new or changed devices on smithi081 2024-05-09T00:00:36.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:36 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi081 to 4278M 2024-05-09T00:00:36.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:36 smithi171 ceph-mon[47351]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi081", "root=default"]}]': finished 2024-05-09T00:00:36.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:36 smithi171 ceph-mon[47351]: osdmap e61: 10 total, 9 up, 10 in 2024-05-09T00:00:36.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:36 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:36.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:36 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:36.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:36 smithi171 ceph-mon[47351]: from='osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324]' entity='osd.9' 2024-05-09T00:00:37.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:37 smithi150 ceph-mon[46187]: purged_snaps scrub starts 2024-05-09T00:00:37.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:37 smithi150 ceph-mon[46187]: purged_snaps scrub ok 2024-05-09T00:00:37.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:37 smithi150 ceph-mon[46187]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:00:37.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:37.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:37.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:37.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:37.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:37 smithi150 ceph-mon[46187]: osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324] boot 2024-05-09T00:00:37.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:37 smithi150 ceph-mon[46187]: osdmap e62: 10 total, 10 up, 10 in 2024-05-09T00:00:37.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:37.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:37 smithi081 ceph-mon[42474]: purged_snaps scrub starts 2024-05-09T00:00:37.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:37 smithi081 ceph-mon[42474]: purged_snaps scrub ok 2024-05-09T00:00:37.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:37 smithi081 ceph-mon[42474]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:00:37.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:37.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:37.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:37.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:37.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:37 smithi081 ceph-mon[42474]: osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324] boot 2024-05-09T00:00:37.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:37 smithi081 ceph-mon[42474]: osdmap e62: 10 total, 10 up, 10 in 2024-05-09T00:00:37.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:37.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:37 smithi171 ceph-mon[47351]: purged_snaps scrub starts 2024-05-09T00:00:37.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:37 smithi171 ceph-mon[47351]: purged_snaps scrub ok 2024-05-09T00:00:37.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:37 smithi171 ceph-mon[47351]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-05-09T00:00:37.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:37.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:37.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:37.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:37.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:37 smithi171 ceph-mon[47351]: osd.9 [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324] boot 2024-05-09T00:00:37.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:37 smithi171 ceph-mon[47351]: osdmap e62: 10 total, 10 up, 10 in 2024-05-09T00:00:37.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:00:38.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:38 smithi081 ceph-mon[42474]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:38.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:38 smithi081 ceph-mon[42474]: osdmap e63: 10 total, 10 up, 10 in 2024-05-09T00:00:38.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:38 smithi150 ceph-mon[46187]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:38.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:38 smithi150 ceph-mon[46187]: osdmap e63: 10 total, 10 up, 10 in 2024-05-09T00:00:38.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:38 smithi171 ceph-mon[47351]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:38.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:38 smithi171 ceph-mon[47351]: osdmap e63: 10 total, 10 up, 10 in 2024-05-09T00:00:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:39 smithi081 ceph-mon[42474]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:39 smithi081 ceph-mon[42474]: from='client.? 172.21.15.150:0/214658489' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae235e47-d35f-4171-bf0d-a983f53e99b2"}]: dispatch 2024-05-09T00:00:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:39 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae235e47-d35f-4171-bf0d-a983f53e99b2"}]: dispatch 2024-05-09T00:00:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:39 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae235e47-d35f-4171-bf0d-a983f53e99b2"}]': finished 2024-05-09T00:00:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:39 smithi081 ceph-mon[42474]: osdmap e64: 11 total, 10 up, 11 in 2024-05-09T00:00:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:39 smithi081 ceph-mon[42474]: from='client.? 172.21.15.150:0/2433227937' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:39.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:39 smithi150 ceph-mon[46187]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:39.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:39 smithi150 ceph-mon[46187]: from='client.? 172.21.15.150:0/214658489' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae235e47-d35f-4171-bf0d-a983f53e99b2"}]: dispatch 2024-05-09T00:00:39.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:39 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae235e47-d35f-4171-bf0d-a983f53e99b2"}]: dispatch 2024-05-09T00:00:39.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:39 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae235e47-d35f-4171-bf0d-a983f53e99b2"}]': finished 2024-05-09T00:00:39.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:39 smithi150 ceph-mon[46187]: osdmap e64: 11 total, 10 up, 11 in 2024-05-09T00:00:39.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:39.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:39 smithi150 ceph-mon[46187]: from='client.? 172.21.15.150:0/2433227937' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:39.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:39 smithi171 ceph-mon[47351]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:39.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:39 smithi171 ceph-mon[47351]: from='client.? 172.21.15.150:0/214658489' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae235e47-d35f-4171-bf0d-a983f53e99b2"}]: dispatch 2024-05-09T00:00:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:39 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ae235e47-d35f-4171-bf0d-a983f53e99b2"}]: dispatch 2024-05-09T00:00:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:39 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ae235e47-d35f-4171-bf0d-a983f53e99b2"}]': finished 2024-05-09T00:00:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:39 smithi171 ceph-mon[47351]: osdmap e64: 11 total, 10 up, 11 in 2024-05-09T00:00:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:39.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:39 smithi171 ceph-mon[47351]: from='client.? 172.21.15.150:0/2433227937' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:41.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:41 smithi081 ceph-mon[42474]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:41.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:41 smithi150 ceph-mon[46187]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:41.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:41 smithi171 ceph-mon[47351]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:43.503 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:43 smithi150 ceph-mon[46187]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:43.622 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:43 smithi081 ceph-mon[42474]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:43.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:43 smithi171 ceph-mon[47351]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:44.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:44 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-09T00:00:44.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:44 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:44.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:44 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-09T00:00:44.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:44 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:44.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:44 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-09T00:00:44.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:44 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:45 smithi081 ceph-mon[42474]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:45.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:45 smithi081 ceph-mon[42474]: Deploying daemon osd.10 on smithi150 2024-05-09T00:00:45.728 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:45 smithi150 ceph-mon[46187]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:45.728 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:45 smithi150 ceph-mon[46187]: Deploying daemon osd.10 on smithi150 2024-05-09T00:00:45.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:45 smithi171 ceph-mon[47351]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:45.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:45 smithi171 ceph-mon[47351]: Deploying daemon osd.10 on smithi150 2024-05-09T00:00:47.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:47 smithi150 ceph-mon[46187]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:47.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:47 smithi081 ceph-mon[42474]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:47.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:47 smithi171 ceph-mon[47351]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:49.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:49 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:49.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:49 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:49.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:49 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:49.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:49 smithi150 ceph-mon[46187]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:49.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:49 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:49.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:49 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:49.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:49 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:49.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:49 smithi171 ceph-mon[47351]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:49.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:49 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:49.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:49 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:49.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:49 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:49.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:49 smithi081 ceph-mon[42474]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:50.251 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 10 on host 'smithi150' 2024-05-09T00:00:50.251 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:50.256+0000 7f22167fc700 1 -- 172.21.15.150:0/1657841601 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f222002ceb0 con 0x7f220c0a1120 2024-05-09T00:00:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:50.258+0000 7f2227483700 1 -- 172.21.15.150:0/1657841601 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f220c0a1120 msgr2=0x7f220c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:50.258+0000 7f2227483700 1 --2- 172.21.15.150:0/1657841601 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f220c0a1120 0x7f220c0a35e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f221c00b5c0 tx=0x7f221c003790 comp rx=0 tx=0).stop 2024-05-09T00:00:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:50.258+0000 7f2227483700 1 -- 172.21.15.150:0/1657841601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2220101b30 msgr2=0x7f2220196f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:50.258+0000 7f2227483700 1 --2- 172.21.15.150:0/1657841601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2220101b30 0x7f2220196f10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f221000d980 tx=0x7f221000dc90 comp rx=0 tx=0).stop 2024-05-09T00:00:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:50.258+0000 7f2227483700 1 -- 172.21.15.150:0/1657841601 shutdown_connections 2024-05-09T00:00:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:50.258+0000 7f2227483700 1 --2- 172.21.15.150:0/1657841601 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f220c0a1120 0x7f220c0a35e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:50.258+0000 7f2227483700 1 --2- 172.21.15.150:0/1657841601 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2220106d90 0x7f222019e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:50.258+0000 7f2227483700 1 --2- 172.21.15.150:0/1657841601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2220101b30 0x7f2220196f10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:50.253 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:50.258+0000 7f2227483700 1 --2- 172.21.15.150:0/1657841601 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2220104460 0x7f2220197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:50.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:50.258+0000 7f2227483700 1 -- 172.21.15.150:0/1657841601 >> 172.21.15.150:0/1657841601 conn(0x7f22200fb4c0 msgr2=0x7f2220102610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:50.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:50.259+0000 7f2227483700 1 -- 172.21.15.150:0/1657841601 shutdown_connections 2024-05-09T00:00:50.254 INFO:teuthology.orchestra.run.smithi150.stderr:2024-05-09T00:00:50.259+0000 7f2227483700 1 -- 172.21.15.150:0/1657841601 wait complete. 2024-05-09T00:00:50.646 DEBUG:teuthology.orchestra.run.smithi150:osd.10> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.10.service 2024-05-09T00:00:50.648 INFO:tasks.cephadm:Deploying osd.11 on smithi171 with /dev/vg_nvme/lv_1... 2024-05-09T00:00:50.648 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-09T00:00:50.673 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:50 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.673 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:50 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.673 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:50 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:50.674 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:50 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:50.674 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:50 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.674 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:50 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.674 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:50 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.674 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:50 smithi150 ceph-mon[46187]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:50.674 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:50 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:50.680 INFO:journalctl@ceph.osd.10.smithi150.stdout:-- Logs begin at Wed 2024-05-08 23:39:53 UTC. -- 2024-05-09T00:00:50.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:50 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:50 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:50 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:50.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:50 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:50.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:50 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:50 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:50 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:50 smithi171 ceph-mon[47351]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:50.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:50 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:50.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:50.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:50.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:50.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:50 smithi081 ceph-mon[42474]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:50.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:50 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:00:50.892 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:00:52.214 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-09T00:00:52.215 INFO:teuthology.orchestra.run.smithi171.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-09T00:00:52.215 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 10+0 records in 2024-05-09T00:00:52.215 INFO:teuthology.orchestra.run.smithi171.stderr:10+0 records out 2024-05-09T00:00:52.215 INFO:teuthology.orchestra.run.smithi171.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113122 s, 927 MB/s 2024-05-09T00:00:52.215 INFO:teuthology.orchestra.run.smithi171.stderr:--> Zapping successful for: 2024-05-09T00:00:52.477 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:00:52 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:00:52.038+0000 7f57a39f97c0 -1 osd.10 0 log_to_monitors true 2024-05-09T00:00:52.478 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:52 smithi150 ceph-mon[46187]: from='osd.10 [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T00:00:52.478 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:52 smithi150 ceph-mon[46187]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T00:00:52.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:52 smithi171 ceph-mon[47351]: from='osd.10 [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T00:00:52.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:52 smithi171 ceph-mon[47351]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T00:00:52.619 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi171:vg_nvme/lv_1 2024-05-09T00:00:52.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:52 smithi081 ceph-mon[42474]: from='osd.10 [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T00:00:52.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:52 smithi081 ceph-mon[42474]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-09T00:00:52.840 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:00:53.245 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-09T00:00:53.245 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: osdmap e65: 11 total, 10 up, 11 in 2024-05-09T00:00:53.245 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:53.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-09T00:00:53.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: osdmap e65: 11 total, 10 up, 11 in 2024-05-09T00:00:53.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:53.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: from='osd.10 [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-09T00:00:53.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-09T00:00:53.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:53.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:53.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:53.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:53.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:53.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:53.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:53.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:53.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:53.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:53.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:53 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:53.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: from='osd.10 [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-09T00:00:53.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-09T00:00:53.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:53.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:53.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:53.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:53.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:53.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:53.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:53.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:53.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:53.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:53.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:53 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:53.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-09T00:00:53.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: osdmap e65: 11 total, 10 up, 11 in 2024-05-09T00:00:53.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:53.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: from='osd.10 [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-09T00:00:53.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2024-05-09T00:00:53.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:53.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:53.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:53.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:53.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:53.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:53.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:00:53.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:53.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:53.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:00:53.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:53 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:00:53.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.822+0000 7f6c211a5700 1 -- 172.21.15.171:0/1540976537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c1c1022a0 msgr2=0x7f6c1c102700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:53.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.822+0000 7f6c211a5700 1 --2- 172.21.15.171:0/1540976537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c1c1022a0 0x7f6c1c102700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009990 tx=0x7f6c0c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:00:53.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.822+0000 7f6c211a5700 1 -- 172.21.15.171:0/1540976537 shutdown_connections 2024-05-09T00:00:53.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.822+0000 7f6c211a5700 1 --2- 172.21.15.171:0/1540976537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c1c102c40 0x7f6c1c1094f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:53.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.822+0000 7f6c211a5700 1 --2- 172.21.15.171:0/1540976537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c0ff2c0 0x7f6c1c0ff6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:53.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.822+0000 7f6c211a5700 1 --2- 172.21.15.171:0/1540976537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c1c1022a0 0x7f6c1c102700 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:53.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.822+0000 7f6c211a5700 1 -- 172.21.15.171:0/1540976537 >> 172.21.15.171:0/1540976537 conn(0x7f6c1c0fac40 msgr2=0x7f6c1c0fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:00:53.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.822+0000 7f6c211a5700 1 -- 172.21.15.171:0/1540976537 shutdown_connections 2024-05-09T00:00:53.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.822+0000 7f6c211a5700 1 -- 172.21.15.171:0/1540976537 wait complete. 2024-05-09T00:00:53.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.823+0000 7f6c211a5700 1 Processor -- start 2024-05-09T00:00:53.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.823+0000 7f6c211a5700 1 -- start start 2024-05-09T00:00:53.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.823+0000 7f6c211a5700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c1c0ff2c0 0x7f6c1c196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:53.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.823+0000 7f6c211a5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c1c1022a0 0x7f6c1c197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:53.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.823+0000 7f6c211a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c102c40 0x7f6c1c19e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:53.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.823+0000 7f6c211a5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c19ea00 con 0x7f6c1c102c40 2024-05-09T00:00:53.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.823+0000 7f6c211a5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c19eb40 con 0x7f6c1c1022a0 2024-05-09T00:00:53.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.823+0000 7f6c211a5700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c19ecd0 con 0x7f6c1c0ff2c0 2024-05-09T00:00:53.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.823+0000 7f6c1ad9d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c1c0ff2c0 0x7f6c1c196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:53.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.823+0000 7f6c1ad9d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c1c0ff2c0 0x7f6c1c196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:59532/0 (socket says 172.21.15.171:59532) 2024-05-09T00:00:53.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.823+0000 7f6c1ad9d700 1 -- 172.21.15.171:0/3008177289 learned_addr learned my addr 172.21.15.171:0/3008177289 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-09T00:00:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.823+0000 7f6c1a59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c1c1022a0 0x7f6c1c197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.824+0000 7f6c1b59e700 1 --2- 172.21.15.171:0/3008177289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c102c40 0x7f6c1c19e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.824+0000 7f6c1ad9d700 1 -- 172.21.15.171:0/3008177289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c1c1022a0 msgr2=0x7f6c1c197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.824+0000 7f6c1ad9d700 1 --2- 172.21.15.171:0/3008177289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c1c1022a0 0x7f6c1c197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.824+0000 7f6c1ad9d700 1 -- 172.21.15.171:0/3008177289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c102c40 msgr2=0x7f6c1c19e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:00:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.824+0000 7f6c1ad9d700 1 --2- 172.21.15.171:0/3008177289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c102c40 0x7f6c1c19e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:00:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.824+0000 7f6c1ad9d700 1 -- 172.21.15.171:0/3008177289 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0095f0 con 0x7f6c1c0ff2c0 2024-05-09T00:00:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.824+0000 7f6c1b59e700 1 --2- 172.21.15.171:0/3008177289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c102c40 0x7f6c1c19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:00:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.824+0000 7f6c1ad9d700 1 --2- 172.21.15.171:0/3008177289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c1c0ff2c0 0x7f6c1c196ec0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000d9b0 tx=0x7f6c1000dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.824+0000 7f6c03fff700 1 -- 172.21.15.171:0/3008177289 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10004020 con 0x7f6c1c0ff2c0 2024-05-09T00:00:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.824+0000 7f6c03fff700 1 -- 172.21.15.171:0/3008177289 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c10009730 con 0x7f6c1c0ff2c0 2024-05-09T00:00:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.824+0000 7f6c211a5700 1 -- 172.21.15.171:0/3008177289 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1c19efb0 con 0x7f6c1c0ff2c0 2024-05-09T00:00:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.824+0000 7f6c03fff700 1 -- 172.21.15.171:0/3008177289 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10003a40 con 0x7f6c1c0ff2c0 2024-05-09T00:00:53.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.824+0000 7f6c211a5700 1 -- 172.21.15.171:0/3008177289 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1c19f3c0 con 0x7f6c1c0ff2c0 2024-05-09T00:00:53.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.825+0000 7f6c211a5700 1 -- 172.21.15.171:0/3008177289 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1c1085d0 con 0x7f6c1c0ff2c0 2024-05-09T00:00:53.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.826+0000 7f6c03fff700 1 -- 172.21.15.171:0/3008177289 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6c100098a0 con 0x7f6c1c0ff2c0 2024-05-09T00:00:53.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.827+0000 7f6c03fff700 1 --2- 172.21.15.171:0/3008177289 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6c040a1120 0x7f6c040a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:00:53.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.827+0000 7f6c03fff700 1 -- 172.21.15.171:0/3008177289 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6c100cc140 con 0x7f6c1c0ff2c0 2024-05-09T00:00:53.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.827+0000 7f6c1a59c700 1 --2- 172.21.15.171:0/3008177289 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6c040a1120 0x7f6c040a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:00:53.823 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.828+0000 7f6c1a59c700 1 --2- 172.21.15.171:0/3008177289 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6c040a1120 0x7f6c040a35e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00b5c0 tx=0x7f6c0c003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:00:53.825 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:53.830+0000 7f6c03fff700 1 -- 172.21.15.171:0/3008177289 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6c10096040 con 0x7f6c1c0ff2c0 2024-05-09T00:00:54.014 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:00:53 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:00:53.730+0000 7f579985e700 -1 osd.10 0 waiting for initial osdmap 2024-05-09T00:00:54.014 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:00:53 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:00:53.745+0000 7f5790e4a700 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:00:54.026 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:00:54.032+0000 7f6c211a5700 1 -- 172.21.15.171:0/3008177289 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c1c02ceb0 con 0x7f6c040a1120 2024-05-09T00:00:54.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:54 smithi150 ceph-mon[46187]: Detected new or changed devices on smithi150 2024-05-09T00:00:54.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:54 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi150 to 4278M 2024-05-09T00:00:54.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:54 smithi150 ceph-mon[46187]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-05-09T00:00:54.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:54 smithi150 ceph-mon[46187]: osdmap e66: 11 total, 10 up, 11 in 2024-05-09T00:00:54.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:54 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:54.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:54 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:54.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:54 smithi150 ceph-mon[46187]: from='osd.10 ' entity='osd.10' 2024-05-09T00:00:54.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:54 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:54.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:54 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:54.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:54 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:54.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:54 smithi171 ceph-mon[47351]: Detected new or changed devices on smithi150 2024-05-09T00:00:54.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:54 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi150 to 4278M 2024-05-09T00:00:54.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:54 smithi171 ceph-mon[47351]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-05-09T00:00:54.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:54 smithi171 ceph-mon[47351]: osdmap e66: 11 total, 10 up, 11 in 2024-05-09T00:00:54.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:54 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:54.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:54 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:54.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:54 smithi171 ceph-mon[47351]: from='osd.10 ' entity='osd.10' 2024-05-09T00:00:54.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:54 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:54.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:54 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:54.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:54 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:54.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:54 smithi081 ceph-mon[42474]: Detected new or changed devices on smithi150 2024-05-09T00:00:54.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:54 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi150 to 4278M 2024-05-09T00:00:54.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:54 smithi081 ceph-mon[42474]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2024-05-09T00:00:54.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:54 smithi081 ceph-mon[42474]: osdmap e66: 11 total, 10 up, 11 in 2024-05-09T00:00:54.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:54 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:54.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:54 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:54.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:54 smithi081 ceph-mon[42474]: from='osd.10 ' entity='osd.10' 2024-05-09T00:00:54.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:54 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-09T00:00:54.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:54 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-09T00:00:54.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:54 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:00:55.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:55 smithi150 ceph-mon[46187]: purged_snaps scrub starts 2024-05-09T00:00:55.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:55 smithi150 ceph-mon[46187]: purged_snaps scrub ok 2024-05-09T00:00:55.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:55 smithi150 ceph-mon[46187]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:55.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:55 smithi150 ceph-mon[46187]: osd.10 [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800] boot 2024-05-09T00:00:55.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:55 smithi150 ceph-mon[46187]: osdmap e67: 11 total, 11 up, 11 in 2024-05-09T00:00:55.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:55 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:55.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:55 smithi150 ceph-mon[46187]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:55.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:55 smithi171 ceph-mon[47351]: purged_snaps scrub starts 2024-05-09T00:00:55.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:55 smithi171 ceph-mon[47351]: purged_snaps scrub ok 2024-05-09T00:00:55.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:55 smithi171 ceph-mon[47351]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:55.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:55 smithi171 ceph-mon[47351]: osd.10 [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800] boot 2024-05-09T00:00:55.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:55 smithi171 ceph-mon[47351]: osdmap e67: 11 total, 11 up, 11 in 2024-05-09T00:00:55.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:55 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:55.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:55 smithi171 ceph-mon[47351]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:55.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:55 smithi081 ceph-mon[42474]: purged_snaps scrub starts 2024-05-09T00:00:55.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:55 smithi081 ceph-mon[42474]: purged_snaps scrub ok 2024-05-09T00:00:55.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:55 smithi081 ceph-mon[42474]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi171:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:00:55.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:55 smithi081 ceph-mon[42474]: osd.10 [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800] boot 2024-05-09T00:00:55.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:55 smithi081 ceph-mon[42474]: osdmap e67: 11 total, 11 up, 11 in 2024-05-09T00:00:55.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:55 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:00:55.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:55 smithi081 ceph-mon[42474]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 306 MiB used, 894 GiB / 894 GiB avail 2024-05-09T00:00:56.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:56 smithi150 ceph-mon[46187]: osdmap e68: 11 total, 11 up, 11 in 2024-05-09T00:00:56.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:56 smithi150 ceph-mon[46187]: from='client.? 172.21.15.171:0/1292595203' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f"}]: dispatch 2024-05-09T00:00:56.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:56 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f"}]: dispatch 2024-05-09T00:00:56.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:56 smithi150 ceph-mon[46187]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f"}]': finished 2024-05-09T00:00:56.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:56 smithi150 ceph-mon[46187]: osdmap e69: 12 total, 11 up, 12 in 2024-05-09T00:00:56.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:56 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:00:56.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:56 smithi171 ceph-mon[47351]: osdmap e68: 11 total, 11 up, 11 in 2024-05-09T00:00:56.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:56 smithi171 ceph-mon[47351]: from='client.? 172.21.15.171:0/1292595203' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f"}]: dispatch 2024-05-09T00:00:56.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:56 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f"}]: dispatch 2024-05-09T00:00:56.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:56 smithi171 ceph-mon[47351]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f"}]': finished 2024-05-09T00:00:56.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:56 smithi171 ceph-mon[47351]: osdmap e69: 12 total, 11 up, 12 in 2024-05-09T00:00:56.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:56 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:00:56.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:56 smithi081 ceph-mon[42474]: osdmap e68: 11 total, 11 up, 11 in 2024-05-09T00:00:56.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:56 smithi081 ceph-mon[42474]: from='client.? 172.21.15.171:0/1292595203' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f"}]: dispatch 2024-05-09T00:00:56.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:56 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f"}]: dispatch 2024-05-09T00:00:56.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:56 smithi081 ceph-mon[42474]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f"}]': finished 2024-05-09T00:00:56.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:56 smithi081 ceph-mon[42474]: osdmap e69: 12 total, 11 up, 12 in 2024-05-09T00:00:56.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:56 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:00:57.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:57 smithi150 ceph-mon[46187]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:00:57.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:57 smithi150 ceph-mon[46187]: from='client.? 172.21.15.171:0/1959510693' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:57.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:57 smithi150 ceph-mon[46187]: osdmap e70: 12 total, 11 up, 12 in 2024-05-09T00:00:57.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:57 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:00:57.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:57 smithi171 ceph-mon[47351]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:00:57.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:57 smithi171 ceph-mon[47351]: from='client.? 172.21.15.171:0/1959510693' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:57.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:57 smithi171 ceph-mon[47351]: osdmap e70: 12 total, 11 up, 12 in 2024-05-09T00:00:57.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:57 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:00:57.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:57 smithi081 ceph-mon[42474]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:00:57.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:57 smithi081 ceph-mon[42474]: from='client.? 172.21.15.171:0/1959510693' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-09T00:00:57.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:57 smithi081 ceph-mon[42474]: osdmap e70: 12 total, 11 up, 12 in 2024-05-09T00:00:57.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:57 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:00:59.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:58 smithi150 ceph-mon[46187]: osdmap e71: 12 total, 11 up, 12 in 2024-05-09T00:00:59.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:58 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:00:59.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:00:58 smithi150 ceph-mon[46187]: pgmap v187: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-09T00:00:59.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:58 smithi171 ceph-mon[47351]: osdmap e71: 12 total, 11 up, 12 in 2024-05-09T00:00:59.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:58 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:00:59.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:00:58 smithi171 ceph-mon[47351]: pgmap v187: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-09T00:00:59.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:58 smithi081 ceph-mon[42474]: osdmap e71: 12 total, 11 up, 12 in 2024-05-09T00:00:59.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:58 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:00:59.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:00:58 smithi081 ceph-mon[42474]: pgmap v187: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-09T00:01:01.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:01 smithi081 ceph-mon[42474]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-09T00:01:01.637 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:01 smithi171 ceph-mon[47351]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-09T00:01:01.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:01 smithi150 ceph-mon[46187]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-09T00:01:02.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:02 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-09T00:01:02.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:02 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:02.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:02 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-09T00:01:02.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:02 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:02.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:02 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-09T00:01:02.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:02 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:03 smithi081 ceph-mon[42474]: Deploying daemon osd.11 on smithi171 2024-05-09T00:01:03.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:03 smithi081 ceph-mon[42474]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-09T00:01:03.656 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:03 smithi171 ceph-mon[47351]: Deploying daemon osd.11 on smithi171 2024-05-09T00:01:03.656 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:03 smithi171 ceph-mon[47351]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-09T00:01:03.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:03 smithi150 ceph-mon[46187]: Deploying daemon osd.11 on smithi171 2024-05-09T00:01:03.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:03 smithi150 ceph-mon[46187]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-09T00:01:05.569 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:05 smithi171 ceph-mon[47351]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T00:01:05.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:05 smithi081 ceph-mon[42474]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T00:01:05.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:05 smithi150 ceph-mon[46187]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-09T00:01:06.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:06 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:06.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:06 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:06.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:06 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:06.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:06 smithi171 ceph-mon[47351]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:01:07.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:06 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:07.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:06 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:07.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:06 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:07.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:06 smithi150 ceph-mon[46187]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:01:07.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:06 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:07.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:06 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:07.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:06 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:07.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:06 smithi081 ceph-mon[42474]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:01:08.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:08.036+0000 7f6c03fff700 1 -- 172.21.15.171:0/3008177289 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f6c1c02ceb0 con 0x7f6c040a1120 2024-05-09T00:01:08.031 INFO:teuthology.orchestra.run.smithi171.stdout:Created osd(s) 11 on host 'smithi171' 2024-05-09T00:01:08.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:08.038+0000 7f6c211a5700 1 -- 172.21.15.171:0/3008177289 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6c040a1120 msgr2=0x7f6c040a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:08.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:08.038+0000 7f6c211a5700 1 --2- 172.21.15.171:0/3008177289 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6c040a1120 0x7f6c040a35e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00b5c0 tx=0x7f6c0c003790 comp rx=0 tx=0).stop 2024-05-09T00:01:08.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:08.038+0000 7f6c211a5700 1 -- 172.21.15.171:0/3008177289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c1c0ff2c0 msgr2=0x7f6c1c196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:08.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:08.038+0000 7f6c211a5700 1 --2- 172.21.15.171:0/3008177289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c1c0ff2c0 0x7f6c1c196ec0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000d9b0 tx=0x7f6c1000dcc0 comp rx=0 tx=0).stop 2024-05-09T00:01:08.034 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:08.038+0000 7f6c211a5700 1 -- 172.21.15.171:0/3008177289 shutdown_connections 2024-05-09T00:01:08.034 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:08.038+0000 7f6c211a5700 1 --2- 172.21.15.171:0/3008177289 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6c040a1120 0x7f6c040a35e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:08.034 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:08.038+0000 7f6c211a5700 1 --2- 172.21.15.171:0/3008177289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c1c102c40 0x7f6c1c19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:08.034 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:08.038+0000 7f6c211a5700 1 --2- 172.21.15.171:0/3008177289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c1c0ff2c0 0x7f6c1c196ec0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:08.034 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:08.038+0000 7f6c211a5700 1 --2- 172.21.15.171:0/3008177289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c1c1022a0 0x7f6c1c197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:08.034 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:08.039+0000 7f6c211a5700 1 -- 172.21.15.171:0/3008177289 >> 172.21.15.171:0/3008177289 conn(0x7f6c1c0fac40 msgr2=0x7f6c1c105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:08.034 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:08.039+0000 7f6c211a5700 1 -- 172.21.15.171:0/3008177289 shutdown_connections 2024-05-09T00:01:08.035 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:08.039+0000 7f6c211a5700 1 -- 172.21.15.171:0/3008177289 wait complete. 2024-05-09T00:01:08.418 DEBUG:teuthology.orchestra.run.smithi171:osd.11> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.11.service 2024-05-09T00:01:08.420 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-09T00:01:08.421 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-09T00:01:08.452 INFO:journalctl@ceph.osd.11.smithi171.stdout:-- Logs begin at Wed 2024-05-08 23:40:11 UTC. -- 2024-05-09T00:01:08.543 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:08 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:08 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:08 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:08.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:08 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:08.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:08 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.544 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:08 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:08 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.545 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:08 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:01:08.763 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.763 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.763 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:08.764 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:08.764 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.764 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.764 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.764 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:08 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:08.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:08 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:08 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:08 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:08.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:08 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:08.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:08 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:08 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:08 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:08.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:08 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:09.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:09 smithi171 ceph-mon[47351]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:01:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 -- 172.21.15.81:0/2657150617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7780101010 msgr2=0x7f7780101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 --2- 172.21.15.81:0/2657150617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7780101010 0x7f7780101430 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f777c0099c0 tx=0x7f777c009cd0 comp rx=0 tx=0).stop 2024-05-09T00:01:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 -- 172.21.15.81:0/2657150617 shutdown_connections 2024-05-09T00:01:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 --2- 172.21.15.81:0/2657150617 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7780102bb0 0x7f7780109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 --2- 172.21.15.81:0/2657150617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7780101010 0x7f7780101430 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 --2- 172.21.15.81:0/2657150617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7780102210 0x7f7780102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 -- 172.21.15.81:0/2657150617 >> 172.21.15.81:0/2657150617 conn(0x7f77800fc5b0 msgr2=0x7f77800fe9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 -- 172.21.15.81:0/2657150617 shutdown_connections 2024-05-09T00:01:09.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 -- 172.21.15.81:0/2657150617 wait complete. 2024-05-09T00:01:09.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 Processor -- start 2024-05-09T00:01:09.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 -- start start 2024-05-09T00:01:09.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7780101010 0x7f7780199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:09.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7780102210 0x7f7780199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:09.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7780102bb0 0x7f77801a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:09.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77801a0c50 con 0x7f7780102bb0 2024-05-09T00:01:09.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.585+0000 7f77883c8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77801a0d90 con 0x7f7780102210 2024-05-09T00:01:09.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f77883c8700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77801a0f20 con 0x7f7780101010 2024-05-09T00:01:09.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f7786965700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7780102bb0 0x7f77801a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:09.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f7786965700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7780102bb0 0x7f77801a0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41410/0 (socket says 172.21.15.81:41410) 2024-05-09T00:01:09.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f7786965700 1 -- 172.21.15.81:0/3318687732 learned_addr learned my addr 172.21.15.81:0/3318687732 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:09.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f7786164700 1 --2- 172.21.15.81:0/3318687732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7780101010 0x7f7780199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:09.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f7785963700 1 --2- 172.21.15.81:0/3318687732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7780102210 0x7f7780199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:09.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f7786965700 1 -- 172.21.15.81:0/3318687732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7780101010 msgr2=0x7f7780199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:09.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f7786965700 1 --2- 172.21.15.81:0/3318687732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7780101010 0x7f7780199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:09.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f7786965700 1 -- 172.21.15.81:0/3318687732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7780102210 msgr2=0x7f7780199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:09.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f7786965700 1 --2- 172.21.15.81:0/3318687732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7780102210 0x7f7780199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:09.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f7786965700 1 -- 172.21.15.81:0/3318687732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777c0095f0 con 0x7f7780102bb0 2024-05-09T00:01:09.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f7786965700 1 --2- 172.21.15.81:0/3318687732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7780102bb0 0x7f77801a0680 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7778007f10 tx=0x7f777800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:09.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f77777fe700 1 -- 172.21.15.81:0/3318687732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778017070 con 0x7f7780102bb0 2024-05-09T00:01:09.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f77883c8700 1 -- 172.21.15.81:0/3318687732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77801a1200 con 0x7f7780102bb0 2024-05-09T00:01:09.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f77777fe700 1 -- 172.21.15.81:0/3318687732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f777800f040 con 0x7f7780102bb0 2024-05-09T00:01:09.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f77777fe700 1 -- 172.21.15.81:0/3318687732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7778005610 con 0x7f7780102bb0 2024-05-09T00:01:09.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.586+0000 7f77883c8700 1 -- 172.21.15.81:0/3318687732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77801a16b0 con 0x7f7780102bb0 2024-05-09T00:01:09.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.587+0000 7f77883c8700 1 -- 172.21.15.81:0/3318687732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778004ec60 con 0x7f7780102bb0 2024-05-09T00:01:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.589+0000 7f77777fe700 1 -- 172.21.15.81:0/3318687732 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7778004ad0 con 0x7f7780102bb0 2024-05-09T00:01:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.589+0000 7f77777fe700 1 --2- 172.21.15.81:0/3318687732 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f776c0a1120 0x7f776c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.590+0000 7f77777fe700 1 -- 172.21.15.81:0/3318687732 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f77780cc160 con 0x7f7780102bb0 2024-05-09T00:01:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.590+0000 7f7786164700 1 --2- 172.21.15.81:0/3318687732 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f776c0a1120 0x7f776c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:09.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.590+0000 7f7786164700 1 --2- 172.21.15.81:0/3318687732 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f776c0a1120 0x7f776c0a35e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f777c003820 tx=0x7f777c005920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:09.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.593+0000 7f77777fe700 1 -- 172.21.15.81:0/3318687732 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7778095e30 con 0x7f7780102bb0 2024-05-09T00:01:09.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:09 smithi150 ceph-mon[46187]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:01:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.785+0000 7f77883c8700 1 -- 172.21.15.81:0/3318687732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f778010ca70 con 0x7f7780102bb0 2024-05-09T00:01:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.785+0000 7f77777fe700 1 -- 172.21.15.81:0/3318687732 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) v1 ==== 74+0+133 (secure 0 0 0) 0x7f7778099450 con 0x7f7780102bb0 2024-05-09T00:01:09.780 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.788+0000 7f77883c8700 1 -- 172.21.15.81:0/3318687732 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f776c0a1120 msgr2=0x7f776c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.788+0000 7f77883c8700 1 --2- 172.21.15.81:0/3318687732 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f776c0a1120 0x7f776c0a35e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f777c003820 tx=0x7f777c005920 comp rx=0 tx=0).stop 2024-05-09T00:01:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.788+0000 7f77883c8700 1 -- 172.21.15.81:0/3318687732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7780102bb0 msgr2=0x7f77801a0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.788+0000 7f77883c8700 1 --2- 172.21.15.81:0/3318687732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7780102bb0 0x7f77801a0680 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7778007f10 tx=0x7f777800d3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.788+0000 7f77883c8700 1 -- 172.21.15.81:0/3318687732 shutdown_connections 2024-05-09T00:01:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.788+0000 7f77883c8700 1 --2- 172.21.15.81:0/3318687732 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f776c0a1120 0x7f776c0a35e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.788+0000 7f77883c8700 1 --2- 172.21.15.81:0/3318687732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7780102bb0 0x7f77801a0680 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.788+0000 7f77883c8700 1 --2- 172.21.15.81:0/3318687732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7780101010 0x7f7780199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.788+0000 7f77883c8700 1 --2- 172.21.15.81:0/3318687732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7780102210 0x7f7780199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.788+0000 7f77883c8700 1 -- 172.21.15.81:0/3318687732 >> 172.21.15.81:0/3318687732 conn(0x7f77800fc5b0 msgr2=0x7f77800731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:09.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.788+0000 7f77883c8700 1 -- 172.21.15.81:0/3318687732 shutdown_connections 2024-05-09T00:01:09.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:09.788+0000 7f77883c8700 1 -- 172.21.15.81:0/3318687732 wait complete. 2024-05-09T00:01:09.810 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:09 smithi081 ceph-mon[42474]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:01:10.052 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:01:09 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:01:09.639+0000 7f8a1df107c0 -1 osd.11 0 log_to_monitors true 2024-05-09T00:01:10.173 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1715212854,"num_in_osds":12,"osd_in_since":1715212855,"num_remapped_pgs":0} 2024-05-09T00:01:10.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:10 smithi171 ceph-mon[47351]: from='osd.11 [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T00:01:10.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:10 smithi171 ceph-mon[47351]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T00:01:10.547 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:10 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3318687732' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T00:01:10.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:10 smithi150 ceph-mon[46187]: from='osd.11 [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T00:01:10.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:10 smithi150 ceph-mon[46187]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T00:01:10.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:10 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3318687732' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T00:01:10.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:10 smithi081 ceph-mon[42474]: from='osd.11 [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T00:01:10.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:10 smithi081 ceph-mon[42474]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-09T00:01:10.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:10 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3318687732' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T00:01:11.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-09T00:01:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:01:11.542 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:01:11.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-09T00:01:11.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: osdmap e72: 12 total, 11 up, 12 in 2024-05-09T00:01:11.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:11.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: from='osd.11 [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-09T00:01:11.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-09T00:01:11.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:11.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:11.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:11.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:11.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:11.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:11.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:11.543 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:11.544 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:11.544 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:11 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:11.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:01:11.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-09T00:01:11.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: osdmap e72: 12 total, 11 up, 12 in 2024-05-09T00:01:11.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:11.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: from='osd.11 [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-09T00:01:11.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-09T00:01:11.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:11.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:11.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:11.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:11.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:11.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:11.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:11.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:11.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:11.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:11 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:11.802 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:01:11 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:01:11.398+0000 7f8a13574700 -1 osd.11 0 waiting for initial osdmap 2024-05-09T00:01:11.803 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:01:11 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:01:11.413+0000 7f8a0f369700 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-09T00:01:11.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:01:11.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-09T00:01:11.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: osdmap e72: 12 total, 11 up, 12 in 2024-05-09T00:01:11.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:11.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: from='osd.11 [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-09T00:01:11.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]: dispatch 2024-05-09T00:01:11.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:11.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:11.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:11.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:11.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:11.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:01:11.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:11.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:11.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:11.804 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:11 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:12.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.393+0000 7f0ed9d66700 1 -- 172.21.15.81:0/187072266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ed4100150 msgr2=0x7f0ed41005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:12.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.393+0000 7f0ed9d66700 1 --2- 172.21.15.81:0/187072266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ed4100150 0x7f0ed41005d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009990 tx=0x7f0ec8009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:12.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.393+0000 7f0ed9d66700 1 -- 172.21.15.81:0/187072266 shutdown_connections 2024-05-09T00:01:12.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.393+0000 7f0ed9d66700 1 --2- 172.21.15.81:0/187072266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ed4100b10 0x7f0ed41083b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:12.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.393+0000 7f0ed9d66700 1 --2- 172.21.15.81:0/187072266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ed4101580 0x7f0ed41019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:12.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.393+0000 7f0ed9d66700 1 --2- 172.21.15.81:0/187072266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ed4100150 0x7f0ed41005d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:12.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.393+0000 7f0ed9d66700 1 -- 172.21.15.81:0/187072266 >> 172.21.15.81:0/187072266 conn(0x7f0ed40fac40 msgr2=0x7f0ed40fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:12.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.393+0000 7f0ed9d66700 1 -- 172.21.15.81:0/187072266 shutdown_connections 2024-05-09T00:01:12.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.393+0000 7f0ed9d66700 1 -- 172.21.15.81:0/187072266 wait complete. 2024-05-09T00:01:12.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.393+0000 7f0ed9d66700 1 Processor -- start 2024-05-09T00:01:12.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.394+0000 7f0ed9d66700 1 -- start start 2024-05-09T00:01:12.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.394+0000 7f0ed9d66700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ed4100150 0x7f0ed4197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:12.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.394+0000 7f0ed9d66700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ed4100b10 0x7f0ed4197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:12.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.394+0000 7f0ed9d66700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ed4101580 0x7f0ed419e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:12.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.394+0000 7f0ed9d66700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed419eaf0 con 0x7f0ed4100150 2024-05-09T00:01:12.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.394+0000 7f0ed9d66700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed419ec30 con 0x7f0ed4101580 2024-05-09T00:01:12.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.394+0000 7f0ed9d66700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed419edc0 con 0x7f0ed4100b10 2024-05-09T00:01:12.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.394+0000 7f0ed3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ed4101580 0x7f0ed419e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:12.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.394+0000 7f0ed3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ed4101580 0x7f0ed419e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.81:54450/0 (socket says 172.21.15.81:54450) 2024-05-09T00:01:12.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.394+0000 7f0ed3fff700 1 -- 172.21.15.81:0/528732922 learned_addr learned my addr 172.21.15.81:0/528732922 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:12.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.394+0000 7f0ed2ffd700 1 --2- 172.21.15.81:0/528732922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ed4100b10 0x7f0ed4197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:12.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.394+0000 7f0ed3fff700 1 -- 172.21.15.81:0/528732922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ed4100b10 msgr2=0x7f0ed4197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:12.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.394+0000 7f0ed3fff700 1 --2- 172.21.15.81:0/528732922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ed4100b10 0x7f0ed4197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:12.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.395+0000 7f0ed3fff700 1 -- 172.21.15.81:0/528732922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ed4100150 msgr2=0x7f0ed4197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:12.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.395+0000 7f0ed3fff700 1 --2- 172.21.15.81:0/528732922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ed4100150 0x7f0ed4197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:12.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.395+0000 7f0ed3fff700 1 -- 172.21.15.81:0/528732922 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec80095f0 con 0x7f0ed4101580 2024-05-09T00:01:12.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.395+0000 7f0ed3fff700 1 --2- 172.21.15.81:0/528732922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ed4101580 0x7f0ed419e520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00ada0 tx=0x7f0ecc00c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:12.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.398+0000 7f0ed0ff9700 1 -- 172.21.15.81:0/528732922 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00f070 con 0x7f0ed4101580 2024-05-09T00:01:12.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.398+0000 7f0ed0ff9700 1 -- 172.21.15.81:0/528732922 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ecc007b30 con 0x7f0ed4101580 2024-05-09T00:01:12.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.398+0000 7f0ed9d66700 1 -- 172.21.15.81:0/528732922 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed419f0a0 con 0x7f0ed4101580 2024-05-09T00:01:12.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.398+0000 7f0ed0ff9700 1 -- 172.21.15.81:0/528732922 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc0053e0 con 0x7f0ed4101580 2024-05-09T00:01:12.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.398+0000 7f0ed9d66700 1 -- 172.21.15.81:0/528732922 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed419f5a0 con 0x7f0ed4101580 2024-05-09T00:01:12.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.399+0000 7f0ed9d66700 1 -- 172.21.15.81:0/528732922 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed404ec60 con 0x7f0ed4101580 2024-05-09T00:01:12.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.400+0000 7f0ed0ff9700 1 -- 172.21.15.81:0/528732922 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0ecc00c980 con 0x7f0ed4101580 2024-05-09T00:01:12.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.400+0000 7f0ed0ff9700 1 --2- 172.21.15.81:0/528732922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0ebc0a11a0 0x7f0ebc0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:12.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.400+0000 7f0ed37fe700 1 --2- 172.21.15.81:0/528732922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0ebc0a11a0 0x7f0ebc0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:12.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.400+0000 7f0ed0ff9700 1 -- 172.21.15.81:0/528732922 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f0ecc0cb8d0 con 0x7f0ed4101580 2024-05-09T00:01:12.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.401+0000 7f0ed37fe700 1 --2- 172.21.15.81:0/528732922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0ebc0a11a0 0x7f0ebc0a3660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400a990 tx=0x7f0ec4005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:12.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.404+0000 7f0ed0ff9700 1 -- 172.21.15.81:0/528732922 <== mon.2 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0ecc095690 con 0x7f0ed4101580 2024-05-09T00:01:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.597+0000 7f0ed9d66700 1 -- 172.21.15.81:0/528732922 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f0ed410b860 con 0x7f0ed4101580 2024-05-09T00:01:12.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.597+0000 7f0ed0ff9700 1 -- 172.21.15.81:0/528732922 <== mon.2 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) v1 ==== 74+0+133 (secure 0 0 0) 0x7f0ecc012390 con 0x7f0ed4101580 2024-05-09T00:01:12.591 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:12.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.599+0000 7f0ed9d66700 1 -- 172.21.15.81:0/528732922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0ebc0a11a0 msgr2=0x7f0ebc0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.599+0000 7f0ed9d66700 1 --2- 172.21.15.81:0/528732922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0ebc0a11a0 0x7f0ebc0a3660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400a990 tx=0x7f0ec4005c80 comp rx=0 tx=0).stop 2024-05-09T00:01:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.599+0000 7f0ed9d66700 1 -- 172.21.15.81:0/528732922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ed4101580 msgr2=0x7f0ed419e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.599+0000 7f0ed9d66700 1 --2- 172.21.15.81:0/528732922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ed4101580 0x7f0ed419e520 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00ada0 tx=0x7f0ecc00c330 comp rx=0 tx=0).stop 2024-05-09T00:01:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.599+0000 7f0ed9d66700 1 -- 172.21.15.81:0/528732922 shutdown_connections 2024-05-09T00:01:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.599+0000 7f0ed9d66700 1 --2- 172.21.15.81:0/528732922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0ebc0a11a0 0x7f0ebc0a3660 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.599+0000 7f0ed9d66700 1 --2- 172.21.15.81:0/528732922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ed4101580 0x7f0ed419e520 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.599+0000 7f0ed9d66700 1 --2- 172.21.15.81:0/528732922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ed4100150 0x7f0ed4197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.599+0000 7f0ed9d66700 1 --2- 172.21.15.81:0/528732922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ed4100b10 0x7f0ed4197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.599+0000 7f0ed9d66700 1 -- 172.21.15.81:0/528732922 >> 172.21.15.81:0/528732922 conn(0x7f0ed40fac40 msgr2=0x7f0ed40ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.599+0000 7f0ed9d66700 1 -- 172.21.15.81:0/528732922 shutdown_connections 2024-05-09T00:01:12.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:12.599+0000 7f0ed9d66700 1 -- 172.21.15.81:0/528732922 wait complete. 2024-05-09T00:01:12.616 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:12 smithi081 ceph-mon[42474]: Detected new or changed devices on smithi171 2024-05-09T00:01:12.616 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:12 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi171 to 4278M 2024-05-09T00:01:12.617 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:12 smithi081 ceph-mon[42474]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-09T00:01:12.617 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:12 smithi081 ceph-mon[42474]: osdmap e73: 12 total, 11 up, 12 in 2024-05-09T00:01:12.617 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:12 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:12.617 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:12 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:12.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:12 smithi150 ceph-mon[46187]: Detected new or changed devices on smithi171 2024-05-09T00:01:12.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:12 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi171 to 4278M 2024-05-09T00:01:12.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:12 smithi150 ceph-mon[46187]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-09T00:01:12.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:12 smithi150 ceph-mon[46187]: osdmap e73: 12 total, 11 up, 12 in 2024-05-09T00:01:12.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:12 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:12.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:12 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:12.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:12 smithi171 ceph-mon[47351]: Detected new or changed devices on smithi171 2024-05-09T00:01:12.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:12 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi171 to 4278M 2024-05-09T00:01:12.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:12 smithi171 ceph-mon[47351]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi171", "root=default"]}]': finished 2024-05-09T00:01:12.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:12 smithi171 ceph-mon[47351]: osdmap e73: 12 total, 11 up, 12 in 2024-05-09T00:01:12.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:12 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:12.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:12 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:12.990 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":74,"num_osds":12,"num_up_osds":12,"osd_up_since":1715212872,"num_in_osds":12,"osd_in_since":1715212855,"num_remapped_pgs":0} 2024-05-09T00:01:12.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T00:01:13.210 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:01:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:13 smithi081 ceph-mon[42474]: purged_snaps scrub starts 2024-05-09T00:01:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:13 smithi081 ceph-mon[42474]: purged_snaps scrub ok 2024-05-09T00:01:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:13 smithi081 ceph-mon[42474]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:01:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:13 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:13 smithi081 ceph-mon[42474]: osd.11 [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273] boot 2024-05-09T00:01:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:13 smithi081 ceph-mon[42474]: osdmap e74: 12 total, 12 up, 12 in 2024-05-09T00:01:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:13 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:13.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:13 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/528732922' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T00:01:13.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:13 smithi150 ceph-mon[46187]: purged_snaps scrub starts 2024-05-09T00:01:13.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:13 smithi150 ceph-mon[46187]: purged_snaps scrub ok 2024-05-09T00:01:13.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:13 smithi150 ceph-mon[46187]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:01:13.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:13 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:13.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:13 smithi150 ceph-mon[46187]: osd.11 [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273] boot 2024-05-09T00:01:13.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:13 smithi150 ceph-mon[46187]: osdmap e74: 12 total, 12 up, 12 in 2024-05-09T00:01:13.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:13 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:13.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:13 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/528732922' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T00:01:13.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:13 smithi171 ceph-mon[47351]: purged_snaps scrub starts 2024-05-09T00:01:13.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:13 smithi171 ceph-mon[47351]: purged_snaps scrub ok 2024-05-09T00:01:13.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:13 smithi171 ceph-mon[47351]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-05-09T00:01:13.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:13 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:13.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:13 smithi171 ceph-mon[47351]: osd.11 [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273] boot 2024-05-09T00:01:13.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:13 smithi171 ceph-mon[47351]: osdmap e74: 12 total, 12 up, 12 in 2024-05-09T00:01:13.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:13 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:01:13.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:13 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/528732922' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-09T00:01:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.217+0000 7f9f531eb700 1 -- 172.21.15.81:0/1666261571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4c105f00 msgr2=0x7f9f4c1062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.217+0000 7f9f531eb700 1 --2- 172.21.15.81:0/1666261571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4c105f00 0x7f9f4c1062e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009990 tx=0x7f9f40009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 -- 172.21.15.81:0/1666261571 shutdown_connections 2024-05-09T00:01:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 --2- 172.21.15.81:0/1666261571 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f4c100890 0x7f9f4c10cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 --2- 172.21.15.81:0/1666261571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4c105f00 0x7f9f4c1062e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 --2- 172.21.15.81:0/1666261571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f4c0ffed0 0x7f9f4c100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 -- 172.21.15.81:0/1666261571 >> 172.21.15.81:0/1666261571 conn(0x7f9f4c075f80 msgr2=0x7f9f4c076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 -- 172.21.15.81:0/1666261571 shutdown_connections 2024-05-09T00:01:14.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 -- 172.21.15.81:0/1666261571 wait complete. 2024-05-09T00:01:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 Processor -- start 2024-05-09T00:01:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 -- start start 2024-05-09T00:01:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f4c0ffed0 0x7f9f4c1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:14.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f4c100890 0x7f9f4c1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4c105f00 0x7f9f4c19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c19c350 con 0x7f9f4c105f00 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c19c4c0 con 0x7f9f4c100890 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.218+0000 7f9f531eb700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c19c680 con 0x7f9f4c0ffed0 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f51788700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4c105f00 0x7f9f4c19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f51788700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4c105f00 0x7f9f4c19bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41448/0 (socket says 172.21.15.81:41448) 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f51788700 1 -- 172.21.15.81:0/1418636326 learned_addr learned my addr 172.21.15.81:0/1418636326 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f50f87700 1 --2- 172.21.15.81:0/1418636326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f4c0ffed0 0x7f9f4c1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f51788700 1 -- 172.21.15.81:0/1418636326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f4c0ffed0 msgr2=0x7f9f4c1974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f51788700 1 --2- 172.21.15.81:0/1418636326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f4c0ffed0 0x7f9f4c1974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f4bfff700 1 --2- 172.21.15.81:0/1418636326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f4c100890 0x7f9f4c1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f51788700 1 -- 172.21.15.81:0/1418636326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f4c100890 msgr2=0x7f9f4c1979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f51788700 1 --2- 172.21.15.81:0/1418636326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f4c100890 0x7f9f4c1979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f51788700 1 -- 172.21.15.81:0/1418636326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f400095f0 con 0x7f9f4c105f00 2024-05-09T00:01:14.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f51788700 1 --2- 172.21.15.81:0/1418636326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4c105f00 0x7f9f4c19bd40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9f44007d70 tx=0x7f9f4400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f49ffb700 1 -- 172.21.15.81:0/1418636326 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4400ad40 con 0x7f9f4c105f00 2024-05-09T00:01:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f49ffb700 1 -- 172.21.15.81:0/1418636326 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f440128e0 con 0x7f9f4c105f00 2024-05-09T00:01:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f531eb700 1 -- 172.21.15.81:0/1418636326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4c19c960 con 0x7f9f4c105f00 2024-05-09T00:01:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f49ffb700 1 -- 172.21.15.81:0/1418636326 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f440116b0 con 0x7f9f4c105f00 2024-05-09T00:01:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.219+0000 7f9f531eb700 1 -- 172.21.15.81:0/1418636326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4c1a41c0 con 0x7f9f4c105f00 2024-05-09T00:01:14.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.220+0000 7f9f531eb700 1 -- 172.21.15.81:0/1418636326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4c1015b0 con 0x7f9f4c105f00 2024-05-09T00:01:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.221+0000 7f9f49ffb700 1 -- 172.21.15.81:0/1418636326 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f9f44012420 con 0x7f9f4c105f00 2024-05-09T00:01:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.222+0000 7f9f49ffb700 1 --2- 172.21.15.81:0/1418636326 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9f3c0a11a0 0x7f9f3c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.222+0000 7f9f50f87700 1 --2- 172.21.15.81:0/1418636326 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9f3c0a11a0 0x7f9f3c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.222+0000 7f9f49ffb700 1 -- 172.21.15.81:0/1418636326 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9f440cc740 con 0x7f9f4c105f00 2024-05-09T00:01:14.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.222+0000 7f9f50f87700 1 --2- 172.21.15.81:0/1418636326 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9f3c0a11a0 0x7f9f3c0a3660 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9f400098e0 tx=0x7f9f40005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:14.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.226+0000 7f9f49ffb700 1 -- 172.21.15.81:0/1418636326 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9f440962d0 con 0x7f9f4c105f00 2024-05-09T00:01:14.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.420+0000 7f9f531eb700 1 -- 172.21.15.81:0/1418636326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f4c198760 con 0x7f9f4c105f00 2024-05-09T00:01:14.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.421+0000 7f9f49ffb700 1 -- 172.21.15.81:0/1418636326 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18398 (secure 0 0 0) 0x7f9f440998f0 con 0x7f9f4c105f00 2024-05-09T00:01:14.416 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:14.416 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:01:13.402033+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:01:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.423+0000 7f9f531eb700 1 -- 172.21.15.81:0/1418636326 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9f3c0a11a0 msgr2=0x7f9f3c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.423+0000 7f9f531eb700 1 --2- 172.21.15.81:0/1418636326 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9f3c0a11a0 0x7f9f3c0a3660 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9f400098e0 tx=0x7f9f40005960 comp rx=0 tx=0).stop 2024-05-09T00:01:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.423+0000 7f9f531eb700 1 -- 172.21.15.81:0/1418636326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4c105f00 msgr2=0x7f9f4c19bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.423+0000 7f9f531eb700 1 --2- 172.21.15.81:0/1418636326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4c105f00 0x7f9f4c19bd40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9f44007d70 tx=0x7f9f4400a340 comp rx=0 tx=0).stop 2024-05-09T00:01:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.423+0000 7f9f531eb700 1 -- 172.21.15.81:0/1418636326 shutdown_connections 2024-05-09T00:01:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.423+0000 7f9f531eb700 1 --2- 172.21.15.81:0/1418636326 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9f3c0a11a0 0x7f9f3c0a3660 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:14.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.423+0000 7f9f531eb700 1 --2- 172.21.15.81:0/1418636326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f4c105f00 0x7f9f4c19bd40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.423+0000 7f9f531eb700 1 --2- 172.21.15.81:0/1418636326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9f4c0ffed0 0x7f9f4c1974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.423+0000 7f9f531eb700 1 --2- 172.21.15.81:0/1418636326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9f4c100890 0x7f9f4c1979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.423+0000 7f9f531eb700 1 -- 172.21.15.81:0/1418636326 >> 172.21.15.81:0/1418636326 conn(0x7f9f4c075f80 msgr2=0x7f9f4c068bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.423+0000 7f9f531eb700 1 -- 172.21.15.81:0/1418636326 shutdown_connections 2024-05-09T00:01:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:14.423+0000 7f9f531eb700 1 -- 172.21.15.81:0/1418636326 wait complete. 2024-05-09T00:01:14.706 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:14 smithi081 ceph-mon[42474]: osdmap e75: 12 total, 12 up, 12 in 2024-05-09T00:01:14.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:14 smithi150 ceph-mon[46187]: osdmap e75: 12 total, 12 up, 12 in 2024-05-09T00:01:14.773 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:58:34.523249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:01:14.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-09T00:01:14.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:14 smithi171 ceph-mon[47351]: osdmap e75: 12 total, 12 up, 12 in 2024-05-09T00:01:14.993 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:01:15.736 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:15 smithi081 ceph-mon[42474]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:15.736 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:15 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1418636326' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:15.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:15 smithi150 ceph-mon[46187]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:15.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:15 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1418636326' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:15.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:15 smithi171 ceph-mon[47351]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:15.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:15 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1418636326' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 -- 172.21.15.81:0/398793460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8760068950 msgr2=0x7f8760068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 --2- 172.21.15.81:0/398793460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8760068950 0x7f8760068db0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8750009990 tx=0x7f8750009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 -- 172.21.15.81:0/398793460 shutdown_connections 2024-05-09T00:01:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 --2- 172.21.15.81:0/398793460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f87600692f0 0x7f876010de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 --2- 172.21.15.81:0/398793460 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8760107020 0x7f8760107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 --2- 172.21.15.81:0/398793460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8760068950 0x7f8760068db0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 -- 172.21.15.81:0/398793460 >> 172.21.15.81:0/398793460 conn(0x7f8760075f80 msgr2=0x7f8760076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:15.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 -- 172.21.15.81:0/398793460 shutdown_connections 2024-05-09T00:01:15.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 -- 172.21.15.81:0/398793460 wait complete. 2024-05-09T00:01:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 Processor -- start 2024-05-09T00:01:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 -- start start 2024-05-09T00:01:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8760068950 0x7f8760197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87600692f0 0x7f8760197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8760107020 0x7f876019bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876019c400 con 0x7f87600692f0 2024-05-09T00:01:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876019c570 con 0x7f8760107020 2024-05-09T00:01:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.922+0000 7f8767bac700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876019c730 con 0x7f8760068950 2024-05-09T00:01:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8765147700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87600692f0 0x7f8760197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8765147700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87600692f0 0x7f8760197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41470/0 (socket says 172.21.15.81:41470) 2024-05-09T00:01:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8765147700 1 -- 172.21.15.81:0/2837602111 learned_addr learned my addr 172.21.15.81:0/2837602111 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8765948700 1 --2- 172.21.15.81:0/2837602111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8760068950 0x7f8760197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8765147700 1 -- 172.21.15.81:0/2837602111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8760068950 msgr2=0x7f8760197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8765147700 1 --2- 172.21.15.81:0/2837602111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8760068950 0x7f8760197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8765147700 1 -- 172.21.15.81:0/2837602111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8760107020 msgr2=0x7f876019bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8765147700 1 --2- 172.21.15.81:0/2837602111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8760107020 0x7f876019bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8765147700 1 -- 172.21.15.81:0/2837602111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87500095f0 con 0x7f87600692f0 2024-05-09T00:01:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8765147700 1 --2- 172.21.15.81:0/2837602111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87600692f0 0x7f8760197a40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8750000c00 tx=0x7f875000f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8756ffd700 1 -- 172.21.15.81:0/2837602111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875001d070 con 0x7f87600692f0 2024-05-09T00:01:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8767bac700 1 -- 172.21.15.81:0/2837602111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876019c9b0 con 0x7f87600692f0 2024-05-09T00:01:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8756ffd700 1 -- 172.21.15.81:0/2837602111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f875000fca0 con 0x7f87600692f0 2024-05-09T00:01:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8756ffd700 1 -- 172.21.15.81:0/2837602111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750017750 con 0x7f87600692f0 2024-05-09T00:01:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.923+0000 7f8767bac700 1 -- 172.21.15.81:0/2837602111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87601a4270 con 0x7f87600692f0 2024-05-09T00:01:15.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.924+0000 7f8767bac700 1 -- 172.21.15.81:0/2837602111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8760109540 con 0x7f87600692f0 2024-05-09T00:01:15.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.925+0000 7f8756ffd700 1 -- 172.21.15.81:0/2837602111 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8750022470 con 0x7f87600692f0 2024-05-09T00:01:15.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.926+0000 7f8756ffd700 1 --2- 172.21.15.81:0/2837602111 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f874c0a11a0 0x7f874c0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:15.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.926+0000 7f8765948700 1 --2- 172.21.15.81:0/2837602111 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f874c0a11a0 0x7f874c0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:15.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.926+0000 7f8756ffd700 1 -- 172.21.15.81:0/2837602111 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f87500cde50 con 0x7f87600692f0 2024-05-09T00:01:15.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.926+0000 7f8765948700 1 --2- 172.21.15.81:0/2837602111 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f874c0a11a0 0x7f874c0a3660 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f875c006fd0 tx=0x7f875c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:15.929+0000 7f8756ffd700 1 -- 172.21.15.81:0/2837602111 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8750097a70 con 0x7f87600692f0 2024-05-09T00:01:16.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:16.121+0000 7f8767bac700 1 -- 172.21.15.81:0/2837602111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8760198810 con 0x7f87600692f0 2024-05-09T00:01:16.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:16.121+0000 7f8756ffd700 1 -- 172.21.15.81:0/2837602111 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f875009b090 con 0x7f87600692f0 2024-05-09T00:01:16.115 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-09T00:01:16.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:16.123+0000 7f8767bac700 1 -- 172.21.15.81:0/2837602111 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f874c0a11a0 msgr2=0x7f874c0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:16.123+0000 7f8767bac700 1 --2- 172.21.15.81:0/2837602111 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f874c0a11a0 0x7f874c0a3660 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f875c006fd0 tx=0x7f875c008040 comp rx=0 tx=0).stop 2024-05-09T00:01:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:16.123+0000 7f8767bac700 1 -- 172.21.15.81:0/2837602111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87600692f0 msgr2=0x7f8760197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:16.123+0000 7f8767bac700 1 --2- 172.21.15.81:0/2837602111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87600692f0 0x7f8760197a40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8750000c00 tx=0x7f875000f7b0 comp rx=0 tx=0).stop 2024-05-09T00:01:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:16.123+0000 7f8767bac700 1 -- 172.21.15.81:0/2837602111 shutdown_connections 2024-05-09T00:01:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:16.123+0000 7f8767bac700 1 --2- 172.21.15.81:0/2837602111 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f874c0a11a0 0x7f874c0a3660 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:16.123+0000 7f8767bac700 1 --2- 172.21.15.81:0/2837602111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8760107020 0x7f876019bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:16.123+0000 7f8767bac700 1 --2- 172.21.15.81:0/2837602111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8760068950 0x7f8760197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:16.123+0000 7f8767bac700 1 --2- 172.21.15.81:0/2837602111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87600692f0 0x7f8760197a40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:16.123+0000 7f8767bac700 1 -- 172.21.15.81:0/2837602111 >> 172.21.15.81:0/2837602111 conn(0x7f8760075f80 msgr2=0x7f87600fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:16.123+0000 7f8767bac700 1 -- 172.21.15.81:0/2837602111 shutdown_connections 2024-05-09T00:01:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:16.124+0000 7f8767bac700 1 -- 172.21.15.81:0/2837602111 wait complete. 2024-05-09T00:01:16.449 INFO:tasks.cephadm:Adding mds.a on smithi081 2024-05-09T00:01:16.449 INFO:tasks.cephadm:Adding mds.d on smithi081 2024-05-09T00:01:16.449 INFO:tasks.cephadm:Adding mds.g on smithi081 2024-05-09T00:01:16.449 INFO:tasks.cephadm:Adding mds.j on smithi081 2024-05-09T00:01:16.449 INFO:tasks.cephadm:Adding mds.b on smithi150 2024-05-09T00:01:16.449 INFO:tasks.cephadm:Adding mds.e on smithi150 2024-05-09T00:01:16.449 INFO:tasks.cephadm:Adding mds.h on smithi150 2024-05-09T00:01:16.449 INFO:tasks.cephadm:Adding mds.k on smithi150 2024-05-09T00:01:16.449 INFO:tasks.cephadm:Adding mds.c on smithi171 2024-05-09T00:01:16.449 INFO:tasks.cephadm:Adding mds.f on smithi171 2024-05-09T00:01:16.449 INFO:tasks.cephadm:Adding mds.i on smithi171 2024-05-09T00:01:16.449 INFO:tasks.cephadm:Adding mds.l on smithi171 2024-05-09T00:01:16.450 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph orch apply mds all '12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l' 2024-05-09T00:01:16.686 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:01:16.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:16 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2837602111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:01:16.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:16 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2837602111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:01:16.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:16 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2837602111' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:01:17.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.703+0000 7ffb1b62e700 1 -- 172.21.15.171:0/3442142661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb14101a20 msgr2=0x7ffb14108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:17.699 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.703+0000 7ffb1b62e700 1 --2- 172.21.15.171:0/3442142661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb14101a20 0x7ffb14108340 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00b0a0 tx=0x7ffb0c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:17.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.703+0000 7ffb1b62e700 1 -- 172.21.15.171:0/3442142661 shutdown_connections 2024-05-09T00:01:17.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.703+0000 7ffb1b62e700 1 --2- 172.21.15.171:0/3442142661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb14101a20 0x7ffb14108340 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:17.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.703+0000 7ffb1b62e700 1 --2- 172.21.15.171:0/3442142661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb140fff00 0x7ffb14100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:17.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.703+0000 7ffb1b62e700 1 --2- 172.21.15.171:0/3442142661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb14101060 0x7ffb141014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:17.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.704+0000 7ffb1b62e700 1 -- 172.21.15.171:0/3442142661 >> 172.21.15.171:0/3442142661 conn(0x7ffb140fb4a0 msgr2=0x7ffb140fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:17.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.704+0000 7ffb1b62e700 1 -- 172.21.15.171:0/3442142661 shutdown_connections 2024-05-09T00:01:17.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.704+0000 7ffb1b62e700 1 -- 172.21.15.171:0/3442142661 wait complete. 2024-05-09T00:01:17.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.704+0000 7ffb1b62e700 1 Processor -- start 2024-05-09T00:01:17.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.704+0000 7ffb1b62e700 1 -- start start 2024-05-09T00:01:17.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.704+0000 7ffb1b62e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb140fff00 0x7ffb14195c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:17.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.704+0000 7ffb1b62e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb14101060 0x7ffb14196140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:17.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.704+0000 7ffb1b62e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb14101a20 0x7ffb1419d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:17.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.704+0000 7ffb1b62e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1419d740 con 0x7ffb140fff00 2024-05-09T00:01:17.700 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.704+0000 7ffb1b62e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1419d880 con 0x7ffb14101060 2024-05-09T00:01:17.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.704+0000 7ffb1b62e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb14069660 con 0x7ffb14101a20 2024-05-09T00:01:17.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb19bcb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb14101a20 0x7ffb1419d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:17.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb19bcb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb14101a20 0x7ffb1419d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:54644/0 (socket says 172.21.15.171:54644) 2024-05-09T00:01:17.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb19bcb700 1 -- 172.21.15.171:0/2398603473 learned_addr learned my addr 172.21.15.171:0/2398603473 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-05-09T00:01:17.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb193ca700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb140fff00 0x7ffb14195c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:17.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb18bc9700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb14101060 0x7ffb14196140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:17.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb19bcb700 1 -- 172.21.15.171:0/2398603473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb14101060 msgr2=0x7ffb14196140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:17.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb19bcb700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb14101060 0x7ffb14196140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:17.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb19bcb700 1 -- 172.21.15.171:0/2398603473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb140fff00 msgr2=0x7ffb14195c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:17.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb19bcb700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb140fff00 0x7ffb14195c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:17.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb19bcb700 1 -- 172.21.15.171:0/2398603473 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c009d00 con 0x7ffb14101a20 2024-05-09T00:01:17.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb18bc9700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb14101060 0x7ffb14196140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:17.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb19bcb700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb14101a20 0x7ffb1419d170 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009cd0 tx=0x7ffb0c0126a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:17.701 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb0a7fc700 1 -- 172.21.15.171:0/2398603473 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c00e040 con 0x7ffb14101a20 2024-05-09T00:01:17.702 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb1b62e700 1 -- 172.21.15.171:0/2398603473 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb140698e0 con 0x7ffb14101a20 2024-05-09T00:01:17.702 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb0a7fc700 1 -- 172.21.15.171:0/2398603473 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb0c012e70 con 0x7ffb14101a20 2024-05-09T00:01:17.702 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb0a7fc700 1 -- 172.21.15.171:0/2398603473 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c01bc10 con 0x7ffb14101a20 2024-05-09T00:01:17.702 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.705+0000 7ffb1b62e700 1 -- 172.21.15.171:0/2398603473 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb14069e30 con 0x7ffb14101a20 2024-05-09T00:01:17.702 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.706+0000 7ffb1b62e700 1 -- 172.21.15.171:0/2398603473 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb14107250 con 0x7ffb14101a20 2024-05-09T00:01:17.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.707+0000 7ffb0a7fc700 1 -- 172.21.15.171:0/2398603473 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ffb0c01bd70 con 0x7ffb14101a20 2024-05-09T00:01:17.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.708+0000 7ffb0a7fc700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffb000a1120 0x7ffb000a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:17.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.708+0000 7ffb0a7fc700 1 -- 172.21.15.171:0/2398603473 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ffb0c0ce370 con 0x7ffb14101a20 2024-05-09T00:01:17.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.708+0000 7ffb193ca700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffb000a1120 0x7ffb000a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:17.703 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.709+0000 7ffb193ca700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffb000a1120 0x7ffb000a35e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffb04005950 tx=0x7ffb0400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:17.705 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.711+0000 7ffb0a7fc700 1 -- 172.21.15.171:0/2398603473 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ffb0c098030 con 0x7ffb14101a20 2024-05-09T00:01:17.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:17 smithi150 ceph-mon[46187]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:17.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:17 smithi171 ceph-mon[47351]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:17.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:17 smithi081 ceph-mon[42474]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:17.908 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.914+0000 7ffb1b62e700 1 -- 172.21.15.171:0/2398603473 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb1406a050 con 0x7ffb000a1120 2024-05-09T00:01:17.916 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.922+0000 7ffb0a7fc700 1 -- 172.21.15.171:0/2398603473 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7ffb1406a050 con 0x7ffb000a1120 2024-05-09T00:01:17.916 INFO:teuthology.orchestra.run.smithi171.stdout:Scheduled mds.all update... 2024-05-09T00:01:17.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.925+0000 7ffb1b62e700 1 -- 172.21.15.171:0/2398603473 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffb000a1120 msgr2=0x7ffb000a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:17.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.925+0000 7ffb1b62e700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffb000a1120 0x7ffb000a35e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ffb04005950 tx=0x7ffb0400a300 comp rx=0 tx=0).stop 2024-05-09T00:01:17.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.925+0000 7ffb1b62e700 1 -- 172.21.15.171:0/2398603473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb14101a20 msgr2=0x7ffb1419d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:17.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.925+0000 7ffb1b62e700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb14101a20 0x7ffb1419d170 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c009cd0 tx=0x7ffb0c0126a0 comp rx=0 tx=0).stop 2024-05-09T00:01:17.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.925+0000 7ffb1b62e700 1 -- 172.21.15.171:0/2398603473 shutdown_connections 2024-05-09T00:01:17.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.925+0000 7ffb1b62e700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffb000a1120 0x7ffb000a35e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:17.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.925+0000 7ffb1b62e700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb14101a20 0x7ffb1419d170 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:17.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.925+0000 7ffb1b62e700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb140fff00 0x7ffb14195c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:17.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.925+0000 7ffb1b62e700 1 --2- 172.21.15.171:0/2398603473 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb14101060 0x7ffb14196140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:17.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.925+0000 7ffb1b62e700 1 -- 172.21.15.171:0/2398603473 >> 172.21.15.171:0/2398603473 conn(0x7ffb140fb4a0 msgr2=0x7ffb14104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:17.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.925+0000 7ffb1b62e700 1 -- 172.21.15.171:0/2398603473 shutdown_connections 2024-05-09T00:01:17.919 INFO:teuthology.orchestra.run.smithi171.stderr:2024-05-09T00:01:17.925+0000 7ffb1b62e700 1 -- 172.21.15.171:0/2398603473 wait complete. 2024-05-09T00:01:18.338 DEBUG:teuthology.orchestra.run.smithi081:mds.a> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.a.service 2024-05-09T00:01:18.341 DEBUG:teuthology.orchestra.run.smithi081:mds.d> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.d.service 2024-05-09T00:01:18.370 INFO:journalctl@ceph.mds.a.smithi081.stdout:-- Logs begin at Wed 2024-05-08 23:39:48 UTC. -- 2024-05-09T00:01:18.371 DEBUG:teuthology.orchestra.run.smithi081:mds.g> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.g.service 2024-05-09T00:01:18.397 INFO:journalctl@ceph.mds.d.smithi081.stdout:-- Logs begin at Wed 2024-05-08 23:39:48 UTC. -- 2024-05-09T00:01:18.397 DEBUG:teuthology.orchestra.run.smithi081:mds.j> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.j.service 2024-05-09T00:01:18.423 INFO:journalctl@ceph.mds.g.smithi081.stdout:-- Logs begin at Wed 2024-05-08 23:39:48 UTC. -- 2024-05-09T00:01:18.424 DEBUG:teuthology.orchestra.run.smithi150:mds.b> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.b.service 2024-05-09T00:01:18.427 DEBUG:teuthology.orchestra.run.smithi150:mds.e> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.e.service 2024-05-09T00:01:18.450 INFO:journalctl@ceph.mds.j.smithi081.stdout:-- Logs begin at Wed 2024-05-08 23:39:48 UTC. -- 2024-05-09T00:01:18.465 INFO:journalctl@ceph.mds.b.smithi150.stdout:-- Logs begin at Wed 2024-05-08 23:39:53 UTC. -- 2024-05-09T00:01:18.465 DEBUG:teuthology.orchestra.run.smithi150:mds.h> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.h.service 2024-05-09T00:01:18.494 INFO:journalctl@ceph.mds.e.smithi150.stdout:-- Logs begin at Wed 2024-05-08 23:39:53 UTC. -- 2024-05-09T00:01:18.495 DEBUG:teuthology.orchestra.run.smithi150:mds.k> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.k.service 2024-05-09T00:01:18.523 INFO:journalctl@ceph.mds.h.smithi150.stdout:-- Logs begin at Wed 2024-05-08 23:39:53 UTC. -- 2024-05-09T00:01:18.524 DEBUG:teuthology.orchestra.run.smithi171:mds.c> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.c.service 2024-05-09T00:01:18.527 DEBUG:teuthology.orchestra.run.smithi171:mds.f> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.f.service 2024-05-09T00:01:18.550 INFO:journalctl@ceph.mds.k.smithi150.stdout:-- Logs begin at Wed 2024-05-08 23:39:53 UTC. -- 2024-05-09T00:01:18.557 INFO:journalctl@ceph.mds.c.smithi171.stdout:-- Logs begin at Wed 2024-05-08 23:40:11 UTC. -- 2024-05-09T00:01:18.559 DEBUG:teuthology.orchestra.run.smithi171:mds.i> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.i.service 2024-05-09T00:01:18.587 INFO:journalctl@ceph.mds.f.smithi171.stdout:-- Logs begin at Wed 2024-05-08 23:40:11 UTC. -- 2024-05-09T00:01:18.588 DEBUG:teuthology.orchestra.run.smithi171:mds.l> sudo journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.l.service 2024-05-09T00:01:18.616 INFO:journalctl@ceph.mds.i.smithi171.stdout:-- Logs begin at Wed 2024-05-08 23:40:11 UTC. -- 2024-05-09T00:01:18.617 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-09T00:01:18.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:01:18.645 INFO:journalctl@ceph.mds.l.smithi171.stdout:-- Logs begin at Wed 2024-05-08 23:40:11 UTC. -- 2024-05-09T00:01:18.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.757+0000 7fe48c4f5700 1 -- 172.21.15.81:0/3207296093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe484100f80 msgr2=0x7fe4841013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:18.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.757+0000 7fe48c4f5700 1 --2- 172.21.15.81:0/3207296093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe484100f80 0x7fe4841013e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe4740099c0 tx=0x7fe474009cd0 comp rx=0 tx=0).stop 2024-05-09T00:01:18.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.757+0000 7fe48c4f5700 1 -- 172.21.15.81:0/3207296093 shutdown_connections 2024-05-09T00:01:18.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.757+0000 7fe48c4f5700 1 --2- 172.21.15.81:0/3207296093 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe484101920 0x7fe4841081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:18.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.757+0000 7fe48c4f5700 1 --2- 172.21.15.81:0/3207296093 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4840ffd90 0x7fe4841001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:18.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.757+0000 7fe48c4f5700 1 --2- 172.21.15.81:0/3207296093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe484100f80 0x7fe4841013e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:18.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.757+0000 7fe48c4f5700 1 -- 172.21.15.81:0/3207296093 >> 172.21.15.81:0/3207296093 conn(0x7fe4840fb300 msgr2=0x7fe4840fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:18.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.757+0000 7fe48c4f5700 1 -- 172.21.15.81:0/3207296093 shutdown_connections 2024-05-09T00:01:18.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.757+0000 7fe48c4f5700 1 -- 172.21.15.81:0/3207296093 wait complete. 2024-05-09T00:01:18.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.757+0000 7fe48c4f5700 1 Processor -- start 2024-05-09T00:01:18.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.757+0000 7fe48c4f5700 1 -- start start 2024-05-09T00:01:18.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe48c4f5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4840ffd90 0x7fe484196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe48c4f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe484100f80 0x7fe484197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe48c4f5700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe484101920 0x7fe48419e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe48c4f5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48419e9e0 con 0x7fe484100f80 2024-05-09T00:01:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe48c4f5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48419eb20 con 0x7fe4840ffd90 2024-05-09T00:01:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe48c4f5700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48419ecb0 con 0x7fe484101920 2024-05-09T00:01:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe489a90700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe484100f80 0x7fe484197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe489a90700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe484100f80 0x7fe484197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59768/0 (socket says 172.21.15.81:59768) 2024-05-09T00:01:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe489a90700 1 -- 172.21.15.81:0/667780743 learned_addr learned my addr 172.21.15.81:0/667780743 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe48aa92700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe484101920 0x7fe48419e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe48a291700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4840ffd90 0x7fe484196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe489a90700 1 -- 172.21.15.81:0/667780743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe484101920 msgr2=0x7fe48419e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe489a90700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe484101920 0x7fe48419e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:18.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe489a90700 1 -- 172.21.15.81:0/667780743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4840ffd90 msgr2=0x7fe484196f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe489a90700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4840ffd90 0x7fe484196f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe489a90700 1 -- 172.21.15.81:0/667780743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4740095f0 con 0x7fe484100f80 2024-05-09T00:01:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe48aa92700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe484101920 0x7fe48419e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe48a291700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4840ffd90 0x7fe484196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:01:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe489a90700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe484100f80 0x7fe484197440 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe474006010 tx=0x7fe474005af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe47b7fe700 1 -- 172.21.15.81:0/667780743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47401d070 con 0x7fe484100f80 2024-05-09T00:01:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe47b7fe700 1 -- 172.21.15.81:0/667780743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe474004150 con 0x7fe484100f80 2024-05-09T00:01:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe48c4f5700 1 -- 172.21.15.81:0/667780743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48419ef30 con 0x7fe484100f80 2024-05-09T00:01:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe47b7fe700 1 -- 172.21.15.81:0/667780743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474021410 con 0x7fe484100f80 2024-05-09T00:01:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.758+0000 7fe48c4f5700 1 -- 172.21.15.81:0/667780743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48419f350 con 0x7fe484100f80 2024-05-09T00:01:18.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.759+0000 7fe48c4f5700 1 -- 172.21.15.81:0/667780743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe484068060 con 0x7fe484100f80 2024-05-09T00:01:18.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.760+0000 7fe47b7fe700 1 -- 172.21.15.81:0/667780743 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe47400f6f0 con 0x7fe484100f80 2024-05-09T00:01:18.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.761+0000 7fe47b7fe700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe4700a11a0 0x7fe4700a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:18.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.761+0000 7fe48a291700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe4700a11a0 0x7fe4700a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:18.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.761+0000 7fe47b7fe700 1 -- 172.21.15.81:0/667780743 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe4740cd7d0 con 0x7fe484100f80 2024-05-09T00:01:18.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.761+0000 7fe48a291700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe4700a11a0 0x7fe4700a3660 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe484100de0 tx=0x7fe480008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:18.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.764+0000 7fe47b7fe700 1 -- 172.21.15.81:0/667780743 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe474097490 con 0x7fe484100f80 2024-05-09T00:01:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.965+0000 7fe48c4f5700 1 -- 172.21.15.81:0/667780743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe48410b690 con 0x7fe484100f80 2024-05-09T00:01:18.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.967+0000 7fe47b7fe700 1 -- 172.21.15.81:0/667780743 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18398 (secure 0 0 0) 0x7fe47409aab0 con 0x7fe484100f80 2024-05-09T00:01:18.961 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:18.961 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:01:13.402033+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:01:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.969+0000 7fe48c4f5700 1 -- 172.21.15.81:0/667780743 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe4700a11a0 msgr2=0x7fe4700a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.969+0000 7fe48c4f5700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe4700a11a0 0x7fe4700a3660 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe484100de0 tx=0x7fe480008040 comp rx=0 tx=0).stop 2024-05-09T00:01:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.969+0000 7fe48c4f5700 1 -- 172.21.15.81:0/667780743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe484100f80 msgr2=0x7fe484197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.969+0000 7fe48c4f5700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe484100f80 0x7fe484197440 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe474006010 tx=0x7fe474005af0 comp rx=0 tx=0).stop 2024-05-09T00:01:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.969+0000 7fe48c4f5700 1 -- 172.21.15.81:0/667780743 shutdown_connections 2024-05-09T00:01:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.969+0000 7fe48c4f5700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fe4700a11a0 0x7fe4700a3660 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:18.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.969+0000 7fe48c4f5700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4840ffd90 0x7fe484196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:18.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.969+0000 7fe48c4f5700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe484101920 0x7fe48419e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:18.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.969+0000 7fe48c4f5700 1 --2- 172.21.15.81:0/667780743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe484100f80 0x7fe484197440 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:18.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.969+0000 7fe48c4f5700 1 -- 172.21.15.81:0/667780743 >> 172.21.15.81:0/667780743 conn(0x7fe4840fb300 msgr2=0x7fe4840fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:18.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.969+0000 7fe48c4f5700 1 -- 172.21.15.81:0/667780743 shutdown_connections 2024-05-09T00:01:18.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:18.969+0000 7fe48c4f5700 1 -- 172.21.15.81:0/667780743 wait complete. 2024-05-09T00:01:18.976 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:58:34.523249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:01:18.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:01:19.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.106+0000 7fbe37f86700 1 -- 172.21.15.81:0/480440239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe30102220 msgr2=0x7fbe30102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.106+0000 7fbe37f86700 1 --2- 172.21.15.81:0/480440239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe30102220 0x7fbe30102680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c009990 tx=0x7fbe2c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.106+0000 7fbe37f86700 1 -- 172.21.15.81:0/480440239 shutdown_connections 2024-05-09T00:01:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.106+0000 7fbe37f86700 1 --2- 172.21.15.81:0/480440239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe30102bc0 0x7fbe30109470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.106+0000 7fbe37f86700 1 --2- 172.21.15.81:0/480440239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe300ff250 0x7fbe300ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.106+0000 7fbe37f86700 1 --2- 172.21.15.81:0/480440239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe30102220 0x7fbe30102680 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.106+0000 7fbe37f86700 1 -- 172.21.15.81:0/480440239 >> 172.21.15.81:0/480440239 conn(0x7fbe300fab80 msgr2=0x7fbe300fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.106+0000 7fbe37f86700 1 -- 172.21.15.81:0/480440239 shutdown_connections 2024-05-09T00:01:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.106+0000 7fbe37f86700 1 -- 172.21.15.81:0/480440239 wait complete. 2024-05-09T00:01:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.106+0000 7fbe37f86700 1 Processor -- start 2024-05-09T00:01:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.106+0000 7fbe37f86700 1 -- start start 2024-05-09T00:01:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe37f86700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe300ff250 0x7fbe30196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe37f86700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe30102220 0x7fbe30197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe37f86700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe30102bc0 0x7fbe3019e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe37f86700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3019ea70 con 0x7fbe30102220 2024-05-09T00:01:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe37f86700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3019ebb0 con 0x7fbe300ff250 2024-05-09T00:01:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe37f86700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3019ed40 con 0x7fbe30102bc0 2024-05-09T00:01:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe35521700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe30102220 0x7fbe30197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe35521700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe30102220 0x7fbe30197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59786/0 (socket says 172.21.15.81:59786) 2024-05-09T00:01:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe35521700 1 -- 172.21.15.81:0/732088096 learned_addr learned my addr 172.21.15.81:0/732088096 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe36523700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe30102bc0 0x7fbe3019e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe35d22700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe300ff250 0x7fbe30196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe35521700 1 -- 172.21.15.81:0/732088096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe30102bc0 msgr2=0x7fbe3019e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe35521700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe30102bc0 0x7fbe3019e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe35521700 1 -- 172.21.15.81:0/732088096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe300ff250 msgr2=0x7fbe30196f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:19.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe35521700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe300ff250 0x7fbe30196f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe35521700 1 -- 172.21.15.81:0/732088096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c0095f0 con 0x7fbe30102220 2024-05-09T00:01:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe35d22700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe300ff250 0x7fbe30196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe35521700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe30102220 0x7fbe30197480 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c0095c0 tx=0x7fbe2c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe26ffd700 1 -- 172.21.15.81:0/732088096 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c01d070 con 0x7fbe30102220 2024-05-09T00:01:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe26ffd700 1 -- 172.21.15.81:0/732088096 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe2c022470 con 0x7fbe30102220 2024-05-09T00:01:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe37f86700 1 -- 172.21.15.81:0/732088096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3019efc0 con 0x7fbe30102220 2024-05-09T00:01:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe26ffd700 1 -- 172.21.15.81:0/732088096 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c017650 con 0x7fbe30102220 2024-05-09T00:01:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.107+0000 7fbe37f86700 1 -- 172.21.15.81:0/732088096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3019f380 con 0x7fbe30102220 2024-05-09T00:01:19.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.108+0000 7fbe37f86700 1 -- 172.21.15.81:0/732088096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe301084d0 con 0x7fbe30102220 2024-05-09T00:01:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.110+0000 7fbe26ffd700 1 -- 172.21.15.81:0/732088096 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbe2c022890 con 0x7fbe30102220 2024-05-09T00:01:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.110+0000 7fbe26ffd700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbe1c0a1120 0x7fbe1c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.110+0000 7fbe35d22700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbe1c0a1120 0x7fbe1c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.111+0000 7fbe26ffd700 1 -- 172.21.15.81:0/732088096 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbe2c0cdc40 con 0x7fbe30102220 2024-05-09T00:01:19.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.111+0000 7fbe35d22700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbe1c0a1120 0x7fbe1c0a35e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe20005950 tx=0x7fbe200058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:19.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.114+0000 7fbe26ffd700 1 -- 172.21.15.81:0/732088096 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbe2c0978e0 con 0x7fbe30102220 2024-05-09T00:01:19.162 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:18 smithi171 ceph-mon[47351]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:19.162 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:18 smithi171 ceph-mon[47351]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-05-09T00:01:19.162 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:19.162 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:19.162 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:18 smithi171 ceph-mon[47351]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:19.162 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:19.163 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:19.163 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:19.163 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:19.163 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:19.163 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:18 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:19.163 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:18 smithi171 ceph-mon[47351]: Deploying daemon mds.l on smithi171 2024-05-09T00:01:19.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:18 smithi150 ceph-mon[46187]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:19.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:18 smithi150 ceph-mon[46187]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-05-09T00:01:19.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:19.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:19.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:18 smithi150 ceph-mon[46187]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:19.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:19.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:19.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:19.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:19.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:19.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:18 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:19.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:18 smithi150 ceph-mon[46187]: Deploying daemon mds.l on smithi171 2024-05-09T00:01:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.307+0000 7fbe37f86700 1 -- 172.21.15.81:0/732088096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe3010c7f0 con 0x7fbe30102220 2024-05-09T00:01:19.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.308+0000 7fbe26ffd700 1 -- 172.21.15.81:0/732088096 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe2c09af00 con 0x7fbe30102220 2024-05-09T00:01:19.302 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-09T00:01:19.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.310+0000 7fbe37f86700 1 -- 172.21.15.81:0/732088096 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbe1c0a1120 msgr2=0x7fbe1c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:19.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.310+0000 7fbe37f86700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbe1c0a1120 0x7fbe1c0a35e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe20005950 tx=0x7fbe200058e0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.310+0000 7fbe37f86700 1 -- 172.21.15.81:0/732088096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe30102220 msgr2=0x7fbe30197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:19.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.310+0000 7fbe37f86700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe30102220 0x7fbe30197480 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c0095c0 tx=0x7fbe2c00f690 comp rx=0 tx=0).stop 2024-05-09T00:01:19.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.310+0000 7fbe37f86700 1 -- 172.21.15.81:0/732088096 shutdown_connections 2024-05-09T00:01:19.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.310+0000 7fbe37f86700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbe1c0a1120 0x7fbe1c0a35e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.310+0000 7fbe37f86700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbe300ff250 0x7fbe30196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.310+0000 7fbe37f86700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbe30102bc0 0x7fbe3019e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.310+0000 7fbe37f86700 1 --2- 172.21.15.81:0/732088096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe30102220 0x7fbe30197480 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.310+0000 7fbe37f86700 1 -- 172.21.15.81:0/732088096 >> 172.21.15.81:0/732088096 conn(0x7fbe300fab80 msgr2=0x7fbe30105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.310+0000 7fbe37f86700 1 -- 172.21.15.81:0/732088096 shutdown_connections 2024-05-09T00:01:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.310+0000 7fbe37f86700 1 -- 172.21.15.81:0/732088096 wait complete. 2024-05-09T00:01:19.315 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:18 smithi081 ceph-mon[42474]: from='client.24403 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:19.315 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:18 smithi081 ceph-mon[42474]: Saving service mds.all spec with placement smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-05-09T00:01:19.315 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:19.315 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:19.315 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:18 smithi081 ceph-mon[42474]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:19.315 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:19.315 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:19.315 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:19.316 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:19.316 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:19.316 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:18 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:19.316 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:18 smithi081 ceph-mon[42474]: Deploying daemon mds.l on smithi171 2024-05-09T00:01:19.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:01:19.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.444+0000 7fdeeabc4700 1 -- 172.21.15.81:0/401447542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4101970 msgr2=0x7fdee4103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:19.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.444+0000 7fdeeabc4700 1 --2- 172.21.15.81:0/401447542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4101970 0x7fdee4103d60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fded8009990 tx=0x7fded8009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.444+0000 7fdeeabc4700 1 -- 172.21.15.81:0/401447542 shutdown_connections 2024-05-09T00:01:19.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.444+0000 7fdeeabc4700 1 --2- 172.21.15.81:0/401447542 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdee4106bd0 0x7fdee4108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.444+0000 7fdeeabc4700 1 --2- 172.21.15.81:0/401447542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4101970 0x7fdee4103d60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.444+0000 7fdeeabc4700 1 --2- 172.21.15.81:0/401447542 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdee41042a0 0x7fdee4106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.444+0000 7fdeeabc4700 1 -- 172.21.15.81:0/401447542 >> 172.21.15.81:0/401447542 conn(0x7fdee40fb300 msgr2=0x7fdee40fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:19.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.444+0000 7fdeeabc4700 1 -- 172.21.15.81:0/401447542 shutdown_connections 2024-05-09T00:01:19.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.444+0000 7fdeeabc4700 1 -- 172.21.15.81:0/401447542 wait complete. 2024-05-09T00:01:19.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdeeabc4700 1 Processor -- start 2024-05-09T00:01:19.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdeeabc4700 1 -- start start 2024-05-09T00:01:19.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdeeabc4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4101970 0x7fdee4196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:19.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdeeabc4700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdee41042a0 0x7fdee4197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:19.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdeeabc4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdee4106bd0 0x7fdee419e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:19.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdeeabc4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee419e960 con 0x7fdee4101970 2024-05-09T00:01:19.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdeeabc4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee419eaa0 con 0x7fdee4106bd0 2024-05-09T00:01:19.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdeeabc4700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee419ec30 con 0x7fdee41042a0 2024-05-09T00:01:19.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdee8960700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4101970 0x7fdee4196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:19.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdee8960700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4101970 0x7fdee4196e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59814/0 (socket says 172.21.15.81:59814) 2024-05-09T00:01:19.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdee8960700 1 -- 172.21.15.81:0/4276223399 learned_addr learned my addr 172.21.15.81:0/4276223399 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:19.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdee3fff700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdee41042a0 0x7fdee4197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:19.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdee9161700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdee4106bd0 0x7fdee419e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:19.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdee8960700 1 -- 172.21.15.81:0/4276223399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdee41042a0 msgr2=0x7fdee4197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:19.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdee8960700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdee41042a0 0x7fdee4197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdee8960700 1 -- 172.21.15.81:0/4276223399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdee4106bd0 msgr2=0x7fdee419e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:19.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdee8960700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdee4106bd0 0x7fdee419e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdee8960700 1 -- 172.21.15.81:0/4276223399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded80095f0 con 0x7fdee4101970 2024-05-09T00:01:19.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdee3fff700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdee41042a0 0x7fdee4197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:19.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdee8960700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4101970 0x7fdee4196e30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fded80095c0 tx=0x7fded800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:19.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdee1ffb700 1 -- 172.21.15.81:0/4276223399 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded801d070 con 0x7fdee4101970 2024-05-09T00:01:19.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.445+0000 7fdee1ffb700 1 -- 172.21.15.81:0/4276223399 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fded800fb80 con 0x7fdee4101970 2024-05-09T00:01:19.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.446+0000 7fdeeabc4700 1 -- 172.21.15.81:0/4276223399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee419eeb0 con 0x7fdee4101970 2024-05-09T00:01:19.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.446+0000 7fdee1ffb700 1 -- 172.21.15.81:0/4276223399 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8017650 con 0x7fdee4101970 2024-05-09T00:01:19.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.446+0000 7fdeeabc4700 1 -- 172.21.15.81:0/4276223399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee419f270 con 0x7fdee4101970 2024-05-09T00:01:19.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.447+0000 7fdeeabc4700 1 -- 172.21.15.81:0/4276223399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee40fce80 con 0x7fdee4101970 2024-05-09T00:01:19.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.448+0000 7fdee1ffb700 1 -- 172.21.15.81:0/4276223399 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fded8022470 con 0x7fdee4101970 2024-05-09T00:01:19.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.448+0000 7fdee1ffb700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fded40a11a0 0x7fded40a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:19.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.448+0000 7fdee3fff700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fded40a11a0 0x7fded40a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:19.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.448+0000 7fdee1ffb700 1 -- 172.21.15.81:0/4276223399 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fded80cddf0 con 0x7fdee4101970 2024-05-09T00:01:19.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.449+0000 7fdee3fff700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fded40a11a0 0x7fded40a3660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fded0005950 tx=0x7fded00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:19.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.452+0000 7fdee1ffb700 1 -- 172.21.15.81:0/4276223399 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fded8097ab0 con 0x7fdee4101970 2024-05-09T00:01:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.694+0000 7fdeeabc4700 1 -- 172.21.15.81:0/4276223399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdee410c9f0 con 0x7fdee4101970 2024-05-09T00:01:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.694+0000 7fdee1ffb700 1 -- 172.21.15.81:0/4276223399 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7fded809b0d0 con 0x7fdee4101970 2024-05-09T00:01:19.689 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:19.689 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-09T00:01:19.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.696+0000 7fdeeabc4700 1 -- 172.21.15.81:0/4276223399 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fded40a11a0 msgr2=0x7fded40a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.696+0000 7fdeeabc4700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fded40a11a0 0x7fded40a3660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fded0005950 tx=0x7fded00058e0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.696+0000 7fdeeabc4700 1 -- 172.21.15.81:0/4276223399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4101970 msgr2=0x7fdee4196e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.696+0000 7fdeeabc4700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4101970 0x7fdee4196e30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fded80095c0 tx=0x7fded800f690 comp rx=0 tx=0).stop 2024-05-09T00:01:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.696+0000 7fdeeabc4700 1 -- 172.21.15.81:0/4276223399 shutdown_connections 2024-05-09T00:01:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.696+0000 7fdeeabc4700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fded40a11a0 0x7fded40a3660 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.696+0000 7fdeeabc4700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdee4106bd0 0x7fdee419e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.696+0000 7fdeeabc4700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdee4101970 0x7fdee4196e30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.696+0000 7fdeeabc4700 1 --2- 172.21.15.81:0/4276223399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdee41042a0 0x7fdee4197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.696+0000 7fdeeabc4700 1 -- 172.21.15.81:0/4276223399 >> 172.21.15.81:0/4276223399 conn(0x7fdee40fb300 msgr2=0x7fdee41022d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.696+0000 7fdeeabc4700 1 -- 172.21.15.81:0/4276223399 shutdown_connections 2024-05-09T00:01:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:19.697+0000 7fdeeabc4700 1 -- 172.21.15.81:0/4276223399 wait complete. 2024-05-09T00:01:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 1 2024-05-09T00:01:19.802 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 09 00:01:19 smithi171 systemd[1]: Starting Ceph mds.l for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:01:20.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:19 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/667780743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:20.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:19 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/732088096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:01:20.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:19 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/4276223399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:20.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:19 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/667780743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:20.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:19 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/732088096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:01:20.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:19 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/4276223399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:20.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:19 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/667780743' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:20.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:19 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/732088096' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:01:20.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:19 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/4276223399' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:20.303 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 09 00:01:19 smithi171 bash[83203]: 9da21d9cde57a0c1a42ee7edba4888c06b3d693db420cc8265455e553fe9bd73 2024-05-09T00:01:20.303 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 09 00:01:19 smithi171 systemd[1]: Started Ceph mds.l for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:01:20.303 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 09 00:01:19 smithi171 ceph-mds[83241]: -- 172.21.15.171:0/1606234948 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a263c541a0 con 0x55a263c2ac00 2024-05-09T00:01:20.303 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 09 00:01:19 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-l[83218]: starting mds.l at 2024-05-09T00:01:21.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:21 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.171:6832/1750853748,v1:172.21.15.171:6833/1750853748] up:boot 2024-05-09T00:01:21.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:21 smithi150 ceph-mon[46187]: fsmap 1 up:standby 2024-05-09T00:01:21.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:21 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T00:01:21.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:21 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:21.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:21 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:21.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:21 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:21.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:21 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:21.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:21 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:21.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:21 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:21.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:21 smithi150 ceph-mon[46187]: Deploying daemon mds.k on smithi150 2024-05-09T00:01:21.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:21 smithi150 ceph-mon[46187]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:21.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:21 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.171:6832/1750853748,v1:172.21.15.171:6833/1750853748] up:boot 2024-05-09T00:01:21.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:21 smithi171 ceph-mon[47351]: fsmap 1 up:standby 2024-05-09T00:01:21.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T00:01:21.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:21.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:21.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:21.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:21.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:21.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:21 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:21.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:21 smithi171 ceph-mon[47351]: Deploying daemon mds.k on smithi150 2024-05-09T00:01:21.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:21 smithi171 ceph-mon[47351]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:21.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:20 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.171:6832/1750853748,v1:172.21.15.171:6833/1750853748] up:boot 2024-05-09T00:01:21.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:20 smithi081 ceph-mon[42474]: fsmap 1 up:standby 2024-05-09T00:01:21.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:20 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T00:01:21.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:20 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:21.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:20 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:21.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:20 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:21.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:20 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:21.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:20 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:21.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:20 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:21.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:20 smithi081 ceph-mon[42474]: Deploying daemon mds.k on smithi150 2024-05-09T00:01:21.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:20 smithi081 ceph-mon[42474]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:21.703 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:01:21.753 INFO:journalctl@ceph.mds.k.smithi150.stdout:May 09 00:01:21 smithi150 systemd[1]: Starting Ceph mds.k for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:01:21.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.853+0000 7ff364788700 1 -- 172.21.15.81:0/3947509142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c1018e0 msgr2=0x7ff35c103cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.853+0000 7ff364788700 1 --2- 172.21.15.81:0/3947509142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c1018e0 0x7ff35c103cd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff358009990 tx=0x7ff358009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.853+0000 7ff364788700 1 -- 172.21.15.81:0/3947509142 shutdown_connections 2024-05-09T00:01:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.853+0000 7ff364788700 1 --2- 172.21.15.81:0/3947509142 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff35c106b40 0x7ff35c108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.853+0000 7ff364788700 1 --2- 172.21.15.81:0/3947509142 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c1018e0 0x7ff35c103cd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.853+0000 7ff364788700 1 --2- 172.21.15.81:0/3947509142 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff35c104210 0x7ff35c106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.853+0000 7ff364788700 1 -- 172.21.15.81:0/3947509142 >> 172.21.15.81:0/3947509142 conn(0x7ff35c0fb2f0 msgr2=0x7ff35c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.853+0000 7ff364788700 1 -- 172.21.15.81:0/3947509142 shutdown_connections 2024-05-09T00:01:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.853+0000 7ff364788700 1 -- 172.21.15.81:0/3947509142 wait complete. 2024-05-09T00:01:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff364788700 1 Processor -- start 2024-05-09T00:01:21.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff364788700 1 -- start start 2024-05-09T00:01:21.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff364788700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c1018e0 0x7ff35c196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:21.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff364788700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff35c104210 0x7ff35c1973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff364788700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff35c106b40 0x7ff35c19e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff364788700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c19e990 con 0x7ff35c1018e0 2024-05-09T00:01:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff364788700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c19ead0 con 0x7ff35c104210 2024-05-09T00:01:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff364788700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c19ec60 con 0x7ff35c106b40 2024-05-09T00:01:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff362524700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c1018e0 0x7ff35c196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff362524700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c1018e0 0x7ff35c196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59832/0 (socket says 172.21.15.81:59832) 2024-05-09T00:01:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff362524700 1 -- 172.21.15.81:0/3811073391 learned_addr learned my addr 172.21.15.81:0/3811073391 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff361d23700 1 --2- 172.21.15.81:0/3811073391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff35c104210 0x7ff35c1973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff362d25700 1 --2- 172.21.15.81:0/3811073391 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff35c106b40 0x7ff35c19e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff362524700 1 -- 172.21.15.81:0/3811073391 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff35c106b40 msgr2=0x7ff35c19e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff362524700 1 --2- 172.21.15.81:0/3811073391 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff35c106b40 0x7ff35c19e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff362524700 1 -- 172.21.15.81:0/3811073391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff35c104210 msgr2=0x7ff35c1973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:21.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff362524700 1 --2- 172.21.15.81:0/3811073391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff35c104210 0x7ff35c1973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff362524700 1 -- 172.21.15.81:0/3811073391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3580095f0 con 0x7ff35c1018e0 2024-05-09T00:01:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.854+0000 7ff362524700 1 --2- 172.21.15.81:0/3811073391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c1018e0 0x7ff35c196e60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff3580098e0 tx=0x7ff35800f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.855+0000 7ff3537fe700 1 -- 172.21.15.81:0/3811073391 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35801d070 con 0x7ff35c1018e0 2024-05-09T00:01:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.855+0000 7ff3537fe700 1 -- 172.21.15.81:0/3811073391 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff358022470 con 0x7ff35c1018e0 2024-05-09T00:01:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.855+0000 7ff364788700 1 -- 172.21.15.81:0/3811073391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35c19eee0 con 0x7ff35c1018e0 2024-05-09T00:01:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.855+0000 7ff3537fe700 1 -- 172.21.15.81:0/3811073391 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358017650 con 0x7ff35c1018e0 2024-05-09T00:01:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.855+0000 7ff364788700 1 -- 172.21.15.81:0/3811073391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c19f2d0 con 0x7ff35c1018e0 2024-05-09T00:01:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.856+0000 7ff364788700 1 -- 172.21.15.81:0/3811073391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35c0fce70 con 0x7ff35c1018e0 2024-05-09T00:01:21.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.857+0000 7ff3537fe700 1 -- 172.21.15.81:0/3811073391 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff3580225e0 con 0x7ff35c1018e0 2024-05-09T00:01:21.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.857+0000 7ff3537fe700 1 --2- 172.21.15.81:0/3811073391 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff3480a11a0 0x7ff3480a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:21.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.858+0000 7ff361d23700 1 --2- 172.21.15.81:0/3811073391 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff3480a11a0 0x7ff3480a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:21.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.858+0000 7ff3537fe700 1 -- 172.21.15.81:0/3811073391 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff3580cd820 con 0x7ff35c1018e0 2024-05-09T00:01:21.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.858+0000 7ff361d23700 1 --2- 172.21.15.81:0/3811073391 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff3480a11a0 0x7ff3480a3660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009a10 tx=0x7ff34c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:21.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:21.862+0000 7ff3537fe700 1 -- 172.21.15.81:0/3811073391 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff358097600 con 0x7ff35c1018e0 2024-05-09T00:01:22.014 INFO:journalctl@ceph.mds.k.smithi150.stdout:May 09 00:01:21 smithi150 ceph-mds[80422]: -- 172.21.15.150:0/3151282601 <== mon.2 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558613f1a1a0 con 0x558613ef0c00 2024-05-09T00:01:22.014 INFO:journalctl@ceph.mds.k.smithi150.stdout:May 09 00:01:21 smithi150 bash[80384]: 71532414337d6a6ce8806a15b547ffb8260db346923d9d1f81ec872486f0b2bc 2024-05-09T00:01:22.014 INFO:journalctl@ceph.mds.k.smithi150.stdout:May 09 00:01:21 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-k[80399]: starting mds.k at 2024-05-09T00:01:22.015 INFO:journalctl@ceph.mds.k.smithi150.stdout:May 09 00:01:21 smithi150 systemd[1]: Started Ceph mds.k for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:01:22.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:22.128+0000 7ff364788700 1 -- 172.21.15.81:0/3811073391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff35c067c10 con 0x7ff35c1018e0 2024-05-09T00:01:22.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:22.129+0000 7ff3537fe700 1 -- 172.21.15.81:0/3811073391 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2020 (secure 0 0 0) 0x7ff358027800 con 0x7ff35c1018e0 2024-05-09T00:01:22.123 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:22.124 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-09T00:01:22.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:22.131+0000 7ff364788700 1 -- 172.21.15.81:0/3811073391 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff3480a11a0 msgr2=0x7ff3480a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:22.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:22.131+0000 7ff364788700 1 --2- 172.21.15.81:0/3811073391 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff3480a11a0 0x7ff3480a3660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff34c009a10 tx=0x7ff34c009190 comp rx=0 tx=0).stop 2024-05-09T00:01:22.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:22.131+0000 7ff364788700 1 -- 172.21.15.81:0/3811073391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c1018e0 msgr2=0x7ff35c196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:22.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:22.131+0000 7ff364788700 1 --2- 172.21.15.81:0/3811073391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c1018e0 0x7ff35c196e60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff3580098e0 tx=0x7ff35800f700 comp rx=0 tx=0).stop 2024-05-09T00:01:22.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:22.131+0000 7ff364788700 1 -- 172.21.15.81:0/3811073391 shutdown_connections 2024-05-09T00:01:22.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:22.131+0000 7ff364788700 1 --2- 172.21.15.81:0/3811073391 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff3480a11a0 0x7ff3480a3660 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:22.131+0000 7ff364788700 1 --2- 172.21.15.81:0/3811073391 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff35c106b40 0x7ff35c19e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:22.131+0000 7ff364788700 1 --2- 172.21.15.81:0/3811073391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff35c1018e0 0x7ff35c196e60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:22.131+0000 7ff364788700 1 --2- 172.21.15.81:0/3811073391 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff35c104210 0x7ff35c1973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:22.131+0000 7ff364788700 1 -- 172.21.15.81:0/3811073391 >> 172.21.15.81:0/3811073391 conn(0x7ff35c0fb2f0 msgr2=0x7ff35c1022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:22.131+0000 7ff364788700 1 -- 172.21.15.81:0/3811073391 shutdown_connections 2024-05-09T00:01:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:22.131+0000 7ff364788700 1 -- 172.21.15.81:0/3811073391 wait complete. 2024-05-09T00:01:22.128 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2024-05-09T00:01:23.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:22 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:23.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:22 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:23.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:22 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:23.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:22 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:23.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:22 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:23.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:22 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:23.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:22 smithi171 ceph-mon[47351]: Deploying daemon mds.j on smithi081 2024-05-09T00:01:23.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:22 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.150:6832/3794539364,v1:172.21.15.150:6833/3794539364] up:boot 2024-05-09T00:01:23.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:22 smithi171 ceph-mon[47351]: fsmap 2 up:standby 2024-05-09T00:01:23.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:22 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T00:01:23.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:22 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3811073391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:23.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:22 smithi171 ceph-mon[47351]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:23.057 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:22 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:23.057 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:22 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:23.057 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:22 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:23.057 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:22 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:23.057 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:22 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:23.058 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:22 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:23.058 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:22 smithi081 ceph-mon[42474]: Deploying daemon mds.j on smithi081 2024-05-09T00:01:23.058 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:22 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.150:6832/3794539364,v1:172.21.15.150:6833/3794539364] up:boot 2024-05-09T00:01:23.058 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:22 smithi081 ceph-mon[42474]: fsmap 2 up:standby 2024-05-09T00:01:23.058 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:22 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T00:01:23.058 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:22 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3811073391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:23.058 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:22 smithi081 ceph-mon[42474]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:23.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:22 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:23.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:22 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:23.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:22 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:23.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:22 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:23.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:22 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:23.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:22 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:23.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:22 smithi150 ceph-mon[46187]: Deploying daemon mds.j on smithi081 2024-05-09T00:01:23.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:22 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.150:6832/3794539364,v1:172.21.15.150:6833/3794539364] up:boot 2024-05-09T00:01:23.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:22 smithi150 ceph-mon[46187]: fsmap 2 up:standby 2024-05-09T00:01:23.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:22 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T00:01:23.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:22 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3811073391' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:23.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:22 smithi150 ceph-mon[46187]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:23.360 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 09 00:01:23 smithi081 systemd[1]: Starting Ceph mds.j for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:01:23.619 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 09 00:01:23 smithi081 ceph-mds[91554]: -- 172.21.15.81:0/2385074123 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5654b4fa01a0 con 0x5654b4f76800 2024-05-09T00:01:23.620 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 09 00:01:23 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-j[91531]: starting mds.j at 2024-05-09T00:01:23.620 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 09 00:01:23 smithi081 bash[91516]: 558bf7905f65796339f4e434a0816416e30a694ee8eae594926f3c8218d41615 2024-05-09T00:01:23.620 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 09 00:01:23 smithi081 systemd[1]: Started Ceph mds.j for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:01:24.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:01:24.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.275+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/1509562445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ff40ffd70 msgr2=0x7f3ff4100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:24.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.275+0000 7f3ffb0ed700 1 --2- 172.21.15.81:0/1509562445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ff40ffd70 0x7f3ff4100190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80099c0 tx=0x7f3fe8009cd0 comp rx=0 tx=0).stop 2024-05-09T00:01:24.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.275+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/1509562445 shutdown_connections 2024-05-09T00:01:24.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.275+0000 7f3ffb0ed700 1 --2- 172.21.15.81:0/1509562445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ff4101900 0x7f3ff41081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:24.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.275+0000 7f3ffb0ed700 1 --2- 172.21.15.81:0/1509562445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ff40ffd70 0x7f3ff4100190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:24.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.275+0000 7f3ffb0ed700 1 --2- 172.21.15.81:0/1509562445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff4100f60 0x7f3ff41013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:24.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.275+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/1509562445 >> 172.21.15.81:0/1509562445 conn(0x7f3ff40fb2e0 msgr2=0x7f3ff40fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:24.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.275+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/1509562445 shutdown_connections 2024-05-09T00:01:24.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.275+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/1509562445 wait complete. 2024-05-09T00:01:24.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ffb0ed700 1 Processor -- start 2024-05-09T00:01:24.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ffb0ed700 1 -- start start 2024-05-09T00:01:24.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ffb0ed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ff40ffd70 0x7f3ff4196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:24.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ffb0ed700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff4100f60 0x7f3ff41973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:24.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ffb0ed700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ff4101900 0x7f3ff419e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:24.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ffb0ed700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff419e900 con 0x7f3ff40ffd70 2024-05-09T00:01:24.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ffb0ed700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff419ea70 con 0x7f3ff4100f60 2024-05-09T00:01:24.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ffb0ed700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff419ec30 con 0x7f3ff4101900 2024-05-09T00:01:24.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ff8e89700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ff40ffd70 0x7f3ff4196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:24.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ff8e89700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ff40ffd70 0x7f3ff4196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59854/0 (socket says 172.21.15.81:59854) 2024-05-09T00:01:24.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ff8e89700 1 -- 172.21.15.81:0/202110850 learned_addr learned my addr 172.21.15.81:0/202110850 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:24.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ff968a700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ff4101900 0x7f3ff419e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:24.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ff3fff700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff4100f60 0x7f3ff41973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:24.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ff8e89700 1 -- 172.21.15.81:0/202110850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ff4101900 msgr2=0x7f3ff419e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:24.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ff8e89700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ff4101900 0x7f3ff419e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:24.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ff8e89700 1 -- 172.21.15.81:0/202110850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff4100f60 msgr2=0x7f3ff41973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:24.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ff8e89700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff4100f60 0x7f3ff41973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:24.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ff8e89700 1 -- 172.21.15.81:0/202110850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe80095f0 con 0x7f3ff40ffd70 2024-05-09T00:01:24.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.276+0000 7f3ff968a700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ff4101900 0x7f3ff419e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:24.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.277+0000 7f3ff8e89700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ff40ffd70 0x7f3ff4196e60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8006010 tx=0x7f3fe8005af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:24.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.277+0000 7f3ff1ffb700 1 -- 172.21.15.81:0/202110850 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe801d070 con 0x7f3ff40ffd70 2024-05-09T00:01:24.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.277+0000 7f3ff1ffb700 1 -- 172.21.15.81:0/202110850 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3fe8004150 con 0x7f3ff40ffd70 2024-05-09T00:01:24.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.277+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/202110850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff419eeb0 con 0x7f3ff40ffd70 2024-05-09T00:01:24.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.277+0000 7f3ff1ffb700 1 -- 172.21.15.81:0/202110850 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8021410 con 0x7f3ff40ffd70 2024-05-09T00:01:24.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.277+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/202110850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff419f220 con 0x7f3ff40ffd70 2024-05-09T00:01:24.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.278+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/202110850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff4067380 con 0x7f3ff40ffd70 2024-05-09T00:01:24.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.279+0000 7f3ff1ffb700 1 -- 172.21.15.81:0/202110850 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3fe800f6f0 con 0x7f3ff40ffd70 2024-05-09T00:01:24.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.280+0000 7f3ff1ffb700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3fe40a1120 0x7f3fe40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:24.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.280+0000 7f3ff1ffb700 1 -- 172.21.15.81:0/202110850 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3fe80cd790 con 0x7f3ff40ffd70 2024-05-09T00:01:24.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.280+0000 7f3ff3fff700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3fe40a1120 0x7f3fe40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:24.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.280+0000 7f3ff3fff700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3fe40a1120 0x7f3fe40a35e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0005ea0 tx=0x7f3fe0005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:24.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.284+0000 7f3ff1ffb700 1 -- 172.21.15.81:0/202110850 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3fe8097450 con 0x7f3ff40ffd70 2024-05-09T00:01:24.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.540+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/202110850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ff410b5d0 con 0x7f3ff40ffd70 2024-05-09T00:01:24.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.541+0000 7f3ff1ffb700 1 -- 172.21.15.81:0/202110850 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2777 (secure 0 0 0) 0x7f3fe809fe60 con 0x7f3ff40ffd70 2024-05-09T00:01:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:24.535 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-09T00:01:24.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.543+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/202110850 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3fe40a1120 msgr2=0x7f3fe40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:24.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.543+0000 7f3ffb0ed700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3fe40a1120 0x7f3fe40a35e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0005ea0 tx=0x7f3fe0005e30 comp rx=0 tx=0).stop 2024-05-09T00:01:24.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.543+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/202110850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ff40ffd70 msgr2=0x7f3ff4196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:24.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.543+0000 7f3ffb0ed700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ff40ffd70 0x7f3ff4196e60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8006010 tx=0x7f3fe8005af0 comp rx=0 tx=0).stop 2024-05-09T00:01:24.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.543+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/202110850 shutdown_connections 2024-05-09T00:01:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.543+0000 7f3ffb0ed700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3fe40a1120 0x7f3fe40a35e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.543+0000 7f3ffb0ed700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ff4101900 0x7f3ff419e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.543+0000 7f3ffb0ed700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ff40ffd70 0x7f3ff4196e60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.543+0000 7f3ffb0ed700 1 --2- 172.21.15.81:0/202110850 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ff4100f60 0x7f3ff41973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.543+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/202110850 >> 172.21.15.81:0/202110850 conn(0x7f3ff40fb2e0 msgr2=0x7f3ff40fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.543+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/202110850 shutdown_connections 2024-05-09T00:01:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:24.543+0000 7f3ffb0ed700 1 -- 172.21.15.81:0/202110850 wait complete. 2024-05-09T00:01:24.538 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 4 2024-05-09T00:01:24.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:24.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:24.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:24.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:24.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:24.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:24.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:24 smithi081 ceph-mon[42474]: Deploying daemon mds.d on smithi081 2024-05-09T00:01:24.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:24 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.81:6834/3510747883,v1:172.21.15.81:6835/3510747883] up:boot 2024-05-09T00:01:24.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:24 smithi081 ceph-mon[42474]: fsmap 3 up:standby 2024-05-09T00:01:24.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:24 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-09T00:01:24.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:24 smithi081 ceph-mon[42474]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:24.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:24 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/202110850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:25.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:25.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:25.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:25.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:25.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:25.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:25.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:24 smithi150 ceph-mon[46187]: Deploying daemon mds.d on smithi081 2024-05-09T00:01:25.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:24 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.81:6834/3510747883,v1:172.21.15.81:6835/3510747883] up:boot 2024-05-09T00:01:25.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:24 smithi150 ceph-mon[46187]: fsmap 3 up:standby 2024-05-09T00:01:25.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:24 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-09T00:01:25.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:24 smithi150 ceph-mon[46187]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:25.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:24 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/202110850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:25.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:25.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:24 smithi171 ceph-mon[47351]: Deploying daemon mds.d on smithi081 2024-05-09T00:01:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:24 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.81:6834/3510747883,v1:172.21.15.81:6835/3510747883] up:boot 2024-05-09T00:01:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:24 smithi171 ceph-mon[47351]: fsmap 3 up:standby 2024-05-09T00:01:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:24 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-09T00:01:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:24 smithi171 ceph-mon[47351]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:24 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/202110850' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:25.102 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 09 00:01:24 smithi081 systemd[1]: Starting Ceph mds.d for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:01:25.370 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 09 00:01:25 smithi081 ceph-mds[91935]: -- 172.21.15.81:0/3360861498 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5595b7af01a0 con 0x5595b7ac6c00 2024-05-09T00:01:25.370 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 09 00:01:25 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-d[91912]: starting mds.d at 2024-05-09T00:01:25.370 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 09 00:01:25 smithi081 bash[91898]: 9efbf34fbc46720404333558dcadfb8fff909f25e2381758ba5948f4c2d31de5 2024-05-09T00:01:25.370 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 09 00:01:25 smithi081 systemd[1]: Started Ceph mds.d for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:01:26.434 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:26 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:26.434 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:26 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:26.434 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:26 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:26.434 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:26 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:26.434 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:26 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:26.434 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:26 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:26.434 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:26 smithi150 ceph-mon[46187]: Deploying daemon mds.e on smithi150 2024-05-09T00:01:26.434 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:26 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.81:6836/1631947486,v1:172.21.15.81:6837/1631947486] up:boot 2024-05-09T00:01:26.434 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:26 smithi150 ceph-mon[46187]: fsmap 4 up:standby 2024-05-09T00:01:26.435 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:26 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-09T00:01:26.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:01:26.585 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:26 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:26.585 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:26 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:26.586 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:26 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:26.586 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:26 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:26.586 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:26 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:26.586 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:26 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:26.586 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:26 smithi081 ceph-mon[42474]: Deploying daemon mds.e on smithi150 2024-05-09T00:01:26.586 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:26 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.81:6836/1631947486,v1:172.21.15.81:6837/1631947486] up:boot 2024-05-09T00:01:26.586 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:26 smithi081 ceph-mon[42474]: fsmap 4 up:standby 2024-05-09T00:01:26.586 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:26 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-09T00:01:26.688 INFO:journalctl@ceph.mds.e.smithi150.stdout:May 09 00:01:26 smithi150 systemd[1]: Starting Ceph mds.e for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:01:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.698+0000 7fec9f59e700 1 -- 172.21.15.81:0/1134377514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec98102a70 msgr2=0x7fec98109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.698+0000 7fec9f59e700 1 --2- 172.21.15.81:0/1134377514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec98102a70 0x7fec98109320 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fec9400b0a0 tx=0x7fec9400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.698+0000 7fec9f59e700 1 -- 172.21.15.81:0/1134377514 shutdown_connections 2024-05-09T00:01:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.698+0000 7fec9f59e700 1 --2- 172.21.15.81:0/1134377514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec980ff100 0x7fec980ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.698+0000 7fec9f59e700 1 --2- 172.21.15.81:0/1134377514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec98102a70 0x7fec98109320 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.698+0000 7fec9f59e700 1 --2- 172.21.15.81:0/1134377514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec981020d0 0x7fec98102530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.698+0000 7fec9f59e700 1 -- 172.21.15.81:0/1134377514 >> 172.21.15.81:0/1134377514 conn(0x7fec980faa30 msgr2=0x7fec980fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.699+0000 7fec9f59e700 1 -- 172.21.15.81:0/1134377514 shutdown_connections 2024-05-09T00:01:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.699+0000 7fec9f59e700 1 -- 172.21.15.81:0/1134377514 wait complete. 2024-05-09T00:01:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.699+0000 7fec9f59e700 1 Processor -- start 2024-05-09T00:01:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.699+0000 7fec9f59e700 1 -- start start 2024-05-09T00:01:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.699+0000 7fec9f59e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec980ff100 0x7fec98196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.699+0000 7fec9f59e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec981020d0 0x7fec981973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.699+0000 7fec9f59e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec98102a70 0x7fec9819e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.699+0000 7fec9f59e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9819e9a0 con 0x7fec980ff100 2024-05-09T00:01:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.699+0000 7fec9f59e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9819eae0 con 0x7fec98102a70 2024-05-09T00:01:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.699+0000 7fec9f59e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9819ec70 con 0x7fec981020d0 2024-05-09T00:01:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec9e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec980ff100 0x7fec98196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec9e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec980ff100 0x7fec98196e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59880/0 (socket says 172.21.15.81:59880) 2024-05-09T00:01:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec9e59c700 1 -- 172.21.15.81:0/1337218704 learned_addr learned my addr 172.21.15.81:0/1337218704 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec9ed9d700 1 --2- 172.21.15.81:0/1337218704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec98102a70 0x7fec9819e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec9dd9b700 1 --2- 172.21.15.81:0/1337218704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec981020d0 0x7fec981973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec9e59c700 1 -- 172.21.15.81:0/1337218704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec981020d0 msgr2=0x7fec981973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec9e59c700 1 --2- 172.21.15.81:0/1337218704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec981020d0 0x7fec981973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec9e59c700 1 -- 172.21.15.81:0/1337218704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec98102a70 msgr2=0x7fec9819e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec9e59c700 1 --2- 172.21.15.81:0/1337218704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec98102a70 0x7fec9819e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec9e59c700 1 -- 172.21.15.81:0/1337218704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec94009d00 con 0x7fec980ff100 2024-05-09T00:01:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec9e59c700 1 --2- 172.21.15.81:0/1337218704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec980ff100 0x7fec98196e70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fec8400e970 tx=0x7fec8400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec937fe700 1 -- 172.21.15.81:0/1337218704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84009790 con 0x7fec980ff100 2024-05-09T00:01:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec937fe700 1 -- 172.21.15.81:0/1337218704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec8400eec0 con 0x7fec980ff100 2024-05-09T00:01:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec937fe700 1 -- 172.21.15.81:0/1337218704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84003cf0 con 0x7fec980ff100 2024-05-09T00:01:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec9f59e700 1 -- 172.21.15.81:0/1337218704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9819ef50 con 0x7fec980ff100 2024-05-09T00:01:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.700+0000 7fec9f59e700 1 -- 172.21.15.81:0/1337218704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9819f370 con 0x7fec980ff100 2024-05-09T00:01:26.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.701+0000 7fec9f59e700 1 -- 172.21.15.81:0/1337218704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec98108310 con 0x7fec980ff100 2024-05-09T00:01:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.702+0000 7fec937fe700 1 -- 172.21.15.81:0/1337218704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fec8400ccd0 con 0x7fec980ff100 2024-05-09T00:01:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.703+0000 7fec937fe700 1 --2- 172.21.15.81:0/1337218704 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fec880a11a0 0x7fec880a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.703+0000 7fec9dd9b700 1 --2- 172.21.15.81:0/1337218704 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fec880a11a0 0x7fec880a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.703+0000 7fec937fe700 1 -- 172.21.15.81:0/1337218704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fec84014070 con 0x7fec980ff100 2024-05-09T00:01:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.703+0000 7fec9dd9b700 1 --2- 172.21.15.81:0/1337218704 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fec880a11a0 0x7fec880a3660 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009af0 tx=0x7fec8c0094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.707+0000 7fec937fe700 1 -- 172.21.15.81:0/1337218704 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fec84096240 con 0x7fec980ff100 2024-05-09T00:01:26.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:26 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:26.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:26 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:26.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:26 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:26.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:26 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:26.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:26 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:26.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:26 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:26.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:26 smithi171 ceph-mon[47351]: Deploying daemon mds.e on smithi150 2024-05-09T00:01:26.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:26 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.81:6836/1631947486,v1:172.21.15.81:6837/1631947486] up:boot 2024-05-09T00:01:26.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:26 smithi171 ceph-mon[47351]: fsmap 4 up:standby 2024-05-09T00:01:26.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:26 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-09T00:01:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.949+0000 7fec9f59e700 1 -- 172.21.15.81:0/1337218704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec98067310 con 0x7fec980ff100 2024-05-09T00:01:26.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.949+0000 7fec937fe700 1 -- 172.21.15.81:0/1337218704 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3534 (secure 0 0 0) 0x7fec84099860 con 0x7fec980ff100 2024-05-09T00:01:26.943 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:26.943 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-09T00:01:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.951+0000 7fec9f59e700 1 -- 172.21.15.81:0/1337218704 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fec880a11a0 msgr2=0x7fec880a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:26.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.951+0000 7fec9f59e700 1 --2- 172.21.15.81:0/1337218704 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fec880a11a0 0x7fec880a3660 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009af0 tx=0x7fec8c0094f0 comp rx=0 tx=0).stop 2024-05-09T00:01:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.951+0000 7fec9f59e700 1 -- 172.21.15.81:0/1337218704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec980ff100 msgr2=0x7fec98196e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.951+0000 7fec9f59e700 1 --2- 172.21.15.81:0/1337218704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec980ff100 0x7fec98196e70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fec8400e970 tx=0x7fec8400ec80 comp rx=0 tx=0).stop 2024-05-09T00:01:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.951+0000 7fec9f59e700 1 -- 172.21.15.81:0/1337218704 shutdown_connections 2024-05-09T00:01:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.951+0000 7fec9f59e700 1 --2- 172.21.15.81:0/1337218704 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fec880a11a0 0x7fec880a3660 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.951+0000 7fec9f59e700 1 --2- 172.21.15.81:0/1337218704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec98102a70 0x7fec9819e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.951+0000 7fec9f59e700 1 --2- 172.21.15.81:0/1337218704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec980ff100 0x7fec98196e70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.951+0000 7fec9f59e700 1 --2- 172.21.15.81:0/1337218704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec981020d0 0x7fec981973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.951+0000 7fec9f59e700 1 -- 172.21.15.81:0/1337218704 >> 172.21.15.81:0/1337218704 conn(0x7fec980faa30 msgr2=0x7fec98105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.951+0000 7fec9f59e700 1 -- 172.21.15.81:0/1337218704 shutdown_connections 2024-05-09T00:01:26.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:26.951+0000 7fec9f59e700 1 -- 172.21.15.81:0/1337218704 wait complete. 2024-05-09T00:01:26.947 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 5 2024-05-09T00:01:27.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:27 smithi150 ceph-mon[46187]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:27.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:27 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1337218704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:27.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:27 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:27.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:27 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:27.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:27 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:27.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:27 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:27.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:27 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:27.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:27 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:27.515 INFO:journalctl@ceph.mds.e.smithi150.stdout:May 09 00:01:27 smithi150 bash[80727]: 789af3268a13efa5738e4c6e4495f8f6356764222e705d7d7814750b249b5329 2024-05-09T00:01:27.515 INFO:journalctl@ceph.mds.e.smithi150.stdout:May 09 00:01:27 smithi150 systemd[1]: Started Ceph mds.e for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:01:27.515 INFO:journalctl@ceph.mds.e.smithi150.stdout:May 09 00:01:27 smithi150 ceph-mds[80765]: -- 172.21.15.150:0/697686466 <== mon.2 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563cfbb361a0 con 0x563cfbb0c800 2024-05-09T00:01:27.515 INFO:journalctl@ceph.mds.e.smithi150.stdout:May 09 00:01:27 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-e[80742]: starting mds.e at 2024-05-09T00:01:27.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:27 smithi081 ceph-mon[42474]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:27.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:27 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1337218704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:27.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:27 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:27.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:27 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:27.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:27 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:27.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:27 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:27.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:27 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:27.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:27 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:27.632 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:27 smithi171 ceph-mon[47351]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:27.632 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:27 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1337218704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:27.632 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:27 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:27.633 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:27 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:27.633 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:27 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:27.633 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:27 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:27.633 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:27 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:27.633 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:27 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:28.514 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 09 00:01:28 smithi171 systemd[1]: Starting Ceph mds.f for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:01:28.514 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:28 smithi171 ceph-mon[47351]: Deploying daemon mds.f on smithi171 2024-05-09T00:01:28.514 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:28 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.150:6834/2480381166,v1:172.21.15.150:6835/2480381166] up:boot 2024-05-09T00:01:28.514 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:28 smithi171 ceph-mon[47351]: fsmap 5 up:standby 2024-05-09T00:01:28.514 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:28 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T00:01:28.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:28 smithi081 ceph-mon[42474]: Deploying daemon mds.f on smithi171 2024-05-09T00:01:28.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:28 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.150:6834/2480381166,v1:172.21.15.150:6835/2480381166] up:boot 2024-05-09T00:01:28.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:28 smithi081 ceph-mon[42474]: fsmap 5 up:standby 2024-05-09T00:01:28.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:28 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T00:01:28.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:28 smithi150 ceph-mon[46187]: Deploying daemon mds.f on smithi171 2024-05-09T00:01:28.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:28 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.150:6834/2480381166,v1:172.21.15.150:6835/2480381166] up:boot 2024-05-09T00:01:28.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:28 smithi150 ceph-mon[46187]: fsmap 5 up:standby 2024-05-09T00:01:28.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:28 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T00:01:28.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:01:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.103+0000 7f875b99b700 1 -- 172.21.15.81:0/328847596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8754101910 msgr2=0x7f8754103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.103+0000 7f875b99b700 1 --2- 172.21.15.81:0/328847596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8754101910 0x7f8754103d00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8750009990 tx=0x7f8750009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.103+0000 7f875b99b700 1 -- 172.21.15.81:0/328847596 shutdown_connections 2024-05-09T00:01:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.103+0000 7f875b99b700 1 --2- 172.21.15.81:0/328847596 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8754106b70 0x7f8754108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.103+0000 7f875b99b700 1 --2- 172.21.15.81:0/328847596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8754101910 0x7f8754103d00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.103+0000 7f875b99b700 1 --2- 172.21.15.81:0/328847596 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8754104240 0x7f8754106630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.103+0000 7f875b99b700 1 -- 172.21.15.81:0/328847596 >> 172.21.15.81:0/328847596 conn(0x7f87540fb300 msgr2=0x7f87540fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.104+0000 7f875b99b700 1 -- 172.21.15.81:0/328847596 shutdown_connections 2024-05-09T00:01:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.104+0000 7f875b99b700 1 -- 172.21.15.81:0/328847596 wait complete. 2024-05-09T00:01:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.104+0000 7f875b99b700 1 Processor -- start 2024-05-09T00:01:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.104+0000 7f875b99b700 1 -- start start 2024-05-09T00:01:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.104+0000 7f875b99b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8754101910 0x7f8754196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.104+0000 7f875b99b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8754104240 0x7f8754197230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.104+0000 7f875b99b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8754106b70 0x7f875419e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.104+0000 7f875b99b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875419e810 con 0x7f8754104240 2024-05-09T00:01:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.104+0000 7f875b99b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875419e980 con 0x7f8754106b70 2024-05-09T00:01:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.104+0000 7f875b99b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875419eb40 con 0x7f8754101910 2024-05-09T00:01:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.104+0000 7f8758f36700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8754104240 0x7f8754197230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.104+0000 7f8759737700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8754101910 0x7f8754196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.104+0000 7f8758f36700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8754104240 0x7f8754197230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44632/0 (socket says 172.21.15.81:44632) 2024-05-09T00:01:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f8759737700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8754101910 0x7f8754196cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:37836/0 (socket says 172.21.15.81:37836) 2024-05-09T00:01:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f8758f36700 1 -- 172.21.15.81:0/1945132573 learned_addr learned my addr 172.21.15.81:0/1945132573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f8759f38700 1 --2- 172.21.15.81:0/1945132573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8754106b70 0x7f875419e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f8758f36700 1 -- 172.21.15.81:0/1945132573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8754101910 msgr2=0x7f8754196cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f8758f36700 1 --2- 172.21.15.81:0/1945132573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8754101910 0x7f8754196cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f8758f36700 1 -- 172.21.15.81:0/1945132573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8754106b70 msgr2=0x7f875419e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f8758f36700 1 --2- 172.21.15.81:0/1945132573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8754106b70 0x7f875419e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f8758f36700 1 -- 172.21.15.81:0/1945132573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87500095f0 con 0x7f8754104240 2024-05-09T00:01:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f8759f38700 1 --2- 172.21.15.81:0/1945132573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8754106b70 0x7f875419e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f8758f36700 1 --2- 172.21.15.81:0/1945132573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8754104240 0x7f8754197230 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f874400e9a0 tx=0x7f874400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f874a7fc700 1 -- 172.21.15.81:0/1945132573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744009790 con 0x7f8754104240 2024-05-09T00:01:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f874a7fc700 1 -- 172.21.15.81:0/1945132573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f874400cbd0 con 0x7f8754104240 2024-05-09T00:01:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f874a7fc700 1 -- 172.21.15.81:0/1945132573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8744018680 con 0x7f8754104240 2024-05-09T00:01:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f875b99b700 1 -- 172.21.15.81:0/1945132573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f875419ee20 con 0x7f8754104240 2024-05-09T00:01:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.105+0000 7f875b99b700 1 -- 172.21.15.81:0/1945132573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875419f250 con 0x7f8754104240 2024-05-09T00:01:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.106+0000 7f875b99b700 1 -- 172.21.15.81:0/1945132573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87540fce80 con 0x7f8754104240 2024-05-09T00:01:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.107+0000 7f874a7fc700 1 -- 172.21.15.81:0/1945132573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f874400cd40 con 0x7f8754104240 2024-05-09T00:01:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.108+0000 7f874a7fc700 1 --2- 172.21.15.81:0/1945132573 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f87400a1120 0x7f87400a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.108+0000 7f8759737700 1 --2- 172.21.15.81:0/1945132573 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f87400a1120 0x7f87400a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.108+0000 7f874a7fc700 1 -- 172.21.15.81:0/1945132573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8744014070 con 0x7f8754104240 2024-05-09T00:01:29.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.108+0000 7f8759737700 1 --2- 172.21.15.81:0/1945132573 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f87400a1120 0x7f87400a35e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f875000b680 tx=0x7f8750005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.111+0000 7f874a7fc700 1 -- 172.21.15.81:0/1945132573 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f87440965c0 con 0x7f8754104240 2024-05-09T00:01:29.302 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 09 00:01:28 smithi171 bash[83547]: cc640f7bfefc037195f0240a89757a1c7c5f0cd456ac4ac31ff56b506323ac52 2024-05-09T00:01:29.302 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 09 00:01:28 smithi171 systemd[1]: Started Ceph mds.f for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:01:29.303 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 09 00:01:28 smithi171 ceph-mds[83586]: -- 172.21.15.171:0/356759493 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55af977b01a0 con 0x55af97786c00 2024-05-09T00:01:29.303 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 09 00:01:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-f[83563]: starting mds.f at 2024-05-09T00:01:29.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.356+0000 7f875b99b700 1 -- 172.21.15.81:0/1945132573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8754068060 con 0x7f8754104240 2024-05-09T00:01:29.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.356+0000 7f874a7fc700 1 -- 172.21.15.81:0/1945132573 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5051 (secure 0 0 0) 0x7f8744099be0 con 0x7f8754104240 2024-05-09T00:01:29.351 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:29.351 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24452,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2024-05-09T00:01:29.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.359+0000 7f875b99b700 1 -- 172.21.15.81:0/1945132573 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f87400a1120 msgr2=0x7f87400a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:29.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.359+0000 7f875b99b700 1 --2- 172.21.15.81:0/1945132573 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f87400a1120 0x7f87400a35e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f875000b680 tx=0x7f8750005fd0 comp rx=0 tx=0).stop 2024-05-09T00:01:29.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.359+0000 7f875b99b700 1 -- 172.21.15.81:0/1945132573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8754104240 msgr2=0x7f8754197230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:29.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.359+0000 7f875b99b700 1 --2- 172.21.15.81:0/1945132573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8754104240 0x7f8754197230 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f874400e9a0 tx=0x7f874400ecb0 comp rx=0 tx=0).stop 2024-05-09T00:01:29.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.359+0000 7f875b99b700 1 -- 172.21.15.81:0/1945132573 shutdown_connections 2024-05-09T00:01:29.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.359+0000 7f875b99b700 1 --2- 172.21.15.81:0/1945132573 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f87400a1120 0x7f87400a35e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:29.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.359+0000 7f875b99b700 1 --2- 172.21.15.81:0/1945132573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8754106b70 0x7f875419e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:29.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.359+0000 7f875b99b700 1 --2- 172.21.15.81:0/1945132573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8754101910 0x7f8754196cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:29.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.359+0000 7f875b99b700 1 --2- 172.21.15.81:0/1945132573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8754104240 0x7f8754197230 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:29.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.359+0000 7f875b99b700 1 -- 172.21.15.81:0/1945132573 >> 172.21.15.81:0/1945132573 conn(0x7f87540fb300 msgr2=0x7f8754102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:29.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.359+0000 7f875b99b700 1 -- 172.21.15.81:0/1945132573 shutdown_connections 2024-05-09T00:01:29.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:29.359+0000 7f875b99b700 1 -- 172.21.15.81:0/1945132573 wait complete. 2024-05-09T00:01:29.354 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-05-09T00:01:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:29 smithi081 ceph-mon[42474]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:29.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:29 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:29.661 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:29 smithi171 ceph-mon[47351]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:29.661 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:29.661 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:29.662 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:29.662 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:29.662 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:29.662 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:29 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:29.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:29 smithi150 ceph-mon[46187]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:29.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:29 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:29.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:29 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:29.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:29 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:29.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:29 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:29.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:29 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:29.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:29 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:30.552 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:01:30 smithi171 systemd[1]: Starting Ceph mds.c for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:01:30.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:30 smithi171 ceph-mon[47351]: Deploying daemon mds.c on smithi171 2024-05-09T00:01:30.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:30 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.171:6834/259351107,v1:172.21.15.171:6835/259351107] up:boot 2024-05-09T00:01:30.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:30 smithi171 ceph-mon[47351]: fsmap 6 up:standby 2024-05-09T00:01:30.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:30 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T00:01:30.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:30 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1945132573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:30.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:30 smithi081 ceph-mon[42474]: Deploying daemon mds.c on smithi171 2024-05-09T00:01:30.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:30 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.171:6834/259351107,v1:172.21.15.171:6835/259351107] up:boot 2024-05-09T00:01:30.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:30 smithi081 ceph-mon[42474]: fsmap 6 up:standby 2024-05-09T00:01:30.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:30 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T00:01:30.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:30 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1945132573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:30.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:30 smithi150 ceph-mon[46187]: Deploying daemon mds.c on smithi171 2024-05-09T00:01:30.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:30 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.171:6834/259351107,v1:172.21.15.171:6835/259351107] up:boot 2024-05-09T00:01:30.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:30 smithi150 ceph-mon[46187]: fsmap 6 up:standby 2024-05-09T00:01:30.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:30 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T00:01:30.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:30 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1945132573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:31.052 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:01:30 smithi171 bash[83892]: 468415071a987d0aa8d4c13489cfcd81b9ed4eeb0158fbba9ff150d2c58b5949 2024-05-09T00:01:31.052 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:01:30 smithi171 systemd[1]: Started Ceph mds.c for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:01:31.052 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:01:30 smithi171 ceph-mds[83930]: -- 172.21.15.171:0/2395865743 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555daee361a0 con 0x555daee0d000 2024-05-09T00:01:31.053 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:01:30 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: starting mds.c at 2024-05-09T00:01:31.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:01:31.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.505+0000 7f2776491700 1 -- 172.21.15.81:0/427704014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27701018f0 msgr2=0x7f27701081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.505+0000 7f2776491700 1 --2- 172.21.15.81:0/427704014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27701018f0 0x7f27701081a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f276800b0d0 tx=0x7f276800b3e0 comp rx=0 tx=0).stop 2024-05-09T00:01:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.505+0000 7f2776491700 1 -- 172.21.15.81:0/427704014 shutdown_connections 2024-05-09T00:01:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.505+0000 7f2776491700 1 --2- 172.21.15.81:0/427704014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27701018f0 0x7f27701081a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.505+0000 7f2776491700 1 --2- 172.21.15.81:0/427704014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27700ffd60 0x7f2770100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.505+0000 7f2776491700 1 --2- 172.21.15.81:0/427704014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2770100f50 0x7f27701013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.505+0000 7f2776491700 1 -- 172.21.15.81:0/427704014 >> 172.21.15.81:0/427704014 conn(0x7f27700fb2f0 msgr2=0x7f27700fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.505+0000 7f2776491700 1 -- 172.21.15.81:0/427704014 shutdown_connections 2024-05-09T00:01:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.505+0000 7f2776491700 1 -- 172.21.15.81:0/427704014 wait complete. 2024-05-09T00:01:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.505+0000 7f2776491700 1 Processor -- start 2024-05-09T00:01:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.505+0000 7f2776491700 1 -- start start 2024-05-09T00:01:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2776491700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27700ffd60 0x7f2770196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2776491700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2770100f50 0x7f2770197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2776491700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27701018f0 0x7f277019e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2776491700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277019ea10 con 0x7f27701018f0 2024-05-09T00:01:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2776491700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277019eb50 con 0x7f27700ffd60 2024-05-09T00:01:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2776491700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277019ece0 con 0x7f2770100f50 2024-05-09T00:01:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2774a2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27701018f0 0x7f277019e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2774a2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27701018f0 0x7f277019e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44652/0 (socket says 172.21.15.81:44652) 2024-05-09T00:01:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2774a2e700 1 -- 172.21.15.81:0/1651301263 learned_addr learned my addr 172.21.15.81:0/1651301263 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f276ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27700ffd60 0x7f2770196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f276f7fe700 1 --2- 172.21.15.81:0/1651301263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2770100f50 0x7f2770197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2774a2e700 1 -- 172.21.15.81:0/1651301263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2770100f50 msgr2=0x7f2770197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2774a2e700 1 --2- 172.21.15.81:0/1651301263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2770100f50 0x7f2770197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2774a2e700 1 -- 172.21.15.81:0/1651301263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27700ffd60 msgr2=0x7f2770196ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2774a2e700 1 --2- 172.21.15.81:0/1651301263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27700ffd60 0x7f2770196ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2774a2e700 1 -- 172.21.15.81:0/1651301263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2768009d00 con 0x7f27701018f0 2024-05-09T00:01:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f2774a2e700 1 --2- 172.21.15.81:0/1651301263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27701018f0 0x7f277019e440 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2768007bd0 tx=0x7f2768009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.506+0000 7f276d7fa700 1 -- 172.21.15.81:0/1651301263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276800e040 con 0x7f27701018f0 2024-05-09T00:01:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.507+0000 7f276d7fa700 1 -- 172.21.15.81:0/1651301263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f276801dd50 con 0x7f27701018f0 2024-05-09T00:01:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.507+0000 7f2776491700 1 -- 172.21.15.81:0/1651301263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277019ef60 con 0x7f27701018f0 2024-05-09T00:01:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.507+0000 7f276d7fa700 1 -- 172.21.15.81:0/1651301263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276801b450 con 0x7f27701018f0 2024-05-09T00:01:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.507+0000 7f2776491700 1 -- 172.21.15.81:0/1651301263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277019f380 con 0x7f27701018f0 2024-05-09T00:01:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.508+0000 7f2776491700 1 -- 172.21.15.81:0/1651301263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2770067c10 con 0x7f27701018f0 2024-05-09T00:01:31.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.508+0000 7f276d7fa700 1 -- 172.21.15.81:0/1651301263 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f276801d890 con 0x7f27701018f0 2024-05-09T00:01:31.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.509+0000 7f276d7fa700 1 --2- 172.21.15.81:0/1651301263 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f27580a1120 0x7f27580a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:31.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.509+0000 7f276ffff700 1 --2- 172.21.15.81:0/1651301263 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f27580a1120 0x7f27580a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:31.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.509+0000 7f276d7fa700 1 -- 172.21.15.81:0/1651301263 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f27680ce1e0 con 0x7f27701018f0 2024-05-09T00:01:31.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.510+0000 7f276ffff700 1 --2- 172.21.15.81:0/1651301263 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f27580a1120 0x7f27580a35e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2770100db0 tx=0x7f276400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:31.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.514+0000 7f276d7fa700 1 -- 172.21.15.81:0/1651301263 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2768097ea0 con 0x7f27701018f0 2024-05-09T00:01:31.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:31 smithi150 ceph-mon[46187]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:31.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:31.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:31.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:31.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:31.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:31.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:31 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:31.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:31 smithi081 ceph-mon[42474]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:31.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:31 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:31.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.753+0000 7f2776491700 1 -- 172.21.15.81:0/1651301263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f277010b580 con 0x7f27701018f0 2024-05-09T00:01:31.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.754+0000 7f276d7fa700 1 -- 172.21.15.81:0/1651301263 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5808 (secure 0 0 0) 0x7f277010b580 con 0x7f27701018f0 2024-05-09T00:01:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:31.748 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24452,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-05-09T00:01:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.756+0000 7f2776491700 1 -- 172.21.15.81:0/1651301263 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f27580a1120 msgr2=0x7f27580a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.756+0000 7f2776491700 1 --2- 172.21.15.81:0/1651301263 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f27580a1120 0x7f27580a35e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2770100db0 tx=0x7f276400b410 comp rx=0 tx=0).stop 2024-05-09T00:01:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.756+0000 7f2776491700 1 -- 172.21.15.81:0/1651301263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27701018f0 msgr2=0x7f277019e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.756+0000 7f2776491700 1 --2- 172.21.15.81:0/1651301263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27701018f0 0x7f277019e440 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2768007bd0 tx=0x7f2768009440 comp rx=0 tx=0).stop 2024-05-09T00:01:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.756+0000 7f2776491700 1 -- 172.21.15.81:0/1651301263 shutdown_connections 2024-05-09T00:01:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.756+0000 7f2776491700 1 --2- 172.21.15.81:0/1651301263 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f27580a1120 0x7f27580a35e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:31.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.756+0000 7f2776491700 1 --2- 172.21.15.81:0/1651301263 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27700ffd60 0x7f2770196ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.756+0000 7f2776491700 1 --2- 172.21.15.81:0/1651301263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27701018f0 0x7f277019e440 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.756+0000 7f2776491700 1 --2- 172.21.15.81:0/1651301263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2770100f50 0x7f2770197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.756+0000 7f2776491700 1 -- 172.21.15.81:0/1651301263 >> 172.21.15.81:0/1651301263 conn(0x7f27700fb2f0 msgr2=0x7f2770067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.756+0000 7f2776491700 1 -- 172.21.15.81:0/1651301263 shutdown_connections 2024-05-09T00:01:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:31.756+0000 7f2776491700 1 -- 172.21.15.81:0/1651301263 wait complete. 2024-05-09T00:01:31.751 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 8 2024-05-09T00:01:31.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:31 smithi171 ceph-mon[47351]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:31.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:31.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:31.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:31.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:31.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:31.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:31 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:32.154 INFO:journalctl@ceph.mds.h.smithi150.stdout:May 09 00:01:32 smithi150 systemd[1]: Starting Ceph mds.h for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:01:32.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:32 smithi081 ceph-mon[42474]: Deploying daemon mds.h on smithi150 2024-05-09T00:01:32.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:32 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.171:6836/781467444,v1:172.21.15.171:6837/781467444] up:boot 2024-05-09T00:01:32.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:32 smithi081 ceph-mon[42474]: fsmap 7 up:standby 2024-05-09T00:01:32.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:32 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:01:32.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:32 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1651301263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:32.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:32 smithi150 ceph-mon[46187]: Deploying daemon mds.h on smithi150 2024-05-09T00:01:32.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:32 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.171:6836/781467444,v1:172.21.15.171:6837/781467444] up:boot 2024-05-09T00:01:32.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:32 smithi150 ceph-mon[46187]: fsmap 7 up:standby 2024-05-09T00:01:32.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:32 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:01:32.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:32 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1651301263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:32.765 INFO:journalctl@ceph.mds.h.smithi150.stdout:May 09 00:01:32 smithi150 bash[81069]: c143127a6f96b9f7c3da020827c309836ee0717e2521389e5e4a83823bb44bbe 2024-05-09T00:01:32.765 INFO:journalctl@ceph.mds.h.smithi150.stdout:May 09 00:01:32 smithi150 systemd[1]: Started Ceph mds.h for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:01:32.765 INFO:journalctl@ceph.mds.h.smithi150.stdout:May 09 00:01:32 smithi150 ceph-mds[81107]: -- 172.21.15.150:0/2882951064 <== mon.2 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5596eaf301a0 con 0x5596eaf06800 2024-05-09T00:01:32.765 INFO:journalctl@ceph.mds.h.smithi150.stdout:May 09 00:01:32 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-h[81084]: starting mds.h at 2024-05-09T00:01:32.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:32 smithi171 ceph-mon[47351]: Deploying daemon mds.h on smithi150 2024-05-09T00:01:32.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:32 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.171:6836/781467444,v1:172.21.15.171:6837/781467444] up:boot 2024-05-09T00:01:32.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:32 smithi171 ceph-mon[47351]: fsmap 7 up:standby 2024-05-09T00:01:32.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:32 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:01:32.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:32 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1651301263' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:33.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:33 smithi081 ceph-mon[42474]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:33.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:33.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:33.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:33.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:33.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:33.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:33 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:33.674 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:33 smithi171 ceph-mon[47351]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:33.674 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:33.674 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:33.674 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:33.674 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:33.674 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:33.674 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:33 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:33.763 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:01:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:33 smithi150 ceph-mon[46187]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:33.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:33 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:33.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.905+0000 7fbb5d747700 1 -- 172.21.15.81:0/2203708317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb581018f0 msgr2=0x7fbb581081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.905+0000 7fbb5d747700 1 --2- 172.21.15.81:0/2203708317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb581018f0 0x7fbb581081a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbb500099c0 tx=0x7fbb50009cd0 comp rx=0 tx=0).stop 2024-05-09T00:01:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.905+0000 7fbb5d747700 1 -- 172.21.15.81:0/2203708317 shutdown_connections 2024-05-09T00:01:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.905+0000 7fbb5d747700 1 --2- 172.21.15.81:0/2203708317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb581018f0 0x7fbb581081a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.905+0000 7fbb5d747700 1 --2- 172.21.15.81:0/2203708317 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb580ffd60 0x7fbb58100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.905+0000 7fbb5d747700 1 --2- 172.21.15.81:0/2203708317 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb58100f50 0x7fbb581013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.905+0000 7fbb5d747700 1 -- 172.21.15.81:0/2203708317 >> 172.21.15.81:0/2203708317 conn(0x7fbb580fb2f0 msgr2=0x7fbb580fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.905+0000 7fbb5d747700 1 -- 172.21.15.81:0/2203708317 shutdown_connections 2024-05-09T00:01:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.905+0000 7fbb5d747700 1 -- 172.21.15.81:0/2203708317 wait complete. 2024-05-09T00:01:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb5d747700 1 Processor -- start 2024-05-09T00:01:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb5d747700 1 -- start start 2024-05-09T00:01:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb5d747700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb580ffd60 0x7fbb58196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:33.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb5d747700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb58100f50 0x7fbb58197240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb5d747700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb581018f0 0x7fbb5819e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb5d747700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5819e820 con 0x7fbb58100f50 2024-05-09T00:01:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb5d747700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5819e990 con 0x7fbb580ffd60 2024-05-09T00:01:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb5d747700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5819eb50 con 0x7fbb581018f0 2024-05-09T00:01:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb567fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb58100f50 0x7fbb58197240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb567fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb58100f50 0x7fbb58197240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44680/0 (socket says 172.21.15.81:44680) 2024-05-09T00:01:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb567fc700 1 -- 172.21.15.81:0/3390878565 learned_addr learned my addr 172.21.15.81:0/3390878565 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb577fe700 1 --2- 172.21.15.81:0/3390878565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb581018f0 0x7fbb5819e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb56ffd700 1 --2- 172.21.15.81:0/3390878565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb580ffd60 0x7fbb58196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb567fc700 1 -- 172.21.15.81:0/3390878565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb581018f0 msgr2=0x7fbb5819e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb567fc700 1 --2- 172.21.15.81:0/3390878565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb581018f0 0x7fbb5819e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb567fc700 1 -- 172.21.15.81:0/3390878565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb580ffd60 msgr2=0x7fbb58196d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb567fc700 1 --2- 172.21.15.81:0/3390878565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb580ffd60 0x7fbb58196d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:33.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.906+0000 7fbb567fc700 1 -- 172.21.15.81:0/3390878565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb500095f0 con 0x7fbb58100f50 2024-05-09T00:01:33.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.907+0000 7fbb567fc700 1 --2- 172.21.15.81:0/3390878565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb58100f50 0x7fbb58197240 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000c9b0 tx=0x7fbb4000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:33.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.907+0000 7fbb4ffff700 1 -- 172.21.15.81:0/3390878565 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40007a80 con 0x7fbb58100f50 2024-05-09T00:01:33.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.907+0000 7fbb5d747700 1 -- 172.21.15.81:0/3390878565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5819ee30 con 0x7fbb58100f50 2024-05-09T00:01:33.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.907+0000 7fbb4ffff700 1 -- 172.21.15.81:0/3390878565 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb40007be0 con 0x7fbb58100f50 2024-05-09T00:01:33.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.907+0000 7fbb4ffff700 1 -- 172.21.15.81:0/3390878565 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb40018660 con 0x7fbb58100f50 2024-05-09T00:01:33.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.907+0000 7fbb5d747700 1 -- 172.21.15.81:0/3390878565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5819f2b0 con 0x7fbb58100f50 2024-05-09T00:01:33.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.908+0000 7fbb5d747700 1 -- 172.21.15.81:0/3390878565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb58107110 con 0x7fbb58100f50 2024-05-09T00:01:33.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.909+0000 7fbb4ffff700 1 -- 172.21.15.81:0/3390878565 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbb4000f450 con 0x7fbb58100f50 2024-05-09T00:01:33.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.910+0000 7fbb4ffff700 1 --2- 172.21.15.81:0/3390878565 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbb440a1120 0x7fbb440a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:33.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.910+0000 7fbb56ffd700 1 --2- 172.21.15.81:0/3390878565 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbb440a1120 0x7fbb440a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:33.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.910+0000 7fbb4ffff700 1 -- 172.21.15.81:0/3390878565 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbb400cc350 con 0x7fbb58100f50 2024-05-09T00:01:33.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.910+0000 7fbb56ffd700 1 --2- 172.21.15.81:0/3390878565 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbb440a1120 0x7fbb440a35e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbb580fcd70 tx=0x7fbb4800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:33.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:33.914+0000 7fbb4ffff700 1 -- 172.21.15.81:0/3390878565 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbb40095f80 con 0x7fbb58100f50 2024-05-09T00:01:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:34.159+0000 7fbb5d747700 1 -- 172.21.15.81:0/3390878565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb58067c10 con 0x7fbb58100f50 2024-05-09T00:01:34.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:34.159+0000 7fbb4ffff700 1 -- 172.21.15.81:0/3390878565 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6568 (secure 0 0 0) 0x7fbb400995a0 con 0x7fbb58100f50 2024-05-09T00:01:34.154 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:34.154 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24452,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24476,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-05-09T00:01:34.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:34.161+0000 7fbb5d747700 1 -- 172.21.15.81:0/3390878565 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbb440a1120 msgr2=0x7fbb440a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:34.161+0000 7fbb5d747700 1 --2- 172.21.15.81:0/3390878565 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbb440a1120 0x7fbb440a35e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbb580fcd70 tx=0x7fbb4800b040 comp rx=0 tx=0).stop 2024-05-09T00:01:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:34.161+0000 7fbb5d747700 1 -- 172.21.15.81:0/3390878565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb58100f50 msgr2=0x7fbb58197240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:34.161+0000 7fbb5d747700 1 --2- 172.21.15.81:0/3390878565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb58100f50 0x7fbb58197240 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbb4000c9b0 tx=0x7fbb4000ccc0 comp rx=0 tx=0).stop 2024-05-09T00:01:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:34.161+0000 7fbb5d747700 1 -- 172.21.15.81:0/3390878565 shutdown_connections 2024-05-09T00:01:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:34.161+0000 7fbb5d747700 1 --2- 172.21.15.81:0/3390878565 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbb440a1120 0x7fbb440a35e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:34.161+0000 7fbb5d747700 1 --2- 172.21.15.81:0/3390878565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbb580ffd60 0x7fbb58196d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:34.161+0000 7fbb5d747700 1 --2- 172.21.15.81:0/3390878565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbb581018f0 0x7fbb5819e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:34.161+0000 7fbb5d747700 1 --2- 172.21.15.81:0/3390878565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb58100f50 0x7fbb58197240 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:34.161+0000 7fbb5d747700 1 -- 172.21.15.81:0/3390878565 >> 172.21.15.81:0/3390878565 conn(0x7fbb580fb2f0 msgr2=0x7fbb58104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:34.162+0000 7fbb5d747700 1 -- 172.21.15.81:0/3390878565 shutdown_connections 2024-05-09T00:01:34.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:34.162+0000 7fbb5d747700 1 -- 172.21.15.81:0/3390878565 wait complete. 2024-05-09T00:01:34.157 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 9 2024-05-09T00:01:34.293 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:01:33 smithi171 systemd[1]: Starting Ceph mds.i for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:01:34.552 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:01:34 smithi171 ceph-mds[84272]: -- 172.21.15.171:0/3043161549 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c08511a1a0 con 0x55c0850f1000 2024-05-09T00:01:34.552 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:01:34 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-i[84249]: starting mds.i at 2024-05-09T00:01:34.553 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:01:34 smithi171 bash[84234]: b75310b7cecf8e77fedd396bd7dcea227cdfa31f20f468879101b9eef333040a 2024-05-09T00:01:34.553 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:01:34 smithi171 systemd[1]: Started Ceph mds.i for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:01:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:34 smithi171 ceph-mon[47351]: Deploying daemon mds.i on smithi171 2024-05-09T00:01:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:34 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] up:boot 2024-05-09T00:01:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:34 smithi171 ceph-mon[47351]: fsmap 8 up:standby 2024-05-09T00:01:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:34 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T00:01:34.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:34 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3390878565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:34.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:34 smithi081 ceph-mon[42474]: Deploying daemon mds.i on smithi171 2024-05-09T00:01:34.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:34 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] up:boot 2024-05-09T00:01:34.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:34 smithi081 ceph-mon[42474]: fsmap 8 up:standby 2024-05-09T00:01:34.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:34 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T00:01:34.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:34 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3390878565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:34.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:34 smithi150 ceph-mon[46187]: Deploying daemon mds.i on smithi171 2024-05-09T00:01:34.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:34 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] up:boot 2024-05-09T00:01:34.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:34 smithi150 ceph-mon[46187]: fsmap 8 up:standby 2024-05-09T00:01:34.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:34 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T00:01:34.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:34 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3390878565' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:35 smithi081 ceph-mon[42474]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:35 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] up:boot 2024-05-09T00:01:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:35 smithi081 ceph-mon[42474]: fsmap 9 up:standby 2024-05-09T00:01:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T00:01:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:35.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:35.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:35.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:35.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:35 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:35.621 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:35 smithi081 ceph-mon[42474]: Deploying daemon mds.g on smithi081 2024-05-09T00:01:35.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:35 smithi150 ceph-mon[46187]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:35.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:35 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] up:boot 2024-05-09T00:01:35.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:35 smithi150 ceph-mon[46187]: fsmap 9 up:standby 2024-05-09T00:01:35.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T00:01:35.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:35.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:35.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:35.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:35.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:35.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:35 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:35.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:35 smithi150 ceph-mon[46187]: Deploying daemon mds.g on smithi081 2024-05-09T00:01:35.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:35 smithi171 ceph-mon[47351]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:35.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:35 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] up:boot 2024-05-09T00:01:35.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:35 smithi171 ceph-mon[47351]: fsmap 9 up:standby 2024-05-09T00:01:35.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T00:01:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:35 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:35.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:35 smithi171 ceph-mon[47351]: Deploying daemon mds.g on smithi081 2024-05-09T00:01:36.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:01:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 -- 172.21.15.81:0/3839980559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d40ffd60 msgr2=0x7fb3d4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 --2- 172.21.15.81:0/3839980559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d40ffd60 0x7fb3d4100180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb3c80099c0 tx=0x7fb3c8009cd0 comp rx=0 tx=0).stop 2024-05-09T00:01:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 -- 172.21.15.81:0/3839980559 shutdown_connections 2024-05-09T00:01:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 --2- 172.21.15.81:0/3839980559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d41018f0 0x7fb3d41081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 --2- 172.21.15.81:0/3839980559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d40ffd60 0x7fb3d4100180 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 --2- 172.21.15.81:0/3839980559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d4100f50 0x7fb3d41013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 -- 172.21.15.81:0/3839980559 >> 172.21.15.81:0/3839980559 conn(0x7fb3d40fb2f0 msgr2=0x7fb3d40fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 -- 172.21.15.81:0/3839980559 shutdown_connections 2024-05-09T00:01:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 -- 172.21.15.81:0/3839980559 wait complete. 2024-05-09T00:01:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 Processor -- start 2024-05-09T00:01:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 -- start start 2024-05-09T00:01:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d40ffd60 0x7fb3d4196d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4100f50 0x7fb3d41972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d41018f0 0x7fb3d419e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d419e870 con 0x7fb3d41018f0 2024-05-09T00:01:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d419e9e0 con 0x7fb3d40ffd60 2024-05-09T00:01:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.310+0000 7fb3dab2a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d419eba0 con 0x7fb3d4100f50 2024-05-09T00:01:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d90c7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d41018f0 0x7fb3d419e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d90c7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d41018f0 0x7fb3d419e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44710/0 (socket says 172.21.15.81:44710) 2024-05-09T00:01:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d90c7700 1 -- 172.21.15.81:0/2736812582 learned_addr learned my addr 172.21.15.81:0/2736812582 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4100f50 0x7fb3d41972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d88c6700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d40ffd60 0x7fb3d4196d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d90c7700 1 -- 172.21.15.81:0/2736812582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4100f50 msgr2=0x7fb3d41972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d90c7700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4100f50 0x7fb3d41972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d90c7700 1 -- 172.21.15.81:0/2736812582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d40ffd60 msgr2=0x7fb3d4196d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d90c7700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d40ffd60 0x7fb3d4196d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d90c7700 1 -- 172.21.15.81:0/2736812582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c80095f0 con 0x7fb3d41018f0 2024-05-09T00:01:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4100f50 0x7fb3d41972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:01:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d90c7700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d41018f0 0x7fb3d419e2a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc007d70 tx=0x7fb3cc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d1ffb700 1 -- 172.21.15.81:0/2736812582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc00ad40 con 0x7fb3d41018f0 2024-05-09T00:01:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d1ffb700 1 -- 172.21.15.81:0/2736812582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3cc0128e0 con 0x7fb3d41018f0 2024-05-09T00:01:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3dab2a700 1 -- 172.21.15.81:0/2736812582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d419ee80 con 0x7fb3d41018f0 2024-05-09T00:01:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.311+0000 7fb3d1ffb700 1 -- 172.21.15.81:0/2736812582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc011780 con 0x7fb3d41018f0 2024-05-09T00:01:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.312+0000 7fb3dab2a700 1 -- 172.21.15.81:0/2736812582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d419f250 con 0x7fb3d41018f0 2024-05-09T00:01:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.312+0000 7fb3dab2a700 1 -- 172.21.15.81:0/2736812582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d4067c10 con 0x7fb3d41018f0 2024-05-09T00:01:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.313+0000 7fb3d1ffb700 1 -- 172.21.15.81:0/2736812582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb3cc012a50 con 0x7fb3d41018f0 2024-05-09T00:01:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.314+0000 7fb3d1ffb700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb3c40a1120 0x7fb3c40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.314+0000 7fb3d88c6700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb3c40a1120 0x7fb3c40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.314+0000 7fb3d1ffb700 1 -- 172.21.15.81:0/2736812582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb3cc0cc7e0 con 0x7fb3d41018f0 2024-05-09T00:01:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.314+0000 7fb3d88c6700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb3c40a1120 0x7fb3c40a35e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8000c00 tx=0x7fb3c8009f30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.318+0000 7fb3d1ffb700 1 -- 172.21.15.81:0/2736812582 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb3cc096370 con 0x7fb3d41018f0 2024-05-09T00:01:36.370 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 09 00:01:36 smithi081 bash[92421]: ed0d2a114cca2afa9084f64188ae4cc6c390ea54cc4dd366315fb2a2a17b18a8 2024-05-09T00:01:36.370 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 09 00:01:36 smithi081 systemd[1]: Started Ceph mds.g for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:01:36.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.600+0000 7fb3dab2a700 1 -- 172.21.15.81:0/2736812582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3d410b570 con 0x7fb3d41018f0 2024-05-09T00:01:36.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.601+0000 7fb3d1ffb700 1 -- 172.21.15.81:0/2736812582 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8082 (secure 0 0 0) 0x7fb3cc099990 con 0x7fb3d41018f0 2024-05-09T00:01:36.595 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:36.595 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24452,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24476,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-05-09T00:01:36.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.604+0000 7fb3dab2a700 1 -- 172.21.15.81:0/2736812582 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb3c40a1120 msgr2=0x7fb3c40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:36.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.604+0000 7fb3dab2a700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb3c40a1120 0x7fb3c40a35e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8000c00 tx=0x7fb3c8009f30 comp rx=0 tx=0).stop 2024-05-09T00:01:36.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.604+0000 7fb3dab2a700 1 -- 172.21.15.81:0/2736812582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d41018f0 msgr2=0x7fb3d419e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:36.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.604+0000 7fb3dab2a700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d41018f0 0x7fb3d419e2a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc007d70 tx=0x7fb3cc00a340 comp rx=0 tx=0).stop 2024-05-09T00:01:36.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.604+0000 7fb3dab2a700 1 -- 172.21.15.81:0/2736812582 shutdown_connections 2024-05-09T00:01:36.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.604+0000 7fb3dab2a700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb3c40a1120 0x7fb3c40a35e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:36.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.604+0000 7fb3dab2a700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d40ffd60 0x7fb3d4196d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:36.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.604+0000 7fb3dab2a700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d41018f0 0x7fb3d419e2a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:36.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.604+0000 7fb3dab2a700 1 --2- 172.21.15.81:0/2736812582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4100f50 0x7fb3d41972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:36.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.604+0000 7fb3dab2a700 1 -- 172.21.15.81:0/2736812582 >> 172.21.15.81:0/2736812582 conn(0x7fb3d40fb2f0 msgr2=0x7fb3d40fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:36.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.604+0000 7fb3dab2a700 1 -- 172.21.15.81:0/2736812582 shutdown_connections 2024-05-09T00:01:36.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:36.604+0000 7fb3dab2a700 1 -- 172.21.15.81:0/2736812582 wait complete. 2024-05-09T00:01:36.599 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 11 2024-05-09T00:01:37.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:37.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:37.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:37.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:37.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:37.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:37.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:37 smithi081 ceph-mon[42474]: Deploying daemon mds.a on smithi081 2024-05-09T00:01:37.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:37 smithi081 ceph-mon[42474]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:37.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:37 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.81:6838/567553409,v1:172.21.15.81:6839/567553409] up:boot 2024-05-09T00:01:37.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:37 smithi081 ceph-mon[42474]: fsmap 10 up:standby 2024-05-09T00:01:37.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:37 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T00:01:37.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:37 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2736812582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:37.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:37.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:37.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:37.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:37.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:37.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:37.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:37 smithi150 ceph-mon[46187]: Deploying daemon mds.a on smithi081 2024-05-09T00:01:37.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:37 smithi150 ceph-mon[46187]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:37.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:37 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.81:6838/567553409,v1:172.21.15.81:6839/567553409] up:boot 2024-05-09T00:01:37.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:37 smithi150 ceph-mon[46187]: fsmap 10 up:standby 2024-05-09T00:01:37.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:37 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T00:01:37.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:37 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2736812582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:37.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:37.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:37.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:37.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:37.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:37.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:37.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:37 smithi171 ceph-mon[47351]: Deploying daemon mds.a on smithi081 2024-05-09T00:01:37.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:37 smithi171 ceph-mon[47351]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:37.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:37 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.81:6838/567553409,v1:172.21.15.81:6839/567553409] up:boot 2024-05-09T00:01:37.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:37 smithi171 ceph-mon[47351]: fsmap 10 up:standby 2024-05-09T00:01:37.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:37 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T00:01:37.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:37 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2736812582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:37.700 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 09 00:01:37 smithi081 systemd[1]: Starting Ceph mds.a for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:01:38.119 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 09 00:01:37 smithi081 ceph-mds[92852]: -- 172.21.15.81:0/2250640384 <== mon.0 v2:172.21.15.81:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f3d68ea1a0 con 0x55f3d68c0c00 2024-05-09T00:01:38.119 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 09 00:01:37 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-a[92829]: starting mds.a at 2024-05-09T00:01:38.120 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 09 00:01:37 smithi081 bash[92814]: 91a50a86d5448474a635d7330afcb44d6a7bb57ab23c128a224be41fcabbd811 2024-05-09T00:01:38.120 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 09 00:01:37 smithi081 systemd[1]: Started Ceph mds.a for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:01:38.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:01:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.758+0000 7f9126537700 1 -- 172.21.15.81:0/1511150718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9120100f50 msgr2=0x7f91201013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.758+0000 7f9126537700 1 --2- 172.21.15.81:0/1511150718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9120100f50 0x7f91201013b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f91140099c0 tx=0x7f9114009cd0 comp rx=0 tx=0).stop 2024-05-09T00:01:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.759+0000 7f9126537700 1 -- 172.21.15.81:0/1511150718 shutdown_connections 2024-05-09T00:01:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.759+0000 7f9126537700 1 --2- 172.21.15.81:0/1511150718 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91200ffd60 0x7f9120100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.759+0000 7f9126537700 1 --2- 172.21.15.81:0/1511150718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91201018f0 0x7f91201081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.759+0000 7f9126537700 1 --2- 172.21.15.81:0/1511150718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9120100f50 0x7f91201013b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.759+0000 7f9126537700 1 -- 172.21.15.81:0/1511150718 >> 172.21.15.81:0/1511150718 conn(0x7f91200fb2f0 msgr2=0x7f91200fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:38.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.759+0000 7f9126537700 1 -- 172.21.15.81:0/1511150718 shutdown_connections 2024-05-09T00:01:38.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.759+0000 7f9126537700 1 -- 172.21.15.81:0/1511150718 wait complete. 2024-05-09T00:01:38.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.760+0000 7f9126537700 1 Processor -- start 2024-05-09T00:01:38.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.760+0000 7f9126537700 1 -- start start 2024-05-09T00:01:38.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.760+0000 7f9126537700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91200ffd60 0x7f9120068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:38.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.760+0000 7f9126537700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9120100f50 0x7f912019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:38.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.760+0000 7f9126537700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91201018f0 0x7f912019e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:38.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.760+0000 7f9126537700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912019e8d0 con 0x7f91201018f0 2024-05-09T00:01:38.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.760+0000 7f9126537700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912019ea40 con 0x7f91200ffd60 2024-05-09T00:01:38.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.760+0000 7f9126537700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912019ec00 con 0x7f9120100f50 2024-05-09T00:01:38.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.760+0000 7f9124ad4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91201018f0 0x7f912019e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:38.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.760+0000 7f9124ad4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91201018f0 0x7f912019e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42336/0 (socket says 172.21.15.81:42336) 2024-05-09T00:01:38.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.760+0000 7f9124ad4700 1 -- 172.21.15.81:0/3539987538 learned_addr learned my addr 172.21.15.81:0/3539987538 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:38.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.760+0000 7f911ffff700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91200ffd60 0x7f9120068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:38.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.760+0000 7f911f7fe700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9120100f50 0x7f912019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:38.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.761+0000 7f9124ad4700 1 -- 172.21.15.81:0/3539987538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9120100f50 msgr2=0x7f912019bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:38.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.761+0000 7f9124ad4700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9120100f50 0x7f912019bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:38.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.761+0000 7f9124ad4700 1 -- 172.21.15.81:0/3539987538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91200ffd60 msgr2=0x7f9120068b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:38.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.761+0000 7f9124ad4700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91200ffd60 0x7f9120068b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:38.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.761+0000 7f9124ad4700 1 -- 172.21.15.81:0/3539987538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91140095f0 con 0x7f91201018f0 2024-05-09T00:01:38.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.761+0000 7f911f7fe700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9120100f50 0x7f912019bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:38.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.761+0000 7f9124ad4700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91201018f0 0x7f912019e0e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9118007ee0 tx=0x7f911800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:38.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.761+0000 7f911d7fa700 1 -- 172.21.15.81:0/3539987538 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118017070 con 0x7f91201018f0 2024-05-09T00:01:38.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.761+0000 7f911d7fa700 1 -- 172.21.15.81:0/3539987538 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f911800f040 con 0x7f91201018f0 2024-05-09T00:01:38.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.761+0000 7f9126537700 1 -- 172.21.15.81:0/3539987538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912019ee80 con 0x7f91201018f0 2024-05-09T00:01:38.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.761+0000 7f911d7fa700 1 -- 172.21.15.81:0/3539987538 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118005740 con 0x7f91201018f0 2024-05-09T00:01:38.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.761+0000 7f9126537700 1 -- 172.21.15.81:0/3539987538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912019f2b0 con 0x7f91201018f0 2024-05-09T00:01:38.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.762+0000 7f9126537700 1 -- 172.21.15.81:0/3539987538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91201071e0 con 0x7f91201018f0 2024-05-09T00:01:38.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.763+0000 7f911d7fa700 1 -- 172.21.15.81:0/3539987538 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f911800dc60 con 0x7f91201018f0 2024-05-09T00:01:38.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.764+0000 7f911d7fa700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f91080a1120 0x7f91080a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.764+0000 7f911ffff700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f91080a1120 0x7f91080a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.764+0000 7f911d7fa700 1 -- 172.21.15.81:0/3539987538 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f91180cc310 con 0x7f91201018f0 2024-05-09T00:01:38.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.764+0000 7f911ffff700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f91080a1120 0x7f91080a35e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9120100db0 tx=0x7f911000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:38.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:38.767+0000 7f911d7fa700 1 -- 172.21.15.81:0/3539987538 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9118095ea0 con 0x7f91201018f0 2024-05-09T00:01:39.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:39.013+0000 7f9126537700 1 -- 172.21.15.81:0/3539987538 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9120067c10 con 0x7f91201018f0 2024-05-09T00:01:39.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:39.014+0000 7f911d7fa700 1 -- 172.21.15.81:0/3539987538 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8837 (secure 0 0 0) 0x7f91180994c0 con 0x7f91201018f0 2024-05-09T00:01:39.008 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:39.008 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24452,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24476,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2024-05-09T00:01:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:39.016+0000 7f9126537700 1 -- 172.21.15.81:0/3539987538 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f91080a1120 msgr2=0x7f91080a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:39.016+0000 7f9126537700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f91080a1120 0x7f91080a35e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9120100db0 tx=0x7f911000b410 comp rx=0 tx=0).stop 2024-05-09T00:01:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:39.016+0000 7f9126537700 1 -- 172.21.15.81:0/3539987538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91201018f0 msgr2=0x7f912019e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:39.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:39.016+0000 7f9126537700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91201018f0 0x7f912019e0e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9118007ee0 tx=0x7f911800d3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:39.016+0000 7f9126537700 1 -- 172.21.15.81:0/3539987538 shutdown_connections 2024-05-09T00:01:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:39.016+0000 7f9126537700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f91080a1120 0x7f91080a35e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:39.016+0000 7f9126537700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91200ffd60 0x7f9120068b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:39.016+0000 7f9126537700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91201018f0 0x7f912019e0e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:39.016+0000 7f9126537700 1 --2- 172.21.15.81:0/3539987538 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9120100f50 0x7f912019bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:39.016+0000 7f9126537700 1 -- 172.21.15.81:0/3539987538 >> 172.21.15.81:0/3539987538 conn(0x7f91200fb2f0 msgr2=0x7f9120104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:39.016+0000 7f9126537700 1 -- 172.21.15.81:0/3539987538 shutdown_connections 2024-05-09T00:01:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:39.016+0000 7f9126537700 1 -- 172.21.15.81:0/3539987538 wait complete. 2024-05-09T00:01:39.011 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 12 2024-05-09T00:01:39.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:39.021 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:39.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:39.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:39.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:39.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:39.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:38 smithi081 ceph-mon[42474]: Deploying daemon mds.b on smithi150 2024-05-09T00:01:39.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:38 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.81:6840/447183521,v1:172.21.15.81:6841/447183521] up:boot 2024-05-09T00:01:39.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:38 smithi081 ceph-mon[42474]: fsmap 11 up:standby 2024-05-09T00:01:39.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:38 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T00:01:39.022 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:38 smithi081 ceph-mon[42474]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:39.264 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:01:39 smithi150 systemd[1]: Starting Ceph mds.b for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:01:39.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:39.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:39.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:39.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:39.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:39.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:39.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:38 smithi150 ceph-mon[46187]: Deploying daemon mds.b on smithi150 2024-05-09T00:01:39.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:38 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.81:6840/447183521,v1:172.21.15.81:6841/447183521] up:boot 2024-05-09T00:01:39.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:38 smithi150 ceph-mon[46187]: fsmap 11 up:standby 2024-05-09T00:01:39.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:38 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T00:01:39.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:38 smithi150 ceph-mon[46187]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:39.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:39.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:39.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:39.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-09T00:01:39.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-09T00:01:39.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:39.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:38 smithi171 ceph-mon[47351]: Deploying daemon mds.b on smithi150 2024-05-09T00:01:39.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:38 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.81:6840/447183521,v1:172.21.15.81:6841/447183521] up:boot 2024-05-09T00:01:39.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:38 smithi171 ceph-mon[47351]: fsmap 11 up:standby 2024-05-09T00:01:39.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:38 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T00:01:39.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:38 smithi171 ceph-mon[47351]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:39.764 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:01:39 smithi150 ceph-mds[81446]: -- 172.21.15.150:0/1584343740 <== mon.2 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562d564641a0 con 0x562d5643a800 2024-05-09T00:01:39.764 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:01:39 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-b[81423]: starting mds.b at 2024-05-09T00:01:39.764 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:01:39 smithi150 bash[81408]: 2575a6edc90a8aa7e485500bb78052ce1e7357a47ebf29645db0c9be948198aa 2024-05-09T00:01:39.764 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:01:39 smithi150 systemd[1]: Started Ceph mds.b for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:01:40.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:39 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3539987538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:40.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:39 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:40.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:39 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3539987538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:40.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:39 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:40.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:39 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3539987538' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:40.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:40.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:39 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:41.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:01:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.156+0000 7fa52f2df700 1 -- 172.21.15.81:0/1420140503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa528106bc0 msgr2=0x7fa528108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.156+0000 7fa52f2df700 1 --2- 172.21.15.81:0/1420140503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa528106bc0 0x7fa528108fb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa52000b0a0 tx=0x7fa52000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.156+0000 7fa52f2df700 1 -- 172.21.15.81:0/1420140503 shutdown_connections 2024-05-09T00:01:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.156+0000 7fa52f2df700 1 --2- 172.21.15.81:0/1420140503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa528101960 0x7fa528103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.156+0000 7fa52f2df700 1 --2- 172.21.15.81:0/1420140503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa528106bc0 0x7fa528108fb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.156+0000 7fa52f2df700 1 --2- 172.21.15.81:0/1420140503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa528104290 0x7fa528106680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.156+0000 7fa52f2df700 1 -- 172.21.15.81:0/1420140503 >> 172.21.15.81:0/1420140503 conn(0x7fa5280fb2f0 msgr2=0x7fa5280fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.156+0000 7fa52f2df700 1 -- 172.21.15.81:0/1420140503 shutdown_connections 2024-05-09T00:01:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.156+0000 7fa52f2df700 1 -- 172.21.15.81:0/1420140503 wait complete. 2024-05-09T00:01:41.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.156+0000 7fa52f2df700 1 Processor -- start 2024-05-09T00:01:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.156+0000 7fa52f2df700 1 -- start start 2024-05-09T00:01:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52f2df700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa528101960 0x7fa528101280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52f2df700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa528104290 0x7fa5280ff910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52f2df700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa528106bc0 0x7fa5280ffe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52f2df700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5281005f0 con 0x7fa528106bc0 2024-05-09T00:01:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52f2df700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa528100760 con 0x7fa528101960 2024-05-09T00:01:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52f2df700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5281a0f30 con 0x7fa528104290 2024-05-09T00:01:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52d87c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa528106bc0 0x7fa5280ffe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52d87c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa528106bc0 0x7fa5280ffe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42354/0 (socket says 172.21.15.81:42354) 2024-05-09T00:01:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52d87c700 1 -- 172.21.15.81:0/1761625736 learned_addr learned my addr 172.21.15.81:0/1761625736 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52d07b700 1 --2- 172.21.15.81:0/1761625736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa528101960 0x7fa528101280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52c87a700 1 --2- 172.21.15.81:0/1761625736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa528104290 0x7fa5280ff910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:41.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52d87c700 1 -- 172.21.15.81:0/1761625736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa528104290 msgr2=0x7fa5280ff910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52d87c700 1 --2- 172.21.15.81:0/1761625736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa528104290 0x7fa5280ff910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52d87c700 1 -- 172.21.15.81:0/1761625736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa528101960 msgr2=0x7fa528101280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52d87c700 1 --2- 172.21.15.81:0/1761625736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa528101960 0x7fa528101280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52d87c700 1 -- 172.21.15.81:0/1761625736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa520009d00 con 0x7fa528106bc0 2024-05-09T00:01:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52d87c700 1 --2- 172.21.15.81:0/1761625736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa528106bc0 0x7fa5280ffe50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa520007ab0 tx=0x7fa520004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa51e7fc700 1 -- 172.21.15.81:0/1761625736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52000e040 con 0x7fa528106bc0 2024-05-09T00:01:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa51e7fc700 1 -- 172.21.15.81:0/1761625736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa520004e70 con 0x7fa528106bc0 2024-05-09T00:01:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52f2df700 1 -- 172.21.15.81:0/1761625736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5281a1160 con 0x7fa528106bc0 2024-05-09T00:01:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa51e7fc700 1 -- 172.21.15.81:0/1761625736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52001da70 con 0x7fa528106bc0 2024-05-09T00:01:41.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.157+0000 7fa52f2df700 1 -- 172.21.15.81:0/1761625736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5281a1580 con 0x7fa528106bc0 2024-05-09T00:01:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.158+0000 7fa52f2df700 1 -- 172.21.15.81:0/1761625736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5280fce70 con 0x7fa528106bc0 2024-05-09T00:01:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.160+0000 7fa51e7fc700 1 -- 172.21.15.81:0/1761625736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa5200058a0 con 0x7fa528106bc0 2024-05-09T00:01:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.161+0000 7fa51e7fc700 1 --2- 172.21.15.81:0/1761625736 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa5140a1120 0x7fa5140a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.161+0000 7fa52d07b700 1 --2- 172.21.15.81:0/1761625736 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa5140a1120 0x7fa5140a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.161+0000 7fa51e7fc700 1 -- 172.21.15.81:0/1761625736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa5200ce1a0 con 0x7fa528106bc0 2024-05-09T00:01:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.161+0000 7fa52d07b700 1 --2- 172.21.15.81:0/1761625736 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa5140a1120 0x7fa5140a35e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa524005950 tx=0x7fa52400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.164+0000 7fa51e7fc700 1 -- 172.21.15.81:0/1761625736 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa520097e60 con 0x7fa528106bc0 2024-05-09T00:01:41.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:41 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] up:boot 2024-05-09T00:01:41.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:41 smithi081 ceph-mon[42474]: fsmap 12 up:standby 2024-05-09T00:01:41.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T00:01:41.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:41 smithi081 ceph-mon[42474]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:41.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:41 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.418+0000 7fa52f2df700 1 -- 172.21.15.81:0/1761625736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa52810c7a0 con 0x7fa528106bc0 2024-05-09T00:01:41.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.419+0000 7fa51e7fc700 1 -- 172.21.15.81:0/1761625736 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9598 (secure 0 0 0) 0x7fa52009b480 con 0x7fa528106bc0 2024-05-09T00:01:41.413 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:41.413 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24451,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24452,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24463,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24476,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24487,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2024-05-09T00:01:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.421+0000 7fa52f2df700 1 -- 172.21.15.81:0/1761625736 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa5140a1120 msgr2=0x7fa5140a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.421+0000 7fa52f2df700 1 --2- 172.21.15.81:0/1761625736 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa5140a1120 0x7fa5140a35e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa524005950 tx=0x7fa52400b410 comp rx=0 tx=0).stop 2024-05-09T00:01:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.421+0000 7fa52f2df700 1 -- 172.21.15.81:0/1761625736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa528106bc0 msgr2=0x7fa5280ffe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.421+0000 7fa52f2df700 1 --2- 172.21.15.81:0/1761625736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa528106bc0 0x7fa5280ffe50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa520007ab0 tx=0x7fa520004c80 comp rx=0 tx=0).stop 2024-05-09T00:01:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.421+0000 7fa52f2df700 1 -- 172.21.15.81:0/1761625736 shutdown_connections 2024-05-09T00:01:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.421+0000 7fa52f2df700 1 --2- 172.21.15.81:0/1761625736 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa5140a1120 0x7fa5140a35e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.421+0000 7fa52f2df700 1 --2- 172.21.15.81:0/1761625736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa528101960 0x7fa528101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.421+0000 7fa52f2df700 1 --2- 172.21.15.81:0/1761625736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa528106bc0 0x7fa5280ffe50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.421+0000 7fa52f2df700 1 --2- 172.21.15.81:0/1761625736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa528104290 0x7fa5280ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.421+0000 7fa52f2df700 1 -- 172.21.15.81:0/1761625736 >> 172.21.15.81:0/1761625736 conn(0x7fa5280fb2f0 msgr2=0x7fa5281022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:41.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.421+0000 7fa52f2df700 1 -- 172.21.15.81:0/1761625736 shutdown_connections 2024-05-09T00:01:41.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.421+0000 7fa52f2df700 1 -- 172.21.15.81:0/1761625736 wait complete. 2024-05-09T00:01:41.417 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 13 2024-05-09T00:01:41.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:01:41.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:41 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] up:boot 2024-05-09T00:01:41.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:41 smithi150 ceph-mon[46187]: fsmap 12 up:standby 2024-05-09T00:01:41.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T00:01:41.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:41 smithi150 ceph-mon[46187]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:41.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:41 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:41 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] up:boot 2024-05-09T00:01:41.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:41 smithi171 ceph-mon[47351]: fsmap 12 up:standby 2024-05-09T00:01:41.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T00:01:41.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:41 smithi171 ceph-mon[47351]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:41.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:41 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.561+0000 7f5d7c99a700 1 -- 172.21.15.81:0/2918804810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d781018f0 msgr2=0x7f5d78103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.561+0000 7f5d7c99a700 1 --2- 172.21.15.81:0/2918804810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d781018f0 0x7f5d78103ce0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009990 tx=0x7f5d68009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.561+0000 7f5d7c99a700 1 -- 172.21.15.81:0/2918804810 shutdown_connections 2024-05-09T00:01:41.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.561+0000 7f5d7c99a700 1 --2- 172.21.15.81:0/2918804810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d78106b50 0x7f5d78108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.561+0000 7f5d7c99a700 1 --2- 172.21.15.81:0/2918804810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d781018f0 0x7f5d78103ce0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.561+0000 7f5d7c99a700 1 --2- 172.21.15.81:0/2918804810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d78104220 0x7f5d78106610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.561+0000 7f5d7c99a700 1 -- 172.21.15.81:0/2918804810 >> 172.21.15.81:0/2918804810 conn(0x7f5d780fb300 msgr2=0x7f5d780fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:41.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.561+0000 7f5d7c99a700 1 -- 172.21.15.81:0/2918804810 shutdown_connections 2024-05-09T00:01:41.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.561+0000 7f5d7c99a700 1 -- 172.21.15.81:0/2918804810 wait complete. 2024-05-09T00:01:41.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.561+0000 7f5d7c99a700 1 Processor -- start 2024-05-09T00:01:41.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.561+0000 7f5d7c99a700 1 -- start start 2024-05-09T00:01:41.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d7c99a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d781018f0 0x7f5d78101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:41.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d7c99a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d78104220 0x7f5d780ff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:41.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d7c99a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d78106b50 0x7f5d780ffde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:41.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d7c99a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d78100580 con 0x7f5d78104220 2024-05-09T00:01:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d7c99a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d781006f0 con 0x7f5d781018f0 2024-05-09T00:01:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d7c99a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d781a0e70 con 0x7f5d78106b50 2024-05-09T00:01:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d75d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d78104220 0x7f5d780ff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d75d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d78104220 0x7f5d780ff8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42374/0 (socket says 172.21.15.81:42374) 2024-05-09T00:01:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d75d9b700 1 -- 172.21.15.81:0/3377571305 learned_addr learned my addr 172.21.15.81:0/3377571305 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d7659c700 1 --2- 172.21.15.81:0/3377571305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d781018f0 0x7f5d78101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d76d9d700 1 --2- 172.21.15.81:0/3377571305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d78106b50 0x7f5d780ffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d75d9b700 1 -- 172.21.15.81:0/3377571305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d78106b50 msgr2=0x7f5d780ffde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d75d9b700 1 --2- 172.21.15.81:0/3377571305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d78106b50 0x7f5d780ffde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d75d9b700 1 -- 172.21.15.81:0/3377571305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d781018f0 msgr2=0x7f5d78101210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d75d9b700 1 --2- 172.21.15.81:0/3377571305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d781018f0 0x7f5d78101210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d75d9b700 1 -- 172.21.15.81:0/3377571305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d680095f0 con 0x7f5d78104220 2024-05-09T00:01:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d75d9b700 1 --2- 172.21.15.81:0/3377571305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d78104220 0x7f5d780ff8a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00e9a0 tx=0x7f5d6c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d677fe700 1 -- 172.21.15.81:0/3377571305 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c009790 con 0x7f5d78104220 2024-05-09T00:01:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d7c99a700 1 -- 172.21.15.81:0/3377571305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d781a1100 con 0x7f5d78104220 2024-05-09T00:01:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d677fe700 1 -- 172.21.15.81:0/3377571305 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d6c00ce70 con 0x7f5d78104220 2024-05-09T00:01:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d677fe700 1 -- 172.21.15.81:0/3377571305 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c018420 con 0x7f5d78104220 2024-05-09T00:01:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.562+0000 7f5d7c99a700 1 -- 172.21.15.81:0/3377571305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d781a1610 con 0x7f5d78104220 2024-05-09T00:01:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.563+0000 7f5d7c99a700 1 -- 172.21.15.81:0/3377571305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d780fce80 con 0x7f5d78104220 2024-05-09T00:01:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.565+0000 7f5d677fe700 1 -- 172.21.15.81:0/3377571305 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5d6c0106f0 con 0x7f5d78104220 2024-05-09T00:01:41.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.565+0000 7f5d677fe700 1 --2- 172.21.15.81:0/3377571305 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5d600a1120 0x7f5d600a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:41.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.565+0000 7f5d677fe700 1 -- 172.21.15.81:0/3377571305 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5d6c014070 con 0x7f5d78104220 2024-05-09T00:01:41.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.565+0000 7f5d7659c700 1 --2- 172.21.15.81:0/3377571305 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5d600a1120 0x7f5d600a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:41.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.566+0000 7f5d7659c700 1 --2- 172.21.15.81:0/3377571305 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5d600a1120 0x7f5d600a35e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800b2e0 tx=0x7f5d68005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:41.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.572+0000 7f5d677fe700 1 -- 172.21.15.81:0/3377571305 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5d6c0966b0 con 0x7f5d78104220 2024-05-09T00:01:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.791+0000 7f5d7c99a700 1 -- 172.21.15.81:0/3377571305 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d78068060 con 0x7f5d78104220 2024-05-09T00:01:41.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.792+0000 7f5d677fe700 1 -- 172.21.15.81:0/3377571305 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+18398 (secure 0 0 0) 0x7f5d6c099cd0 con 0x7f5d78104220 2024-05-09T00:01:41.786 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:41.787 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:01:13.402033+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:01:41.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.794+0000 7f5d7c99a700 1 -- 172.21.15.81:0/3377571305 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5d600a1120 msgr2=0x7f5d600a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:41.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.794+0000 7f5d7c99a700 1 --2- 172.21.15.81:0/3377571305 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5d600a1120 0x7f5d600a35e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5d6800b2e0 tx=0x7f5d68005fb0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.794+0000 7f5d7c99a700 1 -- 172.21.15.81:0/3377571305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d78104220 msgr2=0x7f5d780ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:41.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.794+0000 7f5d7c99a700 1 --2- 172.21.15.81:0/3377571305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d78104220 0x7f5d780ff8a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00e9a0 tx=0x7f5d6c00ecb0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.794+0000 7f5d7c99a700 1 -- 172.21.15.81:0/3377571305 shutdown_connections 2024-05-09T00:01:41.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.794+0000 7f5d7c99a700 1 --2- 172.21.15.81:0/3377571305 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5d600a1120 0x7f5d600a35e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.794+0000 7f5d7c99a700 1 --2- 172.21.15.81:0/3377571305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d781018f0 0x7f5d78101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.794+0000 7f5d7c99a700 1 --2- 172.21.15.81:0/3377571305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d78106b50 0x7f5d780ffde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.794+0000 7f5d7c99a700 1 --2- 172.21.15.81:0/3377571305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d78104220 0x7f5d780ff8a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.794+0000 7f5d7c99a700 1 -- 172.21.15.81:0/3377571305 >> 172.21.15.81:0/3377571305 conn(0x7f5d780fb300 msgr2=0x7f5d78102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:41.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.794+0000 7f5d7c99a700 1 -- 172.21.15.81:0/3377571305 shutdown_connections 2024-05-09T00:01:41.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.794+0000 7f5d7c99a700 1 -- 172.21.15.81:0/3377571305 wait complete. 2024-05-09T00:01:41.801 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:58:34.523249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:01:41.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:01:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.935+0000 7f8b84eea700 1 -- 172.21.15.81:0/1256266468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b80101a60 msgr2=0x7f8b80103e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.935+0000 7f8b84eea700 1 --2- 172.21.15.81:0/1256266468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b80101a60 0x7f8b80103e50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8b70009990 tx=0x7f8b70009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.936+0000 7f8b84eea700 1 -- 172.21.15.81:0/1256266468 shutdown_connections 2024-05-09T00:01:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.936+0000 7f8b84eea700 1 --2- 172.21.15.81:0/1256266468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b80106cc0 0x7f8b801090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.936+0000 7f8b84eea700 1 --2- 172.21.15.81:0/1256266468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b80101a60 0x7f8b80103e50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.936+0000 7f8b84eea700 1 --2- 172.21.15.81:0/1256266468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b80104390 0x7f8b80106780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.936+0000 7f8b84eea700 1 -- 172.21.15.81:0/1256266468 >> 172.21.15.81:0/1256266468 conn(0x7f8b800fb3f0 msgr2=0x7f8b800fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.936+0000 7f8b84eea700 1 -- 172.21.15.81:0/1256266468 shutdown_connections 2024-05-09T00:01:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.936+0000 7f8b84eea700 1 -- 172.21.15.81:0/1256266468 wait complete. 2024-05-09T00:01:41.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.936+0000 7f8b84eea700 1 Processor -- start 2024-05-09T00:01:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.936+0000 7f8b84eea700 1 -- start start 2024-05-09T00:01:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.936+0000 7f8b84eea700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b80101a60 0x7f8b80196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b84eea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b80104390 0x7f8b80197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b84eea700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b80106cc0 0x7f8b8019e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b84eea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8019ea10 con 0x7f8b80104390 2024-05-09T00:01:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b84eea700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8019eb50 con 0x7f8b80106cc0 2024-05-09T00:01:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b84eea700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8019ece0 con 0x7f8b80101a60 2024-05-09T00:01:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b7dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b80104390 0x7f8b80197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b7dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b80104390 0x7f8b80197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42386/0 (socket says 172.21.15.81:42386) 2024-05-09T00:01:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b7dd9b700 1 -- 172.21.15.81:0/3875662007 learned_addr learned my addr 172.21.15.81:0/3875662007 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b7e59c700 1 --2- 172.21.15.81:0/3875662007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b80101a60 0x7f8b80196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b7ed9d700 1 --2- 172.21.15.81:0/3875662007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b80106cc0 0x7f8b8019e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b7dd9b700 1 -- 172.21.15.81:0/3875662007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b80101a60 msgr2=0x7f8b80196ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:41.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b7dd9b700 1 --2- 172.21.15.81:0/3875662007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b80101a60 0x7f8b80196ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b7dd9b700 1 -- 172.21.15.81:0/3875662007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b80106cc0 msgr2=0x7f8b8019e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b7dd9b700 1 --2- 172.21.15.81:0/3875662007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b80106cc0 0x7f8b8019e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b7dd9b700 1 -- 172.21.15.81:0/3875662007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b700095f0 con 0x7f8b80104390 2024-05-09T00:01:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b7dd9b700 1 --2- 172.21.15.81:0/3875662007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b80104390 0x7f8b80197420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400d980 tx=0x7f8b7400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b6f7fe700 1 -- 172.21.15.81:0/3875662007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74004220 con 0x7f8b80104390 2024-05-09T00:01:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b6f7fe700 1 -- 172.21.15.81:0/3875662007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b74007640 con 0x7f8b80104390 2024-05-09T00:01:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b84eea700 1 -- 172.21.15.81:0/3875662007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8019efc0 con 0x7f8b80104390 2024-05-09T00:01:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b6f7fe700 1 -- 172.21.15.81:0/3875662007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74005690 con 0x7f8b80104390 2024-05-09T00:01:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.937+0000 7f8b84eea700 1 -- 172.21.15.81:0/3875662007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8019f440 con 0x7f8b80104390 2024-05-09T00:01:41.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.939+0000 7f8b84eea700 1 -- 172.21.15.81:0/3875662007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b800fcf70 con 0x7f8b80104390 2024-05-09T00:01:41.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.940+0000 7f8b6f7fe700 1 -- 172.21.15.81:0/3875662007 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f8b74004750 con 0x7f8b80104390 2024-05-09T00:01:41.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.940+0000 7f8b6f7fe700 1 --2- 172.21.15.81:0/3875662007 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8b680a1120 0x7f8b680a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:41.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.940+0000 7f8b7e59c700 1 --2- 172.21.15.81:0/3875662007 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8b680a1120 0x7f8b680a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:41.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.940+0000 7f8b6f7fe700 1 -- 172.21.15.81:0/3875662007 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8b740cc240 con 0x7f8b80104390 2024-05-09T00:01:41.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.941+0000 7f8b7e59c700 1 --2- 172.21.15.81:0/3875662007 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8b680a1120 0x7f8b680a35e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000b2e0 tx=0x7f8b70005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:41.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:41.944+0000 7f8b6f7fe700 1 -- 172.21.15.81:0/3875662007 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8b74095e70 con 0x7f8b80104390 2024-05-09T00:01:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.170+0000 7f8b84eea700 1 -- 172.21.15.81:0/3875662007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8b8010c790 con 0x7f8b80104390 2024-05-09T00:01:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.170+0000 7f8b6f7fe700 1 -- 172.21.15.81:0/3875662007 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8b74099490 con 0x7f8b80104390 2024-05-09T00:01:42.166 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-09T00:01:42.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.172+0000 7f8b84eea700 1 -- 172.21.15.81:0/3875662007 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8b680a1120 msgr2=0x7f8b680a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:42.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.172+0000 7f8b84eea700 1 --2- 172.21.15.81:0/3875662007 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8b680a1120 0x7f8b680a35e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8b7000b2e0 tx=0x7f8b70005fb0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.172+0000 7f8b84eea700 1 -- 172.21.15.81:0/3875662007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b80104390 msgr2=0x7f8b80197420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:42.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.172+0000 7f8b84eea700 1 --2- 172.21.15.81:0/3875662007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b80104390 0x7f8b80197420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8b7400d980 tx=0x7f8b7400dc90 comp rx=0 tx=0).stop 2024-05-09T00:01:42.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.172+0000 7f8b84eea700 1 -- 172.21.15.81:0/3875662007 shutdown_connections 2024-05-09T00:01:42.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.172+0000 7f8b84eea700 1 --2- 172.21.15.81:0/3875662007 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8b680a1120 0x7f8b680a35e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.172+0000 7f8b84eea700 1 --2- 172.21.15.81:0/3875662007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8b80106cc0 0x7f8b8019e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.172+0000 7f8b84eea700 1 --2- 172.21.15.81:0/3875662007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b80101a60 0x7f8b80196ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.172+0000 7f8b84eea700 1 --2- 172.21.15.81:0/3875662007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b80104390 0x7f8b80197420 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.172+0000 7f8b84eea700 1 -- 172.21.15.81:0/3875662007 >> 172.21.15.81:0/3875662007 conn(0x7f8b800fb3f0 msgr2=0x7f8b80102500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:42.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.172+0000 7f8b84eea700 1 -- 172.21.15.81:0/3875662007 shutdown_connections 2024-05-09T00:01:42.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.172+0000 7f8b84eea700 1 -- 172.21.15.81:0/3875662007 wait complete. 2024-05-09T00:01:42.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-09T00:01:42.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.321+0000 7fa5c5040700 1 -- 172.21.15.81:0/2730369558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c0106c10 msgr2=0x7fa5c0109000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:42.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.321+0000 7fa5c5040700 1 --2- 172.21.15.81:0/2730369558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c0106c10 0x7fa5c0109000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800b0a0 tx=0x7fa5b800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.321+0000 7fa5c5040700 1 -- 172.21.15.81:0/2730369558 shutdown_connections 2024-05-09T00:01:42.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.321+0000 7fa5c5040700 1 --2- 172.21.15.81:0/2730369558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c0106c10 0x7fa5c0109000 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.321+0000 7fa5c5040700 1 --2- 172.21.15.81:0/2730369558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5c01019b0 0x7fa5c0103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.321+0000 7fa5c5040700 1 --2- 172.21.15.81:0/2730369558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5c01042e0 0x7fa5c01066d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.321+0000 7fa5c5040700 1 -- 172.21.15.81:0/2730369558 >> 172.21.15.81:0/2730369558 conn(0x7fa5c00fb300 msgr2=0x7fa5c00fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:42.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.321+0000 7fa5c5040700 1 -- 172.21.15.81:0/2730369558 shutdown_connections 2024-05-09T00:01:42.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.321+0000 7fa5c5040700 1 -- 172.21.15.81:0/2730369558 wait complete. 2024-05-09T00:01:42.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5c5040700 1 Processor -- start 2024-05-09T00:01:42.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5c5040700 1 -- start start 2024-05-09T00:01:42.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5c5040700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5c01019b0 0x7fa5c0196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:42.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5c5040700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c01042e0 0x7fa5c01973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:42.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5c5040700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5c0106c10 0x7fa5c019e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:42.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5c5040700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c019e9d0 con 0x7fa5c01042e0 2024-05-09T00:01:42.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5c5040700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c019eb10 con 0x7fa5c0106c10 2024-05-09T00:01:42.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5c5040700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c019eca0 con 0x7fa5c01019b0 2024-05-09T00:01:42.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5be59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c01042e0 0x7fa5c01973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:42.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5be59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c01042e0 0x7fa5c01973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42400/0 (socket says 172.21.15.81:42400) 2024-05-09T00:01:42.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5bed9d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5c01019b0 0x7fa5c0196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:42.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5be59c700 1 -- 172.21.15.81:0/2828846927 learned_addr learned my addr 172.21.15.81:0/2828846927 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:42.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5bf59e700 1 --2- 172.21.15.81:0/2828846927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5c0106c10 0x7fa5c019e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:42.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5bed9d700 1 -- 172.21.15.81:0/2828846927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5c0106c10 msgr2=0x7fa5c019e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:42.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5bed9d700 1 --2- 172.21.15.81:0/2828846927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5c0106c10 0x7fa5c019e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5bed9d700 1 -- 172.21.15.81:0/2828846927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c01042e0 msgr2=0x7fa5c01973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:42.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5bed9d700 1 --2- 172.21.15.81:0/2828846927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c01042e0 0x7fa5c01973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.322+0000 7fa5bed9d700 1 -- 172.21.15.81:0/2828846927 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b8009d00 con 0x7fa5c01019b0 2024-05-09T00:01:42.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.323+0000 7fa5be59c700 1 --2- 172.21.15.81:0/2828846927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c01042e0 0x7fa5c01973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:01:42.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.323+0000 7fa5bed9d700 1 --2- 172.21.15.81:0/2828846927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5c01019b0 0x7fa5c0196ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000e9f0 tx=0x7fa5b000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:42.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.323+0000 7fa5a7fff700 1 -- 172.21.15.81:0/2828846927 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b000c9c0 con 0x7fa5c01019b0 2024-05-09T00:01:42.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.323+0000 7fa5c5040700 1 -- 172.21.15.81:0/2828846927 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c019ef80 con 0x7fa5c01019b0 2024-05-09T00:01:42.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.323+0000 7fa5a7fff700 1 -- 172.21.15.81:0/2828846927 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5b0010430 con 0x7fa5c01019b0 2024-05-09T00:01:42.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.323+0000 7fa5a7fff700 1 -- 172.21.15.81:0/2828846927 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0018680 con 0x7fa5c01019b0 2024-05-09T00:01:42.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.323+0000 7fa5c5040700 1 -- 172.21.15.81:0/2828846927 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c019f3b0 con 0x7fa5c01019b0 2024-05-09T00:01:42.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.324+0000 7fa5c5040700 1 -- 172.21.15.81:0/2828846927 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c00fce80 con 0x7fa5c01019b0 2024-05-09T00:01:42.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.326+0000 7fa5a7fff700 1 -- 172.21.15.81:0/2828846927 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa5b0010860 con 0x7fa5c01019b0 2024-05-09T00:01:42.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.326+0000 7fa5a7fff700 1 --2- 172.21.15.81:0/2828846927 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa5a80a1120 0x7fa5a80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:42.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.326+0000 7fa5be59c700 1 --2- 172.21.15.81:0/2828846927 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa5a80a1120 0x7fa5a80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:42.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.326+0000 7fa5a7fff700 1 -- 172.21.15.81:0/2828846927 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa5b0014070 con 0x7fa5c01019b0 2024-05-09T00:01:42.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.327+0000 7fa5be59c700 1 --2- 172.21.15.81:0/2828846927 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa5a80a1120 0x7fa5a80a35e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40104e0 tx=0x7fa5b4007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:42.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.330+0000 7fa5a7fff700 1 -- 172.21.15.81:0/2828846927 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa5b0096130 con 0x7fa5c01019b0 2024-05-09T00:01:42.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:42.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:42 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:42 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1761625736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:42 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3377571305' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:42.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:42 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3875662007' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:01:42.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.568+0000 7fa5c5040700 1 -- 172.21.15.81:0/2828846927 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa5c010c670 con 0x7fa5c01019b0 2024-05-09T00:01:42.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.569+0000 7fa5a7fff700 1 -- 172.21.15.81:0/2828846927 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa5b0099750 con 0x7fa5c01019b0 2024-05-09T00:01:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:42.565 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-05-09T00:01:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:01:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-05-09T00:01:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-05-09T00:01:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:01:42.565 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-05-09T00:01:42.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.571+0000 7fa5c5040700 1 -- 172.21.15.81:0/2828846927 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa5a80a1120 msgr2=0x7fa5a80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:42.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.571+0000 7fa5c5040700 1 --2- 172.21.15.81:0/2828846927 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa5a80a1120 0x7fa5a80a35e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa5b40104e0 tx=0x7fa5b4007480 comp rx=0 tx=0).stop 2024-05-09T00:01:42.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.571+0000 7fa5c5040700 1 -- 172.21.15.81:0/2828846927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5c01019b0 msgr2=0x7fa5c0196ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:42.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.571+0000 7fa5c5040700 1 --2- 172.21.15.81:0/2828846927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5c01019b0 0x7fa5c0196ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa5b000e9f0 tx=0x7fa5b000ed00 comp rx=0 tx=0).stop 2024-05-09T00:01:42.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.571+0000 7fa5c5040700 1 -- 172.21.15.81:0/2828846927 shutdown_connections 2024-05-09T00:01:42.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.571+0000 7fa5c5040700 1 --2- 172.21.15.81:0/2828846927 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa5a80a1120 0x7fa5a80a35e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.571+0000 7fa5c5040700 1 --2- 172.21.15.81:0/2828846927 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa5c0106c10 0x7fa5c019e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.571+0000 7fa5c5040700 1 --2- 172.21.15.81:0/2828846927 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa5c01019b0 0x7fa5c0196ea0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.571+0000 7fa5c5040700 1 --2- 172.21.15.81:0/2828846927 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5c01042e0 0x7fa5c01973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.571+0000 7fa5c5040700 1 -- 172.21.15.81:0/2828846927 >> 172.21.15.81:0/2828846927 conn(0x7fa5c00fb300 msgr2=0x7fa5c0102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:42.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.572+0000 7fa5c5040700 1 -- 172.21.15.81:0/2828846927 shutdown_connections 2024-05-09T00:01:42.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.572+0000 7fa5c5040700 1 -- 172.21.15.81:0/2828846927 wait complete. 2024-05-09T00:01:42.579 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:42.579 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:42.579 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:42.579 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:42.579 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:42 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:42.579 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:42 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1761625736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:42.579 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:42 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3377571305' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:42.579 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:42 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3875662007' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:01:42.580 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-09T00:01:42.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-09T00:01:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.714+0000 7fd155977700 1 -- 172.21.15.81:0/2972270340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd150101510 msgr2=0x7fd150101930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.714+0000 7fd155977700 1 --2- 172.21.15.81:0/2972270340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd150101510 0x7fd150101930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd140009990 tx=0x7fd140009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.714+0000 7fd155977700 1 -- 172.21.15.81:0/2972270340 shutdown_connections 2024-05-09T00:01:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.714+0000 7fd155977700 1 --2- 172.21.15.81:0/2972270340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd150100a90 0x7fd150108330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.714+0000 7fd155977700 1 --2- 172.21.15.81:0/2972270340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd150101510 0x7fd150101930 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.714+0000 7fd155977700 1 --2- 172.21.15.81:0/2972270340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1501000d0 0x7fd150100550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.714+0000 7fd155977700 1 -- 172.21.15.81:0/2972270340 >> 172.21.15.81:0/2972270340 conn(0x7fd1500fab80 msgr2=0x7fd1500fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.714+0000 7fd155977700 1 -- 172.21.15.81:0/2972270340 shutdown_connections 2024-05-09T00:01:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.714+0000 7fd155977700 1 -- 172.21.15.81:0/2972270340 wait complete. 2024-05-09T00:01:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.715+0000 7fd155977700 1 Processor -- start 2024-05-09T00:01:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.715+0000 7fd155977700 1 -- start start 2024-05-09T00:01:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.715+0000 7fd155977700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1501000d0 0x7fd1500ffb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.715+0000 7fd155977700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd150100a90 0x7fd15019bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.715+0000 7fd155977700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd150101510 0x7fd15019e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.715+0000 7fd155977700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15019ea30 con 0x7fd150101510 2024-05-09T00:01:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.715+0000 7fd155977700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15019eba0 con 0x7fd150100a90 2024-05-09T00:01:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.715+0000 7fd155977700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15019ed60 con 0x7fd1501000d0 2024-05-09T00:01:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.715+0000 7fd14f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd150101510 0x7fd15019e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.715+0000 7fd14f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd150101510 0x7fd15019e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42412/0 (socket says 172.21.15.81:42412) 2024-05-09T00:01:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.716+0000 7fd14f7fe700 1 -- 172.21.15.81:0/1325434857 learned_addr learned my addr 172.21.15.81:0/1325434857 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.716+0000 7fd14e7fc700 1 --2- 172.21.15.81:0/1325434857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd150100a90 0x7fd15019bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.716+0000 7fd14effd700 1 --2- 172.21.15.81:0/1325434857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1501000d0 0x7fd1500ffb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.716+0000 7fd14f7fe700 1 -- 172.21.15.81:0/1325434857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1501000d0 msgr2=0x7fd1500ffb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.716+0000 7fd14f7fe700 1 --2- 172.21.15.81:0/1325434857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1501000d0 0x7fd1500ffb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.716+0000 7fd14f7fe700 1 -- 172.21.15.81:0/1325434857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd150100a90 msgr2=0x7fd15019bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.716+0000 7fd14f7fe700 1 --2- 172.21.15.81:0/1325434857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd150100a90 0x7fd15019bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.716+0000 7fd14f7fe700 1 -- 172.21.15.81:0/1325434857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400095f0 con 0x7fd150101510 2024-05-09T00:01:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.716+0000 7fd14f7fe700 1 --2- 172.21.15.81:0/1325434857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd150101510 0x7fd15019e240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd14800ef30 tx=0x7fd14800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.716+0000 7fd154975700 1 -- 172.21.15.81:0/1325434857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148018070 con 0x7fd150101510 2024-05-09T00:01:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.716+0000 7fd154975700 1 -- 172.21.15.81:0/1325434857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd14800f040 con 0x7fd150101510 2024-05-09T00:01:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.716+0000 7fd154975700 1 -- 172.21.15.81:0/1325434857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800cd00 con 0x7fd150101510 2024-05-09T00:01:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.716+0000 7fd155977700 1 -- 172.21.15.81:0/1325434857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15019ef80 con 0x7fd150101510 2024-05-09T00:01:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.716+0000 7fd155977700 1 -- 172.21.15.81:0/1325434857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15019f3b0 con 0x7fd150101510 2024-05-09T00:01:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.717+0000 7fd155977700 1 -- 172.21.15.81:0/1325434857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd150107370 con 0x7fd150101510 2024-05-09T00:01:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.718+0000 7fd154975700 1 -- 172.21.15.81:0/1325434857 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd148003a00 con 0x7fd150101510 2024-05-09T00:01:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.719+0000 7fd154975700 1 --2- 172.21.15.81:0/1325434857 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd1380a1120 0x7fd1380a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.719+0000 7fd154975700 1 -- 172.21.15.81:0/1325434857 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd1480cbf80 con 0x7fd150101510 2024-05-09T00:01:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.719+0000 7fd14effd700 1 --2- 172.21.15.81:0/1325434857 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd1380a1120 0x7fd1380a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.719+0000 7fd14effd700 1 --2- 172.21.15.81:0/1325434857 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd1380a1120 0x7fd1380a35e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd14000b2e0 tx=0x7fd140005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.723+0000 7fd154975700 1 -- 172.21.15.81:0/1325434857 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd1480ffd60 con 0x7fd150101510 2024-05-09T00:01:42.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:42.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:42.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:42.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:42.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:42 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:01:42.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:42 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1761625736' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:42.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:42 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3377571305' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:42.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:42 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3875662007' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:01:42.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:42.922+0000 7fd155977700 1 -- 172.21.15.81:0/1325434857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd1500681a0 con 0x7fd150101510 2024-05-09T00:01:43.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.595+0000 7fd154975700 1 -- 172.21.15.81:0/1325434857 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd1480b7e60 con 0x7fd150101510 2024-05-09T00:01:43.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.598+0000 7fd155977700 1 -- 172.21.15.81:0/1325434857 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd1380a1120 msgr2=0x7fd1380a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.598+0000 7fd155977700 1 --2- 172.21.15.81:0/1325434857 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd1380a1120 0x7fd1380a35e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd14000b2e0 tx=0x7fd140005fd0 comp rx=0 tx=0).stop 2024-05-09T00:01:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.598+0000 7fd155977700 1 -- 172.21.15.81:0/1325434857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd150101510 msgr2=0x7fd15019e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.598+0000 7fd155977700 1 --2- 172.21.15.81:0/1325434857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd150101510 0x7fd15019e240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd14800ef30 tx=0x7fd14800c3a0 comp rx=0 tx=0).stop 2024-05-09T00:01:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.598+0000 7fd155977700 1 -- 172.21.15.81:0/1325434857 shutdown_connections 2024-05-09T00:01:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.598+0000 7fd155977700 1 --2- 172.21.15.81:0/1325434857 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd1380a1120 0x7fd1380a35e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.598+0000 7fd155977700 1 --2- 172.21.15.81:0/1325434857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd150101510 0x7fd15019e240 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.598+0000 7fd155977700 1 --2- 172.21.15.81:0/1325434857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1501000d0 0x7fd1500ffb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.598+0000 7fd155977700 1 --2- 172.21.15.81:0/1325434857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd150100a90 0x7fd15019bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.598+0000 7fd155977700 1 -- 172.21.15.81:0/1325434857 >> 172.21.15.81:0/1325434857 conn(0x7fd1500fab80 msgr2=0x7fd1501044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.599+0000 7fd155977700 1 -- 172.21.15.81:0/1325434857 shutdown_connections 2024-05-09T00:01:43.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.599+0000 7fd155977700 1 -- 172.21.15.81:0/1325434857 wait complete. 2024-05-09T00:01:43.596 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-05-09T00:01:43.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-09T00:01:43.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.741+0000 7f1ce9054700 1 -- 172.21.15.81:0/631641587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce4106c40 msgr2=0x7f1ce41090b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:43.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.741+0000 7f1ce9054700 1 --2- 172.21.15.81:0/631641587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce4106c40 0x7f1ce41090b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00b0a0 tx=0x7f1cdc00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:43.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.741+0000 7f1ce9054700 1 -- 172.21.15.81:0/631641587 shutdown_connections 2024-05-09T00:01:43.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.741+0000 7f1ce9054700 1 --2- 172.21.15.81:0/631641587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce4106c40 0x7f1ce41090b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.741+0000 7f1ce9054700 1 --2- 172.21.15.81:0/631641587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce41019e0 0x7f1ce4103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.741+0000 7f1ce9054700 1 --2- 172.21.15.81:0/631641587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce4104310 0x7f1ce4106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.741+0000 7f1ce9054700 1 -- 172.21.15.81:0/631641587 >> 172.21.15.81:0/631641587 conn(0x7f1ce40fb3f0 msgr2=0x7f1ce40fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.741+0000 7f1ce9054700 1 -- 172.21.15.81:0/631641587 shutdown_connections 2024-05-09T00:01:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.741+0000 7f1ce9054700 1 -- 172.21.15.81:0/631641587 wait complete. 2024-05-09T00:01:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.742+0000 7f1ce9054700 1 Processor -- start 2024-05-09T00:01:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.742+0000 7f1ce9054700 1 -- start start 2024-05-09T00:01:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.742+0000 7f1ce9054700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce41019e0 0x7f1ce4196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.742+0000 7f1ce9054700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce4104310 0x7f1ce41974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.742+0000 7f1ce9054700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce4106c40 0x7f1ce419e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.742+0000 7f1ce9054700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce419eab0 con 0x7f1ce4104310 2024-05-09T00:01:43.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.742+0000 7f1ce9054700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce419ebf0 con 0x7f1ce4106c40 2024-05-09T00:01:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.742+0000 7f1ce9054700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce419ed80 con 0x7f1ce41019e0 2024-05-09T00:01:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ce259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce4104310 0x7f1ce41974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ce259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce4104310 0x7f1ce41974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42424/0 (socket says 172.21.15.81:42424) 2024-05-09T00:01:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ce259c700 1 -- 172.21.15.81:0/597950940 learned_addr learned my addr 172.21.15.81:0/597950940 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ce359e700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce4106c40 0x7f1ce419e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ce2d9d700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce41019e0 0x7f1ce4196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ce259c700 1 -- 172.21.15.81:0/597950940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce41019e0 msgr2=0x7f1ce4196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ce259c700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce41019e0 0x7f1ce4196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ce259c700 1 -- 172.21.15.81:0/597950940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce4106c40 msgr2=0x7f1ce419e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ce259c700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce4106c40 0x7f1ce419e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ce259c700 1 -- 172.21.15.81:0/597950940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cdc009d00 con 0x7f1ce4104310 2024-05-09T00:01:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ce2d9d700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce41019e0 0x7f1ce4196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ce259c700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce4104310 0x7f1ce41974c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400d950 tx=0x7f1cd400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:43.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ccbfff700 1 -- 172.21.15.81:0/597950940 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4009940 con 0x7f1ce4104310 2024-05-09T00:01:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ce9054700 1 -- 172.21.15.81:0/597950940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce419f060 con 0x7f1ce4104310 2024-05-09T00:01:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ccbfff700 1 -- 172.21.15.81:0/597950940 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cd4010460 con 0x7f1ce4104310 2024-05-09T00:01:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ccbfff700 1 -- 172.21.15.81:0/597950940 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd400f620 con 0x7f1ce4104310 2024-05-09T00:01:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.743+0000 7f1ce9054700 1 -- 172.21.15.81:0/597950940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce419f570 con 0x7f1ce4104310 2024-05-09T00:01:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.744+0000 7f1ce9054700 1 -- 172.21.15.81:0/597950940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce40fcf70 con 0x7f1ce4104310 2024-05-09T00:01:43.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.746+0000 7f1ccbfff700 1 -- 172.21.15.81:0/597950940 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1cd40108d0 con 0x7f1ce4104310 2024-05-09T00:01:43.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.747+0000 7f1ccbfff700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1ccc0a1120 0x7f1ccc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:43.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.747+0000 7f1ce2d9d700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1ccc0a1120 0x7f1ccc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:43.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.747+0000 7f1ccbfff700 1 -- 172.21.15.81:0/597950940 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f1cd40cc4f0 con 0x7f1ce4104310 2024-05-09T00:01:43.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.747+0000 7f1ce2d9d700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1ccc0a1120 0x7f1ccc0a35e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8005950 tx=0x7f1cd8005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:43.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.751+0000 7f1ccbfff700 1 -- 172.21.15.81:0/597950940 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1cd4095f10 con 0x7f1ce4104310 2024-05-09T00:01:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:43 smithi150 ceph-mon[46187]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:43 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2828846927' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-09T00:01:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:43.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:43 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1325434857' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-09T00:01:43.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:43 smithi171 ceph-mon[47351]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:43.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:43 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2828846927' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-09T00:01:43.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:43.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:43.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:43 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1325434857' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-09T00:01:43.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:43 smithi081 ceph-mon[42474]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:43.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:43 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2828846927' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-09T00:01:43.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:01:43.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:01:43.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:01:43.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:43 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1325434857' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-09T00:01:43.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:43.953+0000 7f1ce9054700 1 -- 172.21.15.81:0/597950940 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1ce410c940 con 0x7f1ce4104310 2024-05-09T00:01:44.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.603+0000 7f1ccbfff700 1 -- 172.21.15.81:0/597950940 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1cd4099530 con 0x7f1ce4104310 2024-05-09T00:01:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.610+0000 7f1ce9054700 1 -- 172.21.15.81:0/597950940 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1ccc0a1120 msgr2=0x7f1ccc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.610+0000 7f1ce9054700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1ccc0a1120 0x7f1ccc0a35e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8005950 tx=0x7f1cd8005f50 comp rx=0 tx=0).stop 2024-05-09T00:01:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.610+0000 7f1ce9054700 1 -- 172.21.15.81:0/597950940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce4104310 msgr2=0x7f1ce41974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.610+0000 7f1ce9054700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce4104310 0x7f1ce41974c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1cd400d950 tx=0x7f1cd400dc60 comp rx=0 tx=0).stop 2024-05-09T00:01:44.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.615+0000 7f1ce9054700 1 -- 172.21.15.81:0/597950940 shutdown_connections 2024-05-09T00:01:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.615+0000 7f1ce9054700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1ccc0a1120 0x7f1ccc0a35e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.615+0000 7f1ce9054700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1ce4106c40 0x7f1ce419e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.615+0000 7f1ce9054700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1ce41019e0 0x7f1ce4196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.615+0000 7f1ce9054700 1 --2- 172.21.15.81:0/597950940 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ce4104310 0x7f1ce41974c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:44.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.615+0000 7f1ce9054700 1 -- 172.21.15.81:0/597950940 >> 172.21.15.81:0/597950940 conn(0x7f1ce40fb3f0 msgr2=0x7f1ce4102280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:44.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.619+0000 7f1ce9054700 1 -- 172.21.15.81:0/597950940 shutdown_connections 2024-05-09T00:01:44.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.620+0000 7f1ce9054700 1 -- 172.21.15.81:0/597950940 wait complete. 2024-05-09T00:01:44.618 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-05-09T00:01:44.631 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-09T00:01:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.761+0000 7f524f157700 1 -- 172.21.15.81:0/1022926764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5248100fd0 msgr2=0x7f5248101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.761+0000 7f524f157700 1 --2- 172.21.15.81:0/1022926764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5248100fd0 0x7f5248101450 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5234009990 tx=0x7f5234009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.761+0000 7f524f157700 1 -- 172.21.15.81:0/1022926764 shutdown_connections 2024-05-09T00:01:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.761+0000 7f524f157700 1 --2- 172.21.15.81:0/1022926764 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5248101990 0x7f52481082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.761+0000 7f524f157700 1 --2- 172.21.15.81:0/1022926764 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52480ffe80 0x7f52481002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.761+0000 7f524f157700 1 --2- 172.21.15.81:0/1022926764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5248100fd0 0x7f5248101450 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.761+0000 7f524f157700 1 -- 172.21.15.81:0/1022926764 >> 172.21.15.81:0/1022926764 conn(0x7f52480fb3f0 msgr2=0x7f52480fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.761+0000 7f524f157700 1 -- 172.21.15.81:0/1022926764 shutdown_connections 2024-05-09T00:01:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.762+0000 7f524f157700 1 -- 172.21.15.81:0/1022926764 wait complete. 2024-05-09T00:01:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.762+0000 7f524f157700 1 Processor -- start 2024-05-09T00:01:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.762+0000 7f524f157700 1 -- start start 2024-05-09T00:01:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.762+0000 7f524f157700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52480ffe80 0x7f5248196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.762+0000 7f524f157700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5248100fd0 0x7f5248197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.762+0000 7f524f157700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5248101990 0x7f524819e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.762+0000 7f524f157700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524819ea70 con 0x7f5248101990 2024-05-09T00:01:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.762+0000 7f524f157700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524819ebb0 con 0x7f52480ffe80 2024-05-09T00:01:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.762+0000 7f524f157700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524819ed40 con 0x7f5248100fd0 2024-05-09T00:01:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.762+0000 7f524d6f4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5248101990 0x7f524819e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.762+0000 7f524d6f4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5248101990 0x7f524819e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42454/0 (socket says 172.21.15.81:42454) 2024-05-09T00:01:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.762+0000 7f524d6f4700 1 -- 172.21.15.81:0/2826337828 learned_addr learned my addr 172.21.15.81:0/2826337828 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.762+0000 7f5247fff700 1 --2- 172.21.15.81:0/2826337828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5248100fd0 0x7f5248197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.763+0000 7f524cef3700 1 --2- 172.21.15.81:0/2826337828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52480ffe80 0x7f5248196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.763+0000 7f524d6f4700 1 -- 172.21.15.81:0/2826337828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5248100fd0 msgr2=0x7f5248197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.763+0000 7f524d6f4700 1 --2- 172.21.15.81:0/2826337828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5248100fd0 0x7f5248197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.763+0000 7f524d6f4700 1 -- 172.21.15.81:0/2826337828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52480ffe80 msgr2=0x7f5248196f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.763+0000 7f524d6f4700 1 --2- 172.21.15.81:0/2826337828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52480ffe80 0x7f5248196f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.763+0000 7f524d6f4700 1 -- 172.21.15.81:0/2826337828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52340095f0 con 0x7f5248101990 2024-05-09T00:01:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.763+0000 7f524d6f4700 1 --2- 172.21.15.81:0/2826337828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5248101990 0x7f524819e4a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5240007ee0 tx=0x7f524000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.763+0000 7f5245ffb700 1 -- 172.21.15.81:0/2826337828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240017070 con 0x7f5248101990 2024-05-09T00:01:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.763+0000 7f5245ffb700 1 -- 172.21.15.81:0/2826337828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f524000f040 con 0x7f5248101990 2024-05-09T00:01:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.763+0000 7f524f157700 1 -- 172.21.15.81:0/2826337828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524819efc0 con 0x7f5248101990 2024-05-09T00:01:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.763+0000 7f5245ffb700 1 -- 172.21.15.81:0/2826337828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240005740 con 0x7f5248101990 2024-05-09T00:01:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.763+0000 7f524f157700 1 -- 172.21.15.81:0/2826337828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f524819f450 con 0x7f5248101990 2024-05-09T00:01:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.764+0000 7f524f157700 1 -- 172.21.15.81:0/2826337828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5248067460 con 0x7f5248101990 2024-05-09T00:01:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.765+0000 7f5245ffb700 1 -- 172.21.15.81:0/2826337828 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f524000dc60 con 0x7f5248101990 2024-05-09T00:01:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.766+0000 7f5245ffb700 1 --2- 172.21.15.81:0/2826337828 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f52380a1120 0x7f52380a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.766+0000 7f524cef3700 1 --2- 172.21.15.81:0/2826337828 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f52380a1120 0x7f52380a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.766+0000 7f5245ffb700 1 -- 172.21.15.81:0/2826337828 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f52400cbfa0 con 0x7f5248101990 2024-05-09T00:01:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.766+0000 7f524cef3700 1 --2- 172.21.15.81:0/2826337828 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f52380a1120 0x7f52380a35e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f523c009bf0 tx=0x7f523c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:44.771+0000 7f5245ffb700 1 -- 172.21.15.81:0/2826337828 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5240095840 con 0x7f5248101990 2024-05-09T00:01:44.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:44 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1325434857' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-09T00:01:44.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:44 smithi081 ceph-mon[42474]: osdmap e76: 12 total, 12 up, 12 in 2024-05-09T00:01:44.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:44 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/597950940' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-09T00:01:44.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:44 smithi081 ceph-mon[42474]: pgmap v215: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.016+0000 7f524f157700 1 -- 172.21.15.81:0/2826337828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f524819f7f0 con 0x7f5248101990 2024-05-09T00:01:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:44 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1325434857' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-09T00:01:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:44 smithi150 ceph-mon[46187]: osdmap e76: 12 total, 12 up, 12 in 2024-05-09T00:01:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:44 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/597950940' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-09T00:01:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:44 smithi150 ceph-mon[46187]: pgmap v215: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.022+0000 7f5245ffb700 1 -- 172.21.15.81:0/2826337828 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5240098e60 con 0x7f5248101990 2024-05-09T00:01:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.031+0000 7f524f157700 1 -- 172.21.15.81:0/2826337828 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f52380a1120 msgr2=0x7f52380a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.031+0000 7f524f157700 1 --2- 172.21.15.81:0/2826337828 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f52380a1120 0x7f52380a35e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f523c009bf0 tx=0x7f523c009260 comp rx=0 tx=0).stop 2024-05-09T00:01:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.031+0000 7f524f157700 1 -- 172.21.15.81:0/2826337828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5248101990 msgr2=0x7f524819e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.031+0000 7f524f157700 1 --2- 172.21.15.81:0/2826337828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5248101990 0x7f524819e4a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5240007ee0 tx=0x7f524000d3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.032+0000 7f524f157700 1 -- 172.21.15.81:0/2826337828 shutdown_connections 2024-05-09T00:01:45.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.032+0000 7f524f157700 1 --2- 172.21.15.81:0/2826337828 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f52380a1120 0x7f52380a35e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.032+0000 7f524f157700 1 --2- 172.21.15.81:0/2826337828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f52480ffe80 0x7f5248196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.032+0000 7f524f157700 1 --2- 172.21.15.81:0/2826337828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5248101990 0x7f524819e4a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.032+0000 7f524f157700 1 --2- 172.21.15.81:0/2826337828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5248100fd0 0x7f5248197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.032+0000 7f524f157700 1 -- 172.21.15.81:0/2826337828 >> 172.21.15.81:0/2826337828 conn(0x7f52480fb3f0 msgr2=0x7f5248069240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.038+0000 7f524f157700 1 -- 172.21.15.81:0/2826337828 shutdown_connections 2024-05-09T00:01:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.039+0000 7f524f157700 1 -- 172.21.15.81:0/2826337828 wait complete. 2024-05-09T00:01:45.035 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2024-05-09T00:01:45.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:01:45.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:44 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1325434857' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-09T00:01:45.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:44 smithi171 ceph-mon[47351]: osdmap e76: 12 total, 12 up, 12 in 2024-05-09T00:01:45.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:44 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/597950940' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-09T00:01:45.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:44 smithi171 ceph-mon[47351]: pgmap v215: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:01:45.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.178+0000 7fa6ffeba700 1 -- 172.21.15.81:0/1640305232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f8100f50 msgr2=0x7fa6f81013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.178+0000 7fa6ffeba700 1 --2- 172.21.15.81:0/1640305232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f8100f50 0x7fa6f81013b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa6f40099c0 tx=0x7fa6f4009cd0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.178+0000 7fa6ffeba700 1 -- 172.21.15.81:0/1640305232 shutdown_connections 2024-05-09T00:01:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.178+0000 7fa6ffeba700 1 --2- 172.21.15.81:0/1640305232 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f80ffd60 0x7fa6f8100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.178+0000 7fa6ffeba700 1 --2- 172.21.15.81:0/1640305232 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6f81018f0 0x7fa6f81081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.178+0000 7fa6ffeba700 1 --2- 172.21.15.81:0/1640305232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f8100f50 0x7fa6f81013b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.178+0000 7fa6ffeba700 1 -- 172.21.15.81:0/1640305232 >> 172.21.15.81:0/1640305232 conn(0x7fa6f80fb2f0 msgr2=0x7fa6f80fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.178+0000 7fa6ffeba700 1 -- 172.21.15.81:0/1640305232 shutdown_connections 2024-05-09T00:01:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.178+0000 7fa6ffeba700 1 -- 172.21.15.81:0/1640305232 wait complete. 2024-05-09T00:01:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6ffeba700 1 Processor -- start 2024-05-09T00:01:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6ffeba700 1 -- start start 2024-05-09T00:01:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6ffeba700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6f80ffd60 0x7fa6f8195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:45.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6ffeba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f8100f50 0x7fa6f81962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6ffeba700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f81018f0 0x7fa6f819d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6ffeba700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f819d890 con 0x7fa6f8100f50 2024-05-09T00:01:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6ffeba700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f819da00 con 0x7fa6f81018f0 2024-05-09T00:01:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6ffeba700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f819dbc0 con 0x7fa6f80ffd60 2024-05-09T00:01:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6fd455700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f8100f50 0x7fa6f81962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6fd455700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f8100f50 0x7fa6f81962e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42470/0 (socket says 172.21.15.81:42470) 2024-05-09T00:01:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6fd455700 1 -- 172.21.15.81:0/3747539828 learned_addr learned my addr 172.21.15.81:0/3747539828 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6fdc56700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6f80ffd60 0x7fa6f8195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6fe457700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f81018f0 0x7fa6f819d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6fd455700 1 -- 172.21.15.81:0/3747539828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6f80ffd60 msgr2=0x7fa6f8195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6fd455700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6f80ffd60 0x7fa6f8195da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6fd455700 1 -- 172.21.15.81:0/3747539828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f81018f0 msgr2=0x7fa6f819d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6fd455700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f81018f0 0x7fa6f819d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6fd455700 1 -- 172.21.15.81:0/3747539828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40095f0 con 0x7fa6f8100f50 2024-05-09T00:01:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.179+0000 7fa6fe457700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f81018f0 0x7fa6f819d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:01:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.180+0000 7fa6fd455700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f8100f50 0x7fa6f81962e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4006010 tx=0x7fa6f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.180+0000 7fa6eaffd700 1 -- 172.21.15.81:0/3747539828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f401d070 con 0x7fa6f8100f50 2024-05-09T00:01:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.180+0000 7fa6eaffd700 1 -- 172.21.15.81:0/3747539828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6f4003f90 con 0x7fa6f8100f50 2024-05-09T00:01:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.180+0000 7fa6eaffd700 1 -- 172.21.15.81:0/3747539828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f400fd70 con 0x7fa6f8100f50 2024-05-09T00:01:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.180+0000 7fa6ffeba700 1 -- 172.21.15.81:0/3747539828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f819de40 con 0x7fa6f8100f50 2024-05-09T00:01:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.180+0000 7fa6ffeba700 1 -- 172.21.15.81:0/3747539828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f819e1b0 con 0x7fa6f8100f50 2024-05-09T00:01:45.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.181+0000 7fa6ffeba700 1 -- 172.21.15.81:0/3747539828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f81071e0 con 0x7fa6f8100f50 2024-05-09T00:01:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.182+0000 7fa6eaffd700 1 -- 172.21.15.81:0/3747539828 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa6f400f460 con 0x7fa6f8100f50 2024-05-09T00:01:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.182+0000 7fa6eaffd700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa6e40a1120 0x7fa6e40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.183+0000 7fa6fdc56700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa6e40a1120 0x7fa6e40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.183+0000 7fa6eaffd700 1 -- 172.21.15.81:0/3747539828 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa6f40cd6f0 con 0x7fa6f8100f50 2024-05-09T00:01:45.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.183+0000 7fa6fdc56700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa6e40a1120 0x7fa6e40a35e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8197220 tx=0x7fa6ec009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:45.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.187+0000 7fa6eaffd700 1 -- 172.21.15.81:0/3747539828 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa6f4097060 con 0x7fa6f8100f50 2024-05-09T00:01:45.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.388+0000 7fa6ffeba700 1 -- 172.21.15.81:0/3747539828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6f810b6e0 con 0x7fa6f8100f50 2024-05-09T00:01:45.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.389+0000 7fa6eaffd700 1 -- 172.21.15.81:0/3747539828 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+22108 (secure 0 0 0) 0x7fa6f409a680 con 0x7fa6f8100f50 2024-05-09T00:01:45.385 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:45.385 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":78,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:01:45.018162+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:01:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.391+0000 7fa6ffeba700 1 -- 172.21.15.81:0/3747539828 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa6e40a1120 msgr2=0x7fa6e40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.391+0000 7fa6ffeba700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa6e40a1120 0x7fa6e40a35e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8197220 tx=0x7fa6ec009190 comp rx=0 tx=0).stop 2024-05-09T00:01:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.392+0000 7fa6ffeba700 1 -- 172.21.15.81:0/3747539828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f8100f50 msgr2=0x7fa6f81962e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.392+0000 7fa6ffeba700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f8100f50 0x7fa6f81962e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4006010 tx=0x7fa6f4004730 comp rx=0 tx=0).stop 2024-05-09T00:01:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.392+0000 7fa6ffeba700 1 -- 172.21.15.81:0/3747539828 shutdown_connections 2024-05-09T00:01:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.392+0000 7fa6ffeba700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa6e40a1120 0x7fa6e40a35e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.392+0000 7fa6ffeba700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6f81018f0 0x7fa6f819d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.392+0000 7fa6ffeba700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6f80ffd60 0x7fa6f8195da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.392+0000 7fa6ffeba700 1 --2- 172.21.15.81:0/3747539828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6f8100f50 0x7fa6f81962e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.392+0000 7fa6ffeba700 1 -- 172.21.15.81:0/3747539828 >> 172.21.15.81:0/3747539828 conn(0x7fa6f80fb2f0 msgr2=0x7fa6f8104320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:45.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.392+0000 7fa6ffeba700 1 -- 172.21.15.81:0/3747539828 shutdown_connections 2024-05-09T00:01:45.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.392+0000 7fa6ffeba700 1 -- 172.21.15.81:0/3747539828 wait complete. 2024-05-09T00:01:45.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:01:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.526+0000 7f4643289700 1 -- 172.21.15.81:0/1849117124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f463c104270 msgr2=0x7f463c106660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.526+0000 7f4643289700 1 --2- 172.21.15.81:0/1849117124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f463c104270 0x7f463c106660 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f462c009990 tx=0x7f462c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.526+0000 7f4643289700 1 -- 172.21.15.81:0/1849117124 shutdown_connections 2024-05-09T00:01:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.526+0000 7f4643289700 1 --2- 172.21.15.81:0/1849117124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f463c101940 0x7f463c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.526+0000 7f4643289700 1 --2- 172.21.15.81:0/1849117124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f463c106ba0 0x7f463c108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.526+0000 7f4643289700 1 --2- 172.21.15.81:0/1849117124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f463c104270 0x7f463c106660 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.526+0000 7f4643289700 1 -- 172.21.15.81:0/1849117124 >> 172.21.15.81:0/1849117124 conn(0x7f463c0fb2f0 msgr2=0x7f463c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.526+0000 7f4643289700 1 -- 172.21.15.81:0/1849117124 shutdown_connections 2024-05-09T00:01:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.526+0000 7f4643289700 1 -- 172.21.15.81:0/1849117124 wait complete. 2024-05-09T00:01:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4643289700 1 Processor -- start 2024-05-09T00:01:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4643289700 1 -- start start 2024-05-09T00:01:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4643289700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f463c101940 0x7f463c196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4643289700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f463c104270 0x7f463c197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4643289700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f463c106ba0 0x7f463c19e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4643289700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c19e950 con 0x7f463c106ba0 2024-05-09T00:01:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4643289700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c19ea90 con 0x7f463c104270 2024-05-09T00:01:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4643289700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c19ec20 con 0x7f463c101940 2024-05-09T00:01:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4641826700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f463c106ba0 0x7f463c19e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4641826700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f463c106ba0 0x7f463c19e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42482/0 (socket says 172.21.15.81:42482) 2024-05-09T00:01:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4641826700 1 -- 172.21.15.81:0/3651409381 learned_addr learned my addr 172.21.15.81:0/3651409381 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4640824700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f463c104270 0x7f463c197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4641025700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f463c101940 0x7f463c196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4641826700 1 -- 172.21.15.81:0/3651409381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f463c101940 msgr2=0x7f463c196e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4641826700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f463c101940 0x7f463c196e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4641826700 1 -- 172.21.15.81:0/3651409381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f463c104270 msgr2=0x7f463c197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4641826700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f463c104270 0x7f463c197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4641826700 1 -- 172.21.15.81:0/3651409381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c0095f0 con 0x7f463c106ba0 2024-05-09T00:01:45.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.527+0000 7f4640824700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f463c104270 0x7f463c197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:45.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.528+0000 7f4641826700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f463c106ba0 0x7f463c19e380 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4634007ee0 tx=0x7f463400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:45.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.528+0000 7f46327fc700 1 -- 172.21.15.81:0/3651409381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634017070 con 0x7f463c106ba0 2024-05-09T00:01:45.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.528+0000 7f46327fc700 1 -- 172.21.15.81:0/3651409381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f463400f040 con 0x7f463c106ba0 2024-05-09T00:01:45.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.528+0000 7f46327fc700 1 -- 172.21.15.81:0/3651409381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4634005740 con 0x7f463c106ba0 2024-05-09T00:01:45.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.528+0000 7f4643289700 1 -- 172.21.15.81:0/3651409381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463c19ef00 con 0x7f463c106ba0 2024-05-09T00:01:45.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.528+0000 7f4643289700 1 -- 172.21.15.81:0/3651409381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463c19f330 con 0x7f463c106ba0 2024-05-09T00:01:45.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.529+0000 7f4643289700 1 -- 172.21.15.81:0/3651409381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463c0fce70 con 0x7f463c106ba0 2024-05-09T00:01:45.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.530+0000 7f46327fc700 1 -- 172.21.15.81:0/3651409381 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f46340058a0 con 0x7f463c106ba0 2024-05-09T00:01:45.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.530+0000 7f46327fc700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f46280a11a0 0x7f46280a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:45.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.530+0000 7f4641025700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f46280a11a0 0x7f46280a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:45.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.530+0000 7f46327fc700 1 -- 172.21.15.81:0/3651409381 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f46340cc560 con 0x7f463c106ba0 2024-05-09T00:01:45.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.531+0000 7f4641025700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f46280a11a0 0x7f46280a3660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f463800bbd0 tx=0x7f463800b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:45.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.534+0000 7f46327fc700 1 -- 172.21.15.81:0/3651409381 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4634095e40 con 0x7f463c106ba0 2024-05-09T00:01:45.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.733+0000 7f4643289700 1 -- 172.21.15.81:0/3651409381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f463c10c6a0 con 0x7f463c106ba0 2024-05-09T00:01:45.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.735+0000 7f46327fc700 1 -- 172.21.15.81:0/3651409381 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+22108 (secure 0 0 0) 0x7f4634099460 con 0x7f463c106ba0 2024-05-09T00:01:45.730 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:45.730 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":78,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:01:45.018162+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:01:45.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.737+0000 7f4643289700 1 -- 172.21.15.81:0/3651409381 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f46280a11a0 msgr2=0x7f46280a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.737+0000 7f4643289700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f46280a11a0 0x7f46280a3660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f463800bbd0 tx=0x7f463800b5b0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.737+0000 7f4643289700 1 -- 172.21.15.81:0/3651409381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f463c106ba0 msgr2=0x7f463c19e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.737+0000 7f4643289700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f463c106ba0 0x7f463c19e380 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4634007ee0 tx=0x7f463400d3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.737+0000 7f4643289700 1 -- 172.21.15.81:0/3651409381 shutdown_connections 2024-05-09T00:01:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.737+0000 7f4643289700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f46280a11a0 0x7f46280a3660 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.737+0000 7f4643289700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f463c106ba0 0x7f463c19e380 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.737+0000 7f4643289700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f463c101940 0x7f463c196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.737+0000 7f4643289700 1 --2- 172.21.15.81:0/3651409381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f463c104270 0x7f463c197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.737+0000 7f4643289700 1 -- 172.21.15.81:0/3651409381 >> 172.21.15.81:0/3651409381 conn(0x7f463c0fb2f0 msgr2=0x7f463c1037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.737+0000 7f4643289700 1 -- 172.21.15.81:0/3651409381 shutdown_connections 2024-05-09T00:01:45.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.737+0000 7f4643289700 1 -- 172.21.15.81:0/3651409381 wait complete. 2024-05-09T00:01:45.743 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:45 smithi081 ceph-mon[42474]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-09T00:01:45.743 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:45 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/597950940' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-09T00:01:45.743 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:45 smithi081 ceph-mon[42474]: osdmap e77: 12 total, 12 up, 12 in 2024-05-09T00:01:45.743 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:45 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2826337828' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-09T00:01:45.743 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:45 smithi081 ceph-mon[42474]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-09T00:01:45.743 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:45 smithi081 ceph-mon[42474]: osdmap e78: 12 total, 12 up, 12 in 2024-05-09T00:01:45.743 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:45 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2826337828' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-09T00:01:45.743 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:45 smithi081 ceph-mon[42474]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-09T00:01:45.743 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:45 smithi081 ceph-mon[42474]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-09T00:01:45.743 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:45 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3747539828' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:45.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-09T00:01:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.875+0000 7fadc799d700 1 -- 172.21.15.81:0/2192947965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadc01043b0 msgr2=0x7fadc01067a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.875+0000 7fadc799d700 1 --2- 172.21.15.81:0/2192947965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadc01043b0 0x7fadc01067a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009990 tx=0x7fadb4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.875+0000 7fadc799d700 1 -- 172.21.15.81:0/2192947965 shutdown_connections 2024-05-09T00:01:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.875+0000 7fadc799d700 1 --2- 172.21.15.81:0/2192947965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadc0106ce0 0x7fadc01090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.875+0000 7fadc799d700 1 --2- 172.21.15.81:0/2192947965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadc0101a80 0x7fadc0103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.875+0000 7fadc799d700 1 --2- 172.21.15.81:0/2192947965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadc01043b0 0x7fadc01067a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.875+0000 7fadc799d700 1 -- 172.21.15.81:0/2192947965 >> 172.21.15.81:0/2192947965 conn(0x7fadc00fb3f0 msgr2=0x7fadc00fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.875+0000 7fadc799d700 1 -- 172.21.15.81:0/2192947965 shutdown_connections 2024-05-09T00:01:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.875+0000 7fadc799d700 1 -- 172.21.15.81:0/2192947965 wait complete. 2024-05-09T00:01:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc799d700 1 Processor -- start 2024-05-09T00:01:45.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc799d700 1 -- start start 2024-05-09T00:01:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc799d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadc0101a80 0x7fadc0196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc799d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadc01043b0 0x7fadc0197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc799d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadc0106ce0 0x7fadc019e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc799d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc019ea70 con 0x7fadc01043b0 2024-05-09T00:01:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc799d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc019ebb0 con 0x7fadc0101a80 2024-05-09T00:01:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc799d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc019ed40 con 0x7fadc0106ce0 2024-05-09T00:01:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc4f38700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadc01043b0 0x7fadc0197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc4f38700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadc01043b0 0x7fadc0197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42498/0 (socket says 172.21.15.81:42498) 2024-05-09T00:01:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc4f38700 1 -- 172.21.15.81:0/2972013191 learned_addr learned my addr 172.21.15.81:0/2972013191 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:45.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc5739700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadc0101a80 0x7fadc0196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:45.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc4f38700 1 -- 172.21.15.81:0/2972013191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadc0106ce0 msgr2=0x7fadc019e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc5f3a700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadc0106ce0 0x7fadc019e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:45.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc4f38700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadc0106ce0 0x7fadc019e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc4f38700 1 -- 172.21.15.81:0/2972013191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadc0101a80 msgr2=0x7fadc0196f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:45.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc4f38700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadc0101a80 0x7fadc0196f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:45.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc4f38700 1 -- 172.21.15.81:0/2972013191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb40095f0 con 0x7fadc01043b0 2024-05-09T00:01:45.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc5739700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadc0101a80 0x7fadc0196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:45.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadc4f38700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadc01043b0 0x7fadc0197480 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fadb40098e0 tx=0x7fadb400f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:45.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.876+0000 7fadbe7fc700 1 -- 172.21.15.81:0/2972013191 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb401d070 con 0x7fadc01043b0 2024-05-09T00:01:45.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.877+0000 7fadbe7fc700 1 -- 172.21.15.81:0/2972013191 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadb400fca0 con 0x7fadc01043b0 2024-05-09T00:01:45.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.877+0000 7fadc799d700 1 -- 172.21.15.81:0/2972013191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc019efc0 con 0x7fadc01043b0 2024-05-09T00:01:45.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.877+0000 7fadbe7fc700 1 -- 172.21.15.81:0/2972013191 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb4017810 con 0x7fadc01043b0 2024-05-09T00:01:45.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.877+0000 7fadc799d700 1 -- 172.21.15.81:0/2972013191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc019f380 con 0x7fadc01043b0 2024-05-09T00:01:45.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.877+0000 7fadc799d700 1 -- 172.21.15.81:0/2972013191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc00fcf70 con 0x7fadc01043b0 2024-05-09T00:01:45.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.879+0000 7fadbe7fc700 1 -- 172.21.15.81:0/2972013191 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fadb4022ac0 con 0x7fadc01043b0 2024-05-09T00:01:45.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.879+0000 7fadbe7fc700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fada80a11a0 0x7fada80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:45.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.879+0000 7fadc5739700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fada80a11a0 0x7fada80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:45.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.879+0000 7fadbe7fc700 1 -- 172.21.15.81:0/2972013191 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fadb40ce280 con 0x7fadc01043b0 2024-05-09T00:01:45.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.879+0000 7fadc5739700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fada80a11a0 0x7fada80a3660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009fa0 tx=0x7fadb0009570 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:45.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:45.882+0000 7fadbe7fc700 1 -- 172.21.15.81:0/2972013191 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fadb4097b50 con 0x7fadc01043b0 2024-05-09T00:01:46.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:45 smithi150 ceph-mon[46187]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-09T00:01:46.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:45 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/597950940' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-09T00:01:46.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:45 smithi150 ceph-mon[46187]: osdmap e77: 12 total, 12 up, 12 in 2024-05-09T00:01:46.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:45 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2826337828' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-09T00:01:46.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:45 smithi150 ceph-mon[46187]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-09T00:01:46.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:45 smithi150 ceph-mon[46187]: osdmap e78: 12 total, 12 up, 12 in 2024-05-09T00:01:46.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:45 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2826337828' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-09T00:01:46.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:45 smithi150 ceph-mon[46187]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-09T00:01:46.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:45 smithi150 ceph-mon[46187]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-09T00:01:46.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:45 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3747539828' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:46.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:45 smithi171 ceph-mon[47351]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-09T00:01:46.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:45 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/597950940' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-09T00:01:46.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:45 smithi171 ceph-mon[47351]: osdmap e77: 12 total, 12 up, 12 in 2024-05-09T00:01:46.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:45 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2826337828' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-09T00:01:46.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:45 smithi171 ceph-mon[47351]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-09T00:01:46.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:45 smithi171 ceph-mon[47351]: osdmap e78: 12 total, 12 up, 12 in 2024-05-09T00:01:46.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:45 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2826337828' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-09T00:01:46.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:45 smithi171 ceph-mon[47351]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-09T00:01:46.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:45 smithi171 ceph-mon[47351]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-09T00:01:46.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:45 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3747539828' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:46.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:46.131+0000 7fadc799d700 1 -- 172.21.15.81:0/2972013191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fadc010c8d0 con 0x7fadc01043b0 2024-05-09T00:01:46.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:46 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3651409381' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:46.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:46 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] up:active 2024-05-09T00:01:46.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:46 smithi081 ceph-mon[42474]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:01:46.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:46 smithi081 ceph-mon[42474]: osdmap e79: 12 total, 12 up, 12 in 2024-05-09T00:01:46.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:46 smithi081 ceph-mon[42474]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:01:46.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:46 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2972013191' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-09T00:01:46.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:46 smithi081 ceph-mon[42474]: pgmap v219: 97 pgs: 9 creating+peering, 21 active+clean, 67 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-05-09T00:01:47.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:46 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3651409381' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:47.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:46 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] up:active 2024-05-09T00:01:47.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:46 smithi150 ceph-mon[46187]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:01:47.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:46 smithi150 ceph-mon[46187]: osdmap e79: 12 total, 12 up, 12 in 2024-05-09T00:01:47.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:46 smithi150 ceph-mon[46187]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:01:47.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:46 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2972013191' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-09T00:01:47.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:46 smithi150 ceph-mon[46187]: pgmap v219: 97 pgs: 9 creating+peering, 21 active+clean, 67 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-05-09T00:01:47.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.033+0000 7fadbe7fc700 1 -- 172.21.15.81:0/2972013191 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fadb409b170 con 0x7fadc01043b0 2024-05-09T00:01:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.036+0000 7fadc799d700 1 -- 172.21.15.81:0/2972013191 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fada80a11a0 msgr2=0x7fada80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.036+0000 7fadc799d700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fada80a11a0 0x7fada80a3660 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009fa0 tx=0x7fadb0009570 comp rx=0 tx=0).stop 2024-05-09T00:01:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.036+0000 7fadc799d700 1 -- 172.21.15.81:0/2972013191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadc01043b0 msgr2=0x7fadc0197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.036+0000 7fadc799d700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadc01043b0 0x7fadc0197480 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fadb40098e0 tx=0x7fadb400f7b0 comp rx=0 tx=0).stop 2024-05-09T00:01:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.036+0000 7fadc799d700 1 -- 172.21.15.81:0/2972013191 shutdown_connections 2024-05-09T00:01:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.036+0000 7fadc799d700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fada80a11a0 0x7fada80a3660 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.036+0000 7fadc799d700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadc0101a80 0x7fadc0196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.036+0000 7fadc799d700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadc0106ce0 0x7fadc019e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.036+0000 7fadc799d700 1 --2- 172.21.15.81:0/2972013191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadc01043b0 0x7fadc0197480 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.036+0000 7fadc799d700 1 -- 172.21.15.81:0/2972013191 >> 172.21.15.81:0/2972013191 conn(0x7fadc00fb3f0 msgr2=0x7fadc0103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.036+0000 7fadc799d700 1 -- 172.21.15.81:0/2972013191 shutdown_connections 2024-05-09T00:01:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.036+0000 7fadc799d700 1 -- 172.21.15.81:0/2972013191 wait complete. 2024-05-09T00:01:47.046 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-05-09T00:01:47.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-05-09T00:01:47.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:46 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3651409381' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:47.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:46 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] up:active 2024-05-09T00:01:47.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:46 smithi171 ceph-mon[47351]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:01:47.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:46 smithi171 ceph-mon[47351]: osdmap e79: 12 total, 12 up, 12 in 2024-05-09T00:01:47.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:46 smithi171 ceph-mon[47351]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:01:47.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:46 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2972013191' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-09T00:01:47.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:46 smithi171 ceph-mon[47351]: pgmap v219: 97 pgs: 9 creating+peering, 21 active+clean, 67 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2024-05-09T00:01:47.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.183+0000 7fb912318700 1 -- 172.21.15.81:0/3129040254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c102b10 msgr2=0x7fb90c1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:47.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.183+0000 7fb912318700 1 --2- 172.21.15.81:0/3129040254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c102b10 0x7fb90c1093c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb90400b0d0 tx=0x7fb90400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:01:47.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.183+0000 7fb912318700 1 -- 172.21.15.81:0/3129040254 shutdown_connections 2024-05-09T00:01:47.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.183+0000 7fb912318700 1 --2- 172.21.15.81:0/3129040254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c102b10 0x7fb90c1093c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:47.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.183+0000 7fb912318700 1 --2- 172.21.15.81:0/3129040254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb90c100f80 0x7fb90c1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:47.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.183+0000 7fb912318700 1 --2- 172.21.15.81:0/3129040254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb90c102170 0x7fb90c1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:47.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.183+0000 7fb912318700 1 -- 172.21.15.81:0/3129040254 >> 172.21.15.81:0/3129040254 conn(0x7fb90c0fc4f0 msgr2=0x7fb90c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:47.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.183+0000 7fb912318700 1 -- 172.21.15.81:0/3129040254 shutdown_connections 2024-05-09T00:01:47.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.183+0000 7fb912318700 1 -- 172.21.15.81:0/3129040254 wait complete. 2024-05-09T00:01:47.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.183+0000 7fb912318700 1 Processor -- start 2024-05-09T00:01:47.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.183+0000 7fb912318700 1 -- start start 2024-05-09T00:01:47.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb912318700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb90c100f80 0x7fb90c197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:47.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb912318700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c102170 0x7fb90c197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:47.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb912318700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb90c102b10 0x7fb90c19e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:47.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb912318700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c19eb50 con 0x7fb90c102170 2024-05-09T00:01:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb912318700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c19ec90 con 0x7fb90c100f80 2024-05-09T00:01:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb912318700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c19ee20 con 0x7fb90c102b10 2024-05-09T00:01:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb90b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c102170 0x7fb90c197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb90b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c102170 0x7fb90c197560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42516/0 (socket says 172.21.15.81:42516) 2024-05-09T00:01:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb90b7fe700 1 -- 172.21.15.81:0/2186315832 learned_addr learned my addr 172.21.15.81:0/2186315832 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb9108b5700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb90c102b10 0x7fb90c19e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb90bfff700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb90c100f80 0x7fb90c197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb90b7fe700 1 -- 172.21.15.81:0/2186315832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb90c102b10 msgr2=0x7fb90c19e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb90b7fe700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb90c102b10 0x7fb90c19e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb90b7fe700 1 -- 172.21.15.81:0/2186315832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb90c100f80 msgr2=0x7fb90c197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb90b7fe700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb90c100f80 0x7fb90c197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb90b7fe700 1 -- 172.21.15.81:0/2186315832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb904009d00 con 0x7fb90c102170 2024-05-09T00:01:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb9108b5700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb90c102b10 0x7fb90c19e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:47.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb90b7fe700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c102170 0x7fb90c197560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00b530 tx=0x7fb8fc00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:47.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb9097fa700 1 -- 172.21.15.81:0/2186315832 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc011830 con 0x7fb90c102170 2024-05-09T00:01:47.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb9097fa700 1 -- 172.21.15.81:0/2186315832 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8fc011e50 con 0x7fb90c102170 2024-05-09T00:01:47.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb912318700 1 -- 172.21.15.81:0/2186315832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90c19f100 con 0x7fb90c102170 2024-05-09T00:01:47.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb9097fa700 1 -- 172.21.15.81:0/2186315832 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00f2e0 con 0x7fb90c102170 2024-05-09T00:01:47.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.184+0000 7fb912318700 1 -- 172.21.15.81:0/2186315832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90c19f660 con 0x7fb90c102170 2024-05-09T00:01:47.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.185+0000 7fb912318700 1 -- 172.21.15.81:0/2186315832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90c108330 con 0x7fb90c102170 2024-05-09T00:01:47.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.186+0000 7fb9097fa700 1 -- 172.21.15.81:0/2186315832 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb8fc010580 con 0x7fb90c102170 2024-05-09T00:01:47.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.187+0000 7fb9097fa700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb8f80a11a0 0x7fb8f80a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:47.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.187+0000 7fb90bfff700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb8f80a11a0 0x7fb8f80a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:47.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.187+0000 7fb9097fa700 1 -- 172.21.15.81:0/2186315832 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb8fc0cc7c0 con 0x7fb90c102170 2024-05-09T00:01:47.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.187+0000 7fb90bfff700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb8f80a11a0 0x7fb8f80a3660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4005fd0 tx=0x7fb8f4005dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:47.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.190+0000 7fb9097fa700 1 -- 172.21.15.81:0/2186315832 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb8fc0960a0 con 0x7fb90c102170 2024-05-09T00:01:47.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:47.433+0000 7fb912318700 1 -- 172.21.15.81:0/2186315832 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fb90c10c9a0 con 0x7fb90c102170 2024-05-09T00:01:47.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:47 smithi081 ceph-mon[42474]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-09T00:01:47.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:47 smithi081 ceph-mon[42474]: Cluster is now healthy 2024-05-09T00:01:47.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:47 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2972013191' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-09T00:01:47.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:47 smithi081 ceph-mon[42474]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:01:47.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:47 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2186315832' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-09T00:01:48.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:47 smithi150 ceph-mon[46187]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-09T00:01:48.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:47 smithi150 ceph-mon[46187]: Cluster is now healthy 2024-05-09T00:01:48.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:47 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2972013191' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-09T00:01:48.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:47 smithi150 ceph-mon[46187]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:01:48.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:47 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2186315832' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-09T00:01:48.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.034+0000 7fb9097fa700 1 -- 172.21.15.81:0/2186315832 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7fb8fc0150b0 con 0x7fb90c102170 2024-05-09T00:01:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.037+0000 7fb912318700 1 -- 172.21.15.81:0/2186315832 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb8f80a11a0 msgr2=0x7fb8f80a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:48.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.037+0000 7fb912318700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb8f80a11a0 0x7fb8f80a3660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4005fd0 tx=0x7fb8f4005dd0 comp rx=0 tx=0).stop 2024-05-09T00:01:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.037+0000 7fb912318700 1 -- 172.21.15.81:0/2186315832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c102170 msgr2=0x7fb90c197560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.037+0000 7fb912318700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c102170 0x7fb90c197560 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00b530 tx=0x7fb8fc00b8f0 comp rx=0 tx=0).stop 2024-05-09T00:01:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.037+0000 7fb912318700 1 -- 172.21.15.81:0/2186315832 shutdown_connections 2024-05-09T00:01:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.037+0000 7fb912318700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb8f80a11a0 0x7fb8f80a3660 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.037+0000 7fb912318700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb90c100f80 0x7fb90c197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.037+0000 7fb912318700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb90c102b10 0x7fb90c19e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.037+0000 7fb912318700 1 --2- 172.21.15.81:0/2186315832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb90c102170 0x7fb90c197560 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.037+0000 7fb912318700 1 -- 172.21.15.81:0/2186315832 >> 172.21.15.81:0/2186315832 conn(0x7fb90c0fc4f0 msgr2=0x7fb90c105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.037+0000 7fb912318700 1 -- 172.21.15.81:0/2186315832 shutdown_connections 2024-05-09T00:01:48.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.037+0000 7fb912318700 1 -- 172.21.15.81:0/2186315832 wait complete. 2024-05-09T00:01:48.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-05-09T00:01:48.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:47 smithi171 ceph-mon[47351]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-09T00:01:48.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:47 smithi171 ceph-mon[47351]: Cluster is now healthy 2024-05-09T00:01:48.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:47 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2972013191' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-09T00:01:48.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:47 smithi171 ceph-mon[47351]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:01:48.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:47 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2186315832' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-09T00:01:48.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.179+0000 7ff146582700 1 -- 172.21.15.81:0/1903799113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1401019e0 msgr2=0x7ff140103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.179+0000 7ff146582700 1 --2- 172.21.15.81:0/1903799113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1401019e0 0x7ff140103dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff134009990 tx=0x7ff134009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.179+0000 7ff146582700 1 -- 172.21.15.81:0/1903799113 shutdown_connections 2024-05-09T00:01:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.179+0000 7ff146582700 1 --2- 172.21.15.81:0/1903799113 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff140106c40 0x7ff1401090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.179+0000 7ff146582700 1 --2- 172.21.15.81:0/1903799113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1401019e0 0x7ff140103dd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.179+0000 7ff146582700 1 --2- 172.21.15.81:0/1903799113 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff140104310 0x7ff140106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.179+0000 7ff146582700 1 -- 172.21.15.81:0/1903799113 >> 172.21.15.81:0/1903799113 conn(0x7ff1400fb3f0 msgr2=0x7ff1400fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.179+0000 7ff146582700 1 -- 172.21.15.81:0/1903799113 shutdown_connections 2024-05-09T00:01:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.179+0000 7ff146582700 1 -- 172.21.15.81:0/1903799113 wait complete. 2024-05-09T00:01:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.179+0000 7ff146582700 1 Processor -- start 2024-05-09T00:01:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.179+0000 7ff146582700 1 -- start start 2024-05-09T00:01:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff146582700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1401019e0 0x7ff140101300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff146582700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff140104310 0x7ff1400ff990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:48.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff146582700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff140106c40 0x7ff1400ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff146582700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff140100670 con 0x7ff140106c40 2024-05-09T00:01:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff146582700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1401007e0 con 0x7ff1401019e0 2024-05-09T00:01:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff146582700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1401a1010 con 0x7ff140104310 2024-05-09T00:01:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff144b1f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff140106c40 0x7ff1400ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff144b1f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff140106c40 0x7ff1400ffed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48318/0 (socket says 172.21.15.81:48318) 2024-05-09T00:01:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff144b1f700 1 -- 172.21.15.81:0/1421146333 learned_addr learned my addr 172.21.15.81:0/1421146333 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff13ffff700 1 --2- 172.21.15.81:0/1421146333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1401019e0 0x7ff140101300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff13f7fe700 1 --2- 172.21.15.81:0/1421146333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff140104310 0x7ff1400ff990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff144b1f700 1 -- 172.21.15.81:0/1421146333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff140104310 msgr2=0x7ff1400ff990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff144b1f700 1 --2- 172.21.15.81:0/1421146333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff140104310 0x7ff1400ff990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff144b1f700 1 -- 172.21.15.81:0/1421146333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1401019e0 msgr2=0x7ff140101300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff144b1f700 1 --2- 172.21.15.81:0/1421146333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1401019e0 0x7ff140101300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:48.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff144b1f700 1 -- 172.21.15.81:0/1421146333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1340095f0 con 0x7ff140106c40 2024-05-09T00:01:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff144b1f700 1 --2- 172.21.15.81:0/1421146333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff140106c40 0x7ff1400ffed0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff13800b970 tx=0x7ff13800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.180+0000 7ff13d7fa700 1 -- 172.21.15.81:0/1421146333 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13800d8e0 con 0x7ff140106c40 2024-05-09T00:01:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.181+0000 7ff146582700 1 -- 172.21.15.81:0/1421146333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1401a12a0 con 0x7ff140106c40 2024-05-09T00:01:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.181+0000 7ff13d7fa700 1 -- 172.21.15.81:0/1421146333 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1380098b0 con 0x7ff140106c40 2024-05-09T00:01:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.181+0000 7ff13d7fa700 1 -- 172.21.15.81:0/1421146333 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13800c400 con 0x7ff140106c40 2024-05-09T00:01:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.181+0000 7ff146582700 1 -- 172.21.15.81:0/1421146333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1401a17b0 con 0x7ff140106c40 2024-05-09T00:01:48.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.181+0000 7ff146582700 1 -- 172.21.15.81:0/1421146333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1400fcf70 con 0x7ff140106c40 2024-05-09T00:01:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.182+0000 7ff13d7fa700 1 -- 172.21.15.81:0/1421146333 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff13800da40 con 0x7ff140106c40 2024-05-09T00:01:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.183+0000 7ff13d7fa700 1 --2- 172.21.15.81:0/1421146333 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff1280a1120 0x7ff1280a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.183+0000 7ff13d7fa700 1 -- 172.21.15.81:0/1421146333 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff138011070 con 0x7ff140106c40 2024-05-09T00:01:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.183+0000 7ff13ffff700 1 --2- 172.21.15.81:0/1421146333 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff1280a1120 0x7ff1280a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:48.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.183+0000 7ff13ffff700 1 --2- 172.21.15.81:0/1421146333 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff1280a1120 0x7ff1280a35e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff13400b5c0 tx=0x7ff134005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:48.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.187+0000 7ff13d7fa700 1 -- 172.21.15.81:0/1421146333 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff13804fd60 con 0x7ff140106c40 2024-05-09T00:01:48.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:48.431+0000 7ff146582700 1 -- 172.21.15.81:0/1421146333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7ff14010c9a0 con 0x7ff140106c40 2024-05-09T00:01:48.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:48 smithi081 ceph-mon[42474]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T00:01:48.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:48 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2186315832' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-09T00:01:48.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:48 smithi081 ceph-mon[42474]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-09T00:01:48.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:48 smithi081 ceph-mon[42474]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:01:48.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:48 smithi081 ceph-mon[42474]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-09T00:01:48.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:48 smithi081 ceph-mon[42474]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-09T00:01:48.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:48 smithi081 ceph-mon[42474]: pgmap v220: 97 pgs: 9 creating+peering, 54 active+clean, 34 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 876 B/s wr, 6 op/s 2024-05-09T00:01:48.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:48 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1421146333' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-09T00:01:49.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:48 smithi150 ceph-mon[46187]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T00:01:49.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:48 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2186315832' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-09T00:01:49.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:48 smithi150 ceph-mon[46187]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-09T00:01:49.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:48 smithi150 ceph-mon[46187]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:01:49.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:48 smithi150 ceph-mon[46187]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-09T00:01:49.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:48 smithi150 ceph-mon[46187]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-09T00:01:49.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:48 smithi150 ceph-mon[46187]: pgmap v220: 97 pgs: 9 creating+peering, 54 active+clean, 34 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 876 B/s wr, 6 op/s 2024-05-09T00:01:49.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:48 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1421146333' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-09T00:01:49.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.043+0000 7ff13d7fa700 1 -- 172.21.15.81:0/1421146333 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7ff138095cd0 con 0x7ff140106c40 2024-05-09T00:01:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.045+0000 7ff146582700 1 -- 172.21.15.81:0/1421146333 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff1280a1120 msgr2=0x7ff1280a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.045+0000 7ff146582700 1 --2- 172.21.15.81:0/1421146333 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff1280a1120 0x7ff1280a35e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff13400b5c0 tx=0x7ff134005fd0 comp rx=0 tx=0).stop 2024-05-09T00:01:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.045+0000 7ff146582700 1 -- 172.21.15.81:0/1421146333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff140106c40 msgr2=0x7ff1400ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.045+0000 7ff146582700 1 --2- 172.21.15.81:0/1421146333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff140106c40 0x7ff1400ffed0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff13800b970 tx=0x7ff13800bc80 comp rx=0 tx=0).stop 2024-05-09T00:01:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.045+0000 7ff146582700 1 -- 172.21.15.81:0/1421146333 shutdown_connections 2024-05-09T00:01:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.045+0000 7ff146582700 1 --2- 172.21.15.81:0/1421146333 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff1280a1120 0x7ff1280a35e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.045+0000 7ff146582700 1 --2- 172.21.15.81:0/1421146333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff1401019e0 0x7ff140101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.045+0000 7ff146582700 1 --2- 172.21.15.81:0/1421146333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff140106c40 0x7ff1400ffed0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.045+0000 7ff146582700 1 --2- 172.21.15.81:0/1421146333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff140104310 0x7ff1400ff990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.045+0000 7ff146582700 1 -- 172.21.15.81:0/1421146333 >> 172.21.15.81:0/1421146333 conn(0x7ff1400fb3f0 msgr2=0x7ff140102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.046+0000 7ff146582700 1 -- 172.21.15.81:0/1421146333 shutdown_connections 2024-05-09T00:01:49.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.046+0000 7ff146582700 1 -- 172.21.15.81:0/1421146333 wait complete. 2024-05-09T00:01:49.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:48 smithi171 ceph-mon[47351]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-09T00:01:49.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:48 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2186315832' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-09T00:01:49.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:48 smithi171 ceph-mon[47351]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-09T00:01:49.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:48 smithi171 ceph-mon[47351]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-09T00:01:49.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:48 smithi171 ceph-mon[47351]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-09T00:01:49.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:48 smithi171 ceph-mon[47351]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-09T00:01:49.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:48 smithi171 ceph-mon[47351]: pgmap v220: 97 pgs: 9 creating+peering, 54 active+clean, 34 unknown; 577 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 876 B/s wr, 6 op/s 2024-05-09T00:01:49.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:48 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1421146333' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-09T00:01:49.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-09T00:01:49.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.186+0000 7f183cc69700 1 -- 172.21.15.81:0/1168946652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1838100f80 msgr2=0x7f18381013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.186+0000 7f183cc69700 1 --2- 172.21.15.81:0/1168946652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1838100f80 0x7f18381013a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f18280099c0 tx=0x7f1828009cd0 comp rx=0 tx=0).stop 2024-05-09T00:01:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.186+0000 7f183cc69700 1 -- 172.21.15.81:0/1168946652 shutdown_connections 2024-05-09T00:01:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.186+0000 7f183cc69700 1 --2- 172.21.15.81:0/1168946652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1838102b10 0x7f18381093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.186+0000 7f183cc69700 1 --2- 172.21.15.81:0/1168946652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1838100f80 0x7f18381013a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.186+0000 7f183cc69700 1 --2- 172.21.15.81:0/1168946652 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1838102170 0x7f18381025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.186+0000 7f183cc69700 1 -- 172.21.15.81:0/1168946652 >> 172.21.15.81:0/1168946652 conn(0x7f18380fc4f0 msgr2=0x7f18380fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.186+0000 7f183cc69700 1 -- 172.21.15.81:0/1168946652 shutdown_connections 2024-05-09T00:01:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.186+0000 7f183cc69700 1 -- 172.21.15.81:0/1168946652 wait complete. 2024-05-09T00:01:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f183cc69700 1 Processor -- start 2024-05-09T00:01:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f183cc69700 1 -- start start 2024-05-09T00:01:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f183cc69700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1838100f80 0x7f1838199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f183cc69700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1838102170 0x7f1838199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f183cc69700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1838102b10 0x7f18381a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f183cc69700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18381a0ce0 con 0x7f1838102b10 2024-05-09T00:01:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f183cc69700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18381a0e20 con 0x7f1838102170 2024-05-09T00:01:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f183cc69700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18381a0fb0 con 0x7f1838100f80 2024-05-09T00:01:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f1836d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1838102b10 0x7f18381a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f1836d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1838102b10 0x7f18381a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48330/0 (socket says 172.21.15.81:48330) 2024-05-09T00:01:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f1836d9d700 1 -- 172.21.15.81:0/1697362915 learned_addr learned my addr 172.21.15.81:0/1697362915 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f183659c700 1 --2- 172.21.15.81:0/1697362915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1838100f80 0x7f1838199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f1835d9b700 1 --2- 172.21.15.81:0/1697362915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1838102170 0x7f1838199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f1836d9d700 1 -- 172.21.15.81:0/1697362915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1838100f80 msgr2=0x7f1838199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f1836d9d700 1 --2- 172.21.15.81:0/1697362915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1838100f80 0x7f1838199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f1836d9d700 1 -- 172.21.15.81:0/1697362915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1838102170 msgr2=0x7f1838199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f1836d9d700 1 --2- 172.21.15.81:0/1697362915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1838102170 0x7f1838199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.187+0000 7f1836d9d700 1 -- 172.21.15.81:0/1697362915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18280095f0 con 0x7f1838102b10 2024-05-09T00:01:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.188+0000 7f1836d9d700 1 --2- 172.21.15.81:0/1697362915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1838102b10 0x7f18381a0710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1830007ee0 tx=0x7f183000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.188+0000 7f18277fe700 1 -- 172.21.15.81:0/1697362915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830017070 con 0x7f1838102b10 2024-05-09T00:01:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.188+0000 7f183cc69700 1 -- 172.21.15.81:0/1697362915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18381a1290 con 0x7f1838102b10 2024-05-09T00:01:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.188+0000 7f18277fe700 1 -- 172.21.15.81:0/1697362915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f183000f040 con 0x7f1838102b10 2024-05-09T00:01:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.188+0000 7f18277fe700 1 -- 172.21.15.81:0/1697362915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830005580 con 0x7f1838102b10 2024-05-09T00:01:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.188+0000 7f183cc69700 1 -- 172.21.15.81:0/1697362915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18381a1750 con 0x7f1838102b10 2024-05-09T00:01:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.189+0000 7f183cc69700 1 -- 172.21.15.81:0/1697362915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1838067cf0 con 0x7f1838102b10 2024-05-09T00:01:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.190+0000 7f18277fe700 1 -- 172.21.15.81:0/1697362915 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f183000db20 con 0x7f1838102b10 2024-05-09T00:01:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.190+0000 7f18277fe700 1 --2- 172.21.15.81:0/1697362915 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f18200a1120 0x7f18200a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.190+0000 7f183659c700 1 --2- 172.21.15.81:0/1697362915 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f18200a1120 0x7f18200a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.190+0000 7f18277fe700 1 -- 172.21.15.81:0/1697362915 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f18300cc5b0 con 0x7f1838102b10 2024-05-09T00:01:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.191+0000 7f183659c700 1 --2- 172.21.15.81:0/1697362915 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f18200a1120 0x7f18200a35e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1828003820 tx=0x7f1828005ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:49.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.194+0000 7f18277fe700 1 -- 172.21.15.81:0/1697362915 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1830095e90 con 0x7f1838102b10 2024-05-09T00:01:49.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:49.439+0000 7f183cc69700 1 -- 172.21.15.81:0/1697362915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f183810c810 con 0x7f1838102b10 2024-05-09T00:01:50.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.052+0000 7f18277fe700 1 -- 172.21.15.81:0/1697362915 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7f18300994b0 con 0x7f1838102b10 2024-05-09T00:01:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.055+0000 7f183cc69700 1 -- 172.21.15.81:0/1697362915 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f18200a1120 msgr2=0x7f18200a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.055+0000 7f183cc69700 1 --2- 172.21.15.81:0/1697362915 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f18200a1120 0x7f18200a35e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1828003820 tx=0x7f1828005ad0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.055+0000 7f183cc69700 1 -- 172.21.15.81:0/1697362915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1838102b10 msgr2=0x7f18381a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.055+0000 7f183cc69700 1 --2- 172.21.15.81:0/1697362915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1838102b10 0x7f18381a0710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1830007ee0 tx=0x7f183000d3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.055+0000 7f183cc69700 1 -- 172.21.15.81:0/1697362915 shutdown_connections 2024-05-09T00:01:50.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.055+0000 7f183cc69700 1 --2- 172.21.15.81:0/1697362915 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f18200a1120 0x7f18200a35e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.055+0000 7f183cc69700 1 --2- 172.21.15.81:0/1697362915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1838102b10 0x7f18381a0710 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.055+0000 7f183cc69700 1 --2- 172.21.15.81:0/1697362915 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1838100f80 0x7f1838199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.055+0000 7f183cc69700 1 --2- 172.21.15.81:0/1697362915 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1838102170 0x7f1838199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.055+0000 7f183cc69700 1 -- 172.21.15.81:0/1697362915 >> 172.21.15.81:0/1697362915 conn(0x7f18380fc4f0 msgr2=0x7f1838107910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.055+0000 7f183cc69700 1 -- 172.21.15.81:0/1697362915 shutdown_connections 2024-05-09T00:01:50.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.055+0000 7f183cc69700 1 -- 172.21.15.81:0/1697362915 wait complete. 2024-05-09T00:01:50.065 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-05-09T00:01:50.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-05-09T00:01:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.198+0000 7f3badb86700 1 -- 172.21.15.81:0/2686771797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8102ab0 msgr2=0x7f3ba81093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.198+0000 7f3badb86700 1 --2- 172.21.15.81:0/2686771797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8102ab0 0x7f3ba81093d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000b0a0 tx=0x7f3ba000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.198+0000 7f3badb86700 1 -- 172.21.15.81:0/2686771797 shutdown_connections 2024-05-09T00:01:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.198+0000 7f3badb86700 1 --2- 172.21.15.81:0/2686771797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8102ab0 0x7f3ba81093d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.198+0000 7f3badb86700 1 --2- 172.21.15.81:0/2686771797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ba8100f20 0x7f3ba8101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.198+0000 7f3badb86700 1 --2- 172.21.15.81:0/2686771797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba81020f0 0x7f3ba8102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.198+0000 7f3badb86700 1 -- 172.21.15.81:0/2686771797 >> 172.21.15.81:0/2686771797 conn(0x7f3ba80fc4e0 msgr2=0x7f3ba80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.198+0000 7f3badb86700 1 -- 172.21.15.81:0/2686771797 shutdown_connections 2024-05-09T00:01:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.198+0000 7f3badb86700 1 -- 172.21.15.81:0/2686771797 wait complete. 2024-05-09T00:01:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.198+0000 7f3badb86700 1 Processor -- start 2024-05-09T00:01:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.198+0000 7f3badb86700 1 -- start start 2024-05-09T00:01:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3badb86700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8100f20 0x7f3ba8196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3badb86700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ba81020f0 0x7f3ba8197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3badb86700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba8102ab0 0x7f3ba819e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3badb86700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba819ea60 con 0x7f3ba8100f20 2024-05-09T00:01:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3badb86700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba819eba0 con 0x7f3ba8102ab0 2024-05-09T00:01:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3badb86700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba819ed30 con 0x7f3ba81020f0 2024-05-09T00:01:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8100f20 0x7f3ba8196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8100f20 0x7f3ba8196f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48358/0 (socket says 172.21.15.81:48358) 2024-05-09T00:01:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba77fe700 1 -- 172.21.15.81:0/2822420849 learned_addr learned my addr 172.21.15.81:0/2822420849 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba6ffd700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ba81020f0 0x7f3ba8197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba7fff700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba8102ab0 0x7f3ba819e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba77fe700 1 -- 172.21.15.81:0/2822420849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ba81020f0 msgr2=0x7f3ba8197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba77fe700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ba81020f0 0x7f3ba8197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba77fe700 1 -- 172.21.15.81:0/2822420849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba8102ab0 msgr2=0x7f3ba819e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba77fe700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba8102ab0 0x7f3ba819e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba77fe700 1 -- 172.21.15.81:0/2822420849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba0009d00 con 0x7f3ba8100f20 2024-05-09T00:01:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba7fff700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba8102ab0 0x7f3ba819e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:01:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba6ffd700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ba81020f0 0x7f3ba8197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba77fe700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8100f20 0x7f3ba8196f30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800c970 tx=0x7f3b9800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba4ff9700 1 -- 172.21.15.81:0/2822420849 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98004220 con 0x7f3ba8100f20 2024-05-09T00:01:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba4ff9700 1 -- 172.21.15.81:0/2822420849 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b98007d60 con 0x7f3ba8100f20 2024-05-09T00:01:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3badb86700 1 -- 172.21.15.81:0/2822420849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba819efb0 con 0x7f3ba8100f20 2024-05-09T00:01:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3ba4ff9700 1 -- 172.21.15.81:0/2822420849 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b98003d00 con 0x7f3ba8100f20 2024-05-09T00:01:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.199+0000 7f3badb86700 1 -- 172.21.15.81:0/2822420849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba819f430 con 0x7f3ba8100f20 2024-05-09T00:01:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.200+0000 7f3badb86700 1 -- 172.21.15.81:0/2822420849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba81082e0 con 0x7f3ba8100f20 2024-05-09T00:01:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.202+0000 7f3ba4ff9700 1 -- 172.21.15.81:0/2822420849 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3b98004380 con 0x7f3ba8100f20 2024-05-09T00:01:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.202+0000 7f3ba4ff9700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3b940a1120 0x7f3b940a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.202+0000 7f3ba6ffd700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3b940a1120 0x7f3b940a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.202+0000 7f3ba4ff9700 1 -- 172.21.15.81:0/2822420849 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3b980cc760 con 0x7f3ba8100f20 2024-05-09T00:01:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.203+0000 7f3ba6ffd700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3b940a1120 0x7f3b940a35e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3b90005fd0 tx=0x7f3b90005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.206+0000 7f3ba4ff9700 1 -- 172.21.15.81:0/2822420849 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3b98096040 con 0x7f3ba8100f20 2024-05-09T00:01:50.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:50 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] up:active 2024-05-09T00:01:50.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:50 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1421146333' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-09T00:01:50.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:50 smithi171 ceph-mon[47351]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-09T00:01:50.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:50 smithi171 ceph-mon[47351]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T00:01:50.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:50 smithi171 ceph-mon[47351]: Cluster is now healthy 2024-05-09T00:01:50.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:50 smithi171 ceph-mon[47351]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-05-09T00:01:50.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:50 smithi171 ceph-mon[47351]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-05-09T00:01:50.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:50 smithi171 ceph-mon[47351]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-05-09T00:01:50.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:50 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1697362915' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-09T00:01:50.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:50 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] up:active 2024-05-09T00:01:50.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:50 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1421146333' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-09T00:01:50.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:50 smithi081 ceph-mon[42474]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-09T00:01:50.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:50 smithi081 ceph-mon[42474]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T00:01:50.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:50 smithi081 ceph-mon[42474]: Cluster is now healthy 2024-05-09T00:01:50.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:50 smithi081 ceph-mon[42474]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-05-09T00:01:50.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:50 smithi081 ceph-mon[42474]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-05-09T00:01:50.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:50 smithi081 ceph-mon[42474]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-05-09T00:01:50.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:50 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1697362915' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-09T00:01:50.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.435+0000 7f3badb86700 1 -- 172.21.15.81:0/2822420849 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ba802ceb0 con 0x7f3b940a1120 2024-05-09T00:01:50.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.458+0000 7f3ba4ff9700 1 -- 172.21.15.81:0/2822420849 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3ba802ceb0 con 0x7f3b940a1120 2024-05-09T00:01:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.460+0000 7f3badb86700 1 -- 172.21.15.81:0/2822420849 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3b940a1120 msgr2=0x7f3b940a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.460+0000 7f3badb86700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3b940a1120 0x7f3b940a35e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3b90005fd0 tx=0x7f3b90005e30 comp rx=0 tx=0).stop 2024-05-09T00:01:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.460+0000 7f3badb86700 1 -- 172.21.15.81:0/2822420849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8100f20 msgr2=0x7f3ba8196f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.460+0000 7f3badb86700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8100f20 0x7f3ba8196f30 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3b9800c970 tx=0x7f3b9800cd30 comp rx=0 tx=0).stop 2024-05-09T00:01:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.461+0000 7f3badb86700 1 -- 172.21.15.81:0/2822420849 shutdown_connections 2024-05-09T00:01:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.461+0000 7f3badb86700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3b940a1120 0x7f3b940a35e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.461+0000 7f3badb86700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ba8102ab0 0x7f3ba819e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.461+0000 7f3badb86700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ba8100f20 0x7f3ba8196f30 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.461+0000 7f3badb86700 1 --2- 172.21.15.81:0/2822420849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ba81020f0 0x7f3ba8197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.461+0000 7f3badb86700 1 -- 172.21.15.81:0/2822420849 >> 172.21.15.81:0/2822420849 conn(0x7f3ba80fc4e0 msgr2=0x7f3ba8105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.461+0000 7f3badb86700 1 -- 172.21.15.81:0/2822420849 shutdown_connections 2024-05-09T00:01:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.461+0000 7f3badb86700 1 -- 172.21.15.81:0/2822420849 wait complete. 2024-05-09T00:01:50.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-09T00:01:50.514 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:01:50 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-b[81423]: 2024-05-09T00:01:50.199+0000 7fb53602e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-09T00:01:50.514 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:01:50 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-b[81423]: 2024-05-09T00:01:50.199+0000 7fb53602e700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-09T00:01:50.514 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:01:50 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-b[81423]: 2024-05-09T00:01:50.199+0000 7fb53602e700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-09T00:01:50.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:50 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] up:active 2024-05-09T00:01:50.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:50 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1421146333' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-09T00:01:50.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:50 smithi150 ceph-mon[46187]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-09T00:01:50.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:50 smithi150 ceph-mon[46187]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-09T00:01:50.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:50 smithi150 ceph-mon[46187]: Cluster is now healthy 2024-05-09T00:01:50.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:50 smithi150 ceph-mon[46187]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-05-09T00:01:50.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:50 smithi150 ceph-mon[46187]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-05-09T00:01:50.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:50 smithi150 ceph-mon[46187]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-05-09T00:01:50.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:50 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1697362915' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-09T00:01:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.600+0000 7f18fcd47700 1 -- 172.21.15.81:0/2933317820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f8102540 msgr2=0x7f18f8102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.600+0000 7f18fcd47700 1 --2- 172.21.15.81:0/2933317820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f8102540 0x7f18f8102960 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f18e80099c0 tx=0x7f18e8009cd0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.600+0000 7f18fcd47700 1 -- 172.21.15.81:0/2933317820 shutdown_connections 2024-05-09T00:01:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.600+0000 7f18fcd47700 1 --2- 172.21.15.81:0/2933317820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f80ff950 0x7f18f8109520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.600+0000 7f18fcd47700 1 --2- 172.21.15.81:0/2933317820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f8102540 0x7f18f8102960 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.600+0000 7f18fcd47700 1 --2- 172.21.15.81:0/2933317820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18f80fefb0 0x7f18f80ff410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.600+0000 7f18fcd47700 1 -- 172.21.15.81:0/2933317820 >> 172.21.15.81:0/2933317820 conn(0x7f18f80fab50 msgr2=0x7f18f80fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.600+0000 7f18fcd47700 1 -- 172.21.15.81:0/2933317820 shutdown_connections 2024-05-09T00:01:50.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.601+0000 7f18fcd47700 1 -- 172.21.15.81:0/2933317820 wait complete. 2024-05-09T00:01:50.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.601+0000 7f18fcd47700 1 Processor -- start 2024-05-09T00:01:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.601+0000 7f18fcd47700 1 -- start start 2024-05-09T00:01:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.601+0000 7f18fcd47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f80fefb0 0x7f18f8101bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.601+0000 7f18fcd47700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f80ff950 0x7f18f8100280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.601+0000 7f18fcd47700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18f8102540 0x7f18f81007c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.601+0000 7f18fcd47700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f8100f60 con 0x7f18f80fefb0 2024-05-09T00:01:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.601+0000 7f18fcd47700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f81010d0 con 0x7f18f80ff950 2024-05-09T00:01:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.601+0000 7f18fcd47700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f81a0ef0 con 0x7f18f8102540 2024-05-09T00:01:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18f659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f80fefb0 0x7f18f8101bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18f659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f80fefb0 0x7f18f8101bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48384/0 (socket says 172.21.15.81:48384) 2024-05-09T00:01:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18f659c700 1 -- 172.21.15.81:0/2049870513 learned_addr learned my addr 172.21.15.81:0/2049870513 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18f5d9b700 1 --2- 172.21.15.81:0/2049870513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f80ff950 0x7f18f8100280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18f659c700 1 -- 172.21.15.81:0/2049870513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18f8102540 msgr2=0x7f18f81007c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:50.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18f659c700 1 --2- 172.21.15.81:0/2049870513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18f8102540 0x7f18f81007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18f659c700 1 -- 172.21.15.81:0/2049870513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f80ff950 msgr2=0x7f18f8100280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18f659c700 1 --2- 172.21.15.81:0/2049870513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f80ff950 0x7f18f8100280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18f659c700 1 -- 172.21.15.81:0/2049870513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e80095f0 con 0x7f18f80fefb0 2024-05-09T00:01:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18f5d9b700 1 --2- 172.21.15.81:0/2049870513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f80ff950 0x7f18f8100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18f659c700 1 --2- 172.21.15.81:0/2049870513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f80fefb0 0x7f18f8101bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f18e8006010 tx=0x7f18e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18e77fe700 1 -- 172.21.15.81:0/2049870513 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e801d070 con 0x7f18f80fefb0 2024-05-09T00:01:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18e77fe700 1 -- 172.21.15.81:0/2049870513 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18e8004090 con 0x7f18f80fefb0 2024-05-09T00:01:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18fcd47700 1 -- 172.21.15.81:0/2049870513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f81a1120 con 0x7f18f80fefb0 2024-05-09T00:01:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18e77fe700 1 -- 172.21.15.81:0/2049870513 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e800f460 con 0x7f18f80fefb0 2024-05-09T00:01:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.602+0000 7f18fcd47700 1 -- 172.21.15.81:0/2049870513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f81a1540 con 0x7f18f80fefb0 2024-05-09T00:01:50.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.603+0000 7f18fcd47700 1 -- 172.21.15.81:0/2049870513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f8108510 con 0x7f18f80fefb0 2024-05-09T00:01:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.604+0000 7f18e77fe700 1 -- 172.21.15.81:0/2049870513 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f18e8022600 con 0x7f18f80fefb0 2024-05-09T00:01:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.605+0000 7f18e77fe700 1 --2- 172.21.15.81:0/2049870513 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f18e00a11a0 0x7f18e00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.605+0000 7f18f5d9b700 1 --2- 172.21.15.81:0/2049870513 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f18e00a11a0 0x7f18e00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.605+0000 7f18e77fe700 1 -- 172.21.15.81:0/2049870513 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f18e80cdc90 con 0x7f18f80fefb0 2024-05-09T00:01:50.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.605+0000 7f18f5d9b700 1 --2- 172.21.15.81:0/2049870513 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f18e00a11a0 0x7f18e00a3660 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f18ec005fd0 tx=0x7f18ec005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:50.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.609+0000 7f18e77fe700 1 -- 172.21.15.81:0/2049870513 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f18e8097560 con 0x7f18f80fefb0 2024-05-09T00:01:50.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.840+0000 7f18fcd47700 1 -- 172.21.15.81:0/2049870513 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f18f80613e0 con 0x7f18e00a11a0 2024-05-09T00:01:50.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.863+0000 7f18e77fe700 1 -- 172.21.15.81:0/2049870513 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f18f80613e0 con 0x7f18e00a11a0 2024-05-09T00:01:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.865+0000 7f18fcd47700 1 -- 172.21.15.81:0/2049870513 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f18e00a11a0 msgr2=0x7f18e00a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.865+0000 7f18fcd47700 1 --2- 172.21.15.81:0/2049870513 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f18e00a11a0 0x7f18e00a3660 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f18ec005fd0 tx=0x7f18ec005e30 comp rx=0 tx=0).stop 2024-05-09T00:01:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.865+0000 7f18fcd47700 1 -- 172.21.15.81:0/2049870513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f80fefb0 msgr2=0x7f18f8101bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.865+0000 7f18fcd47700 1 --2- 172.21.15.81:0/2049870513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f80fefb0 0x7f18f8101bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f18e8006010 tx=0x7f18e80057f0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.865+0000 7f18fcd47700 1 -- 172.21.15.81:0/2049870513 shutdown_connections 2024-05-09T00:01:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.865+0000 7f18fcd47700 1 --2- 172.21.15.81:0/2049870513 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f18e00a11a0 0x7f18e00a3660 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.865+0000 7f18fcd47700 1 --2- 172.21.15.81:0/2049870513 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f18f8102540 0x7f18f81007c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.865+0000 7f18fcd47700 1 --2- 172.21.15.81:0/2049870513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18f80fefb0 0x7f18f8101bf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.865+0000 7f18fcd47700 1 --2- 172.21.15.81:0/2049870513 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f18f80ff950 0x7f18f8100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.865+0000 7f18fcd47700 1 -- 172.21.15.81:0/2049870513 >> 172.21.15.81:0/2049870513 conn(0x7f18f80fab50 msgr2=0x7f18f8105650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.865+0000 7f18fcd47700 1 -- 172.21.15.81:0/2049870513 shutdown_connections 2024-05-09T00:01:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:50.865+0000 7f18fcd47700 1 -- 172.21.15.81:0/2049870513 wait complete. 2024-05-09T00:01:50.869 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:01:50 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:01:50.440+0000 7fb5989f3700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:01:50.869 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:01:50 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:01:50.440+0000 7fb5989f3700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:01:50.869 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:01:50 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:01:50.440+0000 7fb5989f3700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:01:50.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:01:50 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:01:50.440+0000 7fb5989f3700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:01:50.870 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:01:50 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:01:50.440+0000 7fb5989f3700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:01:50.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-09T00:01:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.004+0000 7f6d74482700 1 -- 172.21.15.81:0/4114882664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d6c0ffe60 msgr2=0x7f6d6c100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.004+0000 7f6d74482700 1 --2- 172.21.15.81:0/4114882664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d6c0ffe60 0x7f6d6c100280 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009990 tx=0x7f6d68009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.004+0000 7f6d74482700 1 -- 172.21.15.81:0/4114882664 shutdown_connections 2024-05-09T00:01:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.004+0000 7f6d74482700 1 --2- 172.21.15.81:0/4114882664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d6c101970 0x7f6d6c108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.004+0000 7f6d74482700 1 --2- 172.21.15.81:0/4114882664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d6c0ffe60 0x7f6d6c100280 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.004+0000 7f6d74482700 1 --2- 172.21.15.81:0/4114882664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d6c100fb0 0x7f6d6c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.004+0000 7f6d74482700 1 -- 172.21.15.81:0/4114882664 >> 172.21.15.81:0/4114882664 conn(0x7f6d6c0fb3f0 msgr2=0x7f6d6c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.004+0000 7f6d74482700 1 -- 172.21.15.81:0/4114882664 shutdown_connections 2024-05-09T00:01:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.004+0000 7f6d74482700 1 -- 172.21.15.81:0/4114882664 wait complete. 2024-05-09T00:01:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d74482700 1 Processor -- start 2024-05-09T00:01:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d74482700 1 -- start start 2024-05-09T00:01:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d74482700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d6c0ffe60 0x7f6d6c068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d74482700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d6c100fb0 0x7f6d6c19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d74482700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d6c101970 0x7f6d6c19e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:51.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d74482700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c19e9e0 con 0x7f6d6c101970 2024-05-09T00:01:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d74482700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c19eb50 con 0x7f6d6c100fb0 2024-05-09T00:01:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d74482700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c19ed10 con 0x7f6d6c0ffe60 2024-05-09T00:01:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d72a1f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d6c101970 0x7f6d6c19e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d72a1f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d6c101970 0x7f6d6c19e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48406/0 (socket says 172.21.15.81:48406) 2024-05-09T00:01:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d72a1f700 1 -- 172.21.15.81:0/3543845273 learned_addr learned my addr 172.21.15.81:0/3543845273 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d7221e700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d6c0ffe60 0x7f6d6c068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d71a1d700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d6c100fb0 0x7f6d6c19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d72a1f700 1 -- 172.21.15.81:0/3543845273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d6c0ffe60 msgr2=0x7f6d6c068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d72a1f700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d6c0ffe60 0x7f6d6c068b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d72a1f700 1 -- 172.21.15.81:0/3543845273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d6c100fb0 msgr2=0x7f6d6c19bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:51.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d72a1f700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d6c100fb0 0x7f6d6c19bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d72a1f700 1 -- 172.21.15.81:0/3543845273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d680095f0 con 0x7f6d6c101970 2024-05-09T00:01:51.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.005+0000 7f6d71a1d700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d6c100fb0 0x7f6d6c19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:01:51.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.006+0000 7f6d72a1f700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d6c101970 0x7f6d6c19e240 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400ada0 tx=0x7f6d6400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:51.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.006+0000 7f6d637fe700 1 -- 172.21.15.81:0/3543845273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400f070 con 0x7f6d6c101970 2024-05-09T00:01:51.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.006+0000 7f6d637fe700 1 -- 172.21.15.81:0/3543845273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d64007b30 con 0x7f6d6c101970 2024-05-09T00:01:51.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.006+0000 7f6d74482700 1 -- 172.21.15.81:0/3543845273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c19eff0 con 0x7f6d6c101970 2024-05-09T00:01:51.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.006+0000 7f6d637fe700 1 -- 172.21.15.81:0/3543845273 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d640053e0 con 0x7f6d6c101970 2024-05-09T00:01:51.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.006+0000 7f6d74482700 1 -- 172.21.15.81:0/3543845273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c19f420 con 0x7f6d6c101970 2024-05-09T00:01:51.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.007+0000 7f6d74482700 1 -- 172.21.15.81:0/3543845273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c1072d0 con 0x7f6d6c101970 2024-05-09T00:01:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.008+0000 7f6d637fe700 1 -- 172.21.15.81:0/3543845273 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6d6400c980 con 0x7f6d6c101970 2024-05-09T00:01:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.008+0000 7f6d637fe700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6d580a1120 0x7f6d580a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.008+0000 7f6d7221e700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6d580a1120 0x7f6d580a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.008+0000 7f6d637fe700 1 -- 172.21.15.81:0/3543845273 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6d640cc340 con 0x7f6d6c101970 2024-05-09T00:01:51.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.009+0000 7f6d7221e700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6d580a1120 0x7f6d580a35e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800b5c0 tx=0x7f6d68003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:51.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.012+0000 7f6d637fe700 1 -- 172.21.15.81:0/3543845273 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6d64095cb0 con 0x7f6d6c101970 2024-05-09T00:01:51.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.249+0000 7f6d74482700 1 -- 172.21.15.81:0/3543845273 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d6c02ce10 con 0x7f6d580a1120 2024-05-09T00:01:51.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.253+0000 7f6d637fe700 1 -- 172.21.15.81:0/3543845273 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f6d6c02ce10 con 0x7f6d580a1120 2024-05-09T00:01:51.249 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/qa/sv_0/63792a64-c6e2-4ba6-9bc5-b1c2c41cd563 2024-05-09T00:01:51.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.256+0000 7f6d74482700 1 -- 172.21.15.81:0/3543845273 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6d580a1120 msgr2=0x7f6d580a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:51.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.256+0000 7f6d74482700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6d580a1120 0x7f6d580a35e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800b5c0 tx=0x7f6d68003790 comp rx=0 tx=0).stop 2024-05-09T00:01:51.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.256+0000 7f6d74482700 1 -- 172.21.15.81:0/3543845273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d6c101970 msgr2=0x7f6d6c19e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:51.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.256+0000 7f6d74482700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d6c101970 0x7f6d6c19e240 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400ada0 tx=0x7f6d6400c330 comp rx=0 tx=0).stop 2024-05-09T00:01:51.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.256+0000 7f6d74482700 1 -- 172.21.15.81:0/3543845273 shutdown_connections 2024-05-09T00:01:51.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.256+0000 7f6d74482700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6d580a1120 0x7f6d580a35e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.256+0000 7f6d74482700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d6c101970 0x7f6d6c19e240 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.256+0000 7f6d74482700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6d6c0ffe60 0x7f6d6c068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.256+0000 7f6d74482700 1 --2- 172.21.15.81:0/3543845273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6d6c100fb0 0x7f6d6c19bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.256+0000 7f6d74482700 1 -- 172.21.15.81:0/3543845273 >> 172.21.15.81:0/3543845273 conn(0x7f6d6c0fb3f0 msgr2=0x7f6d6c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:51.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.256+0000 7f6d74482700 1 -- 172.21.15.81:0/3543845273 shutdown_connections 2024-05-09T00:01:51.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.256+0000 7f6d74482700 1 -- 172.21.15.81:0/3543845273 wait complete. 2024-05-09T00:01:51.262 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:51 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] up:active 2024-05-09T00:01:51.262 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:51 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1697362915' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-09T00:01:51.262 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:51 smithi081 ceph-mon[42474]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-05-09T00:01:51.262 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:51 smithi081 ceph-mon[42474]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T00:01:51.262 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:51 smithi081 ceph-mon[42474]: pgmap v221: 97 pgs: 97 active+clean; 580 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 13 op/s 2024-05-09T00:01:51.262 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:51 smithi081 ceph-mon[42474]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:51.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-09T00:01:51.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:51 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] up:active 2024-05-09T00:01:51.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:51 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1697362915' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-09T00:01:51.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:51 smithi171 ceph-mon[47351]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-05-09T00:01:51.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:51 smithi171 ceph-mon[47351]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T00:01:51.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:51 smithi171 ceph-mon[47351]: pgmap v221: 97 pgs: 97 active+clean; 580 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 13 op/s 2024-05-09T00:01:51.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:51 smithi171 ceph-mon[47351]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.395+0000 7f77af331700 1 -- 172.21.15.81:0/4040341615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a80ffe80 msgr2=0x7f77a81002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.395+0000 7f77af331700 1 --2- 172.21.15.81:0/4040341615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a80ffe80 0x7f77a81002a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009990 tx=0x7f77a4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.395+0000 7f77af331700 1 -- 172.21.15.81:0/4040341615 shutdown_connections 2024-05-09T00:01:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.395+0000 7f77af331700 1 --2- 172.21.15.81:0/4040341615 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77a8101990 0x7f77a81082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.395+0000 7f77af331700 1 --2- 172.21.15.81:0/4040341615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a80ffe80 0x7f77a81002a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.395+0000 7f77af331700 1 --2- 172.21.15.81:0/4040341615 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77a8100fd0 0x7f77a8101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.395+0000 7f77af331700 1 -- 172.21.15.81:0/4040341615 >> 172.21.15.81:0/4040341615 conn(0x7f77a80fb3f0 msgr2=0x7f77a80fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.396+0000 7f77af331700 1 -- 172.21.15.81:0/4040341615 shutdown_connections 2024-05-09T00:01:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.396+0000 7f77af331700 1 -- 172.21.15.81:0/4040341615 wait complete. 2024-05-09T00:01:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.396+0000 7f77af331700 1 Processor -- start 2024-05-09T00:01:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.396+0000 7f77af331700 1 -- start start 2024-05-09T00:01:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.396+0000 7f77af331700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77a80ffe80 0x7f77a8196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.396+0000 7f77af331700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77a8100fd0 0x7f77a81974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.396+0000 7f77af331700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a8101990 0x7f77a819e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.396+0000 7f77af331700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a819eaa0 con 0x7f77a8101990 2024-05-09T00:01:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.396+0000 7f77af331700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a819ebe0 con 0x7f77a80ffe80 2024-05-09T00:01:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.396+0000 7f77af331700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a819ed70 con 0x7f77a8100fd0 2024-05-09T00:01:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.396+0000 7f77ad8ce700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a8101990 0x7f77a819e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.396+0000 7f77ad8ce700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a8101990 0x7f77a819e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48424/0 (socket says 172.21.15.81:48424) 2024-05-09T00:01:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.396+0000 7f77ad8ce700 1 -- 172.21.15.81:0/1627050888 learned_addr learned my addr 172.21.15.81:0/1627050888 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.397+0000 7f77ac8cc700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77a8100fd0 0x7f77a81974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.397+0000 7f77ad0cd700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77a80ffe80 0x7f77a8196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.397+0000 7f77ad8ce700 1 -- 172.21.15.81:0/1627050888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77a8100fd0 msgr2=0x7f77a81974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.397+0000 7f77ad8ce700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77a8100fd0 0x7f77a81974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.397+0000 7f77ad8ce700 1 -- 172.21.15.81:0/1627050888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77a80ffe80 msgr2=0x7f77a8196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.397+0000 7f77ad8ce700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77a80ffe80 0x7f77a8196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.397+0000 7f77ad8ce700 1 -- 172.21.15.81:0/1627050888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a40095f0 con 0x7f77a8101990 2024-05-09T00:01:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.397+0000 7f77ad0cd700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77a80ffe80 0x7f77a8196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:01:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.397+0000 7f77ad8ce700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a8101990 0x7f77a819e4d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f77a0007ee0 tx=0x7f77a000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.397+0000 7f779e7fc700 1 -- 172.21.15.81:0/1627050888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0017070 con 0x7f77a8101990 2024-05-09T00:01:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.397+0000 7f779e7fc700 1 -- 172.21.15.81:0/1627050888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77a000f040 con 0x7f77a8101990 2024-05-09T00:01:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.397+0000 7f77af331700 1 -- 172.21.15.81:0/1627050888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a819eff0 con 0x7f77a8101990 2024-05-09T00:01:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.397+0000 7f779e7fc700 1 -- 172.21.15.81:0/1627050888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0005740 con 0x7f77a8101990 2024-05-09T00:01:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.397+0000 7f77af331700 1 -- 172.21.15.81:0/1627050888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a819f480 con 0x7f77a8101990 2024-05-09T00:01:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.398+0000 7f77af331700 1 -- 172.21.15.81:0/1627050888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a8068140 con 0x7f77a8101990 2024-05-09T00:01:51.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.399+0000 7f779e7fc700 1 -- 172.21.15.81:0/1627050888 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f77a00058a0 con 0x7f77a8101990 2024-05-09T00:01:51.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.400+0000 7f779e7fc700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f77940a11a0 0x7f77940a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:51.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.400+0000 7f77ad0cd700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f77940a11a0 0x7f77940a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:51.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.400+0000 7f779e7fc700 1 -- 172.21.15.81:0/1627050888 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f77a00cc6f0 con 0x7f77a8101990 2024-05-09T00:01:51.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.400+0000 7f77ad0cd700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f77940a11a0 0x7f77940a3660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f77a4000c00 tx=0x7f77a4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.403+0000 7f779e7fc700 1 -- 172.21.15.81:0/1627050888 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f77a0095f30 con 0x7f77a8101990 2024-05-09T00:01:51.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:51 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] up:active 2024-05-09T00:01:51.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:51 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1697362915' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-09T00:01:51.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:51 smithi150 ceph-mon[46187]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-05-09T00:01:51.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:51 smithi150 ceph-mon[46187]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T00:01:51.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:51 smithi150 ceph-mon[46187]: pgmap v221: 97 pgs: 97 active+clean; 580 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s wr, 13 op/s 2024-05-09T00:01:51.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:51 smithi150 ceph-mon[46187]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:51.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.635+0000 7f77af331700 1 -- 172.21.15.81:0/1627050888 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f77a8069b90 con 0x7f77940a11a0 2024-05-09T00:01:51.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.658+0000 7f779e7fc700 1 -- 172.21.15.81:0/1627050888 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f77a8069b90 con 0x7f77940a11a0 2024-05-09T00:01:51.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.660+0000 7f77af331700 1 -- 172.21.15.81:0/1627050888 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f77940a11a0 msgr2=0x7f77940a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:51.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.660+0000 7f77af331700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f77940a11a0 0x7f77940a3660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f77a4000c00 tx=0x7f77a4005fb0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.660+0000 7f77af331700 1 -- 172.21.15.81:0/1627050888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a8101990 msgr2=0x7f77a819e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.660+0000 7f77af331700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a8101990 0x7f77a819e4d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f77a0007ee0 tx=0x7f77a000d3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.660+0000 7f77af331700 1 -- 172.21.15.81:0/1627050888 shutdown_connections 2024-05-09T00:01:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.660+0000 7f77af331700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f77940a11a0 0x7f77940a3660 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.660+0000 7f77af331700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77a80ffe80 0x7f77a8196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.660+0000 7f77af331700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a8101990 0x7f77a819e4d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.660+0000 7f77af331700 1 --2- 172.21.15.81:0/1627050888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77a8100fd0 0x7f77a81974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.660+0000 7f77af331700 1 -- 172.21.15.81:0/1627050888 >> 172.21.15.81:0/1627050888 conn(0x7f77a80fb3f0 msgr2=0x7f77a8069480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.660+0000 7f77af331700 1 -- 172.21.15.81:0/1627050888 shutdown_connections 2024-05-09T00:01:51.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.660+0000 7f77af331700 1 -- 172.21.15.81:0/1627050888 wait complete. 2024-05-09T00:01:51.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-09T00:01:51.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.799+0000 7f7daf847700 1 -- 172.21.15.81:0/2338960469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da80ffe60 msgr2=0x7f7da8100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:51.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.799+0000 7f7daf847700 1 --2- 172.21.15.81:0/2338960469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da80ffe60 0x7f7da8100280 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7da4009990 tx=0x7f7da4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.799+0000 7f7daf847700 1 -- 172.21.15.81:0/2338960469 shutdown_connections 2024-05-09T00:01:51.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.799+0000 7f7daf847700 1 --2- 172.21.15.81:0/2338960469 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7da8101970 0x7f7da8108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.799+0000 7f7daf847700 1 --2- 172.21.15.81:0/2338960469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da80ffe60 0x7f7da8100280 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.799+0000 7f7daf847700 1 --2- 172.21.15.81:0/2338960469 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7da8100fb0 0x7f7da8101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.799+0000 7f7daf847700 1 -- 172.21.15.81:0/2338960469 >> 172.21.15.81:0/2338960469 conn(0x7f7da80fb3f0 msgr2=0x7f7da80fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:51.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.799+0000 7f7daf847700 1 -- 172.21.15.81:0/2338960469 shutdown_connections 2024-05-09T00:01:51.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.799+0000 7f7daf847700 1 -- 172.21.15.81:0/2338960469 wait complete. 2024-05-09T00:01:51.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7daf847700 1 Processor -- start 2024-05-09T00:01:51.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7daf847700 1 -- start start 2024-05-09T00:01:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7daf847700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7da80ffe60 0x7f7da810a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7daf847700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da8100fb0 0x7f7da8108d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7daf847700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7da8101970 0x7f7da81092c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7daf847700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da8109a60 con 0x7f7da8100fb0 2024-05-09T00:01:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7daf847700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da8109bd0 con 0x7f7da80ffe60 2024-05-09T00:01:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7daf847700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da81a0fa0 con 0x7f7da8101970 2024-05-09T00:01:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7dacde2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da8100fb0 0x7f7da8108d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7dacde2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da8100fb0 0x7f7da8108d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48444/0 (socket says 172.21.15.81:48444) 2024-05-09T00:01:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7dacde2700 1 -- 172.21.15.81:0/2628815925 learned_addr learned my addr 172.21.15.81:0/2628815925 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7dad5e3700 1 --2- 172.21.15.81:0/2628815925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7da80ffe60 0x7f7da810a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7dadde4700 1 --2- 172.21.15.81:0/2628815925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7da8101970 0x7f7da81092c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7dacde2700 1 -- 172.21.15.81:0/2628815925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7da8101970 msgr2=0x7f7da81092c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:51.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7dacde2700 1 --2- 172.21.15.81:0/2628815925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7da8101970 0x7f7da81092c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7dacde2700 1 -- 172.21.15.81:0/2628815925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7da80ffe60 msgr2=0x7f7da810a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:51.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7dacde2700 1 --2- 172.21.15.81:0/2628815925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7da80ffe60 0x7f7da810a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:51.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7dacde2700 1 -- 172.21.15.81:0/2628815925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da40095f0 con 0x7f7da8100fb0 2024-05-09T00:01:51.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.800+0000 7f7dacde2700 1 --2- 172.21.15.81:0/2628815925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da8100fb0 0x7f7da8108d80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800b530 tx=0x7f7d9800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:51.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.801+0000 7f7d9e7fc700 1 -- 172.21.15.81:0/2628815925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d98011830 con 0x7f7da8100fb0 2024-05-09T00:01:51.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.801+0000 7f7daf847700 1 -- 172.21.15.81:0/2628815925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da81a1230 con 0x7f7da8100fb0 2024-05-09T00:01:51.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.801+0000 7f7d9e7fc700 1 -- 172.21.15.81:0/2628815925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d98011e50 con 0x7f7da8100fb0 2024-05-09T00:01:51.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.801+0000 7f7d9e7fc700 1 -- 172.21.15.81:0/2628815925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d98010e50 con 0x7f7da8100fb0 2024-05-09T00:01:51.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.801+0000 7f7daf847700 1 -- 172.21.15.81:0/2628815925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da81a1790 con 0x7f7da8100fb0 2024-05-09T00:01:51.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.801+0000 7f7daf847700 1 -- 172.21.15.81:0/2628815925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da81072d0 con 0x7f7da8100fb0 2024-05-09T00:01:51.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.803+0000 7f7d9e7fc700 1 -- 172.21.15.81:0/2628815925 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7d980104f0 con 0x7f7da8100fb0 2024-05-09T00:01:51.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.803+0000 7f7d9e7fc700 1 --2- 172.21.15.81:0/2628815925 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f7d940a1120 0x7f7d940a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:51.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.803+0000 7f7dad5e3700 1 --2- 172.21.15.81:0/2628815925 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f7d940a1120 0x7f7d940a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:51.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.803+0000 7f7d9e7fc700 1 -- 172.21.15.81:0/2628815925 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7d980cc900 con 0x7f7da8100fb0 2024-05-09T00:01:51.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.804+0000 7f7dad5e3700 1 --2- 172.21.15.81:0/2628815925 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f7d940a1120 0x7f7d940a35e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7da400b5c0 tx=0x7f7da4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:51.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:51.807+0000 7f7d9e7fc700 1 -- 172.21.15.81:0/2628815925 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7d980961e0 con 0x7f7da8100fb0 2024-05-09T00:01:52.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.043+0000 7f7daf847700 1 -- 172.21.15.81:0/2628815925 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7da8067cc0 con 0x7f7d940a1120 2024-05-09T00:01:52.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.047+0000 7f7d9e7fc700 1 -- 172.21.15.81:0/2628815925 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f7da8067cc0 con 0x7f7d940a1120 2024-05-09T00:01:52.042 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/qa/sv_1/a571f237-cd1d-4fcd-8d62-a529e0096d24 2024-05-09T00:01:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.049+0000 7f7daf847700 1 -- 172.21.15.81:0/2628815925 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f7d940a1120 msgr2=0x7f7d940a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.049+0000 7f7daf847700 1 --2- 172.21.15.81:0/2628815925 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f7d940a1120 0x7f7d940a35e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7da400b5c0 tx=0x7f7da4005fb0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.049+0000 7f7daf847700 1 -- 172.21.15.81:0/2628815925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da8100fb0 msgr2=0x7f7da8108d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.049+0000 7f7daf847700 1 --2- 172.21.15.81:0/2628815925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da8100fb0 0x7f7da8108d80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800b530 tx=0x7f7d9800b8f0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.049+0000 7f7daf847700 1 -- 172.21.15.81:0/2628815925 shutdown_connections 2024-05-09T00:01:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.049+0000 7f7daf847700 1 --2- 172.21.15.81:0/2628815925 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f7d940a1120 0x7f7d940a35e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.049+0000 7f7daf847700 1 --2- 172.21.15.81:0/2628815925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7da80ffe60 0x7f7da810a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.049+0000 7f7daf847700 1 --2- 172.21.15.81:0/2628815925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7da8101970 0x7f7da81092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.049+0000 7f7daf847700 1 --2- 172.21.15.81:0/2628815925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7da8100fb0 0x7f7da8108d80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.049+0000 7f7daf847700 1 -- 172.21.15.81:0/2628815925 >> 172.21.15.81:0/2628815925 conn(0x7f7da80fb3f0 msgr2=0x7f7da8104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.049+0000 7f7daf847700 1 -- 172.21.15.81:0/2628815925 shutdown_connections 2024-05-09T00:01:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.049+0000 7f7daf847700 1 -- 172.21.15.81:0/2628815925 wait complete. 2024-05-09T00:01:52.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:01:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 -- 172.21.15.81:0/2495779695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0114101990 msgr2=0x7f0114103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 --2- 172.21.15.81:0/2495779695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0114101990 0x7f0114103d80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0108009990 tx=0x7f0108009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 -- 172.21.15.81:0/2495779695 shutdown_connections 2024-05-09T00:01:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 --2- 172.21.15.81:0/2495779695 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0114106bf0 0x7f0114108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 --2- 172.21.15.81:0/2495779695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0114101990 0x7f0114103d80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 --2- 172.21.15.81:0/2495779695 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01141042c0 0x7f01141066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 -- 172.21.15.81:0/2495779695 >> 172.21.15.81:0/2495779695 conn(0x7f01140fb300 msgr2=0x7f01140fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 -- 172.21.15.81:0/2495779695 shutdown_connections 2024-05-09T00:01:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 -- 172.21.15.81:0/2495779695 wait complete. 2024-05-09T00:01:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 Processor -- start 2024-05-09T00:01:52.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 -- start start 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0114101990 0x7f0114196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01141042c0 0x7f01141972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0114106bf0 0x7f011419e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011419e8d0 con 0x7f0114101990 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011419ea10 con 0x7f01141042c0 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.186+0000 7f011b130700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f011419eba0 con 0x7f0114106bf0 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f0118ecc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0114101990 0x7f0114196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f0118ecc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0114101990 0x7f0114196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48456/0 (socket says 172.21.15.81:48456) 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f0118ecc700 1 -- 172.21.15.81:0/3079699174 learned_addr learned my addr 172.21.15.81:0/3079699174 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f0113fff700 1 --2- 172.21.15.81:0/3079699174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01141042c0 0x7f01141972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f01196cd700 1 --2- 172.21.15.81:0/3079699174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0114106bf0 0x7f011419e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f0118ecc700 1 -- 172.21.15.81:0/3079699174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0114106bf0 msgr2=0x7f011419e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f0118ecc700 1 --2- 172.21.15.81:0/3079699174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0114106bf0 0x7f011419e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f0118ecc700 1 -- 172.21.15.81:0/3079699174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01141042c0 msgr2=0x7f01141972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f0118ecc700 1 --2- 172.21.15.81:0/3079699174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01141042c0 0x7f01141972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f0118ecc700 1 -- 172.21.15.81:0/3079699174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01080095f0 con 0x7f0114101990 2024-05-09T00:01:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f0118ecc700 1 --2- 172.21.15.81:0/3079699174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0114101990 0x7f0114196da0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f01080095c0 tx=0x7f010800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f0111ffb700 1 -- 172.21.15.81:0/3079699174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010801d070 con 0x7f0114101990 2024-05-09T00:01:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f0111ffb700 1 -- 172.21.15.81:0/3079699174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0108005030 con 0x7f0114101990 2024-05-09T00:01:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f011b130700 1 -- 172.21.15.81:0/3079699174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f011419ee20 con 0x7f0114101990 2024-05-09T00:01:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f0111ffb700 1 -- 172.21.15.81:0/3079699174 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0108004b00 con 0x7f0114101990 2024-05-09T00:01:52.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.187+0000 7f011b130700 1 -- 172.21.15.81:0/3079699174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f011419f190 con 0x7f0114101990 2024-05-09T00:01:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.188+0000 7f011b130700 1 -- 172.21.15.81:0/3079699174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01140680d0 con 0x7f0114101990 2024-05-09T00:01:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.189+0000 7f0111ffb700 1 -- 172.21.15.81:0/3079699174 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0108005410 con 0x7f0114101990 2024-05-09T00:01:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.190+0000 7f0111ffb700 1 --2- 172.21.15.81:0/3079699174 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f01040a11b0 0x7f01040a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.190+0000 7f0113fff700 1 --2- 172.21.15.81:0/3079699174 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f01040a11b0 0x7f01040a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.190+0000 7f0111ffb700 1 -- 172.21.15.81:0/3079699174 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f01080cd770 con 0x7f0114101990 2024-05-09T00:01:52.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.190+0000 7f0113fff700 1 --2- 172.21.15.81:0/3079699174 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f01040a11b0 0x7f01040a3670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0100005950 tx=0x7f010000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:52.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.194+0000 7f0111ffb700 1 -- 172.21.15.81:0/3079699174 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f01140680d0 con 0x7f0114101990 2024-05-09T00:01:52.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:52 smithi081 ceph-mon[42474]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:52.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:52 smithi081 ceph-mon[42474]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:52.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.437+0000 7f011b130700 1 -- 172.21.15.81:0/3079699174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0114068060 con 0x7f0114101990 2024-05-09T00:01:52.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.438+0000 7f0111ffb700 1 -- 172.21.15.81:0/3079699174 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10864 (secure 0 0 0) 0x7f0108096fe0 con 0x7f0114101990 2024-05-09T00:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:52.433 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:01:50.053948+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:01:52.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.440+0000 7f011b130700 1 -- 172.21.15.81:0/3079699174 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f01040a11b0 msgr2=0x7f01040a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.440+0000 7f011b130700 1 --2- 172.21.15.81:0/3079699174 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f01040a11b0 0x7f01040a3670 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0100005950 tx=0x7f010000b410 comp rx=0 tx=0).stop 2024-05-09T00:01:52.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.440+0000 7f011b130700 1 -- 172.21.15.81:0/3079699174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0114101990 msgr2=0x7f0114196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.440+0000 7f011b130700 1 --2- 172.21.15.81:0/3079699174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0114101990 0x7f0114196da0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f01080095c0 tx=0x7f010800f690 comp rx=0 tx=0).stop 2024-05-09T00:01:52.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.440+0000 7f011b130700 1 -- 172.21.15.81:0/3079699174 shutdown_connections 2024-05-09T00:01:52.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.440+0000 7f011b130700 1 --2- 172.21.15.81:0/3079699174 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f01040a11b0 0x7f01040a3670 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.440+0000 7f011b130700 1 --2- 172.21.15.81:0/3079699174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0114106bf0 0x7f011419e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.440+0000 7f011b130700 1 --2- 172.21.15.81:0/3079699174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0114101990 0x7f0114196da0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.440+0000 7f011b130700 1 --2- 172.21.15.81:0/3079699174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01141042c0 0x7f01141972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.440+0000 7f011b130700 1 -- 172.21.15.81:0/3079699174 >> 172.21.15.81:0/3079699174 conn(0x7f01140fb300 msgr2=0x7f01141024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:52.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.440+0000 7f011b130700 1 -- 172.21.15.81:0/3079699174 shutdown_connections 2024-05-09T00:01:52.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.440+0000 7f011b130700 1 -- 172.21.15.81:0/3079699174 wait complete. 2024-05-09T00:01:52.437 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-05-09T00:01:52.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:01:52.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:52 smithi150 ceph-mon[46187]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:52.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:52 smithi150 ceph-mon[46187]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:52.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:52 smithi171 ceph-mon[47351]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:52.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:52 smithi171 ceph-mon[47351]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:52.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.575+0000 7f77b2ab9700 1 -- 172.21.15.81:0/2181192633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ac1018f0 msgr2=0x7f77ac1081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.575+0000 7f77b2ab9700 1 --2- 172.21.15.81:0/2181192633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ac1018f0 0x7f77ac1081a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f77a400b0d0 tx=0x7f77a400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.575+0000 7f77b2ab9700 1 -- 172.21.15.81:0/2181192633 shutdown_connections 2024-05-09T00:01:52.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.575+0000 7f77b2ab9700 1 --2- 172.21.15.81:0/2181192633 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ac1018f0 0x7f77ac1081a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.575+0000 7f77b2ab9700 1 --2- 172.21.15.81:0/2181192633 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77ac0ffd60 0x7f77ac100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.575+0000 7f77b2ab9700 1 --2- 172.21.15.81:0/2181192633 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77ac100f50 0x7f77ac1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.575+0000 7f77b2ab9700 1 -- 172.21.15.81:0/2181192633 >> 172.21.15.81:0/2181192633 conn(0x7f77ac0fb2f0 msgr2=0x7f77ac0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:52.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.575+0000 7f77b2ab9700 1 -- 172.21.15.81:0/2181192633 shutdown_connections 2024-05-09T00:01:52.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.575+0000 7f77b2ab9700 1 -- 172.21.15.81:0/2181192633 wait complete. 2024-05-09T00:01:52.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b2ab9700 1 Processor -- start 2024-05-09T00:01:52.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b2ab9700 1 -- start start 2024-05-09T00:01:52.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b2ab9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ac0ffd60 0x7f77ac196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:52.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b2ab9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77ac100f50 0x7f77ac1974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:52.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b2ab9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77ac1018f0 0x7f77ac19e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:52.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b2ab9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac19ea50 con 0x7f77ac0ffd60 2024-05-09T00:01:52.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b2ab9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac19eb90 con 0x7f77ac100f50 2024-05-09T00:01:52.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b2ab9700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac19ed20 con 0x7f77ac1018f0 2024-05-09T00:01:52.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b0855700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ac0ffd60 0x7f77ac196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:52.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b0855700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ac0ffd60 0x7f77ac196f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48476/0 (socket says 172.21.15.81:48476) 2024-05-09T00:01:52.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b0855700 1 -- 172.21.15.81:0/1538000357 learned_addr learned my addr 172.21.15.81:0/1538000357 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:52.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77abfff700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77ac100f50 0x7f77ac1974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:52.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b1056700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77ac1018f0 0x7f77ac19e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:52.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b0855700 1 -- 172.21.15.81:0/1538000357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77ac1018f0 msgr2=0x7f77ac19e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b0855700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77ac1018f0 0x7f77ac19e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b0855700 1 -- 172.21.15.81:0/1538000357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77ac100f50 msgr2=0x7f77ac1974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b0855700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77ac100f50 0x7f77ac1974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b0855700 1 -- 172.21.15.81:0/1538000357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a4009d00 con 0x7f77ac0ffd60 2024-05-09T00:01:52.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77abfff700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77ac100f50 0x7f77ac1974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:52.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.576+0000 7f77b0855700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ac0ffd60 0x7f77ac196f70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f77a000c970 tx=0x7f77a000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:52.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.577+0000 7f77a9ffb700 1 -- 172.21.15.81:0/1538000357 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0004220 con 0x7f77ac0ffd60 2024-05-09T00:01:52.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.577+0000 7f77a9ffb700 1 -- 172.21.15.81:0/1538000357 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77a0007d60 con 0x7f77ac0ffd60 2024-05-09T00:01:52.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.577+0000 7f77b2ab9700 1 -- 172.21.15.81:0/1538000357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ac19efa0 con 0x7f77ac0ffd60 2024-05-09T00:01:52.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.577+0000 7f77a9ffb700 1 -- 172.21.15.81:0/1538000357 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0003d00 con 0x7f77ac0ffd60 2024-05-09T00:01:52.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.577+0000 7f77b2ab9700 1 -- 172.21.15.81:0/1538000357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ac19f4a0 con 0x7f77ac0ffd60 2024-05-09T00:01:52.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.578+0000 7f77b2ab9700 1 -- 172.21.15.81:0/1538000357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ac067c10 con 0x7f77ac0ffd60 2024-05-09T00:01:52.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.579+0000 7f77a9ffb700 1 -- 172.21.15.81:0/1538000357 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f77a0004380 con 0x7f77ac0ffd60 2024-05-09T00:01:52.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.579+0000 7f77a9ffb700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f779c0a11b0 0x7f779c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:52.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.579+0000 7f77abfff700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f779c0a11b0 0x7f779c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:52.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.579+0000 7f77a9ffb700 1 -- 172.21.15.81:0/1538000357 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f77a00cc880 con 0x7f77ac0ffd60 2024-05-09T00:01:52.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.580+0000 7f77abfff700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f779c0a11b0 0x7f779c0a3670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f77980099d0 tx=0x7f7798008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:52.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.584+0000 7f77a9ffb700 1 -- 172.21.15.81:0/1538000357 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f77a0096060 con 0x7f77ac0ffd60 2024-05-09T00:01:52.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.785+0000 7f77b2ab9700 1 -- 172.21.15.81:0/1538000357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77ac10b8a0 con 0x7f77ac0ffd60 2024-05-09T00:01:52.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.786+0000 7f77a9ffb700 1 -- 172.21.15.81:0/1538000357 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22095 (secure 0 0 0) 0x7f77a001d090 con 0x7f77ac0ffd60 2024-05-09T00:01:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:52.782 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":79,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:01:46.020465+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:01:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.788+0000 7f77b2ab9700 1 -- 172.21.15.81:0/1538000357 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f779c0a11b0 msgr2=0x7f779c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.788+0000 7f77b2ab9700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f779c0a11b0 0x7f779c0a3670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f77980099d0 tx=0x7f7798008040 comp rx=0 tx=0).stop 2024-05-09T00:01:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.788+0000 7f77b2ab9700 1 -- 172.21.15.81:0/1538000357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ac0ffd60 msgr2=0x7f77ac196f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.788+0000 7f77b2ab9700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ac0ffd60 0x7f77ac196f70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f77a000c970 tx=0x7f77a000cd30 comp rx=0 tx=0).stop 2024-05-09T00:01:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.789+0000 7f77b2ab9700 1 -- 172.21.15.81:0/1538000357 shutdown_connections 2024-05-09T00:01:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.789+0000 7f77b2ab9700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f779c0a11b0 0x7f779c0a3670 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.789+0000 7f77b2ab9700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77ac1018f0 0x7f77ac19e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.789+0000 7f77b2ab9700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ac0ffd60 0x7f77ac196f70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.789+0000 7f77b2ab9700 1 --2- 172.21.15.81:0/1538000357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77ac100f50 0x7f77ac1974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.789+0000 7f77b2ab9700 1 -- 172.21.15.81:0/1538000357 >> 172.21.15.81:0/1538000357 conn(0x7f77ac0fb2f0 msgr2=0x7f77ac0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.789+0000 7f77b2ab9700 1 -- 172.21.15.81:0/1538000357 shutdown_connections 2024-05-09T00:01:52.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.789+0000 7f77b2ab9700 1 -- 172.21.15.81:0/1538000357 wait complete. 2024-05-09T00:01:52.796 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-09T00:01:52.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:01:52.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.924+0000 7f4f650e4700 1 -- 172.21.15.81:0/1649203474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f60100e70 msgr2=0x7f4f60101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.924+0000 7f4f650e4700 1 --2- 172.21.15.81:0/1649203474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f60100e70 0x7f4f60101290 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009990 tx=0x7f4f54009ca0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.924+0000 7f4f650e4700 1 -- 172.21.15.81:0/1649203474 shutdown_connections 2024-05-09T00:01:52.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.924+0000 7f4f650e4700 1 --2- 172.21.15.81:0/1649203474 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f60102980 0x7f4f601092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.924+0000 7f4f650e4700 1 --2- 172.21.15.81:0/1649203474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f60100e70 0x7f4f60101290 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.924+0000 7f4f650e4700 1 --2- 172.21.15.81:0/1649203474 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f60101fc0 0x7f4f60102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.924+0000 7f4f650e4700 1 -- 172.21.15.81:0/1649203474 >> 172.21.15.81:0/1649203474 conn(0x7f4f600fc400 msgr2=0x7f4f600fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:52.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.924+0000 7f4f650e4700 1 -- 172.21.15.81:0/1649203474 shutdown_connections 2024-05-09T00:01:52.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.924+0000 7f4f650e4700 1 -- 172.21.15.81:0/1649203474 wait complete. 2024-05-09T00:01:52.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.924+0000 7f4f650e4700 1 Processor -- start 2024-05-09T00:01:52.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f650e4700 1 -- start start 2024-05-09T00:01:52.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f650e4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f60100e70 0x7f4f60074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:52.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f650e4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f60101fc0 0x7f4f60073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:52.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f650e4700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f60102980 0x7f4f600738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:52.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f650e4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f60074070 con 0x7f4f60101fc0 2024-05-09T00:01:52.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f650e4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f600741e0 con 0x7f4f60100e70 2024-05-09T00:01:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f650e4700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f601a0da0 con 0x7f4f60102980 2024-05-09T00:01:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f5e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f60101fc0 0x7f4f60073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f5e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f60101fc0 0x7f4f60073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48496/0 (socket says 172.21.15.81:48496) 2024-05-09T00:01:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f5e59c700 1 -- 172.21.15.81:0/656434735 learned_addr learned my addr 172.21.15.81:0/656434735 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f5ed9d700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f60100e70 0x7f4f60074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f5f59e700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f60102980 0x7f4f600738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f5e59c700 1 -- 172.21.15.81:0/656434735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f60102980 msgr2=0x7f4f600738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f5e59c700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f60102980 0x7f4f600738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f5e59c700 1 -- 172.21.15.81:0/656434735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f60100e70 msgr2=0x7f4f60074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f5e59c700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f60100e70 0x7f4f60074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f5e59c700 1 -- 172.21.15.81:0/656434735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f540095f0 con 0x7f4f60101fc0 2024-05-09T00:01:52.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f5f59e700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f60102980 0x7f4f600738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.925+0000 7f4f5e59c700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f60101fc0 0x7f4f60073390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000c9b0 tx=0x7f4f5000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.926+0000 7f4f47fff700 1 -- 172.21.15.81:0/656434735 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50007aa0 con 0x7f4f60101fc0 2024-05-09T00:01:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.926+0000 7f4f47fff700 1 -- 172.21.15.81:0/656434735 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f50007c00 con 0x7f4f60101fc0 2024-05-09T00:01:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.926+0000 7f4f650e4700 1 -- 172.21.15.81:0/656434735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f601a0fd0 con 0x7f4f60101fc0 2024-05-09T00:01:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.926+0000 7f4f47fff700 1 -- 172.21.15.81:0/656434735 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f50018660 con 0x7f4f60101fc0 2024-05-09T00:01:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.926+0000 7f4f650e4700 1 -- 172.21.15.81:0/656434735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f601a14b0 con 0x7f4f60101fc0 2024-05-09T00:01:52.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.927+0000 7f4f650e4700 1 -- 172.21.15.81:0/656434735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f60108210 con 0x7f4f60101fc0 2024-05-09T00:01:52.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.928+0000 7f4f47fff700 1 -- 172.21.15.81:0/656434735 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f4f5000f450 con 0x7f4f60101fc0 2024-05-09T00:01:52.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.928+0000 7f4f47fff700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f4f480a1230 0x7f4f480a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:52.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.928+0000 7f4f5ed9d700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f4f480a1230 0x7f4f480a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:52.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.928+0000 7f4f47fff700 1 -- 172.21.15.81:0/656434735 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4f500ccb80 con 0x7f4f60101fc0 2024-05-09T00:01:52.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.929+0000 7f4f5ed9d700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f4f480a1230 0x7f4f480a36f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400b5c0 tx=0x7f4f54003790 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:52.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:52.932+0000 7f4f47fff700 1 -- 172.21.15.81:0/656434735 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4f500962f0 con 0x7f4f60101fc0 2024-05-09T00:01:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.131+0000 7f4f650e4700 1 -- 172.21.15.81:0/656434735 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f6002ceb0 con 0x7f4f480a1230 2024-05-09T00:01:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.141+0000 7f4f47fff700 1 -- 172.21.15.81:0/656434735 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+328372 (secure 0 0 0) 0x7f4f6002ceb0 con 0x7f4f480a1230 2024-05-09T00:01:53.141 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.144+0000 7f4f650e4700 1 -- 172.21.15.81:0/656434735 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f4f480a1230 msgr2=0x7f4f480a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.144+0000 7f4f650e4700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f4f480a1230 0x7f4f480a36f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400b5c0 tx=0x7f4f54003790 comp rx=0 tx=0).stop 2024-05-09T00:01:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.144+0000 7f4f650e4700 1 -- 172.21.15.81:0/656434735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f60101fc0 msgr2=0x7f4f60073390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.144+0000 7f4f650e4700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f60101fc0 0x7f4f60073390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000c9b0 tx=0x7f4f5000ccc0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.145+0000 7f4f650e4700 1 -- 172.21.15.81:0/656434735 shutdown_connections 2024-05-09T00:01:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.145+0000 7f4f650e4700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f4f480a1230 0x7f4f480a36f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.145+0000 7f4f650e4700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4f60100e70 0x7f4f60074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.145+0000 7f4f650e4700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4f60102980 0x7f4f600738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.145+0000 7f4f650e4700 1 --2- 172.21.15.81:0/656434735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f60101fc0 0x7f4f60073390 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.145+0000 7f4f650e4700 1 -- 172.21.15.81:0/656434735 >> 172.21.15.81:0/656434735 conn(0x7f4f600fc400 msgr2=0x7f4f60105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.145+0000 7f4f650e4700 1 -- 172.21.15.81:0/656434735 shutdown_connections 2024-05-09T00:01:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.145+0000 7f4f650e4700 1 -- 172.21.15.81:0/656434735 wait complete. 2024-05-09T00:01:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-09T00:01:53.152 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-05-09T00:01:52.269923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595265,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":148,"num_read_kb":129,"num_write":293,"num_write_kb":2975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":252,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375428,"kb_used_data":10244,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124566396,"statfs":{"total":1151940427776,"available":1151555989504,"internally_reserved":0,"allocated":10489856,"data_stored":6698690,"data_compressed":106908,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19131,"internal_metadata":373798213},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4897,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.668532"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850421+0000","last_change":"2024-05-09T00:01:45.048606+0000","last_active":"2024-05-09T00:01:46.850421+0000","last_peered":"2024-05-09T00:01:46.850421+0000","last_clean":"2024-05-09T00:01:46.850421+0000","last_became_active":"2024-05-09T00:01:45.047691+0000","last_became_peered":"2024-05-09T00:01:45.047691+0000","last_unstale":"2024-05-09T00:01:46.850421+0000","last_undegraded":"2024-05-09T00:01:46.850421+0000","last_fullsized":"2024-05-09T00:01:46.850421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:03.881912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088559+0000","last_change":"2024-05-09T00:01:45.046812+0000","last_active":"2024-05-09T00:01:47.088559+0000","last_peered":"2024-05-09T00:01:47.088559+0000","last_clean":"2024-05-09T00:01:47.088559+0000","last_became_active":"2024-05-09T00:01:45.046510+0000","last_became_peered":"2024-05-09T00:01:45.046510+0000","last_unstale":"2024-05-09T00:01:47.088559+0000","last_undegraded":"2024-05-09T00:01:47.088559+0000","last_fullsized":"2024-05-09T00:01:47.088559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:03.614974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088767+0000","last_change":"2024-05-09T00:01:45.040304+0000","last_active":"2024-05-09T00:01:47.088767+0000","last_peered":"2024-05-09T00:01:47.088767+0000","last_clean":"2024-05-09T00:01:47.088767+0000","last_became_active":"2024-05-09T00:01:45.039990+0000","last_became_peered":"2024-05-09T00:01:45.039990+0000","last_unstale":"2024-05-09T00:01:47.088767+0000","last_undegraded":"2024-05-09T00:01:47.088767+0000","last_fullsized":"2024-05-09T00:01:47.088767+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:17:33.563999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089069+0000","last_change":"2024-05-09T00:01:45.040528+0000","last_active":"2024-05-09T00:01:47.089069+0000","last_peered":"2024-05-09T00:01:47.089069+0000","last_clean":"2024-05-09T00:01:47.089069+0000","last_became_active":"2024-05-09T00:01:45.040100+0000","last_became_peered":"2024-05-09T00:01:45.040100+0000","last_unstale":"2024-05-09T00:01:47.089069+0000","last_undegraded":"2024-05-09T00:01:47.089069+0000","last_fullsized":"2024-05-09T00:01:47.089069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:02.739346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327560+0000","last_change":"2024-05-09T00:01:45.036192+0000","last_active":"2024-05-09T00:01:45.327560+0000","last_peered":"2024-05-09T00:01:45.327560+0000","last_clean":"2024-05-09T00:01:45.327560+0000","last_became_active":"2024-05-09T00:01:45.035845+0000","last_became_peered":"2024-05-09T00:01:45.035845+0000","last_unstale":"2024-05-09T00:01:45.327560+0000","last_undegraded":"2024-05-09T00:01:45.327560+0000","last_fullsized":"2024-05-09T00:01:45.327560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:25.494946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089254+0000","last_change":"2024-05-09T00:01:45.047866+0000","last_active":"2024-05-09T00:01:47.089254+0000","last_peered":"2024-05-09T00:01:47.089254+0000","last_clean":"2024-05-09T00:01:47.089254+0000","last_became_active":"2024-05-09T00:01:45.047549+0000","last_became_peered":"2024-05-09T00:01:45.047549+0000","last_unstale":"2024-05-09T00:01:47.089254+0000","last_undegraded":"2024-05-09T00:01:47.089254+0000","last_fullsized":"2024-05-09T00:01:47.089254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:34:33.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325076+0000","last_change":"2024-05-09T00:01:45.054246+0000","last_active":"2024-05-09T00:01:46.325076+0000","last_peered":"2024-05-09T00:01:46.325076+0000","last_clean":"2024-05-09T00:01:46.325076+0000","last_became_active":"2024-05-09T00:01:45.053863+0000","last_became_peered":"2024-05-09T00:01:45.053863+0000","last_unstale":"2024-05-09T00:01:46.325076+0000","last_undegraded":"2024-05-09T00:01:46.325076+0000","last_fullsized":"2024-05-09T00:01:46.325076+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:12.080139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187184+0000","last_change":"2024-05-09T00:01:45.053747+0000","last_active":"2024-05-09T00:01:45.187184+0000","last_peered":"2024-05-09T00:01:45.187184+0000","last_clean":"2024-05-09T00:01:45.187184+0000","last_became_active":"2024-05-09T00:01:45.053461+0000","last_became_peered":"2024-05-09T00:01:45.053461+0000","last_unstale":"2024-05-09T00:01:45.187184+0000","last_undegraded":"2024-05-09T00:01:45.187184+0000","last_fullsized":"2024-05-09T00:01:45.187184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:30.018296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029785+0000","last_change":"2024-05-09T00:01:45.053851+0000","last_active":"2024-05-09T00:01:46.029785+0000","last_peered":"2024-05-09T00:01:46.029785+0000","last_clean":"2024-05-09T00:01:46.029785+0000","last_became_active":"2024-05-09T00:01:45.053471+0000","last_became_peered":"2024-05-09T00:01:45.053471+0000","last_unstale":"2024-05-09T00:01:46.029785+0000","last_undegraded":"2024-05-09T00:01:46.029785+0000","last_fullsized":"2024-05-09T00:01:46.029785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:25.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089793+0000","last_change":"2024-05-09T00:01:45.048916+0000","last_active":"2024-05-09T00:01:47.089793+0000","last_peered":"2024-05-09T00:01:47.089793+0000","last_clean":"2024-05-09T00:01:47.089793+0000","last_became_active":"2024-05-09T00:01:45.048227+0000","last_became_peered":"2024-05-09T00:01:45.048227+0000","last_unstale":"2024-05-09T00:01:47.089793+0000","last_undegraded":"2024-05-09T00:01:47.089793+0000","last_fullsized":"2024-05-09T00:01:47.089793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:51.246933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325183+0000","last_change":"2024-05-09T00:01:45.053449+0000","last_active":"2024-05-09T00:01:46.325183+0000","last_peered":"2024-05-09T00:01:46.325183+0000","last_clean":"2024-05-09T00:01:46.325183+0000","last_became_active":"2024-05-09T00:01:45.053060+0000","last_became_peered":"2024-05-09T00:01:45.053060+0000","last_unstale":"2024-05-09T00:01:46.325183+0000","last_undegraded":"2024-05-09T00:01:46.325183+0000","last_fullsized":"2024-05-09T00:01:46.325183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:21.236565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088953+0000","last_change":"2024-05-09T00:01:45.047231+0000","last_active":"2024-05-09T00:01:47.088953+0000","last_peered":"2024-05-09T00:01:47.088953+0000","last_clean":"2024-05-09T00:01:47.088953+0000","last_became_active":"2024-05-09T00:01:45.046897+0000","last_became_peered":"2024-05-09T00:01:45.046897+0000","last_unstale":"2024-05-09T00:01:47.088953+0000","last_undegraded":"2024-05-09T00:01:47.088953+0000","last_fullsized":"2024-05-09T00:01:47.088953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:13.307931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028948+0000","last_change":"2024-05-09T00:01:45.048545+0000","last_active":"2024-05-09T00:01:46.028948+0000","last_peered":"2024-05-09T00:01:46.028948+0000","last_clean":"2024-05-09T00:01:46.028948+0000","last_became_active":"2024-05-09T00:01:45.048237+0000","last_became_peered":"2024-05-09T00:01:45.048237+0000","last_unstale":"2024-05-09T00:01:46.028948+0000","last_undegraded":"2024-05-09T00:01:46.028948+0000","last_fullsized":"2024-05-09T00:01:46.028948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:45:41.578704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089031+0000","last_change":"2024-05-09T00:01:45.046735+0000","last_active":"2024-05-09T00:01:47.089031+0000","last_peered":"2024-05-09T00:01:47.089031+0000","last_clean":"2024-05-09T00:01:47.089031+0000","last_became_active":"2024-05-09T00:01:45.046441+0000","last_became_peered":"2024-05-09T00:01:45.046441+0000","last_unstale":"2024-05-09T00:01:47.089031+0000","last_undegraded":"2024-05-09T00:01:47.089031+0000","last_fullsized":"2024-05-09T00:01:47.089031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:51.380665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088074+0000","last_change":"2024-05-09T00:01:45.036289+0000","last_active":"2024-05-09T00:01:47.088074+0000","last_peered":"2024-05-09T00:01:47.088074+0000","last_clean":"2024-05-09T00:01:47.088074+0000","last_became_active":"2024-05-09T00:01:45.035996+0000","last_became_peered":"2024-05-09T00:01:45.035996+0000","last_unstale":"2024-05-09T00:01:47.088074+0000","last_undegraded":"2024-05-09T00:01:47.088074+0000","last_fullsized":"2024-05-09T00:01:47.088074+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:52.769668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029327+0000","last_change":"2024-05-09T00:01:45.044908+0000","last_active":"2024-05-09T00:01:46.029327+0000","last_peered":"2024-05-09T00:01:46.029327+0000","last_clean":"2024-05-09T00:01:46.029327+0000","last_became_active":"2024-05-09T00:01:45.044508+0000","last_became_peered":"2024-05-09T00:01:45.044508+0000","last_unstale":"2024-05-09T00:01:46.029327+0000","last_undegraded":"2024-05-09T00:01:46.029327+0000","last_fullsized":"2024-05-09T00:01:46.029327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:02:23.578743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850564+0000","last_change":"2024-05-09T00:01:45.048389+0000","last_active":"2024-05-09T00:01:46.850564+0000","last_peered":"2024-05-09T00:01:46.850564+0000","last_clean":"2024-05-09T00:01:46.850564+0000","last_became_active":"2024-05-09T00:01:45.047959+0000","last_became_peered":"2024-05-09T00:01:45.047959+0000","last_unstale":"2024-05-09T00:01:46.850564+0000","last_undegraded":"2024-05-09T00:01:46.850564+0000","last_fullsized":"2024-05-09T00:01:46.850564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:44.298296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089171+0000","last_change":"2024-05-09T00:01:45.048314+0000","last_active":"2024-05-09T00:01:47.089171+0000","last_peered":"2024-05-09T00:01:47.089171+0000","last_clean":"2024-05-09T00:01:47.089171+0000","last_became_active":"2024-05-09T00:01:45.048002+0000","last_became_peered":"2024-05-09T00:01:45.048002+0000","last_unstale":"2024-05-09T00:01:47.089171+0000","last_undegraded":"2024-05-09T00:01:47.089171+0000","last_fullsized":"2024-05-09T00:01:47.089171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:36.327498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039835+0000","last_change":"2024-05-09T00:01:45.035747+0000","last_active":"2024-05-09T00:01:47.039835+0000","last_peered":"2024-05-09T00:01:47.039835+0000","last_clean":"2024-05-09T00:01:47.039835+0000","last_became_active":"2024-05-09T00:01:45.035122+0000","last_became_peered":"2024-05-09T00:01:45.035122+0000","last_unstale":"2024-05-09T00:01:47.039835+0000","last_undegraded":"2024-05-09T00:01:47.039835+0000","last_fullsized":"2024-05-09T00:01:47.039835+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:21.361033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"78'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088782+0000","last_change":"2024-05-09T00:01:44.620816+0000","last_active":"2024-05-09T00:01:47.088782+0000","last_peered":"2024-05-09T00:01:47.088782+0000","last_clean":"2024-05-09T00:01:47.088782+0000","last_became_active":"2024-05-09T00:01:44.620524+0000","last_became_peered":"2024-05-09T00:01:44.620524+0000","last_unstale":"2024-05-09T00:01:47.088782+0000","last_undegraded":"2024-05-09T00:01:47.088782+0000","last_fullsized":"2024-05-09T00:01:47.088782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:05.623111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187261+0000","last_change":"2024-05-09T00:01:45.049115+0000","last_active":"2024-05-09T00:01:45.187261+0000","last_peered":"2024-05-09T00:01:45.187261+0000","last_clean":"2024-05-09T00:01:45.187261+0000","last_became_active":"2024-05-09T00:01:45.048825+0000","last_became_peered":"2024-05-09T00:01:45.048825+0000","last_unstale":"2024-05-09T00:01:45.187261+0000","last_undegraded":"2024-05-09T00:01:45.187261+0000","last_fullsized":"2024-05-09T00:01:45.187261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:09:29.890090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088914+0000","last_change":"2024-05-09T00:01:44.621711+0000","last_active":"2024-05-09T00:01:47.088914+0000","last_peered":"2024-05-09T00:01:47.088914+0000","last_clean":"2024-05-09T00:01:47.088914+0000","last_became_active":"2024-05-09T00:01:44.621433+0000","last_became_peered":"2024-05-09T00:01:44.621433+0000","last_unstale":"2024-05-09T00:01:47.088914+0000","last_undegraded":"2024-05-09T00:01:47.088914+0000","last_fullsized":"2024-05-09T00:01:47.088914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:57.451467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088944+0000","last_change":"2024-05-09T00:01:45.038415+0000","last_active":"2024-05-09T00:01:47.088944+0000","last_peered":"2024-05-09T00:01:47.088944+0000","last_clean":"2024-05-09T00:01:47.088944+0000","last_became_active":"2024-05-09T00:01:45.038141+0000","last_became_peered":"2024-05-09T00:01:45.038141+0000","last_unstale":"2024-05-09T00:01:47.088944+0000","last_undegraded":"2024-05-09T00:01:47.088944+0000","last_fullsized":"2024-05-09T00:01:47.088944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:37.772886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.055486+0000","last_change":"2024-05-09T00:01:44.622505+0000","last_active":"2024-05-09T00:01:49.055486+0000","last_peered":"2024-05-09T00:01:49.055486+0000","last_clean":"2024-05-09T00:01:49.055486+0000","last_became_active":"2024-05-09T00:01:44.622120+0000","last_became_peered":"2024-05-09T00:01:44.622120+0000","last_unstale":"2024-05-09T00:01:49.055486+0000","last_undegraded":"2024-05-09T00:01:49.055486+0000","last_fullsized":"2024-05-09T00:01:49.055486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:15.937946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029518+0000","last_change":"2024-05-09T00:01:45.048553+0000","last_active":"2024-05-09T00:01:46.029518+0000","last_peered":"2024-05-09T00:01:46.029518+0000","last_clean":"2024-05-09T00:01:46.029518+0000","last_became_active":"2024-05-09T00:01:45.046659+0000","last_became_peered":"2024-05-09T00:01:45.046659+0000","last_unstale":"2024-05-09T00:01:46.029518+0000","last_undegraded":"2024-05-09T00:01:46.029518+0000","last_fullsized":"2024-05-09T00:01:46.029518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:19.581843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327593+0000","last_change":"2024-05-09T00:01:44.614820+0000","last_active":"2024-05-09T00:01:45.327593+0000","last_peered":"2024-05-09T00:01:45.327593+0000","last_clean":"2024-05-09T00:01:45.327593+0000","last_became_active":"2024-05-09T00:01:44.614418+0000","last_became_peered":"2024-05-09T00:01:44.614418+0000","last_unstale":"2024-05-09T00:01:45.327593+0000","last_undegraded":"2024-05-09T00:01:45.327593+0000","last_fullsized":"2024-05-09T00:01:45.327593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:18.133098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029467+0000","last_change":"2024-05-09T00:01:45.058377+0000","last_active":"2024-05-09T00:01:46.029467+0000","last_peered":"2024-05-09T00:01:46.029467+0000","last_clean":"2024-05-09T00:01:46.029467+0000","last_became_active":"2024-05-09T00:01:45.057991+0000","last_became_peered":"2024-05-09T00:01:45.057991+0000","last_unstale":"2024-05-09T00:01:46.029467+0000","last_undegraded":"2024-05-09T00:01:46.029467+0000","last_fullsized":"2024-05-09T00:01:46.029467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:14.102698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:51.066979+0000","last_change":"2024-05-09T00:01:44.619347+0000","last_active":"2024-05-09T00:01:51.066979+0000","last_peered":"2024-05-09T00:01:51.066979+0000","last_clean":"2024-05-09T00:01:51.066979+0000","last_became_active":"2024-05-09T00:01:44.618967+0000","last_became_peered":"2024-05-09T00:01:44.618967+0000","last_unstale":"2024-05-09T00:01:51.066979+0000","last_undegraded":"2024-05-09T00:01:51.066979+0000","last_fullsized":"2024-05-09T00:01:51.066979+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:10.434674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327548+0000","last_change":"2024-05-09T00:01:45.049365+0000","last_active":"2024-05-09T00:01:45.327548+0000","last_peered":"2024-05-09T00:01:45.327548+0000","last_clean":"2024-05-09T00:01:45.327548+0000","last_became_active":"2024-05-09T00:01:45.049037+0000","last_became_peered":"2024-05-09T00:01:45.049037+0000","last_unstale":"2024-05-09T00:01:45.327548+0000","last_undegraded":"2024-05-09T00:01:45.327548+0000","last_fullsized":"2024-05-09T00:01:45.327548+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:34.290672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.057967+0000","last_change":"2024-05-09T00:01:44.617212+0000","last_active":"2024-05-09T00:01:49.057967+0000","last_peered":"2024-05-09T00:01:49.057967+0000","last_clean":"2024-05-09T00:01:49.057967+0000","last_became_active":"2024-05-09T00:01:44.616898+0000","last_became_peered":"2024-05-09T00:01:44.616898+0000","last_unstale":"2024-05-09T00:01:49.057967+0000","last_undegraded":"2024-05-09T00:01:49.057967+0000","last_fullsized":"2024-05-09T00:01:49.057967+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:39.630039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029579+0000","last_change":"2024-05-09T00:01:45.058567+0000","last_active":"2024-05-09T00:01:46.029579+0000","last_peered":"2024-05-09T00:01:46.029579+0000","last_clean":"2024-05-09T00:01:46.029579+0000","last_became_active":"2024-05-09T00:01:45.058124+0000","last_became_peered":"2024-05-09T00:01:45.058124+0000","last_unstale":"2024-05-09T00:01:46.029579+0000","last_undegraded":"2024-05-09T00:01:46.029579+0000","last_fullsized":"2024-05-09T00:01:46.029579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:03.438029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.057886+0000","last_change":"2024-05-09T00:01:44.618214+0000","last_active":"2024-05-09T00:01:49.057886+0000","last_peered":"2024-05-09T00:01:49.057886+0000","last_clean":"2024-05-09T00:01:49.057886+0000","last_became_active":"2024-05-09T00:01:44.617769+0000","last_became_peered":"2024-05-09T00:01:44.617769+0000","last_unstale":"2024-05-09T00:01:49.057886+0000","last_undegraded":"2024-05-09T00:01:49.057886+0000","last_fullsized":"2024-05-09T00:01:49.057886+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:43.654597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187210+0000","last_change":"2024-05-09T00:01:45.037441+0000","last_active":"2024-05-09T00:01:45.187210+0000","last_peered":"2024-05-09T00:01:45.187210+0000","last_clean":"2024-05-09T00:01:45.187210+0000","last_became_active":"2024-05-09T00:01:45.036668+0000","last_became_peered":"2024-05-09T00:01:45.036668+0000","last_unstale":"2024-05-09T00:01:45.187210+0000","last_undegraded":"2024-05-09T00:01:45.187210+0000","last_fullsized":"2024-05-09T00:01:45.187210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:25.116685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.525580+0000","last_change":"2024-05-09T00:01:44.624973+0000","last_active":"2024-05-09T00:01:46.525580+0000","last_peered":"2024-05-09T00:01:46.525580+0000","last_clean":"2024-05-09T00:01:46.525580+0000","last_became_active":"2024-05-09T00:01:44.624470+0000","last_became_peered":"2024-05-09T00:01:44.624470+0000","last_unstale":"2024-05-09T00:01:46.525580+0000","last_undegraded":"2024-05-09T00:01:46.525580+0000","last_fullsized":"2024-05-09T00:01:46.525580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:22.021060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088654+0000","last_change":"2024-05-09T00:01:45.037414+0000","last_active":"2024-05-09T00:01:47.088654+0000","last_peered":"2024-05-09T00:01:47.088654+0000","last_clean":"2024-05-09T00:01:47.088654+0000","last_became_active":"2024-05-09T00:01:45.037095+0000","last_became_peered":"2024-05-09T00:01:45.037095+0000","last_unstale":"2024-05-09T00:01:47.088654+0000","last_undegraded":"2024-05-09T00:01:47.088654+0000","last_fullsized":"2024-05-09T00:01:47.088654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:29.812977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.049672+0000","last_change":"2024-05-09T00:01:44.614823+0000","last_active":"2024-05-09T00:01:48.049672+0000","last_peered":"2024-05-09T00:01:48.049672+0000","last_clean":"2024-05-09T00:01:48.049672+0000","last_became_active":"2024-05-09T00:01:44.614502+0000","last_became_peered":"2024-05-09T00:01:44.614502+0000","last_unstale":"2024-05-09T00:01:48.049672+0000","last_undegraded":"2024-05-09T00:01:48.049672+0000","last_fullsized":"2024-05-09T00:01:48.049672+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:14.486852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029787+0000","last_change":"2024-05-09T00:01:45.048631+0000","last_active":"2024-05-09T00:01:46.029787+0000","last_peered":"2024-05-09T00:01:46.029787+0000","last_clean":"2024-05-09T00:01:46.029787+0000","last_became_active":"2024-05-09T00:01:45.046691+0000","last_became_peered":"2024-05-09T00:01:45.046691+0000","last_unstale":"2024-05-09T00:01:46.029787+0000","last_undegraded":"2024-05-09T00:01:46.029787+0000","last_fullsized":"2024-05-09T00:01:46.029787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:59:35.017208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.049047+0000","last_change":"2024-05-09T00:01:44.622684+0000","last_active":"2024-05-09T00:01:48.049047+0000","last_peered":"2024-05-09T00:01:48.049047+0000","last_clean":"2024-05-09T00:01:48.049047+0000","last_became_active":"2024-05-09T00:01:44.622301+0000","last_became_peered":"2024-05-09T00:01:44.622301+0000","last_unstale":"2024-05-09T00:01:48.049047+0000","last_undegraded":"2024-05-09T00:01:48.049047+0000","last_fullsized":"2024-05-09T00:01:48.049047+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:38.343729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088905+0000","last_change":"2024-05-09T00:01:45.050240+0000","last_active":"2024-05-09T00:01:47.088905+0000","last_peered":"2024-05-09T00:01:47.088905+0000","last_clean":"2024-05-09T00:01:47.088905+0000","last_became_active":"2024-05-09T00:01:45.049955+0000","last_became_peered":"2024-05-09T00:01:45.049955+0000","last_unstale":"2024-05-09T00:01:47.088905+0000","last_undegraded":"2024-05-09T00:01:47.088905+0000","last_fullsized":"2024-05-09T00:01:47.088905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:56.811853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.049424+0000","last_change":"2024-05-09T00:01:44.618591+0000","last_active":"2024-05-09T00:01:48.049424+0000","last_peered":"2024-05-09T00:01:48.049424+0000","last_clean":"2024-05-09T00:01:48.049424+0000","last_became_active":"2024-05-09T00:01:44.618198+0000","last_became_peered":"2024-05-09T00:01:44.618198+0000","last_unstale":"2024-05-09T00:01:48.049424+0000","last_undegraded":"2024-05-09T00:01:48.049424+0000","last_fullsized":"2024-05-09T00:01:48.049424+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:27.705444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029617+0000","last_change":"2024-05-09T00:01:45.037485+0000","last_active":"2024-05-09T00:01:46.029617+0000","last_peered":"2024-05-09T00:01:46.029617+0000","last_clean":"2024-05-09T00:01:46.029617+0000","last_became_active":"2024-05-09T00:01:45.037150+0000","last_became_peered":"2024-05-09T00:01:45.037150+0000","last_unstale":"2024-05-09T00:01:46.029617+0000","last_undegraded":"2024-05-09T00:01:46.029617+0000","last_fullsized":"2024-05-09T00:01:46.029617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:55.476243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'8","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048082+0000","last_change":"2024-05-09T00:01:44.620485+0000","last_active":"2024-05-09T00:01:48.048082+0000","last_peered":"2024-05-09T00:01:48.048082+0000","last_clean":"2024-05-09T00:01:48.048082+0000","last_became_active":"2024-05-09T00:01:44.620004+0000","last_became_peered":"2024-05-09T00:01:44.620004+0000","last_unstale":"2024-05-09T00:01:48.048082+0000","last_undegraded":"2024-05-09T00:01:48.048082+0000","last_fullsized":"2024-05-09T00:01:48.048082+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:58.529038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327607+0000","last_change":"2024-05-09T00:01:45.045581+0000","last_active":"2024-05-09T00:01:45.327607+0000","last_peered":"2024-05-09T00:01:45.327607+0000","last_clean":"2024-05-09T00:01:45.327607+0000","last_became_active":"2024-05-09T00:01:45.045290+0000","last_became_peered":"2024-05-09T00:01:45.045290+0000","last_unstale":"2024-05-09T00:01:45.327607+0000","last_undegraded":"2024-05-09T00:01:45.327607+0000","last_fullsized":"2024-05-09T00:01:45.327607+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:36.860897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.055577+0000","last_change":"2024-05-09T00:01:44.624145+0000","last_active":"2024-05-09T00:01:49.055577+0000","last_peered":"2024-05-09T00:01:49.055577+0000","last_clean":"2024-05-09T00:01:49.055577+0000","last_became_active":"2024-05-09T00:01:44.623804+0000","last_became_peered":"2024-05-09T00:01:44.623804+0000","last_unstale":"2024-05-09T00:01:49.055577+0000","last_undegraded":"2024-05-09T00:01:49.055577+0000","last_fullsized":"2024-05-09T00:01:49.055577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:22.366804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028727+0000","last_change":"2024-05-09T00:01:45.044724+0000","last_active":"2024-05-09T00:01:46.028727+0000","last_peered":"2024-05-09T00:01:46.028727+0000","last_clean":"2024-05-09T00:01:46.028727+0000","last_became_active":"2024-05-09T00:01:45.044251+0000","last_became_peered":"2024-05-09T00:01:45.044251+0000","last_unstale":"2024-05-09T00:01:46.028727+0000","last_undegraded":"2024-05-09T00:01:46.028727+0000","last_fullsized":"2024-05-09T00:01:46.028727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:33.525140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048447+0000","last_change":"2024-05-09T00:01:44.620188+0000","last_active":"2024-05-09T00:01:48.048447+0000","last_peered":"2024-05-09T00:01:48.048447+0000","last_clean":"2024-05-09T00:01:48.048447+0000","last_became_active":"2024-05-09T00:01:44.619914+0000","last_became_peered":"2024-05-09T00:01:44.619914+0000","last_unstale":"2024-05-09T00:01:48.048447+0000","last_undegraded":"2024-05-09T00:01:48.048447+0000","last_fullsized":"2024-05-09T00:01:48.048447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:50.349806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325112+0000","last_change":"2024-05-09T00:01:45.044881+0000","last_active":"2024-05-09T00:01:46.325112+0000","last_peered":"2024-05-09T00:01:46.325112+0000","last_clean":"2024-05-09T00:01:46.325112+0000","last_became_active":"2024-05-09T00:01:45.044176+0000","last_became_peered":"2024-05-09T00:01:45.044176+0000","last_unstale":"2024-05-09T00:01:46.325112+0000","last_undegraded":"2024-05-09T00:01:46.325112+0000","last_fullsized":"2024-05-09T00:01:46.325112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:15.672966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088587+0000","last_change":"2024-05-09T00:01:44.616560+0000","last_active":"2024-05-09T00:01:47.088587+0000","last_peered":"2024-05-09T00:01:47.088587+0000","last_clean":"2024-05-09T00:01:47.088587+0000","last_became_active":"2024-05-09T00:01:44.616172+0000","last_became_peered":"2024-05-09T00:01:44.616172+0000","last_unstale":"2024-05-09T00:01:47.088587+0000","last_undegraded":"2024-05-09T00:01:47.088587+0000","last_fullsized":"2024-05-09T00:01:47.088587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:51.191335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325022+0000","last_change":"2024-05-09T00:01:45.055008+0000","last_active":"2024-05-09T00:01:46.325022+0000","last_peered":"2024-05-09T00:01:46.325022+0000","last_clean":"2024-05-09T00:01:46.325022+0000","last_became_active":"2024-05-09T00:01:45.054626+0000","last_became_peered":"2024-05-09T00:01:45.054626+0000","last_unstale":"2024-05-09T00:01:46.325022+0000","last_undegraded":"2024-05-09T00:01:46.325022+0000","last_fullsized":"2024-05-09T00:01:46.325022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:30.718554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.058339+0000","last_change":"2024-05-09T00:01:44.622089+0000","last_active":"2024-05-09T00:01:49.058339+0000","last_peered":"2024-05-09T00:01:49.058339+0000","last_clean":"2024-05-09T00:01:49.058339+0000","last_became_active":"2024-05-09T00:01:44.621731+0000","last_became_peered":"2024-05-09T00:01:44.621731+0000","last_unstale":"2024-05-09T00:01:49.058339+0000","last_undegraded":"2024-05-09T00:01:49.058339+0000","last_fullsized":"2024-05-09T00:01:49.058339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.276454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029490+0000","last_change":"2024-05-09T00:01:45.058785+0000","last_active":"2024-05-09T00:01:46.029490+0000","last_peered":"2024-05-09T00:01:46.029490+0000","last_clean":"2024-05-09T00:01:46.029490+0000","last_became_active":"2024-05-09T00:01:45.058387+0000","last_became_peered":"2024-05-09T00:01:45.058387+0000","last_unstale":"2024-05-09T00:01:46.029490+0000","last_undegraded":"2024-05-09T00:01:46.029490+0000","last_fullsized":"2024-05-09T00:01:46.029490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:18.868021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088929+0000","last_change":"2024-05-09T00:01:44.615760+0000","last_active":"2024-05-09T00:01:47.088929+0000","last_peered":"2024-05-09T00:01:47.088929+0000","last_clean":"2024-05-09T00:01:47.088929+0000","last_became_active":"2024-05-09T00:01:44.615409+0000","last_became_peered":"2024-05-09T00:01:44.615409+0000","last_unstale":"2024-05-09T00:01:47.088929+0000","last_undegraded":"2024-05-09T00:01:47.088929+0000","last_fullsized":"2024-05-09T00:01:47.088929+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:29:27.672835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850354+0000","last_change":"2024-05-09T00:01:45.044092+0000","last_active":"2024-05-09T00:01:46.850354+0000","last_peered":"2024-05-09T00:01:46.850354+0000","last_clean":"2024-05-09T00:01:46.850354+0000","last_became_active":"2024-05-09T00:01:45.043721+0000","last_became_peered":"2024-05-09T00:01:45.043721+0000","last_unstale":"2024-05-09T00:01:46.850354+0000","last_undegraded":"2024-05-09T00:01:46.850354+0000","last_fullsized":"2024-05-09T00:01:46.850354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:31:50.854168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088299+0000","last_change":"2024-05-09T00:01:44.618910+0000","last_active":"2024-05-09T00:01:47.088299+0000","last_peered":"2024-05-09T00:01:47.088299+0000","last_clean":"2024-05-09T00:01:47.088299+0000","last_became_active":"2024-05-09T00:01:44.618569+0000","last_became_peered":"2024-05-09T00:01:44.618569+0000","last_unstale":"2024-05-09T00:01:47.088299+0000","last_undegraded":"2024-05-09T00:01:47.088299+0000","last_fullsized":"2024-05-09T00:01:47.088299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:40.748747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.090071+0000","last_change":"2024-05-09T00:01:45.047305+0000","last_active":"2024-05-09T00:01:47.090071+0000","last_peered":"2024-05-09T00:01:47.090071+0000","last_clean":"2024-05-09T00:01:47.090071+0000","last_became_active":"2024-05-09T00:01:45.046944+0000","last_became_peered":"2024-05-09T00:01:45.046944+0000","last_unstale":"2024-05-09T00:01:47.090071+0000","last_undegraded":"2024-05-09T00:01:47.090071+0000","last_fullsized":"2024-05-09T00:01:47.090071+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:24:59.065224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088914+0000","last_change":"2024-05-09T00:01:44.620497+0000","last_active":"2024-05-09T00:01:47.088914+0000","last_peered":"2024-05-09T00:01:47.088914+0000","last_clean":"2024-05-09T00:01:47.088914+0000","last_became_active":"2024-05-09T00:01:44.620165+0000","last_became_peered":"2024-05-09T00:01:44.620165+0000","last_unstale":"2024-05-09T00:01:47.088914+0000","last_undegraded":"2024-05-09T00:01:47.088914+0000","last_fullsized":"2024-05-09T00:01:47.088914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:44.514434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089762+0000","last_change":"2024-05-09T00:01:45.045408+0000","last_active":"2024-05-09T00:01:47.089762+0000","last_peered":"2024-05-09T00:01:47.089762+0000","last_clean":"2024-05-09T00:01:47.089762+0000","last_became_active":"2024-05-09T00:01:45.045086+0000","last_became_peered":"2024-05-09T00:01:45.045086+0000","last_unstale":"2024-05-09T00:01:47.089762+0000","last_undegraded":"2024-05-09T00:01:47.089762+0000","last_fullsized":"2024-05-09T00:01:47.089762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:54.568889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029362+0000","last_change":"2024-05-09T00:01:45.057315+0000","last_active":"2024-05-09T00:01:46.029362+0000","last_peered":"2024-05-09T00:01:46.029362+0000","last_clean":"2024-05-09T00:01:46.029362+0000","last_became_active":"2024-05-09T00:01:45.056962+0000","last_became_peered":"2024-05-09T00:01:45.056962+0000","last_unstale":"2024-05-09T00:01:46.029362+0000","last_undegraded":"2024-05-09T00:01:46.029362+0000","last_fullsized":"2024-05-09T00:01:46.029362+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:09:52.136588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.058025+0000","last_change":"2024-05-09T00:01:44.618477+0000","last_active":"2024-05-09T00:01:49.058025+0000","last_peered":"2024-05-09T00:01:49.058025+0000","last_clean":"2024-05-09T00:01:49.058025+0000","last_became_active":"2024-05-09T00:01:44.618154+0000","last_became_peered":"2024-05-09T00:01:44.618154+0000","last_unstale":"2024-05-09T00:01:49.058025+0000","last_undegraded":"2024-05-09T00:01:49.058025+0000","last_fullsized":"2024-05-09T00:01:49.058025+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:24.380644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187242+0000","last_change":"2024-05-09T00:01:45.053772+0000","last_active":"2024-05-09T00:01:45.187242+0000","last_peered":"2024-05-09T00:01:45.187242+0000","last_clean":"2024-05-09T00:01:45.187242+0000","last_became_active":"2024-05-09T00:01:45.053453+0000","last_became_peered":"2024-05-09T00:01:45.053453+0000","last_unstale":"2024-05-09T00:01:45.187242+0000","last_undegraded":"2024-05-09T00:01:45.187242+0000","last_fullsized":"2024-05-09T00:01:45.187242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:46.136845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048648+0000","last_change":"2024-05-09T00:01:44.610200+0000","last_active":"2024-05-09T00:01:48.048648+0000","last_peered":"2024-05-09T00:01:48.048648+0000","last_clean":"2024-05-09T00:01:48.048648+0000","last_became_active":"2024-05-09T00:01:44.609764+0000","last_became_peered":"2024-05-09T00:01:44.609764+0000","last_unstale":"2024-05-09T00:01:48.048648+0000","last_undegraded":"2024-05-09T00:01:48.048648+0000","last_fullsized":"2024-05-09T00:01:48.048648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:36.122765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":330,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.040899+0000","last_change":"2024-05-09T00:00:57.898648+0000","last_active":"2024-05-09T00:01:45.040899+0000","last_peered":"2024-05-09T00:01:45.040899+0000","last_clean":"2024-05-09T00:01:45.040899+0000","last_became_active":"2024-05-09T00:00:57.898259+0000","last_became_peered":"2024-05-09T00:00:57.898259+0000","last_unstale":"2024-05-09T00:01:45.040899+0000","last_undegraded":"2024-05-09T00:01:45.040899+0000","last_fullsized":"2024-05-09T00:01:45.040899+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:58:35.200738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:58:35.200738+0000","last_clean_scrub_stamp":"2024-05-08T23:58:35.200738+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:47.782068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028515+0000","last_change":"2024-05-09T00:01:45.035407+0000","last_active":"2024-05-09T00:01:46.028515+0000","last_peered":"2024-05-09T00:01:46.028515+0000","last_clean":"2024-05-09T00:01:46.028515+0000","last_became_active":"2024-05-09T00:01:45.035115+0000","last_became_peered":"2024-05-09T00:01:45.035115+0000","last_unstale":"2024-05-09T00:01:46.028515+0000","last_undegraded":"2024-05-09T00:01:46.028515+0000","last_fullsized":"2024-05-09T00:01:46.028515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:23.603196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.056535+0000","last_change":"2024-05-09T00:01:44.622514+0000","last_active":"2024-05-09T00:01:49.056535+0000","last_peered":"2024-05-09T00:01:49.056535+0000","last_clean":"2024-05-09T00:01:49.056535+0000","last_became_active":"2024-05-09T00:01:44.621454+0000","last_became_peered":"2024-05-09T00:01:44.621454+0000","last_unstale":"2024-05-09T00:01:49.056535+0000","last_undegraded":"2024-05-09T00:01:49.056535+0000","last_fullsized":"2024-05-09T00:01:49.056535+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:10.801721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048321+0000","last_change":"2024-05-09T00:01:44.622743+0000","last_active":"2024-05-09T00:01:48.048321+0000","last_peered":"2024-05-09T00:01:48.048321+0000","last_clean":"2024-05-09T00:01:48.048321+0000","last_became_active":"2024-05-09T00:01:44.622304+0000","last_became_peered":"2024-05-09T00:01:44.622304+0000","last_unstale":"2024-05-09T00:01:48.048321+0000","last_undegraded":"2024-05-09T00:01:48.048321+0000","last_fullsized":"2024-05-09T00:01:48.048321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:01.829369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028716+0000","last_change":"2024-05-09T00:01:45.035458+0000","last_active":"2024-05-09T00:01:46.028716+0000","last_peered":"2024-05-09T00:01:46.028716+0000","last_clean":"2024-05-09T00:01:46.028716+0000","last_became_active":"2024-05-09T00:01:45.035140+0000","last_became_peered":"2024-05-09T00:01:45.035140+0000","last_unstale":"2024-05-09T00:01:46.028716+0000","last_undegraded":"2024-05-09T00:01:46.028716+0000","last_fullsized":"2024-05-09T00:01:46.028716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:02:31.258013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089219+0000","last_change":"2024-05-09T00:01:44.615172+0000","last_active":"2024-05-09T00:01:47.089219+0000","last_peered":"2024-05-09T00:01:47.089219+0000","last_clean":"2024-05-09T00:01:47.089219+0000","last_became_active":"2024-05-09T00:01:44.614892+0000","last_became_peered":"2024-05-09T00:01:44.614892+0000","last_unstale":"2024-05-09T00:01:47.089219+0000","last_undegraded":"2024-05-09T00:01:47.089219+0000","last_fullsized":"2024-05-09T00:01:47.089219+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:17.868378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187302+0000","last_change":"2024-05-09T00:01:45.044708+0000","last_active":"2024-05-09T00:01:45.187302+0000","last_peered":"2024-05-09T00:01:45.187302+0000","last_clean":"2024-05-09T00:01:45.187302+0000","last_became_active":"2024-05-09T00:01:45.044451+0000","last_became_peered":"2024-05-09T00:01:45.044451+0000","last_unstale":"2024-05-09T00:01:45.187302+0000","last_undegraded":"2024-05-09T00:01:45.187302+0000","last_fullsized":"2024-05-09T00:01:45.187302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:16.099211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048907+0000","last_change":"2024-05-09T00:01:44.617434+0000","last_active":"2024-05-09T00:01:48.048907+0000","last_peered":"2024-05-09T00:01:48.048907+0000","last_clean":"2024-05-09T00:01:48.048907+0000","last_became_active":"2024-05-09T00:01:44.617017+0000","last_became_peered":"2024-05-09T00:01:44.617017+0000","last_unstale":"2024-05-09T00:01:48.048907+0000","last_undegraded":"2024-05-09T00:01:48.048907+0000","last_fullsized":"2024-05-09T00:01:48.048907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.889962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088825+0000","last_change":"2024-05-09T00:01:45.035749+0000","last_active":"2024-05-09T00:01:47.088825+0000","last_peered":"2024-05-09T00:01:47.088825+0000","last_clean":"2024-05-09T00:01:47.088825+0000","last_became_active":"2024-05-09T00:01:45.034862+0000","last_became_peered":"2024-05-09T00:01:45.034862+0000","last_unstale":"2024-05-09T00:01:47.088825+0000","last_undegraded":"2024-05-09T00:01:47.088825+0000","last_fullsized":"2024-05-09T00:01:47.088825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:20.824467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048783+0000","last_change":"2024-05-09T00:01:44.616652+0000","last_active":"2024-05-09T00:01:48.048783+0000","last_peered":"2024-05-09T00:01:48.048783+0000","last_clean":"2024-05-09T00:01:48.048783+0000","last_became_active":"2024-05-09T00:01:44.616273+0000","last_became_peered":"2024-05-09T00:01:44.616273+0000","last_unstale":"2024-05-09T00:01:48.048783+0000","last_undegraded":"2024-05-09T00:01:48.048783+0000","last_fullsized":"2024-05-09T00:01:48.048783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:12.379909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327536+0000","last_change":"2024-05-09T00:01:45.047020+0000","last_active":"2024-05-09T00:01:45.327536+0000","last_peered":"2024-05-09T00:01:45.327536+0000","last_clean":"2024-05-09T00:01:45.327536+0000","last_became_active":"2024-05-09T00:01:45.046813+0000","last_became_peered":"2024-05-09T00:01:45.046813+0000","last_unstale":"2024-05-09T00:01:45.327536+0000","last_undegraded":"2024-05-09T00:01:45.327536+0000","last_fullsized":"2024-05-09T00:01:45.327536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:53.042258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048301+0000","last_change":"2024-05-09T00:01:44.610843+0000","last_active":"2024-05-09T00:01:48.048301+0000","last_peered":"2024-05-09T00:01:48.048301+0000","last_clean":"2024-05-09T00:01:48.048301+0000","last_became_active":"2024-05-09T00:01:44.610523+0000","last_became_peered":"2024-05-09T00:01:44.610523+0000","last_unstale":"2024-05-09T00:01:48.048301+0000","last_undegraded":"2024-05-09T00:01:48.048301+0000","last_fullsized":"2024-05-09T00:01:48.048301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:58.527344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850071+0000","last_change":"2024-05-09T00:01:45.046259+0000","last_active":"2024-05-09T00:01:46.850071+0000","last_peered":"2024-05-09T00:01:46.850071+0000","last_clean":"2024-05-09T00:01:46.850071+0000","last_became_active":"2024-05-09T00:01:45.045954+0000","last_became_peered":"2024-05-09T00:01:45.045954+0000","last_unstale":"2024-05-09T00:01:46.850071+0000","last_undegraded":"2024-05-09T00:01:46.850071+0000","last_fullsized":"2024-05-09T00:01:46.850071+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:46.569934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039671+0000","last_change":"2024-05-09T00:01:44.616781+0000","last_active":"2024-05-09T00:01:47.039671+0000","last_peered":"2024-05-09T00:01:47.039671+0000","last_clean":"2024-05-09T00:01:47.039671+0000","last_became_active":"2024-05-09T00:01:44.616386+0000","last_became_peered":"2024-05-09T00:01:44.616386+0000","last_unstale":"2024-05-09T00:01:47.039671+0000","last_undegraded":"2024-05-09T00:01:47.039671+0000","last_fullsized":"2024-05-09T00:01:47.039671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:17.073596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187252+0000","last_change":"2024-05-09T00:01:45.046701+0000","last_active":"2024-05-09T00:01:45.187252+0000","last_peered":"2024-05-09T00:01:45.187252+0000","last_clean":"2024-05-09T00:01:45.187252+0000","last_became_active":"2024-05-09T00:01:45.046409+0000","last_became_peered":"2024-05-09T00:01:45.046409+0000","last_unstale":"2024-05-09T00:01:45.187252+0000","last_undegraded":"2024-05-09T00:01:45.187252+0000","last_fullsized":"2024-05-09T00:01:45.187252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:32.178410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.049130+0000","last_change":"2024-05-09T00:01:44.623271+0000","last_active":"2024-05-09T00:01:48.049130+0000","last_peered":"2024-05-09T00:01:48.049130+0000","last_clean":"2024-05-09T00:01:48.049130+0000","last_became_active":"2024-05-09T00:01:44.622863+0000","last_became_peered":"2024-05-09T00:01:44.622863+0000","last_unstale":"2024-05-09T00:01:48.049130+0000","last_undegraded":"2024-05-09T00:01:48.049130+0000","last_fullsized":"2024-05-09T00:01:48.049130+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:58.609140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325100+0000","last_change":"2024-05-09T00:01:45.052296+0000","last_active":"2024-05-09T00:01:46.325100+0000","last_peered":"2024-05-09T00:01:46.325100+0000","last_clean":"2024-05-09T00:01:46.325100+0000","last_became_active":"2024-05-09T00:01:45.051951+0000","last_became_peered":"2024-05-09T00:01:45.051951+0000","last_unstale":"2024-05-09T00:01:46.325100+0000","last_undegraded":"2024-05-09T00:01:46.325100+0000","last_fullsized":"2024-05-09T00:01:46.325100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:46.908629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.056987+0000","last_change":"2024-05-09T00:01:44.620387+0000","last_active":"2024-05-09T00:01:49.056987+0000","last_peered":"2024-05-09T00:01:49.056987+0000","last_clean":"2024-05-09T00:01:49.056987+0000","last_became_active":"2024-05-09T00:01:44.620024+0000","last_became_peered":"2024-05-09T00:01:44.620024+0000","last_unstale":"2024-05-09T00:01:49.056987+0000","last_undegraded":"2024-05-09T00:01:49.056987+0000","last_fullsized":"2024-05-09T00:01:49.056987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:31.599273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325195+0000","last_change":"2024-05-09T00:01:45.050092+0000","last_active":"2024-05-09T00:01:46.325195+0000","last_peered":"2024-05-09T00:01:46.325195+0000","last_clean":"2024-05-09T00:01:46.325195+0000","last_became_active":"2024-05-09T00:01:45.049794+0000","last_became_peered":"2024-05-09T00:01:45.049794+0000","last_unstale":"2024-05-09T00:01:46.325195+0000","last_undegraded":"2024-05-09T00:01:46.325195+0000","last_fullsized":"2024-05-09T00:01:46.325195+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:56.932513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.525700+0000","last_change":"2024-05-09T00:01:44.609940+0000","last_active":"2024-05-09T00:01:46.525700+0000","last_peered":"2024-05-09T00:01:46.525700+0000","last_clean":"2024-05-09T00:01:46.525700+0000","last_became_active":"2024-05-09T00:01:44.609593+0000","last_became_peered":"2024-05-09T00:01:44.609593+0000","last_unstale":"2024-05-09T00:01:46.525700+0000","last_undegraded":"2024-05-09T00:01:46.525700+0000","last_fullsized":"2024-05-09T00:01:46.525700+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:09.671548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325171+0000","last_change":"2024-05-09T00:01:45.042533+0000","last_active":"2024-05-09T00:01:46.325171+0000","last_peered":"2024-05-09T00:01:46.325171+0000","last_clean":"2024-05-09T00:01:46.325171+0000","last_became_active":"2024-05-09T00:01:45.042155+0000","last_became_peered":"2024-05-09T00:01:45.042155+0000","last_unstale":"2024-05-09T00:01:46.325171+0000","last_undegraded":"2024-05-09T00:01:46.325171+0000","last_fullsized":"2024-05-09T00:01:46.325171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:36.519165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.051979+0000","last_change":"2024-05-09T00:01:44.617518+0000","last_active":"2024-05-09T00:01:45.051979+0000","last_peered":"2024-05-09T00:01:45.051979+0000","last_clean":"2024-05-09T00:01:45.051979+0000","last_became_active":"2024-05-09T00:01:44.617196+0000","last_became_peered":"2024-05-09T00:01:44.617196+0000","last_unstale":"2024-05-09T00:01:45.051979+0000","last_undegraded":"2024-05-09T00:01:45.051979+0000","last_fullsized":"2024-05-09T00:01:45.051979+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:47.062855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325220+0000","last_change":"2024-05-09T00:01:45.053962+0000","last_active":"2024-05-09T00:01:46.325220+0000","last_peered":"2024-05-09T00:01:46.325220+0000","last_clean":"2024-05-09T00:01:46.325220+0000","last_became_active":"2024-05-09T00:01:45.053637+0000","last_became_peered":"2024-05-09T00:01:45.053637+0000","last_unstale":"2024-05-09T00:01:46.325220+0000","last_undegraded":"2024-05-09T00:01:46.325220+0000","last_fullsized":"2024-05-09T00:01:46.325220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:18.188806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850155+0000","last_change":"2024-05-09T00:01:45.055532+0000","last_active":"2024-05-09T00:01:46.850155+0000","last_peered":"2024-05-09T00:01:46.850155+0000","last_clean":"2024-05-09T00:01:46.850155+0000","last_became_active":"2024-05-09T00:01:45.054939+0000","last_became_peered":"2024-05-09T00:01:45.054939+0000","last_unstale":"2024-05-09T00:01:46.850155+0000","last_undegraded":"2024-05-09T00:01:46.850155+0000","last_fullsized":"2024-05-09T00:01:46.850155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.919492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039891+0000","last_change":"2024-05-09T00:01:45.053752+0000","last_active":"2024-05-09T00:01:47.039891+0000","last_peered":"2024-05-09T00:01:47.039891+0000","last_clean":"2024-05-09T00:01:47.039891+0000","last_became_active":"2024-05-09T00:01:45.053409+0000","last_became_peered":"2024-05-09T00:01:45.053409+0000","last_unstale":"2024-05-09T00:01:47.039891+0000","last_undegraded":"2024-05-09T00:01:47.039891+0000","last_fullsized":"2024-05-09T00:01:47.039891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:12.517211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039813+0000","last_change":"2024-05-09T00:01:45.036145+0000","last_active":"2024-05-09T00:01:47.039813+0000","last_peered":"2024-05-09T00:01:47.039813+0000","last_clean":"2024-05-09T00:01:47.039813+0000","last_became_active":"2024-05-09T00:01:45.035839+0000","last_became_peered":"2024-05-09T00:01:45.035839+0000","last_unstale":"2024-05-09T00:01:47.039813+0000","last_undegraded":"2024-05-09T00:01:47.039813+0000","last_fullsized":"2024-05-09T00:01:47.039813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:03:17.630399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088680+0000","last_change":"2024-05-09T00:01:45.032875+0000","last_active":"2024-05-09T00:01:47.088680+0000","last_peered":"2024-05-09T00:01:47.088680+0000","last_clean":"2024-05-09T00:01:47.088680+0000","last_became_active":"2024-05-09T00:01:45.032552+0000","last_became_peered":"2024-05-09T00:01:45.032552+0000","last_unstale":"2024-05-09T00:01:47.088680+0000","last_undegraded":"2024-05-09T00:01:47.088680+0000","last_fullsized":"2024-05-09T00:01:47.088680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:17.244204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028730+0000","last_change":"2024-05-09T00:01:45.032427+0000","last_active":"2024-05-09T00:01:46.028730+0000","last_peered":"2024-05-09T00:01:46.028730+0000","last_clean":"2024-05-09T00:01:46.028730+0000","last_became_active":"2024-05-09T00:01:45.032038+0000","last_became_peered":"2024-05-09T00:01:45.032038+0000","last_unstale":"2024-05-09T00:01:46.028730+0000","last_undegraded":"2024-05-09T00:01:46.028730+0000","last_fullsized":"2024-05-09T00:01:46.028730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.495291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850245+0000","last_change":"2024-05-09T00:01:45.053080+0000","last_active":"2024-05-09T00:01:46.850245+0000","last_peered":"2024-05-09T00:01:46.850245+0000","last_clean":"2024-05-09T00:01:46.850245+0000","last_became_active":"2024-05-09T00:01:45.052728+0000","last_became_peered":"2024-05-09T00:01:45.052728+0000","last_unstale":"2024-05-09T00:01:46.850245+0000","last_undegraded":"2024-05-09T00:01:46.850245+0000","last_fullsized":"2024-05-09T00:01:46.850245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:59.631827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.040022+0000","last_change":"2024-05-09T00:01:45.044489+0000","last_active":"2024-05-09T00:01:47.040022+0000","last_peered":"2024-05-09T00:01:47.040022+0000","last_clean":"2024-05-09T00:01:47.040022+0000","last_became_active":"2024-05-09T00:01:45.044139+0000","last_became_peered":"2024-05-09T00:01:45.044139+0000","last_unstale":"2024-05-09T00:01:47.040022+0000","last_undegraded":"2024-05-09T00:01:47.040022+0000","last_fullsized":"2024-05-09T00:01:47.040022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:57.932238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187290+0000","last_change":"2024-05-09T00:01:45.050829+0000","last_active":"2024-05-09T00:01:45.187290+0000","last_peered":"2024-05-09T00:01:45.187290+0000","last_clean":"2024-05-09T00:01:45.187290+0000","last_became_active":"2024-05-09T00:01:45.050410+0000","last_became_peered":"2024-05-09T00:01:45.050410+0000","last_unstale":"2024-05-09T00:01:45.187290+0000","last_undegraded":"2024-05-09T00:01:45.187290+0000","last_fullsized":"2024-05-09T00:01:45.187290+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:08.738918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029150+0000","last_change":"2024-05-09T00:01:45.053957+0000","last_active":"2024-05-09T00:01:46.029150+0000","last_peered":"2024-05-09T00:01:46.029150+0000","last_clean":"2024-05-09T00:01:46.029150+0000","last_became_active":"2024-05-09T00:01:45.053487+0000","last_became_peered":"2024-05-09T00:01:45.053487+0000","last_unstale":"2024-05-09T00:01:46.029150+0000","last_undegraded":"2024-05-09T00:01:46.029150+0000","last_fullsized":"2024-05-09T00:01:46.029150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:35.131361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187232+0000","last_change":"2024-05-09T00:01:45.050653+0000","last_active":"2024-05-09T00:01:45.187232+0000","last_peered":"2024-05-09T00:01:45.187232+0000","last_clean":"2024-05-09T00:01:45.187232+0000","last_became_active":"2024-05-09T00:01:45.050322+0000","last_became_peered":"2024-05-09T00:01:45.050322+0000","last_unstale":"2024-05-09T00:01:45.187232+0000","last_undegraded":"2024-05-09T00:01:45.187232+0000","last_fullsized":"2024-05-09T00:01:45.187232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:11:45.137945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029679+0000","last_change":"2024-05-09T00:01:45.044757+0000","last_active":"2024-05-09T00:01:46.029679+0000","last_peered":"2024-05-09T00:01:46.029679+0000","last_clean":"2024-05-09T00:01:46.029679+0000","last_became_active":"2024-05-09T00:01:45.044464+0000","last_became_peered":"2024-05-09T00:01:45.044464+0000","last_unstale":"2024-05-09T00:01:46.029679+0000","last_undegraded":"2024-05-09T00:01:46.029679+0000","last_fullsized":"2024-05-09T00:01:46.029679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:44.402750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028903+0000","last_change":"2024-05-09T00:01:45.044515+0000","last_active":"2024-05-09T00:01:46.028903+0000","last_peered":"2024-05-09T00:01:46.028903+0000","last_clean":"2024-05-09T00:01:46.028903+0000","last_became_active":"2024-05-09T00:01:45.044209+0000","last_became_peered":"2024-05-09T00:01:45.044209+0000","last_unstale":"2024-05-09T00:01:46.028903+0000","last_undegraded":"2024-05-09T00:01:46.028903+0000","last_fullsized":"2024-05-09T00:01:46.028903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:18.523680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850098+0000","last_change":"2024-05-09T00:01:45.044254+0000","last_active":"2024-05-09T00:01:46.850098+0000","last_peered":"2024-05-09T00:01:46.850098+0000","last_clean":"2024-05-09T00:01:46.850098+0000","last_became_active":"2024-05-09T00:01:45.043220+0000","last_became_peered":"2024-05-09T00:01:45.043220+0000","last_unstale":"2024-05-09T00:01:46.850098+0000","last_undegraded":"2024-05-09T00:01:46.850098+0000","last_fullsized":"2024-05-09T00:01:46.850098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:39:53.986814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246178,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4897,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":33129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579914,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":847872,"data_stored":409787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]}]},{"osd":10,"up_from":67,"seq":287762808845,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":942080,"data_stored":1003249,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":9,"up_from":62,"seq":266287972369,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31944,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713208,"statfs":{"total":95995035648,"available":95962324992,"internally_reserved":0,"allocated":839680,"data_stored":401799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.31},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.432},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.53300000000000003}]},{"osd":8,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.625},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.65300000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":8,"up_from":55,"seq":236223201300,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":864256,"data_stored":410194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.499},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.374}]},{"osd":4,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.71999999999999997}]},{"osd":9,"last update":"Thu May 9 00:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":7,"up_from":48,"seq":206158430232,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":913408,"data_stored":1002244,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.376},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.443}]},{"osd":1,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.497},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.746}]},{"osd":6,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.63100000000000001}]},{"osd":8,"last update":"Thu May 9 00:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.85099999999999998}]},{"osd":9,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.71499999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":6,"up_from":43,"seq":184683593756,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31940,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713212,"statfs":{"total":95995035648,"available":95962329088,"internally_reserved":0,"allocated":847872,"data_stored":409787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68100000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.505,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63,"15min":0.63},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.627},{"interface":"front","average":{"1min":0.622,"5min":0.65200000000000002,"15min":0.65700000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84099999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu May 9 00:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.751},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.95199999999999996}]},{"osd":8,"last update":"Thu May 9 00:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.878},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77800000000000002}]},{"osd":9,"last update":"Thu May 9 00:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.72999999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":864256,"data_stored":417953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.35199999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.35799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51000000000000001,"15min":0.497},"min":{"1min":0.32700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.29999999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu May 9 00:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.501,"15min":0.498},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.376,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu May 9 00:01:15 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.41299999999999998,"15min":0.40300000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.41699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu May 9 00:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu May 9 00:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.58099999999999996,"15min":0.57399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.504}]},{"osd":7,"last update":"Thu May 9 00:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.53500000000000003}]},{"osd":8,"last update":"Thu May 9 00:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.67300000000000004}]},{"osd":9,"last update":"Thu May 9 00:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.58299999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":860160,"data_stored":410481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 9 00:01:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.51200000000000001,"15min":0.48599999999999999},"min":{"1min":0.32000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.53100000000000003,"15min":0.50800000000000001},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80300000000000005,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.52300000000000002,"15min":0.504},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81599999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.39500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu May 9 00:00:56 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.40400000000000003,"15min":0.39800000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.433},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.39900000000000002,"15min":0.39400000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu May 9 00:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.50900000000000001,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.54200000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.92100000000000004,"5min":1.075,"15min":1.075},"last":0.622}]},{"osd":5,"last update":"Thu May 9 00:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu May 9 00:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.34100000000000003}]},{"osd":7,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.56100000000000005}]},{"osd":8,"last update":"Thu May 9 00:01:23 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.72799999999999998}]},{"osd":9,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.42799999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":2,"up_from":17,"seq":73014444074,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":868352,"data_stored":411340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48299999999999998,"15min":0.46300000000000002},"min":{"1min":0.34499999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.48899999999999999,"15min":0.47399999999999998},"min":{"1min":0.39600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu May 9 00:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.37,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.499,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu May 9 00:00:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.503,"15min":0.505},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.503}]},{"osd":4,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.42099999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu May 9 00:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.44500000000000001,"15min":0.433},"min":{"1min":0.31,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.441},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.45900000000000002,"15min":0.44900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.39000000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.83099999999999996}]},{"osd":7,"last update":"Thu May 9 00:01:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67100000000000004}]},{"osd":8,"last update":"Thu May 9 00:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.627},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54700000000000004}]},{"osd":9,"last update":"Thu May 9 00:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.754}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":3,"up_from":24,"seq":103079215142,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31960,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713192,"statfs":{"total":95995035648,"available":95962308608,"internally_reserved":0,"allocated":864256,"data_stored":410071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.215,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35099999999999998,"15min":0.35199999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu May 9 00:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.441},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76100000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu May 9 00:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.42499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.66900000000000004}]},{"osd":4,"last update":"Thu May 9 00:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.38500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu May 9 00:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.42399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.52300000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu May 9 00:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.44500000000000001,"15min":0.439},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.31,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu May 9 00:01:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51100000000000001}]},{"osd":8,"last update":"Thu May 9 00:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.46700000000000003}]},{"osd":9,"last update":"Thu May 9 00:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.40799999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":4,"up_from":31,"seq":133143986211,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31948,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713204,"statfs":{"total":95995035648,"available":95962320896,"internally_reserved":0,"allocated":851968,"data_stored":409809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.39400000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79800000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.34799999999999998},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.36799999999999999,"15min":0.36199999999999999},"min":{"1min":0.27100000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.50800000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.376}]},{"osd":2,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.52300000000000002,"15min":0.50800000000000001},"min":{"1min":0.46400000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.51300000000000001,"15min":0.497},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.624}]},{"osd":3,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.52500000000000002,"15min":0.51100000000000001},"min":{"1min":0.42599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.51000000000000001,"15min":0.496},"min":{"1min":0.44500000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu May 9 00:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57899999999999996,"15min":0.57099999999999995},"min":{"1min":0.441,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.46700000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu May 9 00:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu May 9 00:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58599999999999997}]},{"osd":8,"last update":"Thu May 9 00:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.77500000000000002}]},{"osd":9,"last update":"Thu May 9 00:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.63900000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":5,"up_from":36,"seq":154618822688,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":925696,"data_stored":1001976,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.498,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.49399999999999999,"15min":0.49099999999999999},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.35699999999999998,"15min":0.34799999999999998},"min":{"1min":0.29099999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.437},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.371,"15min":0.36799999999999999},"min":{"1min":0.27000000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.39400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73599999999999999,"5min":0.754,"15min":0.754},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu May 9 00:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.90000000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.41999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.70099999999999996}]},{"osd":8,"last update":"Thu May 9 00:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58199999999999996}]},{"osd":9,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.754}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33999,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33999,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":20849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:01:53.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:01:53.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.318+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3932613127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f740ffd70 msgr2=0x7f2f74100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.318+0000 7f2f7b23b700 1 --2- 172.21.15.81:0/3932613127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f740ffd70 0x7f2f74100190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2f680099c0 tx=0x7f2f68009cd0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.318+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3932613127 shutdown_connections 2024-05-09T00:01:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.318+0000 7f2f7b23b700 1 --2- 172.21.15.81:0/3932613127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f74101900 0x7f2f741081b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.318+0000 7f2f7b23b700 1 --2- 172.21.15.81:0/3932613127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f740ffd70 0x7f2f74100190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.318+0000 7f2f7b23b700 1 --2- 172.21.15.81:0/3932613127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f74100f60 0x7f2f741013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.318+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3932613127 >> 172.21.15.81:0/3932613127 conn(0x7f2f740fb2e0 msgr2=0x7f2f740fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.318+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3932613127 shutdown_connections 2024-05-09T00:01:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.318+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3932613127 wait complete. 2024-05-09T00:01:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f7b23b700 1 Processor -- start 2024-05-09T00:01:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f7b23b700 1 -- start start 2024-05-09T00:01:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f7b23b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f740ffd70 0x7f2f74196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f7b23b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f74100f60 0x7f2f74197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f7b23b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f74101900 0x7f2f7419e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f7b23b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7419e900 con 0x7f2f74101900 2024-05-09T00:01:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f7b23b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7419ea70 con 0x7f2f740ffd70 2024-05-09T00:01:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f7b23b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7419ec30 con 0x7f2f74100f60 2024-05-09T00:01:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f797d8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f74101900 0x7f2f7419e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f797d8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f74101900 0x7f2f7419e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48506/0 (socket says 172.21.15.81:48506) 2024-05-09T00:01:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f797d8700 1 -- 172.21.15.81:0/3925574904 learned_addr learned my addr 172.21.15.81:0/3925574904 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f78fd7700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f740ffd70 0x7f2f74196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f73fff700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f74100f60 0x7f2f74197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f797d8700 1 -- 172.21.15.81:0/3925574904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f74100f60 msgr2=0x7f2f74197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f797d8700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f74100f60 0x7f2f74197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f797d8700 1 -- 172.21.15.81:0/3925574904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f740ffd70 msgr2=0x7f2f74196e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.319+0000 7f2f797d8700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f740ffd70 0x7f2f74196e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.320+0000 7f2f797d8700 1 -- 172.21.15.81:0/3925574904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f680095f0 con 0x7f2f74101900 2024-05-09T00:01:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.320+0000 7f2f73fff700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f74100f60 0x7f2f74197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:01:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.320+0000 7f2f78fd7700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f740ffd70 0x7f2f74196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:01:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.320+0000 7f2f797d8700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f74101900 0x7f2f7419e330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c007ee0 tx=0x7f2f6c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.320+0000 7f2f71ffb700 1 -- 172.21.15.81:0/3925574904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c017070 con 0x7f2f74101900 2024-05-09T00:01:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.320+0000 7f2f71ffb700 1 -- 172.21.15.81:0/3925574904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f6c00f040 con 0x7f2f74101900 2024-05-09T00:01:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.320+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3925574904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7419ef10 con 0x7f2f74101900 2024-05-09T00:01:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.320+0000 7f2f71ffb700 1 -- 172.21.15.81:0/3925574904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c005740 con 0x7f2f74101900 2024-05-09T00:01:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.320+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3925574904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7419f330 con 0x7f2f74101900 2024-05-09T00:01:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.321+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3925574904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f74067380 con 0x7f2f74101900 2024-05-09T00:01:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.322+0000 7f2f71ffb700 1 -- 172.21.15.81:0/3925574904 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2f6c0058a0 con 0x7f2f74101900 2024-05-09T00:01:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.322+0000 7f2f71ffb700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2f640a11b0 0x7f2f640a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.323+0000 7f2f78fd7700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2f640a11b0 0x7f2f640a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.323+0000 7f2f71ffb700 1 -- 172.21.15.81:0/3925574904 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2f6c0cc160 con 0x7f2f74101900 2024-05-09T00:01:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.323+0000 7f2f78fd7700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2f640a11b0 0x7f2f640a3670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009990 tx=0x7f2f68005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.327+0000 7f2f71ffb700 1 -- 172.21.15.81:0/3925574904 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2f6c095940 con 0x7f2f74101900 2024-05-09T00:01:53.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:53 smithi081 ceph-mon[42474]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:53.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:53 smithi081 ceph-mon[42474]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:53.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:53 smithi081 ceph-mon[42474]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-05-09T00:01:53.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:53 smithi081 ceph-mon[42474]: pgmap v222: 97 pgs: 97 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 4.8 KiB/s wr, 16 op/s 2024-05-09T00:01:53.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:53 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3079699174' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:53.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:53 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1538000357' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:53.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:53 smithi150 ceph-mon[46187]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:53.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:53 smithi150 ceph-mon[46187]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:53.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:53 smithi150 ceph-mon[46187]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-05-09T00:01:53.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:53 smithi150 ceph-mon[46187]: pgmap v222: 97 pgs: 97 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 4.8 KiB/s wr, 16 op/s 2024-05-09T00:01:53.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:53 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3079699174' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:53.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:53 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1538000357' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:53.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.521+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3925574904 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f74069960 con 0x7f2f640a11b0 2024-05-09T00:01:53.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.530+0000 7f2f71ffb700 1 -- 172.21.15.81:0/3925574904 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+328372 (secure 0 0 0) 0x7f2f74069960 con 0x7f2f640a11b0 2024-05-09T00:01:53.529 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.533+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3925574904 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2f640a11b0 msgr2=0x7f2f640a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.533+0000 7f2f7b23b700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2f640a11b0 0x7f2f640a3670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009990 tx=0x7f2f68005fb0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.533+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3925574904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f74101900 msgr2=0x7f2f7419e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.533+0000 7f2f7b23b700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f74101900 0x7f2f7419e330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c007ee0 tx=0x7f2f6c00d3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.533+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3925574904 shutdown_connections 2024-05-09T00:01:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.533+0000 7f2f7b23b700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2f640a11b0 0x7f2f640a3670 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.533+0000 7f2f7b23b700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2f740ffd70 0x7f2f74196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.533+0000 7f2f7b23b700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f74101900 0x7f2f7419e330 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.533+0000 7f2f7b23b700 1 --2- 172.21.15.81:0/3925574904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2f74100f60 0x7f2f74197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.533+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3925574904 >> 172.21.15.81:0/3925574904 conn(0x7f2f740fb2e0 msgr2=0x7f2f74069250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.533+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3925574904 shutdown_connections 2024-05-09T00:01:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:53.533+0000 7f2f7b23b700 1 -- 172.21.15.81:0/3925574904 wait complete. 2024-05-09T00:01:53.533 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-09T00:01:53.541 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-05-09T00:01:52.269923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595265,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":148,"num_read_kb":129,"num_write":293,"num_write_kb":2975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":252,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375428,"kb_used_data":10244,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124566396,"statfs":{"total":1151940427776,"available":1151555989504,"internally_reserved":0,"allocated":10489856,"data_stored":6698690,"data_compressed":106908,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19131,"internal_metadata":373798213},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4897,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.668532"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850421+0000","last_change":"2024-05-09T00:01:45.048606+0000","last_active":"2024-05-09T00:01:46.850421+0000","last_peered":"2024-05-09T00:01:46.850421+0000","last_clean":"2024-05-09T00:01:46.850421+0000","last_became_active":"2024-05-09T00:01:45.047691+0000","last_became_peered":"2024-05-09T00:01:45.047691+0000","last_unstale":"2024-05-09T00:01:46.850421+0000","last_undegraded":"2024-05-09T00:01:46.850421+0000","last_fullsized":"2024-05-09T00:01:46.850421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:03.881912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088559+0000","last_change":"2024-05-09T00:01:45.046812+0000","last_active":"2024-05-09T00:01:47.088559+0000","last_peered":"2024-05-09T00:01:47.088559+0000","last_clean":"2024-05-09T00:01:47.088559+0000","last_became_active":"2024-05-09T00:01:45.046510+0000","last_became_peered":"2024-05-09T00:01:45.046510+0000","last_unstale":"2024-05-09T00:01:47.088559+0000","last_undegraded":"2024-05-09T00:01:47.088559+0000","last_fullsized":"2024-05-09T00:01:47.088559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:03.614974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088767+0000","last_change":"2024-05-09T00:01:45.040304+0000","last_active":"2024-05-09T00:01:47.088767+0000","last_peered":"2024-05-09T00:01:47.088767+0000","last_clean":"2024-05-09T00:01:47.088767+0000","last_became_active":"2024-05-09T00:01:45.039990+0000","last_became_peered":"2024-05-09T00:01:45.039990+0000","last_unstale":"2024-05-09T00:01:47.088767+0000","last_undegraded":"2024-05-09T00:01:47.088767+0000","last_fullsized":"2024-05-09T00:01:47.088767+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:17:33.563999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089069+0000","last_change":"2024-05-09T00:01:45.040528+0000","last_active":"2024-05-09T00:01:47.089069+0000","last_peered":"2024-05-09T00:01:47.089069+0000","last_clean":"2024-05-09T00:01:47.089069+0000","last_became_active":"2024-05-09T00:01:45.040100+0000","last_became_peered":"2024-05-09T00:01:45.040100+0000","last_unstale":"2024-05-09T00:01:47.089069+0000","last_undegraded":"2024-05-09T00:01:47.089069+0000","last_fullsized":"2024-05-09T00:01:47.089069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:02.739346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327560+0000","last_change":"2024-05-09T00:01:45.036192+0000","last_active":"2024-05-09T00:01:45.327560+0000","last_peered":"2024-05-09T00:01:45.327560+0000","last_clean":"2024-05-09T00:01:45.327560+0000","last_became_active":"2024-05-09T00:01:45.035845+0000","last_became_peered":"2024-05-09T00:01:45.035845+0000","last_unstale":"2024-05-09T00:01:45.327560+0000","last_undegraded":"2024-05-09T00:01:45.327560+0000","last_fullsized":"2024-05-09T00:01:45.327560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:25.494946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089254+0000","last_change":"2024-05-09T00:01:45.047866+0000","last_active":"2024-05-09T00:01:47.089254+0000","last_peered":"2024-05-09T00:01:47.089254+0000","last_clean":"2024-05-09T00:01:47.089254+0000","last_became_active":"2024-05-09T00:01:45.047549+0000","last_became_peered":"2024-05-09T00:01:45.047549+0000","last_unstale":"2024-05-09T00:01:47.089254+0000","last_undegraded":"2024-05-09T00:01:47.089254+0000","last_fullsized":"2024-05-09T00:01:47.089254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:34:33.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325076+0000","last_change":"2024-05-09T00:01:45.054246+0000","last_active":"2024-05-09T00:01:46.325076+0000","last_peered":"2024-05-09T00:01:46.325076+0000","last_clean":"2024-05-09T00:01:46.325076+0000","last_became_active":"2024-05-09T00:01:45.053863+0000","last_became_peered":"2024-05-09T00:01:45.053863+0000","last_unstale":"2024-05-09T00:01:46.325076+0000","last_undegraded":"2024-05-09T00:01:46.325076+0000","last_fullsized":"2024-05-09T00:01:46.325076+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:12.080139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187184+0000","last_change":"2024-05-09T00:01:45.053747+0000","last_active":"2024-05-09T00:01:45.187184+0000","last_peered":"2024-05-09T00:01:45.187184+0000","last_clean":"2024-05-09T00:01:45.187184+0000","last_became_active":"2024-05-09T00:01:45.053461+0000","last_became_peered":"2024-05-09T00:01:45.053461+0000","last_unstale":"2024-05-09T00:01:45.187184+0000","last_undegraded":"2024-05-09T00:01:45.187184+0000","last_fullsized":"2024-05-09T00:01:45.187184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:30.018296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029785+0000","last_change":"2024-05-09T00:01:45.053851+0000","last_active":"2024-05-09T00:01:46.029785+0000","last_peered":"2024-05-09T00:01:46.029785+0000","last_clean":"2024-05-09T00:01:46.029785+0000","last_became_active":"2024-05-09T00:01:45.053471+0000","last_became_peered":"2024-05-09T00:01:45.053471+0000","last_unstale":"2024-05-09T00:01:46.029785+0000","last_undegraded":"2024-05-09T00:01:46.029785+0000","last_fullsized":"2024-05-09T00:01:46.029785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:25.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089793+0000","last_change":"2024-05-09T00:01:45.048916+0000","last_active":"2024-05-09T00:01:47.089793+0000","last_peered":"2024-05-09T00:01:47.089793+0000","last_clean":"2024-05-09T00:01:47.089793+0000","last_became_active":"2024-05-09T00:01:45.048227+0000","last_became_peered":"2024-05-09T00:01:45.048227+0000","last_unstale":"2024-05-09T00:01:47.089793+0000","last_undegraded":"2024-05-09T00:01:47.089793+0000","last_fullsized":"2024-05-09T00:01:47.089793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:51.246933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325183+0000","last_change":"2024-05-09T00:01:45.053449+0000","last_active":"2024-05-09T00:01:46.325183+0000","last_peered":"2024-05-09T00:01:46.325183+0000","last_clean":"2024-05-09T00:01:46.325183+0000","last_became_active":"2024-05-09T00:01:45.053060+0000","last_became_peered":"2024-05-09T00:01:45.053060+0000","last_unstale":"2024-05-09T00:01:46.325183+0000","last_undegraded":"2024-05-09T00:01:46.325183+0000","last_fullsized":"2024-05-09T00:01:46.325183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:21.236565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088953+0000","last_change":"2024-05-09T00:01:45.047231+0000","last_active":"2024-05-09T00:01:47.088953+0000","last_peered":"2024-05-09T00:01:47.088953+0000","last_clean":"2024-05-09T00:01:47.088953+0000","last_became_active":"2024-05-09T00:01:45.046897+0000","last_became_peered":"2024-05-09T00:01:45.046897+0000","last_unstale":"2024-05-09T00:01:47.088953+0000","last_undegraded":"2024-05-09T00:01:47.088953+0000","last_fullsized":"2024-05-09T00:01:47.088953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:13.307931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028948+0000","last_change":"2024-05-09T00:01:45.048545+0000","last_active":"2024-05-09T00:01:46.028948+0000","last_peered":"2024-05-09T00:01:46.028948+0000","last_clean":"2024-05-09T00:01:46.028948+0000","last_became_active":"2024-05-09T00:01:45.048237+0000","last_became_peered":"2024-05-09T00:01:45.048237+0000","last_unstale":"2024-05-09T00:01:46.028948+0000","last_undegraded":"2024-05-09T00:01:46.028948+0000","last_fullsized":"2024-05-09T00:01:46.028948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:45:41.578704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089031+0000","last_change":"2024-05-09T00:01:45.046735+0000","last_active":"2024-05-09T00:01:47.089031+0000","last_peered":"2024-05-09T00:01:47.089031+0000","last_clean":"2024-05-09T00:01:47.089031+0000","last_became_active":"2024-05-09T00:01:45.046441+0000","last_became_peered":"2024-05-09T00:01:45.046441+0000","last_unstale":"2024-05-09T00:01:47.089031+0000","last_undegraded":"2024-05-09T00:01:47.089031+0000","last_fullsized":"2024-05-09T00:01:47.089031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:51.380665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088074+0000","last_change":"2024-05-09T00:01:45.036289+0000","last_active":"2024-05-09T00:01:47.088074+0000","last_peered":"2024-05-09T00:01:47.088074+0000","last_clean":"2024-05-09T00:01:47.088074+0000","last_became_active":"2024-05-09T00:01:45.035996+0000","last_became_peered":"2024-05-09T00:01:45.035996+0000","last_unstale":"2024-05-09T00:01:47.088074+0000","last_undegraded":"2024-05-09T00:01:47.088074+0000","last_fullsized":"2024-05-09T00:01:47.088074+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:52.769668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029327+0000","last_change":"2024-05-09T00:01:45.044908+0000","last_active":"2024-05-09T00:01:46.029327+0000","last_peered":"2024-05-09T00:01:46.029327+0000","last_clean":"2024-05-09T00:01:46.029327+0000","last_became_active":"2024-05-09T00:01:45.044508+0000","last_became_peered":"2024-05-09T00:01:45.044508+0000","last_unstale":"2024-05-09T00:01:46.029327+0000","last_undegraded":"2024-05-09T00:01:46.029327+0000","last_fullsized":"2024-05-09T00:01:46.029327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:02:23.578743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850564+0000","last_change":"2024-05-09T00:01:45.048389+0000","last_active":"2024-05-09T00:01:46.850564+0000","last_peered":"2024-05-09T00:01:46.850564+0000","last_clean":"2024-05-09T00:01:46.850564+0000","last_became_active":"2024-05-09T00:01:45.047959+0000","last_became_peered":"2024-05-09T00:01:45.047959+0000","last_unstale":"2024-05-09T00:01:46.850564+0000","last_undegraded":"2024-05-09T00:01:46.850564+0000","last_fullsized":"2024-05-09T00:01:46.850564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:44.298296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089171+0000","last_change":"2024-05-09T00:01:45.048314+0000","last_active":"2024-05-09T00:01:47.089171+0000","last_peered":"2024-05-09T00:01:47.089171+0000","last_clean":"2024-05-09T00:01:47.089171+0000","last_became_active":"2024-05-09T00:01:45.048002+0000","last_became_peered":"2024-05-09T00:01:45.048002+0000","last_unstale":"2024-05-09T00:01:47.089171+0000","last_undegraded":"2024-05-09T00:01:47.089171+0000","last_fullsized":"2024-05-09T00:01:47.089171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:36.327498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039835+0000","last_change":"2024-05-09T00:01:45.035747+0000","last_active":"2024-05-09T00:01:47.039835+0000","last_peered":"2024-05-09T00:01:47.039835+0000","last_clean":"2024-05-09T00:01:47.039835+0000","last_became_active":"2024-05-09T00:01:45.035122+0000","last_became_peered":"2024-05-09T00:01:45.035122+0000","last_unstale":"2024-05-09T00:01:47.039835+0000","last_undegraded":"2024-05-09T00:01:47.039835+0000","last_fullsized":"2024-05-09T00:01:47.039835+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:21.361033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"78'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088782+0000","last_change":"2024-05-09T00:01:44.620816+0000","last_active":"2024-05-09T00:01:47.088782+0000","last_peered":"2024-05-09T00:01:47.088782+0000","last_clean":"2024-05-09T00:01:47.088782+0000","last_became_active":"2024-05-09T00:01:44.620524+0000","last_became_peered":"2024-05-09T00:01:44.620524+0000","last_unstale":"2024-05-09T00:01:47.088782+0000","last_undegraded":"2024-05-09T00:01:47.088782+0000","last_fullsized":"2024-05-09T00:01:47.088782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:05.623111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187261+0000","last_change":"2024-05-09T00:01:45.049115+0000","last_active":"2024-05-09T00:01:45.187261+0000","last_peered":"2024-05-09T00:01:45.187261+0000","last_clean":"2024-05-09T00:01:45.187261+0000","last_became_active":"2024-05-09T00:01:45.048825+0000","last_became_peered":"2024-05-09T00:01:45.048825+0000","last_unstale":"2024-05-09T00:01:45.187261+0000","last_undegraded":"2024-05-09T00:01:45.187261+0000","last_fullsized":"2024-05-09T00:01:45.187261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:09:29.890090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088914+0000","last_change":"2024-05-09T00:01:44.621711+0000","last_active":"2024-05-09T00:01:47.088914+0000","last_peered":"2024-05-09T00:01:47.088914+0000","last_clean":"2024-05-09T00:01:47.088914+0000","last_became_active":"2024-05-09T00:01:44.621433+0000","last_became_peered":"2024-05-09T00:01:44.621433+0000","last_unstale":"2024-05-09T00:01:47.088914+0000","last_undegraded":"2024-05-09T00:01:47.088914+0000","last_fullsized":"2024-05-09T00:01:47.088914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:57.451467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088944+0000","last_change":"2024-05-09T00:01:45.038415+0000","last_active":"2024-05-09T00:01:47.088944+0000","last_peered":"2024-05-09T00:01:47.088944+0000","last_clean":"2024-05-09T00:01:47.088944+0000","last_became_active":"2024-05-09T00:01:45.038141+0000","last_became_peered":"2024-05-09T00:01:45.038141+0000","last_unstale":"2024-05-09T00:01:47.088944+0000","last_undegraded":"2024-05-09T00:01:47.088944+0000","last_fullsized":"2024-05-09T00:01:47.088944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:37.772886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.055486+0000","last_change":"2024-05-09T00:01:44.622505+0000","last_active":"2024-05-09T00:01:49.055486+0000","last_peered":"2024-05-09T00:01:49.055486+0000","last_clean":"2024-05-09T00:01:49.055486+0000","last_became_active":"2024-05-09T00:01:44.622120+0000","last_became_peered":"2024-05-09T00:01:44.622120+0000","last_unstale":"2024-05-09T00:01:49.055486+0000","last_undegraded":"2024-05-09T00:01:49.055486+0000","last_fullsized":"2024-05-09T00:01:49.055486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:15.937946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029518+0000","last_change":"2024-05-09T00:01:45.048553+0000","last_active":"2024-05-09T00:01:46.029518+0000","last_peered":"2024-05-09T00:01:46.029518+0000","last_clean":"2024-05-09T00:01:46.029518+0000","last_became_active":"2024-05-09T00:01:45.046659+0000","last_became_peered":"2024-05-09T00:01:45.046659+0000","last_unstale":"2024-05-09T00:01:46.029518+0000","last_undegraded":"2024-05-09T00:01:46.029518+0000","last_fullsized":"2024-05-09T00:01:46.029518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:19.581843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327593+0000","last_change":"2024-05-09T00:01:44.614820+0000","last_active":"2024-05-09T00:01:45.327593+0000","last_peered":"2024-05-09T00:01:45.327593+0000","last_clean":"2024-05-09T00:01:45.327593+0000","last_became_active":"2024-05-09T00:01:44.614418+0000","last_became_peered":"2024-05-09T00:01:44.614418+0000","last_unstale":"2024-05-09T00:01:45.327593+0000","last_undegraded":"2024-05-09T00:01:45.327593+0000","last_fullsized":"2024-05-09T00:01:45.327593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:18.133098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029467+0000","last_change":"2024-05-09T00:01:45.058377+0000","last_active":"2024-05-09T00:01:46.029467+0000","last_peered":"2024-05-09T00:01:46.029467+0000","last_clean":"2024-05-09T00:01:46.029467+0000","last_became_active":"2024-05-09T00:01:45.057991+0000","last_became_peered":"2024-05-09T00:01:45.057991+0000","last_unstale":"2024-05-09T00:01:46.029467+0000","last_undegraded":"2024-05-09T00:01:46.029467+0000","last_fullsized":"2024-05-09T00:01:46.029467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:14.102698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'6","reported_seq":23,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:51.066979+0000","last_change":"2024-05-09T00:01:44.619347+0000","last_active":"2024-05-09T00:01:51.066979+0000","last_peered":"2024-05-09T00:01:51.066979+0000","last_clean":"2024-05-09T00:01:51.066979+0000","last_became_active":"2024-05-09T00:01:44.618967+0000","last_became_peered":"2024-05-09T00:01:44.618967+0000","last_unstale":"2024-05-09T00:01:51.066979+0000","last_undegraded":"2024-05-09T00:01:51.066979+0000","last_fullsized":"2024-05-09T00:01:51.066979+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:10.434674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327548+0000","last_change":"2024-05-09T00:01:45.049365+0000","last_active":"2024-05-09T00:01:45.327548+0000","last_peered":"2024-05-09T00:01:45.327548+0000","last_clean":"2024-05-09T00:01:45.327548+0000","last_became_active":"2024-05-09T00:01:45.049037+0000","last_became_peered":"2024-05-09T00:01:45.049037+0000","last_unstale":"2024-05-09T00:01:45.327548+0000","last_undegraded":"2024-05-09T00:01:45.327548+0000","last_fullsized":"2024-05-09T00:01:45.327548+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:34.290672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.057967+0000","last_change":"2024-05-09T00:01:44.617212+0000","last_active":"2024-05-09T00:01:49.057967+0000","last_peered":"2024-05-09T00:01:49.057967+0000","last_clean":"2024-05-09T00:01:49.057967+0000","last_became_active":"2024-05-09T00:01:44.616898+0000","last_became_peered":"2024-05-09T00:01:44.616898+0000","last_unstale":"2024-05-09T00:01:49.057967+0000","last_undegraded":"2024-05-09T00:01:49.057967+0000","last_fullsized":"2024-05-09T00:01:49.057967+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:39.630039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029579+0000","last_change":"2024-05-09T00:01:45.058567+0000","last_active":"2024-05-09T00:01:46.029579+0000","last_peered":"2024-05-09T00:01:46.029579+0000","last_clean":"2024-05-09T00:01:46.029579+0000","last_became_active":"2024-05-09T00:01:45.058124+0000","last_became_peered":"2024-05-09T00:01:45.058124+0000","last_unstale":"2024-05-09T00:01:46.029579+0000","last_undegraded":"2024-05-09T00:01:46.029579+0000","last_fullsized":"2024-05-09T00:01:46.029579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:03.438029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.057886+0000","last_change":"2024-05-09T00:01:44.618214+0000","last_active":"2024-05-09T00:01:49.057886+0000","last_peered":"2024-05-09T00:01:49.057886+0000","last_clean":"2024-05-09T00:01:49.057886+0000","last_became_active":"2024-05-09T00:01:44.617769+0000","last_became_peered":"2024-05-09T00:01:44.617769+0000","last_unstale":"2024-05-09T00:01:49.057886+0000","last_undegraded":"2024-05-09T00:01:49.057886+0000","last_fullsized":"2024-05-09T00:01:49.057886+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:43.654597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187210+0000","last_change":"2024-05-09T00:01:45.037441+0000","last_active":"2024-05-09T00:01:45.187210+0000","last_peered":"2024-05-09T00:01:45.187210+0000","last_clean":"2024-05-09T00:01:45.187210+0000","last_became_active":"2024-05-09T00:01:45.036668+0000","last_became_peered":"2024-05-09T00:01:45.036668+0000","last_unstale":"2024-05-09T00:01:45.187210+0000","last_undegraded":"2024-05-09T00:01:45.187210+0000","last_fullsized":"2024-05-09T00:01:45.187210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:25.116685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.525580+0000","last_change":"2024-05-09T00:01:44.624973+0000","last_active":"2024-05-09T00:01:46.525580+0000","last_peered":"2024-05-09T00:01:46.525580+0000","last_clean":"2024-05-09T00:01:46.525580+0000","last_became_active":"2024-05-09T00:01:44.624470+0000","last_became_peered":"2024-05-09T00:01:44.624470+0000","last_unstale":"2024-05-09T00:01:46.525580+0000","last_undegraded":"2024-05-09T00:01:46.525580+0000","last_fullsized":"2024-05-09T00:01:46.525580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:22.021060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088654+0000","last_change":"2024-05-09T00:01:45.037414+0000","last_active":"2024-05-09T00:01:47.088654+0000","last_peered":"2024-05-09T00:01:47.088654+0000","last_clean":"2024-05-09T00:01:47.088654+0000","last_became_active":"2024-05-09T00:01:45.037095+0000","last_became_peered":"2024-05-09T00:01:45.037095+0000","last_unstale":"2024-05-09T00:01:47.088654+0000","last_undegraded":"2024-05-09T00:01:47.088654+0000","last_fullsized":"2024-05-09T00:01:47.088654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:29.812977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.049672+0000","last_change":"2024-05-09T00:01:44.614823+0000","last_active":"2024-05-09T00:01:48.049672+0000","last_peered":"2024-05-09T00:01:48.049672+0000","last_clean":"2024-05-09T00:01:48.049672+0000","last_became_active":"2024-05-09T00:01:44.614502+0000","last_became_peered":"2024-05-09T00:01:44.614502+0000","last_unstale":"2024-05-09T00:01:48.049672+0000","last_undegraded":"2024-05-09T00:01:48.049672+0000","last_fullsized":"2024-05-09T00:01:48.049672+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:14.486852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029787+0000","last_change":"2024-05-09T00:01:45.048631+0000","last_active":"2024-05-09T00:01:46.029787+0000","last_peered":"2024-05-09T00:01:46.029787+0000","last_clean":"2024-05-09T00:01:46.029787+0000","last_became_active":"2024-05-09T00:01:45.046691+0000","last_became_peered":"2024-05-09T00:01:45.046691+0000","last_unstale":"2024-05-09T00:01:46.029787+0000","last_undegraded":"2024-05-09T00:01:46.029787+0000","last_fullsized":"2024-05-09T00:01:46.029787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:59:35.017208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.049047+0000","last_change":"2024-05-09T00:01:44.622684+0000","last_active":"2024-05-09T00:01:48.049047+0000","last_peered":"2024-05-09T00:01:48.049047+0000","last_clean":"2024-05-09T00:01:48.049047+0000","last_became_active":"2024-05-09T00:01:44.622301+0000","last_became_peered":"2024-05-09T00:01:44.622301+0000","last_unstale":"2024-05-09T00:01:48.049047+0000","last_undegraded":"2024-05-09T00:01:48.049047+0000","last_fullsized":"2024-05-09T00:01:48.049047+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:38.343729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088905+0000","last_change":"2024-05-09T00:01:45.050240+0000","last_active":"2024-05-09T00:01:47.088905+0000","last_peered":"2024-05-09T00:01:47.088905+0000","last_clean":"2024-05-09T00:01:47.088905+0000","last_became_active":"2024-05-09T00:01:45.049955+0000","last_became_peered":"2024-05-09T00:01:45.049955+0000","last_unstale":"2024-05-09T00:01:47.088905+0000","last_undegraded":"2024-05-09T00:01:47.088905+0000","last_fullsized":"2024-05-09T00:01:47.088905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:56.811853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.049424+0000","last_change":"2024-05-09T00:01:44.618591+0000","last_active":"2024-05-09T00:01:48.049424+0000","last_peered":"2024-05-09T00:01:48.049424+0000","last_clean":"2024-05-09T00:01:48.049424+0000","last_became_active":"2024-05-09T00:01:44.618198+0000","last_became_peered":"2024-05-09T00:01:44.618198+0000","last_unstale":"2024-05-09T00:01:48.049424+0000","last_undegraded":"2024-05-09T00:01:48.049424+0000","last_fullsized":"2024-05-09T00:01:48.049424+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:27.705444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029617+0000","last_change":"2024-05-09T00:01:45.037485+0000","last_active":"2024-05-09T00:01:46.029617+0000","last_peered":"2024-05-09T00:01:46.029617+0000","last_clean":"2024-05-09T00:01:46.029617+0000","last_became_active":"2024-05-09T00:01:45.037150+0000","last_became_peered":"2024-05-09T00:01:45.037150+0000","last_unstale":"2024-05-09T00:01:46.029617+0000","last_undegraded":"2024-05-09T00:01:46.029617+0000","last_fullsized":"2024-05-09T00:01:46.029617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:55.476243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'8","reported_seq":20,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048082+0000","last_change":"2024-05-09T00:01:44.620485+0000","last_active":"2024-05-09T00:01:48.048082+0000","last_peered":"2024-05-09T00:01:48.048082+0000","last_clean":"2024-05-09T00:01:48.048082+0000","last_became_active":"2024-05-09T00:01:44.620004+0000","last_became_peered":"2024-05-09T00:01:44.620004+0000","last_unstale":"2024-05-09T00:01:48.048082+0000","last_undegraded":"2024-05-09T00:01:48.048082+0000","last_fullsized":"2024-05-09T00:01:48.048082+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:58.529038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327607+0000","last_change":"2024-05-09T00:01:45.045581+0000","last_active":"2024-05-09T00:01:45.327607+0000","last_peered":"2024-05-09T00:01:45.327607+0000","last_clean":"2024-05-09T00:01:45.327607+0000","last_became_active":"2024-05-09T00:01:45.045290+0000","last_became_peered":"2024-05-09T00:01:45.045290+0000","last_unstale":"2024-05-09T00:01:45.327607+0000","last_undegraded":"2024-05-09T00:01:45.327607+0000","last_fullsized":"2024-05-09T00:01:45.327607+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:36.860897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":18,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.055577+0000","last_change":"2024-05-09T00:01:44.624145+0000","last_active":"2024-05-09T00:01:49.055577+0000","last_peered":"2024-05-09T00:01:49.055577+0000","last_clean":"2024-05-09T00:01:49.055577+0000","last_became_active":"2024-05-09T00:01:44.623804+0000","last_became_peered":"2024-05-09T00:01:44.623804+0000","last_unstale":"2024-05-09T00:01:49.055577+0000","last_undegraded":"2024-05-09T00:01:49.055577+0000","last_fullsized":"2024-05-09T00:01:49.055577+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:22.366804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028727+0000","last_change":"2024-05-09T00:01:45.044724+0000","last_active":"2024-05-09T00:01:46.028727+0000","last_peered":"2024-05-09T00:01:46.028727+0000","last_clean":"2024-05-09T00:01:46.028727+0000","last_became_active":"2024-05-09T00:01:45.044251+0000","last_became_peered":"2024-05-09T00:01:45.044251+0000","last_unstale":"2024-05-09T00:01:46.028727+0000","last_undegraded":"2024-05-09T00:01:46.028727+0000","last_fullsized":"2024-05-09T00:01:46.028727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:33.525140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048447+0000","last_change":"2024-05-09T00:01:44.620188+0000","last_active":"2024-05-09T00:01:48.048447+0000","last_peered":"2024-05-09T00:01:48.048447+0000","last_clean":"2024-05-09T00:01:48.048447+0000","last_became_active":"2024-05-09T00:01:44.619914+0000","last_became_peered":"2024-05-09T00:01:44.619914+0000","last_unstale":"2024-05-09T00:01:48.048447+0000","last_undegraded":"2024-05-09T00:01:48.048447+0000","last_fullsized":"2024-05-09T00:01:48.048447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:50.349806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325112+0000","last_change":"2024-05-09T00:01:45.044881+0000","last_active":"2024-05-09T00:01:46.325112+0000","last_peered":"2024-05-09T00:01:46.325112+0000","last_clean":"2024-05-09T00:01:46.325112+0000","last_became_active":"2024-05-09T00:01:45.044176+0000","last_became_peered":"2024-05-09T00:01:45.044176+0000","last_unstale":"2024-05-09T00:01:46.325112+0000","last_undegraded":"2024-05-09T00:01:46.325112+0000","last_fullsized":"2024-05-09T00:01:46.325112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:15.672966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088587+0000","last_change":"2024-05-09T00:01:44.616560+0000","last_active":"2024-05-09T00:01:47.088587+0000","last_peered":"2024-05-09T00:01:47.088587+0000","last_clean":"2024-05-09T00:01:47.088587+0000","last_became_active":"2024-05-09T00:01:44.616172+0000","last_became_peered":"2024-05-09T00:01:44.616172+0000","last_unstale":"2024-05-09T00:01:47.088587+0000","last_undegraded":"2024-05-09T00:01:47.088587+0000","last_fullsized":"2024-05-09T00:01:47.088587+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:51.191335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325022+0000","last_change":"2024-05-09T00:01:45.055008+0000","last_active":"2024-05-09T00:01:46.325022+0000","last_peered":"2024-05-09T00:01:46.325022+0000","last_clean":"2024-05-09T00:01:46.325022+0000","last_became_active":"2024-05-09T00:01:45.054626+0000","last_became_peered":"2024-05-09T00:01:45.054626+0000","last_unstale":"2024-05-09T00:01:46.325022+0000","last_undegraded":"2024-05-09T00:01:46.325022+0000","last_fullsized":"2024-05-09T00:01:46.325022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:30.718554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.058339+0000","last_change":"2024-05-09T00:01:44.622089+0000","last_active":"2024-05-09T00:01:49.058339+0000","last_peered":"2024-05-09T00:01:49.058339+0000","last_clean":"2024-05-09T00:01:49.058339+0000","last_became_active":"2024-05-09T00:01:44.621731+0000","last_became_peered":"2024-05-09T00:01:44.621731+0000","last_unstale":"2024-05-09T00:01:49.058339+0000","last_undegraded":"2024-05-09T00:01:49.058339+0000","last_fullsized":"2024-05-09T00:01:49.058339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.276454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029490+0000","last_change":"2024-05-09T00:01:45.058785+0000","last_active":"2024-05-09T00:01:46.029490+0000","last_peered":"2024-05-09T00:01:46.029490+0000","last_clean":"2024-05-09T00:01:46.029490+0000","last_became_active":"2024-05-09T00:01:45.058387+0000","last_became_peered":"2024-05-09T00:01:45.058387+0000","last_unstale":"2024-05-09T00:01:46.029490+0000","last_undegraded":"2024-05-09T00:01:46.029490+0000","last_fullsized":"2024-05-09T00:01:46.029490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:18.868021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088929+0000","last_change":"2024-05-09T00:01:44.615760+0000","last_active":"2024-05-09T00:01:47.088929+0000","last_peered":"2024-05-09T00:01:47.088929+0000","last_clean":"2024-05-09T00:01:47.088929+0000","last_became_active":"2024-05-09T00:01:44.615409+0000","last_became_peered":"2024-05-09T00:01:44.615409+0000","last_unstale":"2024-05-09T00:01:47.088929+0000","last_undegraded":"2024-05-09T00:01:47.088929+0000","last_fullsized":"2024-05-09T00:01:47.088929+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:29:27.672835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850354+0000","last_change":"2024-05-09T00:01:45.044092+0000","last_active":"2024-05-09T00:01:46.850354+0000","last_peered":"2024-05-09T00:01:46.850354+0000","last_clean":"2024-05-09T00:01:46.850354+0000","last_became_active":"2024-05-09T00:01:45.043721+0000","last_became_peered":"2024-05-09T00:01:45.043721+0000","last_unstale":"2024-05-09T00:01:46.850354+0000","last_undegraded":"2024-05-09T00:01:46.850354+0000","last_fullsized":"2024-05-09T00:01:46.850354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:31:50.854168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088299+0000","last_change":"2024-05-09T00:01:44.618910+0000","last_active":"2024-05-09T00:01:47.088299+0000","last_peered":"2024-05-09T00:01:47.088299+0000","last_clean":"2024-05-09T00:01:47.088299+0000","last_became_active":"2024-05-09T00:01:44.618569+0000","last_became_peered":"2024-05-09T00:01:44.618569+0000","last_unstale":"2024-05-09T00:01:47.088299+0000","last_undegraded":"2024-05-09T00:01:47.088299+0000","last_fullsized":"2024-05-09T00:01:47.088299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:40.748747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.090071+0000","last_change":"2024-05-09T00:01:45.047305+0000","last_active":"2024-05-09T00:01:47.090071+0000","last_peered":"2024-05-09T00:01:47.090071+0000","last_clean":"2024-05-09T00:01:47.090071+0000","last_became_active":"2024-05-09T00:01:45.046944+0000","last_became_peered":"2024-05-09T00:01:45.046944+0000","last_unstale":"2024-05-09T00:01:47.090071+0000","last_undegraded":"2024-05-09T00:01:47.090071+0000","last_fullsized":"2024-05-09T00:01:47.090071+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:24:59.065224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088914+0000","last_change":"2024-05-09T00:01:44.620497+0000","last_active":"2024-05-09T00:01:47.088914+0000","last_peered":"2024-05-09T00:01:47.088914+0000","last_clean":"2024-05-09T00:01:47.088914+0000","last_became_active":"2024-05-09T00:01:44.620165+0000","last_became_peered":"2024-05-09T00:01:44.620165+0000","last_unstale":"2024-05-09T00:01:47.088914+0000","last_undegraded":"2024-05-09T00:01:47.088914+0000","last_fullsized":"2024-05-09T00:01:47.088914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:44.514434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089762+0000","last_change":"2024-05-09T00:01:45.045408+0000","last_active":"2024-05-09T00:01:47.089762+0000","last_peered":"2024-05-09T00:01:47.089762+0000","last_clean":"2024-05-09T00:01:47.089762+0000","last_became_active":"2024-05-09T00:01:45.045086+0000","last_became_peered":"2024-05-09T00:01:45.045086+0000","last_unstale":"2024-05-09T00:01:47.089762+0000","last_undegraded":"2024-05-09T00:01:47.089762+0000","last_fullsized":"2024-05-09T00:01:47.089762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:54.568889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029362+0000","last_change":"2024-05-09T00:01:45.057315+0000","last_active":"2024-05-09T00:01:46.029362+0000","last_peered":"2024-05-09T00:01:46.029362+0000","last_clean":"2024-05-09T00:01:46.029362+0000","last_became_active":"2024-05-09T00:01:45.056962+0000","last_became_peered":"2024-05-09T00:01:45.056962+0000","last_unstale":"2024-05-09T00:01:46.029362+0000","last_undegraded":"2024-05-09T00:01:46.029362+0000","last_fullsized":"2024-05-09T00:01:46.029362+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:09:52.136588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.058025+0000","last_change":"2024-05-09T00:01:44.618477+0000","last_active":"2024-05-09T00:01:49.058025+0000","last_peered":"2024-05-09T00:01:49.058025+0000","last_clean":"2024-05-09T00:01:49.058025+0000","last_became_active":"2024-05-09T00:01:44.618154+0000","last_became_peered":"2024-05-09T00:01:44.618154+0000","last_unstale":"2024-05-09T00:01:49.058025+0000","last_undegraded":"2024-05-09T00:01:49.058025+0000","last_fullsized":"2024-05-09T00:01:49.058025+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:24.380644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187242+0000","last_change":"2024-05-09T00:01:45.053772+0000","last_active":"2024-05-09T00:01:45.187242+0000","last_peered":"2024-05-09T00:01:45.187242+0000","last_clean":"2024-05-09T00:01:45.187242+0000","last_became_active":"2024-05-09T00:01:45.053453+0000","last_became_peered":"2024-05-09T00:01:45.053453+0000","last_unstale":"2024-05-09T00:01:45.187242+0000","last_undegraded":"2024-05-09T00:01:45.187242+0000","last_fullsized":"2024-05-09T00:01:45.187242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:46.136845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048648+0000","last_change":"2024-05-09T00:01:44.610200+0000","last_active":"2024-05-09T00:01:48.048648+0000","last_peered":"2024-05-09T00:01:48.048648+0000","last_clean":"2024-05-09T00:01:48.048648+0000","last_became_active":"2024-05-09T00:01:44.609764+0000","last_became_peered":"2024-05-09T00:01:44.609764+0000","last_unstale":"2024-05-09T00:01:48.048648+0000","last_undegraded":"2024-05-09T00:01:48.048648+0000","last_fullsized":"2024-05-09T00:01:48.048648+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:36.122765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":330,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.040899+0000","last_change":"2024-05-09T00:00:57.898648+0000","last_active":"2024-05-09T00:01:45.040899+0000","last_peered":"2024-05-09T00:01:45.040899+0000","last_clean":"2024-05-09T00:01:45.040899+0000","last_became_active":"2024-05-09T00:00:57.898259+0000","last_became_peered":"2024-05-09T00:00:57.898259+0000","last_unstale":"2024-05-09T00:01:45.040899+0000","last_undegraded":"2024-05-09T00:01:45.040899+0000","last_fullsized":"2024-05-09T00:01:45.040899+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:58:35.200738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:58:35.200738+0000","last_clean_scrub_stamp":"2024-05-08T23:58:35.200738+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:47.782068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028515+0000","last_change":"2024-05-09T00:01:45.035407+0000","last_active":"2024-05-09T00:01:46.028515+0000","last_peered":"2024-05-09T00:01:46.028515+0000","last_clean":"2024-05-09T00:01:46.028515+0000","last_became_active":"2024-05-09T00:01:45.035115+0000","last_became_peered":"2024-05-09T00:01:45.035115+0000","last_unstale":"2024-05-09T00:01:46.028515+0000","last_undegraded":"2024-05-09T00:01:46.028515+0000","last_fullsized":"2024-05-09T00:01:46.028515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:23.603196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.056535+0000","last_change":"2024-05-09T00:01:44.622514+0000","last_active":"2024-05-09T00:01:49.056535+0000","last_peered":"2024-05-09T00:01:49.056535+0000","last_clean":"2024-05-09T00:01:49.056535+0000","last_became_active":"2024-05-09T00:01:44.621454+0000","last_became_peered":"2024-05-09T00:01:44.621454+0000","last_unstale":"2024-05-09T00:01:49.056535+0000","last_undegraded":"2024-05-09T00:01:49.056535+0000","last_fullsized":"2024-05-09T00:01:49.056535+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:10.801721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048321+0000","last_change":"2024-05-09T00:01:44.622743+0000","last_active":"2024-05-09T00:01:48.048321+0000","last_peered":"2024-05-09T00:01:48.048321+0000","last_clean":"2024-05-09T00:01:48.048321+0000","last_became_active":"2024-05-09T00:01:44.622304+0000","last_became_peered":"2024-05-09T00:01:44.622304+0000","last_unstale":"2024-05-09T00:01:48.048321+0000","last_undegraded":"2024-05-09T00:01:48.048321+0000","last_fullsized":"2024-05-09T00:01:48.048321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:01.829369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028716+0000","last_change":"2024-05-09T00:01:45.035458+0000","last_active":"2024-05-09T00:01:46.028716+0000","last_peered":"2024-05-09T00:01:46.028716+0000","last_clean":"2024-05-09T00:01:46.028716+0000","last_became_active":"2024-05-09T00:01:45.035140+0000","last_became_peered":"2024-05-09T00:01:45.035140+0000","last_unstale":"2024-05-09T00:01:46.028716+0000","last_undegraded":"2024-05-09T00:01:46.028716+0000","last_fullsized":"2024-05-09T00:01:46.028716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:02:31.258013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089219+0000","last_change":"2024-05-09T00:01:44.615172+0000","last_active":"2024-05-09T00:01:47.089219+0000","last_peered":"2024-05-09T00:01:47.089219+0000","last_clean":"2024-05-09T00:01:47.089219+0000","last_became_active":"2024-05-09T00:01:44.614892+0000","last_became_peered":"2024-05-09T00:01:44.614892+0000","last_unstale":"2024-05-09T00:01:47.089219+0000","last_undegraded":"2024-05-09T00:01:47.089219+0000","last_fullsized":"2024-05-09T00:01:47.089219+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:17.868378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187302+0000","last_change":"2024-05-09T00:01:45.044708+0000","last_active":"2024-05-09T00:01:45.187302+0000","last_peered":"2024-05-09T00:01:45.187302+0000","last_clean":"2024-05-09T00:01:45.187302+0000","last_became_active":"2024-05-09T00:01:45.044451+0000","last_became_peered":"2024-05-09T00:01:45.044451+0000","last_unstale":"2024-05-09T00:01:45.187302+0000","last_undegraded":"2024-05-09T00:01:45.187302+0000","last_fullsized":"2024-05-09T00:01:45.187302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:16.099211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048907+0000","last_change":"2024-05-09T00:01:44.617434+0000","last_active":"2024-05-09T00:01:48.048907+0000","last_peered":"2024-05-09T00:01:48.048907+0000","last_clean":"2024-05-09T00:01:48.048907+0000","last_became_active":"2024-05-09T00:01:44.617017+0000","last_became_peered":"2024-05-09T00:01:44.617017+0000","last_unstale":"2024-05-09T00:01:48.048907+0000","last_undegraded":"2024-05-09T00:01:48.048907+0000","last_fullsized":"2024-05-09T00:01:48.048907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.889962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088825+0000","last_change":"2024-05-09T00:01:45.035749+0000","last_active":"2024-05-09T00:01:47.088825+0000","last_peered":"2024-05-09T00:01:47.088825+0000","last_clean":"2024-05-09T00:01:47.088825+0000","last_became_active":"2024-05-09T00:01:45.034862+0000","last_became_peered":"2024-05-09T00:01:45.034862+0000","last_unstale":"2024-05-09T00:01:47.088825+0000","last_undegraded":"2024-05-09T00:01:47.088825+0000","last_fullsized":"2024-05-09T00:01:47.088825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:20.824467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048783+0000","last_change":"2024-05-09T00:01:44.616652+0000","last_active":"2024-05-09T00:01:48.048783+0000","last_peered":"2024-05-09T00:01:48.048783+0000","last_clean":"2024-05-09T00:01:48.048783+0000","last_became_active":"2024-05-09T00:01:44.616273+0000","last_became_peered":"2024-05-09T00:01:44.616273+0000","last_unstale":"2024-05-09T00:01:48.048783+0000","last_undegraded":"2024-05-09T00:01:48.048783+0000","last_fullsized":"2024-05-09T00:01:48.048783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:12.379909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327536+0000","last_change":"2024-05-09T00:01:45.047020+0000","last_active":"2024-05-09T00:01:45.327536+0000","last_peered":"2024-05-09T00:01:45.327536+0000","last_clean":"2024-05-09T00:01:45.327536+0000","last_became_active":"2024-05-09T00:01:45.046813+0000","last_became_peered":"2024-05-09T00:01:45.046813+0000","last_unstale":"2024-05-09T00:01:45.327536+0000","last_undegraded":"2024-05-09T00:01:45.327536+0000","last_fullsized":"2024-05-09T00:01:45.327536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:53.042258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048301+0000","last_change":"2024-05-09T00:01:44.610843+0000","last_active":"2024-05-09T00:01:48.048301+0000","last_peered":"2024-05-09T00:01:48.048301+0000","last_clean":"2024-05-09T00:01:48.048301+0000","last_became_active":"2024-05-09T00:01:44.610523+0000","last_became_peered":"2024-05-09T00:01:44.610523+0000","last_unstale":"2024-05-09T00:01:48.048301+0000","last_undegraded":"2024-05-09T00:01:48.048301+0000","last_fullsized":"2024-05-09T00:01:48.048301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:58.527344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850071+0000","last_change":"2024-05-09T00:01:45.046259+0000","last_active":"2024-05-09T00:01:46.850071+0000","last_peered":"2024-05-09T00:01:46.850071+0000","last_clean":"2024-05-09T00:01:46.850071+0000","last_became_active":"2024-05-09T00:01:45.045954+0000","last_became_peered":"2024-05-09T00:01:45.045954+0000","last_unstale":"2024-05-09T00:01:46.850071+0000","last_undegraded":"2024-05-09T00:01:46.850071+0000","last_fullsized":"2024-05-09T00:01:46.850071+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:46.569934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039671+0000","last_change":"2024-05-09T00:01:44.616781+0000","last_active":"2024-05-09T00:01:47.039671+0000","last_peered":"2024-05-09T00:01:47.039671+0000","last_clean":"2024-05-09T00:01:47.039671+0000","last_became_active":"2024-05-09T00:01:44.616386+0000","last_became_peered":"2024-05-09T00:01:44.616386+0000","last_unstale":"2024-05-09T00:01:47.039671+0000","last_undegraded":"2024-05-09T00:01:47.039671+0000","last_fullsized":"2024-05-09T00:01:47.039671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:17.073596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187252+0000","last_change":"2024-05-09T00:01:45.046701+0000","last_active":"2024-05-09T00:01:45.187252+0000","last_peered":"2024-05-09T00:01:45.187252+0000","last_clean":"2024-05-09T00:01:45.187252+0000","last_became_active":"2024-05-09T00:01:45.046409+0000","last_became_peered":"2024-05-09T00:01:45.046409+0000","last_unstale":"2024-05-09T00:01:45.187252+0000","last_undegraded":"2024-05-09T00:01:45.187252+0000","last_fullsized":"2024-05-09T00:01:45.187252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:32.178410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.049130+0000","last_change":"2024-05-09T00:01:44.623271+0000","last_active":"2024-05-09T00:01:48.049130+0000","last_peered":"2024-05-09T00:01:48.049130+0000","last_clean":"2024-05-09T00:01:48.049130+0000","last_became_active":"2024-05-09T00:01:44.622863+0000","last_became_peered":"2024-05-09T00:01:44.622863+0000","last_unstale":"2024-05-09T00:01:48.049130+0000","last_undegraded":"2024-05-09T00:01:48.049130+0000","last_fullsized":"2024-05-09T00:01:48.049130+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:58.609140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325100+0000","last_change":"2024-05-09T00:01:45.052296+0000","last_active":"2024-05-09T00:01:46.325100+0000","last_peered":"2024-05-09T00:01:46.325100+0000","last_clean":"2024-05-09T00:01:46.325100+0000","last_became_active":"2024-05-09T00:01:45.051951+0000","last_became_peered":"2024-05-09T00:01:45.051951+0000","last_unstale":"2024-05-09T00:01:46.325100+0000","last_undegraded":"2024-05-09T00:01:46.325100+0000","last_fullsized":"2024-05-09T00:01:46.325100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:46.908629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.056987+0000","last_change":"2024-05-09T00:01:44.620387+0000","last_active":"2024-05-09T00:01:49.056987+0000","last_peered":"2024-05-09T00:01:49.056987+0000","last_clean":"2024-05-09T00:01:49.056987+0000","last_became_active":"2024-05-09T00:01:44.620024+0000","last_became_peered":"2024-05-09T00:01:44.620024+0000","last_unstale":"2024-05-09T00:01:49.056987+0000","last_undegraded":"2024-05-09T00:01:49.056987+0000","last_fullsized":"2024-05-09T00:01:49.056987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:31.599273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325195+0000","last_change":"2024-05-09T00:01:45.050092+0000","last_active":"2024-05-09T00:01:46.325195+0000","last_peered":"2024-05-09T00:01:46.325195+0000","last_clean":"2024-05-09T00:01:46.325195+0000","last_became_active":"2024-05-09T00:01:45.049794+0000","last_became_peered":"2024-05-09T00:01:45.049794+0000","last_unstale":"2024-05-09T00:01:46.325195+0000","last_undegraded":"2024-05-09T00:01:46.325195+0000","last_fullsized":"2024-05-09T00:01:46.325195+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:56.932513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.525700+0000","last_change":"2024-05-09T00:01:44.609940+0000","last_active":"2024-05-09T00:01:46.525700+0000","last_peered":"2024-05-09T00:01:46.525700+0000","last_clean":"2024-05-09T00:01:46.525700+0000","last_became_active":"2024-05-09T00:01:44.609593+0000","last_became_peered":"2024-05-09T00:01:44.609593+0000","last_unstale":"2024-05-09T00:01:46.525700+0000","last_undegraded":"2024-05-09T00:01:46.525700+0000","last_fullsized":"2024-05-09T00:01:46.525700+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:09.671548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325171+0000","last_change":"2024-05-09T00:01:45.042533+0000","last_active":"2024-05-09T00:01:46.325171+0000","last_peered":"2024-05-09T00:01:46.325171+0000","last_clean":"2024-05-09T00:01:46.325171+0000","last_became_active":"2024-05-09T00:01:45.042155+0000","last_became_peered":"2024-05-09T00:01:45.042155+0000","last_unstale":"2024-05-09T00:01:46.325171+0000","last_undegraded":"2024-05-09T00:01:46.325171+0000","last_fullsized":"2024-05-09T00:01:46.325171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:36.519165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.051979+0000","last_change":"2024-05-09T00:01:44.617518+0000","last_active":"2024-05-09T00:01:45.051979+0000","last_peered":"2024-05-09T00:01:45.051979+0000","last_clean":"2024-05-09T00:01:45.051979+0000","last_became_active":"2024-05-09T00:01:44.617196+0000","last_became_peered":"2024-05-09T00:01:44.617196+0000","last_unstale":"2024-05-09T00:01:45.051979+0000","last_undegraded":"2024-05-09T00:01:45.051979+0000","last_fullsized":"2024-05-09T00:01:45.051979+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:47.062855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325220+0000","last_change":"2024-05-09T00:01:45.053962+0000","last_active":"2024-05-09T00:01:46.325220+0000","last_peered":"2024-05-09T00:01:46.325220+0000","last_clean":"2024-05-09T00:01:46.325220+0000","last_became_active":"2024-05-09T00:01:45.053637+0000","last_became_peered":"2024-05-09T00:01:45.053637+0000","last_unstale":"2024-05-09T00:01:46.325220+0000","last_undegraded":"2024-05-09T00:01:46.325220+0000","last_fullsized":"2024-05-09T00:01:46.325220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:18.188806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850155+0000","last_change":"2024-05-09T00:01:45.055532+0000","last_active":"2024-05-09T00:01:46.850155+0000","last_peered":"2024-05-09T00:01:46.850155+0000","last_clean":"2024-05-09T00:01:46.850155+0000","last_became_active":"2024-05-09T00:01:45.054939+0000","last_became_peered":"2024-05-09T00:01:45.054939+0000","last_unstale":"2024-05-09T00:01:46.850155+0000","last_undegraded":"2024-05-09T00:01:46.850155+0000","last_fullsized":"2024-05-09T00:01:46.850155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.919492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039891+0000","last_change":"2024-05-09T00:01:45.053752+0000","last_active":"2024-05-09T00:01:47.039891+0000","last_peered":"2024-05-09T00:01:47.039891+0000","last_clean":"2024-05-09T00:01:47.039891+0000","last_became_active":"2024-05-09T00:01:45.053409+0000","last_became_peered":"2024-05-09T00:01:45.053409+0000","last_unstale":"2024-05-09T00:01:47.039891+0000","last_undegraded":"2024-05-09T00:01:47.039891+0000","last_fullsized":"2024-05-09T00:01:47.039891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:12.517211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039813+0000","last_change":"2024-05-09T00:01:45.036145+0000","last_active":"2024-05-09T00:01:47.039813+0000","last_peered":"2024-05-09T00:01:47.039813+0000","last_clean":"2024-05-09T00:01:47.039813+0000","last_became_active":"2024-05-09T00:01:45.035839+0000","last_became_peered":"2024-05-09T00:01:45.035839+0000","last_unstale":"2024-05-09T00:01:47.039813+0000","last_undegraded":"2024-05-09T00:01:47.039813+0000","last_fullsized":"2024-05-09T00:01:47.039813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:03:17.630399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088680+0000","last_change":"2024-05-09T00:01:45.032875+0000","last_active":"2024-05-09T00:01:47.088680+0000","last_peered":"2024-05-09T00:01:47.088680+0000","last_clean":"2024-05-09T00:01:47.088680+0000","last_became_active":"2024-05-09T00:01:45.032552+0000","last_became_peered":"2024-05-09T00:01:45.032552+0000","last_unstale":"2024-05-09T00:01:47.088680+0000","last_undegraded":"2024-05-09T00:01:47.088680+0000","last_fullsized":"2024-05-09T00:01:47.088680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:17.244204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028730+0000","last_change":"2024-05-09T00:01:45.032427+0000","last_active":"2024-05-09T00:01:46.028730+0000","last_peered":"2024-05-09T00:01:46.028730+0000","last_clean":"2024-05-09T00:01:46.028730+0000","last_became_active":"2024-05-09T00:01:45.032038+0000","last_became_peered":"2024-05-09T00:01:45.032038+0000","last_unstale":"2024-05-09T00:01:46.028730+0000","last_undegraded":"2024-05-09T00:01:46.028730+0000","last_fullsized":"2024-05-09T00:01:46.028730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.495291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850245+0000","last_change":"2024-05-09T00:01:45.053080+0000","last_active":"2024-05-09T00:01:46.850245+0000","last_peered":"2024-05-09T00:01:46.850245+0000","last_clean":"2024-05-09T00:01:46.850245+0000","last_became_active":"2024-05-09T00:01:45.052728+0000","last_became_peered":"2024-05-09T00:01:45.052728+0000","last_unstale":"2024-05-09T00:01:46.850245+0000","last_undegraded":"2024-05-09T00:01:46.850245+0000","last_fullsized":"2024-05-09T00:01:46.850245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:59.631827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.040022+0000","last_change":"2024-05-09T00:01:45.044489+0000","last_active":"2024-05-09T00:01:47.040022+0000","last_peered":"2024-05-09T00:01:47.040022+0000","last_clean":"2024-05-09T00:01:47.040022+0000","last_became_active":"2024-05-09T00:01:45.044139+0000","last_became_peered":"2024-05-09T00:01:45.044139+0000","last_unstale":"2024-05-09T00:01:47.040022+0000","last_undegraded":"2024-05-09T00:01:47.040022+0000","last_fullsized":"2024-05-09T00:01:47.040022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:57.932238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187290+0000","last_change":"2024-05-09T00:01:45.050829+0000","last_active":"2024-05-09T00:01:45.187290+0000","last_peered":"2024-05-09T00:01:45.187290+0000","last_clean":"2024-05-09T00:01:45.187290+0000","last_became_active":"2024-05-09T00:01:45.050410+0000","last_became_peered":"2024-05-09T00:01:45.050410+0000","last_unstale":"2024-05-09T00:01:45.187290+0000","last_undegraded":"2024-05-09T00:01:45.187290+0000","last_fullsized":"2024-05-09T00:01:45.187290+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:08.738918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029150+0000","last_change":"2024-05-09T00:01:45.053957+0000","last_active":"2024-05-09T00:01:46.029150+0000","last_peered":"2024-05-09T00:01:46.029150+0000","last_clean":"2024-05-09T00:01:46.029150+0000","last_became_active":"2024-05-09T00:01:45.053487+0000","last_became_peered":"2024-05-09T00:01:45.053487+0000","last_unstale":"2024-05-09T00:01:46.029150+0000","last_undegraded":"2024-05-09T00:01:46.029150+0000","last_fullsized":"2024-05-09T00:01:46.029150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:35.131361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187232+0000","last_change":"2024-05-09T00:01:45.050653+0000","last_active":"2024-05-09T00:01:45.187232+0000","last_peered":"2024-05-09T00:01:45.187232+0000","last_clean":"2024-05-09T00:01:45.187232+0000","last_became_active":"2024-05-09T00:01:45.050322+0000","last_became_peered":"2024-05-09T00:01:45.050322+0000","last_unstale":"2024-05-09T00:01:45.187232+0000","last_undegraded":"2024-05-09T00:01:45.187232+0000","last_fullsized":"2024-05-09T00:01:45.187232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:11:45.137945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029679+0000","last_change":"2024-05-09T00:01:45.044757+0000","last_active":"2024-05-09T00:01:46.029679+0000","last_peered":"2024-05-09T00:01:46.029679+0000","last_clean":"2024-05-09T00:01:46.029679+0000","last_became_active":"2024-05-09T00:01:45.044464+0000","last_became_peered":"2024-05-09T00:01:45.044464+0000","last_unstale":"2024-05-09T00:01:46.029679+0000","last_undegraded":"2024-05-09T00:01:46.029679+0000","last_fullsized":"2024-05-09T00:01:46.029679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:44.402750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028903+0000","last_change":"2024-05-09T00:01:45.044515+0000","last_active":"2024-05-09T00:01:46.028903+0000","last_peered":"2024-05-09T00:01:46.028903+0000","last_clean":"2024-05-09T00:01:46.028903+0000","last_became_active":"2024-05-09T00:01:45.044209+0000","last_became_peered":"2024-05-09T00:01:45.044209+0000","last_unstale":"2024-05-09T00:01:46.028903+0000","last_undegraded":"2024-05-09T00:01:46.028903+0000","last_fullsized":"2024-05-09T00:01:46.028903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:18.523680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850098+0000","last_change":"2024-05-09T00:01:45.044254+0000","last_active":"2024-05-09T00:01:46.850098+0000","last_peered":"2024-05-09T00:01:46.850098+0000","last_clean":"2024-05-09T00:01:46.850098+0000","last_became_active":"2024-05-09T00:01:45.043220+0000","last_became_peered":"2024-05-09T00:01:45.043220+0000","last_unstale":"2024-05-09T00:01:46.850098+0000","last_undegraded":"2024-05-09T00:01:46.850098+0000","last_fullsized":"2024-05-09T00:01:46.850098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:39:53.986814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246178,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4897,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":112,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":217088,"data_stored":33129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579914,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":847872,"data_stored":409787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]}]},{"osd":10,"up_from":67,"seq":287762808845,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32032,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713120,"statfs":{"total":95995035648,"available":95962234880,"internally_reserved":0,"allocated":942080,"data_stored":1003249,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]},{"osd":9,"up_from":62,"seq":266287972369,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31944,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713208,"statfs":{"total":95995035648,"available":95962324992,"internally_reserved":0,"allocated":839680,"data_stored":401799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.31},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.432},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.53300000000000003}]},{"osd":8,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.625},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.65300000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":8,"up_from":55,"seq":236223201300,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":864256,"data_stored":410194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.65800000000000003}]},{"osd":2,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.499},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.374}]},{"osd":4,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu May 9 00:01:19 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.71999999999999997}]},{"osd":9,"last update":"Thu May 9 00:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.68200000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]}]},{"osd":7,"up_from":48,"seq":206158430232,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":913408,"data_stored":1002244,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.376},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.443}]},{"osd":1,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.497},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.59999999999999998}]},{"osd":4,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.76000000000000001}]},{"osd":5,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.746}]},{"osd":6,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.63100000000000001}]},{"osd":8,"last update":"Thu May 9 00:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.85099999999999998}]},{"osd":9,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.71499999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":6,"up_from":43,"seq":184683593756,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31940,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713212,"statfs":{"total":95995035648,"available":95962329088,"internally_reserved":0,"allocated":847872,"data_stored":409787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.57299999999999995}]},{"osd":2,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68100000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.505,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.91800000000000004}]},{"osd":5,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63,"15min":0.63},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.627},{"interface":"front","average":{"1min":0.622,"5min":0.65200000000000002,"15min":0.65700000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84099999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu May 9 00:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.751},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.95199999999999996}]},{"osd":8,"last update":"Thu May 9 00:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.878},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77800000000000002}]},{"osd":9,"last update":"Thu May 9 00:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.72999999999999998}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":864256,"data_stored":417953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.35199999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.35799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51000000000000001,"15min":0.497},"min":{"1min":0.32700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.29999999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu May 9 00:00:52 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.501,"15min":0.498},"min":{"1min":0.35599999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.67400000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.376,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.55000000000000004}]},{"osd":4,"last update":"Thu May 9 00:01:15 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.41299999999999998,"15min":0.40300000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.42499999999999999,"15min":0.41699999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu May 9 00:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu May 9 00:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.58099999999999996,"15min":0.57399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.504}]},{"osd":7,"last update":"Thu May 9 00:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.53500000000000003}]},{"osd":8,"last update":"Thu May 9 00:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.67300000000000004}]},{"osd":9,"last update":"Thu May 9 00:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.58299999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":860160,"data_stored":410481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 9 00:01:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.51200000000000001,"15min":0.48599999999999999},"min":{"1min":0.32000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.53100000000000003,"15min":0.50800000000000001},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80300000000000005,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68100000000000005}]},{"osd":2,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.52300000000000002,"15min":0.504},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81599999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.39500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu May 9 00:00:56 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.40400000000000003,"15min":0.39800000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.433},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.39900000000000002,"15min":0.39400000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu May 9 00:01:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.50900000000000001,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.54700000000000004,"15min":0.54200000000000004},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.92100000000000004,"5min":1.075,"15min":1.075},"last":0.622}]},{"osd":5,"last update":"Thu May 9 00:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu May 9 00:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.34100000000000003}]},{"osd":7,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.56100000000000005}]},{"osd":8,"last update":"Thu May 9 00:01:23 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.72799999999999998}]},{"osd":9,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.42799999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":2,"up_from":17,"seq":73014444074,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":868352,"data_stored":411340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48299999999999998,"15min":0.46300000000000002},"min":{"1min":0.34499999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.48899999999999999,"15min":0.47399999999999998},"min":{"1min":0.39600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu May 9 00:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.37,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.499,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu May 9 00:00:51 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.503,"15min":0.505},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.503}]},{"osd":4,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.42099999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu May 9 00:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.44500000000000001,"15min":0.433},"min":{"1min":0.31,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.441},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.45900000000000002,"15min":0.44900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.39000000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.83099999999999996}]},{"osd":7,"last update":"Thu May 9 00:01:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67100000000000004}]},{"osd":8,"last update":"Thu May 9 00:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.627},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54700000000000004}]},{"osd":9,"last update":"Thu May 9 00:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.754}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]}]},{"osd":3,"up_from":24,"seq":103079215142,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31960,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713192,"statfs":{"total":95995035648,"available":95962308608,"internally_reserved":0,"allocated":864256,"data_stored":410071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.215,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35099999999999998,"15min":0.35199999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu May 9 00:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.441},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76100000000000001,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu May 9 00:00:54 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.375,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.42499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.66900000000000004}]},{"osd":4,"last update":"Thu May 9 00:01:11 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.38500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu May 9 00:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.42399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.52300000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu May 9 00:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.44500000000000001,"15min":0.439},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.31,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42999999999999999}]},{"osd":7,"last update":"Thu May 9 00:01:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51100000000000001}]},{"osd":8,"last update":"Thu May 9 00:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.46700000000000003}]},{"osd":9,"last update":"Thu May 9 00:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.40799999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":4,"up_from":31,"seq":133143986211,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31948,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713204,"statfs":{"total":95995035648,"available":95962320896,"internally_reserved":0,"allocated":851968,"data_stored":409809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.39400000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79800000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.34799999999999998},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.36799999999999999,"15min":0.36199999999999999},"min":{"1min":0.27100000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.50800000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.376}]},{"osd":2,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.52300000000000002,"15min":0.50800000000000001},"min":{"1min":0.46400000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.51300000000000001,"15min":0.497},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.624}]},{"osd":3,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.52500000000000002,"15min":0.51100000000000001},"min":{"1min":0.42599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.51000000000000001,"15min":0.496},"min":{"1min":0.44500000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu May 9 00:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57899999999999996,"15min":0.57099999999999995},"min":{"1min":0.441,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.46700000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu May 9 00:00:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu May 9 00:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58599999999999997}]},{"osd":8,"last update":"Thu May 9 00:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.77500000000000002}]},{"osd":9,"last update":"Thu May 9 00:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.63900000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":5,"up_from":36,"seq":154618822688,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32016,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713136,"statfs":{"total":95995035648,"available":95962251264,"internally_reserved":0,"allocated":925696,"data_stored":1001976,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.498,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.49399999999999999,"15min":0.49099999999999999},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.72899999999999998}]},{"osd":2,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.35699999999999998,"15min":0.34799999999999998},"min":{"1min":0.29099999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.437},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.371,"15min":0.36799999999999999},"min":{"1min":0.27000000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.39400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73599999999999999,"5min":0.754,"15min":0.754},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu May 9 00:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.90000000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.41999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.70099999999999996}]},{"osd":8,"last update":"Thu May 9 00:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.58199999999999996}]},{"osd":9,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.754}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33999,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33999,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":20849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:01:53.546 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-09T00:01:53.547 INFO:tasks.cephadm:Setting up client nodes... 2024-05-09T00:01:53.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-09T00:01:53.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:53 smithi171 ceph-mon[47351]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:53.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:53 smithi171 ceph-mon[47351]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:01:53.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:53 smithi171 ceph-mon[47351]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-05-09T00:01:53.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:53 smithi171 ceph-mon[47351]: pgmap v222: 97 pgs: 97 active+clean; 581 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 4.8 KiB/s wr, 16 op/s 2024-05-09T00:01:53.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:53 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3079699174' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:01:53.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:53 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1538000357' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:53.797 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:01:54.181 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:54 smithi081 ceph-mon[42474]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:01:54.181 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:54 smithi081 ceph-mon[42474]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:01:54.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:54 smithi150 ceph-mon[46187]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:01:54.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:54 smithi150 ceph-mon[46187]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:01:54.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:54 smithi171 ceph-mon[47351]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:01:54.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:54 smithi171 ceph-mon[47351]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:01:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.729+0000 7faa8521f700 1 -- 172.21.15.81:0/132212652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa80102c50 msgr2=0x7faa80109500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.729+0000 7faa8521f700 1 --2- 172.21.15.81:0/132212652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa80102c50 0x7faa80109500 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7faa7800b0a0 tx=0x7faa7800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.729+0000 7faa8521f700 1 -- 172.21.15.81:0/132212652 shutdown_connections 2024-05-09T00:01:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.729+0000 7faa8521f700 1 --2- 172.21.15.81:0/132212652 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa800ff2d0 0x7faa800ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.729+0000 7faa8521f700 1 --2- 172.21.15.81:0/132212652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa80102c50 0x7faa80109500 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.729+0000 7faa8521f700 1 --2- 172.21.15.81:0/132212652 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa801022b0 0x7faa80102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.729+0000 7faa8521f700 1 -- 172.21.15.81:0/132212652 >> 172.21.15.81:0/132212652 conn(0x7faa800fac30 msgr2=0x7faa800fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:54.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.729+0000 7faa8521f700 1 -- 172.21.15.81:0/132212652 shutdown_connections 2024-05-09T00:01:54.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.729+0000 7faa8521f700 1 -- 172.21.15.81:0/132212652 wait complete. 2024-05-09T00:01:54.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.730+0000 7faa8521f700 1 Processor -- start 2024-05-09T00:01:54.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.730+0000 7faa8521f700 1 -- start start 2024-05-09T00:01:54.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.730+0000 7faa8521f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa800ff2d0 0x7faa80196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:54.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.730+0000 7faa8521f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa801022b0 0x7faa80197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:54.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.730+0000 7faa8521f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa80102c50 0x7faa8019e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.730+0000 7faa8521f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8019eb00 con 0x7faa800ff2d0 2024-05-09T00:01:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.730+0000 7faa8521f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8019ec40 con 0x7faa80102c50 2024-05-09T00:01:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.730+0000 7faa8521f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8019edd0 con 0x7faa801022b0 2024-05-09T00:01:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.730+0000 7faa7ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa800ff2d0 0x7faa80196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.730+0000 7faa7ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa800ff2d0 0x7faa80196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48516/0 (socket says 172.21.15.81:48516) 2024-05-09T00:01:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.730+0000 7faa7ed9d700 1 -- 172.21.15.81:0/3773374627 learned_addr learned my addr 172.21.15.81:0/3773374627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.731+0000 7faa7e59c700 1 --2- 172.21.15.81:0/3773374627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa801022b0 0x7faa80197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.731+0000 7faa7ed9d700 1 -- 172.21.15.81:0/3773374627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa801022b0 msgr2=0x7faa80197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.731+0000 7faa7ed9d700 1 --2- 172.21.15.81:0/3773374627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa801022b0 0x7faa80197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.731+0000 7faa7ed9d700 1 -- 172.21.15.81:0/3773374627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa80102c50 msgr2=0x7faa8019e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.731+0000 7faa7ed9d700 1 --2- 172.21.15.81:0/3773374627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa80102c50 0x7faa8019e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.731+0000 7faa7ed9d700 1 -- 172.21.15.81:0/3773374627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa78009d00 con 0x7faa800ff2d0 2024-05-09T00:01:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.731+0000 7faa7ed9d700 1 --2- 172.21.15.81:0/3773374627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa800ff2d0 0x7faa80196fc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa7000c9a0 tx=0x7faa7000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.731+0000 7faa67fff700 1 -- 172.21.15.81:0/3773374627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70004220 con 0x7faa800ff2d0 2024-05-09T00:01:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.731+0000 7faa8521f700 1 -- 172.21.15.81:0/3773374627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8019f0b0 con 0x7faa800ff2d0 2024-05-09T00:01:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.731+0000 7faa67fff700 1 -- 172.21.15.81:0/3773374627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa70007d20 con 0x7faa800ff2d0 2024-05-09T00:01:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.731+0000 7faa67fff700 1 -- 172.21.15.81:0/3773374627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70003d00 con 0x7faa800ff2d0 2024-05-09T00:01:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.731+0000 7faa8521f700 1 -- 172.21.15.81:0/3773374627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8019f600 con 0x7faa800ff2d0 2024-05-09T00:01:54.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.732+0000 7faa8521f700 1 -- 172.21.15.81:0/3773374627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa80108470 con 0x7faa800ff2d0 2024-05-09T00:01:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.733+0000 7faa67fff700 1 -- 172.21.15.81:0/3773374627 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7faa70004380 con 0x7faa800ff2d0 2024-05-09T00:01:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.734+0000 7faa67fff700 1 --2- 172.21.15.81:0/3773374627 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7faa680a11b0 0x7faa680a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.734+0000 7faa7e59c700 1 --2- 172.21.15.81:0/3773374627 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7faa680a11b0 0x7faa680a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.734+0000 7faa67fff700 1 -- 172.21.15.81:0/3773374627 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7faa700cc890 con 0x7faa800ff2d0 2024-05-09T00:01:54.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.734+0000 7faa7e59c700 1 --2- 172.21.15.81:0/3773374627 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7faa680a11b0 0x7faa680a3670 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faa74005950 tx=0x7faa740058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:54.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:54.738+0000 7faa67fff700 1 -- 172.21.15.81:0/3773374627 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7faa70096070 con 0x7faa800ff2d0 2024-05-09T00:01:55.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:55.010+0000 7faa8521f700 1 -- 172.21.15.81:0/3773374627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7faa8010c820 con 0x7faa800ff2d0 2024-05-09T00:01:55.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:55.014+0000 7faa67fff700 1 -- 172.21.15.81:0/3773374627 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7faa7001d0f0 con 0x7faa800ff2d0 2024-05-09T00:01:55.008 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-05-09T00:01:55.009 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQBzEjxm7la1ABAAUaRWIoKCzA/2qqjFyYAmdw== 2024-05-09T00:01:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:55.017+0000 7faa8521f700 1 -- 172.21.15.81:0/3773374627 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7faa680a11b0 msgr2=0x7faa680a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:55.017+0000 7faa8521f700 1 --2- 172.21.15.81:0/3773374627 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7faa680a11b0 0x7faa680a3670 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faa74005950 tx=0x7faa740058e0 comp rx=0 tx=0).stop 2024-05-09T00:01:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:55.017+0000 7faa8521f700 1 -- 172.21.15.81:0/3773374627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa800ff2d0 msgr2=0x7faa80196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:55.017+0000 7faa8521f700 1 --2- 172.21.15.81:0/3773374627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa800ff2d0 0x7faa80196fc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa7000c9a0 tx=0x7faa7000cd60 comp rx=0 tx=0).stop 2024-05-09T00:01:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:55.017+0000 7faa8521f700 1 -- 172.21.15.81:0/3773374627 shutdown_connections 2024-05-09T00:01:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:55.017+0000 7faa8521f700 1 --2- 172.21.15.81:0/3773374627 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7faa680a11b0 0x7faa680a3670 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:55.017+0000 7faa8521f700 1 --2- 172.21.15.81:0/3773374627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa80102c50 0x7faa8019e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:55.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:55.017+0000 7faa8521f700 1 --2- 172.21.15.81:0/3773374627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa800ff2d0 0x7faa80196fc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:55.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:55.017+0000 7faa8521f700 1 --2- 172.21.15.81:0/3773374627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa801022b0 0x7faa80197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:55.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:55.017+0000 7faa8521f700 1 -- 172.21.15.81:0/3773374627 >> 172.21.15.81:0/3773374627 conn(0x7faa800fac30 msgr2=0x7faa801055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:55.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:55.017+0000 7faa8521f700 1 -- 172.21.15.81:0/3773374627 shutdown_connections 2024-05-09T00:01:55.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:55.017+0000 7faa8521f700 1 -- 172.21.15.81:0/3773374627 wait complete. 2024-05-09T00:01:55.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:55 smithi081 ceph-mon[42474]: pgmap v223: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8.4 KiB/s wr, 19 op/s 2024-05-09T00:01:55.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:55 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3773374627' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T00:01:55.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:55 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3773374627' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T00:01:55.407 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-09T00:01:55.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-09T00:01:55.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-09T00:01:55.448 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-09T00:01:55.448 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-09T00:01:55.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-09T00:01:55.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:55 smithi150 ceph-mon[46187]: pgmap v223: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8.4 KiB/s wr, 19 op/s 2024-05-09T00:01:55.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:55 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3773374627' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T00:01:55.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:55 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3773374627' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T00:01:55.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:55 smithi171 ceph-mon[47351]: pgmap v223: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8.4 KiB/s wr, 19 op/s 2024-05-09T00:01:55.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:55 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3773374627' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-09T00:01:55.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:55 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3773374627' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-09T00:01:55.707 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:01:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.669+0000 7f907683c700 1 -- 172.21.15.81:0/941736805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90701019e0 msgr2=0x7f907010ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.669+0000 7f907683c700 1 --2- 172.21.15.81:0/941736805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90701019e0 0x7f907010ddf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f906800b0a0 tx=0x7f906800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.669+0000 7f907683c700 1 -- 172.21.15.81:0/941736805 shutdown_connections 2024-05-09T00:01:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.669+0000 7f907683c700 1 --2- 172.21.15.81:0/941736805 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90701019e0 0x7f907010ddf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.669+0000 7f907683c700 1 --2- 172.21.15.81:0/941736805 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9070107040 0x7f9070107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.669+0000 7f907683c700 1 --2- 172.21.15.81:0/941736805 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9070101020 0x7f90701014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.669+0000 7f907683c700 1 -- 172.21.15.81:0/941736805 >> 172.21.15.81:0/941736805 conn(0x7f9070078100 msgr2=0x7f9070078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.669+0000 7f907683c700 1 -- 172.21.15.81:0/941736805 shutdown_connections 2024-05-09T00:01:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.670+0000 7f907683c700 1 -- 172.21.15.81:0/941736805 wait complete. 2024-05-09T00:01:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.670+0000 7f907683c700 1 Processor -- start 2024-05-09T00:01:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.670+0000 7f907683c700 1 -- start start 2024-05-09T00:01:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.670+0000 7f907683c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9070101020 0x7f9070197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f907683c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90701019e0 0x7f9070197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f907683c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9070107040 0x7f907019bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f907683c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907019c300 con 0x7f90701019e0 2024-05-09T00:01:56.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f907683c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907019c470 con 0x7f9070107040 2024-05-09T00:01:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f907683c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907019c630 con 0x7f9070101020 2024-05-09T00:01:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f906f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90701019e0 0x7f9070197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f906f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90701019e0 0x7f9070197940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48534/0 (socket says 172.21.15.81:48534) 2024-05-09T00:01:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f906f7fe700 1 -- 172.21.15.81:0/1402924522 learned_addr learned my addr 172.21.15.81:0/1402924522 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f906ffff700 1 --2- 172.21.15.81:0/1402924522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9070101020 0x7f9070197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f906f7fe700 1 -- 172.21.15.81:0/1402924522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9070101020 msgr2=0x7f9070197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f9074dd9700 1 --2- 172.21.15.81:0/1402924522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9070107040 0x7f907019bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f906f7fe700 1 --2- 172.21.15.81:0/1402924522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9070101020 0x7f9070197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f906f7fe700 1 -- 172.21.15.81:0/1402924522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9070107040 msgr2=0x7f907019bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f906f7fe700 1 --2- 172.21.15.81:0/1402924522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9070107040 0x7f907019bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f906f7fe700 1 -- 172.21.15.81:0/1402924522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9068009d00 con 0x7f90701019e0 2024-05-09T00:01:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f906f7fe700 1 --2- 172.21.15.81:0/1402924522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90701019e0 0x7f9070197940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f906400c9b0 tx=0x7f906400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f906d7fa700 1 -- 172.21.15.81:0/1402924522 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064007b00 con 0x7f90701019e0 2024-05-09T00:01:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f907683c700 1 -- 172.21.15.81:0/1402924522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907019c910 con 0x7f90701019e0 2024-05-09T00:01:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f906d7fa700 1 -- 172.21.15.81:0/1402924522 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9064007c60 con 0x7f90701019e0 2024-05-09T00:01:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f906d7fa700 1 -- 172.21.15.81:0/1402924522 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064018660 con 0x7f90701019e0 2024-05-09T00:01:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.671+0000 7f907683c700 1 -- 172.21.15.81:0/1402924522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90701a4170 con 0x7f90701019e0 2024-05-09T00:01:56.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.672+0000 7f907683c700 1 -- 172.21.15.81:0/1402924522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90701094d0 con 0x7f90701019e0 2024-05-09T00:01:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.673+0000 7f906d7fa700 1 -- 172.21.15.81:0/1402924522 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f906400f450 con 0x7f90701019e0 2024-05-09T00:01:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.674+0000 7f906d7fa700 1 --2- 172.21.15.81:0/1402924522 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f90580a11b0 0x7f90580a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:56.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.674+0000 7f906ffff700 1 --2- 172.21.15.81:0/1402924522 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f90580a11b0 0x7f90580a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.674+0000 7f906d7fa700 1 -- 172.21.15.81:0/1402924522 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f90640ccb70 con 0x7f90701019e0 2024-05-09T00:01:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.674+0000 7f906ffff700 1 --2- 172.21.15.81:0/1402924522 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f90580a11b0 0x7f90580a3670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9060005950 tx=0x7f906000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.678+0000 7f906d7fa700 1 -- 172.21.15.81:0/1402924522 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f90640963e0 con 0x7f90701019e0 2024-05-09T00:01:56.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.925+0000 7f907683c700 1 -- 172.21.15.81:0/1402924522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9070102680 con 0x7f90701019e0 2024-05-09T00:01:56.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.929+0000 7f906d7fa700 1 -- 172.21.15.81:0/1402924522 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260284 (secure 0 0 0) 0x7f9064099a00 con 0x7f90701019e0 2024-05-09T00:01:56.928 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:56.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.932+0000 7f907683c700 1 -- 172.21.15.81:0/1402924522 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f90580a11b0 msgr2=0x7f90580a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:56.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.932+0000 7f907683c700 1 --2- 172.21.15.81:0/1402924522 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f90580a11b0 0x7f90580a3670 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9060005950 tx=0x7f906000b410 comp rx=0 tx=0).stop 2024-05-09T00:01:56.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.932+0000 7f907683c700 1 -- 172.21.15.81:0/1402924522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90701019e0 msgr2=0x7f9070197940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:56.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.932+0000 7f907683c700 1 --2- 172.21.15.81:0/1402924522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90701019e0 0x7f9070197940 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f906400c9b0 tx=0x7f906400ccc0 comp rx=0 tx=0).stop 2024-05-09T00:01:56.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.932+0000 7f907683c700 1 -- 172.21.15.81:0/1402924522 shutdown_connections 2024-05-09T00:01:56.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.932+0000 7f907683c700 1 --2- 172.21.15.81:0/1402924522 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f90580a11b0 0x7f90580a3670 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:56.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.932+0000 7f907683c700 1 --2- 172.21.15.81:0/1402924522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9070107040 0x7f907019bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:56.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.932+0000 7f907683c700 1 --2- 172.21.15.81:0/1402924522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9070101020 0x7f9070197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:56.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.932+0000 7f907683c700 1 --2- 172.21.15.81:0/1402924522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90701019e0 0x7f9070197940 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:56.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.933+0000 7f907683c700 1 -- 172.21.15.81:0/1402924522 >> 172.21.15.81:0/1402924522 conn(0x7f9070078100 msgr2=0x7f90700ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:56.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.933+0000 7f907683c700 1 -- 172.21.15.81:0/1402924522 shutdown_connections 2024-05-09T00:01:56.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:56.933+0000 7f907683c700 1 -- 172.21.15.81:0/1402924522 wait complete. 2024-05-09T00:01:57.301 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1458411552},{"type":"v1","addr":"172.21.15.81:6801","nonce":1458411552}]},"active_addr":"172.21.15.81:6801/1458411552","active_change":"2024-05-08T23:56:46.209864+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.81:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1755507053}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":3633496844}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1903231103}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":907969237}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":589390516}]}]} 2024-05-09T00:01:57.307 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-09T00:01:57.307 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-09T00:01:57.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T00:01:57.530 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:01:57.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:57 smithi081 ceph-mon[42474]: pgmap v224: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2024-05-09T00:01:57.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:57 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1402924522' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T00:01:57.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:57 smithi150 ceph-mon[46187]: pgmap v224: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2024-05-09T00:01:57.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:57 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1402924522' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T00:01:57.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:57 smithi171 ceph-mon[47351]: pgmap v224: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2024-05-09T00:01:57.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:57 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1402924522' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-09T00:01:58.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.444+0000 7f2eeabcc700 1 -- 172.21.15.81:0/543163106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee4100850 msgr2=0x7f2ee410ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:58.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.444+0000 7f2eeabcc700 1 --2- 172.21.15.81:0/543163106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee4100850 0x7f2ee410ccf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2edc00b0a0 tx=0x7f2edc00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:01:58.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.444+0000 7f2eeabcc700 1 -- 172.21.15.81:0/543163106 shutdown_connections 2024-05-09T00:01:58.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.444+0000 7f2eeabcc700 1 --2- 172.21.15.81:0/543163106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ee4105f40 0x7f2ee4106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:58.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.444+0000 7f2eeabcc700 1 --2- 172.21.15.81:0/543163106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee4100850 0x7f2ee410ccf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:58.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.444+0000 7f2eeabcc700 1 --2- 172.21.15.81:0/543163106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ee40ffe90 0x7f2ee4100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:58.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.444+0000 7f2eeabcc700 1 -- 172.21.15.81:0/543163106 >> 172.21.15.81:0/543163106 conn(0x7f2ee4076e70 msgr2=0x7f2ee4077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:58.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.444+0000 7f2eeabcc700 1 -- 172.21.15.81:0/543163106 shutdown_connections 2024-05-09T00:01:58.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.444+0000 7f2eeabcc700 1 -- 172.21.15.81:0/543163106 wait complete. 2024-05-09T00:01:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2eeabcc700 1 Processor -- start 2024-05-09T00:01:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2eeabcc700 1 -- start start 2024-05-09T00:01:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2eeabcc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee40ffe90 0x7f2ee4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2eeabcc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ee4100850 0x7f2ee41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2eeabcc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ee4105f40 0x7f2ee41a34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2eeabcc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee4199200 con 0x7f2ee40ffe90 2024-05-09T00:01:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2eeabcc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee41a3a30 con 0x7f2ee4105f40 2024-05-09T00:01:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2eeabcc700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee41a3b70 con 0x7f2ee4100850 2024-05-09T00:01:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2ee8968700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee40ffe90 0x7f2ee4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2ee8968700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee40ffe90 0x7f2ee4198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41610/0 (socket says 172.21.15.81:41610) 2024-05-09T00:01:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2ee8968700 1 -- 172.21.15.81:0/2009096312 learned_addr learned my addr 172.21.15.81:0/2009096312 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:01:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2ee3fff700 1 --2- 172.21.15.81:0/2009096312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ee4100850 0x7f2ee41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2ee8968700 1 -- 172.21.15.81:0/2009096312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ee4100850 msgr2=0x7f2ee41989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2ee8968700 1 --2- 172.21.15.81:0/2009096312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ee4100850 0x7f2ee41989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2ee8968700 1 -- 172.21.15.81:0/2009096312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ee4105f40 msgr2=0x7f2ee41a34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2ee8968700 1 --2- 172.21.15.81:0/2009096312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ee4105f40 0x7f2ee41a34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.445+0000 7f2ee8968700 1 -- 172.21.15.81:0/2009096312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc009d00 con 0x7f2ee40ffe90 2024-05-09T00:01:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.446+0000 7f2ee8968700 1 --2- 172.21.15.81:0/2009096312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee40ffe90 0x7f2ee4198470 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800b560 tx=0x7f2ed800b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.446+0000 7f2ee1ffb700 1 -- 172.21.15.81:0/2009096312 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8011830 con 0x7f2ee40ffe90 2024-05-09T00:01:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.446+0000 7f2ee1ffb700 1 -- 172.21.15.81:0/2009096312 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ed8011e50 con 0x7f2ee40ffe90 2024-05-09T00:01:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.446+0000 7f2ee1ffb700 1 -- 172.21.15.81:0/2009096312 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed800f2e0 con 0x7f2ee40ffe90 2024-05-09T00:01:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.446+0000 7f2eeabcc700 1 -- 172.21.15.81:0/2009096312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee41a3dd0 con 0x7f2ee40ffe90 2024-05-09T00:01:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.446+0000 7f2eeabcc700 1 -- 172.21.15.81:0/2009096312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee41a4280 con 0x7f2ee40ffe90 2024-05-09T00:01:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.447+0000 7f2eeabcc700 1 -- 172.21.15.81:0/2009096312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee41083d0 con 0x7f2ee40ffe90 2024-05-09T00:01:58.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.448+0000 7f2ee1ffb700 1 -- 172.21.15.81:0/2009096312 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2ed8011990 con 0x7f2ee40ffe90 2024-05-09T00:01:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.448+0000 7f2ee1ffb700 1 --2- 172.21.15.81:0/2009096312 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2ed40a11b0 0x7f2ed40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:01:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.449+0000 7f2ee3fff700 1 --2- 172.21.15.81:0/2009096312 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2ed40a11b0 0x7f2ed40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:01:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.449+0000 7f2ee1ffb700 1 -- 172.21.15.81:0/2009096312 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2ed80cc2d0 con 0x7f2ee40ffe90 2024-05-09T00:01:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.449+0000 7f2ee3fff700 1 --2- 172.21.15.81:0/2009096312 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2ed40a11b0 0x7f2ed40a3670 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0006fd0 tx=0x7f2ed0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:01:58.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.453+0000 7f2ee1ffb700 1 -- 172.21.15.81:0/2009096312 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2ed8095bc0 con 0x7f2ee40ffe90 2024-05-09T00:01:58.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.649+0000 7f2eeabcc700 1 -- 172.21.15.81:0/2009096312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ee40697c0 con 0x7f2ee40ffe90 2024-05-09T00:01:58.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.650+0000 7f2ee1ffb700 1 -- 172.21.15.81:0/2009096312 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22095 (secure 0 0 0) 0x7f2ed8010ed0 con 0x7f2ee40ffe90 2024-05-09T00:01:58.645 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:01:58.645 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":79,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:01:46.020465+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:01:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.652+0000 7f2eeabcc700 1 -- 172.21.15.81:0/2009096312 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2ed40a11b0 msgr2=0x7f2ed40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.652+0000 7f2eeabcc700 1 --2- 172.21.15.81:0/2009096312 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2ed40a11b0 0x7f2ed40a3670 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2ed0006fd0 tx=0x7f2ed0008040 comp rx=0 tx=0).stop 2024-05-09T00:01:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.652+0000 7f2eeabcc700 1 -- 172.21.15.81:0/2009096312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee40ffe90 msgr2=0x7f2ee4198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:01:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.652+0000 7f2eeabcc700 1 --2- 172.21.15.81:0/2009096312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee40ffe90 0x7f2ee4198470 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800b560 tx=0x7f2ed800b920 comp rx=0 tx=0).stop 2024-05-09T00:01:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.652+0000 7f2eeabcc700 1 -- 172.21.15.81:0/2009096312 shutdown_connections 2024-05-09T00:01:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.652+0000 7f2eeabcc700 1 --2- 172.21.15.81:0/2009096312 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2ed40a11b0 0x7f2ed40a3670 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:58.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.652+0000 7f2eeabcc700 1 --2- 172.21.15.81:0/2009096312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ee4105f40 0x7f2ee41a34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.653+0000 7f2eeabcc700 1 --2- 172.21.15.81:0/2009096312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ee40ffe90 0x7f2ee4198470 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.653+0000 7f2eeabcc700 1 --2- 172.21.15.81:0/2009096312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ee4100850 0x7f2ee41989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:01:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.653+0000 7f2eeabcc700 1 -- 172.21.15.81:0/2009096312 >> 172.21.15.81:0/2009096312 conn(0x7f2ee4076e70 msgr2=0x7f2ee40feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:01:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.653+0000 7f2eeabcc700 1 -- 172.21.15.81:0/2009096312 shutdown_connections 2024-05-09T00:01:58.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:01:58.653+0000 7f2eeabcc700 1 -- 172.21.15.81:0/2009096312 wait complete. 2024-05-09T00:01:59.035 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-09T00:01:59.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-09T00:01:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:01:59.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:59 smithi081 ceph-mon[42474]: pgmap v225: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.6 KiB/s wr, 14 op/s 2024-05-09T00:01:59.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:01:59 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2009096312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:59.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:59 smithi150 ceph-mon[46187]: pgmap v225: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.6 KiB/s wr, 14 op/s 2024-05-09T00:01:59.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:01:59 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2009096312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:01:59.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:59 smithi171 ceph-mon[47351]: pgmap v225: 97 pgs: 97 active+clean; 618 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.6 KiB/s wr, 14 op/s 2024-05-09T00:01:59.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:01:59 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2009096312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:00.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.279+0000 7f0405aea700 1 -- 172.21.15.81:0/3188065721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0400100890 msgr2=0x7f040010cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:00.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.279+0000 7f0405aea700 1 --2- 172.21.15.81:0/3188065721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0400100890 0x7f040010cd40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f03f800b0a0 tx=0x7f03f800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:00.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.279+0000 7f0405aea700 1 -- 172.21.15.81:0/3188065721 shutdown_connections 2024-05-09T00:02:00.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.279+0000 7f0405aea700 1 --2- 172.21.15.81:0/3188065721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0400105f00 0x7f04001062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:00.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.279+0000 7f0405aea700 1 --2- 172.21.15.81:0/3188065721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0400100890 0x7f040010cd40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:00.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.279+0000 7f0405aea700 1 --2- 172.21.15.81:0/3188065721 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04000ffed0 0x7f0400100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:00.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.279+0000 7f0405aea700 1 -- 172.21.15.81:0/3188065721 >> 172.21.15.81:0/3188065721 conn(0x7f0400075f80 msgr2=0x7f0400076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:00.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.279+0000 7f0405aea700 1 -- 172.21.15.81:0/3188065721 shutdown_connections 2024-05-09T00:02:00.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.279+0000 7f0405aea700 1 -- 172.21.15.81:0/3188065721 wait complete. 2024-05-09T00:02:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.279+0000 7f0405aea700 1 Processor -- start 2024-05-09T00:02:00.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f0405aea700 1 -- start start 2024-05-09T00:02:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f0405aea700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04000ffed0 0x7f0400198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f0405aea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0400100890 0x7f0400198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f0405aea700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0400105f00 0x7f04001a33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f0405aea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04001990c0 con 0x7f0400100890 2024-05-09T00:02:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f0405aea700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04001a38f0 con 0x7f0400105f00 2024-05-09T00:02:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f0405aea700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04001a3a30 con 0x7f04000ffed0 2024-05-09T00:02:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f03feffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0400100890 0x7f0400198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f03feffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0400100890 0x7f0400198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41632/0 (socket says 172.21.15.81:41632) 2024-05-09T00:02:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f03feffd700 1 -- 172.21.15.81:0/2160172393 learned_addr learned my addr 172.21.15.81:0/2160172393 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f03ff7fe700 1 --2- 172.21.15.81:0/2160172393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04000ffed0 0x7f0400198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f03fffff700 1 --2- 172.21.15.81:0/2160172393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0400105f00 0x7f04001a33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f03feffd700 1 -- 172.21.15.81:0/2160172393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04000ffed0 msgr2=0x7f0400198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:00.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f03feffd700 1 --2- 172.21.15.81:0/2160172393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04000ffed0 0x7f0400198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:00.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f03feffd700 1 -- 172.21.15.81:0/2160172393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0400105f00 msgr2=0x7f04001a33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:00.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f03feffd700 1 --2- 172.21.15.81:0/2160172393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0400105f00 0x7f04001a33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:00.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.280+0000 7f03feffd700 1 -- 172.21.15.81:0/2160172393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f8009d00 con 0x7f0400100890 2024-05-09T00:02:00.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.281+0000 7f03feffd700 1 --2- 172.21.15.81:0/2160172393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0400100890 0x7f0400198870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f03f000c950 tx=0x7f03f000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:00.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.281+0000 7f03fcff9700 1 -- 172.21.15.81:0/2160172393 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f00078d0 con 0x7f0400100890 2024-05-09T00:02:00.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.281+0000 7f03fcff9700 1 -- 172.21.15.81:0/2160172393 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03f000f450 con 0x7f0400100890 2024-05-09T00:02:00.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.281+0000 7f0405aea700 1 -- 172.21.15.81:0/2160172393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04001a3c90 con 0x7f0400100890 2024-05-09T00:02:00.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.281+0000 7f03fcff9700 1 -- 172.21.15.81:0/2160172393 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f0018660 con 0x7f0400100890 2024-05-09T00:02:00.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.281+0000 7f0405aea700 1 -- 172.21.15.81:0/2160172393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04001a4190 con 0x7f0400100890 2024-05-09T00:02:00.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.282+0000 7f0405aea700 1 -- 172.21.15.81:0/2160172393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0400108420 con 0x7f0400100890 2024-05-09T00:02:00.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.283+0000 7f03fcff9700 1 -- 172.21.15.81:0/2160172393 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f03f0007a30 con 0x7f0400100890 2024-05-09T00:02:00.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.283+0000 7f03fcff9700 1 --2- 172.21.15.81:0/2160172393 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f03e80a11b0 0x7f03e80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:00.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.283+0000 7f03ff7fe700 1 --2- 172.21.15.81:0/2160172393 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f03e80a11b0 0x7f03e80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:00.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.284+0000 7f03fcff9700 1 -- 172.21.15.81:0/2160172393 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f03f00cc7c0 con 0x7f0400100890 2024-05-09T00:02:00.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.284+0000 7f03ff7fe700 1 --2- 172.21.15.81:0/2160172393 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f03e80a11b0 0x7f03e80a3670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f03f4005950 tx=0x7f03f400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:00.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.287+0000 7f03fcff9700 1 -- 172.21.15.81:0/2160172393 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f03f0096030 con 0x7f0400100890 2024-05-09T00:02:00.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.483+0000 7f0405aea700 1 -- 172.21.15.81:0/2160172393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04001015b0 con 0x7f0400100890 2024-05-09T00:02:00.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.484+0000 7f03fcff9700 1 -- 172.21.15.81:0/2160172393 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22095 (secure 0 0 0) 0x7f03f0099650 con 0x7f0400100890 2024-05-09T00:02:00.479 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:00.479 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":79,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:01:46.020465+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:02:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.486+0000 7f0405aea700 1 -- 172.21.15.81:0/2160172393 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f03e80a11b0 msgr2=0x7f03e80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.486+0000 7f0405aea700 1 --2- 172.21.15.81:0/2160172393 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f03e80a11b0 0x7f03e80a3670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f03f4005950 tx=0x7f03f400b410 comp rx=0 tx=0).stop 2024-05-09T00:02:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.486+0000 7f0405aea700 1 -- 172.21.15.81:0/2160172393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0400100890 msgr2=0x7f0400198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:00.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.486+0000 7f0405aea700 1 --2- 172.21.15.81:0/2160172393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0400100890 0x7f0400198870 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f03f000c950 tx=0x7f03f000cc60 comp rx=0 tx=0).stop 2024-05-09T00:02:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.486+0000 7f0405aea700 1 -- 172.21.15.81:0/2160172393 shutdown_connections 2024-05-09T00:02:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.486+0000 7f0405aea700 1 --2- 172.21.15.81:0/2160172393 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f03e80a11b0 0x7f03e80a3670 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.486+0000 7f0405aea700 1 --2- 172.21.15.81:0/2160172393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0400105f00 0x7f04001a33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.486+0000 7f0405aea700 1 --2- 172.21.15.81:0/2160172393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04000ffed0 0x7f0400198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.486+0000 7f0405aea700 1 --2- 172.21.15.81:0/2160172393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0400100890 0x7f0400198870 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.486+0000 7f0405aea700 1 -- 172.21.15.81:0/2160172393 >> 172.21.15.81:0/2160172393 conn(0x7f0400075f80 msgr2=0x7f04000fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.486+0000 7f0405aea700 1 -- 172.21.15.81:0/2160172393 shutdown_connections 2024-05-09T00:02:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:00.486+0000 7f0405aea700 1 -- 172.21.15.81:0/2160172393 wait complete. 2024-05-09T00:02:00.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-09T00:02:00.870 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-09T00:02:00.871 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-09T00:02:00.871 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-09T00:02:00.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-09T00:02:00.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-09T00:02:00.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-09T00:02:00.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-09T00:02:00.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-09T00:02:00.875 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-09T00:02:00.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-09T00:02:00.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-09T00:02:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:01 smithi081 ceph-mon[42474]: pgmap v226: 97 pgs: 97 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2024-05-09T00:02:01.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:01 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2160172393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:01.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:01 smithi150 ceph-mon[46187]: pgmap v226: 97 pgs: 97 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2024-05-09T00:02:01.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:01 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2160172393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:01.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:01 smithi171 ceph-mon[47351]: pgmap v226: 97 pgs: 97 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2024-05-09T00:02:01.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:01 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2160172393' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:01.873 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:02.248 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:02.728 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:03.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.279+0000 7f198f0ae700 1 -- 172.21.15.81:0/1971333976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1988100bb0 msgr2=0x7f198810ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.279+0000 7f198f0ae700 1 --2- 172.21.15.81:0/1971333976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1988100bb0 0x7f198810ccc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f198000b0a0 tx=0x7f198000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.279+0000 7f198f0ae700 1 -- 172.21.15.81:0/1971333976 shutdown_connections 2024-05-09T00:02:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.279+0000 7f198f0ae700 1 --2- 172.21.15.81:0/1971333976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1988100bb0 0x7f198810ccc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.279+0000 7f198f0ae700 1 --2- 172.21.15.81:0/1971333976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1988105ff0 0x7f19881063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.279+0000 7f198f0ae700 1 --2- 172.21.15.81:0/1971333976 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f19881001f0 0x7f1988100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.279+0000 7f198f0ae700 1 -- 172.21.15.81:0/1971333976 >> 172.21.15.81:0/1971333976 conn(0x7f1988075d10 msgr2=0x7f1988076120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.279+0000 7f198f0ae700 1 -- 172.21.15.81:0/1971333976 shutdown_connections 2024-05-09T00:02:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.279+0000 7f198f0ae700 1 -- 172.21.15.81:0/1971333976 wait complete. 2024-05-09T00:02:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.279+0000 7f198f0ae700 1 Processor -- start 2024-05-09T00:02:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.279+0000 7f198f0ae700 1 -- start start 2024-05-09T00:02:03.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198f0ae700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19881001f0 0x7f1988199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198f0ae700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1988100bb0 0x7f1988199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198f0ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1988105ff0 0x7f198819cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198f0ae700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198819d590 con 0x7f1988105ff0 2024-05-09T00:02:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198f0ae700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198819d700 con 0x7f1988100bb0 2024-05-09T00:02:03.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198f0ae700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198819d8c0 con 0x7f19881001f0 2024-05-09T00:02:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198d64b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1988105ff0 0x7f198819cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:03.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198d64b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1988105ff0 0x7f198819cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41652/0 (socket says 172.21.15.81:41652) 2024-05-09T00:02:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198d64b700 1 -- 172.21.15.81:0/3244893732 learned_addr learned my addr 172.21.15.81:0/3244893732 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198ce4a700 1 --2- 172.21.15.81:0/3244893732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19881001f0 0x7f1988199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f1987fff700 1 --2- 172.21.15.81:0/3244893732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1988100bb0 0x7f1988199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198d64b700 1 -- 172.21.15.81:0/3244893732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19881001f0 msgr2=0x7f1988199750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198d64b700 1 --2- 172.21.15.81:0/3244893732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19881001f0 0x7f1988199750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198d64b700 1 -- 172.21.15.81:0/3244893732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1988100bb0 msgr2=0x7f1988199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198d64b700 1 --2- 172.21.15.81:0/3244893732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1988100bb0 0x7f1988199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198d64b700 1 -- 172.21.15.81:0/3244893732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980009d00 con 0x7f1988105ff0 2024-05-09T00:02:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f198d64b700 1 --2- 172.21.15.81:0/3244893732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1988105ff0 0x7f198819cf90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f198000b830 tx=0x7f19800077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:03.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.280+0000 7f1985ffb700 1 -- 172.21.15.81:0/3244893732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198000e040 con 0x7f1988105ff0 2024-05-09T00:02:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.281+0000 7f1985ffb700 1 -- 172.21.15.81:0/3244893732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1980004e60 con 0x7f1988105ff0 2024-05-09T00:02:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.281+0000 7f1985ffb700 1 -- 172.21.15.81:0/3244893732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19800053c0 con 0x7f1988105ff0 2024-05-09T00:02:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.281+0000 7f198f0ae700 1 -- 172.21.15.81:0/3244893732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198819db40 con 0x7f1988105ff0 2024-05-09T00:02:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.281+0000 7f198f0ae700 1 -- 172.21.15.81:0/3244893732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19881a64f0 con 0x7f1988105ff0 2024-05-09T00:02:03.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.282+0000 7f198f0ae700 1 -- 172.21.15.81:0/3244893732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19881015a0 con 0x7f1988105ff0 2024-05-09T00:02:03.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.283+0000 7f1985ffb700 1 -- 172.21.15.81:0/3244893732 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f198001b450 con 0x7f1988105ff0 2024-05-09T00:02:03.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.283+0000 7f1985ffb700 1 --2- 172.21.15.81:0/3244893732 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f19780a11b0 0x7f19780a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:03.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.284+0000 7f198ce4a700 1 --2- 172.21.15.81:0/3244893732 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f19780a11b0 0x7f19780a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:03.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.284+0000 7f1985ffb700 1 -- 172.21.15.81:0/3244893732 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f19800ce4c0 con 0x7f1988105ff0 2024-05-09T00:02:03.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.284+0000 7f1985ffb700 1 --2- 172.21.15.81:0/3244893732 >> [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145] conn(0x7f19780aa990 0x7f19780acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:03.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.284+0000 7f1985ffb700 1 -- 172.21.15.81:0/3244893732 --> [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19780ad460 con 0x7f19780aa990 2024-05-09T00:02:03.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.284+0000 7f1985ffb700 1 -- 172.21.15.81:0/3244893732 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19800ce960 con 0x7f1988105ff0 2024-05-09T00:02:03.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.284+0000 7f1987fff700 1 --2- 172.21.15.81:0/3244893732 >> [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145] conn(0x7f19780aa990 0x7f19780acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:03.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.284+0000 7f198ce4a700 1 --2- 172.21.15.81:0/3244893732 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f19780a11b0 0x7f19780a3670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f197c009a10 tx=0x7f197c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.284+0000 7f1987fff700 1 --2- 172.21.15.81:0/3244893732 >> [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145] conn(0x7f19780aa990 0x7f19780acdb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:03.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.285+0000 7f1985ffb700 1 -- 172.21.15.81:0/3244893732 <== osd.0 v2:172.21.15.81:6802/870674145 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f19780ad460 con 0x7f19780aa990 2024-05-09T00:02:03.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.309+0000 7f198f0ae700 1 -- 172.21.15.81:0/3244893732 --> [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1988110190 con 0x7f19780aa990 2024-05-09T00:02:03.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.310+0000 7f1985ffb700 1 -- 172.21.15.81:0/3244893732 <== osd.0 v2:172.21.15.81:6802/870674145 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f19740099e0 con 0x7f19780aa990 2024-05-09T00:02:03.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.312+0000 7f198f0ae700 1 -- 172.21.15.81:0/3244893732 >> [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145] conn(0x7f19780aa990 msgr2=0x7f19780acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:03.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.312+0000 7f198f0ae700 1 --2- 172.21.15.81:0/3244893732 >> [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145] conn(0x7f19780aa990 0x7f19780acdb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.312+0000 7f198f0ae700 1 -- 172.21.15.81:0/3244893732 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f19780a11b0 msgr2=0x7f19780a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:03.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.312+0000 7f198f0ae700 1 --2- 172.21.15.81:0/3244893732 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f19780a11b0 0x7f19780a3670 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f197c009a10 tx=0x7f197c009190 comp rx=0 tx=0).stop 2024-05-09T00:02:03.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.312+0000 7f198f0ae700 1 -- 172.21.15.81:0/3244893732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1988105ff0 msgr2=0x7f198819cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:03.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.312+0000 7f198f0ae700 1 --2- 172.21.15.81:0/3244893732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1988105ff0 0x7f198819cf90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f198000b830 tx=0x7f19800077f0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.312+0000 7f198d64b700 1 -- 172.21.15.81:0/3244893732 reap_dead start 2024-05-09T00:02:03.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.312+0000 7f198f0ae700 1 -- 172.21.15.81:0/3244893732 shutdown_connections 2024-05-09T00:02:03.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.312+0000 7f198f0ae700 1 -- 172.21.15.81:0/3244893732 >> 172.21.15.81:0/3244893732 conn(0x7f1988075d10 msgr2=0x7f19880696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:03.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.313+0000 7f198f0ae700 1 -- 172.21.15.81:0/3244893732 shutdown_connections 2024-05-09T00:02:03.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.313+0000 7f198f0ae700 1 -- 172.21.15.81:0/3244893732 wait complete. 2024-05-09T00:02:03.582 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:03 smithi081 ceph-mon[42474]: pgmap v227: 97 pgs: 97 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-05-09T00:02:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:03.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:03 smithi150 ceph-mon[46187]: pgmap v227: 97 pgs: 97 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-05-09T00:02:03.786 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:03.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:03 smithi171 ceph-mon[47351]: pgmap v227: 97 pgs: 97 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-05-09T00:02:03.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.651+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3495971651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc1063c0 msgr2=0x7fafcc10dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:03.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.651+0000 7fafd2cd7700 1 --2- 172.21.15.81:0/3495971651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc1063c0 0x7fafcc10dee0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fafc400b0d0 tx=0x7fafc400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.651+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3495971651 shutdown_connections 2024-05-09T00:02:03.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.651+0000 7fafd2cd7700 1 --2- 172.21.15.81:0/3495971651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafcc0ffba0 0x7fafcc0fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.651+0000 7fafd2cd7700 1 --2- 172.21.15.81:0/3495971651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc1063c0 0x7fafcc10dee0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.651+0000 7fafd2cd7700 1 --2- 172.21.15.81:0/3495971651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafcc100550 0x7fafcc105c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.651+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3495971651 >> 172.21.15.81:0/3495971651 conn(0x7fafcc075260 msgr2=0x7fafcc075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.651+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3495971651 shutdown_connections 2024-05-09T00:02:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.651+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3495971651 wait complete. 2024-05-09T00:02:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.652+0000 7fafd2cd7700 1 Processor -- start 2024-05-09T00:02:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.652+0000 7fafd2cd7700 1 -- start start 2024-05-09T00:02:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.652+0000 7fafd2cd7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafcc0ffba0 0x7fafcc1972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.652+0000 7fafd2cd7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc100550 0x7fafcc197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.652+0000 7fafd2cd7700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafcc1063c0 0x7fafcc19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.652+0000 7fafd2cd7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc19c1e0 con 0x7fafcc100550 2024-05-09T00:02:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.652+0000 7fafd2cd7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc19c350 con 0x7fafcc0ffba0 2024-05-09T00:02:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.652+0000 7fafd2cd7700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc19c510 con 0x7fafcc1063c0 2024-05-09T00:02:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.652+0000 7fafcbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc100550 0x7fafcc197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.652+0000 7fafcbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc100550 0x7fafcc197820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41670/0 (socket says 172.21.15.81:41670) 2024-05-09T00:02:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.652+0000 7fafcbfff700 1 -- 172.21.15.81:0/3685373931 learned_addr learned my addr 172.21.15.81:0/3685373931 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.653+0000 7fafd0a73700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafcc0ffba0 0x7fafcc1972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.653+0000 7fafd1274700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafcc1063c0 0x7fafcc19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.653+0000 7fafcbfff700 1 -- 172.21.15.81:0/3685373931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafcc1063c0 msgr2=0x7fafcc19bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.653+0000 7fafcbfff700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafcc1063c0 0x7fafcc19bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.653+0000 7fafcbfff700 1 -- 172.21.15.81:0/3685373931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafcc0ffba0 msgr2=0x7fafcc1972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.653+0000 7fafcbfff700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fafcc0ffba0 0x7fafcc1972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.653+0000 7fafcbfff700 1 -- 172.21.15.81:0/3685373931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4009d00 con 0x7fafcc100550 2024-05-09T00:02:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.653+0000 7fafd1274700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fafcc1063c0 0x7fafcc19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.653+0000 7fafcbfff700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc100550 0x7fafcc197820 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fafb800d950 tx=0x7fafb800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.653+0000 7fafc9ffb700 1 -- 172.21.15.81:0/3685373931 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8009940 con 0x7fafcc100550 2024-05-09T00:02:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.653+0000 7fafc9ffb700 1 -- 172.21.15.81:0/3685373931 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafb8010460 con 0x7fafcc100550 2024-05-09T00:02:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.653+0000 7fafc9ffb700 1 -- 172.21.15.81:0/3685373931 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb800f620 con 0x7fafcc100550 2024-05-09T00:02:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.654+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3685373931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc19c7f0 con 0x7fafcc100550 2024-05-09T00:02:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.654+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3685373931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc100c20 con 0x7fafcc100550 2024-05-09T00:02:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.655+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3685373931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fafcc111210 con 0x7fafcc100550 2024-05-09T00:02:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.657+0000 7fafc9ffb700 1 -- 172.21.15.81:0/3685373931 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fafb80108d0 con 0x7fafcc100550 2024-05-09T00:02:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.657+0000 7fafc9ffb700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fafbc0a1230 0x7fafbc0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.657+0000 7fafc9ffb700 1 -- 172.21.15.81:0/3685373931 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fafb80cc9b0 con 0x7fafcc100550 2024-05-09T00:02:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.657+0000 7fafd0a73700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fafbc0a1230 0x7fafbc0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.658+0000 7fafc9ffb700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324] conn(0x7fafbc0aaa10 0x7fafbc0ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.658+0000 7fafc9ffb700 1 -- 172.21.15.81:0/3685373931 --> [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fafbc0ad4e0 con 0x7fafbc0aaa10 2024-05-09T00:02:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.658+0000 7fafc9ffb700 1 -- 172.21.15.81:0/3685373931 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafb80d12a0 con 0x7fafcc100550 2024-05-09T00:02:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.659+0000 7fafd0a73700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fafbc0a1230 0x7fafbc0a36f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fafc0005950 tx=0x7fafc000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.661+0000 7fafd1274700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324] conn(0x7fafbc0aaa10 0x7fafbc0ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.661+0000 7fafd1274700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324] conn(0x7fafbc0aaa10 0x7fafbc0ace30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.662+0000 7fafc9ffb700 1 -- 172.21.15.81:0/3685373931 <== osd.9 v2:172.21.15.81:6826/2430864324 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fafbc0ad4e0 con 0x7fafbc0aaa10 2024-05-09T00:02:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.679+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3685373931 --> [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fafcc061620 con 0x7fafbc0aaa10 2024-05-09T00:02:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.679+0000 7fafc9ffb700 1 -- 172.21.15.81:0/3685373931 <== osd.9 v2:172.21.15.81:6826/2430864324 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fafcc061620 con 0x7fafbc0aaa10 2024-05-09T00:02:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.680+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3685373931 >> [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324] conn(0x7fafbc0aaa10 msgr2=0x7fafbc0ace30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.680+0000 7fafd2cd7700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324] conn(0x7fafbc0aaa10 0x7fafbc0ace30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.680+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3685373931 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fafbc0a1230 msgr2=0x7fafbc0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.680+0000 7fafd2cd7700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fafbc0a1230 0x7fafbc0a36f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fafc0005950 tx=0x7fafc000b410 comp rx=0 tx=0).stop 2024-05-09T00:02:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.680+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3685373931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc100550 msgr2=0x7fafcc197820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.680+0000 7fafd2cd7700 1 --2- 172.21.15.81:0/3685373931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafcc100550 0x7fafcc197820 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fafb800d950 tx=0x7fafb800dc60 comp rx=0 tx=0).stop 2024-05-09T00:02:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.680+0000 7fafd1274700 1 -- 172.21.15.81:0/3685373931 reap_dead start 2024-05-09T00:02:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.680+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3685373931 shutdown_connections 2024-05-09T00:02:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.680+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3685373931 >> 172.21.15.81:0/3685373931 conn(0x7fafcc075260 msgr2=0x7fafcc0fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.680+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3685373931 shutdown_connections 2024-05-09T00:02:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:03.680+0000 7fafd2cd7700 1 -- 172.21.15.81:0/3685373931 wait complete. 2024-05-09T00:02:04.071 INFO:teuthology.orchestra.run.smithi081.stdout:34359738419 2024-05-09T00:02:04.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-09T00:02:04.584 INFO:teuthology.orchestra.run.smithi081.stdout:266287972373 2024-05-09T00:02:04.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-09T00:02:04.642 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:04.948 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:05.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.084+0000 7fa034f47700 1 -- 172.21.15.81:0/2088872303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa030100ff0 msgr2=0x7fa030101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:05.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.084+0000 7fa034f47700 1 --2- 172.21.15.81:0/2088872303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa030100ff0 0x7fa030101450 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa018009990 tx=0x7fa018009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:05.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.084+0000 7fa034f47700 1 -- 172.21.15.81:0/2088872303 shutdown_connections 2024-05-09T00:02:05.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.084+0000 7fa034f47700 1 --2- 172.21.15.81:0/2088872303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa030101990 0x7fa03010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:05.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.084+0000 7fa034f47700 1 --2- 172.21.15.81:0/2088872303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa030107030 0x7fa030107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:05.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.084+0000 7fa034f47700 1 --2- 172.21.15.81:0/2088872303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa030100ff0 0x7fa030101450 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:05.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.084+0000 7fa034f47700 1 -- 172.21.15.81:0/2088872303 >> 172.21.15.81:0/2088872303 conn(0x7fa030078190 msgr2=0x7fa0300785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:05.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.084+0000 7fa034f47700 1 -- 172.21.15.81:0/2088872303 shutdown_connections 2024-05-09T00:02:05.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.084+0000 7fa034f47700 1 -- 172.21.15.81:0/2088872303 wait complete. 2024-05-09T00:02:05.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.085+0000 7fa034f47700 1 Processor -- start 2024-05-09T00:02:05.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.085+0000 7fa034f47700 1 -- start start 2024-05-09T00:02:05.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.085+0000 7fa034f47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa030100ff0 0x7fa0301974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:05.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.085+0000 7fa034f47700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa030101990 0x7fa030197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:05.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.085+0000 7fa034f47700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa030107030 0x7fa03019bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:05.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa034f47700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03019c3e0 con 0x7fa030100ff0 2024-05-09T00:02:05.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa034f47700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03019c550 con 0x7fa030101990 2024-05-09T00:02:05.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa034f47700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03019c710 con 0x7fa030107030 2024-05-09T00:02:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa02e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa030100ff0 0x7fa0301974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa02e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa030100ff0 0x7fa0301974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41692/0 (socket says 172.21.15.81:41692) 2024-05-09T00:02:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa02e59c700 1 -- 172.21.15.81:0/2048960454 learned_addr learned my addr 172.21.15.81:0/2048960454 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa02dd9b700 1 --2- 172.21.15.81:0/2048960454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa030101990 0x7fa030197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa02ed9d700 1 --2- 172.21.15.81:0/2048960454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa030107030 0x7fa03019bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa02e59c700 1 -- 172.21.15.81:0/2048960454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa030107030 msgr2=0x7fa03019bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa02e59c700 1 --2- 172.21.15.81:0/2048960454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa030107030 0x7fa03019bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa02e59c700 1 -- 172.21.15.81:0/2048960454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa030101990 msgr2=0x7fa030197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa02e59c700 1 --2- 172.21.15.81:0/2048960454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa030101990 0x7fa030197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa02e59c700 1 -- 172.21.15.81:0/2048960454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0180095f0 con 0x7fa030100ff0 2024-05-09T00:02:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa02e59c700 1 --2- 172.21.15.81:0/2048960454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa030100ff0 0x7fa0301974e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa02000bfd0 tx=0x7fa02000e5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa0277fe700 1 -- 172.21.15.81:0/2048960454 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa020012640 con 0x7fa030100ff0 2024-05-09T00:02:05.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa034f47700 1 -- 172.21.15.81:0/2048960454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03019c9f0 con 0x7fa030100ff0 2024-05-09T00:02:05.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa0277fe700 1 -- 172.21.15.81:0/2048960454 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa02000bb20 con 0x7fa030100ff0 2024-05-09T00:02:05.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa0277fe700 1 -- 172.21.15.81:0/2048960454 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02001ac00 con 0x7fa030100ff0 2024-05-09T00:02:05.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.086+0000 7fa034f47700 1 -- 172.21.15.81:0/2048960454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0300733a0 con 0x7fa030100ff0 2024-05-09T00:02:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.088+0000 7fa034f47700 1 -- 172.21.15.81:0/2048960454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa030111270 con 0x7fa030100ff0 2024-05-09T00:02:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.088+0000 7fa0277fe700 1 -- 172.21.15.81:0/2048960454 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa0200127a0 con 0x7fa030100ff0 2024-05-09T00:02:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.089+0000 7fa0277fe700 1 --2- 172.21.15.81:0/2048960454 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa01c0a11b0 0x7fa01c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.089+0000 7fa02dd9b700 1 --2- 172.21.15.81:0/2048960454 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa01c0a11b0 0x7fa01c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.089+0000 7fa0277fe700 1 -- 172.21.15.81:0/2048960454 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa020016070 con 0x7fa030100ff0 2024-05-09T00:02:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.089+0000 7fa0277fe700 1 --2- 172.21.15.81:0/2048960454 >> [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822] conn(0x7fa01c0aa990 0x7fa01c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.089+0000 7fa0277fe700 1 -- 172.21.15.81:0/2048960454 --> [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa01c0ad460 con 0x7fa01c0aa990 2024-05-09T00:02:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.089+0000 7fa0277fe700 1 -- 172.21.15.81:0/2048960454 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0200d33b0 con 0x7fa030100ff0 2024-05-09T00:02:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.089+0000 7fa02ed9d700 1 --2- 172.21.15.81:0/2048960454 >> [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822] conn(0x7fa01c0aa990 0x7fa01c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.089+0000 7fa02dd9b700 1 --2- 172.21.15.81:0/2048960454 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa01c0a11b0 0x7fa01c0a3670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa01800b5c0 tx=0x7fa018005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.089+0000 7fa02ed9d700 1 --2- 172.21.15.81:0/2048960454 >> [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822] conn(0x7fa01c0aa990 0x7fa01c0acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.090+0000 7fa0277fe700 1 -- 172.21.15.81:0/2048960454 <== osd.6 v2:172.21.15.81:6818/2589726822 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa01c0ad460 con 0x7fa01c0aa990 2024-05-09T00:02:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.106+0000 7fa034f47700 1 -- 172.21.15.81:0/2048960454 --> [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa0301026e0 con 0x7fa01c0aa990 2024-05-09T00:02:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.106+0000 7fa0277fe700 1 -- 172.21.15.81:0/2048960454 <== osd.6 v2:172.21.15.81:6818/2589726822 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa0301026e0 con 0x7fa01c0aa990 2024-05-09T00:02:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.106+0000 7fa034f47700 1 -- 172.21.15.81:0/2048960454 >> [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822] conn(0x7fa01c0aa990 msgr2=0x7fa01c0acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.106+0000 7fa034f47700 1 --2- 172.21.15.81:0/2048960454 >> [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822] conn(0x7fa01c0aa990 0x7fa01c0acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.106+0000 7fa034f47700 1 -- 172.21.15.81:0/2048960454 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa01c0a11b0 msgr2=0x7fa01c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.106+0000 7fa034f47700 1 --2- 172.21.15.81:0/2048960454 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa01c0a11b0 0x7fa01c0a3670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa01800b5c0 tx=0x7fa018005960 comp rx=0 tx=0).stop 2024-05-09T00:02:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.106+0000 7fa034f47700 1 -- 172.21.15.81:0/2048960454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa030100ff0 msgr2=0x7fa0301974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.106+0000 7fa034f47700 1 --2- 172.21.15.81:0/2048960454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa030100ff0 0x7fa0301974e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa02000bfd0 tx=0x7fa02000e5c0 comp rx=0 tx=0).stop 2024-05-09T00:02:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.106+0000 7fa02ed9d700 1 -- 172.21.15.81:0/2048960454 reap_dead start 2024-05-09T00:02:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.106+0000 7fa034f47700 1 -- 172.21.15.81:0/2048960454 shutdown_connections 2024-05-09T00:02:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.106+0000 7fa034f47700 1 -- 172.21.15.81:0/2048960454 >> 172.21.15.81:0/2048960454 conn(0x7fa030078190 msgr2=0x7fa0300ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.106+0000 7fa034f47700 1 -- 172.21.15.81:0/2048960454 shutdown_connections 2024-05-09T00:02:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:05.106+0000 7fa034f47700 1 -- 172.21.15.81:0/2048960454 wait complete. 2024-05-09T00:02:05.249 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:05.579 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:05 smithi081 ceph-mon[42474]: pgmap v228: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-05-09T00:02:05.598 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:05.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:05 smithi150 ceph-mon[46187]: pgmap v228: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-05-09T00:02:05.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:05 smithi171 ceph-mon[47351]: pgmap v228: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.2 KiB/s wr, 10 op/s 2024-05-09T00:02:06.207 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:06.701 INFO:teuthology.orchestra.run.smithi081.stdout:184683593760 2024-05-09T00:02:06.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-09T00:02:07.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.088+0000 7f00b9836700 1 -- 172.21.15.81:0/1395541314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4101990 msgr2=0x7f00b410de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:07.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.088+0000 7f00b9836700 1 --2- 172.21.15.81:0/1395541314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4101990 0x7f00b410de70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00b0a0 tx=0x7f00ac00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.088+0000 7f00b9836700 1 -- 172.21.15.81:0/1395541314 shutdown_connections 2024-05-09T00:02:07.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.088+0000 7f00b9836700 1 --2- 172.21.15.81:0/1395541314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4101990 0x7f00b410de70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.088+0000 7f00b9836700 1 --2- 172.21.15.81:0/1395541314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00b4107030 0x7f00b4107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.088+0000 7f00b9836700 1 --2- 172.21.15.81:0/1395541314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00b4100ff0 0x7f00b4101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.088+0000 7f00b9836700 1 -- 172.21.15.81:0/1395541314 >> 172.21.15.81:0/1395541314 conn(0x7f00b4078190 msgr2=0x7f00b40785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:07.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.088+0000 7f00b9836700 1 -- 172.21.15.81:0/1395541314 shutdown_connections 2024-05-09T00:02:07.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.088+0000 7f00b9836700 1 -- 172.21.15.81:0/1395541314 wait complete. 2024-05-09T00:02:07.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.089+0000 7f00b9836700 1 Processor -- start 2024-05-09T00:02:07.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.089+0000 7f00b9836700 1 -- start start 2024-05-09T00:02:07.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.089+0000 7f00b9836700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00b4100ff0 0x7f00b41974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:07.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.089+0000 7f00b9836700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00b4101990 0x7f00b41979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:07.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.089+0000 7f00b9836700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4107030 0x7f00b419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:07.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.089+0000 7f00b9836700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b419c360 con 0x7f00b4107030 2024-05-09T00:02:07.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.089+0000 7f00b9836700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b419c4d0 con 0x7f00b4101990 2024-05-09T00:02:07.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.089+0000 7f00b9836700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b419c690 con 0x7f00b4100ff0 2024-05-09T00:02:07.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4107030 0x7f00b419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:07.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4107030 0x7f00b419bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41698/0 (socket says 172.21.15.81:41698) 2024-05-09T00:02:07.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b37fe700 1 -- 172.21.15.81:0/4058296337 learned_addr learned my addr 172.21.15.81:0/4058296337 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:07.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b2ffd700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00b4100ff0 0x7f00b41974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:07.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b27fc700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00b4101990 0x7f00b41979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b37fe700 1 -- 172.21.15.81:0/4058296337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00b4100ff0 msgr2=0x7f00b41974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b37fe700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00b4100ff0 0x7f00b41974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b37fe700 1 -- 172.21.15.81:0/4058296337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00b4101990 msgr2=0x7f00b41979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b37fe700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00b4101990 0x7f00b41979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b37fe700 1 -- 172.21.15.81:0/4058296337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ac009d00 con 0x7f00b4107030 2024-05-09T00:02:07.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b27fc700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00b4101990 0x7f00b41979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:07.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b37fe700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4107030 0x7f00b419bd50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00b070 tx=0x7f00ac0094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:07.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b8834700 1 -- 172.21.15.81:0/4058296337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac00e040 con 0x7f00b4107030 2024-05-09T00:02:07.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b9836700 1 -- 172.21.15.81:0/4058296337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b419c910 con 0x7f00b4107030 2024-05-09T00:02:07.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b8834700 1 -- 172.21.15.81:0/4058296337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00ac007990 con 0x7f00b4107030 2024-05-09T00:02:07.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.090+0000 7f00b8834700 1 -- 172.21.15.81:0/4058296337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac01b450 con 0x7f00b4107030 2024-05-09T00:02:07.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.091+0000 7f00b9836700 1 -- 172.21.15.81:0/4058296337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b41a41d0 con 0x7f00b4107030 2024-05-09T00:02:07.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.092+0000 7f00b9836700 1 -- 172.21.15.81:0/4058296337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00b4111160 con 0x7f00b4107030 2024-05-09T00:02:07.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.092+0000 7f00b8834700 1 -- 172.21.15.81:0/4058296337 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f00ac01d610 con 0x7f00b4107030 2024-05-09T00:02:07.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.093+0000 7f00b8834700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f009c0a11b0 0x7f009c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:07.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.093+0000 7f00b8834700 1 -- 172.21.15.81:0/4058296337 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f00ac0cdc50 con 0x7f00b4107030 2024-05-09T00:02:07.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.093+0000 7f00b2ffd700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f009c0a11b0 0x7f009c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:07.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.093+0000 7f00b8834700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617] conn(0x7f009c0aa990 0x7f009c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:07.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.093+0000 7f00b8834700 1 -- 172.21.15.81:0/4058296337 --> [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f009c0ad460 con 0x7f009c0aa990 2024-05-09T00:02:07.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.093+0000 7f00b8834700 1 -- 172.21.15.81:0/4058296337 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00ac0d0300 con 0x7f00b4107030 2024-05-09T00:02:07.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.093+0000 7f00b2ffd700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f009c0a11b0 0x7f009c0a3670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f00a400abd0 tx=0x7f00a400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:07.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.093+0000 7f00b27fc700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617] conn(0x7f009c0aa990 0x7f009c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:07.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.094+0000 7f00b27fc700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617] conn(0x7f009c0aa990 0x7f009c0acdb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:07.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.095+0000 7f00b8834700 1 -- 172.21.15.81:0/4058296337 <== osd.8 v2:172.21.15.171:6816/1718824617 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f009c0ad460 con 0x7f009c0aa990 2024-05-09T00:02:07.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.110+0000 7f00b9836700 1 -- 172.21.15.81:0/4058296337 --> [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f00b41026e0 con 0x7f009c0aa990 2024-05-09T00:02:07.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f00b8834700 1 -- 172.21.15.81:0/4058296337 <== osd.8 v2:172.21.15.171:6816/1718824617 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f00b41026e0 con 0x7f009c0aa990 2024-05-09T00:02:07.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f00b9836700 1 -- 172.21.15.81:0/4058296337 >> [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617] conn(0x7f009c0aa990 msgr2=0x7f009c0acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:07.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f00b9836700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617] conn(0x7f009c0aa990 0x7f009c0acdb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f00b9836700 1 -- 172.21.15.81:0/4058296337 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f009c0a11b0 msgr2=0x7f009c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:07.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f00b9836700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f009c0a11b0 0x7f009c0a3670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f00a400abd0 tx=0x7f00a400a380 comp rx=0 tx=0).stop 2024-05-09T00:02:07.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f00b9836700 1 -- 172.21.15.81:0/4058296337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4107030 msgr2=0x7f00b419bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:07.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f00b9836700 1 --2- 172.21.15.81:0/4058296337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00b4107030 0x7f00b419bd50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00b070 tx=0x7f00ac0094c0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f00b37fe700 1 -- 172.21.15.81:0/4058296337 reap_dead start 2024-05-09T00:02:07.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f00b9836700 1 -- 172.21.15.81:0/4058296337 shutdown_connections 2024-05-09T00:02:07.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f00b9836700 1 -- 172.21.15.81:0/4058296337 >> 172.21.15.81:0/4058296337 conn(0x7f00b4078190 msgr2=0x7f00b40ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:07.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f00b9836700 1 -- 172.21.15.81:0/4058296337 shutdown_connections 2024-05-09T00:02:07.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f00b9836700 1 -- 172.21.15.81:0/4058296337 wait complete. 2024-05-09T00:02:07.500 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:07 smithi081 ceph-mon[42474]: pgmap v229: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-05-09T00:02:07.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f0bd40ea700 1 -- 172.21.15.81:0/425203123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc068950 msgr2=0x7f0bcc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:07.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f0bd40ea700 1 --2- 172.21.15.81:0/425203123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc068950 0x7f0bcc068db0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009990 tx=0x7f0bbc009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f0bd40ea700 1 -- 172.21.15.81:0/425203123 shutdown_connections 2024-05-09T00:02:07.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f0bd40ea700 1 --2- 172.21.15.81:0/425203123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bcc0692f0 0x7f0bcc10de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f0bd40ea700 1 --2- 172.21.15.81:0/425203123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bcc107020 0x7f0bcc107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f0bd40ea700 1 --2- 172.21.15.81:0/425203123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc068950 0x7f0bcc068db0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f0bd40ea700 1 -- 172.21.15.81:0/425203123 >> 172.21.15.81:0/425203123 conn(0x7f0bcc075f80 msgr2=0x7f0bcc076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:07.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f0bd40ea700 1 -- 172.21.15.81:0/425203123 shutdown_connections 2024-05-09T00:02:07.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.111+0000 7f0bd40ea700 1 -- 172.21.15.81:0/425203123 wait complete. 2024-05-09T00:02:07.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd40ea700 1 Processor -- start 2024-05-09T00:02:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd40ea700 1 -- start start 2024-05-09T00:02:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd40ea700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bcc068950 0x7f0bcc197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd40ea700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bcc0692f0 0x7f0bcc197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd40ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc107020 0x7f0bcc19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd40ea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc19c300 con 0x7f0bcc107020 2024-05-09T00:02:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd40ea700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc19c470 con 0x7f0bcc0692f0 2024-05-09T00:02:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd40ea700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc19c630 con 0x7f0bcc068950 2024-05-09T00:02:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd2687700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc107020 0x7f0bcc19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd2687700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc107020 0x7f0bcc19bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41710/0 (socket says 172.21.15.81:41710) 2024-05-09T00:02:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd2687700 1 -- 172.21.15.81:0/4240684790 learned_addr learned my addr 172.21.15.81:0/4240684790 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd1e86700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bcc068950 0x7f0bcc197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd1685700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bcc0692f0 0x7f0bcc197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:07.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd2687700 1 -- 172.21.15.81:0/4240684790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bcc068950 msgr2=0x7f0bcc197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd2687700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0bcc068950 0x7f0bcc197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd2687700 1 -- 172.21.15.81:0/4240684790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bcc0692f0 msgr2=0x7f0bcc197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd2687700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bcc0692f0 0x7f0bcc197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd2687700 1 -- 172.21.15.81:0/4240684790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0095f0 con 0x7f0bcc107020 2024-05-09T00:02:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.112+0000 7f0bd1685700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0bcc0692f0 0x7f0bcc197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.113+0000 7f0bd2687700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc107020 0x7f0bcc19bcf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400ada0 tx=0x7f0bc400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.113+0000 7f0bc2ffd700 1 -- 172.21.15.81:0/4240684790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400f070 con 0x7f0bcc107020 2024-05-09T00:02:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.113+0000 7f0bd40ea700 1 -- 172.21.15.81:0/4240684790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc19c910 con 0x7f0bcc107020 2024-05-09T00:02:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.113+0000 7f0bc2ffd700 1 -- 172.21.15.81:0/4240684790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bc4007b30 con 0x7f0bcc107020 2024-05-09T00:02:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.113+0000 7f0bc2ffd700 1 -- 172.21.15.81:0/4240684790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40053e0 con 0x7f0bcc107020 2024-05-09T00:02:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.113+0000 7f0bd40ea700 1 -- 172.21.15.81:0/4240684790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc1a4170 con 0x7f0bcc107020 2024-05-09T00:02:07.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.113+0000 7f0bd40ea700 1 -- 172.21.15.81:0/4240684790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0bcc1026d0 con 0x7f0bcc107020 2024-05-09T00:02:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.115+0000 7f0bc2ffd700 1 -- 172.21.15.81:0/4240684790 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0bc400c980 con 0x7f0bcc107020 2024-05-09T00:02:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.115+0000 7f0bc2ffd700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0bb80a11b0 0x7f0bb80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.115+0000 7f0bd1e86700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0bb80a11b0 0x7f0bb80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.115+0000 7f0bc2ffd700 1 -- 172.21.15.81:0/4240684790 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0bc40ccc10 con 0x7f0bcc107020 2024-05-09T00:02:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.116+0000 7f0bc2ffd700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814] conn(0x7f0bb80aa990 0x7f0bb80acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.116+0000 7f0bc2ffd700 1 -- 172.21.15.81:0/4240684790 --> [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0bb80ad460 con 0x7f0bb80aa990 2024-05-09T00:02:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.116+0000 7f0bc2ffd700 1 -- 172.21.15.81:0/4240684790 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bc40cd0b0 con 0x7f0bcc107020 2024-05-09T00:02:07.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.116+0000 7f0bd1e86700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0bb80a11b0 0x7f0bb80a3670 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8005950 tx=0x7f0bc800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.116+0000 7f0bd1685700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814] conn(0x7f0bb80aa990 0x7f0bb80acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.116+0000 7f0bd1685700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814] conn(0x7f0bb80aa990 0x7f0bb80acdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.117+0000 7f0bc2ffd700 1 -- 172.21.15.81:0/4240684790 <== osd.4 v2:172.21.15.150:6808/2025740814 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0bb80ad460 con 0x7f0bb80aa990 2024-05-09T00:02:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.134+0000 7f0bd40ea700 1 -- 172.21.15.81:0/4240684790 --> [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0bcc1111f0 con 0x7f0bb80aa990 2024-05-09T00:02:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.135+0000 7f0bc2ffd700 1 -- 172.21.15.81:0/4240684790 <== osd.4 v2:172.21.15.150:6808/2025740814 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0bcc1111f0 con 0x7f0bb80aa990 2024-05-09T00:02:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.135+0000 7f0bd40ea700 1 -- 172.21.15.81:0/4240684790 >> [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814] conn(0x7f0bb80aa990 msgr2=0x7f0bb80acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.135+0000 7f0bd40ea700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814] conn(0x7f0bb80aa990 0x7f0bb80acdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.135+0000 7f0bd40ea700 1 -- 172.21.15.81:0/4240684790 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0bb80a11b0 msgr2=0x7f0bb80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.135+0000 7f0bd40ea700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0bb80a11b0 0x7f0bb80a3670 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8005950 tx=0x7f0bc800b410 comp rx=0 tx=0).stop 2024-05-09T00:02:07.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.135+0000 7f0bd40ea700 1 -- 172.21.15.81:0/4240684790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc107020 msgr2=0x7f0bcc19bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:07.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.135+0000 7f0bd40ea700 1 --2- 172.21.15.81:0/4240684790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bcc107020 0x7f0bcc19bcf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0bc400ada0 tx=0x7f0bc400c330 comp rx=0 tx=0).stop 2024-05-09T00:02:07.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.135+0000 7f0bd2687700 1 -- 172.21.15.81:0/4240684790 reap_dead start 2024-05-09T00:02:07.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.135+0000 7f0bd40ea700 1 -- 172.21.15.81:0/4240684790 shutdown_connections 2024-05-09T00:02:07.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.135+0000 7f0bd40ea700 1 -- 172.21.15.81:0/4240684790 >> 172.21.15.81:0/4240684790 conn(0x7f0bcc075f80 msgr2=0x7f0bcc0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:07.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.136+0000 7f0bd40ea700 1 -- 172.21.15.81:0/4240684790 shutdown_connections 2024-05-09T00:02:07.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:07.136+0000 7f0bd40ea700 1 -- 172.21.15.81:0/4240684790 wait complete. 2024-05-09T00:02:07.583 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:07.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:07 smithi150 ceph-mon[46187]: pgmap v229: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-05-09T00:02:07.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:07 smithi171 ceph-mon[47351]: pgmap v229: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-05-09T00:02:08.572 INFO:teuthology.orchestra.run.smithi081.stdout:236223201304 2024-05-09T00:02:08.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-09T00:02:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.766+0000 7f747ede3700 1 -- 172.21.15.81:0/4057029146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7478107030 msgr2=0x7f7478107410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.766+0000 7f747ede3700 1 --2- 172.21.15.81:0/4057029146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7478107030 0x7f7478107410 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f746c009990 tx=0x7f746c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.766+0000 7f747ede3700 1 -- 172.21.15.81:0/4057029146 shutdown_connections 2024-05-09T00:02:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.766+0000 7f747ede3700 1 --2- 172.21.15.81:0/4057029146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7478101990 0x7f747810de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.766+0000 7f747ede3700 1 --2- 172.21.15.81:0/4057029146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7478107030 0x7f7478107410 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.766+0000 7f747ede3700 1 --2- 172.21.15.81:0/4057029146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7478100ff0 0x7f7478101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.766+0000 7f747ede3700 1 -- 172.21.15.81:0/4057029146 >> 172.21.15.81:0/4057029146 conn(0x7f7478078190 msgr2=0x7f74780785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.766+0000 7f747ede3700 1 -- 172.21.15.81:0/4057029146 shutdown_connections 2024-05-09T00:02:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.766+0000 7f747ede3700 1 -- 172.21.15.81:0/4057029146 wait complete. 2024-05-09T00:02:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.766+0000 7f747ede3700 1 Processor -- start 2024-05-09T00:02:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.766+0000 7f747ede3700 1 -- start start 2024-05-09T00:02:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747ede3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7478100ff0 0x7f7478197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747ede3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7478101990 0x7f7478197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747ede3700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7478107030 0x7f747819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747ede3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747819c330 con 0x7f7478100ff0 2024-05-09T00:02:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747ede3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747819c4a0 con 0x7f7478101990 2024-05-09T00:02:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747ede3700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747819c660 con 0x7f7478107030 2024-05-09T00:02:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747cb7f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7478100ff0 0x7f7478197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747cb7f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7478100ff0 0x7f7478197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58960/0 (socket says 172.21.15.81:58960) 2024-05-09T00:02:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747cb7f700 1 -- 172.21.15.81:0/1043035998 learned_addr learned my addr 172.21.15.81:0/1043035998 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f7477fff700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7478101990 0x7f7478197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747d380700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7478107030 0x7f747819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747cb7f700 1 -- 172.21.15.81:0/1043035998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7478107030 msgr2=0x7f747819bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747cb7f700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7478107030 0x7f747819bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747cb7f700 1 -- 172.21.15.81:0/1043035998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7478101990 msgr2=0x7f7478197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747cb7f700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7478101990 0x7f7478197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747cb7f700 1 -- 172.21.15.81:0/1043035998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c0095f0 con 0x7f7478100ff0 2024-05-09T00:02:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f7477fff700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7478101990 0x7f7478197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747d380700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7478107030 0x7f747819bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747cb7f700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7478100ff0 0x7f7478197430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f746c0095c0 tx=0x7f746c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f7475ffb700 1 -- 172.21.15.81:0/1043035998 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c01d070 con 0x7f7478100ff0 2024-05-09T00:02:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f7475ffb700 1 -- 172.21.15.81:0/1043035998 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f746c0054f0 con 0x7f7478100ff0 2024-05-09T00:02:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.767+0000 7f747ede3700 1 -- 172.21.15.81:0/1043035998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747819c8e0 con 0x7f7478100ff0 2024-05-09T00:02:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.768+0000 7f747ede3700 1 -- 172.21.15.81:0/1043035998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74781a41a0 con 0x7f7478100ff0 2024-05-09T00:02:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.768+0000 7f7475ffb700 1 -- 172.21.15.81:0/1043035998 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c004c40 con 0x7f7478100ff0 2024-05-09T00:02:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.768+0000 7f747ede3700 1 -- 172.21.15.81:0/1043035998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f745c000fc0 con 0x7f7478100ff0 2024-05-09T00:02:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.770+0000 7f7475ffb700 1 -- 172.21.15.81:0/1043035998 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f746c00fc30 con 0x7f7478100ff0 2024-05-09T00:02:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.770+0000 7f7475ffb700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f74680a1230 0x7f74680a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.770+0000 7f7477fff700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f74680a1230 0x7f74680a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.770+0000 7f7475ffb700 1 -- 172.21.15.81:0/1043035998 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f746c0cdc40 con 0x7f7478100ff0 2024-05-09T00:02:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.770+0000 7f7475ffb700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273] conn(0x7f74680aaa10 0x7f74680ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.770+0000 7f7475ffb700 1 -- 172.21.15.81:0/1043035998 --> [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f74680ad4e0 con 0x7f74680aaa10 2024-05-09T00:02:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.770+0000 7f7475ffb700 1 -- 172.21.15.81:0/1043035998 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f746c0ce0e0 con 0x7f7478100ff0 2024-05-09T00:02:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.771+0000 7f7477fff700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f74680a1230 0x7f74680a36f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7464005950 tx=0x7f74640058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.771+0000 7f747d380700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273] conn(0x7f74680aaa10 0x7f74680ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.771+0000 7f747d380700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273] conn(0x7f74680aaa10 0x7f74680ace30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.772+0000 7f7475ffb700 1 -- 172.21.15.81:0/1043035998 <== osd.11 v2:172.21.15.171:6824/674529273 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f74680ad4e0 con 0x7f74680aaa10 2024-05-09T00:02:08.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.787+0000 7f747ede3700 1 -- 172.21.15.81:0/1043035998 --> [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f745c002d40 con 0x7f74680aaa10 2024-05-09T00:02:08.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.788+0000 7f7475ffb700 1 -- 172.21.15.81:0/1043035998 <== osd.11 v2:172.21.15.171:6824/674529273 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f745c002d40 con 0x7f74680aaa10 2024-05-09T00:02:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.788+0000 7f747ede3700 1 -- 172.21.15.81:0/1043035998 >> [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273] conn(0x7f74680aaa10 msgr2=0x7f74680ace30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.788+0000 7f747ede3700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273] conn(0x7f74680aaa10 0x7f74680ace30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.788+0000 7f747ede3700 1 -- 172.21.15.81:0/1043035998 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f74680a1230 msgr2=0x7f74680a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.788+0000 7f747ede3700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f74680a1230 0x7f74680a36f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7464005950 tx=0x7f74640058e0 comp rx=0 tx=0).stop 2024-05-09T00:02:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.788+0000 7f747ede3700 1 -- 172.21.15.81:0/1043035998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7478100ff0 msgr2=0x7f7478197430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.788+0000 7f747ede3700 1 --2- 172.21.15.81:0/1043035998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7478100ff0 0x7f7478197430 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f746c0095c0 tx=0x7f746c00f740 comp rx=0 tx=0).stop 2024-05-09T00:02:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.788+0000 7f747d380700 1 -- 172.21.15.81:0/1043035998 reap_dead start 2024-05-09T00:02:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.788+0000 7f747ede3700 1 -- 172.21.15.81:0/1043035998 shutdown_connections 2024-05-09T00:02:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.788+0000 7f747ede3700 1 -- 172.21.15.81:0/1043035998 >> 172.21.15.81:0/1043035998 conn(0x7f7478078190 msgr2=0x7f74780ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.788+0000 7f747ede3700 1 -- 172.21.15.81:0/1043035998 shutdown_connections 2024-05-09T00:02:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:08.788+0000 7f747ede3700 1 -- 172.21.15.81:0/1043035998 wait complete. 2024-05-09T00:02:09.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.102+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/2069908344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e48105f00 msgr2=0x7f2e481062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:09.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.102+0000 7f2e4f0c5700 1 --2- 172.21.15.81:0/2069908344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e48105f00 0x7f2e481062e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c009990 tx=0x7f2e3c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:09.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.102+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/2069908344 shutdown_connections 2024-05-09T00:02:09.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.102+0000 7f2e4f0c5700 1 --2- 172.21.15.81:0/2069908344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e48100890 0x7f2e4810cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:09.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.102+0000 7f2e4f0c5700 1 --2- 172.21.15.81:0/2069908344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e48105f00 0x7f2e481062e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:09.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.102+0000 7f2e4f0c5700 1 --2- 172.21.15.81:0/2069908344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e480ffed0 0x7f2e48100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:09.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.102+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/2069908344 >> 172.21.15.81:0/2069908344 conn(0x7f2e48075f80 msgr2=0x7f2e48076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:09.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.102+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/2069908344 shutdown_connections 2024-05-09T00:02:09.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.102+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/2069908344 wait complete. 2024-05-09T00:02:09.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.102+0000 7f2e4f0c5700 1 Processor -- start 2024-05-09T00:02:09.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e4f0c5700 1 -- start start 2024-05-09T00:02:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e4f0c5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e480ffed0 0x7f2e48198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e4f0c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e48100890 0x7f2e48198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e4f0c5700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e48105f00 0x7f2e481a33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e4f0c5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e481990c0 con 0x7f2e48100890 2024-05-09T00:02:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e4f0c5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e481a38f0 con 0x7f2e480ffed0 2024-05-09T00:02:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e4f0c5700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e481a3a30 con 0x7f2e48105f00 2024-05-09T00:02:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e47fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e48100890 0x7f2e48198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e47fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e48100890 0x7f2e48198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58982/0 (socket says 172.21.15.81:58982) 2024-05-09T00:02:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e47fff700 1 -- 172.21.15.81:0/3492354853 learned_addr learned my addr 172.21.15.81:0/3492354853 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e4ce61700 1 --2- 172.21.15.81:0/3492354853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e480ffed0 0x7f2e48198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:09.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e4d662700 1 --2- 172.21.15.81:0/3492354853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e48105f00 0x7f2e481a33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:09.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e47fff700 1 -- 172.21.15.81:0/3492354853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e48105f00 msgr2=0x7f2e481a33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:09.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e47fff700 1 --2- 172.21.15.81:0/3492354853 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e48105f00 0x7f2e481a33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:09.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e47fff700 1 -- 172.21.15.81:0/3492354853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e480ffed0 msgr2=0x7f2e48198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:09.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e47fff700 1 --2- 172.21.15.81:0/3492354853 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e480ffed0 0x7f2e48198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:09.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e47fff700 1 -- 172.21.15.81:0/3492354853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c0095f0 con 0x7f2e48100890 2024-05-09T00:02:09.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e47fff700 1 --2- 172.21.15.81:0/3492354853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e48100890 0x7f2e48198870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400b560 tx=0x7f2e3400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:09.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e45ffb700 1 -- 172.21.15.81:0/3492354853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34011830 con 0x7f2e48100890 2024-05-09T00:02:09.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.103+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/3492354853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e481a3c90 con 0x7f2e48100890 2024-05-09T00:02:09.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.104+0000 7f2e45ffb700 1 -- 172.21.15.81:0/3492354853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e34011e50 con 0x7f2e48100890 2024-05-09T00:02:09.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.104+0000 7f2e45ffb700 1 -- 172.21.15.81:0/3492354853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34010e50 con 0x7f2e48100890 2024-05-09T00:02:09.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.104+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/3492354853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e481a4190 con 0x7f2e48100890 2024-05-09T00:02:09.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.104+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/3492354853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2e48110070 con 0x7f2e48100890 2024-05-09T00:02:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.105+0000 7f2e45ffb700 1 -- 172.21.15.81:0/3492354853 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2e340104f0 con 0x7f2e48100890 2024-05-09T00:02:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.106+0000 7f2e45ffb700 1 --2- 172.21.15.81:0/3492354853 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2e380a11b0 0x7f2e380a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.106+0000 7f2e4ce61700 1 --2- 172.21.15.81:0/3492354853 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2e380a11b0 0x7f2e380a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.106+0000 7f2e45ffb700 1 -- 172.21.15.81:0/3492354853 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2e340cc7e0 con 0x7f2e48100890 2024-05-09T00:02:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.106+0000 7f2e45ffb700 1 --2- 172.21.15.81:0/3492354853 >> [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436] conn(0x7f2e380aa990 0x7f2e380acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.106+0000 7f2e45ffb700 1 -- 172.21.15.81:0/3492354853 --> [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e380ad460 con 0x7f2e380aa990 2024-05-09T00:02:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.106+0000 7f2e45ffb700 1 -- 172.21.15.81:0/3492354853 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e340ccc80 con 0x7f2e48100890 2024-05-09T00:02:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.106+0000 7f2e4ce61700 1 --2- 172.21.15.81:0/3492354853 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2e380a11b0 0x7f2e380a3670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0098e0 tx=0x7f2e3c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.107+0000 7f2e4d662700 1 --2- 172.21.15.81:0/3492354853 >> [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436] conn(0x7f2e380aa990 0x7f2e380acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:09.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.107+0000 7f2e4d662700 1 --2- 172.21.15.81:0/3492354853 >> [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436] conn(0x7f2e380aa990 0x7f2e380acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:09.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.108+0000 7f2e45ffb700 1 -- 172.21.15.81:0/3492354853 <== osd.5 v2:172.21.15.171:6808/3861165436 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2e380ad460 con 0x7f2e380aa990 2024-05-09T00:02:09.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.125+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/3492354853 --> [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2e48061660 con 0x7f2e380aa990 2024-05-09T00:02:09.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.126+0000 7f2e45ffb700 1 -- 172.21.15.81:0/3492354853 <== osd.5 v2:172.21.15.171:6808/3861165436 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2e48061660 con 0x7f2e380aa990 2024-05-09T00:02:09.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.126+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/3492354853 >> [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436] conn(0x7f2e380aa990 msgr2=0x7f2e380acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:09.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.126+0000 7f2e4f0c5700 1 --2- 172.21.15.81:0/3492354853 >> [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436] conn(0x7f2e380aa990 0x7f2e380acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:09.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.126+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/3492354853 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2e380a11b0 msgr2=0x7f2e380a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:09.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.126+0000 7f2e4f0c5700 1 --2- 172.21.15.81:0/3492354853 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2e380a11b0 0x7f2e380a3670 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c0098e0 tx=0x7f2e3c005960 comp rx=0 tx=0).stop 2024-05-09T00:02:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.126+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/3492354853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e48100890 msgr2=0x7f2e48198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.126+0000 7f2e4f0c5700 1 --2- 172.21.15.81:0/3492354853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e48100890 0x7f2e48198870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2e3400b560 tx=0x7f2e3400b870 comp rx=0 tx=0).stop 2024-05-09T00:02:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.126+0000 7f2e4d662700 1 -- 172.21.15.81:0/3492354853 reap_dead start 2024-05-09T00:02:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.126+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/3492354853 shutdown_connections 2024-05-09T00:02:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.126+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/3492354853 >> 172.21.15.81:0/3492354853 conn(0x7f2e48075f80 msgr2=0x7f2e480feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.126+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/3492354853 shutdown_connections 2024-05-09T00:02:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:09.126+0000 7f2e4f0c5700 1 -- 172.21.15.81:0/3492354853 wait complete. 2024-05-09T00:02:09.189 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:09.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:09 smithi081 ceph-mon[42474]: pgmap v230: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-05-09T00:02:09.432 INFO:teuthology.orchestra.run.smithi081.stdout:133143986215 2024-05-09T00:02:09.432 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-09T00:02:09.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:09 smithi150 ceph-mon[46187]: pgmap v230: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-05-09T00:02:09.767 INFO:teuthology.orchestra.run.smithi081.stdout:317827579919 2024-05-09T00:02:09.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-09T00:02:09.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:09 smithi171 ceph-mon[47351]: pgmap v230: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-05-09T00:02:09.861 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:10.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.229+0000 7f377a17c700 1 -- 172.21.15.81:0/134883700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3774106fe0 msgr2=0x7f37741073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:10.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.229+0000 7f377a17c700 1 --2- 172.21.15.81:0/134883700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3774106fe0 0x7f37741073c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f375c0099c0 tx=0x7f375c009cd0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.229+0000 7f377a17c700 1 -- 172.21.15.81:0/134883700 shutdown_connections 2024-05-09T00:02:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.229+0000 7f377a17c700 1 --2- 172.21.15.81:0/134883700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3774069bd0 0x7f377410de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.229+0000 7f377a17c700 1 --2- 172.21.15.81:0/134883700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3774106fe0 0x7f37741073c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.229+0000 7f377a17c700 1 --2- 172.21.15.81:0/134883700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3774069210 0x7f3774069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.229+0000 7f377a17c700 1 -- 172.21.15.81:0/134883700 >> 172.21.15.81:0/134883700 conn(0x7f3774076e70 msgr2=0x7f3774077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.229+0000 7f377a17c700 1 -- 172.21.15.81:0/134883700 shutdown_connections 2024-05-09T00:02:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.229+0000 7f377a17c700 1 -- 172.21.15.81:0/134883700 wait complete. 2024-05-09T00:02:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.230+0000 7f377a17c700 1 Processor -- start 2024-05-09T00:02:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.230+0000 7f377a17c700 1 -- start start 2024-05-09T00:02:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.230+0000 7f377a17c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3774069210 0x7f37740fff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f377a17c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3774069bd0 0x7f37741004a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f377a17c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3774106fe0 0x7f37741009e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f377a17c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37741a5710 con 0x7f3774069210 2024-05-09T00:02:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f377a17c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37741a5880 con 0x7f3774069bd0 2024-05-09T00:02:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f377a17c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37741a5a40 con 0x7f3774106fe0 2024-05-09T00:02:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f37737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3774069210 0x7f37740fff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f37737fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3774069210 0x7f37740fff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58988/0 (socket says 172.21.15.81:58988) 2024-05-09T00:02:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f37737fe700 1 -- 172.21.15.81:0/2332484124 learned_addr learned my addr 172.21.15.81:0/2332484124 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f3773fff700 1 --2- 172.21.15.81:0/2332484124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3774106fe0 0x7f37741009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f3772ffd700 1 --2- 172.21.15.81:0/2332484124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3774069bd0 0x7f37741004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f37737fe700 1 -- 172.21.15.81:0/2332484124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3774106fe0 msgr2=0x7f37741009e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f37737fe700 1 --2- 172.21.15.81:0/2332484124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3774106fe0 0x7f37741009e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f37737fe700 1 -- 172.21.15.81:0/2332484124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3774069bd0 msgr2=0x7f37741004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f37737fe700 1 --2- 172.21.15.81:0/2332484124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3774069bd0 0x7f37741004a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f37737fe700 1 -- 172.21.15.81:0/2332484124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c0095f0 con 0x7f3774069210 2024-05-09T00:02:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f37737fe700 1 --2- 172.21.15.81:0/2332484124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3774069210 0x7f37740fff60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f375c00f690 tx=0x7f375c00bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f3770ff9700 1 -- 172.21.15.81:0/2332484124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c01c070 con 0x7f3774069210 2024-05-09T00:02:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f377a17c700 1 -- 172.21.15.81:0/2332484124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37741a5cc0 con 0x7f3774069210 2024-05-09T00:02:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f3770ff9700 1 -- 172.21.15.81:0/2332484124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f375c00fe50 con 0x7f3774069210 2024-05-09T00:02:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f3770ff9700 1 -- 172.21.15.81:0/2332484124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c022db0 con 0x7f3774069210 2024-05-09T00:02:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.231+0000 7f377a17c700 1 -- 172.21.15.81:0/2332484124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37741a60d0 con 0x7f3774069210 2024-05-09T00:02:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.232+0000 7f377a17c700 1 -- 172.21.15.81:0/2332484124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3774102690 con 0x7f3774069210 2024-05-09T00:02:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.234+0000 7f3770ff9700 1 -- 172.21.15.81:0/2332484124 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f375c020070 con 0x7f3774069210 2024-05-09T00:02:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.234+0000 7f3770ff9700 1 --2- 172.21.15.81:0/2332484124 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f37600a11b0 0x7f37600a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.234+0000 7f3770ff9700 1 -- 172.21.15.81:0/2332484124 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f375c0ce140 con 0x7f3774069210 2024-05-09T00:02:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.234+0000 7f3772ffd700 1 --2- 172.21.15.81:0/2332484124 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f37600a11b0 0x7f37600a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.234+0000 7f3770ff9700 1 --2- 172.21.15.81:0/2332484124 >> [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999] conn(0x7f37600aa990 0x7f37600acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.234+0000 7f3770ff9700 1 -- 172.21.15.81:0/2332484124 --> [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37600ad460 con 0x7f37600aa990 2024-05-09T00:02:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.234+0000 7f3770ff9700 1 -- 172.21.15.81:0/2332484124 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f375c0ce5e0 con 0x7f3774069210 2024-05-09T00:02:10.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.234+0000 7f3772ffd700 1 --2- 172.21.15.81:0/2332484124 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f37600a11b0 0x7f37600a3670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3774101690 tx=0x7f3764009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:10.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.235+0000 7f3773fff700 1 --2- 172.21.15.81:0/2332484124 >> [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999] conn(0x7f37600aa990 0x7f37600acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:10.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.235+0000 7f3773fff700 1 --2- 172.21.15.81:0/2332484124 >> [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999] conn(0x7f37600aa990 0x7f37600acdb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:10.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.236+0000 7f3770ff9700 1 -- 172.21.15.81:0/2332484124 <== osd.2 v2:172.21.15.171:6800/1178354999 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f37600ad460 con 0x7f37600aa990 2024-05-09T00:02:10.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.252+0000 7f377a17c700 1 -- 172.21.15.81:0/2332484124 --> [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f37741110e0 con 0x7f37600aa990 2024-05-09T00:02:10.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.252+0000 7f3770ff9700 1 -- 172.21.15.81:0/2332484124 <== osd.2 v2:172.21.15.171:6800/1178354999 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f37741110e0 con 0x7f37600aa990 2024-05-09T00:02:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.253+0000 7f377a17c700 1 -- 172.21.15.81:0/2332484124 >> [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999] conn(0x7f37600aa990 msgr2=0x7f37600acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.253+0000 7f377a17c700 1 --2- 172.21.15.81:0/2332484124 >> [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999] conn(0x7f37600aa990 0x7f37600acdb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.253+0000 7f377a17c700 1 -- 172.21.15.81:0/2332484124 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f37600a11b0 msgr2=0x7f37600a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.253+0000 7f377a17c700 1 --2- 172.21.15.81:0/2332484124 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f37600a11b0 0x7f37600a3670 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3774101690 tx=0x7f3764009260 comp rx=0 tx=0).stop 2024-05-09T00:02:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.253+0000 7f377a17c700 1 -- 172.21.15.81:0/2332484124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3774069210 msgr2=0x7f37740fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.253+0000 7f377a17c700 1 --2- 172.21.15.81:0/2332484124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3774069210 0x7f37740fff60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f375c00f690 tx=0x7f375c00bfd0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.253+0000 7f3773fff700 1 -- 172.21.15.81:0/2332484124 reap_dead start 2024-05-09T00:02:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.253+0000 7f377a17c700 1 -- 172.21.15.81:0/2332484124 shutdown_connections 2024-05-09T00:02:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.253+0000 7f377a17c700 1 -- 172.21.15.81:0/2332484124 >> 172.21.15.81:0/2332484124 conn(0x7f3774076e70 msgr2=0x7f37740fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.253+0000 7f377a17c700 1 -- 172.21.15.81:0/2332484124 shutdown_connections 2024-05-09T00:02:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.253+0000 7f377a17c700 1 -- 172.21.15.81:0/2332484124 wait complete. 2024-05-09T00:02:10.416 INFO:teuthology.orchestra.run.smithi081.stdout:154618822692 2024-05-09T00:02:10.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-09T00:02:10.464 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.646+0000 7fee50fee700 1 -- 172.21.15.81:0/1906875931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee4c068950 msgr2=0x7fee4c068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.646+0000 7fee50fee700 1 --2- 172.21.15.81:0/1906875931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee4c068950 0x7fee4c068db0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fee40009990 tx=0x7fee40009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.646+0000 7fee50fee700 1 -- 172.21.15.81:0/1906875931 shutdown_connections 2024-05-09T00:02:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.646+0000 7fee50fee700 1 --2- 172.21.15.81:0/1906875931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c107020 0x7fee4c107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.646+0000 7fee50fee700 1 --2- 172.21.15.81:0/1906875931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee4c0692f0 0x7fee4c10de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.646+0000 7fee50fee700 1 --2- 172.21.15.81:0/1906875931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee4c068950 0x7fee4c068db0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.646+0000 7fee50fee700 1 -- 172.21.15.81:0/1906875931 >> 172.21.15.81:0/1906875931 conn(0x7fee4c075f80 msgr2=0x7fee4c076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.646+0000 7fee50fee700 1 -- 172.21.15.81:0/1906875931 shutdown_connections 2024-05-09T00:02:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.646+0000 7fee50fee700 1 -- 172.21.15.81:0/1906875931 wait complete. 2024-05-09T00:02:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee50fee700 1 Processor -- start 2024-05-09T00:02:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee50fee700 1 -- start start 2024-05-09T00:02:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee50fee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c068950 0x7fee4c197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee50fee700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee4c0692f0 0x7fee4c197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee50fee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee4c107020 0x7fee4c19bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee50fee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c19c330 con 0x7fee4c107020 2024-05-09T00:02:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee50fee700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c19c4a0 con 0x7fee4c068950 2024-05-09T00:02:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee50fee700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c19c660 con 0x7fee4c0692f0 2024-05-09T00:02:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee4ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee4c107020 0x7fee4c19bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee4ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee4c107020 0x7fee4c19bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58994/0 (socket says 172.21.15.81:58994) 2024-05-09T00:02:10.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee4ad9d700 1 -- 172.21.15.81:0/251808680 learned_addr learned my addr 172.21.15.81:0/251808680 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee4a59c700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c068950 0x7fee4c197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee49d9b700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee4c0692f0 0x7fee4c197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee4ad9d700 1 -- 172.21.15.81:0/251808680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee4c0692f0 msgr2=0x7fee4c197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee4ad9d700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee4c0692f0 0x7fee4c197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee4ad9d700 1 -- 172.21.15.81:0/251808680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c068950 msgr2=0x7fee4c197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.647+0000 7fee4ad9d700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fee4c068950 0x7fee4c197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.648+0000 7fee4ad9d700 1 -- 172.21.15.81:0/251808680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee400095f0 con 0x7fee4c107020 2024-05-09T00:02:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.648+0000 7fee49d9b700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fee4c0692f0 0x7fee4c197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.648+0000 7fee4ad9d700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee4c107020 0x7fee4c19bd20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fee4400b970 tx=0x7fee4400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:10.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.648+0000 7fee3b7fe700 1 -- 172.21.15.81:0/251808680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4400c930 con 0x7fee4c107020 2024-05-09T00:02:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.648+0000 7fee3b7fe700 1 -- 172.21.15.81:0/251808680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee44014440 con 0x7fee4c107020 2024-05-09T00:02:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.648+0000 7fee50fee700 1 -- 172.21.15.81:0/251808680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c19c940 con 0x7fee4c107020 2024-05-09T00:02:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.648+0000 7fee3b7fe700 1 -- 172.21.15.81:0/251808680 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee440075d0 con 0x7fee4c107020 2024-05-09T00:02:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.648+0000 7fee50fee700 1 -- 172.21.15.81:0/251808680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c1a41a0 con 0x7fee4c107020 2024-05-09T00:02:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.649+0000 7fee50fee700 1 -- 172.21.15.81:0/251808680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee4c1026d0 con 0x7fee4c107020 2024-05-09T00:02:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.650+0000 7fee3b7fe700 1 -- 172.21.15.81:0/251808680 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fee440145b0 con 0x7fee4c107020 2024-05-09T00:02:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.650+0000 7fee3b7fe700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fee340a11b0 0x7fee340a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.650+0000 7fee4a59c700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fee340a11b0 0x7fee340a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.651+0000 7fee3b7fe700 1 -- 172.21.15.81:0/251808680 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fee44006e40 con 0x7fee4c107020 2024-05-09T00:02:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.651+0000 7fee3b7fe700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112] conn(0x7fee340aa990 0x7fee340acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.651+0000 7fee3b7fe700 1 -- 172.21.15.81:0/251808680 --> [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee340ad460 con 0x7fee340aa990 2024-05-09T00:02:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.651+0000 7fee3b7fe700 1 -- 172.21.15.81:0/251808680 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee440cc970 con 0x7fee4c107020 2024-05-09T00:02:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.651+0000 7fee4a59c700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fee340a11b0 0x7fee340a3670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee3c005950 tx=0x7fee3c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:10.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.651+0000 7fee49d9b700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112] conn(0x7fee340aa990 0x7fee340acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:10.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.651+0000 7fee49d9b700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112] conn(0x7fee340aa990 0x7fee340acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:10.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.652+0000 7fee3b7fe700 1 -- 172.21.15.81:0/251808680 <== osd.1 v2:172.21.15.150:6800/149811112 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fee340ad460 con 0x7fee340aa990 2024-05-09T00:02:10.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.668+0000 7fee50fee700 1 -- 172.21.15.81:0/251808680 --> [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fee4c111240 con 0x7fee340aa990 2024-05-09T00:02:10.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.669+0000 7fee3b7fe700 1 -- 172.21.15.81:0/251808680 <== osd.1 v2:172.21.15.150:6800/149811112 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fee4c111240 con 0x7fee340aa990 2024-05-09T00:02:10.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.669+0000 7fee50fee700 1 -- 172.21.15.81:0/251808680 >> [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112] conn(0x7fee340aa990 msgr2=0x7fee340acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:10.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.669+0000 7fee50fee700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112] conn(0x7fee340aa990 0x7fee340acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:10.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.669+0000 7fee50fee700 1 -- 172.21.15.81:0/251808680 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fee340a11b0 msgr2=0x7fee340a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:10.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.669+0000 7fee50fee700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fee340a11b0 0x7fee340a3670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee3c005950 tx=0x7fee3c00a300 comp rx=0 tx=0).stop 2024-05-09T00:02:10.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.669+0000 7fee50fee700 1 -- 172.21.15.81:0/251808680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee4c107020 msgr2=0x7fee4c19bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:10.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.669+0000 7fee50fee700 1 --2- 172.21.15.81:0/251808680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee4c107020 0x7fee4c19bd20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fee4400b970 tx=0x7fee4400bc80 comp rx=0 tx=0).stop 2024-05-09T00:02:10.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.669+0000 7fee4ad9d700 1 -- 172.21.15.81:0/251808680 reap_dead start 2024-05-09T00:02:10.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.669+0000 7fee50fee700 1 -- 172.21.15.81:0/251808680 shutdown_connections 2024-05-09T00:02:10.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.669+0000 7fee50fee700 1 -- 172.21.15.81:0/251808680 >> 172.21.15.81:0/251808680 conn(0x7fee4c075f80 msgr2=0x7fee4c0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:10.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.669+0000 7fee50fee700 1 -- 172.21.15.81:0/251808680 shutdown_connections 2024-05-09T00:02:10.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:10.670+0000 7fee50fee700 1 -- 172.21.15.81:0/251808680 wait complete. 2024-05-09T00:02:11.250 INFO:teuthology.orchestra.run.smithi081.stdout:73014444079 2024-05-09T00:02:11.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-09T00:02:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.379+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/4019160737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bc0107020 msgr2=0x7f5bc0107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.379+0000 7f5bc4c3d700 1 --2- 172.21.15.81:0/4019160737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bc0107020 0x7f5bc0107400 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009990 tx=0x7f5bb0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.379+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/4019160737 shutdown_connections 2024-05-09T00:02:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.379+0000 7f5bc4c3d700 1 --2- 172.21.15.81:0/4019160737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5bc00692f0 0x7f5bc010de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.379+0000 7f5bc4c3d700 1 --2- 172.21.15.81:0/4019160737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bc0107020 0x7f5bc0107400 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.379+0000 7f5bc4c3d700 1 --2- 172.21.15.81:0/4019160737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bc0068950 0x7f5bc0068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.379+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/4019160737 >> 172.21.15.81:0/4019160737 conn(0x7f5bc0075f80 msgr2=0x7f5bc0076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.379+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/4019160737 shutdown_connections 2024-05-09T00:02:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.379+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/4019160737 wait complete. 2024-05-09T00:02:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.380+0000 7f5bc4c3d700 1 Processor -- start 2024-05-09T00:02:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.380+0000 7f5bc4c3d700 1 -- start start 2024-05-09T00:02:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.380+0000 7f5bc4c3d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5bc0068950 0x7f5bc0197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.380+0000 7f5bc4c3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bc00692f0 0x7f5bc01979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.380+0000 7f5bc4c3d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bc0107020 0x7f5bc019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.380+0000 7f5bc4c3d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc019c380 con 0x7f5bc00692f0 2024-05-09T00:02:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.380+0000 7f5bc4c3d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc019c4f0 con 0x7f5bc0107020 2024-05-09T00:02:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.380+0000 7f5bc4c3d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc019c6b0 con 0x7f5bc0068950 2024-05-09T00:02:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.380+0000 7f5bbdd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bc00692f0 0x7f5bc01979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.380+0000 7f5bbdd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bc00692f0 0x7f5bc01979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59012/0 (socket says 172.21.15.81:59012) 2024-05-09T00:02:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.380+0000 7f5bbdd9b700 1 -- 172.21.15.81:0/3461938891 learned_addr learned my addr 172.21.15.81:0/3461938891 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.380+0000 7f5bbe59c700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5bc0068950 0x7f5bc0197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.380+0000 7f5bbed9d700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bc0107020 0x7f5bc019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.381+0000 7f5bbdd9b700 1 -- 172.21.15.81:0/3461938891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5bc0068950 msgr2=0x7f5bc0197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.381+0000 7f5bbdd9b700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5bc0068950 0x7f5bc0197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.381+0000 7f5bbdd9b700 1 -- 172.21.15.81:0/3461938891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bc0107020 msgr2=0x7f5bc019bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.381+0000 7f5bbdd9b700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bc0107020 0x7f5bc019bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.381+0000 7f5bbdd9b700 1 -- 172.21.15.81:0/3461938891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb00095f0 con 0x7f5bc00692f0 2024-05-09T00:02:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.381+0000 7f5bbe59c700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5bc0068950 0x7f5bc0197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.381+0000 7f5bbdd9b700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bc00692f0 0x7f5bc01979c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400b530 tx=0x7f5bb400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.381+0000 7f5baf7fe700 1 -- 172.21.15.81:0/3461938891 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4011830 con 0x7f5bc00692f0 2024-05-09T00:02:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.381+0000 7f5baf7fe700 1 -- 172.21.15.81:0/3461938891 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5bb4011e50 con 0x7f5bc00692f0 2024-05-09T00:02:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.381+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/3461938891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc019c990 con 0x7f5bc00692f0 2024-05-09T00:02:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.381+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/3461938891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc01a41f0 con 0x7f5bc00692f0 2024-05-09T00:02:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.381+0000 7f5baf7fe700 1 -- 172.21.15.81:0/3461938891 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb400f2e0 con 0x7f5bc00692f0 2024-05-09T00:02:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.382+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/3461938891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba00052f0 con 0x7f5bc00692f0 2024-05-09T00:02:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.384+0000 7f5baf7fe700 1 -- 172.21.15.81:0/3461938891 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5bb4011990 con 0x7f5bc00692f0 2024-05-09T00:02:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.385+0000 7f5baf7fe700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5ba80a1230 0x7f5ba80a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.385+0000 7f5bbe59c700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5ba80a1230 0x7f5ba80a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.385+0000 7f5baf7fe700 1 -- 172.21.15.81:0/3461938891 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5bb40cc190 con 0x7f5bc00692f0 2024-05-09T00:02:11.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.385+0000 7f5bbe59c700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5ba80a1230 0x7f5ba80a36f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000b5c0 tx=0x7f5bb001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:11.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.389+0000 7f5baf7fe700 1 -- 172.21.15.81:0/3461938891 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5bb4095a80 con 0x7f5bc00692f0 2024-05-09T00:02:11.491 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:11 smithi081 ceph-mon[42474]: pgmap v231: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-05-09T00:02:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.598+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/3461938891 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5ba0005870 con 0x7f5bc00692f0 2024-05-09T00:02:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.598+0000 7f5baf7fe700 1 -- 172.21.15.81:0/3461938891 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5bb40990a0 con 0x7f5bc00692f0 2024-05-09T00:02:11.592 INFO:teuthology.orchestra.run.smithi081.stdout:34359738421 2024-05-09T00:02:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.600+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/3461938891 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5ba80a1230 msgr2=0x7f5ba80a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.600+0000 7f5bc4c3d700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5ba80a1230 0x7f5ba80a36f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000b5c0 tx=0x7f5bb001a040 comp rx=0 tx=0).stop 2024-05-09T00:02:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.600+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/3461938891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bc00692f0 msgr2=0x7f5bc01979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.600+0000 7f5bc4c3d700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bc00692f0 0x7f5bc01979c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5bb400b530 tx=0x7f5bb400b8f0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.600+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/3461938891 shutdown_connections 2024-05-09T00:02:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.600+0000 7f5bc4c3d700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f5ba80a1230 0x7f5ba80a36f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.600+0000 7f5bc4c3d700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5bc0107020 0x7f5bc019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.600+0000 7f5bc4c3d700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5bc0068950 0x7f5bc0197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.600+0000 7f5bc4c3d700 1 --2- 172.21.15.81:0/3461938891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bc00692f0 0x7f5bc01979c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.600+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/3461938891 >> 172.21.15.81:0/3461938891 conn(0x7f5bc0075f80 msgr2=0x7f5bc00fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.600+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/3461938891 shutdown_connections 2024-05-09T00:02:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.600+0000 7f5bc4c3d700 1 -- 172.21.15.81:0/3461938891 wait complete. 2024-05-09T00:02:11.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.765+0000 7ff00cc7d700 1 -- 172.21.15.81:0/864299287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00806a270 msgr2=0x7ff008105bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:11.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.765+0000 7ff00cc7d700 1 --2- 172.21.15.81:0/864299287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00806a270 0x7ff008105bf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7feffc009990 tx=0x7feffc009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.765+0000 7ff00cc7d700 1 -- 172.21.15.81:0/864299287 shutdown_connections 2024-05-09T00:02:11.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.765+0000 7ff00cc7d700 1 --2- 172.21.15.81:0/864299287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff0080698c0 0x7ff008069ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.765+0000 7ff00cc7d700 1 --2- 172.21.15.81:0/864299287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0081062d0 0x7ff00810dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.765+0000 7ff00cc7d700 1 --2- 172.21.15.81:0/864299287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00806a270 0x7ff008105bf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.765+0000 7ff00cc7d700 1 -- 172.21.15.81:0/864299287 >> 172.21.15.81:0/864299287 conn(0x7ff008076c40 msgr2=0x7ff008077050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:11.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.765+0000 7ff00cc7d700 1 -- 172.21.15.81:0/864299287 shutdown_connections 2024-05-09T00:02:11.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.765+0000 7ff00cc7d700 1 -- 172.21.15.81:0/864299287 wait complete. 2024-05-09T00:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.766+0000 7ff00cc7d700 1 Processor -- start 2024-05-09T00:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.766+0000 7ff00cc7d700 1 -- start start 2024-05-09T00:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00cc7d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080698c0 0x7ff008197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00cc7d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff00806a270 0x7ff0081978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00cc7d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0081062d0 0x7ff00819bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:11.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00cc7d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00819c290 con 0x7ff0080698c0 2024-05-09T00:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00cc7d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00819c400 con 0x7ff00806a270 2024-05-09T00:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00cc7d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00819c5c0 con 0x7ff0081062d0 2024-05-09T00:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080698c0 0x7ff008197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080698c0 0x7ff008197390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59036/0 (socket says 172.21.15.81:59036) 2024-05-09T00:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00659c700 1 -- 172.21.15.81:0/3539263478 learned_addr learned my addr 172.21.15.81:0/3539263478 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff005d9b700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff00806a270 0x7ff0081978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff006d9d700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0081062d0 0x7ff00819bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00659c700 1 -- 172.21.15.81:0/3539263478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0081062d0 msgr2=0x7ff00819bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00659c700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff0081062d0 0x7ff00819bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00659c700 1 -- 172.21.15.81:0/3539263478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff00806a270 msgr2=0x7ff0081978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00659c700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff00806a270 0x7ff0081978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00659c700 1 -- 172.21.15.81:0/3539263478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc0095f0 con 0x7ff0080698c0 2024-05-09T00:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff005d9b700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff00806a270 0x7ff0081978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.767+0000 7ff00659c700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080698c0 0x7ff008197390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feff800c920 tx=0x7feff800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.768+0000 7feff77fe700 1 -- 172.21.15.81:0/3539263478 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8007b00 con 0x7ff0080698c0 2024-05-09T00:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.768+0000 7feff77fe700 1 -- 172.21.15.81:0/3539263478 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feff8004cf0 con 0x7ff0080698c0 2024-05-09T00:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.768+0000 7ff00cc7d700 1 -- 172.21.15.81:0/3539263478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00819c8a0 con 0x7ff0080698c0 2024-05-09T00:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.768+0000 7feff77fe700 1 -- 172.21.15.81:0/3539263478 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8005610 con 0x7ff0080698c0 2024-05-09T00:02:11.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.768+0000 7ff00cc7d700 1 -- 172.21.15.81:0/3539263478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0081a4100 con 0x7ff0080698c0 2024-05-09T00:02:11.765 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:11 smithi150 ceph-mon[46187]: pgmap v231: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-05-09T00:02:11.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.769+0000 7ff00cc7d700 1 -- 172.21.15.81:0/3539263478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fefe8000fc0 con 0x7ff0080698c0 2024-05-09T00:02:11.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.770+0000 7feff77fe700 1 -- 172.21.15.81:0/3539263478 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7feff800f450 con 0x7ff0080698c0 2024-05-09T00:02:11.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.771+0000 7feff77fe700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7feff00a11b0 0x7feff00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:11.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.771+0000 7ff005d9b700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7feff00a11b0 0x7feff00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:11.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.771+0000 7feff77fe700 1 -- 172.21.15.81:0/3539263478 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7feff80cc9d0 con 0x7ff0080698c0 2024-05-09T00:02:11.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.771+0000 7feff77fe700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729] conn(0x7feff00aa990 0x7feff00acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:11.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.771+0000 7feff77fe700 1 -- 172.21.15.81:0/3539263478 --> [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feff00ad460 con 0x7feff00aa990 2024-05-09T00:02:11.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.771+0000 7feff77fe700 1 -- 172.21.15.81:0/3539263478 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7feff80cce70 con 0x7ff0080698c0 2024-05-09T00:02:11.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.771+0000 7ff006d9d700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729] conn(0x7feff00aa990 0x7feff00acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:11.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.771+0000 7ff005d9b700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7feff00a11b0 0x7feff00a3670 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feffc00b2e0 tx=0x7feffc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:11.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.771+0000 7ff006d9d700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729] conn(0x7feff00aa990 0x7feff00acdb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:11.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.772+0000 7feff77fe700 1 -- 172.21.15.81:0/3539263478 <== osd.3 v2:172.21.15.81:6810/1225293729 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7feff00ad460 con 0x7feff00aa990 2024-05-09T00:02:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.791+0000 7ff00cc7d700 1 -- 172.21.15.81:0/3539263478 --> [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fefe8002d40 con 0x7feff00aa990 2024-05-09T00:02:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.792+0000 7feff77fe700 1 -- 172.21.15.81:0/3539263478 <== osd.3 v2:172.21.15.81:6810/1225293729 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fefe8002d40 con 0x7feff00aa990 2024-05-09T00:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.792+0000 7ff00cc7d700 1 -- 172.21.15.81:0/3539263478 >> [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729] conn(0x7feff00aa990 msgr2=0x7feff00acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.792+0000 7ff00cc7d700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729] conn(0x7feff00aa990 0x7feff00acdb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.792+0000 7ff00cc7d700 1 -- 172.21.15.81:0/3539263478 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7feff00a11b0 msgr2=0x7feff00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.792+0000 7ff00cc7d700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7feff00a11b0 0x7feff00a3670 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feffc00b2e0 tx=0x7feffc005fd0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.792+0000 7ff00cc7d700 1 -- 172.21.15.81:0/3539263478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080698c0 msgr2=0x7ff008197390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.792+0000 7ff00cc7d700 1 --2- 172.21.15.81:0/3539263478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080698c0 0x7ff008197390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feff800c920 tx=0x7feff800cce0 comp rx=0 tx=0).stop 2024-05-09T00:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.792+0000 7ff006d9d700 1 -- 172.21.15.81:0/3539263478 reap_dead start 2024-05-09T00:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.793+0000 7ff00cc7d700 1 -- 172.21.15.81:0/3539263478 shutdown_connections 2024-05-09T00:02:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.793+0000 7ff00cc7d700 1 -- 172.21.15.81:0/3539263478 >> 172.21.15.81:0/3539263478 conn(0x7ff008076c40 msgr2=0x7ff0080ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.793+0000 7ff00cc7d700 1 -- 172.21.15.81:0/3539263478 shutdown_connections 2024-05-09T00:02:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:11.793+0000 7ff00cc7d700 1 -- 172.21.15.81:0/3539263478 wait complete. 2024-05-09T00:02:11.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:11 smithi171 ceph-mon[47351]: pgmap v231: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-05-09T00:02:12.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:12 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3461938891' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T00:02:12.682 INFO:teuthology.orchestra.run.smithi081.stdout:55834574898 2024-05-09T00:02:12.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-09T00:02:12.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:12 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3461938891' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T00:02:12.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:12 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3461938891' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-09T00:02:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.822+0000 7fb6472fd700 1 -- 172.21.15.81:0/2002631710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb640101c00 msgr2=0x7fb640105bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.822+0000 7fb6472fd700 1 --2- 172.21.15.81:0/2002631710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb640101c00 0x7fb640105bc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fb630009990 tx=0x7fb630009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.822+0000 7fb6472fd700 1 -- 172.21.15.81:0/2002631710 shutdown_connections 2024-05-09T00:02:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.822+0000 7fb6472fd700 1 --2- 172.21.15.81:0/2002631710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb640101250 0x7fb640101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.822+0000 7fb6472fd700 1 --2- 172.21.15.81:0/2002631710 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6401062a0 0x7fb64010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:12.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.822+0000 7fb6472fd700 1 --2- 172.21.15.81:0/2002631710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb640101c00 0x7fb640105bc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.822+0000 7fb6472fd700 1 -- 172.21.15.81:0/2002631710 >> 172.21.15.81:0/2002631710 conn(0x7fb640078160 msgr2=0x7fb640078570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.823+0000 7fb6472fd700 1 -- 172.21.15.81:0/2002631710 shutdown_connections 2024-05-09T00:02:12.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.823+0000 7fb6472fd700 1 -- 172.21.15.81:0/2002631710 wait complete. 2024-05-09T00:02:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.824+0000 7fb6472fd700 1 Processor -- start 2024-05-09T00:02:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.824+0000 7fb6472fd700 1 -- start start 2024-05-09T00:02:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.824+0000 7fb6472fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb640101250 0x7fb640197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb6472fd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb640101c00 0x7fb6401977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb6472fd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6401062a0 0x7fb64019bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb6472fd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64019c180 con 0x7fb640101250 2024-05-09T00:02:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb6472fd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64019c2f0 con 0x7fb6401062a0 2024-05-09T00:02:12.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb6472fd700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64019c4b0 con 0x7fb640101c00 2024-05-09T00:02:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb645099700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb640101250 0x7fb640197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb645099700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb640101250 0x7fb640197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59054/0 (socket says 172.21.15.81:59054) 2024-05-09T00:02:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb645099700 1 -- 172.21.15.81:0/4067475418 learned_addr learned my addr 172.21.15.81:0/4067475418 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb645099700 1 -- 172.21.15.81:0/4067475418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb640101c00 msgr2=0x7fb6401977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb645099700 1 --2- 172.21.15.81:0/4067475418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb640101c00 0x7fb6401977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb645099700 1 -- 172.21.15.81:0/4067475418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6401062a0 msgr2=0x7fb64019bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb64589a700 1 --2- 172.21.15.81:0/4067475418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6401062a0 0x7fb64019bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb645099700 1 --2- 172.21.15.81:0/4067475418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb6401062a0 0x7fb64019bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb645099700 1 -- 172.21.15.81:0/4067475418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6300095f0 con 0x7fb640101250 2024-05-09T00:02:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb645099700 1 --2- 172.21.15.81:0/4067475418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb640101250 0x7fb640197280 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00c9b0 tx=0x7fb63c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb6367fc700 1 -- 172.21.15.81:0/4067475418 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c007b00 con 0x7fb640101250 2024-05-09T00:02:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb6472fd700 1 -- 172.21.15.81:0/4067475418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64019c730 con 0x7fb640101250 2024-05-09T00:02:12.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb6472fd700 1 -- 172.21.15.81:0/4067475418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64006ab90 con 0x7fb640101250 2024-05-09T00:02:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.825+0000 7fb6367fc700 1 -- 172.21.15.81:0/4067475418 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb63c007c60 con 0x7fb640101250 2024-05-09T00:02:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.826+0000 7fb6367fc700 1 -- 172.21.15.81:0/4067475418 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c018660 con 0x7fb640101250 2024-05-09T00:02:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.826+0000 7fb6472fd700 1 -- 172.21.15.81:0/4067475418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb624000fc0 con 0x7fb640101250 2024-05-09T00:02:12.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.828+0000 7fb6367fc700 1 -- 172.21.15.81:0/4067475418 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb63c018880 con 0x7fb640101250 2024-05-09T00:02:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.828+0000 7fb6367fc700 1 --2- 172.21.15.81:0/4067475418 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb62c0c32c0 0x7fb62c0c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.828+0000 7fb6367fc700 1 -- 172.21.15.81:0/4067475418 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb63c0cc940 con 0x7fb640101250 2024-05-09T00:02:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.829+0000 7fb6367fc700 1 --2- 172.21.15.81:0/4067475418 >> [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800] conn(0x7fb62c0ccaa0 0x7fb62c0ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.829+0000 7fb6367fc700 1 -- 172.21.15.81:0/4067475418 --> [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb62c0cf570 con 0x7fb62c0ccaa0 2024-05-09T00:02:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.829+0000 7fb6367fc700 1 -- 172.21.15.81:0/4067475418 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb63c096020 con 0x7fb640101250 2024-05-09T00:02:12.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.829+0000 7fb644898700 1 --2- 172.21.15.81:0/4067475418 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb62c0c32c0 0x7fb62c0c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.829+0000 7fb64589a700 1 --2- 172.21.15.81:0/4067475418 >> [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800] conn(0x7fb62c0ccaa0 0x7fb62c0ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.829+0000 7fb644898700 1 --2- 172.21.15.81:0/4067475418 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb62c0c32c0 0x7fb62c0c5780 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb63000b5c0 tx=0x7fb630005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.830+0000 7fb64589a700 1 --2- 172.21.15.81:0/4067475418 >> [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800] conn(0x7fb62c0ccaa0 0x7fb62c0ceec0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:12.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.830+0000 7fb6367fc700 1 -- 172.21.15.81:0/4067475418 <== osd.10 v2:172.21.15.150:6824/867287800 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb62c0cf570 con 0x7fb62c0ccaa0 2024-05-09T00:02:12.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.847+0000 7fb6472fd700 1 -- 172.21.15.81:0/4067475418 --> [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb624002cb0 con 0x7fb62c0ccaa0 2024-05-09T00:02:12.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.848+0000 7fb6367fc700 1 -- 172.21.15.81:0/4067475418 <== osd.10 v2:172.21.15.150:6824/867287800 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb624002cb0 con 0x7fb62c0ccaa0 2024-05-09T00:02:12.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.848+0000 7fb6472fd700 1 -- 172.21.15.81:0/4067475418 >> [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800] conn(0x7fb62c0ccaa0 msgr2=0x7fb62c0ceec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:12.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.848+0000 7fb6472fd700 1 --2- 172.21.15.81:0/4067475418 >> [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800] conn(0x7fb62c0ccaa0 0x7fb62c0ceec0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:12.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.849+0000 7fb6472fd700 1 -- 172.21.15.81:0/4067475418 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb62c0c32c0 msgr2=0x7fb62c0c5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.849+0000 7fb6472fd700 1 --2- 172.21.15.81:0/4067475418 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb62c0c32c0 0x7fb62c0c5780 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb63000b5c0 tx=0x7fb630005fb0 comp rx=0 tx=0).stop 2024-05-09T00:02:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.849+0000 7fb6472fd700 1 -- 172.21.15.81:0/4067475418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb640101250 msgr2=0x7fb640197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.849+0000 7fb6472fd700 1 --2- 172.21.15.81:0/4067475418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb640101250 0x7fb640197280 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00c9b0 tx=0x7fb63c00cd70 comp rx=0 tx=0).stop 2024-05-09T00:02:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.849+0000 7fb64589a700 1 -- 172.21.15.81:0/4067475418 reap_dead start 2024-05-09T00:02:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.849+0000 7fb6472fd700 1 -- 172.21.15.81:0/4067475418 shutdown_connections 2024-05-09T00:02:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.849+0000 7fb6472fd700 1 -- 172.21.15.81:0/4067475418 >> 172.21.15.81:0/4067475418 conn(0x7fb640078160 msgr2=0x7fb6400fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.849+0000 7fb6472fd700 1 -- 172.21.15.81:0/4067475418 shutdown_connections 2024-05-09T00:02:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:12.849+0000 7fb6472fd700 1 -- 172.21.15.81:0/4067475418 wait complete. 2024-05-09T00:02:13.081 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:13.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.271+0000 7f167fe0c700 1 -- 172.21.15.81:0/3981750283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1678100840 msgr2=0x7f167810cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:13.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.271+0000 7f167fe0c700 1 --2- 172.21.15.81:0/3981750283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1678100840 0x7f167810cd30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f167000b0a0 tx=0x7f167000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.271+0000 7f167fe0c700 1 -- 172.21.15.81:0/3981750283 shutdown_connections 2024-05-09T00:02:13.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.271+0000 7f167fe0c700 1 --2- 172.21.15.81:0/3981750283 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1678105f30 0x7f1678106310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.271+0000 7f167fe0c700 1 --2- 172.21.15.81:0/3981750283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1678100840 0x7f167810cd30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.271+0000 7f167fe0c700 1 --2- 172.21.15.81:0/3981750283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16780ffe80 0x7f1678100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.271+0000 7f167fe0c700 1 -- 172.21.15.81:0/3981750283 >> 172.21.15.81:0/3981750283 conn(0x7f1678076ec0 msgr2=0x7f16780772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:13.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.272+0000 7f167fe0c700 1 -- 172.21.15.81:0/3981750283 shutdown_connections 2024-05-09T00:02:13.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.272+0000 7f167fe0c700 1 -- 172.21.15.81:0/3981750283 wait complete. 2024-05-09T00:02:13.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.272+0000 7f167fe0c700 1 Processor -- start 2024-05-09T00:02:13.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.272+0000 7f167fe0c700 1 -- start start 2024-05-09T00:02:13.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.272+0000 7f167fe0c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16780ffe80 0x7f1678199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:13.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.272+0000 7f167fe0c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1678100840 0x7f1678199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:13.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.272+0000 7f167fe0c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1678105f30 0x7f167819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:13.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.272+0000 7f167fe0c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167819e620 con 0x7f16780ffe80 2024-05-09T00:02:13.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.272+0000 7f167fe0c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167819e790 con 0x7f1678100840 2024-05-09T00:02:13.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.272+0000 7f167fe0c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167819e950 con 0x7f1678105f30 2024-05-09T00:02:13.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.272+0000 7f167dba8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16780ffe80 0x7f1678199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:13.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f167dba8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16780ffe80 0x7f1678199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59066/0 (socket says 172.21.15.81:59066) 2024-05-09T00:02:13.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f167dba8700 1 -- 172.21.15.81:0/2618993260 learned_addr learned my addr 172.21.15.81:0/2618993260 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:13.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f167d3a7700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1678100840 0x7f1678199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:13.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f167e3a9700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1678105f30 0x7f167819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:13.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f167dba8700 1 -- 172.21.15.81:0/2618993260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1678105f30 msgr2=0x7f167819e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:13.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f167dba8700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1678105f30 0x7f167819e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f167dba8700 1 -- 172.21.15.81:0/2618993260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1678100840 msgr2=0x7f1678199c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:13.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f167dba8700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1678100840 0x7f1678199c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f167dba8700 1 -- 172.21.15.81:0/2618993260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1670009d00 con 0x7f16780ffe80 2024-05-09T00:02:13.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f167d3a7700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1678100840 0x7f1678199c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:13.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f167dba8700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16780ffe80 0x7f1678199720 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f167400c920 tx=0x7f167400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:13.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f166effd700 1 -- 172.21.15.81:0/2618993260 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674007b00 con 0x7f16780ffe80 2024-05-09T00:02:13.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f166effd700 1 -- 172.21.15.81:0/2618993260 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1674004cf0 con 0x7f16780ffe80 2024-05-09T00:02:13.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f166effd700 1 -- 172.21.15.81:0/2618993260 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1674005610 con 0x7f16780ffe80 2024-05-09T00:02:13.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f167fe0c700 1 -- 172.21.15.81:0/2618993260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167819ec30 con 0x7f16780ffe80 2024-05-09T00:02:13.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.273+0000 7f167fe0c700 1 -- 172.21.15.81:0/2618993260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16781a6490 con 0x7f16780ffe80 2024-05-09T00:02:13.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.274+0000 7f167fe0c700 1 -- 172.21.15.81:0/2618993260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1678110070 con 0x7f16780ffe80 2024-05-09T00:02:13.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.275+0000 7f166effd700 1 -- 172.21.15.81:0/2618993260 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1674004750 con 0x7f16780ffe80 2024-05-09T00:02:13.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.276+0000 7f166effd700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f16640a11b0 0x7f16640a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:13.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.276+0000 7f167d3a7700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f16640a11b0 0x7f16640a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:13.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.276+0000 7f166effd700 1 -- 172.21.15.81:0/2618993260 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f16740cc9a0 con 0x7f16780ffe80 2024-05-09T00:02:13.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.276+0000 7f166effd700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018] conn(0x7f16640aa990 0x7f16640acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:13.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.276+0000 7f166effd700 1 -- 172.21.15.81:0/2618993260 --> [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16640ad460 con 0x7f16640aa990 2024-05-09T00:02:13.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.276+0000 7f166effd700 1 -- 172.21.15.81:0/2618993260 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16740cce40 con 0x7f16780ffe80 2024-05-09T00:02:13.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.276+0000 7f167d3a7700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f16640a11b0 0x7f16640a3670 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1668005950 tx=0x7f16680058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:13.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.277+0000 7f167e3a9700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018] conn(0x7f16640aa990 0x7f16640acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:13.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.277+0000 7f167e3a9700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018] conn(0x7f16640aa990 0x7f16640acdb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:13.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.278+0000 7f166effd700 1 -- 172.21.15.81:0/2618993260 <== osd.7 v2:172.21.15.150:6816/643513018 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f16640ad460 con 0x7f16640aa990 2024-05-09T00:02:13.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.294+0000 7f167fe0c700 1 -- 172.21.15.81:0/2618993260 --> [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f16781015a0 con 0x7f16640aa990 2024-05-09T00:02:13.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.294+0000 7f166effd700 1 -- 172.21.15.81:0/2618993260 <== osd.7 v2:172.21.15.150:6816/643513018 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f16781015a0 con 0x7f16640aa990 2024-05-09T00:02:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.294+0000 7f167fe0c700 1 -- 172.21.15.81:0/2618993260 >> [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018] conn(0x7f16640aa990 msgr2=0x7f16640acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.294+0000 7f167fe0c700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018] conn(0x7f16640aa990 0x7f16640acdb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.294+0000 7f167fe0c700 1 -- 172.21.15.81:0/2618993260 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f16640a11b0 msgr2=0x7f16640a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.294+0000 7f167fe0c700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f16640a11b0 0x7f16640a3670 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1668005950 tx=0x7f16680058e0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.294+0000 7f167fe0c700 1 -- 172.21.15.81:0/2618993260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16780ffe80 msgr2=0x7f1678199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.294+0000 7f167fe0c700 1 --2- 172.21.15.81:0/2618993260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16780ffe80 0x7f1678199720 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f167400c920 tx=0x7f167400cce0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.295+0000 7f167e3a9700 1 -- 172.21.15.81:0/2618993260 reap_dead start 2024-05-09T00:02:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.295+0000 7f167fe0c700 1 -- 172.21.15.81:0/2618993260 shutdown_connections 2024-05-09T00:02:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.295+0000 7f167fe0c700 1 -- 172.21.15.81:0/2618993260 >> 172.21.15.81:0/2618993260 conn(0x7f1678076ec0 msgr2=0x7f1678069670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.295+0000 7f167fe0c700 1 -- 172.21.15.81:0/2618993260 shutdown_connections 2024-05-09T00:02:13.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.295+0000 7f167fe0c700 1 -- 172.21.15.81:0/2618993260 wait complete. 2024-05-09T00:02:13.335 INFO:teuthology.orchestra.run.smithi081.stdout:103079215147 2024-05-09T00:02:13.336 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-09T00:02:13.558 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:13 smithi081 ceph-mon[42474]: pgmap v232: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-09T00:02:13.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:13 smithi150 ceph-mon[46187]: pgmap v232: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-09T00:02:13.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:13 smithi171 ceph-mon[47351]: pgmap v232: 97 pgs: 97 active+clean; 633 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-09T00:02:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.810+0000 7f2efa2c3700 1 -- 172.21.15.81:0/2540026709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4106320 msgr2=0x7f2ef410dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.810+0000 7f2efa2c3700 1 --2- 172.21.15.81:0/2540026709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4106320 0x7f2ef410dec0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00b0a0 tx=0x7f2eec00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.810+0000 7f2efa2c3700 1 -- 172.21.15.81:0/2540026709 shutdown_connections 2024-05-09T00:02:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.810+0000 7f2efa2c3700 1 --2- 172.21.15.81:0/2540026709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4106320 0x7f2ef410dec0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.810+0000 7f2efa2c3700 1 --2- 172.21.15.81:0/2540026709 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ef4069840 0x7f2ef4069c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.810+0000 7f2efa2c3700 1 --2- 172.21.15.81:0/2540026709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ef406a1f0 0x7f2ef4105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.810+0000 7f2efa2c3700 1 -- 172.21.15.81:0/2540026709 >> 172.21.15.81:0/2540026709 conn(0x7f2ef4076c40 msgr2=0x7f2ef4077050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.810+0000 7f2efa2c3700 1 -- 172.21.15.81:0/2540026709 shutdown_connections 2024-05-09T00:02:13.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.810+0000 7f2efa2c3700 1 -- 172.21.15.81:0/2540026709 wait complete. 2024-05-09T00:02:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.811+0000 7f2efa2c3700 1 Processor -- start 2024-05-09T00:02:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.811+0000 7f2efa2c3700 1 -- start start 2024-05-09T00:02:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.811+0000 7f2efa2c3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ef4069840 0x7f2ef41974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.811+0000 7f2efa2c3700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ef406a1f0 0x7f2ef4197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.811+0000 7f2efa2c3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4106320 0x7f2ef419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.811+0000 7f2efa2c3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef419c3d0 con 0x7f2ef4106320 2024-05-09T00:02:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.811+0000 7f2efa2c3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef419c540 con 0x7f2ef4069840 2024-05-09T00:02:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.811+0000 7f2efa2c3700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef419c700 con 0x7f2ef406a1f0 2024-05-09T00:02:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.812+0000 7f2ef8860700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4106320 0x7f2ef419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:13.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.812+0000 7f2ef8860700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4106320 0x7f2ef419bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59094/0 (socket says 172.21.15.81:59094) 2024-05-09T00:02:13.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.812+0000 7f2ef8860700 1 -- 172.21.15.81:0/605336304 learned_addr learned my addr 172.21.15.81:0/605336304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:13.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.812+0000 7f2ef3fff700 1 --2- 172.21.15.81:0/605336304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ef4069840 0x7f2ef41974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:13.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.812+0000 7f2ef37fe700 1 --2- 172.21.15.81:0/605336304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ef406a1f0 0x7f2ef4197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:13.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.812+0000 7f2ef8860700 1 -- 172.21.15.81:0/605336304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ef406a1f0 msgr2=0x7f2ef4197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:13.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.812+0000 7f2ef8860700 1 --2- 172.21.15.81:0/605336304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ef406a1f0 0x7f2ef4197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.812+0000 7f2ef8860700 1 -- 172.21.15.81:0/605336304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ef4069840 msgr2=0x7f2ef41974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:13.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.812+0000 7f2ef8860700 1 --2- 172.21.15.81:0/605336304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ef4069840 0x7f2ef41974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:13.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.812+0000 7f2ef8860700 1 -- 172.21.15.81:0/605336304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec009d00 con 0x7f2ef4106320 2024-05-09T00:02:13.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.812+0000 7f2ef8860700 1 --2- 172.21.15.81:0/605336304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4106320 0x7f2ef419bdc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00b070 tx=0x7f2eec007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:13.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.812+0000 7f2ef17fa700 1 -- 172.21.15.81:0/605336304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00e040 con 0x7f2ef4106320 2024-05-09T00:02:13.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.812+0000 7f2efa2c3700 1 -- 172.21.15.81:0/605336304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef419c980 con 0x7f2ef4106320 2024-05-09T00:02:13.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.812+0000 7f2ef17fa700 1 -- 172.21.15.81:0/605336304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2eec009440 con 0x7f2ef4106320 2024-05-09T00:02:13.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.813+0000 7f2ef17fa700 1 -- 172.21.15.81:0/605336304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec01b450 con 0x7f2ef4106320 2024-05-09T00:02:13.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.813+0000 7f2efa2c3700 1 -- 172.21.15.81:0/605336304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef4100390 con 0x7f2ef4106320 2024-05-09T00:02:13.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.813+0000 7f2efa2c3700 1 -- 172.21.15.81:0/605336304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef41095a0 con 0x7f2ef4106320 2024-05-09T00:02:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.817+0000 7f2ef17fa700 1 -- 172.21.15.81:0/605336304 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2eec01d480 con 0x7f2ef4106320 2024-05-09T00:02:13.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.817+0000 7f2ef17fa700 1 --2- 172.21.15.81:0/605336304 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2ee00a11b0 0x7f2ee00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.817+0000 7f2ef17fa700 1 -- 172.21.15.81:0/605336304 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2eec0ce820 con 0x7f2ef4106320 2024-05-09T00:02:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.817+0000 7f2ef3fff700 1 --2- 172.21.15.81:0/605336304 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2ee00a11b0 0x7f2ee00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:13.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.818+0000 7f2ef3fff700 1 --2- 172.21.15.81:0/605336304 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2ee00a11b0 0x7f2ee00a3670 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4005950 tx=0x7f2ee400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:13.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:13.820+0000 7f2ef17fa700 1 -- 172.21.15.81:0/605336304 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2eec098090 con 0x7f2ef4106320 2024-05-09T00:02:13.926 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:14.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:14.031+0000 7f2efa2c3700 1 -- 172.21.15.81:0/605336304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f2ef41987e0 con 0x7f2ef4106320 2024-05-09T00:02:14.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:14.031+0000 7f2ef17fa700 1 -- 172.21.15.81:0/605336304 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2eec09b6b0 con 0x7f2ef4106320 2024-05-09T00:02:14.026 INFO:teuthology.orchestra.run.smithi081.stdout:266287972374 2024-05-09T00:02:14.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:14.034+0000 7f2efa2c3700 1 -- 172.21.15.81:0/605336304 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2ee00a11b0 msgr2=0x7f2ee00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:14.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:14.034+0000 7f2efa2c3700 1 --2- 172.21.15.81:0/605336304 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2ee00a11b0 0x7f2ee00a3670 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4005950 tx=0x7f2ee400b410 comp rx=0 tx=0).stop 2024-05-09T00:02:14.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:14.034+0000 7f2efa2c3700 1 -- 172.21.15.81:0/605336304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4106320 msgr2=0x7f2ef419bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:14.034+0000 7f2efa2c3700 1 --2- 172.21.15.81:0/605336304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4106320 0x7f2ef419bdc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00b070 tx=0x7f2eec007870 comp rx=0 tx=0).stop 2024-05-09T00:02:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:14.034+0000 7f2efa2c3700 1 -- 172.21.15.81:0/605336304 shutdown_connections 2024-05-09T00:02:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:14.034+0000 7f2efa2c3700 1 --2- 172.21.15.81:0/605336304 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f2ee00a11b0 0x7f2ee00a3670 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:14.034+0000 7f2efa2c3700 1 --2- 172.21.15.81:0/605336304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ef4069840 0x7f2ef41974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:14.034+0000 7f2efa2c3700 1 --2- 172.21.15.81:0/605336304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ef4106320 0x7f2ef419bdc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:14.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:14.034+0000 7f2efa2c3700 1 --2- 172.21.15.81:0/605336304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ef406a1f0 0x7f2ef4197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:14.034+0000 7f2efa2c3700 1 -- 172.21.15.81:0/605336304 >> 172.21.15.81:0/605336304 conn(0x7f2ef4076c40 msgr2=0x7f2ef40ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:14.034+0000 7f2efa2c3700 1 -- 172.21.15.81:0/605336304 shutdown_connections 2024-05-09T00:02:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:14.034+0000 7f2efa2c3700 1 -- 172.21.15.81:0/605336304 wait complete. 2024-05-09T00:02:14.038 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:14.270 INFO:teuthology.orchestra.run.smithi081.stdout:206158430237 2024-05-09T00:02:14.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-09T00:02:14.590 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:14 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/605336304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-09T00:02:14.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:14 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/605336304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-09T00:02:14.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:14 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/605336304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-09T00:02:15.004 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972373 got 266287972374 for osd.9 2024-05-09T00:02:15.004 DEBUG:teuthology.parallel:result is None 2024-05-09T00:02:15.135 INFO:teuthology.orchestra.run.smithi081.stdout:287762808850 2024-05-09T00:02:15.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-09T00:02:15.239 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:15.417 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:15.456 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:15 smithi081 ceph-mon[42474]: pgmap v233: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-05-09T00:02:15.457 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738419 got 34359738421 for osd.0 2024-05-09T00:02:15.458 DEBUG:teuthology.parallel:result is None 2024-05-09T00:02:15.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:15 smithi150 ceph-mon[46187]: pgmap v233: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-05-09T00:02:15.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.774+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/2226936400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c38105f00 msgr2=0x7f6c381062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:15.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.774+0000 7f6c3d1cc700 1 --2- 172.21.15.81:0/2226936400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c38105f00 0x7f6c381062e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800b0a0 tx=0x7f6c2800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:15.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.774+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/2226936400 shutdown_connections 2024-05-09T00:02:15.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.774+0000 7f6c3d1cc700 1 --2- 172.21.15.81:0/2226936400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c38100890 0x7f6c3810cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:15.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.774+0000 7f6c3d1cc700 1 --2- 172.21.15.81:0/2226936400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c38105f00 0x7f6c381062e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:15.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.774+0000 7f6c3d1cc700 1 --2- 172.21.15.81:0/2226936400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c380ffed0 0x7f6c38100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:15.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.774+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/2226936400 >> 172.21.15.81:0/2226936400 conn(0x7f6c38075f80 msgr2=0x7f6c38076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:15.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.774+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/2226936400 shutdown_connections 2024-05-09T00:02:15.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.774+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/2226936400 wait complete. 2024-05-09T00:02:15.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.775+0000 7f6c3d1cc700 1 Processor -- start 2024-05-09T00:02:15.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.775+0000 7f6c3d1cc700 1 -- start start 2024-05-09T00:02:15.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3d1cc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c380ffed0 0x7f6c38198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:15.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3d1cc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c38100890 0x7f6c38198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:15.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3d1cc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c38105f00 0x7f6c381a34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:15.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3d1cc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c38199250 con 0x7f6c38100890 2024-05-09T00:02:15.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3d1cc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c381a3a10 con 0x7f6c38105f00 2024-05-09T00:02:15.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3d1cc700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c381a3b50 con 0x7f6c380ffed0 2024-05-09T00:02:15.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c38100890 0x7f6c38198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:15.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c38100890 0x7f6c38198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59110/0 (socket says 172.21.15.81:59110) 2024-05-09T00:02:15.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3659c700 1 -- 172.21.15.81:0/1017465248 learned_addr learned my addr 172.21.15.81:0/1017465248 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:15.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c36d9d700 1 --2- 172.21.15.81:0/1017465248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c380ffed0 0x7f6c38198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:15.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3759e700 1 --2- 172.21.15.81:0/1017465248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c38105f00 0x7f6c381a34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:15.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3659c700 1 -- 172.21.15.81:0/1017465248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c380ffed0 msgr2=0x7f6c38198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:15.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3659c700 1 --2- 172.21.15.81:0/1017465248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c380ffed0 0x7f6c38198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:15.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3659c700 1 -- 172.21.15.81:0/1017465248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c38105f00 msgr2=0x7f6c381a34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:15.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3659c700 1 --2- 172.21.15.81:0/1017465248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c38105f00 0x7f6c381a34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:15.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3659c700 1 -- 172.21.15.81:0/1017465248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c28009d00 con 0x7f6c38100890 2024-05-09T00:02:15.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.776+0000 7f6c3659c700 1 --2- 172.21.15.81:0/1017465248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c38100890 0x7f6c38198990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000b530 tx=0x7f6c2000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:15.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.777+0000 7f6c2ffff700 1 -- 172.21.15.81:0/1017465248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20011830 con 0x7f6c38100890 2024-05-09T00:02:15.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.777+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/1017465248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c381a3dd0 con 0x7f6c38100890 2024-05-09T00:02:15.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.777+0000 7f6c2ffff700 1 -- 172.21.15.81:0/1017465248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c20011e50 con 0x7f6c38100890 2024-05-09T00:02:15.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.777+0000 7f6c2ffff700 1 -- 172.21.15.81:0/1017465248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2000f2e0 con 0x7f6c38100890 2024-05-09T00:02:15.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.777+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/1017465248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c381a4250 con 0x7f6c38100890 2024-05-09T00:02:15.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.778+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/1017465248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c38108420 con 0x7f6c38100890 2024-05-09T00:02:15.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.779+0000 7f6c2ffff700 1 -- 172.21.15.81:0/1017465248 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6c20010580 con 0x7f6c38100890 2024-05-09T00:02:15.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.780+0000 7f6c2ffff700 1 --2- 172.21.15.81:0/1017465248 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6c240a11b0 0x7f6c240a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:15.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.780+0000 7f6c36d9d700 1 --2- 172.21.15.81:0/1017465248 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6c240a11b0 0x7f6c240a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:15.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.780+0000 7f6c2ffff700 1 -- 172.21.15.81:0/1017465248 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6c200cc2d0 con 0x7f6c38100890 2024-05-09T00:02:15.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.781+0000 7f6c36d9d700 1 --2- 172.21.15.81:0/1017465248 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6c240a11b0 0x7f6c240a3670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c28006130 tx=0x7f6c28006080 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:15.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:15.785+0000 7f6c2ffff700 1 -- 172.21.15.81:0/1017465248 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6c20095bc0 con 0x7f6c38100890 2024-05-09T00:02:15.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:15 smithi171 ceph-mon[47351]: pgmap v233: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2024-05-09T00:02:15.854 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:16.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.007+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/1017465248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6c38068f10 con 0x7f6c38100890 2024-05-09T00:02:16.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.008+0000 7f6c2ffff700 1 -- 172.21.15.81:0/1017465248 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6c200991e0 con 0x7f6c38100890 2024-05-09T00:02:16.002 INFO:teuthology.orchestra.run.smithi081.stdout:184683593761 2024-05-09T00:02:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.010+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/1017465248 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6c240a11b0 msgr2=0x7f6c240a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.010+0000 7f6c3d1cc700 1 --2- 172.21.15.81:0/1017465248 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6c240a11b0 0x7f6c240a3670 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c28006130 tx=0x7f6c28006080 comp rx=0 tx=0).stop 2024-05-09T00:02:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.010+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/1017465248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c38100890 msgr2=0x7f6c38198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.010+0000 7f6c3d1cc700 1 --2- 172.21.15.81:0/1017465248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c38100890 0x7f6c38198990 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000b530 tx=0x7f6c2000b8f0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.010+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/1017465248 shutdown_connections 2024-05-09T00:02:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.010+0000 7f6c3d1cc700 1 --2- 172.21.15.81:0/1017465248 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6c240a11b0 0x7f6c240a3670 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.010+0000 7f6c3d1cc700 1 --2- 172.21.15.81:0/1017465248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6c38105f00 0x7f6c381a34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.010+0000 7f6c3d1cc700 1 --2- 172.21.15.81:0/1017465248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6c380ffed0 0x7f6c38198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.010+0000 7f6c3d1cc700 1 --2- 172.21.15.81:0/1017465248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c38100890 0x7f6c38198990 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.010+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/1017465248 >> 172.21.15.81:0/1017465248 conn(0x7f6c38075f80 msgr2=0x7f6c380fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.010+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/1017465248 shutdown_connections 2024-05-09T00:02:16.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.010+0000 7f6c3d1cc700 1 -- 172.21.15.81:0/1017465248 wait complete. 2024-05-09T00:02:16.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.070+0000 7f234ae1e700 1 -- 172.21.15.81:0/3390168573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344101990 msgr2=0x7f234410de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:16.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.070+0000 7f234ae1e700 1 --2- 172.21.15.81:0/3390168573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344101990 0x7f234410de70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f233c00b0a0 tx=0x7f233c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.070+0000 7f234ae1e700 1 -- 172.21.15.81:0/3390168573 shutdown_connections 2024-05-09T00:02:16.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.070+0000 7f234ae1e700 1 --2- 172.21.15.81:0/3390168573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2344107030 0x7f2344107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.070+0000 7f234ae1e700 1 --2- 172.21.15.81:0/3390168573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344101990 0x7f234410de70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.070+0000 7f234ae1e700 1 --2- 172.21.15.81:0/3390168573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2344100ff0 0x7f2344101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.070+0000 7f234ae1e700 1 -- 172.21.15.81:0/3390168573 >> 172.21.15.81:0/3390168573 conn(0x7f2344078190 msgr2=0x7f23440785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:16.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.070+0000 7f234ae1e700 1 -- 172.21.15.81:0/3390168573 shutdown_connections 2024-05-09T00:02:16.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.070+0000 7f234ae1e700 1 -- 172.21.15.81:0/3390168573 wait complete. 2024-05-09T00:02:16.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f234ae1e700 1 Processor -- start 2024-05-09T00:02:16.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f234ae1e700 1 -- start start 2024-05-09T00:02:16.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f234ae1e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344100ff0 0x7f2344199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:16.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f234ae1e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2344101990 0x7f2344199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:16.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f234ae1e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2344107030 0x7f234419cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:16.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f234ae1e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234419d5c0 con 0x7f2344100ff0 2024-05-09T00:02:16.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f234ae1e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234419d730 con 0x7f2344101990 2024-05-09T00:02:16.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f234ae1e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234419d8f0 con 0x7f2344107030 2024-05-09T00:02:16.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f2348bba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344100ff0 0x7f2344199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:16.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f2348bba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344100ff0 0x7f2344199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59126/0 (socket says 172.21.15.81:59126) 2024-05-09T00:02:16.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f2348bba700 1 -- 172.21.15.81:0/1305463412 learned_addr learned my addr 172.21.15.81:0/1305463412 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:16.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f2343fff700 1 --2- 172.21.15.81:0/1305463412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2344101990 0x7f2344199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:16.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f23493bb700 1 --2- 172.21.15.81:0/1305463412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2344107030 0x7f234419cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:16.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f2348bba700 1 -- 172.21.15.81:0/1305463412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2344107030 msgr2=0x7f234419cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f2348bba700 1 --2- 172.21.15.81:0/1305463412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2344107030 0x7f234419cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f2348bba700 1 -- 172.21.15.81:0/1305463412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2344101990 msgr2=0x7f2344199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f2348bba700 1 --2- 172.21.15.81:0/1305463412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2344101990 0x7f2344199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.071+0000 7f2348bba700 1 -- 172.21.15.81:0/1305463412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c009d00 con 0x7f2344100ff0 2024-05-09T00:02:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.072+0000 7f2348bba700 1 --2- 172.21.15.81:0/1305463412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344100ff0 0x7f2344199780 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f233400c920 tx=0x7f233400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.072+0000 7f2341ffb700 1 -- 172.21.15.81:0/1305463412 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334004a30 con 0x7f2344100ff0 2024-05-09T00:02:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.072+0000 7f234ae1e700 1 -- 172.21.15.81:0/1305463412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234419dbd0 con 0x7f2344100ff0 2024-05-09T00:02:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.072+0000 7f2341ffb700 1 -- 172.21.15.81:0/1305463412 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23340054e0 con 0x7f2344100ff0 2024-05-09T00:02:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.072+0000 7f2341ffb700 1 -- 172.21.15.81:0/1305463412 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2334007bd0 con 0x7f2344100ff0 2024-05-09T00:02:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.072+0000 7f234ae1e700 1 -- 172.21.15.81:0/1305463412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23441a6520 con 0x7f2344100ff0 2024-05-09T00:02:16.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.073+0000 7f234ae1e700 1 -- 172.21.15.81:0/1305463412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2344104370 con 0x7f2344100ff0 2024-05-09T00:02:16.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.074+0000 7f2341ffb700 1 -- 172.21.15.81:0/1305463412 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2334007d50 con 0x7f2344100ff0 2024-05-09T00:02:16.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.075+0000 7f2341ffb700 1 --2- 172.21.15.81:0/1305463412 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f23300a11b0 0x7f23300a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:16.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.075+0000 7f2341ffb700 1 -- 172.21.15.81:0/1305463412 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f23340cc800 con 0x7f2344100ff0 2024-05-09T00:02:16.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.075+0000 7f2343fff700 1 --2- 172.21.15.81:0/1305463412 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f23300a11b0 0x7f23300a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:16.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.075+0000 7f2343fff700 1 --2- 172.21.15.81:0/1305463412 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f23300a11b0 0x7f23300a3670 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f234419ace0 tx=0x7f232c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:16.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.079+0000 7f2341ffb700 1 -- 172.21.15.81:0/1305463412 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2334095fe0 con 0x7f2344100ff0 2024-05-09T00:02:16.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.296+0000 7f234ae1e700 1 -- 172.21.15.81:0/1305463412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f23441026e0 con 0x7f2344100ff0 2024-05-09T00:02:16.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.297+0000 7f2341ffb700 1 -- 172.21.15.81:0/1305463412 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f233401d020 con 0x7f2344100ff0 2024-05-09T00:02:16.291 INFO:teuthology.orchestra.run.smithi081.stdout:236223201305 2024-05-09T00:02:16.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.299+0000 7f234ae1e700 1 -- 172.21.15.81:0/1305463412 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f23300a11b0 msgr2=0x7f23300a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:16.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.299+0000 7f234ae1e700 1 --2- 172.21.15.81:0/1305463412 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f23300a11b0 0x7f23300a3670 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f234419ace0 tx=0x7f232c009190 comp rx=0 tx=0).stop 2024-05-09T00:02:16.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.299+0000 7f234ae1e700 1 -- 172.21.15.81:0/1305463412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344100ff0 msgr2=0x7f2344199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:16.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.299+0000 7f234ae1e700 1 --2- 172.21.15.81:0/1305463412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344100ff0 0x7f2344199780 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f233400c920 tx=0x7f233400cc30 comp rx=0 tx=0).stop 2024-05-09T00:02:16.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.299+0000 7f234ae1e700 1 -- 172.21.15.81:0/1305463412 shutdown_connections 2024-05-09T00:02:16.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.299+0000 7f234ae1e700 1 --2- 172.21.15.81:0/1305463412 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f23300a11b0 0x7f23300a3670 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.299+0000 7f234ae1e700 1 --2- 172.21.15.81:0/1305463412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2344107030 0x7f234419cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.299+0000 7f234ae1e700 1 --2- 172.21.15.81:0/1305463412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2344100ff0 0x7f2344199780 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.299+0000 7f234ae1e700 1 --2- 172.21.15.81:0/1305463412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2344101990 0x7f2344199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:16.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.299+0000 7f234ae1e700 1 -- 172.21.15.81:0/1305463412 >> 172.21.15.81:0/1305463412 conn(0x7f2344078190 msgr2=0x7f234410c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:16.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.299+0000 7f234ae1e700 1 -- 172.21.15.81:0/1305463412 shutdown_connections 2024-05-09T00:02:16.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:16.299+0000 7f234ae1e700 1 -- 172.21.15.81:0/1305463412 wait complete. 2024-05-09T00:02:16.313 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:16.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:16 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1017465248' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-09T00:02:16.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:16 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1305463412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-09T00:02:16.670 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:16.670 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:16.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:16 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1017465248' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-09T00:02:16.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:16 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1305463412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-09T00:02:16.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:16 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1017465248' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-09T00:02:16.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:16 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1305463412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-09T00:02:17.562 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:17 smithi081 ceph-mon[42474]: pgmap v234: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T00:02:17.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:17 smithi150 ceph-mon[46187]: pgmap v234: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T00:02:17.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:17 smithi171 ceph-mon[47351]: pgmap v234: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T00:02:18.367 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593760 got 184683593761 for osd.6 2024-05-09T00:02:18.367 DEBUG:teuthology.parallel:result is None 2024-05-09T00:02:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.737+0000 7f1400720700 1 -- 172.21.15.81:0/666729086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f8100890 msgr2=0x7f13f810cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.737+0000 7f1400720700 1 --2- 172.21.15.81:0/666729086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f8100890 0x7f13f810cd40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f13f000b0a0 tx=0x7f13f000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.737+0000 7f1400720700 1 -- 172.21.15.81:0/666729086 shutdown_connections 2024-05-09T00:02:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.738+0000 7f1400720700 1 --2- 172.21.15.81:0/666729086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13f8105f00 0x7f13f81062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.738+0000 7f1400720700 1 --2- 172.21.15.81:0/666729086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f8100890 0x7f13f810cd40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.738+0000 7f1400720700 1 --2- 172.21.15.81:0/666729086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f80ffed0 0x7f13f8100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.738+0000 7f1400720700 1 -- 172.21.15.81:0/666729086 >> 172.21.15.81:0/666729086 conn(0x7f13f8075f80 msgr2=0x7f13f8076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.738+0000 7f1400720700 1 -- 172.21.15.81:0/666729086 shutdown_connections 2024-05-09T00:02:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.738+0000 7f1400720700 1 -- 172.21.15.81:0/666729086 wait complete. 2024-05-09T00:02:18.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.738+0000 7f1400720700 1 Processor -- start 2024-05-09T00:02:18.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.738+0000 7f1400720700 1 -- start start 2024-05-09T00:02:18.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.738+0000 7f1400720700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f80ffed0 0x7f13f8101b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:18.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.738+0000 7f1400720700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13f8100890 0x7f13f81020b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:18.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.738+0000 7f1400720700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f8105f00 0x7f13f81025f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:18.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.738+0000 7f1400720700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f81a5a50 con 0x7f13f80ffed0 2024-05-09T00:02:18.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.738+0000 7f1400720700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f81a5bc0 con 0x7f13f8100890 2024-05-09T00:02:18.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.738+0000 7f1400720700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f81a5d80 con 0x7f13f8105f00 2024-05-09T00:02:18.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13fe4bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f80ffed0 0x7f13f8101b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:18.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13fe4bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f80ffed0 0x7f13f8101b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32852/0 (socket says 172.21.15.81:32852) 2024-05-09T00:02:18.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13fe4bc700 1 -- 172.21.15.81:0/2717330261 learned_addr learned my addr 172.21.15.81:0/2717330261 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:18.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13fdcbb700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13f8100890 0x7f13f81020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:18.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13fecbd700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f8105f00 0x7f13f81025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:18.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13fe4bc700 1 -- 172.21.15.81:0/2717330261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f8105f00 msgr2=0x7f13f81025f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:18.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13fe4bc700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f8105f00 0x7f13f81025f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:18.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13fe4bc700 1 -- 172.21.15.81:0/2717330261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13f8100890 msgr2=0x7f13f81020b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:18.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13fe4bc700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13f8100890 0x7f13f81020b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:18.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13fe4bc700 1 -- 172.21.15.81:0/2717330261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f0009d00 con 0x7f13f80ffed0 2024-05-09T00:02:18.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13fecbd700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f8105f00 0x7f13f81025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:18.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13fe4bc700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f80ffed0 0x7f13f8101b70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f13f400b530 tx=0x7f13f400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:18.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13ef7fe700 1 -- 172.21.15.81:0/2717330261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4011830 con 0x7f13f80ffed0 2024-05-09T00:02:18.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13ef7fe700 1 -- 172.21.15.81:0/2717330261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13f4011e50 con 0x7f13f80ffed0 2024-05-09T00:02:18.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f1400720700 1 -- 172.21.15.81:0/2717330261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f81a6060 con 0x7f13f80ffed0 2024-05-09T00:02:18.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f13ef7fe700 1 -- 172.21.15.81:0/2717330261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f400f2e0 con 0x7f13f80ffed0 2024-05-09T00:02:18.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.739+0000 7f1400720700 1 -- 172.21.15.81:0/2717330261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f81a65b0 con 0x7f13f80ffed0 2024-05-09T00:02:18.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.740+0000 7f1400720700 1 -- 172.21.15.81:0/2717330261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f81015b0 con 0x7f13f80ffed0 2024-05-09T00:02:18.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.741+0000 7f13ef7fe700 1 -- 172.21.15.81:0/2717330261 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f13f4010580 con 0x7f13f80ffed0 2024-05-09T00:02:18.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.742+0000 7f13ef7fe700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f13e40a1230 0x7f13e40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:18.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.742+0000 7f13fdcbb700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f13e40a1230 0x7f13e40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:18.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.742+0000 7f13ef7fe700 1 -- 172.21.15.81:0/2717330261 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f13f40cc7d0 con 0x7f13f80ffed0 2024-05-09T00:02:18.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.742+0000 7f13fdcbb700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f13e40a1230 0x7f13e40a36f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f13e8006fd0 tx=0x7f13e8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.746+0000 7f13ef7fe700 1 -- 172.21.15.81:0/2717330261 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f13f40960c0 con 0x7f13f80ffed0 2024-05-09T00:02:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.950+0000 7f1400720700 1 -- 172.21.15.81:0/2717330261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f13f804ec60 con 0x7f13f80ffed0 2024-05-09T00:02:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.950+0000 7f13ef7fe700 1 -- 172.21.15.81:0/2717330261 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f13f4015090 con 0x7f13f80ffed0 2024-05-09T00:02:18.944 INFO:teuthology.orchestra.run.smithi081.stdout:154618822694 2024-05-09T00:02:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.952+0000 7f1400720700 1 -- 172.21.15.81:0/2717330261 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f13e40a1230 msgr2=0x7f13e40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.952+0000 7f1400720700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f13e40a1230 0x7f13e40a36f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f13e8006fd0 tx=0x7f13e8008040 comp rx=0 tx=0).stop 2024-05-09T00:02:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.953+0000 7f1400720700 1 -- 172.21.15.81:0/2717330261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f80ffed0 msgr2=0x7f13f8101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.953+0000 7f1400720700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f80ffed0 0x7f13f8101b70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f13f400b530 tx=0x7f13f400b8f0 comp rx=0 tx=0).stop 2024-05-09T00:02:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.953+0000 7f1400720700 1 -- 172.21.15.81:0/2717330261 shutdown_connections 2024-05-09T00:02:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.953+0000 7f1400720700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f13e40a1230 0x7f13e40a36f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.953+0000 7f1400720700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13f8105f00 0x7f13f81025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.953+0000 7f1400720700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f80ffed0 0x7f13f8101b70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.953+0000 7f1400720700 1 --2- 172.21.15.81:0/2717330261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13f8100890 0x7f13f81020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.953+0000 7f1400720700 1 -- 172.21.15.81:0/2717330261 >> 172.21.15.81:0/2717330261 conn(0x7f13f8075f80 msgr2=0x7f13f8068bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.953+0000 7f1400720700 1 -- 172.21.15.81:0/2717330261 shutdown_connections 2024-05-09T00:02:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:18.953+0000 7f1400720700 1 -- 172.21.15.81:0/2717330261 wait complete. 2024-05-09T00:02:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.031+0000 7f78f7498700 1 -- 172.21.15.81:0/525278305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f0101c00 msgr2=0x7f78f0105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.031+0000 7f78f7498700 1 --2- 172.21.15.81:0/525278305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f0101c00 0x7f78f0105bd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f78e0009990 tx=0x7f78e0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.031+0000 7f78f7498700 1 -- 172.21.15.81:0/525278305 shutdown_connections 2024-05-09T00:02:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.031+0000 7f78f7498700 1 --2- 172.21.15.81:0/525278305 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78f01062b0 0x7f78f010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.031+0000 7f78f7498700 1 --2- 172.21.15.81:0/525278305 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78f0101250 0x7f78f0101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.031+0000 7f78f7498700 1 --2- 172.21.15.81:0/525278305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f0101c00 0x7f78f0105bd0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.031+0000 7f78f7498700 1 -- 172.21.15.81:0/525278305 >> 172.21.15.81:0/525278305 conn(0x7f78f0078100 msgr2=0x7f78f0078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.031+0000 7f78f7498700 1 -- 172.21.15.81:0/525278305 shutdown_connections 2024-05-09T00:02:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.031+0000 7f78f7498700 1 -- 172.21.15.81:0/525278305 wait complete. 2024-05-09T00:02:19.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.031+0000 7f78f7498700 1 Processor -- start 2024-05-09T00:02:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f7498700 1 -- start start 2024-05-09T00:02:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f7498700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f0101250 0x7f78f01973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f7498700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78f0101c00 0x7f78f0197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f7498700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78f01062b0 0x7f78f019bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f7498700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f019c2d0 con 0x7f78f0101250 2024-05-09T00:02:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f7498700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f019c440 con 0x7f78f0101c00 2024-05-09T00:02:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f7498700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f019c600 con 0x7f78f01062b0 2024-05-09T00:02:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f5234700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f0101250 0x7f78f01973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f5234700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f0101250 0x7f78f01973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32868/0 (socket says 172.21.15.81:32868) 2024-05-09T00:02:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f5234700 1 -- 172.21.15.81:0/2361640298 learned_addr learned my addr 172.21.15.81:0/2361640298 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f5a35700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78f01062b0 0x7f78f019bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f4a33700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78f0101c00 0x7f78f0197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f5234700 1 -- 172.21.15.81:0/2361640298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78f01062b0 msgr2=0x7f78f019bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:19.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f5234700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78f01062b0 0x7f78f019bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f5234700 1 -- 172.21.15.81:0/2361640298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78f0101c00 msgr2=0x7f78f0197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f5234700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78f0101c00 0x7f78f0197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f5234700 1 -- 172.21.15.81:0/2361640298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e00095f0 con 0x7f78f0101250 2024-05-09T00:02:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f4a33700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78f0101c00 0x7f78f0197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f5a35700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78f01062b0 0x7f78f019bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.032+0000 7f78f5234700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f0101250 0x7f78f01973d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00e9a0 tx=0x7f78ec00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.033+0000 7f78e67fc700 1 -- 172.21.15.81:0/2361640298 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec009790 con 0x7f78f0101250 2024-05-09T00:02:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.033+0000 7f78e67fc700 1 -- 172.21.15.81:0/2361640298 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78ec00cbd0 con 0x7f78f0101250 2024-05-09T00:02:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.033+0000 7f78f7498700 1 -- 172.21.15.81:0/2361640298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f019c8e0 con 0x7f78f0101250 2024-05-09T00:02:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.033+0000 7f78e67fc700 1 -- 172.21.15.81:0/2361640298 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec018680 con 0x7f78f0101250 2024-05-09T00:02:19.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.033+0000 7f78f7498700 1 -- 172.21.15.81:0/2361640298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f00733a0 con 0x7f78f0101250 2024-05-09T00:02:19.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.034+0000 7f78f7498700 1 -- 172.21.15.81:0/2361640298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f01095d0 con 0x7f78f0101250 2024-05-09T00:02:19.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.035+0000 7f78e67fc700 1 -- 172.21.15.81:0/2361640298 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f78ec00cd40 con 0x7f78f0101250 2024-05-09T00:02:19.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.036+0000 7f78e67fc700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f78dc0a1230 0x7f78dc0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:19.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.036+0000 7f78f4a33700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f78dc0a1230 0x7f78dc0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:19.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.036+0000 7f78e67fc700 1 -- 172.21.15.81:0/2361640298 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f78ec014070 con 0x7f78f0101250 2024-05-09T00:02:19.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.036+0000 7f78f4a33700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f78dc0a1230 0x7f78dc0a36f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f78e000b2e0 tx=0x7f78e0005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:19.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.039+0000 7f78e67fc700 1 -- 172.21.15.81:0/2361640298 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f78ec096860 con 0x7f78f0101250 2024-05-09T00:02:19.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.266+0000 7f78f7498700 1 -- 172.21.15.81:0/2361640298 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f78f01026b0 con 0x7f78f0101250 2024-05-09T00:02:19.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.267+0000 7f78e67fc700 1 -- 172.21.15.81:0/2361640298 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f78ec099e80 con 0x7f78f0101250 2024-05-09T00:02:19.261 INFO:teuthology.orchestra.run.smithi081.stdout:317827579920 2024-05-09T00:02:19.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.269+0000 7f78f7498700 1 -- 172.21.15.81:0/2361640298 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f78dc0a1230 msgr2=0x7f78dc0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:19.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.269+0000 7f78f7498700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f78dc0a1230 0x7f78dc0a36f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f78e000b2e0 tx=0x7f78e0005e80 comp rx=0 tx=0).stop 2024-05-09T00:02:19.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.269+0000 7f78f7498700 1 -- 172.21.15.81:0/2361640298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f0101250 msgr2=0x7f78f01973d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:19.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.269+0000 7f78f7498700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f0101250 0x7f78f01973d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00e9a0 tx=0x7f78ec00ed60 comp rx=0 tx=0).stop 2024-05-09T00:02:19.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.269+0000 7f78f7498700 1 -- 172.21.15.81:0/2361640298 shutdown_connections 2024-05-09T00:02:19.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.269+0000 7f78f7498700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f78dc0a1230 0x7f78dc0a36f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.269+0000 7f78f7498700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78f01062b0 0x7f78f019bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.269+0000 7f78f7498700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f0101250 0x7f78f01973d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.269+0000 7f78f7498700 1 --2- 172.21.15.81:0/2361640298 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78f0101c00 0x7f78f0197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.269+0000 7f78f7498700 1 -- 172.21.15.81:0/2361640298 >> 172.21.15.81:0/2361640298 conn(0x7f78f0078100 msgr2=0x7f78f0107480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:19.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.269+0000 7f78f7498700 1 -- 172.21.15.81:0/2361640298 shutdown_connections 2024-05-09T00:02:19.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.269+0000 7f78f7498700 1 -- 172.21.15.81:0/2361640298 wait complete. 2024-05-09T00:02:19.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.331+0000 7ff63a0e2700 1 -- 172.21.15.81:0/729142912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff634107020 msgr2=0x7ff634107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:19.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.331+0000 7ff63a0e2700 1 --2- 172.21.15.81:0/729142912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff634107020 0x7ff634107400 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff624009990 tx=0x7ff624009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.331+0000 7ff63a0e2700 1 -- 172.21.15.81:0/729142912 shutdown_connections 2024-05-09T00:02:19.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.331+0000 7ff63a0e2700 1 --2- 172.21.15.81:0/729142912 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6340692f0 0x7ff63410de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.331+0000 7ff63a0e2700 1 --2- 172.21.15.81:0/729142912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff634107020 0x7ff634107400 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.331+0000 7ff63a0e2700 1 --2- 172.21.15.81:0/729142912 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff634068950 0x7ff634068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.331+0000 7ff63a0e2700 1 -- 172.21.15.81:0/729142912 >> 172.21.15.81:0/729142912 conn(0x7ff634075f80 msgr2=0x7ff634076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:19.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.331+0000 7ff63a0e2700 1 -- 172.21.15.81:0/729142912 shutdown_connections 2024-05-09T00:02:19.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.331+0000 7ff63a0e2700 1 -- 172.21.15.81:0/729142912 wait complete. 2024-05-09T00:02:19.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff63a0e2700 1 Processor -- start 2024-05-09T00:02:19.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff63a0e2700 1 -- start start 2024-05-09T00:02:19.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff63a0e2700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff634068950 0x7ff6340fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:19.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff63a0e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6340692f0 0x7ff6341004e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:19.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff63a0e2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff634107020 0x7ff634100a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:19.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff63a0e2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6341a5710 con 0x7ff6340692f0 2024-05-09T00:02:19.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff63a0e2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6341a5880 con 0x7ff634107020 2024-05-09T00:02:19.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff63a0e2700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6341a5a40 con 0x7ff634068950 2024-05-09T00:02:19.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff632ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6340692f0 0x7ff6341004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:19.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff632ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6340692f0 0x7ff6341004e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32918/0 (socket says 172.21.15.81:32918) 2024-05-09T00:02:19.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff632ffd700 1 -- 172.21.15.81:0/3085448922 learned_addr learned my addr 172.21.15.81:0/3085448922 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:19.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff6337fe700 1 --2- 172.21.15.81:0/3085448922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff634068950 0x7ff6340fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:19.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff633fff700 1 --2- 172.21.15.81:0/3085448922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff634107020 0x7ff634100a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:19.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff632ffd700 1 -- 172.21.15.81:0/3085448922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff634068950 msgr2=0x7ff6340fffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:19.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff632ffd700 1 --2- 172.21.15.81:0/3085448922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff634068950 0x7ff6340fffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff632ffd700 1 -- 172.21.15.81:0/3085448922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff634107020 msgr2=0x7ff634100a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:19.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff632ffd700 1 --2- 172.21.15.81:0/3085448922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff634107020 0x7ff634100a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.332+0000 7ff632ffd700 1 -- 172.21.15.81:0/3085448922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6240095f0 con 0x7ff6340692f0 2024-05-09T00:02:19.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.333+0000 7ff632ffd700 1 --2- 172.21.15.81:0/3085448922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6340692f0 0x7ff6341004e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff62800c9b0 tx=0x7ff62800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:19.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.333+0000 7ff630ff9700 1 -- 172.21.15.81:0/3085448922 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628007b00 con 0x7ff6340692f0 2024-05-09T00:02:19.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.333+0000 7ff630ff9700 1 -- 172.21.15.81:0/3085448922 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff628007c60 con 0x7ff6340692f0 2024-05-09T00:02:19.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.333+0000 7ff63a0e2700 1 -- 172.21.15.81:0/3085448922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6341a5d20 con 0x7ff6340692f0 2024-05-09T00:02:19.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.333+0000 7ff630ff9700 1 -- 172.21.15.81:0/3085448922 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628018660 con 0x7ff6340692f0 2024-05-09T00:02:19.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.333+0000 7ff63a0e2700 1 -- 172.21.15.81:0/3085448922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6341a6210 con 0x7ff6340692f0 2024-05-09T00:02:19.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.334+0000 7ff63a0e2700 1 -- 172.21.15.81:0/3085448922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff634109540 con 0x7ff6340692f0 2024-05-09T00:02:19.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.335+0000 7ff630ff9700 1 -- 172.21.15.81:0/3085448922 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff62800f450 con 0x7ff6340692f0 2024-05-09T00:02:19.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.335+0000 7ff630ff9700 1 --2- 172.21.15.81:0/3085448922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff61c0a1230 0x7ff61c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:19.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.335+0000 7ff6337fe700 1 --2- 172.21.15.81:0/3085448922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff61c0a1230 0x7ff61c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:19.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.335+0000 7ff630ff9700 1 -- 172.21.15.81:0/3085448922 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff6280cc7f0 con 0x7ff6340692f0 2024-05-09T00:02:19.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.336+0000 7ff6337fe700 1 --2- 172.21.15.81:0/3085448922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff61c0a1230 0x7ff61c0a36f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff6240098e0 tx=0x7ff624005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:19.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.340+0000 7ff630ff9700 1 -- 172.21.15.81:0/3085448922 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff628095fd0 con 0x7ff6340692f0 2024-05-09T00:02:19.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.546+0000 7ff63a0e2700 1 -- 172.21.15.81:0/3085448922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff634101480 con 0x7ff6340692f0 2024-05-09T00:02:19.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.546+0000 7ff630ff9700 1 -- 172.21.15.81:0/3085448922 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff6280995f0 con 0x7ff6340692f0 2024-05-09T00:02:19.540 INFO:teuthology.orchestra.run.smithi081.stdout:55834574900 2024-05-09T00:02:19.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.548+0000 7ff63a0e2700 1 -- 172.21.15.81:0/3085448922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff61c0a1230 msgr2=0x7ff61c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.548+0000 7ff63a0e2700 1 --2- 172.21.15.81:0/3085448922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff61c0a1230 0x7ff61c0a36f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff6240098e0 tx=0x7ff624005960 comp rx=0 tx=0).stop 2024-05-09T00:02:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.548+0000 7ff63a0e2700 1 -- 172.21.15.81:0/3085448922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6340692f0 msgr2=0x7ff6341004e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.548+0000 7ff63a0e2700 1 --2- 172.21.15.81:0/3085448922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6340692f0 0x7ff6341004e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff62800c9b0 tx=0x7ff62800ccc0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.548+0000 7ff63a0e2700 1 -- 172.21.15.81:0/3085448922 shutdown_connections 2024-05-09T00:02:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.548+0000 7ff63a0e2700 1 --2- 172.21.15.81:0/3085448922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ff61c0a1230 0x7ff61c0a36f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.548+0000 7ff63a0e2700 1 --2- 172.21.15.81:0/3085448922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff634107020 0x7ff634100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.548+0000 7ff63a0e2700 1 --2- 172.21.15.81:0/3085448922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff634068950 0x7ff6340fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.548+0000 7ff63a0e2700 1 --2- 172.21.15.81:0/3085448922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6340692f0 0x7ff6341004e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.548+0000 7ff63a0e2700 1 -- 172.21.15.81:0/3085448922 >> 172.21.15.81:0/3085448922 conn(0x7ff634075f80 msgr2=0x7ff6340fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.548+0000 7ff63a0e2700 1 -- 172.21.15.81:0/3085448922 shutdown_connections 2024-05-09T00:02:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.549+0000 7ff63a0e2700 1 -- 172.21.15.81:0/3085448922 wait complete. 2024-05-09T00:02:19.545 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201304 got 236223201305 for osd.8 2024-05-09T00:02:19.545 DEBUG:teuthology.parallel:result is None 2024-05-09T00:02:19.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:19 smithi081 ceph-mon[42474]: pgmap v235: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T00:02:19.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:19 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2717330261' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T00:02:19.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:19 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2361640298' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-09T00:02:19.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:19 smithi150 ceph-mon[46187]: pgmap v235: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T00:02:19.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:19 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2717330261' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T00:02:19.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:19 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2361640298' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-09T00:02:19.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:19 smithi171 ceph-mon[47351]: pgmap v235: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T00:02:19.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:19 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2717330261' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-09T00:02:19.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:19 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2361640298' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-09T00:02:20.228 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579919 got 317827579920 for osd.11 2024-05-09T00:02:20.229 DEBUG:teuthology.parallel:result is None 2024-05-09T00:02:20.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.463+0000 7fde2564b700 1 -- 172.21.15.81:0/2882705383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde20100890 msgr2=0x7fde2010cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:20.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.463+0000 7fde2564b700 1 --2- 172.21.15.81:0/2882705383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde20100890 0x7fde2010cd40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fde1800b0a0 tx=0x7fde1800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.463+0000 7fde2564b700 1 -- 172.21.15.81:0/2882705383 shutdown_connections 2024-05-09T00:02:20.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.463+0000 7fde2564b700 1 --2- 172.21.15.81:0/2882705383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde20105f00 0x7fde201062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.463+0000 7fde2564b700 1 --2- 172.21.15.81:0/2882705383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde20100890 0x7fde2010cd40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.463+0000 7fde2564b700 1 --2- 172.21.15.81:0/2882705383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde200ffed0 0x7fde20100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.463+0000 7fde2564b700 1 -- 172.21.15.81:0/2882705383 >> 172.21.15.81:0/2882705383 conn(0x7fde20075f80 msgr2=0x7fde20076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:20.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.463+0000 7fde2564b700 1 -- 172.21.15.81:0/2882705383 shutdown_connections 2024-05-09T00:02:20.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.463+0000 7fde2564b700 1 -- 172.21.15.81:0/2882705383 wait complete. 2024-05-09T00:02:20.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.464+0000 7fde2564b700 1 Processor -- start 2024-05-09T00:02:20.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.464+0000 7fde2564b700 1 -- start start 2024-05-09T00:02:20.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.464+0000 7fde2564b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde200ffed0 0x7fde20101b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:20.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.464+0000 7fde2564b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde20100890 0x7fde201020b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.464+0000 7fde2564b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde20105f00 0x7fde201025f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.464+0000 7fde2564b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde201a5850 con 0x7fde20100890 2024-05-09T00:02:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.464+0000 7fde2564b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde201a59c0 con 0x7fde200ffed0 2024-05-09T00:02:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.464+0000 7fde2564b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde201a5b80 con 0x7fde20105f00 2024-05-09T00:02:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.464+0000 7fde1e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde20100890 0x7fde201020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.464+0000 7fde1e7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde20100890 0x7fde201020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32936/0 (socket says 172.21.15.81:32936) 2024-05-09T00:02:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.464+0000 7fde1e7fc700 1 -- 172.21.15.81:0/3110105424 learned_addr learned my addr 172.21.15.81:0/3110105424 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.464+0000 7fde1effd700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde200ffed0 0x7fde20101b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.465+0000 7fde1f7fe700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde20105f00 0x7fde201025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.465+0000 7fde1e7fc700 1 -- 172.21.15.81:0/3110105424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde20105f00 msgr2=0x7fde201025f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.465+0000 7fde1e7fc700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde20105f00 0x7fde201025f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.465+0000 7fde1e7fc700 1 -- 172.21.15.81:0/3110105424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde200ffed0 msgr2=0x7fde20101b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:20.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.465+0000 7fde1e7fc700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde200ffed0 0x7fde20101b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.465+0000 7fde1e7fc700 1 -- 172.21.15.81:0/3110105424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde18009d00 con 0x7fde20100890 2024-05-09T00:02:20.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.465+0000 7fde1f7fe700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde20105f00 0x7fde201025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:20.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.465+0000 7fde1e7fc700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde20100890 0x7fde201020b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fde1400d950 tx=0x7fde1400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:20.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.465+0000 7fde07fff700 1 -- 172.21.15.81:0/3110105424 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde14009940 con 0x7fde20100890 2024-05-09T00:02:20.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.465+0000 7fde07fff700 1 -- 172.21.15.81:0/3110105424 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde14010460 con 0x7fde20100890 2024-05-09T00:02:20.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.465+0000 7fde2564b700 1 -- 172.21.15.81:0/3110105424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde201a5e60 con 0x7fde20100890 2024-05-09T00:02:20.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.465+0000 7fde07fff700 1 -- 172.21.15.81:0/3110105424 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1400f620 con 0x7fde20100890 2024-05-09T00:02:20.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.465+0000 7fde2564b700 1 -- 172.21.15.81:0/3110105424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde201a62d0 con 0x7fde20100890 2024-05-09T00:02:20.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.466+0000 7fde2564b700 1 -- 172.21.15.81:0/3110105424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde201015b0 con 0x7fde20100890 2024-05-09T00:02:20.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.467+0000 7fde07fff700 1 -- 172.21.15.81:0/3110105424 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fde140108d0 con 0x7fde20100890 2024-05-09T00:02:20.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.468+0000 7fde07fff700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fde080a11b0 0x7fde080a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:20.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.468+0000 7fde07fff700 1 -- 172.21.15.81:0/3110105424 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fde140ccab0 con 0x7fde20100890 2024-05-09T00:02:20.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.468+0000 7fde1effd700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fde080a11b0 0x7fde080a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:20.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.468+0000 7fde1effd700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fde080a11b0 0x7fde080a3670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fde1000abd0 tx=0x7fde1000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:20.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.471+0000 7fde07fff700 1 -- 172.21.15.81:0/3110105424 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fde14096290 con 0x7fde20100890 2024-05-09T00:02:20.555 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:20.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:20 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/761953621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T00:02:20.556 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:20 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3085448922' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T00:02:20.602 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574898 got 55834574900 for osd.1 2024-05-09T00:02:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.310+0000 7fb734d3c700 1 -- 172.21.15.81:0/612628587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7301084d0 msgr2=0x7fb7301100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.310+0000 7fb734d3c700 1 --2- 172.21.15.81:0/612628587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7301084d0 0x7fb7301100a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb72800b0a0 tx=0x7fb72800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.311+0000 7fb734d3c700 1 -- 172.21.15.81:0/612628587 shutdown_connections 2024-05-09T00:02:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.311+0000 7fb734d3c700 1 --2- 172.21.15.81:0/612628587 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7301033f0 0x7fb7301037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.311+0000 7fb734d3c700 1 --2- 172.21.15.81:0/612628587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7301084d0 0x7fb7301100a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.311+0000 7fb734d3c700 1 --2- 172.21.15.81:0/612628587 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb730103da0 0x7fb730107df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.311+0000 7fb734d3c700 1 -- 172.21.15.81:0/612628587 >> 172.21.15.81:0/612628587 conn(0x7fb7300fecc0 msgr2=0x7fb7301010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.311+0000 7fb734d3c700 1 -- 172.21.15.81:0/612628587 shutdown_connections 2024-05-09T00:02:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.311+0000 7fb734d3c700 1 -- 172.21.15.81:0/612628587 wait complete. 2024-05-09T00:02:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb734d3c700 1 Processor -- start 2024-05-09T00:02:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb734d3c700 1 -- start start 2024-05-09T00:02:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb734d3c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7301033f0 0x7fb73019f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb734d3c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb730103da0 0x7fb73019f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb734d3c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7301084d0 0x7fb7301995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb734d3c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb730199c40 con 0x7fb7301033f0 2024-05-09T00:02:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb734d3c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb730199d80 con 0x7fb7301084d0 2024-05-09T00:02:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb734d3c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb730199f40 con 0x7fb730103da0 2024-05-09T00:02:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb72e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7301033f0 0x7fb73019f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb72e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7301033f0 0x7fb73019f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32890/0 (socket says 172.21.15.81:32890) 2024-05-09T00:02:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb72e59c700 1 -- 172.21.15.81:0/761953621 learned_addr learned my addr 172.21.15.81:0/761953621 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb72dd9b700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb730103da0 0x7fb73019f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb72ed9d700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7301084d0 0x7fb7301995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb72e59c700 1 -- 172.21.15.81:0/761953621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb730103da0 msgr2=0x7fb73019f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb72e59c700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb730103da0 0x7fb73019f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb72e59c700 1 -- 172.21.15.81:0/761953621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7301084d0 msgr2=0x7fb7301995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb72e59c700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7301084d0 0x7fb7301995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb72e59c700 1 -- 172.21.15.81:0/761953621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb728009d00 con 0x7fb7301033f0 2024-05-09T00:02:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.312+0000 7fb72ed9d700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7301084d0 0x7fb7301995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.313+0000 7fb72e59c700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7301033f0 0x7fb73019f3f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb72000b530 tx=0x7fb72000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.313+0000 7fb71f7fe700 1 -- 172.21.15.81:0/761953621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720011830 con 0x7fb7301033f0 2024-05-09T00:02:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.313+0000 7fb71f7fe700 1 -- 172.21.15.81:0/761953621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb720011e50 con 0x7fb7301033f0 2024-05-09T00:02:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.313+0000 7fb734d3c700 1 -- 172.21.15.81:0/761953621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73019a220 con 0x7fb7301033f0 2024-05-09T00:02:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.313+0000 7fb71f7fe700 1 -- 172.21.15.81:0/761953621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72000f2e0 con 0x7fb7301033f0 2024-05-09T00:02:20.605 DEBUG:teuthology.parallel:result is None 2024-05-09T00:02:20.605 INFO:teuthology.orchestra.run.smithi081.stdout:133143986217 2024-05-09T00:02:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.313+0000 7fb734d3c700 1 -- 172.21.15.81:0/761953621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7301a6490 con 0x7fb7301033f0 2024-05-09T00:02:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.314+0000 7fb734d3c700 1 -- 172.21.15.81:0/761953621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73010b7f0 con 0x7fb7301033f0 2024-05-09T00:02:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.315+0000 7fb71f7fe700 1 -- 172.21.15.81:0/761953621 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fb720010380 con 0x7fb7301033f0 2024-05-09T00:02:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.316+0000 7fb71f7fe700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb7180a1230 0x7fb7180a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.316+0000 7fb72dd9b700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb7180a1230 0x7fb7180a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.316+0000 7fb71f7fe700 1 -- 172.21.15.81:0/761953621 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb7200cc2c0 con 0x7fb7301033f0 2024-05-09T00:02:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.316+0000 7fb72dd9b700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb7180a1230 0x7fb7180a36f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb73019acc0 tx=0x7fb72400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.320+0000 7fb71f7fe700 1 -- 172.21.15.81:0/761953621 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb720095bb0 con 0x7fb7301033f0 2024-05-09T00:02:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.525+0000 7fb734d3c700 1 -- 172.21.15.81:0/761953621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb73019aa70 con 0x7fb7301033f0 2024-05-09T00:02:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.525+0000 7fb71f7fe700 1 -- 172.21.15.81:0/761953621 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7200b7e60 con 0x7fb7301033f0 2024-05-09T00:02:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.528+0000 7fb734d3c700 1 -- 172.21.15.81:0/761953621 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb7180a1230 msgr2=0x7fb7180a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.528+0000 7fb734d3c700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb7180a1230 0x7fb7180a36f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb73019acc0 tx=0x7fb72400b410 comp rx=0 tx=0).stop 2024-05-09T00:02:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.528+0000 7fb734d3c700 1 -- 172.21.15.81:0/761953621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7301033f0 msgr2=0x7fb73019f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.528+0000 7fb734d3c700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7301033f0 0x7fb73019f3f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb72000b530 tx=0x7fb72000b840 comp rx=0 tx=0).stop 2024-05-09T00:02:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.528+0000 7fb734d3c700 1 -- 172.21.15.81:0/761953621 shutdown_connections 2024-05-09T00:02:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.528+0000 7fb734d3c700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fb7180a1230 0x7fb7180a36f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.528+0000 7fb734d3c700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7301084d0 0x7fb7301995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.528+0000 7fb734d3c700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7301033f0 0x7fb73019f3f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.528+0000 7fb734d3c700 1 --2- 172.21.15.81:0/761953621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb730103da0 0x7fb73019f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.528+0000 7fb734d3c700 1 -- 172.21.15.81:0/761953621 >> 172.21.15.81:0/761953621 conn(0x7fb7300fecc0 msgr2=0x7fb730101020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:20.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.529+0000 7fb734d3c700 1 -- 172.21.15.81:0/761953621 shutdown_connections 2024-05-09T00:02:20.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:19.529+0000 7fb734d3c700 1 -- 172.21.15.81:0/761953621 wait complete. 2024-05-09T00:02:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.684+0000 7fde2564b700 1 -- 172.21.15.81:0/3110105424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fde2004ec60 con 0x7fde20100890 2024-05-09T00:02:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.684+0000 7fde07fff700 1 -- 172.21.15.81:0/3110105424 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fde14020090 con 0x7fde20100890 2024-05-09T00:02:20.679 INFO:teuthology.orchestra.run.smithi081.stdout:206158430238 2024-05-09T00:02:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.687+0000 7fde2564b700 1 -- 172.21.15.81:0/3110105424 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fde080a11b0 msgr2=0x7fde080a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.687+0000 7fde2564b700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fde080a11b0 0x7fde080a3670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fde1000abd0 tx=0x7fde1000a380 comp rx=0 tx=0).stop 2024-05-09T00:02:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.687+0000 7fde2564b700 1 -- 172.21.15.81:0/3110105424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde20100890 msgr2=0x7fde201020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.687+0000 7fde2564b700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde20100890 0x7fde201020b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fde1400d950 tx=0x7fde1400dc60 comp rx=0 tx=0).stop 2024-05-09T00:02:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.687+0000 7fde2564b700 1 -- 172.21.15.81:0/3110105424 shutdown_connections 2024-05-09T00:02:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.687+0000 7fde2564b700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fde080a11b0 0x7fde080a3670 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.687+0000 7fde2564b700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde200ffed0 0x7fde20101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.687+0000 7fde2564b700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde20105f00 0x7fde201025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.687+0000 7fde2564b700 1 --2- 172.21.15.81:0/3110105424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde20100890 0x7fde201020b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.687+0000 7fde2564b700 1 -- 172.21.15.81:0/3110105424 >> 172.21.15.81:0/3110105424 conn(0x7fde20075f80 msgr2=0x7fde200ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.687+0000 7fde2564b700 1 -- 172.21.15.81:0/3110105424 shutdown_connections 2024-05-09T00:02:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:20.687+0000 7fde2564b700 1 -- 172.21.15.81:0/3110105424 wait complete. 2024-05-09T00:02:20.713 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822692 got 154618822694 for osd.5 2024-05-09T00:02:20.713 DEBUG:teuthology.parallel:result is None 2024-05-09T00:02:20.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:20 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/761953621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T00:02:20.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:20 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3085448922' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T00:02:20.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:20 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/761953621' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-09T00:02:20.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:20 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3085448922' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-09T00:02:21.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.106+0000 7f3e4e04c700 1 -- 172.21.15.81:0/2823120071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e48069fa0 msgr2=0x7f3e4810de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:21.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.106+0000 7f3e4e04c700 1 --2- 172.21.15.81:0/2823120071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e48069fa0 0x7f3e4810de40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3e4000b0d0 tx=0x7f3e4000b3e0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.106+0000 7f3e4e04c700 1 -- 172.21.15.81:0/2823120071 shutdown_connections 2024-05-09T00:02:21.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.106+0000 7f3e4e04c700 1 --2- 172.21.15.81:0/2823120071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e48069fa0 0x7f3e4810de40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.106+0000 7f3e4e04c700 1 --2- 172.21.15.81:0/2823120071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e48107020 0x7f3e48107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.106+0000 7f3e4e04c700 1 --2- 172.21.15.81:0/2823120071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e480695e0 0x7f3e48069a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.106+0000 7f3e4e04c700 1 -- 172.21.15.81:0/2823120071 >> 172.21.15.81:0/2823120071 conn(0x7f3e48076c50 msgr2=0x7f3e48077060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:21.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.106+0000 7f3e4e04c700 1 -- 172.21.15.81:0/2823120071 shutdown_connections 2024-05-09T00:02:21.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.106+0000 7f3e4e04c700 1 -- 172.21.15.81:0/2823120071 wait complete. 2024-05-09T00:02:21.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.106+0000 7f3e4e04c700 1 Processor -- start 2024-05-09T00:02:21.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e4e04c700 1 -- start start 2024-05-09T00:02:21.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e4e04c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e480695e0 0x7f3e48197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:21.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e4e04c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e48069fa0 0x7f3e481979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:21.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e4e04c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e48107020 0x7f3e4819bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:21.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e4e04c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4819c390 con 0x7f3e48107020 2024-05-09T00:02:21.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e4e04c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4819c500 con 0x7f3e48069fa0 2024-05-09T00:02:21.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e4e04c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4819c6c0 con 0x7f3e480695e0 2024-05-09T00:02:21.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e47fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e48107020 0x7f3e4819bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:21.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e477fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e480695e0 0x7f3e48197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:21.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e47fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e48107020 0x7f3e4819bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32952/0 (socket says 172.21.15.81:32952) 2024-05-09T00:02:21.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e47fff700 1 -- 172.21.15.81:0/1093370361 learned_addr learned my addr 172.21.15.81:0/1093370361 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:21.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e46ffd700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e48069fa0 0x7f3e481979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:21.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e47fff700 1 -- 172.21.15.81:0/1093370361 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e480695e0 msgr2=0x7f3e48197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:21.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e47fff700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e480695e0 0x7f3e48197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e47fff700 1 -- 172.21.15.81:0/1093370361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e48069fa0 msgr2=0x7f3e481979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:21.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e47fff700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e48069fa0 0x7f3e481979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e47fff700 1 -- 172.21.15.81:0/1093370361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e40009d00 con 0x7f3e48107020 2024-05-09T00:02:21.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e477fe700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e480695e0 0x7f3e48197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:02:21.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.107+0000 7f3e46ffd700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e48069fa0 0x7f3e481979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:21.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.108+0000 7f3e47fff700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e48107020 0x7f3e4819bd80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3e400094c0 tx=0x7f3e400094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:21.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.108+0000 7f3e44ff9700 1 -- 172.21.15.81:0/1093370361 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4000e040 con 0x7f3e48107020 2024-05-09T00:02:21.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.108+0000 7f3e44ff9700 1 -- 172.21.15.81:0/1093370361 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e4001d940 con 0x7f3e48107020 2024-05-09T00:02:21.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.108+0000 7f3e4e04c700 1 -- 172.21.15.81:0/1093370361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4819c940 con 0x7f3e48107020 2024-05-09T00:02:21.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.108+0000 7f3e44ff9700 1 -- 172.21.15.81:0/1093370361 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4001b9e0 con 0x7f3e48107020 2024-05-09T00:02:21.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.108+0000 7f3e4e04c700 1 -- 172.21.15.81:0/1093370361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e481a4200 con 0x7f3e48107020 2024-05-09T00:02:21.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.109+0000 7f3e4e04c700 1 -- 172.21.15.81:0/1093370361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e48109520 con 0x7f3e48107020 2024-05-09T00:02:21.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.110+0000 7f3e44ff9700 1 -- 172.21.15.81:0/1093370361 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f3e4001d480 con 0x7f3e48107020 2024-05-09T00:02:21.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.111+0000 7f3e44ff9700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3e340a11b0 0x7f3e340a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:21.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.111+0000 7f3e477fe700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3e340a11b0 0x7f3e340a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:21.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.111+0000 7f3e44ff9700 1 -- 172.21.15.81:0/1093370361 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3e400ce8b0 con 0x7f3e48107020 2024-05-09T00:02:21.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.112+0000 7f3e477fe700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3e340a11b0 0x7f3e340a3670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3e38005950 tx=0x7f3e3800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:21.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.115+0000 7f3e44ff9700 1 -- 172.21.15.81:0/1093370361 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3e40098120 con 0x7f3e48107020 2024-05-09T00:02:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.263+0000 7fac072dc700 1 -- 172.21.15.81:0/2791227923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac00100ff0 msgr2=0x7fac00101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.263+0000 7fac072dc700 1 --2- 172.21.15.81:0/2791227923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac00100ff0 0x7fac00101450 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fabf0009990 tx=0x7fabf0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.263+0000 7fac072dc700 1 -- 172.21.15.81:0/2791227923 shutdown_connections 2024-05-09T00:02:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.263+0000 7fac072dc700 1 --2- 172.21.15.81:0/2791227923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac00101990 0x7fac0010de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.263+0000 7fac072dc700 1 --2- 172.21.15.81:0/2791227923 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac00107030 0x7fac00107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.263+0000 7fac072dc700 1 --2- 172.21.15.81:0/2791227923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac00100ff0 0x7fac00101450 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.263+0000 7fac072dc700 1 -- 172.21.15.81:0/2791227923 >> 172.21.15.81:0/2791227923 conn(0x7fac00078190 msgr2=0x7fac000785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.263+0000 7fac072dc700 1 -- 172.21.15.81:0/2791227923 shutdown_connections 2024-05-09T00:02:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.263+0000 7fac072dc700 1 -- 172.21.15.81:0/2791227923 wait complete. 2024-05-09T00:02:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.264+0000 7fac072dc700 1 Processor -- start 2024-05-09T00:02:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.264+0000 7fac072dc700 1 -- start start 2024-05-09T00:02:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.264+0000 7fac072dc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac00100ff0 0x7fac001973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac072dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac00101990 0x7fac00197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac072dc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac00107030 0x7fac0019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac072dc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0019c2c0 con 0x7fac00101990 2024-05-09T00:02:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac072dc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0019c430 con 0x7fac00100ff0 2024-05-09T00:02:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac072dc700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0019c5f0 con 0x7fac00107030 2024-05-09T00:02:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac04877700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac00101990 0x7fac00197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac04877700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac00101990 0x7fac00197900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32984/0 (socket says 172.21.15.81:32984) 2024-05-09T00:02:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac04877700 1 -- 172.21.15.81:0/3889892673 learned_addr learned my addr 172.21.15.81:0/3889892673 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:21.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac05078700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac00100ff0 0x7fac001973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac05879700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac00107030 0x7fac0019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac04877700 1 -- 172.21.15.81:0/3889892673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac00107030 msgr2=0x7fac0019bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac04877700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac00107030 0x7fac0019bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac04877700 1 -- 172.21.15.81:0/3889892673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac00100ff0 msgr2=0x7fac001973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac04877700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac00100ff0 0x7fac001973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac04877700 1 -- 172.21.15.81:0/3889892673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf00095f0 con 0x7fac00101990 2024-05-09T00:02:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac05879700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac00107030 0x7fac0019bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac05078700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac00100ff0 0x7fac001973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:21.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac04877700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac00101990 0x7fac00197900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fabf00098e0 tx=0x7fabf000f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fabf67fc700 1 -- 172.21.15.81:0/3889892673 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf001d070 con 0x7fac00101990 2024-05-09T00:02:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac072dc700 1 -- 172.21.15.81:0/3889892673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0019c870 con 0x7fac00101990 2024-05-09T00:02:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.265+0000 7fac072dc700 1 -- 172.21.15.81:0/3889892673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac001a4130 con 0x7fac00101990 2024-05-09T00:02:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.266+0000 7fabf67fc700 1 -- 172.21.15.81:0/3889892673 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fabf000fb90 con 0x7fac00101990 2024-05-09T00:02:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.266+0000 7fabf67fc700 1 -- 172.21.15.81:0/3889892673 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0017650 con 0x7fac00101990 2024-05-09T00:02:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.266+0000 7fac072dc700 1 -- 172.21.15.81:0/3889892673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac00109550 con 0x7fac00101990 2024-05-09T00:02:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.268+0000 7fabf67fc700 1 -- 172.21.15.81:0/3889892673 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fabf0004830 con 0x7fac00101990 2024-05-09T00:02:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.268+0000 7fabf67fc700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fabec0a1230 0x7fabec0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.268+0000 7fac05078700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fabec0a1230 0x7fabec0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.268+0000 7fabf67fc700 1 -- 172.21.15.81:0/3889892673 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fabf00cdf80 con 0x7fac00101990 2024-05-09T00:02:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.269+0000 7fac05078700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fabec0a1230 0x7fabec0a36f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fabfc005e10 tx=0x7fabfc005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:21.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.271+0000 7fabf67fc700 1 -- 172.21.15.81:0/3889892673 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fabf0098780 con 0x7fac00101990 2024-05-09T00:02:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.326+0000 7f3e4e04c700 1 -- 172.21.15.81:0/1093370361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3e4804ec60 con 0x7f3e48107020 2024-05-09T00:02:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.326+0000 7f3e44ff9700 1 -- 172.21.15.81:0/1093370361 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e4009b740 con 0x7f3e48107020 2024-05-09T00:02:21.321 INFO:teuthology.orchestra.run.smithi081.stdout:73014444081 2024-05-09T00:02:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.329+0000 7f3e4e04c700 1 -- 172.21.15.81:0/1093370361 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3e340a11b0 msgr2=0x7f3e340a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.329+0000 7f3e4e04c700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3e340a11b0 0x7f3e340a3670 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3e38005950 tx=0x7f3e3800b410 comp rx=0 tx=0).stop 2024-05-09T00:02:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.329+0000 7f3e4e04c700 1 -- 172.21.15.81:0/1093370361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e48107020 msgr2=0x7f3e4819bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.329+0000 7f3e4e04c700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e48107020 0x7f3e4819bd80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3e400094c0 tx=0x7f3e400094f0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.329+0000 7f3e4e04c700 1 -- 172.21.15.81:0/1093370361 shutdown_connections 2024-05-09T00:02:21.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.329+0000 7f3e4e04c700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3e340a11b0 0x7f3e340a3670 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.329+0000 7f3e4e04c700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e48107020 0x7f3e4819bd80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.329+0000 7f3e4e04c700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3e480695e0 0x7f3e48197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.329+0000 7f3e4e04c700 1 --2- 172.21.15.81:0/1093370361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3e48069fa0 0x7f3e481979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.329+0000 7f3e4e04c700 1 -- 172.21.15.81:0/1093370361 >> 172.21.15.81:0/1093370361 conn(0x7f3e48076c50 msgr2=0x7f3e480fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:21.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.329+0000 7f3e4e04c700 1 -- 172.21.15.81:0/1093370361 shutdown_connections 2024-05-09T00:02:21.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.329+0000 7f3e4e04c700 1 -- 172.21.15.81:0/1093370361 wait complete. 2024-05-09T00:02:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.476+0000 7fac072dc700 1 -- 172.21.15.81:0/3889892673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fac001986d0 con 0x7fac00101990 2024-05-09T00:02:21.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.476+0000 7fabf67fc700 1 -- 172.21.15.81:0/3889892673 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fabf0027090 con 0x7fac00101990 2024-05-09T00:02:21.470 INFO:teuthology.orchestra.run.smithi081.stdout:103079215149 2024-05-09T00:02:21.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.478+0000 7fac072dc700 1 -- 172.21.15.81:0/3889892673 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fabec0a1230 msgr2=0x7fabec0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:21.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.478+0000 7fac072dc700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fabec0a1230 0x7fabec0a36f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fabfc005e10 tx=0x7fabfc005d60 comp rx=0 tx=0).stop 2024-05-09T00:02:21.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.478+0000 7fac072dc700 1 -- 172.21.15.81:0/3889892673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac00101990 msgr2=0x7fac00197900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.478+0000 7fac072dc700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac00101990 0x7fac00197900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fabf00098e0 tx=0x7fabf000f720 comp rx=0 tx=0).stop 2024-05-09T00:02:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.478+0000 7fac072dc700 1 -- 172.21.15.81:0/3889892673 shutdown_connections 2024-05-09T00:02:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.478+0000 7fac072dc700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fabec0a1230 0x7fabec0a36f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.478+0000 7fac072dc700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac00100ff0 0x7fac001973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.478+0000 7fac072dc700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac00107030 0x7fac0019bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.478+0000 7fac072dc700 1 --2- 172.21.15.81:0/3889892673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac00101990 0x7fac00197900 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.478+0000 7fac072dc700 1 -- 172.21.15.81:0/3889892673 >> 172.21.15.81:0/3889892673 conn(0x7fac00078190 msgr2=0x7fac000ffe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.478+0000 7fac072dc700 1 -- 172.21.15.81:0/3889892673 shutdown_connections 2024-05-09T00:02:21.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:21.478+0000 7fac072dc700 1 -- 172.21.15.81:0/3889892673 wait complete. 2024-05-09T00:02:21.664 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:21 smithi081 ceph-mon[42474]: pgmap v236: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T00:02:21.664 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:21 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3110105424' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-09T00:02:21.664 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:21 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1093370361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T00:02:21.682 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986215 got 133143986217 for osd.4 2024-05-09T00:02:21.682 DEBUG:teuthology.parallel:result is None 2024-05-09T00:02:21.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:21 smithi150 ceph-mon[46187]: pgmap v236: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T00:02:21.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:21 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3110105424' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-09T00:02:21.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:21 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1093370361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T00:02:21.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:21 smithi171 ceph-mon[47351]: pgmap v236: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-09T00:02:21.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:21 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3110105424' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-09T00:02:21.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:21 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1093370361' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-09T00:02:21.890 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444079 got 73014444081 for osd.2 2024-05-09T00:02:21.890 DEBUG:teuthology.parallel:result is None 2024-05-09T00:02:22.373 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430237 got 206158430238 for osd.7 2024-05-09T00:02:22.373 DEBUG:teuthology.parallel:result is None 2024-05-09T00:02:22.513 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:22 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3889892673' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T00:02:22.557 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215147 got 103079215149 for osd.3 2024-05-09T00:02:22.557 DEBUG:teuthology.parallel:result is None 2024-05-09T00:02:22.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.668+0000 7f0ecb168700 1 -- 172.21.15.81:0/3157535056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec4101020 msgr2=0x7f0ec41014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:22.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.668+0000 7f0ecb168700 1 --2- 172.21.15.81:0/3157535056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec4101020 0x7f0ec41014a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009990 tx=0x7f0eb0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:22.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.669+0000 7f0ecb168700 1 -- 172.21.15.81:0/3157535056 shutdown_connections 2024-05-09T00:02:22.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.669+0000 7f0ecb168700 1 --2- 172.21.15.81:0/3157535056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ec41019e0 0x7f0ec410ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:22.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.669+0000 7f0ecb168700 1 --2- 172.21.15.81:0/3157535056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ec4107040 0x7f0ec4107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:22.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.669+0000 7f0ecb168700 1 --2- 172.21.15.81:0/3157535056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec4101020 0x7f0ec41014a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:22.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.669+0000 7f0ecb168700 1 -- 172.21.15.81:0/3157535056 >> 172.21.15.81:0/3157535056 conn(0x7f0ec4078100 msgr2=0x7f0ec4078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:22.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.669+0000 7f0ecb168700 1 -- 172.21.15.81:0/3157535056 shutdown_connections 2024-05-09T00:02:22.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.669+0000 7f0ecb168700 1 -- 172.21.15.81:0/3157535056 wait complete. 2024-05-09T00:02:22.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.669+0000 7f0ecb168700 1 Processor -- start 2024-05-09T00:02:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.669+0000 7f0ecb168700 1 -- start start 2024-05-09T00:02:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ecb168700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ec4101020 0x7f0ec4197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ecb168700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec41019e0 0x7f0ec4197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ecb168700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ec4107040 0x7f0ec419bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ecb168700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec419c1b0 con 0x7f0ec41019e0 2024-05-09T00:02:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ecb168700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec419c320 con 0x7f0ec4101020 2024-05-09T00:02:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ecb168700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec419c4e0 con 0x7f0ec4107040 2024-05-09T00:02:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ec3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec41019e0 0x7f0ec4197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ec3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec41019e0 0x7f0ec4197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33004/0 (socket says 172.21.15.81:33004) 2024-05-09T00:02:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ec3fff700 1 -- 172.21.15.81:0/2761985477 learned_addr learned my addr 172.21.15.81:0/2761985477 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:22.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ec9705700 1 --2- 172.21.15.81:0/2761985477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ec4107040 0x7f0ec419bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ec8f04700 1 --2- 172.21.15.81:0/2761985477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ec4101020 0x7f0ec4197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ec3fff700 1 -- 172.21.15.81:0/2761985477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ec4107040 msgr2=0x7f0ec419bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ec3fff700 1 --2- 172.21.15.81:0/2761985477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ec4107040 0x7f0ec419bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ec3fff700 1 -- 172.21.15.81:0/2761985477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ec4101020 msgr2=0x7f0ec4197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ec3fff700 1 --2- 172.21.15.81:0/2761985477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ec4101020 0x7f0ec4197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ec3fff700 1 -- 172.21.15.81:0/2761985477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb00095f0 con 0x7f0ec41019e0 2024-05-09T00:02:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ec3fff700 1 --2- 172.21.15.81:0/2761985477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec41019e0 0x7f0ec4197840 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009fd0 tx=0x7f0eb000f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ec1ffb700 1 -- 172.21.15.81:0/2761985477 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb001d070 con 0x7f0ec41019e0 2024-05-09T00:02:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ec1ffb700 1 -- 172.21.15.81:0/2761985477 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0eb0005510 con 0x7f0ec41019e0 2024-05-09T00:02:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ecb168700 1 -- 172.21.15.81:0/2761985477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec419c760 con 0x7f0ec41019e0 2024-05-09T00:02:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.670+0000 7f0ec1ffb700 1 -- 172.21.15.81:0/2761985477 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0004b80 con 0x7f0ec41019e0 2024-05-09T00:02:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.671+0000 7f0ecb168700 1 -- 172.21.15.81:0/2761985477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec41a4020 con 0x7f0ec41019e0 2024-05-09T00:02:22.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.672+0000 7f0ecb168700 1 -- 172.21.15.81:0/2761985477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec41094d0 con 0x7f0ec41019e0 2024-05-09T00:02:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.673+0000 7f0ec1ffb700 1 -- 172.21.15.81:0/2761985477 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0eb000fc40 con 0x7f0ec41019e0 2024-05-09T00:02:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.673+0000 7f0ec1ffb700 1 --2- 172.21.15.81:0/2761985477 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0eb40a11b0 0x7f0eb40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.673+0000 7f0ec8f04700 1 --2- 172.21.15.81:0/2761985477 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0eb40a11b0 0x7f0eb40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.673+0000 7f0ec1ffb700 1 -- 172.21.15.81:0/2761985477 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0eb00cd7b0 con 0x7f0ec41019e0 2024-05-09T00:02:22.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.674+0000 7f0ec8f04700 1 --2- 172.21.15.81:0/2761985477 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0eb40a11b0 0x7f0eb40a3670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8005950 tx=0x7f0eb80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:22.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.678+0000 7f0ec1ffb700 1 -- 172.21.15.81:0/2761985477 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0eb0097020 con 0x7f0ec41019e0 2024-05-09T00:02:22.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:22 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3889892673' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T00:02:22.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:22 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3889892673' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-09T00:02:22.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.872+0000 7f0ecb168700 1 -- 172.21.15.81:0/2761985477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f0ec41985c0 con 0x7f0ec41019e0 2024-05-09T00:02:22.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.872+0000 7f0ec1ffb700 1 -- 172.21.15.81:0/2761985477 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f0eb009a640 con 0x7f0ec41019e0 2024-05-09T00:02:22.866 INFO:teuthology.orchestra.run.smithi081.stdout:287762808852 2024-05-09T00:02:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.874+0000 7f0ecb168700 1 -- 172.21.15.81:0/2761985477 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0eb40a11b0 msgr2=0x7f0eb40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.874+0000 7f0ecb168700 1 --2- 172.21.15.81:0/2761985477 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0eb40a11b0 0x7f0eb40a3670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8005950 tx=0x7f0eb80058e0 comp rx=0 tx=0).stop 2024-05-09T00:02:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.874+0000 7f0ecb168700 1 -- 172.21.15.81:0/2761985477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec41019e0 msgr2=0x7f0ec4197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.874+0000 7f0ecb168700 1 --2- 172.21.15.81:0/2761985477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec41019e0 0x7f0ec4197840 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009fd0 tx=0x7f0eb000f720 comp rx=0 tx=0).stop 2024-05-09T00:02:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.874+0000 7f0ecb168700 1 -- 172.21.15.81:0/2761985477 shutdown_connections 2024-05-09T00:02:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.874+0000 7f0ecb168700 1 --2- 172.21.15.81:0/2761985477 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f0eb40a11b0 0x7f0eb40a3670 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.874+0000 7f0ecb168700 1 --2- 172.21.15.81:0/2761985477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ec4101020 0x7f0ec4197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.874+0000 7f0ecb168700 1 --2- 172.21.15.81:0/2761985477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ec4107040 0x7f0ec419bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.874+0000 7f0ecb168700 1 --2- 172.21.15.81:0/2761985477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ec41019e0 0x7f0ec4197840 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.874+0000 7f0ecb168700 1 -- 172.21.15.81:0/2761985477 >> 172.21.15.81:0/2761985477 conn(0x7f0ec4078100 msgr2=0x7f0ec40ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.874+0000 7f0ecb168700 1 -- 172.21.15.81:0/2761985477 shutdown_connections 2024-05-09T00:02:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:22.874+0000 7f0ecb168700 1 -- 172.21.15.81:0/2761985477 wait complete. 2024-05-09T00:02:23.223 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808850 got 287762808852 for osd.10 2024-05-09T00:02:23.223 DEBUG:teuthology.parallel:result is None 2024-05-09T00:02:23.223 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-09T00:02:23.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T00:02:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:23.533 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:23 smithi081 ceph-mon[42474]: pgmap v237: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T00:02:23.533 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:23 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2761985477' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-09T00:02:23.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:23 smithi150 ceph-mon[46187]: pgmap v237: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T00:02:23.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:23 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2761985477' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-09T00:02:23.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:23 smithi171 ceph-mon[47351]: pgmap v237: 97 pgs: 97 active+clean; 636 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-09T00:02:23.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:23 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2761985477' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-09T00:02:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.392+0000 7f896890f700 1 -- 172.21.15.81:0/2916995963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89640692f0 msgr2=0x7f896410de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.392+0000 7f896890f700 1 --2- 172.21.15.81:0/2916995963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89640692f0 0x7f896410de60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f895c00b0a0 tx=0x7f895c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.392+0000 7f896890f700 1 -- 172.21.15.81:0/2916995963 shutdown_connections 2024-05-09T00:02:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.392+0000 7f896890f700 1 --2- 172.21.15.81:0/2916995963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89640692f0 0x7f896410de60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.392+0000 7f896890f700 1 --2- 172.21.15.81:0/2916995963 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8964107020 0x7f8964107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:24.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.392+0000 7f896890f700 1 --2- 172.21.15.81:0/2916995963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8964068950 0x7f8964068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.392+0000 7f896890f700 1 -- 172.21.15.81:0/2916995963 >> 172.21.15.81:0/2916995963 conn(0x7f8964075f80 msgr2=0x7f8964076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.392+0000 7f896890f700 1 -- 172.21.15.81:0/2916995963 shutdown_connections 2024-05-09T00:02:24.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.392+0000 7f896890f700 1 -- 172.21.15.81:0/2916995963 wait complete. 2024-05-09T00:02:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.393+0000 7f896890f700 1 Processor -- start 2024-05-09T00:02:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.393+0000 7f896890f700 1 -- start start 2024-05-09T00:02:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f896890f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8964068950 0x7f89641975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:24.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f896890f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89640692f0 0x7f8964197b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:24.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f896890f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8964107020 0x7f896419be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:24.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f896890f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896419c410 con 0x7f89640692f0 2024-05-09T00:02:24.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f896890f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896419c580 con 0x7f8964068950 2024-05-09T00:02:24.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f896890f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896419c740 con 0x7f8964107020 2024-05-09T00:02:24.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f8961d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89640692f0 0x7f8964197b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:24.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f8961d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89640692f0 0x7f8964197b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33026/0 (socket says 172.21.15.81:33026) 2024-05-09T00:02:24.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f8961d9b700 1 -- 172.21.15.81:0/4049620974 learned_addr learned my addr 172.21.15.81:0/4049620974 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:24.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f896259c700 1 --2- 172.21.15.81:0/4049620974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8964068950 0x7f89641975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:24.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f8962d9d700 1 --2- 172.21.15.81:0/4049620974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8964107020 0x7f896419be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:24.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f8961d9b700 1 -- 172.21.15.81:0/4049620974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8964107020 msgr2=0x7f896419be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:24.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f8961d9b700 1 --2- 172.21.15.81:0/4049620974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8964107020 0x7f896419be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:24.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f8961d9b700 1 -- 172.21.15.81:0/4049620974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8964068950 msgr2=0x7f89641975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:24.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f8961d9b700 1 --2- 172.21.15.81:0/4049620974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8964068950 0x7f89641975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:24.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f8961d9b700 1 -- 172.21.15.81:0/4049620974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c009d00 con 0x7f89640692f0 2024-05-09T00:02:24.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f8961d9b700 1 --2- 172.21.15.81:0/4049620974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89640692f0 0x7f8964197b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f895800d950 tx=0x7f895800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:24.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f89537fe700 1 -- 172.21.15.81:0/4049620974 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800f890 con 0x7f89640692f0 2024-05-09T00:02:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f896890f700 1 -- 172.21.15.81:0/4049620974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896419ca20 con 0x7f89640692f0 2024-05-09T00:02:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f89537fe700 1 -- 172.21.15.81:0/4049620974 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8958010460 con 0x7f89640692f0 2024-05-09T00:02:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.394+0000 7f89537fe700 1 -- 172.21.15.81:0/4049620974 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800e610 con 0x7f89640692f0 2024-05-09T00:02:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.395+0000 7f896890f700 1 -- 172.21.15.81:0/4049620974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89641a42a0 con 0x7f89640692f0 2024-05-09T00:02:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.395+0000 7f896890f700 1 -- 172.21.15.81:0/4049620974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8964109540 con 0x7f89640692f0 2024-05-09T00:02:24.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.396+0000 7f89537fe700 1 -- 172.21.15.81:0/4049620974 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f89580108d0 con 0x7f89640692f0 2024-05-09T00:02:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.397+0000 7f89537fe700 1 --2- 172.21.15.81:0/4049620974 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f894c0a11b0 0x7f894c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.397+0000 7f896259c700 1 --2- 172.21.15.81:0/4049620974 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f894c0a11b0 0x7f894c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.397+0000 7f89537fe700 1 -- 172.21.15.81:0/4049620974 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f89580cc9e0 con 0x7f89640692f0 2024-05-09T00:02:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.397+0000 7f896259c700 1 --2- 172.21.15.81:0/4049620974 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f894c0a11b0 0x7f894c0a3670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f89640688c0 tx=0x7f895400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.402+0000 7f89537fe700 1 -- 172.21.15.81:0/4049620974 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f89580961c0 con 0x7f89640692f0 2024-05-09T00:02:24.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.590+0000 7f896890f700 1 -- 172.21.15.81:0/4049620974 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8964198820 con 0x7f894c0a11b0 2024-05-09T00:02:24.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.600+0000 7f89537fe700 1 -- 172.21.15.81:0/4049620974 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340782 (secure 0 0 0) 0x7f8964198820 con 0x7f894c0a11b0 2024-05-09T00:02:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:24.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.603+0000 7f896890f700 1 -- 172.21.15.81:0/4049620974 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f894c0a11b0 msgr2=0x7f894c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:24.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.603+0000 7f896890f700 1 --2- 172.21.15.81:0/4049620974 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f894c0a11b0 0x7f894c0a3670 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f89640688c0 tx=0x7f895400b410 comp rx=0 tx=0).stop 2024-05-09T00:02:24.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.603+0000 7f896890f700 1 -- 172.21.15.81:0/4049620974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89640692f0 msgr2=0x7f8964197b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.603+0000 7f896890f700 1 --2- 172.21.15.81:0/4049620974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89640692f0 0x7f8964197b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f895800d950 tx=0x7f895800dc60 comp rx=0 tx=0).stop 2024-05-09T00:02:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.603+0000 7f896890f700 1 -- 172.21.15.81:0/4049620974 shutdown_connections 2024-05-09T00:02:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.603+0000 7f896890f700 1 --2- 172.21.15.81:0/4049620974 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f894c0a11b0 0x7f894c0a3670 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.603+0000 7f896890f700 1 --2- 172.21.15.81:0/4049620974 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8964068950 0x7f89641975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.603+0000 7f896890f700 1 --2- 172.21.15.81:0/4049620974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8964107020 0x7f896419be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.603+0000 7f896890f700 1 --2- 172.21.15.81:0/4049620974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89640692f0 0x7f8964197b10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.603+0000 7f896890f700 1 -- 172.21.15.81:0/4049620974 >> 172.21.15.81:0/4049620974 conn(0x7f8964075f80 msgr2=0x7f89640fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.603+0000 7f896890f700 1 -- 172.21.15.81:0/4049620974 shutdown_connections 2024-05-09T00:02:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:24.603+0000 7f896890f700 1 -- 172.21.15.81:0/4049620974 wait complete. 2024-05-09T00:02:24.602 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-09T00:02:24.973 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-05-09T00:02:24.277903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653229,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":364,"num_read_kb":298,"num_write":333,"num_write_kb":3044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375644,"kb_used_data":10488,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124566180,"statfs":{"total":1151940427776,"available":1151555768320,"internally_reserved":0,"allocated":10739712,"data_stored":6874529,"data_compressed":112482,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19131,"internal_metadata":373798213},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5216,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":46,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003032"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850421+0000","last_change":"2024-05-09T00:01:45.048606+0000","last_active":"2024-05-09T00:01:46.850421+0000","last_peered":"2024-05-09T00:01:46.850421+0000","last_clean":"2024-05-09T00:01:46.850421+0000","last_became_active":"2024-05-09T00:01:45.047691+0000","last_became_peered":"2024-05-09T00:01:45.047691+0000","last_unstale":"2024-05-09T00:01:46.850421+0000","last_undegraded":"2024-05-09T00:01:46.850421+0000","last_fullsized":"2024-05-09T00:01:46.850421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:03.881912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088559+0000","last_change":"2024-05-09T00:01:45.046812+0000","last_active":"2024-05-09T00:01:47.088559+0000","last_peered":"2024-05-09T00:01:47.088559+0000","last_clean":"2024-05-09T00:01:47.088559+0000","last_became_active":"2024-05-09T00:01:45.046510+0000","last_became_peered":"2024-05-09T00:01:45.046510+0000","last_unstale":"2024-05-09T00:01:47.088559+0000","last_undegraded":"2024-05-09T00:01:47.088559+0000","last_fullsized":"2024-05-09T00:01:47.088559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:03.614974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088767+0000","last_change":"2024-05-09T00:01:45.040304+0000","last_active":"2024-05-09T00:01:47.088767+0000","last_peered":"2024-05-09T00:01:47.088767+0000","last_clean":"2024-05-09T00:01:47.088767+0000","last_became_active":"2024-05-09T00:01:45.039990+0000","last_became_peered":"2024-05-09T00:01:45.039990+0000","last_unstale":"2024-05-09T00:01:47.088767+0000","last_undegraded":"2024-05-09T00:01:47.088767+0000","last_fullsized":"2024-05-09T00:01:47.088767+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:17:33.563999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089069+0000","last_change":"2024-05-09T00:01:45.040528+0000","last_active":"2024-05-09T00:01:47.089069+0000","last_peered":"2024-05-09T00:01:47.089069+0000","last_clean":"2024-05-09T00:01:47.089069+0000","last_became_active":"2024-05-09T00:01:45.040100+0000","last_became_peered":"2024-05-09T00:01:45.040100+0000","last_unstale":"2024-05-09T00:01:47.089069+0000","last_undegraded":"2024-05-09T00:01:47.089069+0000","last_fullsized":"2024-05-09T00:01:47.089069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:02.739346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327560+0000","last_change":"2024-05-09T00:01:45.036192+0000","last_active":"2024-05-09T00:01:45.327560+0000","last_peered":"2024-05-09T00:01:45.327560+0000","last_clean":"2024-05-09T00:01:45.327560+0000","last_became_active":"2024-05-09T00:01:45.035845+0000","last_became_peered":"2024-05-09T00:01:45.035845+0000","last_unstale":"2024-05-09T00:01:45.327560+0000","last_undegraded":"2024-05-09T00:01:45.327560+0000","last_fullsized":"2024-05-09T00:01:45.327560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:25.494946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089254+0000","last_change":"2024-05-09T00:01:45.047866+0000","last_active":"2024-05-09T00:01:47.089254+0000","last_peered":"2024-05-09T00:01:47.089254+0000","last_clean":"2024-05-09T00:01:47.089254+0000","last_became_active":"2024-05-09T00:01:45.047549+0000","last_became_peered":"2024-05-09T00:01:45.047549+0000","last_unstale":"2024-05-09T00:01:47.089254+0000","last_undegraded":"2024-05-09T00:01:47.089254+0000","last_fullsized":"2024-05-09T00:01:47.089254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:34:33.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325076+0000","last_change":"2024-05-09T00:01:45.054246+0000","last_active":"2024-05-09T00:01:46.325076+0000","last_peered":"2024-05-09T00:01:46.325076+0000","last_clean":"2024-05-09T00:01:46.325076+0000","last_became_active":"2024-05-09T00:01:45.053863+0000","last_became_peered":"2024-05-09T00:01:45.053863+0000","last_unstale":"2024-05-09T00:01:46.325076+0000","last_undegraded":"2024-05-09T00:01:46.325076+0000","last_fullsized":"2024-05-09T00:01:46.325076+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:12.080139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187184+0000","last_change":"2024-05-09T00:01:45.053747+0000","last_active":"2024-05-09T00:01:45.187184+0000","last_peered":"2024-05-09T00:01:45.187184+0000","last_clean":"2024-05-09T00:01:45.187184+0000","last_became_active":"2024-05-09T00:01:45.053461+0000","last_became_peered":"2024-05-09T00:01:45.053461+0000","last_unstale":"2024-05-09T00:01:45.187184+0000","last_undegraded":"2024-05-09T00:01:45.187184+0000","last_fullsized":"2024-05-09T00:01:45.187184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:30.018296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029785+0000","last_change":"2024-05-09T00:01:45.053851+0000","last_active":"2024-05-09T00:01:46.029785+0000","last_peered":"2024-05-09T00:01:46.029785+0000","last_clean":"2024-05-09T00:01:46.029785+0000","last_became_active":"2024-05-09T00:01:45.053471+0000","last_became_peered":"2024-05-09T00:01:45.053471+0000","last_unstale":"2024-05-09T00:01:46.029785+0000","last_undegraded":"2024-05-09T00:01:46.029785+0000","last_fullsized":"2024-05-09T00:01:46.029785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:25.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089793+0000","last_change":"2024-05-09T00:01:45.048916+0000","last_active":"2024-05-09T00:01:47.089793+0000","last_peered":"2024-05-09T00:01:47.089793+0000","last_clean":"2024-05-09T00:01:47.089793+0000","last_became_active":"2024-05-09T00:01:45.048227+0000","last_became_peered":"2024-05-09T00:01:45.048227+0000","last_unstale":"2024-05-09T00:01:47.089793+0000","last_undegraded":"2024-05-09T00:01:47.089793+0000","last_fullsized":"2024-05-09T00:01:47.089793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:51.246933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325183+0000","last_change":"2024-05-09T00:01:45.053449+0000","last_active":"2024-05-09T00:01:46.325183+0000","last_peered":"2024-05-09T00:01:46.325183+0000","last_clean":"2024-05-09T00:01:46.325183+0000","last_became_active":"2024-05-09T00:01:45.053060+0000","last_became_peered":"2024-05-09T00:01:45.053060+0000","last_unstale":"2024-05-09T00:01:46.325183+0000","last_undegraded":"2024-05-09T00:01:46.325183+0000","last_fullsized":"2024-05-09T00:01:46.325183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:21.236565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088953+0000","last_change":"2024-05-09T00:01:45.047231+0000","last_active":"2024-05-09T00:01:47.088953+0000","last_peered":"2024-05-09T00:01:47.088953+0000","last_clean":"2024-05-09T00:01:47.088953+0000","last_became_active":"2024-05-09T00:01:45.046897+0000","last_became_peered":"2024-05-09T00:01:45.046897+0000","last_unstale":"2024-05-09T00:01:47.088953+0000","last_undegraded":"2024-05-09T00:01:47.088953+0000","last_fullsized":"2024-05-09T00:01:47.088953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:13.307931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028948+0000","last_change":"2024-05-09T00:01:45.048545+0000","last_active":"2024-05-09T00:01:46.028948+0000","last_peered":"2024-05-09T00:01:46.028948+0000","last_clean":"2024-05-09T00:01:46.028948+0000","last_became_active":"2024-05-09T00:01:45.048237+0000","last_became_peered":"2024-05-09T00:01:45.048237+0000","last_unstale":"2024-05-09T00:01:46.028948+0000","last_undegraded":"2024-05-09T00:01:46.028948+0000","last_fullsized":"2024-05-09T00:01:46.028948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:45:41.578704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089031+0000","last_change":"2024-05-09T00:01:45.046735+0000","last_active":"2024-05-09T00:01:47.089031+0000","last_peered":"2024-05-09T00:01:47.089031+0000","last_clean":"2024-05-09T00:01:47.089031+0000","last_became_active":"2024-05-09T00:01:45.046441+0000","last_became_peered":"2024-05-09T00:01:45.046441+0000","last_unstale":"2024-05-09T00:01:47.089031+0000","last_undegraded":"2024-05-09T00:01:47.089031+0000","last_fullsized":"2024-05-09T00:01:47.089031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:51.380665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088074+0000","last_change":"2024-05-09T00:01:45.036289+0000","last_active":"2024-05-09T00:01:47.088074+0000","last_peered":"2024-05-09T00:01:47.088074+0000","last_clean":"2024-05-09T00:01:47.088074+0000","last_became_active":"2024-05-09T00:01:45.035996+0000","last_became_peered":"2024-05-09T00:01:45.035996+0000","last_unstale":"2024-05-09T00:01:47.088074+0000","last_undegraded":"2024-05-09T00:01:47.088074+0000","last_fullsized":"2024-05-09T00:01:47.088074+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:52.769668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029327+0000","last_change":"2024-05-09T00:01:45.044908+0000","last_active":"2024-05-09T00:01:46.029327+0000","last_peered":"2024-05-09T00:01:46.029327+0000","last_clean":"2024-05-09T00:01:46.029327+0000","last_became_active":"2024-05-09T00:01:45.044508+0000","last_became_peered":"2024-05-09T00:01:45.044508+0000","last_unstale":"2024-05-09T00:01:46.029327+0000","last_undegraded":"2024-05-09T00:01:46.029327+0000","last_fullsized":"2024-05-09T00:01:46.029327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:02:23.578743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850564+0000","last_change":"2024-05-09T00:01:45.048389+0000","last_active":"2024-05-09T00:01:46.850564+0000","last_peered":"2024-05-09T00:01:46.850564+0000","last_clean":"2024-05-09T00:01:46.850564+0000","last_became_active":"2024-05-09T00:01:45.047959+0000","last_became_peered":"2024-05-09T00:01:45.047959+0000","last_unstale":"2024-05-09T00:01:46.850564+0000","last_undegraded":"2024-05-09T00:01:46.850564+0000","last_fullsized":"2024-05-09T00:01:46.850564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:44.298296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089171+0000","last_change":"2024-05-09T00:01:45.048314+0000","last_active":"2024-05-09T00:01:47.089171+0000","last_peered":"2024-05-09T00:01:47.089171+0000","last_clean":"2024-05-09T00:01:47.089171+0000","last_became_active":"2024-05-09T00:01:45.048002+0000","last_became_peered":"2024-05-09T00:01:45.048002+0000","last_unstale":"2024-05-09T00:01:47.089171+0000","last_undegraded":"2024-05-09T00:01:47.089171+0000","last_fullsized":"2024-05-09T00:01:47.089171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:36.327498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039835+0000","last_change":"2024-05-09T00:01:45.035747+0000","last_active":"2024-05-09T00:01:47.039835+0000","last_peered":"2024-05-09T00:01:47.039835+0000","last_clean":"2024-05-09T00:01:47.039835+0000","last_became_active":"2024-05-09T00:01:45.035122+0000","last_became_peered":"2024-05-09T00:01:45.035122+0000","last_unstale":"2024-05-09T00:01:47.039835+0000","last_undegraded":"2024-05-09T00:01:47.039835+0000","last_fullsized":"2024-05-09T00:01:47.039835+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:21.361033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.057345+0000","last_change":"2024-05-09T00:01:44.620816+0000","last_active":"2024-05-09T00:01:49.057345+0000","last_peered":"2024-05-09T00:01:49.057345+0000","last_clean":"2024-05-09T00:01:49.057345+0000","last_became_active":"2024-05-09T00:01:44.620524+0000","last_became_peered":"2024-05-09T00:01:44.620524+0000","last_unstale":"2024-05-09T00:01:49.057345+0000","last_undegraded":"2024-05-09T00:01:49.057345+0000","last_fullsized":"2024-05-09T00:01:49.057345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:05.623111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187261+0000","last_change":"2024-05-09T00:01:45.049115+0000","last_active":"2024-05-09T00:01:45.187261+0000","last_peered":"2024-05-09T00:01:45.187261+0000","last_clean":"2024-05-09T00:01:45.187261+0000","last_became_active":"2024-05-09T00:01:45.048825+0000","last_became_peered":"2024-05-09T00:01:45.048825+0000","last_unstale":"2024-05-09T00:01:45.187261+0000","last_undegraded":"2024-05-09T00:01:45.187261+0000","last_fullsized":"2024-05-09T00:01:45.187261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:09:29.890090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088914+0000","last_change":"2024-05-09T00:01:44.621711+0000","last_active":"2024-05-09T00:01:47.088914+0000","last_peered":"2024-05-09T00:01:47.088914+0000","last_clean":"2024-05-09T00:01:47.088914+0000","last_became_active":"2024-05-09T00:01:44.621433+0000","last_became_peered":"2024-05-09T00:01:44.621433+0000","last_unstale":"2024-05-09T00:01:47.088914+0000","last_undegraded":"2024-05-09T00:01:47.088914+0000","last_fullsized":"2024-05-09T00:01:47.088914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:57.451467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088944+0000","last_change":"2024-05-09T00:01:45.038415+0000","last_active":"2024-05-09T00:01:47.088944+0000","last_peered":"2024-05-09T00:01:47.088944+0000","last_clean":"2024-05-09T00:01:47.088944+0000","last_became_active":"2024-05-09T00:01:45.038141+0000","last_became_peered":"2024-05-09T00:01:45.038141+0000","last_unstale":"2024-05-09T00:01:47.088944+0000","last_undegraded":"2024-05-09T00:01:47.088944+0000","last_fullsized":"2024-05-09T00:01:47.088944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:37.772886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.055486+0000","last_change":"2024-05-09T00:01:44.622505+0000","last_active":"2024-05-09T00:01:49.055486+0000","last_peered":"2024-05-09T00:01:49.055486+0000","last_clean":"2024-05-09T00:01:49.055486+0000","last_became_active":"2024-05-09T00:01:44.622120+0000","last_became_peered":"2024-05-09T00:01:44.622120+0000","last_unstale":"2024-05-09T00:01:49.055486+0000","last_undegraded":"2024-05-09T00:01:49.055486+0000","last_fullsized":"2024-05-09T00:01:49.055486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:15.937946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029518+0000","last_change":"2024-05-09T00:01:45.048553+0000","last_active":"2024-05-09T00:01:46.029518+0000","last_peered":"2024-05-09T00:01:46.029518+0000","last_clean":"2024-05-09T00:01:46.029518+0000","last_became_active":"2024-05-09T00:01:45.046659+0000","last_became_peered":"2024-05-09T00:01:45.046659+0000","last_unstale":"2024-05-09T00:01:46.029518+0000","last_undegraded":"2024-05-09T00:01:46.029518+0000","last_fullsized":"2024-05-09T00:01:46.029518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:19.581843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327593+0000","last_change":"2024-05-09T00:01:44.614820+0000","last_active":"2024-05-09T00:01:45.327593+0000","last_peered":"2024-05-09T00:01:45.327593+0000","last_clean":"2024-05-09T00:01:45.327593+0000","last_became_active":"2024-05-09T00:01:44.614418+0000","last_became_peered":"2024-05-09T00:01:44.614418+0000","last_unstale":"2024-05-09T00:01:45.327593+0000","last_undegraded":"2024-05-09T00:01:45.327593+0000","last_fullsized":"2024-05-09T00:01:45.327593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:18.133098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029467+0000","last_change":"2024-05-09T00:01:45.058377+0000","last_active":"2024-05-09T00:01:46.029467+0000","last_peered":"2024-05-09T00:01:46.029467+0000","last_clean":"2024-05-09T00:01:46.029467+0000","last_became_active":"2024-05-09T00:01:45.057991+0000","last_became_peered":"2024-05-09T00:01:45.057991+0000","last_unstale":"2024-05-09T00:01:46.029467+0000","last_undegraded":"2024-05-09T00:01:46.029467+0000","last_fullsized":"2024-05-09T00:01:46.029467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:14.102698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'6","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:02:20.108257+0000","last_change":"2024-05-09T00:01:44.619347+0000","last_active":"2024-05-09T00:02:20.108257+0000","last_peered":"2024-05-09T00:02:20.108257+0000","last_clean":"2024-05-09T00:02:20.108257+0000","last_became_active":"2024-05-09T00:01:44.618967+0000","last_became_peered":"2024-05-09T00:01:44.618967+0000","last_unstale":"2024-05-09T00:02:20.108257+0000","last_undegraded":"2024-05-09T00:02:20.108257+0000","last_fullsized":"2024-05-09T00:02:20.108257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:10.434674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327548+0000","last_change":"2024-05-09T00:01:45.049365+0000","last_active":"2024-05-09T00:01:45.327548+0000","last_peered":"2024-05-09T00:01:45.327548+0000","last_clean":"2024-05-09T00:01:45.327548+0000","last_became_active":"2024-05-09T00:01:45.049037+0000","last_became_peered":"2024-05-09T00:01:45.049037+0000","last_unstale":"2024-05-09T00:01:45.327548+0000","last_undegraded":"2024-05-09T00:01:45.327548+0000","last_fullsized":"2024-05-09T00:01:45.327548+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:34.290672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.057967+0000","last_change":"2024-05-09T00:01:44.617212+0000","last_active":"2024-05-09T00:01:49.057967+0000","last_peered":"2024-05-09T00:01:49.057967+0000","last_clean":"2024-05-09T00:01:49.057967+0000","last_became_active":"2024-05-09T00:01:44.616898+0000","last_became_peered":"2024-05-09T00:01:44.616898+0000","last_unstale":"2024-05-09T00:01:49.057967+0000","last_undegraded":"2024-05-09T00:01:49.057967+0000","last_fullsized":"2024-05-09T00:01:49.057967+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:39.630039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029579+0000","last_change":"2024-05-09T00:01:45.058567+0000","last_active":"2024-05-09T00:01:46.029579+0000","last_peered":"2024-05-09T00:01:46.029579+0000","last_clean":"2024-05-09T00:01:46.029579+0000","last_became_active":"2024-05-09T00:01:45.058124+0000","last_became_peered":"2024-05-09T00:01:45.058124+0000","last_unstale":"2024-05-09T00:01:46.029579+0000","last_undegraded":"2024-05-09T00:01:46.029579+0000","last_fullsized":"2024-05-09T00:01:46.029579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:03.438029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.057886+0000","last_change":"2024-05-09T00:01:44.618214+0000","last_active":"2024-05-09T00:01:49.057886+0000","last_peered":"2024-05-09T00:01:49.057886+0000","last_clean":"2024-05-09T00:01:49.057886+0000","last_became_active":"2024-05-09T00:01:44.617769+0000","last_became_peered":"2024-05-09T00:01:44.617769+0000","last_unstale":"2024-05-09T00:01:49.057886+0000","last_undegraded":"2024-05-09T00:01:49.057886+0000","last_fullsized":"2024-05-09T00:01:49.057886+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:43.654597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187210+0000","last_change":"2024-05-09T00:01:45.037441+0000","last_active":"2024-05-09T00:01:45.187210+0000","last_peered":"2024-05-09T00:01:45.187210+0000","last_clean":"2024-05-09T00:01:45.187210+0000","last_became_active":"2024-05-09T00:01:45.036668+0000","last_became_peered":"2024-05-09T00:01:45.036668+0000","last_unstale":"2024-05-09T00:01:45.187210+0000","last_undegraded":"2024-05-09T00:01:45.187210+0000","last_fullsized":"2024-05-09T00:01:45.187210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:25.116685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.525580+0000","last_change":"2024-05-09T00:01:44.624973+0000","last_active":"2024-05-09T00:01:46.525580+0000","last_peered":"2024-05-09T00:01:46.525580+0000","last_clean":"2024-05-09T00:01:46.525580+0000","last_became_active":"2024-05-09T00:01:44.624470+0000","last_became_peered":"2024-05-09T00:01:44.624470+0000","last_unstale":"2024-05-09T00:01:46.525580+0000","last_undegraded":"2024-05-09T00:01:46.525580+0000","last_fullsized":"2024-05-09T00:01:46.525580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:22.021060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088654+0000","last_change":"2024-05-09T00:01:45.037414+0000","last_active":"2024-05-09T00:01:47.088654+0000","last_peered":"2024-05-09T00:01:47.088654+0000","last_clean":"2024-05-09T00:01:47.088654+0000","last_became_active":"2024-05-09T00:01:45.037095+0000","last_became_peered":"2024-05-09T00:01:45.037095+0000","last_unstale":"2024-05-09T00:01:47.088654+0000","last_undegraded":"2024-05-09T00:01:47.088654+0000","last_fullsized":"2024-05-09T00:01:47.088654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:29.812977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":50,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:02:23.111730+0000","last_change":"2024-05-09T00:01:44.614823+0000","last_active":"2024-05-09T00:02:23.111730+0000","last_peered":"2024-05-09T00:02:23.111730+0000","last_clean":"2024-05-09T00:02:23.111730+0000","last_became_active":"2024-05-09T00:01:44.614502+0000","last_became_peered":"2024-05-09T00:01:44.614502+0000","last_unstale":"2024-05-09T00:02:23.111730+0000","last_undegraded":"2024-05-09T00:02:23.111730+0000","last_fullsized":"2024-05-09T00:02:23.111730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:14.486852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029787+0000","last_change":"2024-05-09T00:01:45.048631+0000","last_active":"2024-05-09T00:01:46.029787+0000","last_peered":"2024-05-09T00:01:46.029787+0000","last_clean":"2024-05-09T00:01:46.029787+0000","last_became_active":"2024-05-09T00:01:45.046691+0000","last_became_peered":"2024-05-09T00:01:45.046691+0000","last_unstale":"2024-05-09T00:01:46.029787+0000","last_undegraded":"2024-05-09T00:01:46.029787+0000","last_fullsized":"2024-05-09T00:01:46.029787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:59:35.017208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.049047+0000","last_change":"2024-05-09T00:01:44.622684+0000","last_active":"2024-05-09T00:01:48.049047+0000","last_peered":"2024-05-09T00:01:48.049047+0000","last_clean":"2024-05-09T00:01:48.049047+0000","last_became_active":"2024-05-09T00:01:44.622301+0000","last_became_peered":"2024-05-09T00:01:44.622301+0000","last_unstale":"2024-05-09T00:01:48.049047+0000","last_undegraded":"2024-05-09T00:01:48.049047+0000","last_fullsized":"2024-05-09T00:01:48.049047+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:38.343729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088905+0000","last_change":"2024-05-09T00:01:45.050240+0000","last_active":"2024-05-09T00:01:47.088905+0000","last_peered":"2024-05-09T00:01:47.088905+0000","last_clean":"2024-05-09T00:01:47.088905+0000","last_became_active":"2024-05-09T00:01:45.049955+0000","last_became_peered":"2024-05-09T00:01:45.049955+0000","last_unstale":"2024-05-09T00:01:47.088905+0000","last_undegraded":"2024-05-09T00:01:47.088905+0000","last_fullsized":"2024-05-09T00:01:47.088905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:56.811853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.049424+0000","last_change":"2024-05-09T00:01:44.618591+0000","last_active":"2024-05-09T00:01:48.049424+0000","last_peered":"2024-05-09T00:01:48.049424+0000","last_clean":"2024-05-09T00:01:48.049424+0000","last_became_active":"2024-05-09T00:01:44.618198+0000","last_became_peered":"2024-05-09T00:01:44.618198+0000","last_unstale":"2024-05-09T00:01:48.049424+0000","last_undegraded":"2024-05-09T00:01:48.049424+0000","last_fullsized":"2024-05-09T00:01:48.049424+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:27.705444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029617+0000","last_change":"2024-05-09T00:01:45.037485+0000","last_active":"2024-05-09T00:01:46.029617+0000","last_peered":"2024-05-09T00:01:46.029617+0000","last_clean":"2024-05-09T00:01:46.029617+0000","last_became_active":"2024-05-09T00:01:45.037150+0000","last_became_peered":"2024-05-09T00:01:45.037150+0000","last_unstale":"2024-05-09T00:01:46.029617+0000","last_undegraded":"2024-05-09T00:01:46.029617+0000","last_fullsized":"2024-05-09T00:01:46.029617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:55.476243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:02:24.125899+0000","last_change":"2024-05-09T00:01:44.620485+0000","last_active":"2024-05-09T00:02:24.125899+0000","last_peered":"2024-05-09T00:02:24.125899+0000","last_clean":"2024-05-09T00:02:24.125899+0000","last_became_active":"2024-05-09T00:01:44.620004+0000","last_became_peered":"2024-05-09T00:01:44.620004+0000","last_unstale":"2024-05-09T00:02:24.125899+0000","last_undegraded":"2024-05-09T00:02:24.125899+0000","last_fullsized":"2024-05-09T00:02:24.125899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:58.529038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":95,"num_write":29,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327607+0000","last_change":"2024-05-09T00:01:45.045581+0000","last_active":"2024-05-09T00:01:45.327607+0000","last_peered":"2024-05-09T00:01:45.327607+0000","last_clean":"2024-05-09T00:01:45.327607+0000","last_became_active":"2024-05-09T00:01:45.045290+0000","last_became_peered":"2024-05-09T00:01:45.045290+0000","last_unstale":"2024-05-09T00:01:45.327607+0000","last_undegraded":"2024-05-09T00:01:45.327607+0000","last_fullsized":"2024-05-09T00:01:45.327607+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:36.860897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.056105+0000","last_change":"2024-05-09T00:01:44.624145+0000","last_active":"2024-05-09T00:01:49.056105+0000","last_peered":"2024-05-09T00:01:49.056105+0000","last_clean":"2024-05-09T00:01:49.056105+0000","last_became_active":"2024-05-09T00:01:44.623804+0000","last_became_peered":"2024-05-09T00:01:44.623804+0000","last_unstale":"2024-05-09T00:01:49.056105+0000","last_undegraded":"2024-05-09T00:01:49.056105+0000","last_fullsized":"2024-05-09T00:01:49.056105+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:22.366804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028727+0000","last_change":"2024-05-09T00:01:45.044724+0000","last_active":"2024-05-09T00:01:46.028727+0000","last_peered":"2024-05-09T00:01:46.028727+0000","last_clean":"2024-05-09T00:01:46.028727+0000","last_became_active":"2024-05-09T00:01:45.044251+0000","last_became_peered":"2024-05-09T00:01:45.044251+0000","last_unstale":"2024-05-09T00:01:46.028727+0000","last_undegraded":"2024-05-09T00:01:46.028727+0000","last_fullsized":"2024-05-09T00:01:46.028727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:33.525140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048447+0000","last_change":"2024-05-09T00:01:44.620188+0000","last_active":"2024-05-09T00:01:48.048447+0000","last_peered":"2024-05-09T00:01:48.048447+0000","last_clean":"2024-05-09T00:01:48.048447+0000","last_became_active":"2024-05-09T00:01:44.619914+0000","last_became_peered":"2024-05-09T00:01:44.619914+0000","last_unstale":"2024-05-09T00:01:48.048447+0000","last_undegraded":"2024-05-09T00:01:48.048447+0000","last_fullsized":"2024-05-09T00:01:48.048447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:50.349806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325112+0000","last_change":"2024-05-09T00:01:45.044881+0000","last_active":"2024-05-09T00:01:46.325112+0000","last_peered":"2024-05-09T00:01:46.325112+0000","last_clean":"2024-05-09T00:01:46.325112+0000","last_became_active":"2024-05-09T00:01:45.044176+0000","last_became_peered":"2024-05-09T00:01:45.044176+0000","last_unstale":"2024-05-09T00:01:46.325112+0000","last_undegraded":"2024-05-09T00:01:46.325112+0000","last_fullsized":"2024-05-09T00:01:46.325112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:15.672966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'3","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:02:22.120526+0000","last_change":"2024-05-09T00:01:44.616560+0000","last_active":"2024-05-09T00:02:22.120526+0000","last_peered":"2024-05-09T00:02:22.120526+0000","last_clean":"2024-05-09T00:02:22.120526+0000","last_became_active":"2024-05-09T00:01:44.616172+0000","last_became_peered":"2024-05-09T00:01:44.616172+0000","last_unstale":"2024-05-09T00:02:22.120526+0000","last_undegraded":"2024-05-09T00:02:22.120526+0000","last_fullsized":"2024-05-09T00:02:22.120526+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:51.191335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325022+0000","last_change":"2024-05-09T00:01:45.055008+0000","last_active":"2024-05-09T00:01:46.325022+0000","last_peered":"2024-05-09T00:01:46.325022+0000","last_clean":"2024-05-09T00:01:46.325022+0000","last_became_active":"2024-05-09T00:01:45.054626+0000","last_became_peered":"2024-05-09T00:01:45.054626+0000","last_unstale":"2024-05-09T00:01:46.325022+0000","last_undegraded":"2024-05-09T00:01:46.325022+0000","last_fullsized":"2024-05-09T00:01:46.325022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:30.718554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.058339+0000","last_change":"2024-05-09T00:01:44.622089+0000","last_active":"2024-05-09T00:01:49.058339+0000","last_peered":"2024-05-09T00:01:49.058339+0000","last_clean":"2024-05-09T00:01:49.058339+0000","last_became_active":"2024-05-09T00:01:44.621731+0000","last_became_peered":"2024-05-09T00:01:44.621731+0000","last_unstale":"2024-05-09T00:01:49.058339+0000","last_undegraded":"2024-05-09T00:01:49.058339+0000","last_fullsized":"2024-05-09T00:01:49.058339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.276454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029490+0000","last_change":"2024-05-09T00:01:45.058785+0000","last_active":"2024-05-09T00:01:46.029490+0000","last_peered":"2024-05-09T00:01:46.029490+0000","last_clean":"2024-05-09T00:01:46.029490+0000","last_became_active":"2024-05-09T00:01:45.058387+0000","last_became_peered":"2024-05-09T00:01:45.058387+0000","last_unstale":"2024-05-09T00:01:46.029490+0000","last_undegraded":"2024-05-09T00:01:46.029490+0000","last_fullsized":"2024-05-09T00:01:46.029490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:18.868021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:50.062947+0000","last_change":"2024-05-09T00:01:44.615760+0000","last_active":"2024-05-09T00:01:50.062947+0000","last_peered":"2024-05-09T00:01:50.062947+0000","last_clean":"2024-05-09T00:01:50.062947+0000","last_became_active":"2024-05-09T00:01:44.615409+0000","last_became_peered":"2024-05-09T00:01:44.615409+0000","last_unstale":"2024-05-09T00:01:50.062947+0000","last_undegraded":"2024-05-09T00:01:50.062947+0000","last_fullsized":"2024-05-09T00:01:50.062947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:29:27.672835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850354+0000","last_change":"2024-05-09T00:01:45.044092+0000","last_active":"2024-05-09T00:01:46.850354+0000","last_peered":"2024-05-09T00:01:46.850354+0000","last_clean":"2024-05-09T00:01:46.850354+0000","last_became_active":"2024-05-09T00:01:45.043721+0000","last_became_peered":"2024-05-09T00:01:45.043721+0000","last_unstale":"2024-05-09T00:01:46.850354+0000","last_undegraded":"2024-05-09T00:01:46.850354+0000","last_fullsized":"2024-05-09T00:01:46.850354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:31:50.854168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088299+0000","last_change":"2024-05-09T00:01:44.618910+0000","last_active":"2024-05-09T00:01:47.088299+0000","last_peered":"2024-05-09T00:01:47.088299+0000","last_clean":"2024-05-09T00:01:47.088299+0000","last_became_active":"2024-05-09T00:01:44.618569+0000","last_became_peered":"2024-05-09T00:01:44.618569+0000","last_unstale":"2024-05-09T00:01:47.088299+0000","last_undegraded":"2024-05-09T00:01:47.088299+0000","last_fullsized":"2024-05-09T00:01:47.088299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:40.748747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.265172+0000","last_change":"2024-05-09T00:01:45.047305+0000","last_active":"2024-05-09T00:01:49.265172+0000","last_peered":"2024-05-09T00:01:49.265172+0000","last_clean":"2024-05-09T00:01:49.265172+0000","last_became_active":"2024-05-09T00:01:45.046944+0000","last_became_peered":"2024-05-09T00:01:45.046944+0000","last_unstale":"2024-05-09T00:01:49.265172+0000","last_undegraded":"2024-05-09T00:01:49.265172+0000","last_fullsized":"2024-05-09T00:01:49.265172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:24:59.065224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088914+0000","last_change":"2024-05-09T00:01:44.620497+0000","last_active":"2024-05-09T00:01:47.088914+0000","last_peered":"2024-05-09T00:01:47.088914+0000","last_clean":"2024-05-09T00:01:47.088914+0000","last_became_active":"2024-05-09T00:01:44.620165+0000","last_became_peered":"2024-05-09T00:01:44.620165+0000","last_unstale":"2024-05-09T00:01:47.088914+0000","last_undegraded":"2024-05-09T00:01:47.088914+0000","last_fullsized":"2024-05-09T00:01:47.088914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:44.514434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089762+0000","last_change":"2024-05-09T00:01:45.045408+0000","last_active":"2024-05-09T00:01:47.089762+0000","last_peered":"2024-05-09T00:01:47.089762+0000","last_clean":"2024-05-09T00:01:47.089762+0000","last_became_active":"2024-05-09T00:01:45.045086+0000","last_became_peered":"2024-05-09T00:01:45.045086+0000","last_unstale":"2024-05-09T00:01:47.089762+0000","last_undegraded":"2024-05-09T00:01:47.089762+0000","last_fullsized":"2024-05-09T00:01:47.089762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:54.568889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029362+0000","last_change":"2024-05-09T00:01:45.057315+0000","last_active":"2024-05-09T00:01:46.029362+0000","last_peered":"2024-05-09T00:01:46.029362+0000","last_clean":"2024-05-09T00:01:46.029362+0000","last_became_active":"2024-05-09T00:01:45.056962+0000","last_became_peered":"2024-05-09T00:01:45.056962+0000","last_unstale":"2024-05-09T00:01:46.029362+0000","last_undegraded":"2024-05-09T00:01:46.029362+0000","last_fullsized":"2024-05-09T00:01:46.029362+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:09:52.136588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":46,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:02:18.112571+0000","last_change":"2024-05-09T00:01:44.618477+0000","last_active":"2024-05-09T00:02:18.112571+0000","last_peered":"2024-05-09T00:02:18.112571+0000","last_clean":"2024-05-09T00:02:18.112571+0000","last_became_active":"2024-05-09T00:01:44.618154+0000","last_became_peered":"2024-05-09T00:01:44.618154+0000","last_unstale":"2024-05-09T00:02:18.112571+0000","last_undegraded":"2024-05-09T00:02:18.112571+0000","last_fullsized":"2024-05-09T00:02:18.112571+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:24.380644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187242+0000","last_change":"2024-05-09T00:01:45.053772+0000","last_active":"2024-05-09T00:01:45.187242+0000","last_peered":"2024-05-09T00:01:45.187242+0000","last_clean":"2024-05-09T00:01:45.187242+0000","last_became_active":"2024-05-09T00:01:45.053453+0000","last_became_peered":"2024-05-09T00:01:45.053453+0000","last_unstale":"2024-05-09T00:01:45.187242+0000","last_undegraded":"2024-05-09T00:01:45.187242+0000","last_fullsized":"2024-05-09T00:01:45.187242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:46.136845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:50.061805+0000","last_change":"2024-05-09T00:01:44.610200+0000","last_active":"2024-05-09T00:01:50.061805+0000","last_peered":"2024-05-09T00:01:50.061805+0000","last_clean":"2024-05-09T00:01:50.061805+0000","last_became_active":"2024-05-09T00:01:44.609764+0000","last_became_peered":"2024-05-09T00:01:44.609764+0000","last_unstale":"2024-05-09T00:01:50.061805+0000","last_undegraded":"2024-05-09T00:01:50.061805+0000","last_fullsized":"2024-05-09T00:01:50.061805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:36.122765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":331,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089163+0000","last_change":"2024-05-09T00:00:57.898648+0000","last_active":"2024-05-09T00:01:47.089163+0000","last_peered":"2024-05-09T00:01:47.089163+0000","last_clean":"2024-05-09T00:01:47.089163+0000","last_became_active":"2024-05-09T00:00:57.898259+0000","last_became_peered":"2024-05-09T00:00:57.898259+0000","last_unstale":"2024-05-09T00:01:47.089163+0000","last_undegraded":"2024-05-09T00:01:47.089163+0000","last_fullsized":"2024-05-09T00:01:47.089163+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:58:35.200738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:58:35.200738+0000","last_clean_scrub_stamp":"2024-05-08T23:58:35.200738+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:47.782068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028515+0000","last_change":"2024-05-09T00:01:45.035407+0000","last_active":"2024-05-09T00:01:46.028515+0000","last_peered":"2024-05-09T00:01:46.028515+0000","last_clean":"2024-05-09T00:01:46.028515+0000","last_became_active":"2024-05-09T00:01:45.035115+0000","last_became_peered":"2024-05-09T00:01:45.035115+0000","last_unstale":"2024-05-09T00:01:46.028515+0000","last_undegraded":"2024-05-09T00:01:46.028515+0000","last_fullsized":"2024-05-09T00:01:46.028515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:23.603196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.056535+0000","last_change":"2024-05-09T00:01:44.622514+0000","last_active":"2024-05-09T00:01:49.056535+0000","last_peered":"2024-05-09T00:01:49.056535+0000","last_clean":"2024-05-09T00:01:49.056535+0000","last_became_active":"2024-05-09T00:01:44.621454+0000","last_became_peered":"2024-05-09T00:01:44.621454+0000","last_unstale":"2024-05-09T00:01:49.056535+0000","last_undegraded":"2024-05-09T00:01:49.056535+0000","last_fullsized":"2024-05-09T00:01:49.056535+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:10.801721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048321+0000","last_change":"2024-05-09T00:01:44.622743+0000","last_active":"2024-05-09T00:01:48.048321+0000","last_peered":"2024-05-09T00:01:48.048321+0000","last_clean":"2024-05-09T00:01:48.048321+0000","last_became_active":"2024-05-09T00:01:44.622304+0000","last_became_peered":"2024-05-09T00:01:44.622304+0000","last_unstale":"2024-05-09T00:01:48.048321+0000","last_undegraded":"2024-05-09T00:01:48.048321+0000","last_fullsized":"2024-05-09T00:01:48.048321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:01.829369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028716+0000","last_change":"2024-05-09T00:01:45.035458+0000","last_active":"2024-05-09T00:01:46.028716+0000","last_peered":"2024-05-09T00:01:46.028716+0000","last_clean":"2024-05-09T00:01:46.028716+0000","last_became_active":"2024-05-09T00:01:45.035140+0000","last_became_peered":"2024-05-09T00:01:45.035140+0000","last_unstale":"2024-05-09T00:01:46.028716+0000","last_undegraded":"2024-05-09T00:01:46.028716+0000","last_fullsized":"2024-05-09T00:01:46.028716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:02:31.258013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'5","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:54.469548+0000","last_change":"2024-05-09T00:01:44.615172+0000","last_active":"2024-05-09T00:01:54.469548+0000","last_peered":"2024-05-09T00:01:54.469548+0000","last_clean":"2024-05-09T00:01:54.469548+0000","last_became_active":"2024-05-09T00:01:44.614892+0000","last_became_peered":"2024-05-09T00:01:44.614892+0000","last_unstale":"2024-05-09T00:01:54.469548+0000","last_undegraded":"2024-05-09T00:01:54.469548+0000","last_fullsized":"2024-05-09T00:01:54.469548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:17.868378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187302+0000","last_change":"2024-05-09T00:01:45.044708+0000","last_active":"2024-05-09T00:01:45.187302+0000","last_peered":"2024-05-09T00:01:45.187302+0000","last_clean":"2024-05-09T00:01:45.187302+0000","last_became_active":"2024-05-09T00:01:45.044451+0000","last_became_peered":"2024-05-09T00:01:45.044451+0000","last_unstale":"2024-05-09T00:01:45.187302+0000","last_undegraded":"2024-05-09T00:01:45.187302+0000","last_fullsized":"2024-05-09T00:01:45.187302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:16.099211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048907+0000","last_change":"2024-05-09T00:01:44.617434+0000","last_active":"2024-05-09T00:01:48.048907+0000","last_peered":"2024-05-09T00:01:48.048907+0000","last_clean":"2024-05-09T00:01:48.048907+0000","last_became_active":"2024-05-09T00:01:44.617017+0000","last_became_peered":"2024-05-09T00:01:44.617017+0000","last_unstale":"2024-05-09T00:01:48.048907+0000","last_undegraded":"2024-05-09T00:01:48.048907+0000","last_fullsized":"2024-05-09T00:01:48.048907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.889962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088825+0000","last_change":"2024-05-09T00:01:45.035749+0000","last_active":"2024-05-09T00:01:47.088825+0000","last_peered":"2024-05-09T00:01:47.088825+0000","last_clean":"2024-05-09T00:01:47.088825+0000","last_became_active":"2024-05-09T00:01:45.034862+0000","last_became_peered":"2024-05-09T00:01:45.034862+0000","last_unstale":"2024-05-09T00:01:47.088825+0000","last_undegraded":"2024-05-09T00:01:47.088825+0000","last_fullsized":"2024-05-09T00:01:47.088825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:20.824467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048783+0000","last_change":"2024-05-09T00:01:44.616652+0000","last_active":"2024-05-09T00:01:48.048783+0000","last_peered":"2024-05-09T00:01:48.048783+0000","last_clean":"2024-05-09T00:01:48.048783+0000","last_became_active":"2024-05-09T00:01:44.616273+0000","last_became_peered":"2024-05-09T00:01:44.616273+0000","last_unstale":"2024-05-09T00:01:48.048783+0000","last_undegraded":"2024-05-09T00:01:48.048783+0000","last_fullsized":"2024-05-09T00:01:48.048783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:12.379909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327536+0000","last_change":"2024-05-09T00:01:45.047020+0000","last_active":"2024-05-09T00:01:45.327536+0000","last_peered":"2024-05-09T00:01:45.327536+0000","last_clean":"2024-05-09T00:01:45.327536+0000","last_became_active":"2024-05-09T00:01:45.046813+0000","last_became_peered":"2024-05-09T00:01:45.046813+0000","last_unstale":"2024-05-09T00:01:45.327536+0000","last_undegraded":"2024-05-09T00:01:45.327536+0000","last_fullsized":"2024-05-09T00:01:45.327536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:53.042258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048301+0000","last_change":"2024-05-09T00:01:44.610843+0000","last_active":"2024-05-09T00:01:48.048301+0000","last_peered":"2024-05-09T00:01:48.048301+0000","last_clean":"2024-05-09T00:01:48.048301+0000","last_became_active":"2024-05-09T00:01:44.610523+0000","last_became_peered":"2024-05-09T00:01:44.610523+0000","last_unstale":"2024-05-09T00:01:48.048301+0000","last_undegraded":"2024-05-09T00:01:48.048301+0000","last_fullsized":"2024-05-09T00:01:48.048301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:58.527344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850071+0000","last_change":"2024-05-09T00:01:45.046259+0000","last_active":"2024-05-09T00:01:46.850071+0000","last_peered":"2024-05-09T00:01:46.850071+0000","last_clean":"2024-05-09T00:01:46.850071+0000","last_became_active":"2024-05-09T00:01:45.045954+0000","last_became_peered":"2024-05-09T00:01:45.045954+0000","last_unstale":"2024-05-09T00:01:46.850071+0000","last_undegraded":"2024-05-09T00:01:46.850071+0000","last_fullsized":"2024-05-09T00:01:46.850071+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:46.569934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039671+0000","last_change":"2024-05-09T00:01:44.616781+0000","last_active":"2024-05-09T00:01:47.039671+0000","last_peered":"2024-05-09T00:01:47.039671+0000","last_clean":"2024-05-09T00:01:47.039671+0000","last_became_active":"2024-05-09T00:01:44.616386+0000","last_became_peered":"2024-05-09T00:01:44.616386+0000","last_unstale":"2024-05-09T00:01:47.039671+0000","last_undegraded":"2024-05-09T00:01:47.039671+0000","last_fullsized":"2024-05-09T00:01:47.039671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:17.073596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187252+0000","last_change":"2024-05-09T00:01:45.046701+0000","last_active":"2024-05-09T00:01:45.187252+0000","last_peered":"2024-05-09T00:01:45.187252+0000","last_clean":"2024-05-09T00:01:45.187252+0000","last_became_active":"2024-05-09T00:01:45.046409+0000","last_became_peered":"2024-05-09T00:01:45.046409+0000","last_unstale":"2024-05-09T00:01:45.187252+0000","last_undegraded":"2024-05-09T00:01:45.187252+0000","last_fullsized":"2024-05-09T00:01:45.187252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:32.178410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.049130+0000","last_change":"2024-05-09T00:01:44.623271+0000","last_active":"2024-05-09T00:01:48.049130+0000","last_peered":"2024-05-09T00:01:48.049130+0000","last_clean":"2024-05-09T00:01:48.049130+0000","last_became_active":"2024-05-09T00:01:44.622863+0000","last_became_peered":"2024-05-09T00:01:44.622863+0000","last_unstale":"2024-05-09T00:01:48.049130+0000","last_undegraded":"2024-05-09T00:01:48.049130+0000","last_fullsized":"2024-05-09T00:01:48.049130+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:58.609140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325100+0000","last_change":"2024-05-09T00:01:45.052296+0000","last_active":"2024-05-09T00:01:46.325100+0000","last_peered":"2024-05-09T00:01:46.325100+0000","last_clean":"2024-05-09T00:01:46.325100+0000","last_became_active":"2024-05-09T00:01:45.051951+0000","last_became_peered":"2024-05-09T00:01:45.051951+0000","last_unstale":"2024-05-09T00:01:46.325100+0000","last_undegraded":"2024-05-09T00:01:46.325100+0000","last_fullsized":"2024-05-09T00:01:46.325100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:46.908629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.058312+0000","last_change":"2024-05-09T00:01:44.620387+0000","last_active":"2024-05-09T00:01:49.058312+0000","last_peered":"2024-05-09T00:01:49.058312+0000","last_clean":"2024-05-09T00:01:49.058312+0000","last_became_active":"2024-05-09T00:01:44.620024+0000","last_became_peered":"2024-05-09T00:01:44.620024+0000","last_unstale":"2024-05-09T00:01:49.058312+0000","last_undegraded":"2024-05-09T00:01:49.058312+0000","last_fullsized":"2024-05-09T00:01:49.058312+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:31.599273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325195+0000","last_change":"2024-05-09T00:01:45.050092+0000","last_active":"2024-05-09T00:01:46.325195+0000","last_peered":"2024-05-09T00:01:46.325195+0000","last_clean":"2024-05-09T00:01:46.325195+0000","last_became_active":"2024-05-09T00:01:45.049794+0000","last_became_peered":"2024-05-09T00:01:45.049794+0000","last_unstale":"2024-05-09T00:01:46.325195+0000","last_undegraded":"2024-05-09T00:01:46.325195+0000","last_fullsized":"2024-05-09T00:01:46.325195+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:56.932513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.525700+0000","last_change":"2024-05-09T00:01:44.609940+0000","last_active":"2024-05-09T00:01:46.525700+0000","last_peered":"2024-05-09T00:01:46.525700+0000","last_clean":"2024-05-09T00:01:46.525700+0000","last_became_active":"2024-05-09T00:01:44.609593+0000","last_became_peered":"2024-05-09T00:01:44.609593+0000","last_unstale":"2024-05-09T00:01:46.525700+0000","last_undegraded":"2024-05-09T00:01:46.525700+0000","last_fullsized":"2024-05-09T00:01:46.525700+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:09.671548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088922+0000","last_change":"2024-05-09T00:01:45.042533+0000","last_active":"2024-05-09T00:01:47.088922+0000","last_peered":"2024-05-09T00:01:47.088922+0000","last_clean":"2024-05-09T00:01:47.088922+0000","last_became_active":"2024-05-09T00:01:45.042155+0000","last_became_peered":"2024-05-09T00:01:45.042155+0000","last_unstale":"2024-05-09T00:01:47.088922+0000","last_undegraded":"2024-05-09T00:01:47.088922+0000","last_fullsized":"2024-05-09T00:01:47.088922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:36.519165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.051979+0000","last_change":"2024-05-09T00:01:44.617518+0000","last_active":"2024-05-09T00:01:45.051979+0000","last_peered":"2024-05-09T00:01:45.051979+0000","last_clean":"2024-05-09T00:01:45.051979+0000","last_became_active":"2024-05-09T00:01:44.617196+0000","last_became_peered":"2024-05-09T00:01:44.617196+0000","last_unstale":"2024-05-09T00:01:45.051979+0000","last_undegraded":"2024-05-09T00:01:45.051979+0000","last_fullsized":"2024-05-09T00:01:45.051979+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:47.062855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325220+0000","last_change":"2024-05-09T00:01:45.053962+0000","last_active":"2024-05-09T00:01:46.325220+0000","last_peered":"2024-05-09T00:01:46.325220+0000","last_clean":"2024-05-09T00:01:46.325220+0000","last_became_active":"2024-05-09T00:01:45.053637+0000","last_became_peered":"2024-05-09T00:01:45.053637+0000","last_unstale":"2024-05-09T00:01:46.325220+0000","last_undegraded":"2024-05-09T00:01:46.325220+0000","last_fullsized":"2024-05-09T00:01:46.325220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:18.188806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850155+0000","last_change":"2024-05-09T00:01:45.055532+0000","last_active":"2024-05-09T00:01:46.850155+0000","last_peered":"2024-05-09T00:01:46.850155+0000","last_clean":"2024-05-09T00:01:46.850155+0000","last_became_active":"2024-05-09T00:01:45.054939+0000","last_became_peered":"2024-05-09T00:01:45.054939+0000","last_unstale":"2024-05-09T00:01:46.850155+0000","last_undegraded":"2024-05-09T00:01:46.850155+0000","last_fullsized":"2024-05-09T00:01:46.850155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.919492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039891+0000","last_change":"2024-05-09T00:01:45.053752+0000","last_active":"2024-05-09T00:01:47.039891+0000","last_peered":"2024-05-09T00:01:47.039891+0000","last_clean":"2024-05-09T00:01:47.039891+0000","last_became_active":"2024-05-09T00:01:45.053409+0000","last_became_peered":"2024-05-09T00:01:45.053409+0000","last_unstale":"2024-05-09T00:01:47.039891+0000","last_undegraded":"2024-05-09T00:01:47.039891+0000","last_fullsized":"2024-05-09T00:01:47.039891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:12.517211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039813+0000","last_change":"2024-05-09T00:01:45.036145+0000","last_active":"2024-05-09T00:01:47.039813+0000","last_peered":"2024-05-09T00:01:47.039813+0000","last_clean":"2024-05-09T00:01:47.039813+0000","last_became_active":"2024-05-09T00:01:45.035839+0000","last_became_peered":"2024-05-09T00:01:45.035839+0000","last_unstale":"2024-05-09T00:01:47.039813+0000","last_undegraded":"2024-05-09T00:01:47.039813+0000","last_fullsized":"2024-05-09T00:01:47.039813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:03:17.630399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088680+0000","last_change":"2024-05-09T00:01:45.032875+0000","last_active":"2024-05-09T00:01:47.088680+0000","last_peered":"2024-05-09T00:01:47.088680+0000","last_clean":"2024-05-09T00:01:47.088680+0000","last_became_active":"2024-05-09T00:01:45.032552+0000","last_became_peered":"2024-05-09T00:01:45.032552+0000","last_unstale":"2024-05-09T00:01:47.088680+0000","last_undegraded":"2024-05-09T00:01:47.088680+0000","last_fullsized":"2024-05-09T00:01:47.088680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:17.244204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028730+0000","last_change":"2024-05-09T00:01:45.032427+0000","last_active":"2024-05-09T00:01:46.028730+0000","last_peered":"2024-05-09T00:01:46.028730+0000","last_clean":"2024-05-09T00:01:46.028730+0000","last_became_active":"2024-05-09T00:01:45.032038+0000","last_became_peered":"2024-05-09T00:01:45.032038+0000","last_unstale":"2024-05-09T00:01:46.028730+0000","last_undegraded":"2024-05-09T00:01:46.028730+0000","last_fullsized":"2024-05-09T00:01:46.028730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.495291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850245+0000","last_change":"2024-05-09T00:01:45.053080+0000","last_active":"2024-05-09T00:01:46.850245+0000","last_peered":"2024-05-09T00:01:46.850245+0000","last_clean":"2024-05-09T00:01:46.850245+0000","last_became_active":"2024-05-09T00:01:45.052728+0000","last_became_peered":"2024-05-09T00:01:45.052728+0000","last_unstale":"2024-05-09T00:01:46.850245+0000","last_undegraded":"2024-05-09T00:01:46.850245+0000","last_fullsized":"2024-05-09T00:01:46.850245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:59.631827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.040022+0000","last_change":"2024-05-09T00:01:45.044489+0000","last_active":"2024-05-09T00:01:47.040022+0000","last_peered":"2024-05-09T00:01:47.040022+0000","last_clean":"2024-05-09T00:01:47.040022+0000","last_became_active":"2024-05-09T00:01:45.044139+0000","last_became_peered":"2024-05-09T00:01:45.044139+0000","last_unstale":"2024-05-09T00:01:47.040022+0000","last_undegraded":"2024-05-09T00:01:47.040022+0000","last_fullsized":"2024-05-09T00:01:47.040022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:57.932238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187290+0000","last_change":"2024-05-09T00:01:45.050829+0000","last_active":"2024-05-09T00:01:45.187290+0000","last_peered":"2024-05-09T00:01:45.187290+0000","last_clean":"2024-05-09T00:01:45.187290+0000","last_became_active":"2024-05-09T00:01:45.050410+0000","last_became_peered":"2024-05-09T00:01:45.050410+0000","last_unstale":"2024-05-09T00:01:45.187290+0000","last_undegraded":"2024-05-09T00:01:45.187290+0000","last_fullsized":"2024-05-09T00:01:45.187290+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:08.738918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029150+0000","last_change":"2024-05-09T00:01:45.053957+0000","last_active":"2024-05-09T00:01:46.029150+0000","last_peered":"2024-05-09T00:01:46.029150+0000","last_clean":"2024-05-09T00:01:46.029150+0000","last_became_active":"2024-05-09T00:01:45.053487+0000","last_became_peered":"2024-05-09T00:01:45.053487+0000","last_unstale":"2024-05-09T00:01:46.029150+0000","last_undegraded":"2024-05-09T00:01:46.029150+0000","last_fullsized":"2024-05-09T00:01:46.029150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:35.131361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187232+0000","last_change":"2024-05-09T00:01:45.050653+0000","last_active":"2024-05-09T00:01:45.187232+0000","last_peered":"2024-05-09T00:01:45.187232+0000","last_clean":"2024-05-09T00:01:45.187232+0000","last_became_active":"2024-05-09T00:01:45.050322+0000","last_became_peered":"2024-05-09T00:01:45.050322+0000","last_unstale":"2024-05-09T00:01:45.187232+0000","last_undegraded":"2024-05-09T00:01:45.187232+0000","last_fullsized":"2024-05-09T00:01:45.187232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:11:45.137945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029679+0000","last_change":"2024-05-09T00:01:45.044757+0000","last_active":"2024-05-09T00:01:46.029679+0000","last_peered":"2024-05-09T00:01:46.029679+0000","last_clean":"2024-05-09T00:01:46.029679+0000","last_became_active":"2024-05-09T00:01:45.044464+0000","last_became_peered":"2024-05-09T00:01:45.044464+0000","last_unstale":"2024-05-09T00:01:46.029679+0000","last_undegraded":"2024-05-09T00:01:46.029679+0000","last_fullsized":"2024-05-09T00:01:46.029679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:44.402750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028903+0000","last_change":"2024-05-09T00:01:45.044515+0000","last_active":"2024-05-09T00:01:46.028903+0000","last_peered":"2024-05-09T00:01:46.028903+0000","last_clean":"2024-05-09T00:01:46.028903+0000","last_became_active":"2024-05-09T00:01:45.044209+0000","last_became_peered":"2024-05-09T00:01:45.044209+0000","last_unstale":"2024-05-09T00:01:46.028903+0000","last_undegraded":"2024-05-09T00:01:46.028903+0000","last_fullsized":"2024-05-09T00:01:46.028903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:18.523680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850098+0000","last_change":"2024-05-09T00:01:45.044254+0000","last_active":"2024-05-09T00:01:46.850098+0000","last_peered":"2024-05-09T00:01:46.850098+0000","last_clean":"2024-05-09T00:01:46.850098+0000","last_became_active":"2024-05-09T00:01:45.043220+0000","last_became_peered":"2024-05-09T00:01:45.043220+0000","last_unstale":"2024-05-09T00:01:46.850098+0000","last_undegraded":"2024-05-09T00:01:46.850098+0000","last_fullsized":"2024-05-09T00:01:46.850098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:39:53.986814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246178,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62627,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":228,"num_read_kb":179,"num_write":150,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":186229,"data_compressed":5574,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579922,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":851968,"data_stored":410369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.628}]},{"osd":7,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.80300000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":9,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.75},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.86499999999999999}]},{"osd":10,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.78900000000000003}]}]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":999424,"data_stored":1060522,"data_compressed":37494,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":8,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.61799999999999999}]},{"osd":9,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.68200000000000005}]},{"osd":11,"last update":"Thu May 9 00:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.83999999999999997}]}]},{"osd":9,"up_from":62,"seq":266287972377,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31960,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713192,"statfs":{"total":95995035648,"available":95962308608,"internally_reserved":0,"allocated":868352,"data_stored":410605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.501}]},{"osd":6,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.44},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.745},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.55900000000000005}]},{"osd":8,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.54600000000000004}]},{"osd":10,"last update":"Thu May 9 00:01:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.70699999999999996}]}]},{"osd":8,"up_from":55,"seq":236223201307,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":864256,"data_stored":410194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.60399999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73599999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.57199999999999995}]},{"osd":1,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.42299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83699999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.48499999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48099999999999998,"15min":0.48299999999999998},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64600000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.443},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64500000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.38}]},{"osd":3,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71499999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.44,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85299999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.54400000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.62,"15min":0.629},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.47999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.77300000000000002,"5min":0.996,"15min":0.996},"last":0.67000000000000004}]},{"osd":6,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.79700000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.63},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.503,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86599999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.754},"min":{"1min":0.56599999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.82399999999999995,"5min":1.004,"15min":1.004},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.66300000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93400000000000005,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.745}]},{"osd":9,"last update":"Thu May 9 00:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.72799999999999998}]},{"osd":10,"last update":"Thu May 9 00:01:59 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.75700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":7,"up_from":48,"seq":206158430239,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":917504,"data_stored":1002361,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.376},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.443}]},{"osd":1,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.39500000000000002,"15min":0.38300000000000001},"min":{"1min":0.28699999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.31900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.498}]},{"osd":2,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80600000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.84399999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73599999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76000000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.437}]},{"osd":5,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.626,"15min":0.62},"min":{"1min":0.49399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82899999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.502,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84799999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93000000000000005,"5min":1.032,"15min":1.032},"last":0.52900000000000003}]},{"osd":8,"last update":"Thu May 9 00:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.51500000000000001}]},{"osd":10,"last update":"Thu May 9 00:01:56 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.624}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":6,"up_from":43,"seq":184683593763,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31948,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713204,"statfs":{"total":95995035648,"available":95962320896,"internally_reserved":0,"allocated":856064,"data_stored":409994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.28299999999999997}]},{"osd":1,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68100000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.379}]},{"osd":3,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.505,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.37}]},{"osd":4,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63,"15min":0.63},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.65200000000000002,"15min":0.65700000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84099999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.42299999999999999}]},{"osd":7,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86699999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.496},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.497,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52900000000000003}]},{"osd":8,"last update":"Thu May 9 00:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55300000000000005}]},{"osd":9,"last update":"Thu May 9 00:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.51400000000000001}]},{"osd":10,"last update":"Thu May 9 00:01:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":913408,"data_stored":468507,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.35199999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.35799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51000000000000001,"15min":0.497},"min":{"1min":0.32700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.29999999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.626}]},{"osd":3,"last update":"Thu May 9 00:01:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.36699999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52500000000000002,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu May 9 00:02:17 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.434,"15min":0.40999999999999998},"min":{"1min":0.32300000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.42299999999999999},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu May 9 00:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu May 9 00:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.58099999999999996,"15min":0.57399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu May 9 00:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54300000000000004}]},{"osd":8,"last update":"Thu May 9 00:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.72699999999999998}]},{"osd":9,"last update":"Thu May 9 00:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.80800000000000005}]},{"osd":10,"last update":"Thu May 9 00:01:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.78500000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":876544,"data_stored":411265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 9 00:01:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.51200000000000001,"15min":0.48599999999999999},"min":{"1min":0.32000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.53100000000000003,"15min":0.50800000000000001},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80300000000000005,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.52300000000000002,"15min":0.504},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81599999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.39500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu May 9 00:00:56 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.40400000000000003,"15min":0.39800000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.39900000000000002,"15min":0.39400000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.314}]},{"osd":4,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.72399999999999998,"5min":1.075,"15min":1.075},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu May 9 00:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu May 9 00:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.317,"5min":0.246,"15min":0.246},"max":{"1min":0.99399999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.377},{"interface":"front","average":{"1min":0.505,"5min":0.498,"15min":0.497},"min":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.56100000000000005}]},{"osd":8,"last update":"Thu May 9 00:01:23 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63}]},{"osd":9,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.439}]},{"osd":10,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.45700000000000002}]},{"osd":11,"last update":"Thu May 9 00:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.68799999999999994}]}]},{"osd":2,"up_from":17,"seq":73014444081,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":467931,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48299999999999998,"15min":0.46300000000000002},"min":{"1min":0.34499999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.48899999999999999,"15min":0.47399999999999998},"min":{"1min":0.39600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu May 9 00:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.37,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.499,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu May 9 00:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52000000000000002,"15min":0.51400000000000001},"min":{"1min":0.42099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51100000000000001,"15min":0.50700000000000001},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.42099999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu May 9 00:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.44500000000000001,"15min":0.433},"min":{"1min":0.31,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.45900000000000002,"15min":0.44900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.621}]},{"osd":6,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.39000000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu May 9 00:01:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67100000000000004}]},{"osd":8,"last update":"Thu May 9 00:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.5},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.69999999999999996}]},{"osd":9,"last update":"Thu May 9 00:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.59799999999999998}]},{"osd":10,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.66300000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":3,"up_from":24,"seq":103079215149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31964,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713188,"statfs":{"total":95995035648,"available":95962304512,"internally_reserved":0,"allocated":872448,"data_stored":410305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.33600000000000002,"15min":0.33300000000000002},"min":{"1min":0.26500000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.442,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.248,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48999999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.313}]},{"osd":1,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52000000000000002,"15min":0.51400000000000001},"min":{"1min":0.42299999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.69199999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.41799999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79100000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.44700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75,"5min":1.075,"15min":1.075},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.35499999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63700000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.377},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42499999999999999}]},{"osd":5,"last update":"Thu May 9 00:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.42399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.52300000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.49399999999999999}]},{"osd":6,"last update":"Thu May 9 00:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.44500000000000001,"15min":0.439},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.31,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu May 9 00:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.47099999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69899999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.46899999999999997}]},{"osd":8,"last update":"Thu May 9 00:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.46700000000000003}]},{"osd":9,"last update":"Thu May 9 00:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.62},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.50800000000000001}]},{"osd":10,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.59999999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":4,"up_from":31,"seq":133143986219,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":860160,"data_stored":410383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.39400000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79800000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.371,"15min":0.35299999999999998},"min":{"1min":0.312,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.378,"15min":0.36499999999999999},"min":{"1min":0.28299999999999997,"5min":0.215,"15min":0.215},"max":{"1min":0.64000000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.54500000000000004,"15min":0.51500000000000001},"min":{"1min":0.39900000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.54100000000000004,"15min":0.50700000000000001},"min":{"1min":0.40400000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu May 9 00:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57899999999999996,"15min":0.57099999999999995},"min":{"1min":0.441,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.46700000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu May 9 00:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56299999999999994,"15min":0.55600000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.75}]},{"osd":7,"last update":"Thu May 9 00:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.66200000000000003}]},{"osd":8,"last update":"Thu May 9 00:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.79100000000000004}]},{"osd":9,"last update":"Thu May 9 00:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.88900000000000001}]},{"osd":10,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.78200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]}]},{"osd":5,"up_from":36,"seq":154618822695,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":929792,"data_stored":1002093,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.498,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.49399999999999999,"15min":0.49099999999999999},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.35699999999999998,"15min":0.34799999999999998},"min":{"1min":0.29099999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.371,"15min":0.36799999999999999},"min":{"1min":0.27000000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.498}]},{"osd":4,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.39400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73599999999999999,"5min":0.754,"15min":0.754},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu May 9 00:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.90000000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.41999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.625}]},{"osd":7,"last update":"Thu May 9 00:02:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.59599999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68899999999999995}]},{"osd":8,"last update":"Thu May 9 00:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.39800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83499999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.57199999999999995}]},{"osd":9,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.72399999999999998}]},{"osd":10,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33999,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33999,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":58720,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":58763,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60250,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:02:24.979 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-09T00:02:25.206 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:25.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:25 smithi081 ceph-mon[42474]: pgmap v238: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-09T00:02:25.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:25 smithi150 ceph-mon[46187]: pgmap v238: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-09T00:02:25.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:25 smithi171 ceph-mon[47351]: pgmap v238: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 7 op/s 2024-05-09T00:02:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.201+0000 7f56c109b700 1 -- 172.21.15.81:0/4121691788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc0692f0 msgr2=0x7f56bc10de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.201+0000 7f56c109b700 1 --2- 172.21.15.81:0/4121691788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc0692f0 0x7f56bc10de60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f56b400b0a0 tx=0x7f56b400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.201+0000 7f56c109b700 1 -- 172.21.15.81:0/4121691788 shutdown_connections 2024-05-09T00:02:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.201+0000 7f56c109b700 1 --2- 172.21.15.81:0/4121691788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc0692f0 0x7f56bc10de60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.201+0000 7f56c109b700 1 --2- 172.21.15.81:0/4121691788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56bc107020 0x7f56bc107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.201+0000 7f56c109b700 1 --2- 172.21.15.81:0/4121691788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56bc068950 0x7f56bc068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.201+0000 7f56c109b700 1 -- 172.21.15.81:0/4121691788 >> 172.21.15.81:0/4121691788 conn(0x7f56bc075f80 msgr2=0x7f56bc076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.201+0000 7f56c109b700 1 -- 172.21.15.81:0/4121691788 shutdown_connections 2024-05-09T00:02:26.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.201+0000 7f56c109b700 1 -- 172.21.15.81:0/4121691788 wait complete. 2024-05-09T00:02:26.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56c109b700 1 Processor -- start 2024-05-09T00:02:26.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56c109b700 1 -- start start 2024-05-09T00:02:26.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56c109b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc068950 0x7f56bc0fffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:26.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56c109b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56bc0692f0 0x7f56bc100500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:26.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56c109b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56bc107020 0x7f56bc100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:26.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56c109b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc1a5890 con 0x7f56bc068950 2024-05-09T00:02:26.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56c109b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc1a5a00 con 0x7f56bc0692f0 2024-05-09T00:02:26.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56c109b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc1a5bc0 con 0x7f56bc107020 2024-05-09T00:02:26.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56bad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc068950 0x7f56bc0fffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:26.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56bad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc068950 0x7f56bc0fffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33040/0 (socket says 172.21.15.81:33040) 2024-05-09T00:02:26.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56bad9d700 1 -- 172.21.15.81:0/319339502 learned_addr learned my addr 172.21.15.81:0/319339502 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:26.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56bb59e700 1 --2- 172.21.15.81:0/319339502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56bc107020 0x7f56bc100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:26.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56ba59c700 1 --2- 172.21.15.81:0/319339502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56bc0692f0 0x7f56bc100500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:26.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56bad9d700 1 -- 172.21.15.81:0/319339502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56bc107020 msgr2=0x7f56bc100a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:26.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56bad9d700 1 --2- 172.21.15.81:0/319339502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56bc107020 0x7f56bc100a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:26.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56bad9d700 1 -- 172.21.15.81:0/319339502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56bc0692f0 msgr2=0x7f56bc100500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:26.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56bad9d700 1 --2- 172.21.15.81:0/319339502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56bc0692f0 0x7f56bc100500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:26.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.202+0000 7f56bad9d700 1 -- 172.21.15.81:0/319339502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b4009d00 con 0x7f56bc068950 2024-05-09T00:02:26.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.203+0000 7f56bad9d700 1 --2- 172.21.15.81:0/319339502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc068950 0x7f56bc0fffc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f56b000c920 tx=0x7f56b000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:26.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.203+0000 7f56a3fff700 1 -- 172.21.15.81:0/319339502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0007b00 con 0x7f56bc068950 2024-05-09T00:02:26.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.203+0000 7f56c109b700 1 -- 172.21.15.81:0/319339502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56bc1a5ea0 con 0x7f56bc068950 2024-05-09T00:02:26.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.203+0000 7f56a3fff700 1 -- 172.21.15.81:0/319339502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56b000ce70 con 0x7f56bc068950 2024-05-09T00:02:26.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.203+0000 7f56a3fff700 1 -- 172.21.15.81:0/319339502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0005460 con 0x7f56bc068950 2024-05-09T00:02:26.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.203+0000 7f56c109b700 1 -- 172.21.15.81:0/319339502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56bc1a62c0 con 0x7f56bc068950 2024-05-09T00:02:26.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.204+0000 7f56c109b700 1 -- 172.21.15.81:0/319339502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56bc109540 con 0x7f56bc068950 2024-05-09T00:02:26.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.205+0000 7f56a3fff700 1 -- 172.21.15.81:0/319339502 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f56b0004750 con 0x7f56bc068950 2024-05-09T00:02:26.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.205+0000 7f56a3fff700 1 --2- 172.21.15.81:0/319339502 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f56a40a1230 0x7f56a40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:26.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.205+0000 7f56ba59c700 1 --2- 172.21.15.81:0/319339502 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f56a40a1230 0x7f56a40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:26.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.205+0000 7f56a3fff700 1 -- 172.21.15.81:0/319339502 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f56b00cc570 con 0x7f56bc068950 2024-05-09T00:02:26.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.206+0000 7f56ba59c700 1 --2- 172.21.15.81:0/319339502 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f56a40a1230 0x7f56a40a36f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f56ac005950 tx=0x7f56ac0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:26.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.210+0000 7f56a3fff700 1 -- 172.21.15.81:0/319339502 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f56b0095c50 con 0x7f56bc068950 2024-05-09T00:02:26.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.403+0000 7f56c109b700 1 -- 172.21.15.81:0/319339502 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56bc101450 con 0x7f56a40a1230 2024-05-09T00:02:26.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.413+0000 7f56a3fff700 1 -- 172.21.15.81:0/319339502 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340828 (secure 0 0 0) 0x7f56bc101450 con 0x7f56a40a1230 2024-05-09T00:02:26.412 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:26.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.416+0000 7f56c109b700 1 -- 172.21.15.81:0/319339502 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f56a40a1230 msgr2=0x7f56a40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:26.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.416+0000 7f56c109b700 1 --2- 172.21.15.81:0/319339502 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f56a40a1230 0x7f56a40a36f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f56ac005950 tx=0x7f56ac0058e0 comp rx=0 tx=0).stop 2024-05-09T00:02:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.416+0000 7f56c109b700 1 -- 172.21.15.81:0/319339502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc068950 msgr2=0x7f56bc0fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.416+0000 7f56c109b700 1 --2- 172.21.15.81:0/319339502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc068950 0x7f56bc0fffc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f56b000c920 tx=0x7f56b000cc30 comp rx=0 tx=0).stop 2024-05-09T00:02:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.416+0000 7f56c109b700 1 -- 172.21.15.81:0/319339502 shutdown_connections 2024-05-09T00:02:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.416+0000 7f56c109b700 1 --2- 172.21.15.81:0/319339502 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f56a40a1230 0x7f56a40a36f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.416+0000 7f56c109b700 1 --2- 172.21.15.81:0/319339502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f56bc107020 0x7f56bc100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.416+0000 7f56c109b700 1 --2- 172.21.15.81:0/319339502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56bc068950 0x7f56bc0fffc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.416+0000 7f56c109b700 1 --2- 172.21.15.81:0/319339502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f56bc0692f0 0x7f56bc100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.416+0000 7f56c109b700 1 -- 172.21.15.81:0/319339502 >> 172.21.15.81:0/319339502 conn(0x7f56bc075f80 msgr2=0x7f56bc0fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.417+0000 7f56c109b700 1 -- 172.21.15.81:0/319339502 shutdown_connections 2024-05-09T00:02:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:26.417+0000 7f56c109b700 1 -- 172.21.15.81:0/319339502 wait complete. 2024-05-09T00:02:26.415 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-09T00:02:26.704 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:26 smithi081 ceph-mon[42474]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:02:26.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:26 smithi150 ceph-mon[46187]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:02:26.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:26 smithi171 ceph-mon[47351]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:02:26.814 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-05-09T00:02:26.278355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653229,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":369,"num_read_kb":303,"num_write":333,"num_write_kb":3044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375648,"kb_used_data":10492,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124566176,"statfs":{"total":1151940427776,"available":1151555764224,"internally_reserved":0,"allocated":10743808,"data_stored":6876181,"data_compressed":112482,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19131,"internal_metadata":373798213},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":37,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002934"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850421+0000","last_change":"2024-05-09T00:01:45.048606+0000","last_active":"2024-05-09T00:01:46.850421+0000","last_peered":"2024-05-09T00:01:46.850421+0000","last_clean":"2024-05-09T00:01:46.850421+0000","last_became_active":"2024-05-09T00:01:45.047691+0000","last_became_peered":"2024-05-09T00:01:45.047691+0000","last_unstale":"2024-05-09T00:01:46.850421+0000","last_undegraded":"2024-05-09T00:01:46.850421+0000","last_fullsized":"2024-05-09T00:01:46.850421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:03.881912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088559+0000","last_change":"2024-05-09T00:01:45.046812+0000","last_active":"2024-05-09T00:01:47.088559+0000","last_peered":"2024-05-09T00:01:47.088559+0000","last_clean":"2024-05-09T00:01:47.088559+0000","last_became_active":"2024-05-09T00:01:45.046510+0000","last_became_peered":"2024-05-09T00:01:45.046510+0000","last_unstale":"2024-05-09T00:01:47.088559+0000","last_undegraded":"2024-05-09T00:01:47.088559+0000","last_fullsized":"2024-05-09T00:01:47.088559+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:03.614974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088767+0000","last_change":"2024-05-09T00:01:45.040304+0000","last_active":"2024-05-09T00:01:47.088767+0000","last_peered":"2024-05-09T00:01:47.088767+0000","last_clean":"2024-05-09T00:01:47.088767+0000","last_became_active":"2024-05-09T00:01:45.039990+0000","last_became_peered":"2024-05-09T00:01:45.039990+0000","last_unstale":"2024-05-09T00:01:47.088767+0000","last_undegraded":"2024-05-09T00:01:47.088767+0000","last_fullsized":"2024-05-09T00:01:47.088767+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:17:33.563999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089069+0000","last_change":"2024-05-09T00:01:45.040528+0000","last_active":"2024-05-09T00:01:47.089069+0000","last_peered":"2024-05-09T00:01:47.089069+0000","last_clean":"2024-05-09T00:01:47.089069+0000","last_became_active":"2024-05-09T00:01:45.040100+0000","last_became_peered":"2024-05-09T00:01:45.040100+0000","last_unstale":"2024-05-09T00:01:47.089069+0000","last_undegraded":"2024-05-09T00:01:47.089069+0000","last_fullsized":"2024-05-09T00:01:47.089069+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:02.739346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327560+0000","last_change":"2024-05-09T00:01:45.036192+0000","last_active":"2024-05-09T00:01:45.327560+0000","last_peered":"2024-05-09T00:01:45.327560+0000","last_clean":"2024-05-09T00:01:45.327560+0000","last_became_active":"2024-05-09T00:01:45.035845+0000","last_became_peered":"2024-05-09T00:01:45.035845+0000","last_unstale":"2024-05-09T00:01:45.327560+0000","last_undegraded":"2024-05-09T00:01:45.327560+0000","last_fullsized":"2024-05-09T00:01:45.327560+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:25.494946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089254+0000","last_change":"2024-05-09T00:01:45.047866+0000","last_active":"2024-05-09T00:01:47.089254+0000","last_peered":"2024-05-09T00:01:47.089254+0000","last_clean":"2024-05-09T00:01:47.089254+0000","last_became_active":"2024-05-09T00:01:45.047549+0000","last_became_peered":"2024-05-09T00:01:45.047549+0000","last_unstale":"2024-05-09T00:01:47.089254+0000","last_undegraded":"2024-05-09T00:01:47.089254+0000","last_fullsized":"2024-05-09T00:01:47.089254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:34:33.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325076+0000","last_change":"2024-05-09T00:01:45.054246+0000","last_active":"2024-05-09T00:01:46.325076+0000","last_peered":"2024-05-09T00:01:46.325076+0000","last_clean":"2024-05-09T00:01:46.325076+0000","last_became_active":"2024-05-09T00:01:45.053863+0000","last_became_peered":"2024-05-09T00:01:45.053863+0000","last_unstale":"2024-05-09T00:01:46.325076+0000","last_undegraded":"2024-05-09T00:01:46.325076+0000","last_fullsized":"2024-05-09T00:01:46.325076+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:12.080139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187184+0000","last_change":"2024-05-09T00:01:45.053747+0000","last_active":"2024-05-09T00:01:45.187184+0000","last_peered":"2024-05-09T00:01:45.187184+0000","last_clean":"2024-05-09T00:01:45.187184+0000","last_became_active":"2024-05-09T00:01:45.053461+0000","last_became_peered":"2024-05-09T00:01:45.053461+0000","last_unstale":"2024-05-09T00:01:45.187184+0000","last_undegraded":"2024-05-09T00:01:45.187184+0000","last_fullsized":"2024-05-09T00:01:45.187184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:30.018296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029785+0000","last_change":"2024-05-09T00:01:45.053851+0000","last_active":"2024-05-09T00:01:46.029785+0000","last_peered":"2024-05-09T00:01:46.029785+0000","last_clean":"2024-05-09T00:01:46.029785+0000","last_became_active":"2024-05-09T00:01:45.053471+0000","last_became_peered":"2024-05-09T00:01:45.053471+0000","last_unstale":"2024-05-09T00:01:46.029785+0000","last_undegraded":"2024-05-09T00:01:46.029785+0000","last_fullsized":"2024-05-09T00:01:46.029785+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:25.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089793+0000","last_change":"2024-05-09T00:01:45.048916+0000","last_active":"2024-05-09T00:01:47.089793+0000","last_peered":"2024-05-09T00:01:47.089793+0000","last_clean":"2024-05-09T00:01:47.089793+0000","last_became_active":"2024-05-09T00:01:45.048227+0000","last_became_peered":"2024-05-09T00:01:45.048227+0000","last_unstale":"2024-05-09T00:01:47.089793+0000","last_undegraded":"2024-05-09T00:01:47.089793+0000","last_fullsized":"2024-05-09T00:01:47.089793+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:51.246933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325183+0000","last_change":"2024-05-09T00:01:45.053449+0000","last_active":"2024-05-09T00:01:46.325183+0000","last_peered":"2024-05-09T00:01:46.325183+0000","last_clean":"2024-05-09T00:01:46.325183+0000","last_became_active":"2024-05-09T00:01:45.053060+0000","last_became_peered":"2024-05-09T00:01:45.053060+0000","last_unstale":"2024-05-09T00:01:46.325183+0000","last_undegraded":"2024-05-09T00:01:46.325183+0000","last_fullsized":"2024-05-09T00:01:46.325183+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:21.236565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088953+0000","last_change":"2024-05-09T00:01:45.047231+0000","last_active":"2024-05-09T00:01:47.088953+0000","last_peered":"2024-05-09T00:01:47.088953+0000","last_clean":"2024-05-09T00:01:47.088953+0000","last_became_active":"2024-05-09T00:01:45.046897+0000","last_became_peered":"2024-05-09T00:01:45.046897+0000","last_unstale":"2024-05-09T00:01:47.088953+0000","last_undegraded":"2024-05-09T00:01:47.088953+0000","last_fullsized":"2024-05-09T00:01:47.088953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:13.307931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028948+0000","last_change":"2024-05-09T00:01:45.048545+0000","last_active":"2024-05-09T00:01:46.028948+0000","last_peered":"2024-05-09T00:01:46.028948+0000","last_clean":"2024-05-09T00:01:46.028948+0000","last_became_active":"2024-05-09T00:01:45.048237+0000","last_became_peered":"2024-05-09T00:01:45.048237+0000","last_unstale":"2024-05-09T00:01:46.028948+0000","last_undegraded":"2024-05-09T00:01:46.028948+0000","last_fullsized":"2024-05-09T00:01:46.028948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:45:41.578704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089031+0000","last_change":"2024-05-09T00:01:45.046735+0000","last_active":"2024-05-09T00:01:47.089031+0000","last_peered":"2024-05-09T00:01:47.089031+0000","last_clean":"2024-05-09T00:01:47.089031+0000","last_became_active":"2024-05-09T00:01:45.046441+0000","last_became_peered":"2024-05-09T00:01:45.046441+0000","last_unstale":"2024-05-09T00:01:47.089031+0000","last_undegraded":"2024-05-09T00:01:47.089031+0000","last_fullsized":"2024-05-09T00:01:47.089031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:51.380665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088074+0000","last_change":"2024-05-09T00:01:45.036289+0000","last_active":"2024-05-09T00:01:47.088074+0000","last_peered":"2024-05-09T00:01:47.088074+0000","last_clean":"2024-05-09T00:01:47.088074+0000","last_became_active":"2024-05-09T00:01:45.035996+0000","last_became_peered":"2024-05-09T00:01:45.035996+0000","last_unstale":"2024-05-09T00:01:47.088074+0000","last_undegraded":"2024-05-09T00:01:47.088074+0000","last_fullsized":"2024-05-09T00:01:47.088074+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:52.769668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029327+0000","last_change":"2024-05-09T00:01:45.044908+0000","last_active":"2024-05-09T00:01:46.029327+0000","last_peered":"2024-05-09T00:01:46.029327+0000","last_clean":"2024-05-09T00:01:46.029327+0000","last_became_active":"2024-05-09T00:01:45.044508+0000","last_became_peered":"2024-05-09T00:01:45.044508+0000","last_unstale":"2024-05-09T00:01:46.029327+0000","last_undegraded":"2024-05-09T00:01:46.029327+0000","last_fullsized":"2024-05-09T00:01:46.029327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:02:23.578743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850564+0000","last_change":"2024-05-09T00:01:45.048389+0000","last_active":"2024-05-09T00:01:46.850564+0000","last_peered":"2024-05-09T00:01:46.850564+0000","last_clean":"2024-05-09T00:01:46.850564+0000","last_became_active":"2024-05-09T00:01:45.047959+0000","last_became_peered":"2024-05-09T00:01:45.047959+0000","last_unstale":"2024-05-09T00:01:46.850564+0000","last_undegraded":"2024-05-09T00:01:46.850564+0000","last_fullsized":"2024-05-09T00:01:46.850564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:44.298296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089171+0000","last_change":"2024-05-09T00:01:45.048314+0000","last_active":"2024-05-09T00:01:47.089171+0000","last_peered":"2024-05-09T00:01:47.089171+0000","last_clean":"2024-05-09T00:01:47.089171+0000","last_became_active":"2024-05-09T00:01:45.048002+0000","last_became_peered":"2024-05-09T00:01:45.048002+0000","last_unstale":"2024-05-09T00:01:47.089171+0000","last_undegraded":"2024-05-09T00:01:47.089171+0000","last_fullsized":"2024-05-09T00:01:47.089171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:36.327498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039835+0000","last_change":"2024-05-09T00:01:45.035747+0000","last_active":"2024-05-09T00:01:47.039835+0000","last_peered":"2024-05-09T00:01:47.039835+0000","last_clean":"2024-05-09T00:01:47.039835+0000","last_became_active":"2024-05-09T00:01:45.035122+0000","last_became_peered":"2024-05-09T00:01:45.035122+0000","last_unstale":"2024-05-09T00:01:47.039835+0000","last_undegraded":"2024-05-09T00:01:47.039835+0000","last_fullsized":"2024-05-09T00:01:47.039835+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:21.361033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":22,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.057345+0000","last_change":"2024-05-09T00:01:44.620816+0000","last_active":"2024-05-09T00:01:49.057345+0000","last_peered":"2024-05-09T00:01:49.057345+0000","last_clean":"2024-05-09T00:01:49.057345+0000","last_became_active":"2024-05-09T00:01:44.620524+0000","last_became_peered":"2024-05-09T00:01:44.620524+0000","last_unstale":"2024-05-09T00:01:49.057345+0000","last_undegraded":"2024-05-09T00:01:49.057345+0000","last_fullsized":"2024-05-09T00:01:49.057345+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:05.623111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187261+0000","last_change":"2024-05-09T00:01:45.049115+0000","last_active":"2024-05-09T00:01:45.187261+0000","last_peered":"2024-05-09T00:01:45.187261+0000","last_clean":"2024-05-09T00:01:45.187261+0000","last_became_active":"2024-05-09T00:01:45.048825+0000","last_became_peered":"2024-05-09T00:01:45.048825+0000","last_unstale":"2024-05-09T00:01:45.187261+0000","last_undegraded":"2024-05-09T00:01:45.187261+0000","last_fullsized":"2024-05-09T00:01:45.187261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:09:29.890090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088914+0000","last_change":"2024-05-09T00:01:44.621711+0000","last_active":"2024-05-09T00:01:47.088914+0000","last_peered":"2024-05-09T00:01:47.088914+0000","last_clean":"2024-05-09T00:01:47.088914+0000","last_became_active":"2024-05-09T00:01:44.621433+0000","last_became_peered":"2024-05-09T00:01:44.621433+0000","last_unstale":"2024-05-09T00:01:47.088914+0000","last_undegraded":"2024-05-09T00:01:47.088914+0000","last_fullsized":"2024-05-09T00:01:47.088914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:57.451467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088944+0000","last_change":"2024-05-09T00:01:45.038415+0000","last_active":"2024-05-09T00:01:47.088944+0000","last_peered":"2024-05-09T00:01:47.088944+0000","last_clean":"2024-05-09T00:01:47.088944+0000","last_became_active":"2024-05-09T00:01:45.038141+0000","last_became_peered":"2024-05-09T00:01:45.038141+0000","last_unstale":"2024-05-09T00:01:47.088944+0000","last_undegraded":"2024-05-09T00:01:47.088944+0000","last_fullsized":"2024-05-09T00:01:47.088944+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:37.772886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.055486+0000","last_change":"2024-05-09T00:01:44.622505+0000","last_active":"2024-05-09T00:01:49.055486+0000","last_peered":"2024-05-09T00:01:49.055486+0000","last_clean":"2024-05-09T00:01:49.055486+0000","last_became_active":"2024-05-09T00:01:44.622120+0000","last_became_peered":"2024-05-09T00:01:44.622120+0000","last_unstale":"2024-05-09T00:01:49.055486+0000","last_undegraded":"2024-05-09T00:01:49.055486+0000","last_fullsized":"2024-05-09T00:01:49.055486+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:17:15.937946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029518+0000","last_change":"2024-05-09T00:01:45.048553+0000","last_active":"2024-05-09T00:01:46.029518+0000","last_peered":"2024-05-09T00:01:46.029518+0000","last_clean":"2024-05-09T00:01:46.029518+0000","last_became_active":"2024-05-09T00:01:45.046659+0000","last_became_peered":"2024-05-09T00:01:45.046659+0000","last_unstale":"2024-05-09T00:01:46.029518+0000","last_undegraded":"2024-05-09T00:01:46.029518+0000","last_fullsized":"2024-05-09T00:01:46.029518+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:19.581843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327593+0000","last_change":"2024-05-09T00:01:44.614820+0000","last_active":"2024-05-09T00:01:45.327593+0000","last_peered":"2024-05-09T00:01:45.327593+0000","last_clean":"2024-05-09T00:01:45.327593+0000","last_became_active":"2024-05-09T00:01:44.614418+0000","last_became_peered":"2024-05-09T00:01:44.614418+0000","last_unstale":"2024-05-09T00:01:45.327593+0000","last_undegraded":"2024-05-09T00:01:45.327593+0000","last_fullsized":"2024-05-09T00:01:45.327593+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:18.133098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029467+0000","last_change":"2024-05-09T00:01:45.058377+0000","last_active":"2024-05-09T00:01:46.029467+0000","last_peered":"2024-05-09T00:01:46.029467+0000","last_clean":"2024-05-09T00:01:46.029467+0000","last_became_active":"2024-05-09T00:01:45.057991+0000","last_became_peered":"2024-05-09T00:01:45.057991+0000","last_unstale":"2024-05-09T00:01:46.029467+0000","last_undegraded":"2024-05-09T00:01:46.029467+0000","last_fullsized":"2024-05-09T00:01:46.029467+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:18:14.102698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"79'6","reported_seq":53,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:02:20.108257+0000","last_change":"2024-05-09T00:01:44.619347+0000","last_active":"2024-05-09T00:02:20.108257+0000","last_peered":"2024-05-09T00:02:20.108257+0000","last_clean":"2024-05-09T00:02:20.108257+0000","last_became_active":"2024-05-09T00:01:44.618967+0000","last_became_peered":"2024-05-09T00:01:44.618967+0000","last_unstale":"2024-05-09T00:02:20.108257+0000","last_undegraded":"2024-05-09T00:02:20.108257+0000","last_fullsized":"2024-05-09T00:02:20.108257+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:10.434674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327548+0000","last_change":"2024-05-09T00:01:45.049365+0000","last_active":"2024-05-09T00:01:45.327548+0000","last_peered":"2024-05-09T00:01:45.327548+0000","last_clean":"2024-05-09T00:01:45.327548+0000","last_became_active":"2024-05-09T00:01:45.049037+0000","last_became_peered":"2024-05-09T00:01:45.049037+0000","last_unstale":"2024-05-09T00:01:45.327548+0000","last_undegraded":"2024-05-09T00:01:45.327548+0000","last_fullsized":"2024-05-09T00:01:45.327548+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:34.290672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.057967+0000","last_change":"2024-05-09T00:01:44.617212+0000","last_active":"2024-05-09T00:01:49.057967+0000","last_peered":"2024-05-09T00:01:49.057967+0000","last_clean":"2024-05-09T00:01:49.057967+0000","last_became_active":"2024-05-09T00:01:44.616898+0000","last_became_peered":"2024-05-09T00:01:44.616898+0000","last_unstale":"2024-05-09T00:01:49.057967+0000","last_undegraded":"2024-05-09T00:01:49.057967+0000","last_fullsized":"2024-05-09T00:01:49.057967+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:39.630039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029579+0000","last_change":"2024-05-09T00:01:45.058567+0000","last_active":"2024-05-09T00:01:46.029579+0000","last_peered":"2024-05-09T00:01:46.029579+0000","last_clean":"2024-05-09T00:01:46.029579+0000","last_became_active":"2024-05-09T00:01:45.058124+0000","last_became_peered":"2024-05-09T00:01:45.058124+0000","last_unstale":"2024-05-09T00:01:46.029579+0000","last_undegraded":"2024-05-09T00:01:46.029579+0000","last_fullsized":"2024-05-09T00:01:46.029579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:03.438029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.057886+0000","last_change":"2024-05-09T00:01:44.618214+0000","last_active":"2024-05-09T00:01:49.057886+0000","last_peered":"2024-05-09T00:01:49.057886+0000","last_clean":"2024-05-09T00:01:49.057886+0000","last_became_active":"2024-05-09T00:01:44.617769+0000","last_became_peered":"2024-05-09T00:01:44.617769+0000","last_unstale":"2024-05-09T00:01:49.057886+0000","last_undegraded":"2024-05-09T00:01:49.057886+0000","last_fullsized":"2024-05-09T00:01:49.057886+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:43.654597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187210+0000","last_change":"2024-05-09T00:01:45.037441+0000","last_active":"2024-05-09T00:01:45.187210+0000","last_peered":"2024-05-09T00:01:45.187210+0000","last_clean":"2024-05-09T00:01:45.187210+0000","last_became_active":"2024-05-09T00:01:45.036668+0000","last_became_peered":"2024-05-09T00:01:45.036668+0000","last_unstale":"2024-05-09T00:01:45.187210+0000","last_undegraded":"2024-05-09T00:01:45.187210+0000","last_fullsized":"2024-05-09T00:01:45.187210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:25.116685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.525580+0000","last_change":"2024-05-09T00:01:44.624973+0000","last_active":"2024-05-09T00:01:46.525580+0000","last_peered":"2024-05-09T00:01:46.525580+0000","last_clean":"2024-05-09T00:01:46.525580+0000","last_became_active":"2024-05-09T00:01:44.624470+0000","last_became_peered":"2024-05-09T00:01:44.624470+0000","last_unstale":"2024-05-09T00:01:46.525580+0000","last_undegraded":"2024-05-09T00:01:46.525580+0000","last_fullsized":"2024-05-09T00:01:46.525580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:22.021060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088654+0000","last_change":"2024-05-09T00:01:45.037414+0000","last_active":"2024-05-09T00:01:47.088654+0000","last_peered":"2024-05-09T00:01:47.088654+0000","last_clean":"2024-05-09T00:01:47.088654+0000","last_became_active":"2024-05-09T00:01:45.037095+0000","last_became_peered":"2024-05-09T00:01:45.037095+0000","last_unstale":"2024-05-09T00:01:47.088654+0000","last_undegraded":"2024-05-09T00:01:47.088654+0000","last_fullsized":"2024-05-09T00:01:47.088654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:29.812977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"79'3","reported_seq":50,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:02:23.111730+0000","last_change":"2024-05-09T00:01:44.614823+0000","last_active":"2024-05-09T00:02:23.111730+0000","last_peered":"2024-05-09T00:02:23.111730+0000","last_clean":"2024-05-09T00:02:23.111730+0000","last_became_active":"2024-05-09T00:01:44.614502+0000","last_became_peered":"2024-05-09T00:01:44.614502+0000","last_unstale":"2024-05-09T00:02:23.111730+0000","last_undegraded":"2024-05-09T00:02:23.111730+0000","last_fullsized":"2024-05-09T00:02:23.111730+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:14.486852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029787+0000","last_change":"2024-05-09T00:01:45.048631+0000","last_active":"2024-05-09T00:01:46.029787+0000","last_peered":"2024-05-09T00:01:46.029787+0000","last_clean":"2024-05-09T00:01:46.029787+0000","last_became_active":"2024-05-09T00:01:45.046691+0000","last_became_peered":"2024-05-09T00:01:45.046691+0000","last_unstale":"2024-05-09T00:01:46.029787+0000","last_undegraded":"2024-05-09T00:01:46.029787+0000","last_fullsized":"2024-05-09T00:01:46.029787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:59:35.017208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.049047+0000","last_change":"2024-05-09T00:01:44.622684+0000","last_active":"2024-05-09T00:01:48.049047+0000","last_peered":"2024-05-09T00:01:48.049047+0000","last_clean":"2024-05-09T00:01:48.049047+0000","last_became_active":"2024-05-09T00:01:44.622301+0000","last_became_peered":"2024-05-09T00:01:44.622301+0000","last_unstale":"2024-05-09T00:01:48.049047+0000","last_undegraded":"2024-05-09T00:01:48.049047+0000","last_fullsized":"2024-05-09T00:01:48.049047+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:38.343729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088905+0000","last_change":"2024-05-09T00:01:45.050240+0000","last_active":"2024-05-09T00:01:47.088905+0000","last_peered":"2024-05-09T00:01:47.088905+0000","last_clean":"2024-05-09T00:01:47.088905+0000","last_became_active":"2024-05-09T00:01:45.049955+0000","last_became_peered":"2024-05-09T00:01:45.049955+0000","last_unstale":"2024-05-09T00:01:47.088905+0000","last_undegraded":"2024-05-09T00:01:47.088905+0000","last_fullsized":"2024-05-09T00:01:47.088905+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:56.811853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.049424+0000","last_change":"2024-05-09T00:01:44.618591+0000","last_active":"2024-05-09T00:01:48.049424+0000","last_peered":"2024-05-09T00:01:48.049424+0000","last_clean":"2024-05-09T00:01:48.049424+0000","last_became_active":"2024-05-09T00:01:44.618198+0000","last_became_peered":"2024-05-09T00:01:44.618198+0000","last_unstale":"2024-05-09T00:01:48.049424+0000","last_undegraded":"2024-05-09T00:01:48.049424+0000","last_fullsized":"2024-05-09T00:01:48.049424+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:27.705444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029617+0000","last_change":"2024-05-09T00:01:45.037485+0000","last_active":"2024-05-09T00:01:46.029617+0000","last_peered":"2024-05-09T00:01:46.029617+0000","last_clean":"2024-05-09T00:01:46.029617+0000","last_became_active":"2024-05-09T00:01:45.037150+0000","last_became_peered":"2024-05-09T00:01:45.037150+0000","last_unstale":"2024-05-09T00:01:46.029617+0000","last_undegraded":"2024-05-09T00:01:46.029617+0000","last_fullsized":"2024-05-09T00:01:46.029617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:55.476243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"79'28","reported_seq":118,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:02:24.125899+0000","last_change":"2024-05-09T00:01:44.620485+0000","last_active":"2024-05-09T00:02:24.125899+0000","last_peered":"2024-05-09T00:02:24.125899+0000","last_clean":"2024-05-09T00:02:24.125899+0000","last_became_active":"2024-05-09T00:01:44.620004+0000","last_became_peered":"2024-05-09T00:01:44.620004+0000","last_unstale":"2024-05-09T00:02:24.125899+0000","last_undegraded":"2024-05-09T00:02:24.125899+0000","last_fullsized":"2024-05-09T00:02:24.125899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:58.529038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":95,"num_write":29,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327607+0000","last_change":"2024-05-09T00:01:45.045581+0000","last_active":"2024-05-09T00:01:45.327607+0000","last_peered":"2024-05-09T00:01:45.327607+0000","last_clean":"2024-05-09T00:01:45.327607+0000","last_became_active":"2024-05-09T00:01:45.045290+0000","last_became_peered":"2024-05-09T00:01:45.045290+0000","last_unstale":"2024-05-09T00:01:45.327607+0000","last_undegraded":"2024-05-09T00:01:45.327607+0000","last_fullsized":"2024-05-09T00:01:45.327607+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:36.860897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":19,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.056105+0000","last_change":"2024-05-09T00:01:44.624145+0000","last_active":"2024-05-09T00:01:49.056105+0000","last_peered":"2024-05-09T00:01:49.056105+0000","last_clean":"2024-05-09T00:01:49.056105+0000","last_became_active":"2024-05-09T00:01:44.623804+0000","last_became_peered":"2024-05-09T00:01:44.623804+0000","last_unstale":"2024-05-09T00:01:49.056105+0000","last_undegraded":"2024-05-09T00:01:49.056105+0000","last_fullsized":"2024-05-09T00:01:49.056105+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:22.366804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028727+0000","last_change":"2024-05-09T00:01:45.044724+0000","last_active":"2024-05-09T00:01:46.028727+0000","last_peered":"2024-05-09T00:01:46.028727+0000","last_clean":"2024-05-09T00:01:46.028727+0000","last_became_active":"2024-05-09T00:01:45.044251+0000","last_became_peered":"2024-05-09T00:01:45.044251+0000","last_unstale":"2024-05-09T00:01:46.028727+0000","last_undegraded":"2024-05-09T00:01:46.028727+0000","last_fullsized":"2024-05-09T00:01:46.028727+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:11:33.525140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048447+0000","last_change":"2024-05-09T00:01:44.620188+0000","last_active":"2024-05-09T00:01:48.048447+0000","last_peered":"2024-05-09T00:01:48.048447+0000","last_clean":"2024-05-09T00:01:48.048447+0000","last_became_active":"2024-05-09T00:01:44.619914+0000","last_became_peered":"2024-05-09T00:01:44.619914+0000","last_unstale":"2024-05-09T00:01:48.048447+0000","last_undegraded":"2024-05-09T00:01:48.048447+0000","last_fullsized":"2024-05-09T00:01:48.048447+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:50.349806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325112+0000","last_change":"2024-05-09T00:01:45.044881+0000","last_active":"2024-05-09T00:01:46.325112+0000","last_peered":"2024-05-09T00:01:46.325112+0000","last_clean":"2024-05-09T00:01:46.325112+0000","last_became_active":"2024-05-09T00:01:45.044176+0000","last_became_peered":"2024-05-09T00:01:45.044176+0000","last_unstale":"2024-05-09T00:01:46.325112+0000","last_undegraded":"2024-05-09T00:01:46.325112+0000","last_fullsized":"2024-05-09T00:01:46.325112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:15.672966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"79'3","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:02:22.120526+0000","last_change":"2024-05-09T00:01:44.616560+0000","last_active":"2024-05-09T00:02:22.120526+0000","last_peered":"2024-05-09T00:02:22.120526+0000","last_clean":"2024-05-09T00:02:22.120526+0000","last_became_active":"2024-05-09T00:01:44.616172+0000","last_became_peered":"2024-05-09T00:01:44.616172+0000","last_unstale":"2024-05-09T00:02:22.120526+0000","last_undegraded":"2024-05-09T00:02:22.120526+0000","last_fullsized":"2024-05-09T00:02:22.120526+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:51.191335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325022+0000","last_change":"2024-05-09T00:01:45.055008+0000","last_active":"2024-05-09T00:01:46.325022+0000","last_peered":"2024-05-09T00:01:46.325022+0000","last_clean":"2024-05-09T00:01:46.325022+0000","last_became_active":"2024-05-09T00:01:45.054626+0000","last_became_peered":"2024-05-09T00:01:45.054626+0000","last_unstale":"2024-05-09T00:01:46.325022+0000","last_undegraded":"2024-05-09T00:01:46.325022+0000","last_fullsized":"2024-05-09T00:01:46.325022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:59:30.718554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":28,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.058339+0000","last_change":"2024-05-09T00:01:44.622089+0000","last_active":"2024-05-09T00:01:49.058339+0000","last_peered":"2024-05-09T00:01:49.058339+0000","last_clean":"2024-05-09T00:01:49.058339+0000","last_became_active":"2024-05-09T00:01:44.621731+0000","last_became_peered":"2024-05-09T00:01:44.621731+0000","last_unstale":"2024-05-09T00:01:49.058339+0000","last_undegraded":"2024-05-09T00:01:49.058339+0000","last_fullsized":"2024-05-09T00:01:49.058339+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.276454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029490+0000","last_change":"2024-05-09T00:01:45.058785+0000","last_active":"2024-05-09T00:01:46.029490+0000","last_peered":"2024-05-09T00:01:46.029490+0000","last_clean":"2024-05-09T00:01:46.029490+0000","last_became_active":"2024-05-09T00:01:45.058387+0000","last_became_peered":"2024-05-09T00:01:45.058387+0000","last_unstale":"2024-05-09T00:01:46.029490+0000","last_undegraded":"2024-05-09T00:01:46.029490+0000","last_fullsized":"2024-05-09T00:01:46.029490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:18.868021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:50.062947+0000","last_change":"2024-05-09T00:01:44.615760+0000","last_active":"2024-05-09T00:01:50.062947+0000","last_peered":"2024-05-09T00:01:50.062947+0000","last_clean":"2024-05-09T00:01:50.062947+0000","last_became_active":"2024-05-09T00:01:44.615409+0000","last_became_peered":"2024-05-09T00:01:44.615409+0000","last_unstale":"2024-05-09T00:01:50.062947+0000","last_undegraded":"2024-05-09T00:01:50.062947+0000","last_fullsized":"2024-05-09T00:01:50.062947+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:29:27.672835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850354+0000","last_change":"2024-05-09T00:01:45.044092+0000","last_active":"2024-05-09T00:01:46.850354+0000","last_peered":"2024-05-09T00:01:46.850354+0000","last_clean":"2024-05-09T00:01:46.850354+0000","last_became_active":"2024-05-09T00:01:45.043721+0000","last_became_peered":"2024-05-09T00:01:45.043721+0000","last_unstale":"2024-05-09T00:01:46.850354+0000","last_undegraded":"2024-05-09T00:01:46.850354+0000","last_fullsized":"2024-05-09T00:01:46.850354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:31:50.854168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088299+0000","last_change":"2024-05-09T00:01:44.618910+0000","last_active":"2024-05-09T00:01:47.088299+0000","last_peered":"2024-05-09T00:01:47.088299+0000","last_clean":"2024-05-09T00:01:47.088299+0000","last_became_active":"2024-05-09T00:01:44.618569+0000","last_became_peered":"2024-05-09T00:01:44.618569+0000","last_unstale":"2024-05-09T00:01:47.088299+0000","last_undegraded":"2024-05-09T00:01:47.088299+0000","last_fullsized":"2024-05-09T00:01:47.088299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:40.748747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.265172+0000","last_change":"2024-05-09T00:01:45.047305+0000","last_active":"2024-05-09T00:01:49.265172+0000","last_peered":"2024-05-09T00:01:49.265172+0000","last_clean":"2024-05-09T00:01:49.265172+0000","last_became_active":"2024-05-09T00:01:45.046944+0000","last_became_peered":"2024-05-09T00:01:45.046944+0000","last_unstale":"2024-05-09T00:01:49.265172+0000","last_undegraded":"2024-05-09T00:01:49.265172+0000","last_fullsized":"2024-05-09T00:01:49.265172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:24:59.065224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088914+0000","last_change":"2024-05-09T00:01:44.620497+0000","last_active":"2024-05-09T00:01:47.088914+0000","last_peered":"2024-05-09T00:01:47.088914+0000","last_clean":"2024-05-09T00:01:47.088914+0000","last_became_active":"2024-05-09T00:01:44.620165+0000","last_became_peered":"2024-05-09T00:01:44.620165+0000","last_unstale":"2024-05-09T00:01:47.088914+0000","last_undegraded":"2024-05-09T00:01:47.088914+0000","last_fullsized":"2024-05-09T00:01:47.088914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:44.514434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089762+0000","last_change":"2024-05-09T00:01:45.045408+0000","last_active":"2024-05-09T00:01:47.089762+0000","last_peered":"2024-05-09T00:01:47.089762+0000","last_clean":"2024-05-09T00:01:47.089762+0000","last_became_active":"2024-05-09T00:01:45.045086+0000","last_became_peered":"2024-05-09T00:01:45.045086+0000","last_unstale":"2024-05-09T00:01:47.089762+0000","last_undegraded":"2024-05-09T00:01:47.089762+0000","last_fullsized":"2024-05-09T00:01:47.089762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:54.568889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029362+0000","last_change":"2024-05-09T00:01:45.057315+0000","last_active":"2024-05-09T00:01:46.029362+0000","last_peered":"2024-05-09T00:01:46.029362+0000","last_clean":"2024-05-09T00:01:46.029362+0000","last_became_active":"2024-05-09T00:01:45.056962+0000","last_became_peered":"2024-05-09T00:01:45.056962+0000","last_unstale":"2024-05-09T00:01:46.029362+0000","last_undegraded":"2024-05-09T00:01:46.029362+0000","last_fullsized":"2024-05-09T00:01:46.029362+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:09:52.136588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"79'4","reported_seq":51,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:02:23.121513+0000","last_change":"2024-05-09T00:01:44.618477+0000","last_active":"2024-05-09T00:02:23.121513+0000","last_peered":"2024-05-09T00:02:23.121513+0000","last_clean":"2024-05-09T00:02:23.121513+0000","last_became_active":"2024-05-09T00:01:44.618154+0000","last_became_peered":"2024-05-09T00:01:44.618154+0000","last_unstale":"2024-05-09T00:02:23.121513+0000","last_undegraded":"2024-05-09T00:02:23.121513+0000","last_fullsized":"2024-05-09T00:02:23.121513+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:24.380644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187242+0000","last_change":"2024-05-09T00:01:45.053772+0000","last_active":"2024-05-09T00:01:45.187242+0000","last_peered":"2024-05-09T00:01:45.187242+0000","last_clean":"2024-05-09T00:01:45.187242+0000","last_became_active":"2024-05-09T00:01:45.053453+0000","last_became_peered":"2024-05-09T00:01:45.053453+0000","last_unstale":"2024-05-09T00:01:45.187242+0000","last_undegraded":"2024-05-09T00:01:45.187242+0000","last_fullsized":"2024-05-09T00:01:45.187242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:46.136845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:50.061805+0000","last_change":"2024-05-09T00:01:44.610200+0000","last_active":"2024-05-09T00:01:50.061805+0000","last_peered":"2024-05-09T00:01:50.061805+0000","last_clean":"2024-05-09T00:01:50.061805+0000","last_became_active":"2024-05-09T00:01:44.609764+0000","last_became_peered":"2024-05-09T00:01:44.609764+0000","last_unstale":"2024-05-09T00:01:50.061805+0000","last_undegraded":"2024-05-09T00:01:50.061805+0000","last_fullsized":"2024-05-09T00:01:50.061805+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:36.122765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":331,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.089163+0000","last_change":"2024-05-09T00:00:57.898648+0000","last_active":"2024-05-09T00:01:47.089163+0000","last_peered":"2024-05-09T00:01:47.089163+0000","last_clean":"2024-05-09T00:01:47.089163+0000","last_became_active":"2024-05-09T00:00:57.898259+0000","last_became_peered":"2024-05-09T00:00:57.898259+0000","last_unstale":"2024-05-09T00:01:47.089163+0000","last_undegraded":"2024-05-09T00:01:47.089163+0000","last_fullsized":"2024-05-09T00:01:47.089163+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:58:35.200738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:58:35.200738+0000","last_clean_scrub_stamp":"2024-05-08T23:58:35.200738+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:47.782068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028515+0000","last_change":"2024-05-09T00:01:45.035407+0000","last_active":"2024-05-09T00:01:46.028515+0000","last_peered":"2024-05-09T00:01:46.028515+0000","last_clean":"2024-05-09T00:01:46.028515+0000","last_became_active":"2024-05-09T00:01:45.035115+0000","last_became_peered":"2024-05-09T00:01:45.035115+0000","last_unstale":"2024-05-09T00:01:46.028515+0000","last_undegraded":"2024-05-09T00:01:46.028515+0000","last_fullsized":"2024-05-09T00:01:46.028515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:23.603196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.056535+0000","last_change":"2024-05-09T00:01:44.622514+0000","last_active":"2024-05-09T00:01:49.056535+0000","last_peered":"2024-05-09T00:01:49.056535+0000","last_clean":"2024-05-09T00:01:49.056535+0000","last_became_active":"2024-05-09T00:01:44.621454+0000","last_became_peered":"2024-05-09T00:01:44.621454+0000","last_unstale":"2024-05-09T00:01:49.056535+0000","last_undegraded":"2024-05-09T00:01:49.056535+0000","last_fullsized":"2024-05-09T00:01:49.056535+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:10.801721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048321+0000","last_change":"2024-05-09T00:01:44.622743+0000","last_active":"2024-05-09T00:01:48.048321+0000","last_peered":"2024-05-09T00:01:48.048321+0000","last_clean":"2024-05-09T00:01:48.048321+0000","last_became_active":"2024-05-09T00:01:44.622304+0000","last_became_peered":"2024-05-09T00:01:44.622304+0000","last_unstale":"2024-05-09T00:01:48.048321+0000","last_undegraded":"2024-05-09T00:01:48.048321+0000","last_fullsized":"2024-05-09T00:01:48.048321+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:01.829369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028716+0000","last_change":"2024-05-09T00:01:45.035458+0000","last_active":"2024-05-09T00:01:46.028716+0000","last_peered":"2024-05-09T00:01:46.028716+0000","last_clean":"2024-05-09T00:01:46.028716+0000","last_became_active":"2024-05-09T00:01:45.035140+0000","last_became_peered":"2024-05-09T00:01:45.035140+0000","last_unstale":"2024-05-09T00:01:46.028716+0000","last_undegraded":"2024-05-09T00:01:46.028716+0000","last_fullsized":"2024-05-09T00:01:46.028716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:02:31.258013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"79'5","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:54.469548+0000","last_change":"2024-05-09T00:01:44.615172+0000","last_active":"2024-05-09T00:01:54.469548+0000","last_peered":"2024-05-09T00:01:54.469548+0000","last_clean":"2024-05-09T00:01:54.469548+0000","last_became_active":"2024-05-09T00:01:44.614892+0000","last_became_peered":"2024-05-09T00:01:44.614892+0000","last_unstale":"2024-05-09T00:01:54.469548+0000","last_undegraded":"2024-05-09T00:01:54.469548+0000","last_fullsized":"2024-05-09T00:01:54.469548+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:17.868378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187302+0000","last_change":"2024-05-09T00:01:45.044708+0000","last_active":"2024-05-09T00:01:45.187302+0000","last_peered":"2024-05-09T00:01:45.187302+0000","last_clean":"2024-05-09T00:01:45.187302+0000","last_became_active":"2024-05-09T00:01:45.044451+0000","last_became_peered":"2024-05-09T00:01:45.044451+0000","last_unstale":"2024-05-09T00:01:45.187302+0000","last_undegraded":"2024-05-09T00:01:45.187302+0000","last_fullsized":"2024-05-09T00:01:45.187302+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:16.099211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048907+0000","last_change":"2024-05-09T00:01:44.617434+0000","last_active":"2024-05-09T00:01:48.048907+0000","last_peered":"2024-05-09T00:01:48.048907+0000","last_clean":"2024-05-09T00:01:48.048907+0000","last_became_active":"2024-05-09T00:01:44.617017+0000","last_became_peered":"2024-05-09T00:01:44.617017+0000","last_unstale":"2024-05-09T00:01:48.048907+0000","last_undegraded":"2024-05-09T00:01:48.048907+0000","last_fullsized":"2024-05-09T00:01:48.048907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.889962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088825+0000","last_change":"2024-05-09T00:01:45.035749+0000","last_active":"2024-05-09T00:01:47.088825+0000","last_peered":"2024-05-09T00:01:47.088825+0000","last_clean":"2024-05-09T00:01:47.088825+0000","last_became_active":"2024-05-09T00:01:45.034862+0000","last_became_peered":"2024-05-09T00:01:45.034862+0000","last_unstale":"2024-05-09T00:01:47.088825+0000","last_undegraded":"2024-05-09T00:01:47.088825+0000","last_fullsized":"2024-05-09T00:01:47.088825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:20.824467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048783+0000","last_change":"2024-05-09T00:01:44.616652+0000","last_active":"2024-05-09T00:01:48.048783+0000","last_peered":"2024-05-09T00:01:48.048783+0000","last_clean":"2024-05-09T00:01:48.048783+0000","last_became_active":"2024-05-09T00:01:44.616273+0000","last_became_peered":"2024-05-09T00:01:44.616273+0000","last_unstale":"2024-05-09T00:01:48.048783+0000","last_undegraded":"2024-05-09T00:01:48.048783+0000","last_fullsized":"2024-05-09T00:01:48.048783+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:12.379909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.327536+0000","last_change":"2024-05-09T00:01:45.047020+0000","last_active":"2024-05-09T00:01:45.327536+0000","last_peered":"2024-05-09T00:01:45.327536+0000","last_clean":"2024-05-09T00:01:45.327536+0000","last_became_active":"2024-05-09T00:01:45.046813+0000","last_became_peered":"2024-05-09T00:01:45.046813+0000","last_unstale":"2024-05-09T00:01:45.327536+0000","last_undegraded":"2024-05-09T00:01:45.327536+0000","last_fullsized":"2024-05-09T00:01:45.327536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:53.042258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":15,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.048301+0000","last_change":"2024-05-09T00:01:44.610843+0000","last_active":"2024-05-09T00:01:48.048301+0000","last_peered":"2024-05-09T00:01:48.048301+0000","last_clean":"2024-05-09T00:01:48.048301+0000","last_became_active":"2024-05-09T00:01:44.610523+0000","last_became_peered":"2024-05-09T00:01:44.610523+0000","last_unstale":"2024-05-09T00:01:48.048301+0000","last_undegraded":"2024-05-09T00:01:48.048301+0000","last_fullsized":"2024-05-09T00:01:48.048301+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:58.527344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850071+0000","last_change":"2024-05-09T00:01:45.046259+0000","last_active":"2024-05-09T00:01:46.850071+0000","last_peered":"2024-05-09T00:01:46.850071+0000","last_clean":"2024-05-09T00:01:46.850071+0000","last_became_active":"2024-05-09T00:01:45.045954+0000","last_became_peered":"2024-05-09T00:01:45.045954+0000","last_unstale":"2024-05-09T00:01:46.850071+0000","last_undegraded":"2024-05-09T00:01:46.850071+0000","last_fullsized":"2024-05-09T00:01:46.850071+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:46.569934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039671+0000","last_change":"2024-05-09T00:01:44.616781+0000","last_active":"2024-05-09T00:01:47.039671+0000","last_peered":"2024-05-09T00:01:47.039671+0000","last_clean":"2024-05-09T00:01:47.039671+0000","last_became_active":"2024-05-09T00:01:44.616386+0000","last_became_peered":"2024-05-09T00:01:44.616386+0000","last_unstale":"2024-05-09T00:01:47.039671+0000","last_undegraded":"2024-05-09T00:01:47.039671+0000","last_fullsized":"2024-05-09T00:01:47.039671+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:17.073596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187252+0000","last_change":"2024-05-09T00:01:45.046701+0000","last_active":"2024-05-09T00:01:45.187252+0000","last_peered":"2024-05-09T00:01:45.187252+0000","last_clean":"2024-05-09T00:01:45.187252+0000","last_became_active":"2024-05-09T00:01:45.046409+0000","last_became_peered":"2024-05-09T00:01:45.046409+0000","last_unstale":"2024-05-09T00:01:45.187252+0000","last_undegraded":"2024-05-09T00:01:45.187252+0000","last_fullsized":"2024-05-09T00:01:45.187252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:32.178410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":17,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:48.049130+0000","last_change":"2024-05-09T00:01:44.623271+0000","last_active":"2024-05-09T00:01:48.049130+0000","last_peered":"2024-05-09T00:01:48.049130+0000","last_clean":"2024-05-09T00:01:48.049130+0000","last_became_active":"2024-05-09T00:01:44.622863+0000","last_became_peered":"2024-05-09T00:01:44.622863+0000","last_unstale":"2024-05-09T00:01:48.049130+0000","last_undegraded":"2024-05-09T00:01:48.049130+0000","last_fullsized":"2024-05-09T00:01:48.049130+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:58.609140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325100+0000","last_change":"2024-05-09T00:01:45.052296+0000","last_active":"2024-05-09T00:01:46.325100+0000","last_peered":"2024-05-09T00:01:46.325100+0000","last_clean":"2024-05-09T00:01:46.325100+0000","last_became_active":"2024-05-09T00:01:45.051951+0000","last_became_peered":"2024-05-09T00:01:45.051951+0000","last_unstale":"2024-05-09T00:01:46.325100+0000","last_undegraded":"2024-05-09T00:01:46.325100+0000","last_fullsized":"2024-05-09T00:01:46.325100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:46.908629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":16,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:49.058312+0000","last_change":"2024-05-09T00:01:44.620387+0000","last_active":"2024-05-09T00:01:49.058312+0000","last_peered":"2024-05-09T00:01:49.058312+0000","last_clean":"2024-05-09T00:01:49.058312+0000","last_became_active":"2024-05-09T00:01:44.620024+0000","last_became_peered":"2024-05-09T00:01:44.620024+0000","last_unstale":"2024-05-09T00:01:49.058312+0000","last_undegraded":"2024-05-09T00:01:49.058312+0000","last_fullsized":"2024-05-09T00:01:49.058312+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:31.599273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325195+0000","last_change":"2024-05-09T00:01:45.050092+0000","last_active":"2024-05-09T00:01:46.325195+0000","last_peered":"2024-05-09T00:01:46.325195+0000","last_clean":"2024-05-09T00:01:46.325195+0000","last_became_active":"2024-05-09T00:01:45.049794+0000","last_became_peered":"2024-05-09T00:01:45.049794+0000","last_unstale":"2024-05-09T00:01:46.325195+0000","last_undegraded":"2024-05-09T00:01:46.325195+0000","last_fullsized":"2024-05-09T00:01:46.325195+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:56.932513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"78'1","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.525700+0000","last_change":"2024-05-09T00:01:44.609940+0000","last_active":"2024-05-09T00:01:46.525700+0000","last_peered":"2024-05-09T00:01:46.525700+0000","last_clean":"2024-05-09T00:01:46.525700+0000","last_became_active":"2024-05-09T00:01:44.609593+0000","last_became_peered":"2024-05-09T00:01:44.609593+0000","last_unstale":"2024-05-09T00:01:46.525700+0000","last_undegraded":"2024-05-09T00:01:46.525700+0000","last_fullsized":"2024-05-09T00:01:46.525700+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:09.671548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"79'1","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088922+0000","last_change":"2024-05-09T00:01:45.042533+0000","last_active":"2024-05-09T00:01:47.088922+0000","last_peered":"2024-05-09T00:01:47.088922+0000","last_clean":"2024-05-09T00:01:47.088922+0000","last_became_active":"2024-05-09T00:01:45.042155+0000","last_became_peered":"2024-05-09T00:01:45.042155+0000","last_unstale":"2024-05-09T00:01:47.088922+0000","last_undegraded":"2024-05-09T00:01:47.088922+0000","last_fullsized":"2024-05-09T00:01:47.088922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:36.519165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.051979+0000","last_change":"2024-05-09T00:01:44.617518+0000","last_active":"2024-05-09T00:01:45.051979+0000","last_peered":"2024-05-09T00:01:45.051979+0000","last_clean":"2024-05-09T00:01:45.051979+0000","last_became_active":"2024-05-09T00:01:44.617196+0000","last_became_peered":"2024-05-09T00:01:44.617196+0000","last_unstale":"2024-05-09T00:01:45.051979+0000","last_undegraded":"2024-05-09T00:01:45.051979+0000","last_fullsized":"2024-05-09T00:01:45.051979+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:47.062855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.325220+0000","last_change":"2024-05-09T00:01:45.053962+0000","last_active":"2024-05-09T00:01:46.325220+0000","last_peered":"2024-05-09T00:01:46.325220+0000","last_clean":"2024-05-09T00:01:46.325220+0000","last_became_active":"2024-05-09T00:01:45.053637+0000","last_became_peered":"2024-05-09T00:01:45.053637+0000","last_unstale":"2024-05-09T00:01:46.325220+0000","last_undegraded":"2024-05-09T00:01:46.325220+0000","last_fullsized":"2024-05-09T00:01:46.325220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:18.188806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850155+0000","last_change":"2024-05-09T00:01:45.055532+0000","last_active":"2024-05-09T00:01:46.850155+0000","last_peered":"2024-05-09T00:01:46.850155+0000","last_clean":"2024-05-09T00:01:46.850155+0000","last_became_active":"2024-05-09T00:01:45.054939+0000","last_became_peered":"2024-05-09T00:01:45.054939+0000","last_unstale":"2024-05-09T00:01:46.850155+0000","last_undegraded":"2024-05-09T00:01:46.850155+0000","last_fullsized":"2024-05-09T00:01:46.850155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.919492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039891+0000","last_change":"2024-05-09T00:01:45.053752+0000","last_active":"2024-05-09T00:01:47.039891+0000","last_peered":"2024-05-09T00:01:47.039891+0000","last_clean":"2024-05-09T00:01:47.039891+0000","last_became_active":"2024-05-09T00:01:45.053409+0000","last_became_peered":"2024-05-09T00:01:45.053409+0000","last_unstale":"2024-05-09T00:01:47.039891+0000","last_undegraded":"2024-05-09T00:01:47.039891+0000","last_fullsized":"2024-05-09T00:01:47.039891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:12.517211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.039813+0000","last_change":"2024-05-09T00:01:45.036145+0000","last_active":"2024-05-09T00:01:47.039813+0000","last_peered":"2024-05-09T00:01:47.039813+0000","last_clean":"2024-05-09T00:01:47.039813+0000","last_became_active":"2024-05-09T00:01:45.035839+0000","last_became_peered":"2024-05-09T00:01:45.035839+0000","last_unstale":"2024-05-09T00:01:47.039813+0000","last_undegraded":"2024-05-09T00:01:47.039813+0000","last_fullsized":"2024-05-09T00:01:47.039813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:03:17.630399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.088680+0000","last_change":"2024-05-09T00:01:45.032875+0000","last_active":"2024-05-09T00:01:47.088680+0000","last_peered":"2024-05-09T00:01:47.088680+0000","last_clean":"2024-05-09T00:01:47.088680+0000","last_became_active":"2024-05-09T00:01:45.032552+0000","last_became_peered":"2024-05-09T00:01:45.032552+0000","last_unstale":"2024-05-09T00:01:47.088680+0000","last_undegraded":"2024-05-09T00:01:47.088680+0000","last_fullsized":"2024-05-09T00:01:47.088680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:17.244204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028730+0000","last_change":"2024-05-09T00:01:45.032427+0000","last_active":"2024-05-09T00:01:46.028730+0000","last_peered":"2024-05-09T00:01:46.028730+0000","last_clean":"2024-05-09T00:01:46.028730+0000","last_became_active":"2024-05-09T00:01:45.032038+0000","last_became_peered":"2024-05-09T00:01:45.032038+0000","last_unstale":"2024-05-09T00:01:46.028730+0000","last_undegraded":"2024-05-09T00:01:46.028730+0000","last_fullsized":"2024-05-09T00:01:46.028730+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.495291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850245+0000","last_change":"2024-05-09T00:01:45.053080+0000","last_active":"2024-05-09T00:01:46.850245+0000","last_peered":"2024-05-09T00:01:46.850245+0000","last_clean":"2024-05-09T00:01:46.850245+0000","last_became_active":"2024-05-09T00:01:45.052728+0000","last_became_peered":"2024-05-09T00:01:45.052728+0000","last_unstale":"2024-05-09T00:01:46.850245+0000","last_undegraded":"2024-05-09T00:01:46.850245+0000","last_fullsized":"2024-05-09T00:01:46.850245+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:59.631827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:47.040022+0000","last_change":"2024-05-09T00:01:45.044489+0000","last_active":"2024-05-09T00:01:47.040022+0000","last_peered":"2024-05-09T00:01:47.040022+0000","last_clean":"2024-05-09T00:01:47.040022+0000","last_became_active":"2024-05-09T00:01:45.044139+0000","last_became_peered":"2024-05-09T00:01:45.044139+0000","last_unstale":"2024-05-09T00:01:47.040022+0000","last_undegraded":"2024-05-09T00:01:47.040022+0000","last_fullsized":"2024-05-09T00:01:47.040022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:57.932238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187290+0000","last_change":"2024-05-09T00:01:45.050829+0000","last_active":"2024-05-09T00:01:45.187290+0000","last_peered":"2024-05-09T00:01:45.187290+0000","last_clean":"2024-05-09T00:01:45.187290+0000","last_became_active":"2024-05-09T00:01:45.050410+0000","last_became_peered":"2024-05-09T00:01:45.050410+0000","last_unstale":"2024-05-09T00:01:45.187290+0000","last_undegraded":"2024-05-09T00:01:45.187290+0000","last_fullsized":"2024-05-09T00:01:45.187290+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:08.738918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029150+0000","last_change":"2024-05-09T00:01:45.053957+0000","last_active":"2024-05-09T00:01:46.029150+0000","last_peered":"2024-05-09T00:01:46.029150+0000","last_clean":"2024-05-09T00:01:46.029150+0000","last_became_active":"2024-05-09T00:01:45.053487+0000","last_became_peered":"2024-05-09T00:01:45.053487+0000","last_unstale":"2024-05-09T00:01:46.029150+0000","last_undegraded":"2024-05-09T00:01:46.029150+0000","last_fullsized":"2024-05-09T00:01:46.029150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:35.131361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-05-09T00:01:45.187232+0000","last_change":"2024-05-09T00:01:45.050653+0000","last_active":"2024-05-09T00:01:45.187232+0000","last_peered":"2024-05-09T00:01:45.187232+0000","last_clean":"2024-05-09T00:01:45.187232+0000","last_became_active":"2024-05-09T00:01:45.050322+0000","last_became_peered":"2024-05-09T00:01:45.050322+0000","last_unstale":"2024-05-09T00:01:45.187232+0000","last_undegraded":"2024-05-09T00:01:45.187232+0000","last_fullsized":"2024-05-09T00:01:45.187232+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:11:45.137945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.029679+0000","last_change":"2024-05-09T00:01:45.044757+0000","last_active":"2024-05-09T00:01:46.029679+0000","last_peered":"2024-05-09T00:01:46.029679+0000","last_clean":"2024-05-09T00:01:46.029679+0000","last_became_active":"2024-05-09T00:01:45.044464+0000","last_became_peered":"2024-05-09T00:01:45.044464+0000","last_unstale":"2024-05-09T00:01:46.029679+0000","last_undegraded":"2024-05-09T00:01:46.029679+0000","last_fullsized":"2024-05-09T00:01:46.029679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:44.402750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.028903+0000","last_change":"2024-05-09T00:01:45.044515+0000","last_active":"2024-05-09T00:01:46.028903+0000","last_peered":"2024-05-09T00:01:46.028903+0000","last_clean":"2024-05-09T00:01:46.028903+0000","last_became_active":"2024-05-09T00:01:45.044209+0000","last_became_peered":"2024-05-09T00:01:45.044209+0000","last_unstale":"2024-05-09T00:01:46.028903+0000","last_undegraded":"2024-05-09T00:01:46.028903+0000","last_fullsized":"2024-05-09T00:01:46.028903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:18.523680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-09T00:01:46.850098+0000","last_change":"2024-05-09T00:01:45.044254+0000","last_active":"2024-05-09T00:01:46.850098+0000","last_peered":"2024-05-09T00:01:46.850098+0000","last_clean":"2024-05-09T00:01:46.850098+0000","last_became_active":"2024-05-09T00:01:45.043220+0000","last_became_peered":"2024-05-09T00:01:45.043220+0000","last_unstale":"2024-05-09T00:01:46.850098+0000","last_undegraded":"2024-05-09T00:01:46.850098+0000","last_fullsized":"2024-05-09T00:01:46.850098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:39:53.986814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246178,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62627,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":233,"num_read_kb":184,"num_write":150,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":187881,"data_compressed":5574,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579922,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":851968,"data_stored":410369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.45300000000000001}]},{"osd":1,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.73599999999999999}]},{"osd":5,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.71999999999999997}]},{"osd":6,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.628}]},{"osd":7,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.80300000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":9,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.75},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.86499999999999999}]},{"osd":10,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.78900000000000003}]}]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":999424,"data_stored":1060522,"data_compressed":37494,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":1,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.64500000000000002}]},{"osd":2,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":8,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.61799999999999999}]},{"osd":9,"last update":"Thu May 9 00:01:54 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.681,"5min":1.681,"15min":1.681},"last":0.68200000000000005}]},{"osd":11,"last update":"Thu May 9 00:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.83999999999999997}]}]},{"osd":9,"up_from":62,"seq":266287972377,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31960,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713192,"statfs":{"total":95995035648,"available":95962308608,"internally_reserved":0,"allocated":868352,"data_stored":410605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36699999999999999}]},{"osd":4,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.501}]},{"osd":6,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.44},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.745},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.55900000000000005}]},{"osd":8,"last update":"Thu May 9 00:01:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.54600000000000004}]},{"osd":10,"last update":"Thu May 9 00:01:57 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.70699999999999996}]}]},{"osd":8,"up_from":55,"seq":236223201308,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":864256,"data_stored":410194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.60399999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73599999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.307}]},{"osd":1,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.42299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83699999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.48499999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.48999999999999999}]},{"osd":2,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48099999999999998,"15min":0.48299999999999998},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64600000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64500000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.34499999999999997}]},{"osd":3,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71499999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.44,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85299999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.502},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.54400000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.62,"15min":0.629},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.47999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.77300000000000002,"5min":0.996,"15min":0.996},"last":0.46500000000000002}]},{"osd":6,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.79700000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.503,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86599999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.754},"min":{"1min":0.56599999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.82399999999999995,"5min":1.004,"15min":1.004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.66300000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93400000000000005,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.56899999999999995}]},{"osd":9,"last update":"Thu May 9 00:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.71299999999999997}]},{"osd":10,"last update":"Thu May 9 00:01:59 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.625},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.77500000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]}]},{"osd":7,"up_from":48,"seq":206158430239,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":917504,"data_stored":1002361,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.376},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.443}]},{"osd":1,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.39500000000000002,"15min":0.38300000000000001},"min":{"1min":0.28699999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.31900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.498}]},{"osd":2,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80600000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.84399999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73599999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76000000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.437}]},{"osd":5,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.626,"15min":0.62},"min":{"1min":0.49399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82899999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.502,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84799999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93000000000000005,"5min":1.032,"15min":1.032},"last":0.52900000000000003}]},{"osd":8,"last update":"Thu May 9 00:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68999999999999995}]},{"osd":9,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.51500000000000001}]},{"osd":10,"last update":"Thu May 9 00:01:56 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.624}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":6,"up_from":43,"seq":184683593764,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31948,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713204,"statfs":{"total":95995035648,"available":95962320896,"internally_reserved":0,"allocated":856064,"data_stored":409994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39100000000000001},"min":{"1min":0.27100000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54400000000000004,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.52500000000000002},"min":{"1min":0.40200000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68100000000000005,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.376},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39900000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.438}]},{"osd":3,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.435,"15min":0.435},"min":{"1min":0.28599999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.505,"15min":0.503},"min":{"1min":0.35399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.433,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63,"15min":0.63},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.65200000000000002,"15min":0.65700000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.84099999999999997,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.42199999999999999}]},{"osd":7,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86699999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.497,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.65400000000000003}]},{"osd":8,"last update":"Thu May 9 00:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55200000000000005}]},{"osd":9,"last update":"Thu May 9 00:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.499}]},{"osd":10,"last update":"Thu May 9 00:01:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.51200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32004,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713148,"statfs":{"total":95995035648,"available":95962263552,"internally_reserved":0,"allocated":913408,"data_stored":468507,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.35199999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.35799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51000000000000001,"15min":0.497},"min":{"1min":0.32700000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.29999999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.626}]},{"osd":3,"last update":"Thu May 9 00:01:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.36699999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.52500000000000002,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu May 9 00:02:17 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.434,"15min":0.40999999999999998},"min":{"1min":0.32300000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.42299999999999999},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu May 9 00:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.54900000000000004,"15min":0.54000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu May 9 00:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.58099999999999996,"15min":0.57399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu May 9 00:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54300000000000004}]},{"osd":8,"last update":"Thu May 9 00:01:24 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.72699999999999998}]},{"osd":9,"last update":"Thu May 9 00:01:38 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.80800000000000005}]},{"osd":10,"last update":"Thu May 9 00:01:57 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.78500000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":876544,"data_stored":411265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 9 00:01:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.51200000000000001,"15min":0.48599999999999999},"min":{"1min":0.32000000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.53100000000000003,"15min":0.50800000000000001},"min":{"1min":0.35299999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80300000000000005,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.52300000000000002,"15min":0.504},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81599999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.39500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu May 9 00:00:56 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.40400000000000003,"15min":0.39800000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.42699999999999999,"5min":0.39900000000000002,"15min":0.39400000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.314}]},{"osd":4,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.72399999999999998,"5min":1.075,"15min":1.075},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu May 9 00:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.35999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu May 9 00:01:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48299999999999998,"15min":0.48499999999999999},"min":{"1min":0.317,"5min":0.246,"15min":0.246},"max":{"1min":0.99399999999999999,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.377},{"interface":"front","average":{"1min":0.505,"5min":0.498,"15min":0.497},"min":{"1min":0.30299999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.56100000000000005}]},{"osd":8,"last update":"Thu May 9 00:01:23 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.63}]},{"osd":9,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.439}]},{"osd":10,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.45700000000000002}]},{"osd":11,"last update":"Thu May 9 00:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.68799999999999994}]}]},{"osd":2,"up_from":17,"seq":73014444082,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":469583,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.48299999999999998,"15min":0.46300000000000002},"min":{"1min":0.34499999999999997,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.48899999999999999,"15min":0.47399999999999998},"min":{"1min":0.39600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu May 9 00:01:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.37,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.499,"15min":0.48299999999999998},"min":{"1min":0.34399999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu May 9 00:01:53 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52000000000000002,"15min":0.51400000000000001},"min":{"1min":0.42099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.51100000000000001,"15min":0.50700000000000001},"min":{"1min":0.41999999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.47099999999999997,"15min":0.46000000000000002},"min":{"1min":0.374,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.42099999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu May 9 00:01:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.44500000000000001,"15min":0.433},"min":{"1min":0.31,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.45900000000000002,"15min":0.44900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu May 9 00:01:47 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.59799999999999998},"min":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.39000000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu May 9 00:01:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67100000000000004}]},{"osd":8,"last update":"Thu May 9 00:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.54500000000000004,"15min":0.53000000000000003},"min":{"1min":0.32200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.629}]},{"osd":9,"last update":"Thu May 9 00:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.76700000000000002}]},{"osd":10,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.753}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":3,"up_from":24,"seq":103079215150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31964,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713188,"statfs":{"total":95995035648,"available":95962304512,"internally_reserved":0,"allocated":872448,"data_stored":410305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.33600000000000002,"15min":0.33300000000000002},"min":{"1min":0.26500000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.442,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.248,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48999999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52000000000000002,"15min":0.51400000000000001},"min":{"1min":0.42299999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.69199999999999995,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.41799999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79100000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.44700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75,"5min":1.075,"15min":1.075},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.35499999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.5}]},{"osd":4,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63700000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.40899999999999997}]},{"osd":5,"last update":"Thu May 9 00:01:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56200000000000006},"min":{"1min":0.42399999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.52300000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu May 9 00:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.44500000000000001,"15min":0.439},"min":{"1min":0.32600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.31,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.376}]},{"osd":7,"last update":"Thu May 9 00:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.47099999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69899999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.59299999999999997}]},{"osd":8,"last update":"Thu May 9 00:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.46700000000000003}]},{"osd":9,"last update":"Thu May 9 00:01:40 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.46500000000000002}]},{"osd":10,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.64300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":4,"up_from":31,"seq":133143986219,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31956,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713196,"statfs":{"total":95995035648,"available":95962312704,"internally_reserved":0,"allocated":860160,"data_stored":410383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.39400000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79800000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.371,"15min":0.35299999999999998},"min":{"1min":0.312,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.378,"15min":0.36499999999999999},"min":{"1min":0.28299999999999997,"5min":0.215,"15min":0.215},"max":{"1min":0.64000000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.54500000000000004,"15min":0.51500000000000001},"min":{"1min":0.39900000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.54100000000000004,"15min":0.50700000000000001},"min":{"1min":0.40400000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu May 9 00:01:25 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.57899999999999996,"15min":0.57099999999999995},"min":{"1min":0.441,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.46700000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68400000000000005}]},{"osd":6,"last update":"Thu May 9 00:01:51 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.57799999999999996,"15min":0.56499999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56299999999999994,"15min":0.55600000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.75}]},{"osd":7,"last update":"Thu May 9 00:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.66200000000000003}]},{"osd":8,"last update":"Thu May 9 00:01:20 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.79100000000000004}]},{"osd":9,"last update":"Thu May 9 00:01:37 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.88900000000000001}]},{"osd":10,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.78200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]}]},{"osd":5,"up_from":36,"seq":154618822695,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32020,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713132,"statfs":{"total":95995035648,"available":95962247168,"internally_reserved":0,"allocated":929792,"data_stored":1002093,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.498,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.49399999999999999,"15min":0.49099999999999999},"min":{"1min":0.35999999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.749,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40300000000000002}]},{"osd":1,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52500000000000002,"15min":0.52100000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.35699999999999998,"15min":0.34799999999999998},"min":{"1min":0.29099999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.371,"15min":0.36799999999999999},"min":{"1min":0.27000000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.50800000000000001,"15min":0.5},"min":{"1min":0.35899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.72299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.498}]},{"osd":4,"last update":"Thu May 9 00:01:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.53300000000000003,"15min":0.52600000000000002},"min":{"1min":0.39400000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73599999999999999,"5min":0.754,"15min":0.754},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu May 9 00:01:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.90000000000000002,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57699999999999996,"15min":0.57999999999999996},"min":{"1min":0.41999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.625}]},{"osd":7,"last update":"Thu May 9 00:02:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.59599999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68899999999999995}]},{"osd":8,"last update":"Thu May 9 00:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.39800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83499999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.57199999999999995}]},{"osd":9,"last update":"Thu May 9 00:01:39 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.72399999999999998}]},{"osd":10,"last update":"Thu May 9 00:01:55 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.79400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33999,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33999,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":58720,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60415,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60250,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:02:26.820 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-09T00:02:26.820 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-09T00:02:26.820 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-09T00:02:26.821 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-09T00:02:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:27.476 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:27 smithi081 ceph-mon[42474]: pgmap v239: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T00:02:27.477 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:27 smithi081 ceph-mon[42474]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:02:27.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:27 smithi150 ceph-mon[46187]: pgmap v239: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T00:02:27.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:27 smithi150 ceph-mon[46187]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:02:27.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:27 smithi171 ceph-mon[47351]: pgmap v239: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T00:02:27.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:27 smithi171 ceph-mon[47351]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:02:27.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.932+0000 7fece261d700 1 -- 172.21.15.81:0/1649949640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc0ffed0 msgr2=0x7fecdc100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:27.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.932+0000 7fece261d700 1 --2- 172.21.15.81:0/1649949640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc0ffed0 0x7fecdc100350 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009990 tx=0x7fecd0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:27.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.932+0000 7fece261d700 1 -- 172.21.15.81:0/1649949640 shutdown_connections 2024-05-09T00:02:27.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.932+0000 7fece261d700 1 --2- 172.21.15.81:0/1649949640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc105f00 0x7fecdc1062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:27.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.932+0000 7fece261d700 1 --2- 172.21.15.81:0/1649949640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecdc100890 0x7fecdc10cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:27.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.932+0000 7fece261d700 1 --2- 172.21.15.81:0/1649949640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc0ffed0 0x7fecdc100350 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:27.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.932+0000 7fece261d700 1 -- 172.21.15.81:0/1649949640 >> 172.21.15.81:0/1649949640 conn(0x7fecdc075f80 msgr2=0x7fecdc076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:27.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.932+0000 7fece261d700 1 -- 172.21.15.81:0/1649949640 shutdown_connections 2024-05-09T00:02:27.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.932+0000 7fece261d700 1 -- 172.21.15.81:0/1649949640 wait complete. 2024-05-09T00:02:27.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.932+0000 7fece261d700 1 Processor -- start 2024-05-09T00:02:27.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.932+0000 7fece261d700 1 -- start start 2024-05-09T00:02:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fece261d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecdc0ffed0 0x7fecdc1981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fece261d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc100890 0x7fecdc1986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fece261d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc105f00 0x7fecdc1a3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fece261d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc198f40 con 0x7fecdc100890 2024-05-09T00:02:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fece261d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc1a3770 con 0x7fecdc105f00 2024-05-09T00:02:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fece261d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc1a38b0 con 0x7fecdc0ffed0 2024-05-09T00:02:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fecdb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc100890 0x7fecdc1986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fecdb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc100890 0x7fecdc1986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35656/0 (socket says 172.21.15.81:35656) 2024-05-09T00:02:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fecdb7fe700 1 -- 172.21.15.81:0/3874376517 learned_addr learned my addr 172.21.15.81:0/3874376517 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fece0bba700 1 --2- 172.21.15.81:0/3874376517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc105f00 0x7fecdc1a3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fecdb7fe700 1 -- 172.21.15.81:0/3874376517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecdc0ffed0 msgr2=0x7fecdc1981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fecdb7fe700 1 --2- 172.21.15.81:0/3874376517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecdc0ffed0 0x7fecdc1981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fecdb7fe700 1 -- 172.21.15.81:0/3874376517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc105f00 msgr2=0x7fecdc1a3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:27.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fecdb7fe700 1 --2- 172.21.15.81:0/3874376517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc105f00 0x7fecdc1a3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:27.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fecdb7fe700 1 -- 172.21.15.81:0/3874376517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd00095f0 con 0x7fecdc100890 2024-05-09T00:02:27.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fecdb7fe700 1 --2- 172.21.15.81:0/3874376517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc100890 0x7fecdc1986f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fecd000f670 tx=0x7fecd000f750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:27.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fecd97fa700 1 -- 172.21.15.81:0/3874376517 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd001d070 con 0x7fecdc100890 2024-05-09T00:02:27.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fecd97fa700 1 -- 172.21.15.81:0/3874376517 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecd0005510 con 0x7fecdc100890 2024-05-09T00:02:27.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fece261d700 1 -- 172.21.15.81:0/3874376517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc1a3ab0 con 0x7fecdc100890 2024-05-09T00:02:27.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fecd97fa700 1 -- 172.21.15.81:0/3874376517 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0004b00 con 0x7fecdc100890 2024-05-09T00:02:27.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.933+0000 7fece261d700 1 -- 172.21.15.81:0/3874376517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc1a3fa0 con 0x7fecdc100890 2024-05-09T00:02:27.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.934+0000 7fece261d700 1 -- 172.21.15.81:0/3874376517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecdc108420 con 0x7fecdc100890 2024-05-09T00:02:27.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.935+0000 7fecd97fa700 1 -- 172.21.15.81:0/3874376517 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fecd0004ce0 con 0x7fecdc100890 2024-05-09T00:02:27.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.936+0000 7fecd97fa700 1 --2- 172.21.15.81:0/3874376517 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fecc40a1230 0x7fecc40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:27.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.936+0000 7fecdbfff700 1 --2- 172.21.15.81:0/3874376517 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fecc40a1230 0x7fecc40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:27.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.936+0000 7fecd97fa700 1 -- 172.21.15.81:0/3874376517 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fecd00cd610 con 0x7fecdc100890 2024-05-09T00:02:27.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.936+0000 7fecdbfff700 1 --2- 172.21.15.81:0/3874376517 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fecc40a1230 0x7fecc40a36f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feccc005fd0 tx=0x7feccc005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:27.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:27.940+0000 7fecd97fa700 1 -- 172.21.15.81:0/3874376517 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fecd0096e80 con 0x7fecdc100890 2024-05-09T00:02:28.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.177+0000 7fece261d700 1 -- 172.21.15.81:0/3874376517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fecdc068ef0 con 0x7fecdc100890 2024-05-09T00:02:28.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.177+0000 7fecd97fa700 1 -- 172.21.15.81:0/3874376517 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fecd009a4a0 con 0x7fecdc100890 2024-05-09T00:02:28.172 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:28.172 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-09T00:02:28.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.179+0000 7fece261d700 1 -- 172.21.15.81:0/3874376517 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fecc40a1230 msgr2=0x7fecc40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:28.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.179+0000 7fece261d700 1 --2- 172.21.15.81:0/3874376517 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fecc40a1230 0x7fecc40a36f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feccc005fd0 tx=0x7feccc005ee0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.179+0000 7fece261d700 1 -- 172.21.15.81:0/3874376517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc100890 msgr2=0x7fecdc1986f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.179+0000 7fece261d700 1 --2- 172.21.15.81:0/3874376517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc100890 0x7fecdc1986f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fecd000f670 tx=0x7fecd000f750 comp rx=0 tx=0).stop 2024-05-09T00:02:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.180+0000 7fece261d700 1 -- 172.21.15.81:0/3874376517 shutdown_connections 2024-05-09T00:02:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.180+0000 7fece261d700 1 --2- 172.21.15.81:0/3874376517 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fecc40a1230 0x7fecc40a36f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.180+0000 7fece261d700 1 --2- 172.21.15.81:0/3874376517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecdc105f00 0x7fecdc1a3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.180+0000 7fece261d700 1 --2- 172.21.15.81:0/3874376517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecdc0ffed0 0x7fecdc1981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.180+0000 7fece261d700 1 --2- 172.21.15.81:0/3874376517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecdc100890 0x7fecdc1986f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.180+0000 7fece261d700 1 -- 172.21.15.81:0/3874376517 >> 172.21.15.81:0/3874376517 conn(0x7fecdc075f80 msgr2=0x7fecdc0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.180+0000 7fece261d700 1 -- 172.21.15.81:0/3874376517 shutdown_connections 2024-05-09T00:02:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.180+0000 7fece261d700 1 -- 172.21.15.81:0/3874376517 wait complete. 2024-05-09T00:02:28.471 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:28 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3874376517' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T00:02:28.547 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-09T00:02:28.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:02:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.680+0000 7fba6beec700 1 -- 172.21.15.81:0/1206206179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba64101970 msgr2=0x7fba64103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.680+0000 7fba6beec700 1 --2- 172.21.15.81:0/1206206179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba64101970 0x7fba64103d60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fba58009990 tx=0x7fba58009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.680+0000 7fba6beec700 1 -- 172.21.15.81:0/1206206179 shutdown_connections 2024-05-09T00:02:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.680+0000 7fba6beec700 1 --2- 172.21.15.81:0/1206206179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba64106bd0 0x7fba64108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.680+0000 7fba6beec700 1 --2- 172.21.15.81:0/1206206179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba64101970 0x7fba64103d60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.680+0000 7fba6beec700 1 --2- 172.21.15.81:0/1206206179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba641042a0 0x7fba64106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.680+0000 7fba6beec700 1 -- 172.21.15.81:0/1206206179 >> 172.21.15.81:0/1206206179 conn(0x7fba640fb300 msgr2=0x7fba640fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.681+0000 7fba6beec700 1 -- 172.21.15.81:0/1206206179 shutdown_connections 2024-05-09T00:02:28.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.681+0000 7fba6beec700 1 -- 172.21.15.81:0/1206206179 wait complete. 2024-05-09T00:02:28.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.681+0000 7fba6beec700 1 Processor -- start 2024-05-09T00:02:28.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.681+0000 7fba6beec700 1 -- start start 2024-05-09T00:02:28.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba6beec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba64101970 0x7fba64196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:28.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba6beec700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba641042a0 0x7fba64197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:28.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba6beec700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba64106bd0 0x7fba6419e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:28.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba6beec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6419e890 con 0x7fba64101970 2024-05-09T00:02:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba6beec700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6419ea00 con 0x7fba641042a0 2024-05-09T00:02:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba6beec700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba6419ebc0 con 0x7fba64106bd0 2024-05-09T00:02:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba69c88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba64101970 0x7fba64196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba69c88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba64101970 0x7fba64196df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35676/0 (socket says 172.21.15.81:35676) 2024-05-09T00:02:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba69c88700 1 -- 172.21.15.81:0/294241286 learned_addr learned my addr 172.21.15.81:0/294241286 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba6a489700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba64106bd0 0x7fba6419e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba69487700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba641042a0 0x7fba64197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba69c88700 1 -- 172.21.15.81:0/294241286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba64106bd0 msgr2=0x7fba6419e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba69c88700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba64106bd0 0x7fba6419e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba69c88700 1 -- 172.21.15.81:0/294241286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba641042a0 msgr2=0x7fba64197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba69c88700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba641042a0 0x7fba64197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba69c88700 1 -- 172.21.15.81:0/294241286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba580095f0 con 0x7fba64101970 2024-05-09T00:02:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba69487700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba641042a0 0x7fba64197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:28.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba69c88700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba64101970 0x7fba64196df0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fba580095c0 tx=0x7fba5800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:28.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba56ffd700 1 -- 172.21.15.81:0/294241286 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5801d070 con 0x7fba64101970 2024-05-09T00:02:28.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba56ffd700 1 -- 172.21.15.81:0/294241286 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba5800fb80 con 0x7fba64101970 2024-05-09T00:02:28.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba6beec700 1 -- 172.21.15.81:0/294241286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6419ee40 con 0x7fba64101970 2024-05-09T00:02:28.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba56ffd700 1 -- 172.21.15.81:0/294241286 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba58017650 con 0x7fba64101970 2024-05-09T00:02:28.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.682+0000 7fba6beec700 1 -- 172.21.15.81:0/294241286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6419f1b0 con 0x7fba64101970 2024-05-09T00:02:28.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.683+0000 7fba6beec700 1 -- 172.21.15.81:0/294241286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba640fce80 con 0x7fba64101970 2024-05-09T00:02:28.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.684+0000 7fba56ffd700 1 -- 172.21.15.81:0/294241286 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fba58022470 con 0x7fba64101970 2024-05-09T00:02:28.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.685+0000 7fba56ffd700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fba500a11b0 0x7fba500a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:28.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.685+0000 7fba69487700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fba500a11b0 0x7fba500a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:28.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.685+0000 7fba56ffd700 1 -- 172.21.15.81:0/294241286 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fba580ce300 con 0x7fba64101970 2024-05-09T00:02:28.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.685+0000 7fba69487700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fba500a11b0 0x7fba500a3670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fba60005fd0 tx=0x7fba60005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:28.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.688+0000 7fba56ffd700 1 -- 172.21.15.81:0/294241286 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fba58097b70 con 0x7fba64101970 2024-05-09T00:02:28.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:28 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3874376517' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T00:02:28.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:28 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3874376517' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-09T00:02:28.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.888+0000 7fba6beec700 1 -- 172.21.15.81:0/294241286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba64067380 con 0x7fba64101970 2024-05-09T00:02:28.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.889+0000 7fba56ffd700 1 -- 172.21.15.81:0/294241286 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22095 (secure 0 0 0) 0x7fba5809b190 con 0x7fba64101970 2024-05-09T00:02:28.884 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:28.884 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":79,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:01:46.020465+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:02:28.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.891+0000 7fba6beec700 1 -- 172.21.15.81:0/294241286 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fba500a11b0 msgr2=0x7fba500a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:28.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.891+0000 7fba6beec700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fba500a11b0 0x7fba500a3670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fba60005fd0 tx=0x7fba60005e20 comp rx=0 tx=0).stop 2024-05-09T00:02:28.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.891+0000 7fba6beec700 1 -- 172.21.15.81:0/294241286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba64101970 msgr2=0x7fba64196df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.891+0000 7fba6beec700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba64101970 0x7fba64196df0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fba580095c0 tx=0x7fba5800f690 comp rx=0 tx=0).stop 2024-05-09T00:02:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.891+0000 7fba6beec700 1 -- 172.21.15.81:0/294241286 shutdown_connections 2024-05-09T00:02:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.891+0000 7fba6beec700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fba500a11b0 0x7fba500a3670 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.891+0000 7fba6beec700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba64106bd0 0x7fba6419e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.891+0000 7fba6beec700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba64101970 0x7fba64196df0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.891+0000 7fba6beec700 1 --2- 172.21.15.81:0/294241286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba641042a0 0x7fba64197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.891+0000 7fba6beec700 1 -- 172.21.15.81:0/294241286 >> 172.21.15.81:0/294241286 conn(0x7fba640fb300 msgr2=0x7fba64102390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.891+0000 7fba6beec700 1 -- 172.21.15.81:0/294241286 shutdown_connections 2024-05-09T00:02:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:28.891+0000 7fba6beec700 1 -- 172.21.15.81:0/294241286 wait complete. 2024-05-09T00:02:28.898 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:58:34.523249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T00:01:43.149260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T00:01:44.182730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:02:28.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:02:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.030+0000 7f1b8e668700 1 -- 172.21.15.81:0/3913143225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b880ff9b0 msgr2=0x7f1b88109560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.030+0000 7f1b8e668700 1 --2- 172.21.15.81:0/3913143225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b880ff9b0 0x7f1b88109560 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1b8000b0a0 tx=0x7f1b8000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.030+0000 7f1b8e668700 1 -- 172.21.15.81:0/3913143225 shutdown_connections 2024-05-09T00:02:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.030+0000 7f1b8e668700 1 --2- 172.21.15.81:0/3913143225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b880ff9b0 0x7f1b88109560 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.030+0000 7f1b8e668700 1 --2- 172.21.15.81:0/3913143225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b88102580 0x7f1b881029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.030+0000 7f1b8e668700 1 --2- 172.21.15.81:0/3913143225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b880feff0 0x7f1b880ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.030+0000 7f1b8e668700 1 -- 172.21.15.81:0/3913143225 >> 172.21.15.81:0/3913143225 conn(0x7f1b880fab70 msgr2=0x7f1b880fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:29.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.030+0000 7f1b8e668700 1 -- 172.21.15.81:0/3913143225 shutdown_connections 2024-05-09T00:02:29.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.030+0000 7f1b8e668700 1 -- 172.21.15.81:0/3913143225 wait complete. 2024-05-09T00:02:29.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.030+0000 7f1b8e668700 1 Processor -- start 2024-05-09T00:02:29.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.030+0000 7f1b8e668700 1 -- start start 2024-05-09T00:02:29.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b8e668700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b880feff0 0x7f1b88196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:29.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b8e668700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b880ff9b0 0x7f1b881974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:29.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b8e668700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b88102580 0x7f1b8819e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:29.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b8e668700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8819eaa0 con 0x7f1b880ff9b0 2024-05-09T00:02:29.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b8e668700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8819ebe0 con 0x7f1b880feff0 2024-05-09T00:02:29.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b8e668700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8819ed70 con 0x7f1b88102580 2024-05-09T00:02:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b880ff9b0 0x7f1b881974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b880ff9b0 0x7f1b881974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35688/0 (socket says 172.21.15.81:35688) 2024-05-09T00:02:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b877fe700 1 -- 172.21.15.81:0/593980716 learned_addr learned my addr 172.21.15.81:0/593980716 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b87fff700 1 --2- 172.21.15.81:0/593980716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b880feff0 0x7f1b88196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b877fe700 1 -- 172.21.15.81:0/593980716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b88102580 msgr2=0x7f1b8819e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b877fe700 1 --2- 172.21.15.81:0/593980716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b88102580 0x7f1b8819e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b877fe700 1 -- 172.21.15.81:0/593980716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b880feff0 msgr2=0x7f1b88196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b877fe700 1 --2- 172.21.15.81:0/593980716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b880feff0 0x7f1b88196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b877fe700 1 -- 172.21.15.81:0/593980716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b80009d00 con 0x7f1b880ff9b0 2024-05-09T00:02:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b877fe700 1 --2- 172.21.15.81:0/593980716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b880ff9b0 0x7f1b881974b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800e970 tx=0x7f1b7800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b857fa700 1 -- 172.21.15.81:0/593980716 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78009790 con 0x7f1b880ff9b0 2024-05-09T00:02:29.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b857fa700 1 -- 172.21.15.81:0/593980716 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b7800eec0 con 0x7f1b880ff9b0 2024-05-09T00:02:29.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b8e668700 1 -- 172.21.15.81:0/593980716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8819eff0 con 0x7f1b880ff9b0 2024-05-09T00:02:29.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b857fa700 1 -- 172.21.15.81:0/593980716 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78003cf0 con 0x7f1b880ff9b0 2024-05-09T00:02:29.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.031+0000 7f1b8e668700 1 -- 172.21.15.81:0/593980716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8819f4d0 con 0x7f1b880ff9b0 2024-05-09T00:02:29.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.032+0000 7f1b8e668700 1 -- 172.21.15.81:0/593980716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b881084d0 con 0x7f1b880ff9b0 2024-05-09T00:02:29.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.033+0000 7f1b857fa700 1 -- 172.21.15.81:0/593980716 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1b7800ccd0 con 0x7f1b880ff9b0 2024-05-09T00:02:29.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.034+0000 7f1b857fa700 1 --2- 172.21.15.81:0/593980716 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1b700a11b0 0x7f1b700a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:29.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.034+0000 7f1b87fff700 1 --2- 172.21.15.81:0/593980716 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1b700a11b0 0x7f1b700a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:29.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.034+0000 7f1b857fa700 1 -- 172.21.15.81:0/593980716 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1b78014070 con 0x7f1b880ff9b0 2024-05-09T00:02:29.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.034+0000 7f1b87fff700 1 --2- 172.21.15.81:0/593980716 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1b700a11b0 0x7f1b700a3670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1b88069230 tx=0x7f1b7c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:29.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.037+0000 7f1b857fa700 1 -- 172.21.15.81:0/593980716 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1b78096490 con 0x7f1b880ff9b0 2024-05-09T00:02:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.235+0000 7f1b8e668700 1 -- 172.21.15.81:0/593980716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b8810ca50 con 0x7f1b880ff9b0 2024-05-09T00:02:29.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.236+0000 7f1b857fa700 1 -- 172.21.15.81:0/593980716 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b78099ab0 con 0x7f1b880ff9b0 2024-05-09T00:02:29.230 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-09T00:02:29.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.238+0000 7f1b8e668700 1 -- 172.21.15.81:0/593980716 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1b700a11b0 msgr2=0x7f1b700a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.238+0000 7f1b8e668700 1 --2- 172.21.15.81:0/593980716 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1b700a11b0 0x7f1b700a3670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1b88069230 tx=0x7f1b7c009260 comp rx=0 tx=0).stop 2024-05-09T00:02:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.238+0000 7f1b8e668700 1 -- 172.21.15.81:0/593980716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b880ff9b0 msgr2=0x7f1b881974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.238+0000 7f1b8e668700 1 --2- 172.21.15.81:0/593980716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b880ff9b0 0x7f1b881974b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800e970 tx=0x7f1b7800ec80 comp rx=0 tx=0).stop 2024-05-09T00:02:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.238+0000 7f1b8e668700 1 -- 172.21.15.81:0/593980716 shutdown_connections 2024-05-09T00:02:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.238+0000 7f1b8e668700 1 --2- 172.21.15.81:0/593980716 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f1b700a11b0 0x7f1b700a3670 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.238+0000 7f1b8e668700 1 --2- 172.21.15.81:0/593980716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1b880feff0 0x7f1b88196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.238+0000 7f1b8e668700 1 --2- 172.21.15.81:0/593980716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b88102580 0x7f1b8819e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.238+0000 7f1b8e668700 1 --2- 172.21.15.81:0/593980716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b880ff9b0 0x7f1b881974b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.238+0000 7f1b8e668700 1 -- 172.21.15.81:0/593980716 >> 172.21.15.81:0/593980716 conn(0x7f1b880fab70 msgr2=0x7f1b88105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.239+0000 7f1b8e668700 1 -- 172.21.15.81:0/593980716 shutdown_connections 2024-05-09T00:02:29.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.239+0000 7f1b8e668700 1 -- 172.21.15.81:0/593980716 wait complete. 2024-05-09T00:02:29.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T00:02:29.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.377+0000 7fa36bc10700 1 -- 172.21.15.81:0/2706685885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa364101990 msgr2=0x7fa3641082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.377+0000 7fa36bc10700 1 --2- 172.21.15.81:0/2706685885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa364101990 0x7fa3641082b0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa35c00b0a0 tx=0x7fa35c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.377+0000 7fa36bc10700 1 -- 172.21.15.81:0/2706685885 shutdown_connections 2024-05-09T00:02:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.377+0000 7fa36bc10700 1 --2- 172.21.15.81:0/2706685885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa364101990 0x7fa3641082b0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.377+0000 7fa36bc10700 1 --2- 172.21.15.81:0/2706685885 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3640ffe80 0x7fa3641002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.377+0000 7fa36bc10700 1 --2- 172.21.15.81:0/2706685885 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364100fd0 0x7fa364101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.377+0000 7fa36bc10700 1 -- 172.21.15.81:0/2706685885 >> 172.21.15.81:0/2706685885 conn(0x7fa3640fb3f0 msgr2=0x7fa3640fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.377+0000 7fa36bc10700 1 -- 172.21.15.81:0/2706685885 shutdown_connections 2024-05-09T00:02:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.377+0000 7fa36bc10700 1 -- 172.21.15.81:0/2706685885 wait complete. 2024-05-09T00:02:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.378+0000 7fa36bc10700 1 Processor -- start 2024-05-09T00:02:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.378+0000 7fa36bc10700 1 -- start start 2024-05-09T00:02:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.378+0000 7fa36bc10700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3640ffe80 0x7fa364196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.378+0000 7fa36bc10700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa364100fd0 0x7fa364197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.378+0000 7fa36bc10700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364101990 0x7fa36419e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:29.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.378+0000 7fa36bc10700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36419eab0 con 0x7fa364100fd0 2024-05-09T00:02:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.378+0000 7fa36bc10700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36419ebf0 con 0x7fa364101990 2024-05-09T00:02:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.378+0000 7fa36bc10700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa36419ed80 con 0x7fa3640ffe80 2024-05-09T00:02:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.378+0000 7fa3691ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa364100fd0 0x7fa364197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.378+0000 7fa3691ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa364100fd0 0x7fa364197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35720/0 (socket says 172.21.15.81:35720) 2024-05-09T00:02:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.378+0000 7fa3691ab700 1 -- 172.21.15.81:0/1942431419 learned_addr learned my addr 172.21.15.81:0/1942431419 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.378+0000 7fa36a1ad700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364101990 0x7fa36419e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.378+0000 7fa3699ac700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3640ffe80 0x7fa364196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.379+0000 7fa3691ab700 1 -- 172.21.15.81:0/1942431419 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3640ffe80 msgr2=0x7fa364196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.379+0000 7fa3691ab700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3640ffe80 0x7fa364196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.379+0000 7fa3691ab700 1 -- 172.21.15.81:0/1942431419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364101990 msgr2=0x7fa36419e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.379+0000 7fa3691ab700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364101990 0x7fa36419e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.379+0000 7fa3691ab700 1 -- 172.21.15.81:0/1942431419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c009d00 con 0x7fa364100fd0 2024-05-09T00:02:29.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.379+0000 7fa3699ac700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3640ffe80 0x7fa364196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:29.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.379+0000 7fa3691ab700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa364100fd0 0x7fa364197510 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa35800c9b0 tx=0x7fa35800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:29.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.379+0000 7fa356ffd700 1 -- 172.21.15.81:0/1942431419 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358007b00 con 0x7fa364100fd0 2024-05-09T00:02:29.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.379+0000 7fa356ffd700 1 -- 172.21.15.81:0/1942431419 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa358007c60 con 0x7fa364100fd0 2024-05-09T00:02:29.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.379+0000 7fa36bc10700 1 -- 172.21.15.81:0/1942431419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa36419f060 con 0x7fa364100fd0 2024-05-09T00:02:29.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.379+0000 7fa356ffd700 1 -- 172.21.15.81:0/1942431419 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa358018660 con 0x7fa364100fd0 2024-05-09T00:02:29.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.379+0000 7fa36bc10700 1 -- 172.21.15.81:0/1942431419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa36419f570 con 0x7fa364100fd0 2024-05-09T00:02:29.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.380+0000 7fa36bc10700 1 -- 172.21.15.81:0/1942431419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa364067460 con 0x7fa364100fd0 2024-05-09T00:02:29.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.381+0000 7fa356ffd700 1 -- 172.21.15.81:0/1942431419 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa358018880 con 0x7fa364100fd0 2024-05-09T00:02:29.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.382+0000 7fa356ffd700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa3500a11b0 0x7fa3500a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:29.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.382+0000 7fa3699ac700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa3500a11b0 0x7fa3500a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:29.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.382+0000 7fa356ffd700 1 -- 172.21.15.81:0/1942431419 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa3580cccb0 con 0x7fa364100fd0 2024-05-09T00:02:29.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.382+0000 7fa3699ac700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa3500a11b0 0x7fa3500a3670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa360009be0 tx=0x7fa360009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:29.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.386+0000 7fa356ffd700 1 -- 172.21.15.81:0/1942431419 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa3580964a0 con 0x7fa364100fd0 2024-05-09T00:02:29.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.586+0000 7fa36bc10700 1 -- 172.21.15.81:0/1942431419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa36419f8f0 con 0x7fa364100fd0 2024-05-09T00:02:29.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.587+0000 7fa356ffd700 1 -- 172.21.15.81:0/1942431419 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa358099ac0 con 0x7fa364100fd0 2024-05-09T00:02:29.581 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-09T00:02:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.589+0000 7fa36bc10700 1 -- 172.21.15.81:0/1942431419 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa3500a11b0 msgr2=0x7fa3500a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.589+0000 7fa36bc10700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa3500a11b0 0x7fa3500a3670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa360009be0 tx=0x7fa360009260 comp rx=0 tx=0).stop 2024-05-09T00:02:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.589+0000 7fa36bc10700 1 -- 172.21.15.81:0/1942431419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa364100fd0 msgr2=0x7fa364197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.589+0000 7fa36bc10700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa364100fd0 0x7fa364197510 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa35800c9b0 tx=0x7fa35800cd70 comp rx=0 tx=0).stop 2024-05-09T00:02:29.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.589+0000 7fa36bc10700 1 -- 172.21.15.81:0/1942431419 shutdown_connections 2024-05-09T00:02:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.589+0000 7fa36bc10700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa3500a11b0 0x7fa3500a3670 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.589+0000 7fa36bc10700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa364101990 0x7fa36419e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.589+0000 7fa36bc10700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3640ffe80 0x7fa364196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.589+0000 7fa36bc10700 1 --2- 172.21.15.81:0/1942431419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa364100fd0 0x7fa364197510 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.589+0000 7fa36bc10700 1 -- 172.21.15.81:0/1942431419 >> 172.21.15.81:0/1942431419 conn(0x7fa3640fb3f0 msgr2=0x7fa3640fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.589+0000 7fa36bc10700 1 -- 172.21.15.81:0/1942431419 shutdown_connections 2024-05-09T00:02:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.589+0000 7fa36bc10700 1 -- 172.21.15.81:0/1942431419 wait complete. 2024-05-09T00:02:29.594 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:29 smithi081 ceph-mon[42474]: pgmap v240: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T00:02:29.594 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:29 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/294241286' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:29.594 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:29 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/593980716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:02:29.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T00:02:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.726+0000 7fbf04da4700 1 -- 172.21.15.81:0/3493922180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf00106c60 msgr2=0x7fbf001090d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.726+0000 7fbf04da4700 1 --2- 172.21.15.81:0/3493922180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf00106c60 0x7fbf001090d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbef800b0a0 tx=0x7fbef800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.726+0000 7fbf04da4700 1 -- 172.21.15.81:0/3493922180 shutdown_connections 2024-05-09T00:02:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.726+0000 7fbf04da4700 1 --2- 172.21.15.81:0/3493922180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf00106c60 0x7fbf001090d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.726+0000 7fbf04da4700 1 --2- 172.21.15.81:0/3493922180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf00101a00 0x7fbf00103df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.726+0000 7fbf04da4700 1 --2- 172.21.15.81:0/3493922180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf00104330 0x7fbf00106720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.726+0000 7fbf04da4700 1 -- 172.21.15.81:0/3493922180 >> 172.21.15.81:0/3493922180 conn(0x7fbf000fb3f0 msgr2=0x7fbf000fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.726+0000 7fbf04da4700 1 -- 172.21.15.81:0/3493922180 shutdown_connections 2024-05-09T00:02:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.726+0000 7fbf04da4700 1 -- 172.21.15.81:0/3493922180 wait complete. 2024-05-09T00:02:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbf04da4700 1 Processor -- start 2024-05-09T00:02:29.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbf04da4700 1 -- start start 2024-05-09T00:02:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbf04da4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf00101a00 0x7fbf00196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbf04da4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf00104330 0x7fbf00197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbf04da4700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf00106c60 0x7fbf0019e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbf04da4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0019eb10 con 0x7fbf00101a00 2024-05-09T00:02:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbf04da4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0019ec50 con 0x7fbf00104330 2024-05-09T00:02:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbf04da4700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0019ede0 con 0x7fbf00106c60 2024-05-09T00:02:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbefe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf00101a00 0x7fbf00196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbefe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf00101a00 0x7fbf00196fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35746/0 (socket says 172.21.15.81:35746) 2024-05-09T00:02:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbefe59c700 1 -- 172.21.15.81:0/3393443536 learned_addr learned my addr 172.21.15.81:0/3393443536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbefed9d700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf00106c60 0x7fbf0019e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbefdd9b700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf00104330 0x7fbf00197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:29.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbefe59c700 1 -- 172.21.15.81:0/3393443536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf00106c60 msgr2=0x7fbf0019e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbefe59c700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf00106c60 0x7fbf0019e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbefe59c700 1 -- 172.21.15.81:0/3393443536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf00104330 msgr2=0x7fbf00197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbefe59c700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf00104330 0x7fbf00197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbefe59c700 1 -- 172.21.15.81:0/3393443536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef8009d00 con 0x7fbf00101a00 2024-05-09T00:02:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbefdd9b700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf00104330 0x7fbf00197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.727+0000 7fbefed9d700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf00106c60 0x7fbf0019e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.728+0000 7fbefe59c700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf00101a00 0x7fbf00196fe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbef400d950 tx=0x7fbef400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.728+0000 7fbeef7fe700 1 -- 172.21.15.81:0/3393443536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4009b40 con 0x7fbf00101a00 2024-05-09T00:02:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.728+0000 7fbf04da4700 1 -- 172.21.15.81:0/3393443536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0019f0c0 con 0x7fbf00101a00 2024-05-09T00:02:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.728+0000 7fbeef7fe700 1 -- 172.21.15.81:0/3393443536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbef4009ca0 con 0x7fbf00101a00 2024-05-09T00:02:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.728+0000 7fbeef7fe700 1 -- 172.21.15.81:0/3393443536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef400f620 con 0x7fbf00101a00 2024-05-09T00:02:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.728+0000 7fbf04da4700 1 -- 172.21.15.81:0/3393443536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0019f5d0 con 0x7fbf00101a00 2024-05-09T00:02:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.729+0000 7fbf04da4700 1 -- 172.21.15.81:0/3393443536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf000fcf70 con 0x7fbf00101a00 2024-05-09T00:02:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.730+0000 7fbeef7fe700 1 -- 172.21.15.81:0/3393443536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fbef4010460 con 0x7fbf00101a00 2024-05-09T00:02:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.730+0000 7fbeef7fe700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbee80a11b0 0x7fbee80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.731+0000 7fbeef7fe700 1 -- 172.21.15.81:0/3393443536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbef40cccc0 con 0x7fbf00101a00 2024-05-09T00:02:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.731+0000 7fbefdd9b700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbee80a11b0 0x7fbee80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.731+0000 7fbefdd9b700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbee80a11b0 0x7fbee80a3670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbef0005fd0 tx=0x7fbef0005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.734+0000 7fbeef7fe700 1 -- 172.21.15.81:0/3393443536 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbef40964a0 con 0x7fbf00101a00 2024-05-09T00:02:29.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:29 smithi150 ceph-mon[46187]: pgmap v240: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T00:02:29.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:29 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/294241286' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:29.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:29 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/593980716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:02:29.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:29 smithi171 ceph-mon[47351]: pgmap v240: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T00:02:29.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:29 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/294241286' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:29.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:29 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/593980716' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:02:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.933+0000 7fbf04da4700 1 -- 172.21.15.81:0/3393443536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbf0010ca60 con 0x7fbf00101a00 2024-05-09T00:02:29.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.933+0000 7fbeef7fe700 1 -- 172.21.15.81:0/3393443536 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbef4020020 con 0x7fbf00101a00 2024-05-09T00:02:29.927 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-09T00:02:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.935+0000 7fbf04da4700 1 -- 172.21.15.81:0/3393443536 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbee80a11b0 msgr2=0x7fbee80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.935+0000 7fbf04da4700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbee80a11b0 0x7fbee80a3670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbef0005fd0 tx=0x7fbef0005dc0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.935+0000 7fbf04da4700 1 -- 172.21.15.81:0/3393443536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf00101a00 msgr2=0x7fbf00196fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.935+0000 7fbf04da4700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf00101a00 0x7fbf00196fe0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fbef400d950 tx=0x7fbef400dd10 comp rx=0 tx=0).stop 2024-05-09T00:02:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.935+0000 7fbf04da4700 1 -- 172.21.15.81:0/3393443536 shutdown_connections 2024-05-09T00:02:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.935+0000 7fbf04da4700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fbee80a11b0 0x7fbee80a3670 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.935+0000 7fbf04da4700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf00106c60 0x7fbf0019e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.935+0000 7fbf04da4700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf00101a00 0x7fbf00196fe0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.935+0000 7fbf04da4700 1 --2- 172.21.15.81:0/3393443536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf00104330 0x7fbf00197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.935+0000 7fbf04da4700 1 -- 172.21.15.81:0/3393443536 >> 172.21.15.81:0/3393443536 conn(0x7fbf000fb3f0 msgr2=0x7fbf001022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.935+0000 7fbf04da4700 1 -- 172.21.15.81:0/3393443536 shutdown_connections 2024-05-09T00:02:29.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:29.935+0000 7fbf04da4700 1 -- 172.21.15.81:0/3393443536 wait complete. 2024-05-09T00:02:29.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:02:30.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.070+0000 7f847e196700 1 -- 172.21.15.81:0/1713886763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8478100f80 msgr2=0x7f84781013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:30.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.070+0000 7f847e196700 1 --2- 172.21.15.81:0/1713886763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8478100f80 0x7f84781013e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f84680099c0 tx=0x7f8468009cd0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.070+0000 7f847e196700 1 -- 172.21.15.81:0/1713886763 shutdown_connections 2024-05-09T00:02:30.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.070+0000 7f847e196700 1 --2- 172.21.15.81:0/1713886763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f84780ffd90 0x7f84781001b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.070+0000 7f847e196700 1 --2- 172.21.15.81:0/1713886763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8478101920 0x7f84781081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.070+0000 7f847e196700 1 --2- 172.21.15.81:0/1713886763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8478100f80 0x7f84781013e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.070+0000 7f847e196700 1 -- 172.21.15.81:0/1713886763 >> 172.21.15.81:0/1713886763 conn(0x7f84780fb300 msgr2=0x7f84780fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:30.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.070+0000 7f847e196700 1 -- 172.21.15.81:0/1713886763 shutdown_connections 2024-05-09T00:02:30.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.070+0000 7f847e196700 1 -- 172.21.15.81:0/1713886763 wait complete. 2024-05-09T00:02:30.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.071+0000 7f847e196700 1 Processor -- start 2024-05-09T00:02:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.071+0000 7f847e196700 1 -- start start 2024-05-09T00:02:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.071+0000 7f847e196700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84780ffd90 0x7f8478195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.071+0000 7f847e196700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8478100f80 0x7f84781961b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.071+0000 7f847e196700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8478101920 0x7f847819d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.071+0000 7f847e196700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847819d760 con 0x7f84780ffd90 2024-05-09T00:02:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.071+0000 7f847e196700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847819d8d0 con 0x7f8478100f80 2024-05-09T00:02:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.071+0000 7f847e196700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847819da90 con 0x7f8478101920 2024-05-09T00:02:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.071+0000 7f84777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84780ffd90 0x7f8478195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.071+0000 7f84777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84780ffd90 0x7f8478195c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35758/0 (socket says 172.21.15.81:35758) 2024-05-09T00:02:30.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.071+0000 7f84777fe700 1 -- 172.21.15.81:0/3507104573 learned_addr learned my addr 172.21.15.81:0/3507104573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:30.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.071+0000 7f8476ffd700 1 --2- 172.21.15.81:0/3507104573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8478100f80 0x7f84781961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:30.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.072+0000 7f84777fe700 1 -- 172.21.15.81:0/3507104573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8478101920 msgr2=0x7f847819d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:30.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.072+0000 7f84777fe700 1 --2- 172.21.15.81:0/3507104573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8478101920 0x7f847819d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.072+0000 7f84777fe700 1 -- 172.21.15.81:0/3507104573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8478100f80 msgr2=0x7f84781961b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:30.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.072+0000 7f84777fe700 1 --2- 172.21.15.81:0/3507104573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8478100f80 0x7f84781961b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.072+0000 7f84777fe700 1 -- 172.21.15.81:0/3507104573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84680095f0 con 0x7f84780ffd90 2024-05-09T00:02:30.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.072+0000 7f8476ffd700 1 --2- 172.21.15.81:0/3507104573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8478100f80 0x7f84781961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:30.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.072+0000 7f84777fe700 1 --2- 172.21.15.81:0/3507104573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84780ffd90 0x7f8478195c70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f846000c990 tx=0x7f846000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:30.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.072+0000 7f8474ff9700 1 -- 172.21.15.81:0/3507104573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460007b00 con 0x7f84780ffd90 2024-05-09T00:02:30.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.072+0000 7f847e196700 1 -- 172.21.15.81:0/3507104573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847819dd70 con 0x7f84780ffd90 2024-05-09T00:02:30.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.072+0000 7f8474ff9700 1 -- 172.21.15.81:0/3507104573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8460007c60 con 0x7f84780ffd90 2024-05-09T00:02:30.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.072+0000 7f8474ff9700 1 -- 172.21.15.81:0/3507104573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460018660 con 0x7f84780ffd90 2024-05-09T00:02:30.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.072+0000 7f847e196700 1 -- 172.21.15.81:0/3507104573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847819e210 con 0x7f84780ffd90 2024-05-09T00:02:30.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.073+0000 7f847e196700 1 -- 172.21.15.81:0/3507104573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84781070e0 con 0x7f84780ffd90 2024-05-09T00:02:30.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.074+0000 7f8474ff9700 1 -- 172.21.15.81:0/3507104573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f846000f450 con 0x7f84780ffd90 2024-05-09T00:02:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.075+0000 7f8474ff9700 1 --2- 172.21.15.81:0/3507104573 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f84640a11b0 0x7f84640a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.075+0000 7f8476ffd700 1 --2- 172.21.15.81:0/3507104573 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f84640a11b0 0x7f84640a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.075+0000 7f8474ff9700 1 -- 172.21.15.81:0/3507104573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f84600cc8d0 con 0x7f84780ffd90 2024-05-09T00:02:30.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.075+0000 7f8476ffd700 1 --2- 172.21.15.81:0/3507104573 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f84640a11b0 0x7f84640a3670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8468000c00 tx=0x7f8468005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:30.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.079+0000 7f8474ff9700 1 -- 172.21.15.81:0/3507104573 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f84600960b0 con 0x7f84780ffd90 2024-05-09T00:02:30.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.321+0000 7f847e196700 1 -- 172.21.15.81:0/3507104573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f847810b5f0 con 0x7f84780ffd90 2024-05-09T00:02:30.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.322+0000 7f8474ff9700 1 -- 172.21.15.81:0/3507104573 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10864 (secure 0 0 0) 0x7f84600996d0 con 0x7f84780ffd90 2024-05-09T00:02:30.316 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:30.316 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:01:50.053948+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:02:30.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.324+0000 7f847e196700 1 -- 172.21.15.81:0/3507104573 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f84640a11b0 msgr2=0x7f84640a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:30.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.324+0000 7f847e196700 1 --2- 172.21.15.81:0/3507104573 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f84640a11b0 0x7f84640a3670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8468000c00 tx=0x7f8468005fb0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.324+0000 7f847e196700 1 -- 172.21.15.81:0/3507104573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84780ffd90 msgr2=0x7f8478195c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:30.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.324+0000 7f847e196700 1 --2- 172.21.15.81:0/3507104573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84780ffd90 0x7f8478195c70 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f846000c990 tx=0x7f846000cd50 comp rx=0 tx=0).stop 2024-05-09T00:02:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.324+0000 7f847e196700 1 -- 172.21.15.81:0/3507104573 shutdown_connections 2024-05-09T00:02:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.324+0000 7f847e196700 1 --2- 172.21.15.81:0/3507104573 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f84640a11b0 0x7f84640a3670 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.324+0000 7f847e196700 1 --2- 172.21.15.81:0/3507104573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8478101920 0x7f847819d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.324+0000 7f847e196700 1 --2- 172.21.15.81:0/3507104573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f84780ffd90 0x7f8478195c70 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.324+0000 7f847e196700 1 --2- 172.21.15.81:0/3507104573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8478100f80 0x7f84781961b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.324+0000 7f847e196700 1 -- 172.21.15.81:0/3507104573 >> 172.21.15.81:0/3507104573 conn(0x7f84780fb300 msgr2=0x7f8478104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.324+0000 7f847e196700 1 -- 172.21.15.81:0/3507104573 shutdown_connections 2024-05-09T00:02:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.324+0000 7f847e196700 1 -- 172.21.15.81:0/3507104573 wait complete. 2024-05-09T00:02:30.319 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-05-09T00:02:30.331 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:02:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.460+0000 7f2964a49700 1 -- 172.21.15.81:0/114842169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29601018f0 msgr2=0x7f29601081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:30.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.460+0000 7f2964a49700 1 --2- 172.21.15.81:0/114842169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29601018f0 0x7f29601081a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f295800b0d0 tx=0x7f295800b3e0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.460+0000 7f2964a49700 1 -- 172.21.15.81:0/114842169 shutdown_connections 2024-05-09T00:02:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.460+0000 7f2964a49700 1 --2- 172.21.15.81:0/114842169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29600ffd60 0x7f2960100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.460+0000 7f2964a49700 1 --2- 172.21.15.81:0/114842169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29601018f0 0x7f29601081a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.460+0000 7f2964a49700 1 --2- 172.21.15.81:0/114842169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2960100f50 0x7f29601013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.460+0000 7f2964a49700 1 -- 172.21.15.81:0/114842169 >> 172.21.15.81:0/114842169 conn(0x7f29600fb2f0 msgr2=0x7f29600fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.460+0000 7f2964a49700 1 -- 172.21.15.81:0/114842169 shutdown_connections 2024-05-09T00:02:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.460+0000 7f2964a49700 1 -- 172.21.15.81:0/114842169 wait complete. 2024-05-09T00:02:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.461+0000 7f2964a49700 1 Processor -- start 2024-05-09T00:02:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.461+0000 7f2964a49700 1 -- start start 2024-05-09T00:02:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.461+0000 7f2964a49700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29600ffd60 0x7f2960068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.461+0000 7f2964a49700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2960100f50 0x7f296019bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.461+0000 7f2964a49700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29601018f0 0x7f296019e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:30.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.461+0000 7f2964a49700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296019e990 con 0x7f29600ffd60 2024-05-09T00:02:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.461+0000 7f2964a49700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296019eb00 con 0x7f2960100f50 2024-05-09T00:02:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.461+0000 7f2964a49700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296019ecc0 con 0x7f29601018f0 2024-05-09T00:02:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.461+0000 7f295e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29600ffd60 0x7f2960068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.461+0000 7f295e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29600ffd60 0x7f2960068b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35766/0 (socket says 172.21.15.81:35766) 2024-05-09T00:02:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.461+0000 7f295e59c700 1 -- 172.21.15.81:0/2761561470 learned_addr learned my addr 172.21.15.81:0/2761561470 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.462+0000 7f295e59c700 1 -- 172.21.15.81:0/2761561470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29601018f0 msgr2=0x7f296019e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.462+0000 7f295ed9d700 1 --2- 172.21.15.81:0/2761561470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29601018f0 0x7f296019e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.462+0000 7f295e59c700 1 --2- 172.21.15.81:0/2761561470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29601018f0 0x7f296019e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.462+0000 7f295e59c700 1 -- 172.21.15.81:0/2761561470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2960100f50 msgr2=0x7f296019bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.462+0000 7f295dd9b700 1 --2- 172.21.15.81:0/2761561470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2960100f50 0x7f296019bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.462+0000 7f295e59c700 1 --2- 172.21.15.81:0/2761561470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2960100f50 0x7f296019bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.462+0000 7f295e59c700 1 -- 172.21.15.81:0/2761561470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2958009d00 con 0x7f29600ffd60 2024-05-09T00:02:30.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.462+0000 7f295e59c700 1 --2- 172.21.15.81:0/2761561470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29600ffd60 0x7f2960068b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f294800c970 tx=0x7f294800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.462+0000 7f29577fe700 1 -- 172.21.15.81:0/2761561470 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948004220 con 0x7f29600ffd60 2024-05-09T00:02:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.462+0000 7f29577fe700 1 -- 172.21.15.81:0/2761561470 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2948007d60 con 0x7f29600ffd60 2024-05-09T00:02:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.462+0000 7f2964a49700 1 -- 172.21.15.81:0/2761561470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296019efa0 con 0x7f29600ffd60 2024-05-09T00:02:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.462+0000 7f29577fe700 1 -- 172.21.15.81:0/2761561470 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948003d00 con 0x7f29600ffd60 2024-05-09T00:02:30.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.462+0000 7f2964a49700 1 -- 172.21.15.81:0/2761561470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296019f3c0 con 0x7f29600ffd60 2024-05-09T00:02:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.463+0000 7f2964a49700 1 -- 172.21.15.81:0/2761561470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2960107110 con 0x7f29600ffd60 2024-05-09T00:02:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.464+0000 7f29577fe700 1 -- 172.21.15.81:0/2761561470 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2948004380 con 0x7f29600ffd60 2024-05-09T00:02:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.465+0000 7f29577fe700 1 --2- 172.21.15.81:0/2761561470 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f294c0a11b0 0x7f294c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.465+0000 7f295dd9b700 1 --2- 172.21.15.81:0/2761561470 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f294c0a11b0 0x7f294c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.465+0000 7f29577fe700 1 -- 172.21.15.81:0/2761561470 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f29480cc8a0 con 0x7f29600ffd60 2024-05-09T00:02:30.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.465+0000 7f295dd9b700 1 --2- 172.21.15.81:0/2761561470 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f294c0a11b0 0x7f294c0a3670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f29600690d0 tx=0x7f2950005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:30.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.468+0000 7f29577fe700 1 -- 172.21.15.81:0/2761561470 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2948096080 con 0x7f29600ffd60 2024-05-09T00:02:30.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:30 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1942431419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:02:30.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:30 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3393443536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:02:30.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:30 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3507104573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.672+0000 7f2964a49700 1 -- 172.21.15.81:0/2761561470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f296010b600 con 0x7f29600ffd60 2024-05-09T00:02:30.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.673+0000 7f29577fe700 1 -- 172.21.15.81:0/2761561470 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22095 (secure 0 0 0) 0x7f29480996a0 con 0x7f29600ffd60 2024-05-09T00:02:30.667 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:30.667 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":79,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:01:46.020465+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:02:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.675+0000 7f2964a49700 1 -- 172.21.15.81:0/2761561470 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f294c0a11b0 msgr2=0x7f294c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.675+0000 7f2964a49700 1 --2- 172.21.15.81:0/2761561470 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f294c0a11b0 0x7f294c0a3670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f29600690d0 tx=0x7f2950005cf0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.675+0000 7f2964a49700 1 -- 172.21.15.81:0/2761561470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29600ffd60 msgr2=0x7f2960068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.675+0000 7f2964a49700 1 --2- 172.21.15.81:0/2761561470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29600ffd60 0x7f2960068b10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f294800c970 tx=0x7f294800cd30 comp rx=0 tx=0).stop 2024-05-09T00:02:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.675+0000 7f2964a49700 1 -- 172.21.15.81:0/2761561470 shutdown_connections 2024-05-09T00:02:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.675+0000 7f2964a49700 1 --2- 172.21.15.81:0/2761561470 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f294c0a11b0 0x7f294c0a3670 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.675+0000 7f2964a49700 1 --2- 172.21.15.81:0/2761561470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29601018f0 0x7f296019e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.675+0000 7f2964a49700 1 --2- 172.21.15.81:0/2761561470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29600ffd60 0x7f2960068b10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.675+0000 7f2964a49700 1 --2- 172.21.15.81:0/2761561470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2960100f50 0x7f296019bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.675+0000 7f2964a49700 1 -- 172.21.15.81:0/2761561470 >> 172.21.15.81:0/2761561470 conn(0x7f29600fb2f0 msgr2=0x7f2960104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.675+0000 7f2964a49700 1 -- 172.21.15.81:0/2761561470 shutdown_connections 2024-05-09T00:02:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.675+0000 7f2964a49700 1 -- 172.21.15.81:0/2761561470 wait complete. 2024-05-09T00:02:30.681 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:58:34.523249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T00:01:43.149260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T00:01:44.182730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:02:30.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:02:30.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:30 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1942431419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:02:30.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:30 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3393443536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:02:30.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:30 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3507104573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:30.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:30 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1942431419' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:02:30.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:30 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3393443536' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:02:30.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:30 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3507104573' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.812+0000 7f23e3fa6700 1 -- 172.21.15.81:0/2734957090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23dc1022e0 msgr2=0x7f23dc102740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.812+0000 7f23e3fa6700 1 --2- 172.21.15.81:0/2734957090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23dc1022e0 0x7f23dc102740 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009990 tx=0x7f23cc009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.812+0000 7f23e3fa6700 1 -- 172.21.15.81:0/2734957090 shutdown_connections 2024-05-09T00:02:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.812+0000 7f23e3fa6700 1 --2- 172.21.15.81:0/2734957090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23dc102c80 0x7f23dc109530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.812+0000 7f23e3fa6700 1 --2- 172.21.15.81:0/2734957090 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23dc0ff270 0x7f23dc0ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.812+0000 7f23e3fa6700 1 --2- 172.21.15.81:0/2734957090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23dc1022e0 0x7f23dc102740 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.812+0000 7f23e3fa6700 1 -- 172.21.15.81:0/2734957090 >> 172.21.15.81:0/2734957090 conn(0x7f23dc0fab80 msgr2=0x7f23dc0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.813+0000 7f23e3fa6700 1 -- 172.21.15.81:0/2734957090 shutdown_connections 2024-05-09T00:02:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.813+0000 7f23e3fa6700 1 -- 172.21.15.81:0/2734957090 wait complete. 2024-05-09T00:02:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.813+0000 7f23e3fa6700 1 Processor -- start 2024-05-09T00:02:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.813+0000 7f23e3fa6700 1 -- start start 2024-05-09T00:02:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.813+0000 7f23e3fa6700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23dc0ff270 0x7f23dc101c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:30.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.813+0000 7f23e3fa6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23dc1022e0 0x7f23dc100290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.813+0000 7f23e3fa6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23dc102c80 0x7f23dc1007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.813+0000 7f23e3fa6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc100f70 con 0x7f23dc1022e0 2024-05-09T00:02:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.813+0000 7f23e3fa6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc1010e0 con 0x7f23dc102c80 2024-05-09T00:02:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.813+0000 7f23e3fa6700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc1a0f50 con 0x7f23dc0ff270 2024-05-09T00:02:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.813+0000 7f23e1541700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23dc1022e0 0x7f23dc100290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.813+0000 7f23e1541700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23dc1022e0 0x7f23dc100290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35782/0 (socket says 172.21.15.81:35782) 2024-05-09T00:02:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.813+0000 7f23e1541700 1 -- 172.21.15.81:0/4010172201 learned_addr learned my addr 172.21.15.81:0/4010172201 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.814+0000 7f23e2543700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23dc102c80 0x7f23dc1007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.814+0000 7f23e1d42700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23dc0ff270 0x7f23dc101c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.814+0000 7f23e1541700 1 -- 172.21.15.81:0/4010172201 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23dc0ff270 msgr2=0x7f23dc101c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.814+0000 7f23e1541700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23dc0ff270 0x7f23dc101c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.814+0000 7f23e1541700 1 -- 172.21.15.81:0/4010172201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23dc102c80 msgr2=0x7f23dc1007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:30.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.814+0000 7f23e1541700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23dc102c80 0x7f23dc1007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:30.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.814+0000 7f23e1541700 1 -- 172.21.15.81:0/4010172201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23cc0095f0 con 0x7f23dc1022e0 2024-05-09T00:02:30.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.814+0000 7f23e1d42700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23dc0ff270 0x7f23dc101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:30.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.814+0000 7f23e1541700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23dc1022e0 0x7f23dc100290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f23cc006010 tx=0x7f23cc005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:30.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.814+0000 7f23d2ffd700 1 -- 172.21.15.81:0/4010172201 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc01d070 con 0x7f23dc1022e0 2024-05-09T00:02:30.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.814+0000 7f23d2ffd700 1 -- 172.21.15.81:0/4010172201 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23cc004ca0 con 0x7f23dc1022e0 2024-05-09T00:02:30.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.814+0000 7f23e3fa6700 1 -- 172.21.15.81:0/4010172201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23dc1a1180 con 0x7f23dc1022e0 2024-05-09T00:02:30.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.814+0000 7f23d2ffd700 1 -- 172.21.15.81:0/4010172201 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23cc005500 con 0x7f23dc1022e0 2024-05-09T00:02:30.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.814+0000 7f23e3fa6700 1 -- 172.21.15.81:0/4010172201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23dc1a15a0 con 0x7f23dc1022e0 2024-05-09T00:02:30.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.815+0000 7f23e3fa6700 1 -- 172.21.15.81:0/4010172201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23dc108570 con 0x7f23dc1022e0 2024-05-09T00:02:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.816+0000 7f23d2ffd700 1 -- 172.21.15.81:0/4010172201 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f23cc00fb80 con 0x7f23dc1022e0 2024-05-09T00:02:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.817+0000 7f23d2ffd700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f23c80a1230 0x7f23c80a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.817+0000 7f23e1d42700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f23c80a1230 0x7f23c80a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.817+0000 7f23d2ffd700 1 -- 172.21.15.81:0/4010172201 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f23cc0cdec0 con 0x7f23dc1022e0 2024-05-09T00:02:30.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.817+0000 7f23e1d42700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f23c80a1230 0x7f23c80a36f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f23dc069210 tx=0x7f23d8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:30.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:30.820+0000 7f23d2ffd700 1 -- 172.21.15.81:0/4010172201 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f23cc097730 con 0x7f23dc1022e0 2024-05-09T00:02:31.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.016+0000 7f23e3fa6700 1 -- 172.21.15.81:0/4010172201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23dc10c8e0 con 0x7f23dc1022e0 2024-05-09T00:02:31.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.017+0000 7f23d2ffd700 1 -- 172.21.15.81:0/4010172201 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23cc0056c0 con 0x7f23dc1022e0 2024-05-09T00:02:31.011 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-09T00:02:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.019+0000 7f23e3fa6700 1 -- 172.21.15.81:0/4010172201 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f23c80a1230 msgr2=0x7f23c80a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.019+0000 7f23e3fa6700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f23c80a1230 0x7f23c80a36f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f23dc069210 tx=0x7f23d8009260 comp rx=0 tx=0).stop 2024-05-09T00:02:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.019+0000 7f23e3fa6700 1 -- 172.21.15.81:0/4010172201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23dc1022e0 msgr2=0x7f23dc100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.019+0000 7f23e3fa6700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23dc1022e0 0x7f23dc100290 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f23cc006010 tx=0x7f23cc005ef0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.019+0000 7f23e3fa6700 1 -- 172.21.15.81:0/4010172201 shutdown_connections 2024-05-09T00:02:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.019+0000 7f23e3fa6700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f23c80a1230 0x7f23c80a36f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.019+0000 7f23e3fa6700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23dc102c80 0x7f23dc1007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.019+0000 7f23e3fa6700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23dc0ff270 0x7f23dc101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.019+0000 7f23e3fa6700 1 --2- 172.21.15.81:0/4010172201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23dc1022e0 0x7f23dc100290 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.019+0000 7f23e3fa6700 1 -- 172.21.15.81:0/4010172201 >> 172.21.15.81:0/4010172201 conn(0x7f23dc0fab80 msgr2=0x7f23dc1056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.019+0000 7f23e3fa6700 1 -- 172.21.15.81:0/4010172201 shutdown_connections 2024-05-09T00:02:31.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.019+0000 7f23e3fa6700 1 -- 172.21.15.81:0/4010172201 wait complete. 2024-05-09T00:02:31.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T00:02:31.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.157+0000 7f678a7c0700 1 -- 172.21.15.81:0/2608294961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840ff250 msgr2=0x7f67840ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.157+0000 7f678a7c0700 1 --2- 172.21.15.81:0/2608294961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840ff250 0x7f67840ff670 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6774009990 tx=0x7f6774009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.157+0000 7f678a7c0700 1 -- 172.21.15.81:0/2608294961 shutdown_connections 2024-05-09T00:02:31.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.157+0000 7f678a7c0700 1 --2- 172.21.15.81:0/2608294961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6784102c60 0x7f6784109510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.157+0000 7f678a7c0700 1 --2- 172.21.15.81:0/2608294961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840ff250 0x7f67840ff670 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.157+0000 7f678a7c0700 1 --2- 172.21.15.81:0/2608294961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67841022c0 0x7f6784102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.157+0000 7f678a7c0700 1 -- 172.21.15.81:0/2608294961 >> 172.21.15.81:0/2608294961 conn(0x7f67840fab80 msgr2=0x7f67840fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:31.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.157+0000 7f678a7c0700 1 -- 172.21.15.81:0/2608294961 shutdown_connections 2024-05-09T00:02:31.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.157+0000 7f678a7c0700 1 -- 172.21.15.81:0/2608294961 wait complete. 2024-05-09T00:02:31.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f678a7c0700 1 Processor -- start 2024-05-09T00:02:31.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f678a7c0700 1 -- start start 2024-05-09T00:02:31.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f678a7c0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840ff250 0x7f6784196f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:31.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f678a7c0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67841022c0 0x7f6784197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f678a7c0700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6784102c60 0x7f678419e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f678a7c0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678419ea60 con 0x7f67840ff250 2024-05-09T00:02:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f678a7c0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678419eba0 con 0x7f67841022c0 2024-05-09T00:02:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f678a7c0700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678419ed30 con 0x7f6784102c60 2024-05-09T00:02:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f6783fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840ff250 0x7f6784196f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f6783fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840ff250 0x7f6784196f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35800/0 (socket says 172.21.15.81:35800) 2024-05-09T00:02:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f6783fff700 1 -- 172.21.15.81:0/256131803 learned_addr learned my addr 172.21.15.81:0/256131803 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f6788d5d700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6784102c60 0x7f678419e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f67837fe700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67841022c0 0x7f6784197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f6783fff700 1 -- 172.21.15.81:0/256131803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6784102c60 msgr2=0x7f678419e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f6783fff700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6784102c60 0x7f678419e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f6783fff700 1 -- 172.21.15.81:0/256131803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67841022c0 msgr2=0x7f6784197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f6783fff700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67841022c0 0x7f6784197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f6783fff700 1 -- 172.21.15.81:0/256131803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67740095f0 con 0x7f67840ff250 2024-05-09T00:02:31.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.158+0000 7f67837fe700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67841022c0 0x7f6784197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:31.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.159+0000 7f6783fff700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840ff250 0x7f6784196f30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f67740095c0 tx=0x7f677400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:31.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.159+0000 7f67817fa700 1 -- 172.21.15.81:0/256131803 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677401d070 con 0x7f67840ff250 2024-05-09T00:02:31.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.159+0000 7f678a7c0700 1 -- 172.21.15.81:0/256131803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678419efb0 con 0x7f67840ff250 2024-05-09T00:02:31.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.159+0000 7f67817fa700 1 -- 172.21.15.81:0/256131803 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6774022470 con 0x7f67840ff250 2024-05-09T00:02:31.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.159+0000 7f67817fa700 1 -- 172.21.15.81:0/256131803 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6774017650 con 0x7f67840ff250 2024-05-09T00:02:31.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.159+0000 7f678a7c0700 1 -- 172.21.15.81:0/256131803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678419f370 con 0x7f67840ff250 2024-05-09T00:02:31.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.160+0000 7f678a7c0700 1 -- 172.21.15.81:0/256131803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6784108570 con 0x7f67840ff250 2024-05-09T00:02:31.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.161+0000 7f67817fa700 1 -- 172.21.15.81:0/256131803 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6774022850 con 0x7f67840ff250 2024-05-09T00:02:31.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.161+0000 7f67817fa700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f676c0a11b0 0x7f676c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:31.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.161+0000 7f67837fe700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f676c0a11b0 0x7f676c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:31.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.162+0000 7f67817fa700 1 -- 172.21.15.81:0/256131803 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f67740ce3d0 con 0x7f67840ff250 2024-05-09T00:02:31.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.162+0000 7f67837fe700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f676c0a11b0 0x7f676c0a3670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6778005fd0 tx=0x7f6778005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:31.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.165+0000 7f67817fa700 1 -- 172.21.15.81:0/256131803 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6774097b80 con 0x7f67840ff250 2024-05-09T00:02:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.362+0000 7f678a7c0700 1 -- 172.21.15.81:0/256131803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f678410c7b0 con 0x7f67840ff250 2024-05-09T00:02:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.362+0000 7f67817fa700 1 -- 172.21.15.81:0/256131803 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v79) v1 ==== 104+0+11 (secure 0 0 0) 0x7f677409b1a0 con 0x7f67840ff250 2024-05-09T00:02:31.356 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-09T00:02:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.364+0000 7f678a7c0700 1 -- 172.21.15.81:0/256131803 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f676c0a11b0 msgr2=0x7f676c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.364+0000 7f678a7c0700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f676c0a11b0 0x7f676c0a3670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6778005fd0 tx=0x7f6778005ee0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.364+0000 7f678a7c0700 1 -- 172.21.15.81:0/256131803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840ff250 msgr2=0x7f6784196f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.364+0000 7f678a7c0700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840ff250 0x7f6784196f30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f67740095c0 tx=0x7f677400f690 comp rx=0 tx=0).stop 2024-05-09T00:02:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.364+0000 7f678a7c0700 1 -- 172.21.15.81:0/256131803 shutdown_connections 2024-05-09T00:02:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.364+0000 7f678a7c0700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f676c0a11b0 0x7f676c0a3670 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.364+0000 7f678a7c0700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6784102c60 0x7f678419e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.364+0000 7f678a7c0700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67840ff250 0x7f6784196f30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.364+0000 7f678a7c0700 1 --2- 172.21.15.81:0/256131803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67841022c0 0x7f6784197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.364+0000 7f678a7c0700 1 -- 172.21.15.81:0/256131803 >> 172.21.15.81:0/256131803 conn(0x7f67840fab80 msgr2=0x7f67841056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.365+0000 7f678a7c0700 1 -- 172.21.15.81:0/256131803 shutdown_connections 2024-05-09T00:02:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.365+0000 7f678a7c0700 1 -- 172.21.15.81:0/256131803 wait complete. 2024-05-09T00:02:31.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T00:02:31.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.502+0000 7f468de1e700 1 -- 172.21.15.81:0/1280066117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4688101170 msgr2=0x7f4688107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.502+0000 7f468de1e700 1 --2- 172.21.15.81:0/1280066117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4688101170 0x7f4688107a20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f468000b0d0 tx=0x7f468000b3e0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.502+0000 7f468de1e700 1 -- 172.21.15.81:0/1280066117 shutdown_connections 2024-05-09T00:02:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.502+0000 7f468de1e700 1 --2- 172.21.15.81:0/1280066117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46880ff5e0 0x7f46880ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.502+0000 7f468de1e700 1 --2- 172.21.15.81:0/1280066117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4688101170 0x7f4688107a20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.502+0000 7f468de1e700 1 --2- 172.21.15.81:0/1280066117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46881007d0 0x7f4688100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.502+0000 7f468de1e700 1 -- 172.21.15.81:0/1280066117 >> 172.21.15.81:0/1280066117 conn(0x7f46880fab50 msgr2=0x7f46880fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.502+0000 7f468de1e700 1 -- 172.21.15.81:0/1280066117 shutdown_connections 2024-05-09T00:02:31.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.502+0000 7f468de1e700 1 -- 172.21.15.81:0/1280066117 wait complete. 2024-05-09T00:02:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.503+0000 7f468de1e700 1 Processor -- start 2024-05-09T00:02:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.503+0000 7f468de1e700 1 -- start start 2024-05-09T00:02:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.503+0000 7f468de1e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46880ff5e0 0x7f46880fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.503+0000 7f468de1e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46881007d0 0x7f468819e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.503+0000 7f468de1e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4688101170 0x7f46881a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.503+0000 7f468de1e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46881a0c80 con 0x7f46880ff5e0 2024-05-09T00:02:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.503+0000 7f468de1e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46881a0dc0 con 0x7f4688101170 2024-05-09T00:02:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.503+0000 7f468de1e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46881a0f80 con 0x7f46881007d0 2024-05-09T00:02:31.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.503+0000 7f46877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46880ff5e0 0x7f46880fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.503+0000 7f46877fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46880ff5e0 0x7f46880fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35826/0 (socket says 172.21.15.81:35826) 2024-05-09T00:02:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.503+0000 7f46877fe700 1 -- 172.21.15.81:0/3851464922 learned_addr learned my addr 172.21.15.81:0/3851464922 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.504+0000 7f4687fff700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4688101170 0x7f46881a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.504+0000 7f4686ffd700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46881007d0 0x7f468819e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.504+0000 7f46877fe700 1 -- 172.21.15.81:0/3851464922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46881007d0 msgr2=0x7f468819e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.504+0000 7f46877fe700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46881007d0 0x7f468819e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.504+0000 7f46877fe700 1 -- 172.21.15.81:0/3851464922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4688101170 msgr2=0x7f46881a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.504+0000 7f46877fe700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4688101170 0x7f46881a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.504+0000 7f46877fe700 1 -- 172.21.15.81:0/3851464922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4680009d00 con 0x7f46880ff5e0 2024-05-09T00:02:31.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.504+0000 7f4686ffd700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46881007d0 0x7f468819e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:31.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.504+0000 7f46877fe700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46880ff5e0 0x7f46880fcbd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f467800c990 tx=0x7f467800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:31.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.504+0000 7f4684ff9700 1 -- 172.21.15.81:0/3851464922 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678007b00 con 0x7f46880ff5e0 2024-05-09T00:02:31.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.504+0000 7f4684ff9700 1 -- 172.21.15.81:0/3851464922 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4678007c60 con 0x7f46880ff5e0 2024-05-09T00:02:31.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.504+0000 7f468de1e700 1 -- 172.21.15.81:0/3851464922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46881a1260 con 0x7f46880ff5e0 2024-05-09T00:02:31.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.504+0000 7f4684ff9700 1 -- 172.21.15.81:0/3851464922 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678018660 con 0x7f46880ff5e0 2024-05-09T00:02:31.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.504+0000 7f468de1e700 1 -- 172.21.15.81:0/3851464922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46881a1770 con 0x7f46880ff5e0 2024-05-09T00:02:31.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.505+0000 7f468de1e700 1 -- 172.21.15.81:0/3851464922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4688067460 con 0x7f46880ff5e0 2024-05-09T00:02:31.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.506+0000 7f4684ff9700 1 -- 172.21.15.81:0/3851464922 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f467800f450 con 0x7f46880ff5e0 2024-05-09T00:02:31.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.507+0000 7f4684ff9700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f46700a1230 0x7f46700a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:31.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.507+0000 7f4686ffd700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f46700a1230 0x7f46700a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:31.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.507+0000 7f4684ff9700 1 -- 172.21.15.81:0/3851464922 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f46780cc9f0 con 0x7f46880ff5e0 2024-05-09T00:02:31.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.507+0000 7f4686ffd700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f46700a1230 0x7f46700a36f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f467c005950 tx=0x7f467c005f30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:31.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.511+0000 7f4684ff9700 1 -- 172.21.15.81:0/3851464922 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4678096160 con 0x7f46880ff5e0 2024-05-09T00:02:31.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.706+0000 7f468de1e700 1 -- 172.21.15.81:0/3851464922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4688106d20 con 0x7f46880ff5e0 2024-05-09T00:02:31.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.707+0000 7f4684ff9700 1 -- 172.21.15.81:0/3851464922 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v79) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4678099780 con 0x7f46880ff5e0 2024-05-09T00:02:31.701 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-09T00:02:31.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.709+0000 7f468de1e700 1 -- 172.21.15.81:0/3851464922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f46700a1230 msgr2=0x7f46700a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.709+0000 7f468de1e700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f46700a1230 0x7f46700a36f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f467c005950 tx=0x7f467c005f30 comp rx=0 tx=0).stop 2024-05-09T00:02:31.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.709+0000 7f468de1e700 1 -- 172.21.15.81:0/3851464922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46880ff5e0 msgr2=0x7f46880fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.709+0000 7f468de1e700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46880ff5e0 0x7f46880fcbd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f467800c990 tx=0x7f467800cca0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.709+0000 7f468de1e700 1 -- 172.21.15.81:0/3851464922 shutdown_connections 2024-05-09T00:02:31.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.709+0000 7f468de1e700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f46700a1230 0x7f46700a36f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.709+0000 7f468de1e700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4688101170 0x7f46881a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.709+0000 7f468de1e700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46880ff5e0 0x7f46880fcbd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.709+0000 7f468de1e700 1 --2- 172.21.15.81:0/3851464922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46881007d0 0x7f468819e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.709+0000 7f468de1e700 1 -- 172.21.15.81:0/3851464922 >> 172.21.15.81:0/3851464922 conn(0x7f46880fab50 msgr2=0x7f4688103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:31.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.709+0000 7f468de1e700 1 -- 172.21.15.81:0/3851464922 shutdown_connections 2024-05-09T00:02:31.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.709+0000 7f468de1e700 1 -- 172.21.15.81:0/3851464922 wait complete. 2024-05-09T00:02:31.714 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:31 smithi081 ceph-mon[42474]: pgmap v241: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-09T00:02:31.714 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:31 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2761561470' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:31.715 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:31 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/4010172201' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:02:31.715 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:31 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/256131803' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:02:31.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:02:31.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:31 smithi150 ceph-mon[46187]: pgmap v241: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-09T00:02:31.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:31 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2761561470' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:31.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:31 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/4010172201' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:02:31.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:31 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/256131803' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:02:31.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:31 smithi171 ceph-mon[47351]: pgmap v241: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-09T00:02:31.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:31 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2761561470' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:31.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:31 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/4010172201' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:02:31.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:31 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/256131803' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:02:31.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.844+0000 7f9463703700 1 -- 172.21.15.81:0/194724514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c1018f0 msgr2=0x7f945c1081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.844+0000 7f9463703700 1 --2- 172.21.15.81:0/194724514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c1018f0 0x7f945c1081a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f945400b0d0 tx=0x7f945400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.844+0000 7f9463703700 1 -- 172.21.15.81:0/194724514 shutdown_connections 2024-05-09T00:02:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.844+0000 7f9463703700 1 --2- 172.21.15.81:0/194724514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f945c0ffd60 0x7f945c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.844+0000 7f9463703700 1 --2- 172.21.15.81:0/194724514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c1018f0 0x7f945c1081a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.844+0000 7f9463703700 1 --2- 172.21.15.81:0/194724514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f945c100f50 0x7f945c1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.844+0000 7f9463703700 1 -- 172.21.15.81:0/194724514 >> 172.21.15.81:0/194724514 conn(0x7f945c0fb2f0 msgr2=0x7f945c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.844+0000 7f9463703700 1 -- 172.21.15.81:0/194724514 shutdown_connections 2024-05-09T00:02:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.844+0000 7f9463703700 1 -- 172.21.15.81:0/194724514 wait complete. 2024-05-09T00:02:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9463703700 1 Processor -- start 2024-05-09T00:02:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9463703700 1 -- start start 2024-05-09T00:02:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9463703700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f945c0ffd60 0x7f945c195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9463703700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f945c100f50 0x7f945c1962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:31.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9463703700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c1018f0 0x7f945c19d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9463703700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c19d8e0 con 0x7f945c1018f0 2024-05-09T00:02:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9463703700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c19da20 con 0x7f945c0ffd60 2024-05-09T00:02:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9463703700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c19dbb0 con 0x7f945c100f50 2024-05-09T00:02:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9461ca0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c1018f0 0x7f945c19d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9461ca0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c1018f0 0x7f945c19d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35846/0 (socket says 172.21.15.81:35846) 2024-05-09T00:02:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9461ca0700 1 -- 172.21.15.81:0/2541769908 learned_addr learned my addr 172.21.15.81:0/2541769908 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9460c9e700 1 --2- 172.21.15.81:0/2541769908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f945c100f50 0x7f945c1962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f946149f700 1 --2- 172.21.15.81:0/2541769908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f945c0ffd60 0x7f945c195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9461ca0700 1 -- 172.21.15.81:0/2541769908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f945c100f50 msgr2=0x7f945c1962f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9461ca0700 1 --2- 172.21.15.81:0/2541769908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f945c100f50 0x7f945c1962f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9461ca0700 1 -- 172.21.15.81:0/2541769908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f945c0ffd60 msgr2=0x7f945c195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:31.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9461ca0700 1 --2- 172.21.15.81:0/2541769908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f945c0ffd60 0x7f945c195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:31.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9461ca0700 1 -- 172.21.15.81:0/2541769908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9454009d00 con 0x7f945c1018f0 2024-05-09T00:02:31.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.845+0000 7f9461ca0700 1 --2- 172.21.15.81:0/2541769908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c1018f0 0x7f945c19d310 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9454007bd0 tx=0x7f94540094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:31.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.846+0000 7f944e7fc700 1 -- 172.21.15.81:0/2541769908 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945400e040 con 0x7f945c1018f0 2024-05-09T00:02:31.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.846+0000 7f944e7fc700 1 -- 172.21.15.81:0/2541769908 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9454012dc0 con 0x7f945c1018f0 2024-05-09T00:02:31.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.846+0000 7f944e7fc700 1 -- 172.21.15.81:0/2541769908 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454023390 con 0x7f945c1018f0 2024-05-09T00:02:31.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.846+0000 7f9463703700 1 -- 172.21.15.81:0/2541769908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945c067ff0 con 0x7f945c1018f0 2024-05-09T00:02:31.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.846+0000 7f9463703700 1 -- 172.21.15.81:0/2541769908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945c0684b0 con 0x7f945c1018f0 2024-05-09T00:02:31.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.847+0000 7f9463703700 1 -- 172.21.15.81:0/2541769908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945c067c10 con 0x7f945c1018f0 2024-05-09T00:02:31.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.848+0000 7f944e7fc700 1 -- 172.21.15.81:0/2541769908 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f945401a650 con 0x7f945c1018f0 2024-05-09T00:02:31.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.848+0000 7f944e7fc700 1 --2- 172.21.15.81:0/2541769908 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f94480a1230 0x7f94480a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:31.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.848+0000 7f946149f700 1 --2- 172.21.15.81:0/2541769908 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f94480a1230 0x7f94480a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:31.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.848+0000 7f944e7fc700 1 -- 172.21.15.81:0/2541769908 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f94540cfcf0 con 0x7f945c1018f0 2024-05-09T00:02:31.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.849+0000 7f946149f700 1 --2- 172.21.15.81:0/2541769908 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f94480a1230 0x7f94480a36f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9450005950 tx=0x7f94500058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:31.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:31.852+0000 7f944e7fc700 1 -- 172.21.15.81:0/2541769908 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f94540995f0 con 0x7f945c1018f0 2024-05-09T00:02:32.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.095+0000 7f9463703700 1 -- 172.21.15.81:0/2541769908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f945c068ea0 con 0x7f945c1018f0 2024-05-09T00:02:32.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.096+0000 7f944e7fc700 1 -- 172.21.15.81:0/2541769908 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10864 (secure 0 0 0) 0x7f945409cc10 con 0x7f945c1018f0 2024-05-09T00:02:32.090 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:32.090 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:01:50.053948+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:02:32.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.098+0000 7f9463703700 1 -- 172.21.15.81:0/2541769908 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f94480a1230 msgr2=0x7f94480a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.098+0000 7f9463703700 1 --2- 172.21.15.81:0/2541769908 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f94480a1230 0x7f94480a36f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9450005950 tx=0x7f94500058e0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.099+0000 7f9463703700 1 -- 172.21.15.81:0/2541769908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c1018f0 msgr2=0x7f945c19d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.099+0000 7f9463703700 1 --2- 172.21.15.81:0/2541769908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c1018f0 0x7f945c19d310 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9454007bd0 tx=0x7f94540094f0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.099+0000 7f9463703700 1 -- 172.21.15.81:0/2541769908 shutdown_connections 2024-05-09T00:02:32.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.099+0000 7f9463703700 1 --2- 172.21.15.81:0/2541769908 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f94480a1230 0x7f94480a36f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.099+0000 7f9463703700 1 --2- 172.21.15.81:0/2541769908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f945c0ffd60 0x7f945c195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.099+0000 7f9463703700 1 --2- 172.21.15.81:0/2541769908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c1018f0 0x7f945c19d310 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.099+0000 7f9463703700 1 --2- 172.21.15.81:0/2541769908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f945c100f50 0x7f945c1962f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.099+0000 7f9463703700 1 -- 172.21.15.81:0/2541769908 >> 172.21.15.81:0/2541769908 conn(0x7f945c0fb2f0 msgr2=0x7f945c104250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:32.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.099+0000 7f9463703700 1 -- 172.21.15.81:0/2541769908 shutdown_connections 2024-05-09T00:02:32.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.099+0000 7f9463703700 1 -- 172.21.15.81:0/2541769908 wait complete. 2024-05-09T00:02:32.094 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-05-09T00:02:32.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:02:32.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.233+0000 7feb86474700 1 -- 172.21.15.81:0/871345083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb801018f0 msgr2=0x7feb801081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.233+0000 7feb86474700 1 --2- 172.21.15.81:0/871345083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb801018f0 0x7feb801081a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feb7800b0d0 tx=0x7feb7800b3e0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.233+0000 7feb86474700 1 -- 172.21.15.81:0/871345083 shutdown_connections 2024-05-09T00:02:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.233+0000 7feb86474700 1 --2- 172.21.15.81:0/871345083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb801018f0 0x7feb801081a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.233+0000 7feb86474700 1 --2- 172.21.15.81:0/871345083 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb800ffd60 0x7feb80100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.233+0000 7feb86474700 1 --2- 172.21.15.81:0/871345083 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb80100f50 0x7feb801013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.233+0000 7feb86474700 1 -- 172.21.15.81:0/871345083 >> 172.21.15.81:0/871345083 conn(0x7feb800fb2f0 msgr2=0x7feb800fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.233+0000 7feb86474700 1 -- 172.21.15.81:0/871345083 shutdown_connections 2024-05-09T00:02:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.233+0000 7feb86474700 1 -- 172.21.15.81:0/871345083 wait complete. 2024-05-09T00:02:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.234+0000 7feb86474700 1 Processor -- start 2024-05-09T00:02:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.234+0000 7feb86474700 1 -- start start 2024-05-09T00:02:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.234+0000 7feb86474700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb800ffd60 0x7feb80196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.234+0000 7feb86474700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb80100f50 0x7feb801973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.234+0000 7feb86474700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb801018f0 0x7feb8019e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.234+0000 7feb86474700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8019e970 con 0x7feb800ffd60 2024-05-09T00:02:32.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.234+0000 7feb86474700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8019eab0 con 0x7feb80100f50 2024-05-09T00:02:32.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.234+0000 7feb86474700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8019ec40 con 0x7feb801018f0 2024-05-09T00:02:32.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.234+0000 7feb7ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb800ffd60 0x7feb80196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.234+0000 7feb7ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb800ffd60 0x7feb80196e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35876/0 (socket says 172.21.15.81:35876) 2024-05-09T00:02:32.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.235+0000 7feb7ffff700 1 -- 172.21.15.81:0/3542577156 learned_addr learned my addr 172.21.15.81:0/3542577156 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:32.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.235+0000 7feb84a11700 1 --2- 172.21.15.81:0/3542577156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb801018f0 0x7feb8019e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.235+0000 7feb7f7fe700 1 --2- 172.21.15.81:0/3542577156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb80100f50 0x7feb801973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.235+0000 7feb7ffff700 1 -- 172.21.15.81:0/3542577156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb801018f0 msgr2=0x7feb8019e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.235+0000 7feb7ffff700 1 --2- 172.21.15.81:0/3542577156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb801018f0 0x7feb8019e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.235+0000 7feb7ffff700 1 -- 172.21.15.81:0/3542577156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb80100f50 msgr2=0x7feb801973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.235+0000 7feb7ffff700 1 --2- 172.21.15.81:0/3542577156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb80100f50 0x7feb801973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.235+0000 7feb7ffff700 1 -- 172.21.15.81:0/3542577156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb78009d00 con 0x7feb800ffd60 2024-05-09T00:02:32.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.235+0000 7feb7ffff700 1 --2- 172.21.15.81:0/3542577156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb800ffd60 0x7feb80196e90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7feb7000c970 tx=0x7feb7000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:32.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.235+0000 7feb7d7fa700 1 -- 172.21.15.81:0/3542577156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70004220 con 0x7feb800ffd60 2024-05-09T00:02:32.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.235+0000 7feb7d7fa700 1 -- 172.21.15.81:0/3542577156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb70004380 con 0x7feb800ffd60 2024-05-09T00:02:32.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.235+0000 7feb86474700 1 -- 172.21.15.81:0/3542577156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8019ef20 con 0x7feb800ffd60 2024-05-09T00:02:32.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.235+0000 7feb7d7fa700 1 -- 172.21.15.81:0/3542577156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70003b50 con 0x7feb800ffd60 2024-05-09T00:02:32.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.235+0000 7feb86474700 1 -- 172.21.15.81:0/3542577156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8019f340 con 0x7feb800ffd60 2024-05-09T00:02:32.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.236+0000 7feb86474700 1 -- 172.21.15.81:0/3542577156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb80068060 con 0x7feb800ffd60 2024-05-09T00:02:32.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.237+0000 7feb7d7fa700 1 -- 172.21.15.81:0/3542577156 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7feb70003cf0 con 0x7feb800ffd60 2024-05-09T00:02:32.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.237+0000 7feb7d7fa700 1 --2- 172.21.15.81:0/3542577156 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7feb680a11b0 0x7feb680a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.238+0000 7feb7f7fe700 1 --2- 172.21.15.81:0/3542577156 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7feb680a11b0 0x7feb680a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.238+0000 7feb7d7fa700 1 -- 172.21.15.81:0/3542577156 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7feb700cc470 con 0x7feb800ffd60 2024-05-09T00:02:32.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.238+0000 7feb7f7fe700 1 --2- 172.21.15.81:0/3542577156 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7feb680a11b0 0x7feb680a3670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feb7400ac50 tx=0x7feb7400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:32.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.242+0000 7feb7d7fa700 1 -- 172.21.15.81:0/3542577156 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7feb70095b50 con 0x7feb800ffd60 2024-05-09T00:02:32.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.443+0000 7feb86474700 1 -- 172.21.15.81:0/3542577156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb8010b580 con 0x7feb800ffd60 2024-05-09T00:02:32.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.444+0000 7feb7d7fa700 1 -- 172.21.15.81:0/3542577156 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22095 (secure 0 0 0) 0x7feb8010b580 con 0x7feb800ffd60 2024-05-09T00:02:32.438 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:32.438 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":79,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:01:46.020465+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:02:32.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.446+0000 7feb86474700 1 -- 172.21.15.81:0/3542577156 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7feb680a11b0 msgr2=0x7feb680a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.446+0000 7feb86474700 1 --2- 172.21.15.81:0/3542577156 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7feb680a11b0 0x7feb680a3670 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feb7400ac50 tx=0x7feb7400a380 comp rx=0 tx=0).stop 2024-05-09T00:02:32.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.446+0000 7feb86474700 1 -- 172.21.15.81:0/3542577156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb800ffd60 msgr2=0x7feb80196e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.446+0000 7feb86474700 1 --2- 172.21.15.81:0/3542577156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb800ffd60 0x7feb80196e90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7feb7000c970 tx=0x7feb7000cc80 comp rx=0 tx=0).stop 2024-05-09T00:02:32.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.446+0000 7feb86474700 1 -- 172.21.15.81:0/3542577156 shutdown_connections 2024-05-09T00:02:32.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.446+0000 7feb86474700 1 --2- 172.21.15.81:0/3542577156 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7feb680a11b0 0x7feb680a3670 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.446+0000 7feb86474700 1 --2- 172.21.15.81:0/3542577156 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb801018f0 0x7feb8019e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.446+0000 7feb86474700 1 --2- 172.21.15.81:0/3542577156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb800ffd60 0x7feb80196e90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.446+0000 7feb86474700 1 --2- 172.21.15.81:0/3542577156 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7feb80100f50 0x7feb801973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.446+0000 7feb86474700 1 -- 172.21.15.81:0/3542577156 >> 172.21.15.81:0/3542577156 conn(0x7feb800fb2f0 msgr2=0x7feb800fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:32.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.447+0000 7feb86474700 1 -- 172.21.15.81:0/3542577156 shutdown_connections 2024-05-09T00:02:32.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.447+0000 7feb86474700 1 -- 172.21.15.81:0/3542577156 wait complete. 2024-05-09T00:02:32.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:02:32.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.581+0000 7f4df2905700 1 -- 172.21.15.81:0/777178274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec100e70 msgr2=0x7f4dec101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.581+0000 7f4df2905700 1 --2- 172.21.15.81:0/777178274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec100e70 0x7f4dec101290 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009990 tx=0x7f4ddc009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.581+0000 7f4df2905700 1 -- 172.21.15.81:0/777178274 shutdown_connections 2024-05-09T00:02:32.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.581+0000 7f4df2905700 1 --2- 172.21.15.81:0/777178274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dec102980 0x7f4dec1092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.581+0000 7f4df2905700 1 --2- 172.21.15.81:0/777178274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec100e70 0x7f4dec101290 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.581+0000 7f4df2905700 1 --2- 172.21.15.81:0/777178274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dec101fc0 0x7f4dec102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.581+0000 7f4df2905700 1 -- 172.21.15.81:0/777178274 >> 172.21.15.81:0/777178274 conn(0x7f4dec0fc400 msgr2=0x7f4dec0fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.581+0000 7f4df2905700 1 -- 172.21.15.81:0/777178274 shutdown_connections 2024-05-09T00:02:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.581+0000 7f4df2905700 1 -- 172.21.15.81:0/777178274 wait complete. 2024-05-09T00:02:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.581+0000 7f4df2905700 1 Processor -- start 2024-05-09T00:02:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4df2905700 1 -- start start 2024-05-09T00:02:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4df2905700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dec100e70 0x7f4dec196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4df2905700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec101fc0 0x7f4dec1972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4df2905700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dec102980 0x7f4dec19e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4df2905700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec19e8e0 con 0x7f4dec101fc0 2024-05-09T00:02:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4df2905700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec19ea20 con 0x7f4dec102980 2024-05-09T00:02:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4df2905700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dec19ebb0 con 0x7f4dec100e70 2024-05-09T00:02:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4deb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec101fc0 0x7f4dec1972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4deb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec101fc0 0x7f4dec1972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35900/0 (socket says 172.21.15.81:35900) 2024-05-09T00:02:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4deb7fe700 1 -- 172.21.15.81:0/1229856574 learned_addr learned my addr 172.21.15.81:0/1229856574 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4debfff700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dec100e70 0x7f4dec196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4df0ea2700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dec102980 0x7f4dec19e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4deb7fe700 1 -- 172.21.15.81:0/1229856574 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dec100e70 msgr2=0x7f4dec196db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4deb7fe700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dec100e70 0x7f4dec196db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4deb7fe700 1 -- 172.21.15.81:0/1229856574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dec102980 msgr2=0x7f4dec19e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4deb7fe700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dec102980 0x7f4dec19e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4deb7fe700 1 -- 172.21.15.81:0/1229856574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc0095f0 con 0x7f4dec101fc0 2024-05-09T00:02:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4df0ea2700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dec102980 0x7f4dec19e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.582+0000 7f4deb7fe700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec101fc0 0x7f4dec1972f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400c9b0 tx=0x7f4dd400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.583+0000 7f4de97fa700 1 -- 172.21.15.81:0/1229856574 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4007b00 con 0x7f4dec101fc0 2024-05-09T00:02:32.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.583+0000 7f4df2905700 1 -- 172.21.15.81:0/1229856574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dec19ee90 con 0x7f4dec101fc0 2024-05-09T00:02:32.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.583+0000 7f4de97fa700 1 -- 172.21.15.81:0/1229856574 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4dd4007c60 con 0x7f4dec101fc0 2024-05-09T00:02:32.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.583+0000 7f4de97fa700 1 -- 172.21.15.81:0/1229856574 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4018660 con 0x7f4dec101fc0 2024-05-09T00:02:32.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.583+0000 7f4df2905700 1 -- 172.21.15.81:0/1229856574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dec19f310 con 0x7f4dec101fc0 2024-05-09T00:02:32.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.584+0000 7f4df2905700 1 -- 172.21.15.81:0/1229856574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dec108230 con 0x7f4dec101fc0 2024-05-09T00:02:32.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.585+0000 7f4de97fa700 1 -- 172.21.15.81:0/1229856574 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f4dd4018880 con 0x7f4dec101fc0 2024-05-09T00:02:32.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.585+0000 7f4de97fa700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f4dd80a11b0 0x7f4dd80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.585+0000 7f4debfff700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f4dd80a11b0 0x7f4dd80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.585+0000 7f4de97fa700 1 -- 172.21.15.81:0/1229856574 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4dd40ccbd0 con 0x7f4dec101fc0 2024-05-09T00:02:32.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.586+0000 7f4debfff700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f4dd80a11b0 0x7f4dd80a3670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc006010 tx=0x7f4ddc0037b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:32.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.589+0000 7f4de97fa700 1 -- 172.21.15.81:0/1229856574 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4dd4096440 con 0x7f4dec101fc0 2024-05-09T00:02:32.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:32 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3851464922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:02:32.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:32 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2541769908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:32.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:32 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3851464922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:02:32.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:32 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2541769908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.833+0000 7f4df2905700 1 -- 172.21.15.81:0/1229856574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dec067380 con 0x7f4dec101fc0 2024-05-09T00:02:32.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.834+0000 7f4de97fa700 1 -- 172.21.15.81:0/1229856574 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10864 (secure 0 0 0) 0x7f4dd4099a60 con 0x7f4dec101fc0 2024-05-09T00:02:32.828 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:32.828 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:01:50.053948+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:02:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.836+0000 7f4df2905700 1 -- 172.21.15.81:0/1229856574 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f4dd80a11b0 msgr2=0x7f4dd80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.836+0000 7f4df2905700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f4dd80a11b0 0x7f4dd80a3670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc006010 tx=0x7f4ddc0037b0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.836+0000 7f4df2905700 1 -- 172.21.15.81:0/1229856574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec101fc0 msgr2=0x7f4dec1972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.836+0000 7f4df2905700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec101fc0 0x7f4dec1972f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400c9b0 tx=0x7f4dd400cd70 comp rx=0 tx=0).stop 2024-05-09T00:02:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.836+0000 7f4df2905700 1 -- 172.21.15.81:0/1229856574 shutdown_connections 2024-05-09T00:02:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.836+0000 7f4df2905700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f4dd80a11b0 0x7f4dd80a3670 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.836+0000 7f4df2905700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dec102980 0x7f4dec19e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.836+0000 7f4df2905700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dec100e70 0x7f4dec196db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.836+0000 7f4df2905700 1 --2- 172.21.15.81:0/1229856574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dec101fc0 0x7f4dec1972f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.836+0000 7f4df2905700 1 -- 172.21.15.81:0/1229856574 >> 172.21.15.81:0/1229856574 conn(0x7f4dec0fc400 msgr2=0x7f4dec105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.836+0000 7f4df2905700 1 -- 172.21.15.81:0/1229856574 shutdown_connections 2024-05-09T00:02:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.836+0000 7f4df2905700 1 -- 172.21.15.81:0/1229856574 wait complete. 2024-05-09T00:02:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-05-09T00:02:32.842 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:32 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3851464922' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:02:32.842 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:32 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2541769908' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:32.843 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-09T00:01:45.018539+0000', 'modified': '2024-05-09T00:01:50.053948+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24506, 'mds_1': 24487, 'mds_2': 24476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6835/259351107', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6834', 'nonce': 259351107}, {'type': 'v1', 'addr': '172.21.15.171:6835', 'nonce': 259351107}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24452': {'gid': 24452, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.150:6835/2480381166', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 2480381166}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 2480381166}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6837/781467444', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6836', 'nonce': 781467444}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 781467444}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24476': {'gid': 24476, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.150:6837/2308594773', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6836', 'nonce': 2308594773}, {'type': 'v1', 'addr': '172.21.15.150:6837', 'nonce': 2308594773}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.171:6839/932961693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6838', 'nonce': 932961693}, {'type': 'v1', 'addr': '172.21.15.171:6839', 'nonce': 932961693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24506': {'gid': 24506, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6839/1233365858', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6838', 'nonce': 1233365858}, {'type': 'v1', 'addr': '172.21.15.150:6839', 'nonce': 1233365858}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-09T00:02:32.843 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-09T00:02:32.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-05-09T00:02:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.973+0000 7f5230979700 1 -- 172.21.15.81:0/3237458246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522c0ffe60 msgr2=0x7f522c100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.973+0000 7f5230979700 1 --2- 172.21.15.81:0/3237458246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522c0ffe60 0x7f522c100280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f521c009990 tx=0x7f521c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.973+0000 7f5230979700 1 -- 172.21.15.81:0/3237458246 shutdown_connections 2024-05-09T00:02:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.973+0000 7f5230979700 1 --2- 172.21.15.81:0/3237458246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f522c101970 0x7f522c108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.973+0000 7f5230979700 1 --2- 172.21.15.81:0/3237458246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522c0ffe60 0x7f522c100280 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.973+0000 7f5230979700 1 --2- 172.21.15.81:0/3237458246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f522c100fb0 0x7f522c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.973+0000 7f5230979700 1 -- 172.21.15.81:0/3237458246 >> 172.21.15.81:0/3237458246 conn(0x7f522c0fb3f0 msgr2=0x7f522c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:32.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.973+0000 7f5230979700 1 -- 172.21.15.81:0/3237458246 shutdown_connections 2024-05-09T00:02:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.973+0000 7f5230979700 1 -- 172.21.15.81:0/3237458246 wait complete. 2024-05-09T00:02:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.973+0000 7f5230979700 1 Processor -- start 2024-05-09T00:02:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.973+0000 7f5230979700 1 -- start start 2024-05-09T00:02:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5230979700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f522c0ffe60 0x7f522c196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5230979700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522c100fb0 0x7f522c197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5230979700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f522c101970 0x7f522c19e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5230979700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c19ea40 con 0x7f522c100fb0 2024-05-09T00:02:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5230979700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c19eb80 con 0x7f522c0ffe60 2024-05-09T00:02:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5230979700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c19ed10 con 0x7f522c101970 2024-05-09T00:02:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5229d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522c100fb0 0x7f522c197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5229d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522c100fb0 0x7f522c197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35918/0 (socket says 172.21.15.81:35918) 2024-05-09T00:02:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5229d9b700 1 -- 172.21.15.81:0/1086076810 learned_addr learned my addr 172.21.15.81:0/1086076810 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f522a59c700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f522c0ffe60 0x7f522c196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f522ad9d700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f522c101970 0x7f522c19e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5229d9b700 1 -- 172.21.15.81:0/1086076810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f522c101970 msgr2=0x7f522c19e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5229d9b700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f522c101970 0x7f522c19e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5229d9b700 1 -- 172.21.15.81:0/1086076810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f522c0ffe60 msgr2=0x7f522c196f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5229d9b700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f522c0ffe60 0x7f522c196f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5229d9b700 1 -- 172.21.15.81:0/1086076810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c0095f0 con 0x7f522c100fb0 2024-05-09T00:02:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f522a59c700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f522c0ffe60 0x7f522c196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5229d9b700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522c100fb0 0x7f522c197450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f522000e9a0 tx=0x7f522000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f521b7fe700 1 -- 172.21.15.81:0/1086076810 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220009790 con 0x7f522c100fb0 2024-05-09T00:02:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f521b7fe700 1 -- 172.21.15.81:0/1086076810 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f522000cbd0 con 0x7f522c100fb0 2024-05-09T00:02:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5230979700 1 -- 172.21.15.81:0/1086076810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c19eff0 con 0x7f522c100fb0 2024-05-09T00:02:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f521b7fe700 1 -- 172.21.15.81:0/1086076810 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220018680 con 0x7f522c100fb0 2024-05-09T00:02:32.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.974+0000 7f5230979700 1 -- 172.21.15.81:0/1086076810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c19f470 con 0x7f522c100fb0 2024-05-09T00:02:32.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.976+0000 7f521b7fe700 1 -- 172.21.15.81:0/1086076810 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f522000cd40 con 0x7f522c100fb0 2024-05-09T00:02:32.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.977+0000 7f521b7fe700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f52140a1230 0x7f52140a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.977+0000 7f522a59c700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f52140a1230 0x7f52140a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.977+0000 7f521b7fe700 1 -- 172.21.15.81:0/1086076810 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5220014070 con 0x7f522c100fb0 2024-05-09T00:02:32.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.977+0000 7f522a59c700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f52140a1230 0x7f52140a36f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f521c00b750 tx=0x7f521c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:32.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.978+0000 7f523cb33b80 1 Processor -- start 2024-05-09T00:02:32.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.978+0000 7f523cb33b80 1 -- start start 2024-05-09T00:02:32.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.978+0000 7f523cb33b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a4194f0 0x55ad4a419910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.978+0000 7f523cb33b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a419e50 0x55ad4a41a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.978+0000 7f523cb33b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a41a810 0x55ad4a41ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.978+0000 7f523cb33b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4a370100 con 0x55ad4a41a810 2024-05-09T00:02:32.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.978+0000 7f523cb33b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4a36dac0 con 0x55ad4a4194f0 2024-05-09T00:02:32.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.978+0000 7f523cb33b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4a3693b0 con 0x55ad4a419e50 2024-05-09T00:02:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.978+0000 7f522ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a41a810 0x55ad4a41ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.978+0000 7f522ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a41a810 0x55ad4a41ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35924/0 (socket says 172.21.15.81:35924) 2024-05-09T00:02:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.978+0000 7f522ad9d700 1 -- 172.21.15.81:0/765840857 learned_addr learned my addr 172.21.15.81:0/765840857 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.979+0000 7f5229d9b700 1 --2- 172.21.15.81:0/765840857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a419e50 0x55ad4a41a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.979+0000 7f522ad9d700 1 -- 172.21.15.81:0/765840857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a419e50 msgr2=0x55ad4a41a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.979+0000 7f522a59c700 1 --2- 172.21.15.81:0/765840857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a4194f0 0x55ad4a419910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.979+0000 7f522ad9d700 1 --2- 172.21.15.81:0/765840857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a419e50 0x55ad4a41a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.979+0000 7f522ad9d700 1 -- 172.21.15.81:0/765840857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a4194f0 msgr2=0x55ad4a419910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.979+0000 7f522ad9d700 1 --2- 172.21.15.81:0/765840857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a4194f0 0x55ad4a419910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.979+0000 7f522ad9d700 1 -- 172.21.15.81:0/765840857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad4a1ea360 con 0x55ad4a41a810 2024-05-09T00:02:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.979+0000 7f522a59c700 1 --2- 172.21.15.81:0/765840857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a4194f0 0x55ad4a419910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.979+0000 7f522ad9d700 1 --2- 172.21.15.81:0/765840857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a41a810 0x55ad4a41ac90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f52240060b0 tx=0x7f5224007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd014d028ccc3f0e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.979+0000 7f5218ff9700 1 -- 172.21.15.81:0/765840857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224003c00 con 0x55ad4a41a810 2024-05-09T00:02:32.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.979+0000 7f5218ff9700 1 -- 172.21.15.81:0/765840857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5224007e40 con 0x55ad4a41a810 2024-05-09T00:02:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.979+0000 7f5218ff9700 1 -- 172.21.15.81:0/765840857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224014780 con 0x55ad4a41a810 2024-05-09T00:02:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.980+0000 7f523cb33b80 1 -- 172.21.15.81:0/765840857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a41a810 msgr2=0x55ad4a41ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.980+0000 7f523cb33b80 1 --2- 172.21.15.81:0/765840857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a41a810 0x55ad4a41ac90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f52240060b0 tx=0x7f5224007500 comp rx=0 tx=0).stop 2024-05-09T00:02:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.980+0000 7f523cb33b80 1 -- 172.21.15.81:0/765840857 shutdown_connections 2024-05-09T00:02:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.980+0000 7f523cb33b80 1 --2- 172.21.15.81:0/765840857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a4194f0 0x55ad4a419910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.980+0000 7f523cb33b80 1 --2- 172.21.15.81:0/765840857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a41a810 0x55ad4a41ac90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.980+0000 7f523cb33b80 1 --2- 172.21.15.81:0/765840857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a419e50 0x55ad4a41a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.980+0000 7f523cb33b80 1 -- 172.21.15.81:0/765840857 >> 172.21.15.81:0/765840857 conn(0x55ad4a3771c0 msgr2=0x55ad4a413d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.980+0000 7f523cb33b80 1 -- 172.21.15.81:0/765840857 shutdown_connections 2024-05-09T00:02:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.980+0000 7f523cb33b80 1 -- 172.21.15.81:0/765840857 wait complete. 2024-05-09T00:02:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.980+0000 7f523cb33b80 1 -- start start 2024-05-09T00:02:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.980+0000 7f523cb33b80 1 Processor -- start 2024-05-09T00:02:32.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.980+0000 7f523cb33b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a4194f0 0x55ad4a422e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.980+0000 7f523cb33b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a419e50 0x55ad4a4233d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.980+0000 7f523cb33b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a41a810 0x55ad4a42a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f523cb33b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4a305510 con 0x55ad4a419e50 2024-05-09T00:02:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f523cb33b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4a3051b0 con 0x55ad4a4194f0 2024-05-09T00:02:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f523cb33b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4a1ec650 con 0x55ad4a41a810 2024-05-09T00:02:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f523cb33b80 10 client.0 _ll_register_callbacks cb 0x55ad4a30eae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:02:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f5229d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a419e50 0x55ad4a4233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f5229d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a419e50 0x55ad4a4233d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35940/0 (socket says 172.21.15.81:35940) 2024-05-09T00:02:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f5229d9b700 1 -- 172.21.15.81:0/2131151447 learned_addr learned my addr 172.21.15.81:0/2131151447 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f522ad9d700 1 --2- 172.21.15.81:0/2131151447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a41a810 0x55ad4a42a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f5229d9b700 1 -- 172.21.15.81:0/2131151447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a41a810 msgr2=0x55ad4a42a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f522a59c700 1 --2- 172.21.15.81:0/2131151447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a4194f0 0x55ad4a422e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f5229d9b700 1 --2- 172.21.15.81:0/2131151447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a41a810 0x55ad4a42a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f5229d9b700 1 -- 172.21.15.81:0/2131151447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a4194f0 msgr2=0x55ad4a422e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f5229d9b700 1 --2- 172.21.15.81:0/2131151447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a4194f0 0x55ad4a422e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f5229d9b700 1 -- 172.21.15.81:0/2131151447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5224009920 con 0x55ad4a419e50 2024-05-09T00:02:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f522a59c700 1 --2- 172.21.15.81:0/2131151447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a4194f0 0x55ad4a422e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f5229d9b700 1 --2- 172.21.15.81:0/2131151447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a419e50 0x55ad4a4233d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5220099fd0 tx=0x7f522009a580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cb2fa4321f5632 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f5211ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:02:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f5211ffb700 1 -- 172.21.15.81:0/2131151447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52200a24c0 con 0x55ad4a419e50 2024-05-09T00:02:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f5211ffb700 1 -- 172.21.15.81:0/2131151447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5220095e30 con 0x55ad4a419e50 2024-05-09T00:02:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f523cb33b80 1 -- 172.21.15.81:0/2131151447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad4a2c2220 con 0x55ad4a419e50 2024-05-09T00:02:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f5211ffb700 1 -- 172.21.15.81:0/2131151447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5220095ff0 con 0x55ad4a419e50 2024-05-09T00:02:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f523cb33b80 10 client.15066 fetch_fsmap learned FSMap version 23 2024-05-09T00:02:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.981+0000 7f523cb33b80 1 -- 172.21.15.81:0/2131151447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ad4a196b10 con 0x55ad4a419e50 2024-05-09T00:02:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.982+0000 7f5211ffb700 1 -- 172.21.15.81:0/2131151447 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ad4a2c2220 con 0x55ad4a419e50 2024-05-09T00:02:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.982+0000 7f5211ffb700 1 -- 172.21.15.81:0/2131151447 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f522009ef50 con 0x55ad4a419e50 2024-05-09T00:02:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.982+0000 7f523cb33b80 10 client.15066 fetch_fsmap finished waiting for FSMap version 23 2024-05-09T00:02:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.982+0000 7f523cb33b80 10 client.15066 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-09T00:02:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.982+0000 7f523cb33b80 20 client.15066 populate_metadata read hostname 'smithi081' 2024-05-09T00:02:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.982+0000 7f523cb33b80 1 --2- 172.21.15.81:0/2131151447 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ad4a42dea0 0x55ad4a4331c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.982+0000 7f523cb33b80 4 client.15066 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:02:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.982+0000 7f523cb33b80 1 -- 172.21.15.81:0/2131151447 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad4a3e87c0 con 0x55ad4a42dea0 2024-05-09T00:02:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.982+0000 7f522a59c700 1 --2- 172.21.15.81:0/2131151447 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ad4a42dea0 0x55ad4a4331c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.982+0000 7f5211ffb700 10 client.15066 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:02:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.982+0000 7f522a59c700 1 --2- 172.21.15.81:0/2131151447 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ad4a42dea0 0x55ad4a4331c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a33f3723097f8dc2 server_cookie=f4e2b44b4bce8da7 in_seq=0 out_seq=0 2024-05-09T00:02:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.983+0000 7f5211ffb700 1 -- 172.21.15.81:0/2131151447 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ad4a3e87c0 con 0x55ad4a42dea0 2024-05-09T00:02:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.983+0000 7f5211ffb700 10 client.15066 handle_command_reply: tid=0 2024-05-09T00:02:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.983+0000 7f523cb33b80 1 client.15066 shutdown 2024-05-09T00:02:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.983+0000 7f523cb33b80 1 -- 172.21.15.81:0/2131151447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a419e50 msgr2=0x55ad4a4233d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.983+0000 7f523cb33b80 1 --2- 172.21.15.81:0/2131151447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a419e50 0x55ad4a4233d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5220099fd0 tx=0x7f522009a580 comp rx=0 tx=0).stop 2024-05-09T00:02:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.983+0000 7f523cb33b80 1 -- 172.21.15.81:0/2131151447 shutdown_connections 2024-05-09T00:02:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.983+0000 7f523cb33b80 1 --2- 172.21.15.81:0/2131151447 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ad4a42dea0 0x55ad4a4331c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.983+0000 7f523cb33b80 1 --2- 172.21.15.81:0/2131151447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a4194f0 0x55ad4a422e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.983+0000 7f5211ffb700 0 client.15066 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:02:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.983+0000 7f523cb33b80 1 --2- 172.21.15.81:0/2131151447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a41a810 0x55ad4a42a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.983+0000 7f523cb33b80 1 --2- 172.21.15.81:0/2131151447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a419e50 0x55ad4a4233d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.983+0000 7f523cb33b80 1 -- 172.21.15.81:0/2131151447 >> 172.21.15.81:0/2131151447 conn(0x55ad4a3771c0 msgr2=0x55ad4a413550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.983+0000 7f523cb33b80 1 -- 172.21.15.81:0/2131151447 shutdown_connections 2024-05-09T00:02:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.983+0000 7f523cb33b80 1 -- 172.21.15.81:0/2131151447 wait complete. 2024-05-09T00:02:32.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:32.984+0000 7f523cb33b80 20 client.15066 trim_cache size 0 max 16384 2024-05-09T00:02:33.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.001+0000 7f523cb33b80 1 Processor -- start 2024-05-09T00:02:33.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.001+0000 7f523cb33b80 1 -- start start 2024-05-09T00:02:33.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.001+0000 7f523cb33b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a4194f0 0x55ad4a4198d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.001+0000 7f523cb33b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a419e50 0x55ad4a421a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.001+0000 7f523cb33b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a41a810 0x55ad4a42a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.001+0000 7f523cb33b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4a2c2220 con 0x55ad4a419e50 2024-05-09T00:02:33.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.001+0000 7f523cb33b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4a42c050 con 0x55ad4a41a810 2024-05-09T00:02:33.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.001+0000 7f523cb33b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4a3272b0 con 0x55ad4a4194f0 2024-05-09T00:02:33.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.002+0000 7f5229d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a419e50 0x55ad4a421a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.002+0000 7f5229d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a419e50 0x55ad4a421a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35956/0 (socket says 172.21.15.81:35956) 2024-05-09T00:02:33.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.002+0000 7f5229d9b700 1 -- 172.21.15.81:0/3151666388 learned_addr learned my addr 172.21.15.81:0/3151666388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:33.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.002+0000 7f522ad9d700 1 --2- 172.21.15.81:0/3151666388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a41a810 0x55ad4a42a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.002+0000 7f5229d9b700 1 -- 172.21.15.81:0/3151666388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a4194f0 msgr2=0x55ad4a4198d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.002+0000 7f5229d9b700 1 --2- 172.21.15.81:0/3151666388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a4194f0 0x55ad4a4198d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.002+0000 7f5229d9b700 1 -- 172.21.15.81:0/3151666388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a41a810 msgr2=0x55ad4a42a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.002+0000 7f5229d9b700 1 --2- 172.21.15.81:0/3151666388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a41a810 0x55ad4a42a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.002+0000 7f5229d9b700 1 -- 172.21.15.81:0/3151666388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad4a32f510 con 0x55ad4a419e50 2024-05-09T00:02:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.002+0000 7f5229d9b700 1 --2- 172.21.15.81:0/3151666388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a419e50 0x55ad4a421a90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5220099d40 tx=0x7f5220099c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9ea7cb2bbc0e7f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.002+0000 7f52197fa700 1 -- 172.21.15.81:0/3151666388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522009a0b0 con 0x55ad4a419e50 2024-05-09T00:02:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.002+0000 7f52197fa700 1 -- 172.21.15.81:0/3151666388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f522009ab20 con 0x55ad4a419e50 2024-05-09T00:02:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.002+0000 7f52197fa700 1 -- 172.21.15.81:0/3151666388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522009ed90 con 0x55ad4a419e50 2024-05-09T00:02:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 -- 172.21.15.81:0/3151666388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a419e50 msgr2=0x55ad4a421a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 --2- 172.21.15.81:0/3151666388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a419e50 0x55ad4a421a90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5220099d40 tx=0x7f5220099c20 comp rx=0 tx=0).stop 2024-05-09T00:02:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 -- 172.21.15.81:0/3151666388 shutdown_connections 2024-05-09T00:02:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 --2- 172.21.15.81:0/3151666388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a41a810 0x55ad4a42a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 --2- 172.21.15.81:0/3151666388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a4194f0 0x55ad4a4198d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 --2- 172.21.15.81:0/3151666388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a419e50 0x55ad4a421a90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 -- 172.21.15.81:0/3151666388 >> 172.21.15.81:0/3151666388 conn(0x55ad4a3771c0 msgr2=0x55ad4a4101c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 -- 172.21.15.81:0/3151666388 shutdown_connections 2024-05-09T00:02:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 -- 172.21.15.81:0/3151666388 wait complete. 2024-05-09T00:02:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 -- start start 2024-05-09T00:02:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 Processor -- start 2024-05-09T00:02:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a4194f0 0x55ad4a429bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a419e50 0x55ad4a42a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a41a810 0x55ad4a4267d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4a426df0 con 0x55ad4a4194f0 2024-05-09T00:02:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4a426f60 con 0x55ad4a41a810 2024-05-09T00:02:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad4a427120 con 0x55ad4a419e50 2024-05-09T00:02:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f523cb33b80 10 client.0 _ll_register_callbacks cb 0x55ad4a30eae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:02:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f522a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a4194f0 0x55ad4a429bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f522a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a4194f0 0x55ad4a429bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35972/0 (socket says 172.21.15.81:35972) 2024-05-09T00:02:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f522a59c700 1 -- 172.21.15.81:0/524711986 learned_addr learned my addr 172.21.15.81:0/524711986 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.003+0000 7f522ad9d700 1 --2- 172.21.15.81:0/524711986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a41a810 0x55ad4a4267d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f522a59c700 1 -- 172.21.15.81:0/524711986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a419e50 msgr2=0x55ad4a42a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f5229d9b700 1 --2- 172.21.15.81:0/524711986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a419e50 0x55ad4a42a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f522a59c700 1 --2- 172.21.15.81:0/524711986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a419e50 0x55ad4a42a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f522a59c700 1 -- 172.21.15.81:0/524711986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a41a810 msgr2=0x55ad4a4267d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f522a59c700 1 --2- 172.21.15.81:0/524711986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a41a810 0x55ad4a4267d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f522a59c700 1 -- 172.21.15.81:0/524711986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad4a196b10 con 0x55ad4a4194f0 2024-05-09T00:02:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f522ad9d700 1 --2- 172.21.15.81:0/524711986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a41a810 0x55ad4a4267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f522a59c700 1 --2- 172.21.15.81:0/524711986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a4194f0 0x55ad4a429bc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f521c000c00 tx=0x7f521c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5102de8362b2f635 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f5211ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:02:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f5211ffb700 1 -- 172.21.15.81:0/524711986 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521c0332f0 con 0x55ad4a4194f0 2024-05-09T00:02:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f5211ffb700 1 -- 172.21.15.81:0/524711986 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f521c033450 con 0x55ad4a4194f0 2024-05-09T00:02:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f523cb33b80 1 -- 172.21.15.81:0/524711986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5224007e40 con 0x55ad4a4194f0 2024-05-09T00:02:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f5211ffb700 1 -- 172.21.15.81:0/524711986 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f521c033610 con 0x55ad4a4194f0 2024-05-09T00:02:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f523cb33b80 10 client.15072 fetch_fsmap learned FSMap version 23 2024-05-09T00:02:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f523cb33b80 1 -- 172.21.15.81:0/524711986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ad4a1eec80 con 0x55ad4a4194f0 2024-05-09T00:02:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f5211ffb700 1 -- 172.21.15.81:0/524711986 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5224007e40 con 0x55ad4a4194f0 2024-05-09T00:02:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f5211ffb700 1 -- 172.21.15.81:0/524711986 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f521c00f460 con 0x55ad4a4194f0 2024-05-09T00:02:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f523cb33b80 10 client.15072 fetch_fsmap finished waiting for FSMap version 23 2024-05-09T00:02:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f523cb33b80 10 client.15072 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-09T00:02:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f523cb33b80 20 client.15072 populate_metadata read hostname 'smithi081' 2024-05-09T00:02:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f523cb33b80 1 --2- 172.21.15.81:0/524711986 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ad4a4897e0 0x55ad4a486190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f523cb33b80 4 client.15072 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T00:02:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.004+0000 7f523cb33b80 1 -- 172.21.15.81:0/524711986 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ad4a361e70 con 0x55ad4a4897e0 2024-05-09T00:02:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.005+0000 7f5229d9b700 1 --2- 172.21.15.81:0/524711986 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ad4a4897e0 0x55ad4a486190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.005+0000 7f5211ffb700 10 client.15072 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:02:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.005+0000 7f5229d9b700 1 --2- 172.21.15.81:0/524711986 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ad4a4897e0 0x55ad4a486190 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1e0deb1acf552749 server_cookie=6441b2b199702ae4 in_seq=0 out_seq=0 2024-05-09T00:02:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.005+0000 7f5211ffb700 1 -- 172.21.15.81:0/524711986 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55ad4a361e70 con 0x55ad4a4897e0 2024-05-09T00:02:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.005+0000 7f5211ffb700 10 client.15072 handle_command_reply: tid=0 2024-05-09T00:02:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.005+0000 7f523cb33b80 1 client.15072 shutdown 2024-05-09T00:02:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.005+0000 7f523cb33b80 1 -- 172.21.15.81:0/524711986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a4194f0 msgr2=0x55ad4a429bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.005+0000 7f523cb33b80 1 --2- 172.21.15.81:0/524711986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a4194f0 0x55ad4a429bc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f521c000c00 tx=0x7f521c009310 comp rx=0 tx=0).stop 2024-05-09T00:02:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.005+0000 7f523cb33b80 1 -- 172.21.15.81:0/524711986 shutdown_connections 2024-05-09T00:02:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.005+0000 7f523cb33b80 1 --2- 172.21.15.81:0/524711986 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ad4a4897e0 0x55ad4a486190 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.005+0000 7f523cb33b80 1 --2- 172.21.15.81:0/524711986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ad4a41a810 0x55ad4a4267d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.005+0000 7f523cb33b80 1 --2- 172.21.15.81:0/524711986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ad4a4194f0 0x55ad4a429bc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.005+0000 7f5211ffb700 0 client.15072 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:02:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.005+0000 7f523cb33b80 1 --2- 172.21.15.81:0/524711986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ad4a419e50 0x55ad4a42a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f523cb33b80 1 -- 172.21.15.81:0/524711986 >> 172.21.15.81:0/524711986 conn(0x55ad4a3771c0 msgr2=0x55ad4a41abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f523cb33b80 1 -- 172.21.15.81:0/524711986 shutdown_connections 2024-05-09T00:02:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f523cb33b80 1 -- 172.21.15.81:0/524711986 wait complete. 2024-05-09T00:02:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f523cb33b80 20 client.15072 trim_cache size 0 max 16384 2024-05-09T00:02:33.008 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:02:33.008 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "6c93ddc4-0d96-11ef-bc97-c7b262605968", 2024-05-09T00:02:33.008 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-05-09T00:02:33.008 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24476, 2024-05-09T00:02:33.008 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-09T00:02:33.008 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-09T00:02:33.008 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-09T00:02:33.008 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 43.958233079000003, 2024-05-09T00:02:33.008 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 23, 2024-05-09T00:02:33.008 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 79, 2024-05-09T00:02:33.008 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T00:02:33.008 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 60.413536211999997 2024-05-09T00:02:33.008 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:02:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f5230979700 1 -- 172.21.15.81:0/1086076810 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f52140a1230 msgr2=0x7f52140a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f5230979700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f52140a1230 0x7f52140a36f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f521c00b750 tx=0x7f521c005fb0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f5230979700 1 -- 172.21.15.81:0/1086076810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522c100fb0 msgr2=0x7f522c197450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f5230979700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522c100fb0 0x7f522c197450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f522000e9a0 tx=0x7f522000ed60 comp rx=0 tx=0).stop 2024-05-09T00:02:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f5230979700 1 -- 172.21.15.81:0/1086076810 shutdown_connections 2024-05-09T00:02:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f5230979700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f52140a1230 0x7f52140a36f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f5230979700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f522c0ffe60 0x7f522c196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f5230979700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f522c101970 0x7f522c19e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f5230979700 1 --2- 172.21.15.81:0/1086076810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f522c100fb0 0x7f522c197450 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f5230979700 1 -- 172.21.15.81:0/1086076810 >> 172.21.15.81:0/1086076810 conn(0x7f522c0fb3f0 msgr2=0x7f522c068060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f5230979700 1 -- 172.21.15.81:0/1086076810 shutdown_connections 2024-05-09T00:02:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.006+0000 7f5230979700 1 -- 172.21.15.81:0/1086076810 wait complete. 2024-05-09T00:02:33.012 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-05-09T00:02:33.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.143+0000 7f767e019700 1 -- 172.21.15.81:0/4095872392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76780ffe60 msgr2=0x7f7678100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.143+0000 7f767e019700 1 --2- 172.21.15.81:0/4095872392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76780ffe60 0x7f7678100280 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7668009990 tx=0x7f7668009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.144+0000 7f767e019700 1 -- 172.21.15.81:0/4095872392 shutdown_connections 2024-05-09T00:02:33.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.144+0000 7f767e019700 1 --2- 172.21.15.81:0/4095872392 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7678101970 0x7f7678108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.144+0000 7f767e019700 1 --2- 172.21.15.81:0/4095872392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76780ffe60 0x7f7678100280 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.144+0000 7f767e019700 1 --2- 172.21.15.81:0/4095872392 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7678100fb0 0x7f7678101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.144+0000 7f767e019700 1 -- 172.21.15.81:0/4095872392 >> 172.21.15.81:0/4095872392 conn(0x7f76780fb3f0 msgr2=0x7f76780fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.144+0000 7f767e019700 1 -- 172.21.15.81:0/4095872392 shutdown_connections 2024-05-09T00:02:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.144+0000 7f767e019700 1 -- 172.21.15.81:0/4095872392 wait complete. 2024-05-09T00:02:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.144+0000 7f767e019700 1 Processor -- start 2024-05-09T00:02:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.144+0000 7f767e019700 1 -- start start 2024-05-09T00:02:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f767e019700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76780ffe60 0x7f7678103ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f767e019700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678100fb0 0x7f76781025c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f767e019700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7678101970 0x7f7678102b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f767e019700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7678103200 con 0x7f7678100fb0 2024-05-09T00:02:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f767e019700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7678103370 con 0x7f76780ffe60 2024-05-09T00:02:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f767e019700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76781a0f80 con 0x7f7678101970 2024-05-09T00:02:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f7676ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678100fb0 0x7f76781025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f7676ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678100fb0 0x7f76781025c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35986/0 (socket says 172.21.15.81:35986) 2024-05-09T00:02:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f7676ffd700 1 -- 172.21.15.81:0/4017615958 learned_addr learned my addr 172.21.15.81:0/4017615958 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f7677fff700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7678101970 0x7f7678102b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f76777fe700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76780ffe60 0x7f7678103ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f7676ffd700 1 -- 172.21.15.81:0/4017615958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7678101970 msgr2=0x7f7678102b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f7676ffd700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7678101970 0x7f7678102b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f7676ffd700 1 -- 172.21.15.81:0/4017615958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76780ffe60 msgr2=0x7f7678103ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f7676ffd700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76780ffe60 0x7f7678103ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f7676ffd700 1 -- 172.21.15.81:0/4017615958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76680095f0 con 0x7f7678100fb0 2024-05-09T00:02:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f76777fe700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76780ffe60 0x7f7678103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f7677fff700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7678101970 0x7f7678102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f7676ffd700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678100fb0 0x7f76781025c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f766c00d950 tx=0x7f766c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f7674ff9700 1 -- 172.21.15.81:0/4017615958 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c009b40 con 0x7f7678100fb0 2024-05-09T00:02:33.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f767e019700 1 -- 172.21.15.81:0/4017615958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76781a11e0 con 0x7f7678100fb0 2024-05-09T00:02:33.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f7674ff9700 1 -- 172.21.15.81:0/4017615958 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f766c009ca0 con 0x7f7678100fb0 2024-05-09T00:02:33.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f7674ff9700 1 -- 172.21.15.81:0/4017615958 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c00f620 con 0x7f7678100fb0 2024-05-09T00:02:33.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.145+0000 7f767e019700 1 -- 172.21.15.81:0/4017615958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76781a1740 con 0x7f7678100fb0 2024-05-09T00:02:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.148+0000 7f7674ff9700 1 -- 172.21.15.81:0/4017615958 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f766c010460 con 0x7f7678100fb0 2024-05-09T00:02:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.148+0000 7f7674ff9700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f76600a11b0 0x7f76600a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.149+0000 7f76777fe700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f76600a11b0 0x7f76600a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.149+0000 7f7674ff9700 1 -- 172.21.15.81:0/4017615958 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f766c0ccc60 con 0x7f7678100fb0 2024-05-09T00:02:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.149+0000 7f76777fe700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f76600a11b0 0x7f76600a3670 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7668000c00 tx=0x7f7668005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.149+0000 7f768a1d3b80 1 Processor -- start 2024-05-09T00:02:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.149+0000 7f768a1d3b80 1 -- start start 2024-05-09T00:02:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.149+0000 7f768a1d3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357b4f0 0x55751357b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.149+0000 7f768a1d3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357be50 0x55751357c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.149+0000 7f768a1d3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357c810 0x55751357cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.149+0000 7f768a1d3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575134d2100 con 0x55751357be50 2024-05-09T00:02:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.149+0000 7f768a1d3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575134cfac0 con 0x55751357b4f0 2024-05-09T00:02:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.149+0000 7f768a1d3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575134cb3b0 con 0x55751357c810 2024-05-09T00:02:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.150+0000 7f7676ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357be50 0x55751357c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.150+0000 7f7676ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357be50 0x55751357c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35996/0 (socket says 172.21.15.81:35996) 2024-05-09T00:02:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.150+0000 7f7676ffd700 1 -- 172.21.15.81:0/334695867 learned_addr learned my addr 172.21.15.81:0/334695867 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.150+0000 7f76777fe700 1 --2- 172.21.15.81:0/334695867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357b4f0 0x55751357b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.150+0000 7f7676ffd700 1 -- 172.21.15.81:0/334695867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357c810 msgr2=0x55751357cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.150+0000 7f7676ffd700 1 --2- 172.21.15.81:0/334695867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357c810 0x55751357cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.150+0000 7f7676ffd700 1 -- 172.21.15.81:0/334695867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357b4f0 msgr2=0x55751357b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.150+0000 7f7676ffd700 1 --2- 172.21.15.81:0/334695867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357b4f0 0x55751357b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.150+0000 7f7676ffd700 1 -- 172.21.15.81:0/334695867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55751334c360 con 0x55751357be50 2024-05-09T00:02:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.150+0000 7f76777fe700 1 --2- 172.21.15.81:0/334695867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357b4f0 0x55751357b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.150+0000 7f7676ffd700 1 --2- 172.21.15.81:0/334695867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357be50 0x55751357c2d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f766c010fd0 tx=0x7f766c099d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbf43087c96f73e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.150+0000 7f765dffb700 1 -- 172.21.15.81:0/334695867 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c09df30 con 0x55751357be50 2024-05-09T00:02:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.150+0000 7f765dffb700 1 -- 172.21.15.81:0/334695867 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f766c0a2580 con 0x55751357be50 2024-05-09T00:02:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.150+0000 7f765dffb700 1 -- 172.21.15.81:0/334695867 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0995f0 con 0x55751357be50 2024-05-09T00:02:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.151+0000 7f768a1d3b80 1 -- 172.21.15.81:0/334695867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357be50 msgr2=0x55751357c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.151+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/334695867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357be50 0x55751357c2d0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f766c010fd0 tx=0x7f766c099d70 comp rx=0 tx=0).stop 2024-05-09T00:02:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.151+0000 7f768a1d3b80 1 -- 172.21.15.81:0/334695867 shutdown_connections 2024-05-09T00:02:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.151+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/334695867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357b4f0 0x55751357b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.151+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/334695867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357c810 0x55751357cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.151+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/334695867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357be50 0x55751357c2d0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.151+0000 7f768a1d3b80 1 -- 172.21.15.81:0/334695867 >> 172.21.15.81:0/334695867 conn(0x5575134d91c0 msgr2=0x557513575d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.151+0000 7f768a1d3b80 1 -- 172.21.15.81:0/334695867 shutdown_connections 2024-05-09T00:02:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.151+0000 7f768a1d3b80 1 -- 172.21.15.81:0/334695867 wait complete. 2024-05-09T00:02:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.151+0000 7f768a1d3b80 1 -- start start 2024-05-09T00:02:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.151+0000 7f768a1d3b80 1 Processor -- start 2024-05-09T00:02:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f768a1d3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357b4f0 0x557513584c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f768a1d3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357be50 0x557513585180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f768a1d3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357c810 0x55751358c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f768a1d3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557513467510 con 0x55751357c810 2024-05-09T00:02:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f768a1d3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575134671b0 con 0x55751357be50 2024-05-09T00:02:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f768a1d3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751334e650 con 0x55751357b4f0 2024-05-09T00:02:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f768a1d3b80 10 client.0 _ll_register_callbacks cb 0x557513470ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:02:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f7677fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357c810 0x55751358c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f7677fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357c810 0x55751358c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36000/0 (socket says 172.21.15.81:36000) 2024-05-09T00:02:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f7677fff700 1 -- 172.21.15.81:0/1430816105 learned_addr learned my addr 172.21.15.81:0/1430816105 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f76777fe700 1 --2- 172.21.15.81:0/1430816105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357b4f0 0x557513584c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f7676ffd700 1 --2- 172.21.15.81:0/1430816105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357be50 0x557513585180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f7677fff700 1 -- 172.21.15.81:0/1430816105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357b4f0 msgr2=0x557513584c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f7677fff700 1 --2- 172.21.15.81:0/1430816105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357b4f0 0x557513584c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f7677fff700 1 -- 172.21.15.81:0/1430816105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357be50 msgr2=0x557513585180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f7677fff700 1 --2- 172.21.15.81:0/1430816105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357be50 0x557513585180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f7677fff700 1 -- 172.21.15.81:0/1430816105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76781a1740 con 0x55751357c810 2024-05-09T00:02:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f7677fff700 1 --2- 172.21.15.81:0/1430816105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357c810 0x55751358c1c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7670008ba0 tx=0x7f7670008eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83dbb56b8b82444 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f7656ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:02:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f7656ffd700 1 -- 172.21.15.81:0/1430816105 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670018070 con 0x55751357c810 2024-05-09T00:02:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f7656ffd700 1 -- 172.21.15.81:0/1430816105 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7670003a00 con 0x55751357c810 2024-05-09T00:02:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.152+0000 7f768a1d3b80 1 -- 172.21.15.81:0/1430816105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557513424220 con 0x55751357c810 2024-05-09T00:02:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.153+0000 7f7656ffd700 1 -- 172.21.15.81:0/1430816105 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7670003bc0 con 0x55751357c810 2024-05-09T00:02:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.153+0000 7f768a1d3b80 10 client.15084 fetch_fsmap learned FSMap version 23 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.153+0000 7f768a1d3b80 1 -- 172.21.15.81:0/1430816105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5575132f8b10 con 0x55751357c810 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.153+0000 7f7656ffd700 1 -- 172.21.15.81:0/1430816105 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557513424220 con 0x55751357c810 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.153+0000 7f7656ffd700 1 -- 172.21.15.81:0/1430816105 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f767001b020 con 0x55751357c810 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.153+0000 7f768a1d3b80 10 client.15084 fetch_fsmap finished waiting for FSMap version 23 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.153+0000 7f768a1d3b80 10 client.15084 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.153+0000 7f768a1d3b80 20 client.15084 populate_metadata read hostname 'smithi081' 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.153+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/1430816105 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55751358f330 0x557513595110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.153+0000 7f768a1d3b80 4 client.15084 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.153+0000 7f768a1d3b80 1 -- 172.21.15.81:0/1430816105 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55751354a7c0 con 0x55751358f330 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.153+0000 7f76777fe700 1 --2- 172.21.15.81:0/1430816105 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55751358f330 0x557513595110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.154+0000 7f7656ffd700 10 client.15084 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.154+0000 7f76777fe700 1 --2- 172.21.15.81:0/1430816105 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55751358f330 0x557513595110 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ee1c5ea358a4cc24 server_cookie=ecc8225edb74517a in_seq=0 out_seq=0 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.154+0000 7f7656ffd700 1 -- 172.21.15.81:0/1430816105 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55751354a7c0 con 0x55751358f330 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.154+0000 7f7656ffd700 10 client.15084 handle_command_reply: tid=0 2024-05-09T00:02:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.154+0000 7f768a1d3b80 1 client.15084 shutdown 2024-05-09T00:02:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.154+0000 7f768a1d3b80 1 -- 172.21.15.81:0/1430816105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357c810 msgr2=0x55751358c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.154+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/1430816105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357c810 0x55751358c1c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7670008ba0 tx=0x7f7670008eb0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.154+0000 7f768a1d3b80 1 -- 172.21.15.81:0/1430816105 shutdown_connections 2024-05-09T00:02:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.154+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/1430816105 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55751358f330 0x557513595110 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.155+0000 7f7656ffd700 0 client.15084 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:02:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.154+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/1430816105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357c810 0x55751358c1c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.155+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/1430816105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357b4f0 0x557513584c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.155+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/1430816105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357be50 0x557513585180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.155+0000 7f768a1d3b80 1 -- 172.21.15.81:0/1430816105 >> 172.21.15.81:0/1430816105 conn(0x5575134d91c0 msgr2=0x557513575550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.155+0000 7f768a1d3b80 1 -- 172.21.15.81:0/1430816105 shutdown_connections 2024-05-09T00:02:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.155+0000 7f768a1d3b80 1 -- 172.21.15.81:0/1430816105 wait complete. 2024-05-09T00:02:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.155+0000 7f768a1d3b80 20 client.15084 trim_cache size 0 max 16384 2024-05-09T00:02:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.172+0000 7f768a1d3b80 1 Processor -- start 2024-05-09T00:02:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.172+0000 7f768a1d3b80 1 -- start start 2024-05-09T00:02:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.172+0000 7f768a1d3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357b4f0 0x55751358cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.172+0000 7f768a1d3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357be50 0x55751357b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f768a1d3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357c810 0x557513584150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f768a1d3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557513576b40 con 0x55751357be50 2024-05-09T00:02:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f768a1d3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557513585b40 con 0x55751357c810 2024-05-09T00:02:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f768a1d3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575135847b0 con 0x55751357b4f0 2024-05-09T00:02:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f7676ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357be50 0x55751357b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f7676ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357be50 0x55751357b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36016/0 (socket says 172.21.15.81:36016) 2024-05-09T00:02:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f7676ffd700 1 -- 172.21.15.81:0/1045256660 learned_addr learned my addr 172.21.15.81:0/1045256660 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f76777fe700 1 --2- 172.21.15.81:0/1045256660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357b4f0 0x55751358cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f7676ffd700 1 -- 172.21.15.81:0/1045256660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357b4f0 msgr2=0x55751358cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f7676ffd700 1 --2- 172.21.15.81:0/1045256660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357b4f0 0x55751358cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f7676ffd700 1 -- 172.21.15.81:0/1045256660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357c810 msgr2=0x557513584150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f7676ffd700 1 --2- 172.21.15.81:0/1045256660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357c810 0x557513584150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f7676ffd700 1 -- 172.21.15.81:0/1045256660 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557513491510 con 0x55751357be50 2024-05-09T00:02:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f7676ffd700 1 --2- 172.21.15.81:0/1045256660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357be50 0x55751357b8d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f766c000c00 tx=0x7f766c096570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b819cceaeb5446f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f765e7fc700 1 -- 172.21.15.81:0/1045256660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c09df30 con 0x55751357be50 2024-05-09T00:02:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f765e7fc700 1 -- 172.21.15.81:0/1045256660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f766c0984a0 con 0x55751357be50 2024-05-09T00:02:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.173+0000 7f765e7fc700 1 -- 172.21.15.81:0/1045256660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c09a5c0 con 0x55751357be50 2024-05-09T00:02:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 -- 172.21.15.81:0/1045256660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357be50 msgr2=0x55751357b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/1045256660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357be50 0x55751357b8d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f766c000c00 tx=0x7f766c096570 comp rx=0 tx=0).stop 2024-05-09T00:02:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 -- 172.21.15.81:0/1045256660 shutdown_connections 2024-05-09T00:02:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/1045256660 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357c810 0x557513584150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/1045256660 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357b4f0 0x55751358cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/1045256660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357be50 0x55751357b8d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 -- 172.21.15.81:0/1045256660 >> 172.21.15.81:0/1045256660 conn(0x5575134d91c0 msgr2=0x5575135721c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 -- 172.21.15.81:0/1045256660 shutdown_connections 2024-05-09T00:02:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 -- 172.21.15.81:0/1045256660 wait complete. 2024-05-09T00:02:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 -- start start 2024-05-09T00:02:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 Processor -- start 2024-05-09T00:02:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357b4f0 0x557513574f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357be50 0x557513575450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357c810 0x55751358b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751358b920 con 0x55751357b4f0 2024-05-09T00:02:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751358ba60 con 0x55751357be50 2024-05-09T00:02:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.174+0000 7f768a1d3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751358bc20 con 0x55751357c810 2024-05-09T00:02:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f768a1d3b80 10 client.0 _ll_register_callbacks cb 0x557513470ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:02:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f76777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357b4f0 0x557513574f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f76777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357b4f0 0x557513574f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36026/0 (socket says 172.21.15.81:36026) 2024-05-09T00:02:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f76777fe700 1 -- 172.21.15.81:0/3913085363 learned_addr learned my addr 172.21.15.81:0/3913085363 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f7677fff700 1 --2- 172.21.15.81:0/3913085363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357c810 0x55751358b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f76777fe700 1 -- 172.21.15.81:0/3913085363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357c810 msgr2=0x55751358b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f76777fe700 1 --2- 172.21.15.81:0/3913085363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357c810 0x55751358b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f76777fe700 1 -- 172.21.15.81:0/3913085363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357be50 msgr2=0x557513575450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f76777fe700 1 --2- 172.21.15.81:0/3913085363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357be50 0x557513575450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f76777fe700 1 -- 172.21.15.81:0/3913085363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766c0b1040 con 0x55751357b4f0 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f76777fe700 1 --2- 172.21.15.81:0/3913085363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357b4f0 0x557513574f10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7668009990 tx=0x7f7668009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d69930186c7de2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f7656ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f7656ffd700 1 -- 172.21.15.81:0/3913085363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766800b9f0 con 0x55751357b4f0 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f7656ffd700 1 -- 172.21.15.81:0/3913085363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f766800bb50 con 0x55751357b4f0 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f768a1d3b80 1 -- 172.21.15.81:0/3913085363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f766c0a2580 con 0x55751357b4f0 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f7656ffd700 1 -- 172.21.15.81:0/3913085363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f766800bd10 con 0x55751357b4f0 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f768a1d3b80 10 client.15090 fetch_fsmap learned FSMap version 23 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f768a1d3b80 1 -- 172.21.15.81:0/3913085363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x557513350c80 con 0x55751357b4f0 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.175+0000 7f7656ffd700 1 -- 172.21.15.81:0/3913085363 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f766c0a2580 con 0x55751357b4f0 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.176+0000 7f7656ffd700 1 -- 172.21.15.81:0/3913085363 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7668044070 con 0x55751357b4f0 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.176+0000 7f768a1d3b80 10 client.15090 fetch_fsmap finished waiting for FSMap version 23 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.176+0000 7f768a1d3b80 10 client.15090 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-09T00:02:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.176+0000 7f768a1d3b80 20 client.15090 populate_metadata read hostname 'smithi081' 2024-05-09T00:02:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.176+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/3913085363 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5575135eb200 0x5575135e7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.176+0000 7f768a1d3b80 4 client.15090 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T00:02:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.176+0000 7f768a1d3b80 1 -- 172.21.15.81:0/3913085363 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5575134c3e70 con 0x5575135eb200 2024-05-09T00:02:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.176+0000 7f7676ffd700 1 --2- 172.21.15.81:0/3913085363 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5575135eb200 0x5575135e7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.176+0000 7f7656ffd700 10 client.15090 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:02:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.176+0000 7f7676ffd700 1 --2- 172.21.15.81:0/3913085363 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5575135eb200 0x5575135e7b10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d83d1c85c748cf9 server_cookie=e5820cd5e42cb3c4 in_seq=0 out_seq=0 2024-05-09T00:02:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.176+0000 7f7656ffd700 1 -- 172.21.15.81:0/3913085363 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5575134c3e70 con 0x5575135eb200 2024-05-09T00:02:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.176+0000 7f7656ffd700 10 client.15090 handle_command_reply: tid=0 2024-05-09T00:02:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.176+0000 7f768a1d3b80 1 client.15090 shutdown 2024-05-09T00:02:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f768a1d3b80 1 -- 172.21.15.81:0/3913085363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357b4f0 msgr2=0x557513574f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/3913085363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357b4f0 0x557513574f10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7668009990 tx=0x7f7668009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f768a1d3b80 1 -- 172.21.15.81:0/3913085363 shutdown_connections 2024-05-09T00:02:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/3913085363 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5575135eb200 0x5575135e7b10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/3913085363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55751357c810 0x55751358b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f7656ffd700 0 client.15090 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:02:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/3913085363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55751357b4f0 0x557513574f10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f768a1d3b80 1 --2- 172.21.15.81:0/3913085363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55751357be50 0x557513575450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f768a1d3b80 1 -- 172.21.15.81:0/3913085363 >> 172.21.15.81:0/3913085363 conn(0x5575134d91c0 msgr2=0x55751357f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f768a1d3b80 1 -- 172.21.15.81:0/3913085363 shutdown_connections 2024-05-09T00:02:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f768a1d3b80 1 -- 172.21.15.81:0/3913085363 wait complete. 2024-05-09T00:02:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f768a1d3b80 20 client.15090 trim_cache size 0 max 16384 2024-05-09T00:02:33.178 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:02:33.178 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "6c93ddc4-0d96-11ef-bc97-c7b262605968", 2024-05-09T00:02:33.178 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-05-09T00:02:33.179 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24487, 2024-05-09T00:02:33.179 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-09T00:02:33.179 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-09T00:02:33.179 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-09T00:02:33.179 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 45.138507730999997, 2024-05-09T00:02:33.179 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 23, 2024-05-09T00:02:33.179 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 79, 2024-05-09T00:02:33.179 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T00:02:33.179 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 58.874798509999998 2024-05-09T00:02:33.179 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:02:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f767e019700 1 -- 172.21.15.81:0/4017615958 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f76600a11b0 msgr2=0x7f76600a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f767e019700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f76600a11b0 0x7f76600a3670 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7668000c00 tx=0x7f7668005fb0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f767e019700 1 -- 172.21.15.81:0/4017615958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678100fb0 msgr2=0x7f76781025c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f767e019700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678100fb0 0x7f76781025c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f766c00d950 tx=0x7f766c00dd10 comp rx=0 tx=0).stop 2024-05-09T00:02:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f767e019700 1 -- 172.21.15.81:0/4017615958 shutdown_connections 2024-05-09T00:02:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f767e019700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f76600a11b0 0x7f76600a3670 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f767e019700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76780ffe60 0x7f7678103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f767e019700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7678101970 0x7f7678102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f767e019700 1 --2- 172.21.15.81:0/4017615958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7678100fb0 0x7f76781025c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f767e019700 1 -- 172.21.15.81:0/4017615958 >> 172.21.15.81:0/4017615958 conn(0x7f76780fb3f0 msgr2=0x7f7678067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f767e019700 1 -- 172.21.15.81:0/4017615958 shutdown_connections 2024-05-09T00:02:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.177+0000 7f767e019700 1 -- 172.21.15.81:0/4017615958 wait complete. 2024-05-09T00:02:33.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-09T00:02:33.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.313+0000 7f67cbd66700 1 -- 172.21.15.81:0/3471633181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67c40ff270 msgr2=0x7f67c40ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.313+0000 7f67cbd66700 1 --2- 172.21.15.81:0/3471633181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67c40ff270 0x7f67c40ff690 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009990 tx=0x7f67b4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.313+0000 7f67cbd66700 1 -- 172.21.15.81:0/3471633181 shutdown_connections 2024-05-09T00:02:33.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.313+0000 7f67cbd66700 1 --2- 172.21.15.81:0/3471633181 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67c4102c80 0x7f67c4109530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.313+0000 7f67cbd66700 1 --2- 172.21.15.81:0/3471633181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67c40ff270 0x7f67c40ff690 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.313+0000 7f67cbd66700 1 --2- 172.21.15.81:0/3471633181 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67c41022e0 0x7f67c4102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.313+0000 7f67cbd66700 1 -- 172.21.15.81:0/3471633181 >> 172.21.15.81:0/3471633181 conn(0x7f67c40fab80 msgr2=0x7f67c40fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.313+0000 7f67cbd66700 1 -- 172.21.15.81:0/3471633181 shutdown_connections 2024-05-09T00:02:33.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.313+0000 7f67cbd66700 1 -- 172.21.15.81:0/3471633181 wait complete. 2024-05-09T00:02:33.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67cbd66700 1 Processor -- start 2024-05-09T00:02:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67cbd66700 1 -- start start 2024-05-09T00:02:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67cbd66700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67c40ff270 0x7f67c4101c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67cbd66700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67c41022e0 0x7f67c4100290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67cbd66700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67c4102c80 0x7f67c41007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67cbd66700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4100f70 con 0x7f67c4102c80 2024-05-09T00:02:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67cbd66700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c41010e0 con 0x7f67c41022e0 2024-05-09T00:02:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67cbd66700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c41a0f60 con 0x7f67c40ff270 2024-05-09T00:02:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67ca303700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67c4102c80 0x7f67c41007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67ca303700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67c4102c80 0x7f67c41007d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36034/0 (socket says 172.21.15.81:36034) 2024-05-09T00:02:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67ca303700 1 -- 172.21.15.81:0/4162667861 learned_addr learned my addr 172.21.15.81:0/4162667861 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:33.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67c9301700 1 --2- 172.21.15.81:0/4162667861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67c41022e0 0x7f67c4100290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67ca303700 1 -- 172.21.15.81:0/4162667861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67c40ff270 msgr2=0x7f67c4101c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67ca303700 1 --2- 172.21.15.81:0/4162667861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67c40ff270 0x7f67c4101c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67ca303700 1 -- 172.21.15.81:0/4162667861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67c41022e0 msgr2=0x7f67c4100290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67ca303700 1 --2- 172.21.15.81:0/4162667861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67c41022e0 0x7f67c4100290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.314+0000 7f67ca303700 1 -- 172.21.15.81:0/4162667861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b40095f0 con 0x7f67c4102c80 2024-05-09T00:02:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.315+0000 7f67ca303700 1 --2- 172.21.15.81:0/4162667861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67c4102c80 0x7f67c41007d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f67bc007ee0 tx=0x7f67bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.315+0000 7f67baffd700 1 -- 172.21.15.81:0/4162667861 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc017070 con 0x7f67c4102c80 2024-05-09T00:02:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.315+0000 7f67baffd700 1 -- 172.21.15.81:0/4162667861 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67bc00f040 con 0x7f67c4102c80 2024-05-09T00:02:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.315+0000 7f67cbd66700 1 -- 172.21.15.81:0/4162667861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c41a11f0 con 0x7f67c4102c80 2024-05-09T00:02:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.315+0000 7f67baffd700 1 -- 172.21.15.81:0/4162667861 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc005740 con 0x7f67c4102c80 2024-05-09T00:02:33.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.315+0000 7f67cbd66700 1 -- 172.21.15.81:0/4162667861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c41a16b0 con 0x7f67c4102c80 2024-05-09T00:02:33.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.317+0000 7f67baffd700 1 -- 172.21.15.81:0/4162667861 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f67bc004ad0 con 0x7f67c4102c80 2024-05-09T00:02:33.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.318+0000 7f67baffd700 1 --2- 172.21.15.81:0/4162667861 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f67b00a11b0 0x7f67b00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.318+0000 7f67c9b02700 1 --2- 172.21.15.81:0/4162667861 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f67b00a11b0 0x7f67b00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.318+0000 7f67baffd700 1 -- 172.21.15.81:0/4162667861 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f67bc0cc170 con 0x7f67c4102c80 2024-05-09T00:02:33.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.318+0000 7f67c9b02700 1 --2- 172.21.15.81:0/4162667861 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f67b00a11b0 0x7f67b00a3670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f67b40098e0 tx=0x7f67b4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:33.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.318+0000 7f67d7f20b80 1 Processor -- start 2024-05-09T00:02:33.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67d7f20b80 1 -- start start 2024-05-09T00:02:33.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67d7f20b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c64f0 0x5618749c6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67d7f20b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67d7f20b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c7810 0x5618749c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67d7f20b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56187491d100 con 0x5618749c64f0 2024-05-09T00:02:33.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67d7f20b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56187491aac0 con 0x5618749c7810 2024-05-09T00:02:33.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67d7f20b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618749163b0 con 0x5618749c6e50 2024-05-09T00:02:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67c9b02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c64f0 0x5618749c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67c9b02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c64f0 0x5618749c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36042/0 (socket says 172.21.15.81:36042) 2024-05-09T00:02:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67c9b02700 1 -- 172.21.15.81:0/901133494 learned_addr learned my addr 172.21.15.81:0/901133494 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67c9301700 1 --2- 172.21.15.81:0/901133494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67ca303700 1 --2- 172.21.15.81:0/901133494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c7810 0x5618749c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67c9b02700 1 -- 172.21.15.81:0/901133494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 msgr2=0x5618749c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67c9b02700 1 --2- 172.21.15.81:0/901133494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67c9b02700 1 -- 172.21.15.81:0/901133494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c7810 msgr2=0x5618749c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67c9b02700 1 --2- 172.21.15.81:0/901133494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c7810 0x5618749c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67c9b02700 1 -- 172.21.15.81:0/901133494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561874797360 con 0x5618749c64f0 2024-05-09T00:02:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67c9b02700 1 --2- 172.21.15.81:0/901133494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c64f0 0x5618749c6910 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b7d0 tx=0x7f67b401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd7037e9af31d27 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67affff700 1 -- 172.21.15.81:0/901133494 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b401d070 con 0x5618749c64f0 2024-05-09T00:02:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.319+0000 7f67affff700 1 -- 172.21.15.81:0/901133494 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67b4003d20 con 0x5618749c64f0 2024-05-09T00:02:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.320+0000 7f67affff700 1 -- 172.21.15.81:0/901133494 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b400f920 con 0x5618749c64f0 2024-05-09T00:02:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.320+0000 7f67d7f20b80 1 -- 172.21.15.81:0/901133494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c64f0 msgr2=0x5618749c6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.320+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/901133494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c64f0 0x5618749c6910 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f67b400b7d0 tx=0x7f67b401d000 comp rx=0 tx=0).stop 2024-05-09T00:02:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.320+0000 7f67d7f20b80 1 -- 172.21.15.81:0/901133494 shutdown_connections 2024-05-09T00:02:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.320+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/901133494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c7810 0x5618749c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.320+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/901133494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c64f0 0x5618749c6910 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.320+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/901133494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.320+0000 7f67d7f20b80 1 -- 172.21.15.81:0/901133494 >> 172.21.15.81:0/901133494 conn(0x5618749241c0 msgr2=0x5618749c0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.320+0000 7f67d7f20b80 1 -- 172.21.15.81:0/901133494 shutdown_connections 2024-05-09T00:02:33.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.320+0000 7f67d7f20b80 1 -- 172.21.15.81:0/901133494 wait complete. 2024-05-09T00:02:33.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67d7f20b80 1 -- start start 2024-05-09T00:02:33.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67d7f20b80 1 Processor -- start 2024-05-09T00:02:33.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67d7f20b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c64f0 0x5618749cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67d7f20b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67d7f20b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c7810 0x5618749d7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67d7f20b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618748b2510 con 0x5618749c7810 2024-05-09T00:02:33.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67d7f20b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618748b21b0 con 0x5618749c64f0 2024-05-09T00:02:33.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67d7f20b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561874799650 con 0x5618749c6e50 2024-05-09T00:02:33.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67d7f20b80 10 client.0 _ll_register_callbacks cb 0x5618748bbae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:02:33.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67ca303700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c7810 0x5618749d7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67ca303700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c7810 0x5618749d7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36052/0 (socket says 172.21.15.81:36052) 2024-05-09T00:02:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67ca303700 1 -- 172.21.15.81:0/2736233781 learned_addr learned my addr 172.21.15.81:0/2736233781 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67c9301700 1 --2- 172.21.15.81:0/2736233781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67c9b02700 1 --2- 172.21.15.81:0/2736233781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c64f0 0x5618749cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67ca303700 1 -- 172.21.15.81:0/2736233781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 msgr2=0x5618749d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67ca303700 1 --2- 172.21.15.81:0/2736233781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67ca303700 1 -- 172.21.15.81:0/2736233781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c64f0 msgr2=0x5618749cfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67ca303700 1 --2- 172.21.15.81:0/2736233781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c64f0 0x5618749cfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.321+0000 7f67ca303700 1 -- 172.21.15.81:0/2736233781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c4109d20 con 0x5618749c7810 2024-05-09T00:02:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67c9b02700 1 --2- 172.21.15.81:0/2736233781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c64f0 0x5618749cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67ca303700 1 --2- 172.21.15.81:0/2736233781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c7810 0x5618749d7230 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0995a0 tx=0x7f67bc0990a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3fcd158e64a09a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:02:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67ad7fa700 1 -- 172.21.15.81:0/2736233781 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc005210 con 0x5618749c7810 2024-05-09T00:02:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67ad7fa700 1 -- 172.21.15.81:0/2736233781 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f67bc099610 con 0x5618749c7810 2024-05-09T00:02:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67d7f20b80 1 -- 172.21.15.81:0/2736233781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56187486f220 con 0x5618749c7810 2024-05-09T00:02:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67ad7fa700 1 -- 172.21.15.81:0/2736233781 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67bc09d440 con 0x5618749c7810 2024-05-09T00:02:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67d7f20b80 10 client.15102 fetch_fsmap learned FSMap version 23 2024-05-09T00:02:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67d7f20b80 1 -- 172.21.15.81:0/2736233781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x561874743b10 con 0x5618749c7810 2024-05-09T00:02:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67ad7fa700 1 -- 172.21.15.81:0/2736233781 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56187486f220 con 0x5618749c7810 2024-05-09T00:02:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67ad7fa700 1 -- 172.21.15.81:0/2736233781 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f67bc099870 con 0x5618749c7810 2024-05-09T00:02:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67d7f20b80 10 client.15102 fetch_fsmap finished waiting for FSMap version 23 2024-05-09T00:02:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67d7f20b80 10 client.15102 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T00:02:33.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67d7f20b80 20 client.15102 populate_metadata read hostname 'smithi081' 2024-05-09T00:02:33.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/2736233781 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5618749daf10 0x5618749e0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67d7f20b80 4 client.15102 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:02:33.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.322+0000 7f67d7f20b80 1 -- 172.21.15.81:0/2736233781 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5618749957c0 con 0x5618749daf10 2024-05-09T00:02:33.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.323+0000 7f67c9b02700 1 --2- 172.21.15.81:0/2736233781 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5618749daf10 0x5618749e0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.323+0000 7f67ad7fa700 10 client.15102 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:02:33.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.323+0000 7f67c9b02700 1 --2- 172.21.15.81:0/2736233781 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5618749daf10 0x5618749e0230 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=123afb7773bb2b65 server_cookie=b43d3d3670095b53 in_seq=0 out_seq=0 2024-05-09T00:02:33.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67ad7fa700 1 -- 172.21.15.81:0/2736233781 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5618749957c0 con 0x5618749daf10 2024-05-09T00:02:33.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67ad7fa700 10 client.15102 handle_command_reply: tid=0 2024-05-09T00:02:33.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67d7f20b80 1 client.15102 shutdown 2024-05-09T00:02:33.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67d7f20b80 1 -- 172.21.15.81:0/2736233781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c7810 msgr2=0x5618749d7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/2736233781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c7810 0x5618749d7230 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f67bc0995a0 tx=0x7f67bc0990a0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67d7f20b80 1 -- 172.21.15.81:0/2736233781 shutdown_connections 2024-05-09T00:02:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/2736233781 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5618749daf10 0x5618749e0230 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/2736233781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c64f0 0x5618749cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/2736233781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c7810 0x5618749d7230 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/2736233781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67ad7fa700 0 client.15102 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:02:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67d7f20b80 1 -- 172.21.15.81:0/2736233781 >> 172.21.15.81:0/2736233781 conn(0x5618749241c0 msgr2=0x5618749c0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67d7f20b80 1 -- 172.21.15.81:0/2736233781 shutdown_connections 2024-05-09T00:02:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67d7f20b80 1 -- 172.21.15.81:0/2736233781 wait complete. 2024-05-09T00:02:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.324+0000 7f67d7f20b80 20 client.15102 trim_cache size 0 max 16384 2024-05-09T00:02:33.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.342+0000 7f67d7f20b80 1 Processor -- start 2024-05-09T00:02:33.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.342+0000 7f67d7f20b80 1 -- start start 2024-05-09T00:02:33.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.342+0000 7f67d7f20b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c64f0 0x5618749c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.342+0000 7f67d7f20b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749d71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.342+0000 7f67d7f20b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c7810 0x5618749d78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.342+0000 7f67d7f20b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56187486f250 con 0x5618749c7810 2024-05-09T00:02:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.342+0000 7f67d7f20b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618748d42e0 con 0x5618749c64f0 2024-05-09T00:02:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.342+0000 7f67d7f20b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561874913010 con 0x5618749c6e50 2024-05-09T00:02:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.342+0000 7f67ca303700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c7810 0x5618749d78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.342+0000 7f67ca303700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c7810 0x5618749d78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36060/0 (socket says 172.21.15.81:36060) 2024-05-09T00:02:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.342+0000 7f67ca303700 1 -- 172.21.15.81:0/1392850189 learned_addr learned my addr 172.21.15.81:0/1392850189 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.342+0000 7f67c9b02700 1 --2- 172.21.15.81:0/1392850189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c64f0 0x5618749c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.342+0000 7f67c9301700 1 --2- 172.21.15.81:0/1392850189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749d71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67ca303700 1 -- 172.21.15.81:0/1392850189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 msgr2=0x5618749d71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67ca303700 1 --2- 172.21.15.81:0/1392850189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749d71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67ca303700 1 -- 172.21.15.81:0/1392850189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c64f0 msgr2=0x5618749c68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67ca303700 1 --2- 172.21.15.81:0/1392850189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c64f0 0x5618749c68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67ca303700 1 -- 172.21.15.81:0/1392850189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618748dc510 con 0x5618749c7810 2024-05-09T00:02:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67c9b02700 1 --2- 172.21.15.81:0/1392850189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c64f0 0x5618749c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67ca303700 1 --2- 172.21.15.81:0/1392850189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c7810 0x5618749d78e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f67bc099c70 tx=0x7f67bc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306570a9e5fa4415 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67b8ff9700 1 -- 172.21.15.81:0/1392850189 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc005210 con 0x5618749c7810 2024-05-09T00:02:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67b8ff9700 1 -- 172.21.15.81:0/1392850189 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67bc099610 con 0x5618749c7810 2024-05-09T00:02:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67b8ff9700 1 -- 172.21.15.81:0/1392850189 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67bc098b80 con 0x5618749c7810 2024-05-09T00:02:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67d7f20b80 1 -- 172.21.15.81:0/1392850189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c7810 msgr2=0x5618749d78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/1392850189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c7810 0x5618749d78e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f67bc099c70 tx=0x7f67bc009260 comp rx=0 tx=0).stop 2024-05-09T00:02:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67d7f20b80 1 -- 172.21.15.81:0/1392850189 shutdown_connections 2024-05-09T00:02:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/1392850189 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c64f0 0x5618749c68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/1392850189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c7810 0x5618749d78e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/1392850189 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749d71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67d7f20b80 1 -- 172.21.15.81:0/1392850189 >> 172.21.15.81:0/1392850189 conn(0x5618749241c0 msgr2=0x5618749c7bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.343+0000 7f67d7f20b80 1 -- 172.21.15.81:0/1392850189 shutdown_connections 2024-05-09T00:02:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.344+0000 7f67d7f20b80 1 -- 172.21.15.81:0/1392850189 wait complete. 2024-05-09T00:02:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.344+0000 7f67d7f20b80 1 -- start start 2024-05-09T00:02:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.344+0000 7f67d7f20b80 1 Processor -- start 2024-05-09T00:02:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.344+0000 7f67d7f20b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c64f0 0x5618749c0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.344+0000 7f67d7f20b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749d6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.344+0000 7f67d7f20b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c7810 0x5618749d6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.344+0000 7f67d7f20b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618749d6fa0 con 0x5618749c64f0 2024-05-09T00:02:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.344+0000 7f67d7f20b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618749d7110 con 0x5618749c7810 2024-05-09T00:02:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.344+0000 7f67d7f20b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618749d72d0 con 0x5618749c6e50 2024-05-09T00:02:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.344+0000 7f67d7f20b80 10 client.0 _ll_register_callbacks cb 0x5618748bbae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:02:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.344+0000 7f67c9b02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c64f0 0x5618749c0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.344+0000 7f67c9b02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c64f0 0x5618749c0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36072/0 (socket says 172.21.15.81:36072) 2024-05-09T00:02:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.344+0000 7f67c9b02700 1 -- 172.21.15.81:0/3306095478 learned_addr learned my addr 172.21.15.81:0/3306095478 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.344+0000 7f67c9301700 1 --2- 172.21.15.81:0/3306095478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749d6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67ca303700 1 --2- 172.21.15.81:0/3306095478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c7810 0x5618749d6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67c9b02700 1 -- 172.21.15.81:0/3306095478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 msgr2=0x5618749d6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67c9b02700 1 --2- 172.21.15.81:0/3306095478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749d6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67c9b02700 1 -- 172.21.15.81:0/3306095478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c7810 msgr2=0x5618749d6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67c9b02700 1 --2- 172.21.15.81:0/3306095478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c7810 0x5618749d6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67c9b02700 1 -- 172.21.15.81:0/3306095478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561874743b10 con 0x5618749c64f0 2024-05-09T00:02:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67ca303700 1 --2- 172.21.15.81:0/3306095478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c7810 0x5618749d6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67c9b02700 1 --2- 172.21.15.81:0/3306095478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c64f0 0x5618749c0760 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009990 tx=0x7f67b40037b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7814f8f37176544e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67ad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:02:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67ad7fa700 1 -- 172.21.15.81:0/3306095478 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b4033040 con 0x5618749c64f0 2024-05-09T00:02:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67ad7fa700 1 -- 172.21.15.81:0/3306095478 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f67b4005160 con 0x5618749c64f0 2024-05-09T00:02:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67d7f20b80 1 -- 172.21.15.81:0/3306095478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67b4003d20 con 0x5618749c64f0 2024-05-09T00:02:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67ad7fa700 1 -- 172.21.15.81:0/3306095478 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67b40398f0 con 0x5618749c64f0 2024-05-09T00:02:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67d7f20b80 10 client.15108 fetch_fsmap learned FSMap version 23 2024-05-09T00:02:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67d7f20b80 1 -- 172.21.15.81:0/3306095478 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56187479bc80 con 0x5618749c64f0 2024-05-09T00:02:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67ad7fa700 1 -- 172.21.15.81:0/3306095478 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f67b4003d20 con 0x5618749c64f0 2024-05-09T00:02:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67ad7fa700 1 -- 172.21.15.81:0/3306095478 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f67b400fb20 con 0x5618749c64f0 2024-05-09T00:02:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67d7f20b80 10 client.15108 fetch_fsmap finished waiting for FSMap version 23 2024-05-09T00:02:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67d7f20b80 10 client.15108 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T00:02:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67d7f20b80 20 client.15108 populate_metadata read hostname 'smithi081' 2024-05-09T00:02:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/3306095478 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561874a36360 0x561874a32d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67d7f20b80 4 client.15108 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T00:02:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.345+0000 7f67d7f20b80 1 -- 172.21.15.81:0/3306095478 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56187490ee70 con 0x561874a36360 2024-05-09T00:02:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67c9301700 1 --2- 172.21.15.81:0/3306095478 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561874a36360 0x561874a32d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67ad7fa700 10 client.15108 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:02:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67c9301700 1 --2- 172.21.15.81:0/3306095478 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561874a36360 0x561874a32d20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba83e65369001b25 server_cookie=7016f391a54797c7 in_seq=0 out_seq=0 2024-05-09T00:02:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67ad7fa700 1 -- 172.21.15.81:0/3306095478 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56187490ee70 con 0x561874a36360 2024-05-09T00:02:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67ad7fa700 10 client.15108 handle_command_reply: tid=0 2024-05-09T00:02:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67d7f20b80 1 client.15108 shutdown 2024-05-09T00:02:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67d7f20b80 1 -- 172.21.15.81:0/3306095478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c64f0 msgr2=0x5618749c0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/3306095478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c64f0 0x5618749c0760 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009990 tx=0x7f67b40037b0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67d7f20b80 1 -- 172.21.15.81:0/3306095478 shutdown_connections 2024-05-09T00:02:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/3306095478 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561874a36360 0x561874a32d20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/3306095478 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5618749c7810 0x5618749d6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/3306095478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5618749c64f0 0x5618749c0760 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67d7f20b80 1 --2- 172.21.15.81:0/3306095478 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5618749c6e50 0x5618749d6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67ad7fa700 0 client.15108 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:02:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67d7f20b80 1 -- 172.21.15.81:0/3306095478 >> 172.21.15.81:0/3306095478 conn(0x5618749241c0 msgr2=0x5618749d78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67d7f20b80 1 -- 172.21.15.81:0/3306095478 shutdown_connections 2024-05-09T00:02:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.346+0000 7f67d7f20b80 1 -- 172.21.15.81:0/3306095478 wait complete. 2024-05-09T00:02:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.347+0000 7f67d7f20b80 20 client.15108 trim_cache size 0 max 16384 2024-05-09T00:02:33.350 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:02:33.350 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "6c93ddc4-0d96-11ef-bc97-c7b262605968", 2024-05-09T00:02:33.350 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-05-09T00:02:33.350 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24506, 2024-05-09T00:02:33.350 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-09T00:02:33.350 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-09T00:02:33.350 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-09T00:02:33.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 48.325663585999997, 2024-05-09T00:02:33.351 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 23, 2024-05-09T00:02:33.351 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 79, 2024-05-09T00:02:33.351 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T00:02:33.351 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 53.881904532999997 2024-05-09T00:02:33.351 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:02:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.347+0000 7f67cbd66700 1 -- 172.21.15.81:0/4162667861 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f67b00a11b0 msgr2=0x7f67b00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.347+0000 7f67cbd66700 1 --2- 172.21.15.81:0/4162667861 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f67b00a11b0 0x7f67b00a3670 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f67b40098e0 tx=0x7f67b4005fb0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.347+0000 7f67cbd66700 1 -- 172.21.15.81:0/4162667861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67c4102c80 msgr2=0x7f67c41007d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.347+0000 7f67cbd66700 1 --2- 172.21.15.81:0/4162667861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67c4102c80 0x7f67c41007d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f67bc007ee0 tx=0x7f67bc00d3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.347+0000 7f67cbd66700 1 -- 172.21.15.81:0/4162667861 shutdown_connections 2024-05-09T00:02:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.347+0000 7f67cbd66700 1 --2- 172.21.15.81:0/4162667861 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f67b00a11b0 0x7f67b00a3670 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.347+0000 7f67cbd66700 1 --2- 172.21.15.81:0/4162667861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67c4102c80 0x7f67c41007d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.347+0000 7f67cbd66700 1 --2- 172.21.15.81:0/4162667861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f67c40ff270 0x7f67c4101c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.347+0000 7f67cbd66700 1 --2- 172.21.15.81:0/4162667861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f67c41022e0 0x7f67c4100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.347+0000 7f67cbd66700 1 -- 172.21.15.81:0/4162667861 >> 172.21.15.81:0/4162667861 conn(0x7f67c40fab80 msgr2=0x7f67c4105700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.347+0000 7f67cbd66700 1 -- 172.21.15.81:0/4162667861 shutdown_connections 2024-05-09T00:02:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:33.347+0000 7f67cbd66700 1 -- 172.21.15.81:0/4162667861 wait complete. 2024-05-09T00:02:33.354 INFO:tasks.cephadm:Setup complete, yielding 2024-05-09T00:02:33.354 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T00:02:33.367 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-05-09T00:02:33.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-09T00:02:33.588 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:33.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:33 smithi081 ceph-mon[42474]: pgmap v242: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T00:02:33.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:33 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3542577156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:33.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:33 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1229856574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:33 smithi150 ceph-mon[46187]: pgmap v242: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T00:02:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:33 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3542577156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:33.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:33 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1229856574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:33.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:33 smithi171 ceph-mon[47351]: pgmap v242: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-09T00:02:33.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:33 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3542577156' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:33.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:33 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1229856574' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:34.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.524+0000 7f8c68292700 1 -- 172.21.15.81:0/3973496959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c60101a20 msgr2=0x7f8c60108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.524+0000 7f8c68292700 1 --2- 172.21.15.81:0/3973496959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c60101a20 0x7f8c60108340 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800b0a0 tx=0x7f8c5800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.524+0000 7f8c68292700 1 -- 172.21.15.81:0/3973496959 shutdown_connections 2024-05-09T00:02:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.524+0000 7f8c68292700 1 --2- 172.21.15.81:0/3973496959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c60101a20 0x7f8c60108340 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.524+0000 7f8c68292700 1 --2- 172.21.15.81:0/3973496959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c600fff00 0x7f8c60100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.524+0000 7f8c68292700 1 --2- 172.21.15.81:0/3973496959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c60101060 0x7f8c601014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.524+0000 7f8c68292700 1 -- 172.21.15.81:0/3973496959 >> 172.21.15.81:0/3973496959 conn(0x7f8c600fb4a0 msgr2=0x7f8c600fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.525+0000 7f8c68292700 1 -- 172.21.15.81:0/3973496959 shutdown_connections 2024-05-09T00:02:34.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.525+0000 7f8c68292700 1 -- 172.21.15.81:0/3973496959 wait complete. 2024-05-09T00:02:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.525+0000 7f8c68292700 1 Processor -- start 2024-05-09T00:02:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.525+0000 7f8c68292700 1 -- start start 2024-05-09T00:02:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.525+0000 7f8c68292700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c600fff00 0x7f8c60069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:34.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.525+0000 7f8c68292700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c60101060 0x7f8c6019bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.525+0000 7f8c68292700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c60101a20 0x7f8c6019e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.525+0000 7f8c68292700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6019ebd0 con 0x7f8c600fff00 2024-05-09T00:02:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.525+0000 7f8c68292700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6019ed40 con 0x7f8c60101060 2024-05-09T00:02:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.525+0000 7f8c68292700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6019ef00 con 0x7f8c60101a20 2024-05-09T00:02:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.525+0000 7f8c6602e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c600fff00 0x7f8c60069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.525+0000 7f8c6602e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c600fff00 0x7f8c60069410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36098/0 (socket says 172.21.15.81:36098) 2024-05-09T00:02:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.525+0000 7f8c6602e700 1 -- 172.21.15.81:0/3510107536 learned_addr learned my addr 172.21.15.81:0/3510107536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.526+0000 7f8c6682f700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c60101a20 0x7f8c6019e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.526+0000 7f8c6582d700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c60101060 0x7f8c6019bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.526+0000 7f8c6602e700 1 -- 172.21.15.81:0/3510107536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c60101a20 msgr2=0x7f8c6019e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.526+0000 7f8c6602e700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c60101a20 0x7f8c6019e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.526+0000 7f8c6602e700 1 -- 172.21.15.81:0/3510107536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c60101060 msgr2=0x7f8c6019bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:34.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.526+0000 7f8c6602e700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c60101060 0x7f8c6019bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.526+0000 7f8c6602e700 1 -- 172.21.15.81:0/3510107536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c58009d00 con 0x7f8c600fff00 2024-05-09T00:02:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.526+0000 7f8c6682f700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c60101a20 0x7f8c6019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.526+0000 7f8c6602e700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c600fff00 0x7f8c60069410 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400b530 tx=0x7f8c5400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.526+0000 7f8c537fe700 1 -- 172.21.15.81:0/3510107536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c54011830 con 0x7f8c600fff00 2024-05-09T00:02:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.526+0000 7f8c537fe700 1 -- 172.21.15.81:0/3510107536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c54011e50 con 0x7f8c600fff00 2024-05-09T00:02:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.526+0000 7f8c68292700 1 -- 172.21.15.81:0/3510107536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6019f1e0 con 0x7f8c600fff00 2024-05-09T00:02:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.526+0000 7f8c537fe700 1 -- 172.21.15.81:0/3510107536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5400f2e0 con 0x7f8c600fff00 2024-05-09T00:02:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.526+0000 7f8c68292700 1 -- 172.21.15.81:0/3510107536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6019f730 con 0x7f8c600fff00 2024-05-09T00:02:34.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.527+0000 7f8c68292700 1 -- 172.21.15.81:0/3510107536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c601072b0 con 0x7f8c600fff00 2024-05-09T00:02:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.528+0000 7f8c537fe700 1 -- 172.21.15.81:0/3510107536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8c54010580 con 0x7f8c600fff00 2024-05-09T00:02:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.529+0000 7f8c537fe700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8c4c0a1230 0x7f8c4c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.529+0000 7f8c6582d700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8c4c0a1230 0x7f8c4c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.529+0000 7f8c537fe700 1 -- 172.21.15.81:0/3510107536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8c540cc7d0 con 0x7f8c600fff00 2024-05-09T00:02:34.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.529+0000 7f8c6582d700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8c4c0a1230 0x7f8c4c0a36f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c006fd0 tx=0x7f8c5c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:34.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.532+0000 7f8c537fe700 1 -- 172.21.15.81:0/3510107536 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8c540960c0 con 0x7f8c600fff00 2024-05-09T00:02:34.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.744+0000 7f8c68292700 1 -- 172.21.15.81:0/3510107536 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c6002ce10 con 0x7f8c4c0a1230 2024-05-09T00:02:34.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.745+0000 7f8c537fe700 1 -- 172.21.15.81:0/3510107536 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f8c6002ce10 con 0x7f8c4c0a1230 2024-05-09T00:02:34.740 INFO:teuthology.orchestra.run.smithi081.stdout:Backend: cephadm 2024-05-09T00:02:34.740 INFO:teuthology.orchestra.run.smithi081.stdout:Available: Yes 2024-05-09T00:02:34.740 INFO:teuthology.orchestra.run.smithi081.stdout:Paused: No 2024-05-09T00:02:34.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.747+0000 7f8c68292700 1 -- 172.21.15.81:0/3510107536 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8c4c0a1230 msgr2=0x7f8c4c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:34.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.747+0000 7f8c68292700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8c4c0a1230 0x7f8c4c0a36f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c006fd0 tx=0x7f8c5c008040 comp rx=0 tx=0).stop 2024-05-09T00:02:34.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.747+0000 7f8c68292700 1 -- 172.21.15.81:0/3510107536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c600fff00 msgr2=0x7f8c60069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:34.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.747+0000 7f8c68292700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c600fff00 0x7f8c60069410 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400b530 tx=0x7f8c5400b8f0 comp rx=0 tx=0).stop 2024-05-09T00:02:34.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.747+0000 7f8c68292700 1 -- 172.21.15.81:0/3510107536 shutdown_connections 2024-05-09T00:02:34.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.747+0000 7f8c68292700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f8c4c0a1230 0x7f8c4c0a36f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:34.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.747+0000 7f8c68292700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c60101a20 0x7f8c6019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:34.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.747+0000 7f8c68292700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c600fff00 0x7f8c60069410 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:34.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.747+0000 7f8c68292700 1 --2- 172.21.15.81:0/3510107536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8c60101060 0x7f8c6019bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:34.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.747+0000 7f8c68292700 1 -- 172.21.15.81:0/3510107536 >> 172.21.15.81:0/3510107536 conn(0x7f8c600fb4a0 msgr2=0x7f8c601043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:34.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.747+0000 7f8c68292700 1 -- 172.21.15.81:0/3510107536 shutdown_connections 2024-05-09T00:02:34.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:34.747+0000 7f8c68292700 1 -- 172.21.15.81:0/3510107536 wait complete. 2024-05-09T00:02:35.105 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-09T00:02:35.328 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:35.742 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:35 smithi081 ceph-mon[42474]: pgmap v243: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-09T00:02:35.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:35 smithi150 ceph-mon[46187]: pgmap v243: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-09T00:02:35.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:35 smithi171 ceph-mon[47351]: pgmap v243: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-05-09T00:02:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.308+0000 7f9200e8f700 1 -- 172.21.15.81:0/2987099103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc1021e0 msgr2=0x7f91fc102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.308+0000 7f9200e8f700 1 --2- 172.21.15.81:0/2987099103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc1021e0 0x7f91fc102640 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0099c0 tx=0x7f91ec009cd0 comp rx=0 tx=0).stop 2024-05-09T00:02:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.308+0000 7f9200e8f700 1 -- 172.21.15.81:0/2987099103 shutdown_connections 2024-05-09T00:02:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.308+0000 7f9200e8f700 1 --2- 172.21.15.81:0/2987099103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91fc102b80 0x7f91fc109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.308+0000 7f9200e8f700 1 --2- 172.21.15.81:0/2987099103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc100fe0 0x7f91fc101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.308+0000 7f9200e8f700 1 --2- 172.21.15.81:0/2987099103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc1021e0 0x7f91fc102640 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.308+0000 7f9200e8f700 1 -- 172.21.15.81:0/2987099103 >> 172.21.15.81:0/2987099103 conn(0x7f91fc0fc580 msgr2=0x7f91fc0fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.308+0000 7f9200e8f700 1 -- 172.21.15.81:0/2987099103 shutdown_connections 2024-05-09T00:02:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.308+0000 7f9200e8f700 1 -- 172.21.15.81:0/2987099103 wait complete. 2024-05-09T00:02:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.309+0000 7f9200e8f700 1 Processor -- start 2024-05-09T00:02:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.309+0000 7f9200e8f700 1 -- start start 2024-05-09T00:02:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.309+0000 7f9200e8f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc100fe0 0x7f91fc197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.309+0000 7f9200e8f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91fc1021e0 0x7f91fc197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.309+0000 7f9200e8f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc102b80 0x7f91fc19e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.309+0000 7f9200e8f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc19eb70 con 0x7f91fc100fe0 2024-05-09T00:02:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.309+0000 7f9200e8f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc19ecb0 con 0x7f91fc1021e0 2024-05-09T00:02:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.309+0000 7f9200e8f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc19ee40 con 0x7f91fc102b80 2024-05-09T00:02:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.309+0000 7f91fa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc100fe0 0x7f91fc197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f91fa59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc100fe0 0x7f91fc197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36110/0 (socket says 172.21.15.81:36110) 2024-05-09T00:02:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f91fa59c700 1 -- 172.21.15.81:0/2326897068 learned_addr learned my addr 172.21.15.81:0/2326897068 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f91fad9d700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc102b80 0x7f91fc19e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f91f9d9b700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91fc1021e0 0x7f91fc197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f91fa59c700 1 -- 172.21.15.81:0/2326897068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc102b80 msgr2=0x7f91fc19e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f91fa59c700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc102b80 0x7f91fc19e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f91fa59c700 1 -- 172.21.15.81:0/2326897068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91fc1021e0 msgr2=0x7f91fc197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f91fa59c700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91fc1021e0 0x7f91fc197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f91fa59c700 1 -- 172.21.15.81:0/2326897068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91ec0095f0 con 0x7f91fc100fe0 2024-05-09T00:02:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f91fad9d700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc102b80 0x7f91fc19e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f91fa59c700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc100fe0 0x7f91fc197030 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f91e400b530 tx=0x7f91e400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f91f37fe700 1 -- 172.21.15.81:0/2326897068 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4011830 con 0x7f91fc100fe0 2024-05-09T00:02:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f91f37fe700 1 -- 172.21.15.81:0/2326897068 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91e4011e50 con 0x7f91fc100fe0 2024-05-09T00:02:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f9200e8f700 1 -- 172.21.15.81:0/2326897068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc19f120 con 0x7f91fc100fe0 2024-05-09T00:02:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f91f37fe700 1 -- 172.21.15.81:0/2326897068 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e400f2e0 con 0x7f91fc100fe0 2024-05-09T00:02:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.310+0000 7f9200e8f700 1 -- 172.21.15.81:0/2326897068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc19f620 con 0x7f91fc100fe0 2024-05-09T00:02:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.311+0000 7f9200e8f700 1 -- 172.21.15.81:0/2326897068 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91fc108460 con 0x7f91fc100fe0 2024-05-09T00:02:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.312+0000 7f91f37fe700 1 -- 172.21.15.81:0/2326897068 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f91e4010580 con 0x7f91fc100fe0 2024-05-09T00:02:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.313+0000 7f91f37fe700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f91e80a11b0 0x7f91e80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.313+0000 7f91f37fe700 1 -- 172.21.15.81:0/2326897068 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f91e40cc290 con 0x7f91fc100fe0 2024-05-09T00:02:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.313+0000 7f91f9d9b700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f91e80a11b0 0x7f91e80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.313+0000 7f91f9d9b700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f91e80a11b0 0x7f91e80a3670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f91ec003680 tx=0x7f91ec005040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.317+0000 7f91f37fe700 1 -- 172.21.15.81:0/2326897068 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f91e4095b80 con 0x7f91fc100fe0 2024-05-09T00:02:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.524+0000 7f9200e8f700 1 -- 172.21.15.81:0/2326897068 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f91fc0613e0 con 0x7f91e80a11b0 2024-05-09T00:02:36.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.537+0000 7f91f37fe700 1 -- 172.21.15.81:0/2326897068 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f91fc0613e0 con 0x7f91e80a11b0 2024-05-09T00:02:36.532 INFO:teuthology.orchestra.run.smithi081.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-09T00:02:36.532 INFO:teuthology.orchestra.run.smithi081.stdout:mds.a smithi081 running (58s) 54s ago 58s 13.5M - 18.2.2-1322-gd21e4f96 af23193ff691 91a50a86d544 2024-05-09T00:02:36.533 INFO:teuthology.orchestra.run.smithi081.stdout:mds.b smithi150 running (57s) 54s ago 57s 14.0M - 18.2.2-1322-gd21e4f96 af23193ff691 2575a6edc90a 2024-05-09T00:02:36.533 INFO:teuthology.orchestra.run.smithi081.stdout:mds.c smithi171 running (66s) 53s ago 65s 14.3M - 18.2.2-1322-gd21e4f96 af23193ff691 468415071a98 2024-05-09T00:02:36.533 INFO:teuthology.orchestra.run.smithi081.stdout:mds.d smithi081 running (71s) 54s ago 71s 13.4M - 18.2.2-1322-gd21e4f96 af23193ff691 9efbf34fbc46 2024-05-09T00:02:36.533 INFO:teuthology.orchestra.run.smithi081.stdout:mds.e smithi150 running (69s) 54s ago 69s 14.4M - 18.2.2-1322-gd21e4f96 af23193ff691 789af3268a13 2024-05-09T00:02:36.533 INFO:teuthology.orchestra.run.smithi081.stdout:mds.f smithi171 running (67s) 53s ago 67s 16.4M - 18.2.2-1322-gd21e4f96 af23193ff691 cc640f7bfefc 2024-05-09T00:02:36.533 INFO:teuthology.orchestra.run.smithi081.stdout:mds.g smithi081 running (60s) 54s ago 60s 16.8M - 18.2.2-1322-gd21e4f96 af23193ff691 ed0d2a114cca 2024-05-09T00:02:36.533 INFO:teuthology.orchestra.run.smithi081.stdout:mds.h smithi150 running (64s) 54s ago 63s 14.3M - 18.2.2-1322-gd21e4f96 af23193ff691 c143127a6f96 2024-05-09T00:02:36.533 INFO:teuthology.orchestra.run.smithi081.stdout:mds.i smithi171 running (62s) 53s ago 62s 13.3M - 18.2.2-1322-gd21e4f96 af23193ff691 b75310b7cecf 2024-05-09T00:02:36.533 INFO:teuthology.orchestra.run.smithi081.stdout:mds.j smithi081 running (73s) 54s ago 73s 14.3M - 18.2.2-1322-gd21e4f96 af23193ff691 558bf7905f65 2024-05-09T00:02:36.533 INFO:teuthology.orchestra.run.smithi081.stdout:mds.k smithi150 running (75s) 54s ago 74s 13.3M - 18.2.2-1322-gd21e4f96 af23193ff691 71532414337d 2024-05-09T00:02:36.533 INFO:teuthology.orchestra.run.smithi081.stdout:mds.l smithi171 running (76s) 53s ago 76s 14.1M - 18.2.2-1322-gd21e4f96 af23193ff691 9da21d9cde57 2024-05-09T00:02:36.533 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.x smithi081 *:9283,8765 running (6m) 54s ago 6m 524M - 18.2.2-1322-gd21e4f96 af23193ff691 bafa97db1e7f 2024-05-09T00:02:36.533 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.y smithi150 *:8443,8765 running (4m) 54s ago 4m 461M - 18.2.2-1322-gd21e4f96 af23193ff691 41a757e4a8e0 2024-05-09T00:02:36.534 INFO:teuthology.orchestra.run.smithi081.stdout:mgr.z smithi171 *:8443,8765 running (5m) 53s ago 5m 459M - 18.2.2-1322-gd21e4f96 af23193ff691 668a06d6a8a7 2024-05-09T00:02:36.534 INFO:teuthology.orchestra.run.smithi081.stdout:mon.a smithi081 running (6m) 54s ago 6m 79.5M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 5c248f71de16 2024-05-09T00:02:36.534 INFO:teuthology.orchestra.run.smithi081.stdout:mon.b smithi150 running (5m) 54s ago 5m 53.8M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 6b71a5e67894 2024-05-09T00:02:36.534 INFO:teuthology.orchestra.run.smithi081.stdout:mon.c smithi171 running (5m) 53s ago 5m 54.2M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 2e0d326fbddd 2024-05-09T00:02:36.534 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 smithi081 running (4m) 54s ago 4m 126M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 1945c5ed4437 2024-05-09T00:02:36.534 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 smithi150 running (4m) 54s ago 4m 132M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 4b2caa5593a0 2024-05-09T00:02:36.534 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 smithi171 running (4m) 53s ago 4m 58.8M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 c2091110ab34 2024-05-09T00:02:36.534 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 smithi081 running (3m) 54s ago 3m 123M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 2e9d391899bb 2024-05-09T00:02:36.534 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 smithi150 running (3m) 54s ago 3m 117M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 de594a5eb32e 2024-05-09T00:02:36.534 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 smithi171 running (3m) 53s ago 3m 123M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 d73fca6bc6be 2024-05-09T00:02:36.534 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 smithi081 running (3m) 54s ago 2m 116M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 9f637579d44f 2024-05-09T00:02:36.534 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 smithi150 running (2m) 54s ago 2m 120M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 3b008e7e19a7 2024-05-09T00:02:36.534 INFO:teuthology.orchestra.run.smithi081.stdout:osd.8 smithi171 running (2m) 53s ago 2m 120M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 351701d88665 2024-05-09T00:02:36.535 INFO:teuthology.orchestra.run.smithi081.stdout:osd.9 smithi081 running (2m) 54s ago 2m 115M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 3cd3bec72db2 2024-05-09T00:02:36.535 INFO:teuthology.orchestra.run.smithi081.stdout:osd.10 smithi150 running (108s) 54s ago 108s 117M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 1ef41f51b2de 2024-05-09T00:02:36.535 INFO:teuthology.orchestra.run.smithi081.stdout:osd.11 smithi171 running (91s) 53s ago 90s 42.6M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 81970352edfd 2024-05-09T00:02:36.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.540+0000 7f9200e8f700 1 -- 172.21.15.81:0/2326897068 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f91e80a11b0 msgr2=0x7f91e80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:36.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.540+0000 7f9200e8f700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f91e80a11b0 0x7f91e80a3670 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f91ec003680 tx=0x7f91ec005040 comp rx=0 tx=0).stop 2024-05-09T00:02:36.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.540+0000 7f9200e8f700 1 -- 172.21.15.81:0/2326897068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc100fe0 msgr2=0x7f91fc197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.540+0000 7f9200e8f700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc100fe0 0x7f91fc197030 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f91e400b530 tx=0x7f91e400b8f0 comp rx=0 tx=0).stop 2024-05-09T00:02:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.540+0000 7f9200e8f700 1 -- 172.21.15.81:0/2326897068 shutdown_connections 2024-05-09T00:02:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.540+0000 7f9200e8f700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f91e80a11b0 0x7f91e80a3670 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.540+0000 7f9200e8f700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f91fc102b80 0x7f91fc19e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.540+0000 7f9200e8f700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc100fe0 0x7f91fc197030 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.540+0000 7f9200e8f700 1 --2- 172.21.15.81:0/2326897068 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f91fc1021e0 0x7f91fc197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.540+0000 7f9200e8f700 1 -- 172.21.15.81:0/2326897068 >> 172.21.15.81:0/2326897068 conn(0x7f91fc0fc580 msgr2=0x7f91fc1055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.540+0000 7f9200e8f700 1 -- 172.21.15.81:0/2326897068 shutdown_connections 2024-05-09T00:02:36.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:36.540+0000 7f9200e8f700 1 -- 172.21.15.81:0/2326897068 wait complete. 2024-05-09T00:02:36.725 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:36 smithi081 ceph-mon[42474]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:36.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:36 smithi150 ceph-mon[46187]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:36.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:36 smithi171 ceph-mon[47351]: from='client.15114 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:36.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-09T00:02:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:37.610 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:37 smithi081 ceph-mon[42474]: pgmap v244: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T00:02:37.611 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:37 smithi081 ceph-mon[42474]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:37.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:37 smithi150 ceph-mon[46187]: pgmap v244: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T00:02:37.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:37 smithi150 ceph-mon[46187]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:37.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:37 smithi171 ceph-mon[47351]: pgmap v244: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T00:02:37.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:37 smithi171 ceph-mon[47351]: from='client.15120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:38.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.165+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3475051432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee4101060 msgr2=0x7f3ee41014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:38.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.165+0000 7f3eeaf47700 1 --2- 172.21.15.81:0/3475051432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee4101060 0x7f3ee41014e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0009990 tx=0x7f3ed0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:38.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.165+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3475051432 shutdown_connections 2024-05-09T00:02:38.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.165+0000 7f3eeaf47700 1 --2- 172.21.15.81:0/3475051432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee4101a20 0x7f3ee4108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:38.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.165+0000 7f3eeaf47700 1 --2- 172.21.15.81:0/3475051432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ee40fff00 0x7f3ee4100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:38.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.165+0000 7f3eeaf47700 1 --2- 172.21.15.81:0/3475051432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee4101060 0x7f3ee41014e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:38.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.165+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3475051432 >> 172.21.15.81:0/3475051432 conn(0x7f3ee40fb4c0 msgr2=0x7f3ee40fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:38.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.165+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3475051432 shutdown_connections 2024-05-09T00:02:38.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.165+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3475051432 wait complete. 2024-05-09T00:02:38.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3eeaf47700 1 Processor -- start 2024-05-09T00:02:38.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3eeaf47700 1 -- start start 2024-05-09T00:02:38.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3eeaf47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee40fff00 0x7f3ee4197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:38.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3eeaf47700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ee4101060 0x7f3ee4197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:38.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3eeaf47700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee4101a20 0x7f3ee419e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:38.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3eeaf47700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee419eb40 con 0x7f3ee40fff00 2024-05-09T00:02:38.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3eeaf47700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee419ec80 con 0x7f3ee4101a20 2024-05-09T00:02:38.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3eeaf47700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee419ee10 con 0x7f3ee4101060 2024-05-09T00:02:38.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3ee8ce3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee40fff00 0x7f3ee4197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:38.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3ee8ce3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee40fff00 0x7f3ee4197050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45536/0 (socket says 172.21.15.81:45536) 2024-05-09T00:02:38.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3ee8ce3700 1 -- 172.21.15.81:0/3455329228 learned_addr learned my addr 172.21.15.81:0/3455329228 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:38.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3ee3fff700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ee4101060 0x7f3ee4197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:38.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3ee94e4700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee4101a20 0x7f3ee419e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:38.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3ee8ce3700 1 -- 172.21.15.81:0/3455329228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ee4101060 msgr2=0x7f3ee4197590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:38.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3ee8ce3700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ee4101060 0x7f3ee4197590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:38.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3ee8ce3700 1 -- 172.21.15.81:0/3455329228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee4101a20 msgr2=0x7f3ee419e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:38.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3ee8ce3700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee4101a20 0x7f3ee419e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:38.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3ee8ce3700 1 -- 172.21.15.81:0/3455329228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed00095f0 con 0x7f3ee40fff00 2024-05-09T00:02:38.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3ee94e4700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee4101a20 0x7f3ee419e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:38.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3ee3fff700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ee4101060 0x7f3ee4197590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:38.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3ee8ce3700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee40fff00 0x7f3ee4197050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800b560 tx=0x7f3ed800b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:38.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3ee1ffb700 1 -- 172.21.15.81:0/3455329228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8011830 con 0x7f3ee40fff00 2024-05-09T00:02:38.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.166+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3455329228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee419f0f0 con 0x7f3ee40fff00 2024-05-09T00:02:38.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.167+0000 7f3ee1ffb700 1 -- 172.21.15.81:0/3455329228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ed8011e50 con 0x7f3ee40fff00 2024-05-09T00:02:38.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.167+0000 7f3ee1ffb700 1 -- 172.21.15.81:0/3455329228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed800f2e0 con 0x7f3ee40fff00 2024-05-09T00:02:38.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.167+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3455329228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee419f6c0 con 0x7f3ee40fff00 2024-05-09T00:02:38.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.168+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3455329228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee404ec60 con 0x7f3ee40fff00 2024-05-09T00:02:38.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.169+0000 7f3ee1ffb700 1 -- 172.21.15.81:0/3455329228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f3ed8011990 con 0x7f3ee40fff00 2024-05-09T00:02:38.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.169+0000 7f3ee1ffb700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3ed40a11b0 0x7f3ed40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:38.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.169+0000 7f3ee1ffb700 1 -- 172.21.15.81:0/3455329228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3ed80cc300 con 0x7f3ee40fff00 2024-05-09T00:02:38.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.169+0000 7f3ee3fff700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3ed40a11b0 0x7f3ed40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:38.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.170+0000 7f3ee3fff700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3ed40a11b0 0x7f3ed40a3670 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0006010 tx=0x7f3ed00037b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:38.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.174+0000 7f3ee1ffb700 1 -- 172.21.15.81:0/3455329228 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3ed8095bf0 con 0x7f3ee40fff00 2024-05-09T00:02:38.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.377+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3455329228 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ee40fd6d0 con 0x7f3ed40a11b0 2024-05-09T00:02:38.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.383+0000 7f3ee1ffb700 1 -- 172.21.15.81:0/3455329228 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7f3ee40fd6d0 con 0x7f3ed40a11b0 2024-05-09T00:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-09T00:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout:mds.all 12/12 55s ago 80s smithi081=a;smithi081=d;smithi081=g;smithi081=j;smithi150=b;smithi150=e;smithi150=h;smithi150=k;smithi171=c;smithi171=f;smithi171=i;smithi171=l;count:12 2024-05-09T00:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout:mgr 3/3 55s ago 5m smithi081=x;smithi150=y;smithi171=z;count:3 2024-05-09T00:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout:mon 3/3 55s ago 5m smithi081:172.21.15.81=a;smithi150:172.21.15.150=b;smithi171:172.21.15.171=c;count:3 2024-05-09T00:02:38.378 INFO:teuthology.orchestra.run.smithi081.stdout:osd 12 55s ago - 2024-05-09T00:02:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.385+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3455329228 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3ed40a11b0 msgr2=0x7f3ed40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.385+0000 7f3eeaf47700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3ed40a11b0 0x7f3ed40a3670 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0006010 tx=0x7f3ed00037b0 comp rx=0 tx=0).stop 2024-05-09T00:02:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.385+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3455329228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee40fff00 msgr2=0x7f3ee4197050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:38.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.385+0000 7f3eeaf47700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee40fff00 0x7f3ee4197050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800b560 tx=0x7f3ed800b920 comp rx=0 tx=0).stop 2024-05-09T00:02:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.385+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3455329228 shutdown_connections 2024-05-09T00:02:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.385+0000 7f3eeaf47700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f3ed40a11b0 0x7f3ed40a3670 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.385+0000 7f3eeaf47700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3ee4101a20 0x7f3ee419e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.385+0000 7f3eeaf47700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ee40fff00 0x7f3ee4197050 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.385+0000 7f3eeaf47700 1 --2- 172.21.15.81:0/3455329228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3ee4101060 0x7f3ee4197590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.385+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3455329228 >> 172.21.15.81:0/3455329228 conn(0x7f3ee40fb4c0 msgr2=0x7f3ee40fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.385+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3455329228 shutdown_connections 2024-05-09T00:02:38.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:38.385+0000 7f3eeaf47700 1 -- 172.21.15.81:0/3455329228 wait complete. 2024-05-09T00:02:38.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-09T00:02:38.961 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:39.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:39 smithi081 ceph-mon[42474]: pgmap v245: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T00:02:39.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:39 smithi081 ceph-mon[42474]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:39.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:39 smithi150 ceph-mon[46187]: pgmap v245: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T00:02:39.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:39 smithi150 ceph-mon[46187]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:39.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:39 smithi171 ceph-mon[47351]: pgmap v245: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T00:02:39.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:39 smithi171 ceph-mon[47351]: from='client.15126 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.899+0000 7f282348e700 1 -- 172.21.15.81:0/3838148148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f281c101a30 msgr2=0x7f281c108350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.899+0000 7f282348e700 1 --2- 172.21.15.81:0/3838148148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f281c101a30 0x7f281c108350 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f281400b0a0 tx=0x7f281400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.899+0000 7f282348e700 1 -- 172.21.15.81:0/3838148148 shutdown_connections 2024-05-09T00:02:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.899+0000 7f282348e700 1 --2- 172.21.15.81:0/3838148148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f281c101a30 0x7f281c108350 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.899+0000 7f282348e700 1 --2- 172.21.15.81:0/3838148148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f281c0ffe80 0x7f281c1002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.899+0000 7f282348e700 1 --2- 172.21.15.81:0/3838148148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f281c101070 0x7f281c1014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.899+0000 7f282348e700 1 -- 172.21.15.81:0/3838148148 >> 172.21.15.81:0/3838148148 conn(0x7f281c0fb470 msgr2=0x7f281c0fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.900+0000 7f282348e700 1 -- 172.21.15.81:0/3838148148 shutdown_connections 2024-05-09T00:02:39.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.900+0000 7f282348e700 1 -- 172.21.15.81:0/3838148148 wait complete. 2024-05-09T00:02:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.900+0000 7f282348e700 1 Processor -- start 2024-05-09T00:02:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.900+0000 7f282348e700 1 -- start start 2024-05-09T00:02:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.900+0000 7f282348e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f281c0ffe80 0x7f281c103f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.900+0000 7f282348e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f281c101070 0x7f281c102620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.900+0000 7f282348e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f281c101a30 0x7f281c102b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:39.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.900+0000 7f282348e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c103300 con 0x7f281c101a30 2024-05-09T00:02:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.900+0000 7f282348e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c103470 con 0x7f281c0ffe80 2024-05-09T00:02:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.900+0000 7f282348e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c1a1170 con 0x7f281c101070 2024-05-09T00:02:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.900+0000 7f2821a2b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f281c101a30 0x7f281c102b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.900+0000 7f2821a2b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f281c101a30 0x7f281c102b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45554/0 (socket says 172.21.15.81:45554) 2024-05-09T00:02:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.900+0000 7f2821a2b700 1 -- 172.21.15.81:0/1530238481 learned_addr learned my addr 172.21.15.81:0/1530238481 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.901+0000 7f2820a29700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f281c101070 0x7f281c102620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.901+0000 7f2821a2b700 1 -- 172.21.15.81:0/1530238481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f281c101070 msgr2=0x7f281c102620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.901+0000 7f2821a2b700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f281c101070 0x7f281c102620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.901+0000 7f2821a2b700 1 -- 172.21.15.81:0/1530238481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f281c0ffe80 msgr2=0x7f281c103f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.901+0000 7f282122a700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f281c0ffe80 0x7f281c103f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.901+0000 7f2821a2b700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f281c0ffe80 0x7f281c103f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.901+0000 7f2821a2b700 1 -- 172.21.15.81:0/1530238481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814009d00 con 0x7f281c101a30 2024-05-09T00:02:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.901+0000 7f2820a29700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f281c101070 0x7f281c102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:39.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.901+0000 7f2821a2b700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f281c101a30 0x7f281c102b60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f281400d010 tx=0x7f2814004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.901+0000 7f280e7fc700 1 -- 172.21.15.81:0/1530238481 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281400e040 con 0x7f281c101a30 2024-05-09T00:02:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.901+0000 7f280e7fc700 1 -- 172.21.15.81:0/1530238481 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28140094c0 con 0x7f281c101a30 2024-05-09T00:02:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.901+0000 7f282348e700 1 -- 172.21.15.81:0/1530238481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c1a13a0 con 0x7f281c101a30 2024-05-09T00:02:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.901+0000 7f280e7fc700 1 -- 172.21.15.81:0/1530238481 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281401bc70 con 0x7f281c101a30 2024-05-09T00:02:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.901+0000 7f282348e700 1 -- 172.21.15.81:0/1530238481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c1a1810 con 0x7f281c101a30 2024-05-09T00:02:39.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.902+0000 7f282348e700 1 -- 172.21.15.81:0/1530238481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c04ec60 con 0x7f281c101a30 2024-05-09T00:02:39.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.903+0000 7f280e7fc700 1 -- 172.21.15.81:0/1530238481 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2814003a00 con 0x7f281c101a30 2024-05-09T00:02:39.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.904+0000 7f280e7fc700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f28080a1230 0x7f28080a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:39.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.904+0000 7f282122a700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f28080a1230 0x7f28080a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:39.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.904+0000 7f280e7fc700 1 -- 172.21.15.81:0/1530238481 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f28140cedb0 con 0x7f281c101a30 2024-05-09T00:02:39.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.904+0000 7f282122a700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f28080a1230 0x7f28080a36f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2810006fd0 tx=0x7f2810008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:39.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:39.907+0000 7f280e7fc700 1 -- 172.21.15.81:0/1530238481 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2814098520 con 0x7f281c101a30 2024-05-09T00:02:40.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:40.103+0000 7f282348e700 1 -- 172.21.15.81:0/1530238481 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f281c069d90 con 0x7f28080a1230 2024-05-09T00:02:40.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:40.105+0000 7f280e7fc700 1 -- 172.21.15.81:0/1530238481 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f281c069d90 con 0x7f28080a1230 2024-05-09T00:02:40.100 INFO:teuthology.orchestra.run.smithi081.stdout:HOST ADDR LABELS STATUS 2024-05-09T00:02:40.100 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 172.21.15.81 2024-05-09T00:02:40.100 INFO:teuthology.orchestra.run.smithi081.stdout:smithi150 172.21.15.150 2024-05-09T00:02:40.100 INFO:teuthology.orchestra.run.smithi081.stdout:smithi171 172.21.15.171 2024-05-09T00:02:40.100 INFO:teuthology.orchestra.run.smithi081.stdout:3 hosts in cluster 2024-05-09T00:02:40.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:40.107+0000 7f282348e700 1 -- 172.21.15.81:0/1530238481 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f28080a1230 msgr2=0x7f28080a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:40.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:40.107+0000 7f282348e700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f28080a1230 0x7f28080a36f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2810006fd0 tx=0x7f2810008040 comp rx=0 tx=0).stop 2024-05-09T00:02:40.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:40.107+0000 7f282348e700 1 -- 172.21.15.81:0/1530238481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f281c101a30 msgr2=0x7f281c102b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:40.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:40.107+0000 7f282348e700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f281c101a30 0x7f281c102b60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f281400d010 tx=0x7f2814004db0 comp rx=0 tx=0).stop 2024-05-09T00:02:40.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:40.107+0000 7f282348e700 1 -- 172.21.15.81:0/1530238481 shutdown_connections 2024-05-09T00:02:40.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:40.107+0000 7f282348e700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f28080a1230 0x7f28080a36f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:40.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:40.107+0000 7f282348e700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f281c0ffe80 0x7f281c103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:40.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:40.107+0000 7f282348e700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f281c101a30 0x7f281c102b60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:40.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:40.107+0000 7f282348e700 1 --2- 172.21.15.81:0/1530238481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f281c101070 0x7f281c102620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:40.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:40.107+0000 7f282348e700 1 -- 172.21.15.81:0/1530238481 >> 172.21.15.81:0/1530238481 conn(0x7f281c0fb470 msgr2=0x7f281c069680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:40.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:40.107+0000 7f282348e700 1 -- 172.21.15.81:0/1530238481 shutdown_connections 2024-05-09T00:02:40.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:40.107+0000 7f282348e700 1 -- 172.21.15.81:0/1530238481 wait complete. 2024-05-09T00:02:40.479 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-09T00:02:40.704 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:41.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.684+0000 7f99b772f700 1 -- 172.21.15.81:0/910472325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0102b80 msgr2=0x7f99b0109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:41.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.684+0000 7f99b772f700 1 --2- 172.21.15.81:0/910472325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0102b80 0x7f99b0109430 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f99a800b0d0 tx=0x7f99a800b3e0 comp rx=0 tx=0).stop 2024-05-09T00:02:41.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.684+0000 7f99b772f700 1 -- 172.21.15.81:0/910472325 shutdown_connections 2024-05-09T00:02:41.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.684+0000 7f99b772f700 1 --2- 172.21.15.81:0/910472325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99b0100fe0 0x7f99b0101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:41.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.684+0000 7f99b772f700 1 --2- 172.21.15.81:0/910472325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0102b80 0x7f99b0109430 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.684+0000 7f99b772f700 1 --2- 172.21.15.81:0/910472325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99b01021e0 0x7f99b0102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.684+0000 7f99b772f700 1 -- 172.21.15.81:0/910472325 >> 172.21.15.81:0/910472325 conn(0x7f99b00fc580 msgr2=0x7f99b00fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.684+0000 7f99b772f700 1 -- 172.21.15.81:0/910472325 shutdown_connections 2024-05-09T00:02:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.684+0000 7f99b772f700 1 -- 172.21.15.81:0/910472325 wait complete. 2024-05-09T00:02:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b772f700 1 Processor -- start 2024-05-09T00:02:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b772f700 1 -- start start 2024-05-09T00:02:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b772f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0100fe0 0x7f99b01970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b772f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99b01021e0 0x7f99b0197610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b772f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99b0102b80 0x7f99b019e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b772f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b019ec10 con 0x7f99b0100fe0 2024-05-09T00:02:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b772f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b019ed50 con 0x7f99b0102b80 2024-05-09T00:02:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b772f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b019eee0 con 0x7f99b01021e0 2024-05-09T00:02:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b54cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0100fe0 0x7f99b01970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b54cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0100fe0 0x7f99b01970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45574/0 (socket says 172.21.15.81:45574) 2024-05-09T00:02:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b54cb700 1 -- 172.21.15.81:0/1986922276 learned_addr learned my addr 172.21.15.81:0/1986922276 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b4cca700 1 --2- 172.21.15.81:0/1986922276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99b01021e0 0x7f99b0197610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b54cb700 1 -- 172.21.15.81:0/1986922276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99b01021e0 msgr2=0x7f99b0197610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b54cb700 1 --2- 172.21.15.81:0/1986922276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99b01021e0 0x7f99b0197610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b54cb700 1 -- 172.21.15.81:0/1986922276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99b0102b80 msgr2=0x7f99b019e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b54cb700 1 --2- 172.21.15.81:0/1986922276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99b0102b80 0x7f99b019e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b54cb700 1 -- 172.21.15.81:0/1986922276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a8009d00 con 0x7f99b0100fe0 2024-05-09T00:02:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.685+0000 7f99b4cca700 1 --2- 172.21.15.81:0/1986922276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99b01021e0 0x7f99b0197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.686+0000 7f99b54cb700 1 --2- 172.21.15.81:0/1986922276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0100fe0 0x7f99b01970d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00b530 tx=0x7f99ac00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.686+0000 7f99a27fc700 1 -- 172.21.15.81:0/1986922276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac011830 con 0x7f99b0100fe0 2024-05-09T00:02:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.686+0000 7f99a27fc700 1 -- 172.21.15.81:0/1986922276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99ac011e50 con 0x7f99b0100fe0 2024-05-09T00:02:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.686+0000 7f99b772f700 1 -- 172.21.15.81:0/1986922276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b019f1c0 con 0x7f99b0100fe0 2024-05-09T00:02:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.686+0000 7f99a27fc700 1 -- 172.21.15.81:0/1986922276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00f2e0 con 0x7f99b0100fe0 2024-05-09T00:02:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.686+0000 7f99b772f700 1 -- 172.21.15.81:0/1986922276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b019f740 con 0x7f99b0100fe0 2024-05-09T00:02:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.687+0000 7f99b772f700 1 -- 172.21.15.81:0/1986922276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b0108470 con 0x7f99b0100fe0 2024-05-09T00:02:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.688+0000 7f99a27fc700 1 -- 172.21.15.81:0/1986922276 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f99ac010580 con 0x7f99b0100fe0 2024-05-09T00:02:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.688+0000 7f99a27fc700 1 --2- 172.21.15.81:0/1986922276 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f999c0a11b0 0x7f999c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.688+0000 7f99a27fc700 1 -- 172.21.15.81:0/1986922276 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f99ac0cc290 con 0x7f99b0100fe0 2024-05-09T00:02:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.688+0000 7f99b4cca700 1 --2- 172.21.15.81:0/1986922276 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f999c0a11b0 0x7f999c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.689+0000 7f99b4cca700 1 --2- 172.21.15.81:0/1986922276 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f999c0a11b0 0x7f999c0a3670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f99a40099d0 tx=0x7f99a4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.693+0000 7f99a27fc700 1 -- 172.21.15.81:0/1986922276 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f99ac095b80 con 0x7f99b0100fe0 2024-05-09T00:02:41.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:41 smithi150 ceph-mon[46187]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:41.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:41 smithi150 ceph-mon[46187]: pgmap v246: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-09T00:02:41.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:41 smithi171 ceph-mon[47351]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:41.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:41 smithi171 ceph-mon[47351]: pgmap v246: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-09T00:02:41.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:41 smithi081 ceph-mon[42474]: from='client.15132 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:41.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:41 smithi081 ceph-mon[42474]: pgmap v246: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-09T00:02:41.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.895+0000 7f99b772f700 1 -- 172.21.15.81:0/1986922276 --> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f99b002ce10 con 0x7f999c0a11b0 2024-05-09T00:02:41.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.896+0000 7f99a27fc700 1 -- 172.21.15.81:0/1986922276 <== mgr.14152 v2:172.21.15.81:6800/1458411552 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f99b002ce10 con 0x7f999c0a11b0 2024-05-09T00:02:41.891 INFO:teuthology.orchestra.run.smithi081.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-09T00:02:41.892 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400N7400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-05-09T00:02:41.892 INFO:teuthology.orchestra.run.smithi081.stdout:smithi150 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GX400BGN 372G No 109s ago Has a FileSystem, LVM detected 2024-05-09T00:02:41.892 INFO:teuthology.orchestra.run.smithi081.stdout:smithi171 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6233001S400BGN 372G No 91s ago Has a FileSystem, LVM detected 2024-05-09T00:02:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.899+0000 7f99b772f700 1 -- 172.21.15.81:0/1986922276 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f999c0a11b0 msgr2=0x7f999c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.899+0000 7f99b772f700 1 --2- 172.21.15.81:0/1986922276 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f999c0a11b0 0x7f999c0a3670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f99a40099d0 tx=0x7f99a4008040 comp rx=0 tx=0).stop 2024-05-09T00:02:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.899+0000 7f99b772f700 1 -- 172.21.15.81:0/1986922276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0100fe0 msgr2=0x7f99b01970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.899+0000 7f99b772f700 1 --2- 172.21.15.81:0/1986922276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0100fe0 0x7f99b01970d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00b530 tx=0x7f99ac00b8f0 comp rx=0 tx=0).stop 2024-05-09T00:02:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.899+0000 7f99b772f700 1 -- 172.21.15.81:0/1986922276 shutdown_connections 2024-05-09T00:02:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.899+0000 7f99b772f700 1 --2- 172.21.15.81:0/1986922276 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f999c0a11b0 0x7f999c0a3670 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.899+0000 7f99b772f700 1 --2- 172.21.15.81:0/1986922276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99b0102b80 0x7f99b019e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.899+0000 7f99b772f700 1 --2- 172.21.15.81:0/1986922276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99b0100fe0 0x7f99b01970d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.899+0000 7f99b772f700 1 --2- 172.21.15.81:0/1986922276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99b01021e0 0x7f99b0197610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.899+0000 7f99b772f700 1 -- 172.21.15.81:0/1986922276 >> 172.21.15.81:0/1986922276 conn(0x7f99b00fc580 msgr2=0x7f99b01055b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.899+0000 7f99b772f700 1 -- 172.21.15.81:0/1986922276 shutdown_connections 2024-05-09T00:02:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:41.899+0000 7f99b772f700 1 -- 172.21.15.81:0/1986922276 wait complete. 2024-05-09T00:02:42.297 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-09T00:02:42.310 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-05-09T00:02:42.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-09T00:02:42.534 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.689+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/3324555653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb84106cf0 msgr2=0x7ffb84109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.689+0000 7ffb8c5b0700 1 --2- 172.21.15.81:0/3324555653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb84106cf0 0x7ffb84109160 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00b0a0 tx=0x7ffb7c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.689+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/3324555653 shutdown_connections 2024-05-09T00:02:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.689+0000 7ffb8c5b0700 1 --2- 172.21.15.81:0/3324555653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb84101a90 0x7ffb84103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.689+0000 7ffb8c5b0700 1 --2- 172.21.15.81:0/3324555653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb84106cf0 0x7ffb84109160 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.689+0000 7ffb8c5b0700 1 --2- 172.21.15.81:0/3324555653 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb841043c0 0x7ffb841067b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.689+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/3324555653 >> 172.21.15.81:0/3324555653 conn(0x7ffb840fb4a0 msgr2=0x7ffb840fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.689+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/3324555653 shutdown_connections 2024-05-09T00:02:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.689+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/3324555653 wait complete. 2024-05-09T00:02:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.690+0000 7ffb8c5b0700 1 Processor -- start 2024-05-09T00:02:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.690+0000 7ffb8c5b0700 1 -- start start 2024-05-09T00:02:43.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.690+0000 7ffb8c5b0700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb84101a90 0x7ffb84196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.690+0000 7ffb8c5b0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb841043c0 0x7ffb84197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb8c5b0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb84106cf0 0x7ffb8419e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb8c5b0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8419eb10 con 0x7ffb841043c0 2024-05-09T00:02:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb8c5b0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8419ec50 con 0x7ffb84106cf0 2024-05-09T00:02:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb8c5b0700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8419ede0 con 0x7ffb84101a90 2024-05-09T00:02:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb89b4b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb841043c0 0x7ffb84197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb89b4b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb841043c0 0x7ffb84197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45602/0 (socket says 172.21.15.81:45602) 2024-05-09T00:02:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb89b4b700 1 -- 172.21.15.81:0/2257320627 learned_addr learned my addr 172.21.15.81:0/2257320627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb8a34c700 1 --2- 172.21.15.81:0/2257320627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb84101a90 0x7ffb84196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb8ab4d700 1 --2- 172.21.15.81:0/2257320627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb84106cf0 0x7ffb8419e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb89b4b700 1 -- 172.21.15.81:0/2257320627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb84101a90 msgr2=0x7ffb84196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb89b4b700 1 --2- 172.21.15.81:0/2257320627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb84101a90 0x7ffb84196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb89b4b700 1 -- 172.21.15.81:0/2257320627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb84106cf0 msgr2=0x7ffb8419e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb89b4b700 1 --2- 172.21.15.81:0/2257320627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb84106cf0 0x7ffb8419e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb89b4b700 1 -- 172.21.15.81:0/2257320627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c009d00 con 0x7ffb841043c0 2024-05-09T00:02:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb89b4b700 1 --2- 172.21.15.81:0/2257320627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb841043c0 0x7ffb84197510 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400e9d0 tx=0x7ffb7400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb7b7fe700 1 -- 172.21.15.81:0/2257320627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74009790 con 0x7ffb841043c0 2024-05-09T00:02:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/2257320627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8419f0c0 con 0x7ffb841043c0 2024-05-09T00:02:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb7b7fe700 1 -- 172.21.15.81:0/2257320627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb7400ee70 con 0x7ffb841043c0 2024-05-09T00:02:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb7b7fe700 1 -- 172.21.15.81:0/2257320627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb74010ea0 con 0x7ffb841043c0 2024-05-09T00:02:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.691+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/2257320627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8419f610 con 0x7ffb841043c0 2024-05-09T00:02:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.692+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/2257320627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb840fd020 con 0x7ffb841043c0 2024-05-09T00:02:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.693+0000 7ffb7b7fe700 1 -- 172.21.15.81:0/2257320627 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ffb7400cbd0 con 0x7ffb841043c0 2024-05-09T00:02:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.694+0000 7ffb7b7fe700 1 --2- 172.21.15.81:0/2257320627 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffb700a11b0 0x7ffb700a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.694+0000 7ffb8a34c700 1 --2- 172.21.15.81:0/2257320627 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffb700a11b0 0x7ffb700a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.694+0000 7ffb7b7fe700 1 -- 172.21.15.81:0/2257320627 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ffb74014070 con 0x7ffb841043c0 2024-05-09T00:02:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.694+0000 7ffb8a34c700 1 --2- 172.21.15.81:0/2257320627 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffb700a11b0 0x7ffb700a3670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009c60 tx=0x7ffb80009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:43.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.698+0000 7ffb7b7fe700 1 -- 172.21.15.81:0/2257320627 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ffb74052d60 con 0x7ffb841043c0 2024-05-09T00:02:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:43 smithi150 ceph-mon[46187]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:43 smithi150 ceph-mon[46187]: pgmap v247: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T00:02:43.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:43 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:02:43.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:43 smithi171 ceph-mon[47351]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:43.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:43 smithi171 ceph-mon[47351]: pgmap v247: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T00:02:43.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:43 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:02:43.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:43 smithi081 ceph-mon[42474]: from='client.15138 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:02:43.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:43 smithi081 ceph-mon[42474]: pgmap v247: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-05-09T00:02:43.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:43 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:02:43.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.984+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/2257320627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb840fca00 con 0x7ffb841043c0 2024-05-09T00:02:43.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.984+0000 7ffb7b7fe700 1 -- 172.21.15.81:0/2257320627 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+2895 (secure 0 0 0) 0x7ffb74096240 con 0x7ffb841043c0 2024-05-09T00:02:43.979 INFO:teuthology.orchestra.run.smithi081.stdout:e23 2024-05-09T00:02:43.979 INFO:teuthology.orchestra.run.smithi081.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-09T00:02:43.979 INFO:teuthology.orchestra.run.smithi081.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout:legacy client fscid: 1 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout:Filesystem 'cephfs' (1) 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout:fs_name cephfs 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 23 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-05-09T00:01:45.018539+0000 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-05-09T00:01:50.053948+0000 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout:tableserver 0 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout:root 0 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout:session_timeout 300 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout:session_autoclose 300 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout:max_file_size 1099511627776 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout:max_xattr_size 65536 2024-05-09T00:02:43.980 INFO:teuthology.orchestra.run.smithi081.stdout:required_client_features {} 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure 0 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:last_failure_osd_epoch 0 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:max_mds 3 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:in 0,1,2 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:up {0=24506,1=24487,2=24476} 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:failed 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:damaged 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:stopped 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:data_pools [3] 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:metadata_pool 2 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:inline_data disabled 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:balancer 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:bal_rank_mask -1 2024-05-09T00:02:43.981 INFO:teuthology.orchestra.run.smithi081.stdout:standby_count_wanted 0 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b{0:24506} state up:active seq 3 addr [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c{0:24463} state up:standby-replay seq 1 addr [v2:172.21.15.171:6836/781467444,v1:172.21.15.171:6837/781467444] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.i{1:24487} state up:active seq 5 addr [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.e{1:24452} state up:standby-replay seq 1 addr [v2:172.21.15.150:6834/2480381166,v1:172.21.15.150:6835/2480381166] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.h{2:24476} state up:active seq 6 addr [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.f{2:24451} state up:standby-replay seq 1 addr [v2:172.21.15.171:6834/259351107,v1:172.21.15.171:6835/259351107] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout:Standby daemons: 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.j{-1:14568} state up:standby seq 1 addr [v2:172.21.15.81:6834/3510747883,v1:172.21.15.81:6835/3510747883] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d{-1:14580} state up:standby seq 1 addr [v2:172.21.15.81:6836/1631947486,v1:172.21.15.81:6837/1631947486] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.g{-1:14634} state up:standby seq 1 addr [v2:172.21.15.81:6838/567553409,v1:172.21.15.81:6839/567553409] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a{-1:14646} state up:standby seq 1 addr [v2:172.21.15.81:6840/447183521,v1:172.21.15.81:6841/447183521] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:02:43.982 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.l{-1:24421} state up:standby seq 1 addr [v2:172.21.15.171:6832/1750853748,v1:172.21.15.171:6833/1750853748] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:02:43.983 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.k{-1:24428} state up:standby seq 1 addr [v2:172.21.15.150:6832/3794539364,v1:172.21.15.150:6833/3794539364] compat {c=[1],r=[1],i=[7ff]}] 2024-05-09T00:02:43.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.987+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/2257320627 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffb700a11b0 msgr2=0x7ffb700a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:43.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.987+0000 7ffb8c5b0700 1 --2- 172.21.15.81:0/2257320627 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffb700a11b0 0x7ffb700a3670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009c60 tx=0x7ffb80009260 comp rx=0 tx=0).stop 2024-05-09T00:02:43.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.987+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/2257320627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb841043c0 msgr2=0x7ffb84197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:43.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.987+0000 7ffb8c5b0700 1 --2- 172.21.15.81:0/2257320627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb841043c0 0x7ffb84197510 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffb7400e9d0 tx=0x7ffb7400ece0 comp rx=0 tx=0).stop 2024-05-09T00:02:43.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.987+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/2257320627 shutdown_connections 2024-05-09T00:02:43.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.987+0000 7ffb8c5b0700 1 --2- 172.21.15.81:0/2257320627 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7ffb700a11b0 0x7ffb700a3670 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:43.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.987+0000 7ffb8c5b0700 1 --2- 172.21.15.81:0/2257320627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb84106cf0 0x7ffb8419e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:43.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.987+0000 7ffb8c5b0700 1 --2- 172.21.15.81:0/2257320627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb84101a90 0x7ffb84196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:43.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.987+0000 7ffb8c5b0700 1 --2- 172.21.15.81:0/2257320627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb841043c0 0x7ffb84197510 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:43.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.987+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/2257320627 >> 172.21.15.81:0/2257320627 conn(0x7ffb840fb4a0 msgr2=0x7ffb841023d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:43.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.987+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/2257320627 shutdown_connections 2024-05-09T00:02:43.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:43.987+0000 7ffb8c5b0700 1 -- 172.21.15.81:0/2257320627 wait complete. 2024-05-09T00:02:43.984 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-05-09T00:02:44.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-09T00:02:44.622 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:44 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:44 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:44 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:44 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:44 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2257320627' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:02:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:44 smithi150 ceph-mon[46187]: pgmap v248: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T00:02:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:44 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:44 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:44 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:44 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:44 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:44 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:44 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2257320627' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:02:45.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:44 smithi171 ceph-mon[47351]: pgmap v248: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T00:02:45.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:44 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:44 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.066 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:44 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.066 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:44 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.066 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:44 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.066 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:44 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.066 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:44 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2257320627' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-09T00:02:45.067 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:44 smithi081 ceph-mon[42474]: pgmap v248: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-05-09T00:02:45.067 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:44 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.067 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:44 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.564+0000 7f887aa7a700 1 -- 172.21.15.81:0/2537419997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8874101a20 msgr2=0x7f8874108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.564+0000 7f887aa7a700 1 --2- 172.21.15.81:0/2537419997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8874101a20 0x7f8874108340 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f886c00b0a0 tx=0x7f886c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.564+0000 7f887aa7a700 1 -- 172.21.15.81:0/2537419997 shutdown_connections 2024-05-09T00:02:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.564+0000 7f887aa7a700 1 --2- 172.21.15.81:0/2537419997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f88740fff00 0x7f8874100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.564+0000 7f887aa7a700 1 --2- 172.21.15.81:0/2537419997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8874101a20 0x7f8874108340 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:45.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.564+0000 7f887aa7a700 1 --2- 172.21.15.81:0/2537419997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8874101060 0x7f88741014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:45.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.564+0000 7f887aa7a700 1 -- 172.21.15.81:0/2537419997 >> 172.21.15.81:0/2537419997 conn(0x7f88740fb4a0 msgr2=0x7f88740fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:45.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.564+0000 7f887aa7a700 1 -- 172.21.15.81:0/2537419997 shutdown_connections 2024-05-09T00:02:45.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.564+0000 7f887aa7a700 1 -- 172.21.15.81:0/2537419997 wait complete. 2024-05-09T00:02:45.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.565+0000 7f887aa7a700 1 Processor -- start 2024-05-09T00:02:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.565+0000 7f887aa7a700 1 -- start start 2024-05-09T00:02:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.565+0000 7f887aa7a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88740fff00 0x7f8874196040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.565+0000 7f887aa7a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8874101060 0x7f8874196580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.565+0000 7f887aa7a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8874101a20 0x7f887419d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.565+0000 7f887aa7a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887419db30 con 0x7f8874101a20 2024-05-09T00:02:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.565+0000 7f887aa7a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887419dc70 con 0x7f8874101060 2024-05-09T00:02:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.565+0000 7f887aa7a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887419de00 con 0x7f88740fff00 2024-05-09T00:02:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.565+0000 7f8879017700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8874101a20 0x7f887419d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.565+0000 7f8878816700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88740fff00 0x7f8874196040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.565+0000 7f8879017700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8874101a20 0x7f887419d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45624/0 (socket says 172.21.15.81:45624) 2024-05-09T00:02:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.565+0000 7f8879017700 1 -- 172.21.15.81:0/2240309518 learned_addr learned my addr 172.21.15.81:0/2240309518 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:45.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.565+0000 7f8873fff700 1 --2- 172.21.15.81:0/2240309518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8874101060 0x7f8874196580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.565+0000 7f8879017700 1 -- 172.21.15.81:0/2240309518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88740fff00 msgr2=0x7f8874196040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.566+0000 7f8879017700 1 --2- 172.21.15.81:0/2240309518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88740fff00 0x7f8874196040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.566+0000 7f8879017700 1 -- 172.21.15.81:0/2240309518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8874101060 msgr2=0x7f8874196580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.566+0000 7f8879017700 1 --2- 172.21.15.81:0/2240309518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8874101060 0x7f8874196580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.566+0000 7f8879017700 1 -- 172.21.15.81:0/2240309518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c009d00 con 0x7f8874101a20 2024-05-09T00:02:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.566+0000 7f8873fff700 1 --2- 172.21.15.81:0/2240309518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8874101060 0x7f8874196580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.566+0000 7f8879017700 1 --2- 172.21.15.81:0/2240309518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8874101a20 0x7f887419d560 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f886c004d00 tx=0x7f886c004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.566+0000 7f8871ffb700 1 -- 172.21.15.81:0/2240309518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c00e040 con 0x7f8874101a20 2024-05-09T00:02:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.566+0000 7f887aa7a700 1 -- 172.21.15.81:0/2240309518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887419e080 con 0x7f8874101a20 2024-05-09T00:02:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.566+0000 7f8871ffb700 1 -- 172.21.15.81:0/2240309518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f886c01db50 con 0x7f8874101a20 2024-05-09T00:02:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.566+0000 7f8871ffb700 1 -- 172.21.15.81:0/2240309518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c01bc20 con 0x7f8874101a20 2024-05-09T00:02:45.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.566+0000 7f887aa7a700 1 -- 172.21.15.81:0/2240309518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887419e540 con 0x7f8874101a20 2024-05-09T00:02:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.567+0000 7f887aa7a700 1 -- 172.21.15.81:0/2240309518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88741072b0 con 0x7f8874101a20 2024-05-09T00:02:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.568+0000 7f8871ffb700 1 -- 172.21.15.81:0/2240309518 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f886c01dcc0 con 0x7f8874101a20 2024-05-09T00:02:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.569+0000 7f8871ffb700 1 --2- 172.21.15.81:0/2240309518 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f88640a11b0 0x7f88640a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.569+0000 7f8878816700 1 --2- 172.21.15.81:0/2240309518 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f88640a11b0 0x7f88640a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:45.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.569+0000 7f8871ffb700 1 -- 172.21.15.81:0/2240309518 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f886c0ce8e0 con 0x7f8874101a20 2024-05-09T00:02:45.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.569+0000 7f8878816700 1 --2- 172.21.15.81:0/2240309518 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f88640a11b0 0x7f88640a3670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8868009a10 tx=0x7f8868009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:45.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.574+0000 7f8871ffb700 1 -- 172.21.15.81:0/2240309518 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f886c098050 con 0x7f8874101a20 2024-05-09T00:02:45.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.765+0000 7f887aa7a700 1 -- 172.21.15.81:0/2240309518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f887410b810 con 0x7f8874101a20 2024-05-09T00:02:45.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.766+0000 7f8871ffb700 1 -- 172.21.15.81:0/2240309518 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v79) v1 ==== 56+0+5064 (secure 0 0 0) 0x7f886c09b670 con 0x7f8874101a20 2024-05-09T00:02:45.761 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 79 2024-05-09T00:02:45.762 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-09T00:02:45.762 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-05-08T23:55:58.923433+0000 2024-05-09T00:02:45.762 INFO:teuthology.orchestra.run.smithi081.stdout:modified 2024-05-09T00:01:46.020465+0000 2024-05-09T00:02:45.762 INFO:teuthology.orchestra.run.smithi081.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-09T00:02:45.762 INFO:teuthology.orchestra.run.smithi081.stdout:crush_version 26 2024-05-09T00:02:45.762 INFO:teuthology.orchestra.run.smithi081.stdout:full_ratio 0.95 2024-05-09T00:02:45.762 INFO:teuthology.orchestra.run.smithi081.stdout:backfillfull_ratio 0.9 2024-05-09T00:02:45.762 INFO:teuthology.orchestra.run.smithi081.stdout:nearfull_ratio 0.85 2024-05-09T00:02:45.762 INFO:teuthology.orchestra.run.smithi081.stdout:require_min_compat_client luminous 2024-05-09T00:02:45.762 INFO:teuthology.orchestra.run.smithi081.stdout:min_compat_client jewel 2024-05-09T00:02:45.763 INFO:teuthology.orchestra.run.smithi081.stdout:require_osd_release reef 2024-05-09T00:02:45.763 INFO:teuthology.orchestra.run.smithi081.stdout:stretch_mode_enabled false 2024-05-09T00:02:45.763 INFO:teuthology.orchestra.run.smithi081.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-09T00:02:45.763 INFO:teuthology.orchestra.run.smithi081.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 78 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-05-09T00:02:45.763 INFO:teuthology.orchestra.run.smithi081.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-05-09T00:02:45.763 INFO:teuthology.orchestra.run.smithi081.stdout:max_osd 12 2024-05-09T00:02:45.763 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 up in weight 1 up_from 8 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6802/870674145,v1:172.21.15.81:6803/870674145] [v2:172.21.15.81:6804/870674145,v1:172.21.15.81:6805/870674145] exists,up 5eca74f4-ec24-4e6b-a18e-aff734ea3087 2024-05-09T00:02:45.763 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 up in weight 1 up_from 13 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.150:6800/149811112,v1:172.21.15.150:6801/149811112] [v2:172.21.15.150:6802/149811112,v1:172.21.15.150:6803/149811112] exists,up 6663424d-1532-4800-8fd7-b969cf177bc5 2024-05-09T00:02:45.763 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 up in weight 1 up_from 17 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6800/1178354999,v1:172.21.15.171:6801/1178354999] [v2:172.21.15.171:6802/1178354999,v1:172.21.15.171:6803/1178354999] exists,up c8943079-f99e-4886-ae7f-69ea2917b744 2024-05-09T00:02:45.763 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 up in weight 1 up_from 24 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6810/1225293729,v1:172.21.15.81:6811/1225293729] [v2:172.21.15.81:6812/1225293729,v1:172.21.15.81:6813/1225293729] exists,up db48419f-e889-4126-9b11-9f40dee85d82 2024-05-09T00:02:45.763 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 up in weight 1 up_from 31 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.150:6808/2025740814,v1:172.21.15.150:6809/2025740814] [v2:172.21.15.150:6810/2025740814,v1:172.21.15.150:6811/2025740814] exists,up 72f26a22-e6f4-4e40-85e3-e4907cf5ca9d 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 up in weight 1 up_from 36 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6808/3861165436,v1:172.21.15.171:6809/3861165436] [v2:172.21.15.171:6810/3861165436,v1:172.21.15.171:6811/3861165436] exists,up d6eb056b-a97c-4a6e-9716-4d18d740f456 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 up in weight 1 up_from 43 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6818/2589726822,v1:172.21.15.81:6819/2589726822] [v2:172.21.15.81:6820/2589726822,v1:172.21.15.81:6821/2589726822] exists,up 228afbcd-479c-407b-83f2-a51afec0076c 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 up in weight 1 up_from 48 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.150:6816/643513018,v1:172.21.15.150:6817/643513018] [v2:172.21.15.150:6818/643513018,v1:172.21.15.150:6819/643513018] exists,up fc45d82f-490e-4708-b8c3-19befc6c6c99 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:osd.8 up in weight 1 up_from 55 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6816/1718824617,v1:172.21.15.171:6817/1718824617] [v2:172.21.15.171:6818/1718824617,v1:172.21.15.171:6819/1718824617] exists,up 6bec428c-7cf2-4eda-8fab-d2101e275491 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:osd.9 up in weight 1 up_from 62 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.81:6826/2430864324,v1:172.21.15.81:6827/2430864324] [v2:172.21.15.81:6828/2430864324,v1:172.21.15.81:6829/2430864324] exists,up b5283c55-1261-430c-a956-40670f7470e4 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:osd.10 up in weight 1 up_from 67 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.150:6824/867287800,v1:172.21.15.150:6825/867287800] [v2:172.21.15.150:6826/867287800,v1:172.21.15.150:6827/867287800] exists,up ae235e47-d35f-4171-bf0d-a983f53e99b2 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:osd.11 up in weight 1 up_from 74 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.171:6824/674529273,v1:172.21.15.171:6825/674529273] [v2:172.21.15.171:6826/674529273,v1:172.21.15.171:6827/674529273] exists,up d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/3479615186 expires 2024-05-09T23:56:46.209751+0000 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/1352656946 expires 2024-05-09T23:56:46.209751+0000 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/983907098 expires 2024-05-09T23:56:46.209751+0000 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6801/4280496150 expires 2024-05-09T23:56:46.209751+0000 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6800/2902845226 expires 2024-05-09T23:56:25.210832+0000 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/3549875739 expires 2024-05-09T23:56:25.210832+0000 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6801/2902845226 expires 2024-05-09T23:56:25.210832+0000 2024-05-09T00:02:45.764 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/2080304730 expires 2024-05-09T23:56:25.210832+0000 2024-05-09T00:02:45.765 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:0/468139746 expires 2024-05-09T23:56:25.210832+0000 2024-05-09T00:02:45.765 INFO:teuthology.orchestra.run.smithi081.stdout:blocklist 172.21.15.81:6800/4280496150 expires 2024-05-09T23:56:46.209751+0000 2024-05-09T00:02:45.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.769+0000 7f887aa7a700 1 -- 172.21.15.81:0/2240309518 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f88640a11b0 msgr2=0x7f88640a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.769+0000 7f887aa7a700 1 --2- 172.21.15.81:0/2240309518 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f88640a11b0 0x7f88640a3670 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8868009a10 tx=0x7f8868009190 comp rx=0 tx=0).stop 2024-05-09T00:02:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.769+0000 7f887aa7a700 1 -- 172.21.15.81:0/2240309518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8874101a20 msgr2=0x7f887419d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.769+0000 7f887aa7a700 1 --2- 172.21.15.81:0/2240309518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8874101a20 0x7f887419d560 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f886c004d00 tx=0x7f886c004d30 comp rx=0 tx=0).stop 2024-05-09T00:02:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.769+0000 7f887aa7a700 1 -- 172.21.15.81:0/2240309518 shutdown_connections 2024-05-09T00:02:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.769+0000 7f887aa7a700 1 --2- 172.21.15.81:0/2240309518 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f88640a11b0 0x7f88640a3670 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.769+0000 7f887aa7a700 1 --2- 172.21.15.81:0/2240309518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8874101a20 0x7f887419d560 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.769+0000 7f887aa7a700 1 --2- 172.21.15.81:0/2240309518 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f88740fff00 0x7f8874196040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:45.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.769+0000 7f887aa7a700 1 --2- 172.21.15.81:0/2240309518 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8874101060 0x7f8874196580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.769+0000 7f887aa7a700 1 -- 172.21.15.81:0/2240309518 >> 172.21.15.81:0/2240309518 conn(0x7f88740fb4a0 msgr2=0x7f88741043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.769+0000 7f887aa7a700 1 -- 172.21.15.81:0/2240309518 shutdown_connections 2024-05-09T00:02:45.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:45.769+0000 7f887aa7a700 1 -- 172.21.15.81:0/2240309518 wait complete. 2024-05-09T00:02:46.094 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:45 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:46.094 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:45 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:02:46.094 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:45 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:46.094 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:45 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2240309518' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-09T00:02:46.113 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-09T00:02:46.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:02:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.265+0000 7fd144c80700 1 -- 172.21.15.81:0/2271098175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1400ffd90 msgr2=0x7fd1401001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.265+0000 7fd144c80700 1 --2- 172.21.15.81:0/2271098175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1400ffd90 0x7fd1401001b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd1280099c0 tx=0x7fd128009cd0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.265+0000 7fd144c80700 1 -- 172.21.15.81:0/2271098175 shutdown_connections 2024-05-09T00:02:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.265+0000 7fd144c80700 1 --2- 172.21.15.81:0/2271098175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd140101920 0x7fd1401081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.265+0000 7fd144c80700 1 --2- 172.21.15.81:0/2271098175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1400ffd90 0x7fd1401001b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.265+0000 7fd144c80700 1 --2- 172.21.15.81:0/2271098175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd140100f80 0x7fd1401013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.265+0000 7fd144c80700 1 -- 172.21.15.81:0/2271098175 >> 172.21.15.81:0/2271098175 conn(0x7fd1400fb300 msgr2=0x7fd1400fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.265+0000 7fd144c80700 1 -- 172.21.15.81:0/2271098175 shutdown_connections 2024-05-09T00:02:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.265+0000 7fd144c80700 1 -- 172.21.15.81:0/2271098175 wait complete. 2024-05-09T00:02:46.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.265+0000 7fd144c80700 1 Processor -- start 2024-05-09T00:02:46.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.265+0000 7fd144c80700 1 -- start start 2024-05-09T00:02:46.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd144c80700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1400ffd90 0x7fd140069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:46.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd144c80700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd140100f80 0x7fd14019bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:46.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd144c80700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd140101920 0x7fd14019e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:46.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd144c80700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14019e8e0 con 0x7fd140101920 2024-05-09T00:02:46.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd144c80700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14019ea50 con 0x7fd1400ffd90 2024-05-09T00:02:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd144c80700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14019ec10 con 0x7fd140100f80 2024-05-09T00:02:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd13ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd140101920 0x7fd14019e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd13ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd140101920 0x7fd14019e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45652/0 (socket says 172.21.15.81:45652) 2024-05-09T00:02:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd13ed9d700 1 -- 172.21.15.81:0/793860771 learned_addr learned my addr 172.21.15.81:0/793860771 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd13dd9b700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd140100f80 0x7fd14019bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd13e59c700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1400ffd90 0x7fd140069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd13ed9d700 1 -- 172.21.15.81:0/793860771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd140100f80 msgr2=0x7fd14019bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd13ed9d700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd140100f80 0x7fd14019bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd13ed9d700 1 -- 172.21.15.81:0/793860771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1400ffd90 msgr2=0x7fd140069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd13ed9d700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1400ffd90 0x7fd140069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd13ed9d700 1 -- 172.21.15.81:0/793860771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1280095f0 con 0x7fd140101920 2024-05-09T00:02:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd13e59c700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1400ffd90 0x7fd140069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:46.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd13ed9d700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd140101920 0x7fd14019e140 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd138007ee0 tx=0x7fd13800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:46.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd1377fe700 1 -- 172.21.15.81:0/793860771 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138017070 con 0x7fd140101920 2024-05-09T00:02:46.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd1377fe700 1 -- 172.21.15.81:0/793860771 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd13800f040 con 0x7fd140101920 2024-05-09T00:02:46.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd144c80700 1 -- 172.21.15.81:0/793860771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14019eef0 con 0x7fd140101920 2024-05-09T00:02:46.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd1377fe700 1 -- 172.21.15.81:0/793860771 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138005740 con 0x7fd140101920 2024-05-09T00:02:46.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.266+0000 7fd144c80700 1 -- 172.21.15.81:0/793860771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14019f320 con 0x7fd140101920 2024-05-09T00:02:46.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.267+0000 7fd144c80700 1 -- 172.21.15.81:0/793860771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1401071b0 con 0x7fd140101920 2024-05-09T00:02:46.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.268+0000 7fd1377fe700 1 -- 172.21.15.81:0/793860771 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd13800dc60 con 0x7fd140101920 2024-05-09T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:45 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:45 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:45 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:46.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:45 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2240309518' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-09T00:02:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.269+0000 7fd1377fe700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd12c0a11b0 0x7fd12c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.269+0000 7fd13e59c700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd12c0a11b0 0x7fd12c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.269+0000 7fd1377fe700 1 -- 172.21.15.81:0/793860771 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd1380cc0d0 con 0x7fd140101920 2024-05-09T00:02:46.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.269+0000 7fd13e59c700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd12c0a11b0 0x7fd12c0a3670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd12800b580 tx=0x7fd128005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:46.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.274+0000 7fd1377fe700 1 -- 172.21.15.81:0/793860771 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd1380958b0 con 0x7fd140101920 2024-05-09T00:02:46.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:45 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:02:46.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:45 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:02:46.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:45 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' 2024-05-09T00:02:46.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:45 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2240309518' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-09T00:02:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.475+0000 7fd144c80700 1 -- 172.21.15.81:0/793860771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd14010b640 con 0x7fd140101920 2024-05-09T00:02:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.477+0000 7fd1377fe700 1 -- 172.21.15.81:0/793860771 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22095 (secure 0 0 0) 0x7fd138098ed0 con 0x7fd140101920 2024-05-09T00:02:46.472 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:46.472 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":79,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:01:46.020465+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:02:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.479+0000 7fd144c80700 1 -- 172.21.15.81:0/793860771 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd12c0a11b0 msgr2=0x7fd12c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.479+0000 7fd144c80700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd12c0a11b0 0x7fd12c0a3670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd12800b580 tx=0x7fd128005fb0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.479+0000 7fd144c80700 1 -- 172.21.15.81:0/793860771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd140101920 msgr2=0x7fd14019e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.479+0000 7fd144c80700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd140101920 0x7fd14019e140 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd138007ee0 tx=0x7fd13800d3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.479+0000 7fd144c80700 1 -- 172.21.15.81:0/793860771 shutdown_connections 2024-05-09T00:02:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.479+0000 7fd144c80700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fd12c0a11b0 0x7fd12c0a3670 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.479+0000 7fd144c80700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1400ffd90 0x7fd140069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.479+0000 7fd144c80700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd140101920 0x7fd14019e140 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.479+0000 7fd144c80700 1 --2- 172.21.15.81:0/793860771 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd140100f80 0x7fd14019bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.479+0000 7fd144c80700 1 -- 172.21.15.81:0/793860771 >> 172.21.15.81:0/793860771 conn(0x7fd1400fb300 msgr2=0x7fd1401042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:46.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.479+0000 7fd144c80700 1 -- 172.21.15.81:0/793860771 shutdown_connections 2024-05-09T00:02:46.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.479+0000 7fd144c80700 1 -- 172.21.15.81:0/793860771 wait complete. 2024-05-09T00:02:46.486 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:58:34.523249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T00:01:43.149260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T00:01:44.182730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:02:46.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:02:46.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.617+0000 7f130b756700 1 -- 172.21.15.81:0/1777786422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13041020f0 msgr2=0x7f1304102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.617+0000 7f130b756700 1 --2- 172.21.15.81:0/1777786422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13041020f0 0x7f1304102570 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1300009990 tx=0x7f1300009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.617+0000 7f130b756700 1 -- 172.21.15.81:0/1777786422 shutdown_connections 2024-05-09T00:02:46.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.617+0000 7f130b756700 1 --2- 172.21.15.81:0/1777786422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1304102ab0 0x7f13041093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.617+0000 7f130b756700 1 --2- 172.21.15.81:0/1777786422 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1304100f20 0x7f1304101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.617+0000 7f130b756700 1 --2- 172.21.15.81:0/1777786422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13041020f0 0x7f1304102570 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.617+0000 7f130b756700 1 -- 172.21.15.81:0/1777786422 >> 172.21.15.81:0/1777786422 conn(0x7f13040fc4e0 msgr2=0x7f13040fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.617+0000 7f130b756700 1 -- 172.21.15.81:0/1777786422 shutdown_connections 2024-05-09T00:02:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.617+0000 7f130b756700 1 -- 172.21.15.81:0/1777786422 wait complete. 2024-05-09T00:02:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f130b756700 1 Processor -- start 2024-05-09T00:02:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f130b756700 1 -- start start 2024-05-09T00:02:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f130b756700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1304100f20 0x7f1304196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f130b756700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13041020f0 0x7f13041973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f130b756700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1304102ab0 0x7f130419e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f130b756700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130419e9e0 con 0x7f13041020f0 2024-05-09T00:02:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f130b756700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130419eb20 con 0x7f1304102ab0 2024-05-09T00:02:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f130b756700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130419ecb0 con 0x7f1304100f20 2024-05-09T00:02:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f1308cf1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13041020f0 0x7f13041973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:46.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f1308cf1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13041020f0 0x7f13041973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45676/0 (socket says 172.21.15.81:45676) 2024-05-09T00:02:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f1308cf1700 1 -- 172.21.15.81:0/3459146896 learned_addr learned my addr 172.21.15.81:0/3459146896 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f13094f2700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1304100f20 0x7f1304196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f1309cf3700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1304102ab0 0x7f130419e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f1308cf1700 1 -- 172.21.15.81:0/3459146896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1304100f20 msgr2=0x7f1304196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f1308cf1700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1304100f20 0x7f1304196eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f1308cf1700 1 -- 172.21.15.81:0/3459146896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1304102ab0 msgr2=0x7f130419e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f1308cf1700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1304102ab0 0x7f130419e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f1308cf1700 1 -- 172.21.15.81:0/3459146896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000095f0 con 0x7f13041020f0 2024-05-09T00:02:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f1309cf3700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1304102ab0 0x7f130419e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:46.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f1308cf1700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13041020f0 0x7f13041973f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f130000b5c0 tx=0x7f1300004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.618+0000 7f12fa7fc700 1 -- 172.21.15.81:0/3459146896 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130001d070 con 0x7f13041020f0 2024-05-09T00:02:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.619+0000 7f12fa7fc700 1 -- 172.21.15.81:0/3459146896 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1300003f60 con 0x7f13041020f0 2024-05-09T00:02:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.619+0000 7f130b756700 1 -- 172.21.15.81:0/3459146896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130419ef30 con 0x7f13041020f0 2024-05-09T00:02:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.619+0000 7f12fa7fc700 1 -- 172.21.15.81:0/3459146896 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1300022d10 con 0x7f13041020f0 2024-05-09T00:02:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.619+0000 7f130b756700 1 -- 172.21.15.81:0/3459146896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130419f350 con 0x7f13041020f0 2024-05-09T00:02:46.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.619+0000 7f130b756700 1 -- 172.21.15.81:0/3459146896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1304108410 con 0x7f13041020f0 2024-05-09T00:02:46.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.620+0000 7f12fa7fc700 1 -- 172.21.15.81:0/3459146896 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f13000040d0 con 0x7f13041020f0 2024-05-09T00:02:46.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.621+0000 7f12fa7fc700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f12f00a1230 0x7f12f00a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:46.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.621+0000 7f13094f2700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f12f00a1230 0x7f12f00a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:46.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.621+0000 7f12fa7fc700 1 -- 172.21.15.81:0/3459146896 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f13000cdc10 con 0x7f13041020f0 2024-05-09T00:02:46.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.621+0000 7f13094f2700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f12f00a1230 0x7f12f00a36f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1304100c40 tx=0x7f12f400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:46.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.624+0000 7f12fa7fc700 1 -- 172.21.15.81:0/3459146896 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f130005dd60 con 0x7f13041020f0 2024-05-09T00:02:46.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.820+0000 7f130b756700 1 -- 172.21.15.81:0/3459146896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f130410c790 con 0x7f13041020f0 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.824+0000 7f12fa7fc700 1 -- 172.21.15.81:0/3459146896 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1300097400 con 0x7f13041020f0 2024-05-09T00:02:46.819 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-09T00:02:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.827+0000 7f130b756700 1 -- 172.21.15.81:0/3459146896 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f12f00a1230 msgr2=0x7f12f00a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.827+0000 7f130b756700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f12f00a1230 0x7f12f00a36f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1304100c40 tx=0x7f12f400b410 comp rx=0 tx=0).stop 2024-05-09T00:02:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.827+0000 7f130b756700 1 -- 172.21.15.81:0/3459146896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13041020f0 msgr2=0x7f13041973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.827+0000 7f130b756700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13041020f0 0x7f13041973f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f130000b5c0 tx=0x7f1300004730 comp rx=0 tx=0).stop 2024-05-09T00:02:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.827+0000 7f130b756700 1 -- 172.21.15.81:0/3459146896 shutdown_connections 2024-05-09T00:02:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.827+0000 7f130b756700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f12f00a1230 0x7f12f00a36f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.827+0000 7f130b756700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1304102ab0 0x7f130419e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.827+0000 7f130b756700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1304100f20 0x7f1304196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.827+0000 7f130b756700 1 --2- 172.21.15.81:0/3459146896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13041020f0 0x7f13041973f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.827+0000 7f130b756700 1 -- 172.21.15.81:0/3459146896 >> 172.21.15.81:0/3459146896 conn(0x7f13040fc4e0 msgr2=0x7f1304105550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:46.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.827+0000 7f130b756700 1 -- 172.21.15.81:0/3459146896 shutdown_connections 2024-05-09T00:02:46.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.827+0000 7f130b756700 1 -- 172.21.15.81:0/3459146896 wait complete. 2024-05-09T00:02:46.837 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T00:02:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.968+0000 7eff9ffff700 1 -- 172.21.15.81:0/3990620468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa01020f0 msgr2=0x7effa0102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.968+0000 7eff9ffff700 1 --2- 172.21.15.81:0/3990620468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa01020f0 0x7effa0102550 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7eff90009990 tx=0x7eff90009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.969+0000 7eff9ffff700 1 -- 172.21.15.81:0/3990620468 shutdown_connections 2024-05-09T00:02:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.969+0000 7eff9ffff700 1 --2- 172.21.15.81:0/3990620468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effa00ff080 0x7effa00ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.969+0000 7eff9ffff700 1 --2- 172.21.15.81:0/3990620468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa0102a90 0x7effa0109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.969+0000 7eff9ffff700 1 --2- 172.21.15.81:0/3990620468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa01020f0 0x7effa0102550 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.969+0000 7eff9ffff700 1 -- 172.21.15.81:0/3990620468 >> 172.21.15.81:0/3990620468 conn(0x7effa00fa9d0 msgr2=0x7effa00fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:46.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.969+0000 7eff9ffff700 1 -- 172.21.15.81:0/3990620468 shutdown_connections 2024-05-09T00:02:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.969+0000 7eff9ffff700 1 -- 172.21.15.81:0/3990620468 wait complete. 2024-05-09T00:02:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.969+0000 7eff9ffff700 1 Processor -- start 2024-05-09T00:02:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.969+0000 7eff9ffff700 1 -- start start 2024-05-09T00:02:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.969+0000 7eff9ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effa00ff080 0x7effa0101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9ffff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa01020f0 0x7effa01000a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa0102a90 0x7effa01005e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9ffff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa0100d80 con 0x7effa0102a90 2024-05-09T00:02:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9ffff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa0100ef0 con 0x7effa00ff080 2024-05-09T00:02:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9ffff700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa01a0d80 con 0x7effa01020f0 2024-05-09T00:02:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa0102a90 0x7effa01005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa0102a90 0x7effa01005e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45706/0 (socket says 172.21.15.81:45706) 2024-05-09T00:02:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9f7fe700 1 -- 172.21.15.81:0/937115129 learned_addr learned my addr 172.21.15.81:0/937115129 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9e7fc700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa01020f0 0x7effa01000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:46.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9f7fe700 1 -- 172.21.15.81:0/937115129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa01020f0 msgr2=0x7effa01000a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9f7fe700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa01020f0 0x7effa01000a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9f7fe700 1 -- 172.21.15.81:0/937115129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effa00ff080 msgr2=0x7effa0101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9effd700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effa00ff080 0x7effa0101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9f7fe700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effa00ff080 0x7effa0101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9f7fe700 1 -- 172.21.15.81:0/937115129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff900095f0 con 0x7effa0102a90 2024-05-09T00:02:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9e7fc700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa01020f0 0x7effa01000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9effd700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effa00ff080 0x7effa0101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9f7fe700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa0102a90 0x7effa01005e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7eff9800b970 tx=0x7eff9800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7effa49fd700 1 -- 172.21.15.81:0/937115129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9800c950 con 0x7effa0102a90 2024-05-09T00:02:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7effa49fd700 1 -- 172.21.15.81:0/937115129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff98014440 con 0x7effa0102a90 2024-05-09T00:02:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9ffff700 1 -- 172.21.15.81:0/937115129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa01a0fb0 con 0x7effa0102a90 2024-05-09T00:02:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7effa49fd700 1 -- 172.21.15.81:0/937115129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff980075d0 con 0x7effa0102a90 2024-05-09T00:02:46.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.970+0000 7eff9ffff700 1 -- 172.21.15.81:0/937115129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa01a1440 con 0x7effa0102a90 2024-05-09T00:02:46.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.971+0000 7eff9ffff700 1 -- 172.21.15.81:0/937115129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa01082b0 con 0x7effa0102a90 2024-05-09T00:02:46.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.972+0000 7effa49fd700 1 -- 172.21.15.81:0/937115129 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7eff980145b0 con 0x7effa0102a90 2024-05-09T00:02:46.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.973+0000 7effa49fd700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7eff880a11b0 0x7eff880a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:46.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.973+0000 7eff9effd700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7eff880a11b0 0x7eff880a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:46.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.973+0000 7effa49fd700 1 -- 172.21.15.81:0/937115129 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8227+0+0 (secure 0 0 0) 0x7eff98006e40 con 0x7effa0102a90 2024-05-09T00:02:46.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.973+0000 7eff9effd700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7eff880a11b0 0x7eff880a3670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7eff94005fd0 tx=0x7eff94005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:46.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:46.977+0000 7effa49fd700 1 -- 172.21.15.81:0/937115129 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7eff980957d0 con 0x7effa0102a90 2024-05-09T00:02:47.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-05-09T00:02:47.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-05-09T00:02:47.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11, 2, 1]}]: dispatch 2024-05-09T00:02:47.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]: dispatch 2024-05-09T00:02:47.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-09T00:02:47.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-05-09T00:02:47.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7, 5, 9]}]: dispatch 2024-05-09T00:02:47.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:46 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-05-09T00:02:47.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:46 smithi081 ceph-mon[42474]: pgmap v249: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T00:02:47.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:46 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/793860771' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.175+0000 7eff9ffff700 1 -- 172.21.15.81:0/937115129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7effa010c660 con 0x7effa0102a90 2024-05-09T00:02:47.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.175+0000 7effa49fd700 1 -- 172.21.15.81:0/937115129 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff98098df0 con 0x7effa0102a90 2024-05-09T00:02:47.169 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-09T00:02:47.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.177+0000 7eff9ffff700 1 -- 172.21.15.81:0/937115129 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7eff880a11b0 msgr2=0x7eff880a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:47.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.177+0000 7eff9ffff700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7eff880a11b0 0x7eff880a3670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7eff94005fd0 tx=0x7eff94005e40 comp rx=0 tx=0).stop 2024-05-09T00:02:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.177+0000 7eff9ffff700 1 -- 172.21.15.81:0/937115129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa0102a90 msgr2=0x7effa01005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.177+0000 7eff9ffff700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa0102a90 0x7effa01005e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7eff9800b970 tx=0x7eff9800bd30 comp rx=0 tx=0).stop 2024-05-09T00:02:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.177+0000 7eff9ffff700 1 -- 172.21.15.81:0/937115129 shutdown_connections 2024-05-09T00:02:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.177+0000 7eff9ffff700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7eff880a11b0 0x7eff880a3670 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.177+0000 7eff9ffff700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7effa00ff080 0x7effa0101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.177+0000 7eff9ffff700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effa0102a90 0x7effa01005e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.177+0000 7eff9ffff700 1 --2- 172.21.15.81:0/937115129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7effa01020f0 0x7effa01000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.177+0000 7eff9ffff700 1 -- 172.21.15.81:0/937115129 >> 172.21.15.81:0/937115129 conn(0x7effa00fa9d0 msgr2=0x7effa01053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.177+0000 7eff9ffff700 1 -- 172.21.15.81:0/937115129 shutdown_connections 2024-05-09T00:02:47.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.177+0000 7eff9ffff700 1 -- 172.21.15.81:0/937115129 wait complete. 2024-05-09T00:02:47.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T00:02:47.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-05-09T00:02:47.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-05-09T00:02:47.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11, 2, 1]}]: dispatch 2024-05-09T00:02:47.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]: dispatch 2024-05-09T00:02:47.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-09T00:02:47.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-05-09T00:02:47.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7, 5, 9]}]: dispatch 2024-05-09T00:02:47.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:46 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-05-09T00:02:47.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:46 smithi150 ceph-mon[46187]: pgmap v249: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T00:02:47.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:46 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/793860771' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:47.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-05-09T00:02:47.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]: dispatch 2024-05-09T00:02:47.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11, 2, 1]}]: dispatch 2024-05-09T00:02:47.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]: dispatch 2024-05-09T00:02:47.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]: dispatch 2024-05-09T00:02:47.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-05-09T00:02:47.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7, 5, 9]}]: dispatch 2024-05-09T00:02:47.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:46 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]: dispatch 2024-05-09T00:02:47.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:46 smithi171 ceph-mon[47351]: pgmap v249: 97 pgs: 97 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-09T00:02:47.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:46 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/793860771' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:47.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.314+0000 7f92e2a73700 1 -- 172.21.15.81:0/315009838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92dc102b10 msgr2=0x7f92dc1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:47.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.314+0000 7f92e2a73700 1 --2- 172.21.15.81:0/315009838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92dc102b10 0x7f92dc1093c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f92d400b0d0 tx=0x7f92d400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.314+0000 7f92e2a73700 1 -- 172.21.15.81:0/315009838 shutdown_connections 2024-05-09T00:02:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.314+0000 7f92e2a73700 1 --2- 172.21.15.81:0/315009838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92dc102b10 0x7f92dc1093c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.314+0000 7f92e2a73700 1 --2- 172.21.15.81:0/315009838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92dc100f80 0x7f92dc1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.314+0000 7f92e2a73700 1 --2- 172.21.15.81:0/315009838 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92dc102170 0x7f92dc1025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.314+0000 7f92e2a73700 1 -- 172.21.15.81:0/315009838 >> 172.21.15.81:0/315009838 conn(0x7f92dc0fc4f0 msgr2=0x7f92dc0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.314+0000 7f92e2a73700 1 -- 172.21.15.81:0/315009838 shutdown_connections 2024-05-09T00:02:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.314+0000 7f92e2a73700 1 -- 172.21.15.81:0/315009838 wait complete. 2024-05-09T00:02:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e2a73700 1 Processor -- start 2024-05-09T00:02:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e2a73700 1 -- start start 2024-05-09T00:02:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e2a73700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92dc100f80 0x7f92dc074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e2a73700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92dc102170 0x7f92dc073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e2a73700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92dc102b10 0x7f92dc0738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e2a73700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc074070 con 0x7f92dc100f80 2024-05-09T00:02:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e2a73700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc0741e0 con 0x7f92dc102170 2024-05-09T00:02:47.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e2a73700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92dc1a1030 con 0x7f92dc102b10 2024-05-09T00:02:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e080f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92dc100f80 0x7f92dc074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e080f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92dc100f80 0x7f92dc074d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59314/0 (socket says 172.21.15.81:59314) 2024-05-09T00:02:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e080f700 1 -- 172.21.15.81:0/673721527 learned_addr learned my addr 172.21.15.81:0/673721527 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e1010700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92dc102b10 0x7f92dc0738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92dbfff700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92dc102170 0x7f92dc073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e080f700 1 -- 172.21.15.81:0/673721527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92dc102b10 msgr2=0x7f92dc0738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e080f700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92dc102b10 0x7f92dc0738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e080f700 1 -- 172.21.15.81:0/673721527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92dc102170 msgr2=0x7f92dc073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e080f700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92dc102170 0x7f92dc073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e080f700 1 -- 172.21.15.81:0/673721527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d4009d00 con 0x7f92dc100f80 2024-05-09T00:02:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.315+0000 7f92e1010700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92dc102b10 0x7f92dc0738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.316+0000 7f92e080f700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92dc100f80 0x7f92dc074d00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f92d000e950 tx=0x7f92d000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.316+0000 7f92d9ffb700 1 -- 172.21.15.81:0/673721527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0009770 con 0x7f92dc100f80 2024-05-09T00:02:47.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.316+0000 7f92e2a73700 1 -- 172.21.15.81:0/673721527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92dc1a12c0 con 0x7f92dc100f80 2024-05-09T00:02:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.316+0000 7f92d9ffb700 1 -- 172.21.15.81:0/673721527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92d00044f0 con 0x7f92dc100f80 2024-05-09T00:02:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.316+0000 7f92d9ffb700 1 -- 172.21.15.81:0/673721527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0003d40 con 0x7f92dc100f80 2024-05-09T00:02:47.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.316+0000 7f92e2a73700 1 -- 172.21.15.81:0/673721527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92dc1a17d0 con 0x7f92dc100f80 2024-05-09T00:02:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.317+0000 7f92e2a73700 1 -- 172.21.15.81:0/673721527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92dc108330 con 0x7f92dc100f80 2024-05-09T00:02:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.318+0000 7f92d9ffb700 1 -- 172.21.15.81:0/673721527 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f92d000cce0 con 0x7f92dc100f80 2024-05-09T00:02:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.318+0000 7f92d9ffb700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f92cc0a11b0 0x7f92cc0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.318+0000 7f92dbfff700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f92cc0a11b0 0x7f92cc0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.319+0000 7f92d9ffb700 1 -- 172.21.15.81:0/673721527 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f92d0014070 con 0x7f92dc100f80 2024-05-09T00:02:47.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.319+0000 7f92dbfff700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f92cc0a11b0 0x7f92cc0a3670 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f92c8005fd0 tx=0x7f92c8005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:47.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.323+0000 7f92d9ffb700 1 -- 172.21.15.81:0/673721527 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f92d0096490 con 0x7f92dc100f80 2024-05-09T00:02:47.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.523+0000 7f92e2a73700 1 -- 172.21.15.81:0/673721527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f92dc10c9f0 con 0x7f92dc100f80 2024-05-09T00:02:47.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.524+0000 7f92d9ffb700 1 -- 172.21.15.81:0/673721527 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7f92d0099ab0 con 0x7f92dc100f80 2024-05-09T00:02:47.518 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-09T00:02:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.526+0000 7f92e2a73700 1 -- 172.21.15.81:0/673721527 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f92cc0a11b0 msgr2=0x7f92cc0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.526+0000 7f92e2a73700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f92cc0a11b0 0x7f92cc0a3670 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f92c8005fd0 tx=0x7f92c8005f60 comp rx=0 tx=0).stop 2024-05-09T00:02:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.526+0000 7f92e2a73700 1 -- 172.21.15.81:0/673721527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92dc100f80 msgr2=0x7f92dc074d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.526+0000 7f92e2a73700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92dc100f80 0x7f92dc074d00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f92d000e950 tx=0x7f92d000ed10 comp rx=0 tx=0).stop 2024-05-09T00:02:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.526+0000 7f92e2a73700 1 -- 172.21.15.81:0/673721527 shutdown_connections 2024-05-09T00:02:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.526+0000 7f92e2a73700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f92cc0a11b0 0x7f92cc0a3670 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.526+0000 7f92e2a73700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92dc102b10 0x7f92dc0738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.526+0000 7f92e2a73700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92dc100f80 0x7f92dc074d00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.526+0000 7f92e2a73700 1 --2- 172.21.15.81:0/673721527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f92dc102170 0x7f92dc073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.526+0000 7f92e2a73700 1 -- 172.21.15.81:0/673721527 >> 172.21.15.81:0/673721527 conn(0x7f92dc0fc4f0 msgr2=0x7f92dc105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.526+0000 7f92e2a73700 1 -- 172.21.15.81:0/673721527 shutdown_connections 2024-05-09T00:02:47.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.526+0000 7f92e2a73700 1 -- 172.21.15.81:0/673721527 wait complete. 2024-05-09T00:02:47.532 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:02:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.660+0000 7f61c5ec9700 1 -- 172.21.15.81:0/4122705447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c00ffd60 msgr2=0x7f61c0100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.660+0000 7f61c5ec9700 1 --2- 172.21.15.81:0/4122705447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c00ffd60 0x7f61c0100180 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f61a80099c0 tx=0x7f61a8009cd0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.660+0000 7f61c5ec9700 1 -- 172.21.15.81:0/4122705447 shutdown_connections 2024-05-09T00:02:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.660+0000 7f61c5ec9700 1 --2- 172.21.15.81:0/4122705447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c01018f0 0x7f61c01081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.660+0000 7f61c5ec9700 1 --2- 172.21.15.81:0/4122705447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c00ffd60 0x7f61c0100180 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.660+0000 7f61c5ec9700 1 --2- 172.21.15.81:0/4122705447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61c0100f50 0x7f61c01013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.660+0000 7f61c5ec9700 1 -- 172.21.15.81:0/4122705447 >> 172.21.15.81:0/4122705447 conn(0x7f61c00fb2f0 msgr2=0x7f61c00fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.660+0000 7f61c5ec9700 1 -- 172.21.15.81:0/4122705447 shutdown_connections 2024-05-09T00:02:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.660+0000 7f61c5ec9700 1 -- 172.21.15.81:0/4122705447 wait complete. 2024-05-09T00:02:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.661+0000 7f61c5ec9700 1 Processor -- start 2024-05-09T00:02:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.661+0000 7f61c5ec9700 1 -- start start 2024-05-09T00:02:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.661+0000 7f61c5ec9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61c00ffd60 0x7f61c0195cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.661+0000 7f61c5ec9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c0100f50 0x7f61c0196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.661+0000 7f61c5ec9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c01018f0 0x7f61c019d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.661+0000 7f61c5ec9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c019d7c0 con 0x7f61c01018f0 2024-05-09T00:02:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.661+0000 7f61c5ec9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c019d930 con 0x7f61c0100f50 2024-05-09T00:02:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.661+0000 7f61c5ec9700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c019daf0 con 0x7f61c00ffd60 2024-05-09T00:02:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.661+0000 7f61bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c01018f0 0x7f61c019d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.661+0000 7f61bffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c01018f0 0x7f61c019d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59336/0 (socket says 172.21.15.81:59336) 2024-05-09T00:02:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.661+0000 7f61bffff700 1 -- 172.21.15.81:0/2003433814 learned_addr learned my addr 172.21.15.81:0/2003433814 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.661+0000 7f61bf7fe700 1 --2- 172.21.15.81:0/2003433814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61c00ffd60 0x7f61c0195cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.661+0000 7f61beffd700 1 --2- 172.21.15.81:0/2003433814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c0100f50 0x7f61c0196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.662+0000 7f61bffff700 1 -- 172.21.15.81:0/2003433814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61c00ffd60 msgr2=0x7f61c0195cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.662+0000 7f61bffff700 1 --2- 172.21.15.81:0/2003433814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61c00ffd60 0x7f61c0195cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.662+0000 7f61bffff700 1 -- 172.21.15.81:0/2003433814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c0100f50 msgr2=0x7f61c0196210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.662+0000 7f61bffff700 1 --2- 172.21.15.81:0/2003433814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c0100f50 0x7f61c0196210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.662+0000 7f61bffff700 1 -- 172.21.15.81:0/2003433814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a80095f0 con 0x7f61c01018f0 2024-05-09T00:02:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.662+0000 7f61bffff700 1 --2- 172.21.15.81:0/2003433814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c01018f0 0x7f61c019d1f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f61b8007ee0 tx=0x7f61b800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.662+0000 7f61bcff9700 1 -- 172.21.15.81:0/2003433814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8017070 con 0x7f61c01018f0 2024-05-09T00:02:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.662+0000 7f61c5ec9700 1 -- 172.21.15.81:0/2003433814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c019ddd0 con 0x7f61c01018f0 2024-05-09T00:02:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.662+0000 7f61bcff9700 1 -- 172.21.15.81:0/2003433814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61b800f040 con 0x7f61c01018f0 2024-05-09T00:02:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.662+0000 7f61bcff9700 1 -- 172.21.15.81:0/2003433814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8005580 con 0x7f61c01018f0 2024-05-09T00:02:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.662+0000 7f61c5ec9700 1 -- 172.21.15.81:0/2003433814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c019e1f0 con 0x7f61c01018f0 2024-05-09T00:02:47.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.663+0000 7f61c5ec9700 1 -- 172.21.15.81:0/2003433814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c0107180 con 0x7f61c01018f0 2024-05-09T00:02:47.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.664+0000 7f61bcff9700 1 -- 172.21.15.81:0/2003433814 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f61b800db20 con 0x7f61c01018f0 2024-05-09T00:02:47.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.664+0000 7f61bcff9700 1 --2- 172.21.15.81:0/2003433814 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f61ac0a11b0 0x7f61ac0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:47.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.665+0000 7f61bf7fe700 1 --2- 172.21.15.81:0/2003433814 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f61ac0a11b0 0x7f61ac0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:47.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.665+0000 7f61bcff9700 1 -- 172.21.15.81:0/2003433814 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f61b80cc7d0 con 0x7f61c01018f0 2024-05-09T00:02:47.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.665+0000 7f61bf7fe700 1 --2- 172.21.15.81:0/2003433814 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f61ac0a11b0 0x7f61ac0a3670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f61a8003820 tx=0x7f61a8005900 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:47.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.668+0000 7f61bcff9700 1 -- 172.21.15.81:0/2003433814 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f61b8095e00 con 0x7f61c01018f0 2024-05-09T00:02:47.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.919+0000 7f61c5ec9700 1 -- 172.21.15.81:0/2003433814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61c0067c10 con 0x7f61c01018f0 2024-05-09T00:02:47.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.920+0000 7f61bcff9700 1 -- 172.21.15.81:0/2003433814 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10864 (secure 0 0 0) 0x7f61b8099420 con 0x7f61c01018f0 2024-05-09T00:02:47.914 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:47.914 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:01:50.053948+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:02:47.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.922+0000 7f61c5ec9700 1 -- 172.21.15.81:0/2003433814 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f61ac0a11b0 msgr2=0x7f61ac0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:47.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.922+0000 7f61c5ec9700 1 --2- 172.21.15.81:0/2003433814 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f61ac0a11b0 0x7f61ac0a3670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f61a8003820 tx=0x7f61a8005900 comp rx=0 tx=0).stop 2024-05-09T00:02:47.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.922+0000 7f61c5ec9700 1 -- 172.21.15.81:0/2003433814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c01018f0 msgr2=0x7f61c019d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:47.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.922+0000 7f61c5ec9700 1 --2- 172.21.15.81:0/2003433814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c01018f0 0x7f61c019d1f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f61b8007ee0 tx=0x7f61b800d3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.922+0000 7f61c5ec9700 1 -- 172.21.15.81:0/2003433814 shutdown_connections 2024-05-09T00:02:47.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.922+0000 7f61c5ec9700 1 --2- 172.21.15.81:0/2003433814 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f61ac0a11b0 0x7f61ac0a3670 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.922+0000 7f61c5ec9700 1 --2- 172.21.15.81:0/2003433814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c01018f0 0x7f61c019d1f0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.922+0000 7f61c5ec9700 1 --2- 172.21.15.81:0/2003433814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61c00ffd60 0x7f61c0195cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.922+0000 7f61c5ec9700 1 --2- 172.21.15.81:0/2003433814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61c0100f50 0x7f61c0196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:47.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.922+0000 7f61c5ec9700 1 -- 172.21.15.81:0/2003433814 >> 172.21.15.81:0/2003433814 conn(0x7f61c00fb2f0 msgr2=0x7f61c01042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:47.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.922+0000 7f61c5ec9700 1 -- 172.21.15.81:0/2003433814 shutdown_connections 2024-05-09T00:02:47.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:47.922+0000 7f61c5ec9700 1 -- 172.21.15.81:0/2003433814 wait complete. 2024-05-09T00:02:47.917 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-05-09T00:02:47.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:02:48.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 -- 172.21.15.81:0/3298582414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9470100280 msgr2=0x7f94701006a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 --2- 172.21.15.81:0/3298582414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9470100280 0x7f94701006a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9464009990 tx=0x7f9464009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 -- 172.21.15.81:0/3298582414 shutdown_connections 2024-05-09T00:02:48.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 --2- 172.21.15.81:0/3298582414 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9470101950 0x7f94701081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 --2- 172.21.15.81:0/3298582414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9470100280 0x7f94701006a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 --2- 172.21.15.81:0/3298582414 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9470100f90 0x7f9470101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 -- 172.21.15.81:0/3298582414 >> 172.21.15.81:0/3298582414 conn(0x7f94700faa70 msgr2=0x7f94700fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:48.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 -- 172.21.15.81:0/3298582414 shutdown_connections 2024-05-09T00:02:48.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 -- 172.21.15.81:0/3298582414 wait complete. 2024-05-09T00:02:48.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 Processor -- start 2024-05-09T00:02:48.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 -- start start 2024-05-09T00:02:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9470100280 0x7f9470196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9470100f90 0x7f94701973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9470101950 0x7f947019e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947019e9c0 con 0x7f9470100280 2024-05-09T00:02:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947019eb00 con 0x7f9470101950 2024-05-09T00:02:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f94771c0700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947019ec90 con 0x7f9470100f90 2024-05-09T00:02:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.057+0000 7f9474f5c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9470100280 0x7f9470196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.058+0000 7f9474f5c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9470100280 0x7f9470196e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59356/0 (socket says 172.21.15.81:59356) 2024-05-09T00:02:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.058+0000 7f9474f5c700 1 -- 172.21.15.81:0/3591661910 learned_addr learned my addr 172.21.15.81:0/3591661910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.058+0000 7f9474f5c700 1 -- 172.21.15.81:0/3591661910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9470100f90 msgr2=0x7f94701973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.058+0000 7f9474f5c700 1 --2- 172.21.15.81:0/3591661910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9470100f90 0x7f94701973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.058+0000 7f9474f5c700 1 -- 172.21.15.81:0/3591661910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9470101950 msgr2=0x7f947019e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.058+0000 7f9474f5c700 1 --2- 172.21.15.81:0/3591661910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9470101950 0x7f947019e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.058+0000 7f9474f5c700 1 -- 172.21.15.81:0/3591661910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94640095f0 con 0x7f9470100280 2024-05-09T00:02:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.058+0000 7f9474f5c700 1 --2- 172.21.15.81:0/3591661910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9470100280 0x7f9470196e90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9464004730 tx=0x7f9464004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.058+0000 7f946dffb700 1 -- 172.21.15.81:0/3591661910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946401d070 con 0x7f9470100280 2024-05-09T00:02:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.058+0000 7f946dffb700 1 -- 172.21.15.81:0/3591661910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9464022470 con 0x7f9470100280 2024-05-09T00:02:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.058+0000 7f94771c0700 1 -- 172.21.15.81:0/3591661910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947019ef10 con 0x7f9470100280 2024-05-09T00:02:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.058+0000 7f946dffb700 1 -- 172.21.15.81:0/3591661910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400f6c0 con 0x7f9470100280 2024-05-09T00:02:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.058+0000 7f94771c0700 1 -- 172.21.15.81:0/3591661910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947019f330 con 0x7f9470100280 2024-05-09T00:02:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.059+0000 7f94771c0700 1 -- 172.21.15.81:0/3591661910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94700673f0 con 0x7f9470100280 2024-05-09T00:02:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.060+0000 7f946dffb700 1 -- 172.21.15.81:0/3591661910 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f94640225e0 con 0x7f9470100280 2024-05-09T00:02:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.061+0000 7f946dffb700 1 --2- 172.21.15.81:0/3591661910 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f94600a1230 0x7f94600a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.061+0000 7f946dffb700 1 -- 172.21.15.81:0/3591661910 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f94640cdff0 con 0x7f9470100280 2024-05-09T00:02:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.061+0000 7f946ffff700 1 --2- 172.21.15.81:0/3591661910 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f94600a1230 0x7f94600a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.061+0000 7f946ffff700 1 --2- 172.21.15.81:0/3591661910 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f94600a1230 0x7f94600a36f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f94700fffa0 tx=0x7f945c005ca0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:48.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.065+0000 7f946dffb700 1 -- 172.21.15.81:0/3591661910 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f94640976b0 con 0x7f9470100280 2024-05-09T00:02:48.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:47 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3459146896' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:02:48.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:47 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-05-09T00:02:48.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:47 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-05-09T00:02:48.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:47 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11, 2, 1]}]': finished 2024-05-09T00:02:48.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:47 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-05-09T00:02:48.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:47 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-09T00:02:48.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:47 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-05-09T00:02:48.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:47 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7, 5, 9]}]': finished 2024-05-09T00:02:48.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:47 smithi081 ceph-mon[42474]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-05-09T00:02:48.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:47 smithi081 ceph-mon[42474]: osdmap e80: 12 total, 12 up, 12 in 2024-05-09T00:02:48.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:47 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/937115129' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:02:48.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:47 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/673721527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:02:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.267+0000 7f94771c0700 1 -- 172.21.15.81:0/3591661910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9470067380 con 0x7f9470100280 2024-05-09T00:02:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.268+0000 7f946dffb700 1 -- 172.21.15.81:0/3591661910 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22565 (secure 0 0 0) 0x7f946409acd0 con 0x7f9470100280 2024-05-09T00:02:48.263 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:48.264 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":81,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:02:47.827546+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:02:48.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:47 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3459146896' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:02:48.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:47 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-05-09T00:02:48.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:47 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-05-09T00:02:48.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:47 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11, 2, 1]}]': finished 2024-05-09T00:02:48.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:47 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-05-09T00:02:48.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:47 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-09T00:02:48.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:47 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-05-09T00:02:48.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:47 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7, 5, 9]}]': finished 2024-05-09T00:02:48.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:47 smithi150 ceph-mon[46187]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-05-09T00:02:48.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:47 smithi150 ceph-mon[46187]: osdmap e80: 12 total, 12 up, 12 in 2024-05-09T00:02:48.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:47 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/937115129' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:02:48.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:47 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/673721527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:02:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.271+0000 7f94771c0700 1 -- 172.21.15.81:0/3591661910 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f94600a1230 msgr2=0x7f94600a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.271+0000 7f94771c0700 1 --2- 172.21.15.81:0/3591661910 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f94600a1230 0x7f94600a36f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f94700fffa0 tx=0x7f945c005ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.271+0000 7f94771c0700 1 -- 172.21.15.81:0/3591661910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9470100280 msgr2=0x7f9470196e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.271+0000 7f94771c0700 1 --2- 172.21.15.81:0/3591661910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9470100280 0x7f9470196e90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9464004730 tx=0x7f9464004760 comp rx=0 tx=0).stop 2024-05-09T00:02:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.271+0000 7f94771c0700 1 -- 172.21.15.81:0/3591661910 shutdown_connections 2024-05-09T00:02:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.271+0000 7f94771c0700 1 --2- 172.21.15.81:0/3591661910 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f94600a1230 0x7f94600a36f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.271+0000 7f94771c0700 1 --2- 172.21.15.81:0/3591661910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9470101950 0x7f947019e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.271+0000 7f94771c0700 1 --2- 172.21.15.81:0/3591661910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9470100280 0x7f9470196e90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.271+0000 7f94771c0700 1 --2- 172.21.15.81:0/3591661910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9470100f90 0x7f94701973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.271+0000 7f94771c0700 1 -- 172.21.15.81:0/3591661910 >> 172.21.15.81:0/3591661910 conn(0x7f94700faa70 msgr2=0x7f94700fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.271+0000 7f94771c0700 1 -- 172.21.15.81:0/3591661910 shutdown_connections 2024-05-09T00:02:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.271+0000 7f94771c0700 1 -- 172.21.15.81:0/3591661910 wait complete. 2024-05-09T00:02:48.278 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:58:34.523249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T00:01:43.149260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T00:01:44.182730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:02:48.278 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:02:48.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:47 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3459146896' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:02:48.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:47 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-05-09T00:02:48.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:47 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-05-09T00:02:48.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:47 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11, 2, 1]}]': finished 2024-05-09T00:02:48.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:47 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 6]}]': finished 2024-05-09T00:02:48.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:47 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.10", "id": [5, 9]}]': finished 2024-05-09T00:02:48.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:47 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-05-09T00:02:48.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:47 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 7, 5, 9]}]': finished 2024-05-09T00:02:48.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:47 smithi171 ceph-mon[47351]: from='mgr.14152 172.21.15.81:0/951989859' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2024-05-09T00:02:48.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:47 smithi171 ceph-mon[47351]: osdmap e80: 12 total, 12 up, 12 in 2024-05-09T00:02:48.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:47 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/937115129' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:02:48.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:47 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/673721527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.409+0000 7f9b16791700 1 -- 172.21.15.81:0/3800341130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b10100fb0 msgr2=0x7f9b10101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.409+0000 7f9b16791700 1 --2- 172.21.15.81:0/3800341130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b10100fb0 0x7f9b10101430 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009990 tx=0x7f9b00009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 -- 172.21.15.81:0/3800341130 shutdown_connections 2024-05-09T00:02:48.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 --2- 172.21.15.81:0/3800341130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b100ffe60 0x7f9b10100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 --2- 172.21.15.81:0/3800341130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b10101970 0x7f9b10108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 --2- 172.21.15.81:0/3800341130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b10100fb0 0x7f9b10101430 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 -- 172.21.15.81:0/3800341130 >> 172.21.15.81:0/3800341130 conn(0x7f9b100fb3f0 msgr2=0x7f9b100fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:48.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 -- 172.21.15.81:0/3800341130 shutdown_connections 2024-05-09T00:02:48.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 -- 172.21.15.81:0/3800341130 wait complete. 2024-05-09T00:02:48.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 Processor -- start 2024-05-09T00:02:48.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 -- start start 2024-05-09T00:02:48.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b100ffe60 0x7f9b10068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:48.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b10100fb0 0x7f9b1019bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:48.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b10101970 0x7f9b1019e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:48.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1019ea00 con 0x7f9b10101970 2024-05-09T00:02:48.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1019eb70 con 0x7f9b10100fb0 2024-05-09T00:02:48.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.410+0000 7f9b16791700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1019ed30 con 0x7f9b100ffe60 2024-05-09T00:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b14d2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b10101970 0x7f9b1019e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b14d2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b10101970 0x7f9b1019e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59368/0 (socket says 172.21.15.81:59368) 2024-05-09T00:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b14d2e700 1 -- 172.21.15.81:0/3689099214 learned_addr learned my addr 172.21.15.81:0/3689099214 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b0f7fe700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b10100fb0 0x7f9b1019bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b0ffff700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b100ffe60 0x7f9b10068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b14d2e700 1 -- 172.21.15.81:0/3689099214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b100ffe60 msgr2=0x7f9b10068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b14d2e700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b100ffe60 0x7f9b10068b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b14d2e700 1 -- 172.21.15.81:0/3689099214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b10100fb0 msgr2=0x7f9b1019bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b14d2e700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b10100fb0 0x7f9b1019bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b14d2e700 1 -- 172.21.15.81:0/3689099214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b000095f0 con 0x7f9b10101970 2024-05-09T00:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b0f7fe700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b10100fb0 0x7f9b1019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b14d2e700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b10101970 0x7f9b1019e260 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800ada0 tx=0x7f9b0800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:48.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b0d7fa700 1 -- 172.21.15.81:0/3689099214 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0800f070 con 0x7f9b10101970 2024-05-09T00:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b16791700 1 -- 172.21.15.81:0/3689099214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1019efb0 con 0x7f9b10101970 2024-05-09T00:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b0d7fa700 1 -- 172.21.15.81:0/3689099214 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b08007b30 con 0x7f9b10101970 2024-05-09T00:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b0d7fa700 1 -- 172.21.15.81:0/3689099214 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08005440 con 0x7f9b10101970 2024-05-09T00:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.411+0000 7f9b16791700 1 -- 172.21.15.81:0/3689099214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1019f440 con 0x7f9b10101970 2024-05-09T00:02:48.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.412+0000 7f9b16791700 1 -- 172.21.15.81:0/3689099214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b101072a0 con 0x7f9b10101970 2024-05-09T00:02:48.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.413+0000 7f9b0d7fa700 1 -- 172.21.15.81:0/3689099214 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f9b08004ad0 con 0x7f9b10101970 2024-05-09T00:02:48.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.414+0000 7f9b0d7fa700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9af80a11b0 0x7f9af80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:48.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.414+0000 7f9b0ffff700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9af80a11b0 0x7f9af80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:48.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.414+0000 7f9b0d7fa700 1 -- 172.21.15.81:0/3689099214 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f9b080cc6b0 con 0x7f9b10101970 2024-05-09T00:02:48.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.414+0000 7f9b0ffff700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9af80a11b0 0x7f9af80a3670 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9b04005fd0 tx=0x7f9b0400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:48.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.417+0000 7f9b0d7fa700 1 -- 172.21.15.81:0/3689099214 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9b08095d70 con 0x7f9b10101970 2024-05-09T00:02:48.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.614+0000 7f9b16791700 1 -- 172.21.15.81:0/3689099214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b1010b6b0 con 0x7f9b10101970 2024-05-09T00:02:48.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.615+0000 7f9b0d7fa700 1 -- 172.21.15.81:0/3689099214 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b0801a310 con 0x7f9b10101970 2024-05-09T00:02:48.609 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-09T00:02:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.617+0000 7f9b16791700 1 -- 172.21.15.81:0/3689099214 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9af80a11b0 msgr2=0x7f9af80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.617+0000 7f9b16791700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9af80a11b0 0x7f9af80a3670 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9b04005fd0 tx=0x7f9b0400a560 comp rx=0 tx=0).stop 2024-05-09T00:02:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.617+0000 7f9b16791700 1 -- 172.21.15.81:0/3689099214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b10101970 msgr2=0x7f9b1019e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.617+0000 7f9b16791700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b10101970 0x7f9b1019e260 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800ada0 tx=0x7f9b0800c330 comp rx=0 tx=0).stop 2024-05-09T00:02:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.617+0000 7f9b16791700 1 -- 172.21.15.81:0/3689099214 shutdown_connections 2024-05-09T00:02:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.617+0000 7f9b16791700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f9af80a11b0 0x7f9af80a3670 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.617+0000 7f9b16791700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b10101970 0x7f9b1019e260 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.617+0000 7f9b16791700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b100ffe60 0x7f9b10068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.617+0000 7f9b16791700 1 --2- 172.21.15.81:0/3689099214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9b10100fb0 0x7f9b1019bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.617+0000 7f9b16791700 1 -- 172.21.15.81:0/3689099214 >> 172.21.15.81:0/3689099214 conn(0x7f9b100fb3f0 msgr2=0x7f9b101043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.617+0000 7f9b16791700 1 -- 172.21.15.81:0/3689099214 shutdown_connections 2024-05-09T00:02:48.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.617+0000 7f9b16791700 1 -- 172.21.15.81:0/3689099214 wait complete. 2024-05-09T00:02:48.624 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T00:02:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.756+0000 7f6dd19c5700 1 -- 172.21.15.81:0/968202340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dcc1000b0 msgr2=0x7f6dcc100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.756+0000 7f6dd19c5700 1 --2- 172.21.15.81:0/968202340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dcc1000b0 0x7f6dcc100530 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009990 tx=0x7f6dc0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.756+0000 7f6dd19c5700 1 -- 172.21.15.81:0/968202340 shutdown_connections 2024-05-09T00:02:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.756+0000 7f6dd19c5700 1 --2- 172.21.15.81:0/968202340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dcc100a70 0x7f6dcc108310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.756+0000 7f6dd19c5700 1 --2- 172.21.15.81:0/968202340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dcc101460 0x7f6dcc101880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.756+0000 7f6dd19c5700 1 --2- 172.21.15.81:0/968202340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dcc1000b0 0x7f6dcc100530 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.756+0000 7f6dd19c5700 1 -- 172.21.15.81:0/968202340 >> 172.21.15.81:0/968202340 conn(0x7f6dcc0fab80 msgr2=0x7f6dcc0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.756+0000 7f6dd19c5700 1 -- 172.21.15.81:0/968202340 shutdown_connections 2024-05-09T00:02:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.757+0000 7f6dd19c5700 1 -- 172.21.15.81:0/968202340 wait complete. 2024-05-09T00:02:48.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.757+0000 7f6dd19c5700 1 Processor -- start 2024-05-09T00:02:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.757+0000 7f6dd19c5700 1 -- start start 2024-05-09T00:02:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.757+0000 7f6dd19c5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dcc1000b0 0x7f6dcc0ffae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.757+0000 7f6dd19c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dcc100a70 0x7f6dcc19bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.757+0000 7f6dd19c5700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dcc101460 0x7f6dcc19e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.757+0000 7f6dd19c5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc19eab0 con 0x7f6dcc100a70 2024-05-09T00:02:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.757+0000 7f6dd19c5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc19ec20 con 0x7f6dcc1000b0 2024-05-09T00:02:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.757+0000 7f6dd19c5700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc19ede0 con 0x7f6dcc101460 2024-05-09T00:02:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dca7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dcc100a70 0x7f6dcc19bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dca7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dcc100a70 0x7f6dcc19bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59384/0 (socket says 172.21.15.81:59384) 2024-05-09T00:02:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dca7fc700 1 -- 172.21.15.81:0/3193760443 learned_addr learned my addr 172.21.15.81:0/3193760443 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dcb7fe700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dcc101460 0x7f6dcc19e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dcaffd700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dcc1000b0 0x7f6dcc0ffae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:48.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dca7fc700 1 -- 172.21.15.81:0/3193760443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dcc101460 msgr2=0x7f6dcc19e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dca7fc700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dcc101460 0x7f6dcc19e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dca7fc700 1 -- 172.21.15.81:0/3193760443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dcc1000b0 msgr2=0x7f6dcc0ffae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dca7fc700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dcc1000b0 0x7f6dcc0ffae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dca7fc700 1 -- 172.21.15.81:0/3193760443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc00095f0 con 0x7f6dcc100a70 2024-05-09T00:02:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dcb7fe700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dcc101460 0x7f6dcc19e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dcaffd700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dcc1000b0 0x7f6dcc0ffae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dca7fc700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dcc100a70 0x7f6dcc19bca0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00036f0 tx=0x7f6dc0009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dd09c3700 1 -- 172.21.15.81:0/3193760443 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc001d070 con 0x7f6dcc100a70 2024-05-09T00:02:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dd09c3700 1 -- 172.21.15.81:0/3193760443 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6dc00040d0 con 0x7f6dcc100a70 2024-05-09T00:02:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dd19c5700 1 -- 172.21.15.81:0/3193760443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc19f000 con 0x7f6dcc100a70 2024-05-09T00:02:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dd09c3700 1 -- 172.21.15.81:0/3193760443 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0005280 con 0x7f6dcc100a70 2024-05-09T00:02:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.758+0000 7f6dd19c5700 1 -- 172.21.15.81:0/3193760443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc19f3c0 con 0x7f6dcc100a70 2024-05-09T00:02:48.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.759+0000 7f6dd19c5700 1 -- 172.21.15.81:0/3193760443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dcc1073a0 con 0x7f6dcc100a70 2024-05-09T00:02:48.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.760+0000 7f6dd09c3700 1 -- 172.21.15.81:0/3193760443 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6dc0004830 con 0x7f6dcc100a70 2024-05-09T00:02:48.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.761+0000 7f6dd09c3700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6db40a11b0 0x7f6db40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:48.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.761+0000 7f6dd09c3700 1 -- 172.21.15.81:0/3193760443 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f6dc00cdc80 con 0x7f6dcc100a70 2024-05-09T00:02:48.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.761+0000 7f6dcaffd700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6db40a11b0 0x7f6db40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:48.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.761+0000 7f6dcaffd700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6db40a11b0 0x7f6db40a3670 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc005fd0 tx=0x7f6dbc005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:48.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.765+0000 7f6dd09c3700 1 -- 172.21.15.81:0/3193760443 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6dc0097340 con 0x7f6dcc100a70 2024-05-09T00:02:48.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.964+0000 7f6dd19c5700 1 -- 172.21.15.81:0/3193760443 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6dcc10b910 con 0x7f6dcc100a70 2024-05-09T00:02:48.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.965+0000 7f6dd09c3700 1 -- 172.21.15.81:0/3193760443 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6dc0016e80 con 0x7f6dcc100a70 2024-05-09T00:02:48.959 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-09T00:02:48.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.967+0000 7f6dd19c5700 1 -- 172.21.15.81:0/3193760443 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6db40a11b0 msgr2=0x7f6db40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.967+0000 7f6dd19c5700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6db40a11b0 0x7f6db40a3670 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc005fd0 tx=0x7f6dbc005f00 comp rx=0 tx=0).stop 2024-05-09T00:02:48.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.967+0000 7f6dd19c5700 1 -- 172.21.15.81:0/3193760443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dcc100a70 msgr2=0x7f6dcc19bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:48.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.967+0000 7f6dd19c5700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dcc100a70 0x7f6dcc19bca0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6dc00036f0 tx=0x7f6dc0009510 comp rx=0 tx=0).stop 2024-05-09T00:02:48.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.967+0000 7f6dd19c5700 1 -- 172.21.15.81:0/3193760443 shutdown_connections 2024-05-09T00:02:48.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.967+0000 7f6dd19c5700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f6db40a11b0 0x7f6db40a3670 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.967+0000 7f6dd19c5700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6dcc1000b0 0x7f6dcc0ffae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.967+0000 7f6dd19c5700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dcc101460 0x7f6dcc19e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.967+0000 7f6dd19c5700 1 --2- 172.21.15.81:0/3193760443 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6dcc100a70 0x7f6dcc19bca0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:48.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.967+0000 7f6dd19c5700 1 -- 172.21.15.81:0/3193760443 >> 172.21.15.81:0/3193760443 conn(0x7f6dcc0fab80 msgr2=0x7f6dcc1044e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:48.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.967+0000 7f6dd19c5700 1 -- 172.21.15.81:0/3193760443 shutdown_connections 2024-05-09T00:02:48.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:48.967+0000 7f6dd19c5700 1 -- 172.21.15.81:0/3193760443 wait complete. 2024-05-09T00:02:48.972 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:48 smithi081 ceph-mon[42474]: osdmap e81: 12 total, 12 up, 12 in 2024-05-09T00:02:48.972 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:48 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2003433814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:48.972 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:48 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3591661910' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:48.972 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:48 smithi081 ceph-mon[42474]: pgmap v252: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-05-09T00:02:48.972 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:48 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3689099214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:02:48.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T00:02:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.107+0000 7fa93c17f700 1 -- 172.21.15.81:0/287532103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa934101990 msgr2=0x7fa9341082b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.107+0000 7fa93c17f700 1 --2- 172.21.15.81:0/287532103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa934101990 0x7fa9341082b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00b0a0 tx=0x7fa92c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.107+0000 7fa93c17f700 1 -- 172.21.15.81:0/287532103 shutdown_connections 2024-05-09T00:02:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.107+0000 7fa93c17f700 1 --2- 172.21.15.81:0/287532103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa934101990 0x7fa9341082b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.107+0000 7fa93c17f700 1 --2- 172.21.15.81:0/287532103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9340ffe80 0x7fa9341002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.107+0000 7fa93c17f700 1 --2- 172.21.15.81:0/287532103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa934100fd0 0x7fa934101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.107+0000 7fa93c17f700 1 -- 172.21.15.81:0/287532103 >> 172.21.15.81:0/287532103 conn(0x7fa9340fb3f0 msgr2=0x7fa9340fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.107+0000 7fa93c17f700 1 -- 172.21.15.81:0/287532103 shutdown_connections 2024-05-09T00:02:49.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.107+0000 7fa93c17f700 1 -- 172.21.15.81:0/287532103 wait complete. 2024-05-09T00:02:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93c17f700 1 Processor -- start 2024-05-09T00:02:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93c17f700 1 -- start start 2024-05-09T00:02:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93c17f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9340ffe80 0x7fa934199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93c17f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa934100fd0 0x7fa9341996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93c17f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa934101990 0x7fa9341a06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93c17f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9341a0cb0 con 0x7fa934101990 2024-05-09T00:02:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93c17f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9341a0df0 con 0x7fa934100fd0 2024-05-09T00:02:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93c17f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9341a0f80 con 0x7fa9340ffe80 2024-05-09T00:02:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93a71c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa934101990 0x7fa9341a06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93a71c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa934101990 0x7fa9341a06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59412/0 (socket says 172.21.15.81:59412) 2024-05-09T00:02:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93a71c700 1 -- 172.21.15.81:0/1707461134 learned_addr learned my addr 172.21.15.81:0/1707461134 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa939f1b700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9340ffe80 0x7fa934199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93971a700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa934100fd0 0x7fa9341996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93a71c700 1 -- 172.21.15.81:0/1707461134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9340ffe80 msgr2=0x7fa934199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93a71c700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9340ffe80 0x7fa934199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93a71c700 1 -- 172.21.15.81:0/1707461134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa934100fd0 msgr2=0x7fa9341996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93a71c700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa934100fd0 0x7fa9341996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93a71c700 1 -- 172.21.15.81:0/1707461134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c009d00 con 0x7fa934101990 2024-05-09T00:02:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93971a700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa934100fd0 0x7fa9341996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.108+0000 7fa93a71c700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa934101990 0x7fa9341a06e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00d010 tx=0x7fa92c004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.109+0000 7fa92affd700 1 -- 172.21.15.81:0/1707461134 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c00e040 con 0x7fa934101990 2024-05-09T00:02:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.109+0000 7fa93c17f700 1 -- 172.21.15.81:0/1707461134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9341a1200 con 0x7fa934101990 2024-05-09T00:02:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.109+0000 7fa92affd700 1 -- 172.21.15.81:0/1707461134 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa92c01db50 con 0x7fa934101990 2024-05-09T00:02:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.109+0000 7fa92affd700 1 -- 172.21.15.81:0/1707461134 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c01bb60 con 0x7fa934101990 2024-05-09T00:02:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.109+0000 7fa93c17f700 1 -- 172.21.15.81:0/1707461134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9341a16d0 con 0x7fa934101990 2024-05-09T00:02:49.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.110+0000 7fa93c17f700 1 -- 172.21.15.81:0/1707461134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa934067460 con 0x7fa934101990 2024-05-09T00:02:49.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.111+0000 7fa92affd700 1 -- 172.21.15.81:0/1707461134 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa92c01bcc0 con 0x7fa934101990 2024-05-09T00:02:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.111+0000 7fa92affd700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa9200a11b0 0x7fa9200a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.111+0000 7fa939f1b700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa9200a11b0 0x7fa9200a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.111+0000 7fa92affd700 1 -- 172.21.15.81:0/1707461134 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7fa92c0cee40 con 0x7fa934101990 2024-05-09T00:02:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.112+0000 7fa939f1b700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa9200a11b0 0x7fa9200a3670 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa930009a10 tx=0x7fa930009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.115+0000 7fa92affd700 1 -- 172.21.15.81:0/1707461134 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa92c098500 con 0x7fa934101990 2024-05-09T00:02:49.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:48 smithi150 ceph-mon[46187]: osdmap e81: 12 total, 12 up, 12 in 2024-05-09T00:02:49.302 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:48 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2003433814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:49.302 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:48 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3591661910' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:49.302 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:48 smithi150 ceph-mon[46187]: pgmap v252: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-05-09T00:02:49.302 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:48 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3689099214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:02:49.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:48 smithi171 ceph-mon[47351]: osdmap e81: 12 total, 12 up, 12 in 2024-05-09T00:02:49.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:48 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2003433814' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:49.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:48 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3591661910' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:49.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:48 smithi171 ceph-mon[47351]: pgmap v252: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 4 op/s 2024-05-09T00:02:49.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:48 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3689099214' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:02:49.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.312+0000 7fa93c17f700 1 -- 172.21.15.81:0/1707461134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa93410b700 con 0x7fa934101990 2024-05-09T00:02:49.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.313+0000 7fa92affd700 1 -- 172.21.15.81:0/1707461134 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa92c09bb20 con 0x7fa934101990 2024-05-09T00:02:49.307 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-09T00:02:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.315+0000 7fa93c17f700 1 -- 172.21.15.81:0/1707461134 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa9200a11b0 msgr2=0x7fa9200a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:49.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.315+0000 7fa93c17f700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa9200a11b0 0x7fa9200a3670 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa930009a10 tx=0x7fa930009190 comp rx=0 tx=0).stop 2024-05-09T00:02:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.315+0000 7fa93c17f700 1 -- 172.21.15.81:0/1707461134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa934101990 msgr2=0x7fa9341a06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.315+0000 7fa93c17f700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa934101990 0x7fa9341a06e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00d010 tx=0x7fa92c004d00 comp rx=0 tx=0).stop 2024-05-09T00:02:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.315+0000 7fa93c17f700 1 -- 172.21.15.81:0/1707461134 shutdown_connections 2024-05-09T00:02:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.315+0000 7fa93c17f700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa9200a11b0 0x7fa9200a3670 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.315+0000 7fa93c17f700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa934101990 0x7fa9341a06e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.315+0000 7fa93c17f700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9340ffe80 0x7fa934199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.315+0000 7fa93c17f700 1 --2- 172.21.15.81:0/1707461134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa934100fd0 0x7fa9341996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.315+0000 7fa93c17f700 1 -- 172.21.15.81:0/1707461134 >> 172.21.15.81:0/1707461134 conn(0x7fa9340fb3f0 msgr2=0x7fa9340fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.315+0000 7fa93c17f700 1 -- 172.21.15.81:0/1707461134 shutdown_connections 2024-05-09T00:02:49.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.315+0000 7fa93c17f700 1 -- 172.21.15.81:0/1707461134 wait complete. 2024-05-09T00:02:49.322 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:02:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.450+0000 7f64e7e40700 1 -- 172.21.15.81:0/2182952522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e0106bb0 msgr2=0x7f64e0108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.450+0000 7f64e7e40700 1 --2- 172.21.15.81:0/2182952522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e0106bb0 0x7f64e0108fc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f64d800b0a0 tx=0x7f64d800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.450+0000 7f64e7e40700 1 -- 172.21.15.81:0/2182952522 shutdown_connections 2024-05-09T00:02:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.450+0000 7f64e7e40700 1 --2- 172.21.15.81:0/2182952522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e0106bb0 0x7f64e0108fc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.450+0000 7f64e7e40700 1 --2- 172.21.15.81:0/2182952522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64e0101950 0x7f64e0103d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.450+0000 7f64e7e40700 1 --2- 172.21.15.81:0/2182952522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64e0104280 0x7f64e0106670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.450+0000 7f64e7e40700 1 -- 172.21.15.81:0/2182952522 >> 172.21.15.81:0/2182952522 conn(0x7f64e00fb2e0 msgr2=0x7f64e00fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.450+0000 7f64e7e40700 1 -- 172.21.15.81:0/2182952522 shutdown_connections 2024-05-09T00:02:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.450+0000 7f64e7e40700 1 -- 172.21.15.81:0/2182952522 wait complete. 2024-05-09T00:02:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.450+0000 7f64e7e40700 1 Processor -- start 2024-05-09T00:02:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.450+0000 7f64e7e40700 1 -- start start 2024-05-09T00:02:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e7e40700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64e0101950 0x7f64e01011d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e7e40700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e0104280 0x7f64e00ff900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e7e40700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64e0106bb0 0x7f64e00ffe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e7e40700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e01004f0 con 0x7f64e0104280 2024-05-09T00:02:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e7e40700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e0100660 con 0x7f64e0101950 2024-05-09T00:02:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e7e40700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e01a0f80 con 0x7f64e0106bb0 2024-05-09T00:02:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e53db700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e0104280 0x7f64e00ff900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e53db700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e0104280 0x7f64e00ff900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59432/0 (socket says 172.21.15.81:59432) 2024-05-09T00:02:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e53db700 1 -- 172.21.15.81:0/3029265820 learned_addr learned my addr 172.21.15.81:0/3029265820 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e5bdc700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64e0101950 0x7f64e01011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e63dd700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64e0106bb0 0x7f64e00ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e53db700 1 -- 172.21.15.81:0/3029265820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64e0106bb0 msgr2=0x7f64e00ffe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e53db700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64e0106bb0 0x7f64e00ffe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e53db700 1 -- 172.21.15.81:0/3029265820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64e0101950 msgr2=0x7f64e01011d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e53db700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64e0101950 0x7f64e01011d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e53db700 1 -- 172.21.15.81:0/3029265820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d8009d00 con 0x7f64e0104280 2024-05-09T00:02:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e63dd700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64e0106bb0 0x7f64e00ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e53db700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e0104280 0x7f64e00ff900 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00c920 tx=0x7f64dc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64d6ffd700 1 -- 172.21.15.81:0/3029265820 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc007b00 con 0x7f64e0104280 2024-05-09T00:02:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64d6ffd700 1 -- 172.21.15.81:0/3029265820 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64dc00ce70 con 0x7f64e0104280 2024-05-09T00:02:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64e7e40700 1 -- 172.21.15.81:0/3029265820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e01a1180 con 0x7f64e0104280 2024-05-09T00:02:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.451+0000 7f64d6ffd700 1 -- 172.21.15.81:0/3029265820 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64dc0054e0 con 0x7f64e0104280 2024-05-09T00:02:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.452+0000 7f64e7e40700 1 -- 172.21.15.81:0/3029265820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e01a1690 con 0x7f64e0104280 2024-05-09T00:02:49.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.452+0000 7f64e7e40700 1 -- 172.21.15.81:0/3029265820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e00fce60 con 0x7f64e0104280 2024-05-09T00:02:49.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.453+0000 7f64d6ffd700 1 -- 172.21.15.81:0/3029265820 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f64dc004750 con 0x7f64e0104280 2024-05-09T00:02:49.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.454+0000 7f64d6ffd700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f64cc0a11b0 0x7f64cc0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:49.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.454+0000 7f64d6ffd700 1 -- 172.21.15.81:0/3029265820 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f64dc0cca70 con 0x7f64e0104280 2024-05-09T00:02:49.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.454+0000 7f64e5bdc700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f64cc0a11b0 0x7f64cc0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:49.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.454+0000 7f64e5bdc700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f64cc0a11b0 0x7f64cc0a3670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f64d0005950 tx=0x7f64d000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:49.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.458+0000 7f64d6ffd700 1 -- 172.21.15.81:0/3029265820 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f64dc0960a0 con 0x7f64e0104280 2024-05-09T00:02:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.703+0000 7f64e7e40700 1 -- 172.21.15.81:0/3029265820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64e0067380 con 0x7f64e0104280 2024-05-09T00:02:49.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.704+0000 7f64d6ffd700 1 -- 172.21.15.81:0/3029265820 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10864 (secure 0 0 0) 0x7f64dc01d020 con 0x7f64e0104280 2024-05-09T00:02:49.698 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:49.698 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:01:50.053948+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:02:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.706+0000 7f64e7e40700 1 -- 172.21.15.81:0/3029265820 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f64cc0a11b0 msgr2=0x7f64cc0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.706+0000 7f64e7e40700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f64cc0a11b0 0x7f64cc0a3670 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f64d0005950 tx=0x7f64d000b410 comp rx=0 tx=0).stop 2024-05-09T00:02:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.706+0000 7f64e7e40700 1 -- 172.21.15.81:0/3029265820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e0104280 msgr2=0x7f64e00ff900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.706+0000 7f64e7e40700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e0104280 0x7f64e00ff900 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f64dc00c920 tx=0x7f64dc00cc30 comp rx=0 tx=0).stop 2024-05-09T00:02:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.706+0000 7f64e7e40700 1 -- 172.21.15.81:0/3029265820 shutdown_connections 2024-05-09T00:02:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.706+0000 7f64e7e40700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f64cc0a11b0 0x7f64cc0a3670 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.706+0000 7f64e7e40700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64e0101950 0x7f64e01011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.706+0000 7f64e7e40700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64e0106bb0 0x7f64e00ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.706+0000 7f64e7e40700 1 --2- 172.21.15.81:0/3029265820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64e0104280 0x7f64e00ff900 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.706+0000 7f64e7e40700 1 -- 172.21.15.81:0/3029265820 >> 172.21.15.81:0/3029265820 conn(0x7f64e00fb2e0 msgr2=0x7f64e0102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.706+0000 7f64e7e40700 1 -- 172.21.15.81:0/3029265820 shutdown_connections 2024-05-09T00:02:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.706+0000 7f64e7e40700 1 -- 172.21.15.81:0/3029265820 wait complete. 2024-05-09T00:02:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-05-09T00:02:49.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:02:49.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.840+0000 7f82d0872700 1 -- 172.21.15.81:0/1004659110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82cc0ffd60 msgr2=0x7f82cc100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.840+0000 7f82d0872700 1 --2- 172.21.15.81:0/1004659110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82cc0ffd60 0x7f82cc100180 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0099c0 tx=0x7f82bc009cd0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.840+0000 7f82d0872700 1 -- 172.21.15.81:0/1004659110 shutdown_connections 2024-05-09T00:02:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.840+0000 7f82d0872700 1 --2- 172.21.15.81:0/1004659110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82cc1018f0 0x7f82cc1081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.840+0000 7f82d0872700 1 --2- 172.21.15.81:0/1004659110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82cc0ffd60 0x7f82cc100180 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.840+0000 7f82d0872700 1 --2- 172.21.15.81:0/1004659110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82cc100f50 0x7f82cc1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.840+0000 7f82d0872700 1 -- 172.21.15.81:0/1004659110 >> 172.21.15.81:0/1004659110 conn(0x7f82cc0fb2f0 msgr2=0x7f82cc0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.840+0000 7f82d0872700 1 -- 172.21.15.81:0/1004659110 shutdown_connections 2024-05-09T00:02:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.840+0000 7f82d0872700 1 -- 172.21.15.81:0/1004659110 wait complete. 2024-05-09T00:02:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.841+0000 7f82d0872700 1 Processor -- start 2024-05-09T00:02:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.841+0000 7f82d0872700 1 -- start start 2024-05-09T00:02:49.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.841+0000 7f82d0872700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82cc0ffd60 0x7f82cc103ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:49.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.841+0000 7f82d0872700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82cc100f50 0x7f82cc102330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:49.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.841+0000 7f82d0872700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82cc1018f0 0x7f82cc102870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:49.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.841+0000 7f82d0872700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc103010 con 0x7f82cc0ffd60 2024-05-09T00:02:49.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.841+0000 7f82d0872700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc103180 con 0x7f82cc100f50 2024-05-09T00:02:49.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.841+0000 7f82d0872700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc1a0e90 con 0x7f82cc1018f0 2024-05-09T00:02:49.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.841+0000 7f82ca59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82cc0ffd60 0x7f82cc103ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:49.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.841+0000 7f82ca59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82cc0ffd60 0x7f82cc103ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59436/0 (socket says 172.21.15.81:59436) 2024-05-09T00:02:49.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.842+0000 7f82ca59c700 1 -- 172.21.15.81:0/2616683218 learned_addr learned my addr 172.21.15.81:0/2616683218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:49.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.842+0000 7f82c9d9b700 1 --2- 172.21.15.81:0/2616683218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82cc100f50 0x7f82cc102330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:49.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.842+0000 7f82cad9d700 1 --2- 172.21.15.81:0/2616683218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82cc1018f0 0x7f82cc102870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:49.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.842+0000 7f82ca59c700 1 -- 172.21.15.81:0/2616683218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82cc1018f0 msgr2=0x7f82cc102870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:49.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.842+0000 7f82ca59c700 1 --2- 172.21.15.81:0/2616683218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82cc1018f0 0x7f82cc102870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.842+0000 7f82ca59c700 1 -- 172.21.15.81:0/2616683218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82cc100f50 msgr2=0x7f82cc102330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:49.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.842+0000 7f82ca59c700 1 --2- 172.21.15.81:0/2616683218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82cc100f50 0x7f82cc102330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:49.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.842+0000 7f82ca59c700 1 -- 172.21.15.81:0/2616683218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc0095f0 con 0x7f82cc0ffd60 2024-05-09T00:02:49.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.842+0000 7f82ca59c700 1 --2- 172.21.15.81:0/2616683218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82cc0ffd60 0x7f82cc103ca0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f82bc003730 tx=0x7f82bc00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:49.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.842+0000 7f82bb7fe700 1 -- 172.21.15.81:0/2616683218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc01d070 con 0x7f82cc0ffd60 2024-05-09T00:02:49.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.842+0000 7f82bb7fe700 1 -- 172.21.15.81:0/2616683218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82bc00fe70 con 0x7f82cc0ffd60 2024-05-09T00:02:49.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.842+0000 7f82d0872700 1 -- 172.21.15.81:0/2616683218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82cc1a10c0 con 0x7f82cc0ffd60 2024-05-09T00:02:49.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.842+0000 7f82bb7fe700 1 -- 172.21.15.81:0/2616683218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc0173f0 con 0x7f82cc0ffd60 2024-05-09T00:02:49.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.842+0000 7f82d0872700 1 -- 172.21.15.81:0/2616683218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc1a1480 con 0x7f82cc0ffd60 2024-05-09T00:02:49.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.843+0000 7f82d0872700 1 -- 172.21.15.81:0/2616683218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc067c10 con 0x7f82cc0ffd60 2024-05-09T00:02:49.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.844+0000 7f82bb7fe700 1 -- 172.21.15.81:0/2616683218 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f82bc022470 con 0x7f82cc0ffd60 2024-05-09T00:02:49.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.845+0000 7f82bb7fe700 1 --2- 172.21.15.81:0/2616683218 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f82b40a11b0 0x7f82b40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:49.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.845+0000 7f82bb7fe700 1 -- 172.21.15.81:0/2616683218 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f82bc0ce110 con 0x7f82cc0ffd60 2024-05-09T00:02:49.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.845+0000 7f82c9d9b700 1 --2- 172.21.15.81:0/2616683218 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f82b40a11b0 0x7f82b40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:49.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.845+0000 7f82c9d9b700 1 --2- 172.21.15.81:0/2616683218 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f82b40a11b0 0x7f82b40a3670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f82c0005950 tx=0x7f82c000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:49.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:49.848+0000 7f82bb7fe700 1 -- 172.21.15.81:0/2616683218 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f82bc0977d0 con 0x7f82cc0ffd60 2024-05-09T00:02:50.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.046+0000 7f82d0872700 1 -- 172.21.15.81:0/2616683218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82cc10b5c0 con 0x7f82cc0ffd60 2024-05-09T00:02:50.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.048+0000 7f82bb7fe700 1 -- 172.21.15.81:0/2616683218 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22565 (secure 0 0 0) 0x7f82bc09adf0 con 0x7f82cc0ffd60 2024-05-09T00:02:50.042 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:02:50.042 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":81,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:02:47.827546+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:02:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.050+0000 7f82d0872700 1 -- 172.21.15.81:0/2616683218 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f82b40a11b0 msgr2=0x7f82b40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.050+0000 7f82d0872700 1 --2- 172.21.15.81:0/2616683218 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f82b40a11b0 0x7f82b40a3670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f82c0005950 tx=0x7f82c000b410 comp rx=0 tx=0).stop 2024-05-09T00:02:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.050+0000 7f82d0872700 1 -- 172.21.15.81:0/2616683218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82cc0ffd60 msgr2=0x7f82cc103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.050+0000 7f82d0872700 1 --2- 172.21.15.81:0/2616683218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82cc0ffd60 0x7f82cc103ca0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f82bc003730 tx=0x7f82bc00fa00 comp rx=0 tx=0).stop 2024-05-09T00:02:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.050+0000 7f82d0872700 1 -- 172.21.15.81:0/2616683218 shutdown_connections 2024-05-09T00:02:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.050+0000 7f82d0872700 1 --2- 172.21.15.81:0/2616683218 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f82b40a11b0 0x7f82b40a3670 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.050+0000 7f82d0872700 1 --2- 172.21.15.81:0/2616683218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f82cc1018f0 0x7f82cc102870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.050+0000 7f82d0872700 1 --2- 172.21.15.81:0/2616683218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f82cc0ffd60 0x7f82cc103ca0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.050+0000 7f82d0872700 1 --2- 172.21.15.81:0/2616683218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f82cc100f50 0x7f82cc102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.050+0000 7f82d0872700 1 -- 172.21.15.81:0/2616683218 >> 172.21.15.81:0/2616683218 conn(0x7f82cc0fb2f0 msgr2=0x7f82cc0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.050+0000 7f82d0872700 1 -- 172.21.15.81:0/2616683218 shutdown_connections 2024-05-09T00:02:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.050+0000 7f82d0872700 1 -- 172.21.15.81:0/2616683218 wait complete. 2024-05-09T00:02:50.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:49 smithi081 ceph-mon[42474]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-05-09T00:02:50.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:49 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3193760443' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:02:50.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:49 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1707461134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:02:50.055 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:49 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3029265820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:50.057 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-09T00:01:45.018539+0000', 'modified': '2024-05-09T00:01:50.053948+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24506, 'mds_1': 24487, 'mds_2': 24476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24451': {'gid': 24451, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6835/259351107', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6834', 'nonce': 259351107}, {'type': 'v1', 'addr': '172.21.15.171:6835', 'nonce': 259351107}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24452': {'gid': 24452, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.150:6835/2480381166', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6834', 'nonce': 2480381166}, {'type': 'v1', 'addr': '172.21.15.150:6835', 'nonce': 2480381166}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24463': {'gid': 24463, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.171:6837/781467444', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6836', 'nonce': 781467444}, {'type': 'v1', 'addr': '172.21.15.171:6837', 'nonce': 781467444}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24476': {'gid': 24476, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.150:6837/2308594773', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6836', 'nonce': 2308594773}, {'type': 'v1', 'addr': '172.21.15.150:6837', 'nonce': 2308594773}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24487': {'gid': 24487, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.171:6839/932961693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6838', 'nonce': 932961693}, {'type': 'v1', 'addr': '172.21.15.171:6839', 'nonce': 932961693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24506': {'gid': 24506, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.150:6839/1233365858', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.150:6838', 'nonce': 1233365858}, {'type': 'v1', 'addr': '172.21.15.150:6839', 'nonce': 1233365858}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-09T00:02:50.057 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-09T00:02:50.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-05-09T00:02:50.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.186+0000 7f013522b700 1 -- 172.21.15.81:0/1781535192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0130102ab0 msgr2=0x7f01301093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.186+0000 7f013522b700 1 --2- 172.21.15.81:0/1781535192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0130102ab0 0x7f01301093d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f012800b0a0 tx=0x7f012800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.186+0000 7f013522b700 1 -- 172.21.15.81:0/1781535192 shutdown_connections 2024-05-09T00:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.186+0000 7f013522b700 1 --2- 172.21.15.81:0/1781535192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0130102ab0 0x7f01301093d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.186+0000 7f013522b700 1 --2- 172.21.15.81:0/1781535192 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0130100f20 0x7f0130101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.186+0000 7f013522b700 1 --2- 172.21.15.81:0/1781535192 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01301020f0 0x7f0130102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.186+0000 7f013522b700 1 -- 172.21.15.81:0/1781535192 >> 172.21.15.81:0/1781535192 conn(0x7f01300fc4e0 msgr2=0x7f01300fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.186+0000 7f013522b700 1 -- 172.21.15.81:0/1781535192 shutdown_connections 2024-05-09T00:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.186+0000 7f013522b700 1 -- 172.21.15.81:0/1781535192 wait complete. 2024-05-09T00:02:50.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.186+0000 7f013522b700 1 Processor -- start 2024-05-09T00:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f013522b700 1 -- start start 2024-05-09T00:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f013522b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0130100f20 0x7f0130197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f013522b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01301020f0 0x7f01301975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f013522b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0130102ab0 0x7f013019e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f013522b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013019eb90 con 0x7f01301020f0 2024-05-09T00:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f013522b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013019ecd0 con 0x7f0130100f20 2024-05-09T00:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f013522b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013019ee60 con 0x7f0130102ab0 2024-05-09T00:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f012e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01301020f0 0x7f01301975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f012e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01301020f0 0x7f01301975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59460/0 (socket says 172.21.15.81:59460) 2024-05-09T00:02:50.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f012e59c700 1 -- 172.21.15.81:0/3191449357 learned_addr learned my addr 172.21.15.81:0/3191449357 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f012f59e700 1 --2- 172.21.15.81:0/3191449357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0130102ab0 0x7f013019e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f012ed9d700 1 --2- 172.21.15.81:0/3191449357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0130100f20 0x7f0130197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f012e59c700 1 -- 172.21.15.81:0/3191449357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0130102ab0 msgr2=0x7f013019e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f012e59c700 1 --2- 172.21.15.81:0/3191449357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0130102ab0 0x7f013019e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f012e59c700 1 -- 172.21.15.81:0/3191449357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0130100f20 msgr2=0x7f0130197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f012e59c700 1 --2- 172.21.15.81:0/3191449357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0130100f20 0x7f0130197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f012e59c700 1 -- 172.21.15.81:0/3191449357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0128009d00 con 0x7f01301020f0 2024-05-09T00:02:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.187+0000 7f012e59c700 1 --2- 172.21.15.81:0/3191449357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01301020f0 0x7f01301975a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f012000d950 tx=0x7f012000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.188+0000 7f0117fff700 1 -- 172.21.15.81:0/3191449357 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120009940 con 0x7f01301020f0 2024-05-09T00:02:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.188+0000 7f0117fff700 1 -- 172.21.15.81:0/3191449357 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0120010460 con 0x7f01301020f0 2024-05-09T00:02:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.188+0000 7f013522b700 1 -- 172.21.15.81:0/3191449357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013019f140 con 0x7f01301020f0 2024-05-09T00:02:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.188+0000 7f0117fff700 1 -- 172.21.15.81:0/3191449357 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012000f620 con 0x7f01301020f0 2024-05-09T00:02:50.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.188+0000 7f013522b700 1 -- 172.21.15.81:0/3191449357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013019f650 con 0x7f01301020f0 2024-05-09T00:02:50.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.190+0000 7f0117fff700 1 -- 172.21.15.81:0/3191449357 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f01200108d0 con 0x7f01301020f0 2024-05-09T00:02:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.190+0000 7f0117fff700 1 --2- 172.21.15.81:0/3191449357 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f01180a11b0 0x7f01180a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.190+0000 7f012ed9d700 1 --2- 172.21.15.81:0/3191449357 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f01180a11b0 0x7f01180a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.190+0000 7f0117fff700 1 -- 172.21.15.81:0/3191449357 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f01200cc910 con 0x7f01301020f0 2024-05-09T00:02:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.191+0000 7f012ed9d700 1 --2- 172.21.15.81:0/3191449357 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f01180a11b0 0x7f01180a3670 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0124006fd0 tx=0x7f0124008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.191+0000 7f01413e5b80 1 Processor -- start 2024-05-09T00:02:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.191+0000 7f01413e5b80 1 -- start start 2024-05-09T00:02:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.191+0000 7f01413e5b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661b4f0 0x5575a661b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.191+0000 7f01413e5b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a661c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.191+0000 7f01413e5b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661c810 0x5575a661cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.191+0000 7f01413e5b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a6572100 con 0x5575a661be50 2024-05-09T00:02:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.191+0000 7f01413e5b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a656fac0 con 0x5575a661b4f0 2024-05-09T00:02:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.191+0000 7f01413e5b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a656b3b0 con 0x5575a661c810 2024-05-09T00:02:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.192+0000 7f012e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a661c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.192+0000 7f012e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a661c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59472/0 (socket says 172.21.15.81:59472) 2024-05-09T00:02:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.192+0000 7f012e59c700 1 -- 172.21.15.81:0/919802439 learned_addr learned my addr 172.21.15.81:0/919802439 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.192+0000 7f012ed9d700 1 --2- 172.21.15.81:0/919802439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661b4f0 0x5575a661b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.192+0000 7f012e59c700 1 -- 172.21.15.81:0/919802439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661c810 msgr2=0x5575a661cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.192+0000 7f012e59c700 1 --2- 172.21.15.81:0/919802439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661c810 0x5575a661cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.192+0000 7f012e59c700 1 -- 172.21.15.81:0/919802439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661b4f0 msgr2=0x5575a661b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.192+0000 7f012e59c700 1 --2- 172.21.15.81:0/919802439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661b4f0 0x5575a661b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.192+0000 7f012e59c700 1 -- 172.21.15.81:0/919802439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575a63ec360 con 0x5575a661be50 2024-05-09T00:02:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.192+0000 7f012e59c700 1 --2- 172.21.15.81:0/919802439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a661c2d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0120096670 tx=0x7f0120099660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4e88a4c8a05ed2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.192+0000 7f01157fa700 1 -- 172.21.15.81:0/919802439 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01200a2080 con 0x5575a661be50 2024-05-09T00:02:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.192+0000 7f01157fa700 1 -- 172.21.15.81:0/919802439 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01200ca510 con 0x5575a661be50 2024-05-09T00:02:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.192+0000 7f01157fa700 1 -- 172.21.15.81:0/919802439 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01200a1bf0 con 0x5575a661be50 2024-05-09T00:02:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.193+0000 7f01413e5b80 1 -- 172.21.15.81:0/919802439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 msgr2=0x5575a661c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.193+0000 7f01413e5b80 1 --2- 172.21.15.81:0/919802439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a661c2d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0120096670 tx=0x7f0120099660 comp rx=0 tx=0).stop 2024-05-09T00:02:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.193+0000 7f01413e5b80 1 -- 172.21.15.81:0/919802439 shutdown_connections 2024-05-09T00:02:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.193+0000 7f01413e5b80 1 --2- 172.21.15.81:0/919802439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661b4f0 0x5575a661b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.193+0000 7f01413e5b80 1 --2- 172.21.15.81:0/919802439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661c810 0x5575a661cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.193+0000 7f01413e5b80 1 --2- 172.21.15.81:0/919802439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a661c2d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.193+0000 7f01413e5b80 1 -- 172.21.15.81:0/919802439 >> 172.21.15.81:0/919802439 conn(0x5575a65791c0 msgr2=0x5575a6615d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.193+0000 7f01413e5b80 1 -- 172.21.15.81:0/919802439 shutdown_connections 2024-05-09T00:02:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.193+0000 7f01413e5b80 1 -- 172.21.15.81:0/919802439 wait complete. 2024-05-09T00:02:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.193+0000 7f01413e5b80 1 -- start start 2024-05-09T00:02:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.193+0000 7f01413e5b80 1 Processor -- start 2024-05-09T00:02:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.193+0000 7f01413e5b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661b4f0 0x5575a6624e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.193+0000 7f01413e5b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a6625350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.193+0000 7f01413e5b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661c810 0x5575a662c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f01413e5b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a6507510 con 0x5575a661be50 2024-05-09T00:02:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f01413e5b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a65071b0 con 0x5575a661c810 2024-05-09T00:02:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f01413e5b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a63ee650 con 0x5575a661b4f0 2024-05-09T00:02:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f01413e5b80 10 client.0 _ll_register_callbacks cb 0x5575a6510ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:02:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f012e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a6625350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f012e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a6625350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59474/0 (socket says 172.21.15.81:59474) 2024-05-09T00:02:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f012e59c700 1 -- 172.21.15.81:0/4171041521 learned_addr learned my addr 172.21.15.81:0/4171041521 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f012ed9d700 1 --2- 172.21.15.81:0/4171041521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661b4f0 0x5575a6624e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f012e59c700 1 -- 172.21.15.81:0/4171041521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661b4f0 msgr2=0x5575a6624e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f012e59c700 1 --2- 172.21.15.81:0/4171041521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661b4f0 0x5575a6624e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f012e59c700 1 -- 172.21.15.81:0/4171041521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661c810 msgr2=0x5575a662c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f012e59c700 1 --2- 172.21.15.81:0/4171041521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661c810 0x5575a662c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f012e59c700 1 -- 172.21.15.81:0/4171041521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013019f650 con 0x5575a661be50 2024-05-09T00:02:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f012e59c700 1 --2- 172.21.15.81:0/4171041521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a6625350 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f012009c040 tx=0x7f0120010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d844b4a3ac75027 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f0112ff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:02:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f0112ff5700 1 -- 172.21.15.81:0/4171041521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120099370 con 0x5575a661be50 2024-05-09T00:02:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f0112ff5700 1 -- 172.21.15.81:0/4171041521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f01200a1bf0 con 0x5575a661be50 2024-05-09T00:02:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f01413e5b80 1 -- 172.21.15.81:0/4171041521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5575a64c4220 con 0x5575a661be50 2024-05-09T00:02:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f0112ff5700 1 -- 172.21.15.81:0/4171041521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01200a1db0 con 0x5575a661be50 2024-05-09T00:02:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f01413e5b80 10 client.15228 fetch_fsmap learned FSMap version 23 2024-05-09T00:02:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f01413e5b80 1 -- 172.21.15.81:0/4171041521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5575a6398b10 con 0x5575a661be50 2024-05-09T00:02:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.194+0000 7f0112ff5700 1 -- 172.21.15.81:0/4171041521 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f012007d020 con 0x5575a661be50 2024-05-09T00:02:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.195+0000 7f0112ff5700 1 -- 172.21.15.81:0/4171041521 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f01200adbf0 con 0x5575a661be50 2024-05-09T00:02:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.195+0000 7f01413e5b80 10 client.15228 fetch_fsmap finished waiting for FSMap version 23 2024-05-09T00:02:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.195+0000 7f01413e5b80 10 client.15228 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-09T00:02:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.195+0000 7f01413e5b80 20 client.15228 populate_metadata read hostname 'smithi081' 2024-05-09T00:02:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.195+0000 7f01413e5b80 1 --2- 172.21.15.81:0/4171041521 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5575a662fb70 0x5575a6634e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.195+0000 7f01413e5b80 4 client.15228 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:02:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.195+0000 7f01413e5b80 1 -- 172.21.15.81:0/4171041521 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5575a65ea7c0 con 0x5575a662fb70 2024-05-09T00:02:50.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.195+0000 7f012ed9d700 1 --2- 172.21.15.81:0/4171041521 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5575a662fb70 0x5575a6634e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.195+0000 7f0112ff5700 10 client.15228 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:02:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.195+0000 7f012ed9d700 1 --2- 172.21.15.81:0/4171041521 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5575a662fb70 0x5575a6634e70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a25daeecdf9a4999 server_cookie=59f943378f74376e in_seq=0 out_seq=0 2024-05-09T00:02:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f0112ff5700 1 -- 172.21.15.81:0/4171041521 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5575a65ea7c0 con 0x5575a662fb70 2024-05-09T00:02:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f0112ff5700 10 client.15228 handle_command_reply: tid=0 2024-05-09T00:02:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f01413e5b80 1 client.15228 shutdown 2024-05-09T00:02:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f01413e5b80 1 -- 172.21.15.81:0/4171041521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 msgr2=0x5575a6625350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f01413e5b80 1 --2- 172.21.15.81:0/4171041521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a6625350 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f012009c040 tx=0x7f0120010cd0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f01413e5b80 1 -- 172.21.15.81:0/4171041521 shutdown_connections 2024-05-09T00:02:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f01413e5b80 1 --2- 172.21.15.81:0/4171041521 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5575a662fb70 0x5575a6634e70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f01413e5b80 1 --2- 172.21.15.81:0/4171041521 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661c810 0x5575a662c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f01413e5b80 1 --2- 172.21.15.81:0/4171041521 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661b4f0 0x5575a6624e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f0112ff5700 0 client.15228 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:02:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f01413e5b80 1 --2- 172.21.15.81:0/4171041521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a6625350 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f01413e5b80 1 -- 172.21.15.81:0/4171041521 >> 172.21.15.81:0/4171041521 conn(0x5575a65791c0 msgr2=0x5575a6615550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f01413e5b80 1 -- 172.21.15.81:0/4171041521 shutdown_connections 2024-05-09T00:02:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f01413e5b80 1 -- 172.21.15.81:0/4171041521 wait complete. 2024-05-09T00:02:50.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.196+0000 7f01413e5b80 20 client.15228 trim_cache size 0 max 16384 2024-05-09T00:02:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.214+0000 7f01413e5b80 1 Processor -- start 2024-05-09T00:02:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.214+0000 7f01413e5b80 1 -- start start 2024-05-09T00:02:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f01413e5b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661b4f0 0x5575a66165f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f01413e5b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a661b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f01413e5b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661c810 0x5575a662ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f01413e5b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a65ea7f0 con 0x5575a661be50 2024-05-09T00:02:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f01413e5b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a65292e0 con 0x5575a661b4f0 2024-05-09T00:02:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f01413e5b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a6568010 con 0x5575a661c810 2024-05-09T00:02:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f012e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a661b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f012e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a661b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59488/0 (socket says 172.21.15.81:59488) 2024-05-09T00:02:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f012e59c700 1 -- 172.21.15.81:0/733677403 learned_addr learned my addr 172.21.15.81:0/733677403 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f012e59c700 1 -- 172.21.15.81:0/733677403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661c810 msgr2=0x5575a662ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f012e59c700 1 --2- 172.21.15.81:0/733677403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661c810 0x5575a662ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f012e59c700 1 -- 172.21.15.81:0/733677403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661b4f0 msgr2=0x5575a66165f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f012e59c700 1 --2- 172.21.15.81:0/733677403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661b4f0 0x5575a66165f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f012e59c700 1 -- 172.21.15.81:0/733677403 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5575a6531510 con 0x5575a661be50 2024-05-09T00:02:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f012e59c700 1 --2- 172.21.15.81:0/733677403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a661b8d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f012000b2f0 tx=0x7f012009a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cca0d723752d38 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f0115ffb700 1 -- 172.21.15.81:0/733677403 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120099370 con 0x5575a661be50 2024-05-09T00:02:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f0115ffb700 1 -- 172.21.15.81:0/733677403 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f012007d070 con 0x5575a661be50 2024-05-09T00:02:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.215+0000 7f0115ffb700 1 -- 172.21.15.81:0/733677403 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01200a1e50 con 0x5575a661be50 2024-05-09T00:02:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 -- 172.21.15.81:0/733677403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 msgr2=0x5575a661b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 --2- 172.21.15.81:0/733677403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a661b8d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f012000b2f0 tx=0x7f012009a470 comp rx=0 tx=0).stop 2024-05-09T00:02:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 -- 172.21.15.81:0/733677403 shutdown_connections 2024-05-09T00:02:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 --2- 172.21.15.81:0/733677403 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661b4f0 0x5575a66165f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 --2- 172.21.15.81:0/733677403 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661c810 0x5575a662ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 --2- 172.21.15.81:0/733677403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661be50 0x5575a661b8d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 -- 172.21.15.81:0/733677403 >> 172.21.15.81:0/733677403 conn(0x5575a65791c0 msgr2=0x5575a661cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 -- 172.21.15.81:0/733677403 shutdown_connections 2024-05-09T00:02:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 -- 172.21.15.81:0/733677403 wait complete. 2024-05-09T00:02:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 -- start start 2024-05-09T00:02:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 Processor -- start 2024-05-09T00:02:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661b4f0 0x5575a66264d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661be50 0x5575a6626a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661c810 0x5575a662b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a662bc60 con 0x5575a661b4f0 2024-05-09T00:02:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a662bdd0 con 0x5575a661be50 2024-05-09T00:02:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.216+0000 7f01413e5b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5575a662bf90 con 0x5575a661c810 2024-05-09T00:02:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f01413e5b80 10 client.0 _ll_register_callbacks cb 0x5575a6510ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:02:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f012ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661b4f0 0x5575a66264d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f012ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661b4f0 0x5575a66264d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59498/0 (socket says 172.21.15.81:59498) 2024-05-09T00:02:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f012ed9d700 1 -- 172.21.15.81:0/1509688807 learned_addr learned my addr 172.21.15.81:0/1509688807 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f012e59c700 1 --2- 172.21.15.81:0/1509688807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661be50 0x5575a6626a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f012f59e700 1 --2- 172.21.15.81:0/1509688807 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661c810 0x5575a662b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f012ed9d700 1 -- 172.21.15.81:0/1509688807 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661c810 msgr2=0x5575a662b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f012ed9d700 1 --2- 172.21.15.81:0/1509688807 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661c810 0x5575a662b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f012ed9d700 1 -- 172.21.15.81:0/1509688807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661be50 msgr2=0x5575a6626a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f012ed9d700 1 --2- 172.21.15.81:0/1509688807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661be50 0x5575a6626a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f012ed9d700 1 -- 172.21.15.81:0/1509688807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5575a6398b10 con 0x5575a661b4f0 2024-05-09T00:02:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f012f59e700 1 --2- 172.21.15.81:0/1509688807 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661c810 0x5575a662b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f012ed9d700 1 --2- 172.21.15.81:0/1509688807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661b4f0 0x5575a66264d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x5575a65075d0 tx=0x7f0124004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab59a90ce96f41b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f0112ff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:02:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f0112ff5700 1 -- 172.21.15.81:0/1509688807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0124025380 con 0x5575a661b4f0 2024-05-09T00:02:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f0112ff5700 1 -- 172.21.15.81:0/1509688807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f01240254e0 con 0x5575a661b4f0 2024-05-09T00:02:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f01413e5b80 1 -- 172.21.15.81:0/1509688807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01200ca510 con 0x5575a661b4f0 2024-05-09T00:02:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f0112ff5700 1 -- 172.21.15.81:0/1509688807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01240256a0 con 0x5575a661b4f0 2024-05-09T00:02:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f01413e5b80 10 client.15234 fetch_fsmap learned FSMap version 23 2024-05-09T00:02:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f01413e5b80 1 -- 172.21.15.81:0/1509688807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5575a63f0c80 con 0x5575a661b4f0 2024-05-09T00:02:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.217+0000 7f0112ff5700 1 -- 172.21.15.81:0/1509688807 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01200ca510 con 0x5575a661b4f0 2024-05-09T00:02:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.218+0000 7f0112ff5700 1 -- 172.21.15.81:0/1509688807 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0124022410 con 0x5575a661b4f0 2024-05-09T00:02:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.218+0000 7f01413e5b80 10 client.15234 fetch_fsmap finished waiting for FSMap version 23 2024-05-09T00:02:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.218+0000 7f01413e5b80 10 client.15234 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-09T00:02:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.218+0000 7f01413e5b80 20 client.15234 populate_metadata read hostname 'smithi081' 2024-05-09T00:02:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.218+0000 7f01413e5b80 1 --2- 172.21.15.81:0/1509688807 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5575a668af00 0x5575a6687870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.218+0000 7f01413e5b80 4 client.15234 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T00:02:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.218+0000 7f01413e5b80 1 -- 172.21.15.81:0/1509688807 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5575a6563e70 con 0x5575a668af00 2024-05-09T00:02:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.218+0000 7f012e59c700 1 --2- 172.21.15.81:0/1509688807 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5575a668af00 0x5575a6687870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.218+0000 7f0112ff5700 10 client.15234 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:02:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.218+0000 7f012e59c700 1 --2- 172.21.15.81:0/1509688807 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5575a668af00 0x5575a6687870 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dd7d2d4c1460b14c server_cookie=1f8b2c05d5c22dbe in_seq=0 out_seq=0 2024-05-09T00:02:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.218+0000 7f0112ff5700 1 -- 172.21.15.81:0/1509688807 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5575a6563e70 con 0x5575a668af00 2024-05-09T00:02:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.218+0000 7f0112ff5700 10 client.15234 handle_command_reply: tid=0 2024-05-09T00:02:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.218+0000 7f01413e5b80 1 client.15234 shutdown 2024-05-09T00:02:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f01413e5b80 1 -- 172.21.15.81:0/1509688807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661b4f0 msgr2=0x5575a66264d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f01413e5b80 1 --2- 172.21.15.81:0/1509688807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661b4f0 0x5575a66264d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x5575a65075d0 tx=0x7f0124004860 comp rx=0 tx=0).stop 2024-05-09T00:02:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f01413e5b80 1 -- 172.21.15.81:0/1509688807 shutdown_connections 2024-05-09T00:02:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f01413e5b80 1 --2- 172.21.15.81:0/1509688807 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5575a661c810 0x5575a662b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f01413e5b80 1 --2- 172.21.15.81:0/1509688807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5575a661b4f0 0x5575a66264d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f01413e5b80 1 --2- 172.21.15.81:0/1509688807 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5575a668af00 0x5575a6687870 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f01413e5b80 1 --2- 172.21.15.81:0/1509688807 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5575a661be50 0x5575a6626a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f0112ff5700 0 client.15234 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:02:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f01413e5b80 1 -- 172.21.15.81:0/1509688807 >> 172.21.15.81:0/1509688807 conn(0x5575a65791c0 msgr2=0x5575a66242f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f01413e5b80 1 -- 172.21.15.81:0/1509688807 shutdown_connections 2024-05-09T00:02:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f01413e5b80 1 -- 172.21.15.81:0/1509688807 wait complete. 2024-05-09T00:02:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f01413e5b80 20 client.15234 trim_cache size 0 max 16384 2024-05-09T00:02:50.223 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:02:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "6c93ddc4-0d96-11ef-bc97-c7b262605968", 2024-05-09T00:02:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 2, 2024-05-09T00:02:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24476, 2024-05-09T00:02:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-09T00:02:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-09T00:02:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-09T00:02:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 61.171380169000003, 2024-05-09T00:02:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 23, 2024-05-09T00:02:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 81, 2024-05-09T00:02:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T00:02:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 77.626683928000006 2024-05-09T00:02:50.224 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:02:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f013522b700 1 -- 172.21.15.81:0/3191449357 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f01180a11b0 msgr2=0x7f01180a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f013522b700 1 --2- 172.21.15.81:0/3191449357 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f01180a11b0 0x7f01180a3670 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0124006fd0 tx=0x7f0124008040 comp rx=0 tx=0).stop 2024-05-09T00:02:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f013522b700 1 -- 172.21.15.81:0/3191449357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01301020f0 msgr2=0x7f01301975a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f013522b700 1 --2- 172.21.15.81:0/3191449357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01301020f0 0x7f01301975a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f012000d950 tx=0x7f012000dc60 comp rx=0 tx=0).stop 2024-05-09T00:02:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f013522b700 1 -- 172.21.15.81:0/3191449357 shutdown_connections 2024-05-09T00:02:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f013522b700 1 --2- 172.21.15.81:0/3191449357 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f01180a11b0 0x7f01180a3670 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f013522b700 1 --2- 172.21.15.81:0/3191449357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0130100f20 0x7f0130197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f013522b700 1 --2- 172.21.15.81:0/3191449357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0130102ab0 0x7f013019e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f013522b700 1 --2- 172.21.15.81:0/3191449357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01301020f0 0x7f01301975a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f013522b700 1 -- 172.21.15.81:0/3191449357 >> 172.21.15.81:0/3191449357 conn(0x7f01300fc4e0 msgr2=0x7f0130105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f013522b700 1 -- 172.21.15.81:0/3191449357 shutdown_connections 2024-05-09T00:02:50.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.219+0000 7f013522b700 1 -- 172.21.15.81:0/3191449357 wait complete. 2024-05-09T00:02:50.227 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2024-05-09T00:02:50.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:49 smithi150 ceph-mon[46187]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-05-09T00:02:50.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:49 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3193760443' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:02:50.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:49 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1707461134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:02:50.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:49 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3029265820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:50.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:49 smithi171 ceph-mon[47351]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-05-09T00:02:50.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:49 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3193760443' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:02:50.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:49 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1707461134' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:02:50.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:49 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3029265820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:02:50.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.357+0000 7fa20aebf700 1 -- 172.21.15.81:0/1212197313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204102ab0 msgr2=0x7fa2041093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.357+0000 7fa20aebf700 1 --2- 172.21.15.81:0/1212197313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204102ab0 0x7fa2041093d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00b0a0 tx=0x7fa1fc00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.357+0000 7fa20aebf700 1 -- 172.21.15.81:0/1212197313 shutdown_connections 2024-05-09T00:02:50.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.357+0000 7fa20aebf700 1 --2- 172.21.15.81:0/1212197313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa204100f20 0x7fa204101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.357+0000 7fa20aebf700 1 --2- 172.21.15.81:0/1212197313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204102ab0 0x7fa2041093d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.357+0000 7fa20aebf700 1 --2- 172.21.15.81:0/1212197313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa2041020f0 0x7fa204102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.357+0000 7fa20aebf700 1 -- 172.21.15.81:0/1212197313 >> 172.21.15.81:0/1212197313 conn(0x7fa2040fc4e0 msgr2=0x7fa2040fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.357+0000 7fa20aebf700 1 -- 172.21.15.81:0/1212197313 shutdown_connections 2024-05-09T00:02:50.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.357+0000 7fa20aebf700 1 -- 172.21.15.81:0/1212197313 wait complete. 2024-05-09T00:02:50.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20aebf700 1 Processor -- start 2024-05-09T00:02:50.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20aebf700 1 -- start start 2024-05-09T00:02:50.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20aebf700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa204100f20 0x7fa204197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20aebf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2041020f0 0x7fa204197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20aebf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204102ab0 0x7fa20419e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20aebf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20419eb40 con 0x7fa204102ab0 2024-05-09T00:02:50.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20aebf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20419ec80 con 0x7fa2041020f0 2024-05-09T00:02:50.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20aebf700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20419ee10 con 0x7fa204100f20 2024-05-09T00:02:50.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20945c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204102ab0 0x7fa20419e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20945c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204102ab0 0x7fa20419e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59506/0 (socket says 172.21.15.81:59506) 2024-05-09T00:02:50.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20945c700 1 -- 172.21.15.81:0/4169683104 learned_addr learned my addr 172.21.15.81:0/4169683104 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa208c5b700 1 --2- 172.21.15.81:0/4169683104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa204100f20 0x7fa204197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa203fff700 1 --2- 172.21.15.81:0/4169683104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2041020f0 0x7fa204197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20945c700 1 -- 172.21.15.81:0/4169683104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa204100f20 msgr2=0x7fa204197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20945c700 1 --2- 172.21.15.81:0/4169683104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa204100f20 0x7fa204197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20945c700 1 -- 172.21.15.81:0/4169683104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2041020f0 msgr2=0x7fa204197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20945c700 1 --2- 172.21.15.81:0/4169683104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2041020f0 0x7fa204197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20945c700 1 -- 172.21.15.81:0/4169683104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc009d00 con 0x7fa204102ab0 2024-05-09T00:02:50.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.358+0000 7fa20945c700 1 --2- 172.21.15.81:0/4169683104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204102ab0 0x7fa20419e570 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00b830 tx=0x7fa1fc004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.359+0000 7fa201ffb700 1 -- 172.21.15.81:0/4169683104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00e040 con 0x7fa204102ab0 2024-05-09T00:02:50.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.359+0000 7fa201ffb700 1 -- 172.21.15.81:0/4169683104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1fc004e70 con 0x7fa204102ab0 2024-05-09T00:02:50.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.359+0000 7fa201ffb700 1 -- 172.21.15.81:0/4169683104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc004020 con 0x7fa204102ab0 2024-05-09T00:02:50.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.359+0000 7fa20aebf700 1 -- 172.21.15.81:0/4169683104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa20419f090 con 0x7fa204102ab0 2024-05-09T00:02:50.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.359+0000 7fa20aebf700 1 -- 172.21.15.81:0/4169683104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20419f510 con 0x7fa204102ab0 2024-05-09T00:02:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.361+0000 7fa201ffb700 1 -- 172.21.15.81:0/4169683104 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa1fc01d690 con 0x7fa204102ab0 2024-05-09T00:02:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.361+0000 7fa201ffb700 1 --2- 172.21.15.81:0/4169683104 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa1f40a1230 0x7fa1f40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.361+0000 7fa208c5b700 1 --2- 172.21.15.81:0/4169683104 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa1f40a1230 0x7fa1f40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.362+0000 7fa201ffb700 1 -- 172.21.15.81:0/4169683104 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7fa1fc0ce0b0 con 0x7fa204102ab0 2024-05-09T00:02:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.362+0000 7fa208c5b700 1 --2- 172.21.15.81:0/4169683104 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa1f40a1230 0x7fa1f40a36f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa204100c40 tx=0x7fa1f800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.362+0000 7fa217079b80 1 Processor -- start 2024-05-09T00:02:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.362+0000 7fa217079b80 1 -- start start 2024-05-09T00:02:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.362+0000 7fa217079b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec244f0 0x56057ec24910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.362+0000 7fa217079b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec24e50 0x56057ec252d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.362+0000 7fa217079b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec25810 0x56057ec25c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa217079b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56057eb7b100 con 0x56057ec24e50 2024-05-09T00:02:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa217079b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56057eb78ac0 con 0x56057ec25810 2024-05-09T00:02:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa217079b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56057eb743b0 con 0x56057ec244f0 2024-05-09T00:02:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa203fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec24e50 0x56057ec252d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa203fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec24e50 0x56057ec252d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59522/0 (socket says 172.21.15.81:59522) 2024-05-09T00:02:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa203fff700 1 -- 172.21.15.81:0/2405549198 learned_addr learned my addr 172.21.15.81:0/2405549198 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa208c5b700 1 --2- 172.21.15.81:0/2405549198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec244f0 0x56057ec24910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa20945c700 1 --2- 172.21.15.81:0/2405549198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec25810 0x56057ec25c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa203fff700 1 -- 172.21.15.81:0/2405549198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec244f0 msgr2=0x56057ec24910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa203fff700 1 --2- 172.21.15.81:0/2405549198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec244f0 0x56057ec24910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa203fff700 1 -- 172.21.15.81:0/2405549198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec25810 msgr2=0x56057ec25c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa203fff700 1 --2- 172.21.15.81:0/2405549198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec25810 0x56057ec25c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa203fff700 1 -- 172.21.15.81:0/2405549198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56057e9f5360 con 0x56057ec24e50 2024-05-09T00:02:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa20945c700 1 --2- 172.21.15.81:0/2405549198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec25810 0x56057ec25c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa203fff700 1 --2- 172.21.15.81:0/2405549198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec24e50 0x56057ec252d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000bd70 tx=0x7fa1f00106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3001751e9f5b6c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa1eeffd700 1 -- 172.21.15.81:0/2405549198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0010cc0 con 0x56057ec24e50 2024-05-09T00:02:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa1eeffd700 1 -- 172.21.15.81:0/2405549198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1f0015070 con 0x56057ec24e50 2024-05-09T00:02:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.363+0000 7fa1eeffd700 1 -- 172.21.15.81:0/2405549198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0011680 con 0x56057ec24e50 2024-05-09T00:02:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.364+0000 7fa217079b80 1 -- 172.21.15.81:0/2405549198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec24e50 msgr2=0x56057ec252d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.364+0000 7fa217079b80 1 --2- 172.21.15.81:0/2405549198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec24e50 0x56057ec252d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000bd70 tx=0x7fa1f00106b0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.364+0000 7fa217079b80 1 -- 172.21.15.81:0/2405549198 shutdown_connections 2024-05-09T00:02:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.364+0000 7fa217079b80 1 --2- 172.21.15.81:0/2405549198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec25810 0x56057ec25c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.364+0000 7fa217079b80 1 --2- 172.21.15.81:0/2405549198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec244f0 0x56057ec24910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.364+0000 7fa217079b80 1 --2- 172.21.15.81:0/2405549198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec24e50 0x56057ec252d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.364+0000 7fa217079b80 1 -- 172.21.15.81:0/2405549198 >> 172.21.15.81:0/2405549198 conn(0x56057eb821c0 msgr2=0x56057ec1ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.364+0000 7fa217079b80 1 -- 172.21.15.81:0/2405549198 shutdown_connections 2024-05-09T00:02:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.364+0000 7fa217079b80 1 -- 172.21.15.81:0/2405549198 wait complete. 2024-05-09T00:02:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.364+0000 7fa217079b80 1 -- start start 2024-05-09T00:02:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.364+0000 7fa217079b80 1 Processor -- start 2024-05-09T00:02:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa217079b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec244f0 0x56057ec2ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa217079b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec24e50 0x56057ec2e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa217079b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec25810 0x56057ec35330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa217079b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56057eb10510 con 0x56057ec25810 2024-05-09T00:02:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa217079b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56057eb101b0 con 0x56057ec244f0 2024-05-09T00:02:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa217079b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56057e9f7650 con 0x56057ec24e50 2024-05-09T00:02:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa217079b80 10 client.0 _ll_register_callbacks cb 0x56057eb19ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:02:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa20945c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec25810 0x56057ec35330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa20945c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec25810 0x56057ec35330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59538/0 (socket says 172.21.15.81:59538) 2024-05-09T00:02:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa20945c700 1 -- 172.21.15.81:0/643349888 learned_addr learned my addr 172.21.15.81:0/643349888 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa208c5b700 1 --2- 172.21.15.81:0/643349888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec244f0 0x56057ec2ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa203fff700 1 --2- 172.21.15.81:0/643349888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec24e50 0x56057ec2e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa20945c700 1 -- 172.21.15.81:0/643349888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec24e50 msgr2=0x56057ec2e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa20945c700 1 --2- 172.21.15.81:0/643349888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec24e50 0x56057ec2e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa20945c700 1 -- 172.21.15.81:0/643349888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec244f0 msgr2=0x56057ec2ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa20945c700 1 --2- 172.21.15.81:0/643349888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec244f0 0x56057ec2ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa20945c700 1 -- 172.21.15.81:0/643349888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f000b9a0 con 0x56057ec25810 2024-05-09T00:02:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa20945c700 1 --2- 172.21.15.81:0/643349888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec25810 0x56057ec35330 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc09b130 tx=0x7fa1fc09b2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2258254e08925913 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa1e3fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:02:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa1e3fff700 1 -- 172.21.15.81:0/643349888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc09ad90 con 0x56057ec25810 2024-05-09T00:02:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa1e3fff700 1 -- 172.21.15.81:0/643349888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7fa1fc09bb30 con 0x56057ec25810 2024-05-09T00:02:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.365+0000 7fa217079b80 1 -- 172.21.15.81:0/643349888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56057eacd220 con 0x56057ec25810 2024-05-09T00:02:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.366+0000 7fa1e3fff700 1 -- 172.21.15.81:0/643349888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1fc09f020 con 0x56057ec25810 2024-05-09T00:02:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.366+0000 7fa217079b80 10 client.15246 fetch_fsmap learned FSMap version 23 2024-05-09T00:02:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.366+0000 7fa217079b80 1 -- 172.21.15.81:0/643349888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56057e9a1b10 con 0x56057ec25810 2024-05-09T00:02:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.366+0000 7fa1e3fff700 1 -- 172.21.15.81:0/643349888 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1fc07e080 con 0x56057ec25810 2024-05-09T00:02:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.366+0000 7fa1e3fff700 1 -- 172.21.15.81:0/643349888 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa1fc0a3390 con 0x56057ec25810 2024-05-09T00:02:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.366+0000 7fa217079b80 10 client.15246 fetch_fsmap finished waiting for FSMap version 23 2024-05-09T00:02:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.366+0000 7fa217079b80 10 client.15246 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-09T00:02:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.366+0000 7fa217079b80 20 client.15246 populate_metadata read hostname 'smithi081' 2024-05-09T00:02:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.366+0000 7fa217079b80 1 --2- 172.21.15.81:0/643349888 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56057ec38d10 0x56057ec3e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.366+0000 7fa217079b80 4 client.15246 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:02:50.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.366+0000 7fa217079b80 1 -- 172.21.15.81:0/643349888 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56057ebf37c0 con 0x56057ec38d10 2024-05-09T00:02:50.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.366+0000 7fa208c5b700 1 --2- 172.21.15.81:0/643349888 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56057ec38d10 0x56057ec3e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.367+0000 7fa1e3fff700 10 client.15246 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:02:50.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.367+0000 7fa208c5b700 1 --2- 172.21.15.81:0/643349888 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56057ec38d10 0x56057ec3e030 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fad86f3ec38138a7 server_cookie=69d7e91f94b6366b in_seq=0 out_seq=0 2024-05-09T00:02:50.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.367+0000 7fa1e3fff700 1 -- 172.21.15.81:0/643349888 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56057ebf37c0 con 0x56057ec38d10 2024-05-09T00:02:50.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.367+0000 7fa1e3fff700 10 client.15246 handle_command_reply: tid=0 2024-05-09T00:02:50.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.367+0000 7fa217079b80 1 client.15246 shutdown 2024-05-09T00:02:50.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.367+0000 7fa217079b80 1 -- 172.21.15.81:0/643349888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec25810 msgr2=0x56057ec35330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.367+0000 7fa217079b80 1 --2- 172.21.15.81:0/643349888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec25810 0x56057ec35330 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc09b130 tx=0x7fa1fc09b2b0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.368+0000 7fa217079b80 1 -- 172.21.15.81:0/643349888 shutdown_connections 2024-05-09T00:02:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.368+0000 7fa217079b80 1 --2- 172.21.15.81:0/643349888 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56057ec38d10 0x56057ec3e030 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.368+0000 7fa217079b80 1 --2- 172.21.15.81:0/643349888 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec244f0 0x56057ec2ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.368+0000 7fa217079b80 1 --2- 172.21.15.81:0/643349888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec25810 0x56057ec35330 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.368+0000 7fa1e3fff700 0 client.15246 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:02:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.368+0000 7fa217079b80 1 --2- 172.21.15.81:0/643349888 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec24e50 0x56057ec2e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.368+0000 7fa217079b80 1 -- 172.21.15.81:0/643349888 >> 172.21.15.81:0/643349888 conn(0x56057eb821c0 msgr2=0x56057ec1e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.368+0000 7fa217079b80 1 -- 172.21.15.81:0/643349888 shutdown_connections 2024-05-09T00:02:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.368+0000 7fa217079b80 1 -- 172.21.15.81:0/643349888 wait complete. 2024-05-09T00:02:50.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.368+0000 7fa217079b80 20 client.15246 trim_cache size 0 max 16384 2024-05-09T00:02:50.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa217079b80 1 Processor -- start 2024-05-09T00:02:50.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa217079b80 1 -- start start 2024-05-09T00:02:50.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa217079b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec244f0 0x56057ec2d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa217079b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec24e50 0x56057ec352f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa217079b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec25810 0x56057ec2bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa217079b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56057ec2ee20 con 0x56057ec244f0 2024-05-09T00:02:50.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa217079b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56057ebf37c0 con 0x56057ec24e50 2024-05-09T00:02:50.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa217079b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56057eb322b0 con 0x56057ec25810 2024-05-09T00:02:50.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa208c5b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec244f0 0x56057ec2d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa208c5b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec244f0 0x56057ec2d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59546/0 (socket says 172.21.15.81:59546) 2024-05-09T00:02:50.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa208c5b700 1 -- 172.21.15.81:0/1349375507 learned_addr learned my addr 172.21.15.81:0/1349375507 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa203fff700 1 --2- 172.21.15.81:0/1349375507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec24e50 0x56057ec352f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa208c5b700 1 -- 172.21.15.81:0/1349375507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec25810 msgr2=0x56057ec2bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa208c5b700 1 --2- 172.21.15.81:0/1349375507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec25810 0x56057ec2bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa208c5b700 1 -- 172.21.15.81:0/1349375507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec24e50 msgr2=0x56057ec352f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa208c5b700 1 --2- 172.21.15.81:0/1349375507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec24e50 0x56057ec352f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa208c5b700 1 -- 172.21.15.81:0/1349375507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56057eb3a510 con 0x56057ec244f0 2024-05-09T00:02:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa203fff700 1 --2- 172.21.15.81:0/1349375507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec24e50 0x56057ec352f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa208c5b700 1 --2- 172.21.15.81:0/1349375507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec244f0 0x56057ec2d2c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x56057ec2edf0 tx=0x7fa1f8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985f09bc2d76add4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa1ef7fe700 1 -- 172.21.15.81:0/1349375507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8024040 con 0x56057ec244f0 2024-05-09T00:02:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa1ef7fe700 1 -- 172.21.15.81:0/1349375507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1f8015070 con 0x56057ec244f0 2024-05-09T00:02:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.386+0000 7fa1ef7fe700 1 -- 172.21.15.81:0/1349375507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8029920 con 0x56057ec244f0 2024-05-09T00:02:50.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.387+0000 7fa217079b80 1 -- 172.21.15.81:0/1349375507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec244f0 msgr2=0x56057ec2d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.387+0000 7fa217079b80 1 --2- 172.21.15.81:0/1349375507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec244f0 0x56057ec2d2c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x56057ec2edf0 tx=0x7fa1f8013000 comp rx=0 tx=0).stop 2024-05-09T00:02:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.387+0000 7fa217079b80 1 -- 172.21.15.81:0/1349375507 shutdown_connections 2024-05-09T00:02:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.387+0000 7fa217079b80 1 --2- 172.21.15.81:0/1349375507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec25810 0x56057ec2bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.387+0000 7fa217079b80 1 --2- 172.21.15.81:0/1349375507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec244f0 0x56057ec2d2c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.387+0000 7fa217079b80 1 --2- 172.21.15.81:0/1349375507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec24e50 0x56057ec352f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.387+0000 7fa217079b80 1 -- 172.21.15.81:0/1349375507 >> 172.21.15.81:0/1349375507 conn(0x56057eb821c0 msgr2=0x56057ec25bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.387+0000 7fa217079b80 1 -- 172.21.15.81:0/1349375507 shutdown_connections 2024-05-09T00:02:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.387+0000 7fa217079b80 1 -- 172.21.15.81:0/1349375507 wait complete. 2024-05-09T00:02:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.387+0000 7fa217079b80 1 -- start start 2024-05-09T00:02:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.387+0000 7fa217079b80 1 Processor -- start 2024-05-09T00:02:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa217079b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec244f0 0x56057ec2b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa217079b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec24e50 0x56057ec352f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa217079b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec25810 0x56057ec29730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa217079b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56057ec29e40 con 0x56057ec25810 2024-05-09T00:02:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa217079b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56057ec29fb0 con 0x56057ec24e50 2024-05-09T00:02:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa217079b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56057ec2a170 con 0x56057ec244f0 2024-05-09T00:02:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa217079b80 10 client.0 _ll_register_callbacks cb 0x56057eb19ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:02:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa20945c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec25810 0x56057ec29730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa20945c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec25810 0x56057ec29730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59548/0 (socket says 172.21.15.81:59548) 2024-05-09T00:02:50.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa20945c700 1 -- 172.21.15.81:0/1945517377 learned_addr learned my addr 172.21.15.81:0/1945517377 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa203fff700 1 --2- 172.21.15.81:0/1945517377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec24e50 0x56057ec352f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa208c5b700 1 --2- 172.21.15.81:0/1945517377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec244f0 0x56057ec2b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa20945c700 1 -- 172.21.15.81:0/1945517377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec244f0 msgr2=0x56057ec2b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa20945c700 1 --2- 172.21.15.81:0/1945517377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec244f0 0x56057ec2b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa20945c700 1 -- 172.21.15.81:0/1945517377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec24e50 msgr2=0x56057ec352f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa20945c700 1 --2- 172.21.15.81:0/1945517377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec24e50 0x56057ec352f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa20945c700 1 -- 172.21.15.81:0/1945517377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f8011540 con 0x56057ec25810 2024-05-09T00:02:50.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa208c5b700 1 --2- 172.21.15.81:0/1945517377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec244f0 0x56057ec2b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:50.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa20945c700 1 --2- 172.21.15.81:0/1945517377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec25810 0x56057ec29730 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc01d9e0 tx=0x7fa1fc0cbee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0018ab1aa6dad89 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa1e3fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:02:50.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.388+0000 7fa1e3fff700 1 -- 172.21.15.81:0/1945517377 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0a1400 con 0x56057ec25810 2024-05-09T00:02:50.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.389+0000 7fa1e3fff700 1 -- 172.21.15.81:0/1945517377 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7fa1fc09f260 con 0x56057ec25810 2024-05-09T00:02:50.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.389+0000 7fa217079b80 1 -- 172.21.15.81:0/1945517377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa1f0015070 con 0x56057ec25810 2024-05-09T00:02:50.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.389+0000 7fa1e3fff700 1 -- 172.21.15.81:0/1945517377 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1fc09a920 con 0x56057ec25810 2024-05-09T00:02:50.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.389+0000 7fa217079b80 10 client.15252 fetch_fsmap learned FSMap version 23 2024-05-09T00:02:50.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.389+0000 7fa217079b80 1 -- 172.21.15.81:0/1945517377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56057e9f9c80 con 0x56057ec25810 2024-05-09T00:02:50.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.389+0000 7fa1e3fff700 1 -- 172.21.15.81:0/1945517377 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1fc0a7080 con 0x56057ec25810 2024-05-09T00:02:50.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.389+0000 7fa1e3fff700 1 -- 172.21.15.81:0/1945517377 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa1fc083020 con 0x56057ec25810 2024-05-09T00:02:50.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.389+0000 7fa217079b80 10 client.15252 fetch_fsmap finished waiting for FSMap version 23 2024-05-09T00:02:50.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.389+0000 7fa217079b80 10 client.15252 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-09T00:02:50.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.389+0000 7fa217079b80 20 client.15252 populate_metadata read hostname 'smithi081' 2024-05-09T00:02:50.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.389+0000 7fa217079b80 1 --2- 172.21.15.81:0/1945517377 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56057ec93f00 0x56057ec90990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.389+0000 7fa217079b80 4 client.15252 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T00:02:50.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.389+0000 7fa217079b80 1 -- 172.21.15.81:0/1945517377 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56057eb6ce70 con 0x56057ec93f00 2024-05-09T00:02:50.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.389+0000 7fa208c5b700 1 --2- 172.21.15.81:0/1945517377 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56057ec93f00 0x56057ec90990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa1e3fff700 10 client.15252 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:02:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa208c5b700 1 --2- 172.21.15.81:0/1945517377 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56057ec93f00 0x56057ec90990 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bf28df7d2c30a40d server_cookie=bfef46436c21ac14 in_seq=0 out_seq=0 2024-05-09T00:02:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa1e3fff700 1 -- 172.21.15.81:0/1945517377 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56057eb6ce70 con 0x56057ec93f00 2024-05-09T00:02:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa1e3fff700 10 client.15252 handle_command_reply: tid=0 2024-05-09T00:02:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa217079b80 1 client.15252 shutdown 2024-05-09T00:02:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa217079b80 1 -- 172.21.15.81:0/1945517377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec25810 msgr2=0x56057ec29730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa217079b80 1 --2- 172.21.15.81:0/1945517377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec25810 0x56057ec29730 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc01d9e0 tx=0x7fa1fc0cbee0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa217079b80 1 -- 172.21.15.81:0/1945517377 shutdown_connections 2024-05-09T00:02:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa217079b80 1 --2- 172.21.15.81:0/1945517377 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56057ec93f00 0x56057ec90990 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa217079b80 1 --2- 172.21.15.81:0/1945517377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56057ec25810 0x56057ec29730 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa217079b80 1 --2- 172.21.15.81:0/1945517377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56057ec244f0 0x56057ec2b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa217079b80 1 --2- 172.21.15.81:0/1945517377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56057ec24e50 0x56057ec352f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa1e3fff700 0 client.15252 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:02:50.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa217079b80 1 -- 172.21.15.81:0/1945517377 >> 172.21.15.81:0/1945517377 conn(0x56057eb821c0 msgr2=0x56057ec2ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa217079b80 1 -- 172.21.15.81:0/1945517377 shutdown_connections 2024-05-09T00:02:50.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa217079b80 1 -- 172.21.15.81:0/1945517377 wait complete. 2024-05-09T00:02:50.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.390+0000 7fa217079b80 20 client.15252 trim_cache size 0 max 16384 2024-05-09T00:02:50.394 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:02:50.394 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "6c93ddc4-0d96-11ef-bc97-c7b262605968", 2024-05-09T00:02:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 1, 2024-05-09T00:02:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24487, 2024-05-09T00:02:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-09T00:02:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-09T00:02:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-09T00:02:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 62.351889708000002, 2024-05-09T00:02:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 23, 2024-05-09T00:02:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 81, 2024-05-09T00:02:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T00:02:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 76.088180359000006 2024-05-09T00:02:50.395 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:02:50.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.391+0000 7fa20aebf700 1 -- 172.21.15.81:0/4169683104 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa1f40a1230 msgr2=0x7fa1f40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.391+0000 7fa20aebf700 1 --2- 172.21.15.81:0/4169683104 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa1f40a1230 0x7fa1f40a36f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa204100c40 tx=0x7fa1f800b410 comp rx=0 tx=0).stop 2024-05-09T00:02:50.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.391+0000 7fa20aebf700 1 -- 172.21.15.81:0/4169683104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204102ab0 msgr2=0x7fa20419e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.391+0000 7fa20aebf700 1 --2- 172.21.15.81:0/4169683104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204102ab0 0x7fa20419e570 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00b830 tx=0x7fa1fc004c80 comp rx=0 tx=0).stop 2024-05-09T00:02:50.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.391+0000 7fa20aebf700 1 -- 172.21.15.81:0/4169683104 shutdown_connections 2024-05-09T00:02:50.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.391+0000 7fa20aebf700 1 --2- 172.21.15.81:0/4169683104 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fa1f40a1230 0x7fa1f40a36f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.391+0000 7fa20aebf700 1 --2- 172.21.15.81:0/4169683104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa204102ab0 0x7fa20419e570 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.391+0000 7fa20aebf700 1 --2- 172.21.15.81:0/4169683104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa204100f20 0x7fa204197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.391+0000 7fa20aebf700 1 --2- 172.21.15.81:0/4169683104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa2041020f0 0x7fa204197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.391+0000 7fa20aebf700 1 -- 172.21.15.81:0/4169683104 >> 172.21.15.81:0/4169683104 conn(0x7fa2040fc4e0 msgr2=0x7fa204105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.391+0000 7fa20aebf700 1 -- 172.21.15.81:0/4169683104 shutdown_connections 2024-05-09T00:02:50.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.391+0000 7fa20aebf700 1 -- 172.21.15.81:0/4169683104 wait complete. 2024-05-09T00:02:50.398 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-09T00:02:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.527+0000 7f431b0bc700 1 -- 172.21.15.81:0/724390704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4314100fd0 msgr2=0x7f4314101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.527+0000 7f431b0bc700 1 --2- 172.21.15.81:0/724390704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4314100fd0 0x7f4314101450 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4300009990 tx=0x7f4300009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.527+0000 7f431b0bc700 1 -- 172.21.15.81:0/724390704 shutdown_connections 2024-05-09T00:02:50.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.527+0000 7f431b0bc700 1 --2- 172.21.15.81:0/724390704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4314101990 0x7f43141082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.527+0000 7f431b0bc700 1 --2- 172.21.15.81:0/724390704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43140ffe80 0x7f43141002a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.527+0000 7f431b0bc700 1 --2- 172.21.15.81:0/724390704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4314100fd0 0x7f4314101450 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.527+0000 7f431b0bc700 1 -- 172.21.15.81:0/724390704 >> 172.21.15.81:0/724390704 conn(0x7f43140fb3f0 msgr2=0x7f43140fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.527+0000 7f431b0bc700 1 -- 172.21.15.81:0/724390704 shutdown_connections 2024-05-09T00:02:50.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.527+0000 7f431b0bc700 1 -- 172.21.15.81:0/724390704 wait complete. 2024-05-09T00:02:50.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.527+0000 7f431b0bc700 1 Processor -- start 2024-05-09T00:02:50.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f431b0bc700 1 -- start start 2024-05-09T00:02:50.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f431b0bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43140ffe80 0x7f4314195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f431b0bc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4314100fd0 0x7f43141963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f431b0bc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4314101990 0x7f431419d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f431b0bc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431419d900 con 0x7f43140ffe80 2024-05-09T00:02:50.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f431b0bc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431419da70 con 0x7f4314101990 2024-05-09T00:02:50.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f431b0bc700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431419dc30 con 0x7f4314100fd0 2024-05-09T00:02:50.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f4318e58700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43140ffe80 0x7f4314195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f4318e58700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43140ffe80 0x7f4314195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59568/0 (socket says 172.21.15.81:59568) 2024-05-09T00:02:50.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f4318e58700 1 -- 172.21.15.81:0/4250618333 learned_addr learned my addr 172.21.15.81:0/4250618333 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f4319659700 1 --2- 172.21.15.81:0/4250618333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4314101990 0x7f431419d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f4318e58700 1 -- 172.21.15.81:0/4250618333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4314100fd0 msgr2=0x7f43141963a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f4318e58700 1 --2- 172.21.15.81:0/4250618333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4314100fd0 0x7f43141963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f4318e58700 1 -- 172.21.15.81:0/4250618333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4314101990 msgr2=0x7f431419d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f4318e58700 1 --2- 172.21.15.81:0/4250618333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4314101990 0x7f431419d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f4318e58700 1 -- 172.21.15.81:0/4250618333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43000095f0 con 0x7f43140ffe80 2024-05-09T00:02:50.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f4319659700 1 --2- 172.21.15.81:0/4250618333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4314101990 0x7f431419d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:50.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f4318e58700 1 --2- 172.21.15.81:0/4250618333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43140ffe80 0x7f4314195e60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f430800d950 tx=0x7f430800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f4311ffb700 1 -- 172.21.15.81:0/4250618333 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308009b40 con 0x7f43140ffe80 2024-05-09T00:02:50.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f4311ffb700 1 -- 172.21.15.81:0/4250618333 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4308009ca0 con 0x7f43140ffe80 2024-05-09T00:02:50.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f431b0bc700 1 -- 172.21.15.81:0/4250618333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431419df10 con 0x7f43140ffe80 2024-05-09T00:02:50.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.528+0000 7f4311ffb700 1 -- 172.21.15.81:0/4250618333 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430800f620 con 0x7f43140ffe80 2024-05-09T00:02:50.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.529+0000 7f431b0bc700 1 -- 172.21.15.81:0/4250618333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431419e330 con 0x7f43140ffe80 2024-05-09T00:02:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.530+0000 7f4311ffb700 1 -- 172.21.15.81:0/4250618333 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f4308010460 con 0x7f43140ffe80 2024-05-09T00:02:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.531+0000 7f4311ffb700 1 --2- 172.21.15.81:0/4250618333 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f43040a11b0 0x7f43040a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.531+0000 7f4311ffb700 1 -- 172.21.15.81:0/4250618333 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f43080cce10 con 0x7f43140ffe80 2024-05-09T00:02:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.531+0000 7f4313fff700 1 --2- 172.21.15.81:0/4250618333 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f43040a11b0 0x7f43040a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.531+0000 7f4313fff700 1 --2- 172.21.15.81:0/4250618333 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f43040a11b0 0x7f43040a3670 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f43000095c0 tx=0x7f4300009530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.532+0000 7f4327276b80 1 Processor -- start 2024-05-09T00:02:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.532+0000 7f4327276b80 1 -- start start 2024-05-09T00:02:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.532+0000 7f4327276b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7e8c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.532+0000 7f4327276b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8ce50 0x563fd7e8d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.532+0000 7f4327276b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8d810 0x563fd7e8dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.532+0000 7f4327276b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd7de3100 con 0x563fd7e8c4f0 2024-05-09T00:02:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.532+0000 7f4327276b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd7de0ac0 con 0x563fd7e8ce50 2024-05-09T00:02:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.532+0000 7f4327276b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd7ddc3b0 con 0x563fd7e8d810 2024-05-09T00:02:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.532+0000 7f4318e58700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7e8c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.532+0000 7f4318e58700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7e8c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59580/0 (socket says 172.21.15.81:59580) 2024-05-09T00:02:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.532+0000 7f4318e58700 1 -- 172.21.15.81:0/2580710810 learned_addr learned my addr 172.21.15.81:0/2580710810 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.533+0000 7f4319659700 1 --2- 172.21.15.81:0/2580710810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8d810 0x563fd7e8dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.533+0000 7f4318e58700 1 -- 172.21.15.81:0/2580710810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8d810 msgr2=0x563fd7e8dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.533+0000 7f4313fff700 1 --2- 172.21.15.81:0/2580710810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8ce50 0x563fd7e8d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.533+0000 7f4318e58700 1 --2- 172.21.15.81:0/2580710810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8d810 0x563fd7e8dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.533+0000 7f4318e58700 1 -- 172.21.15.81:0/2580710810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8ce50 msgr2=0x563fd7e8d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.533+0000 7f4318e58700 1 --2- 172.21.15.81:0/2580710810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8ce50 0x563fd7e8d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.533+0000 7f4318e58700 1 -- 172.21.15.81:0/2580710810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fd7c5d360 con 0x563fd7e8c4f0 2024-05-09T00:02:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.533+0000 7f4319659700 1 --2- 172.21.15.81:0/2580710810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8d810 0x563fd7e8dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.533+0000 7f4313fff700 1 --2- 172.21.15.81:0/2580710810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8ce50 0x563fd7e8d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.533+0000 7f4318e58700 1 --2- 172.21.15.81:0/2580710810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7e8c910 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f43080a2050 tx=0x7f4308099b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf3602c6894057e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.533+0000 7f42feffd700 1 -- 172.21.15.81:0/2580710810 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43080a2580 con 0x563fd7e8c4f0 2024-05-09T00:02:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.533+0000 7f42feffd700 1 -- 172.21.15.81:0/2580710810 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43080caa10 con 0x563fd7e8c4f0 2024-05-09T00:02:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.533+0000 7f42feffd700 1 -- 172.21.15.81:0/2580710810 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430809a5c0 con 0x563fd7e8c4f0 2024-05-09T00:02:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 -- 172.21.15.81:0/2580710810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 msgr2=0x563fd7e8c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 --2- 172.21.15.81:0/2580710810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7e8c910 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f43080a2050 tx=0x7f4308099b90 comp rx=0 tx=0).stop 2024-05-09T00:02:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 -- 172.21.15.81:0/2580710810 shutdown_connections 2024-05-09T00:02:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 --2- 172.21.15.81:0/2580710810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8d810 0x563fd7e8dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 --2- 172.21.15.81:0/2580710810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7e8c910 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 --2- 172.21.15.81:0/2580710810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8ce50 0x563fd7e8d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 -- 172.21.15.81:0/2580710810 >> 172.21.15.81:0/2580710810 conn(0x563fd7dea1c0 msgr2=0x563fd7e86d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 -- 172.21.15.81:0/2580710810 shutdown_connections 2024-05-09T00:02:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 -- 172.21.15.81:0/2580710810 wait complete. 2024-05-09T00:02:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 -- start start 2024-05-09T00:02:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 Processor -- start 2024-05-09T00:02:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7e99ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 0x563fd7e9a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8d810 0x563fd7ea1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd7d78510 con 0x563fd7e8c4f0 2024-05-09T00:02:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd7d781b0 con 0x563fd7e8d810 2024-05-09T00:02:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.534+0000 7f4327276b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd7c5f650 con 0x563fd7e8ce50 2024-05-09T00:02:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4327276b80 10 client.0 _ll_register_callbacks cb 0x563fd7d81ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:02:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4318e58700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7e99ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4318e58700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7e99ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59592/0 (socket says 172.21.15.81:59592) 2024-05-09T00:02:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4318e58700 1 -- 172.21.15.81:0/1654843676 learned_addr learned my addr 172.21.15.81:0/1654843676 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4313fff700 1 --2- 172.21.15.81:0/1654843676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 0x563fd7e9a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4318e58700 1 -- 172.21.15.81:0/1654843676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 msgr2=0x563fd7e9a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4318e58700 1 --2- 172.21.15.81:0/1654843676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 0x563fd7e9a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4318e58700 1 -- 172.21.15.81:0/1654843676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8d810 msgr2=0x563fd7ea1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4318e58700 1 --2- 172.21.15.81:0/1654843676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8d810 0x563fd7ea1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4318e58700 1 -- 172.21.15.81:0/1654843676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431419e330 con 0x563fd7e8c4f0 2024-05-09T00:02:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4313fff700 1 --2- 172.21.15.81:0/1654843676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 0x563fd7e9a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4318e58700 1 --2- 172.21.15.81:0/1654843676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7e99ff0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4308096b70 tx=0x7f430809a970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9975fbf9bc4bfa8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f42f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:02:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f42f3fff700 1 -- 172.21.15.81:0/1654843676 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308009e10 con 0x563fd7e8c4f0 2024-05-09T00:02:50.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f42f3fff700 1 -- 172.21.15.81:0/1654843676 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f4308010710 con 0x563fd7e8c4f0 2024-05-09T00:02:50.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4327276b80 1 -- 172.21.15.81:0/1654843676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fd7d35220 con 0x563fd7e8c4f0 2024-05-09T00:02:50.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f42f3fff700 1 -- 172.21.15.81:0/1654843676 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43080a2580 con 0x563fd7e8c4f0 2024-05-09T00:02:50.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4327276b80 10 client.15264 fetch_fsmap learned FSMap version 23 2024-05-09T00:02:50.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f4327276b80 1 -- 172.21.15.81:0/1654843676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x563fd7c09b10 con 0x563fd7e8c4f0 2024-05-09T00:02:50.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f42f3fff700 1 -- 172.21.15.81:0/1654843676 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563fd7d35220 con 0x563fd7e8c4f0 2024-05-09T00:02:50.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.535+0000 7f42f3fff700 1 -- 172.21.15.81:0/1654843676 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f43080b8120 con 0x563fd7e8c4f0 2024-05-09T00:02:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.536+0000 7f4327276b80 10 client.15264 fetch_fsmap finished waiting for FSMap version 23 2024-05-09T00:02:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.536+0000 7f4327276b80 10 client.15264 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T00:02:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.536+0000 7f4327276b80 20 client.15264 populate_metadata read hostname 'smithi081' 2024-05-09T00:02:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.536+0000 7f4327276b80 1 --2- 172.21.15.81:0/1654843676 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563fd7ea4de0 0x563fd7eaa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.536+0000 7f4327276b80 4 client.15264 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:02:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.536+0000 7f4327276b80 1 -- 172.21.15.81:0/1654843676 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563fd7e5b7c0 con 0x563fd7ea4de0 2024-05-09T00:02:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.536+0000 7f4313fff700 1 --2- 172.21.15.81:0/1654843676 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563fd7ea4de0 0x563fd7eaa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.536+0000 7f42f3fff700 10 client.15264 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:02:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.536+0000 7f4313fff700 1 --2- 172.21.15.81:0/1654843676 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563fd7ea4de0 0x563fd7eaa100 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e29a52c1f8f8eca7 server_cookie=a299f74bca0fd24d in_seq=0 out_seq=0 2024-05-09T00:02:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f42f3fff700 1 -- 172.21.15.81:0/1654843676 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563fd7e5b7c0 con 0x563fd7ea4de0 2024-05-09T00:02:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f42f3fff700 10 client.15264 handle_command_reply: tid=0 2024-05-09T00:02:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f4327276b80 1 client.15264 shutdown 2024-05-09T00:02:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f4327276b80 1 -- 172.21.15.81:0/1654843676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 msgr2=0x563fd7e99ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f4327276b80 1 --2- 172.21.15.81:0/1654843676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7e99ff0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4308096b70 tx=0x7f430809a970 comp rx=0 tx=0).stop 2024-05-09T00:02:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f4327276b80 1 -- 172.21.15.81:0/1654843676 shutdown_connections 2024-05-09T00:02:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f4327276b80 1 --2- 172.21.15.81:0/1654843676 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563fd7ea4de0 0x563fd7eaa100 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f4327276b80 1 --2- 172.21.15.81:0/1654843676 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8d810 0x563fd7ea1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f4327276b80 1 --2- 172.21.15.81:0/1654843676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7e99ff0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f42f3fff700 0 client.15264 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:02:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f4327276b80 1 --2- 172.21.15.81:0/1654843676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 0x563fd7e9a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f4327276b80 1 -- 172.21.15.81:0/1654843676 >> 172.21.15.81:0/1654843676 conn(0x563fd7dea1c0 msgr2=0x563fd7e86550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f4327276b80 1 -- 172.21.15.81:0/1654843676 shutdown_connections 2024-05-09T00:02:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f4327276b80 1 -- 172.21.15.81:0/1654843676 wait complete. 2024-05-09T00:02:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.537+0000 7f4327276b80 20 client.15264 trim_cache size 0 max 16384 2024-05-09T00:02:50.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.555+0000 7f4327276b80 1 Processor -- start 2024-05-09T00:02:50.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.555+0000 7f4327276b80 1 -- start start 2024-05-09T00:02:50.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.555+0000 7f4327276b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7ea2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4327276b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 0x563fd7e8c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4327276b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8d810 0x563fd7ea1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4327276b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd7d35220 con 0x563fd7e8c4f0 2024-05-09T00:02:50.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4327276b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd7e87b80 con 0x563fd7e8d810 2024-05-09T00:02:50.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4327276b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd7dd5150 con 0x563fd7e8ce50 2024-05-09T00:02:50.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4318e58700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7ea2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4318e58700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7ea2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59602/0 (socket says 172.21.15.81:59602) 2024-05-09T00:02:50.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4318e58700 1 -- 172.21.15.81:0/650853155 learned_addr learned my addr 172.21.15.81:0/650853155 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4318e58700 1 -- 172.21.15.81:0/650853155 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 msgr2=0x563fd7e8c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4318e58700 1 --2- 172.21.15.81:0/650853155 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 0x563fd7e8c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4318e58700 1 -- 172.21.15.81:0/650853155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8d810 msgr2=0x563fd7ea1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4319659700 1 --2- 172.21.15.81:0/650853155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8d810 0x563fd7ea1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4318e58700 1 --2- 172.21.15.81:0/650853155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8d810 0x563fd7ea1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4318e58700 1 -- 172.21.15.81:0/650853155 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fd7da2510 con 0x563fd7e8c4f0 2024-05-09T00:02:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f4318e58700 1 --2- 172.21.15.81:0/650853155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7ea2350 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4308000c00 tx=0x7f430809e0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35187bf26081a55c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f42ff7fe700 1 -- 172.21.15.81:0/650853155 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308009e10 con 0x563fd7e8c4f0 2024-05-09T00:02:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f42ff7fe700 1 -- 172.21.15.81:0/650853155 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43080a2580 con 0x563fd7e8c4f0 2024-05-09T00:02:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.556+0000 7f42ff7fe700 1 -- 172.21.15.81:0/650853155 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308010710 con 0x563fd7e8c4f0 2024-05-09T00:02:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 -- 172.21.15.81:0/650853155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 msgr2=0x563fd7ea2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 --2- 172.21.15.81:0/650853155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7ea2350 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4308000c00 tx=0x7f430809e0b0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 -- 172.21.15.81:0/650853155 shutdown_connections 2024-05-09T00:02:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 --2- 172.21.15.81:0/650853155 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8d810 0x563fd7ea1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 --2- 172.21.15.81:0/650853155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8c4f0 0x563fd7ea2350 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 --2- 172.21.15.81:0/650853155 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 0x563fd7e8c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 -- 172.21.15.81:0/650853155 >> 172.21.15.81:0/650853155 conn(0x563fd7dea1c0 msgr2=0x563fd7e8dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 -- 172.21.15.81:0/650853155 shutdown_connections 2024-05-09T00:02:50.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 -- 172.21.15.81:0/650853155 wait complete. 2024-05-09T00:02:50.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 -- start start 2024-05-09T00:02:50.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 Processor -- start 2024-05-09T00:02:50.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8c4f0 0x563fd7e85cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 0x563fd7e86200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8d810 0x563fd7ea0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd7e86a10 con 0x563fd7e8d810 2024-05-09T00:02:50.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd7ea0ab0 con 0x563fd7e8c4f0 2024-05-09T00:02:50.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.557+0000 7f4327276b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fd7ea0c70 con 0x563fd7e8ce50 2024-05-09T00:02:50.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f4327276b80 10 client.0 _ll_register_callbacks cb 0x563fd7d81ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:02:50.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f4319659700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8d810 0x563fd7ea0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f4319659700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8d810 0x563fd7ea0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59618/0 (socket says 172.21.15.81:59618) 2024-05-09T00:02:50.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f4319659700 1 -- 172.21.15.81:0/2642130374 learned_addr learned my addr 172.21.15.81:0/2642130374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f4313fff700 1 --2- 172.21.15.81:0/2642130374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 0x563fd7e86200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f4318e58700 1 --2- 172.21.15.81:0/2642130374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8c4f0 0x563fd7e85cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f4319659700 1 -- 172.21.15.81:0/2642130374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 msgr2=0x563fd7e86200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f4319659700 1 --2- 172.21.15.81:0/2642130374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 0x563fd7e86200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f4319659700 1 -- 172.21.15.81:0/2642130374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8c4f0 msgr2=0x563fd7e85cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:02:50.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f4319659700 1 --2- 172.21.15.81:0/2642130374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8c4f0 0x563fd7e85cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f4319659700 1 -- 172.21.15.81:0/2642130374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563fd7c09b10 con 0x563fd7e8d810 2024-05-09T00:02:50.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f4318e58700 1 --2- 172.21.15.81:0/2642130374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8c4f0 0x563fd7e85cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:50.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f4319659700 1 --2- 172.21.15.81:0/2642130374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8d810 0x563fd7ea0570 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f430c007af0 tx=0x7f430c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0024208a8760db server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f42f3fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:02:50.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.558+0000 7f42f3fff700 1 -- 172.21.15.81:0/2642130374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c00e030 con 0x563fd7e8d810 2024-05-09T00:02:50.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.559+0000 7f42f3fff700 1 -- 172.21.15.81:0/2642130374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f430c00f070 con 0x563fd7e8d810 2024-05-09T00:02:50.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.559+0000 7f4327276b80 1 -- 172.21.15.81:0/2642130374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f43080caa10 con 0x563fd7e8d810 2024-05-09T00:02:50.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.559+0000 7f42f3fff700 1 -- 172.21.15.81:0/2642130374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f430c0117f0 con 0x563fd7e8d810 2024-05-09T00:02:50.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.559+0000 7f4327276b80 10 client.15270 fetch_fsmap learned FSMap version 23 2024-05-09T00:02:50.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.559+0000 7f4327276b80 1 -- 172.21.15.81:0/2642130374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x563fd7c61c80 con 0x563fd7e8d810 2024-05-09T00:02:50.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.559+0000 7f42f3fff700 1 -- 172.21.15.81:0/2642130374 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43080caa10 con 0x563fd7e8d810 2024-05-09T00:02:50.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.559+0000 7f42f3fff700 1 -- 172.21.15.81:0/2642130374 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f430c014070 con 0x563fd7e8d810 2024-05-09T00:02:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.559+0000 7f4327276b80 10 client.15270 fetch_fsmap finished waiting for FSMap version 23 2024-05-09T00:02:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.559+0000 7f4327276b80 10 client.15270 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-09T00:02:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.559+0000 7f4327276b80 20 client.15270 populate_metadata read hostname 'smithi081' 2024-05-09T00:02:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.559+0000 7f4327276b80 1 --2- 172.21.15.81:0/2642130374 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563fd7effcd0 0x563fd7efc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.559+0000 7f4327276b80 4 client.15270 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-09T00:02:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.559+0000 7f4327276b80 1 -- 172.21.15.81:0/2642130374 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563fd7dd4e70 con 0x563fd7effcd0 2024-05-09T00:02:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.559+0000 7f4318e58700 1 --2- 172.21.15.81:0/2642130374 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563fd7effcd0 0x563fd7efc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f42f3fff700 10 client.15270 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:02:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f4318e58700 1 --2- 172.21.15.81:0/2642130374 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563fd7effcd0 0x563fd7efc680 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8837b90de3cfff51 server_cookie=6cd1de4c596d1f7b in_seq=0 out_seq=0 2024-05-09T00:02:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f42f3fff700 1 -- 172.21.15.81:0/2642130374 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x563fd7dd4e70 con 0x563fd7effcd0 2024-05-09T00:02:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f42f3fff700 10 client.15270 handle_command_reply: tid=0 2024-05-09T00:02:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f4327276b80 1 client.15270 shutdown 2024-05-09T00:02:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f4327276b80 1 -- 172.21.15.81:0/2642130374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8d810 msgr2=0x563fd7ea0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f4327276b80 1 --2- 172.21.15.81:0/2642130374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8d810 0x563fd7ea0570 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f430c007af0 tx=0x7f430c007e00 comp rx=0 tx=0).stop 2024-05-09T00:02:50.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f4327276b80 1 -- 172.21.15.81:0/2642130374 shutdown_connections 2024-05-09T00:02:50.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f4327276b80 1 --2- 172.21.15.81:0/2642130374 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563fd7effcd0 0x563fd7efc680 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f4327276b80 1 --2- 172.21.15.81:0/2642130374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563fd7e8c4f0 0x563fd7e85cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f4327276b80 1 --2- 172.21.15.81:0/2642130374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563fd7e8d810 0x563fd7ea0570 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f42f3fff700 0 client.15270 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:02:50.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f4327276b80 1 --2- 172.21.15.81:0/2642130374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563fd7e8ce50 0x563fd7e86200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f4327276b80 1 -- 172.21.15.81:0/2642130374 >> 172.21.15.81:0/2642130374 conn(0x563fd7dea1c0 msgr2=0x563fd7ea2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f4327276b80 1 -- 172.21.15.81:0/2642130374 shutdown_connections 2024-05-09T00:02:50.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f4327276b80 1 -- 172.21.15.81:0/2642130374 wait complete. 2024-05-09T00:02:50.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.560+0000 7f4327276b80 20 client.15270 trim_cache size 0 max 16384 2024-05-09T00:02:50.563 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:02:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "6c93ddc4-0d96-11ef-bc97-c7b262605968", 2024-05-09T00:02:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-05-09T00:02:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 24506, 2024-05-09T00:02:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-05-09T00:02:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-05-09T00:02:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-05-09T00:02:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 65.539481535999997, 2024-05-09T00:02:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 23, 2024-05-09T00:02:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 81, 2024-05-09T00:02:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 79, 2024-05-09T00:02:50.563 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 71.095728516999998 2024-05-09T00:02:50.564 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:02:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.561+0000 7f431b0bc700 1 -- 172.21.15.81:0/4250618333 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f43040a11b0 msgr2=0x7f43040a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.561+0000 7f431b0bc700 1 --2- 172.21.15.81:0/4250618333 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f43040a11b0 0x7f43040a3670 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f43000095c0 tx=0x7f4300009530 comp rx=0 tx=0).stop 2024-05-09T00:02:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.561+0000 7f431b0bc700 1 -- 172.21.15.81:0/4250618333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43140ffe80 msgr2=0x7f4314195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.561+0000 7f431b0bc700 1 --2- 172.21.15.81:0/4250618333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43140ffe80 0x7f4314195e60 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f430800d950 tx=0x7f430800dd10 comp rx=0 tx=0).stop 2024-05-09T00:02:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.561+0000 7f431b0bc700 1 -- 172.21.15.81:0/4250618333 shutdown_connections 2024-05-09T00:02:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.561+0000 7f431b0bc700 1 --2- 172.21.15.81:0/4250618333 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f43040a11b0 0x7f43040a3670 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.561+0000 7f431b0bc700 1 --2- 172.21.15.81:0/4250618333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4314101990 0x7f431419d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.561+0000 7f431b0bc700 1 --2- 172.21.15.81:0/4250618333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43140ffe80 0x7f4314195e60 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.561+0000 7f431b0bc700 1 --2- 172.21.15.81:0/4250618333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4314100fd0 0x7f43141963a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.561+0000 7f431b0bc700 1 -- 172.21.15.81:0/4250618333 >> 172.21.15.81:0/4250618333 conn(0x7f43140fb3f0 msgr2=0x7f4314104400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.561+0000 7f431b0bc700 1 -- 172.21.15.81:0/4250618333 shutdown_connections 2024-05-09T00:02:50.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.561+0000 7f431b0bc700 1 -- 172.21.15.81:0/4250618333 wait complete. 2024-05-09T00:02:50.567 INFO:teuthology.run_tasks:Running task sequential... 2024-05-09T00:02:50.577 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-09T00:02:50.577 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-09T00:02:50.577 INFO:teuthology.task.print:Enabling mgr modules 2024-05-09T00:02:50.577 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-05-09T00:02:50.578 INFO:teuthology.task.exec:Executing custom commands... 2024-05-09T00:02:50.578 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-05-09T00:02:50.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-05-09T00:02:50.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.706+0000 7fef5ea15700 1 -- 172.21.15.81:0/4036458380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef58106c50 msgr2=0x7fef58109060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.706+0000 7fef5ea15700 1 --2- 172.21.15.81:0/4036458380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef58106c50 0x7fef58109060 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fef5000b0a0 tx=0x7fef5000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.706+0000 7fef5ea15700 1 -- 172.21.15.81:0/4036458380 shutdown_connections 2024-05-09T00:02:50.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.706+0000 7fef5ea15700 1 --2- 172.21.15.81:0/4036458380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef581019f0 0x7fef58103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.706+0000 7fef5ea15700 1 --2- 172.21.15.81:0/4036458380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef58106c50 0x7fef58109060 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.706+0000 7fef5ea15700 1 --2- 172.21.15.81:0/4036458380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef58104320 0x7fef58106710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.706+0000 7fef5ea15700 1 -- 172.21.15.81:0/4036458380 >> 172.21.15.81:0/4036458380 conn(0x7fef580fb380 msgr2=0x7fef580fd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:50.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.706+0000 7fef5ea15700 1 -- 172.21.15.81:0/4036458380 shutdown_connections 2024-05-09T00:02:50.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.706+0000 7fef5ea15700 1 -- 172.21.15.81:0/4036458380 wait complete. 2024-05-09T00:02:50.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.707+0000 7fef5ea15700 1 Processor -- start 2024-05-09T00:02:50.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.707+0000 7fef5ea15700 1 -- start start 2024-05-09T00:02:50.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.707+0000 7fef5ea15700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef581019f0 0x7fef58196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.707+0000 7fef5ea15700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef58104320 0x7fef581974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.707+0000 7fef5ea15700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef58106c50 0x7fef5819e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.707+0000 7fef5ea15700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5819ea30 con 0x7fef58104320 2024-05-09T00:02:50.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.707+0000 7fef5ea15700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5819eb70 con 0x7fef581019f0 2024-05-09T00:02:50.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef5ea15700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5819ed00 con 0x7fef58106c50 2024-05-09T00:02:50.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef58104320 0x7fef581974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef58104320 0x7fef581974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59650/0 (socket says 172.21.15.81:59650) 2024-05-09T00:02:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef577fe700 1 -- 172.21.15.81:0/3558502188 learned_addr learned my addr 172.21.15.81:0/3558502188 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef5cfb2700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef58106c50 0x7fef5819e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef57fff700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef581019f0 0x7fef58196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef577fe700 1 -- 172.21.15.81:0/3558502188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef58106c50 msgr2=0x7fef5819e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef577fe700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef58106c50 0x7fef5819e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef577fe700 1 -- 172.21.15.81:0/3558502188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef581019f0 msgr2=0x7fef58196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef577fe700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef581019f0 0x7fef58196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef577fe700 1 -- 172.21.15.81:0/3558502188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef50009d00 con 0x7fef58104320 2024-05-09T00:02:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef5cfb2700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef58106c50 0x7fef5819e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:02:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef57fff700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef581019f0 0x7fef58196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:02:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef577fe700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef58104320 0x7fef581974e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00d950 tx=0x7fef4c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef557fa700 1 -- 172.21.15.81:0/3558502188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c009b40 con 0x7fef58104320 2024-05-09T00:02:50.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef557fa700 1 -- 172.21.15.81:0/3558502188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef4c009ca0 con 0x7fef58104320 2024-05-09T00:02:50.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef5ea15700 1 -- 172.21.15.81:0/3558502188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5819efe0 con 0x7fef58104320 2024-05-09T00:02:50.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef557fa700 1 -- 172.21.15.81:0/3558502188 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c00f620 con 0x7fef58104320 2024-05-09T00:02:50.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.708+0000 7fef5ea15700 1 -- 172.21.15.81:0/3558502188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5819f460 con 0x7fef58104320 2024-05-09T00:02:50.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.709+0000 7fef5ea15700 1 -- 172.21.15.81:0/3558502188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef580fcf00 con 0x7fef58104320 2024-05-09T00:02:50.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.710+0000 7fef557fa700 1 -- 172.21.15.81:0/3558502188 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fef4c010460 con 0x7fef58104320 2024-05-09T00:02:50.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.711+0000 7fef557fa700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fef400a11b0 0x7fef400a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:50.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.711+0000 7fef57fff700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fef400a11b0 0x7fef400a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:50.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.711+0000 7fef557fa700 1 -- 172.21.15.81:0/3558502188 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7fef4c0ccdf0 con 0x7fef58104320 2024-05-09T00:02:50.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.711+0000 7fef57fff700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fef400a11b0 0x7fef400a3670 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fef48005fd0 tx=0x7fef48005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:50.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.714+0000 7fef557fa700 1 -- 172.21.15.81:0/3558502188 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fef4c096420 con 0x7fef58104320 2024-05-09T00:02:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:50.970+0000 7fef5ea15700 1 -- 172.21.15.81:0/3558502188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fef5810c740 con 0x7fef58104320 2024-05-09T00:02:51.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:50 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2616683218' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:51.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:50 smithi081 ceph-mon[42474]: pgmap v253: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-05-09T00:02:51.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:50 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2616683218' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:51.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:50 smithi150 ceph-mon[46187]: pgmap v253: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-05-09T00:02:51.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:50 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2616683218' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:02:51.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:50 smithi171 ceph-mon[47351]: pgmap v253: 97 pgs: 1 peering, 96 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-05-09T00:02:51.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:51.861+0000 7fef557fa700 1 -- 172.21.15.81:0/3558502188 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 18) v1 ==== 135941+0+0 (secure 0 0 0) 0x7fef4c0967f0 con 0x7fef58104320 2024-05-09T00:02:51.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:51.863+0000 7fef557fa700 1 -- 172.21.15.81:0/3558502188 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) v1 ==== 92+0+0 (secure 0 0 0) 0x7fef4c099eb0 con 0x7fef58104320 2024-05-09T00:02:51.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:51.865+0000 7fef5ea15700 1 -- 172.21.15.81:0/3558502188 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fef400a11b0 msgr2=0x7fef400a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:51.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:51.865+0000 7fef5ea15700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fef400a11b0 0x7fef400a3670 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fef48005fd0 tx=0x7fef48005dc0 comp rx=0 tx=0).stop 2024-05-09T00:02:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:51.865+0000 7fef5ea15700 1 -- 172.21.15.81:0/3558502188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef58104320 msgr2=0x7fef581974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:51.865+0000 7fef5ea15700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef58104320 0x7fef581974e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fef4c00d950 tx=0x7fef4c00dd10 comp rx=0 tx=0).stop 2024-05-09T00:02:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:51.865+0000 7fef5ea15700 1 -- 172.21.15.81:0/3558502188 shutdown_connections 2024-05-09T00:02:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:51.865+0000 7fef5ea15700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7fef400a11b0 0x7fef400a3670 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:51.865+0000 7fef5ea15700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fef581019f0 0x7fef58196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:51.865+0000 7fef5ea15700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef58106c50 0x7fef5819e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:51.865+0000 7fef5ea15700 1 --2- 172.21.15.81:0/3558502188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef58104320 0x7fef581974e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:51.865+0000 7fef5ea15700 1 -- 172.21.15.81:0/3558502188 >> 172.21.15.81:0/3558502188 conn(0x7fef580fb380 msgr2=0x7fef58102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:51.865+0000 7fef5ea15700 1 -- 172.21.15.81:0/3558502188 shutdown_connections 2024-05-09T00:02:51.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:51.865+0000 7fef5ea15700 1 -- 172.21.15.81:0/3558502188 wait complete. 2024-05-09T00:02:51.873 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-05-09T00:02:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.012+0000 7f997c3f4700 1 -- 172.21.15.81:0/1658201948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9974106cb0 msgr2=0x7f99741090a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.012+0000 7f997c3f4700 1 --2- 172.21.15.81:0/1658201948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9974106cb0 0x7f99741090a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f996c00b0a0 tx=0x7f996c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.012+0000 7f997c3f4700 1 -- 172.21.15.81:0/1658201948 shutdown_connections 2024-05-09T00:02:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.012+0000 7f997c3f4700 1 --2- 172.21.15.81:0/1658201948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9974106cb0 0x7f99741090a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.012+0000 7f997c3f4700 1 --2- 172.21.15.81:0/1658201948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9974101a50 0x7f9974103e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.012+0000 7f997c3f4700 1 --2- 172.21.15.81:0/1658201948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9974104380 0x7f9974106770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.012+0000 7f997c3f4700 1 -- 172.21.15.81:0/1658201948 >> 172.21.15.81:0/1658201948 conn(0x7f99740fb3a0 msgr2=0x7f99740fd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.012+0000 7f997c3f4700 1 -- 172.21.15.81:0/1658201948 shutdown_connections 2024-05-09T00:02:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.012+0000 7f997c3f4700 1 -- 172.21.15.81:0/1658201948 wait complete. 2024-05-09T00:02:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.012+0000 7f997c3f4700 1 Processor -- start 2024-05-09T00:02:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.012+0000 7f997c3f4700 1 -- start start 2024-05-09T00:02:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997c3f4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9974101a50 0x7f9974196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997c3f4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9974104380 0x7f9974197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997c3f4700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9974106cb0 0x7f997419e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997c3f4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997419ea70 con 0x7f9974104380 2024-05-09T00:02:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997c3f4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997419ebb0 con 0x7f9974101a50 2024-05-09T00:02:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997c3f4700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997419ed40 con 0x7f9974106cb0 2024-05-09T00:02:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997998f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9974104380 0x7f9974197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997a190700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9974101a50 0x7f9974196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997998f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9974104380 0x7f9974197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59694/0 (socket says 172.21.15.81:59694) 2024-05-09T00:02:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997998f700 1 -- 172.21.15.81:0/3065246032 learned_addr learned my addr 172.21.15.81:0/3065246032 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997a991700 1 --2- 172.21.15.81:0/3065246032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9974106cb0 0x7f997419e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997998f700 1 -- 172.21.15.81:0/3065246032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9974106cb0 msgr2=0x7f997419e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997998f700 1 --2- 172.21.15.81:0/3065246032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9974106cb0 0x7f997419e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997998f700 1 -- 172.21.15.81:0/3065246032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9974101a50 msgr2=0x7f9974196f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997998f700 1 --2- 172.21.15.81:0/3065246032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9974101a50 0x7f9974196f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997998f700 1 -- 172.21.15.81:0/3065246032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c009d00 con 0x7f9974104380 2024-05-09T00:02:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997a190700 1 --2- 172.21.15.81:0/3065246032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9974101a50 0x7f9974196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:02:52.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997998f700 1 --2- 172.21.15.81:0/3065246032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9974104380 0x7f9974197480 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f996400e9a0 tx=0x7f996400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f996b7fe700 1 -- 172.21.15.81:0/3065246032 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964009790 con 0x7f9974104380 2024-05-09T00:02:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997c3f4700 1 -- 172.21.15.81:0/3065246032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997419efc0 con 0x7f9974104380 2024-05-09T00:02:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f996b7fe700 1 -- 172.21.15.81:0/3065246032 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9964010430 con 0x7f9974104380 2024-05-09T00:02:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f996b7fe700 1 -- 172.21.15.81:0/3065246032 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964018680 con 0x7f9974104380 2024-05-09T00:02:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.013+0000 7f997c3f4700 1 -- 172.21.15.81:0/3065246032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997419f4f0 con 0x7f9974104380 2024-05-09T00:02:52.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.014+0000 7f997c3f4700 1 -- 172.21.15.81:0/3065246032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99740fcf20 con 0x7f9974104380 2024-05-09T00:02:52.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.016+0000 7f996b7fe700 1 -- 172.21.15.81:0/3065246032 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 135941+0+0 (secure 0 0 0) 0x7f99640105a0 con 0x7f9974104380 2024-05-09T00:02:52.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.016+0000 7f996b7fe700 1 --2- 172.21.15.81:0/3065246032 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f99600a1200 0x7f99600a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:52.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.016+0000 7f997a190700 1 -- 172.21.15.81:0/3065246032 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f99600a1200 msgr2=0x7f99600a36c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1458411552 2024-05-09T00:02:52.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.017+0000 7f996b7fe700 1 -- 172.21.15.81:0/3065246032 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f9964014070 con 0x7f9974104380 2024-05-09T00:02:52.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.017+0000 7f997a190700 1 --2- 172.21.15.81:0/3065246032 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f99600a1200 0x7f99600a36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:02:52.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.024+0000 7f996b7fe700 1 -- 172.21.15.81:0/3065246032 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f99640964a0 con 0x7f9974104380 2024-05-09T00:02:52.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:51 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3558502188' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-09T00:02:52.120 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:51 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: ignoring --setuser ceph since I am not root 2024-05-09T00:02:52.120 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:51 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: ignoring --setgroup ceph since I am not root 2024-05-09T00:02:52.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.218+0000 7f997a190700 1 -- 172.21.15.81:0/3065246032 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f99600a1200 msgr2=0x7f99600a36c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1458411552 2024-05-09T00:02:52.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.218+0000 7f997a190700 1 --2- 172.21.15.81:0/3065246032 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f99600a1200 0x7f99600a36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T00:02:52.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.231+0000 7f997c3f4700 1 -- 172.21.15.81:0/3065246032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f99740675a0 con 0x7f9974104380 2024-05-09T00:02:52.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.236+0000 7f996b7fe700 1 -- 172.21.15.81:0/3065246032 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v33)=0 v33) v1 ==== 138+0+0 (secure 0 0 0) 0x7f99640260d0 con 0x7f9974104380 2024-05-09T00:02:52.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.238+0000 7f997c3f4700 1 -- 172.21.15.81:0/3065246032 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f99600a1200 msgr2=0x7f99600a36c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:02:52.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.238+0000 7f997c3f4700 1 --2- 172.21.15.81:0/3065246032 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f99600a1200 0x7f99600a36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.238+0000 7f997c3f4700 1 -- 172.21.15.81:0/3065246032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9974104380 msgr2=0x7f9974197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:52.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.238+0000 7f997c3f4700 1 --2- 172.21.15.81:0/3065246032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9974104380 0x7f9974197480 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f996400e9a0 tx=0x7f996400ecb0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.238+0000 7f997c3f4700 1 -- 172.21.15.81:0/3065246032 shutdown_connections 2024-05-09T00:02:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.238+0000 7f997c3f4700 1 --2- 172.21.15.81:0/3065246032 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f99600a1200 0x7f99600a36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.238+0000 7f997c3f4700 1 --2- 172.21.15.81:0/3065246032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9974101a50 0x7f9974196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.238+0000 7f997c3f4700 1 --2- 172.21.15.81:0/3065246032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9974106cb0 0x7f997419e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.238+0000 7f997c3f4700 1 --2- 172.21.15.81:0/3065246032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9974104380 0x7f9974197480 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.238+0000 7f997c3f4700 1 -- 172.21.15.81:0/3065246032 >> 172.21.15.81:0/3065246032 conn(0x7f99740fb3a0 msgr2=0x7f99741022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.238+0000 7f997c3f4700 1 -- 172.21.15.81:0/3065246032 shutdown_connections 2024-05-09T00:02:52.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.238+0000 7f997c3f4700 1 -- 172.21.15.81:0/3065246032 wait complete. 2024-05-09T00:02:52.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-05-09T00:02:52.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:51 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3558502188' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-09T00:02:52.264 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:51 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: ignoring --setuser ceph since I am not root 2024-05-09T00:02:52.265 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:51 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: ignoring --setgroup ceph since I am not root 2024-05-09T00:02:52.265 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:51 smithi150 ceph-mgr[47655]: -- 172.21.15.150:0/1044171283 <== mon.2 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d44b5ee1a0 con 0x55d44b5c4c00 2024-05-09T00:02:52.294 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:51 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3558502188' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-09T00:02:52.294 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:51 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: ignoring --setuser ceph since I am not root 2024-05-09T00:02:52.294 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:51 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: ignoring --setgroup ceph since I am not root 2024-05-09T00:02:52.294 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:51 smithi171 ceph-mgr[49206]: -- 172.21.15.171:0/3914146686 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56415c1e21a0 con 0x56415c1b8800 2024-05-09T00:02:52.294 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:52 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:52.299+0000 7f71d4fb1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T00:02:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.376+0000 7f223ec5c700 1 -- 172.21.15.81:0/18455926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238100f30 msgr2=0x7f2238101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.376+0000 7f223ec5c700 1 --2- 172.21.15.81:0/18455926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238100f30 0x7f2238101350 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f222c009990 tx=0x7f222c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.376+0000 7f223ec5c700 1 -- 172.21.15.81:0/18455926 shutdown_connections 2024-05-09T00:02:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.376+0000 7f223ec5c700 1 --2- 172.21.15.81:0/18455926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2238102a40 0x7f2238109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.376+0000 7f223ec5c700 1 --2- 172.21.15.81:0/18455926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238100f30 0x7f2238101350 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.376+0000 7f223ec5c700 1 --2- 172.21.15.81:0/18455926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2238102080 0x7f2238102500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.376+0000 7f223ec5c700 1 -- 172.21.15.81:0/18455926 >> 172.21.15.81:0/18455926 conn(0x7f22380fc4a0 msgr2=0x7f22380fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.376+0000 7f223ec5c700 1 -- 172.21.15.81:0/18455926 shutdown_connections 2024-05-09T00:02:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.377+0000 7f223ec5c700 1 -- 172.21.15.81:0/18455926 wait complete. 2024-05-09T00:02:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.377+0000 7f223ec5c700 1 Processor -- start 2024-05-09T00:02:52.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.377+0000 7f223ec5c700 1 -- start start 2024-05-09T00:02:52.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.377+0000 7f223ec5c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2238100f30 0x7f2238074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:52.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.377+0000 7f223ec5c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2238102080 0x7f2238073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:52.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.377+0000 7f223ec5c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238102a40 0x7f22380738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:52.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.377+0000 7f223ec5c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2238074070 con 0x7f2238102a40 2024-05-09T00:02:52.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.377+0000 7f223ec5c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380741e0 con 0x7f2238100f30 2024-05-09T00:02:52.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.377+0000 7f223ec5c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22381a0f00 con 0x7f2238102080 2024-05-09T00:02:52.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.377+0000 7f223d1f9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238102a40 0x7f22380738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:52.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.377+0000 7f223d1f9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238102a40 0x7f22380738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59712/0 (socket says 172.21.15.81:59712) 2024-05-09T00:02:52.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.377+0000 7f223d1f9700 1 -- 172.21.15.81:0/335076969 learned_addr learned my addr 172.21.15.81:0/335076969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:52.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.377+0000 7f223c9f8700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2238100f30 0x7f2238074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:52.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.377+0000 7f2237fff700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2238102080 0x7f2238073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:52.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.378+0000 7f223d1f9700 1 -- 172.21.15.81:0/335076969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2238102080 msgr2=0x7f2238073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:52.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.378+0000 7f223d1f9700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2238102080 0x7f2238073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.378+0000 7f223d1f9700 1 -- 172.21.15.81:0/335076969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2238100f30 msgr2=0x7f2238074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:52.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.378+0000 7f223d1f9700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2238100f30 0x7f2238074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.378+0000 7f223d1f9700 1 -- 172.21.15.81:0/335076969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c0095f0 con 0x7f2238102a40 2024-05-09T00:02:52.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.378+0000 7f223c9f8700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2238100f30 0x7f2238074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:02:52.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.378+0000 7f2237fff700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2238102080 0x7f2238073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:02:52.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.378+0000 7f223d1f9700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238102a40 0x7f22380738d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f223000ef30 tx=0x7f223000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:52.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.378+0000 7f2235ffb700 1 -- 172.21.15.81:0/335076969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230018070 con 0x7f2238102a40 2024-05-09T00:02:52.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.378+0000 7f2235ffb700 1 -- 172.21.15.81:0/335076969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f223000f040 con 0x7f2238102a40 2024-05-09T00:02:52.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.378+0000 7f223ec5c700 1 -- 172.21.15.81:0/335076969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22381a1130 con 0x7f2238102a40 2024-05-09T00:02:52.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.378+0000 7f2235ffb700 1 -- 172.21.15.81:0/335076969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223000cca0 con 0x7f2238102a40 2024-05-09T00:02:52.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.378+0000 7f223ec5c700 1 -- 172.21.15.81:0/335076969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22381a15f0 con 0x7f2238102a40 2024-05-09T00:02:52.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.379+0000 7f223ec5c700 1 -- 172.21.15.81:0/335076969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22381083a0 con 0x7f2238102a40 2024-05-09T00:02:52.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.380+0000 7f2235ffb700 1 -- 172.21.15.81:0/335076969 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 135941+0+0 (secure 0 0 0) 0x7f2230003a00 con 0x7f2238102a40 2024-05-09T00:02:52.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.381+0000 7f2235ffb700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f22280a1200 0x7f22280a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:52.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.381+0000 7f223c9f8700 1 -- 172.21.15.81:0/335076969 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f22280a1200 msgr2=0x7f22280a36c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1458411552 2024-05-09T00:02:52.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.381+0000 7f2235ffb700 1 -- 172.21.15.81:0/335076969 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f22300cc670 con 0x7f2238102a40 2024-05-09T00:02:52.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.381+0000 7f223c9f8700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f22280a1200 0x7f22280a36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:02:52.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.385+0000 7f2235ffb700 1 -- 172.21.15.81:0/335076969 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2230095cd0 con 0x7f2238102a40 2024-05-09T00:02:52.498 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:52 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:52.316+0000 7fd0b6cc8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T00:02:52.498 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:52 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:52.414+0000 7fd0b6cc8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T00:02:52.498 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:52 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:52.503+0000 7fd0b6cc8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T00:02:52.555 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:52 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:52.393+0000 7f71d4fb1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T00:02:52.556 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:52 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:52.481+0000 7f71d4fb1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T00:02:52.558 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:52 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:52.299+0000 7fafdbb1c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-09T00:02:52.558 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:52 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:52.392+0000 7fafdbb1c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-09T00:02:52.558 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:52 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:52.478+0000 7fafdbb1c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-09T00:02:52.558 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:52 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:52.564+0000 7fafdbb1c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T00:02:52.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.582+0000 7f223c9f8700 1 -- 172.21.15.81:0/335076969 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f22280a1200 msgr2=0x7f22280a36c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1458411552 2024-05-09T00:02:52.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.582+0000 7f223c9f8700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f22280a1200 0x7f22280a36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T00:02:52.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.588+0000 7f223ec5c700 1 -- 172.21.15.81:0/335076969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f2238107d80 con 0x7f2238102a40 2024-05-09T00:02:52.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.593+0000 7f2235ffb700 1 -- 172.21.15.81:0/335076969 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v34)=0 v34) v1 ==== 133+0+0 (secure 0 0 0) 0x7f22300992f0 con 0x7f2238102a40 2024-05-09T00:02:52.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.595+0000 7f223ec5c700 1 -- 172.21.15.81:0/335076969 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f22280a1200 msgr2=0x7f22280a36c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:02:52.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.595+0000 7f223ec5c700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f22280a1200 0x7f22280a36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.595+0000 7f223ec5c700 1 -- 172.21.15.81:0/335076969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238102a40 msgr2=0x7f22380738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.595+0000 7f223ec5c700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238102a40 0x7f22380738d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f223000ef30 tx=0x7f223000c3a0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.595+0000 7f223ec5c700 1 -- 172.21.15.81:0/335076969 shutdown_connections 2024-05-09T00:02:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.595+0000 7f223ec5c700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f22280a1200 0x7f22280a36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.595+0000 7f223ec5c700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2238100f30 0x7f2238074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.595+0000 7f223ec5c700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2238102a40 0x7f22380738d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.595+0000 7f223ec5c700 1 --2- 172.21.15.81:0/335076969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2238102080 0x7f2238073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.595+0000 7f223ec5c700 1 -- 172.21.15.81:0/335076969 >> 172.21.15.81:0/335076969 conn(0x7f22380fc4a0 msgr2=0x7f22381054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:52.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.595+0000 7f223ec5c700 1 -- 172.21.15.81:0/335076969 shutdown_connections 2024-05-09T00:02:52.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:52.596+0000 7f223ec5c700 1 -- 172.21.15.81:0/335076969 wait complete. 2024-05-09T00:02:52.603 INFO:teuthology.run_tasks:Running task kclient... 2024-05-09T00:02:52.648 INFO:tasks.kclient:Mounting kernel clients... 2024-05-09T00:02:52.648 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-09T00:02:52.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:52.649 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-05-09T00:02:52.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:52.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-05-09T00:02:52.736 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-05-09T00:02:52.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:02:52.738 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-05-09T00:02:52.738 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-09T00:02:52.738 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T00:02:52.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-09T00:02:52.803 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:52 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:52.590+0000 7fd0b6cc8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T00:02:52.846 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:52 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:52.568+0000 7f71d4fb1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-09T00:02:53.029 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:02:53.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:52 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3558502188' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-09T00:02:53.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:52 smithi081 ceph-mon[42474]: mgrmap e18: x(active, since 6m), standbys: z, y 2024-05-09T00:02:53.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:52 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3065246032' entity='client.admin' 2024-05-09T00:02:53.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:52 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/335076969' entity='client.admin' 2024-05-09T00:02:53.190 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:52 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3558502188' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-09T00:02:53.190 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:52 smithi150 ceph-mon[46187]: mgrmap e18: x(active, since 6m), standbys: z, y 2024-05-09T00:02:53.191 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:52 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3065246032' entity='client.admin' 2024-05-09T00:02:53.191 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:52 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/335076969' entity='client.admin' 2024-05-09T00:02:53.193 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:52 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3558502188' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-09T00:02:53.193 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:52 smithi171 ceph-mon[47351]: mgrmap e18: x(active, since 6m), standbys: z, y 2024-05-09T00:02:53.193 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:52 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3065246032' entity='client.admin' 2024-05-09T00:02:53.194 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:52 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/335076969' entity='client.admin' 2024-05-09T00:02:53.443 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:53 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:53.196+0000 7fafdbb1c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:02:53.448 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:53 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:53.200+0000 7f71d4fb1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:02:53.481 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:53 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:53.263+0000 7fd0b6cc8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:02:53.764 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:53 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:53.448+0000 7fafdbb1c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T00:02:53.764 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:53 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:53.534+0000 7fafdbb1c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T00:02:53.764 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:53 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:53.643+0000 7fafdbb1c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T00:02:53.802 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:53 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:53.455+0000 7f71d4fb1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T00:02:53.802 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:53 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:53.542+0000 7f71d4fb1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T00:02:53.802 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:53 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:53.652+0000 7f71d4fb1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T00:02:53.834 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:53 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:53.527+0000 7fd0b6cc8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-09T00:02:53.834 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:53 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:53.614+0000 7fd0b6cc8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-09T00:02:53.834 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:53 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:53.727+0000 7fd0b6cc8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-09T00:02:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.041+0000 7f816dd19700 1 -- 172.21.15.81:0/259029093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8168107020 msgr2=0x7f8168107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:54.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.041+0000 7f816dd19700 1 --2- 172.21.15.81:0/259029093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8168107020 0x7f8168107400 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8158009990 tx=0x7f8158009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.041+0000 7f816dd19700 1 -- 172.21.15.81:0/259029093 shutdown_connections 2024-05-09T00:02:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.041+0000 7f816dd19700 1 --2- 172.21.15.81:0/259029093 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81680692f0 0x7f816810de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.041+0000 7f816dd19700 1 --2- 172.21.15.81:0/259029093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8168107020 0x7f8168107400 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.041+0000 7f816dd19700 1 --2- 172.21.15.81:0/259029093 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8168068950 0x7f8168068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.041+0000 7f816dd19700 1 -- 172.21.15.81:0/259029093 >> 172.21.15.81:0/259029093 conn(0x7f8168075f80 msgr2=0x7f8168076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.041+0000 7f816dd19700 1 -- 172.21.15.81:0/259029093 shutdown_connections 2024-05-09T00:02:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.041+0000 7f816dd19700 1 -- 172.21.15.81:0/259029093 wait complete. 2024-05-09T00:02:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.042+0000 7f816dd19700 1 Processor -- start 2024-05-09T00:02:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.042+0000 7f816dd19700 1 -- start start 2024-05-09T00:02:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.042+0000 7f816dd19700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8168068950 0x7f8168197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.042+0000 7f816dd19700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81680692f0 0x7f81681978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.042+0000 7f816dd19700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8168107020 0x7f816819bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:54.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.042+0000 7f816dd19700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816819c290 con 0x7f8168068950 2024-05-09T00:02:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.042+0000 7f816dd19700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816819c400 con 0x7f81680692f0 2024-05-09T00:02:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.042+0000 7f816dd19700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816819c5c0 con 0x7f8168107020 2024-05-09T00:02:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.042+0000 7f81677fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8168068950 0x7f8168197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.042+0000 7f81677fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8168068950 0x7f8168197390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59732/0 (socket says 172.21.15.81:59732) 2024-05-09T00:02:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.042+0000 7f81677fe700 1 -- 172.21.15.81:0/1065421655 learned_addr learned my addr 172.21.15.81:0/1065421655 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.042+0000 7f8166ffd700 1 --2- 172.21.15.81:0/1065421655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81680692f0 0x7f81681978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.042+0000 7f8167fff700 1 --2- 172.21.15.81:0/1065421655 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8168107020 0x7f816819bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.043+0000 7f81677fe700 1 -- 172.21.15.81:0/1065421655 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8168107020 msgr2=0x7f816819bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.043+0000 7f81677fe700 1 --2- 172.21.15.81:0/1065421655 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8168107020 0x7f816819bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.043+0000 7f81677fe700 1 -- 172.21.15.81:0/1065421655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81680692f0 msgr2=0x7f81681978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.043+0000 7f81677fe700 1 --2- 172.21.15.81:0/1065421655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81680692f0 0x7f81681978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.043+0000 7f81677fe700 1 -- 172.21.15.81:0/1065421655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81580095f0 con 0x7f8168068950 2024-05-09T00:02:54.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.043+0000 7f81677fe700 1 --2- 172.21.15.81:0/1065421655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8168068950 0x7f8168197390 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8158000c00 tx=0x7f8158004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:54.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.043+0000 7f8164ff9700 1 -- 172.21.15.81:0/1065421655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815801d070 con 0x7f8168068950 2024-05-09T00:02:54.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.043+0000 7f8164ff9700 1 -- 172.21.15.81:0/1065421655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8158022470 con 0x7f8168068950 2024-05-09T00:02:54.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.043+0000 7f816dd19700 1 -- 172.21.15.81:0/1065421655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816819c840 con 0x7f8168068950 2024-05-09T00:02:54.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.043+0000 7f8164ff9700 1 -- 172.21.15.81:0/1065421655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8158017650 con 0x7f8168068950 2024-05-09T00:02:54.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.043+0000 7f816dd19700 1 -- 172.21.15.81:0/1065421655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81681a4100 con 0x7f8168068950 2024-05-09T00:02:54.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.044+0000 7f816dd19700 1 -- 172.21.15.81:0/1065421655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8168109540 con 0x7f8168068950 2024-05-09T00:02:54.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.046+0000 7f8164ff9700 1 -- 172.21.15.81:0/1065421655 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) v1 ==== 135941+0+0 (secure 0 0 0) 0x7f81580225e0 con 0x7f8168068950 2024-05-09T00:02:54.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.046+0000 7f8164ff9700 1 --2- 172.21.15.81:0/1065421655 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f81500a1280 0x7f81500a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:54.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.046+0000 7f8166ffd700 1 -- 172.21.15.81:0/1065421655 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f81500a1280 msgr2=0x7f81500a3740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1458411552 2024-05-09T00:02:54.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.046+0000 7f8164ff9700 1 -- 172.21.15.81:0/1065421655 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 8227+0+0 (secure 0 0 0) 0x7f81580ce2d0 con 0x7f8168068950 2024-05-09T00:02:54.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.047+0000 7f8166ffd700 1 --2- 172.21.15.81:0/1065421655 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f81500a1280 0x7f81500a3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-09T00:02:54.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.050+0000 7f8164ff9700 1 -- 172.21.15.81:0/1065421655 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8158097930 con 0x7f8168068950 2024-05-09T00:02:54.119 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:53 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:53.901+0000 7fd0b6cc8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T00:02:54.119 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:54 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:54.035+0000 7fd0b6cc8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T00:02:54.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.248+0000 7f8166ffd700 1 -- 172.21.15.81:0/1065421655 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f81500a1280 msgr2=0x7f81500a3740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.81:6800/1458411552 2024-05-09T00:02:54.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.248+0000 7f8166ffd700 1 --2- 172.21.15.81:0/1065421655 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f81500a1280 0x7f81500a3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-09T00:02:54.263 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:53 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:53.803+0000 7fafdbb1c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T00:02:54.264 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:53 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:53.930+0000 7fafdbb1c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T00:02:54.264 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:54 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:54.016+0000 7fafdbb1c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T00:02:54.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.295+0000 7f816dd19700 1 -- 172.21.15.81:0/1065421655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f816804ec60 con 0x7f8168068950 2024-05-09T00:02:54.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.296+0000 7f8164ff9700 1 -- 172.21.15.81:0/1065421655 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f815809af50 con 0x7f8168068950 2024-05-09T00:02:54.290 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-09T00:02:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.298+0000 7f816dd19700 1 -- 172.21.15.81:0/1065421655 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f81500a1280 msgr2=0x7f81500a3740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:02:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.298+0000 7f816dd19700 1 --2- 172.21.15.81:0/1065421655 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f81500a1280 0x7f81500a3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.298+0000 7f816dd19700 1 -- 172.21.15.81:0/1065421655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8168068950 msgr2=0x7f8168197390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.298+0000 7f816dd19700 1 --2- 172.21.15.81:0/1065421655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8168068950 0x7f8168197390 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8158000c00 tx=0x7f8158004730 comp rx=0 tx=0).stop 2024-05-09T00:02:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.298+0000 7f816dd19700 1 -- 172.21.15.81:0/1065421655 shutdown_connections 2024-05-09T00:02:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.298+0000 7f816dd19700 1 --2- 172.21.15.81:0/1065421655 >> [v2:172.21.15.81:6800/1458411552,v1:172.21.15.81:6801/1458411552] conn(0x7f81500a1280 0x7f81500a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.298+0000 7f816dd19700 1 --2- 172.21.15.81:0/1065421655 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8168107020 0x7f816819bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:54.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.298+0000 7f816dd19700 1 --2- 172.21.15.81:0/1065421655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8168068950 0x7f8168197390 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.298+0000 7f816dd19700 1 --2- 172.21.15.81:0/1065421655 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f81680692f0 0x7f81681978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.298+0000 7f816dd19700 1 -- 172.21.15.81:0/1065421655 >> 172.21.15.81:0/1065421655 conn(0x7f8168075f80 msgr2=0x7f81680fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.298+0000 7f816dd19700 1 -- 172.21.15.81:0/1065421655 shutdown_connections 2024-05-09T00:02:54.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:54.298+0000 7f816dd19700 1 -- 172.21.15.81:0/1065421655 wait complete. 2024-05-09T00:02:54.302 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:53 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:53.809+0000 7f71d4fb1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-09T00:02:54.302 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:53 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:53.939+0000 7f71d4fb1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-09T00:02:54.302 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:54 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:54.025+0000 7f71d4fb1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T00:02:54.470 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:54 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1065421655' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T00:02:54.470 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:54 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:54.127+0000 7fd0b6cc8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-09T00:02:54.653 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-09T00:02:54.654 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-09T00:02:54.654 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-05-09T00:02:54.654 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-09T00:02:54.654 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-09T00:02:54.654 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-09T00:02:54.654 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-09T00:02:54.654 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-09T00:02:54.654 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-09T00:02:54.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:54.654 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-05-09T00:02:54.713 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-09T00:02:54.713 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-09T00:02:54.713 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-05-09T00:02:54.713 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:02:54.713 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-05-09T00:02:54.713 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:02:54.714 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:02:54.714 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:02:54.714 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-05-09T00:02:54.714 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:02:54.714 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:02:54.714 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-05-09T00:02:54.714 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-09T00:02:54.714 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:02:54.714 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-09T00:02:54.714 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-05-09T00:02:54.714 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-09T00:02:54.714 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 41833sec preferred_lft 41833sec 2024-05-09T00:02:54.714 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::2c08:76e3:a549:1524/64 scope link noprefixroute 2024-05-09T00:02:54.715 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-05-09T00:02:54.715 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-09T00:02:54.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:54.715 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-05-09T00:02:54.715 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-09T00:02:54.715 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-05-09T00:02:54.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-05-09T00:02:54.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-05-09T00:02:54.716 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-09T00:02:54.716 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-09T00:02:54.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:54 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1065421655' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T00:02:54.764 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:54 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:54.389+0000 7fafdbb1c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T00:02:54.783 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:54 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1065421655' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-09T00:02:54.783 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:54 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:54.398+0000 7f71d4fb1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T00:02:54.795 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:54 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:54.514+0000 7fd0b6cc8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-09T00:02:54.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:54.888 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-09T00:02:54.957 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-05-09T00:02:54.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:54.959 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-05-09T00:02:55.050 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-05-09T00:02:55.050 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-09T00:02:55.050 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-09T00:02:55.050 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-09T00:02:55.050 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-09T00:02:55.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:55.051 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-05-09T00:02:55.051 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-09T00:02:55.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-09T00:02:55.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-09T00:02:55.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-09T00:02:55.051 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-09T00:02:55.052 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:54 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:54.789+0000 7f71d4fb1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T00:02:55.052 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:54 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:54.989+0000 7f71d4fb1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T00:02:55.064 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:54 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:54.781+0000 7fafdbb1c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T00:02:55.064 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:54 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:54.976+0000 7fafdbb1c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T00:02:55.064 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:55 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:55.070+0000 7fafdbb1c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T00:02:55.090 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:54 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:54.928+0000 7fd0b6cc8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-09T00:02:55.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:55.255 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-05-09T00:02:55.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:55.313 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-05-09T00:02:55.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:55.370 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-05-09T00:02:55.370 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-09T00:02:55.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T00:02:55.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-09T00:02:55.371 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-09T00:02:55.371 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:55 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:55.136+0000 7fd0b6cc8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-09T00:02:55.371 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:55 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:55.236+0000 7fd0b6cc8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T00:02:55.466 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-09T00:02:55.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:55.467 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-05-09T00:02:55.467 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-09T00:02:55.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-09T00:02:55.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-09T00:02:55.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-09T00:02:55.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-09T00:02:55.467 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-09T00:02:55.467 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-09T00:02:55.552 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:55 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:55.083+0000 7f71d4fb1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-09T00:02:55.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:55.680 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec bash -c ' 2024-05-09T00:02:55.680 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-05-09T00:02:55.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-05-09T00:02:55.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-05-09T00:02:55.680 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-05-09T00:02:55.781 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T00:02:55.781 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-09T00:02:55.798 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-09T00:02:55.799 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-09T00:02:55.799 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-09T00:02:55.856 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-05-09T00:02:55.856 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-05-09T00:02:55.856 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/a571f237-cd1d-4fcd-8d62-a529e0096d24 2024-05-09T00:02:55.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:55.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/a571f237-cd1d-4fcd-8d62-a529e0096d24 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-09T00:02:55.942 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-09T00:02:55.942 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-05-09T00:02:55.943 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-05-09T00:02:56.098 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:55 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:55.851+0000 7f71d4fb1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T00:02:56.098 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:55 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:55.949+0000 7f71d4fb1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T00:02:56.264 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:55 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:55.836+0000 7fafdbb1c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T00:02:56.264 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:55 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:55.933+0000 7fafdbb1c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T00:02:56.264 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:56 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:56.084+0000 7fafdbb1c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T00:02:56.305 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:56 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:56.060+0000 7fd0b6cc8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-09T00:02:56.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:56 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:56.159+0000 7fd0b6cc8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-09T00:02:56.306 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:56 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:56.311+0000 7fd0b6cc8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T00:02:56.552 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:56 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:56.104+0000 7f71d4fb1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-09T00:02:57.014 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:56 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:56.715+0000 7fafdbb1c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T00:02:57.014 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:56 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:56.897+0000 7fafdbb1c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T00:02:57.052 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:56 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:56.741+0000 7f71d4fb1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T00:02:57.052 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:56 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:56.924+0000 7f71d4fb1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T00:02:57.320 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:56 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:56.939+0000 7fd0b6cc8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-09T00:02:57.320 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:57 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:57.128+0000 7fd0b6cc8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-09T00:02:57.514 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:57 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:57.096+0000 7fafdbb1c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T00:02:57.552 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:57 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:57.124+0000 7f71d4fb1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T00:02:57.619 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:57 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:57.326+0000 7fd0b6cc8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-09T00:02:58.314 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:58 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:58.031+0000 7fafdbb1c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T00:02:58.344 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:58 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:58.062+0000 7f71d4fb1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T00:02:58.549 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:58 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:58.262+0000 7fd0b6cc8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-09T00:02:58.592 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:58 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:58.320+0000 7fafdbb1c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:02:58.592 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:58 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:58.409+0000 7fafdbb1c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T00:02:58.592 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:02:58 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y[47632]: 2024-05-09T00:02:58.598+0000 7fafdbb1c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T00:02:58.625 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:58 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:58.351+0000 7f71d4fb1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:02:58.626 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:58 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:58.441+0000 7f71d4fb1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T00:02:58.843 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:58 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:58.555+0000 7fd0b6cc8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-09T00:02:58.843 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:58 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:58.649+0000 7fd0b6cc8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-09T00:02:58.843 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:58 smithi081 ceph-mon[42474]: Standby manager daemon y restarted 2024-05-09T00:02:58.843 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:58 smithi081 ceph-mon[42474]: Standby manager daemon y started 2024-05-09T00:02:58.843 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:58 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.150:0/2447147190' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-09T00:02:58.844 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:58 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.150:0/2447147190' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:02:58.844 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:58 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.150:0/2447147190' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-09T00:02:58.844 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:58 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.150:0/2447147190' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:02:58.844 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:58 smithi081 ceph-mon[42474]: Standby manager daemon z restarted 2024-05-09T00:02:58.844 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:58 smithi081 ceph-mon[42474]: Standby manager daemon z started 2024-05-09T00:02:58.844 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:58 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.171:0/1131370806' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-09T00:02:58.844 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:58 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.171:0/1131370806' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:02:58.844 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:58 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.171:0/1131370806' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-09T00:02:58.844 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:58 smithi081 ceph-mon[42474]: from='mgr.? 172.21.15.171:0/1131370806' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:02:58.886 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-09T00:02:58.887 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-05-09T00:02:58.887 INFO:teuthology.orchestra.run.smithi081.stdout:invalid new device string format 2024-05-09T00:02:58.887 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.150:3300,172.21.15.171:3300" 2024-05-09T00:02:58.887 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.81:3300,172.21.15.150:3300,172.21.15.171:3300:/volumes/qa/sv_1/a571f237-cd1d-4fcd-8d62-a529e0096d24 2024-05-09T00:02:58.887 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=6c93ddc4-0d96-11ef-bc97-c7b262605968" will pass to kernel 2024-05-09T00:02:58.895 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-09T00:02:58.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:58.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-09T00:02:58.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:58.939 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:02:59.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:58 smithi150 ceph-mon[46187]: Standby manager daemon y restarted 2024-05-09T00:02:59.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:58 smithi150 ceph-mon[46187]: Standby manager daemon y started 2024-05-09T00:02:59.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:58 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.150:0/2447147190' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-09T00:02:59.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:58 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.150:0/2447147190' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:02:59.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:58 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.150:0/2447147190' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-09T00:02:59.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:58 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.150:0/2447147190' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:02:59.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:58 smithi150 ceph-mon[46187]: Standby manager daemon z restarted 2024-05-09T00:02:59.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:58 smithi150 ceph-mon[46187]: Standby manager daemon z started 2024-05-09T00:02:59.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:58 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.171:0/1131370806' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-09T00:02:59.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:58 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.171:0/1131370806' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:02:59.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:58 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.171:0/1131370806' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-09T00:02:59.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:58 smithi150 ceph-mon[46187]: from='mgr.? 172.21.15.171:0/1131370806' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:02:59.024 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:58 smithi171 ceph-mon[47351]: Standby manager daemon y restarted 2024-05-09T00:02:59.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:58 smithi171 ceph-mon[47351]: Standby manager daemon y started 2024-05-09T00:02:59.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:58 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.150:0/2447147190' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-09T00:02:59.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:58 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.150:0/2447147190' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:02:59.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:58 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.150:0/2447147190' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-09T00:02:59.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:58 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.150:0/2447147190' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:02:59.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:58 smithi171 ceph-mon[47351]: Standby manager daemon z restarted 2024-05-09T00:02:59.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:58 smithi171 ceph-mon[47351]: Standby manager daemon z started 2024-05-09T00:02:59.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:58 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.171:0/1131370806' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-09T00:02:59.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:58 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.171:0/1131370806' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-09T00:02:59.025 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:58 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.171:0/1131370806' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-09T00:02:59.026 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:58 smithi171 ceph-mon[47351]: from='mgr.? 172.21.15.171:0/1131370806' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-09T00:02:59.026 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:02:58 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z[49183]: 2024-05-09T00:02:58.632+0000 7f71d4fb1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T00:02:59.027 INFO:teuthology.orchestra.run.smithi081.stdout:client24922 2024-05-09T00:02:59.027 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-09T00:02:59.027 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:02:59.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:59.050 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:02:59.120 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:58 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:58.849+0000 7fd0b6cc8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-09T00:02:59.127 INFO:teuthology.orchestra.run.smithi081.stdout:client24922 2024-05-09T00:02:59.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:59.128 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-09T00:02:59.200 INFO:teuthology.orchestra.run.smithi081.stdout:client24922 2024-05-09T00:02:59.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:02:59.201 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968.client24922/status') 2024-05-09T00:02:59.282 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.24922 (3)172.21.15.81:0/3345962255 2024-05-09T00:02:59.282 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2024-05-09T00:02:59.282 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2024-05-09T00:02:59.282 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2024-05-09T00:02:59.282 INFO:teuthology.orchestra.run.smithi081.stderr:71 bytes copied, 2.4174e-05 s, 2.9 MB/s 2024-05-09T00:02:59.283 INFO:teuthology.run_tasks:Running task exec... 2024-05-09T00:02:59.399 INFO:teuthology.task.exec:Executing custom commands... 2024-05-09T00:02:59.399 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-05-09T00:02:59.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-05-09T00:02:59.424 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:59 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:59.143+0000 7fd0167d7700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:02:59.424 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:59 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:59.143+0000 7fd0167d7700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:02:59.424 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:59 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:59.143+0000 7fd0167d7700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:02:59.424 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:59 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:59.143+0000 7fd0167d7700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:02:59.424 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:59 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:59.143+0000 7fd0167d7700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:02:59.425 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:59 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:59.144+0000 7fd0187db700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:02:59.425 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:59 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:59.144+0000 7fd0187db700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:02:59.425 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:59 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:59.144+0000 7fd0187db700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:02:59.425 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:59 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:59.144+0000 7fd0187db700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:02:59.425 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:02:59 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:02:59.144+0000 7fd0187db700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:02:59.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.542+0000 7f263369d700 1 -- 172.21.15.81:0/4066134354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c100f90 msgr2=0x7f262c101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.542+0000 7f263369d700 1 --2- 172.21.15.81:0/4066134354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c100f90 0x7f262c101410 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f261c009990 tx=0x7f261c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:02:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.542+0000 7f263369d700 1 -- 172.21.15.81:0/4066134354 shutdown_connections 2024-05-09T00:02:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.542+0000 7f263369d700 1 --2- 172.21.15.81:0/4066134354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f262c0ffe40 0x7f262c100260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.542+0000 7f263369d700 1 --2- 172.21.15.81:0/4066134354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f262c101950 0x7f262c108270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.542+0000 7f263369d700 1 --2- 172.21.15.81:0/4066134354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c100f90 0x7f262c101410 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.542+0000 7f263369d700 1 -- 172.21.15.81:0/4066134354 >> 172.21.15.81:0/4066134354 conn(0x7f262c0fb3b0 msgr2=0x7f262c0fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:02:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.543+0000 7f263369d700 1 -- 172.21.15.81:0/4066134354 shutdown_connections 2024-05-09T00:02:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.543+0000 7f263369d700 1 -- 172.21.15.81:0/4066134354 wait complete. 2024-05-09T00:02:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.543+0000 7f263369d700 1 Processor -- start 2024-05-09T00:02:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.543+0000 7f263369d700 1 -- start start 2024-05-09T00:02:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.543+0000 7f263369d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f262c0ffe40 0x7f262c069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:59.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.543+0000 7f263369d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c100f90 0x7f262c19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.543+0000 7f263369d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f262c101950 0x7f262c19e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.543+0000 7f263369d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c19e980 con 0x7f262c100f90 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.543+0000 7f263369d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c19eaf0 con 0x7f262c0ffe40 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.543+0000 7f263369d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262c19ecb0 con 0x7f262c101950 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f2630c38700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c100f90 0x7f262c19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f2630c38700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c100f90 0x7f262c19bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57944/0 (socket says 172.21.15.81:57944) 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f2630c38700 1 -- 172.21.15.81:0/1331530076 learned_addr learned my addr 172.21.15.81:0/1331530076 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f2631439700 1 --2- 172.21.15.81:0/1331530076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f262c0ffe40 0x7f262c069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f2631c3a700 1 --2- 172.21.15.81:0/1331530076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f262c101950 0x7f262c19e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f2630c38700 1 -- 172.21.15.81:0/1331530076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f262c101950 msgr2=0x7f262c19e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f2630c38700 1 --2- 172.21.15.81:0/1331530076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f262c101950 0x7f262c19e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f2630c38700 1 -- 172.21.15.81:0/1331530076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f262c0ffe40 msgr2=0x7f262c069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f2630c38700 1 --2- 172.21.15.81:0/1331530076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f262c0ffe40 0x7f262c069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f2630c38700 1 -- 172.21.15.81:0/1331530076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0095f0 con 0x7f262c100f90 2024-05-09T00:02:59.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f2630c38700 1 --2- 172.21.15.81:0/1331530076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c100f90 0x7f262c19bb90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f261c00b2e0 tx=0x7f261c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:02:59.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f26227fc700 1 -- 172.21.15.81:0/1331530076 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c01d070 con 0x7f262c100f90 2024-05-09T00:02:59.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f26227fc700 1 -- 172.21.15.81:0/1331530076 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f261c022470 con 0x7f262c100f90 2024-05-09T00:02:59.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f263369d700 1 -- 172.21.15.81:0/1331530076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262c19ef30 con 0x7f262c100f90 2024-05-09T00:02:59.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f26227fc700 1 -- 172.21.15.81:0/1331530076 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f261c017650 con 0x7f262c100f90 2024-05-09T00:02:59.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.544+0000 7f263369d700 1 -- 172.21.15.81:0/1331530076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262c19f2f0 con 0x7f262c100f90 2024-05-09T00:02:59.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.546+0000 7f263369d700 1 -- 172.21.15.81:0/1331530076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f262c107300 con 0x7f262c100f90 2024-05-09T00:02:59.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.547+0000 7f26227fc700 1 -- 172.21.15.81:0/1331530076 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) v1 ==== 135558+0+0 (secure 0 0 0) 0x7f261c0225e0 con 0x7f262c100f90 2024-05-09T00:02:59.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.548+0000 7f26227fc700 1 -- 172.21.15.81:0/1331530076 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f261c0cda80 con 0x7f262c100f90 2024-05-09T00:02:59.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.553+0000 7f26227fc700 1 -- 172.21.15.81:0/1331530076 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f261c0976a0 con 0x7f262c100f90 2024-05-09T00:02:59.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.847+0000 7f263369d700 1 -- 172.21.15.81:0/1331530076 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) v1 -- 0x7f262c0675a0 con 0x7f262c100f90 2024-05-09T00:02:59.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: mgrmap e19: x(active, since 6m), standbys: y, z 2024-05-09T00:02:59.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: Active manager daemon x restarted 2024-05-09T00:02:59.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: Activating manager daemon x 2024-05-09T00:02:59.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: osdmap e82: 12 total, 12 up, 12 in 2024-05-09T00:02:59.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: mgrmap e20: x(active, starting, since 0.0149017s), standbys: y, z 2024-05-09T00:02:59.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:02:59.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:02:59.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:02:59.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-09T00:02:59.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-09T00:02:59.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T00:02:59.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T00:02:59.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T00:02:59.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T00:02:59.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T00:02:59.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T00:02:59.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:02:59.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T00:02:59.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T00:02:59.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T00:02:59.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-09T00:02:59.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-09T00:02:59.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-09T00:02:59.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:02:59.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:02:59.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:02:59.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:02:59.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:02:59.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:02:59.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:02:59.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:02:59.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:02:59.875 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:02:59.875 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:02:59.875 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:02:59.875 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T00:02:59.875 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T00:02:59.875 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T00:02:59.875 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: Manager daemon x is now available 2024-05-09T00:02:59.875 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:02:59.875 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:02:59.875 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:02:59.875 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-09T00:02:59.875 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:02:59 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-09T00:02:59.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.879+0000 7f26227fc700 1 -- 172.21.15.81:0/1331530076 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 21) v1 ==== 135685+0+0 (secure 0 0 0) 0x7f261c097150 con 0x7f262c100f90 2024-05-09T00:02:59.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.880+0000 7f26227fc700 1 --2- 172.21.15.81:0/1331530076 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f26180a7ec0 0x7f26180aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:02:59.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.882+0000 7f2631439700 1 --2- 172.21.15.81:0/1331530076 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f26180a7ec0 0x7f26180aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:02:59.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:02:59.886+0000 7f2631439700 1 --2- 172.21.15.81:0/1331530076 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f26180a7ec0 0x7f26180aa2b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2628009c60 tx=0x7f2628009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:00.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: mgrmap e19: x(active, since 6m), standbys: y, z 2024-05-09T00:03:00.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: Active manager daemon x restarted 2024-05-09T00:03:00.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: Activating manager daemon x 2024-05-09T00:03:00.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: osdmap e82: 12 total, 12 up, 12 in 2024-05-09T00:03:00.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: mgrmap e20: x(active, starting, since 0.0149017s), standbys: y, z 2024-05-09T00:03:00.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:03:00.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:03:00.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:03:00.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-09T00:03:00.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-09T00:03:00.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T00:03:00.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T00:03:00.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T00:03:00.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T00:03:00.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T00:03:00.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T00:03:00.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:03:00.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T00:03:00.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T00:03:00.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T00:03:00.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-09T00:03:00.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-09T00:03:00.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-09T00:03:00.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:03:00.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:03:00.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:03:00.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:03:00.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:03:00.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:03:00.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:03:00.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:03:00.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:03:00.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:03:00.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:03:00.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:03:00.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T00:03:00.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T00:03:00.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T00:03:00.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: Manager daemon x is now available 2024-05-09T00:03:00.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:03:00.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:03:00.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:03:00.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-09T00:03:00.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:02:59 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-09T00:03:00.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: mgrmap e19: x(active, since 6m), standbys: y, z 2024-05-09T00:03:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: Active manager daemon x restarted 2024-05-09T00:03:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: Activating manager daemon x 2024-05-09T00:03:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: osdmap e82: 12 total, 12 up, 12 in 2024-05-09T00:03:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: mgrmap e20: x(active, starting, since 0.0149017s), standbys: y, z 2024-05-09T00:03:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:03:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:03:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:03:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-09T00:03:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-09T00:03:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-09T00:03:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-09T00:03:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-09T00:03:00.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-09T00:03:00.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T00:03:00.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T00:03:00.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:03:00.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T00:03:00.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T00:03:00.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T00:03:00.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-09T00:03:00.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-09T00:03:00.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-09T00:03:00.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-09T00:03:00.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-09T00:03:00.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-09T00:03:00.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-09T00:03:00.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-09T00:03:00.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-09T00:03:00.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-09T00:03:00.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-09T00:03:00.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-09T00:03:00.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-09T00:03:00.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-09T00:03:00.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-09T00:03:00.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-09T00:03:00.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-09T00:03:00.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-09T00:03:00.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: Manager daemon x is now available 2024-05-09T00:03:00.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:03:00.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:03:00.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-09T00:03:00.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-09T00:03:00.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:02:59 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-09T00:03:00.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.685+0000 7f26227fc700 1 -- 172.21.15.81:0/1331530076 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f261c0bffd0 con 0x7f262c100f90 2024-05-09T00:03:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.688+0000 7f263369d700 1 -- 172.21.15.81:0/1331530076 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f26180a7ec0 msgr2=0x7f26180aa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.688+0000 7f263369d700 1 --2- 172.21.15.81:0/1331530076 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f26180a7ec0 0x7f26180aa2b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2628009c60 tx=0x7f2628009260 comp rx=0 tx=0).stop 2024-05-09T00:03:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.688+0000 7f263369d700 1 -- 172.21.15.81:0/1331530076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c100f90 msgr2=0x7f262c19bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.688+0000 7f263369d700 1 --2- 172.21.15.81:0/1331530076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c100f90 0x7f262c19bb90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f261c00b2e0 tx=0x7f261c005740 comp rx=0 tx=0).stop 2024-05-09T00:03:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.688+0000 7f263369d700 1 -- 172.21.15.81:0/1331530076 shutdown_connections 2024-05-09T00:03:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.688+0000 7f263369d700 1 --2- 172.21.15.81:0/1331530076 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f26180a7ec0 0x7f26180aa2b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.688+0000 7f263369d700 1 --2- 172.21.15.81:0/1331530076 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f262c0ffe40 0x7f262c069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.688+0000 7f263369d700 1 --2- 172.21.15.81:0/1331530076 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f262c101950 0x7f262c19e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.688+0000 7f263369d700 1 --2- 172.21.15.81:0/1331530076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f262c100f90 0x7f262c19bb90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.688+0000 7f263369d700 1 -- 172.21.15.81:0/1331530076 >> 172.21.15.81:0/1331530076 conn(0x7f262c0fb3b0 msgr2=0x7f262c104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.688+0000 7f263369d700 1 -- 172.21.15.81:0/1331530076 shutdown_connections 2024-05-09T00:03:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.688+0000 7f263369d700 1 -- 172.21.15.81:0/1331530076 wait complete. 2024-05-09T00:03:00.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-05-09T00:03:00.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.876+0000 7fe12f9e9700 1 -- 172.21.15.81:0/4103423451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe128074f80 msgr2=0x7fe1280733d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:00.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.876+0000 7fe12f9e9700 1 --2- 172.21.15.81:0/4103423451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe128074f80 0x7fe1280733d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe124009990 tx=0x7fe124009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:00.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.876+0000 7fe12f9e9700 1 -- 172.21.15.81:0/4103423451 shutdown_connections 2024-05-09T00:03:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.876+0000 7fe12f9e9700 1 --2- 172.21.15.81:0/4103423451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe128108df0 0x7fe12810b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.876+0000 7fe12f9e9700 1 --2- 172.21.15.81:0/4103423451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe128074f80 0x7fe1280733d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.876+0000 7fe12f9e9700 1 --2- 172.21.15.81:0/4103423451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1280739a0 0x7fe128073e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.876+0000 7fe12f9e9700 1 -- 172.21.15.81:0/4103423451 >> 172.21.15.81:0/4103423451 conn(0x7fe1280fc490 msgr2=0x7fe1280fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.876+0000 7fe12f9e9700 1 -- 172.21.15.81:0/4103423451 shutdown_connections 2024-05-09T00:03:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.876+0000 7fe12f9e9700 1 -- 172.21.15.81:0/4103423451 wait complete. 2024-05-09T00:03:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.876+0000 7fe12f9e9700 1 Processor -- start 2024-05-09T00:03:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.876+0000 7fe12f9e9700 1 -- start start 2024-05-09T00:03:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12f9e9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1280739a0 0x7fe1281990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12f9e9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe128074f80 0x7fe128199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12f9e9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe128108df0 0x7fe1281a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12f9e9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1281a0bb0 con 0x7fe1280739a0 2024-05-09T00:03:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12f9e9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1281a0cf0 con 0x7fe128108df0 2024-05-09T00:03:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12f9e9700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1281a0e80 con 0x7fe128074f80 2024-05-09T00:03:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12d785700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1280739a0 0x7fe1281990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12d785700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1280739a0 0x7fe1281990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57966/0 (socket says 172.21.15.81:57966) 2024-05-09T00:03:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12d785700 1 -- 172.21.15.81:0/1515747619 learned_addr learned my addr 172.21.15.81:0/1515747619 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12cf84700 1 --2- 172.21.15.81:0/1515747619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe128074f80 0x7fe128199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12df86700 1 --2- 172.21.15.81:0/1515747619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe128108df0 0x7fe1281a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12d785700 1 -- 172.21.15.81:0/1515747619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe128074f80 msgr2=0x7fe128199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12d785700 1 --2- 172.21.15.81:0/1515747619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe128074f80 0x7fe128199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12d785700 1 -- 172.21.15.81:0/1515747619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe128108df0 msgr2=0x7fe1281a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12d785700 1 --2- 172.21.15.81:0/1515747619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe128108df0 0x7fe1281a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:00.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12d785700 1 -- 172.21.15.81:0/1515747619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1240095f0 con 0x7fe1280739a0 2024-05-09T00:03:00.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12d785700 1 --2- 172.21.15.81:0/1515747619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1280739a0 0x7fe1281990d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe12400b680 tx=0x7fe124009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:00.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe11e7fc700 1 -- 172.21.15.81:0/1515747619 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12401d070 con 0x7fe1280739a0 2024-05-09T00:03:00.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe11e7fc700 1 -- 172.21.15.81:0/1515747619 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe124022470 con 0x7fe1280739a0 2024-05-09T00:03:00.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.877+0000 7fe12f9e9700 1 -- 172.21.15.81:0/1515747619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1281a1100 con 0x7fe1280739a0 2024-05-09T00:03:00.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.878+0000 7fe11e7fc700 1 -- 172.21.15.81:0/1515747619 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe124017650 con 0x7fe1280739a0 2024-05-09T00:03:00.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.878+0000 7fe12f9e9700 1 -- 172.21.15.81:0/1515747619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1281a1520 con 0x7fe1280739a0 2024-05-09T00:03:00.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.878+0000 7fe12f9e9700 1 -- 172.21.15.81:0/1515747619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe128107c00 con 0x7fe1280739a0 2024-05-09T00:03:00.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.879+0000 7fe11e7fc700 1 -- 172.21.15.81:0/1515747619 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 21) v1 ==== 135685+0+0 (secure 0 0 0) 0x7fe1240225e0 con 0x7fe1280739a0 2024-05-09T00:03:00.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.880+0000 7fe11e7fc700 1 --2- 172.21.15.81:0/1515747619 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1140a0f20 0x7fe1140a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:00.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.880+0000 7fe11e7fc700 1 -- 172.21.15.81:0/1515747619 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fe1240cdeb0 con 0x7fe1280739a0 2024-05-09T00:03:00.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.880+0000 7fe12cf84700 1 --2- 172.21.15.81:0/1515747619 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1140a0f20 0x7fe1140a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:00.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.880+0000 7fe12cf84700 1 --2- 172.21.15.81:0/1515747619 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1140a0f20 0x7fe1140a33e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe118009c60 tx=0x7fe118009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:00.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:00.884+0000 7fe11e7fc700 1 -- 172.21.15.81:0/1515747619 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe1240978a0 con 0x7fe1280739a0 2024-05-09T00:03:01.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:00 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1331530076' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-09T00:03:01.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:00 smithi150 ceph-mon[46187]: mgrmap e21: x(active, since 1.01825s), standbys: y, z 2024-05-09T00:03:01.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:00 smithi150 ceph-mon[46187]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:03:01.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:00 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:00 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:00 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:00 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:00 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:00 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:00 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1331530076' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-09T00:03:01.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:00 smithi171 ceph-mon[47351]: mgrmap e21: x(active, since 1.01825s), standbys: y, z 2024-05-09T00:03:01.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:00 smithi171 ceph-mon[47351]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:03:01.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:00 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:00 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:00 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:00 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:00 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:00 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:00 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1331530076' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-09T00:03:01.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:00 smithi081 ceph-mon[42474]: mgrmap e21: x(active, since 1.01825s), standbys: y, z 2024-05-09T00:03:01.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:00 smithi081 ceph-mon[42474]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:03:01.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:00 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:00 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:00 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:00 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:00 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:00 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.132+0000 7fe12f9e9700 1 -- 172.21.15.81:0/1515747619 --> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) v1 -- 0x7fe128061480 con 0x7fe1140a0f20 2024-05-09T00:03:01.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.148+0000 7fe11e7fc700 1 -- 172.21.15.81:0/1515747619 <== mgr.15285 v2:172.21.15.81:6800/2111088526 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7fe128061480 con 0x7fe1140a0f20 2024-05-09T00:03:01.142 INFO:teuthology.orchestra.run.smithi081.stdout:{} 2024-05-09T00:03:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.150+0000 7fe12f9e9700 1 -- 172.21.15.81:0/1515747619 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1140a0f20 msgr2=0x7fe1140a33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.150+0000 7fe12f9e9700 1 --2- 172.21.15.81:0/1515747619 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1140a0f20 0x7fe1140a33e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe118009c60 tx=0x7fe118009260 comp rx=0 tx=0).stop 2024-05-09T00:03:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.150+0000 7fe12f9e9700 1 -- 172.21.15.81:0/1515747619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1280739a0 msgr2=0x7fe1281990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.150+0000 7fe12f9e9700 1 --2- 172.21.15.81:0/1515747619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1280739a0 0x7fe1281990d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe12400b680 tx=0x7fe124009580 comp rx=0 tx=0).stop 2024-05-09T00:03:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.150+0000 7fe12f9e9700 1 -- 172.21.15.81:0/1515747619 shutdown_connections 2024-05-09T00:03:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.150+0000 7fe12f9e9700 1 --2- 172.21.15.81:0/1515747619 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1140a0f20 0x7fe1140a33e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.150+0000 7fe12f9e9700 1 --2- 172.21.15.81:0/1515747619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe128108df0 0x7fe1281a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.150+0000 7fe12f9e9700 1 --2- 172.21.15.81:0/1515747619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1280739a0 0x7fe1281990d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.150+0000 7fe12f9e9700 1 --2- 172.21.15.81:0/1515747619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe128074f80 0x7fe128199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.150+0000 7fe12f9e9700 1 -- 172.21.15.81:0/1515747619 >> 172.21.15.81:0/1515747619 conn(0x7fe1280fc490 msgr2=0x7fe128104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.150+0000 7fe12f9e9700 1 -- 172.21.15.81:0/1515747619 shutdown_connections 2024-05-09T00:03:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.150+0000 7fe12f9e9700 1 -- 172.21.15.81:0/1515747619 wait complete. 2024-05-09T00:03:01.158 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-09T00:03:01.247 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-05-09T00:03:01.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:03:01.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.429+0000 7efd923e7700 1 -- 172.21.15.81:0/839333973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c106b40 msgr2=0x7efd8c108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:01.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.429+0000 7efd923e7700 1 --2- 172.21.15.81:0/839333973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c106b40 0x7efd8c108fb0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efd8400b0a0 tx=0x7efd8400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.429+0000 7efd923e7700 1 -- 172.21.15.81:0/839333973 shutdown_connections 2024-05-09T00:03:01.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.429+0000 7efd923e7700 1 --2- 172.21.15.81:0/839333973 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd8c1018e0 0x7efd8c103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.429+0000 7efd923e7700 1 --2- 172.21.15.81:0/839333973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c106b40 0x7efd8c108fb0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.429+0000 7efd923e7700 1 --2- 172.21.15.81:0/839333973 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd8c104210 0x7efd8c106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.429+0000 7efd923e7700 1 -- 172.21.15.81:0/839333973 >> 172.21.15.81:0/839333973 conn(0x7efd8c0fb2f0 msgr2=0x7efd8c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:01.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.429+0000 7efd923e7700 1 -- 172.21.15.81:0/839333973 shutdown_connections 2024-05-09T00:03:01.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.429+0000 7efd923e7700 1 -- 172.21.15.81:0/839333973 wait complete. 2024-05-09T00:03:01.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.430+0000 7efd923e7700 1 Processor -- start 2024-05-09T00:03:01.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.430+0000 7efd923e7700 1 -- start start 2024-05-09T00:03:01.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd923e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c1018e0 0x7efd8c196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:01.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd923e7700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd8c104210 0x7efd8c1973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:01.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd923e7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd8c106b40 0x7efd8c19e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:01.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd923e7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c19e990 con 0x7efd8c1018e0 2024-05-09T00:03:01.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd923e7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c19ead0 con 0x7efd8c106b40 2024-05-09T00:03:01.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd923e7700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd8c19ec60 con 0x7efd8c104210 2024-05-09T00:03:01.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd90984700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd8c106b40 0x7efd8c19e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:01.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd90984700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd8c106b40 0x7efd8c19e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.81:40688/0 (socket says 172.21.15.81:40688) 2024-05-09T00:03:01.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd8b7fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd8c104210 0x7efd8c1973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd90984700 1 -- 172.21.15.81:0/3007211082 learned_addr learned my addr 172.21.15.81:0/3007211082 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd90984700 1 -- 172.21.15.81:0/3007211082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd8c104210 msgr2=0x7efd8c1973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd90984700 1 --2- 172.21.15.81:0/3007211082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd8c104210 0x7efd8c1973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd90984700 1 -- 172.21.15.81:0/3007211082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c1018e0 msgr2=0x7efd8c196e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd90984700 1 --2- 172.21.15.81:0/3007211082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c1018e0 0x7efd8c196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd90984700 1 -- 172.21.15.81:0/3007211082 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd84009d00 con 0x7efd8c106b40 2024-05-09T00:03:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd8b7fe700 1 --2- 172.21.15.81:0/3007211082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd8c104210 0x7efd8c1973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:03:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd90984700 1 --2- 172.21.15.81:0/3007211082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd8c106b40 0x7efd8c19e3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efd84007a60 tx=0x7efd84007930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.431+0000 7efd897fa700 1 -- 172.21.15.81:0/3007211082 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd8400e040 con 0x7efd8c106b40 2024-05-09T00:03:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.432+0000 7efd923e7700 1 -- 172.21.15.81:0/3007211082 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd8c19eee0 con 0x7efd8c106b40 2024-05-09T00:03:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.432+0000 7efd897fa700 1 -- 172.21.15.81:0/3007211082 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd84004c50 con 0x7efd8c106b40 2024-05-09T00:03:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.432+0000 7efd897fa700 1 -- 172.21.15.81:0/3007211082 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840052a0 con 0x7efd8c106b40 2024-05-09T00:03:01.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.432+0000 7efd923e7700 1 -- 172.21.15.81:0/3007211082 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd8c19f310 con 0x7efd8c106b40 2024-05-09T00:03:01.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.432+0000 7efd923e7700 1 -- 172.21.15.81:0/3007211082 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8c0fce70 con 0x7efd8c106b40 2024-05-09T00:03:01.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.434+0000 7efd897fa700 1 -- 172.21.15.81:0/3007211082 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 21) v1 ==== 135685+0+0 (secure 0 0 0) 0x7efd84005610 con 0x7efd8c106b40 2024-05-09T00:03:01.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.434+0000 7efd897fa700 1 --2- 172.21.15.81:0/3007211082 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efd740a0f20 0x7efd740a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:01.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.434+0000 7efd8bfff700 1 --2- 172.21.15.81:0/3007211082 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efd740a0f20 0x7efd740a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:01.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.434+0000 7efd897fa700 1 -- 172.21.15.81:0/3007211082 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7efd840ce0e0 con 0x7efd8c106b40 2024-05-09T00:03:01.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.435+0000 7efd8bfff700 1 --2- 172.21.15.81:0/3007211082 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efd740a0f20 0x7efd740a33e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd7c005950 tx=0x7efd7c0058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:01.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.439+0000 7efd897fa700 1 -- 172.21.15.81:0/3007211082 <== mon.2 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efd84097ad0 con 0x7efd8c106b40 2024-05-09T00:03:01.536 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 09 00:03:01 smithi081 sudo[106653]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:01.536 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 09 00:03:01 smithi081 sudo[106653]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:01.536 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 09 00:03:01 smithi081 sudo[106653]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:01.536 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 09 00:03:01 smithi081 sudo[106653]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:01.536 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:03:01 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:03:01.137+0000 7fd0137d1700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:03:01.536 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:03:01 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:03:01.137+0000 7fd0137d1700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:03:01.536 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:03:01 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:03:01.137+0000 7fd0137d1700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:03:01.537 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:03:01 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:03:01.137+0000 7fd0137d1700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:03:01.537 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:03:01 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:03:01.137+0000 7fd0137d1700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:03:01.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.698+0000 7efd923e7700 1 -- 172.21.15.81:0/3007211082 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd8c10c690 con 0x7efd8c106b40 2024-05-09T00:03:01.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.699+0000 7efd897fa700 1 -- 172.21.15.81:0/3007211082 <== mon.2 v2:172.21.15.150:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+23003 (secure 0 0 0) 0x7efd8409b0f0 con 0x7efd8c106b40 2024-05-09T00:03:01.694 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:03:01.694 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:02:58.862731+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/907969237":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/589390516":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/1458411552":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1755507053":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/3633496844":"2024-05-10T00:02:58.862694+0000","172.21.15.81:6801/1458411552":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/1903231103":"2024-05-10T00:02:58.862694+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:03:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.702+0000 7efd923e7700 1 -- 172.21.15.81:0/3007211082 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efd740a0f20 msgr2=0x7efd740a33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.702+0000 7efd923e7700 1 --2- 172.21.15.81:0/3007211082 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efd740a0f20 0x7efd740a33e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd7c005950 tx=0x7efd7c0058e0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.702+0000 7efd923e7700 1 -- 172.21.15.81:0/3007211082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd8c106b40 msgr2=0x7efd8c19e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.702+0000 7efd923e7700 1 --2- 172.21.15.81:0/3007211082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd8c106b40 0x7efd8c19e3c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efd84007a60 tx=0x7efd84007930 comp rx=0 tx=0).stop 2024-05-09T00:03:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.702+0000 7efd923e7700 1 -- 172.21.15.81:0/3007211082 shutdown_connections 2024-05-09T00:03:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.702+0000 7efd923e7700 1 --2- 172.21.15.81:0/3007211082 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efd740a0f20 0x7efd740a33e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.702+0000 7efd923e7700 1 --2- 172.21.15.81:0/3007211082 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efd8c106b40 0x7efd8c19e3c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.702+0000 7efd923e7700 1 --2- 172.21.15.81:0/3007211082 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8c1018e0 0x7efd8c196e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.702+0000 7efd923e7700 1 --2- 172.21.15.81:0/3007211082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd8c104210 0x7efd8c1973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.702+0000 7efd923e7700 1 -- 172.21.15.81:0/3007211082 >> 172.21.15.81:0/3007211082 conn(0x7efd8c0fb2f0 msgr2=0x7efd8c102240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.702+0000 7efd923e7700 1 -- 172.21.15.81:0/3007211082 shutdown_connections 2024-05-09T00:03:01.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.702+0000 7efd923e7700 1 -- 172.21.15.81:0/3007211082 wait complete. 2024-05-09T00:03:01.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:58:34.523249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T00:01:43.149260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T00:01:44.182730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:03:01.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:03:01.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.848+0000 7f65acfa5700 1 -- 172.21.15.81:0/3786423044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8104310 msgr2=0x7f65a8106700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:01.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.848+0000 7f65acfa5700 1 --2- 172.21.15.81:0/3786423044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8104310 0x7f65a8106700 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f659c009990 tx=0x7f659c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.848+0000 7f65acfa5700 1 -- 172.21.15.81:0/3786423044 shutdown_connections 2024-05-09T00:03:01.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.848+0000 7f65acfa5700 1 --2- 172.21.15.81:0/3786423044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65a8106c40 0x7f65a81090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.848+0000 7f65acfa5700 1 --2- 172.21.15.81:0/3786423044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65a81019e0 0x7f65a8103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.848+0000 7f65acfa5700 1 --2- 172.21.15.81:0/3786423044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8104310 0x7f65a8106700 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.848+0000 7f65acfa5700 1 -- 172.21.15.81:0/3786423044 >> 172.21.15.81:0/3786423044 conn(0x7f65a80fb3f0 msgr2=0x7f65a80fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:01.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.848+0000 7f65acfa5700 1 -- 172.21.15.81:0/3786423044 shutdown_connections 2024-05-09T00:03:01.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.848+0000 7f65acfa5700 1 -- 172.21.15.81:0/3786423044 wait complete. 2024-05-09T00:03:01.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.849+0000 7f65acfa5700 1 Processor -- start 2024-05-09T00:03:01.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.849+0000 7f65acfa5700 1 -- start start 2024-05-09T00:03:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.849+0000 7f65acfa5700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65a81019e0 0x7f65a8199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.849+0000 7f65acfa5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8104310 0x7f65a81995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.849+0000 7f65acfa5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65a8106c40 0x7f65a81a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.849+0000 7f65acfa5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a81a0bc0 con 0x7f65a8104310 2024-05-09T00:03:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.849+0000 7f65acfa5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a81a0d00 con 0x7f65a8106c40 2024-05-09T00:03:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.849+0000 7f65acfa5700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a81a0e90 con 0x7f65a81019e0 2024-05-09T00:03:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.849+0000 7f65a5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8104310 0x7f65a81995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.849+0000 7f65a5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8104310 0x7f65a81995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58034/0 (socket says 172.21.15.81:58034) 2024-05-09T00:03:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.849+0000 7f65a5d9b700 1 -- 172.21.15.81:0/1705614507 learned_addr learned my addr 172.21.15.81:0/1705614507 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.849+0000 7f65a659c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65a81019e0 0x7f65a8199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.850+0000 7f65a6d9d700 1 --2- 172.21.15.81:0/1705614507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65a8106c40 0x7f65a81a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.850+0000 7f65a5d9b700 1 -- 172.21.15.81:0/1705614507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65a81019e0 msgr2=0x7f65a8199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:01.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.850+0000 7f65a5d9b700 1 --2- 172.21.15.81:0/1705614507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65a81019e0 0x7f65a8199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.850+0000 7f65a5d9b700 1 -- 172.21.15.81:0/1705614507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65a8106c40 msgr2=0x7f65a81a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.850+0000 7f65a5d9b700 1 --2- 172.21.15.81:0/1705614507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65a8106c40 0x7f65a81a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.850+0000 7f65a5d9b700 1 -- 172.21.15.81:0/1705614507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c0095f0 con 0x7f65a8104310 2024-05-09T00:03:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.850+0000 7f65a659c700 1 --2- 172.21.15.81:0/1705614507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65a81019e0 0x7f65a8199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:03:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.850+0000 7f65a5d9b700 1 --2- 172.21.15.81:0/1705614507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8104310 0x7f65a81995d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f659c000c00 tx=0x7f659c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.850+0000 7f65977fe700 1 -- 172.21.15.81:0/1705614507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c01d070 con 0x7f65a8104310 2024-05-09T00:03:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.850+0000 7f65acfa5700 1 -- 172.21.15.81:0/1705614507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a81a1110 con 0x7f65a8104310 2024-05-09T00:03:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.850+0000 7f65977fe700 1 -- 172.21.15.81:0/1705614507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f659c0054f0 con 0x7f65a8104310 2024-05-09T00:03:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.850+0000 7f65977fe700 1 -- 172.21.15.81:0/1705614507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c004bd0 con 0x7f65a8104310 2024-05-09T00:03:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.850+0000 7f65acfa5700 1 -- 172.21.15.81:0/1705614507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a81a1530 con 0x7f65a8104310 2024-05-09T00:03:01.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.852+0000 7f65acfa5700 1 -- 172.21.15.81:0/1705614507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a8108810 con 0x7f65a8104310 2024-05-09T00:03:01.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.853+0000 7f65977fe700 1 -- 172.21.15.81:0/1705614507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 21) v1 ==== 135685+0+0 (secure 0 0 0) 0x7f659c00fb90 con 0x7f65a8104310 2024-05-09T00:03:01.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.854+0000 7f65977fe700 1 --2- 172.21.15.81:0/1705614507 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f65900a0f20 0x7f65900a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:01.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.854+0000 7f65a659c700 1 --2- 172.21.15.81:0/1705614507 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f65900a0f20 0x7f65900a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:01.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.854+0000 7f65977fe700 1 -- 172.21.15.81:0/1705614507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f659c0cd770 con 0x7f65a8104310 2024-05-09T00:03:01.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.854+0000 7f65a659c700 1 --2- 172.21.15.81:0/1705614507 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f65900a0f20 0x7f65900a33e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6598005950 tx=0x7f659800b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:01.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.859+0000 7f65977fe700 1 -- 172.21.15.81:0/1705614507 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f659c097160 con 0x7f65a8104310 2024-05-09T00:03:01.869 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 09 00:03:01 smithi081 sudo[106912]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:01.869 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 09 00:03:01 smithi081 sudo[106912]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:01.869 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 09 00:03:01 smithi081 sudo[106912]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:01.869 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 09 00:03:01 smithi081 sudo[106912]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:01.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: [09/May/2024:00:03:00] ENGINE Bus STARTING 2024-05-09T00:03:01.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: [09/May/2024:00:03:00] ENGINE Serving on https://172.21.15.81:7150 2024-05-09T00:03:01.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1331530076' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-09T00:03:01.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T00:03:01.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: [09/May/2024:00:03:00] ENGINE Serving on http://172.21.15.81:8765 2024-05-09T00:03:01.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: [09/May/2024:00:03:00] ENGINE Bus STARTED 2024-05-09T00:03:01.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-05-09T00:03:01.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: Cluster is now healthy 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:01.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:03:01.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:03:01.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:01 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:01.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:01.887+0000 7f65977fe700 1 -- 172.21.15.81:0/1705614507 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 22) v1 ==== 135993+0+0 (secure 0 0 0) 0x7f659c097530 con 0x7f65a8104310 2024-05-09T00:03:02.014 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 09 00:03:01 smithi150 sudo[83922]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:02.014 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 09 00:03:01 smithi150 sudo[83922]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:02.014 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 09 00:03:01 smithi150 sudo[83922]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:02.014 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 09 00:03:01 smithi150 sudo[83922]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:02.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: [09/May/2024:00:03:00] ENGINE Bus STARTING 2024-05-09T00:03:02.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: [09/May/2024:00:03:00] ENGINE Serving on https://172.21.15.81:7150 2024-05-09T00:03:02.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1331530076' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-09T00:03:02.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T00:03:02.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: [09/May/2024:00:03:00] ENGINE Serving on http://172.21.15.81:8765 2024-05-09T00:03:02.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: [09/May/2024:00:03:00] ENGINE Bus STARTED 2024-05-09T00:03:02.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-05-09T00:03:02.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: Cluster is now healthy 2024-05-09T00:03:02.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:03:02.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:03:02.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:03:02.018 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:01 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: [09/May/2024:00:03:00] ENGINE Bus STARTING 2024-05-09T00:03:02.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: [09/May/2024:00:03:00] ENGINE Serving on https://172.21.15.81:7150 2024-05-09T00:03:02.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1331530076' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-09T00:03:02.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T00:03:02.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: [09/May/2024:00:03:00] ENGINE Serving on http://172.21.15.81:8765 2024-05-09T00:03:02.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: [09/May/2024:00:03:00] ENGINE Bus STARTED 2024-05-09T00:03:02.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-05-09T00:03:02.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: Cluster is now healthy 2024-05-09T00:03:02.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:03:02.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:03:02.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:03:02.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:03:02.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:01 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.127+0000 7f65acfa5700 1 -- 172.21.15.81:0/1705614507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65a8067cf0 con 0x7f65a8104310 2024-05-09T00:03:02.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.127+0000 7f65977fe700 1 -- 172.21.15.81:0/1705614507 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f659c0ab030 con 0x7f65a8104310 2024-05-09T00:03:02.121 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-09T00:03:02.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.129+0000 7f65acfa5700 1 -- 172.21.15.81:0/1705614507 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f65900a0f20 msgr2=0x7f65900a33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:02.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.129+0000 7f65acfa5700 1 --2- 172.21.15.81:0/1705614507 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f65900a0f20 0x7f65900a33e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6598005950 tx=0x7f659800b410 comp rx=0 tx=0).stop 2024-05-09T00:03:02.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.129+0000 7f65acfa5700 1 -- 172.21.15.81:0/1705614507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8104310 msgr2=0x7f65a81995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:02.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.129+0000 7f65acfa5700 1 --2- 172.21.15.81:0/1705614507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8104310 0x7f65a81995d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f659c000c00 tx=0x7f659c004730 comp rx=0 tx=0).stop 2024-05-09T00:03:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.129+0000 7f65acfa5700 1 -- 172.21.15.81:0/1705614507 shutdown_connections 2024-05-09T00:03:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.129+0000 7f65acfa5700 1 --2- 172.21.15.81:0/1705614507 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f65900a0f20 0x7f65900a33e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.129+0000 7f65acfa5700 1 --2- 172.21.15.81:0/1705614507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f65a8106c40 0x7f65a81a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.129+0000 7f65acfa5700 1 --2- 172.21.15.81:0/1705614507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f65a81019e0 0x7f65a8199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.129+0000 7f65acfa5700 1 --2- 172.21.15.81:0/1705614507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a8104310 0x7f65a81995d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.129+0000 7f65acfa5700 1 -- 172.21.15.81:0/1705614507 >> 172.21.15.81:0/1705614507 conn(0x7f65a80fb3f0 msgr2=0x7f65a8101200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.129+0000 7f65acfa5700 1 -- 172.21.15.81:0/1705614507 shutdown_connections 2024-05-09T00:03:02.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.129+0000 7f65acfa5700 1 -- 172.21.15.81:0/1705614507 wait complete. 2024-05-09T00:03:02.138 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T00:03:02.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.299+0000 7f3bf039d700 1 -- 172.21.15.81:0/146978160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8105ef0 msgr2=0x7f3be81062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:02.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.299+0000 7f3bf039d700 1 --2- 172.21.15.81:0/146978160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8105ef0 0x7f3be81062d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009990 tx=0x7f3be4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.299+0000 7f3bf039d700 1 -- 172.21.15.81:0/146978160 shutdown_connections 2024-05-09T00:03:02.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.299+0000 7f3bf039d700 1 --2- 172.21.15.81:0/146978160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3be80ffdd0 0x7f3be810dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.299+0000 7f3bf039d700 1 --2- 172.21.15.81:0/146978160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8105ef0 0x7f3be81062d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.299+0000 7f3bf039d700 1 --2- 172.21.15.81:0/146978160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3be80ff410 0x7f3be80ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.299+0000 7f3bf039d700 1 -- 172.21.15.81:0/146978160 >> 172.21.15.81:0/146978160 conn(0x7f3be80763a0 msgr2=0x7f3be80fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:02.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.299+0000 7f3bf039d700 1 -- 172.21.15.81:0/146978160 shutdown_connections 2024-05-09T00:03:02.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.300+0000 7f3bf039d700 1 -- 172.21.15.81:0/146978160 wait complete. 2024-05-09T00:03:02.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.300+0000 7f3bf039d700 1 Processor -- start 2024-05-09T00:03:02.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.300+0000 7f3bf039d700 1 -- start start 2024-05-09T00:03:02.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.300+0000 7f3bf039d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3be80ff410 0x7f3be8197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:02.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.300+0000 7f3bf039d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3be80ffdd0 0x7f3be81979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:02.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bf039d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8105ef0 0x7f3be819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:02.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bf039d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be819c380 con 0x7f3be8105ef0 2024-05-09T00:03:02.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bf039d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be819c4f0 con 0x7f3be80ffdd0 2024-05-09T00:03:02.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bf039d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be819c6b0 con 0x7f3be80ff410 2024-05-09T00:03:02.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bee139700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3be80ff410 0x7f3be8197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:02.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bee93a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8105ef0 0x7f3be819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:02.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bee139700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3be80ff410 0x7f3be8197460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:42532/0 (socket says 172.21.15.81:42532) 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bee139700 1 -- 172.21.15.81:0/2977228224 learned_addr learned my addr 172.21.15.81:0/2977228224 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bed938700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3be80ffdd0 0x7f3be81979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bee93a700 1 -- 172.21.15.81:0/2977228224 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3be80ff410 msgr2=0x7f3be8197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bee93a700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3be80ff410 0x7f3be8197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bee93a700 1 -- 172.21.15.81:0/2977228224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3be80ffdd0 msgr2=0x7f3be81979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bee93a700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3be80ffdd0 0x7f3be81979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bee93a700 1 -- 172.21.15.81:0/2977228224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be40095f0 con 0x7f3be8105ef0 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bee139700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3be80ff410 0x7f3be8197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bed938700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3be80ffdd0 0x7f3be81979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bee93a700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8105ef0 0x7f3be819bd40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3be000b330 tx=0x7f3be000b640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.301+0000 7f3bdf7fe700 1 -- 172.21.15.81:0/2977228224 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0015070 con 0x7f3be8105ef0 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.302+0000 7f3bdf7fe700 1 -- 172.21.15.81:0/2977228224 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3be000bdd0 con 0x7f3be8105ef0 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.302+0000 7f3bf039d700 1 -- 172.21.15.81:0/2977228224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be819c930 con 0x7f3be8105ef0 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.302+0000 7f3bdf7fe700 1 -- 172.21.15.81:0/2977228224 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0007c20 con 0x7f3be8105ef0 2024-05-09T00:03:02.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.302+0000 7f3bf039d700 1 -- 172.21.15.81:0/2977228224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be8100700 con 0x7f3be8105ef0 2024-05-09T00:03:02.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.303+0000 7f3bf039d700 1 -- 172.21.15.81:0/2977228224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be8109460 con 0x7f3be8105ef0 2024-05-09T00:03:02.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.304+0000 7f3bdf7fe700 1 -- 172.21.15.81:0/2977228224 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) v1 ==== 135993+0+0 (secure 0 0 0) 0x7f3be0007500 con 0x7f3be8105ef0 2024-05-09T00:03:02.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.304+0000 7f3bdf7fe700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3bd40a1310 0x7f3bd40a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:02.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.304+0000 7f3bdf7fe700 1 -- 172.21.15.81:0/2977228224 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f3be00d0b90 con 0x7f3be8105ef0 2024-05-09T00:03:02.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.304+0000 7f3bee139700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3bd40a1310 0x7f3bd40a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:02.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.305+0000 7f3bee139700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3bd40a1310 0x7f3bd40a37d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3be4006010 tx=0x7f3be400b280 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:02.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.309+0000 7f3bdf7fe700 1 -- 172.21.15.81:0/2977228224 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3be0099fe0 con 0x7f3be8105ef0 2024-05-09T00:03:02.514 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 09 00:03:02 smithi150 sudo[84084]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:02.514 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 09 00:03:02 smithi150 sudo[84084]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:02.514 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 09 00:03:02 smithi150 sudo[84084]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:02.514 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 09 00:03:02 smithi150 sudo[84084]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.533+0000 7f3bf039d700 1 -- 172.21.15.81:0/2977228224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3be8198760 con 0x7f3be8105ef0 2024-05-09T00:03:02.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.534+0000 7f3bdf7fe700 1 -- 172.21.15.81:0/2977228224 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3be009d600 con 0x7f3be8105ef0 2024-05-09T00:03:02.528 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-09T00:03:02.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.536+0000 7f3bf039d700 1 -- 172.21.15.81:0/2977228224 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3bd40a1310 msgr2=0x7f3bd40a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:02.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.536+0000 7f3bf039d700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3bd40a1310 0x7f3bd40a37d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3be4006010 tx=0x7f3be400b280 comp rx=0 tx=0).stop 2024-05-09T00:03:02.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.536+0000 7f3bf039d700 1 -- 172.21.15.81:0/2977228224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8105ef0 msgr2=0x7f3be819bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:02.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.536+0000 7f3bf039d700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8105ef0 0x7f3be819bd40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3be000b330 tx=0x7f3be000b640 comp rx=0 tx=0).stop 2024-05-09T00:03:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.536+0000 7f3bf039d700 1 -- 172.21.15.81:0/2977228224 shutdown_connections 2024-05-09T00:03:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.536+0000 7f3bf039d700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3bd40a1310 0x7f3bd40a37d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.536+0000 7f3bf039d700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3be8105ef0 0x7f3be819bd40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.536+0000 7f3bf039d700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3be80ff410 0x7f3be8197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.536+0000 7f3bf039d700 1 --2- 172.21.15.81:0/2977228224 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3be80ffdd0 0x7f3be81979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.536+0000 7f3bf039d700 1 -- 172.21.15.81:0/2977228224 >> 172.21.15.81:0/2977228224 conn(0x7f3be80763a0 msgr2=0x7f3be8104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.536+0000 7f3bf039d700 1 -- 172.21.15.81:0/2977228224 shutdown_connections 2024-05-09T00:03:02.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.536+0000 7f3bf039d700 1 -- 172.21.15.81:0/2977228224 wait complete. 2024-05-09T00:03:02.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T00:03:02.615 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 09 00:03:02 smithi171 sudo[87114]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:02.615 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 09 00:03:02 smithi171 sudo[87114]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:02.615 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 09 00:03:02 smithi171 sudo[87114]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:02.616 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 09 00:03:02 smithi171 sudo[87114]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:02.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.679+0000 7f1eb9b25700 1 -- 172.21.15.81:0/3294251823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb40682e0 msgr2=0x7f1eb40686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.679+0000 7f1eb9b25700 1 --2- 172.21.15.81:0/3294251823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb40682e0 0x7f1eb40686c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40099c0 tx=0x7f1ea4009cd0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.679+0000 7f1eb9b25700 1 -- 172.21.15.81:0/3294251823 shutdown_connections 2024-05-09T00:03:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.679+0000 7f1eb9b25700 1 --2- 172.21.15.81:0/3294251823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1eb4106290 0x7f1eb410de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.679+0000 7f1eb9b25700 1 --2- 172.21.15.81:0/3294251823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb40682e0 0x7f1eb40686c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.679+0000 7f1eb9b25700 1 --2- 172.21.15.81:0/3294251823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eb4068c90 0x7f1eb4105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.679+0000 7f1eb9b25700 1 -- 172.21.15.81:0/3294251823 >> 172.21.15.81:0/3294251823 conn(0x7f1eb4076f40 msgr2=0x7f1eb4077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.679+0000 7f1eb9b25700 1 -- 172.21.15.81:0/3294251823 shutdown_connections 2024-05-09T00:03:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.679+0000 7f1eb9b25700 1 -- 172.21.15.81:0/3294251823 wait complete. 2024-05-09T00:03:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.680+0000 7f1eb9b25700 1 Processor -- start 2024-05-09T00:03:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.680+0000 7f1eb9b25700 1 -- start start 2024-05-09T00:03:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.680+0000 7f1eb9b25700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1eb40682e0 0x7f1eb40ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.680+0000 7f1eb9b25700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb4106290 0x7f1eb41003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.680+0000 7f1eb9b25700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eb41008e0 0x7f1eb41a5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.680+0000 7f1eb9b25700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb41a5c30 con 0x7f1eb4106290 2024-05-09T00:03:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.680+0000 7f1eb9b25700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb41a5da0 con 0x7f1eb41008e0 2024-05-09T00:03:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.680+0000 7f1eb9b25700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb41a5f60 con 0x7f1eb40682e0 2024-05-09T00:03:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb4106290 0x7f1eb41003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb4106290 0x7f1eb41003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58062/0 (socket says 172.21.15.81:58062) 2024-05-09T00:03:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb2ffd700 1 -- 172.21.15.81:0/2238164806 learned_addr learned my addr 172.21.15.81:0/2238164806 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb37fe700 1 --2- 172.21.15.81:0/2238164806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1eb40682e0 0x7f1eb40ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb3fff700 1 --2- 172.21.15.81:0/2238164806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eb41008e0 0x7f1eb41a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb2ffd700 1 -- 172.21.15.81:0/2238164806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1eb40682e0 msgr2=0x7f1eb40ffe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb2ffd700 1 --2- 172.21.15.81:0/2238164806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1eb40682e0 0x7f1eb40ffe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb2ffd700 1 -- 172.21.15.81:0/2238164806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eb41008e0 msgr2=0x7f1eb41a5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb2ffd700 1 --2- 172.21.15.81:0/2238164806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eb41008e0 0x7f1eb41a5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb2ffd700 1 -- 172.21.15.81:0/2238164806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea40095f0 con 0x7f1eb4106290 2024-05-09T00:03:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb2ffd700 1 --2- 172.21.15.81:0/2238164806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb4106290 0x7f1eb41003a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800b500 tx=0x7f1ea800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb0ff9700 1 -- 172.21.15.81:0/2238164806 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8011830 con 0x7f1eb4106290 2024-05-09T00:03:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb0ff9700 1 -- 172.21.15.81:0/2238164806 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ea8011e50 con 0x7f1eb4106290 2024-05-09T00:03:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb9b25700 1 -- 172.21.15.81:0/2238164806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb41a6240 con 0x7f1eb4106290 2024-05-09T00:03:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb0ff9700 1 -- 172.21.15.81:0/2238164806 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8010de0 con 0x7f1eb4106290 2024-05-09T00:03:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.681+0000 7f1eb9b25700 1 -- 172.21.15.81:0/2238164806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb41a6750 con 0x7f1eb4106290 2024-05-09T00:03:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.682+0000 7f1eb9b25700 1 -- 172.21.15.81:0/2238164806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb41094d0 con 0x7f1eb4106290 2024-05-09T00:03:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.684+0000 7f1eb0ff9700 1 -- 172.21.15.81:0/2238164806 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) v1 ==== 135993+0+0 (secure 0 0 0) 0x7f1ea8010480 con 0x7f1eb4106290 2024-05-09T00:03:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.684+0000 7f1eb0ff9700 1 --2- 172.21.15.81:0/2238164806 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1e9c0a1290 0x7f1e9c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.684+0000 7f1eb37fe700 1 --2- 172.21.15.81:0/2238164806 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1e9c0a1290 0x7f1e9c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.684+0000 7f1eb0ff9700 1 -- 172.21.15.81:0/2238164806 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f1ea80cc640 con 0x7f1eb4106290 2024-05-09T00:03:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.685+0000 7f1eb37fe700 1 --2- 172.21.15.81:0/2238164806 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1e9c0a1290 0x7f1e9c0a3750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009990 tx=0x7f1ea4005c00 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.689+0000 7f1eb0ff9700 1 -- 172.21.15.81:0/2238164806 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1ea8095ba0 con 0x7f1eb4106290 2024-05-09T00:03:02.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi150 to 182.5M 2024-05-09T00:03:02.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Unable to set osd_memory_target on smithi150 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-05-09T00:03:02.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:02.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi081 to 182.5M 2024-05-09T00:03:02.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi171 to 182.5M 2024-05-09T00:03:02.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Unable to set osd_memory_target on smithi081 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2024-05-09T00:03:02.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Unable to set osd_memory_target on smithi171 to 191374131: error parsing value: Value '191374131' is below minimum 939524096 2024-05-09T00:03:02.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Updating smithi081:/etc/ceph/ceph.conf 2024-05-09T00:03:02.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Updating smithi150:/etc/ceph/ceph.conf 2024-05-09T00:03:02.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Updating smithi171:/etc/ceph/ceph.conf 2024-05-09T00:03:02.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Updating smithi081:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Updating smithi150:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Updating smithi171:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3007211082' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Updating smithi150:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: mgrmap e22: x(active, since 3s), standbys: y, z 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1705614507' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:03:02.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:03:02.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:03:02.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2977228224' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:03:02.872 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:02 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:02.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.896+0000 7f1eb9b25700 1 -- 172.21.15.81:0/2238164806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1eb4101340 con 0x7f1eb4106290 2024-05-09T00:03:02.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.897+0000 7f1eb0ff9700 1 -- 172.21.15.81:0/2238164806 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ea80991c0 con 0x7f1eb4106290 2024-05-09T00:03:02.891 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-09T00:03:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.899+0000 7f1eb9b25700 1 -- 172.21.15.81:0/2238164806 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1e9c0a1290 msgr2=0x7f1e9c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.899+0000 7f1eb9b25700 1 --2- 172.21.15.81:0/2238164806 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1e9c0a1290 0x7f1e9c0a3750 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4009990 tx=0x7f1ea4005c00 comp rx=0 tx=0).stop 2024-05-09T00:03:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.899+0000 7f1eb9b25700 1 -- 172.21.15.81:0/2238164806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb4106290 msgr2=0x7f1eb41003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.899+0000 7f1eb9b25700 1 --2- 172.21.15.81:0/2238164806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb4106290 0x7f1eb41003a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800b500 tx=0x7f1ea800b810 comp rx=0 tx=0).stop 2024-05-09T00:03:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.899+0000 7f1eb9b25700 1 -- 172.21.15.81:0/2238164806 shutdown_connections 2024-05-09T00:03:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.899+0000 7f1eb9b25700 1 --2- 172.21.15.81:0/2238164806 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1e9c0a1290 0x7f1e9c0a3750 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.899+0000 7f1eb9b25700 1 --2- 172.21.15.81:0/2238164806 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1eb41008e0 0x7f1eb41a5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.899+0000 7f1eb9b25700 1 --2- 172.21.15.81:0/2238164806 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1eb40682e0 0x7f1eb40ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.899+0000 7f1eb9b25700 1 --2- 172.21.15.81:0/2238164806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1eb4106290 0x7f1eb41003a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:02.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.899+0000 7f1eb9b25700 1 -- 172.21.15.81:0/2238164806 >> 172.21.15.81:0/2238164806 conn(0x7f1eb4076f40 msgr2=0x7f1eb40fe070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:02.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.899+0000 7f1eb9b25700 1 -- 172.21.15.81:0/2238164806 shutdown_connections 2024-05-09T00:03:02.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:02.899+0000 7f1eb9b25700 1 -- 172.21.15.81:0/2238164806 wait complete. 2024-05-09T00:03:02.906 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:03:03.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi150 to 182.5M 2024-05-09T00:03:03.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Unable to set osd_memory_target on smithi150 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-05-09T00:03:03.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi081 to 182.5M 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi171 to 182.5M 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Unable to set osd_memory_target on smithi081 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Unable to set osd_memory_target on smithi171 to 191374131: error parsing value: Value '191374131' is below minimum 939524096 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Updating smithi081:/etc/ceph/ceph.conf 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Updating smithi150:/etc/ceph/ceph.conf 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Updating smithi171:/etc/ceph/ceph.conf 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Updating smithi081:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Updating smithi150:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Updating smithi171:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3007211082' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Updating smithi150:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:03:03.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: mgrmap e22: x(active, since 3s), standbys: y, z 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1705614507' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2977228224' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:03:03.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:02 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.034+0000 7f99808b2700 1 -- 172.21.15.81:0/3251201209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101fa0 msgr2=0x7f997c102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.034+0000 7f99808b2700 1 --2- 172.21.15.81:0/3251201209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101fa0 0x7f997c102380 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f996c009990 tx=0x7f996c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.034+0000 7f99808b2700 1 -- 172.21.15.81:0/3251201209 shutdown_connections 2024-05-09T00:03:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.034+0000 7f99808b2700 1 --2- 172.21.15.81:0/3251201209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f997c10b3c0 0x7f997c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.034+0000 7f99808b2700 1 --2- 172.21.15.81:0/3251201209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101fa0 0x7f997c102380 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.034+0000 7f99808b2700 1 --2- 172.21.15.81:0/3251201209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997c1028c0 0x7f997c10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.034+0000 7f99808b2700 1 -- 172.21.15.81:0/3251201209 >> 172.21.15.81:0/3251201209 conn(0x7f997c0fb7e0 msgr2=0x7f997c0fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.035+0000 7f99808b2700 1 -- 172.21.15.81:0/3251201209 shutdown_connections 2024-05-09T00:03:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.035+0000 7f99808b2700 1 -- 172.21.15.81:0/3251201209 wait complete. 2024-05-09T00:03:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.035+0000 7f99808b2700 1 Processor -- start 2024-05-09T00:03:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.035+0000 7f99808b2700 1 -- start start 2024-05-09T00:03:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.035+0000 7f99808b2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101fa0 0x7f997c1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.035+0000 7f99808b2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997c1028c0 0x7f997c197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.035+0000 7f99808b2700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f997c10b3c0 0x7f997c19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.035+0000 7f99808b2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997c19c1e0 con 0x7f997c101fa0 2024-05-09T00:03:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.035+0000 7f99808b2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997c19c350 con 0x7f997c1028c0 2024-05-09T00:03:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.035+0000 7f99808b2700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997c19c510 con 0x7f997c10b3c0 2024-05-09T00:03:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f997a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101fa0 0x7f997c1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f997a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101fa0 0x7f997c1972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58084/0 (socket says 172.21.15.81:58084) 2024-05-09T00:03:03.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f997a59c700 1 -- 172.21.15.81:0/3847717091 learned_addr learned my addr 172.21.15.81:0/3847717091 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f9979d9b700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997c1028c0 0x7f997c197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f997ad9d700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f997c10b3c0 0x7f997c19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f997a59c700 1 -- 172.21.15.81:0/3847717091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f997c10b3c0 msgr2=0x7f997c19bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f997a59c700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f997c10b3c0 0x7f997c19bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f997a59c700 1 -- 172.21.15.81:0/3847717091 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997c1028c0 msgr2=0x7f997c197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f997a59c700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997c1028c0 0x7f997c197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f997a59c700 1 -- 172.21.15.81:0/3847717091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c0095f0 con 0x7f997c101fa0 2024-05-09T00:03:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f997ad9d700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f997c10b3c0 0x7f997c19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f997a59c700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101fa0 0x7f997c1972c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f996c000c00 tx=0x7f996c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f996b7fe700 1 -- 172.21.15.81:0/3847717091 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c01d070 con 0x7f997c101fa0 2024-05-09T00:03:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f996b7fe700 1 -- 172.21.15.81:0/3847717091 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f996c022470 con 0x7f997c101fa0 2024-05-09T00:03:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f99808b2700 1 -- 172.21.15.81:0/3847717091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997c19c790 con 0x7f997c101fa0 2024-05-09T00:03:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f996b7fe700 1 -- 172.21.15.81:0/3847717091 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c017650 con 0x7f997c101fa0 2024-05-09T00:03:03.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.036+0000 7f99808b2700 1 -- 172.21.15.81:0/3847717091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997c1a4030 con 0x7f997c101fa0 2024-05-09T00:03:03.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.037+0000 7f99808b2700 1 -- 172.21.15.81:0/3847717091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997c1064f0 con 0x7f997c101fa0 2024-05-09T00:03:03.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.038+0000 7f996b7fe700 1 -- 172.21.15.81:0/3847717091 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) v1 ==== 135993+0+0 (secure 0 0 0) 0x7f996c0225e0 con 0x7f997c101fa0 2024-05-09T00:03:03.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.039+0000 7f996b7fe700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f99640a1390 0x7f99640a3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:03.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.039+0000 7f9979d9b700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f99640a1390 0x7f99640a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:03.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.039+0000 7f996b7fe700 1 -- 172.21.15.81:0/3847717091 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f996c0cdfb0 con 0x7f997c101fa0 2024-05-09T00:03:03.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.039+0000 7f9979d9b700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f99640a1390 0x7f99640a3850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f997c198810 tx=0x7f9970009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:03.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.043+0000 7f996b7fe700 1 -- 172.21.15.81:0/3847717091 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f996c097450 con 0x7f997c101fa0 2024-05-09T00:03:03.052 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 09 00:03:02 smithi171 sudo[87166]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:03.052 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 09 00:03:02 smithi171 sudo[87166]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:03.052 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 09 00:03:02 smithi171 sudo[87166]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:03.052 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 09 00:03:02 smithi171 sudo[87166]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:03.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi150 to 182.5M 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Unable to set osd_memory_target on smithi150 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi081 to 182.5M 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi171 to 182.5M 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Unable to set osd_memory_target on smithi081 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Unable to set osd_memory_target on smithi171 to 191374131: error parsing value: Value '191374131' is below minimum 939524096 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Updating smithi081:/etc/ceph/ceph.conf 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Updating smithi150:/etc/ceph/ceph.conf 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Updating smithi171:/etc/ceph/ceph.conf 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Updating smithi081:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Updating smithi150:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Updating smithi171:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3007211082' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Updating smithi150:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:03:03.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Updating smithi081:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:03:03.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: Updating smithi171:/etc/ceph/ceph.client.admin.keyring 2024-05-09T00:03:03.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: mgrmap e22: x(active, since 3s), standbys: y, z 2024-05-09T00:03:03.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1705614507' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:03:03.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:03:03.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:03:03.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:03:03.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2977228224' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:03:03.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:02 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:03:03.154 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 09 00:03:02 smithi081 sudo[107671]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:03.154 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 09 00:03:02 smithi081 sudo[107671]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:03.154 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 09 00:03:02 smithi081 sudo[107671]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:03.154 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 09 00:03:02 smithi081 sudo[107671]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:03.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.250+0000 7f99808b2700 1 -- 172.21.15.81:0/3847717091 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f997c198610 con 0x7f997c101fa0 2024-05-09T00:03:03.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.251+0000 7f996b7fe700 1 -- 172.21.15.81:0/3847717091 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+23003 (secure 0 0 0) 0x7f996c027090 con 0x7f997c101fa0 2024-05-09T00:03:03.246 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:03:03.246 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:02:58.862731+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/907969237":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/589390516":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/1458411552":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1755507053":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/3633496844":"2024-05-10T00:02:58.862694+0000","172.21.15.81:6801/1458411552":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/1903231103":"2024-05-10T00:02:58.862694+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:03:03.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.254+0000 7f99808b2700 1 -- 172.21.15.81:0/3847717091 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f99640a1390 msgr2=0x7f99640a3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.254+0000 7f99808b2700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f99640a1390 0x7f99640a3850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f997c198810 tx=0x7f9970009260 comp rx=0 tx=0).stop 2024-05-09T00:03:03.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.254+0000 7f99808b2700 1 -- 172.21.15.81:0/3847717091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101fa0 msgr2=0x7f997c1972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.254+0000 7f99808b2700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101fa0 0x7f997c1972c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f996c000c00 tx=0x7f996c004730 comp rx=0 tx=0).stop 2024-05-09T00:03:03.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.254+0000 7f99808b2700 1 -- 172.21.15.81:0/3847717091 shutdown_connections 2024-05-09T00:03:03.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.254+0000 7f99808b2700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f99640a1390 0x7f99640a3850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.254+0000 7f99808b2700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f997c10b3c0 0x7f997c19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.254+0000 7f99808b2700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f997c101fa0 0x7f997c1972c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.254+0000 7f99808b2700 1 --2- 172.21.15.81:0/3847717091 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f997c1028c0 0x7f997c197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.254+0000 7f99808b2700 1 -- 172.21.15.81:0/3847717091 >> 172.21.15.81:0/3847717091 conn(0x7f997c0fb7e0 msgr2=0x7f997c0fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:03.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.254+0000 7f99808b2700 1 -- 172.21.15.81:0/3847717091 shutdown_connections 2024-05-09T00:03:03.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.254+0000 7f99808b2700 1 -- 172.21.15.81:0/3847717091 wait complete. 2024-05-09T00:03:03.260 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:58:34.523249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T00:01:43.149260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T00:01:44.182730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:03:03.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:03:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.392+0000 7f86867fb700 1 -- 172.21.15.81:0/1333109593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8680105180 msgr2=0x7f868010cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.392+0000 7f86867fb700 1 --2- 172.21.15.81:0/1333109593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8680105180 0x7f868010cd00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f867800b0a0 tx=0x7f867800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.392+0000 7f86867fb700 1 -- 172.21.15.81:0/1333109593 shutdown_connections 2024-05-09T00:03:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.392+0000 7f86867fb700 1 --2- 172.21.15.81:0/1333109593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8680105180 0x7f868010cd00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.392+0000 7f86867fb700 1 --2- 172.21.15.81:0/1333109593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8680100060 0x7f8680100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.392+0000 7f86867fb700 1 --2- 172.21.15.81:0/1333109593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8680100a10 0x7f8680104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.392+0000 7f86867fb700 1 -- 172.21.15.81:0/1333109593 >> 172.21.15.81:0/1333109593 conn(0x7f8680076f70 msgr2=0x7f8680077380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.392+0000 7f86867fb700 1 -- 172.21.15.81:0/1333109593 shutdown_connections 2024-05-09T00:03:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.392+0000 7f86867fb700 1 -- 172.21.15.81:0/1333109593 wait complete. 2024-05-09T00:03:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.392+0000 7f86867fb700 1 Processor -- start 2024-05-09T00:03:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f86867fb700 1 -- start start 2024-05-09T00:03:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f86867fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8680100060 0x7f86801963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f86867fb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8680105180 0x7f8680196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f86867fb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f868019acd0 0x7f868019b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f86867fb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868019b750 con 0x7f8680100060 2024-05-09T00:03:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f86867fb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868019b8c0 con 0x7f868019acd0 2024-05-09T00:03:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f86867fb700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868019ba80 con 0x7f8680105180 2024-05-09T00:03:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f867ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8680100060 0x7f86801963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f867ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8680100060 0x7f86801963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58090/0 (socket says 172.21.15.81:58090) 2024-05-09T00:03:03.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f867ffff700 1 -- 172.21.15.81:0/490476831 learned_addr learned my addr 172.21.15.81:0/490476831 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f8684d98700 1 --2- 172.21.15.81:0/490476831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f868019acd0 0x7f868019b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f867f7fe700 1 --2- 172.21.15.81:0/490476831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8680105180 0x7f8680196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f867ffff700 1 -- 172.21.15.81:0/490476831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8680105180 msgr2=0x7f8680196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f867ffff700 1 --2- 172.21.15.81:0/490476831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8680105180 0x7f8680196930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f867ffff700 1 -- 172.21.15.81:0/490476831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f868019acd0 msgr2=0x7f868019b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f867ffff700 1 --2- 172.21.15.81:0/490476831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f868019acd0 0x7f868019b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.393+0000 7f867ffff700 1 -- 172.21.15.81:0/490476831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8678009d00 con 0x7f8680100060 2024-05-09T00:03:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.394+0000 7f867ffff700 1 --2- 172.21.15.81:0/490476831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8680100060 0x7f86801963f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f867400e9a0 tx=0x7f867400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.394+0000 7f867d7fa700 1 -- 172.21.15.81:0/490476831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674009790 con 0x7f8680100060 2024-05-09T00:03:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.394+0000 7f867d7fa700 1 -- 172.21.15.81:0/490476831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8674010430 con 0x7f8680100060 2024-05-09T00:03:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.394+0000 7f86867fb700 1 -- 172.21.15.81:0/490476831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86801a2fe0 con 0x7f8680100060 2024-05-09T00:03:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.394+0000 7f867d7fa700 1 -- 172.21.15.81:0/490476831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674018680 con 0x7f8680100060 2024-05-09T00:03:03.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.394+0000 7f86867fb700 1 -- 172.21.15.81:0/490476831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86801a3460 con 0x7f8680100060 2024-05-09T00:03:03.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.395+0000 7f86867fb700 1 -- 172.21.15.81:0/490476831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8680108450 con 0x7f8680100060 2024-05-09T00:03:03.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.396+0000 7f867d7fa700 1 -- 172.21.15.81:0/490476831 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) v1 ==== 135993+0+0 (secure 0 0 0) 0x7f86740105a0 con 0x7f8680100060 2024-05-09T00:03:03.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.396+0000 7f867d7fa700 1 --2- 172.21.15.81:0/490476831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f86680a1290 0x7f86680a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:03.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.397+0000 7f867f7fe700 1 --2- 172.21.15.81:0/490476831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f86680a1290 0x7f86680a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:03.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.397+0000 7f867d7fa700 1 -- 172.21.15.81:0/490476831 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f8674014070 con 0x7f8680100060 2024-05-09T00:03:03.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.397+0000 7f867f7fe700 1 --2- 172.21.15.81:0/490476831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f86680a1290 0x7f86680a3750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8680197940 tx=0x7f8670009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:03.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.400+0000 7f867d7fa700 1 -- 172.21.15.81:0/490476831 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f86740964d0 con 0x7f8680100060 2024-05-09T00:03:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.596+0000 7f86867fb700 1 -- 172.21.15.81:0/490476831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8680101530 con 0x7f8680100060 2024-05-09T00:03:03.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.596+0000 7f867d7fa700 1 -- 172.21.15.81:0/490476831 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86740260a0 con 0x7f8680100060 2024-05-09T00:03:03.591 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-09T00:03:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.599+0000 7f86867fb700 1 -- 172.21.15.81:0/490476831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f86680a1290 msgr2=0x7f86680a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.599+0000 7f86867fb700 1 --2- 172.21.15.81:0/490476831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f86680a1290 0x7f86680a3750 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8680197940 tx=0x7f8670009260 comp rx=0 tx=0).stop 2024-05-09T00:03:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.599+0000 7f86867fb700 1 -- 172.21.15.81:0/490476831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8680100060 msgr2=0x7f86801963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.599+0000 7f86867fb700 1 --2- 172.21.15.81:0/490476831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8680100060 0x7f86801963f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f867400e9a0 tx=0x7f867400ecb0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.599+0000 7f86867fb700 1 -- 172.21.15.81:0/490476831 shutdown_connections 2024-05-09T00:03:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.599+0000 7f86867fb700 1 --2- 172.21.15.81:0/490476831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f86680a1290 0x7f86680a3750 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.599+0000 7f86867fb700 1 --2- 172.21.15.81:0/490476831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f868019acd0 0x7f868019b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.599+0000 7f86867fb700 1 --2- 172.21.15.81:0/490476831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8680100060 0x7f86801963f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.599+0000 7f86867fb700 1 --2- 172.21.15.81:0/490476831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8680105180 0x7f8680196930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.599+0000 7f86867fb700 1 -- 172.21.15.81:0/490476831 >> 172.21.15.81:0/490476831 conn(0x7f8680076f70 msgr2=0x7f86800ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.599+0000 7f86867fb700 1 -- 172.21.15.81:0/490476831 shutdown_connections 2024-05-09T00:03:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.599+0000 7f86867fb700 1 -- 172.21.15.81:0/490476831 wait complete. 2024-05-09T00:03:03.604 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 09 00:03:03 smithi081 sudo[107719]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:03.604 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 09 00:03:03 smithi081 sudo[107719]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:03.604 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 09 00:03:03 smithi081 sudo[107719]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:03.604 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 09 00:03:03 smithi081 sudo[107719]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:03.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T00:03:03.645 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 09 00:03:03 smithi150 sudo[84342]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:03.645 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 09 00:03:03 smithi150 sudo[84342]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:03.645 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 09 00:03:03 smithi150 sudo[84342]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:03.645 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 09 00:03:03 smithi150 sudo[84342]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:03.645 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 09 00:03:03 smithi150 sudo[84345]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:03.646 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 09 00:03:03 smithi150 sudo[84345]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:03.646 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 09 00:03:03 smithi150 sudo[84345]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:03.646 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 09 00:03:03 smithi150 sudo[84345]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:03.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.741+0000 7f8813c4c700 1 -- 172.21.15.81:0/1335601322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c100a10 msgr2=0x7f880c104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.741+0000 7f8813c4c700 1 --2- 172.21.15.81:0/1335601322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c100a10 0x7f880c104a40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8808009990 tx=0x7f8808009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.741+0000 7f8813c4c700 1 -- 172.21.15.81:0/1335601322 shutdown_connections 2024-05-09T00:03:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.741+0000 7f8813c4c700 1 --2- 172.21.15.81:0/1335601322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f880c105170 0x7f880c10ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.741+0000 7f8813c4c700 1 --2- 172.21.15.81:0/1335601322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c100060 0x7f880c100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.741+0000 7f8813c4c700 1 --2- 172.21.15.81:0/1335601322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c100a10 0x7f880c104a40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.741+0000 7f8813c4c700 1 -- 172.21.15.81:0/1335601322 >> 172.21.15.81:0/1335601322 conn(0x7f880c076f30 msgr2=0x7f880c077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.741+0000 7f8813c4c700 1 -- 172.21.15.81:0/1335601322 shutdown_connections 2024-05-09T00:03:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.741+0000 7f8813c4c700 1 -- 172.21.15.81:0/1335601322 wait complete. 2024-05-09T00:03:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f8813c4c700 1 Processor -- start 2024-05-09T00:03:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f8813c4c700 1 -- start start 2024-05-09T00:03:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f8813c4c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c100060 0x7f880c198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f8813c4c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c105170 0x7f880c1987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f8813c4c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f880c198d10 0x7f880c1a3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:03.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f8813c4c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c1a39f0 con 0x7f880c105170 2024-05-09T00:03:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f8813c4c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c1a3b60 con 0x7f880c198d10 2024-05-09T00:03:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f8813c4c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880c1a3d20 con 0x7f880c100060 2024-05-09T00:03:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f88111e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c105170 0x7f880c1987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f88111e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c105170 0x7f880c1987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58122/0 (socket says 172.21.15.81:58122) 2024-05-09T00:03:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f88111e7700 1 -- 172.21.15.81:0/4079880677 learned_addr learned my addr 172.21.15.81:0/4079880677 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f88119e8700 1 --2- 172.21.15.81:0/4079880677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c100060 0x7f880c198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f88121e9700 1 --2- 172.21.15.81:0/4079880677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f880c198d10 0x7f880c1a3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f88111e7700 1 -- 172.21.15.81:0/4079880677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c100060 msgr2=0x7f880c198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f88111e7700 1 --2- 172.21.15.81:0/4079880677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c100060 0x7f880c198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f88111e7700 1 -- 172.21.15.81:0/4079880677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f880c198d10 msgr2=0x7f880c1a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f88111e7700 1 --2- 172.21.15.81:0/4079880677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f880c198d10 0x7f880c1a3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f88111e7700 1 -- 172.21.15.81:0/4079880677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88080095f0 con 0x7f880c105170 2024-05-09T00:03:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.742+0000 7f88111e7700 1 --2- 172.21.15.81:0/4079880677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c105170 0x7f880c1987d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8808000c00 tx=0x7f8808004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:03.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.743+0000 7f8802ffd700 1 -- 172.21.15.81:0/4079880677 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880801d070 con 0x7f880c105170 2024-05-09T00:03:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.743+0000 7f8802ffd700 1 -- 172.21.15.81:0/4079880677 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8808021410 con 0x7f880c105170 2024-05-09T00:03:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.743+0000 7f8813c4c700 1 -- 172.21.15.81:0/4079880677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f880c1a3fa0 con 0x7f880c105170 2024-05-09T00:03:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.743+0000 7f8802ffd700 1 -- 172.21.15.81:0/4079880677 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808017650 con 0x7f880c105170 2024-05-09T00:03:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.743+0000 7f8813c4c700 1 -- 172.21.15.81:0/4079880677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f880c1a4360 con 0x7f880c105170 2024-05-09T00:03:03.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.744+0000 7f8813c4c700 1 -- 172.21.15.81:0/4079880677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f880c108440 con 0x7f880c105170 2024-05-09T00:03:03.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.745+0000 7f8802ffd700 1 -- 172.21.15.81:0/4079880677 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f8808021580 con 0x7f880c105170 2024-05-09T00:03:03.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.746+0000 7f8802ffd700 1 --2- 172.21.15.81:0/4079880677 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f87f80a13b0 0x7f87f80a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:03.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.746+0000 7f88119e8700 1 --2- 172.21.15.81:0/4079880677 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f87f80a13b0 0x7f87f80a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:03.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.746+0000 7f8802ffd700 1 -- 172.21.15.81:0/4079880677 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f88080ce930 con 0x7f880c105170 2024-05-09T00:03:03.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.746+0000 7f88119e8700 1 --2- 172.21.15.81:0/4079880677 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f87f80a13b0 0x7f87f80a3870 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009c60 tx=0x7f87fc009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:03.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.750+0000 7f8802ffd700 1 -- 172.21.15.81:0/4079880677 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8808097b80 con 0x7f880c105170 2024-05-09T00:03:03.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:03 smithi081 ceph-mon[42474]: Updating smithi150:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:03:03.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:03 smithi081 ceph-mon[42474]: Updating smithi171:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:03:03.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:03 smithi081 ceph-mon[42474]: Updating smithi081:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:03:03.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:03 smithi081 ceph-mon[42474]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:03:03.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:03 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2238164806' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:03:03.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:03 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3847717091' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:03.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:03 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/490476831' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:03:03.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.945+0000 7f8813c4c700 1 -- 172.21.15.81:0/4079880677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f880c0697b0 con 0x7f880c105170 2024-05-09T00:03:03.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.946+0000 7f8802ffd700 1 -- 172.21.15.81:0/4079880677 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f880809b1a0 con 0x7f880c105170 2024-05-09T00:03:03.940 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-09T00:03:03.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.948+0000 7f8813c4c700 1 -- 172.21.15.81:0/4079880677 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f87f80a13b0 msgr2=0x7f87f80a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.948+0000 7f8813c4c700 1 --2- 172.21.15.81:0/4079880677 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f87f80a13b0 0x7f87f80a3870 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009c60 tx=0x7f87fc009260 comp rx=0 tx=0).stop 2024-05-09T00:03:03.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.948+0000 7f8813c4c700 1 -- 172.21.15.81:0/4079880677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c105170 msgr2=0x7f880c1987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:03.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.948+0000 7f8813c4c700 1 --2- 172.21.15.81:0/4079880677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c105170 0x7f880c1987d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8808000c00 tx=0x7f8808004730 comp rx=0 tx=0).stop 2024-05-09T00:03:03.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.948+0000 7f8813c4c700 1 -- 172.21.15.81:0/4079880677 shutdown_connections 2024-05-09T00:03:03.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.948+0000 7f8813c4c700 1 --2- 172.21.15.81:0/4079880677 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f87f80a13b0 0x7f87f80a3870 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.948+0000 7f8813c4c700 1 --2- 172.21.15.81:0/4079880677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f880c198d10 0x7f880c1a3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.948+0000 7f8813c4c700 1 --2- 172.21.15.81:0/4079880677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f880c100060 0x7f880c198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.948+0000 7f8813c4c700 1 --2- 172.21.15.81:0/4079880677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f880c105170 0x7f880c1987d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:03.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.948+0000 7f8813c4c700 1 -- 172.21.15.81:0/4079880677 >> 172.21.15.81:0/4079880677 conn(0x7f880c076f30 msgr2=0x7f880c0fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:03.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.948+0000 7f8813c4c700 1 -- 172.21.15.81:0/4079880677 shutdown_connections 2024-05-09T00:03:03.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:03.948+0000 7f8813c4c700 1 -- 172.21.15.81:0/4079880677 wait complete. 2024-05-09T00:03:03.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T00:03:04.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:03 smithi150 ceph-mon[46187]: Updating smithi150:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:03:04.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:03 smithi150 ceph-mon[46187]: Updating smithi171:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:03:04.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:03 smithi150 ceph-mon[46187]: Updating smithi081:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:03:04.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:03 smithi150 ceph-mon[46187]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:03:04.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:03 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2238164806' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:03:04.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:03 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3847717091' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:04.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:03 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/490476831' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:03:04.052 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:03:03 smithi171 sudo[87180]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:04.052 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:03:03 smithi171 sudo[87180]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:04.052 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:03:03 smithi171 sudo[87180]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:04.052 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:03:03 smithi171 sudo[87180]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:04.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:03 smithi171 ceph-mon[47351]: Updating smithi150:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:03:04.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:03 smithi171 ceph-mon[47351]: Updating smithi171:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:03:04.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:03 smithi171 ceph-mon[47351]: Updating smithi081:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-09T00:03:04.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:03 smithi171 ceph-mon[47351]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:03:04.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:03 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2238164806' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:03:04.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:03 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3847717091' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:04.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:03 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/490476831' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:03:04.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.086+0000 7f3a94f43700 1 -- 172.21.15.81:0/3616651318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a90105160 msgr2=0x7f3a9010cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:04.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.086+0000 7f3a94f43700 1 --2- 172.21.15.81:0/3616651318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a90105160 0x7f3a9010cce0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800b0a0 tx=0x7f3a8800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.086+0000 7f3a94f43700 1 -- 172.21.15.81:0/3616651318 shutdown_connections 2024-05-09T00:03:04.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.086+0000 7f3a94f43700 1 --2- 172.21.15.81:0/3616651318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a90105160 0x7f3a9010cce0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.086+0000 7f3a94f43700 1 --2- 172.21.15.81:0/3616651318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90100060 0x7f3a90100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.086+0000 7f3a94f43700 1 --2- 172.21.15.81:0/3616651318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a90100a10 0x7f3a90104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.086+0000 7f3a94f43700 1 -- 172.21.15.81:0/3616651318 >> 172.21.15.81:0/3616651318 conn(0x7f3a90076f40 msgr2=0x7f3a90077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:04.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.086+0000 7f3a94f43700 1 -- 172.21.15.81:0/3616651318 shutdown_connections 2024-05-09T00:03:04.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.086+0000 7f3a94f43700 1 -- 172.21.15.81:0/3616651318 wait complete. 2024-05-09T00:03:04.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a94f43700 1 Processor -- start 2024-05-09T00:03:04.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a94f43700 1 -- start start 2024-05-09T00:03:04.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a94f43700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a90100060 0x7f3a901963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:04.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a94f43700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90105160 0x7f3a90196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:04.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a94f43700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a9019ac70 0x7f3a9019b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:04.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a94f43700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9019b6f0 con 0x7f3a9019ac70 2024-05-09T00:03:04.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a94f43700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9019b860 con 0x7f3a90100060 2024-05-09T00:03:04.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a94f43700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9019ba20 con 0x7f3a90105160 2024-05-09T00:03:04.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a8ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a9019ac70 0x7f3a9019b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:04.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a8ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a9019ac70 0x7f3a9019b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58144/0 (socket says 172.21.15.81:58144) 2024-05-09T00:03:04.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a8dd9b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90105160 0x7f3a90196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:04.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a8e59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a90100060 0x7f3a901963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:04.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a8ed9d700 1 -- 172.21.15.81:0/1821986025 learned_addr learned my addr 172.21.15.81:0/1821986025 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:04.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a8ed9d700 1 -- 172.21.15.81:0/1821986025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90105160 msgr2=0x7f3a90196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:04.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a8ed9d700 1 --2- 172.21.15.81:0/1821986025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90105160 0x7f3a90196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a8ed9d700 1 -- 172.21.15.81:0/1821986025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a90100060 msgr2=0x7f3a901963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:04.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a8ed9d700 1 --2- 172.21.15.81:0/1821986025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a90100060 0x7f3a901963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a8ed9d700 1 -- 172.21.15.81:0/1821986025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a88009d00 con 0x7f3a9019ac70 2024-05-09T00:03:04.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.087+0000 7f3a8ed9d700 1 --2- 172.21.15.81:0/1821986025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a9019ac70 0x7f3a9019b0f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3a88006130 tx=0x7f3a88007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:04.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.088+0000 7f3a7f7fe700 1 -- 172.21.15.81:0/1821986025 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8800e040 con 0x7f3a9019ac70 2024-05-09T00:03:04.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.088+0000 7f3a7f7fe700 1 -- 172.21.15.81:0/1821986025 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3a88009480 con 0x7f3a9019ac70 2024-05-09T00:03:04.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.088+0000 7f3a94f43700 1 -- 172.21.15.81:0/1821986025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a901a2f20 con 0x7f3a9019ac70 2024-05-09T00:03:04.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.088+0000 7f3a7f7fe700 1 -- 172.21.15.81:0/1821986025 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8801b6b0 con 0x7f3a9019ac70 2024-05-09T00:03:04.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.088+0000 7f3a94f43700 1 -- 172.21.15.81:0/1821986025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a901a33f0 con 0x7f3a9019ac70 2024-05-09T00:03:04.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.089+0000 7f3a94f43700 1 -- 172.21.15.81:0/1821986025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a90108430 con 0x7f3a9019ac70 2024-05-09T00:03:04.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.090+0000 7f3a7f7fe700 1 -- 172.21.15.81:0/1821986025 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f3a8801d480 con 0x7f3a9019ac70 2024-05-09T00:03:04.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.091+0000 7f3a7f7fe700 1 --2- 172.21.15.81:0/1821986025 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3a780a1430 0x7f3a780a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:04.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.091+0000 7f3a8e59c700 1 --2- 172.21.15.81:0/1821986025 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3a780a1430 0x7f3a780a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:04.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.091+0000 7f3a7f7fe700 1 -- 172.21.15.81:0/1821986025 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f3a880ceaf0 con 0x7f3a9019ac70 2024-05-09T00:03:04.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.091+0000 7f3a8e59c700 1 --2- 172.21.15.81:0/1821986025 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3a780a1430 0x7f3a780a38f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009c60 tx=0x7f3a84009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:04.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.094+0000 7f3a7f7fe700 1 -- 172.21.15.81:0/1821986025 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3a88097dc0 con 0x7f3a9019ac70 2024-05-09T00:03:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.293+0000 7f3a94f43700 1 -- 172.21.15.81:0/1821986025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a90197690 con 0x7f3a9019ac70 2024-05-09T00:03:04.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.294+0000 7f3a7f7fe700 1 -- 172.21.15.81:0/1821986025 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a880210a0 con 0x7f3a9019ac70 2024-05-09T00:03:04.288 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-09T00:03:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.296+0000 7f3a94f43700 1 -- 172.21.15.81:0/1821986025 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3a780a1430 msgr2=0x7f3a780a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.296+0000 7f3a94f43700 1 --2- 172.21.15.81:0/1821986025 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3a780a1430 0x7f3a780a38f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009c60 tx=0x7f3a84009260 comp rx=0 tx=0).stop 2024-05-09T00:03:04.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.296+0000 7f3a94f43700 1 -- 172.21.15.81:0/1821986025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a9019ac70 msgr2=0x7f3a9019b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.296+0000 7f3a94f43700 1 --2- 172.21.15.81:0/1821986025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a9019ac70 0x7f3a9019b0f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3a88006130 tx=0x7f3a88007cf0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.296+0000 7f3a94f43700 1 -- 172.21.15.81:0/1821986025 shutdown_connections 2024-05-09T00:03:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.296+0000 7f3a94f43700 1 --2- 172.21.15.81:0/1821986025 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3a780a1430 0x7f3a780a38f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.296+0000 7f3a94f43700 1 --2- 172.21.15.81:0/1821986025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3a90100060 0x7f3a901963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.296+0000 7f3a94f43700 1 --2- 172.21.15.81:0/1821986025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a9019ac70 0x7f3a9019b0f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.296+0000 7f3a94f43700 1 --2- 172.21.15.81:0/1821986025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a90105160 0x7f3a90196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.296+0000 7f3a94f43700 1 -- 172.21.15.81:0/1821986025 >> 172.21.15.81:0/1821986025 conn(0x7f3a90076f40 msgr2=0x7f3a900fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.296+0000 7f3a94f43700 1 -- 172.21.15.81:0/1821986025 shutdown_connections 2024-05-09T00:03:04.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.296+0000 7f3a94f43700 1 -- 172.21.15.81:0/1821986025 wait complete. 2024-05-09T00:03:04.302 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-05-09T00:03:04.303 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:03:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.434+0000 7f8d69328700 1 -- 172.21.15.81:0/964492222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d64101fa0 msgr2=0x7f8d64102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.434+0000 7f8d69328700 1 --2- 172.21.15.81:0/964492222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d64101fa0 0x7f8d64102380 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009990 tx=0x7f8d54009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.434+0000 7f8d69328700 1 -- 172.21.15.81:0/964492222 shutdown_connections 2024-05-09T00:03:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.434+0000 7f8d69328700 1 --2- 172.21.15.81:0/964492222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d6410b3c0 0x7f8d6410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.434+0000 7f8d69328700 1 --2- 172.21.15.81:0/964492222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d64101fa0 0x7f8d64102380 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.434+0000 7f8d69328700 1 --2- 172.21.15.81:0/964492222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d641028c0 0x7f8d6410ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.434+0000 7f8d69328700 1 -- 172.21.15.81:0/964492222 >> 172.21.15.81:0/964492222 conn(0x7f8d640fb7e0 msgr2=0x7f8d640fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.434+0000 7f8d69328700 1 -- 172.21.15.81:0/964492222 shutdown_connections 2024-05-09T00:03:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.434+0000 7f8d69328700 1 -- 172.21.15.81:0/964492222 wait complete. 2024-05-09T00:03:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.434+0000 7f8d69328700 1 Processor -- start 2024-05-09T00:03:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d69328700 1 -- start start 2024-05-09T00:03:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d69328700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d64101fa0 0x7f8d640ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d69328700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d641028c0 0x7f8d64100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d69328700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d6410b3c0 0x7f8d64100670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d69328700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d641a56d0 con 0x7f8d64101fa0 2024-05-09T00:03:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d69328700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d641a5840 con 0x7f8d6410b3c0 2024-05-09T00:03:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d69328700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d641a5a00 con 0x7f8d641028c0 2024-05-09T00:03:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d62ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d64101fa0 0x7f8d640ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d62ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d64101fa0 0x7f8d640ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58158/0 (socket says 172.21.15.81:58158) 2024-05-09T00:03:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d62ffd700 1 -- 172.21.15.81:0/2335812356 learned_addr learned my addr 172.21.15.81:0/2335812356 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d637fe700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d6410b3c0 0x7f8d64100670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d627fc700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d641028c0 0x7f8d64100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d62ffd700 1 -- 172.21.15.81:0/2335812356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d641028c0 msgr2=0x7f8d64100130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d62ffd700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d641028c0 0x7f8d64100130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d62ffd700 1 -- 172.21.15.81:0/2335812356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d6410b3c0 msgr2=0x7f8d64100670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d62ffd700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d6410b3c0 0x7f8d64100670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d62ffd700 1 -- 172.21.15.81:0/2335812356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d540095f0 con 0x7f8d64101fa0 2024-05-09T00:03:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d627fc700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d641028c0 0x7f8d64100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d62ffd700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d64101fa0 0x7f8d640ffbf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8d54005910 tx=0x7f8d54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d4bfff700 1 -- 172.21.15.81:0/2335812356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5401d070 con 0x7f8d64101fa0 2024-05-09T00:03:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.435+0000 7f8d4bfff700 1 -- 172.21.15.81:0/2335812356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d54022470 con 0x7f8d64101fa0 2024-05-09T00:03:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.436+0000 7f8d69328700 1 -- 172.21.15.81:0/2335812356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d641a5c80 con 0x7f8d64101fa0 2024-05-09T00:03:04.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.436+0000 7f8d4bfff700 1 -- 172.21.15.81:0/2335812356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54017650 con 0x7f8d64101fa0 2024-05-09T00:03:04.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.436+0000 7f8d69328700 1 -- 172.21.15.81:0/2335812356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d641a6180 con 0x7f8d64101fa0 2024-05-09T00:03:04.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.437+0000 7f8d69328700 1 -- 172.21.15.81:0/2335812356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d641064f0 con 0x7f8d64101fa0 2024-05-09T00:03:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.438+0000 7f8d4bfff700 1 -- 172.21.15.81:0/2335812356 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f8d540225e0 con 0x7f8d64101fa0 2024-05-09T00:03:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.438+0000 7f8d4bfff700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8d4c0a1430 0x7f8d4c0a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.438+0000 7f8d4bfff700 1 -- 172.21.15.81:0/2335812356 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f8d540ce5a0 con 0x7f8d64101fa0 2024-05-09T00:03:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.438+0000 7f8d627fc700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8d4c0a1430 0x7f8d4c0a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.439+0000 7f8d627fc700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8d4c0a1430 0x7f8d4c0a38f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8d64101320 tx=0x7f8d58009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.442+0000 7f8d4bfff700 1 -- 172.21.15.81:0/2335812356 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8d54097830 con 0x7f8d64101fa0 2024-05-09T00:03:04.552 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:03:04 smithi171 sudo[87183]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:04.552 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:03:04 smithi171 sudo[87183]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:04.552 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:03:04 smithi171 sudo[87183]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:04.552 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:03:04 smithi171 sudo[87183]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:04.619 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:03:04 smithi081 sudo[107882]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:04.620 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:03:04 smithi081 sudo[107882]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:04.620 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:03:04 smithi081 sudo[107882]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:04.620 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:03:04 smithi081 sudo[107882]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.702+0000 7f8d69328700 1 -- 172.21.15.81:0/2335812356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d640688d0 con 0x7f8d64101fa0 2024-05-09T00:03:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.703+0000 7f8d4bfff700 1 -- 172.21.15.81:0/2335812356 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10864 (secure 0 0 0) 0x7f8d5409ae50 con 0x7f8d64101fa0 2024-05-09T00:03:04.697 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:03:04.697 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:03:00.676924+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:03:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.705+0000 7f8d69328700 1 -- 172.21.15.81:0/2335812356 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8d4c0a1430 msgr2=0x7f8d4c0a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.705+0000 7f8d69328700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8d4c0a1430 0x7f8d4c0a38f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8d64101320 tx=0x7f8d58009260 comp rx=0 tx=0).stop 2024-05-09T00:03:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.705+0000 7f8d69328700 1 -- 172.21.15.81:0/2335812356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d64101fa0 msgr2=0x7f8d640ffbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.705+0000 7f8d69328700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d64101fa0 0x7f8d640ffbf0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8d54005910 tx=0x7f8d54004730 comp rx=0 tx=0).stop 2024-05-09T00:03:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.705+0000 7f8d69328700 1 -- 172.21.15.81:0/2335812356 shutdown_connections 2024-05-09T00:03:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.705+0000 7f8d69328700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8d4c0a1430 0x7f8d4c0a38f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.705+0000 7f8d69328700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d6410b3c0 0x7f8d64100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.705+0000 7f8d69328700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d64101fa0 0x7f8d640ffbf0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.705+0000 7f8d69328700 1 --2- 172.21.15.81:0/2335812356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d641028c0 0x7f8d64100130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.705+0000 7f8d69328700 1 -- 172.21.15.81:0/2335812356 >> 172.21.15.81:0/2335812356 conn(0x7f8d640fb7e0 msgr2=0x7f8d640fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.705+0000 7f8d69328700 1 -- 172.21.15.81:0/2335812356 shutdown_connections 2024-05-09T00:03:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.705+0000 7f8d69328700 1 -- 172.21.15.81:0/2335812356 wait complete. 2024-05-09T00:03:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-05-09T00:03:04.712 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-05-09T00:03:04.712 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-05-09T00:03:04.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:03:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.840+0000 7f166a229700 1 -- 172.21.15.81:0/2772604910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16640fff40 msgr2=0x7f1664100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.840+0000 7f166a229700 1 --2- 172.21.15.81:0/2772604910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16640fff40 0x7f1664100320 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1654009990 tx=0x7f1654009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.840+0000 7f166a229700 1 -- 172.21.15.81:0/2772604910 shutdown_connections 2024-05-09T00:03:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.840+0000 7f166a229700 1 --2- 172.21.15.81:0/2772604910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1664105060 0x7f166410cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.840+0000 7f166a229700 1 --2- 172.21.15.81:0/2772604910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16640fff40 0x7f1664100320 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.840+0000 7f166a229700 1 --2- 172.21.15.81:0/2772604910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16641008f0 0x7f1664104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.840+0000 7f166a229700 1 -- 172.21.15.81:0/2772604910 >> 172.21.15.81:0/2772604910 conn(0x7f16640fb7e0 msgr2=0x7f16640fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.840+0000 7f166a229700 1 -- 172.21.15.81:0/2772604910 shutdown_connections 2024-05-09T00:03:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.840+0000 7f166a229700 1 -- 172.21.15.81:0/2772604910 wait complete. 2024-05-09T00:03:04.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.841+0000 7f166a229700 1 Processor -- start 2024-05-09T00:03:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.841+0000 7f166a229700 1 -- start start 2024-05-09T00:03:04.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f166a229700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16640fff40 0x7f16641981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f166a229700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1664105060 0x7f1664198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f166a229700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1664198c70 0x7f16641a3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f166a229700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16641a3900 con 0x7f16640fff40 2024-05-09T00:03:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f166a229700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16641a3a70 con 0x7f1664105060 2024-05-09T00:03:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f166a229700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16641a3c30 con 0x7f1664198c70 2024-05-09T00:03:04.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f16637fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16640fff40 0x7f16641981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f16637fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16640fff40 0x7f16641981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58172/0 (socket says 172.21.15.81:58172) 2024-05-09T00:03:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f16637fe700 1 -- 172.21.15.81:0/109186333 learned_addr learned my addr 172.21.15.81:0/109186333 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f1662ffd700 1 --2- 172.21.15.81:0/109186333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1664105060 0x7f1664198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f16637fe700 1 -- 172.21.15.81:0/109186333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1664198c70 msgr2=0x7f16641a3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f16637fe700 1 --2- 172.21.15.81:0/109186333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1664198c70 0x7f16641a3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f16637fe700 1 -- 172.21.15.81:0/109186333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1664105060 msgr2=0x7f1664198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:04.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f16637fe700 1 --2- 172.21.15.81:0/109186333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1664105060 0x7f1664198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f16637fe700 1 -- 172.21.15.81:0/109186333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16540095f0 con 0x7f16640fff40 2024-05-09T00:03:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f16637fe700 1 --2- 172.21.15.81:0/109186333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16640fff40 0x7f16641981f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1654005910 tx=0x7f1654004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f1660ff9700 1 -- 172.21.15.81:0/109186333 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165401d070 con 0x7f16640fff40 2024-05-09T00:03:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f1660ff9700 1 -- 172.21.15.81:0/109186333 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1654022470 con 0x7f16640fff40 2024-05-09T00:03:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f166a229700 1 -- 172.21.15.81:0/109186333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16641a3eb0 con 0x7f16640fff40 2024-05-09T00:03:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f1660ff9700 1 -- 172.21.15.81:0/109186333 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1654017650 con 0x7f16640fff40 2024-05-09T00:03:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.842+0000 7f166a229700 1 -- 172.21.15.81:0/109186333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16641a4270 con 0x7f16640fff40 2024-05-09T00:03:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.843+0000 7f166a229700 1 -- 172.21.15.81:0/109186333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16641082d0 con 0x7f16640fff40 2024-05-09T00:03:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.844+0000 7f1660ff9700 1 -- 172.21.15.81:0/109186333 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f16540225e0 con 0x7f16640fff40 2024-05-09T00:03:04.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.845+0000 7f1660ff9700 1 --2- 172.21.15.81:0/109186333 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f164c0a13b0 0x7f164c0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:04.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.845+0000 7f1662ffd700 1 --2- 172.21.15.81:0/109186333 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f164c0a13b0 0x7f164c0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:04.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.845+0000 7f1660ff9700 1 -- 172.21.15.81:0/109186333 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f16540ce360 con 0x7f16640fff40 2024-05-09T00:03:04.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.845+0000 7f1662ffd700 1 --2- 172.21.15.81:0/109186333 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f164c0a13b0 0x7f164c0a3870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1664068790 tx=0x7f1658009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:04.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:04.849+0000 7f1660ff9700 1 -- 172.21.15.81:0/109186333 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f16540975f0 con 0x7f16640fff40 2024-05-09T00:03:04.928 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:04 smithi081 ceph-mon[42474]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-05-09T00:03:04.928 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:04 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/4079880677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:03:04.928 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:04 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1821986025' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:03:04.928 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:03:04 smithi081 sudo[107905]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:04.929 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:03:04 smithi081 sudo[107905]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:04.929 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:03:04 smithi081 sudo[107905]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:04.929 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:03:04 smithi081 sudo[107905]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:05.014 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:03:04 smithi150 sudo[84348]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:05.014 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:03:04 smithi150 sudo[84348]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:05.014 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:03:04 smithi150 sudo[84348]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:05.014 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:03:04 smithi150 sudo[84348]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:05.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:04 smithi150 ceph-mon[46187]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-05-09T00:03:05.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:04 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/4079880677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:03:05.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:04 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1821986025' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:03:05.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.051+0000 7f166a229700 1 -- 172.21.15.81:0/109186333 --> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16641008c0 con 0x7f164c0a13b0 2024-05-09T00:03:05.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:04 smithi171 ceph-mon[47351]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-05-09T00:03:05.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:04 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/4079880677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:03:05.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:04 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1821986025' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:03:05.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.063+0000 7f1660ff9700 1 -- 172.21.15.81:0/109186333 <== mgr.15285 v2:172.21.15.81:6800/2111088526 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343285 (secure 0 0 0) 0x7f16641008c0 con 0x7f164c0a13b0 2024-05-09T00:03:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:03:05.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.066+0000 7f166a229700 1 -- 172.21.15.81:0/109186333 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f164c0a13b0 msgr2=0x7f164c0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:05.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.066+0000 7f166a229700 1 --2- 172.21.15.81:0/109186333 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f164c0a13b0 0x7f164c0a3870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1664068790 tx=0x7f1658009260 comp rx=0 tx=0).stop 2024-05-09T00:03:05.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.066+0000 7f166a229700 1 -- 172.21.15.81:0/109186333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16640fff40 msgr2=0x7f16641981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:05.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.066+0000 7f166a229700 1 --2- 172.21.15.81:0/109186333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16640fff40 0x7f16641981f0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1654005910 tx=0x7f1654004730 comp rx=0 tx=0).stop 2024-05-09T00:03:05.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.066+0000 7f166a229700 1 -- 172.21.15.81:0/109186333 shutdown_connections 2024-05-09T00:03:05.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.066+0000 7f166a229700 1 --2- 172.21.15.81:0/109186333 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f164c0a13b0 0x7f164c0a3870 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.066+0000 7f166a229700 1 --2- 172.21.15.81:0/109186333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1664198c70 0x7f16641a3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.066+0000 7f166a229700 1 --2- 172.21.15.81:0/109186333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16640fff40 0x7f16641981f0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.066+0000 7f166a229700 1 --2- 172.21.15.81:0/109186333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1664105060 0x7f1664198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.066+0000 7f166a229700 1 -- 172.21.15.81:0/109186333 >> 172.21.15.81:0/109186333 conn(0x7f16640fb7e0 msgr2=0x7f16640fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:05.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.066+0000 7f166a229700 1 -- 172.21.15.81:0/109186333 shutdown_connections 2024-05-09T00:03:05.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.066+0000 7f166a229700 1 -- 172.21.15.81:0/109186333 wait complete. 2024-05-09T00:03:05.067 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-09T00:03:05.073 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-05-09T00:03:04.882662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185615,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":673,"num_read_kb":497,"num_write":455,"num_write_kb":4367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1181725,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376244,"kb_used_data":11044,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124565580,"statfs":{"total":1151940427776,"available":1151555153920,"internally_reserved":0,"allocated":11309056,"data_stored":8394175,"data_compressed":204414,"data_compressed_allocated":270336,"data_compressed_original":3047424,"omap_allocated":19131,"internal_metadata":373798213},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.990706"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.909563+0000","last_change":"2024-05-09T00:01:45.048606+0000","last_active":"2024-05-09T00:02:58.909563+0000","last_peered":"2024-05-09T00:02:58.909563+0000","last_clean":"2024-05-09T00:02:58.909563+0000","last_became_active":"2024-05-09T00:01:45.047691+0000","last_became_peered":"2024-05-09T00:01:45.047691+0000","last_unstale":"2024-05-09T00:02:58.909563+0000","last_undegraded":"2024-05-09T00:02:58.909563+0000","last_fullsized":"2024-05-09T00:02:58.909563+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:03.881912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.920179+0000","last_change":"2024-05-09T00:01:45.046812+0000","last_active":"2024-05-09T00:02:58.920179+0000","last_peered":"2024-05-09T00:02:58.920179+0000","last_clean":"2024-05-09T00:02:58.920179+0000","last_became_active":"2024-05-09T00:01:45.046510+0000","last_became_peered":"2024-05-09T00:01:45.046510+0000","last_unstale":"2024-05-09T00:02:58.920179+0000","last_undegraded":"2024-05-09T00:02:58.920179+0000","last_fullsized":"2024-05-09T00:02:58.920179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:03.614974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925132+0000","last_change":"2024-05-09T00:01:45.040304+0000","last_active":"2024-05-09T00:02:58.925132+0000","last_peered":"2024-05-09T00:02:58.925132+0000","last_clean":"2024-05-09T00:02:58.925132+0000","last_became_active":"2024-05-09T00:01:45.039990+0000","last_became_peered":"2024-05-09T00:01:45.039990+0000","last_unstale":"2024-05-09T00:02:58.925132+0000","last_undegraded":"2024-05-09T00:02:58.925132+0000","last_fullsized":"2024-05-09T00:02:58.925132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:17:33.563999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.913271+0000","last_change":"2024-05-09T00:01:45.040528+0000","last_active":"2024-05-09T00:02:58.913271+0000","last_peered":"2024-05-09T00:02:58.913271+0000","last_clean":"2024-05-09T00:02:58.913271+0000","last_became_active":"2024-05-09T00:01:45.040100+0000","last_became_peered":"2024-05-09T00:01:45.040100+0000","last_unstale":"2024-05-09T00:02:58.913271+0000","last_undegraded":"2024-05-09T00:02:58.913271+0000","last_fullsized":"2024-05-09T00:02:58.913271+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:02.739346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.922977+0000","last_change":"2024-05-09T00:01:45.036192+0000","last_active":"2024-05-09T00:02:58.922977+0000","last_peered":"2024-05-09T00:02:58.922977+0000","last_clean":"2024-05-09T00:02:58.922977+0000","last_became_active":"2024-05-09T00:01:45.035845+0000","last_became_peered":"2024-05-09T00:01:45.035845+0000","last_unstale":"2024-05-09T00:02:58.922977+0000","last_undegraded":"2024-05-09T00:02:58.922977+0000","last_fullsized":"2024-05-09T00:02:58.922977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:25.494946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.920477+0000","last_change":"2024-05-09T00:01:45.047866+0000","last_active":"2024-05-09T00:02:58.920477+0000","last_peered":"2024-05-09T00:02:58.920477+0000","last_clean":"2024-05-09T00:02:58.920477+0000","last_became_active":"2024-05-09T00:01:45.047549+0000","last_became_peered":"2024-05-09T00:01:45.047549+0000","last_unstale":"2024-05-09T00:02:58.920477+0000","last_undegraded":"2024-05-09T00:02:58.920477+0000","last_fullsized":"2024-05-09T00:02:58.920477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:34:33.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917257+0000","last_change":"2024-05-09T00:01:45.054246+0000","last_active":"2024-05-09T00:02:58.917257+0000","last_peered":"2024-05-09T00:02:58.917257+0000","last_clean":"2024-05-09T00:02:58.917257+0000","last_became_active":"2024-05-09T00:01:45.053863+0000","last_became_peered":"2024-05-09T00:01:45.053863+0000","last_unstale":"2024-05-09T00:02:58.917257+0000","last_undegraded":"2024-05-09T00:02:58.917257+0000","last_fullsized":"2024-05-09T00:02:58.917257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:12.080139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929596+0000","last_change":"2024-05-09T00:01:45.053747+0000","last_active":"2024-05-09T00:02:58.929596+0000","last_peered":"2024-05-09T00:02:58.929596+0000","last_clean":"2024-05-09T00:02:58.929596+0000","last_became_active":"2024-05-09T00:01:45.053461+0000","last_became_peered":"2024-05-09T00:01:45.053461+0000","last_unstale":"2024-05-09T00:02:58.929596+0000","last_undegraded":"2024-05-09T00:02:58.929596+0000","last_fullsized":"2024-05-09T00:02:58.929596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:30.018296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.916352+0000","last_change":"2024-05-09T00:01:45.053851+0000","last_active":"2024-05-09T00:02:58.916352+0000","last_peered":"2024-05-09T00:02:58.916352+0000","last_clean":"2024-05-09T00:02:58.916352+0000","last_became_active":"2024-05-09T00:01:45.053471+0000","last_became_peered":"2024-05-09T00:01:45.053471+0000","last_unstale":"2024-05-09T00:02:58.916352+0000","last_undegraded":"2024-05-09T00:02:58.916352+0000","last_fullsized":"2024-05-09T00:02:58.916352+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:25.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.920307+0000","last_change":"2024-05-09T00:01:45.048916+0000","last_active":"2024-05-09T00:02:58.920307+0000","last_peered":"2024-05-09T00:02:58.920307+0000","last_clean":"2024-05-09T00:02:58.920307+0000","last_became_active":"2024-05-09T00:01:45.048227+0000","last_became_peered":"2024-05-09T00:01:45.048227+0000","last_unstale":"2024-05-09T00:02:58.920307+0000","last_undegraded":"2024-05-09T00:02:58.920307+0000","last_fullsized":"2024-05-09T00:02:58.920307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:51.246933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.914098+0000","last_change":"2024-05-09T00:01:45.053449+0000","last_active":"2024-05-09T00:02:58.914098+0000","last_peered":"2024-05-09T00:02:58.914098+0000","last_clean":"2024-05-09T00:02:58.914098+0000","last_became_active":"2024-05-09T00:01:45.053060+0000","last_became_peered":"2024-05-09T00:01:45.053060+0000","last_unstale":"2024-05-09T00:02:58.914098+0000","last_undegraded":"2024-05-09T00:02:58.914098+0000","last_fullsized":"2024-05-09T00:02:58.914098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:21.236565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921190+0000","last_change":"2024-05-09T00:01:45.047231+0000","last_active":"2024-05-09T00:02:58.921190+0000","last_peered":"2024-05-09T00:02:58.921190+0000","last_clean":"2024-05-09T00:02:58.921190+0000","last_became_active":"2024-05-09T00:01:45.046897+0000","last_became_peered":"2024-05-09T00:01:45.046897+0000","last_unstale":"2024-05-09T00:02:58.921190+0000","last_undegraded":"2024-05-09T00:02:58.921190+0000","last_fullsized":"2024-05-09T00:02:58.921190+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:13.307931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925844+0000","last_change":"2024-05-09T00:01:45.048545+0000","last_active":"2024-05-09T00:02:58.925844+0000","last_peered":"2024-05-09T00:02:58.925844+0000","last_clean":"2024-05-09T00:02:58.925844+0000","last_became_active":"2024-05-09T00:01:45.048237+0000","last_became_peered":"2024-05-09T00:01:45.048237+0000","last_unstale":"2024-05-09T00:02:58.925844+0000","last_undegraded":"2024-05-09T00:02:58.925844+0000","last_fullsized":"2024-05-09T00:02:58.925844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:45:41.578704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.924801+0000","last_change":"2024-05-09T00:01:45.046735+0000","last_active":"2024-05-09T00:02:58.924801+0000","last_peered":"2024-05-09T00:02:58.924801+0000","last_clean":"2024-05-09T00:02:58.924801+0000","last_became_active":"2024-05-09T00:01:45.046441+0000","last_became_peered":"2024-05-09T00:01:45.046441+0000","last_unstale":"2024-05-09T00:02:58.924801+0000","last_undegraded":"2024-05-09T00:02:58.924801+0000","last_fullsized":"2024-05-09T00:02:58.924801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:51.380665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926317+0000","last_change":"2024-05-09T00:01:45.036289+0000","last_active":"2024-05-09T00:02:58.926317+0000","last_peered":"2024-05-09T00:02:58.926317+0000","last_clean":"2024-05-09T00:02:58.926317+0000","last_became_active":"2024-05-09T00:01:45.035996+0000","last_became_peered":"2024-05-09T00:01:45.035996+0000","last_unstale":"2024-05-09T00:02:58.926317+0000","last_undegraded":"2024-05-09T00:02:58.926317+0000","last_fullsized":"2024-05-09T00:02:58.926317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:52.769668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.901458+0000","last_change":"2024-05-09T00:01:45.044908+0000","last_active":"2024-05-09T00:02:58.901458+0000","last_peered":"2024-05-09T00:02:58.901458+0000","last_clean":"2024-05-09T00:02:58.901458+0000","last_became_active":"2024-05-09T00:01:45.044508+0000","last_became_peered":"2024-05-09T00:01:45.044508+0000","last_unstale":"2024-05-09T00:02:58.901458+0000","last_undegraded":"2024-05-09T00:02:58.901458+0000","last_fullsized":"2024-05-09T00:02:58.901458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:02:23.578743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.910112+0000","last_change":"2024-05-09T00:01:45.048389+0000","last_active":"2024-05-09T00:02:58.910112+0000","last_peered":"2024-05-09T00:02:58.910112+0000","last_clean":"2024-05-09T00:02:58.910112+0000","last_became_active":"2024-05-09T00:01:45.047959+0000","last_became_peered":"2024-05-09T00:01:45.047959+0000","last_unstale":"2024-05-09T00:02:58.910112+0000","last_undegraded":"2024-05-09T00:02:58.910112+0000","last_fullsized":"2024-05-09T00:02:58.910112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:44.298296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.919072+0000","last_change":"2024-05-09T00:01:45.048314+0000","last_active":"2024-05-09T00:02:58.919072+0000","last_peered":"2024-05-09T00:02:58.919072+0000","last_clean":"2024-05-09T00:02:58.919072+0000","last_became_active":"2024-05-09T00:01:45.048002+0000","last_became_peered":"2024-05-09T00:01:45.048002+0000","last_unstale":"2024-05-09T00:02:58.919072+0000","last_undegraded":"2024-05-09T00:02:58.919072+0000","last_fullsized":"2024-05-09T00:02:58.919072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:36.327498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925163+0000","last_change":"2024-05-09T00:01:45.035747+0000","last_active":"2024-05-09T00:02:58.925163+0000","last_peered":"2024-05-09T00:02:58.925163+0000","last_clean":"2024-05-09T00:02:58.925163+0000","last_became_active":"2024-05-09T00:01:45.035122+0000","last_became_peered":"2024-05-09T00:01:45.035122+0000","last_unstale":"2024-05-09T00:02:58.925163+0000","last_undegraded":"2024-05-09T00:02:58.925163+0000","last_fullsized":"2024-05-09T00:02:58.925163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:21.361033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.833443+0000","last_change":"2024-05-09T00:01:44.620816+0000","last_active":"2024-05-09T00:02:47.833443+0000","last_peered":"2024-05-09T00:02:47.833443+0000","last_clean":"2024-05-09T00:02:47.833443+0000","last_became_active":"2024-05-09T00:01:44.620524+0000","last_became_peered":"2024-05-09T00:01:44.620524+0000","last_unstale":"2024-05-09T00:02:47.833443+0000","last_undegraded":"2024-05-09T00:02:47.833443+0000","last_fullsized":"2024-05-09T00:02:47.833443+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:05.623111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.922725+0000","last_change":"2024-05-09T00:01:45.049115+0000","last_active":"2024-05-09T00:02:58.922725+0000","last_peered":"2024-05-09T00:02:58.922725+0000","last_clean":"2024-05-09T00:02:58.922725+0000","last_became_active":"2024-05-09T00:01:45.048825+0000","last_became_peered":"2024-05-09T00:01:45.048825+0000","last_unstale":"2024-05-09T00:02:58.922725+0000","last_undegraded":"2024-05-09T00:02:58.922725+0000","last_fullsized":"2024-05-09T00:02:58.922725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:09:29.890090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.912390+0000","last_change":"2024-05-09T00:01:44.621711+0000","last_active":"2024-05-09T00:02:47.912390+0000","last_peered":"2024-05-09T00:02:47.912390+0000","last_clean":"2024-05-09T00:02:47.912390+0000","last_became_active":"2024-05-09T00:01:44.621433+0000","last_became_peered":"2024-05-09T00:01:44.621433+0000","last_unstale":"2024-05-09T00:02:47.912390+0000","last_undegraded":"2024-05-09T00:02:47.912390+0000","last_fullsized":"2024-05-09T00:02:47.912390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:57.451467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926717+0000","last_change":"2024-05-09T00:01:45.038415+0000","last_active":"2024-05-09T00:02:58.926717+0000","last_peered":"2024-05-09T00:02:58.926717+0000","last_clean":"2024-05-09T00:02:58.926717+0000","last_became_active":"2024-05-09T00:01:45.038141+0000","last_became_peered":"2024-05-09T00:01:45.038141+0000","last_unstale":"2024-05-09T00:02:58.926717+0000","last_undegraded":"2024-05-09T00:02:58.926717+0000","last_fullsized":"2024-05-09T00:02:58.926717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:37.772886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:48.407709+0000","last_change":"2024-05-09T00:02:47.920115+0000","last_active":"2024-05-09T00:02:48.407709+0000","last_peered":"2024-05-09T00:02:48.407709+0000","last_clean":"2024-05-09T00:02:48.407709+0000","last_became_active":"2024-05-09T00:02:47.913365+0000","last_became_peered":"2024-05-09T00:02:47.913365+0000","last_unstale":"2024-05-09T00:02:48.407709+0000","last_undegraded":"2024-05-09T00:02:48.407709+0000","last_fullsized":"2024-05-09T00:02:48.407709+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.930857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925715+0000","last_change":"2024-05-09T00:01:45.048553+0000","last_active":"2024-05-09T00:02:58.925715+0000","last_peered":"2024-05-09T00:02:58.925715+0000","last_clean":"2024-05-09T00:02:58.925715+0000","last_became_active":"2024-05-09T00:01:45.046659+0000","last_became_peered":"2024-05-09T00:01:45.046659+0000","last_unstale":"2024-05-09T00:02:58.925715+0000","last_undegraded":"2024-05-09T00:02:58.925715+0000","last_fullsized":"2024-05-09T00:02:58.925715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:19.581843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836573+0000","last_change":"2024-05-09T00:01:44.614820+0000","last_active":"2024-05-09T00:02:47.836573+0000","last_peered":"2024-05-09T00:02:47.836573+0000","last_clean":"2024-05-09T00:02:47.836573+0000","last_became_active":"2024-05-09T00:01:44.614418+0000","last_became_peered":"2024-05-09T00:01:44.614418+0000","last_unstale":"2024-05-09T00:02:47.836573+0000","last_undegraded":"2024-05-09T00:02:47.836573+0000","last_fullsized":"2024-05-09T00:02:47.836573+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:18.133098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.914191+0000","last_change":"2024-05-09T00:02:47.913822+0000","last_active":"2024-05-09T00:02:58.914191+0000","last_peered":"2024-05-09T00:02:58.914191+0000","last_clean":"2024-05-09T00:02:58.914191+0000","last_became_active":"2024-05-09T00:02:47.913375+0000","last_became_peered":"2024-05-09T00:02:47.913375+0000","last_unstale":"2024-05-09T00:02:58.914191+0000","last_undegraded":"2024-05-09T00:02:58.914191+0000","last_fullsized":"2024-05-09T00:02:58.914191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:12.486856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":113,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.855099+0000","last_change":"2024-05-09T00:02:47.845264+0000","last_active":"2024-05-09T00:02:59.855099+0000","last_peered":"2024-05-09T00:02:59.855099+0000","last_clean":"2024-05-09T00:02:59.855099+0000","last_became_active":"2024-05-09T00:02:47.837967+0000","last_became_peered":"2024-05-09T00:02:47.837967+0000","last_unstale":"2024-05-09T00:02:59.855099+0000","last_undegraded":"2024-05-09T00:02:59.855099+0000","last_fullsized":"2024-05-09T00:02:59.855099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:52.606544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":967,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.912254+0000","last_change":"2024-05-09T00:01:45.049365+0000","last_active":"2024-05-09T00:02:58.912254+0000","last_peered":"2024-05-09T00:02:58.912254+0000","last_clean":"2024-05-09T00:02:58.912254+0000","last_became_active":"2024-05-09T00:01:45.049037+0000","last_became_peered":"2024-05-09T00:01:45.049037+0000","last_unstale":"2024-05-09T00:02:58.912254+0000","last_undegraded":"2024-05-09T00:02:58.912254+0000","last_fullsized":"2024-05-09T00:02:58.912254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:34.290672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.831655+0000","last_change":"2024-05-09T00:01:44.617212+0000","last_active":"2024-05-09T00:02:47.831655+0000","last_peered":"2024-05-09T00:02:47.831655+0000","last_clean":"2024-05-09T00:02:47.831655+0000","last_became_active":"2024-05-09T00:01:44.616898+0000","last_became_peered":"2024-05-09T00:01:44.616898+0000","last_unstale":"2024-05-09T00:02:47.831655+0000","last_undegraded":"2024-05-09T00:02:47.831655+0000","last_fullsized":"2024-05-09T00:02:47.831655+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:39.630039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917773+0000","last_change":"2024-05-09T00:02:47.912964+0000","last_active":"2024-05-09T00:02:58.917773+0000","last_peered":"2024-05-09T00:02:58.917773+0000","last_clean":"2024-05-09T00:02:58.917773+0000","last_became_active":"2024-05-09T00:02:47.912523+0000","last_became_peered":"2024-05-09T00:02:47.912523+0000","last_unstale":"2024-05-09T00:02:58.917773+0000","last_undegraded":"2024-05-09T00:02:58.917773+0000","last_fullsized":"2024-05-09T00:02:58.917773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:49.437293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,3],"acting":[9,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.830682+0000","last_change":"2024-05-09T00:01:44.618214+0000","last_active":"2024-05-09T00:02:47.830682+0000","last_peered":"2024-05-09T00:02:47.830682+0000","last_clean":"2024-05-09T00:02:47.830682+0000","last_became_active":"2024-05-09T00:01:44.617769+0000","last_became_peered":"2024-05-09T00:01:44.617769+0000","last_unstale":"2024-05-09T00:02:47.830682+0000","last_undegraded":"2024-05-09T00:02:47.830682+0000","last_fullsized":"2024-05-09T00:02:47.830682+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:43.654597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.927185+0000","last_change":"2024-05-09T00:01:45.037441+0000","last_active":"2024-05-09T00:02:58.927185+0000","last_peered":"2024-05-09T00:02:58.927185+0000","last_clean":"2024-05-09T00:02:58.927185+0000","last_became_active":"2024-05-09T00:01:45.036668+0000","last_became_peered":"2024-05-09T00:01:45.036668+0000","last_unstale":"2024-05-09T00:02:58.927185+0000","last_undegraded":"2024-05-09T00:02:58.927185+0000","last_fullsized":"2024-05-09T00:02:58.927185+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:25.116685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.834752+0000","last_change":"2024-05-09T00:01:44.624973+0000","last_active":"2024-05-09T00:02:47.834752+0000","last_peered":"2024-05-09T00:02:47.834752+0000","last_clean":"2024-05-09T00:02:47.834752+0000","last_became_active":"2024-05-09T00:01:44.624470+0000","last_became_peered":"2024-05-09T00:01:44.624470+0000","last_unstale":"2024-05-09T00:02:47.834752+0000","last_undegraded":"2024-05-09T00:02:47.834752+0000","last_fullsized":"2024-05-09T00:02:47.834752+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:22.021060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.919463+0000","last_change":"2024-05-09T00:01:45.037414+0000","last_active":"2024-05-09T00:02:58.919463+0000","last_peered":"2024-05-09T00:02:58.919463+0000","last_clean":"2024-05-09T00:02:58.919463+0000","last_became_active":"2024-05-09T00:01:45.037095+0000","last_became_peered":"2024-05-09T00:01:45.037095+0000","last_unstale":"2024-05-09T00:02:58.919463+0000","last_undegraded":"2024-05-09T00:02:58.919463+0000","last_fullsized":"2024-05-09T00:02:58.919463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:29.812977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.880182+0000","last_change":"2024-05-09T00:01:44.614823+0000","last_active":"2024-05-09T00:02:58.880182+0000","last_peered":"2024-05-09T00:02:58.880182+0000","last_clean":"2024-05-09T00:02:58.880182+0000","last_became_active":"2024-05-09T00:01:44.614502+0000","last_became_peered":"2024-05-09T00:01:44.614502+0000","last_unstale":"2024-05-09T00:02:58.880182+0000","last_undegraded":"2024-05-09T00:02:58.880182+0000","last_fullsized":"2024-05-09T00:02:58.880182+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:14.486852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.919897+0000","last_change":"2024-05-09T00:01:45.048631+0000","last_active":"2024-05-09T00:02:58.919897+0000","last_peered":"2024-05-09T00:02:58.919897+0000","last_clean":"2024-05-09T00:02:58.919897+0000","last_became_active":"2024-05-09T00:01:45.046691+0000","last_became_peered":"2024-05-09T00:01:45.046691+0000","last_unstale":"2024-05-09T00:02:58.919897+0000","last_undegraded":"2024-05-09T00:02:58.919897+0000","last_fullsized":"2024-05-09T00:02:58.919897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:59:35.017208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.833476+0000","last_change":"2024-05-09T00:01:44.622684+0000","last_active":"2024-05-09T00:02:47.833476+0000","last_peered":"2024-05-09T00:02:47.833476+0000","last_clean":"2024-05-09T00:02:47.833476+0000","last_became_active":"2024-05-09T00:01:44.622301+0000","last_became_peered":"2024-05-09T00:01:44.622301+0000","last_unstale":"2024-05-09T00:02:47.833476+0000","last_undegraded":"2024-05-09T00:02:47.833476+0000","last_fullsized":"2024-05-09T00:02:47.833476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:38.343729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.924718+0000","last_change":"2024-05-09T00:01:45.050240+0000","last_active":"2024-05-09T00:02:58.924718+0000","last_peered":"2024-05-09T00:02:58.924718+0000","last_clean":"2024-05-09T00:02:58.924718+0000","last_became_active":"2024-05-09T00:01:45.049955+0000","last_became_peered":"2024-05-09T00:01:45.049955+0000","last_unstale":"2024-05-09T00:02:58.924718+0000","last_undegraded":"2024-05-09T00:02:58.924718+0000","last_fullsized":"2024-05-09T00:02:58.924718+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:56.811853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836054+0000","last_change":"2024-05-09T00:01:44.618591+0000","last_active":"2024-05-09T00:02:47.836054+0000","last_peered":"2024-05-09T00:02:47.836054+0000","last_clean":"2024-05-09T00:02:47.836054+0000","last_became_active":"2024-05-09T00:01:44.618198+0000","last_became_peered":"2024-05-09T00:01:44.618198+0000","last_unstale":"2024-05-09T00:02:47.836054+0000","last_undegraded":"2024-05-09T00:02:47.836054+0000","last_fullsized":"2024-05-09T00:02:47.836054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:27.705444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.908801+0000","last_change":"2024-05-09T00:01:45.037485+0000","last_active":"2024-05-09T00:02:58.908801+0000","last_peered":"2024-05-09T00:02:58.908801+0000","last_clean":"2024-05-09T00:02:58.908801+0000","last_became_active":"2024-05-09T00:01:45.037150+0000","last_became_peered":"2024-05-09T00:01:45.037150+0000","last_unstale":"2024-05-09T00:02:58.908801+0000","last_undegraded":"2024-05-09T00:02:58.908801+0000","last_fullsized":"2024-05-09T00:02:58.908801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:55.476243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":199,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.855097+0000","last_change":"2024-05-09T00:01:44.620485+0000","last_active":"2024-05-09T00:02:59.855097+0000","last_peered":"2024-05-09T00:02:59.855097+0000","last_clean":"2024-05-09T00:02:59.855097+0000","last_became_active":"2024-05-09T00:01:44.620004+0000","last_became_peered":"2024-05-09T00:01:44.620004+0000","last_unstale":"2024-05-09T00:02:59.855097+0000","last_undegraded":"2024-05-09T00:02:59.855097+0000","last_fullsized":"2024-05-09T00:02:59.855097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:58.529038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65442,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":138,"num_write":35,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.915108+0000","last_change":"2024-05-09T00:01:45.045581+0000","last_active":"2024-05-09T00:02:58.915108+0000","last_peered":"2024-05-09T00:02:58.915108+0000","last_clean":"2024-05-09T00:02:58.915108+0000","last_became_active":"2024-05-09T00:01:45.045290+0000","last_became_peered":"2024-05-09T00:01:45.045290+0000","last_unstale":"2024-05-09T00:02:58.915108+0000","last_undegraded":"2024-05-09T00:02:58.915108+0000","last_fullsized":"2024-05-09T00:02:58.915108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:36.860897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836337+0000","last_change":"2024-05-09T00:01:44.624145+0000","last_active":"2024-05-09T00:02:47.836337+0000","last_peered":"2024-05-09T00:02:47.836337+0000","last_clean":"2024-05-09T00:02:47.836337+0000","last_became_active":"2024-05-09T00:01:44.623804+0000","last_became_peered":"2024-05-09T00:01:44.623804+0000","last_unstale":"2024-05-09T00:02:47.836337+0000","last_undegraded":"2024-05-09T00:02:47.836337+0000","last_fullsized":"2024-05-09T00:02:47.836337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:22.366804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921602+0000","last_change":"2024-05-09T00:02:47.836307+0000","last_active":"2024-05-09T00:02:58.921602+0000","last_peered":"2024-05-09T00:02:58.921602+0000","last_clean":"2024-05-09T00:02:58.921602+0000","last_became_active":"2024-05-09T00:02:47.835948+0000","last_became_peered":"2024-05-09T00:02:47.835948+0000","last_unstale":"2024-05-09T00:02:58.921602+0000","last_undegraded":"2024-05-09T00:02:58.921602+0000","last_fullsized":"2024-05-09T00:02:58.921602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:52.582826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.835187+0000","last_change":"2024-05-09T00:01:44.620188+0000","last_active":"2024-05-09T00:02:47.835187+0000","last_peered":"2024-05-09T00:02:47.835187+0000","last_clean":"2024-05-09T00:02:47.835187+0000","last_became_active":"2024-05-09T00:01:44.619914+0000","last_became_peered":"2024-05-09T00:01:44.619914+0000","last_unstale":"2024-05-09T00:02:47.835187+0000","last_undegraded":"2024-05-09T00:02:47.835187+0000","last_fullsized":"2024-05-09T00:02:47.835187+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:50.349806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.927088+0000","last_change":"2024-05-09T00:01:45.044881+0000","last_active":"2024-05-09T00:02:58.927088+0000","last_peered":"2024-05-09T00:02:58.927088+0000","last_clean":"2024-05-09T00:02:58.927088+0000","last_became_active":"2024-05-09T00:01:45.044176+0000","last_became_peered":"2024-05-09T00:01:45.044176+0000","last_unstale":"2024-05-09T00:02:58.927088+0000","last_undegraded":"2024-05-09T00:02:58.927088+0000","last_fullsized":"2024-05-09T00:02:58.927088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:15.672966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.174413+0000","last_change":"2024-05-09T00:01:44.616560+0000","last_active":"2024-05-09T00:02:59.174413+0000","last_peered":"2024-05-09T00:02:59.174413+0000","last_clean":"2024-05-09T00:02:59.174413+0000","last_became_active":"2024-05-09T00:01:44.616172+0000","last_became_peered":"2024-05-09T00:01:44.616172+0000","last_unstale":"2024-05-09T00:02:59.174413+0000","last_undegraded":"2024-05-09T00:02:59.174413+0000","last_fullsized":"2024-05-09T00:02:59.174413+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:51.191335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917956+0000","last_change":"2024-05-09T00:02:47.836428+0000","last_active":"2024-05-09T00:02:58.917956+0000","last_peered":"2024-05-09T00:02:58.917956+0000","last_clean":"2024-05-09T00:02:58.917956+0000","last_became_active":"2024-05-09T00:02:47.836075+0000","last_became_peered":"2024-05-09T00:02:47.836075+0000","last_unstale":"2024-05-09T00:02:58.917956+0000","last_undegraded":"2024-05-09T00:02:58.917956+0000","last_fullsized":"2024-05-09T00:02:58.917956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:29:43.983172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.835384+0000","last_change":"2024-05-09T00:01:44.622089+0000","last_active":"2024-05-09T00:02:47.835384+0000","last_peered":"2024-05-09T00:02:47.835384+0000","last_clean":"2024-05-09T00:02:47.835384+0000","last_became_active":"2024-05-09T00:01:44.621731+0000","last_became_peered":"2024-05-09T00:01:44.621731+0000","last_unstale":"2024-05-09T00:02:47.835384+0000","last_undegraded":"2024-05-09T00:02:47.835384+0000","last_fullsized":"2024-05-09T00:02:47.835384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.276454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.910413+0000","last_change":"2024-05-09T00:01:45.058785+0000","last_active":"2024-05-09T00:02:58.910413+0000","last_peered":"2024-05-09T00:02:58.910413+0000","last_clean":"2024-05-09T00:02:58.910413+0000","last_became_active":"2024-05-09T00:01:45.058387+0000","last_became_peered":"2024-05-09T00:01:45.058387+0000","last_unstale":"2024-05-09T00:02:58.910413+0000","last_undegraded":"2024-05-09T00:02:58.910413+0000","last_fullsized":"2024-05-09T00:02:58.910413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:18.868021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:48.407741+0000","last_change":"2024-05-09T00:02:47.842905+0000","last_active":"2024-05-09T00:02:48.407741+0000","last_peered":"2024-05-09T00:02:48.407741+0000","last_clean":"2024-05-09T00:02:48.407741+0000","last_became_active":"2024-05-09T00:02:47.837585+0000","last_became_peered":"2024-05-09T00:02:47.837585+0000","last_unstale":"2024-05-09T00:02:48.407741+0000","last_undegraded":"2024-05-09T00:02:48.407741+0000","last_fullsized":"2024-05-09T00:02:48.407741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:14.463873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925053+0000","last_change":"2024-05-09T00:02:47.838555+0000","last_active":"2024-05-09T00:02:58.925053+0000","last_peered":"2024-05-09T00:02:58.925053+0000","last_clean":"2024-05-09T00:02:58.925053+0000","last_became_active":"2024-05-09T00:02:47.837636+0000","last_became_peered":"2024-05-09T00:02:47.837636+0000","last_unstale":"2024-05-09T00:02:58.925053+0000","last_undegraded":"2024-05-09T00:02:58.925053+0000","last_fullsized":"2024-05-09T00:02:58.925053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:30.564942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.833331+0000","last_change":"2024-05-09T00:01:44.618910+0000","last_active":"2024-05-09T00:02:47.833331+0000","last_peered":"2024-05-09T00:02:47.833331+0000","last_clean":"2024-05-09T00:02:47.833331+0000","last_became_active":"2024-05-09T00:01:44.618569+0000","last_became_peered":"2024-05-09T00:01:44.618569+0000","last_unstale":"2024-05-09T00:02:47.833331+0000","last_undegraded":"2024-05-09T00:02:47.833331+0000","last_fullsized":"2024-05-09T00:02:47.833331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:40.748747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929775+0000","last_change":"2024-05-09T00:01:45.047305+0000","last_active":"2024-05-09T00:02:58.929775+0000","last_peered":"2024-05-09T00:02:58.929775+0000","last_clean":"2024-05-09T00:02:58.929775+0000","last_became_active":"2024-05-09T00:01:45.046944+0000","last_became_peered":"2024-05-09T00:01:45.046944+0000","last_unstale":"2024-05-09T00:02:58.929775+0000","last_undegraded":"2024-05-09T00:02:58.929775+0000","last_fullsized":"2024-05-09T00:02:58.929775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:24:59.065224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.833584+0000","last_change":"2024-05-09T00:01:44.620497+0000","last_active":"2024-05-09T00:02:47.833584+0000","last_peered":"2024-05-09T00:02:47.833584+0000","last_clean":"2024-05-09T00:02:47.833584+0000","last_became_active":"2024-05-09T00:01:44.620165+0000","last_became_peered":"2024-05-09T00:01:44.620165+0000","last_unstale":"2024-05-09T00:02:47.833584+0000","last_undegraded":"2024-05-09T00:02:47.833584+0000","last_fullsized":"2024-05-09T00:02:47.833584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:44.514434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925805+0000","last_change":"2024-05-09T00:01:45.045408+0000","last_active":"2024-05-09T00:02:58.925805+0000","last_peered":"2024-05-09T00:02:58.925805+0000","last_clean":"2024-05-09T00:02:58.925805+0000","last_became_active":"2024-05-09T00:01:45.045086+0000","last_became_peered":"2024-05-09T00:01:45.045086+0000","last_unstale":"2024-05-09T00:02:58.925805+0000","last_undegraded":"2024-05-09T00:02:58.925805+0000","last_fullsized":"2024-05-09T00:02:58.925805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:54.568889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.907222+0000","last_change":"2024-05-09T00:01:45.057315+0000","last_active":"2024-05-09T00:02:58.907222+0000","last_peered":"2024-05-09T00:02:58.907222+0000","last_clean":"2024-05-09T00:02:58.907222+0000","last_became_active":"2024-05-09T00:01:45.056962+0000","last_became_peered":"2024-05-09T00:01:45.056962+0000","last_unstale":"2024-05-09T00:02:58.907222+0000","last_undegraded":"2024-05-09T00:02:58.907222+0000","last_fullsized":"2024-05-09T00:02:58.907222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:09:52.136588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.151416+0000","last_change":"2024-05-09T00:01:44.618477+0000","last_active":"2024-05-09T00:02:59.151416+0000","last_peered":"2024-05-09T00:02:59.151416+0000","last_clean":"2024-05-09T00:02:59.151416+0000","last_became_active":"2024-05-09T00:01:44.618154+0000","last_became_peered":"2024-05-09T00:01:44.618154+0000","last_unstale":"2024-05-09T00:02:59.151416+0000","last_undegraded":"2024-05-09T00:02:59.151416+0000","last_fullsized":"2024-05-09T00:02:59.151416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:24.380644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921394+0000","last_change":"2024-05-09T00:01:45.053772+0000","last_active":"2024-05-09T00:02:58.921394+0000","last_peered":"2024-05-09T00:02:58.921394+0000","last_clean":"2024-05-09T00:02:58.921394+0000","last_became_active":"2024-05-09T00:01:45.053453+0000","last_became_peered":"2024-05-09T00:01:45.053453+0000","last_unstale":"2024-05-09T00:02:58.921394+0000","last_undegraded":"2024-05-09T00:02:58.921394+0000","last_fullsized":"2024-05-09T00:02:58.921394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:46.136845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.835823+0000","last_change":"2024-05-09T00:01:44.610200+0000","last_active":"2024-05-09T00:02:47.835823+0000","last_peered":"2024-05-09T00:02:47.835823+0000","last_clean":"2024-05-09T00:02:47.835823+0000","last_became_active":"2024-05-09T00:01:44.609764+0000","last_became_peered":"2024-05-09T00:01:44.609764+0000","last_unstale":"2024-05-09T00:02:47.835823+0000","last_undegraded":"2024-05-09T00:02:47.835823+0000","last_fullsized":"2024-05-09T00:02:47.835823+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:36.122765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":334,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.834185+0000","last_change":"2024-05-09T00:00:57.898648+0000","last_active":"2024-05-09T00:02:47.834185+0000","last_peered":"2024-05-09T00:02:47.834185+0000","last_clean":"2024-05-09T00:02:47.834185+0000","last_became_active":"2024-05-09T00:00:57.898259+0000","last_became_peered":"2024-05-09T00:00:57.898259+0000","last_unstale":"2024-05-09T00:02:47.834185+0000","last_undegraded":"2024-05-09T00:02:47.834185+0000","last_fullsized":"2024-05-09T00:02:47.834185+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:58:35.200738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:58:35.200738+0000","last_clean_scrub_stamp":"2024-05-08T23:58:35.200738+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:47.782068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.919516+0000","last_change":"2024-05-09T00:01:45.035407+0000","last_active":"2024-05-09T00:02:58.919516+0000","last_peered":"2024-05-09T00:02:58.919516+0000","last_clean":"2024-05-09T00:02:58.919516+0000","last_became_active":"2024-05-09T00:01:45.035115+0000","last_became_peered":"2024-05-09T00:01:45.035115+0000","last_unstale":"2024-05-09T00:02:58.919516+0000","last_undegraded":"2024-05-09T00:02:58.919516+0000","last_fullsized":"2024-05-09T00:02:58.919516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:23.603196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.834350+0000","last_change":"2024-05-09T00:01:44.622514+0000","last_active":"2024-05-09T00:02:47.834350+0000","last_peered":"2024-05-09T00:02:47.834350+0000","last_clean":"2024-05-09T00:02:47.834350+0000","last_became_active":"2024-05-09T00:01:44.621454+0000","last_became_peered":"2024-05-09T00:01:44.621454+0000","last_unstale":"2024-05-09T00:02:47.834350+0000","last_undegraded":"2024-05-09T00:02:47.834350+0000","last_fullsized":"2024-05-09T00:02:47.834350+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:10.801721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.837046+0000","last_change":"2024-05-09T00:01:44.622743+0000","last_active":"2024-05-09T00:02:47.837046+0000","last_peered":"2024-05-09T00:02:47.837046+0000","last_clean":"2024-05-09T00:02:47.837046+0000","last_became_active":"2024-05-09T00:01:44.622304+0000","last_became_peered":"2024-05-09T00:01:44.622304+0000","last_unstale":"2024-05-09T00:02:47.837046+0000","last_undegraded":"2024-05-09T00:02:47.837046+0000","last_fullsized":"2024-05-09T00:02:47.837046+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:01.829369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921939+0000","last_change":"2024-05-09T00:01:45.035458+0000","last_active":"2024-05-09T00:02:58.921939+0000","last_peered":"2024-05-09T00:02:58.921939+0000","last_clean":"2024-05-09T00:02:58.921939+0000","last_became_active":"2024-05-09T00:01:45.035140+0000","last_became_peered":"2024-05-09T00:01:45.035140+0000","last_unstale":"2024-05-09T00:02:58.921939+0000","last_undegraded":"2024-05-09T00:02:58.921939+0000","last_fullsized":"2024-05-09T00:02:58.921939+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:02:31.258013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'40","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.109427+0000","last_change":"2024-05-09T00:01:44.615172+0000","last_active":"2024-05-09T00:02:59.109427+0000","last_peered":"2024-05-09T00:02:59.109427+0000","last_clean":"2024-05-09T00:02:59.109427+0000","last_became_active":"2024-05-09T00:01:44.614892+0000","last_became_peered":"2024-05-09T00:01:44.614892+0000","last_unstale":"2024-05-09T00:02:59.109427+0000","last_undegraded":"2024-05-09T00:02:59.109427+0000","last_fullsized":"2024-05-09T00:02:59.109427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:17.868378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":71,"num_write_kb":834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926189+0000","last_change":"2024-05-09T00:01:45.044708+0000","last_active":"2024-05-09T00:02:58.926189+0000","last_peered":"2024-05-09T00:02:58.926189+0000","last_clean":"2024-05-09T00:02:58.926189+0000","last_became_active":"2024-05-09T00:01:45.044451+0000","last_became_peered":"2024-05-09T00:01:45.044451+0000","last_unstale":"2024-05-09T00:02:58.926189+0000","last_undegraded":"2024-05-09T00:02:58.926189+0000","last_fullsized":"2024-05-09T00:02:58.926189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:16.099211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.835582+0000","last_change":"2024-05-09T00:01:44.617434+0000","last_active":"2024-05-09T00:02:47.835582+0000","last_peered":"2024-05-09T00:02:47.835582+0000","last_clean":"2024-05-09T00:02:47.835582+0000","last_became_active":"2024-05-09T00:01:44.617017+0000","last_became_peered":"2024-05-09T00:01:44.617017+0000","last_unstale":"2024-05-09T00:02:47.835582+0000","last_undegraded":"2024-05-09T00:02:47.835582+0000","last_fullsized":"2024-05-09T00:02:47.835582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.889962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929780+0000","last_change":"2024-05-09T00:01:45.035749+0000","last_active":"2024-05-09T00:02:58.929780+0000","last_peered":"2024-05-09T00:02:58.929780+0000","last_clean":"2024-05-09T00:02:58.929780+0000","last_became_active":"2024-05-09T00:01:45.034862+0000","last_became_peered":"2024-05-09T00:01:45.034862+0000","last_unstale":"2024-05-09T00:02:58.929780+0000","last_undegraded":"2024-05-09T00:02:58.929780+0000","last_fullsized":"2024-05-09T00:02:58.929780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:20.824467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.912120+0000","last_change":"2024-05-09T00:01:44.616652+0000","last_active":"2024-05-09T00:02:47.912120+0000","last_peered":"2024-05-09T00:02:47.912120+0000","last_clean":"2024-05-09T00:02:47.912120+0000","last_became_active":"2024-05-09T00:01:44.616273+0000","last_became_peered":"2024-05-09T00:01:44.616273+0000","last_unstale":"2024-05-09T00:02:47.912120+0000","last_undegraded":"2024-05-09T00:02:47.912120+0000","last_fullsized":"2024-05-09T00:02:47.912120+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:12.379909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.916820+0000","last_change":"2024-05-09T00:01:45.047020+0000","last_active":"2024-05-09T00:02:58.916820+0000","last_peered":"2024-05-09T00:02:58.916820+0000","last_clean":"2024-05-09T00:02:58.916820+0000","last_became_active":"2024-05-09T00:01:45.046813+0000","last_became_peered":"2024-05-09T00:01:45.046813+0000","last_unstale":"2024-05-09T00:02:58.916820+0000","last_undegraded":"2024-05-09T00:02:58.916820+0000","last_fullsized":"2024-05-09T00:02:58.916820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:53.042258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.911743+0000","last_change":"2024-05-09T00:01:44.610843+0000","last_active":"2024-05-09T00:02:47.911743+0000","last_peered":"2024-05-09T00:02:47.911743+0000","last_clean":"2024-05-09T00:02:47.911743+0000","last_became_active":"2024-05-09T00:01:44.610523+0000","last_became_peered":"2024-05-09T00:01:44.610523+0000","last_unstale":"2024-05-09T00:02:47.911743+0000","last_undegraded":"2024-05-09T00:02:47.911743+0000","last_fullsized":"2024-05-09T00:02:47.911743+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:58.527344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.911641+0000","last_change":"2024-05-09T00:01:45.046259+0000","last_active":"2024-05-09T00:02:58.911641+0000","last_peered":"2024-05-09T00:02:58.911641+0000","last_clean":"2024-05-09T00:02:58.911641+0000","last_became_active":"2024-05-09T00:01:45.045954+0000","last_became_peered":"2024-05-09T00:01:45.045954+0000","last_unstale":"2024-05-09T00:02:58.911641+0000","last_undegraded":"2024-05-09T00:02:58.911641+0000","last_fullsized":"2024-05-09T00:02:58.911641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:46.569934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836410+0000","last_change":"2024-05-09T00:01:44.616781+0000","last_active":"2024-05-09T00:02:47.836410+0000","last_peered":"2024-05-09T00:02:47.836410+0000","last_clean":"2024-05-09T00:02:47.836410+0000","last_became_active":"2024-05-09T00:01:44.616386+0000","last_became_peered":"2024-05-09T00:01:44.616386+0000","last_unstale":"2024-05-09T00:02:47.836410+0000","last_undegraded":"2024-05-09T00:02:47.836410+0000","last_fullsized":"2024-05-09T00:02:47.836410+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:17.073596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.927662+0000","last_change":"2024-05-09T00:01:45.046701+0000","last_active":"2024-05-09T00:02:58.927662+0000","last_peered":"2024-05-09T00:02:58.927662+0000","last_clean":"2024-05-09T00:02:58.927662+0000","last_became_active":"2024-05-09T00:01:45.046409+0000","last_became_peered":"2024-05-09T00:01:45.046409+0000","last_unstale":"2024-05-09T00:02:58.927662+0000","last_undegraded":"2024-05-09T00:02:58.927662+0000","last_fullsized":"2024-05-09T00:02:58.927662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:32.178410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836025+0000","last_change":"2024-05-09T00:01:44.623271+0000","last_active":"2024-05-09T00:02:47.836025+0000","last_peered":"2024-05-09T00:02:47.836025+0000","last_clean":"2024-05-09T00:02:47.836025+0000","last_became_active":"2024-05-09T00:01:44.622863+0000","last_became_peered":"2024-05-09T00:01:44.622863+0000","last_unstale":"2024-05-09T00:02:47.836025+0000","last_undegraded":"2024-05-09T00:02:47.836025+0000","last_fullsized":"2024-05-09T00:02:47.836025+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:58.609140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925564+0000","last_change":"2024-05-09T00:01:45.052296+0000","last_active":"2024-05-09T00:02:58.925564+0000","last_peered":"2024-05-09T00:02:58.925564+0000","last_clean":"2024-05-09T00:02:58.925564+0000","last_became_active":"2024-05-09T00:01:45.051951+0000","last_became_peered":"2024-05-09T00:01:45.051951+0000","last_unstale":"2024-05-09T00:02:58.925564+0000","last_undegraded":"2024-05-09T00:02:58.925564+0000","last_fullsized":"2024-05-09T00:02:58.925564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:46.908629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836186+0000","last_change":"2024-05-09T00:01:44.620387+0000","last_active":"2024-05-09T00:02:47.836186+0000","last_peered":"2024-05-09T00:02:47.836186+0000","last_clean":"2024-05-09T00:02:47.836186+0000","last_became_active":"2024-05-09T00:01:44.620024+0000","last_became_peered":"2024-05-09T00:01:44.620024+0000","last_unstale":"2024-05-09T00:02:47.836186+0000","last_undegraded":"2024-05-09T00:02:47.836186+0000","last_fullsized":"2024-05-09T00:02:47.836186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:31.599273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917468+0000","last_change":"2024-05-09T00:01:45.050092+0000","last_active":"2024-05-09T00:02:58.917468+0000","last_peered":"2024-05-09T00:02:58.917468+0000","last_clean":"2024-05-09T00:02:58.917468+0000","last_became_active":"2024-05-09T00:01:45.049794+0000","last_became_peered":"2024-05-09T00:01:45.049794+0000","last_unstale":"2024-05-09T00:02:58.917468+0000","last_undegraded":"2024-05-09T00:02:58.917468+0000","last_fullsized":"2024-05-09T00:02:58.917468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:56.932513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'39","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.101124+0000","last_change":"2024-05-09T00:01:44.609940+0000","last_active":"2024-05-09T00:02:59.101124+0000","last_peered":"2024-05-09T00:02:59.101124+0000","last_clean":"2024-05-09T00:02:59.101124+0000","last_became_active":"2024-05-09T00:01:44.609593+0000","last_became_peered":"2024-05-09T00:01:44.609593+0000","last_unstale":"2024-05-09T00:02:59.101124+0000","last_undegraded":"2024-05-09T00:02:59.101124+0000","last_fullsized":"2024-05-09T00:02:59.101124+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:09.671548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929505+0000","last_change":"2024-05-09T00:01:45.042533+0000","last_active":"2024-05-09T00:02:58.929505+0000","last_peered":"2024-05-09T00:02:58.929505+0000","last_clean":"2024-05-09T00:02:58.929505+0000","last_became_active":"2024-05-09T00:01:45.042155+0000","last_became_peered":"2024-05-09T00:01:45.042155+0000","last_unstale":"2024-05-09T00:02:58.929505+0000","last_undegraded":"2024-05-09T00:02:58.929505+0000","last_fullsized":"2024-05-09T00:02:58.929505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:36.519165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.831123+0000","last_change":"2024-05-09T00:01:44.617518+0000","last_active":"2024-05-09T00:02:47.831123+0000","last_peered":"2024-05-09T00:02:47.831123+0000","last_clean":"2024-05-09T00:02:47.831123+0000","last_became_active":"2024-05-09T00:01:44.617196+0000","last_became_peered":"2024-05-09T00:01:44.617196+0000","last_unstale":"2024-05-09T00:02:47.831123+0000","last_undegraded":"2024-05-09T00:02:47.831123+0000","last_fullsized":"2024-05-09T00:02:47.831123+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:47.062855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917866+0000","last_change":"2024-05-09T00:01:45.053962+0000","last_active":"2024-05-09T00:02:58.917866+0000","last_peered":"2024-05-09T00:02:58.917866+0000","last_clean":"2024-05-09T00:02:58.917866+0000","last_became_active":"2024-05-09T00:01:45.053637+0000","last_became_peered":"2024-05-09T00:01:45.053637+0000","last_unstale":"2024-05-09T00:02:58.917866+0000","last_undegraded":"2024-05-09T00:02:58.917866+0000","last_fullsized":"2024-05-09T00:02:58.917866+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:18.188806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.911544+0000","last_change":"2024-05-09T00:01:45.055532+0000","last_active":"2024-05-09T00:02:58.911544+0000","last_peered":"2024-05-09T00:02:58.911544+0000","last_clean":"2024-05-09T00:02:58.911544+0000","last_became_active":"2024-05-09T00:01:45.054939+0000","last_became_peered":"2024-05-09T00:01:45.054939+0000","last_unstale":"2024-05-09T00:02:58.911544+0000","last_undegraded":"2024-05-09T00:02:58.911544+0000","last_fullsized":"2024-05-09T00:02:58.911544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.919492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.911899+0000","last_change":"2024-05-09T00:01:45.053752+0000","last_active":"2024-05-09T00:02:58.911899+0000","last_peered":"2024-05-09T00:02:58.911899+0000","last_clean":"2024-05-09T00:02:58.911899+0000","last_became_active":"2024-05-09T00:01:45.053409+0000","last_became_peered":"2024-05-09T00:01:45.053409+0000","last_unstale":"2024-05-09T00:02:58.911899+0000","last_undegraded":"2024-05-09T00:02:58.911899+0000","last_fullsized":"2024-05-09T00:02:58.911899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:12.517211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.924846+0000","last_change":"2024-05-09T00:01:45.036145+0000","last_active":"2024-05-09T00:02:58.924846+0000","last_peered":"2024-05-09T00:02:58.924846+0000","last_clean":"2024-05-09T00:02:58.924846+0000","last_became_active":"2024-05-09T00:01:45.035839+0000","last_became_peered":"2024-05-09T00:01:45.035839+0000","last_unstale":"2024-05-09T00:02:58.924846+0000","last_undegraded":"2024-05-09T00:02:58.924846+0000","last_fullsized":"2024-05-09T00:02:58.924846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:03:17.630399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926417+0000","last_change":"2024-05-09T00:01:45.032875+0000","last_active":"2024-05-09T00:02:58.926417+0000","last_peered":"2024-05-09T00:02:58.926417+0000","last_clean":"2024-05-09T00:02:58.926417+0000","last_became_active":"2024-05-09T00:01:45.032552+0000","last_became_peered":"2024-05-09T00:01:45.032552+0000","last_unstale":"2024-05-09T00:02:58.926417+0000","last_undegraded":"2024-05-09T00:02:58.926417+0000","last_fullsized":"2024-05-09T00:02:58.926417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:17.244204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925597+0000","last_change":"2024-05-09T00:01:45.032427+0000","last_active":"2024-05-09T00:02:58.925597+0000","last_peered":"2024-05-09T00:02:58.925597+0000","last_clean":"2024-05-09T00:02:58.925597+0000","last_became_active":"2024-05-09T00:01:45.032038+0000","last_became_peered":"2024-05-09T00:01:45.032038+0000","last_unstale":"2024-05-09T00:02:58.925597+0000","last_undegraded":"2024-05-09T00:02:58.925597+0000","last_fullsized":"2024-05-09T00:02:58.925597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.495291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.909248+0000","last_change":"2024-05-09T00:01:45.053080+0000","last_active":"2024-05-09T00:02:58.909248+0000","last_peered":"2024-05-09T00:02:58.909248+0000","last_clean":"2024-05-09T00:02:58.909248+0000","last_became_active":"2024-05-09T00:01:45.052728+0000","last_became_peered":"2024-05-09T00:01:45.052728+0000","last_unstale":"2024-05-09T00:02:58.909248+0000","last_undegraded":"2024-05-09T00:02:58.909248+0000","last_fullsized":"2024-05-09T00:02:58.909248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:59.631827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.913824+0000","last_change":"2024-05-09T00:01:45.044489+0000","last_active":"2024-05-09T00:02:58.913824+0000","last_peered":"2024-05-09T00:02:58.913824+0000","last_clean":"2024-05-09T00:02:58.913824+0000","last_became_active":"2024-05-09T00:01:45.044139+0000","last_became_peered":"2024-05-09T00:01:45.044139+0000","last_unstale":"2024-05-09T00:02:58.913824+0000","last_undegraded":"2024-05-09T00:02:58.913824+0000","last_fullsized":"2024-05-09T00:02:58.913824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:57.932238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921240+0000","last_change":"2024-05-09T00:01:45.050829+0000","last_active":"2024-05-09T00:02:58.921240+0000","last_peered":"2024-05-09T00:02:58.921240+0000","last_clean":"2024-05-09T00:02:58.921240+0000","last_became_active":"2024-05-09T00:01:45.050410+0000","last_became_peered":"2024-05-09T00:01:45.050410+0000","last_unstale":"2024-05-09T00:02:58.921240+0000","last_undegraded":"2024-05-09T00:02:58.921240+0000","last_fullsized":"2024-05-09T00:02:58.921240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:08.738918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929503+0000","last_change":"2024-05-09T00:01:45.053957+0000","last_active":"2024-05-09T00:02:58.929503+0000","last_peered":"2024-05-09T00:02:58.929503+0000","last_clean":"2024-05-09T00:02:58.929503+0000","last_became_active":"2024-05-09T00:01:45.053487+0000","last_became_peered":"2024-05-09T00:01:45.053487+0000","last_unstale":"2024-05-09T00:02:58.929503+0000","last_undegraded":"2024-05-09T00:02:58.929503+0000","last_fullsized":"2024-05-09T00:02:58.929503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:35.131361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926068+0000","last_change":"2024-05-09T00:01:45.050653+0000","last_active":"2024-05-09T00:02:58.926068+0000","last_peered":"2024-05-09T00:02:58.926068+0000","last_clean":"2024-05-09T00:02:58.926068+0000","last_became_active":"2024-05-09T00:01:45.050322+0000","last_became_peered":"2024-05-09T00:01:45.050322+0000","last_unstale":"2024-05-09T00:02:58.926068+0000","last_undegraded":"2024-05-09T00:02:58.926068+0000","last_fullsized":"2024-05-09T00:02:58.926068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:11:45.137945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.901822+0000","last_change":"2024-05-09T00:01:45.044757+0000","last_active":"2024-05-09T00:02:58.901822+0000","last_peered":"2024-05-09T00:02:58.901822+0000","last_clean":"2024-05-09T00:02:58.901822+0000","last_became_active":"2024-05-09T00:01:45.044464+0000","last_became_peered":"2024-05-09T00:01:45.044464+0000","last_unstale":"2024-05-09T00:02:58.901822+0000","last_undegraded":"2024-05-09T00:02:58.901822+0000","last_fullsized":"2024-05-09T00:02:58.901822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:44.402750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926851+0000","last_change":"2024-05-09T00:01:45.044515+0000","last_active":"2024-05-09T00:02:58.926851+0000","last_peered":"2024-05-09T00:02:58.926851+0000","last_clean":"2024-05-09T00:02:58.926851+0000","last_became_active":"2024-05-09T00:01:45.044209+0000","last_became_peered":"2024-05-09T00:01:45.044209+0000","last_unstale":"2024-05-09T00:02:58.926851+0000","last_undegraded":"2024-05-09T00:02:58.926851+0000","last_fullsized":"2024-05-09T00:02:58.926851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:18.523680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.906985+0000","last_change":"2024-05-09T00:01:45.044254+0000","last_active":"2024-05-09T00:02:58.906985+0000","last_peered":"2024-05-09T00:02:58.906985+0000","last_clean":"2024-05-09T00:02:58.906985+0000","last_became_active":"2024-05-09T00:01:45.043220+0000","last_became_peered":"2024-05-09T00:01:45.043220+0000","last_unstale":"2024-05-09T00:02:58.906985+0000","last_undegraded":"2024-05-09T00:02:58.906985+0000","last_fullsized":"2024-05-09T00:02:58.906985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:39:53.986814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":106908,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595013,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":537,"num_read_kb":378,"num_write":272,"num_write_kb":1427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":989,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":1785039,"data_compressed":81480,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579928,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":892928,"data_stored":436562,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.505},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.437}]},{"osd":1,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.374}]},{"osd":2,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.497}]},{"osd":5,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.34999999999999998}]},{"osd":6,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.40899999999999997}]},{"osd":8,"last update":"Thu May 9 00:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.38600000000000001}]},{"osd":9,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.54600000000000004}]},{"osd":10,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.51400000000000001}]}]},{"osd":10,"up_from":67,"seq":287762808859,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":1060864,"data_stored":1225408,"data_compressed":46581,"data_compressed_allocated":61440,"data_compressed_original":729088,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70799999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79000000000000004,"5min":1.109,"15min":1.109},"last":0.432}]},{"osd":3,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.627,"15min":0.64000000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90200000000000002,"5min":1.022,"15min":1.022},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.85099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.371},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":1.347,"15min":1.347},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82399999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.876,"5min":1.28,"15min":1.28},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83799999999999997,"5min":1.371,"15min":1.371},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94399999999999995,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":8,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.96899999999999997,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.497},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90600000000000003,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.504}]},{"osd":9,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0269999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.77100000000000002,"15min":0.79000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85999999999999999,"5min":1.681,"15min":1.681},"last":0.55800000000000005}]},{"osd":11,"last update":"Thu May 9 00:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.61899999999999999}]}]},{"osd":9,"up_from":62,"seq":266287972383,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":929792,"data_stored":829992,"data_compressed":22077,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42599999999999999,"15min":0.42899999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57699999999999996,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.318},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57599999999999996,"15min":0.57499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":0.62,"15min":0.53400000000000003},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":11.98,"5min":11.98,"15min":11.98},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.498},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.438}]},{"osd":6,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":0.71699999999999997,"15min":0.63900000000000001},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":11.930999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.69799999999999995,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":7.1929999999999996,"5min":7.1929999999999996,"15min":7.1929999999999996},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73099999999999998,"15min":0.74299999999999999},"min":{"1min":0.48599999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1140000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.47899999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.48199999999999998}]},{"osd":8,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.036,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.60999999999999999}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70399999999999996,"15min":0.70899999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.623},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.63900000000000001}]}]},{"osd":8,"up_from":55,"seq":236223201314,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":897024,"data_stored":436343,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.60399999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73599999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.38}]},{"osd":1,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.42299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83699999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.48499999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48099999999999998,"15min":0.48299999999999998},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64600000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.495},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64500000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71499999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.44,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85299999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.54400000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.439}]},{"osd":5,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.62,"15min":0.629},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.47999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.77300000000000002,"5min":0.996,"15min":0.996},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.79700000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.503,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86599999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.754},"min":{"1min":0.56599999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.82399999999999995,"5min":1.004,"15min":1.004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.66300000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93400000000000005,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.58499999999999996}]},{"osd":9,"last update":"Thu May 9 00:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.53500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72299999999999998,"15min":0.71599999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.56899999999999995}]},{"osd":10,"last update":"Thu May 9 00:01:59 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.59599999999999997}]},{"osd":11,"last update":"Thu May 9 00:02:49 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.61799999999999999}]}]},{"osd":7,"up_from":48,"seq":206158430246,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":954368,"data_stored":1029380,"data_compressed":38567,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.376},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.443}]},{"osd":1,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.39500000000000002,"15min":0.38300000000000001},"min":{"1min":0.28699999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.31900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.314}]},{"osd":2,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80600000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.84399999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73599999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76000000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.29999999999999999}]},{"osd":5,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.626,"15min":0.62},"min":{"1min":0.49399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82899999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.502,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84799999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93000000000000005,"5min":1.032,"15min":1.032},"last":0.496}]},{"osd":8,"last update":"Thu May 9 00:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67400000000000004,"15min":0.67200000000000004},"min":{"1min":0.52900000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84199999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68200000000000005,"15min":0.67500000000000004},"min":{"1min":0.55600000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85199999999999998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.433}]},{"osd":9,"last update":"Thu May 9 00:02:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82799999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71399999999999997,"15min":0.72299999999999998},"min":{"1min":0.51500000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.77500000000000002,"5min":1.258,"15min":1.258},"last":0.52000000000000002}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.53000000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.874,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.56100000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.81599999999999995,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56100000000000005}]},{"osd":11,"last update":"Thu May 9 00:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58599999999999997}]}]},{"osd":6,"up_from":43,"seq":184683593770,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":892928,"data_stored":436165,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.377,"15min":0.38600000000000001},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.40200000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.38700000000000001,"15min":0.39800000000000002},"min":{"1min":0.26400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.45800000000000002,"5min":0.62,"15min":0.62},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76700000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.35999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68400000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65600000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.59699999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.41499999999999998,"15min":0.42799999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.42599999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.48199999999999998,"15min":0.495},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.505,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.499}]},{"osd":4,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64900000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76100000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70299999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.626,"15min":0.64800000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.68600000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86699999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.622},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.497,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.63200000000000001}]},{"osd":8,"last update":"Thu May 9 00:02:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66700000000000004,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90500000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.73299999999999998}]},{"osd":9,"last update":"Thu May 9 00:02:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.64400000000000002,"15min":0.67000000000000004},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.61299999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.503,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72999999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.79000000000000004}]},{"osd":10,"last update":"Thu May 9 00:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.77700000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67400000000000004,"15min":0.68500000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79200000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":954368,"data_stored":501400,"data_compressed":4789,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:24 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.32900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72999999999999998,"5min":0.752,"15min":0.752},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu May 9 00:02:40 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.53200000000000003,"15min":0.504},"min":{"1min":0.45800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.753,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.55800000000000005,"15min":0.52400000000000002},"min":{"1min":0.58199999999999996,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.38200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu May 9 00:02:17 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.434,"15min":0.40999999999999998},"min":{"1min":0.32300000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.42299999999999999},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.39900000000000002}]},{"osd":5,"last update":"Thu May 9 00:02:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56999999999999995,"15min":0.54700000000000004},"min":{"1min":0.48899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79800000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91800000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.57599999999999996},"min":{"1min":0.436,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76600000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.438}]},{"osd":7,"last update":"Thu May 9 00:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.36599999999999999}]},{"osd":8,"last update":"Thu May 9 00:02:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.55400000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85899999999999999,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.52600000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.53700000000000003}]},{"osd":9,"last update":"Thu May 9 00:02:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91100000000000003,"5min":1.02,"15min":1.02},"last":0.63},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70699999999999996,"15min":0.70999999999999996},"min":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92200000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.622}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64900000000000002,"15min":0.64200000000000002},"min":{"1min":0.498,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89200000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.498},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.5,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86399999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56299999999999994}]},{"osd":11,"last update":"Thu May 9 00:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.65800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":913408,"data_stored":437436,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 9 00:02:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52700000000000002,"15min":0.49099999999999999},"min":{"1min":0.40999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.752,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54400000000000004,"15min":0.51200000000000001},"min":{"1min":0.46600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu May 9 00:02:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.50800000000000001},"min":{"1min":0.433,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67100000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52400000000000002,"15min":0.504},"min":{"1min":0.36899999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68300000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu May 9 00:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.438}]},{"osd":4,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.625},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.72399999999999998,"5min":1.075,"15min":1.075},"last":0.747}]},{"osd":5,"last update":"Thu May 9 00:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.53400000000000003,"15min":0.51400000000000001},"min":{"1min":0.442,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72499999999999998,"5min":0.748,"15min":0.748},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55300000000000005,"15min":0.54200000000000004},"min":{"1min":0.41199999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66300000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu May 9 00:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.46600000000000003,"15min":0.47999999999999998},"min":{"1min":0.29299999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.52500000000000002,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48899999999999999,"15min":0.49399999999999999},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59599999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.56100000000000005}]},{"osd":8,"last update":"Thu May 9 00:02:28 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.433,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77700000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.67200000000000004,"15min":0.68200000000000005},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72799999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.57999999999999996}]},{"osd":9,"last update":"Thu May 9 00:02:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.61499999999999999,"5min":1.038,"15min":1.038},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.67500000000000004,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.36499999999999999}]},{"osd":10,"last update":"Thu May 9 00:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.71099999999999997,"5min":1.123,"15min":1.123},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.69799999999999995,"15min":0.71099999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84199999999999997,"5min":1.121,"15min":1.121},"last":0.84199999999999997}]},{"osd":11,"last update":"Thu May 9 00:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.76400000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444088,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":501509,"data_compressed":4789,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.35099999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70399999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.502,"15min":0.47799999999999998},"min":{"1min":0.39600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78600000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu May 9 00:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.53100000000000003,"15min":0.51400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71799999999999997,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.53500000000000003,"15min":0.495},"min":{"1min":0.372,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.315}]},{"osd":3,"last update":"Thu May 9 00:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.42699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.745,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.432},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.51100000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.377}]},{"osd":5,"last update":"Thu May 9 00:02:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.47499999999999998,"15min":0.443},"min":{"1min":0.38300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.48699999999999999,"15min":0.45800000000000002},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79800000000000004,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.36099999999999999}]},{"osd":6,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.439,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.38900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.502}]},{"osd":7,"last update":"Thu May 9 00:01:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67100000000000004}]},{"osd":8,"last update":"Thu May 9 00:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.54500000000000004,"15min":0.53000000000000003},"min":{"1min":0.32200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45300000000000001}]},{"osd":9,"last update":"Thu May 9 00:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.59199999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88400000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.57699999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90900000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56000000000000005}]},{"osd":10,"last update":"Thu May 9 00:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.53400000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91600000000000004,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48099999999999998}]},{"osd":11,"last update":"Thu May 9 00:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.51500000000000001}]}]},{"osd":3,"up_from":24,"seq":103079215156,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":954368,"data_stored":961292,"data_compressed":28233,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.33400000000000002},"min":{"1min":0.26600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.497,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.28699999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48699999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.438}]},{"osd":1,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.51600000000000001},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.371}]},{"osd":2,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.433,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70499999999999996,"5min":1.075,"15min":1.075},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55900000000000005,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63700000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu May 9 00:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57999999999999996,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.49399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67400000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.501}]},{"osd":6,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.34799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55700000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32700000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu May 9 00:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.47099999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69899999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51400000000000001}]},{"osd":8,"last update":"Thu May 9 00:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.46700000000000003}]},{"osd":9,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.54300000000000004}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82499999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.56699999999999995}]},{"osd":11,"last update":"Thu May 9 00:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.49399999999999999}]}]},{"osd":4,"up_from":31,"seq":133143986225,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":905216,"data_stored":438369,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.39400000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79800000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.371,"15min":0.35299999999999998},"min":{"1min":0.312,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.378,"15min":0.36499999999999999},"min":{"1min":0.28299999999999997,"5min":0.215,"15min":0.215},"max":{"1min":0.64000000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.318}]},{"osd":2,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.54500000000000004,"15min":0.51500000000000001},"min":{"1min":0.39900000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.54100000000000004,"15min":0.50700000000000001},"min":{"1min":0.40400000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.433}]},{"osd":5,"last update":"Thu May 9 00:02:29 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83499999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.627,"15min":0.59899999999999998},"min":{"1min":0.49299999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89900000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu May 9 00:02:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57199999999999995,"15min":0.56299999999999994},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76600000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu May 9 00:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.46800000000000003}]},{"osd":8,"last update":"Thu May 9 00:02:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71199999999999997,"15min":0.71699999999999997},"min":{"1min":0.43099999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.871,"5min":1.484,"15min":1.484},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.52000000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.84399999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.501}]},{"osd":9,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73799999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.876,"5min":1.417,"15min":1.417},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.89000000000000001,"5min":1.038,"15min":1.038},"last":0.54800000000000004}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":1.103,"15min":1.103},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.53700000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96899999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.55800000000000005}]},{"osd":11,"last update":"Thu May 9 00:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.58899999999999997}]}]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":987136,"data_stored":1160319,"data_compressed":44723,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64600000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66500000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.42199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.5}]},{"osd":2,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.37,"15min":0.35199999999999998},"min":{"1min":0.29299999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.62,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.307},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.372},"min":{"1min":0.28399999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.501},"min":{"1min":0.35799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73799999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.373},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.51200000000000001},"min":{"1min":0.40400000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.79500000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.441}]},{"osd":4,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.55200000000000005,"15min":0.53200000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.501,"5min":0.376,"15min":0.376},"max":{"1min":0.68100000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.53900000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69199999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu May 9 00:02:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.59599999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47999999999999998}]},{"osd":8,"last update":"Thu May 9 00:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.39800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83499999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40200000000000002}]},{"osd":9,"last update":"Thu May 9 00:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.53000000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.432},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66400000000000003,"15min":0.65500000000000003},"min":{"1min":0.59099999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52400000000000002}]},{"osd":10,"last update":"Thu May 9 00:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":65442,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66170,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":133876,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393932,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":198965,"data_compressed":8014,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:03:05.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:03:05.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.242+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2084293894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540fff40 msgr2=0x7f3d54100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:05.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.242+0000 7f3d59ac3700 1 --2- 172.21.15.81:0/2084293894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540fff40 0x7f3d54100320 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3d48009990 tx=0x7f3d48009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.242+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2084293894 shutdown_connections 2024-05-09T00:03:05.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.242+0000 7f3d59ac3700 1 --2- 172.21.15.81:0/2084293894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d54105060 0x7f3d5410cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.242+0000 7f3d59ac3700 1 --2- 172.21.15.81:0/2084293894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d540fff40 0x7f3d54100320 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.242+0000 7f3d59ac3700 1 --2- 172.21.15.81:0/2084293894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d541008f0 0x7f3d54104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.242+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2084293894 >> 172.21.15.81:0/2084293894 conn(0x7f3d540fb7e0 msgr2=0x7f3d540fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:05.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.242+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2084293894 shutdown_connections 2024-05-09T00:03:05.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.242+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2084293894 wait complete. 2024-05-09T00:03:05.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.242+0000 7f3d59ac3700 1 Processor -- start 2024-05-09T00:03:05.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d59ac3700 1 -- start start 2024-05-09T00:03:05.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d59ac3700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d540fff40 0x7f3d54196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:05.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d59ac3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d54105060 0x7f3d541967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:05.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d59ac3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d5419aaf0 0x7f3d5419af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:05.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d59ac3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5419b570 con 0x7f3d54105060 2024-05-09T00:03:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d59ac3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5419b6e0 con 0x7f3d5419aaf0 2024-05-09T00:03:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d59ac3700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5419b8a0 con 0x7f3d540fff40 2024-05-09T00:03:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d52ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d54105060 0x7f3d541967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d52ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d54105060 0x7f3d541967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58192/0 (socket says 172.21.15.81:58192) 2024-05-09T00:03:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d52ffd700 1 -- 172.21.15.81:0/2272455321 learned_addr learned my addr 172.21.15.81:0/2272455321 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d537fe700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d540fff40 0x7f3d54196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d53fff700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d5419aaf0 0x7f3d5419af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d537fe700 1 -- 172.21.15.81:0/2272455321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d5419aaf0 msgr2=0x7f3d5419af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d537fe700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d5419aaf0 0x7f3d5419af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d537fe700 1 -- 172.21.15.81:0/2272455321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d54105060 msgr2=0x7f3d541967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d537fe700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d54105060 0x7f3d541967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d537fe700 1 -- 172.21.15.81:0/2272455321 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d480095f0 con 0x7f3d540fff40 2024-05-09T00:03:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d53fff700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d5419aaf0 0x7f3d5419af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d52ffd700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d54105060 0x7f3d541967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:03:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.243+0000 7f3d537fe700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d540fff40 0x7f3d54196260 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3d480059d0 tx=0x7f3d48004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.244+0000 7f3d50ff9700 1 -- 172.21.15.81:0/2272455321 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4801d070 con 0x7f3d540fff40 2024-05-09T00:03:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.244+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2272455321 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d541a2da0 con 0x7f3d540fff40 2024-05-09T00:03:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.244+0000 7f3d50ff9700 1 -- 172.21.15.81:0/2272455321 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d48022470 con 0x7f3d540fff40 2024-05-09T00:03:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.244+0000 7f3d50ff9700 1 -- 172.21.15.81:0/2272455321 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48017650 con 0x7f3d540fff40 2024-05-09T00:03:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.244+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2272455321 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d541a31c0 con 0x7f3d540fff40 2024-05-09T00:03:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.245+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2272455321 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d541082d0 con 0x7f3d540fff40 2024-05-09T00:03:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.246+0000 7f3d50ff9700 1 -- 172.21.15.81:0/2272455321 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f3d48022870 con 0x7f3d540fff40 2024-05-09T00:03:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.246+0000 7f3d50ff9700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3d3c0a13b0 0x7f3d3c0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.246+0000 7f3d52ffd700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3d3c0a13b0 0x7f3d3c0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.246+0000 7f3d50ff9700 1 -- 172.21.15.81:0/2272455321 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f3d480ce260 con 0x7f3d540fff40 2024-05-09T00:03:05.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.247+0000 7f3d52ffd700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3d3c0a13b0 0x7f3d3c0a3870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d54197760 tx=0x7f3d44009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:05.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.250+0000 7f3d50ff9700 1 -- 172.21.15.81:0/2272455321 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3d480974f0 con 0x7f3d540fff40 2024-05-09T00:03:05.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.442+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2272455321 --> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d54100860 con 0x7f3d3c0a13b0 2024-05-09T00:03:05.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.452+0000 7f3d50ff9700 1 -- 172.21.15.81:0/2272455321 <== mgr.15285 v2:172.21.15.81:6800/2111088526 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343285 (secure 0 0 0) 0x7f3d54100860 con 0x7f3d3c0a13b0 2024-05-09T00:03:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:03:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.455+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2272455321 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3d3c0a13b0 msgr2=0x7f3d3c0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.455+0000 7f3d59ac3700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3d3c0a13b0 0x7f3d3c0a3870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3d54197760 tx=0x7f3d44009260 comp rx=0 tx=0).stop 2024-05-09T00:03:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.455+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2272455321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d540fff40 msgr2=0x7f3d54196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.455+0000 7f3d59ac3700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d540fff40 0x7f3d54196260 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3d480059d0 tx=0x7f3d48004730 comp rx=0 tx=0).stop 2024-05-09T00:03:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.455+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2272455321 shutdown_connections 2024-05-09T00:03:05.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.455+0000 7f3d59ac3700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f3d3c0a13b0 0x7f3d3c0a3870 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.455+0000 7f3d59ac3700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3d5419aaf0 0x7f3d5419af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.455+0000 7f3d59ac3700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3d540fff40 0x7f3d54196260 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.455+0000 7f3d59ac3700 1 --2- 172.21.15.81:0/2272455321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3d54105060 0x7f3d541967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.455+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2272455321 >> 172.21.15.81:0/2272455321 conn(0x7f3d540fb7e0 msgr2=0x7f3d540fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.455+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2272455321 shutdown_connections 2024-05-09T00:03:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.455+0000 7f3d59ac3700 1 -- 172.21.15.81:0/2272455321 wait complete. 2024-05-09T00:03:05.455 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-09T00:03:05.461 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-05-09T00:03:04.882662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185615,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":673,"num_read_kb":497,"num_write":455,"num_write_kb":4367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1181725,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376244,"kb_used_data":11044,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124565580,"statfs":{"total":1151940427776,"available":1151555153920,"internally_reserved":0,"allocated":11309056,"data_stored":8394175,"data_compressed":204414,"data_compressed_allocated":270336,"data_compressed_original":3047424,"omap_allocated":19131,"internal_metadata":373798213},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.990706"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.909563+0000","last_change":"2024-05-09T00:01:45.048606+0000","last_active":"2024-05-09T00:02:58.909563+0000","last_peered":"2024-05-09T00:02:58.909563+0000","last_clean":"2024-05-09T00:02:58.909563+0000","last_became_active":"2024-05-09T00:01:45.047691+0000","last_became_peered":"2024-05-09T00:01:45.047691+0000","last_unstale":"2024-05-09T00:02:58.909563+0000","last_undegraded":"2024-05-09T00:02:58.909563+0000","last_fullsized":"2024-05-09T00:02:58.909563+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:03.881912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.920179+0000","last_change":"2024-05-09T00:01:45.046812+0000","last_active":"2024-05-09T00:02:58.920179+0000","last_peered":"2024-05-09T00:02:58.920179+0000","last_clean":"2024-05-09T00:02:58.920179+0000","last_became_active":"2024-05-09T00:01:45.046510+0000","last_became_peered":"2024-05-09T00:01:45.046510+0000","last_unstale":"2024-05-09T00:02:58.920179+0000","last_undegraded":"2024-05-09T00:02:58.920179+0000","last_fullsized":"2024-05-09T00:02:58.920179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:03.614974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925132+0000","last_change":"2024-05-09T00:01:45.040304+0000","last_active":"2024-05-09T00:02:58.925132+0000","last_peered":"2024-05-09T00:02:58.925132+0000","last_clean":"2024-05-09T00:02:58.925132+0000","last_became_active":"2024-05-09T00:01:45.039990+0000","last_became_peered":"2024-05-09T00:01:45.039990+0000","last_unstale":"2024-05-09T00:02:58.925132+0000","last_undegraded":"2024-05-09T00:02:58.925132+0000","last_fullsized":"2024-05-09T00:02:58.925132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:17:33.563999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.913271+0000","last_change":"2024-05-09T00:01:45.040528+0000","last_active":"2024-05-09T00:02:58.913271+0000","last_peered":"2024-05-09T00:02:58.913271+0000","last_clean":"2024-05-09T00:02:58.913271+0000","last_became_active":"2024-05-09T00:01:45.040100+0000","last_became_peered":"2024-05-09T00:01:45.040100+0000","last_unstale":"2024-05-09T00:02:58.913271+0000","last_undegraded":"2024-05-09T00:02:58.913271+0000","last_fullsized":"2024-05-09T00:02:58.913271+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:02.739346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.922977+0000","last_change":"2024-05-09T00:01:45.036192+0000","last_active":"2024-05-09T00:02:58.922977+0000","last_peered":"2024-05-09T00:02:58.922977+0000","last_clean":"2024-05-09T00:02:58.922977+0000","last_became_active":"2024-05-09T00:01:45.035845+0000","last_became_peered":"2024-05-09T00:01:45.035845+0000","last_unstale":"2024-05-09T00:02:58.922977+0000","last_undegraded":"2024-05-09T00:02:58.922977+0000","last_fullsized":"2024-05-09T00:02:58.922977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:25.494946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.920477+0000","last_change":"2024-05-09T00:01:45.047866+0000","last_active":"2024-05-09T00:02:58.920477+0000","last_peered":"2024-05-09T00:02:58.920477+0000","last_clean":"2024-05-09T00:02:58.920477+0000","last_became_active":"2024-05-09T00:01:45.047549+0000","last_became_peered":"2024-05-09T00:01:45.047549+0000","last_unstale":"2024-05-09T00:02:58.920477+0000","last_undegraded":"2024-05-09T00:02:58.920477+0000","last_fullsized":"2024-05-09T00:02:58.920477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:34:33.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917257+0000","last_change":"2024-05-09T00:01:45.054246+0000","last_active":"2024-05-09T00:02:58.917257+0000","last_peered":"2024-05-09T00:02:58.917257+0000","last_clean":"2024-05-09T00:02:58.917257+0000","last_became_active":"2024-05-09T00:01:45.053863+0000","last_became_peered":"2024-05-09T00:01:45.053863+0000","last_unstale":"2024-05-09T00:02:58.917257+0000","last_undegraded":"2024-05-09T00:02:58.917257+0000","last_fullsized":"2024-05-09T00:02:58.917257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:12.080139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929596+0000","last_change":"2024-05-09T00:01:45.053747+0000","last_active":"2024-05-09T00:02:58.929596+0000","last_peered":"2024-05-09T00:02:58.929596+0000","last_clean":"2024-05-09T00:02:58.929596+0000","last_became_active":"2024-05-09T00:01:45.053461+0000","last_became_peered":"2024-05-09T00:01:45.053461+0000","last_unstale":"2024-05-09T00:02:58.929596+0000","last_undegraded":"2024-05-09T00:02:58.929596+0000","last_fullsized":"2024-05-09T00:02:58.929596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:30.018296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.916352+0000","last_change":"2024-05-09T00:01:45.053851+0000","last_active":"2024-05-09T00:02:58.916352+0000","last_peered":"2024-05-09T00:02:58.916352+0000","last_clean":"2024-05-09T00:02:58.916352+0000","last_became_active":"2024-05-09T00:01:45.053471+0000","last_became_peered":"2024-05-09T00:01:45.053471+0000","last_unstale":"2024-05-09T00:02:58.916352+0000","last_undegraded":"2024-05-09T00:02:58.916352+0000","last_fullsized":"2024-05-09T00:02:58.916352+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:25.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.920307+0000","last_change":"2024-05-09T00:01:45.048916+0000","last_active":"2024-05-09T00:02:58.920307+0000","last_peered":"2024-05-09T00:02:58.920307+0000","last_clean":"2024-05-09T00:02:58.920307+0000","last_became_active":"2024-05-09T00:01:45.048227+0000","last_became_peered":"2024-05-09T00:01:45.048227+0000","last_unstale":"2024-05-09T00:02:58.920307+0000","last_undegraded":"2024-05-09T00:02:58.920307+0000","last_fullsized":"2024-05-09T00:02:58.920307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:51.246933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.914098+0000","last_change":"2024-05-09T00:01:45.053449+0000","last_active":"2024-05-09T00:02:58.914098+0000","last_peered":"2024-05-09T00:02:58.914098+0000","last_clean":"2024-05-09T00:02:58.914098+0000","last_became_active":"2024-05-09T00:01:45.053060+0000","last_became_peered":"2024-05-09T00:01:45.053060+0000","last_unstale":"2024-05-09T00:02:58.914098+0000","last_undegraded":"2024-05-09T00:02:58.914098+0000","last_fullsized":"2024-05-09T00:02:58.914098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:21.236565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921190+0000","last_change":"2024-05-09T00:01:45.047231+0000","last_active":"2024-05-09T00:02:58.921190+0000","last_peered":"2024-05-09T00:02:58.921190+0000","last_clean":"2024-05-09T00:02:58.921190+0000","last_became_active":"2024-05-09T00:01:45.046897+0000","last_became_peered":"2024-05-09T00:01:45.046897+0000","last_unstale":"2024-05-09T00:02:58.921190+0000","last_undegraded":"2024-05-09T00:02:58.921190+0000","last_fullsized":"2024-05-09T00:02:58.921190+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:13.307931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925844+0000","last_change":"2024-05-09T00:01:45.048545+0000","last_active":"2024-05-09T00:02:58.925844+0000","last_peered":"2024-05-09T00:02:58.925844+0000","last_clean":"2024-05-09T00:02:58.925844+0000","last_became_active":"2024-05-09T00:01:45.048237+0000","last_became_peered":"2024-05-09T00:01:45.048237+0000","last_unstale":"2024-05-09T00:02:58.925844+0000","last_undegraded":"2024-05-09T00:02:58.925844+0000","last_fullsized":"2024-05-09T00:02:58.925844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:45:41.578704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.924801+0000","last_change":"2024-05-09T00:01:45.046735+0000","last_active":"2024-05-09T00:02:58.924801+0000","last_peered":"2024-05-09T00:02:58.924801+0000","last_clean":"2024-05-09T00:02:58.924801+0000","last_became_active":"2024-05-09T00:01:45.046441+0000","last_became_peered":"2024-05-09T00:01:45.046441+0000","last_unstale":"2024-05-09T00:02:58.924801+0000","last_undegraded":"2024-05-09T00:02:58.924801+0000","last_fullsized":"2024-05-09T00:02:58.924801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:51.380665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926317+0000","last_change":"2024-05-09T00:01:45.036289+0000","last_active":"2024-05-09T00:02:58.926317+0000","last_peered":"2024-05-09T00:02:58.926317+0000","last_clean":"2024-05-09T00:02:58.926317+0000","last_became_active":"2024-05-09T00:01:45.035996+0000","last_became_peered":"2024-05-09T00:01:45.035996+0000","last_unstale":"2024-05-09T00:02:58.926317+0000","last_undegraded":"2024-05-09T00:02:58.926317+0000","last_fullsized":"2024-05-09T00:02:58.926317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:52.769668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.901458+0000","last_change":"2024-05-09T00:01:45.044908+0000","last_active":"2024-05-09T00:02:58.901458+0000","last_peered":"2024-05-09T00:02:58.901458+0000","last_clean":"2024-05-09T00:02:58.901458+0000","last_became_active":"2024-05-09T00:01:45.044508+0000","last_became_peered":"2024-05-09T00:01:45.044508+0000","last_unstale":"2024-05-09T00:02:58.901458+0000","last_undegraded":"2024-05-09T00:02:58.901458+0000","last_fullsized":"2024-05-09T00:02:58.901458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:02:23.578743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.910112+0000","last_change":"2024-05-09T00:01:45.048389+0000","last_active":"2024-05-09T00:02:58.910112+0000","last_peered":"2024-05-09T00:02:58.910112+0000","last_clean":"2024-05-09T00:02:58.910112+0000","last_became_active":"2024-05-09T00:01:45.047959+0000","last_became_peered":"2024-05-09T00:01:45.047959+0000","last_unstale":"2024-05-09T00:02:58.910112+0000","last_undegraded":"2024-05-09T00:02:58.910112+0000","last_fullsized":"2024-05-09T00:02:58.910112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:44.298296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.919072+0000","last_change":"2024-05-09T00:01:45.048314+0000","last_active":"2024-05-09T00:02:58.919072+0000","last_peered":"2024-05-09T00:02:58.919072+0000","last_clean":"2024-05-09T00:02:58.919072+0000","last_became_active":"2024-05-09T00:01:45.048002+0000","last_became_peered":"2024-05-09T00:01:45.048002+0000","last_unstale":"2024-05-09T00:02:58.919072+0000","last_undegraded":"2024-05-09T00:02:58.919072+0000","last_fullsized":"2024-05-09T00:02:58.919072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:36.327498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925163+0000","last_change":"2024-05-09T00:01:45.035747+0000","last_active":"2024-05-09T00:02:58.925163+0000","last_peered":"2024-05-09T00:02:58.925163+0000","last_clean":"2024-05-09T00:02:58.925163+0000","last_became_active":"2024-05-09T00:01:45.035122+0000","last_became_peered":"2024-05-09T00:01:45.035122+0000","last_unstale":"2024-05-09T00:02:58.925163+0000","last_undegraded":"2024-05-09T00:02:58.925163+0000","last_fullsized":"2024-05-09T00:02:58.925163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:21.361033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.833443+0000","last_change":"2024-05-09T00:01:44.620816+0000","last_active":"2024-05-09T00:02:47.833443+0000","last_peered":"2024-05-09T00:02:47.833443+0000","last_clean":"2024-05-09T00:02:47.833443+0000","last_became_active":"2024-05-09T00:01:44.620524+0000","last_became_peered":"2024-05-09T00:01:44.620524+0000","last_unstale":"2024-05-09T00:02:47.833443+0000","last_undegraded":"2024-05-09T00:02:47.833443+0000","last_fullsized":"2024-05-09T00:02:47.833443+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:05.623111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.922725+0000","last_change":"2024-05-09T00:01:45.049115+0000","last_active":"2024-05-09T00:02:58.922725+0000","last_peered":"2024-05-09T00:02:58.922725+0000","last_clean":"2024-05-09T00:02:58.922725+0000","last_became_active":"2024-05-09T00:01:45.048825+0000","last_became_peered":"2024-05-09T00:01:45.048825+0000","last_unstale":"2024-05-09T00:02:58.922725+0000","last_undegraded":"2024-05-09T00:02:58.922725+0000","last_fullsized":"2024-05-09T00:02:58.922725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:09:29.890090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.912390+0000","last_change":"2024-05-09T00:01:44.621711+0000","last_active":"2024-05-09T00:02:47.912390+0000","last_peered":"2024-05-09T00:02:47.912390+0000","last_clean":"2024-05-09T00:02:47.912390+0000","last_became_active":"2024-05-09T00:01:44.621433+0000","last_became_peered":"2024-05-09T00:01:44.621433+0000","last_unstale":"2024-05-09T00:02:47.912390+0000","last_undegraded":"2024-05-09T00:02:47.912390+0000","last_fullsized":"2024-05-09T00:02:47.912390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:57.451467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926717+0000","last_change":"2024-05-09T00:01:45.038415+0000","last_active":"2024-05-09T00:02:58.926717+0000","last_peered":"2024-05-09T00:02:58.926717+0000","last_clean":"2024-05-09T00:02:58.926717+0000","last_became_active":"2024-05-09T00:01:45.038141+0000","last_became_peered":"2024-05-09T00:01:45.038141+0000","last_unstale":"2024-05-09T00:02:58.926717+0000","last_undegraded":"2024-05-09T00:02:58.926717+0000","last_fullsized":"2024-05-09T00:02:58.926717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:37.772886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:48.407709+0000","last_change":"2024-05-09T00:02:47.920115+0000","last_active":"2024-05-09T00:02:48.407709+0000","last_peered":"2024-05-09T00:02:48.407709+0000","last_clean":"2024-05-09T00:02:48.407709+0000","last_became_active":"2024-05-09T00:02:47.913365+0000","last_became_peered":"2024-05-09T00:02:47.913365+0000","last_unstale":"2024-05-09T00:02:48.407709+0000","last_undegraded":"2024-05-09T00:02:48.407709+0000","last_fullsized":"2024-05-09T00:02:48.407709+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.930857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925715+0000","last_change":"2024-05-09T00:01:45.048553+0000","last_active":"2024-05-09T00:02:58.925715+0000","last_peered":"2024-05-09T00:02:58.925715+0000","last_clean":"2024-05-09T00:02:58.925715+0000","last_became_active":"2024-05-09T00:01:45.046659+0000","last_became_peered":"2024-05-09T00:01:45.046659+0000","last_unstale":"2024-05-09T00:02:58.925715+0000","last_undegraded":"2024-05-09T00:02:58.925715+0000","last_fullsized":"2024-05-09T00:02:58.925715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:19.581843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836573+0000","last_change":"2024-05-09T00:01:44.614820+0000","last_active":"2024-05-09T00:02:47.836573+0000","last_peered":"2024-05-09T00:02:47.836573+0000","last_clean":"2024-05-09T00:02:47.836573+0000","last_became_active":"2024-05-09T00:01:44.614418+0000","last_became_peered":"2024-05-09T00:01:44.614418+0000","last_unstale":"2024-05-09T00:02:47.836573+0000","last_undegraded":"2024-05-09T00:02:47.836573+0000","last_fullsized":"2024-05-09T00:02:47.836573+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:18.133098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.914191+0000","last_change":"2024-05-09T00:02:47.913822+0000","last_active":"2024-05-09T00:02:58.914191+0000","last_peered":"2024-05-09T00:02:58.914191+0000","last_clean":"2024-05-09T00:02:58.914191+0000","last_became_active":"2024-05-09T00:02:47.913375+0000","last_became_peered":"2024-05-09T00:02:47.913375+0000","last_unstale":"2024-05-09T00:02:58.914191+0000","last_undegraded":"2024-05-09T00:02:58.914191+0000","last_fullsized":"2024-05-09T00:02:58.914191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:12.486856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":113,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.855099+0000","last_change":"2024-05-09T00:02:47.845264+0000","last_active":"2024-05-09T00:02:59.855099+0000","last_peered":"2024-05-09T00:02:59.855099+0000","last_clean":"2024-05-09T00:02:59.855099+0000","last_became_active":"2024-05-09T00:02:47.837967+0000","last_became_peered":"2024-05-09T00:02:47.837967+0000","last_unstale":"2024-05-09T00:02:59.855099+0000","last_undegraded":"2024-05-09T00:02:59.855099+0000","last_fullsized":"2024-05-09T00:02:59.855099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:52.606544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":967,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.912254+0000","last_change":"2024-05-09T00:01:45.049365+0000","last_active":"2024-05-09T00:02:58.912254+0000","last_peered":"2024-05-09T00:02:58.912254+0000","last_clean":"2024-05-09T00:02:58.912254+0000","last_became_active":"2024-05-09T00:01:45.049037+0000","last_became_peered":"2024-05-09T00:01:45.049037+0000","last_unstale":"2024-05-09T00:02:58.912254+0000","last_undegraded":"2024-05-09T00:02:58.912254+0000","last_fullsized":"2024-05-09T00:02:58.912254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:34.290672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.831655+0000","last_change":"2024-05-09T00:01:44.617212+0000","last_active":"2024-05-09T00:02:47.831655+0000","last_peered":"2024-05-09T00:02:47.831655+0000","last_clean":"2024-05-09T00:02:47.831655+0000","last_became_active":"2024-05-09T00:01:44.616898+0000","last_became_peered":"2024-05-09T00:01:44.616898+0000","last_unstale":"2024-05-09T00:02:47.831655+0000","last_undegraded":"2024-05-09T00:02:47.831655+0000","last_fullsized":"2024-05-09T00:02:47.831655+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:39.630039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917773+0000","last_change":"2024-05-09T00:02:47.912964+0000","last_active":"2024-05-09T00:02:58.917773+0000","last_peered":"2024-05-09T00:02:58.917773+0000","last_clean":"2024-05-09T00:02:58.917773+0000","last_became_active":"2024-05-09T00:02:47.912523+0000","last_became_peered":"2024-05-09T00:02:47.912523+0000","last_unstale":"2024-05-09T00:02:58.917773+0000","last_undegraded":"2024-05-09T00:02:58.917773+0000","last_fullsized":"2024-05-09T00:02:58.917773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:49.437293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,3],"acting":[9,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.830682+0000","last_change":"2024-05-09T00:01:44.618214+0000","last_active":"2024-05-09T00:02:47.830682+0000","last_peered":"2024-05-09T00:02:47.830682+0000","last_clean":"2024-05-09T00:02:47.830682+0000","last_became_active":"2024-05-09T00:01:44.617769+0000","last_became_peered":"2024-05-09T00:01:44.617769+0000","last_unstale":"2024-05-09T00:02:47.830682+0000","last_undegraded":"2024-05-09T00:02:47.830682+0000","last_fullsized":"2024-05-09T00:02:47.830682+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:43.654597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.927185+0000","last_change":"2024-05-09T00:01:45.037441+0000","last_active":"2024-05-09T00:02:58.927185+0000","last_peered":"2024-05-09T00:02:58.927185+0000","last_clean":"2024-05-09T00:02:58.927185+0000","last_became_active":"2024-05-09T00:01:45.036668+0000","last_became_peered":"2024-05-09T00:01:45.036668+0000","last_unstale":"2024-05-09T00:02:58.927185+0000","last_undegraded":"2024-05-09T00:02:58.927185+0000","last_fullsized":"2024-05-09T00:02:58.927185+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:25.116685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.834752+0000","last_change":"2024-05-09T00:01:44.624973+0000","last_active":"2024-05-09T00:02:47.834752+0000","last_peered":"2024-05-09T00:02:47.834752+0000","last_clean":"2024-05-09T00:02:47.834752+0000","last_became_active":"2024-05-09T00:01:44.624470+0000","last_became_peered":"2024-05-09T00:01:44.624470+0000","last_unstale":"2024-05-09T00:02:47.834752+0000","last_undegraded":"2024-05-09T00:02:47.834752+0000","last_fullsized":"2024-05-09T00:02:47.834752+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:22.021060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.919463+0000","last_change":"2024-05-09T00:01:45.037414+0000","last_active":"2024-05-09T00:02:58.919463+0000","last_peered":"2024-05-09T00:02:58.919463+0000","last_clean":"2024-05-09T00:02:58.919463+0000","last_became_active":"2024-05-09T00:01:45.037095+0000","last_became_peered":"2024-05-09T00:01:45.037095+0000","last_unstale":"2024-05-09T00:02:58.919463+0000","last_undegraded":"2024-05-09T00:02:58.919463+0000","last_fullsized":"2024-05-09T00:02:58.919463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:29.812977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.880182+0000","last_change":"2024-05-09T00:01:44.614823+0000","last_active":"2024-05-09T00:02:58.880182+0000","last_peered":"2024-05-09T00:02:58.880182+0000","last_clean":"2024-05-09T00:02:58.880182+0000","last_became_active":"2024-05-09T00:01:44.614502+0000","last_became_peered":"2024-05-09T00:01:44.614502+0000","last_unstale":"2024-05-09T00:02:58.880182+0000","last_undegraded":"2024-05-09T00:02:58.880182+0000","last_fullsized":"2024-05-09T00:02:58.880182+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:14.486852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.919897+0000","last_change":"2024-05-09T00:01:45.048631+0000","last_active":"2024-05-09T00:02:58.919897+0000","last_peered":"2024-05-09T00:02:58.919897+0000","last_clean":"2024-05-09T00:02:58.919897+0000","last_became_active":"2024-05-09T00:01:45.046691+0000","last_became_peered":"2024-05-09T00:01:45.046691+0000","last_unstale":"2024-05-09T00:02:58.919897+0000","last_undegraded":"2024-05-09T00:02:58.919897+0000","last_fullsized":"2024-05-09T00:02:58.919897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:59:35.017208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.833476+0000","last_change":"2024-05-09T00:01:44.622684+0000","last_active":"2024-05-09T00:02:47.833476+0000","last_peered":"2024-05-09T00:02:47.833476+0000","last_clean":"2024-05-09T00:02:47.833476+0000","last_became_active":"2024-05-09T00:01:44.622301+0000","last_became_peered":"2024-05-09T00:01:44.622301+0000","last_unstale":"2024-05-09T00:02:47.833476+0000","last_undegraded":"2024-05-09T00:02:47.833476+0000","last_fullsized":"2024-05-09T00:02:47.833476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:38.343729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.924718+0000","last_change":"2024-05-09T00:01:45.050240+0000","last_active":"2024-05-09T00:02:58.924718+0000","last_peered":"2024-05-09T00:02:58.924718+0000","last_clean":"2024-05-09T00:02:58.924718+0000","last_became_active":"2024-05-09T00:01:45.049955+0000","last_became_peered":"2024-05-09T00:01:45.049955+0000","last_unstale":"2024-05-09T00:02:58.924718+0000","last_undegraded":"2024-05-09T00:02:58.924718+0000","last_fullsized":"2024-05-09T00:02:58.924718+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:56.811853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836054+0000","last_change":"2024-05-09T00:01:44.618591+0000","last_active":"2024-05-09T00:02:47.836054+0000","last_peered":"2024-05-09T00:02:47.836054+0000","last_clean":"2024-05-09T00:02:47.836054+0000","last_became_active":"2024-05-09T00:01:44.618198+0000","last_became_peered":"2024-05-09T00:01:44.618198+0000","last_unstale":"2024-05-09T00:02:47.836054+0000","last_undegraded":"2024-05-09T00:02:47.836054+0000","last_fullsized":"2024-05-09T00:02:47.836054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:27.705444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.908801+0000","last_change":"2024-05-09T00:01:45.037485+0000","last_active":"2024-05-09T00:02:58.908801+0000","last_peered":"2024-05-09T00:02:58.908801+0000","last_clean":"2024-05-09T00:02:58.908801+0000","last_became_active":"2024-05-09T00:01:45.037150+0000","last_became_peered":"2024-05-09T00:01:45.037150+0000","last_unstale":"2024-05-09T00:02:58.908801+0000","last_undegraded":"2024-05-09T00:02:58.908801+0000","last_fullsized":"2024-05-09T00:02:58.908801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:55.476243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":199,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.855097+0000","last_change":"2024-05-09T00:01:44.620485+0000","last_active":"2024-05-09T00:02:59.855097+0000","last_peered":"2024-05-09T00:02:59.855097+0000","last_clean":"2024-05-09T00:02:59.855097+0000","last_became_active":"2024-05-09T00:01:44.620004+0000","last_became_peered":"2024-05-09T00:01:44.620004+0000","last_unstale":"2024-05-09T00:02:59.855097+0000","last_undegraded":"2024-05-09T00:02:59.855097+0000","last_fullsized":"2024-05-09T00:02:59.855097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:58.529038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65442,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":138,"num_write":35,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.915108+0000","last_change":"2024-05-09T00:01:45.045581+0000","last_active":"2024-05-09T00:02:58.915108+0000","last_peered":"2024-05-09T00:02:58.915108+0000","last_clean":"2024-05-09T00:02:58.915108+0000","last_became_active":"2024-05-09T00:01:45.045290+0000","last_became_peered":"2024-05-09T00:01:45.045290+0000","last_unstale":"2024-05-09T00:02:58.915108+0000","last_undegraded":"2024-05-09T00:02:58.915108+0000","last_fullsized":"2024-05-09T00:02:58.915108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:36.860897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836337+0000","last_change":"2024-05-09T00:01:44.624145+0000","last_active":"2024-05-09T00:02:47.836337+0000","last_peered":"2024-05-09T00:02:47.836337+0000","last_clean":"2024-05-09T00:02:47.836337+0000","last_became_active":"2024-05-09T00:01:44.623804+0000","last_became_peered":"2024-05-09T00:01:44.623804+0000","last_unstale":"2024-05-09T00:02:47.836337+0000","last_undegraded":"2024-05-09T00:02:47.836337+0000","last_fullsized":"2024-05-09T00:02:47.836337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:22.366804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921602+0000","last_change":"2024-05-09T00:02:47.836307+0000","last_active":"2024-05-09T00:02:58.921602+0000","last_peered":"2024-05-09T00:02:58.921602+0000","last_clean":"2024-05-09T00:02:58.921602+0000","last_became_active":"2024-05-09T00:02:47.835948+0000","last_became_peered":"2024-05-09T00:02:47.835948+0000","last_unstale":"2024-05-09T00:02:58.921602+0000","last_undegraded":"2024-05-09T00:02:58.921602+0000","last_fullsized":"2024-05-09T00:02:58.921602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:52.582826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.835187+0000","last_change":"2024-05-09T00:01:44.620188+0000","last_active":"2024-05-09T00:02:47.835187+0000","last_peered":"2024-05-09T00:02:47.835187+0000","last_clean":"2024-05-09T00:02:47.835187+0000","last_became_active":"2024-05-09T00:01:44.619914+0000","last_became_peered":"2024-05-09T00:01:44.619914+0000","last_unstale":"2024-05-09T00:02:47.835187+0000","last_undegraded":"2024-05-09T00:02:47.835187+0000","last_fullsized":"2024-05-09T00:02:47.835187+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:50.349806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.927088+0000","last_change":"2024-05-09T00:01:45.044881+0000","last_active":"2024-05-09T00:02:58.927088+0000","last_peered":"2024-05-09T00:02:58.927088+0000","last_clean":"2024-05-09T00:02:58.927088+0000","last_became_active":"2024-05-09T00:01:45.044176+0000","last_became_peered":"2024-05-09T00:01:45.044176+0000","last_unstale":"2024-05-09T00:02:58.927088+0000","last_undegraded":"2024-05-09T00:02:58.927088+0000","last_fullsized":"2024-05-09T00:02:58.927088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:15.672966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.174413+0000","last_change":"2024-05-09T00:01:44.616560+0000","last_active":"2024-05-09T00:02:59.174413+0000","last_peered":"2024-05-09T00:02:59.174413+0000","last_clean":"2024-05-09T00:02:59.174413+0000","last_became_active":"2024-05-09T00:01:44.616172+0000","last_became_peered":"2024-05-09T00:01:44.616172+0000","last_unstale":"2024-05-09T00:02:59.174413+0000","last_undegraded":"2024-05-09T00:02:59.174413+0000","last_fullsized":"2024-05-09T00:02:59.174413+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:51.191335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917956+0000","last_change":"2024-05-09T00:02:47.836428+0000","last_active":"2024-05-09T00:02:58.917956+0000","last_peered":"2024-05-09T00:02:58.917956+0000","last_clean":"2024-05-09T00:02:58.917956+0000","last_became_active":"2024-05-09T00:02:47.836075+0000","last_became_peered":"2024-05-09T00:02:47.836075+0000","last_unstale":"2024-05-09T00:02:58.917956+0000","last_undegraded":"2024-05-09T00:02:58.917956+0000","last_fullsized":"2024-05-09T00:02:58.917956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:29:43.983172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.835384+0000","last_change":"2024-05-09T00:01:44.622089+0000","last_active":"2024-05-09T00:02:47.835384+0000","last_peered":"2024-05-09T00:02:47.835384+0000","last_clean":"2024-05-09T00:02:47.835384+0000","last_became_active":"2024-05-09T00:01:44.621731+0000","last_became_peered":"2024-05-09T00:01:44.621731+0000","last_unstale":"2024-05-09T00:02:47.835384+0000","last_undegraded":"2024-05-09T00:02:47.835384+0000","last_fullsized":"2024-05-09T00:02:47.835384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.276454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.910413+0000","last_change":"2024-05-09T00:01:45.058785+0000","last_active":"2024-05-09T00:02:58.910413+0000","last_peered":"2024-05-09T00:02:58.910413+0000","last_clean":"2024-05-09T00:02:58.910413+0000","last_became_active":"2024-05-09T00:01:45.058387+0000","last_became_peered":"2024-05-09T00:01:45.058387+0000","last_unstale":"2024-05-09T00:02:58.910413+0000","last_undegraded":"2024-05-09T00:02:58.910413+0000","last_fullsized":"2024-05-09T00:02:58.910413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:18.868021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:48.407741+0000","last_change":"2024-05-09T00:02:47.842905+0000","last_active":"2024-05-09T00:02:48.407741+0000","last_peered":"2024-05-09T00:02:48.407741+0000","last_clean":"2024-05-09T00:02:48.407741+0000","last_became_active":"2024-05-09T00:02:47.837585+0000","last_became_peered":"2024-05-09T00:02:47.837585+0000","last_unstale":"2024-05-09T00:02:48.407741+0000","last_undegraded":"2024-05-09T00:02:48.407741+0000","last_fullsized":"2024-05-09T00:02:48.407741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:14.463873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925053+0000","last_change":"2024-05-09T00:02:47.838555+0000","last_active":"2024-05-09T00:02:58.925053+0000","last_peered":"2024-05-09T00:02:58.925053+0000","last_clean":"2024-05-09T00:02:58.925053+0000","last_became_active":"2024-05-09T00:02:47.837636+0000","last_became_peered":"2024-05-09T00:02:47.837636+0000","last_unstale":"2024-05-09T00:02:58.925053+0000","last_undegraded":"2024-05-09T00:02:58.925053+0000","last_fullsized":"2024-05-09T00:02:58.925053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:30.564942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.833331+0000","last_change":"2024-05-09T00:01:44.618910+0000","last_active":"2024-05-09T00:02:47.833331+0000","last_peered":"2024-05-09T00:02:47.833331+0000","last_clean":"2024-05-09T00:02:47.833331+0000","last_became_active":"2024-05-09T00:01:44.618569+0000","last_became_peered":"2024-05-09T00:01:44.618569+0000","last_unstale":"2024-05-09T00:02:47.833331+0000","last_undegraded":"2024-05-09T00:02:47.833331+0000","last_fullsized":"2024-05-09T00:02:47.833331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:40.748747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929775+0000","last_change":"2024-05-09T00:01:45.047305+0000","last_active":"2024-05-09T00:02:58.929775+0000","last_peered":"2024-05-09T00:02:58.929775+0000","last_clean":"2024-05-09T00:02:58.929775+0000","last_became_active":"2024-05-09T00:01:45.046944+0000","last_became_peered":"2024-05-09T00:01:45.046944+0000","last_unstale":"2024-05-09T00:02:58.929775+0000","last_undegraded":"2024-05-09T00:02:58.929775+0000","last_fullsized":"2024-05-09T00:02:58.929775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:24:59.065224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.833584+0000","last_change":"2024-05-09T00:01:44.620497+0000","last_active":"2024-05-09T00:02:47.833584+0000","last_peered":"2024-05-09T00:02:47.833584+0000","last_clean":"2024-05-09T00:02:47.833584+0000","last_became_active":"2024-05-09T00:01:44.620165+0000","last_became_peered":"2024-05-09T00:01:44.620165+0000","last_unstale":"2024-05-09T00:02:47.833584+0000","last_undegraded":"2024-05-09T00:02:47.833584+0000","last_fullsized":"2024-05-09T00:02:47.833584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:44.514434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925805+0000","last_change":"2024-05-09T00:01:45.045408+0000","last_active":"2024-05-09T00:02:58.925805+0000","last_peered":"2024-05-09T00:02:58.925805+0000","last_clean":"2024-05-09T00:02:58.925805+0000","last_became_active":"2024-05-09T00:01:45.045086+0000","last_became_peered":"2024-05-09T00:01:45.045086+0000","last_unstale":"2024-05-09T00:02:58.925805+0000","last_undegraded":"2024-05-09T00:02:58.925805+0000","last_fullsized":"2024-05-09T00:02:58.925805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:54.568889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.907222+0000","last_change":"2024-05-09T00:01:45.057315+0000","last_active":"2024-05-09T00:02:58.907222+0000","last_peered":"2024-05-09T00:02:58.907222+0000","last_clean":"2024-05-09T00:02:58.907222+0000","last_became_active":"2024-05-09T00:01:45.056962+0000","last_became_peered":"2024-05-09T00:01:45.056962+0000","last_unstale":"2024-05-09T00:02:58.907222+0000","last_undegraded":"2024-05-09T00:02:58.907222+0000","last_fullsized":"2024-05-09T00:02:58.907222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:09:52.136588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.151416+0000","last_change":"2024-05-09T00:01:44.618477+0000","last_active":"2024-05-09T00:02:59.151416+0000","last_peered":"2024-05-09T00:02:59.151416+0000","last_clean":"2024-05-09T00:02:59.151416+0000","last_became_active":"2024-05-09T00:01:44.618154+0000","last_became_peered":"2024-05-09T00:01:44.618154+0000","last_unstale":"2024-05-09T00:02:59.151416+0000","last_undegraded":"2024-05-09T00:02:59.151416+0000","last_fullsized":"2024-05-09T00:02:59.151416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:24.380644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921394+0000","last_change":"2024-05-09T00:01:45.053772+0000","last_active":"2024-05-09T00:02:58.921394+0000","last_peered":"2024-05-09T00:02:58.921394+0000","last_clean":"2024-05-09T00:02:58.921394+0000","last_became_active":"2024-05-09T00:01:45.053453+0000","last_became_peered":"2024-05-09T00:01:45.053453+0000","last_unstale":"2024-05-09T00:02:58.921394+0000","last_undegraded":"2024-05-09T00:02:58.921394+0000","last_fullsized":"2024-05-09T00:02:58.921394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:46.136845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.835823+0000","last_change":"2024-05-09T00:01:44.610200+0000","last_active":"2024-05-09T00:02:47.835823+0000","last_peered":"2024-05-09T00:02:47.835823+0000","last_clean":"2024-05-09T00:02:47.835823+0000","last_became_active":"2024-05-09T00:01:44.609764+0000","last_became_peered":"2024-05-09T00:01:44.609764+0000","last_unstale":"2024-05-09T00:02:47.835823+0000","last_undegraded":"2024-05-09T00:02:47.835823+0000","last_fullsized":"2024-05-09T00:02:47.835823+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:36.122765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":334,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.834185+0000","last_change":"2024-05-09T00:00:57.898648+0000","last_active":"2024-05-09T00:02:47.834185+0000","last_peered":"2024-05-09T00:02:47.834185+0000","last_clean":"2024-05-09T00:02:47.834185+0000","last_became_active":"2024-05-09T00:00:57.898259+0000","last_became_peered":"2024-05-09T00:00:57.898259+0000","last_unstale":"2024-05-09T00:02:47.834185+0000","last_undegraded":"2024-05-09T00:02:47.834185+0000","last_fullsized":"2024-05-09T00:02:47.834185+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:58:35.200738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:58:35.200738+0000","last_clean_scrub_stamp":"2024-05-08T23:58:35.200738+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:47.782068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.919516+0000","last_change":"2024-05-09T00:01:45.035407+0000","last_active":"2024-05-09T00:02:58.919516+0000","last_peered":"2024-05-09T00:02:58.919516+0000","last_clean":"2024-05-09T00:02:58.919516+0000","last_became_active":"2024-05-09T00:01:45.035115+0000","last_became_peered":"2024-05-09T00:01:45.035115+0000","last_unstale":"2024-05-09T00:02:58.919516+0000","last_undegraded":"2024-05-09T00:02:58.919516+0000","last_fullsized":"2024-05-09T00:02:58.919516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:23.603196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.834350+0000","last_change":"2024-05-09T00:01:44.622514+0000","last_active":"2024-05-09T00:02:47.834350+0000","last_peered":"2024-05-09T00:02:47.834350+0000","last_clean":"2024-05-09T00:02:47.834350+0000","last_became_active":"2024-05-09T00:01:44.621454+0000","last_became_peered":"2024-05-09T00:01:44.621454+0000","last_unstale":"2024-05-09T00:02:47.834350+0000","last_undegraded":"2024-05-09T00:02:47.834350+0000","last_fullsized":"2024-05-09T00:02:47.834350+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:10.801721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.837046+0000","last_change":"2024-05-09T00:01:44.622743+0000","last_active":"2024-05-09T00:02:47.837046+0000","last_peered":"2024-05-09T00:02:47.837046+0000","last_clean":"2024-05-09T00:02:47.837046+0000","last_became_active":"2024-05-09T00:01:44.622304+0000","last_became_peered":"2024-05-09T00:01:44.622304+0000","last_unstale":"2024-05-09T00:02:47.837046+0000","last_undegraded":"2024-05-09T00:02:47.837046+0000","last_fullsized":"2024-05-09T00:02:47.837046+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:01.829369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921939+0000","last_change":"2024-05-09T00:01:45.035458+0000","last_active":"2024-05-09T00:02:58.921939+0000","last_peered":"2024-05-09T00:02:58.921939+0000","last_clean":"2024-05-09T00:02:58.921939+0000","last_became_active":"2024-05-09T00:01:45.035140+0000","last_became_peered":"2024-05-09T00:01:45.035140+0000","last_unstale":"2024-05-09T00:02:58.921939+0000","last_undegraded":"2024-05-09T00:02:58.921939+0000","last_fullsized":"2024-05-09T00:02:58.921939+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:02:31.258013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'40","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.109427+0000","last_change":"2024-05-09T00:01:44.615172+0000","last_active":"2024-05-09T00:02:59.109427+0000","last_peered":"2024-05-09T00:02:59.109427+0000","last_clean":"2024-05-09T00:02:59.109427+0000","last_became_active":"2024-05-09T00:01:44.614892+0000","last_became_peered":"2024-05-09T00:01:44.614892+0000","last_unstale":"2024-05-09T00:02:59.109427+0000","last_undegraded":"2024-05-09T00:02:59.109427+0000","last_fullsized":"2024-05-09T00:02:59.109427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:17.868378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":71,"num_write_kb":834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926189+0000","last_change":"2024-05-09T00:01:45.044708+0000","last_active":"2024-05-09T00:02:58.926189+0000","last_peered":"2024-05-09T00:02:58.926189+0000","last_clean":"2024-05-09T00:02:58.926189+0000","last_became_active":"2024-05-09T00:01:45.044451+0000","last_became_peered":"2024-05-09T00:01:45.044451+0000","last_unstale":"2024-05-09T00:02:58.926189+0000","last_undegraded":"2024-05-09T00:02:58.926189+0000","last_fullsized":"2024-05-09T00:02:58.926189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:16.099211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.835582+0000","last_change":"2024-05-09T00:01:44.617434+0000","last_active":"2024-05-09T00:02:47.835582+0000","last_peered":"2024-05-09T00:02:47.835582+0000","last_clean":"2024-05-09T00:02:47.835582+0000","last_became_active":"2024-05-09T00:01:44.617017+0000","last_became_peered":"2024-05-09T00:01:44.617017+0000","last_unstale":"2024-05-09T00:02:47.835582+0000","last_undegraded":"2024-05-09T00:02:47.835582+0000","last_fullsized":"2024-05-09T00:02:47.835582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.889962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929780+0000","last_change":"2024-05-09T00:01:45.035749+0000","last_active":"2024-05-09T00:02:58.929780+0000","last_peered":"2024-05-09T00:02:58.929780+0000","last_clean":"2024-05-09T00:02:58.929780+0000","last_became_active":"2024-05-09T00:01:45.034862+0000","last_became_peered":"2024-05-09T00:01:45.034862+0000","last_unstale":"2024-05-09T00:02:58.929780+0000","last_undegraded":"2024-05-09T00:02:58.929780+0000","last_fullsized":"2024-05-09T00:02:58.929780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:20.824467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.912120+0000","last_change":"2024-05-09T00:01:44.616652+0000","last_active":"2024-05-09T00:02:47.912120+0000","last_peered":"2024-05-09T00:02:47.912120+0000","last_clean":"2024-05-09T00:02:47.912120+0000","last_became_active":"2024-05-09T00:01:44.616273+0000","last_became_peered":"2024-05-09T00:01:44.616273+0000","last_unstale":"2024-05-09T00:02:47.912120+0000","last_undegraded":"2024-05-09T00:02:47.912120+0000","last_fullsized":"2024-05-09T00:02:47.912120+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:12.379909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.916820+0000","last_change":"2024-05-09T00:01:45.047020+0000","last_active":"2024-05-09T00:02:58.916820+0000","last_peered":"2024-05-09T00:02:58.916820+0000","last_clean":"2024-05-09T00:02:58.916820+0000","last_became_active":"2024-05-09T00:01:45.046813+0000","last_became_peered":"2024-05-09T00:01:45.046813+0000","last_unstale":"2024-05-09T00:02:58.916820+0000","last_undegraded":"2024-05-09T00:02:58.916820+0000","last_fullsized":"2024-05-09T00:02:58.916820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:53.042258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.911743+0000","last_change":"2024-05-09T00:01:44.610843+0000","last_active":"2024-05-09T00:02:47.911743+0000","last_peered":"2024-05-09T00:02:47.911743+0000","last_clean":"2024-05-09T00:02:47.911743+0000","last_became_active":"2024-05-09T00:01:44.610523+0000","last_became_peered":"2024-05-09T00:01:44.610523+0000","last_unstale":"2024-05-09T00:02:47.911743+0000","last_undegraded":"2024-05-09T00:02:47.911743+0000","last_fullsized":"2024-05-09T00:02:47.911743+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:58.527344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.911641+0000","last_change":"2024-05-09T00:01:45.046259+0000","last_active":"2024-05-09T00:02:58.911641+0000","last_peered":"2024-05-09T00:02:58.911641+0000","last_clean":"2024-05-09T00:02:58.911641+0000","last_became_active":"2024-05-09T00:01:45.045954+0000","last_became_peered":"2024-05-09T00:01:45.045954+0000","last_unstale":"2024-05-09T00:02:58.911641+0000","last_undegraded":"2024-05-09T00:02:58.911641+0000","last_fullsized":"2024-05-09T00:02:58.911641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:46.569934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836410+0000","last_change":"2024-05-09T00:01:44.616781+0000","last_active":"2024-05-09T00:02:47.836410+0000","last_peered":"2024-05-09T00:02:47.836410+0000","last_clean":"2024-05-09T00:02:47.836410+0000","last_became_active":"2024-05-09T00:01:44.616386+0000","last_became_peered":"2024-05-09T00:01:44.616386+0000","last_unstale":"2024-05-09T00:02:47.836410+0000","last_undegraded":"2024-05-09T00:02:47.836410+0000","last_fullsized":"2024-05-09T00:02:47.836410+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:17.073596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.927662+0000","last_change":"2024-05-09T00:01:45.046701+0000","last_active":"2024-05-09T00:02:58.927662+0000","last_peered":"2024-05-09T00:02:58.927662+0000","last_clean":"2024-05-09T00:02:58.927662+0000","last_became_active":"2024-05-09T00:01:45.046409+0000","last_became_peered":"2024-05-09T00:01:45.046409+0000","last_unstale":"2024-05-09T00:02:58.927662+0000","last_undegraded":"2024-05-09T00:02:58.927662+0000","last_fullsized":"2024-05-09T00:02:58.927662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:32.178410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836025+0000","last_change":"2024-05-09T00:01:44.623271+0000","last_active":"2024-05-09T00:02:47.836025+0000","last_peered":"2024-05-09T00:02:47.836025+0000","last_clean":"2024-05-09T00:02:47.836025+0000","last_became_active":"2024-05-09T00:01:44.622863+0000","last_became_peered":"2024-05-09T00:01:44.622863+0000","last_unstale":"2024-05-09T00:02:47.836025+0000","last_undegraded":"2024-05-09T00:02:47.836025+0000","last_fullsized":"2024-05-09T00:02:47.836025+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:58.609140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925564+0000","last_change":"2024-05-09T00:01:45.052296+0000","last_active":"2024-05-09T00:02:58.925564+0000","last_peered":"2024-05-09T00:02:58.925564+0000","last_clean":"2024-05-09T00:02:58.925564+0000","last_became_active":"2024-05-09T00:01:45.051951+0000","last_became_peered":"2024-05-09T00:01:45.051951+0000","last_unstale":"2024-05-09T00:02:58.925564+0000","last_undegraded":"2024-05-09T00:02:58.925564+0000","last_fullsized":"2024-05-09T00:02:58.925564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:46.908629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836186+0000","last_change":"2024-05-09T00:01:44.620387+0000","last_active":"2024-05-09T00:02:47.836186+0000","last_peered":"2024-05-09T00:02:47.836186+0000","last_clean":"2024-05-09T00:02:47.836186+0000","last_became_active":"2024-05-09T00:01:44.620024+0000","last_became_peered":"2024-05-09T00:01:44.620024+0000","last_unstale":"2024-05-09T00:02:47.836186+0000","last_undegraded":"2024-05-09T00:02:47.836186+0000","last_fullsized":"2024-05-09T00:02:47.836186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:31.599273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917468+0000","last_change":"2024-05-09T00:01:45.050092+0000","last_active":"2024-05-09T00:02:58.917468+0000","last_peered":"2024-05-09T00:02:58.917468+0000","last_clean":"2024-05-09T00:02:58.917468+0000","last_became_active":"2024-05-09T00:01:45.049794+0000","last_became_peered":"2024-05-09T00:01:45.049794+0000","last_unstale":"2024-05-09T00:02:58.917468+0000","last_undegraded":"2024-05-09T00:02:58.917468+0000","last_fullsized":"2024-05-09T00:02:58.917468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:56.932513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'39","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.101124+0000","last_change":"2024-05-09T00:01:44.609940+0000","last_active":"2024-05-09T00:02:59.101124+0000","last_peered":"2024-05-09T00:02:59.101124+0000","last_clean":"2024-05-09T00:02:59.101124+0000","last_became_active":"2024-05-09T00:01:44.609593+0000","last_became_peered":"2024-05-09T00:01:44.609593+0000","last_unstale":"2024-05-09T00:02:59.101124+0000","last_undegraded":"2024-05-09T00:02:59.101124+0000","last_fullsized":"2024-05-09T00:02:59.101124+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:09.671548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929505+0000","last_change":"2024-05-09T00:01:45.042533+0000","last_active":"2024-05-09T00:02:58.929505+0000","last_peered":"2024-05-09T00:02:58.929505+0000","last_clean":"2024-05-09T00:02:58.929505+0000","last_became_active":"2024-05-09T00:01:45.042155+0000","last_became_peered":"2024-05-09T00:01:45.042155+0000","last_unstale":"2024-05-09T00:02:58.929505+0000","last_undegraded":"2024-05-09T00:02:58.929505+0000","last_fullsized":"2024-05-09T00:02:58.929505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:36.519165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.831123+0000","last_change":"2024-05-09T00:01:44.617518+0000","last_active":"2024-05-09T00:02:47.831123+0000","last_peered":"2024-05-09T00:02:47.831123+0000","last_clean":"2024-05-09T00:02:47.831123+0000","last_became_active":"2024-05-09T00:01:44.617196+0000","last_became_peered":"2024-05-09T00:01:44.617196+0000","last_unstale":"2024-05-09T00:02:47.831123+0000","last_undegraded":"2024-05-09T00:02:47.831123+0000","last_fullsized":"2024-05-09T00:02:47.831123+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:47.062855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917866+0000","last_change":"2024-05-09T00:01:45.053962+0000","last_active":"2024-05-09T00:02:58.917866+0000","last_peered":"2024-05-09T00:02:58.917866+0000","last_clean":"2024-05-09T00:02:58.917866+0000","last_became_active":"2024-05-09T00:01:45.053637+0000","last_became_peered":"2024-05-09T00:01:45.053637+0000","last_unstale":"2024-05-09T00:02:58.917866+0000","last_undegraded":"2024-05-09T00:02:58.917866+0000","last_fullsized":"2024-05-09T00:02:58.917866+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:18.188806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.911544+0000","last_change":"2024-05-09T00:01:45.055532+0000","last_active":"2024-05-09T00:02:58.911544+0000","last_peered":"2024-05-09T00:02:58.911544+0000","last_clean":"2024-05-09T00:02:58.911544+0000","last_became_active":"2024-05-09T00:01:45.054939+0000","last_became_peered":"2024-05-09T00:01:45.054939+0000","last_unstale":"2024-05-09T00:02:58.911544+0000","last_undegraded":"2024-05-09T00:02:58.911544+0000","last_fullsized":"2024-05-09T00:02:58.911544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.919492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.911899+0000","last_change":"2024-05-09T00:01:45.053752+0000","last_active":"2024-05-09T00:02:58.911899+0000","last_peered":"2024-05-09T00:02:58.911899+0000","last_clean":"2024-05-09T00:02:58.911899+0000","last_became_active":"2024-05-09T00:01:45.053409+0000","last_became_peered":"2024-05-09T00:01:45.053409+0000","last_unstale":"2024-05-09T00:02:58.911899+0000","last_undegraded":"2024-05-09T00:02:58.911899+0000","last_fullsized":"2024-05-09T00:02:58.911899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:12.517211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.924846+0000","last_change":"2024-05-09T00:01:45.036145+0000","last_active":"2024-05-09T00:02:58.924846+0000","last_peered":"2024-05-09T00:02:58.924846+0000","last_clean":"2024-05-09T00:02:58.924846+0000","last_became_active":"2024-05-09T00:01:45.035839+0000","last_became_peered":"2024-05-09T00:01:45.035839+0000","last_unstale":"2024-05-09T00:02:58.924846+0000","last_undegraded":"2024-05-09T00:02:58.924846+0000","last_fullsized":"2024-05-09T00:02:58.924846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:03:17.630399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926417+0000","last_change":"2024-05-09T00:01:45.032875+0000","last_active":"2024-05-09T00:02:58.926417+0000","last_peered":"2024-05-09T00:02:58.926417+0000","last_clean":"2024-05-09T00:02:58.926417+0000","last_became_active":"2024-05-09T00:01:45.032552+0000","last_became_peered":"2024-05-09T00:01:45.032552+0000","last_unstale":"2024-05-09T00:02:58.926417+0000","last_undegraded":"2024-05-09T00:02:58.926417+0000","last_fullsized":"2024-05-09T00:02:58.926417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:17.244204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925597+0000","last_change":"2024-05-09T00:01:45.032427+0000","last_active":"2024-05-09T00:02:58.925597+0000","last_peered":"2024-05-09T00:02:58.925597+0000","last_clean":"2024-05-09T00:02:58.925597+0000","last_became_active":"2024-05-09T00:01:45.032038+0000","last_became_peered":"2024-05-09T00:01:45.032038+0000","last_unstale":"2024-05-09T00:02:58.925597+0000","last_undegraded":"2024-05-09T00:02:58.925597+0000","last_fullsized":"2024-05-09T00:02:58.925597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.495291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.909248+0000","last_change":"2024-05-09T00:01:45.053080+0000","last_active":"2024-05-09T00:02:58.909248+0000","last_peered":"2024-05-09T00:02:58.909248+0000","last_clean":"2024-05-09T00:02:58.909248+0000","last_became_active":"2024-05-09T00:01:45.052728+0000","last_became_peered":"2024-05-09T00:01:45.052728+0000","last_unstale":"2024-05-09T00:02:58.909248+0000","last_undegraded":"2024-05-09T00:02:58.909248+0000","last_fullsized":"2024-05-09T00:02:58.909248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:59.631827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.913824+0000","last_change":"2024-05-09T00:01:45.044489+0000","last_active":"2024-05-09T00:02:58.913824+0000","last_peered":"2024-05-09T00:02:58.913824+0000","last_clean":"2024-05-09T00:02:58.913824+0000","last_became_active":"2024-05-09T00:01:45.044139+0000","last_became_peered":"2024-05-09T00:01:45.044139+0000","last_unstale":"2024-05-09T00:02:58.913824+0000","last_undegraded":"2024-05-09T00:02:58.913824+0000","last_fullsized":"2024-05-09T00:02:58.913824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:57.932238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921240+0000","last_change":"2024-05-09T00:01:45.050829+0000","last_active":"2024-05-09T00:02:58.921240+0000","last_peered":"2024-05-09T00:02:58.921240+0000","last_clean":"2024-05-09T00:02:58.921240+0000","last_became_active":"2024-05-09T00:01:45.050410+0000","last_became_peered":"2024-05-09T00:01:45.050410+0000","last_unstale":"2024-05-09T00:02:58.921240+0000","last_undegraded":"2024-05-09T00:02:58.921240+0000","last_fullsized":"2024-05-09T00:02:58.921240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:08.738918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929503+0000","last_change":"2024-05-09T00:01:45.053957+0000","last_active":"2024-05-09T00:02:58.929503+0000","last_peered":"2024-05-09T00:02:58.929503+0000","last_clean":"2024-05-09T00:02:58.929503+0000","last_became_active":"2024-05-09T00:01:45.053487+0000","last_became_peered":"2024-05-09T00:01:45.053487+0000","last_unstale":"2024-05-09T00:02:58.929503+0000","last_undegraded":"2024-05-09T00:02:58.929503+0000","last_fullsized":"2024-05-09T00:02:58.929503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:35.131361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926068+0000","last_change":"2024-05-09T00:01:45.050653+0000","last_active":"2024-05-09T00:02:58.926068+0000","last_peered":"2024-05-09T00:02:58.926068+0000","last_clean":"2024-05-09T00:02:58.926068+0000","last_became_active":"2024-05-09T00:01:45.050322+0000","last_became_peered":"2024-05-09T00:01:45.050322+0000","last_unstale":"2024-05-09T00:02:58.926068+0000","last_undegraded":"2024-05-09T00:02:58.926068+0000","last_fullsized":"2024-05-09T00:02:58.926068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:11:45.137945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.901822+0000","last_change":"2024-05-09T00:01:45.044757+0000","last_active":"2024-05-09T00:02:58.901822+0000","last_peered":"2024-05-09T00:02:58.901822+0000","last_clean":"2024-05-09T00:02:58.901822+0000","last_became_active":"2024-05-09T00:01:45.044464+0000","last_became_peered":"2024-05-09T00:01:45.044464+0000","last_unstale":"2024-05-09T00:02:58.901822+0000","last_undegraded":"2024-05-09T00:02:58.901822+0000","last_fullsized":"2024-05-09T00:02:58.901822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:44.402750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926851+0000","last_change":"2024-05-09T00:01:45.044515+0000","last_active":"2024-05-09T00:02:58.926851+0000","last_peered":"2024-05-09T00:02:58.926851+0000","last_clean":"2024-05-09T00:02:58.926851+0000","last_became_active":"2024-05-09T00:01:45.044209+0000","last_became_peered":"2024-05-09T00:01:45.044209+0000","last_unstale":"2024-05-09T00:02:58.926851+0000","last_undegraded":"2024-05-09T00:02:58.926851+0000","last_fullsized":"2024-05-09T00:02:58.926851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:18.523680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.906985+0000","last_change":"2024-05-09T00:01:45.044254+0000","last_active":"2024-05-09T00:02:58.906985+0000","last_peered":"2024-05-09T00:02:58.906985+0000","last_clean":"2024-05-09T00:02:58.906985+0000","last_became_active":"2024-05-09T00:01:45.043220+0000","last_became_peered":"2024-05-09T00:01:45.043220+0000","last_unstale":"2024-05-09T00:02:58.906985+0000","last_undegraded":"2024-05-09T00:02:58.906985+0000","last_fullsized":"2024-05-09T00:02:58.906985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:39:53.986814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":106908,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595013,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":537,"num_read_kb":378,"num_write":272,"num_write_kb":1427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":989,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":1785039,"data_compressed":81480,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579928,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":892928,"data_stored":436562,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.505},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.437}]},{"osd":1,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.374}]},{"osd":2,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.497}]},{"osd":5,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.34999999999999998}]},{"osd":6,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.40899999999999997}]},{"osd":8,"last update":"Thu May 9 00:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.38600000000000001}]},{"osd":9,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.54600000000000004}]},{"osd":10,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.51400000000000001}]}]},{"osd":10,"up_from":67,"seq":287762808859,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":1060864,"data_stored":1225408,"data_compressed":46581,"data_compressed_allocated":61440,"data_compressed_original":729088,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70799999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79000000000000004,"5min":1.109,"15min":1.109},"last":0.432}]},{"osd":3,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.627,"15min":0.64000000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90200000000000002,"5min":1.022,"15min":1.022},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.85099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.371},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":1.347,"15min":1.347},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82399999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.876,"5min":1.28,"15min":1.28},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83799999999999997,"5min":1.371,"15min":1.371},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94399999999999995,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":8,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.96899999999999997,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.497},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90600000000000003,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.504}]},{"osd":9,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0269999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.77100000000000002,"15min":0.79000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85999999999999999,"5min":1.681,"15min":1.681},"last":0.55800000000000005}]},{"osd":11,"last update":"Thu May 9 00:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.61899999999999999}]}]},{"osd":9,"up_from":62,"seq":266287972383,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":929792,"data_stored":829992,"data_compressed":22077,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42599999999999999,"15min":0.42899999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57699999999999996,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.318},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57599999999999996,"15min":0.57499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":0.62,"15min":0.53400000000000003},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":11.98,"5min":11.98,"15min":11.98},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.498},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.438}]},{"osd":6,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":0.71699999999999997,"15min":0.63900000000000001},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":11.930999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.69799999999999995,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":7.1929999999999996,"5min":7.1929999999999996,"15min":7.1929999999999996},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73099999999999998,"15min":0.74299999999999999},"min":{"1min":0.48599999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1140000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.47899999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.48199999999999998}]},{"osd":8,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.036,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.60999999999999999}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70399999999999996,"15min":0.70899999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.623},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.63900000000000001}]}]},{"osd":8,"up_from":55,"seq":236223201314,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":897024,"data_stored":436343,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.60399999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73599999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.38}]},{"osd":1,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.42299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83699999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.48499999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48099999999999998,"15min":0.48299999999999998},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64600000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.495},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64500000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71499999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.44,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85299999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.54400000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.439}]},{"osd":5,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.62,"15min":0.629},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.47999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.77300000000000002,"5min":0.996,"15min":0.996},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.79700000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.503,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86599999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.754},"min":{"1min":0.56599999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.82399999999999995,"5min":1.004,"15min":1.004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.66300000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93400000000000005,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.58499999999999996}]},{"osd":9,"last update":"Thu May 9 00:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.53500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72299999999999998,"15min":0.71599999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.56899999999999995}]},{"osd":10,"last update":"Thu May 9 00:01:59 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.59599999999999997}]},{"osd":11,"last update":"Thu May 9 00:02:49 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.61799999999999999}]}]},{"osd":7,"up_from":48,"seq":206158430246,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":954368,"data_stored":1029380,"data_compressed":38567,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.376},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.443}]},{"osd":1,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.39500000000000002,"15min":0.38300000000000001},"min":{"1min":0.28699999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.31900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.314}]},{"osd":2,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80600000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.84399999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73599999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76000000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.29999999999999999}]},{"osd":5,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.626,"15min":0.62},"min":{"1min":0.49399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82899999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.502,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84799999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93000000000000005,"5min":1.032,"15min":1.032},"last":0.496}]},{"osd":8,"last update":"Thu May 9 00:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67400000000000004,"15min":0.67200000000000004},"min":{"1min":0.52900000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84199999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68200000000000005,"15min":0.67500000000000004},"min":{"1min":0.55600000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85199999999999998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.433}]},{"osd":9,"last update":"Thu May 9 00:02:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82799999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71399999999999997,"15min":0.72299999999999998},"min":{"1min":0.51500000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.77500000000000002,"5min":1.258,"15min":1.258},"last":0.52000000000000002}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.53000000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.874,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.56100000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.81599999999999995,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56100000000000005}]},{"osd":11,"last update":"Thu May 9 00:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58599999999999997}]}]},{"osd":6,"up_from":43,"seq":184683593770,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":892928,"data_stored":436165,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.377,"15min":0.38600000000000001},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.40200000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.38700000000000001,"15min":0.39800000000000002},"min":{"1min":0.26400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.45800000000000002,"5min":0.62,"15min":0.62},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76700000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.35999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68400000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65600000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.59699999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.41499999999999998,"15min":0.42799999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.42599999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.48199999999999998,"15min":0.495},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.505,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.499}]},{"osd":4,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64900000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76100000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70299999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.626,"15min":0.64800000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.68600000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86699999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.622},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.497,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.63200000000000001}]},{"osd":8,"last update":"Thu May 9 00:02:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66700000000000004,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90500000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.73299999999999998}]},{"osd":9,"last update":"Thu May 9 00:02:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.64400000000000002,"15min":0.67000000000000004},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.61299999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.503,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72999999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.79000000000000004}]},{"osd":10,"last update":"Thu May 9 00:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.77700000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67400000000000004,"15min":0.68500000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79200000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":954368,"data_stored":501400,"data_compressed":4789,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:24 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.32900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72999999999999998,"5min":0.752,"15min":0.752},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu May 9 00:02:40 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.53200000000000003,"15min":0.504},"min":{"1min":0.45800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.753,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.55800000000000005,"15min":0.52400000000000002},"min":{"1min":0.58199999999999996,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.38200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu May 9 00:02:17 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.434,"15min":0.40999999999999998},"min":{"1min":0.32300000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.42299999999999999},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.39900000000000002}]},{"osd":5,"last update":"Thu May 9 00:02:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56999999999999995,"15min":0.54700000000000004},"min":{"1min":0.48899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79800000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91800000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.57599999999999996},"min":{"1min":0.436,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76600000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.438}]},{"osd":7,"last update":"Thu May 9 00:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.36599999999999999}]},{"osd":8,"last update":"Thu May 9 00:02:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.55400000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85899999999999999,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.52600000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.53700000000000003}]},{"osd":9,"last update":"Thu May 9 00:02:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91100000000000003,"5min":1.02,"15min":1.02},"last":0.63},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70699999999999996,"15min":0.70999999999999996},"min":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92200000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.622}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64900000000000002,"15min":0.64200000000000002},"min":{"1min":0.498,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89200000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.498},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.5,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86399999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56299999999999994}]},{"osd":11,"last update":"Thu May 9 00:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.65800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":913408,"data_stored":437436,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 9 00:02:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52700000000000002,"15min":0.49099999999999999},"min":{"1min":0.40999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.752,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54400000000000004,"15min":0.51200000000000001},"min":{"1min":0.46600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu May 9 00:02:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.50800000000000001},"min":{"1min":0.433,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67100000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52400000000000002,"15min":0.504},"min":{"1min":0.36899999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68300000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu May 9 00:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.438}]},{"osd":4,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.625},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.72399999999999998,"5min":1.075,"15min":1.075},"last":0.747}]},{"osd":5,"last update":"Thu May 9 00:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.53400000000000003,"15min":0.51400000000000001},"min":{"1min":0.442,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72499999999999998,"5min":0.748,"15min":0.748},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55300000000000005,"15min":0.54200000000000004},"min":{"1min":0.41199999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66300000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu May 9 00:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.46600000000000003,"15min":0.47999999999999998},"min":{"1min":0.29299999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.52500000000000002,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48899999999999999,"15min":0.49399999999999999},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59599999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.56100000000000005}]},{"osd":8,"last update":"Thu May 9 00:02:28 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.433,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77700000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.67200000000000004,"15min":0.68200000000000005},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72799999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.57999999999999996}]},{"osd":9,"last update":"Thu May 9 00:02:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.61499999999999999,"5min":1.038,"15min":1.038},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.67500000000000004,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.36499999999999999}]},{"osd":10,"last update":"Thu May 9 00:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.71099999999999997,"5min":1.123,"15min":1.123},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.69799999999999995,"15min":0.71099999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84199999999999997,"5min":1.121,"15min":1.121},"last":0.84199999999999997}]},{"osd":11,"last update":"Thu May 9 00:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.76400000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444088,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":501509,"data_compressed":4789,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.35099999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70399999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.502,"15min":0.47799999999999998},"min":{"1min":0.39600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78600000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu May 9 00:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.53100000000000003,"15min":0.51400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71799999999999997,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.53500000000000003,"15min":0.495},"min":{"1min":0.372,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.315}]},{"osd":3,"last update":"Thu May 9 00:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.42699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.745,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.432},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.51100000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.377}]},{"osd":5,"last update":"Thu May 9 00:02:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.47499999999999998,"15min":0.443},"min":{"1min":0.38300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.48699999999999999,"15min":0.45800000000000002},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79800000000000004,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.36099999999999999}]},{"osd":6,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.439,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.38900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.502}]},{"osd":7,"last update":"Thu May 9 00:01:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67100000000000004}]},{"osd":8,"last update":"Thu May 9 00:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.54500000000000004,"15min":0.53000000000000003},"min":{"1min":0.32200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45300000000000001}]},{"osd":9,"last update":"Thu May 9 00:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.59199999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88400000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.57699999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90900000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56000000000000005}]},{"osd":10,"last update":"Thu May 9 00:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.53400000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91600000000000004,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48099999999999998}]},{"osd":11,"last update":"Thu May 9 00:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.51500000000000001}]}]},{"osd":3,"up_from":24,"seq":103079215156,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":954368,"data_stored":961292,"data_compressed":28233,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.33400000000000002},"min":{"1min":0.26600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.497,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.28699999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48699999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.438}]},{"osd":1,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.51600000000000001},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.371}]},{"osd":2,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.433,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70499999999999996,"5min":1.075,"15min":1.075},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55900000000000005,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63700000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu May 9 00:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57999999999999996,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.49399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67400000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.501}]},{"osd":6,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.34799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55700000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32700000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu May 9 00:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.47099999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69899999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51400000000000001}]},{"osd":8,"last update":"Thu May 9 00:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.46700000000000003}]},{"osd":9,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.54300000000000004}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82499999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.56699999999999995}]},{"osd":11,"last update":"Thu May 9 00:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.49399999999999999}]}]},{"osd":4,"up_from":31,"seq":133143986225,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":905216,"data_stored":438369,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.39400000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79800000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.371,"15min":0.35299999999999998},"min":{"1min":0.312,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.378,"15min":0.36499999999999999},"min":{"1min":0.28299999999999997,"5min":0.215,"15min":0.215},"max":{"1min":0.64000000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.318}]},{"osd":2,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.54500000000000004,"15min":0.51500000000000001},"min":{"1min":0.39900000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.54100000000000004,"15min":0.50700000000000001},"min":{"1min":0.40400000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.433}]},{"osd":5,"last update":"Thu May 9 00:02:29 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83499999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.627,"15min":0.59899999999999998},"min":{"1min":0.49299999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89900000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu May 9 00:02:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57199999999999995,"15min":0.56299999999999994},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76600000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu May 9 00:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.46800000000000003}]},{"osd":8,"last update":"Thu May 9 00:02:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71199999999999997,"15min":0.71699999999999997},"min":{"1min":0.43099999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.871,"5min":1.484,"15min":1.484},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.52000000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.84399999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.501}]},{"osd":9,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73799999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.876,"5min":1.417,"15min":1.417},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.89000000000000001,"5min":1.038,"15min":1.038},"last":0.54800000000000004}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":1.103,"15min":1.103},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.53700000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96899999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.55800000000000005}]},{"osd":11,"last update":"Thu May 9 00:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.58899999999999997}]}]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":987136,"data_stored":1160319,"data_compressed":44723,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64600000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66500000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.42199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.5}]},{"osd":2,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.37,"15min":0.35199999999999998},"min":{"1min":0.29299999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.62,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.307},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.372},"min":{"1min":0.28399999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.501},"min":{"1min":0.35799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73799999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.373},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.51200000000000001},"min":{"1min":0.40400000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.79500000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.441}]},{"osd":4,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.55200000000000005,"15min":0.53200000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.501,"5min":0.376,"15min":0.376},"max":{"1min":0.68100000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.53900000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69199999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu May 9 00:02:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.59599999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47999999999999998}]},{"osd":8,"last update":"Thu May 9 00:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.39800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83499999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40200000000000002}]},{"osd":9,"last update":"Thu May 9 00:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.53000000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.432},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66400000000000003,"15min":0.65500000000000003},"min":{"1min":0.59099999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52400000000000002}]},{"osd":10,"last update":"Thu May 9 00:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":65442,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66170,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":133876,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393932,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":198965,"data_compressed":8014,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:03:05.468 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-05-09T00:03:05.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-09T00:03:05.514 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:03:05 smithi150 sudo[84351]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:05.514 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:03:05 smithi150 sudo[84351]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:05.514 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:03:05 smithi150 sudo[84351]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:05.514 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:03:05 smithi150 sudo[84351]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.631+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/1407912019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f581050a0 msgr2=0x7f0f5810cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.631+0000 7f0f5ff1b700 1 --2- 172.21.15.81:0/1407912019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f581050a0 0x7f0f5810cc20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000b0a0 tx=0x7f0f5000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.631+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/1407912019 shutdown_connections 2024-05-09T00:03:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.631+0000 7f0f5ff1b700 1 --2- 172.21.15.81:0/1407912019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f581050a0 0x7f0f5810cc20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.631+0000 7f0f5ff1b700 1 --2- 172.21.15.81:0/1407912019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f580fff80 0x7f0f58100360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.631+0000 7f0f5ff1b700 1 --2- 172.21.15.81:0/1407912019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f58100930 0x7f0f58104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.631+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/1407912019 >> 172.21.15.81:0/1407912019 conn(0x7f0f580fb840 msgr2=0x7f0f580fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.631+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/1407912019 shutdown_connections 2024-05-09T00:03:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.631+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/1407912019 wait complete. 2024-05-09T00:03:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5ff1b700 1 Processor -- start 2024-05-09T00:03:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5ff1b700 1 -- start start 2024-05-09T00:03:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5ff1b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f580fff80 0x7f0f58198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5ff1b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f581050a0 0x7f0f581987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5ff1b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f58198d60 0x7f0f581a3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5ff1b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f581a3a50 con 0x7f0f580fff80 2024-05-09T00:03:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5ff1b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f581a3bc0 con 0x7f0f58198d60 2024-05-09T00:03:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5ff1b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f581a3d80 con 0x7f0f581050a0 2024-05-09T00:03:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5dcb7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f580fff80 0x7f0f58198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5dcb7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f580fff80 0x7f0f58198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58202/0 (socket says 172.21.15.81:58202) 2024-05-09T00:03:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5dcb7700 1 -- 172.21.15.81:0/4162482260 learned_addr learned my addr 172.21.15.81:0/4162482260 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5d4b6700 1 --2- 172.21.15.81:0/4162482260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f581050a0 0x7f0f581987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5e4b8700 1 --2- 172.21.15.81:0/4162482260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f58198d60 0x7f0f581a3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5dcb7700 1 -- 172.21.15.81:0/4162482260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f581050a0 msgr2=0x7f0f581987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5dcb7700 1 --2- 172.21.15.81:0/4162482260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f581050a0 0x7f0f581987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5dcb7700 1 -- 172.21.15.81:0/4162482260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f58198d60 msgr2=0x7f0f581a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5dcb7700 1 --2- 172.21.15.81:0/4162482260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f58198d60 0x7f0f581a3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5dcb7700 1 -- 172.21.15.81:0/4162482260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f50009d00 con 0x7f0f580fff80 2024-05-09T00:03:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.632+0000 7f0f5dcb7700 1 --2- 172.21.15.81:0/4162482260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f580fff80 0x7f0f58198290 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400e9a0 tx=0x7f0f5400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.633+0000 7f0f4effd700 1 -- 172.21.15.81:0/4162482260 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54009790 con 0x7f0f580fff80 2024-05-09T00:03:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.633+0000 7f0f4effd700 1 -- 172.21.15.81:0/4162482260 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f5400cbd0 con 0x7f0f580fff80 2024-05-09T00:03:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.633+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/4162482260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f581a4060 con 0x7f0f580fff80 2024-05-09T00:03:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.633+0000 7f0f4effd700 1 -- 172.21.15.81:0/4162482260 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f54018680 con 0x7f0f580fff80 2024-05-09T00:03:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.633+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/4162482260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f581a4570 con 0x7f0f580fff80 2024-05-09T00:03:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.634+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/4162482260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f58108370 con 0x7f0f580fff80 2024-05-09T00:03:05.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.635+0000 7f0f4effd700 1 -- 172.21.15.81:0/4162482260 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f0f5400cd40 con 0x7f0f580fff80 2024-05-09T00:03:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.635+0000 7f0f4effd700 1 --2- 172.21.15.81:0/4162482260 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0f440a13b0 0x7f0f440a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.636+0000 7f0f5d4b6700 1 --2- 172.21.15.81:0/4162482260 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0f440a13b0 0x7f0f440a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.636+0000 7f0f4effd700 1 -- 172.21.15.81:0/4162482260 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f0f54014070 con 0x7f0f580fff80 2024-05-09T00:03:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.636+0000 7f0f5d4b6700 1 --2- 172.21.15.81:0/4162482260 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0f440a13b0 0x7f0f440a3870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f58069a20 tx=0x7f0f4800b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:05.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.640+0000 7f0f4effd700 1 -- 172.21.15.81:0/4162482260 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0f54052d60 con 0x7f0f580fff80 2024-05-09T00:03:05.696 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:03:05 smithi171 sudo[87187]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:05.696 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:03:05 smithi171 sudo[87187]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:05.696 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:03:05 smithi171 sudo[87187]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:05.696 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:03:05 smithi171 sudo[87187]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:05.696 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:03:05 smithi171 sudo[87190]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:05.696 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:03:05 smithi171 sudo[87190]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:05.697 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:03:05 smithi171 sudo[87190]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:05.697 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:03:05 smithi171 sudo[87190]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:05.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.840+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/4162482260 --> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f58069840 con 0x7f0f440a13b0 2024-05-09T00:03:05.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.851+0000 7f0f4effd700 1 -- 172.21.15.81:0/4162482260 <== mgr.15285 v2:172.21.15.81:6800/2111088526 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343285 (secure 0 0 0) 0x7f0f58069840 con 0x7f0f440a13b0 2024-05-09T00:03:05.849 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:03:05.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.854+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/4162482260 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0f440a13b0 msgr2=0x7f0f440a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:05.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.854+0000 7f0f5ff1b700 1 --2- 172.21.15.81:0/4162482260 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0f440a13b0 0x7f0f440a3870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0f58069a20 tx=0x7f0f4800b410 comp rx=0 tx=0).stop 2024-05-09T00:03:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.854+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/4162482260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f580fff80 msgr2=0x7f0f58198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.854+0000 7f0f5ff1b700 1 --2- 172.21.15.81:0/4162482260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f580fff80 0x7f0f58198290 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400e9a0 tx=0x7f0f5400ecb0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.854+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/4162482260 shutdown_connections 2024-05-09T00:03:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.854+0000 7f0f5ff1b700 1 --2- 172.21.15.81:0/4162482260 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0f440a13b0 0x7f0f440a3870 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.854+0000 7f0f5ff1b700 1 --2- 172.21.15.81:0/4162482260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0f58198d60 0x7f0f581a3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.854+0000 7f0f5ff1b700 1 --2- 172.21.15.81:0/4162482260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f580fff80 0x7f0f58198290 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.854+0000 7f0f5ff1b700 1 --2- 172.21.15.81:0/4162482260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f581050a0 0x7f0f581987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.854+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/4162482260 >> 172.21.15.81:0/4162482260 conn(0x7f0f580fb840 msgr2=0x7f0f580fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.854+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/4162482260 shutdown_connections 2024-05-09T00:03:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:05.854+0000 7f0f5ff1b700 1 -- 172.21.15.81:0/4162482260 wait complete. 2024-05-09T00:03:05.852 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-05-09T00:03:05.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:05 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2335812356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:03:05.859 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:05 smithi081 ceph-mon[42474]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:03:05.860 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-05-09T00:03:04.882662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1185615,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":673,"num_read_kb":497,"num_write":455,"num_write_kb":4367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1181725,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376244,"kb_used_data":11044,"kb_used_omap":18,"kb_used_meta":365037,"kb_avail":1124565580,"statfs":{"total":1151940427776,"available":1151555153920,"internally_reserved":0,"allocated":11309056,"data_stored":8394175,"data_compressed":204414,"data_compressed_allocated":270336,"data_compressed_original":3047424,"omap_allocated":19131,"internal_metadata":373798213},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.990706"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.909563+0000","last_change":"2024-05-09T00:01:45.048606+0000","last_active":"2024-05-09T00:02:58.909563+0000","last_peered":"2024-05-09T00:02:58.909563+0000","last_clean":"2024-05-09T00:02:58.909563+0000","last_became_active":"2024-05-09T00:01:45.047691+0000","last_became_peered":"2024-05-09T00:01:45.047691+0000","last_unstale":"2024-05-09T00:02:58.909563+0000","last_undegraded":"2024-05-09T00:02:58.909563+0000","last_fullsized":"2024-05-09T00:02:58.909563+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:03.881912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.920179+0000","last_change":"2024-05-09T00:01:45.046812+0000","last_active":"2024-05-09T00:02:58.920179+0000","last_peered":"2024-05-09T00:02:58.920179+0000","last_clean":"2024-05-09T00:02:58.920179+0000","last_became_active":"2024-05-09T00:01:45.046510+0000","last_became_peered":"2024-05-09T00:01:45.046510+0000","last_unstale":"2024-05-09T00:02:58.920179+0000","last_undegraded":"2024-05-09T00:02:58.920179+0000","last_fullsized":"2024-05-09T00:02:58.920179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:18:03.614974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925132+0000","last_change":"2024-05-09T00:01:45.040304+0000","last_active":"2024-05-09T00:02:58.925132+0000","last_peered":"2024-05-09T00:02:58.925132+0000","last_clean":"2024-05-09T00:02:58.925132+0000","last_became_active":"2024-05-09T00:01:45.039990+0000","last_became_peered":"2024-05-09T00:01:45.039990+0000","last_unstale":"2024-05-09T00:02:58.925132+0000","last_undegraded":"2024-05-09T00:02:58.925132+0000","last_fullsized":"2024-05-09T00:02:58.925132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:17:33.563999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.913271+0000","last_change":"2024-05-09T00:01:45.040528+0000","last_active":"2024-05-09T00:02:58.913271+0000","last_peered":"2024-05-09T00:02:58.913271+0000","last_clean":"2024-05-09T00:02:58.913271+0000","last_became_active":"2024-05-09T00:01:45.040100+0000","last_became_peered":"2024-05-09T00:01:45.040100+0000","last_unstale":"2024-05-09T00:02:58.913271+0000","last_undegraded":"2024-05-09T00:02:58.913271+0000","last_fullsized":"2024-05-09T00:02:58.913271+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:40:02.739346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.922977+0000","last_change":"2024-05-09T00:01:45.036192+0000","last_active":"2024-05-09T00:02:58.922977+0000","last_peered":"2024-05-09T00:02:58.922977+0000","last_clean":"2024-05-09T00:02:58.922977+0000","last_became_active":"2024-05-09T00:01:45.035845+0000","last_became_peered":"2024-05-09T00:01:45.035845+0000","last_unstale":"2024-05-09T00:02:58.922977+0000","last_undegraded":"2024-05-09T00:02:58.922977+0000","last_fullsized":"2024-05-09T00:02:58.922977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:15:25.494946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.920477+0000","last_change":"2024-05-09T00:01:45.047866+0000","last_active":"2024-05-09T00:02:58.920477+0000","last_peered":"2024-05-09T00:02:58.920477+0000","last_clean":"2024-05-09T00:02:58.920477+0000","last_became_active":"2024-05-09T00:01:45.047549+0000","last_became_peered":"2024-05-09T00:01:45.047549+0000","last_unstale":"2024-05-09T00:02:58.920477+0000","last_undegraded":"2024-05-09T00:02:58.920477+0000","last_fullsized":"2024-05-09T00:02:58.920477+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:34:33.378675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917257+0000","last_change":"2024-05-09T00:01:45.054246+0000","last_active":"2024-05-09T00:02:58.917257+0000","last_peered":"2024-05-09T00:02:58.917257+0000","last_clean":"2024-05-09T00:02:58.917257+0000","last_became_active":"2024-05-09T00:01:45.053863+0000","last_became_peered":"2024-05-09T00:01:45.053863+0000","last_unstale":"2024-05-09T00:02:58.917257+0000","last_undegraded":"2024-05-09T00:02:58.917257+0000","last_fullsized":"2024-05-09T00:02:58.917257+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:12.080139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929596+0000","last_change":"2024-05-09T00:01:45.053747+0000","last_active":"2024-05-09T00:02:58.929596+0000","last_peered":"2024-05-09T00:02:58.929596+0000","last_clean":"2024-05-09T00:02:58.929596+0000","last_became_active":"2024-05-09T00:01:45.053461+0000","last_became_peered":"2024-05-09T00:01:45.053461+0000","last_unstale":"2024-05-09T00:02:58.929596+0000","last_undegraded":"2024-05-09T00:02:58.929596+0000","last_fullsized":"2024-05-09T00:02:58.929596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:51:30.018296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.916352+0000","last_change":"2024-05-09T00:01:45.053851+0000","last_active":"2024-05-09T00:02:58.916352+0000","last_peered":"2024-05-09T00:02:58.916352+0000","last_clean":"2024-05-09T00:02:58.916352+0000","last_became_active":"2024-05-09T00:01:45.053471+0000","last_became_peered":"2024-05-09T00:01:45.053471+0000","last_unstale":"2024-05-09T00:02:58.916352+0000","last_undegraded":"2024-05-09T00:02:58.916352+0000","last_fullsized":"2024-05-09T00:02:58.916352+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:28:25.786870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.920307+0000","last_change":"2024-05-09T00:01:45.048916+0000","last_active":"2024-05-09T00:02:58.920307+0000","last_peered":"2024-05-09T00:02:58.920307+0000","last_clean":"2024-05-09T00:02:58.920307+0000","last_became_active":"2024-05-09T00:01:45.048227+0000","last_became_peered":"2024-05-09T00:01:45.048227+0000","last_unstale":"2024-05-09T00:02:58.920307+0000","last_undegraded":"2024-05-09T00:02:58.920307+0000","last_fullsized":"2024-05-09T00:02:58.920307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:17:51.246933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.914098+0000","last_change":"2024-05-09T00:01:45.053449+0000","last_active":"2024-05-09T00:02:58.914098+0000","last_peered":"2024-05-09T00:02:58.914098+0000","last_clean":"2024-05-09T00:02:58.914098+0000","last_became_active":"2024-05-09T00:01:45.053060+0000","last_became_peered":"2024-05-09T00:01:45.053060+0000","last_unstale":"2024-05-09T00:02:58.914098+0000","last_undegraded":"2024-05-09T00:02:58.914098+0000","last_fullsized":"2024-05-09T00:02:58.914098+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:40:21.236565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921190+0000","last_change":"2024-05-09T00:01:45.047231+0000","last_active":"2024-05-09T00:02:58.921190+0000","last_peered":"2024-05-09T00:02:58.921190+0000","last_clean":"2024-05-09T00:02:58.921190+0000","last_became_active":"2024-05-09T00:01:45.046897+0000","last_became_peered":"2024-05-09T00:01:45.046897+0000","last_unstale":"2024-05-09T00:02:58.921190+0000","last_undegraded":"2024-05-09T00:02:58.921190+0000","last_fullsized":"2024-05-09T00:02:58.921190+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:45:13.307931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925844+0000","last_change":"2024-05-09T00:01:45.048545+0000","last_active":"2024-05-09T00:02:58.925844+0000","last_peered":"2024-05-09T00:02:58.925844+0000","last_clean":"2024-05-09T00:02:58.925844+0000","last_became_active":"2024-05-09T00:01:45.048237+0000","last_became_peered":"2024-05-09T00:01:45.048237+0000","last_unstale":"2024-05-09T00:02:58.925844+0000","last_undegraded":"2024-05-09T00:02:58.925844+0000","last_fullsized":"2024-05-09T00:02:58.925844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:45:41.578704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.924801+0000","last_change":"2024-05-09T00:01:45.046735+0000","last_active":"2024-05-09T00:02:58.924801+0000","last_peered":"2024-05-09T00:02:58.924801+0000","last_clean":"2024-05-09T00:02:58.924801+0000","last_became_active":"2024-05-09T00:01:45.046441+0000","last_became_peered":"2024-05-09T00:01:45.046441+0000","last_unstale":"2024-05-09T00:02:58.924801+0000","last_undegraded":"2024-05-09T00:02:58.924801+0000","last_fullsized":"2024-05-09T00:02:58.924801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:26:51.380665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926317+0000","last_change":"2024-05-09T00:01:45.036289+0000","last_active":"2024-05-09T00:02:58.926317+0000","last_peered":"2024-05-09T00:02:58.926317+0000","last_clean":"2024-05-09T00:02:58.926317+0000","last_became_active":"2024-05-09T00:01:45.035996+0000","last_became_peered":"2024-05-09T00:01:45.035996+0000","last_unstale":"2024-05-09T00:02:58.926317+0000","last_undegraded":"2024-05-09T00:02:58.926317+0000","last_fullsized":"2024-05-09T00:02:58.926317+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:53:52.769668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.901458+0000","last_change":"2024-05-09T00:01:45.044908+0000","last_active":"2024-05-09T00:02:58.901458+0000","last_peered":"2024-05-09T00:02:58.901458+0000","last_clean":"2024-05-09T00:02:58.901458+0000","last_became_active":"2024-05-09T00:01:45.044508+0000","last_became_peered":"2024-05-09T00:01:45.044508+0000","last_unstale":"2024-05-09T00:02:58.901458+0000","last_undegraded":"2024-05-09T00:02:58.901458+0000","last_fullsized":"2024-05-09T00:02:58.901458+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:02:23.578743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.910112+0000","last_change":"2024-05-09T00:01:45.048389+0000","last_active":"2024-05-09T00:02:58.910112+0000","last_peered":"2024-05-09T00:02:58.910112+0000","last_clean":"2024-05-09T00:02:58.910112+0000","last_became_active":"2024-05-09T00:01:45.047959+0000","last_became_peered":"2024-05-09T00:01:45.047959+0000","last_unstale":"2024-05-09T00:02:58.910112+0000","last_undegraded":"2024-05-09T00:02:58.910112+0000","last_fullsized":"2024-05-09T00:02:58.910112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:12:44.298296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.919072+0000","last_change":"2024-05-09T00:01:45.048314+0000","last_active":"2024-05-09T00:02:58.919072+0000","last_peered":"2024-05-09T00:02:58.919072+0000","last_clean":"2024-05-09T00:02:58.919072+0000","last_became_active":"2024-05-09T00:01:45.048002+0000","last_became_peered":"2024-05-09T00:01:45.048002+0000","last_unstale":"2024-05-09T00:02:58.919072+0000","last_undegraded":"2024-05-09T00:02:58.919072+0000","last_fullsized":"2024-05-09T00:02:58.919072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:36.327498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925163+0000","last_change":"2024-05-09T00:01:45.035747+0000","last_active":"2024-05-09T00:02:58.925163+0000","last_peered":"2024-05-09T00:02:58.925163+0000","last_clean":"2024-05-09T00:02:58.925163+0000","last_became_active":"2024-05-09T00:01:45.035122+0000","last_became_peered":"2024-05-09T00:01:45.035122+0000","last_unstale":"2024-05-09T00:02:58.925163+0000","last_undegraded":"2024-05-09T00:02:58.925163+0000","last_fullsized":"2024-05-09T00:02:58.925163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:07:21.361033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"79'9","reported_seq":25,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.833443+0000","last_change":"2024-05-09T00:01:44.620816+0000","last_active":"2024-05-09T00:02:47.833443+0000","last_peered":"2024-05-09T00:02:47.833443+0000","last_clean":"2024-05-09T00:02:47.833443+0000","last_became_active":"2024-05-09T00:01:44.620524+0000","last_became_peered":"2024-05-09T00:01:44.620524+0000","last_unstale":"2024-05-09T00:02:47.833443+0000","last_undegraded":"2024-05-09T00:02:47.833443+0000","last_fullsized":"2024-05-09T00:02:47.833443+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:34:05.623111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.922725+0000","last_change":"2024-05-09T00:01:45.049115+0000","last_active":"2024-05-09T00:02:58.922725+0000","last_peered":"2024-05-09T00:02:58.922725+0000","last_clean":"2024-05-09T00:02:58.922725+0000","last_became_active":"2024-05-09T00:01:45.048825+0000","last_became_peered":"2024-05-09T00:01:45.048825+0000","last_unstale":"2024-05-09T00:02:58.922725+0000","last_undegraded":"2024-05-09T00:02:58.922725+0000","last_fullsized":"2024-05-09T00:02:58.922725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:09:29.890090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"79'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.912390+0000","last_change":"2024-05-09T00:01:44.621711+0000","last_active":"2024-05-09T00:02:47.912390+0000","last_peered":"2024-05-09T00:02:47.912390+0000","last_clean":"2024-05-09T00:02:47.912390+0000","last_became_active":"2024-05-09T00:01:44.621433+0000","last_became_peered":"2024-05-09T00:01:44.621433+0000","last_unstale":"2024-05-09T00:02:47.912390+0000","last_undegraded":"2024-05-09T00:02:47.912390+0000","last_fullsized":"2024-05-09T00:02:47.912390+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:05:57.451467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926717+0000","last_change":"2024-05-09T00:01:45.038415+0000","last_active":"2024-05-09T00:02:58.926717+0000","last_peered":"2024-05-09T00:02:58.926717+0000","last_clean":"2024-05-09T00:02:58.926717+0000","last_became_active":"2024-05-09T00:01:45.038141+0000","last_became_peered":"2024-05-09T00:01:45.038141+0000","last_unstale":"2024-05-09T00:02:58.926717+0000","last_undegraded":"2024-05-09T00:02:58.926717+0000","last_fullsized":"2024-05-09T00:02:58.926717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:26:37.772886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'4","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:48.407709+0000","last_change":"2024-05-09T00:02:47.920115+0000","last_active":"2024-05-09T00:02:48.407709+0000","last_peered":"2024-05-09T00:02:48.407709+0000","last_clean":"2024-05-09T00:02:48.407709+0000","last_became_active":"2024-05-09T00:02:47.913365+0000","last_became_peered":"2024-05-09T00:02:47.913365+0000","last_unstale":"2024-05-09T00:02:48.407709+0000","last_undegraded":"2024-05-09T00:02:48.407709+0000","last_fullsized":"2024-05-09T00:02:48.407709+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:08:20.930857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925715+0000","last_change":"2024-05-09T00:01:45.048553+0000","last_active":"2024-05-09T00:02:58.925715+0000","last_peered":"2024-05-09T00:02:58.925715+0000","last_clean":"2024-05-09T00:02:58.925715+0000","last_became_active":"2024-05-09T00:01:45.046659+0000","last_became_peered":"2024-05-09T00:01:45.046659+0000","last_unstale":"2024-05-09T00:02:58.925715+0000","last_undegraded":"2024-05-09T00:02:58.925715+0000","last_fullsized":"2024-05-09T00:02:58.925715+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:18:19.581843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"78'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836573+0000","last_change":"2024-05-09T00:01:44.614820+0000","last_active":"2024-05-09T00:02:47.836573+0000","last_peered":"2024-05-09T00:02:47.836573+0000","last_clean":"2024-05-09T00:02:47.836573+0000","last_became_active":"2024-05-09T00:01:44.614418+0000","last_became_peered":"2024-05-09T00:01:44.614418+0000","last_unstale":"2024-05-09T00:02:47.836573+0000","last_undegraded":"2024-05-09T00:02:47.836573+0000","last_fullsized":"2024-05-09T00:02:47.836573+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:18.133098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.914191+0000","last_change":"2024-05-09T00:02:47.913822+0000","last_active":"2024-05-09T00:02:58.914191+0000","last_peered":"2024-05-09T00:02:58.914191+0000","last_clean":"2024-05-09T00:02:58.914191+0000","last_became_active":"2024-05-09T00:02:47.913375+0000","last_became_peered":"2024-05-09T00:02:47.913375+0000","last_unstale":"2024-05-09T00:02:58.914191+0000","last_undegraded":"2024-05-09T00:02:58.914191+0000","last_fullsized":"2024-05-09T00:02:58.914191+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:46:12.486856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"82'8","reported_seq":113,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.855099+0000","last_change":"2024-05-09T00:02:47.845264+0000","last_active":"2024-05-09T00:02:59.855099+0000","last_peered":"2024-05-09T00:02:59.855099+0000","last_clean":"2024-05-09T00:02:59.855099+0000","last_became_active":"2024-05-09T00:02:47.837967+0000","last_became_peered":"2024-05-09T00:02:47.837967+0000","last_unstale":"2024-05-09T00:02:59.855099+0000","last_undegraded":"2024-05-09T00:02:59.855099+0000","last_fullsized":"2024-05-09T00:02:59.855099+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:52.606544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1422,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":967,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.912254+0000","last_change":"2024-05-09T00:01:45.049365+0000","last_active":"2024-05-09T00:02:58.912254+0000","last_peered":"2024-05-09T00:02:58.912254+0000","last_clean":"2024-05-09T00:02:58.912254+0000","last_became_active":"2024-05-09T00:01:45.049037+0000","last_became_peered":"2024-05-09T00:01:45.049037+0000","last_unstale":"2024-05-09T00:02:58.912254+0000","last_undegraded":"2024-05-09T00:02:58.912254+0000","last_fullsized":"2024-05-09T00:02:58.912254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:14:34.290672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.831655+0000","last_change":"2024-05-09T00:01:44.617212+0000","last_active":"2024-05-09T00:02:47.831655+0000","last_peered":"2024-05-09T00:02:47.831655+0000","last_clean":"2024-05-09T00:02:47.831655+0000","last_became_active":"2024-05-09T00:01:44.616898+0000","last_became_peered":"2024-05-09T00:01:44.616898+0000","last_unstale":"2024-05-09T00:02:47.831655+0000","last_undegraded":"2024-05-09T00:02:47.831655+0000","last_fullsized":"2024-05-09T00:02:47.831655+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:54:39.630039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917773+0000","last_change":"2024-05-09T00:02:47.912964+0000","last_active":"2024-05-09T00:02:58.917773+0000","last_peered":"2024-05-09T00:02:58.917773+0000","last_clean":"2024-05-09T00:02:58.917773+0000","last_became_active":"2024-05-09T00:02:47.912523+0000","last_became_peered":"2024-05-09T00:02:47.912523+0000","last_unstale":"2024-05-09T00:02:58.917773+0000","last_undegraded":"2024-05-09T00:02:58.917773+0000","last_fullsized":"2024-05-09T00:02:58.917773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:36:49.437293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,3],"acting":[9,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.19","version":"79'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.830682+0000","last_change":"2024-05-09T00:01:44.618214+0000","last_active":"2024-05-09T00:02:47.830682+0000","last_peered":"2024-05-09T00:02:47.830682+0000","last_clean":"2024-05-09T00:02:47.830682+0000","last_became_active":"2024-05-09T00:01:44.617769+0000","last_became_peered":"2024-05-09T00:01:44.617769+0000","last_unstale":"2024-05-09T00:02:47.830682+0000","last_undegraded":"2024-05-09T00:02:47.830682+0000","last_fullsized":"2024-05-09T00:02:47.830682+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:43.654597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.927185+0000","last_change":"2024-05-09T00:01:45.037441+0000","last_active":"2024-05-09T00:02:58.927185+0000","last_peered":"2024-05-09T00:02:58.927185+0000","last_clean":"2024-05-09T00:02:58.927185+0000","last_became_active":"2024-05-09T00:01:45.036668+0000","last_became_peered":"2024-05-09T00:01:45.036668+0000","last_unstale":"2024-05-09T00:02:58.927185+0000","last_undegraded":"2024-05-09T00:02:58.927185+0000","last_fullsized":"2024-05-09T00:02:58.927185+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:52:25.116685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"79'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.834752+0000","last_change":"2024-05-09T00:01:44.624973+0000","last_active":"2024-05-09T00:02:47.834752+0000","last_peered":"2024-05-09T00:02:47.834752+0000","last_clean":"2024-05-09T00:02:47.834752+0000","last_became_active":"2024-05-09T00:01:44.624470+0000","last_became_peered":"2024-05-09T00:01:44.624470+0000","last_unstale":"2024-05-09T00:02:47.834752+0000","last_undegraded":"2024-05-09T00:02:47.834752+0000","last_fullsized":"2024-05-09T00:02:47.834752+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:23:22.021060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.919463+0000","last_change":"2024-05-09T00:01:45.037414+0000","last_active":"2024-05-09T00:02:58.919463+0000","last_peered":"2024-05-09T00:02:58.919463+0000","last_clean":"2024-05-09T00:02:58.919463+0000","last_became_active":"2024-05-09T00:01:45.037095+0000","last_became_peered":"2024-05-09T00:01:45.037095+0000","last_unstale":"2024-05-09T00:02:58.919463+0000","last_undegraded":"2024-05-09T00:02:58.919463+0000","last_fullsized":"2024-05-09T00:02:58.919463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:42:29.812977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'4","reported_seq":89,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.880182+0000","last_change":"2024-05-09T00:01:44.614823+0000","last_active":"2024-05-09T00:02:58.880182+0000","last_peered":"2024-05-09T00:02:58.880182+0000","last_clean":"2024-05-09T00:02:58.880182+0000","last_became_active":"2024-05-09T00:01:44.614502+0000","last_became_peered":"2024-05-09T00:01:44.614502+0000","last_unstale":"2024-05-09T00:02:58.880182+0000","last_undegraded":"2024-05-09T00:02:58.880182+0000","last_fullsized":"2024-05-09T00:02:58.880182+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:06:14.486852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.919897+0000","last_change":"2024-05-09T00:01:45.048631+0000","last_active":"2024-05-09T00:02:58.919897+0000","last_peered":"2024-05-09T00:02:58.919897+0000","last_clean":"2024-05-09T00:02:58.919897+0000","last_became_active":"2024-05-09T00:01:45.046691+0000","last_became_peered":"2024-05-09T00:01:45.046691+0000","last_unstale":"2024-05-09T00:02:58.919897+0000","last_undegraded":"2024-05-09T00:02:58.919897+0000","last_fullsized":"2024-05-09T00:02:58.919897+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:59:35.017208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"79'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.833476+0000","last_change":"2024-05-09T00:01:44.622684+0000","last_active":"2024-05-09T00:02:47.833476+0000","last_peered":"2024-05-09T00:02:47.833476+0000","last_clean":"2024-05-09T00:02:47.833476+0000","last_became_active":"2024-05-09T00:01:44.622301+0000","last_became_peered":"2024-05-09T00:01:44.622301+0000","last_unstale":"2024-05-09T00:02:47.833476+0000","last_undegraded":"2024-05-09T00:02:47.833476+0000","last_fullsized":"2024-05-09T00:02:47.833476+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:03:38.343729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.924718+0000","last_change":"2024-05-09T00:01:45.050240+0000","last_active":"2024-05-09T00:02:58.924718+0000","last_peered":"2024-05-09T00:02:58.924718+0000","last_clean":"2024-05-09T00:02:58.924718+0000","last_became_active":"2024-05-09T00:01:45.049955+0000","last_became_peered":"2024-05-09T00:01:45.049955+0000","last_unstale":"2024-05-09T00:02:58.924718+0000","last_undegraded":"2024-05-09T00:02:58.924718+0000","last_fullsized":"2024-05-09T00:02:58.924718+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:59:56.811853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"79'4","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836054+0000","last_change":"2024-05-09T00:01:44.618591+0000","last_active":"2024-05-09T00:02:47.836054+0000","last_peered":"2024-05-09T00:02:47.836054+0000","last_clean":"2024-05-09T00:02:47.836054+0000","last_became_active":"2024-05-09T00:01:44.618198+0000","last_became_peered":"2024-05-09T00:01:44.618198+0000","last_unstale":"2024-05-09T00:02:47.836054+0000","last_undegraded":"2024-05-09T00:02:47.836054+0000","last_fullsized":"2024-05-09T00:02:47.836054+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:20:27.705444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.908801+0000","last_change":"2024-05-09T00:01:45.037485+0000","last_active":"2024-05-09T00:02:58.908801+0000","last_peered":"2024-05-09T00:02:58.908801+0000","last_clean":"2024-05-09T00:02:58.908801+0000","last_became_active":"2024-05-09T00:01:45.037150+0000","last_became_peered":"2024-05-09T00:01:45.037150+0000","last_unstale":"2024-05-09T00:02:58.908801+0000","last_undegraded":"2024-05-09T00:02:58.908801+0000","last_fullsized":"2024-05-09T00:02:58.908801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:03:55.476243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'34","reported_seq":199,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.855097+0000","last_change":"2024-05-09T00:01:44.620485+0000","last_active":"2024-05-09T00:02:59.855097+0000","last_peered":"2024-05-09T00:02:59.855097+0000","last_clean":"2024-05-09T00:02:59.855097+0000","last_became_active":"2024-05-09T00:01:44.620004+0000","last_became_peered":"2024-05-09T00:01:44.620004+0000","last_unstale":"2024-05-09T00:02:59.855097+0000","last_undegraded":"2024-05-09T00:02:59.855097+0000","last_fullsized":"2024-05-09T00:02:59.855097+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:46:58.529038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65442,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":150,"num_read_kb":138,"num_write":35,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.915108+0000","last_change":"2024-05-09T00:01:45.045581+0000","last_active":"2024-05-09T00:02:58.915108+0000","last_peered":"2024-05-09T00:02:58.915108+0000","last_clean":"2024-05-09T00:02:58.915108+0000","last_became_active":"2024-05-09T00:01:45.045290+0000","last_became_peered":"2024-05-09T00:01:45.045290+0000","last_unstale":"2024-05-09T00:02:58.915108+0000","last_undegraded":"2024-05-09T00:02:58.915108+0000","last_fullsized":"2024-05-09T00:02:58.915108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:41:36.860897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'6","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836337+0000","last_change":"2024-05-09T00:01:44.624145+0000","last_active":"2024-05-09T00:02:47.836337+0000","last_peered":"2024-05-09T00:02:47.836337+0000","last_clean":"2024-05-09T00:02:47.836337+0000","last_became_active":"2024-05-09T00:01:44.623804+0000","last_became_peered":"2024-05-09T00:01:44.623804+0000","last_unstale":"2024-05-09T00:02:47.836337+0000","last_undegraded":"2024-05-09T00:02:47.836337+0000","last_fullsized":"2024-05-09T00:02:47.836337+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:18:22.366804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921602+0000","last_change":"2024-05-09T00:02:47.836307+0000","last_active":"2024-05-09T00:02:58.921602+0000","last_peered":"2024-05-09T00:02:58.921602+0000","last_clean":"2024-05-09T00:02:58.921602+0000","last_became_active":"2024-05-09T00:02:47.835948+0000","last_became_peered":"2024-05-09T00:02:47.835948+0000","last_unstale":"2024-05-09T00:02:58.921602+0000","last_undegraded":"2024-05-09T00:02:58.921602+0000","last_fullsized":"2024-05-09T00:02:58.921602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:58:52.582826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.835187+0000","last_change":"2024-05-09T00:01:44.620188+0000","last_active":"2024-05-09T00:02:47.835187+0000","last_peered":"2024-05-09T00:02:47.835187+0000","last_clean":"2024-05-09T00:02:47.835187+0000","last_became_active":"2024-05-09T00:01:44.619914+0000","last_became_peered":"2024-05-09T00:01:44.619914+0000","last_unstale":"2024-05-09T00:02:47.835187+0000","last_undegraded":"2024-05-09T00:02:47.835187+0000","last_fullsized":"2024-05-09T00:02:47.835187+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:28:50.349806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.927088+0000","last_change":"2024-05-09T00:01:45.044881+0000","last_active":"2024-05-09T00:02:58.927088+0000","last_peered":"2024-05-09T00:02:58.927088+0000","last_clean":"2024-05-09T00:02:58.927088+0000","last_became_active":"2024-05-09T00:01:45.044176+0000","last_became_peered":"2024-05-09T00:01:45.044176+0000","last_unstale":"2024-05-09T00:02:58.927088+0000","last_undegraded":"2024-05-09T00:02:58.927088+0000","last_fullsized":"2024-05-09T00:02:58.927088+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:00:15.672966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'4","reported_seq":92,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.174413+0000","last_change":"2024-05-09T00:01:44.616560+0000","last_active":"2024-05-09T00:02:59.174413+0000","last_peered":"2024-05-09T00:02:59.174413+0000","last_clean":"2024-05-09T00:02:59.174413+0000","last_became_active":"2024-05-09T00:01:44.616172+0000","last_became_peered":"2024-05-09T00:01:44.616172+0000","last_unstale":"2024-05-09T00:02:59.174413+0000","last_undegraded":"2024-05-09T00:02:59.174413+0000","last_fullsized":"2024-05-09T00:02:59.174413+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:30:51.191335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917956+0000","last_change":"2024-05-09T00:02:47.836428+0000","last_active":"2024-05-09T00:02:58.917956+0000","last_peered":"2024-05-09T00:02:58.917956+0000","last_clean":"2024-05-09T00:02:58.917956+0000","last_became_active":"2024-05-09T00:02:47.836075+0000","last_became_peered":"2024-05-09T00:02:47.836075+0000","last_unstale":"2024-05-09T00:02:58.917956+0000","last_undegraded":"2024-05-09T00:02:58.917956+0000","last_fullsized":"2024-05-09T00:02:58.917956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:29:43.983172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,10],"acting":[7,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"79'15","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.835384+0000","last_change":"2024-05-09T00:01:44.622089+0000","last_active":"2024-05-09T00:02:47.835384+0000","last_peered":"2024-05-09T00:02:47.835384+0000","last_clean":"2024-05-09T00:02:47.835384+0000","last_became_active":"2024-05-09T00:01:44.621731+0000","last_became_peered":"2024-05-09T00:01:44.621731+0000","last_unstale":"2024-05-09T00:02:47.835384+0000","last_undegraded":"2024-05-09T00:02:47.835384+0000","last_fullsized":"2024-05-09T00:02:47.835384+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:56:57.276454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.910413+0000","last_change":"2024-05-09T00:01:45.058785+0000","last_active":"2024-05-09T00:02:58.910413+0000","last_peered":"2024-05-09T00:02:58.910413+0000","last_clean":"2024-05-09T00:02:58.910413+0000","last_became_active":"2024-05-09T00:01:45.058387+0000","last_became_peered":"2024-05-09T00:01:45.058387+0000","last_unstale":"2024-05-09T00:02:58.910413+0000","last_undegraded":"2024-05-09T00:02:58.910413+0000","last_fullsized":"2024-05-09T00:02:58.910413+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:13:18.868021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'2","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:48.407741+0000","last_change":"2024-05-09T00:02:47.842905+0000","last_active":"2024-05-09T00:02:48.407741+0000","last_peered":"2024-05-09T00:02:48.407741+0000","last_clean":"2024-05-09T00:02:48.407741+0000","last_became_active":"2024-05-09T00:02:47.837585+0000","last_became_peered":"2024-05-09T00:02:47.837585+0000","last_unstale":"2024-05-09T00:02:48.407741+0000","last_undegraded":"2024-05-09T00:02:48.407741+0000","last_fullsized":"2024-05-09T00:02:48.407741+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:34:14.463873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925053+0000","last_change":"2024-05-09T00:02:47.838555+0000","last_active":"2024-05-09T00:02:58.925053+0000","last_peered":"2024-05-09T00:02:58.925053+0000","last_clean":"2024-05-09T00:02:58.925053+0000","last_became_active":"2024-05-09T00:02:47.837636+0000","last_became_peered":"2024-05-09T00:02:47.837636+0000","last_unstale":"2024-05-09T00:02:58.925053+0000","last_undegraded":"2024-05-09T00:02:58.925053+0000","last_fullsized":"2024-05-09T00:02:58.925053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:12:30.564942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,6],"acting":[11,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.833331+0000","last_change":"2024-05-09T00:01:44.618910+0000","last_active":"2024-05-09T00:02:47.833331+0000","last_peered":"2024-05-09T00:02:47.833331+0000","last_clean":"2024-05-09T00:02:47.833331+0000","last_became_active":"2024-05-09T00:01:44.618569+0000","last_became_peered":"2024-05-09T00:01:44.618569+0000","last_unstale":"2024-05-09T00:02:47.833331+0000","last_undegraded":"2024-05-09T00:02:47.833331+0000","last_fullsized":"2024-05-09T00:02:47.833331+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:33:40.748747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929775+0000","last_change":"2024-05-09T00:01:45.047305+0000","last_active":"2024-05-09T00:02:58.929775+0000","last_peered":"2024-05-09T00:02:58.929775+0000","last_clean":"2024-05-09T00:02:58.929775+0000","last_became_active":"2024-05-09T00:01:45.046944+0000","last_became_peered":"2024-05-09T00:01:45.046944+0000","last_unstale":"2024-05-09T00:02:58.929775+0000","last_undegraded":"2024-05-09T00:02:58.929775+0000","last_fullsized":"2024-05-09T00:02:58.929775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:24:59.065224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"79'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.833584+0000","last_change":"2024-05-09T00:01:44.620497+0000","last_active":"2024-05-09T00:02:47.833584+0000","last_peered":"2024-05-09T00:02:47.833584+0000","last_clean":"2024-05-09T00:02:47.833584+0000","last_became_active":"2024-05-09T00:01:44.620165+0000","last_became_peered":"2024-05-09T00:01:44.620165+0000","last_unstale":"2024-05-09T00:02:47.833584+0000","last_undegraded":"2024-05-09T00:02:47.833584+0000","last_fullsized":"2024-05-09T00:02:47.833584+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:44.514434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925805+0000","last_change":"2024-05-09T00:01:45.045408+0000","last_active":"2024-05-09T00:02:58.925805+0000","last_peered":"2024-05-09T00:02:58.925805+0000","last_clean":"2024-05-09T00:02:58.925805+0000","last_became_active":"2024-05-09T00:01:45.045086+0000","last_became_peered":"2024-05-09T00:01:45.045086+0000","last_unstale":"2024-05-09T00:02:58.925805+0000","last_undegraded":"2024-05-09T00:02:58.925805+0000","last_fullsized":"2024-05-09T00:02:58.925805+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:43:54.568889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.907222+0000","last_change":"2024-05-09T00:01:45.057315+0000","last_active":"2024-05-09T00:02:58.907222+0000","last_peered":"2024-05-09T00:02:58.907222+0000","last_clean":"2024-05-09T00:02:58.907222+0000","last_became_active":"2024-05-09T00:01:45.056962+0000","last_became_peered":"2024-05-09T00:01:45.056962+0000","last_unstale":"2024-05-09T00:02:58.907222+0000","last_undegraded":"2024-05-09T00:02:58.907222+0000","last_fullsized":"2024-05-09T00:02:58.907222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:09:52.136588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'5","reported_seq":90,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.151416+0000","last_change":"2024-05-09T00:01:44.618477+0000","last_active":"2024-05-09T00:02:59.151416+0000","last_peered":"2024-05-09T00:02:59.151416+0000","last_clean":"2024-05-09T00:02:59.151416+0000","last_became_active":"2024-05-09T00:01:44.618154+0000","last_became_peered":"2024-05-09T00:01:44.618154+0000","last_unstale":"2024-05-09T00:02:59.151416+0000","last_undegraded":"2024-05-09T00:02:59.151416+0000","last_fullsized":"2024-05-09T00:02:59.151416+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:24.380644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":70,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921394+0000","last_change":"2024-05-09T00:01:45.053772+0000","last_active":"2024-05-09T00:02:58.921394+0000","last_peered":"2024-05-09T00:02:58.921394+0000","last_clean":"2024-05-09T00:02:58.921394+0000","last_became_active":"2024-05-09T00:01:45.053453+0000","last_became_peered":"2024-05-09T00:01:45.053453+0000","last_unstale":"2024-05-09T00:02:58.921394+0000","last_undegraded":"2024-05-09T00:02:58.921394+0000","last_fullsized":"2024-05-09T00:02:58.921394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:02:46.136845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"79'3","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.835823+0000","last_change":"2024-05-09T00:01:44.610200+0000","last_active":"2024-05-09T00:02:47.835823+0000","last_peered":"2024-05-09T00:02:47.835823+0000","last_clean":"2024-05-09T00:02:47.835823+0000","last_became_active":"2024-05-09T00:01:44.609764+0000","last_became_peered":"2024-05-09T00:01:44.609764+0000","last_unstale":"2024-05-09T00:02:47.835823+0000","last_undegraded":"2024-05-09T00:02:47.835823+0000","last_fullsized":"2024-05-09T00:02:47.835823+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:16:36.122765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":334,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.834185+0000","last_change":"2024-05-09T00:00:57.898648+0000","last_active":"2024-05-09T00:02:47.834185+0000","last_peered":"2024-05-09T00:02:47.834185+0000","last_clean":"2024-05-09T00:02:47.834185+0000","last_became_active":"2024-05-09T00:00:57.898259+0000","last_became_peered":"2024-05-09T00:00:57.898259+0000","last_unstale":"2024-05-09T00:02:47.834185+0000","last_undegraded":"2024-05-09T00:02:47.834185+0000","last_fullsized":"2024-05-09T00:02:47.834185+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T23:58:35.200738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T23:58:35.200738+0000","last_clean_scrub_stamp":"2024-05-08T23:58:35.200738+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:17:47.782068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.919516+0000","last_change":"2024-05-09T00:01:45.035407+0000","last_active":"2024-05-09T00:02:58.919516+0000","last_peered":"2024-05-09T00:02:58.919516+0000","last_clean":"2024-05-09T00:02:58.919516+0000","last_became_active":"2024-05-09T00:01:45.035115+0000","last_became_peered":"2024-05-09T00:01:45.035115+0000","last_unstale":"2024-05-09T00:02:58.919516+0000","last_undegraded":"2024-05-09T00:02:58.919516+0000","last_fullsized":"2024-05-09T00:02:58.919516+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:40:23.603196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.834350+0000","last_change":"2024-05-09T00:01:44.622514+0000","last_active":"2024-05-09T00:02:47.834350+0000","last_peered":"2024-05-09T00:02:47.834350+0000","last_clean":"2024-05-09T00:02:47.834350+0000","last_became_active":"2024-05-09T00:01:44.621454+0000","last_became_peered":"2024-05-09T00:01:44.621454+0000","last_unstale":"2024-05-09T00:02:47.834350+0000","last_undegraded":"2024-05-09T00:02:47.834350+0000","last_fullsized":"2024-05-09T00:02:47.834350+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:05:10.801721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"79'1","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.837046+0000","last_change":"2024-05-09T00:01:44.622743+0000","last_active":"2024-05-09T00:02:47.837046+0000","last_peered":"2024-05-09T00:02:47.837046+0000","last_clean":"2024-05-09T00:02:47.837046+0000","last_became_active":"2024-05-09T00:01:44.622304+0000","last_became_peered":"2024-05-09T00:01:44.622304+0000","last_unstale":"2024-05-09T00:02:47.837046+0000","last_undegraded":"2024-05-09T00:02:47.837046+0000","last_fullsized":"2024-05-09T00:02:47.837046+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:30:01.829369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921939+0000","last_change":"2024-05-09T00:01:45.035458+0000","last_active":"2024-05-09T00:02:58.921939+0000","last_peered":"2024-05-09T00:02:58.921939+0000","last_clean":"2024-05-09T00:02:58.921939+0000","last_became_active":"2024-05-09T00:01:45.035140+0000","last_became_peered":"2024-05-09T00:01:45.035140+0000","last_unstale":"2024-05-09T00:02:58.921939+0000","last_undegraded":"2024-05-09T00:02:58.921939+0000","last_fullsized":"2024-05-09T00:02:58.921939+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:02:31.258013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'40","reported_seq":78,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.109427+0000","last_change":"2024-05-09T00:01:44.615172+0000","last_active":"2024-05-09T00:02:59.109427+0000","last_peered":"2024-05-09T00:02:59.109427+0000","last_clean":"2024-05-09T00:02:59.109427+0000","last_became_active":"2024-05-09T00:01:44.614892+0000","last_became_peered":"2024-05-09T00:01:44.614892+0000","last_unstale":"2024-05-09T00:02:59.109427+0000","last_undegraded":"2024-05-09T00:02:59.109427+0000","last_fullsized":"2024-05-09T00:02:59.109427+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:34:17.868378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":71,"num_write_kb":834,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926189+0000","last_change":"2024-05-09T00:01:45.044708+0000","last_active":"2024-05-09T00:02:58.926189+0000","last_peered":"2024-05-09T00:02:58.926189+0000","last_clean":"2024-05-09T00:02:58.926189+0000","last_became_active":"2024-05-09T00:01:45.044451+0000","last_became_peered":"2024-05-09T00:01:45.044451+0000","last_unstale":"2024-05-09T00:02:58.926189+0000","last_undegraded":"2024-05-09T00:02:58.926189+0000","last_fullsized":"2024-05-09T00:02:58.926189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:50:16.099211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"79'4","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.835582+0000","last_change":"2024-05-09T00:01:44.617434+0000","last_active":"2024-05-09T00:02:47.835582+0000","last_peered":"2024-05-09T00:02:47.835582+0000","last_clean":"2024-05-09T00:02:47.835582+0000","last_became_active":"2024-05-09T00:01:44.617017+0000","last_became_peered":"2024-05-09T00:01:44.617017+0000","last_unstale":"2024-05-09T00:02:47.835582+0000","last_undegraded":"2024-05-09T00:02:47.835582+0000","last_fullsized":"2024-05-09T00:02:47.835582+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:29.889962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929780+0000","last_change":"2024-05-09T00:01:45.035749+0000","last_active":"2024-05-09T00:02:58.929780+0000","last_peered":"2024-05-09T00:02:58.929780+0000","last_clean":"2024-05-09T00:02:58.929780+0000","last_became_active":"2024-05-09T00:01:45.034862+0000","last_became_peered":"2024-05-09T00:01:45.034862+0000","last_unstale":"2024-05-09T00:02:58.929780+0000","last_undegraded":"2024-05-09T00:02:58.929780+0000","last_fullsized":"2024-05-09T00:02:58.929780+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:25:20.824467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"79'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.912120+0000","last_change":"2024-05-09T00:01:44.616652+0000","last_active":"2024-05-09T00:02:47.912120+0000","last_peered":"2024-05-09T00:02:47.912120+0000","last_clean":"2024-05-09T00:02:47.912120+0000","last_became_active":"2024-05-09T00:01:44.616273+0000","last_became_peered":"2024-05-09T00:01:44.616273+0000","last_unstale":"2024-05-09T00:02:47.912120+0000","last_undegraded":"2024-05-09T00:02:47.912120+0000","last_fullsized":"2024-05-09T00:02:47.912120+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:16:12.379909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.916820+0000","last_change":"2024-05-09T00:01:45.047020+0000","last_active":"2024-05-09T00:02:58.916820+0000","last_peered":"2024-05-09T00:02:58.916820+0000","last_clean":"2024-05-09T00:02:58.916820+0000","last_became_active":"2024-05-09T00:01:45.046813+0000","last_became_peered":"2024-05-09T00:01:45.046813+0000","last_unstale":"2024-05-09T00:02:58.916820+0000","last_undegraded":"2024-05-09T00:02:58.916820+0000","last_fullsized":"2024-05-09T00:02:58.916820+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:53.042258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"79'3","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.911743+0000","last_change":"2024-05-09T00:01:44.610843+0000","last_active":"2024-05-09T00:02:47.911743+0000","last_peered":"2024-05-09T00:02:47.911743+0000","last_clean":"2024-05-09T00:02:47.911743+0000","last_became_active":"2024-05-09T00:01:44.610523+0000","last_became_peered":"2024-05-09T00:01:44.610523+0000","last_unstale":"2024-05-09T00:02:47.911743+0000","last_undegraded":"2024-05-09T00:02:47.911743+0000","last_fullsized":"2024-05-09T00:02:47.911743+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:56:58.527344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.911641+0000","last_change":"2024-05-09T00:01:45.046259+0000","last_active":"2024-05-09T00:02:58.911641+0000","last_peered":"2024-05-09T00:02:58.911641+0000","last_clean":"2024-05-09T00:02:58.911641+0000","last_became_active":"2024-05-09T00:01:45.045954+0000","last_became_peered":"2024-05-09T00:01:45.045954+0000","last_unstale":"2024-05-09T00:02:58.911641+0000","last_undegraded":"2024-05-09T00:02:58.911641+0000","last_fullsized":"2024-05-09T00:02:58.911641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:49:46.569934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"79'1","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836410+0000","last_change":"2024-05-09T00:01:44.616781+0000","last_active":"2024-05-09T00:02:47.836410+0000","last_peered":"2024-05-09T00:02:47.836410+0000","last_clean":"2024-05-09T00:02:47.836410+0000","last_became_active":"2024-05-09T00:01:44.616386+0000","last_became_peered":"2024-05-09T00:01:44.616386+0000","last_unstale":"2024-05-09T00:02:47.836410+0000","last_undegraded":"2024-05-09T00:02:47.836410+0000","last_fullsized":"2024-05-09T00:02:47.836410+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:50:17.073596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.927662+0000","last_change":"2024-05-09T00:01:45.046701+0000","last_active":"2024-05-09T00:02:58.927662+0000","last_peered":"2024-05-09T00:02:58.927662+0000","last_clean":"2024-05-09T00:02:58.927662+0000","last_became_active":"2024-05-09T00:01:45.046409+0000","last_became_peered":"2024-05-09T00:01:45.046409+0000","last_unstale":"2024-05-09T00:02:58.927662+0000","last_undegraded":"2024-05-09T00:02:58.927662+0000","last_fullsized":"2024-05-09T00:02:58.927662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:25:32.178410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"79'4","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836025+0000","last_change":"2024-05-09T00:01:44.623271+0000","last_active":"2024-05-09T00:02:47.836025+0000","last_peered":"2024-05-09T00:02:47.836025+0000","last_clean":"2024-05-09T00:02:47.836025+0000","last_became_active":"2024-05-09T00:01:44.622863+0000","last_became_peered":"2024-05-09T00:01:44.622863+0000","last_unstale":"2024-05-09T00:02:47.836025+0000","last_undegraded":"2024-05-09T00:02:47.836025+0000","last_fullsized":"2024-05-09T00:02:47.836025+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:15:58.609140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925564+0000","last_change":"2024-05-09T00:01:45.052296+0000","last_active":"2024-05-09T00:02:58.925564+0000","last_peered":"2024-05-09T00:02:58.925564+0000","last_clean":"2024-05-09T00:02:58.925564+0000","last_became_active":"2024-05-09T00:01:45.051951+0000","last_became_peered":"2024-05-09T00:01:45.051951+0000","last_unstale":"2024-05-09T00:02:58.925564+0000","last_undegraded":"2024-05-09T00:02:58.925564+0000","last_fullsized":"2024-05-09T00:02:58.925564+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:00:46.908629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"79'3","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.836186+0000","last_change":"2024-05-09T00:01:44.620387+0000","last_active":"2024-05-09T00:02:47.836186+0000","last_peered":"2024-05-09T00:02:47.836186+0000","last_clean":"2024-05-09T00:02:47.836186+0000","last_became_active":"2024-05-09T00:01:44.620024+0000","last_became_peered":"2024-05-09T00:01:44.620024+0000","last_unstale":"2024-05-09T00:02:47.836186+0000","last_undegraded":"2024-05-09T00:02:47.836186+0000","last_fullsized":"2024-05-09T00:02:47.836186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:41:31.599273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917468+0000","last_change":"2024-05-09T00:01:45.050092+0000","last_active":"2024-05-09T00:02:58.917468+0000","last_peered":"2024-05-09T00:02:58.917468+0000","last_clean":"2024-05-09T00:02:58.917468+0000","last_became_active":"2024-05-09T00:01:45.049794+0000","last_became_peered":"2024-05-09T00:01:45.049794+0000","last_unstale":"2024-05-09T00:02:58.917468+0000","last_undegraded":"2024-05-09T00:02:58.917468+0000","last_fullsized":"2024-05-09T00:02:58.917468+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:39:56.932513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'39","reported_seq":62,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:59.101124+0000","last_change":"2024-05-09T00:01:44.609940+0000","last_active":"2024-05-09T00:02:59.101124+0000","last_peered":"2024-05-09T00:02:59.101124+0000","last_clean":"2024-05-09T00:02:59.101124+0000","last_became_active":"2024-05-09T00:01:44.609593+0000","last_became_peered":"2024-05-09T00:01:44.609593+0000","last_unstale":"2024-05-09T00:02:59.101124+0000","last_undegraded":"2024-05-09T00:02:59.101124+0000","last_fullsized":"2024-05-09T00:02:59.101124+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:00:09.671548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929505+0000","last_change":"2024-05-09T00:01:45.042533+0000","last_active":"2024-05-09T00:02:58.929505+0000","last_peered":"2024-05-09T00:02:58.929505+0000","last_clean":"2024-05-09T00:02:58.929505+0000","last_became_active":"2024-05-09T00:01:45.042155+0000","last_became_peered":"2024-05-09T00:01:45.042155+0000","last_unstale":"2024-05-09T00:02:58.929505+0000","last_undegraded":"2024-05-09T00:02:58.929505+0000","last_fullsized":"2024-05-09T00:02:58.929505+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:36.519165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"78'2","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-05-09T00:02:47.831123+0000","last_change":"2024-05-09T00:01:44.617518+0000","last_active":"2024-05-09T00:02:47.831123+0000","last_peered":"2024-05-09T00:02:47.831123+0000","last_clean":"2024-05-09T00:02:47.831123+0000","last_became_active":"2024-05-09T00:01:44.617196+0000","last_became_peered":"2024-05-09T00:01:44.617196+0000","last_unstale":"2024-05-09T00:02:47.831123+0000","last_undegraded":"2024-05-09T00:02:47.831123+0000","last_fullsized":"2024-05-09T00:02:47.831123+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:43.589179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:43.589179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:47.062855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.917866+0000","last_change":"2024-05-09T00:01:45.053962+0000","last_active":"2024-05-09T00:02:58.917866+0000","last_peered":"2024-05-09T00:02:58.917866+0000","last_clean":"2024-05-09T00:02:58.917866+0000","last_became_active":"2024-05-09T00:01:45.053637+0000","last_became_peered":"2024-05-09T00:01:45.053637+0000","last_unstale":"2024-05-09T00:02:58.917866+0000","last_undegraded":"2024-05-09T00:02:58.917866+0000","last_fullsized":"2024-05-09T00:02:58.917866+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:41:18.188806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.911544+0000","last_change":"2024-05-09T00:01:45.055532+0000","last_active":"2024-05-09T00:02:58.911544+0000","last_peered":"2024-05-09T00:02:58.911544+0000","last_clean":"2024-05-09T00:02:58.911544+0000","last_became_active":"2024-05-09T00:01:45.054939+0000","last_became_peered":"2024-05-09T00:01:45.054939+0000","last_unstale":"2024-05-09T00:02:58.911544+0000","last_undegraded":"2024-05-09T00:02:58.911544+0000","last_fullsized":"2024-05-09T00:02:58.911544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:38:53.919492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.911899+0000","last_change":"2024-05-09T00:01:45.053752+0000","last_active":"2024-05-09T00:02:58.911899+0000","last_peered":"2024-05-09T00:02:58.911899+0000","last_clean":"2024-05-09T00:02:58.911899+0000","last_became_active":"2024-05-09T00:01:45.053409+0000","last_became_peered":"2024-05-09T00:01:45.053409+0000","last_unstale":"2024-05-09T00:02:58.911899+0000","last_undegraded":"2024-05-09T00:02:58.911899+0000","last_fullsized":"2024-05-09T00:02:58.911899+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:12.517211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.924846+0000","last_change":"2024-05-09T00:01:45.036145+0000","last_active":"2024-05-09T00:02:58.924846+0000","last_peered":"2024-05-09T00:02:58.924846+0000","last_clean":"2024-05-09T00:02:58.924846+0000","last_became_active":"2024-05-09T00:01:45.035839+0000","last_became_peered":"2024-05-09T00:01:45.035839+0000","last_unstale":"2024-05-09T00:02:58.924846+0000","last_undegraded":"2024-05-09T00:02:58.924846+0000","last_fullsized":"2024-05-09T00:02:58.924846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T09:03:17.630399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926417+0000","last_change":"2024-05-09T00:01:45.032875+0000","last_active":"2024-05-09T00:02:58.926417+0000","last_peered":"2024-05-09T00:02:58.926417+0000","last_clean":"2024-05-09T00:02:58.926417+0000","last_became_active":"2024-05-09T00:01:45.032552+0000","last_became_peered":"2024-05-09T00:01:45.032552+0000","last_unstale":"2024-05-09T00:02:58.926417+0000","last_undegraded":"2024-05-09T00:02:58.926417+0000","last_fullsized":"2024-05-09T00:02:58.926417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T11:24:17.244204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.925597+0000","last_change":"2024-05-09T00:01:45.032427+0000","last_active":"2024-05-09T00:02:58.925597+0000","last_peered":"2024-05-09T00:02:58.925597+0000","last_clean":"2024-05-09T00:02:58.925597+0000","last_became_active":"2024-05-09T00:01:45.032038+0000","last_became_peered":"2024-05-09T00:01:45.032038+0000","last_unstale":"2024-05-09T00:02:58.925597+0000","last_undegraded":"2024-05-09T00:02:58.925597+0000","last_fullsized":"2024-05-09T00:02:58.925597+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:15:13.495291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.909248+0000","last_change":"2024-05-09T00:01:45.053080+0000","last_active":"2024-05-09T00:02:58.909248+0000","last_peered":"2024-05-09T00:02:58.909248+0000","last_clean":"2024-05-09T00:02:58.909248+0000","last_became_active":"2024-05-09T00:01:45.052728+0000","last_became_peered":"2024-05-09T00:01:45.052728+0000","last_unstale":"2024-05-09T00:02:58.909248+0000","last_undegraded":"2024-05-09T00:02:58.909248+0000","last_fullsized":"2024-05-09T00:02:58.909248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:42:59.631827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.913824+0000","last_change":"2024-05-09T00:01:45.044489+0000","last_active":"2024-05-09T00:02:58.913824+0000","last_peered":"2024-05-09T00:02:58.913824+0000","last_clean":"2024-05-09T00:02:58.913824+0000","last_became_active":"2024-05-09T00:01:45.044139+0000","last_became_peered":"2024-05-09T00:01:45.044139+0000","last_unstale":"2024-05-09T00:02:58.913824+0000","last_undegraded":"2024-05-09T00:02:58.913824+0000","last_fullsized":"2024-05-09T00:02:58.913824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:03:57.932238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.921240+0000","last_change":"2024-05-09T00:01:45.050829+0000","last_active":"2024-05-09T00:02:58.921240+0000","last_peered":"2024-05-09T00:02:58.921240+0000","last_clean":"2024-05-09T00:02:58.921240+0000","last_became_active":"2024-05-09T00:01:45.050410+0000","last_became_peered":"2024-05-09T00:01:45.050410+0000","last_unstale":"2024-05-09T00:02:58.921240+0000","last_undegraded":"2024-05-09T00:02:58.921240+0000","last_fullsized":"2024-05-09T00:02:58.921240+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:56:08.738918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.929503+0000","last_change":"2024-05-09T00:01:45.053957+0000","last_active":"2024-05-09T00:02:58.929503+0000","last_peered":"2024-05-09T00:02:58.929503+0000","last_clean":"2024-05-09T00:02:58.929503+0000","last_became_active":"2024-05-09T00:01:45.053487+0000","last_became_peered":"2024-05-09T00:01:45.053487+0000","last_unstale":"2024-05-09T00:02:58.929503+0000","last_undegraded":"2024-05-09T00:02:58.929503+0000","last_fullsized":"2024-05-09T00:02:58.929503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:18:35.131361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926068+0000","last_change":"2024-05-09T00:01:45.050653+0000","last_active":"2024-05-09T00:02:58.926068+0000","last_peered":"2024-05-09T00:02:58.926068+0000","last_clean":"2024-05-09T00:02:58.926068+0000","last_became_active":"2024-05-09T00:01:45.050322+0000","last_became_peered":"2024-05-09T00:01:45.050322+0000","last_unstale":"2024-05-09T00:02:58.926068+0000","last_undegraded":"2024-05-09T00:02:58.926068+0000","last_fullsized":"2024-05-09T00:02:58.926068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:11:45.137945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.901822+0000","last_change":"2024-05-09T00:01:45.044757+0000","last_active":"2024-05-09T00:02:58.901822+0000","last_peered":"2024-05-09T00:02:58.901822+0000","last_clean":"2024-05-09T00:02:58.901822+0000","last_became_active":"2024-05-09T00:01:45.044464+0000","last_became_peered":"2024-05-09T00:01:45.044464+0000","last_unstale":"2024-05-09T00:02:58.901822+0000","last_undegraded":"2024-05-09T00:02:58.901822+0000","last_fullsized":"2024-05-09T00:02:58.901822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T10:35:44.402750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.926851+0000","last_change":"2024-05-09T00:01:45.044515+0000","last_active":"2024-05-09T00:02:58.926851+0000","last_peered":"2024-05-09T00:02:58.926851+0000","last_clean":"2024-05-09T00:02:58.926851+0000","last_became_active":"2024-05-09T00:01:45.044209+0000","last_became_peered":"2024-05-09T00:01:45.044209+0000","last_unstale":"2024-05-09T00:02:58.926851+0000","last_undegraded":"2024-05-09T00:02:58.926851+0000","last_fullsized":"2024-05-09T00:02:58.926851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:31:18.523680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-09T00:02:58.906985+0000","last_change":"2024-05-09T00:01:45.044254+0000","last_active":"2024-05-09T00:02:58.906985+0000","last_peered":"2024-05-09T00:02:58.906985+0000","last_clean":"2024-05-09T00:02:58.906985+0000","last_became_active":"2024-05-09T00:01:45.043220+0000","last_became_peered":"2024-05-09T00:01:45.043220+0000","last_unstale":"2024-05-09T00:02:58.906985+0000","last_undegraded":"2024-05-09T00:02:58.906985+0000","last_fullsized":"2024-05-09T00:02:58.906985+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-09T00:01:44.591179+0000","last_clean_scrub_stamp":"2024-05-09T00:01:44.591179+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:39:53.986814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1771104,"data_compressed":106908,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":595013,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":537,"num_read_kb":378,"num_write":272,"num_write_kb":1427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":989,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":1785039,"data_compressed":81480,"data_compressed_allocated":110592,"data_compressed_original":1572864,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579928,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":892928,"data_stored":436562,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.505},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.437}]},{"osd":1,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.374}]},{"osd":2,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.497}]},{"osd":5,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.34999999999999998}]},{"osd":6,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.41899999999999998}]},{"osd":7,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.40899999999999997}]},{"osd":8,"last update":"Thu May 9 00:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.38600000000000001}]},{"osd":9,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.54600000000000004}]},{"osd":10,"last update":"Thu May 9 00:02:12 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.51400000000000001}]}]},{"osd":10,"up_from":67,"seq":287762808859,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32152,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713000,"statfs":{"total":95995035648,"available":95962112000,"internally_reserved":0,"allocated":1060864,"data_stored":1225408,"data_compressed":46581,"data_compressed_allocated":61440,"data_compressed_original":729088,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.47999999999999998,"15min":0.48699999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48599999999999999,"15min":0.48999999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55500000000000005,"15min":0.55800000000000005},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70799999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79000000000000004,"5min":1.109,"15min":1.109},"last":0.432}]},{"osd":3,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.627,"15min":0.64000000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.90200000000000002,"5min":1.022,"15min":1.022},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61099999999999999,"15min":0.61899999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.57999999999999996},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.85099999999999998,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.371},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57199999999999995,"15min":0.58099999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":1.347,"15min":1.347},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82399999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.876,"5min":1.28,"15min":1.28},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.72099999999999997,"15min":0.73699999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83799999999999997,"5min":1.371,"15min":1.371},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94399999999999995,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":8,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.96899999999999997,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.497},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.72799999999999998,"15min":0.74199999999999999},"min":{"1min":0.504,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90600000000000003,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.504}]},{"osd":9,"last update":"Thu May 9 00:02:58 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0269999999999999,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.77100000000000002,"15min":0.79000000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.85999999999999999,"5min":1.681,"15min":1.681},"last":0.55800000000000005}]},{"osd":11,"last update":"Thu May 9 00:02:14 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.61899999999999999}]}]},{"osd":9,"up_from":62,"seq":266287972383,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":929792,"data_stored":829992,"data_compressed":22077,"data_compressed_allocated":28672,"data_compressed_original":401408,"omap_allocated":1599,"internal_metadata":31848897},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42599999999999999,"15min":0.42899999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.45000000000000001,"15min":0.45700000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.33500000000000002}]},{"osd":1,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57699999999999996,"15min":0.57599999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.318},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.41799999999999998}]},{"osd":2,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57599999999999996,"15min":0.57499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.496,"15min":0.49399999999999999},"min":{"1min":0.27400000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":1.1399999999999999,"5min":0.62,"15min":0.53400000000000003},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":11.98,"5min":11.98,"15min":11.98},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63900000000000001,"15min":0.64100000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.498},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.438}]},{"osd":6,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":0.71699999999999997,"15min":0.63900000000000001},"min":{"1min":0.34100000000000003,"5min":0.314,"15min":0.314},"max":{"1min":11.930999999999999,"5min":11.930999999999999,"15min":11.930999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.69799999999999995,"15min":0.65800000000000003},"min":{"1min":0.42299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":7.1929999999999996,"5min":7.1929999999999996,"15min":7.1929999999999996},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73099999999999998,"15min":0.74299999999999999},"min":{"1min":0.48599999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1140000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71599999999999997,"15min":0.72399999999999998},"min":{"1min":0.47899999999999998,"5min":0.438,"15min":0.438},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.48199999999999998}]},{"osd":8,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.036,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.60999999999999999}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.70399999999999996,"15min":0.70899999999999996},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.623},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72199999999999998,"15min":0.72999999999999998},"min":{"1min":0.53900000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.63900000000000001}]}]},{"osd":8,"up_from":55,"seq":236223201314,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31992,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713160,"statfs":{"total":95995035648,"available":95962275840,"internally_reserved":0,"allocated":897024,"data_stored":436343,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.53900000000000003,"15min":0.54800000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.60399999999999998,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73599999999999999,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.38}]},{"osd":1,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.42299999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83699999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.48499999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48099999999999998,"15min":0.48299999999999998},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.64600000000000002,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.495},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52500000000000002,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64500000000000002,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64100000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.58799999999999997,"15min":0.59799999999999998},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71499999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66900000000000004,"15min":0.67000000000000004},"min":{"1min":0.44,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85299999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66600000000000004,"15min":0.66800000000000004},"min":{"1min":0.54400000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79000000000000004,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.439}]},{"osd":5,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.62,"15min":0.629},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69399999999999995,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.47999999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.77300000000000002,"5min":0.996,"15min":0.996},"last":0.35199999999999998}]},{"osd":6,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66500000000000004,"15min":0.67500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.79700000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70799999999999996,"15min":0.71799999999999997},"min":{"1min":0.503,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.86599999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.44900000000000001}]},{"osd":7,"last update":"Thu May 9 00:02:19 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.748,"15min":0.754},"min":{"1min":0.56599999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.82399999999999995,"5min":1.004,"15min":1.004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.75700000000000001,"15min":0.755},"min":{"1min":0.66300000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93400000000000005,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.58499999999999996}]},{"osd":9,"last update":"Thu May 9 00:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73599999999999999,"15min":0.73399999999999999},"min":{"1min":0.53500000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72299999999999998,"15min":0.71599999999999997},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.56899999999999995}]},{"osd":10,"last update":"Thu May 9 00:01:59 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.59599999999999997}]},{"osd":11,"last update":"Thu May 9 00:02:49 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.61799999999999999}]}]},{"osd":7,"up_from":48,"seq":206158430246,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":954368,"data_stored":1029380,"data_compressed":38567,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.376},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.443}]},{"osd":1,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.39500000000000002,"15min":0.38300000000000001},"min":{"1min":0.28699999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.40899999999999997},"min":{"1min":0.31900000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.314}]},{"osd":2,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.42199999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.432,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.80600000000000005,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.35999999999999999}]},{"osd":3,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76900000000000002,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.84399999999999997,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.44700000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.73599999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.38},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.49399999999999999,"15min":0.48999999999999999},"min":{"1min":0.32200000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.76000000000000001,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.29999999999999999}]},{"osd":5,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.626,"15min":0.62},"min":{"1min":0.49399999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.82899999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63200000000000001,"15min":0.628},"min":{"1min":0.502,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.84799999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.40899999999999997}]},{"osd":6,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64100000000000001,"15min":0.63500000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66000000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93000000000000005,"5min":1.032,"15min":1.032},"last":0.496}]},{"osd":8,"last update":"Thu May 9 00:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67400000000000004,"15min":0.67200000000000004},"min":{"1min":0.52900000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84199999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68200000000000005,"15min":0.67500000000000004},"min":{"1min":0.55600000000000005,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85199999999999998,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.433}]},{"osd":9,"last update":"Thu May 9 00:02:41 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.82799999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71399999999999997,"15min":0.72299999999999998},"min":{"1min":0.51500000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.77500000000000002,"5min":1.258,"15min":1.258},"last":0.52000000000000002}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.53000000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.874,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70599999999999996,"15min":0.71399999999999997},"min":{"1min":0.56100000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.81599999999999995,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.56100000000000005}]},{"osd":11,"last update":"Thu May 9 00:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.58599999999999997}]}]},{"osd":6,"up_from":43,"seq":184683593770,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31988,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713164,"statfs":{"total":95995035648,"available":95962279936,"internally_reserved":0,"allocated":892928,"data_stored":436165,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.377,"15min":0.38600000000000001},"min":{"1min":0.23999999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.40200000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.38700000000000001,"15min":0.39800000000000002},"min":{"1min":0.26400000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.45800000000000002,"5min":0.62,"15min":0.62},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76700000000000002,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53700000000000003,"15min":0.52800000000000002},"min":{"1min":0.35999999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68400000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55000000000000004,"15min":0.56399999999999995},"min":{"1min":0.376,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65600000000000003,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.59699999999999998,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.41499999999999998,"15min":0.42799999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.42599999999999999,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.48199999999999998,"15min":0.495},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.505,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.499}]},{"osd":4,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64900000000000002,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.76100000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.61099999999999999,"15min":0.624},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.70299999999999996,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.626,"15min":0.64800000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.68600000000000005,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu May 9 00:02:03 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.86699999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.622},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68500000000000005,"15min":0.69099999999999995},"min":{"1min":0.497,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.63200000000000001}]},{"osd":8,"last update":"Thu May 9 00:02:24 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.65000000000000002,"15min":0.66000000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.66700000000000004,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90500000000000003,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.73299999999999998}]},{"osd":9,"last update":"Thu May 9 00:02:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.64400000000000002,"15min":0.67000000000000004},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.61299999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.503,"5min":0.65700000000000003,"15min":0.68300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.72999999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.79000000000000004}]},{"osd":10,"last update":"Thu May 9 00:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.70099999999999996,"15min":0.71299999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.77700000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67400000000000004,"15min":0.68500000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79200000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.65500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32048,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713104,"statfs":{"total":95995035648,"available":95962218496,"internally_reserved":0,"allocated":954368,"data_stored":501400,"data_compressed":4789,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:24 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.32900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.317,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72999999999999998,"5min":0.752,"15min":0.752},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu May 9 00:02:40 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.53200000000000003,"15min":0.504},"min":{"1min":0.45800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.753,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.55800000000000005,"15min":0.52400000000000002},"min":{"1min":0.58199999999999996,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51500000000000001,"15min":0.503},"min":{"1min":0.38200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.52000000000000002}]},{"osd":4,"last update":"Thu May 9 00:02:17 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.434,"15min":0.40999999999999998},"min":{"1min":0.32300000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.44400000000000001,"15min":0.42299999999999999},"min":{"1min":0.30299999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.39900000000000002}]},{"osd":5,"last update":"Thu May 9 00:02:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56999999999999995,"15min":0.54700000000000004},"min":{"1min":0.48899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79800000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.439,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91800000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.52900000000000003}]},{"osd":6,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58899999999999997,"15min":0.57899999999999996},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.57599999999999996},"min":{"1min":0.436,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.76600000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.438}]},{"osd":7,"last update":"Thu May 9 00:02:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.35799999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.36599999999999999}]},{"osd":8,"last update":"Thu May 9 00:02:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.55400000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.85899999999999999,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.52600000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.78600000000000003,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.53700000000000003}]},{"osd":9,"last update":"Thu May 9 00:02:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.91100000000000003,"5min":1.02,"15min":1.02},"last":0.63},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.70699999999999996,"15min":0.70999999999999996},"min":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92200000000000004,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.622}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64900000000000002,"15min":0.64200000000000002},"min":{"1min":0.498,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89200000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.498},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.5,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86399999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.56299999999999994}]},{"osd":11,"last update":"Thu May 9 00:02:44 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.65800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32008,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713144,"statfs":{"total":95995035648,"available":95962259456,"internally_reserved":0,"allocated":913408,"data_stored":437436,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu May 9 00:02:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52700000000000002,"15min":0.49099999999999999},"min":{"1min":0.40999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.752,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54400000000000004,"15min":0.51200000000000001},"min":{"1min":0.46600000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78700000000000003,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.78900000000000003}]},{"osd":2,"last update":"Thu May 9 00:02:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.53400000000000003,"15min":0.50800000000000001},"min":{"1min":0.433,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67100000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52400000000000002,"15min":0.504},"min":{"1min":0.36899999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68300000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu May 9 00:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.37,"15min":0.37},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"last":0.438}]},{"osd":4,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.51600000000000001,"15min":0.502},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.625},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.40699999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.72399999999999998,"5min":1.075,"15min":1.075},"last":0.747}]},{"osd":5,"last update":"Thu May 9 00:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.53400000000000003,"15min":0.51400000000000001},"min":{"1min":0.442,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72499999999999998,"5min":0.748,"15min":0.748},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55300000000000005,"15min":0.54200000000000004},"min":{"1min":0.41199999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66300000000000003,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55500000000000005}]},{"osd":6,"last update":"Thu May 9 00:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.46600000000000003,"15min":0.47999999999999998},"min":{"1min":0.29299999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.52500000000000002,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48899999999999999,"15min":0.49399999999999999},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.59599999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu May 9 00:01:01 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.56100000000000005}]},{"osd":8,"last update":"Thu May 9 00:02:28 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.433,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77700000000000002,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.67200000000000004,"15min":0.68200000000000005},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.72799999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.57999999999999996}]},{"osd":9,"last update":"Thu May 9 00:02:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.61199999999999999,"15min":0.63400000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.61499999999999999,"5min":1.038,"15min":1.038},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.626,"15min":0.64500000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.67500000000000004,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.36499999999999999}]},{"osd":10,"last update":"Thu May 9 00:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.71099999999999997,"5min":1.123,"15min":1.123},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.69799999999999995,"15min":0.71099999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.84199999999999997,"5min":1.121,"15min":1.121},"last":0.84199999999999997}]},{"osd":11,"last update":"Thu May 9 00:02:15 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.76400000000000001}]}]},{"osd":2,"up_from":17,"seq":73014444088,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":966656,"data_stored":501509,"data_compressed":4789,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.49299999999999999,"15min":0.46700000000000003},"min":{"1min":0.35099999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70399999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.502,"15min":0.47799999999999998},"min":{"1min":0.39600000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.78600000000000003,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44400000000000001}]},{"osd":1,"last update":"Thu May 9 00:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.53100000000000003,"15min":0.51400000000000001},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71799999999999997,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.53500000000000003,"15min":0.495},"min":{"1min":0.372,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.315}]},{"osd":3,"last update":"Thu May 9 00:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.42699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.745,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.432},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.51100000000000001},"min":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.377}]},{"osd":5,"last update":"Thu May 9 00:02:33 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.47499999999999998,"15min":0.443},"min":{"1min":0.38300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.48699999999999999,"15min":0.45800000000000002},"min":{"1min":0.34999999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79800000000000004,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.36099999999999999}]},{"osd":6,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.439,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.38900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90600000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.502}]},{"osd":7,"last update":"Thu May 9 00:01:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.67100000000000004}]},{"osd":8,"last update":"Thu May 9 00:02:23 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.54500000000000004,"15min":0.53000000000000003},"min":{"1min":0.32200000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.45300000000000001}]},{"osd":9,"last update":"Thu May 9 00:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.59199999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88400000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.66600000000000004,"15min":0.65600000000000003},"min":{"1min":0.57699999999999996,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90900000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56000000000000005}]},{"osd":10,"last update":"Thu May 9 00:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.53400000000000003,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73099999999999998,"15min":0.72999999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91600000000000004,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48099999999999998}]},{"osd":11,"last update":"Thu May 9 00:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.51500000000000001}]}]},{"osd":3,"up_from":24,"seq":103079215156,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32044,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713108,"statfs":{"total":95995035648,"available":95962222592,"internally_reserved":0,"allocated":954368,"data_stored":961292,"data_compressed":28233,"data_compressed_allocated":36864,"data_compressed_original":524288,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33900000000000002,"15min":0.33400000000000002},"min":{"1min":0.26600000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.497,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.28699999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.48699999999999999,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.438}]},{"osd":1,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52500000000000002,"15min":0.51600000000000001},"min":{"1min":0.33900000000000002,"5min":0.315,"15min":0.315},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.371}]},{"osd":2,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.54700000000000004},"min":{"1min":0.433,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70499999999999996,"5min":1.075,"15min":1.075},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55900000000000005,"15min":0.54000000000000004},"min":{"1min":0.39600000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.55400000000000005,"15min":0.55100000000000005},"min":{"1min":0.434,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.63700000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.377,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79400000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu May 9 00:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57999999999999996,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57999999999999996,"15min":0.56999999999999995},"min":{"1min":0.49399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67400000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.501}]},{"osd":6,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44400000000000001,"15min":0.439},"min":{"1min":0.34799999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.55700000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32700000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64400000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.46100000000000002}]},{"osd":7,"last update":"Thu May 9 00:02:07 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.72799999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59399999999999997,"15min":0.59699999999999998},"min":{"1min":0.47099999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.69899999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51400000000000001}]},{"osd":8,"last update":"Thu May 9 00:01:21 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.46700000000000003}]},{"osd":9,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63900000000000001,"15min":0.65100000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.54300000000000004}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.68000000000000005,"15min":0.69399999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82499999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67500000000000004,"15min":0.67600000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.56699999999999995}]},{"osd":11,"last update":"Thu May 9 00:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.49399999999999999}]}]},{"osd":4,"up_from":31,"seq":133143986225,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32000,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713152,"statfs":{"total":95995035648,"available":95962267648,"internally_reserved":0,"allocated":905216,"data_stored":438369,"data_compressed":2931,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:01:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.496,"15min":0.48699999999999999},"min":{"1min":0.39400000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79800000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.497,"15min":0.48499999999999999},"min":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.371,"15min":0.35299999999999998},"min":{"1min":0.312,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.378,"15min":0.36499999999999999},"min":{"1min":0.28299999999999997,"5min":0.215,"15min":0.215},"max":{"1min":0.64000000000000001,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.318}]},{"osd":2,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.54500000000000004,"15min":0.51500000000000001},"min":{"1min":0.39900000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.628,"5min":0.54100000000000004,"15min":0.50700000000000001},"min":{"1min":0.40400000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu May 9 00:02:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.38200000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.433}]},{"osd":5,"last update":"Thu May 9 00:02:29 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.83499999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.627,"15min":0.59899999999999998},"min":{"1min":0.49299999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.89900000000000002,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52600000000000002}]},{"osd":6,"last update":"Thu May 9 00:02:53 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.57199999999999995,"15min":0.56299999999999994},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.76600000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu May 9 00:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53400000000000003,"15min":0.52400000000000002},"min":{"1min":0.35499999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":1.575,"5min":1.575,"15min":1.575},"last":0.46800000000000003}]},{"osd":8,"last update":"Thu May 9 00:02:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71199999999999997,"15min":0.71699999999999997},"min":{"1min":0.43099999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.871,"5min":1.484,"15min":1.484},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.52000000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.84399999999999997,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.501}]},{"osd":9,"last update":"Thu May 9 00:02:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.73799999999999999,"15min":0.748},"min":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.876,"5min":1.417,"15min":1.417},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.70899999999999996,"15min":0.71399999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.89000000000000001,"5min":1.038,"15min":1.038},"last":0.54800000000000004}]},{"osd":10,"last update":"Thu May 9 00:02:57 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91000000000000003,"5min":1.103,"15min":1.103},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.53700000000000003,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.96899999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.55800000000000005}]},{"osd":11,"last update":"Thu May 9 00:02:43 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.58899999999999997}]}]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":987136,"data_stored":1160319,"data_compressed":44723,"data_compressed_allocated":57344,"data_compressed_original":720896,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.499,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.64600000000000002,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.495,"15min":0.49099999999999999},"min":{"1min":0.34499999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.66500000000000004,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.42199999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.77400000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.5}]},{"osd":2,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.37,"15min":0.35199999999999998},"min":{"1min":0.29299999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.62,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.307},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.372},"min":{"1min":0.28399999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51200000000000001,"15min":0.501},"min":{"1min":0.35799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73799999999999999,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.373},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.51200000000000001},"min":{"1min":0.40400000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.79500000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.441}]},{"osd":4,"last update":"Thu May 9 00:02:31 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.55200000000000005,"15min":0.53200000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.36499999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu May 9 00:02:51 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.501,"5min":0.376,"15min":0.376},"max":{"1min":0.68100000000000005,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.53900000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.69199999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu May 9 00:02:02 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.59899999999999998,"15min":0.59599999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59499999999999997,"15min":0.59299999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47999999999999998}]},{"osd":8,"last update":"Thu May 9 00:02:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.56799999999999995},"min":{"1min":0.39800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83499999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40200000000000002}]},{"osd":9,"last update":"Thu May 9 00:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.53000000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.432},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66400000000000003,"15min":0.65500000000000003},"min":{"1min":0.59099999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.92300000000000004,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52400000000000002}]},{"osd":10,"last update":"Thu May 9 00:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.82999999999999996,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.55700000000000005,"5min":0.505,"15min":0.505},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35636,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":65442,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66170,"data_compressed":1858,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":525100,"data_compressed":25302,"data_compressed_allocated":32768,"data_compressed_original":516096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":133876,"data_compressed":6156,"data_compressed_allocated":8192,"data_compressed_original":122880,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":393932,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":394034,"data_compressed":19146,"data_compressed_allocated":24576,"data_compressed_original":393216,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":198965,"data_compressed":8014,"data_compressed_allocated":12288,"data_compressed_original":131072,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-09T00:03:05.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:03:06.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:05 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2335812356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:03:06.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:05 smithi150 ceph-mon[46187]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:03:06.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.031+0000 7f13d29cb700 1 -- 172.21.15.81:0/4277041726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc1028c0 msgr2=0x7f13cc10ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.031+0000 7f13d29cb700 1 --2- 172.21.15.81:0/4277041726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc1028c0 0x7f13cc10ada0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009990 tx=0x7f13c0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.031+0000 7f13d29cb700 1 -- 172.21.15.81:0/4277041726 shutdown_connections 2024-05-09T00:03:06.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.031+0000 7f13d29cb700 1 --2- 172.21.15.81:0/4277041726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13cc101fa0 0x7f13cc102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.031+0000 7f13d29cb700 1 --2- 172.21.15.81:0/4277041726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13cc10b3c0 0x7f13cc10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.031+0000 7f13d29cb700 1 --2- 172.21.15.81:0/4277041726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc1028c0 0x7f13cc10ada0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.031+0000 7f13d29cb700 1 -- 172.21.15.81:0/4277041726 >> 172.21.15.81:0/4277041726 conn(0x7f13cc0fb7e0 msgr2=0x7f13cc0fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.031+0000 7f13d29cb700 1 -- 172.21.15.81:0/4277041726 shutdown_connections 2024-05-09T00:03:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.031+0000 7f13d29cb700 1 -- 172.21.15.81:0/4277041726 wait complete. 2024-05-09T00:03:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.031+0000 7f13d29cb700 1 Processor -- start 2024-05-09T00:03:06.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.031+0000 7f13d29cb700 1 -- start start 2024-05-09T00:03:06.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d29cb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13cc101fa0 0x7f13cc1972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:06.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d29cb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13cc1028c0 0x7f13cc1977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:06.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d29cb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc10b3c0 0x7f13cc19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:06.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d29cb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc19c1d0 con 0x7f13cc10b3c0 2024-05-09T00:03:06.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d29cb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc19c340 con 0x7f13cc101fa0 2024-05-09T00:03:06.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d29cb700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13cc19c500 con 0x7f13cc1028c0 2024-05-09T00:03:06.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d0f68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc10b3c0 0x7f13cc19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:06.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d0f68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc10b3c0 0x7f13cc19bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58210/0 (socket says 172.21.15.81:58210) 2024-05-09T00:03:06.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d0f68700 1 -- 172.21.15.81:0/2847876575 learned_addr learned my addr 172.21.15.81:0/2847876575 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:06.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13cbfff700 1 --2- 172.21.15.81:0/2847876575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13cc101fa0 0x7f13cc1972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:06.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13cb7fe700 1 --2- 172.21.15.81:0/2847876575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13cc1028c0 0x7f13cc1977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:06.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d0f68700 1 -- 172.21.15.81:0/2847876575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13cc1028c0 msgr2=0x7f13cc1977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d0f68700 1 --2- 172.21.15.81:0/2847876575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13cc1028c0 0x7f13cc1977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d0f68700 1 -- 172.21.15.81:0/2847876575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13cc101fa0 msgr2=0x7f13cc1972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d0f68700 1 --2- 172.21.15.81:0/2847876575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13cc101fa0 0x7f13cc1972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d0f68700 1 -- 172.21.15.81:0/2847876575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c00095f0 con 0x7f13cc10b3c0 2024-05-09T00:03:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d0f68700 1 --2- 172.21.15.81:0/2847876575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc10b3c0 0x7f13cc19bb90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f13c4007ee0 tx=0x7f13c400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13c97fa700 1 -- 172.21.15.81:0/2847876575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c4017070 con 0x7f13cc10b3c0 2024-05-09T00:03:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13c97fa700 1 -- 172.21.15.81:0/2847876575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13c400f040 con 0x7f13cc10b3c0 2024-05-09T00:03:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13d29cb700 1 -- 172.21.15.81:0/2847876575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13cc19c7e0 con 0x7f13cc10b3c0 2024-05-09T00:03:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.032+0000 7f13c97fa700 1 -- 172.21.15.81:0/2847876575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c4005740 con 0x7f13cc10b3c0 2024-05-09T00:03:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.033+0000 7f13d29cb700 1 -- 172.21.15.81:0/2847876575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13cc1a4020 con 0x7f13cc10b3c0 2024-05-09T00:03:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.033+0000 7f13d29cb700 1 -- 172.21.15.81:0/2847876575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13cc19ca00 con 0x7f13cc10b3c0 2024-05-09T00:03:06.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.035+0000 7f13c97fa700 1 -- 172.21.15.81:0/2847876575 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f13c40058a0 con 0x7f13cc10b3c0 2024-05-09T00:03:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.035+0000 7f13c97fa700 1 --2- 172.21.15.81:0/2847876575 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f13b40a13b0 0x7f13b40a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.036+0000 7f13cbfff700 1 --2- 172.21.15.81:0/2847876575 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f13b40a13b0 0x7f13b40a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.036+0000 7f13c97fa700 1 -- 172.21.15.81:0/2847876575 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f13c40ccca0 con 0x7f13cc10b3c0 2024-05-09T00:03:06.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.036+0000 7f13cbfff700 1 --2- 172.21.15.81:0/2847876575 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f13b40a13b0 0x7f13b40a3870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f13bc005950 tx=0x7f13bc0058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:06.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.039+0000 7f13c97fa700 1 -- 172.21.15.81:0/2847876575 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f13c4095ea0 con 0x7f13cc10b3c0 2024-05-09T00:03:06.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:05 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2335812356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:03:06.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:05 smithi171 ceph-mon[47351]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-09T00:03:06.119 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:03:05 smithi081 sudo[108046]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:06.120 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:03:05 smithi081 sudo[108046]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:06.120 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:03:05 smithi081 sudo[108046]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:06.120 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:03:05 smithi081 sudo[108046]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:06.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.243+0000 7f13d29cb700 1 -- 172.21.15.81:0/2847876575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13cc106490 con 0x7f13cc10b3c0 2024-05-09T00:03:06.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.244+0000 7f13c97fa700 1 -- 172.21.15.81:0/2847876575 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+23003 (secure 0 0 0) 0x7f13c40994c0 con 0x7f13cc10b3c0 2024-05-09T00:03:06.239 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:03:06.239 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:02:58.862731+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/907969237":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/589390516":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/1458411552":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1755507053":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/3633496844":"2024-05-10T00:02:58.862694+0000","172.21.15.81:6801/1458411552":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/1903231103":"2024-05-10T00:02:58.862694+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:03:06.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.246+0000 7f13d29cb700 1 -- 172.21.15.81:0/2847876575 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f13b40a13b0 msgr2=0x7f13b40a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.246+0000 7f13d29cb700 1 --2- 172.21.15.81:0/2847876575 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f13b40a13b0 0x7f13b40a3870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f13bc005950 tx=0x7f13bc0058e0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.246+0000 7f13d29cb700 1 -- 172.21.15.81:0/2847876575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc10b3c0 msgr2=0x7f13cc19bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.246+0000 7f13d29cb700 1 --2- 172.21.15.81:0/2847876575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc10b3c0 0x7f13cc19bb90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f13c4007ee0 tx=0x7f13c400d3b0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.246+0000 7f13d29cb700 1 -- 172.21.15.81:0/2847876575 shutdown_connections 2024-05-09T00:03:06.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.246+0000 7f13d29cb700 1 --2- 172.21.15.81:0/2847876575 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f13b40a13b0 0x7f13b40a3870 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.246+0000 7f13d29cb700 1 --2- 172.21.15.81:0/2847876575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f13cc101fa0 0x7f13cc1972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.246+0000 7f13d29cb700 1 --2- 172.21.15.81:0/2847876575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13cc10b3c0 0x7f13cc19bb90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.246+0000 7f13d29cb700 1 --2- 172.21.15.81:0/2847876575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f13cc1028c0 0x7f13cc1977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.246+0000 7f13d29cb700 1 -- 172.21.15.81:0/2847876575 >> 172.21.15.81:0/2847876575 conn(0x7f13cc0fb7e0 msgr2=0x7f13cc0fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:06.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.247+0000 7f13d29cb700 1 -- 172.21.15.81:0/2847876575 shutdown_connections 2024-05-09T00:03:06.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.247+0000 7f13d29cb700 1 -- 172.21.15.81:0/2847876575 wait complete. 2024-05-09T00:03:06.253 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:58:34.523249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T00:01:43.149260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T00:01:44.182730+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:03:06.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:03:06.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.385+0000 7efcd7baf700 1 -- 172.21.15.81:0/1935064036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0069e90 msgr2=0x7efcd0105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.385+0000 7efcd7baf700 1 --2- 172.21.15.81:0/1935064036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0069e90 0x7efcd0105b60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efccc0099c0 tx=0x7efccc009cd0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.385+0000 7efcd7baf700 1 -- 172.21.15.81:0/1935064036 shutdown_connections 2024-05-09T00:03:06.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.385+0000 7efcd7baf700 1 --2- 172.21.15.81:0/1935064036 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcd0106290 0x7efcd010de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.385+0000 7efcd7baf700 1 --2- 172.21.15.81:0/1935064036 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcd00694e0 0x7efcd00698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.385+0000 7efcd7baf700 1 --2- 172.21.15.81:0/1935064036 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0069e90 0x7efcd0105b60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.385+0000 7efcd7baf700 1 -- 172.21.15.81:0/1935064036 >> 172.21.15.81:0/1935064036 conn(0x7efcd0076f30 msgr2=0x7efcd0077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:06.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.385+0000 7efcd7baf700 1 -- 172.21.15.81:0/1935064036 shutdown_connections 2024-05-09T00:03:06.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.385+0000 7efcd7baf700 1 -- 172.21.15.81:0/1935064036 wait complete. 2024-05-09T00:03:06.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.386+0000 7efcd7baf700 1 Processor -- start 2024-05-09T00:03:06.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.386+0000 7efcd7baf700 1 -- start start 2024-05-09T00:03:06.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.386+0000 7efcd7baf700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcd00694e0 0x7efcd01973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.386+0000 7efcd7baf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0106290 0x7efcd01978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.386+0000 7efcd7baf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcd019bc90 0x7efcd019c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.386+0000 7efcd7baf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd019c710 con 0x7efcd0106290 2024-05-09T00:03:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.386+0000 7efcd7baf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd019c880 con 0x7efcd019bc90 2024-05-09T00:03:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.386+0000 7efcd7baf700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd019ca40 con 0x7efcd00694e0 2024-05-09T00:03:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.386+0000 7efcd514a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0106290 0x7efcd01978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.386+0000 7efcd514a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0106290 0x7efcd01978f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58216/0 (socket says 172.21.15.81:58216) 2024-05-09T00:03:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.386+0000 7efcd514a700 1 -- 172.21.15.81:0/4034242878 learned_addr learned my addr 172.21.15.81:0/4034242878 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.386+0000 7efcd594b700 1 --2- 172.21.15.81:0/4034242878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcd00694e0 0x7efcd01973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.386+0000 7efcd614c700 1 --2- 172.21.15.81:0/4034242878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcd019bc90 0x7efcd019c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.387+0000 7efcd514a700 1 -- 172.21.15.81:0/4034242878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcd00694e0 msgr2=0x7efcd01973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.387+0000 7efcd514a700 1 --2- 172.21.15.81:0/4034242878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcd00694e0 0x7efcd01973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.387+0000 7efcd514a700 1 -- 172.21.15.81:0/4034242878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcd019bc90 msgr2=0x7efcd019c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.387+0000 7efcd514a700 1 --2- 172.21.15.81:0/4034242878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcd019bc90 0x7efcd019c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.387+0000 7efcd514a700 1 -- 172.21.15.81:0/4034242878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efccc0095f0 con 0x7efcd0106290 2024-05-09T00:03:06.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.387+0000 7efcd514a700 1 --2- 172.21.15.81:0/4034242878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0106290 0x7efcd01978f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efccc00b580 tx=0x7efccc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:06.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.387+0000 7efcc2ffd700 1 -- 172.21.15.81:0/4034242878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc01c070 con 0x7efcd0106290 2024-05-09T00:03:06.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.387+0000 7efcc2ffd700 1 -- 172.21.15.81:0/4034242878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efccc00fd80 con 0x7efcd0106290 2024-05-09T00:03:06.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.387+0000 7efcd7baf700 1 -- 172.21.15.81:0/4034242878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd01a3f40 con 0x7efcd0106290 2024-05-09T00:03:06.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.387+0000 7efcc2ffd700 1 -- 172.21.15.81:0/4034242878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efccc022ca0 con 0x7efcd0106290 2024-05-09T00:03:06.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.387+0000 7efcd7baf700 1 -- 172.21.15.81:0/4034242878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd01a4360 con 0x7efcd0106290 2024-05-09T00:03:06.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.388+0000 7efcd7baf700 1 -- 172.21.15.81:0/4034242878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd01094f0 con 0x7efcd0106290 2024-05-09T00:03:06.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.389+0000 7efcc2ffd700 1 -- 172.21.15.81:0/4034242878 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7efccc020070 con 0x7efcd0106290 2024-05-09T00:03:06.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.389+0000 7efcc2ffd700 1 --2- 172.21.15.81:0/4034242878 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efcbc0a1430 0x7efcbc0a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:06.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.389+0000 7efcc2ffd700 1 -- 172.21.15.81:0/4034242878 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7efccc0ce100 con 0x7efcd0106290 2024-05-09T00:03:06.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.389+0000 7efcd594b700 1 --2- 172.21.15.81:0/4034242878 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efcbc0a1430 0x7efcbc0a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:06.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.390+0000 7efcd594b700 1 --2- 172.21.15.81:0/4034242878 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efcbc0a1430 0x7efcbc0a38f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efcc4004630 tx=0x7efcc400b3c0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:06.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.393+0000 7efcc2ffd700 1 -- 172.21.15.81:0/4034242878 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efccc097430 con 0x7efcd0106290 2024-05-09T00:03:06.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.588+0000 7efcd7baf700 1 -- 172.21.15.81:0/4034242878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efcd01986b0 con 0x7efcd0106290 2024-05-09T00:03:06.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.588+0000 7efcc2ffd700 1 -- 172.21.15.81:0/4034242878 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7efccc09aa50 con 0x7efcd0106290 2024-05-09T00:03:06.582 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-09T00:03:06.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.590+0000 7efcd7baf700 1 -- 172.21.15.81:0/4034242878 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efcbc0a1430 msgr2=0x7efcbc0a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.590+0000 7efcd7baf700 1 --2- 172.21.15.81:0/4034242878 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efcbc0a1430 0x7efcbc0a38f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efcc4004630 tx=0x7efcc400b3c0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.590+0000 7efcd7baf700 1 -- 172.21.15.81:0/4034242878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0106290 msgr2=0x7efcd01978f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.590+0000 7efcd7baf700 1 --2- 172.21.15.81:0/4034242878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0106290 0x7efcd01978f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efccc00b580 tx=0x7efccc00f690 comp rx=0 tx=0).stop 2024-05-09T00:03:06.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.590+0000 7efcd7baf700 1 -- 172.21.15.81:0/4034242878 shutdown_connections 2024-05-09T00:03:06.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.590+0000 7efcd7baf700 1 --2- 172.21.15.81:0/4034242878 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efcbc0a1430 0x7efcbc0a38f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.590+0000 7efcd7baf700 1 --2- 172.21.15.81:0/4034242878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcd019bc90 0x7efcd019c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.590+0000 7efcd7baf700 1 --2- 172.21.15.81:0/4034242878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcd00694e0 0x7efcd01973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.590+0000 7efcd7baf700 1 --2- 172.21.15.81:0/4034242878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcd0106290 0x7efcd01978f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.590+0000 7efcd7baf700 1 -- 172.21.15.81:0/4034242878 >> 172.21.15.81:0/4034242878 conn(0x7efcd0076f30 msgr2=0x7efcd00fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:06.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.590+0000 7efcd7baf700 1 -- 172.21.15.81:0/4034242878 shutdown_connections 2024-05-09T00:03:06.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.590+0000 7efcd7baf700 1 -- 172.21.15.81:0/4034242878 wait complete. 2024-05-09T00:03:06.595 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:03:06 smithi081 sudo[108092]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:06.595 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:03:06 smithi081 sudo[108092]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:06.595 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:03:06 smithi081 sudo[108092]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:06.595 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:03:06 smithi081 sudo[108092]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:06.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T00:03:06.637 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:03:06 smithi150 sudo[84354]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:06.637 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:03:06 smithi150 sudo[84354]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:06.638 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:03:06 smithi150 sudo[84354]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:06.638 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:03:06 smithi150 sudo[84354]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:06.638 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:03:06 smithi150 sudo[84357]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:06.638 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:03:06 smithi150 sudo[84357]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:06.638 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:03:06 smithi150 sudo[84357]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:06.638 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:03:06 smithi150 sudo[84357]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:06.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.728+0000 7f1ce125e700 1 -- 172.21.15.81:0/3709993579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc069e90 msgr2=0x7f1cdc105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.728+0000 7f1ce125e700 1 --2- 172.21.15.81:0/3709993579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc069e90 0x7f1cdc105b60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00099c0 tx=0x7f1cd0009cd0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.728+0000 7f1ce125e700 1 -- 172.21.15.81:0/3709993579 shutdown_connections 2024-05-09T00:03:06.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.728+0000 7f1ce125e700 1 --2- 172.21.15.81:0/3709993579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cdc0694e0 0x7f1cdc0698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.728+0000 7f1ce125e700 1 --2- 172.21.15.81:0/3709993579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cdc106290 0x7f1cdc10de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.728+0000 7f1ce125e700 1 --2- 172.21.15.81:0/3709993579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc069e90 0x7f1cdc105b60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.728+0000 7f1ce125e700 1 -- 172.21.15.81:0/3709993579 >> 172.21.15.81:0/3709993579 conn(0x7f1cdc076f30 msgr2=0x7f1cdc077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:06.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.728+0000 7f1ce125e700 1 -- 172.21.15.81:0/3709993579 shutdown_connections 2024-05-09T00:03:06.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.728+0000 7f1ce125e700 1 -- 172.21.15.81:0/3709993579 wait complete. 2024-05-09T00:03:06.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.729+0000 7f1ce125e700 1 Processor -- start 2024-05-09T00:03:06.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.729+0000 7f1ce125e700 1 -- start start 2024-05-09T00:03:06.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1ce125e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cdc0694e0 0x7f1cdc1973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:06.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1ce125e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc106290 0x7f1cdc197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:06.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1ce125e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cdc19bcc0 0x7f1cdc19c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:06.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1ce125e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc19c740 con 0x7f1cdc106290 2024-05-09T00:03:06.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1ce125e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc19c8b0 con 0x7f1cdc0694e0 2024-05-09T00:03:06.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1ce125e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cdc19ca70 con 0x7f1cdc19bcc0 2024-05-09T00:03:06.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1cda59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc106290 0x7f1cdc197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:06.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1cda59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc106290 0x7f1cdc197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58236/0 (socket says 172.21.15.81:58236) 2024-05-09T00:03:06.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1cda59c700 1 -- 172.21.15.81:0/2245722949 learned_addr learned my addr 172.21.15.81:0/2245722949 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:06.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1cdb59e700 1 --2- 172.21.15.81:0/2245722949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cdc19bcc0 0x7f1cdc19c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:06.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1cdad9d700 1 --2- 172.21.15.81:0/2245722949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cdc0694e0 0x7f1cdc1973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:06.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1cda59c700 1 -- 172.21.15.81:0/2245722949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cdc19bcc0 msgr2=0x7f1cdc19c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1cda59c700 1 --2- 172.21.15.81:0/2245722949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cdc19bcc0 0x7f1cdc19c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1cda59c700 1 -- 172.21.15.81:0/2245722949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cdc0694e0 msgr2=0x7f1cdc1973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1cda59c700 1 --2- 172.21.15.81:0/2245722949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cdc0694e0 0x7f1cdc1973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1cda59c700 1 -- 172.21.15.81:0/2245722949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd00095f0 con 0x7f1cdc106290 2024-05-09T00:03:06.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1cda59c700 1 --2- 172.21.15.81:0/2245722949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc106290 0x7f1cdc197920 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009fd0 tx=0x7f1cd000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:06.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1cc3fff700 1 -- 172.21.15.81:0/2245722949 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd001c070 con 0x7f1cdc106290 2024-05-09T00:03:06.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1ce125e700 1 -- 172.21.15.81:0/2245722949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cdc1a3f70 con 0x7f1cdc106290 2024-05-09T00:03:06.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1cc3fff700 1 -- 172.21.15.81:0/2245722949 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1cd000fd80 con 0x7f1cdc106290 2024-05-09T00:03:06.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1cc3fff700 1 -- 172.21.15.81:0/2245722949 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0004970 con 0x7f1cdc106290 2024-05-09T00:03:06.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.730+0000 7f1ce125e700 1 -- 172.21.15.81:0/2245722949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cdc1a4330 con 0x7f1cdc106290 2024-05-09T00:03:06.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.731+0000 7f1ce125e700 1 -- 172.21.15.81:0/2245722949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cdc1094f0 con 0x7f1cdc106290 2024-05-09T00:03:06.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.733+0000 7f1cc3fff700 1 -- 172.21.15.81:0/2245722949 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f1cd0020070 con 0x7f1cdc106290 2024-05-09T00:03:06.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.733+0000 7f1cc3fff700 1 --2- 172.21.15.81:0/2245722949 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1cc40a13b0 0x7f1cc40a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:06.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.733+0000 7f1cc3fff700 1 -- 172.21.15.81:0/2245722949 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f1cd00cdaf0 con 0x7f1cdc106290 2024-05-09T00:03:06.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.733+0000 7f1cdad9d700 1 --2- 172.21.15.81:0/2245722949 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1cc40a13b0 0x7f1cc40a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:06.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.734+0000 7f1cdad9d700 1 --2- 172.21.15.81:0/2245722949 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1cc40a13b0 0x7f1cc40a3870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc007be0 tx=0x7f1ccc0073d0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:06.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.737+0000 7f1cc3fff700 1 -- 172.21.15.81:0/2245722949 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1cd0096d80 con 0x7f1cdc106290 2024-05-09T00:03:06.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:06 smithi081 ceph-mon[42474]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:03:06.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:06 smithi081 ceph-mon[42474]: from='client.25036 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:03:06.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:06 smithi081 ceph-mon[42474]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:03:06.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:06 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2847876575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:06.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:06 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/4034242878' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:03:06.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.936+0000 7f1ce125e700 1 -- 172.21.15.81:0/2245722949 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1cdc1986e0 con 0x7f1cdc106290 2024-05-09T00:03:06.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.936+0000 7f1cc3fff700 1 -- 172.21.15.81:0/2245722949 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1cd009a3a0 con 0x7f1cdc106290 2024-05-09T00:03:06.930 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-09T00:03:06.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.939+0000 7f1ce125e700 1 -- 172.21.15.81:0/2245722949 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1cc40a13b0 msgr2=0x7f1cc40a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.939+0000 7f1ce125e700 1 --2- 172.21.15.81:0/2245722949 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1cc40a13b0 0x7f1cc40a3870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc007be0 tx=0x7f1ccc0073d0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.939+0000 7f1ce125e700 1 -- 172.21.15.81:0/2245722949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc106290 msgr2=0x7f1cdc197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:06.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.939+0000 7f1ce125e700 1 --2- 172.21.15.81:0/2245722949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc106290 0x7f1cdc197920 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009fd0 tx=0x7f1cd000f690 comp rx=0 tx=0).stop 2024-05-09T00:03:06.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.939+0000 7f1ce125e700 1 -- 172.21.15.81:0/2245722949 shutdown_connections 2024-05-09T00:03:06.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.939+0000 7f1ce125e700 1 --2- 172.21.15.81:0/2245722949 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1cc40a13b0 0x7f1cc40a3870 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.939+0000 7f1ce125e700 1 --2- 172.21.15.81:0/2245722949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1cdc0694e0 0x7f1cdc1973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.939+0000 7f1ce125e700 1 --2- 172.21.15.81:0/2245722949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1cdc19bcc0 0x7f1cdc19c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.939+0000 7f1ce125e700 1 --2- 172.21.15.81:0/2245722949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cdc106290 0x7f1cdc197920 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:06.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.939+0000 7f1ce125e700 1 -- 172.21.15.81:0/2245722949 >> 172.21.15.81:0/2245722949 conn(0x7f1cdc076f30 msgr2=0x7f1cdc0fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:06.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.939+0000 7f1ce125e700 1 -- 172.21.15.81:0/2245722949 shutdown_connections 2024-05-09T00:03:06.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:06.939+0000 7f1ce125e700 1 -- 172.21.15.81:0/2245722949 wait complete. 2024-05-09T00:03:06.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T00:03:07.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:06 smithi150 ceph-mon[46187]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:03:07.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:06 smithi150 ceph-mon[46187]: from='client.25036 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:03:07.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:06 smithi150 ceph-mon[46187]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:03:07.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:06 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2847876575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:07.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:06 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/4034242878' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:03:07.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:06 smithi171 ceph-mon[47351]: from='client.15417 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:03:07.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:06 smithi171 ceph-mon[47351]: from='client.25036 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:03:07.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:06 smithi171 ceph-mon[47351]: from='client.15429 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-09T00:03:07.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:06 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2847876575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:07.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:06 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/4034242878' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:03:07.053 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:03:06 smithi171 sudo[87193]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:07.053 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:03:06 smithi171 sudo[87193]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:07.053 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:03:06 smithi171 sudo[87193]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:07.053 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:03:06 smithi171 sudo[87193]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.076+0000 7f7764da9700 1 -- 172.21.15.81:0/1285603823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7760105160 msgr2=0x7f776010cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.076+0000 7f7764da9700 1 --2- 172.21.15.81:0/1285603823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7760105160 0x7f776010cce0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f775800b0a0 tx=0x7f775800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.076+0000 7f7764da9700 1 -- 172.21.15.81:0/1285603823 shutdown_connections 2024-05-09T00:03:07.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.076+0000 7f7764da9700 1 --2- 172.21.15.81:0/1285603823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7760105160 0x7f776010cce0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.076+0000 7f7764da9700 1 --2- 172.21.15.81:0/1285603823 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760100060 0x7f7760100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.076+0000 7f7764da9700 1 --2- 172.21.15.81:0/1285603823 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7760100a10 0x7f7760104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.076+0000 7f7764da9700 1 -- 172.21.15.81:0/1285603823 >> 172.21.15.81:0/1285603823 conn(0x7f7760076f40 msgr2=0x7f7760077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.076+0000 7f7764da9700 1 -- 172.21.15.81:0/1285603823 shutdown_connections 2024-05-09T00:03:07.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.076+0000 7f7764da9700 1 -- 172.21.15.81:0/1285603823 wait complete. 2024-05-09T00:03:07.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f7764da9700 1 Processor -- start 2024-05-09T00:03:07.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f7764da9700 1 -- start start 2024-05-09T00:03:07.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f7764da9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760100060 0x7f7760197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:07.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f7764da9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7760105160 0x7f7760197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:07.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f7764da9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f776019bdf0 0x7f776019c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:07.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f7764da9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776019c870 con 0x7f7760105160 2024-05-09T00:03:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f7764da9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776019c9e0 con 0x7f776019bdf0 2024-05-09T00:03:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f7764da9700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776019cba0 con 0x7f7760100060 2024-05-09T00:03:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f775dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7760105160 0x7f7760197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f775dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7760105160 0x7f7760197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58254/0 (socket says 172.21.15.81:58254) 2024-05-09T00:03:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f775dd9b700 1 -- 172.21.15.81:0/1262573648 learned_addr learned my addr 172.21.15.81:0/1262573648 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f775e59c700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760100060 0x7f7760197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f775ed9d700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f776019bdf0 0x7f776019c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f775dd9b700 1 -- 172.21.15.81:0/1262573648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760100060 msgr2=0x7f7760197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f775dd9b700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760100060 0x7f7760197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f775dd9b700 1 -- 172.21.15.81:0/1262573648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f776019bdf0 msgr2=0x7f776019c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:07.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.077+0000 7f775dd9b700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f776019bdf0 0x7f776019c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.078+0000 7f775dd9b700 1 -- 172.21.15.81:0/1262573648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7758009d00 con 0x7f7760105160 2024-05-09T00:03:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.078+0000 7f775ed9d700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f776019bdf0 0x7f776019c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:03:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.078+0000 7f775dd9b700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7760105160 0x7f7760197a50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f775000e970 tx=0x7f775000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.078+0000 7f774f7fe700 1 -- 172.21.15.81:0/1262573648 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7750009790 con 0x7f7760105160 2024-05-09T00:03:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.078+0000 7f774f7fe700 1 -- 172.21.15.81:0/1262573648 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f775000c7e0 con 0x7f7760105160 2024-05-09T00:03:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.078+0000 7f7764da9700 1 -- 172.21.15.81:0/1262573648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77601a4100 con 0x7f7760105160 2024-05-09T00:03:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.078+0000 7f774f7fe700 1 -- 172.21.15.81:0/1262573648 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77500054e0 con 0x7f7760105160 2024-05-09T00:03:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.078+0000 7f7764da9700 1 -- 172.21.15.81:0/1262573648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77601a45e0 con 0x7f7760105160 2024-05-09T00:03:07.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.079+0000 7f7764da9700 1 -- 172.21.15.81:0/1262573648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7760109440 con 0x7f7760105160 2024-05-09T00:03:07.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.080+0000 7f774f7fe700 1 -- 172.21.15.81:0/1262573648 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f775000c950 con 0x7f7760105160 2024-05-09T00:03:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.080+0000 7f774f7fe700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f77480a13b0 0x7f77480a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.080+0000 7f774f7fe700 1 -- 172.21.15.81:0/1262573648 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f7750014070 con 0x7f7760105160 2024-05-09T00:03:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.080+0000 7f775e59c700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f77480a13b0 0x7f77480a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.081+0000 7f775e59c700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f77480a13b0 0x7f77480a3870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7754009c60 tx=0x7f7754009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:07.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.084+0000 7f774f7fe700 1 -- 172.21.15.81:0/1262573648 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7750096570 con 0x7f7760105160 2024-05-09T00:03:07.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.288+0000 7f7764da9700 1 -- 172.21.15.81:0/1262573648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7760198810 con 0x7f7760105160 2024-05-09T00:03:07.552 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:03:07 smithi171 sudo[87196]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:07.552 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:03:07 smithi171 sudo[87196]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:07.552 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:03:07 smithi171 sudo[87196]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:07.552 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:03:07 smithi171 sudo[87196]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:07.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:07 smithi081 sudo[108231]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:07.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:07 smithi081 sudo[108231]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:07.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:07 smithi081 sudo[108231]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:07.627 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:07 smithi081 sudo[108231]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:07.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.639+0000 7f774f7fe700 1 -- 172.21.15.81:0/1262573648 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7750099b90 con 0x7f7760105160 2024-05-09T00:03:07.633 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-09T00:03:07.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.641+0000 7f7764da9700 1 -- 172.21.15.81:0/1262573648 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f77480a13b0 msgr2=0x7f77480a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:07.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.641+0000 7f7764da9700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f77480a13b0 0x7f77480a3870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7754009c60 tx=0x7f7754009260 comp rx=0 tx=0).stop 2024-05-09T00:03:07.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.641+0000 7f7764da9700 1 -- 172.21.15.81:0/1262573648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7760105160 msgr2=0x7f7760197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:07.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.641+0000 7f7764da9700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7760105160 0x7f7760197a50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f775000e970 tx=0x7f775000ec80 comp rx=0 tx=0).stop 2024-05-09T00:03:07.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.641+0000 7f7764da9700 1 -- 172.21.15.81:0/1262573648 shutdown_connections 2024-05-09T00:03:07.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.641+0000 7f7764da9700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f77480a13b0 0x7f77480a3870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.641+0000 7f7764da9700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f776019bdf0 0x7f776019c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.641+0000 7f7764da9700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7760100060 0x7f7760197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.641+0000 7f7764da9700 1 --2- 172.21.15.81:0/1262573648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7760105160 0x7f7760197a50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.641+0000 7f7764da9700 1 -- 172.21.15.81:0/1262573648 >> 172.21.15.81:0/1262573648 conn(0x7f7760076f40 msgr2=0x7f7760068330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:07.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.641+0000 7f7764da9700 1 -- 172.21.15.81:0/1262573648 shutdown_connections 2024-05-09T00:03:07.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.641+0000 7f7764da9700 1 -- 172.21.15.81:0/1262573648 wait complete. 2024-05-09T00:03:07.647 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:03:07.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.776+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/3660307093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0100440 msgr2=0x7f0ca01008c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.776+0000 7f0ca5c4e700 1 --2- 172.21.15.81:0/3660307093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0100440 0x7f0ca01008c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0c900099c0 tx=0x7f0c90009cd0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.776+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/3660307093 shutdown_connections 2024-05-09T00:03:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.776+0000 7f0ca5c4e700 1 --2- 172.21.15.81:0/3660307093 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca0104d20 0x7f0ca0105100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.776+0000 7f0ca5c4e700 1 --2- 172.21.15.81:0/3660307093 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ca0100e00 0x7f0ca010cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.776+0000 7f0ca5c4e700 1 --2- 172.21.15.81:0/3660307093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0100440 0x7f0ca01008c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.776+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/3660307093 >> 172.21.15.81:0/3660307093 conn(0x7f0ca0076270 msgr2=0x7f0ca00fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.776+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/3660307093 shutdown_connections 2024-05-09T00:03:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.776+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/3660307093 wait complete. 2024-05-09T00:03:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.776+0000 7f0ca5c4e700 1 Processor -- start 2024-05-09T00:03:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0ca5c4e700 1 -- start start 2024-05-09T00:03:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0ca5c4e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0100440 0x7f0ca00fb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:07.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0ca5c4e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca0100e00 0x7f0ca00fbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:07.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0ca5c4e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ca0104d20 0x7f0ca00fc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:07.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0ca5c4e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01a5550 con 0x7f0ca0100440 2024-05-09T00:03:07.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0ca5c4e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01a56c0 con 0x7f0ca0100e00 2024-05-09T00:03:07.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0ca5c4e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01a5880 con 0x7f0ca0104d20 2024-05-09T00:03:07.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0c9f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0100440 0x7f0ca00fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:07.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0c9f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0100440 0x7f0ca00fb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57014/0 (socket says 172.21.15.81:57014) 2024-05-09T00:03:07.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0c9f7fe700 1 -- 172.21.15.81:0/535464955 learned_addr learned my addr 172.21.15.81:0/535464955 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:07.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0c9effd700 1 --2- 172.21.15.81:0/535464955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca0100e00 0x7f0ca00fbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:07.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0c9ffff700 1 --2- 172.21.15.81:0/535464955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ca0104d20 0x7f0ca00fc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:07.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0c9f7fe700 1 -- 172.21.15.81:0/535464955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ca0104d20 msgr2=0x7f0ca00fc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0c9f7fe700 1 --2- 172.21.15.81:0/535464955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ca0104d20 0x7f0ca00fc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0c9f7fe700 1 -- 172.21.15.81:0/535464955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca0100e00 msgr2=0x7f0ca00fbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0c9f7fe700 1 --2- 172.21.15.81:0/535464955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca0100e00 0x7f0ca00fbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0c9f7fe700 1 -- 172.21.15.81:0/535464955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900095f0 con 0x7f0ca0100440 2024-05-09T00:03:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0c9f7fe700 1 --2- 172.21.15.81:0/535464955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0100440 0x7f0ca00fb700 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400c9b0 tx=0x7f0c9400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0c9cff9700 1 -- 172.21.15.81:0/535464955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94007b00 con 0x7f0ca0100440 2024-05-09T00:03:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.777+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/535464955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca01a5b60 con 0x7f0ca0100440 2024-05-09T00:03:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.778+0000 7f0c9cff9700 1 -- 172.21.15.81:0/535464955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c9400ce50 con 0x7f0ca0100440 2024-05-09T00:03:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.778+0000 7f0c9cff9700 1 -- 172.21.15.81:0/535464955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94018660 con 0x7f0ca0100440 2024-05-09T00:03:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.778+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/535464955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca01a6040 con 0x7f0ca0100440 2024-05-09T00:03:07.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.778+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/535464955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca0109310 con 0x7f0ca0100440 2024-05-09T00:03:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.780+0000 7f0c9cff9700 1 -- 172.21.15.81:0/535464955 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f0c9400f450 con 0x7f0ca0100440 2024-05-09T00:03:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.780+0000 7f0c9cff9700 1 --2- 172.21.15.81:0/535464955 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0c880a1430 0x7f0c880a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.781+0000 7f0c9effd700 1 --2- 172.21.15.81:0/535464955 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0c880a1430 0x7f0c880a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.781+0000 7f0c9cff9700 1 -- 172.21.15.81:0/535464955 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f0c940cd130 con 0x7f0ca0100440 2024-05-09T00:03:07.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.781+0000 7f0c9effd700 1 --2- 172.21.15.81:0/535464955 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0c880a1430 0x7f0c880a38f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009990 tx=0x7f0c90003680 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:07.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:07.784+0000 7f0c9cff9700 1 -- 172.21.15.81:0/535464955 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0c94096380 con 0x7f0ca0100440 2024-05-09T00:03:08.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.027+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/535464955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ca0101450 con 0x7f0ca0100440 2024-05-09T00:03:08.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.028+0000 7f0c9cff9700 1 -- 172.21.15.81:0/535464955 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10864 (secure 0 0 0) 0x7f0c94007e60 con 0x7f0ca0100440 2024-05-09T00:03:08.022 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:03:08.022 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:03:00.676924+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:03:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.030+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/535464955 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0c880a1430 msgr2=0x7f0c880a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.030+0000 7f0ca5c4e700 1 --2- 172.21.15.81:0/535464955 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0c880a1430 0x7f0c880a38f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009990 tx=0x7f0c90003680 comp rx=0 tx=0).stop 2024-05-09T00:03:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.030+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/535464955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0100440 msgr2=0x7f0ca00fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.030+0000 7f0ca5c4e700 1 --2- 172.21.15.81:0/535464955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0100440 0x7f0ca00fb700 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400c9b0 tx=0x7f0c9400ccc0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.030+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/535464955 shutdown_connections 2024-05-09T00:03:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.030+0000 7f0ca5c4e700 1 --2- 172.21.15.81:0/535464955 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0c880a1430 0x7f0c880a38f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.030+0000 7f0ca5c4e700 1 --2- 172.21.15.81:0/535464955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ca0104d20 0x7f0ca00fc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.030+0000 7f0ca5c4e700 1 --2- 172.21.15.81:0/535464955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ca0100440 0x7f0ca00fb700 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.030+0000 7f0ca5c4e700 1 --2- 172.21.15.81:0/535464955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ca0100e00 0x7f0ca00fbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.030+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/535464955 >> 172.21.15.81:0/535464955 conn(0x7f0ca0076270 msgr2=0x7f0ca00ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.030+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/535464955 shutdown_connections 2024-05-09T00:03:08.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.030+0000 7f0ca5c4e700 1 -- 172.21.15.81:0/535464955 wait complete. 2024-05-09T00:03:08.025 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-05-09T00:03:08.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:07 smithi081 sudo[108234]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:08.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:07 smithi081 sudo[108234]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:08.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:07 smithi081 sudo[108234]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:08.035 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:07 smithi081 sudo[108234]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:08.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:03:08.123 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:07 smithi171 sudo[87199]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:08.123 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:07 smithi171 sudo[87199]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:08.123 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:07 smithi171 sudo[87199]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:08.123 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:07 smithi171 sudo[87199]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:08.123 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:08 smithi171 sudo[87202]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:08.123 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:08 smithi171 sudo[87202]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:08.123 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:08 smithi171 sudo[87202]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:08.123 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:08 smithi171 sudo[87202]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:08.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.166+0000 7ff7667a0700 1 -- 172.21.15.81:0/1844419795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff760101080 msgr2=0x7ff760101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.166+0000 7ff7667a0700 1 --2- 172.21.15.81:0/1844419795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff760101080 0x7ff760101460 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff750009990 tx=0x7ff750009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.166+0000 7ff7667a0700 1 -- 172.21.15.81:0/1844419795 shutdown_connections 2024-05-09T00:03:08.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.166+0000 7ff7667a0700 1 --2- 172.21.15.81:0/1844419795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7601061a0 0x7ff76010dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.166+0000 7ff7667a0700 1 --2- 172.21.15.81:0/1844419795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff760101080 0x7ff760101460 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.166+0000 7ff7667a0700 1 --2- 172.21.15.81:0/1844419795 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff760101a30 0x7ff760105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.166+0000 7ff7667a0700 1 -- 172.21.15.81:0/1844419795 >> 172.21.15.81:0/1844419795 conn(0x7ff7600fc940 msgr2=0x7ff7600fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.167+0000 7ff7667a0700 1 -- 172.21.15.81:0/1844419795 shutdown_connections 2024-05-09T00:03:08.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.167+0000 7ff7667a0700 1 -- 172.21.15.81:0/1844419795 wait complete. 2024-05-09T00:03:08.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.167+0000 7ff7667a0700 1 Processor -- start 2024-05-09T00:03:08.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.167+0000 7ff7667a0700 1 -- start start 2024-05-09T00:03:08.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.167+0000 7ff7667a0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff760101080 0x7ff760197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.167+0000 7ff7667a0700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7601061a0 0x7ff7601977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.167+0000 7ff7667a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76019bb60 0x7ff76019bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.167+0000 7ff7667a0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76019c5e0 con 0x7ff76019bb60 2024-05-09T00:03:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff7667a0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76019c750 con 0x7ff760101080 2024-05-09T00:03:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff7667a0700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76019c910 con 0x7ff7601061a0 2024-05-09T00:03:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff764d3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76019bb60 0x7ff76019bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff764d3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76019bb60 0x7ff76019bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57032/0 (socket says 172.21.15.81:57032) 2024-05-09T00:03:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff764d3d700 1 -- 172.21.15.81:0/2321642049 learned_addr learned my addr 172.21.15.81:0/2321642049 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff75ffff700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff760101080 0x7ff760197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff75f7fe700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7601061a0 0x7ff7601977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff764d3d700 1 -- 172.21.15.81:0/2321642049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7601061a0 msgr2=0x7ff7601977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff764d3d700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7601061a0 0x7ff7601977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff764d3d700 1 -- 172.21.15.81:0/2321642049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff760101080 msgr2=0x7ff760197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff764d3d700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff760101080 0x7ff760197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff764d3d700 1 -- 172.21.15.81:0/2321642049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7500095f0 con 0x7ff76019bb60 2024-05-09T00:03:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff75f7fe700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7601061a0 0x7ff7601977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff764d3d700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76019bb60 0x7ff76019bfe0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff758007d70 tx=0x7ff75800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff75d7fa700 1 -- 172.21.15.81:0/2321642049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75800ad40 con 0x7ff76019bb60 2024-05-09T00:03:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff7667a0700 1 -- 172.21.15.81:0/2321642049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7601a3e70 con 0x7ff76019bb60 2024-05-09T00:03:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff75d7fa700 1 -- 172.21.15.81:0/2321642049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7580128e0 con 0x7ff76019bb60 2024-05-09T00:03:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff75d7fa700 1 -- 172.21.15.81:0/2321642049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7580116b0 con 0x7ff76019bb60 2024-05-09T00:03:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.168+0000 7ff7667a0700 1 -- 172.21.15.81:0/2321642049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7601a4350 con 0x7ff76019bb60 2024-05-09T00:03:08.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.169+0000 7ff7667a0700 1 -- 172.21.15.81:0/2321642049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff760109410 con 0x7ff76019bb60 2024-05-09T00:03:08.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.170+0000 7ff75d7fa700 1 -- 172.21.15.81:0/2321642049 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7ff758012420 con 0x7ff76019bb60 2024-05-09T00:03:08.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.171+0000 7ff75d7fa700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff7480a13b0 0x7ff7480a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.171+0000 7ff75ffff700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff7480a13b0 0x7ff7480a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.171+0000 7ff75d7fa700 1 -- 172.21.15.81:0/2321642049 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ff7580cd0a0 con 0x7ff76019bb60 2024-05-09T00:03:08.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.171+0000 7ff75ffff700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff7480a13b0 0x7ff7480a3870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff750006010 tx=0x7ff750005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.175+0000 7ff75d7fa700 1 -- 172.21.15.81:0/2321642049 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff7580963b0 con 0x7ff76019bb60 2024-05-09T00:03:08.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:08 smithi081 ceph-mon[42474]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 169 KiB/s wr, 37 op/s 2024-05-09T00:03:08.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:08 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2245722949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:03:08.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:08 smithi081 ceph-mon[42474]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:03:08.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:08 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:03:08.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:08 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:03:08.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:08 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:03:08.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:08 smithi081 ceph-mon[42474]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:03:08.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:08 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1262573648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:03:08.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.375+0000 7ff7667a0700 1 -- 172.21.15.81:0/2321642049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff760102550 con 0x7ff76019bb60 2024-05-09T00:03:08.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.377+0000 7ff75d7fa700 1 -- 172.21.15.81:0/2321642049 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+23003 (secure 0 0 0) 0x7ff7580999d0 con 0x7ff76019bb60 2024-05-09T00:03:08.372 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:03:08.372 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:02:58.862731+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/907969237":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/589390516":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/1458411552":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1755507053":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/3633496844":"2024-05-10T00:02:58.862694+0000","172.21.15.81:6801/1458411552":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/1903231103":"2024-05-10T00:02:58.862694+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:03:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.379+0000 7ff7667a0700 1 -- 172.21.15.81:0/2321642049 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff7480a13b0 msgr2=0x7ff7480a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.379+0000 7ff7667a0700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff7480a13b0 0x7ff7480a3870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff750006010 tx=0x7ff750005960 comp rx=0 tx=0).stop 2024-05-09T00:03:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.379+0000 7ff7667a0700 1 -- 172.21.15.81:0/2321642049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76019bb60 msgr2=0x7ff76019bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.379+0000 7ff7667a0700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76019bb60 0x7ff76019bfe0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff758007d70 tx=0x7ff75800a340 comp rx=0 tx=0).stop 2024-05-09T00:03:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.379+0000 7ff7667a0700 1 -- 172.21.15.81:0/2321642049 shutdown_connections 2024-05-09T00:03:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.379+0000 7ff7667a0700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff7480a13b0 0x7ff7480a3870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.379+0000 7ff7667a0700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff760101080 0x7ff760197280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.379+0000 7ff7667a0700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff76019bb60 0x7ff76019bfe0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.379+0000 7ff7667a0700 1 --2- 172.21.15.81:0/2321642049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff7601061a0 0x7ff7601977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.379+0000 7ff7667a0700 1 -- 172.21.15.81:0/2321642049 >> 172.21.15.81:0/2321642049 conn(0x7ff7600fc940 msgr2=0x7ff7600fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.379+0000 7ff7667a0700 1 -- 172.21.15.81:0/2321642049 shutdown_connections 2024-05-09T00:03:08.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.380+0000 7ff7667a0700 1 -- 172.21.15.81:0/2321642049 wait complete. 2024-05-09T00:03:08.386 DEBUG:tasks.fwd_scrub:Yielding 2024-05-09T00:03:08.386 INFO:teuthology.run_tasks:Running task exec... 2024-05-09T00:03:08.417 INFO:teuthology.task.exec:Executing custom commands... 2024-05-09T00:03:08.417 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-05-09T00:03:08.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-05-09T00:03:08.417 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-05-09T00:03:08.418 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:03:08.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:03:08.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 ceph-mon[46187]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 169 KiB/s wr, 37 op/s 2024-05-09T00:03:08.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2245722949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:03:08.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 ceph-mon[46187]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:03:08.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:03:08.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:03:08.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:03:08.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 ceph-mon[46187]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:03:08.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1262573648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:03:08.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 sudo[84360]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-09T00:03:08.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 sudo[84360]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:08.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 sudo[84360]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:08.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 sudo[84360]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:08.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.550+0000 7f5c2bcac700 1 -- 172.21.15.81:0/187698159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c240682e0 msgr2=0x7f5c24068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.550+0000 7f5c2bcac700 1 --2- 172.21.15.81:0/187698159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c240682e0 0x7f5c24068760 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009990 tx=0x7f5c14009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 -- 172.21.15.81:0/187698159 shutdown_connections 2024-05-09T00:03:08.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 --2- 172.21.15.81:0/187698159 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c24107000 0x7f5c241073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 --2- 172.21.15.81:0/187698159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c24068ca0 0x7f5c2410dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 --2- 172.21.15.81:0/187698159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c240682e0 0x7f5c24068760 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 -- 172.21.15.81:0/187698159 >> 172.21.15.81:0/187698159 conn(0x7f5c24076f10 msgr2=0x7f5c24077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 -- 172.21.15.81:0/187698159 shutdown_connections 2024-05-09T00:03:08.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 -- 172.21.15.81:0/187698159 wait complete. 2024-05-09T00:03:08.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 Processor -- start 2024-05-09T00:03:08.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 -- start start 2024-05-09T00:03:08.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f04cae60700 1 -- 172.21.15.81:0/1733272551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04c4101180 msgr2=0x7f04c4101560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f04cae60700 1 --2- 172.21.15.81:0/1733272551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04c4101180 0x7f04c4101560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f04b80098f0 tx=0x7f04b8009c00 comp rx=0 tx=0).stop 2024-05-09T00:03:08.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c240682e0 0x7f5c241972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c24068ca0 0x7f5c24197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c24107000 0x7f5c2419bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2419c1b0 con 0x7f5c24107000 2024-05-09T00:03:08.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2419c320 con 0x7f5c24068ca0 2024-05-09T00:03:08.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f5c2bcac700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2419c4e0 con 0x7f5c240682e0 2024-05-09T00:03:08.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f04cae60700 1 -- 172.21.15.81:0/1733272551 shutdown_connections 2024-05-09T00:03:08.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f04cae60700 1 --2- 172.21.15.81:0/1733272551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c41062a0 0x7f04c410de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f04cae60700 1 --2- 172.21.15.81:0/1733272551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04c4101180 0x7f04c4101560 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f04cae60700 1 --2- 172.21.15.81:0/1733272551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04c4101b30 0x7f04c4105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.551+0000 7f04cae60700 1 -- 172.21.15.81:0/1733272551 >> 172.21.15.81:0/1733272551 conn(0x7f04c40fc9e0 msgr2=0x7f04c40fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f5c2a249700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c24107000 0x7f5c2419bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f04cae60700 1 -- 172.21.15.81:0/1733272551 shutdown_connections 2024-05-09T00:03:08.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f5c29247700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c24068ca0 0x7f5c24197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f5c2a249700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c24107000 0x7f5c2419bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57064/0 (socket says 172.21.15.81:57064) 2024-05-09T00:03:08.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f5c2a249700 1 -- 172.21.15.81:0/324279170 learned_addr learned my addr 172.21.15.81:0/324279170 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:08.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f5c29a48700 1 --2- 172.21.15.81:0/324279170 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c240682e0 0x7f5c241972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f04cae60700 1 -- 172.21.15.81:0/1733272551 wait complete. 2024-05-09T00:03:08.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f5c29247700 1 -- 172.21.15.81:0/324279170 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c240682e0 msgr2=0x7f5c241972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f5c29247700 1 --2- 172.21.15.81:0/324279170 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c240682e0 0x7f5c241972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f5c29247700 1 -- 172.21.15.81:0/324279170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c24107000 msgr2=0x7f5c2419bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f5c29247700 1 --2- 172.21.15.81:0/324279170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c24107000 0x7f5c2419bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f5c29247700 1 -- 172.21.15.81:0/324279170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c140095f0 con 0x7f5c24068ca0 2024-05-09T00:03:08.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f5c2a249700 1 --2- 172.21.15.81:0/324279170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c24107000 0x7f5c2419bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:03:08.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f5c29247700 1 --2- 172.21.15.81:0/324279170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c24068ca0 0x7f5c24197820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c140059d0 tx=0x7f5c14004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.556 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:08 smithi171 ceph-mon[47351]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 169 KiB/s wr, 37 op/s 2024-05-09T00:03:08.557 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:08 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2245722949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:03:08.557 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:08 smithi171 ceph-mon[47351]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:03:08.557 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:08 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:03:08.557 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:08 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:03:08.557 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:08 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:03:08.557 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:08 smithi171 ceph-mon[47351]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:03:08.557 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:08 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1262573648' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:03:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f04cae60700 1 Processor -- start 2024-05-09T00:03:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.552+0000 7f04cae60700 1 -- start start 2024-05-09T00:03:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04cae60700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c4101180 0x7f04c41974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04cae60700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04c41062a0 0x7f04c4197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04cae60700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04c419bd80 0x7f04c419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04cae60700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c419c800 con 0x7f04c4101180 2024-05-09T00:03:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04cae60700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c419c970 con 0x7f04c41062a0 2024-05-09T00:03:08.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04cae60700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c419cb30 con 0x7f04c419bd80 2024-05-09T00:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c8bfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c4101180 0x7f04c41974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c8bfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c4101180 0x7f04c41974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57078/0 (socket says 172.21.15.81:57078) 2024-05-09T00:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c8bfc700 1 -- 172.21.15.81:0/3949118318 learned_addr learned my addr 172.21.15.81:0/3949118318 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c93fd700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04c419bd80 0x7f04c419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c3fff700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04c41062a0 0x7f04c4197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c8bfc700 1 -- 172.21.15.81:0/3949118318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04c419bd80 msgr2=0x7f04c419c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04c419bd80 0x7f04c419c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c8bfc700 1 -- 172.21.15.81:0/3949118318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04c41062a0 msgr2=0x7f04c4197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04c41062a0 0x7f04c4197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c8bfc700 1 -- 172.21.15.81:0/3949118318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b8009520 con 0x7f04c4101180 2024-05-09T00:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c3fff700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04c41062a0 0x7f04c4197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c4101180 0x7f04c41974f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f04b8005950 tx=0x7f04b800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c1ffb700 1 -- 172.21.15.81:0/3949118318 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b801c070 con 0x7f04c4101180 2024-05-09T00:03:08.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04cae60700 1 -- 172.21.15.81:0/3949118318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c41a4030 con 0x7f04c4101180 2024-05-09T00:03:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c1ffb700 1 -- 172.21.15.81:0/3949118318 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04b800ba40 con 0x7f04c4101180 2024-05-09T00:03:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.553+0000 7f04c1ffb700 1 -- 172.21.15.81:0/3949118318 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80038e0 con 0x7f04c4101180 2024-05-09T00:03:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.554+0000 7f04cae60700 1 -- 172.21.15.81:0/3949118318 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c41a4450 con 0x7f04c4101180 2024-05-09T00:03:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.556+0000 7f04c1ffb700 1 -- 172.21.15.81:0/3949118318 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f04b8020030 con 0x7f04c4101180 2024-05-09T00:03:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.556+0000 7f04c1ffb700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f04b40a13b0 0x7f04b40a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.557+0000 7f04c3fff700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f04b40a13b0 0x7f04b40a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.557+0000 7f04c1ffb700 1 -- 172.21.15.81:0/3949118318 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f04b80cde00 con 0x7f04c4101180 2024-05-09T00:03:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.557+0000 7f04c3fff700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f04b40a13b0 0x7f04b40a3870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f04c41989f0 tx=0x7f04b0009310 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.557+0000 7f04d701ab80 1 Processor -- start 2024-05-09T00:03:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04d701ab80 1 -- start start 2024-05-09T00:03:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04d701ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bd2e80 0x55f2e6bd3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04d701ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd37a0 0x55f2e6bcd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04d701ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bcd910 0x55f2e6bcdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04d701ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e6b241d0 con 0x55f2e6bd2e80 2024-05-09T00:03:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04d701ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e6b21b90 con 0x55f2e6bd37a0 2024-05-09T00:03:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04d701ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e6b1d480 con 0x55f2e6bcd910 2024-05-09T00:03:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04c8bfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bd2e80 0x55f2e6bd3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04c8bfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bd2e80 0x55f2e6bd3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57086/0 (socket says 172.21.15.81:57086) 2024-05-09T00:03:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04c8bfc700 1 -- 172.21.15.81:0/1497876951 learned_addr learned my addr 172.21.15.81:0/1497876951 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04c3fff700 1 --2- 172.21.15.81:0/1497876951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd37a0 0x55f2e6bcd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04c93fd700 1 --2- 172.21.15.81:0/1497876951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bcd910 0x55f2e6bcdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04c8bfc700 1 -- 172.21.15.81:0/1497876951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bcd910 msgr2=0x55f2e6bcdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/1497876951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bcd910 0x55f2e6bcdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04c8bfc700 1 -- 172.21.15.81:0/1497876951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd37a0 msgr2=0x55f2e6bcd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/1497876951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd37a0 0x55f2e6bcd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04c8bfc700 1 -- 172.21.15.81:0/1497876951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2e699e430 con 0x55f2e6bd2e80 2024-05-09T00:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/1497876951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bd2e80 0x55f2e6bd3260 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f04b8005e90 tx=0x7f04b809ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5657166585e08fb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04aeffd700 1 -- 172.21.15.81:0/1497876951 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80b2070 con 0x55f2e6bd2e80 2024-05-09T00:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04aeffd700 1 -- 172.21.15.81:0/1497876951 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04b809eb80 con 0x55f2e6bd2e80 2024-05-09T00:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.558+0000 7f04aeffd700 1 -- 172.21.15.81:0/1497876951 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b8021380 con 0x55f2e6bd2e80 2024-05-09T00:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.559+0000 7f04d701ab80 1 -- 172.21.15.81:0/1497876951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bd2e80 msgr2=0x55f2e6bd3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.559+0000 7f04d701ab80 1 --2- 172.21.15.81:0/1497876951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bd2e80 0x55f2e6bd3260 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f04b8005e90 tx=0x7f04b809ac50 comp rx=0 tx=0).stop 2024-05-09T00:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.559+0000 7f04d701ab80 1 -- 172.21.15.81:0/1497876951 shutdown_connections 2024-05-09T00:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.559+0000 7f04d701ab80 1 --2- 172.21.15.81:0/1497876951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bcd910 0x55f2e6bcdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.559+0000 7f04d701ab80 1 --2- 172.21.15.81:0/1497876951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bd2e80 0x55f2e6bd3260 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.559+0000 7f04d701ab80 1 --2- 172.21.15.81:0/1497876951 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd37a0 0x55f2e6bcd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.559+0000 7f04d701ab80 1 -- 172.21.15.81:0/1497876951 >> 172.21.15.81:0/1497876951 conn(0x55f2e6b2b290 msgr2=0x55f2e6bc7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.559+0000 7f04d701ab80 1 -- 172.21.15.81:0/1497876951 shutdown_connections 2024-05-09T00:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.559+0000 7f04d701ab80 1 -- 172.21.15.81:0/1497876951 wait complete. 2024-05-09T00:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.559+0000 7f04d701ab80 1 -- start start 2024-05-09T00:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04d701ab80 1 Processor -- start 2024-05-09T00:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04d701ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bcd910 0x55f2e6bd97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04d701ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd2e80 0x55f2e6bd6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04d701ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd37a0 0x55f2e6bd71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04d701ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e6ab95e0 con 0x55f2e6bcd910 2024-05-09T00:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04d701ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e6ab9280 con 0x55f2e6bd37a0 2024-05-09T00:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04d701ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e69a0720 con 0x55f2e6bd2e80 2024-05-09T00:03:08.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04d701ab80 10 client.0 _ll_register_callbacks cb 0x55f2e6ac2bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:08.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04c8bfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bcd910 0x55f2e6bd97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04c8bfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bcd910 0x55f2e6bd97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57102/0 (socket says 172.21.15.81:57102) 2024-05-09T00:03:08.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04c8bfc700 1 -- 172.21.15.81:0/1316011868 learned_addr learned my addr 172.21.15.81:0/1316011868 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:08.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04c3fff700 1 --2- 172.21.15.81:0/1316011868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd2e80 0x55f2e6bd6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04c93fd700 1 --2- 172.21.15.81:0/1316011868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd37a0 0x55f2e6bd71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04c8bfc700 1 -- 172.21.15.81:0/1316011868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd2e80 msgr2=0x55f2e6bd6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/1316011868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd2e80 0x55f2e6bd6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04c8bfc700 1 -- 172.21.15.81:0/1316011868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd37a0 msgr2=0x55f2e6bd71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/1316011868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd37a0 0x55f2e6bd71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04c8bfc700 1 -- 172.21.15.81:0/1316011868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c41a4450 con 0x55f2e6bcd910 2024-05-09T00:03:08.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/1316011868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bcd910 0x55f2e6bd97c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f04b809ace0 tx=0x7f04b809ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819e96119ea6300 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.560+0000 7f04a3fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:08.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04a3fff700 1 -- 172.21.15.81:0/1316011868 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80b9070 con 0x55f2e6bcd910 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04a3fff700 1 -- 172.21.15.81:0/1316011868 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f04b80b3070 con 0x55f2e6bcd910 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04d701ab80 1 -- 172.21.15.81:0/1316011868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2e6a762f0 con 0x55f2e6bcd910 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04a3fff700 1 -- 172.21.15.81:0/1316011868 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04b80b2030 con 0x55f2e6bcd910 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04d701ab80 10 client.15486 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04d701ab80 1 -- 172.21.15.81:0/1316011868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55f2e694abe0 con 0x55f2e6bcd910 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04a3fff700 1 -- 172.21.15.81:0/1316011868 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04b807d070 con 0x55f2e6bcd910 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04a3fff700 1 -- 172.21.15.81:0/1316011868 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f04b80ba050 con 0x55f2e6bcd910 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04d701ab80 10 client.15486 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04d701ab80 10 client.15486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04d701ab80 20 client.15486 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04d701ab80 1 --2- 172.21.15.81:0/1316011868 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2e6be6ad0 0x55f2e6be8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04d701ab80 4 client.15486 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04d701ab80 1 -- 172.21.15.81:0/1316011868 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f2e6b9c890 con 0x55f2e6be6ad0 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.561+0000 7f04c3fff700 1 --2- 172.21.15.81:0/1316011868 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2e6be6ad0 0x55f2e6be8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.562+0000 7f04a3fff700 10 client.15486 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:08.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.562+0000 7f04c3fff700 1 --2- 172.21.15.81:0/1316011868 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2e6be6ad0 0x55f2e6be8ec0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7838083e6c6c2120 server_cookie=1f0dc43085602aac in_seq=0 out_seq=0 2024-05-09T00:03:08.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.562+0000 7f04a3fff700 1 -- 172.21.15.81:0/1316011868 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f2e6b9c890 con 0x55f2e6be6ad0 2024-05-09T00:03:08.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.562+0000 7f04a3fff700 10 client.15486 handle_command_reply: tid=0 2024-05-09T00:03:08.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.562+0000 7f04d701ab80 1 client.15486 shutdown 2024-05-09T00:03:08.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.562+0000 7f04d701ab80 1 -- 172.21.15.81:0/1316011868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bcd910 msgr2=0x55f2e6bd97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.562+0000 7f04d701ab80 1 --2- 172.21.15.81:0/1316011868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bcd910 0x55f2e6bd97c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f04b809ace0 tx=0x7f04b809ae90 comp rx=0 tx=0).stop 2024-05-09T00:03:08.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.562+0000 7f04d701ab80 1 -- 172.21.15.81:0/1316011868 shutdown_connections 2024-05-09T00:03:08.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.562+0000 7f04d701ab80 1 --2- 172.21.15.81:0/1316011868 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2e6be6ad0 0x55f2e6be8ec0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.562+0000 7f04d701ab80 1 --2- 172.21.15.81:0/1316011868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd37a0 0x55f2e6bd71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.562+0000 7f04d701ab80 1 --2- 172.21.15.81:0/1316011868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bcd910 0x55f2e6bd97c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.562+0000 7f04a3fff700 0 client.15486 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:08.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.562+0000 7f04d701ab80 1 --2- 172.21.15.81:0/1316011868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd2e80 0x55f2e6bd6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.562+0000 7f04d701ab80 1 -- 172.21.15.81:0/1316011868 >> 172.21.15.81:0/1316011868 conn(0x55f2e6b2b290 msgr2=0x55f2e6bc7620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.563+0000 7f04d701ab80 1 -- 172.21.15.81:0/1316011868 shutdown_connections 2024-05-09T00:03:08.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.563+0000 7f04d701ab80 1 -- 172.21.15.81:0/1316011868 wait complete. 2024-05-09T00:03:08.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.563+0000 7f04d701ab80 20 client.15486 trim_cache size 0 max 16384 2024-05-09T00:03:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04d701ab80 1 Processor -- start 2024-05-09T00:03:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04d701ab80 1 -- start start 2024-05-09T00:03:08.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04d701ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bcd910 0x55f2e6bc7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04d701ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd2e80 0x55f2e6bd22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04d701ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd37a0 0x55f2e6bdc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04d701ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e6bee0d0 con 0x55f2e6bcd910 2024-05-09T00:03:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04d701ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e6bc8960 con 0x55f2e6bd2e80 2024-05-09T00:03:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04d701ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e6bd4f70 con 0x55f2e6bd37a0 2024-05-09T00:03:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04c8bfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bcd910 0x55f2e6bc7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04c8bfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bcd910 0x55f2e6bc7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57106/0 (socket says 172.21.15.81:57106) 2024-05-09T00:03:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04c8bfc700 1 -- 172.21.15.81:0/3125767025 learned_addr learned my addr 172.21.15.81:0/3125767025 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04c3fff700 1 --2- 172.21.15.81:0/3125767025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd2e80 0x55f2e6bd22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04c93fd700 1 --2- 172.21.15.81:0/3125767025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd37a0 0x55f2e6bdc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04c8bfc700 1 -- 172.21.15.81:0/3125767025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd37a0 msgr2=0x55f2e6bdc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/3125767025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd37a0 0x55f2e6bdc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04c8bfc700 1 -- 172.21.15.81:0/3125767025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd2e80 msgr2=0x55f2e6bd22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/3125767025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd2e80 0x55f2e6bd22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04c8bfc700 1 -- 172.21.15.81:0/3125767025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2e6bcdfc0 con 0x55f2e6bcd910 2024-05-09T00:03:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/3125767025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bcd910 0x55f2e6bc7da0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f04b8097250 tx=0x7f04b8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da1640466d6ffe9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.580+0000 7f04af7fe700 1 -- 172.21.15.81:0/3125767025 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80b9050 con 0x55f2e6bcd910 2024-05-09T00:03:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.581+0000 7f04af7fe700 1 -- 172.21.15.81:0/3125767025 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04b807d070 con 0x55f2e6bcd910 2024-05-09T00:03:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.581+0000 7f04af7fe700 1 -- 172.21.15.81:0/3125767025 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80215e0 con 0x55f2e6bcd910 2024-05-09T00:03:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.581+0000 7f04d701ab80 1 -- 172.21.15.81:0/3125767025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bcd910 msgr2=0x55f2e6bc7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.581+0000 7f04d701ab80 1 --2- 172.21.15.81:0/3125767025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bcd910 0x55f2e6bc7da0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f04b8097250 tx=0x7f04b8009c00 comp rx=0 tx=0).stop 2024-05-09T00:03:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.581+0000 7f04d701ab80 1 -- 172.21.15.81:0/3125767025 shutdown_connections 2024-05-09T00:03:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.581+0000 7f04d701ab80 1 --2- 172.21.15.81:0/3125767025 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd37a0 0x55f2e6bdc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.581+0000 7f04d701ab80 1 --2- 172.21.15.81:0/3125767025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bcd910 0x55f2e6bc7da0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.581+0000 7f04d701ab80 1 --2- 172.21.15.81:0/3125767025 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bd2e80 0x55f2e6bd22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.581+0000 7f04d701ab80 1 -- 172.21.15.81:0/3125767025 >> 172.21.15.81:0/3125767025 conn(0x55f2e6b2b290 msgr2=0x55f2e6bd1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.581+0000 7f04d701ab80 1 -- 172.21.15.81:0/3125767025 shutdown_connections 2024-05-09T00:03:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.581+0000 7f04d701ab80 1 -- 172.21.15.81:0/3125767025 wait complete. 2024-05-09T00:03:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.581+0000 7f04d701ab80 1 -- start start 2024-05-09T00:03:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04d701ab80 1 Processor -- start 2024-05-09T00:03:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04d701ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bcd910 0x55f2e6c35460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04d701ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bd2e80 0x55f2e6c359a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04d701ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd37a0 0x55f2e6c30f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04d701ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e6c31640 con 0x55f2e6bd2e80 2024-05-09T00:03:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04d701ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e6c317b0 con 0x55f2e6bcd910 2024-05-09T00:03:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04d701ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2e6c31970 con 0x55f2e6bd37a0 2024-05-09T00:03:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04d701ab80 10 client.0 _ll_register_callbacks cb 0x55f2e6ac2bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bd2e80 0x55f2e6c359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bd2e80 0x55f2e6c359a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57110/0 (socket says 172.21.15.81:57110) 2024-05-09T00:03:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04c3fff700 1 -- 172.21.15.81:0/3645687752 learned_addr learned my addr 172.21.15.81:0/3645687752 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:08.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/3645687752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bcd910 0x55f2e6c35460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04c93fd700 1 --2- 172.21.15.81:0/3645687752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd37a0 0x55f2e6c30f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04c3fff700 1 -- 172.21.15.81:0/3645687752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd37a0 msgr2=0x55f2e6c30f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04c3fff700 1 --2- 172.21.15.81:0/3645687752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd37a0 0x55f2e6c30f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04c3fff700 1 -- 172.21.15.81:0/3645687752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bcd910 msgr2=0x55f2e6c35460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04c3fff700 1 --2- 172.21.15.81:0/3645687752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bcd910 0x55f2e6c35460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04c3fff700 1 -- 172.21.15.81:0/3645687752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f2e694abe0 con 0x55f2e6bd2e80 2024-05-09T00:03:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.582+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/3645687752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bcd910 0x55f2e6c35460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:03:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04c3fff700 1 --2- 172.21.15.81:0/3645687752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bd2e80 0x55f2e6c359a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f04c406a5d0 tx=0x7f04b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8b2450fdceb4d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04a3fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04a3fff700 1 -- 172.21.15.81:0/3645687752 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0025040 con 0x55f2e6bd2e80 2024-05-09T00:03:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04a3fff700 1 -- 172.21.15.81:0/3645687752 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f04b0018070 con 0x55f2e6bd2e80 2024-05-09T00:03:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04d701ab80 1 -- 172.21.15.81:0/3645687752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04b809eb80 con 0x55f2e6bd2e80 2024-05-09T00:03:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04a3fff700 1 -- 172.21.15.81:0/3645687752 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04b0012650 con 0x55f2e6bd2e80 2024-05-09T00:03:08.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04d701ab80 10 client.15492 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04d701ab80 1 -- 172.21.15.81:0/3645687752 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55f2e6ae35e0 con 0x55f2e6bd2e80 2024-05-09T00:03:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04a3fff700 1 -- 172.21.15.81:0/3645687752 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04b003f080 con 0x55f2e6bd2e80 2024-05-09T00:03:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04a3fff700 1 -- 172.21.15.81:0/3645687752 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f04b0039030 con 0x55f2e6bd2e80 2024-05-09T00:03:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04d701ab80 10 client.15492 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04d701ab80 10 client.15492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04d701ab80 20 client.15492 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04d701ab80 1 --2- 172.21.15.81:0/3645687752 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2e6c3e550 0x55f2e6c40970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04d701ab80 4 client.15492 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:03:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04d701ab80 1 -- 172.21.15.81:0/3645687752 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f2e6b15f40 con 0x55f2e6c3e550 2024-05-09T00:03:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.583+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/3645687752 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2e6c3e550 0x55f2e6c40970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.584+0000 7f04c8bfc700 1 --2- 172.21.15.81:0/3645687752 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2e6c3e550 0x55f2e6c40970 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a0438162dee2388 server_cookie=15de7d26ac5b7a5c in_seq=0 out_seq=0 2024-05-09T00:03:08.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.584+0000 7f04a3fff700 10 client.15492 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:08.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04a3fff700 1 -- 172.21.15.81:0/3645687752 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f2e6b15f40 con 0x55f2e6c3e550 2024-05-09T00:03:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04a3fff700 10 client.15492 handle_command_reply: tid=0 2024-05-09T00:03:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04d701ab80 1 client.15492 shutdown 2024-05-09T00:03:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04d701ab80 1 -- 172.21.15.81:0/3645687752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bd2e80 msgr2=0x55f2e6c359a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04d701ab80 1 --2- 172.21.15.81:0/3645687752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bd2e80 0x55f2e6c359a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f04c406a5d0 tx=0x7f04b00047c0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04d701ab80 1 -- 172.21.15.81:0/3645687752 shutdown_connections 2024-05-09T00:03:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04d701ab80 1 --2- 172.21.15.81:0/3645687752 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2e6c3e550 0x55f2e6c40970 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04d701ab80 1 --2- 172.21.15.81:0/3645687752 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2e6bcd910 0x55f2e6c35460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04d701ab80 1 --2- 172.21.15.81:0/3645687752 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2e6bd37a0 0x55f2e6c30f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04a3fff700 0 client.15492 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04d701ab80 1 --2- 172.21.15.81:0/3645687752 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2e6bd2e80 0x55f2e6c359a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04d701ab80 1 -- 172.21.15.81:0/3645687752 >> 172.21.15.81:0/3645687752 conn(0x55f2e6b2b290 msgr2=0x55f2e6bd1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04d701ab80 1 -- 172.21.15.81:0/3645687752 shutdown_connections 2024-05-09T00:03:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04d701ab80 1 -- 172.21.15.81:0/3645687752 wait complete. 2024-05-09T00:03:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.585+0000 7f04d701ab80 20 client.15492 trim_cache size 0 max 16384 2024-05-09T00:03:08.586 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:03:08.586 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:03:08.586 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "3c3533cd-4605-425e-9014-2151bfb97d8c", 2024-05-09T00:03:08.586 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:03:08.586 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:03:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.586+0000 7f04cae60700 1 -- 172.21.15.81:0/3949118318 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f04b40a13b0 msgr2=0x7f04b40a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.586+0000 7f04cae60700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f04b40a13b0 0x7f04b40a3870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f04c41989f0 tx=0x7f04b0009310 comp rx=0 tx=0).stop 2024-05-09T00:03:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.586+0000 7f04cae60700 1 -- 172.21.15.81:0/3949118318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c4101180 msgr2=0x7f04c41974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.586+0000 7f04cae60700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c4101180 0x7f04c41974f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f04b8005950 tx=0x7f04b800fa00 comp rx=0 tx=0).stop 2024-05-09T00:03:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.586+0000 7f04cae60700 1 -- 172.21.15.81:0/3949118318 shutdown_connections 2024-05-09T00:03:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.586+0000 7f04cae60700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f04b40a13b0 0x7f04b40a3870 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.586+0000 7f04cae60700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04c419bd80 0x7f04c419c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.586+0000 7f04cae60700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04c4101180 0x7f04c41974f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.586+0000 7f04cae60700 1 --2- 172.21.15.81:0/3949118318 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f04c41062a0 0x7f04c4197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.586+0000 7f04cae60700 1 -- 172.21.15.81:0/3949118318 >> 172.21.15.81:0/3949118318 conn(0x7f04c40fc9e0 msgr2=0x7f04c40fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.586+0000 7f04cae60700 1 -- 172.21.15.81:0/3949118318 shutdown_connections 2024-05-09T00:03:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.586+0000 7f04cae60700 1 -- 172.21.15.81:0/3949118318 wait complete. 2024-05-09T00:03:08.595 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:03:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.622+0000 7f5c1affd700 1 -- 172.21.15.81:0/324279170 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1401d070 con 0x7f5c24068ca0 2024-05-09T00:03:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.622+0000 7f5c1affd700 1 -- 172.21.15.81:0/324279170 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c14022470 con 0x7f5c24068ca0 2024-05-09T00:03:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.622+0000 7f5c1affd700 1 -- 172.21.15.81:0/324279170 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c14017650 con 0x7f5c24068ca0 2024-05-09T00:03:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.622+0000 7f5c2bcac700 1 -- 172.21.15.81:0/324279170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2419c760 con 0x7f5c24068ca0 2024-05-09T00:03:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.622+0000 7f5c2bcac700 1 -- 172.21.15.81:0/324279170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2419c9b0 con 0x7f5c24068ca0 2024-05-09T00:03:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.623+0000 7f5c2bcac700 1 -- 172.21.15.81:0/324279170 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c24109380 con 0x7f5c24068ca0 2024-05-09T00:03:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.625+0000 7f5c1affd700 1 -- 172.21.15.81:0/324279170 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f5c140225e0 con 0x7f5c24068ca0 2024-05-09T00:03:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.626+0000 7f5c1affd700 1 --2- 172.21.15.81:0/324279170 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5c100a1430 0x7f5c100a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.626+0000 7f5c29a48700 1 --2- 172.21.15.81:0/324279170 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5c100a1430 0x7f5c100a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.626+0000 7f5c1affd700 1 -- 172.21.15.81:0/324279170 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f5c140ce550 con 0x7f5c24068ca0 2024-05-09T00:03:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.626+0000 7f5c29a48700 1 --2- 172.21.15.81:0/324279170 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5c100a1430 0x7f5c100a38f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5c20005950 tx=0x7f5c2000b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.631+0000 7f5c1affd700 1 -- 172.21.15.81:0/324279170 <== mon.2 v2:172.21.15.150:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5c140977a0 con 0x7f5c24068ca0 2024-05-09T00:03:08.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.730+0000 7f08aa99d700 1 -- 172.21.15.81:0/912235539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a41028a0 msgr2=0x7f08a410ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.730+0000 7f08aa99d700 1 --2- 172.21.15.81:0/912235539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a41028a0 0x7f08a410ad80 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0894009990 tx=0x7f0894009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.730+0000 7f08aa99d700 1 -- 172.21.15.81:0/912235539 shutdown_connections 2024-05-09T00:03:08.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.730+0000 7f08aa99d700 1 --2- 172.21.15.81:0/912235539 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a410b350 0x7f08a410d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.730+0000 7f08aa99d700 1 --2- 172.21.15.81:0/912235539 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08a4101f80 0x7f08a4102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.730+0000 7f08aa99d700 1 --2- 172.21.15.81:0/912235539 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a41028a0 0x7f08a410ad80 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.730+0000 7f08aa99d700 1 -- 172.21.15.81:0/912235539 >> 172.21.15.81:0/912235539 conn(0x7f08a40fb760 msgr2=0x7f08a40fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.730+0000 7f08aa99d700 1 -- 172.21.15.81:0/912235539 shutdown_connections 2024-05-09T00:03:08.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.730+0000 7f08aa99d700 1 -- 172.21.15.81:0/912235539 wait complete. 2024-05-09T00:03:08.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.730+0000 7f08aa99d700 1 Processor -- start 2024-05-09T00:03:08.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.730+0000 7f08aa99d700 1 -- start start 2024-05-09T00:03:08.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08aa99d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a4101f80 0x7f08a40ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08aa99d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a41028a0 0x7f08a4100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08aa99d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08a410b350 0x7f08a4100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08aa99d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a41a5550 con 0x7f08a4101f80 2024-05-09T00:03:08.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08aa99d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a41a56c0 con 0x7f08a41028a0 2024-05-09T00:03:08.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08aa99d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a41a5880 con 0x7f08a410b350 2024-05-09T00:03:08.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08a999b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a4101f80 0x7f08a40ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08a999b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a4101f80 0x7f08a40ffbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57132/0 (socket says 172.21.15.81:57132) 2024-05-09T00:03:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08a919a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a41028a0 0x7f08a4100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08a999b700 1 -- 172.21.15.81:0/3978523028 learned_addr learned my addr 172.21.15.81:0/3978523028 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08aa19c700 1 --2- 172.21.15.81:0/3978523028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08a410b350 0x7f08a4100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08a999b700 1 -- 172.21.15.81:0/3978523028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08a410b350 msgr2=0x7f08a4100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08a999b700 1 --2- 172.21.15.81:0/3978523028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08a410b350 0x7f08a4100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08a999b700 1 -- 172.21.15.81:0/3978523028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a41028a0 msgr2=0x7f08a4100110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08a999b700 1 --2- 172.21.15.81:0/3978523028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a41028a0 0x7f08a4100110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08a999b700 1 -- 172.21.15.81:0/3978523028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08940095f0 con 0x7f08a4101f80 2024-05-09T00:03:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.731+0000 7f08a999b700 1 --2- 172.21.15.81:0/3978523028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a4101f80 0x7f08a40ffbd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f08a000d980 tx=0x7f08a000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.732+0000 7f089affd700 1 -- 172.21.15.81:0/3978523028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0004220 con 0x7f08a4101f80 2024-05-09T00:03:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.732+0000 7f089affd700 1 -- 172.21.15.81:0/3978523028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08a0007640 con 0x7f08a4101f80 2024-05-09T00:03:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.732+0000 7f089affd700 1 -- 172.21.15.81:0/3978523028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a0005690 con 0x7f08a4101f80 2024-05-09T00:03:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.732+0000 7f08aa99d700 1 -- 172.21.15.81:0/3978523028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a41a5b60 con 0x7f08a4101f80 2024-05-09T00:03:08.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.732+0000 7f08aa99d700 1 -- 172.21.15.81:0/3978523028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a41a5ff0 con 0x7f08a4101f80 2024-05-09T00:03:08.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.734+0000 7f089affd700 1 -- 172.21.15.81:0/3978523028 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f08a0004750 con 0x7f08a4101f80 2024-05-09T00:03:08.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.735+0000 7f089affd700 1 --2- 172.21.15.81:0/3978523028 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f08900a13b0 0x7f08900a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.735+0000 7f089affd700 1 -- 172.21.15.81:0/3978523028 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f08a00ccd30 con 0x7f08a4101f80 2024-05-09T00:03:08.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.735+0000 7f08a919a700 1 --2- 172.21.15.81:0/3978523028 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f08900a13b0 0x7f08900a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.735+0000 7f08a919a700 1 --2- 172.21.15.81:0/3978523028 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f08900a13b0 0x7f08900a3870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08940098e0 tx=0x7f0894005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.735+0000 7f08b7db9b80 1 Processor -- start 2024-05-09T00:03:08.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08b7db9b80 1 -- start start 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08b7db9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840050 0x555f8a840430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08b7db9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840970 0x555f8a83a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08b7db9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a83a890 0x555f8a83acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08b7db9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8a791150 con 0x555f8a840970 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08b7db9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8a78eb10 con 0x555f8a83a890 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08b7db9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8a78a400 con 0x555f8a840050 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08a919a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840970 0x555f8a83a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08a919a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840970 0x555f8a83a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57144/0 (socket says 172.21.15.81:57144) 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08a919a700 1 -- 172.21.15.81:0/4154470872 learned_addr learned my addr 172.21.15.81:0/4154470872 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08a999b700 1 --2- 172.21.15.81:0/4154470872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840050 0x555f8a840430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08aa19c700 1 --2- 172.21.15.81:0/4154470872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a83a890 0x555f8a83acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08a919a700 1 -- 172.21.15.81:0/4154470872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840050 msgr2=0x555f8a840430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08a919a700 1 --2- 172.21.15.81:0/4154470872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840050 0x555f8a840430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08a919a700 1 -- 172.21.15.81:0/4154470872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a83a890 msgr2=0x555f8a83acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08a919a700 1 --2- 172.21.15.81:0/4154470872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a83a890 0x555f8a83acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08a919a700 1 -- 172.21.15.81:0/4154470872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f8a60b3b0 con 0x555f8a840970 2024-05-09T00:03:08.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f08a919a700 1 --2- 172.21.15.81:0/4154470872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840970 0x555f8a83a350 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0894015000 tx=0x7f089401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc9bbd51770557d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.736+0000 7f088ffff700 1 -- 172.21.15.81:0/4154470872 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894029070 con 0x555f8a840970 2024-05-09T00:03:08.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.737+0000 7f088ffff700 1 -- 172.21.15.81:0/4154470872 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f089401e040 con 0x555f8a840970 2024-05-09T00:03:08.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.737+0000 7f088ffff700 1 -- 172.21.15.81:0/4154470872 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089400f860 con 0x555f8a840970 2024-05-09T00:03:08.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.737+0000 7f08b7db9b80 1 -- 172.21.15.81:0/4154470872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840970 msgr2=0x555f8a83a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.737+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/4154470872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840970 0x555f8a83a350 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f0894015000 tx=0x7f089401f000 comp rx=0 tx=0).stop 2024-05-09T00:03:08.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.737+0000 7f08b7db9b80 1 -- 172.21.15.81:0/4154470872 shutdown_connections 2024-05-09T00:03:08.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.737+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/4154470872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a83a890 0x555f8a83acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.737+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/4154470872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840050 0x555f8a840430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.737+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/4154470872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840970 0x555f8a83a350 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.737+0000 7f08b7db9b80 1 -- 172.21.15.81:0/4154470872 >> 172.21.15.81:0/4154470872 conn(0x555f8a798210 msgr2=0x555f8a8352d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.737+0000 7f08b7db9b80 1 -- 172.21.15.81:0/4154470872 shutdown_connections 2024-05-09T00:03:08.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.737+0000 7f08b7db9b80 1 -- 172.21.15.81:0/4154470872 wait complete. 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.738+0000 7f08b7db9b80 1 -- start start 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.738+0000 7f08b7db9b80 1 Processor -- start 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.738+0000 7f08b7db9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a83a890 0x555f8a8468b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.738+0000 7f08b7db9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a840050 0x555f8a843b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.738+0000 7f08b7db9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840970 0x555f8a844270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.738+0000 7f08b7db9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8a726560 con 0x555f8a83a890 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.738+0000 7f08b7db9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8a726200 con 0x555f8a840050 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.738+0000 7f08b7db9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8a60d6a0 con 0x555f8a840970 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.738+0000 7f08b7db9b80 10 client.0 _ll_register_callbacks cb 0x555f8a72fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.738+0000 7f08a999b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a83a890 0x555f8a8468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.738+0000 7f08a999b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a83a890 0x555f8a8468b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57156/0 (socket says 172.21.15.81:57156) 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.738+0000 7f08a999b700 1 -- 172.21.15.81:0/1069883646 learned_addr learned my addr 172.21.15.81:0/1069883646 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.738+0000 7f08a919a700 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a840050 0x555f8a843b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08aa19c700 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840970 0x555f8a844270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08a999b700 1 -- 172.21.15.81:0/1069883646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840970 msgr2=0x555f8a844270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08a999b700 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840970 0x555f8a844270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08a999b700 1 -- 172.21.15.81:0/1069883646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a840050 msgr2=0x555f8a843b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08a999b700 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a840050 0x555f8a843b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08a999b700 1 -- 172.21.15.81:0/1069883646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a410e4b0 con 0x555f8a83a890 2024-05-09T00:03:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08a919a700 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a840050 0x555f8a843b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08aa19c700 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840970 0x555f8a844270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08a999b700 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a83a890 0x555f8a8468b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f08a000d950 tx=0x7f08a0099ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6324c79a7e1b55 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f088d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f088d7fa700 1 -- 172.21.15.81:0/1069883646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a00990e0 con 0x555f8a83a890 2024-05-09T00:03:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f088d7fa700 1 -- 172.21.15.81:0/1069883646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f08a0099240 con 0x555f8a83a890 2024-05-09T00:03:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08b7db9b80 1 -- 172.21.15.81:0/1069883646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f8a6e3270 con 0x555f8a83a890 2024-05-09T00:03:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f088d7fa700 1 -- 172.21.15.81:0/1069883646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08a00cabd0 con 0x555f8a83a890 2024-05-09T00:03:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08b7db9b80 10 client.15504 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08b7db9b80 1 -- 172.21.15.81:0/1069883646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x555f8a5b7b60 con 0x555f8a83a890 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f088d7fa700 1 -- 172.21.15.81:0/1069883646 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555f8a6e3270 con 0x555f8a83a890 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f088d7fa700 1 -- 172.21.15.81:0/1069883646 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f08a00ca5e0 con 0x555f8a83a890 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08b7db9b80 10 client.15504 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08b7db9b80 10 client.15504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08b7db9b80 20 client.15504 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555f8a854210 0x555f8a856600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08b7db9b80 4 client.15504 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.739+0000 7f08b7db9b80 1 -- 172.21.15.81:0/1069883646 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f8a809810 con 0x555f8a854210 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.740+0000 7f08a919a700 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555f8a854210 0x555f8a856600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.740+0000 7f088d7fa700 10 client.15504 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.740+0000 7f08a919a700 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555f8a854210 0x555f8a856600 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d14d3083003d072 server_cookie=5d715ff586e1c3e9 in_seq=0 out_seq=0 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f088d7fa700 1 -- 172.21.15.81:0/1069883646 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555f8a809810 con 0x555f8a854210 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f088d7fa700 10 client.15504 handle_command_reply: tid=0 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f08b7db9b80 1 client.15504 shutdown 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f08b7db9b80 1 -- 172.21.15.81:0/1069883646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a83a890 msgr2=0x555f8a8468b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a83a890 0x555f8a8468b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f08a000d950 tx=0x7f08a0099ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f08b7db9b80 1 -- 172.21.15.81:0/1069883646 shutdown_connections 2024-05-09T00:03:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555f8a854210 0x555f8a856600 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840970 0x555f8a844270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a83a890 0x555f8a8468b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f088d7fa700 0 client.15504 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/1069883646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a840050 0x555f8a843b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f08b7db9b80 1 -- 172.21.15.81:0/1069883646 >> 172.21.15.81:0/1069883646 conn(0x555f8a798210 msgr2=0x555f8a8347b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f08b7db9b80 1 -- 172.21.15.81:0/1069883646 shutdown_connections 2024-05-09T00:03:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f08b7db9b80 1 -- 172.21.15.81:0/1069883646 wait complete. 2024-05-09T00:03:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.741+0000 7f08b7db9b80 20 client.15504 trim_cache size 0 max 16384 2024-05-09T00:03:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08b7db9b80 1 Processor -- start 2024-05-09T00:03:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08b7db9b80 1 -- start start 2024-05-09T00:03:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08b7db9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a83a890 0x555f8a8463e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08b7db9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840050 0x555f8a84b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08b7db9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a840970 0x555f8a84b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08b7db9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8a8420a0 con 0x555f8a840050 2024-05-09T00:03:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08b7db9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8a834390 con 0x555f8a840970 2024-05-09T00:03:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08b7db9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8a850640 con 0x555f8a83a890 2024-05-09T00:03:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08a919a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840050 0x555f8a84b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08a919a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840050 0x555f8a84b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57168/0 (socket says 172.21.15.81:57168) 2024-05-09T00:03:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08a919a700 1 -- 172.21.15.81:0/481374970 learned_addr learned my addr 172.21.15.81:0/481374970 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08a999b700 1 --2- 172.21.15.81:0/481374970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a83a890 0x555f8a8463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08a919a700 1 -- 172.21.15.81:0/481374970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a83a890 msgr2=0x555f8a8463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08aa19c700 1 --2- 172.21.15.81:0/481374970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a840970 0x555f8a84b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08a919a700 1 --2- 172.21.15.81:0/481374970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a83a890 0x555f8a8463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08a919a700 1 -- 172.21.15.81:0/481374970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a840970 msgr2=0x555f8a84b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08a919a700 1 --2- 172.21.15.81:0/481374970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a840970 0x555f8a84b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.758+0000 7f08a919a700 1 -- 172.21.15.81:0/481374970 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f8a750560 con 0x555f8a840050 2024-05-09T00:03:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.759+0000 7f08a999b700 1 --2- 172.21.15.81:0/481374970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a83a890 0x555f8a8463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.759+0000 7f08a919a700 1 --2- 172.21.15.81:0/481374970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840050 0x555f8a84b2a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f089400c010 tx=0x7f0894009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41d36c3637b597d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.759+0000 7f0898da4700 1 -- 172.21.15.81:0/481374970 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0894029040 con 0x555f8a840050 2024-05-09T00:03:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.759+0000 7f0898da4700 1 -- 172.21.15.81:0/481374970 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0894003c50 con 0x555f8a840050 2024-05-09T00:03:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.759+0000 7f0898da4700 1 -- 172.21.15.81:0/481374970 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08940397c0 con 0x555f8a840050 2024-05-09T00:03:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.759+0000 7f08b7db9b80 1 -- 172.21.15.81:0/481374970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840050 msgr2=0x555f8a84b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.759+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/481374970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840050 0x555f8a84b2a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f089400c010 tx=0x7f0894009290 comp rx=0 tx=0).stop 2024-05-09T00:03:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.759+0000 7f08b7db9b80 1 -- 172.21.15.81:0/481374970 shutdown_connections 2024-05-09T00:03:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.759+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/481374970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a840970 0x555f8a84b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.759+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/481374970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a83a890 0x555f8a8463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.759+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/481374970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840050 0x555f8a84b2a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.759+0000 7f08b7db9b80 1 -- 172.21.15.81:0/481374970 >> 172.21.15.81:0/481374970 conn(0x555f8a798210 msgr2=0x555f8a83dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.760+0000 7f08b7db9b80 1 -- 172.21.15.81:0/481374970 shutdown_connections 2024-05-09T00:03:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.760+0000 7f08b7db9b80 1 -- 172.21.15.81:0/481374970 wait complete. 2024-05-09T00:03:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.760+0000 7f08b7db9b80 1 -- start start 2024-05-09T00:03:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.760+0000 7f08b7db9b80 1 Processor -- start 2024-05-09T00:03:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.760+0000 7f08b7db9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a83a890 0x555f8a84b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.760+0000 7f08b7db9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840050 0x555f8a83cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.760+0000 7f08b7db9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840970 0x555f8a83d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.760+0000 7f08b7db9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8a83ba00 con 0x555f8a840970 2024-05-09T00:03:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.760+0000 7f08b7db9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8a83bb70 con 0x555f8a83a890 2024-05-09T00:03:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.760+0000 7f08b7db9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f8a83bd30 con 0x555f8a840050 2024-05-09T00:03:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.760+0000 7f08b7db9b80 10 client.0 _ll_register_callbacks cb 0x555f8a72fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.760+0000 7f08aa19c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840970 0x555f8a83d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.760+0000 7f08aa19c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840970 0x555f8a83d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57180/0 (socket says 172.21.15.81:57180) 2024-05-09T00:03:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f08aa19c700 1 -- 172.21.15.81:0/3432953322 learned_addr learned my addr 172.21.15.81:0/3432953322 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f08a919a700 1 --2- 172.21.15.81:0/3432953322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840050 0x555f8a83cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f08a999b700 1 --2- 172.21.15.81:0/3432953322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a83a890 0x555f8a84b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f08aa19c700 1 -- 172.21.15.81:0/3432953322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840050 msgr2=0x555f8a83cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f08aa19c700 1 --2- 172.21.15.81:0/3432953322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840050 0x555f8a83cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f08aa19c700 1 -- 172.21.15.81:0/3432953322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a83a890 msgr2=0x555f8a84b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f08aa19c700 1 --2- 172.21.15.81:0/3432953322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a83a890 0x555f8a84b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f08aa19c700 1 -- 172.21.15.81:0/3432953322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f8a60b3b0 con 0x555f8a840970 2024-05-09T00:03:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f08a999b700 1 --2- 172.21.15.81:0/3432953322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a83a890 0x555f8a84b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f08aa19c700 1 --2- 172.21.15.81:0/3432953322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840970 0x555f8a83d280 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f089c007fd0 tx=0x7f089c013ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f933268335823e44 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f088d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f088d7fa700 1 -- 172.21.15.81:0/3432953322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089c011ad0 con 0x555f8a840970 2024-05-09T00:03:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f088d7fa700 1 -- 172.21.15.81:0/3432953322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f089c011c30 con 0x555f8a840970 2024-05-09T00:03:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f08b7db9b80 1 -- 172.21.15.81:0/3432953322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f089401e040 con 0x555f8a840970 2024-05-09T00:03:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f088d7fa700 1 -- 172.21.15.81:0/3432953322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f089c011df0 con 0x555f8a840970 2024-05-09T00:03:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f08b7db9b80 10 client.15510 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f08b7db9b80 1 -- 172.21.15.81:0/3432953322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x555f8a60fcd0 con 0x555f8a840970 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.761+0000 7f088d7fa700 1 -- 172.21.15.81:0/3432953322 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f089401e040 con 0x555f8a840970 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f088d7fa700 1 -- 172.21.15.81:0/3432953322 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f089c01d020 con 0x555f8a840970 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f08b7db9b80 10 client.15510 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f08b7db9b80 10 client.15510 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f08b7db9b80 20 client.15510 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/3432953322 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555f8a8ab110 0x555f8a8ad530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f08b7db9b80 4 client.15510 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f08b7db9b80 1 -- 172.21.15.81:0/3432953322 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555f8a782ec0 con 0x555f8a8ab110 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f08a999b700 1 --2- 172.21.15.81:0/3432953322 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555f8a8ab110 0x555f8a8ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f08a999b700 1 --2- 172.21.15.81:0/3432953322 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555f8a8ab110 0x555f8a8ad530 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7637d14b3c3de3d5 server_cookie=921c41073173c270 in_seq=0 out_seq=0 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f088d7fa700 10 client.15510 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f088d7fa700 1 -- 172.21.15.81:0/3432953322 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555f8a782ec0 con 0x555f8a8ab110 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f088d7fa700 10 client.15510 handle_command_reply: tid=0 2024-05-09T00:03:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f08b7db9b80 1 client.15510 shutdown 2024-05-09T00:03:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f08b7db9b80 1 -- 172.21.15.81:0/3432953322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840970 msgr2=0x555f8a83d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.762+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/3432953322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840970 0x555f8a83d280 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f089c007fd0 tx=0x7f089c013ce0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08b7db9b80 1 -- 172.21.15.81:0/3432953322 shutdown_connections 2024-05-09T00:03:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/3432953322 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555f8a8ab110 0x555f8a8ad530 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/3432953322 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555f8a83a890 0x555f8a84b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f088d7fa700 0 client.15510 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/3432953322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555f8a840970 0x555f8a83d280 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08b7db9b80 1 --2- 172.21.15.81:0/3432953322 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555f8a840050 0x555f8a83cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08b7db9b80 1 -- 172.21.15.81:0/3432953322 >> 172.21.15.81:0/3432953322 conn(0x555f8a798210 msgr2=0x555f8a8347b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08b7db9b80 1 -- 172.21.15.81:0/3432953322 shutdown_connections 2024-05-09T00:03:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08b7db9b80 1 -- 172.21.15.81:0/3432953322 wait complete. 2024-05-09T00:03:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08b7db9b80 20 client.15510 trim_cache size 0 max 16384 2024-05-09T00:03:08.766 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:03:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:03:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:03:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: "3c3533cd-4605-425e-9014-2151bfb97d8c": { 2024-05-09T00:03:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:03:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "3c3533cd-4605-425e-9014-2151bfb97d8c", 2024-05-09T00:03:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:03:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:03:08.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:03:08.767 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:03:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08aa99d700 1 -- 172.21.15.81:0/3978523028 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f08900a13b0 msgr2=0x7f08900a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08aa99d700 1 --2- 172.21.15.81:0/3978523028 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f08900a13b0 0x7f08900a3870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08940098e0 tx=0x7f0894005960 comp rx=0 tx=0).stop 2024-05-09T00:03:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08aa99d700 1 -- 172.21.15.81:0/3978523028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a4101f80 msgr2=0x7f08a40ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08aa99d700 1 --2- 172.21.15.81:0/3978523028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a4101f80 0x7f08a40ffbd0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f08a000d980 tx=0x7f08a000dc90 comp rx=0 tx=0).stop 2024-05-09T00:03:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08aa99d700 1 -- 172.21.15.81:0/3978523028 shutdown_connections 2024-05-09T00:03:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08aa99d700 1 --2- 172.21.15.81:0/3978523028 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f08900a13b0 0x7f08900a3870 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08aa99d700 1 --2- 172.21.15.81:0/3978523028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08a410b350 0x7f08a4100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08aa99d700 1 --2- 172.21.15.81:0/3978523028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a4101f80 0x7f08a40ffbd0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08aa99d700 1 --2- 172.21.15.81:0/3978523028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f08a41028a0 0x7f08a4100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08aa99d700 1 -- 172.21.15.81:0/3978523028 >> 172.21.15.81:0/3978523028 conn(0x7f08a40fb760 msgr2=0x7f08a40fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08aa99d700 1 -- 172.21.15.81:0/3978523028 shutdown_connections 2024-05-09T00:03:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.763+0000 7f08aa99d700 1 -- 172.21.15.81:0/3978523028 wait complete. 2024-05-09T00:03:08.769 INFO:tasks.cephfs.filesystem:scrub status for tag:3c3533cd-4605-425e-9014-2151bfb97d8c - {'path': '/', 'tag': '3c3533cd-4605-425e-9014-2151bfb97d8c', 'options': 'recursive,force'} 2024-05-09T00:03:08.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.866+0000 7f5c2bcac700 1 -- 172.21.15.81:0/324279170 --> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c24198590 con 0x7f5c100a1430 2024-05-09T00:03:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.928+0000 7f5c1affd700 1 -- 172.21.15.81:0/324279170 <== mgr.15285 v2:172.21.15.81:6800/2111088526 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f5c24198590 con 0x7f5c100a1430 2024-05-09T00:03:08.922 INFO:teuthology.orchestra.run.smithi081.stdout:Schedule set for path / 2024-05-09T00:03:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.930+0000 7f5c2bcac700 1 -- 172.21.15.81:0/324279170 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5c100a1430 msgr2=0x7f5c100a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.930+0000 7f5c2bcac700 1 --2- 172.21.15.81:0/324279170 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5c100a1430 0x7f5c100a38f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5c20005950 tx=0x7f5c2000b410 comp rx=0 tx=0).stop 2024-05-09T00:03:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.930+0000 7f5c2bcac700 1 -- 172.21.15.81:0/324279170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c24068ca0 msgr2=0x7f5c24197820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.930+0000 7f5c2bcac700 1 --2- 172.21.15.81:0/324279170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c24068ca0 0x7f5c24197820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c140059d0 tx=0x7f5c14004730 comp rx=0 tx=0).stop 2024-05-09T00:03:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.931+0000 7f5c2bcac700 1 -- 172.21.15.81:0/324279170 shutdown_connections 2024-05-09T00:03:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.931+0000 7f5c2bcac700 1 --2- 172.21.15.81:0/324279170 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5c100a1430 0x7f5c100a38f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.931+0000 7f5c2bcac700 1 --2- 172.21.15.81:0/324279170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c24107000 0x7f5c2419bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.931+0000 7f5c2bcac700 1 --2- 172.21.15.81:0/324279170 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c240682e0 0x7f5c241972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.931+0000 7f5c2bcac700 1 --2- 172.21.15.81:0/324279170 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5c24068ca0 0x7f5c24197820 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.931+0000 7f5c2bcac700 1 -- 172.21.15.81:0/324279170 >> 172.21.15.81:0/324279170 conn(0x7f5c24076f10 msgr2=0x7f5c240febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.931+0000 7f5c2bcac700 1 -- 172.21.15.81:0/324279170 shutdown_connections 2024-05-09T00:03:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:08.931+0000 7f5c2bcac700 1 -- 172.21.15.81:0/324279170 wait complete. 2024-05-09T00:03:08.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-05-09T00:03:09.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 sudo[84363]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-09T00:03:09.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 sudo[84363]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-09T00:03:09.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 sudo[84363]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-09T00:03:09.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:08 smithi150 sudo[84363]: pam_unix(sudo:session): session closed for user root 2024-05-09T00:03:09.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.067+0000 7f2a5147a700 1 -- 172.21.15.81:0/4169131254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c105120 msgr2=0x7f2a4c10cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.067+0000 7f2a5147a700 1 --2- 172.21.15.81:0/4169131254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c105120 0x7f2a4c10cca0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400b0a0 tx=0x7f2a4400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.067+0000 7f2a5147a700 1 -- 172.21.15.81:0/4169131254 shutdown_connections 2024-05-09T00:03:09.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.067+0000 7f2a5147a700 1 --2- 172.21.15.81:0/4169131254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a4c100010 0x7f2a4c1003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.067+0000 7f2a5147a700 1 --2- 172.21.15.81:0/4169131254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c105120 0x7f2a4c10cca0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.067+0000 7f2a5147a700 1 --2- 172.21.15.81:0/4169131254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a4c1009c0 0x7f2a4c1049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.067+0000 7f2a5147a700 1 -- 172.21.15.81:0/4169131254 >> 172.21.15.81:0/4169131254 conn(0x7f2a4c076fd0 msgr2=0x7f2a4c0773e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:09.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.068+0000 7f2a5147a700 1 -- 172.21.15.81:0/4169131254 shutdown_connections 2024-05-09T00:03:09.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.068+0000 7f2a5147a700 1 -- 172.21.15.81:0/4169131254 wait complete. 2024-05-09T00:03:09.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.068+0000 7f2a5147a700 1 Processor -- start 2024-05-09T00:03:09.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.068+0000 7f2a5147a700 1 -- start start 2024-05-09T00:03:09.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.068+0000 7f2a5147a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a4c100010 0x7f2a4c197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:09.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.068+0000 7f2a5147a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a4c105120 0x7f2a4c1979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:09.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.068+0000 7f2a5147a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c19bd60 0x7f2a4c19c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:09.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.068+0000 7f2a5147a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c19c7e0 con 0x7f2a4c19bd60 2024-05-09T00:03:09.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.068+0000 7f2a5147a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c19c950 con 0x7f2a4c105120 2024-05-09T00:03:09.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.068+0000 7f2a5147a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c19cb10 con 0x7f2a4c100010 2024-05-09T00:03:09.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a4b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c19bd60 0x7f2a4c19c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:09.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a4b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c19bd60 0x7f2a4c19c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57202/0 (socket says 172.21.15.81:57202) 2024-05-09T00:03:09.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a4b7fe700 1 -- 172.21.15.81:0/2400828918 learned_addr learned my addr 172.21.15.81:0/2400828918 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:09.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a4a7fc700 1 --2- 172.21.15.81:0/2400828918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a4c105120 0x7f2a4c1979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:09.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a4b7fe700 1 -- 172.21.15.81:0/2400828918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a4c100010 msgr2=0x7f2a4c197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a4b7fe700 1 --2- 172.21.15.81:0/2400828918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a4c100010 0x7f2a4c197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a4b7fe700 1 -- 172.21.15.81:0/2400828918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a4c105120 msgr2=0x7f2a4c1979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a4b7fe700 1 --2- 172.21.15.81:0/2400828918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a4c105120 0x7f2a4c1979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a4b7fe700 1 -- 172.21.15.81:0/2400828918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44009d00 con 0x7f2a4c19bd60 2024-05-09T00:03:09.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a4a7fc700 1 --2- 172.21.15.81:0/2400828918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a4c105120 0x7f2a4c1979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:09.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a4b7fe700 1 --2- 172.21.15.81:0/2400828918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c19bd60 0x7f2a4c19c1e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2a44006130 tx=0x7f2a4400bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:09.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a33fff700 1 -- 172.21.15.81:0/2400828918 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400e040 con 0x7f2a4c19bd60 2024-05-09T00:03:09.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a33fff700 1 -- 172.21.15.81:0/2400828918 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a44007e50 con 0x7f2a4c19bd60 2024-05-09T00:03:09.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a5147a700 1 -- 172.21.15.81:0/2400828918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c1a4010 con 0x7f2a4c19bd60 2024-05-09T00:03:09.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a33fff700 1 -- 172.21.15.81:0/2400828918 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4401b6b0 con 0x7f2a4c19bd60 2024-05-09T00:03:09.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.069+0000 7f2a5147a700 1 -- 172.21.15.81:0/2400828918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c1a4490 con 0x7f2a4c19bd60 2024-05-09T00:03:09.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.070+0000 7f2a5147a700 1 -- 172.21.15.81:0/2400828918 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c109400 con 0x7f2a4c19bd60 2024-05-09T00:03:09.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.071+0000 7f2a33fff700 1 -- 172.21.15.81:0/2400828918 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f2a4401d480 con 0x7f2a4c19bd60 2024-05-09T00:03:09.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.072+0000 7f2a33fff700 1 --2- 172.21.15.81:0/2400828918 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2a340a13b0 0x7f2a340a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:09.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.072+0000 7f2a33fff700 1 -- 172.21.15.81:0/2400828918 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2a440cebb0 con 0x7f2a4c19bd60 2024-05-09T00:03:09.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.072+0000 7f2a4affd700 1 --2- 172.21.15.81:0/2400828918 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2a340a13b0 0x7f2a340a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:09.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.072+0000 7f2a4affd700 1 --2- 172.21.15.81:0/2400828918 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2a340a13b0 0x7f2a340a3870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c005950 tx=0x7f2a3c0058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:09.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.076+0000 7f2a33fff700 1 -- 172.21.15.81:0/2400828918 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2a44097e40 con 0x7f2a4c19bd60 2024-05-09T00:03:09.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.304+0000 7f2a5147a700 1 -- 172.21.15.81:0/2400828918 --> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a4c1987f0 con 0x7f2a340a13b0 2024-05-09T00:03:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.362+0000 7f2a33fff700 1 -- 172.21.15.81:0/2400828918 <== mgr.15285 v2:172.21.15.81:6800/2111088526 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f2a4c1987f0 con 0x7f2a340a13b0 2024-05-09T00:03:09.356 INFO:teuthology.orchestra.run.smithi081.stdout:Retention added to path / 2024-05-09T00:03:09.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.364+0000 7f2a5147a700 1 -- 172.21.15.81:0/2400828918 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2a340a13b0 msgr2=0x7f2a340a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.364+0000 7f2a5147a700 1 --2- 172.21.15.81:0/2400828918 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2a340a13b0 0x7f2a340a3870 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c005950 tx=0x7f2a3c0058e0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.364+0000 7f2a5147a700 1 -- 172.21.15.81:0/2400828918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c19bd60 msgr2=0x7f2a4c19c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.364+0000 7f2a5147a700 1 --2- 172.21.15.81:0/2400828918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c19bd60 0x7f2a4c19c1e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2a44006130 tx=0x7f2a4400bd80 comp rx=0 tx=0).stop 2024-05-09T00:03:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.364+0000 7f2a5147a700 1 -- 172.21.15.81:0/2400828918 shutdown_connections 2024-05-09T00:03:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.364+0000 7f2a5147a700 1 --2- 172.21.15.81:0/2400828918 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2a340a13b0 0x7f2a340a3870 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.364+0000 7f2a5147a700 1 --2- 172.21.15.81:0/2400828918 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4c19bd60 0x7f2a4c19c1e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.364+0000 7f2a5147a700 1 --2- 172.21.15.81:0/2400828918 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a4c100010 0x7f2a4c197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.364+0000 7f2a5147a700 1 --2- 172.21.15.81:0/2400828918 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a4c105120 0x7f2a4c1979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.364+0000 7f2a5147a700 1 -- 172.21.15.81:0/2400828918 >> 172.21.15.81:0/2400828918 conn(0x7f2a4c076fd0 msgr2=0x7f2a4c069a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.364+0000 7f2a5147a700 1 -- 172.21.15.81:0/2400828918 shutdown_connections 2024-05-09T00:03:09.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.364+0000 7f2a5147a700 1 -- 172.21.15.81:0/2400828918 wait complete. 2024-05-09T00:03:09.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-05-09T00:03:09.394 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:09 smithi081 ceph-mon[42474]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:03:09.394 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:09 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/535464955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:03:09.394 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:09 smithi081 ceph-mon[42474]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:03:09.395 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:09 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:03:09.395 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:09 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:03:09.395 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:09 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:03:09.395 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:09 smithi081 ceph-mon[42474]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:03:09.395 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:09 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:03:09.395 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:09 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:03:09.395 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:09 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:03:09.395 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:09 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2321642049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:09.395 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:09 smithi081 ceph-mon[42474]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:03:09.395 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:09 smithi081 ceph-mon[42474]: from='client.25025 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:09.395 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:09 smithi081 ceph-mon[42474]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 132 KiB/s wr, 29 op/s 2024-05-09T00:03:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.499+0000 7f01ede88700 1 -- 172.21.15.81:0/2859926903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e80ffda0 msgr2=0x7f01e8100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.499+0000 7f01ede88700 1 --2- 172.21.15.81:0/2859926903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e80ffda0 0x7f01e8100220 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009990 tx=0x7f01d8009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.499+0000 7f01ede88700 1 -- 172.21.15.81:0/2859926903 shutdown_connections 2024-05-09T00:03:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.499+0000 7f01ede88700 1 --2- 172.21.15.81:0/2859926903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e8105e60 0x7f01e8106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.499+0000 7f01ede88700 1 --2- 172.21.15.81:0/2859926903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01e8100760 0x7f01e810cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.499+0000 7f01ede88700 1 --2- 172.21.15.81:0/2859926903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e80ffda0 0x7f01e8100220 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.499+0000 7f01ede88700 1 -- 172.21.15.81:0/2859926903 >> 172.21.15.81:0/2859926903 conn(0x7f01e8076f10 msgr2=0x7f01e8077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.499+0000 7f01ede88700 1 -- 172.21.15.81:0/2859926903 shutdown_connections 2024-05-09T00:03:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.499+0000 7f01ede88700 1 -- 172.21.15.81:0/2859926903 wait complete. 2024-05-09T00:03:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01ede88700 1 Processor -- start 2024-05-09T00:03:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01ede88700 1 -- start start 2024-05-09T00:03:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01ede88700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01e80ffda0 0x7f01e8197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01ede88700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e8100760 0x7f01e81978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01ede88700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e8105e60 0x7f01e819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01ede88700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e819c280 con 0x7f01e8105e60 2024-05-09T00:03:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01ede88700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e819c3f0 con 0x7f01e8100760 2024-05-09T00:03:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01ede88700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e819c5b0 con 0x7f01e80ffda0 2024-05-09T00:03:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e8105e60 0x7f01e819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01e7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e8105e60 0x7f01e819bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57218/0 (socket says 172.21.15.81:57218) 2024-05-09T00:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01e7fff700 1 -- 172.21.15.81:0/3091314136 learned_addr learned my addr 172.21.15.81:0/3091314136 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01e6ffd700 1 --2- 172.21.15.81:0/3091314136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e8100760 0x7f01e81978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01e77fe700 1 --2- 172.21.15.81:0/3091314136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01e80ffda0 0x7f01e8197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01e7fff700 1 -- 172.21.15.81:0/3091314136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01e80ffda0 msgr2=0x7f01e8197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01e7fff700 1 --2- 172.21.15.81:0/3091314136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01e80ffda0 0x7f01e8197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01e7fff700 1 -- 172.21.15.81:0/3091314136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e8100760 msgr2=0x7f01e81978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01e7fff700 1 --2- 172.21.15.81:0/3091314136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e8100760 0x7f01e81978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.500+0000 7f01e7fff700 1 -- 172.21.15.81:0/3091314136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d80095f0 con 0x7f01e8105e60 2024-05-09T00:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.501+0000 7f01e7fff700 1 --2- 172.21.15.81:0/3091314136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e8105e60 0x7f01e819bc40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f01e000b970 tx=0x7f01e000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.501+0000 7f01e4ff9700 1 -- 172.21.15.81:0/3091314136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e000d860 con 0x7f01e8105e60 2024-05-09T00:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.501+0000 7f01e4ff9700 1 -- 172.21.15.81:0/3091314136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01e000de80 con 0x7f01e8105e60 2024-05-09T00:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.501+0000 7f01ede88700 1 -- 172.21.15.81:0/3091314136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e819c890 con 0x7f01e8105e60 2024-05-09T00:03:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.501+0000 7f01e4ff9700 1 -- 172.21.15.81:0/3091314136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0017400 con 0x7f01e8105e60 2024-05-09T00:03:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.501+0000 7f01ede88700 1 -- 172.21.15.81:0/3091314136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e81a40d0 con 0x7f01e8105e60 2024-05-09T00:03:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.502+0000 7f01ede88700 1 -- 172.21.15.81:0/3091314136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e8101490 con 0x7f01e8105e60 2024-05-09T00:03:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.503+0000 7f01e4ff9700 1 -- 172.21.15.81:0/3091314136 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f01e000e630 con 0x7f01e8105e60 2024-05-09T00:03:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.503+0000 7f01e4ff9700 1 --2- 172.21.15.81:0/3091314136 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f01d00a13b0 0x7f01d00a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.503+0000 7f01e77fe700 1 --2- 172.21.15.81:0/3091314136 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f01d00a13b0 0x7f01d00a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.503+0000 7f01e4ff9700 1 -- 172.21.15.81:0/3091314136 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f01e0006e40 con 0x7f01e8105e60 2024-05-09T00:03:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.504+0000 7f01e77fe700 1 --2- 172.21.15.81:0/3091314136 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f01d00a13b0 0x7f01d00a3870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f01dc005950 tx=0x7f01dc00b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:09.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.508+0000 7f01e4ff9700 1 -- 172.21.15.81:0/3091314136 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f01e0095dd0 con 0x7f01e8105e60 2024-05-09T00:03:09.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:09 smithi150 ceph-mon[46187]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:03:09.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:09 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/535464955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:03:09.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:09 smithi150 ceph-mon[46187]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:03:09.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:09 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:03:09.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:09 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:03:09.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:09 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:03:09.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:09 smithi150 ceph-mon[46187]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:03:09.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:09 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:03:09.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:09 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:03:09.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:09 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:03:09.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:09 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2321642049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:09.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:09 smithi150 ceph-mon[46187]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:03:09.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:09 smithi150 ceph-mon[46187]: from='client.25025 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:09.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:09 smithi150 ceph-mon[46187]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 132 KiB/s wr, 29 op/s 2024-05-09T00:03:09.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:09 smithi171 ceph-mon[47351]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:03:09.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:09 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/535464955' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:03:09.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:09 smithi171 ceph-mon[47351]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:03:09.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:09 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:03:09.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:09 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:03:09.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:09 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:03:09.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:09 smithi171 ceph-mon[47351]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-09T00:03:09.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:09 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-09T00:03:09.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:09 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-09T00:03:09.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:09 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-09T00:03:09.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:09 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2321642049' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:03:09.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:09 smithi171 ceph-mon[47351]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-09T00:03:09.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:09 smithi171 ceph-mon[47351]: from='client.25025 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:09.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:09 smithi171 ceph-mon[47351]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 132 KiB/s wr, 29 op/s 2024-05-09T00:03:09.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.730+0000 7f01ede88700 1 -- 172.21.15.81:0/3091314136 --> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f01e8198770 con 0x7f01d00a13b0 2024-05-09T00:03:09.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.738+0000 7f01e4ff9700 1 -- 172.21.15.81:0/3091314136 <== mgr.15285 v2:172.21.15.81:6800/2111088526 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+298 (secure 0 0 0) 0x7f01e8198770 con 0x7f01d00a13b0 2024-05-09T00:03:09.769 INFO:teuthology.orchestra.run.smithi081.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-05-09T00:00:00", "created": "2024-05-09T00:03:08", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-05-09T00:03:09.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.740+0000 7f01ede88700 1 -- 172.21.15.81:0/3091314136 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f01d00a13b0 msgr2=0x7f01d00a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.740+0000 7f01ede88700 1 --2- 172.21.15.81:0/3091314136 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f01d00a13b0 0x7f01d00a3870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f01dc005950 tx=0x7f01dc00b410 comp rx=0 tx=0).stop 2024-05-09T00:03:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.740+0000 7f01ede88700 1 -- 172.21.15.81:0/3091314136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e8105e60 msgr2=0x7f01e819bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.740+0000 7f01ede88700 1 --2- 172.21.15.81:0/3091314136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e8105e60 0x7f01e819bc40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f01e000b970 tx=0x7f01e000bc80 comp rx=0 tx=0).stop 2024-05-09T00:03:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.741+0000 7f01ede88700 1 -- 172.21.15.81:0/3091314136 shutdown_connections 2024-05-09T00:03:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.741+0000 7f01ede88700 1 --2- 172.21.15.81:0/3091314136 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f01d00a13b0 0x7f01d00a3870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.741+0000 7f01ede88700 1 --2- 172.21.15.81:0/3091314136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01e8105e60 0x7f01e819bc40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.741+0000 7f01ede88700 1 --2- 172.21.15.81:0/3091314136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f01e80ffda0 0x7f01e8197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.741+0000 7f01ede88700 1 --2- 172.21.15.81:0/3091314136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f01e8100760 0x7f01e81978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.741+0000 7f01ede88700 1 -- 172.21.15.81:0/3091314136 >> 172.21.15.81:0/3091314136 conn(0x7f01e8076f10 msgr2=0x7f01e8068620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.741+0000 7f01ede88700 1 -- 172.21.15.81:0/3091314136 shutdown_connections 2024-05-09T00:03:09.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.741+0000 7f01ede88700 1 -- 172.21.15.81:0/3091314136 wait complete. 2024-05-09T00:03:09.771 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-05-09T00:03:09.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.942+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/3172155959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf00ff410 msgr2=0x7f5cf00ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.942+0000 7f5cf6c7c700 1 --2- 172.21.15.81:0/3172155959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf00ff410 0x7f5cf00ff890 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0099c0 tx=0x7f5cdc009cd0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.942+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/3172155959 shutdown_connections 2024-05-09T00:03:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.942+0000 7f5cf6c7c700 1 --2- 172.21.15.81:0/3172155959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cf00ffdd0 0x7f5cf010dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.942+0000 7f5cf6c7c700 1 --2- 172.21.15.81:0/3172155959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf0107020 0x7f5cf0107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.942+0000 7f5cf6c7c700 1 --2- 172.21.15.81:0/3172155959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf00ff410 0x7f5cf00ff890 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.943+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/3172155959 >> 172.21.15.81:0/3172155959 conn(0x7f5cf00763a0 msgr2=0x7f5cf00fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.943+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/3172155959 shutdown_connections 2024-05-09T00:03:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.943+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/3172155959 wait complete. 2024-05-09T00:03:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.943+0000 7f5cf6c7c700 1 Processor -- start 2024-05-09T00:03:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.943+0000 7f5cf6c7c700 1 -- start start 2024-05-09T00:03:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.943+0000 7f5cf6c7c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cf00ff410 0x7f5cf01005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:09.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.943+0000 7f5cf6c7c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf00ffdd0 0x7f5cf0100b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.943+0000 7f5cf6c7c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf0107020 0x7f5cf0101070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.943+0000 7f5cf6c7c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01a57e0 con 0x7f5cf00ffdd0 2024-05-09T00:03:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.943+0000 7f5cf6c7c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01a5950 con 0x7f5cf00ff410 2024-05-09T00:03:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.943+0000 7f5cf6c7c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01a5b10 con 0x7f5cf0107020 2024-05-09T00:03:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.943+0000 7f5ceffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf00ffdd0 0x7f5cf0100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5ceffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf00ffdd0 0x7f5cf0100b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57232/0 (socket says 172.21.15.81:57232) 2024-05-09T00:03:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5ceffff700 1 -- 172.21.15.81:0/4122003983 learned_addr learned my addr 172.21.15.81:0/4122003983 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5cf4a18700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cf00ff410 0x7f5cf01005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5cf5219700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf0107020 0x7f5cf0101070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5ceffff700 1 -- 172.21.15.81:0/4122003983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf0107020 msgr2=0x7f5cf0101070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5ceffff700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf0107020 0x7f5cf0101070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5ceffff700 1 -- 172.21.15.81:0/4122003983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cf00ff410 msgr2=0x7f5cf01005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:09.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5ceffff700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cf00ff410 0x7f5cf01005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:09.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5ceffff700 1 -- 172.21.15.81:0/4122003983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc0095f0 con 0x7f5cf00ffdd0 2024-05-09T00:03:09.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5cf5219700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf0107020 0x7f5cf0101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:09.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5ceffff700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf00ffdd0 0x7f5cf0100b30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c010 tx=0x7f5cdc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:09.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5cedffb700 1 -- 172.21.15.81:0/4122003983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc01c070 con 0x7f5cf00ffdd0 2024-05-09T00:03:09.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5cedffb700 1 -- 172.21.15.81:0/4122003983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5cdc00fe60 con 0x7f5cf00ffdd0 2024-05-09T00:03:09.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/4122003983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf01a5d90 con 0x7f5cf00ffdd0 2024-05-09T00:03:09.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5cedffb700 1 -- 172.21.15.81:0/4122003983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc022d80 con 0x7f5cf00ffdd0 2024-05-09T00:03:09.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.944+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/4122003983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf01a61b0 con 0x7f5cf00ffdd0 2024-05-09T00:03:09.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.945+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/4122003983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf0109530 con 0x7f5cf00ffdd0 2024-05-09T00:03:09.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.946+0000 7f5cedffb700 1 -- 172.21.15.81:0/4122003983 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f5cdc020070 con 0x7f5cf00ffdd0 2024-05-09T00:03:09.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.947+0000 7f5cedffb700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5ce00a13b0 0x7f5ce00a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.947+0000 7f5cf4a18700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5ce00a13b0 0x7f5ce00a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.947+0000 7f5cedffb700 1 -- 172.21.15.81:0/4122003983 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f5cdc0cde60 con 0x7f5cf00ffdd0 2024-05-09T00:03:09.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.947+0000 7f5cf4a18700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5ce00a13b0 0x7f5ce00a3870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009be0 tx=0x7f5ce4009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:09.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:09.951+0000 7f5cedffb700 1 -- 172.21.15.81:0/4122003983 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5cdc0971d0 con 0x7f5cf00ffdd0 2024-05-09T00:03:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:10.174+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/4122003983 --> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f5cf0102710 con 0x7f5ce00a13b0 2024-05-09T00:03:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:10.181+0000 7f5cedffb700 1 -- 172.21.15.81:0/4122003983 <== mgr.15285 v2:172.21.15.81:6800/2111088526 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f5cf0102710 con 0x7f5ce00a13b0 2024-05-09T00:03:10.175 INFO:teuthology.orchestra.run.smithi081.stdout:/ 1m 6m3h 2024-05-09T00:03:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:10.183+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/4122003983 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5ce00a13b0 msgr2=0x7f5ce00a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:10.183+0000 7f5cf6c7c700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5ce00a13b0 0x7f5ce00a3870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4009be0 tx=0x7f5ce4009260 comp rx=0 tx=0).stop 2024-05-09T00:03:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:10.183+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/4122003983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf00ffdd0 msgr2=0x7f5cf0100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:10.183+0000 7f5cf6c7c700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf00ffdd0 0x7f5cf0100b30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c010 tx=0x7f5cdc00f690 comp rx=0 tx=0).stop 2024-05-09T00:03:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:10.183+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/4122003983 shutdown_connections 2024-05-09T00:03:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:10.183+0000 7f5cf6c7c700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5ce00a13b0 0x7f5ce00a3870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:10.183+0000 7f5cf6c7c700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cf00ff410 0x7f5cf01005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:10.183+0000 7f5cf6c7c700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf0107020 0x7f5cf0101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:10.183+0000 7f5cf6c7c700 1 --2- 172.21.15.81:0/4122003983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf00ffdd0 0x7f5cf0100b30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:10.183+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/4122003983 >> 172.21.15.81:0/4122003983 conn(0x7f5cf00763a0 msgr2=0x7f5cf0103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:10.183+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/4122003983 shutdown_connections 2024-05-09T00:03:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:10.183+0000 7f5cf6c7c700 1 -- 172.21.15.81:0/4122003983 wait complete. 2024-05-09T00:03:10.190 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-05-09T00:03:10.218 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-05-09T00:03:10.230 INFO:teuthology.run_tasks:Running task background_exec... 2024-05-09T00:03:10.250 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-05-09T00:03:10.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-05-09T00:03:10.261 INFO:teuthology.run_tasks:Running task workunit... 2024-05-09T00:03:10.278 INFO:tasks.workunit:Pulling workunits from ref d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-09T00:03:10.278 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-09T00:03:10.278 INFO:tasks.workunit:timeout=3h 2024-05-09T00:03:10.278 INFO:tasks.workunit:cleanup=True 2024-05-09T00:03:10.279 DEBUG:teuthology.orchestra.run.smithi081:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-09T00:03:10.296 INFO:teuthology.orchestra.run.smithi081.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-09T00:03:10.296 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-09T00:03:10.297 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 7ch/124d Inode: 1099511628283 Links: 2 2024-05-09T00:03:10.297 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-09T00:03:10.297 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:cephfs_t:s0 2024-05-09T00:03:10.297 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-05-09 00:01:51.640624910 +0000 2024-05-09T00:03:10.297 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-05-09 00:01:51.640624910 +0000 2024-05-09T00:03:10.297 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-05-09 00:02:58.942520936 +0000 2024-05-09T00:03:10.297 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-05-09 00:01:51.640624910 +0000 2024-05-09T00:03:10.297 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-09T00:03:10.297 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-09T00:03:10.370 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-09T00:03:10.427 INFO:tasks.workunit.client.0.smithi081.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-09T00:03:10.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:10 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:03:10.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:10 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:03:10.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:10 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:03:10.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:10 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:03:10.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:10 smithi150 ceph-mon[46187]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:10.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:10 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:03:10.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:10 smithi150 ceph-mon[46187]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:10.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:10 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:03:10.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:10 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:03:10.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:10 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:03:10.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:10 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:03:10.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:10 smithi171 ceph-mon[47351]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:10.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:10 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:03:10.553 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:10 smithi171 ceph-mon[47351]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:10.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:10 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:03:10.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:10 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:03:10.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:10 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:03:10.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:10 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:03:10.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:10 smithi081 ceph-mon[42474]: from='client.15516 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:10.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:10 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:03:10.620 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:10 smithi081 ceph-mon[42474]: from='client.15522 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:11.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:11 smithi150 ceph-mon[46187]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:11.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:11 smithi150 ceph-mon[46187]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 215 KiB/s wr, 62 op/s 2024-05-09T00:03:11.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:11 smithi171 ceph-mon[47351]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:11.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:11 smithi171 ceph-mon[47351]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 215 KiB/s wr, 62 op/s 2024-05-09T00:03:11.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:11 smithi081 ceph-mon[42474]: from='client.15528 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:03:11.619 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:11 smithi081 ceph-mon[42474]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 215 KiB/s wr, 62 op/s 2024-05-09T00:03:13.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:12 smithi150 ceph-mon[46187]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 197 KiB/s wr, 57 op/s 2024-05-09T00:03:13.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:12 smithi171 ceph-mon[47351]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 197 KiB/s wr, 57 op/s 2024-05-09T00:03:13.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:12 smithi081 ceph-mon[42474]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 197 KiB/s wr, 57 op/s 2024-05-09T00:03:15.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:14 smithi150 ceph-mon[46187]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 197 KiB/s wr, 57 op/s 2024-05-09T00:03:15.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:14 smithi171 ceph-mon[47351]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 197 KiB/s wr, 57 op/s 2024-05-09T00:03:15.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:14 smithi081 ceph-mon[42474]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 197 KiB/s wr, 57 op/s 2024-05-09T00:03:17.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:16 smithi150 ceph-mon[46187]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 197 KiB/s wr, 61 op/s 2024-05-09T00:03:17.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:16 smithi171 ceph-mon[47351]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 197 KiB/s wr, 61 op/s 2024-05-09T00:03:17.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:16 smithi081 ceph-mon[42474]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 197 KiB/s wr, 61 op/s 2024-05-09T00:03:19.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:18 smithi150 ceph-mon[46187]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 99 KiB/s wr, 39 op/s 2024-05-09T00:03:19.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:18 smithi171 ceph-mon[47351]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 99 KiB/s wr, 39 op/s 2024-05-09T00:03:19.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:18 smithi081 ceph-mon[42474]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 99 KiB/s wr, 39 op/s 2024-05-09T00:03:21.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:20 smithi150 ceph-mon[46187]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 99 KiB/s wr, 41 op/s 2024-05-09T00:03:21.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:20 smithi171 ceph-mon[47351]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 99 KiB/s wr, 41 op/s 2024-05-09T00:03:21.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:20 smithi081 ceph-mon[42474]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 99 KiB/s wr, 41 op/s 2024-05-09T00:03:23.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:22 smithi150 ceph-mon[46187]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-09T00:03:23.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:22 smithi171 ceph-mon[47351]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-09T00:03:23.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:22 smithi081 ceph-mon[42474]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-09T00:03:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.431+0000 7f4619c43700 1 -- 172.21.15.81:0/580038400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614107000 msgr2=0x7f46141073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.431+0000 7f4619c43700 1 --2- 172.21.15.81:0/580038400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614107000 0x7f46141073e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4604009990 tx=0x7f4604009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.431+0000 7f4619c43700 1 -- 172.21.15.81:0/580038400 shutdown_connections 2024-05-09T00:03:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.431+0000 7f4619c43700 1 --2- 172.21.15.81:0/580038400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4614068ca0 0x7f461410dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.431+0000 7f4619c43700 1 --2- 172.21.15.81:0/580038400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614107000 0x7f46141073e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.431+0000 7f4619c43700 1 --2- 172.21.15.81:0/580038400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46140682e0 0x7f4614068760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.431+0000 7f4619c43700 1 -- 172.21.15.81:0/580038400 >> 172.21.15.81:0/580038400 conn(0x7f4614076f10 msgr2=0x7f4614077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.431+0000 7f4619c43700 1 -- 172.21.15.81:0/580038400 shutdown_connections 2024-05-09T00:03:23.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.431+0000 7f4619c43700 1 -- 172.21.15.81:0/580038400 wait complete. 2024-05-09T00:03:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.432+0000 7f4619c43700 1 Processor -- start 2024-05-09T00:03:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.432+0000 7f4619c43700 1 -- start start 2024-05-09T00:03:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.432+0000 7f4619c43700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46140682e0 0x7f46141995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.432+0000 7f4619c43700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4614068ca0 0x7f4614199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.432+0000 7f4619c43700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614107000 0x7f461419de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.432+0000 7f4619c43700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461419e4d0 con 0x7f4614107000 2024-05-09T00:03:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.432+0000 7f4619c43700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461419e640 con 0x7f4614068ca0 2024-05-09T00:03:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.432+0000 7f4619c43700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461419e800 con 0x7f46140682e0 2024-05-09T00:03:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4613fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614107000 0x7f461419de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4613fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614107000 0x7f461419de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47090/0 (socket says 172.21.15.81:47090) 2024-05-09T00:03:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4613fff700 1 -- 172.21.15.81:0/1157530303 learned_addr learned my addr 172.21.15.81:0/1157530303 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f46137fe700 1 --2- 172.21.15.81:0/1157530303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46140682e0 0x7f46141995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4612ffd700 1 --2- 172.21.15.81:0/1157530303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4614068ca0 0x7f4614199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4613fff700 1 -- 172.21.15.81:0/1157530303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46140682e0 msgr2=0x7f46141995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4613fff700 1 --2- 172.21.15.81:0/1157530303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46140682e0 0x7f46141995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4613fff700 1 -- 172.21.15.81:0/1157530303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4614068ca0 msgr2=0x7f4614199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4613fff700 1 --2- 172.21.15.81:0/1157530303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4614068ca0 0x7f4614199af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4613fff700 1 -- 172.21.15.81:0/1157530303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46040095f0 con 0x7f4614107000 2024-05-09T00:03:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4613fff700 1 --2- 172.21.15.81:0/1157530303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614107000 0x7f461419de90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f460c00b970 tx=0x7f460c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4610ff9700 1 -- 172.21.15.81:0/1157530303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c00c9b0 con 0x7f4614107000 2024-05-09T00:03:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4619c43700 1 -- 172.21.15.81:0/1157530303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461419eae0 con 0x7f4614107000 2024-05-09T00:03:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4610ff9700 1 -- 172.21.15.81:0/1157530303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f460c014440 con 0x7f4614107000 2024-05-09T00:03:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4610ff9700 1 -- 172.21.15.81:0/1157530303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c0075d0 con 0x7f4614107000 2024-05-09T00:03:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.433+0000 7f4619c43700 1 -- 172.21.15.81:0/1157530303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46141a6320 con 0x7f4614107000 2024-05-09T00:03:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.435+0000 7f4610ff9700 1 -- 172.21.15.81:0/1157530303 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f460c0145b0 con 0x7f4614107000 2024-05-09T00:03:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.436+0000 7f4610ff9700 1 --2- 172.21.15.81:0/1157530303 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f45fc0a13b0 0x7f45fc0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.436+0000 7f46137fe700 1 --2- 172.21.15.81:0/1157530303 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f45fc0a13b0 0x7f45fc0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.436+0000 7f4610ff9700 1 -- 172.21.15.81:0/1157530303 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f460c006e40 con 0x7f4614107000 2024-05-09T00:03:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.436+0000 7f46137fe700 1 --2- 172.21.15.81:0/1157530303 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f45fc0a13b0 0x7f45fc0a3870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4604006010 tx=0x7f460400b540 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4625dfdb80 1 Processor -- start 2024-05-09T00:03:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4625dfdb80 1 -- start start 2024-05-09T00:03:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4625dfdb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559537873950 0x559537873d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4625dfdb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 0x55953786df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4625dfdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55953786e480 0x55953786e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4625dfdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595377c50f0 con 0x55953786e480 2024-05-09T00:03:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4625dfdb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595377c2ab0 con 0x559537873950 2024-05-09T00:03:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4625dfdb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595377be3a0 con 0x559537874270 2024-05-09T00:03:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4613fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55953786e480 0x55953786e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4613fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55953786e480 0x55953786e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47096/0 (socket says 172.21.15.81:47096) 2024-05-09T00:03:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4613fff700 1 -- 172.21.15.81:0/602899029 learned_addr learned my addr 172.21.15.81:0/602899029 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f46137fe700 1 --2- 172.21.15.81:0/602899029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559537873950 0x559537873d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4612ffd700 1 --2- 172.21.15.81:0/602899029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 0x55953786df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4613fff700 1 -- 172.21.15.81:0/602899029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 msgr2=0x55953786df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4613fff700 1 --2- 172.21.15.81:0/602899029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 0x55953786df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4613fff700 1 -- 172.21.15.81:0/602899029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559537873950 msgr2=0x559537873d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4613fff700 1 --2- 172.21.15.81:0/602899029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559537873950 0x559537873d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.437+0000 7f4613fff700 1 -- 172.21.15.81:0/602899029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55953763f350 con 0x55953786e480 2024-05-09T00:03:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.438+0000 7f4613fff700 1 --2- 172.21.15.81:0/602899029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55953786e480 0x55953786e8a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f460c099300 tx=0x7f460c098f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1450810c914f099a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.438+0000 7f45f9ffb700 1 -- 172.21.15.81:0/602899029 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c099600 con 0x55953786e480 2024-05-09T00:03:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.438+0000 7f45f9ffb700 1 -- 172.21.15.81:0/602899029 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f460c09d430 con 0x55953786e480 2024-05-09T00:03:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.438+0000 7f45f9ffb700 1 -- 172.21.15.81:0/602899029 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c0149f0 con 0x55953786e480 2024-05-09T00:03:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.438+0000 7f4625dfdb80 1 -- 172.21.15.81:0/602899029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55953786e480 msgr2=0x55953786e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.438+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/602899029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55953786e480 0x55953786e8a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f460c099300 tx=0x7f460c098f60 comp rx=0 tx=0).stop 2024-05-09T00:03:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.439+0000 7f4625dfdb80 1 -- 172.21.15.81:0/602899029 shutdown_connections 2024-05-09T00:03:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.439+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/602899029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559537873950 0x559537873d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.439+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/602899029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55953786e480 0x55953786e8a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.439+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/602899029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 0x55953786df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.439+0000 7f4625dfdb80 1 -- 172.21.15.81:0/602899029 >> 172.21.15.81:0/602899029 conn(0x5595377cc1b0 msgr2=0x559537868840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.439+0000 7f4625dfdb80 1 -- 172.21.15.81:0/602899029 shutdown_connections 2024-05-09T00:03:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.439+0000 7f4625dfdb80 1 -- 172.21.15.81:0/602899029 wait complete. 2024-05-09T00:03:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.439+0000 7f4625dfdb80 1 -- start start 2024-05-09T00:03:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.439+0000 7f4625dfdb80 1 Processor -- start 2024-05-09T00:03:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4625dfdb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 0x5595378775d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4625dfdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537873950 0x559537877b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4625dfdb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 0x559537878050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4625dfdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55953775a500 con 0x559537873950 2024-05-09T00:03:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4625dfdb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55953775a1a0 con 0x55953786e480 2024-05-09T00:03:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4625dfdb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559537641640 con 0x559537874270 2024-05-09T00:03:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4625dfdb80 10 client.0 _ll_register_callbacks cb 0x559537763ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4612ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537873950 0x559537877b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4612ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537873950 0x559537877b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47104/0 (socket says 172.21.15.81:47104) 2024-05-09T00:03:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4612ffd700 1 -- 172.21.15.81:0/1079248963 learned_addr learned my addr 172.21.15.81:0/1079248963 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f46137fe700 1 --2- 172.21.15.81:0/1079248963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 0x5595378775d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4612ffd700 1 -- 172.21.15.81:0/1079248963 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 msgr2=0x559537878050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4612ffd700 1 --2- 172.21.15.81:0/1079248963 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 0x559537878050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4612ffd700 1 -- 172.21.15.81:0/1079248963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 msgr2=0x5595378775d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4612ffd700 1 --2- 172.21.15.81:0/1079248963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 0x5595378775d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4612ffd700 1 -- 172.21.15.81:0/1079248963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46141a6320 con 0x559537873950 2024-05-09T00:03:23.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4612ffd700 1 --2- 172.21.15.81:0/1079248963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537873950 0x559537877b10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f460800e2f0 tx=0x7f460800e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2790fcbe213ef4ce server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f45f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f45f2ffd700 1 -- 172.21.15.81:0/1079248963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4608013450 con 0x559537873950 2024-05-09T00:03:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f45f2ffd700 1 -- 172.21.15.81:0/1079248963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f46080135b0 con 0x559537873950 2024-05-09T00:03:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1079248963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559537717210 con 0x559537873950 2024-05-09T00:03:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.440+0000 7f45f2ffd700 1 -- 172.21.15.81:0/1079248963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4608013770 con 0x559537873950 2024-05-09T00:03:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.441+0000 7f4625dfdb80 10 client.15540 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:23.450 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.441+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1079248963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5595375ebb00 con 0x559537873950 2024-05-09T00:03:23.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.441+0000 7f45f2ffd700 1 -- 172.21.15.81:0/1079248963 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559537717210 con 0x559537873950 2024-05-09T00:03:23.451 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.441+0000 7f45f2ffd700 1 -- 172.21.15.81:0/1079248963 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4608011070 con 0x559537873950 2024-05-09T00:03:23.453 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.441+0000 7f4625dfdb80 10 client.15540 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:23.453 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.441+0000 7f4625dfdb80 10 client.15540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.441+0000 7f4625dfdb80 20 client.15540 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.441+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/1079248963 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559537887d00 0x55953788a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.441+0000 7f4625dfdb80 4 client.15540 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:03:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.441+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1079248963 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55953783d7b0 con 0x559537887d00 2024-05-09T00:03:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.441+0000 7f46137fe700 1 --2- 172.21.15.81:0/1079248963 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559537887d00 0x55953788a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.454 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f46137fe700 1 --2- 172.21.15.81:0/1079248963 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559537887d00 0x55953788a120 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c89b49027342c07c server_cookie=728e8a5e8e041891 in_seq=0 out_seq=0 2024-05-09T00:03:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f45f2ffd700 10 client.15540 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f45f2ffd700 1 -- 172.21.15.81:0/1079248963 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55953783d7b0 con 0x559537887d00 2024-05-09T00:03:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f45f2ffd700 10 client.15540 handle_command_reply: tid=0 2024-05-09T00:03:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f4625dfdb80 1 client.15540 shutdown 2024-05-09T00:03:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1079248963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537873950 msgr2=0x559537877b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:23.455 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/1079248963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537873950 0x559537877b10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f460800e2f0 tx=0x7f460800e6b0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1079248963 shutdown_connections 2024-05-09T00:03:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/1079248963 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559537887d00 0x55953788a120 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/1079248963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 0x5595378775d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/1079248963 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 0x559537878050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f45f2ffd700 0 client.15540 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/1079248963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537873950 0x559537877b10 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1079248963 >> 172.21.15.81:0/1079248963 conn(0x5595377cc1b0 msgr2=0x559537871460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.442+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1079248963 shutdown_connections 2024-05-09T00:03:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.443+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1079248963 wait complete. 2024-05-09T00:03:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.443+0000 7f4625dfdb80 20 client.15540 trim_cache size 0 max 16384 2024-05-09T00:03:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.457+0000 7f4625dfdb80 1 Processor -- start 2024-05-09T00:03:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.457+0000 7f4625dfdb80 1 -- start start 2024-05-09T00:03:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.457+0000 7f4625dfdb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 0x559537868910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.457+0000 7f4625dfdb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537873950 0x55953786e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.457+0000 7f4625dfdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537874270 0x55953786dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f4625dfdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55953786d1c0 con 0x559537874270 2024-05-09T00:03:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f4625dfdb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559537869510 con 0x55953786e480 2024-05-09T00:03:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f4625dfdb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55953786e220 con 0x559537873950 2024-05-09T00:03:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f4613fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537874270 0x55953786dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f4613fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537874270 0x55953786dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47114/0 (socket says 172.21.15.81:47114) 2024-05-09T00:03:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f4613fff700 1 -- 172.21.15.81:0/3518101956 learned_addr learned my addr 172.21.15.81:0/3518101956 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f46137fe700 1 --2- 172.21.15.81:0/3518101956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 0x559537868910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f4612ffd700 1 --2- 172.21.15.81:0/3518101956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537873950 0x55953786e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f4613fff700 1 -- 172.21.15.81:0/3518101956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537873950 msgr2=0x55953786e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f4613fff700 1 --2- 172.21.15.81:0/3518101956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537873950 0x55953786e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f4613fff700 1 -- 172.21.15.81:0/3518101956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 msgr2=0x559537868910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f4613fff700 1 --2- 172.21.15.81:0/3518101956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 0x559537868910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f4613fff700 1 -- 172.21.15.81:0/3518101956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559537784500 con 0x559537874270 2024-05-09T00:03:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f4612ffd700 1 --2- 172.21.15.81:0/3518101956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537873950 0x55953786e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f4613fff700 1 --2- 172.21.15.81:0/3518101956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537874270 0x55953786dce0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f460c00be50 tx=0x7f460c004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638a96deb145262a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f45fa7fc700 1 -- 172.21.15.81:0/3518101956 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c099600 con 0x559537874270 2024-05-09T00:03:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f45fa7fc700 1 -- 172.21.15.81:0/3518101956 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f460c0a1a80 con 0x559537874270 2024-05-09T00:03:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.458+0000 7f45fa7fc700 1 -- 172.21.15.81:0/3518101956 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460c0840b0 con 0x559537874270 2024-05-09T00:03:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.459+0000 7f4625dfdb80 1 -- 172.21.15.81:0/3518101956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537874270 msgr2=0x55953786dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.459+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/3518101956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537874270 0x55953786dce0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f460c00be50 tx=0x7f460c004be0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.459+0000 7f4625dfdb80 1 -- 172.21.15.81:0/3518101956 shutdown_connections 2024-05-09T00:03:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.459+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/3518101956 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 0x559537868910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.459+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/3518101956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537874270 0x55953786dce0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.459+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/3518101956 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537873950 0x55953786e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.459+0000 7f4625dfdb80 1 -- 172.21.15.81:0/3518101956 >> 172.21.15.81:0/3518101956 conn(0x5595377cc1b0 msgr2=0x55953786d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.459+0000 7f4625dfdb80 1 -- 172.21.15.81:0/3518101956 shutdown_connections 2024-05-09T00:03:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.459+0000 7f4625dfdb80 1 -- 172.21.15.81:0/3518101956 wait complete. 2024-05-09T00:03:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.459+0000 7f4625dfdb80 1 -- start start 2024-05-09T00:03:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.459+0000 7f4625dfdb80 1 Processor -- start 2024-05-09T00:03:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4625dfdb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 0x55953787abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4625dfdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537873950 0x55953787b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4625dfdb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 0x55953787b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4625dfdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595378dd1f0 con 0x559537873950 2024-05-09T00:03:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4625dfdb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595378dd330 con 0x55953786e480 2024-05-09T00:03:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4625dfdb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595378dd4c0 con 0x559537874270 2024-05-09T00:03:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4625dfdb80 10 client.0 _ll_register_callbacks cb 0x559537763ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4612ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537873950 0x55953787b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4612ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537873950 0x55953787b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47118/0 (socket says 172.21.15.81:47118) 2024-05-09T00:03:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4612ffd700 1 -- 172.21.15.81:0/1479872551 learned_addr learned my addr 172.21.15.81:0/1479872551 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f46137fe700 1 --2- 172.21.15.81:0/1479872551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 0x55953787abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4613fff700 1 --2- 172.21.15.81:0/1479872551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 0x55953787b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4612ffd700 1 -- 172.21.15.81:0/1479872551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 msgr2=0x55953787b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4612ffd700 1 --2- 172.21.15.81:0/1479872551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 0x55953787b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4612ffd700 1 -- 172.21.15.81:0/1479872551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 msgr2=0x55953787abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4612ffd700 1 --2- 172.21.15.81:0/1479872551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 0x55953787abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4612ffd700 1 -- 172.21.15.81:0/1479872551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55953763f350 con 0x559537873950 2024-05-09T00:03:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4613fff700 1 --2- 172.21.15.81:0/1479872551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 0x55953787b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4612ffd700 1 --2- 172.21.15.81:0/1479872551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537873950 0x55953787b0f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f46080048a0 tx=0x7f4608006e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a3f0e70dada9fa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f45f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f45f2ffd700 1 -- 172.21.15.81:0/1479872551 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460800eab0 con 0x559537873950 2024-05-09T00:03:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f45f2ffd700 1 -- 172.21.15.81:0/1479872551 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f460801d610 con 0x559537873950 2024-05-09T00:03:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.460+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1479872551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f460c09d430 con 0x559537873950 2024-05-09T00:03:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.461+0000 7f45f2ffd700 1 -- 172.21.15.81:0/1479872551 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f460801d7d0 con 0x559537873950 2024-05-09T00:03:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.461+0000 7f4625dfdb80 10 client.15546 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.461+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1479872551 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x559537643c70 con 0x559537873950 2024-05-09T00:03:23.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.461+0000 7f45f2ffd700 1 -- 172.21.15.81:0/1479872551 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f460c09d430 con 0x559537873950 2024-05-09T00:03:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.461+0000 7f45f2ffd700 1 -- 172.21.15.81:0/1479872551 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f460800e3d0 con 0x559537873950 2024-05-09T00:03:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.461+0000 7f4625dfdb80 10 client.15546 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.461+0000 7f4625dfdb80 10 client.15546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.461+0000 7f4625dfdb80 20 client.15546 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.461+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/1479872551 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5595378dec30 0x5595378e1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.461+0000 7f4625dfdb80 4 client.15546 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:03:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.461+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1479872551 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5595377b6e60 con 0x5595378dec30 2024-05-09T00:03:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.461+0000 7f46137fe700 1 --2- 172.21.15.81:0/1479872551 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5595378dec30 0x5595378e1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.462+0000 7f45f2ffd700 10 client.15546 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.462+0000 7f46137fe700 1 --2- 172.21.15.81:0/1479872551 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5595378dec30 0x5595378e1050 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2707361ff8f3424 server_cookie=c1b2c277f732b437 in_seq=0 out_seq=0 2024-05-09T00:03:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.473+0000 7f45f2ffd700 1 -- 172.21.15.81:0/1479872551 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5595377b6e60 con 0x5595378dec30 2024-05-09T00:03:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f45f2ffd700 10 client.15546 handle_command_reply: tid=0 2024-05-09T00:03:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4625dfdb80 1 client.15546 shutdown 2024-05-09T00:03:23.477 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1479872551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537873950 msgr2=0x55953787b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/1479872551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537873950 0x55953787b0f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f46080048a0 tx=0x7f4608006e30 comp rx=0 tx=0).stop 2024-05-09T00:03:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1479872551 shutdown_connections 2024-05-09T00:03:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/1479872551 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5595378dec30 0x5595378e1050 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/1479872551 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55953786e480 0x55953787abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f45f2ffd700 0 client.15546 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/1479872551 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559537874270 0x55953787b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4625dfdb80 1 --2- 172.21.15.81:0/1479872551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559537873950 0x55953787b0f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1479872551 >> 172.21.15.81:0/1479872551 conn(0x5595377cc1b0 msgr2=0x559537874650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1479872551 shutdown_connections 2024-05-09T00:03:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4625dfdb80 1 -- 172.21.15.81:0/1479872551 wait complete. 2024-05-09T00:03:23.478 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4625dfdb80 20 client.15546 trim_cache size 0 max 16384 2024-05-09T00:03:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:03:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:03:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:03:23.479 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:03:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4619c43700 1 -- 172.21.15.81:0/1157530303 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f45fc0a13b0 msgr2=0x7f45fc0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4619c43700 1 --2- 172.21.15.81:0/1157530303 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f45fc0a13b0 0x7f45fc0a3870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4604006010 tx=0x7f460400b540 comp rx=0 tx=0).stop 2024-05-09T00:03:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4619c43700 1 -- 172.21.15.81:0/1157530303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614107000 msgr2=0x7f461419de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.474+0000 7f4619c43700 1 --2- 172.21.15.81:0/1157530303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614107000 0x7f461419de90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f460c00b970 tx=0x7f460c00bd30 comp rx=0 tx=0).stop 2024-05-09T00:03:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.475+0000 7f4619c43700 1 -- 172.21.15.81:0/1157530303 shutdown_connections 2024-05-09T00:03:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.475+0000 7f4619c43700 1 --2- 172.21.15.81:0/1157530303 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f45fc0a13b0 0x7f45fc0a3870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.475+0000 7f4619c43700 1 --2- 172.21.15.81:0/1157530303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4614107000 0x7f461419de90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.475+0000 7f4619c43700 1 --2- 172.21.15.81:0/1157530303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46140682e0 0x7f46141995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.475+0000 7f4619c43700 1 --2- 172.21.15.81:0/1157530303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4614068ca0 0x7f4614199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.475+0000 7f4619c43700 1 -- 172.21.15.81:0/1157530303 >> 172.21.15.81:0/1157530303 conn(0x7f4614076f10 msgr2=0x7f461410bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.475+0000 7f4619c43700 1 -- 172.21.15.81:0/1157530303 shutdown_connections 2024-05-09T00:03:23.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:23.475+0000 7f4619c43700 1 -- 172.21.15.81:0/1157530303 wait complete. 2024-05-09T00:03:25.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:24 smithi150 ceph-mon[46187]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-09T00:03:25.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:24 smithi171 ceph-mon[47351]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-09T00:03:25.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:24 smithi081 ceph-mon[42474]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-05-09T00:03:27.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:26 smithi150 ceph-mon[46187]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-05-09T00:03:27.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:26 smithi171 ceph-mon[47351]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-05-09T00:03:27.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:26 smithi081 ceph-mon[42474]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-05-09T00:03:29.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:28 smithi150 ceph-mon[46187]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-09T00:03:29.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:28 smithi171 ceph-mon[47351]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-09T00:03:29.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:28 smithi081 ceph-mon[42474]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-09T00:03:31.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:30 smithi150 ceph-mon[46187]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-09T00:03:31.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:30 smithi171 ceph-mon[47351]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-09T00:03:31.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:30 smithi081 ceph-mon[42474]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-09T00:03:33.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:32 smithi150 ceph-mon[46187]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-09T00:03:33.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:32 smithi171 ceph-mon[47351]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-09T00:03:33.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:32 smithi081 ceph-mon[42474]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-09T00:03:35.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:34 smithi150 ceph-mon[46187]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-09T00:03:35.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:34 smithi171 ceph-mon[47351]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-09T00:03:35.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:34 smithi081 ceph-mon[42474]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-09T00:03:36.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.591+0000 7f590df3d700 1 -- 172.21.15.81:0/2623429889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5908106250 msgr2=0x7f590810ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:36.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.591+0000 7f590df3d700 1 --2- 172.21.15.81:0/2623429889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5908106250 0x7f590810ddd0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f590000b0d0 tx=0x7f590000b3e0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.591+0000 7f590df3d700 1 -- 172.21.15.81:0/2623429889 shutdown_connections 2024-05-09T00:03:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.591+0000 7f590df3d700 1 --2- 172.21.15.81:0/2623429889 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5908069420 0x7f5908069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.591+0000 7f590df3d700 1 --2- 172.21.15.81:0/2623429889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5908106250 0x7f590810ddd0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.591+0000 7f590df3d700 1 --2- 172.21.15.81:0/2623429889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5908069dd0 0x7f5908105b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.591+0000 7f590df3d700 1 -- 172.21.15.81:0/2623429889 >> 172.21.15.81:0/2623429889 conn(0x7f5908076f40 msgr2=0x7f5908077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.591+0000 7f590df3d700 1 -- 172.21.15.81:0/2623429889 shutdown_connections 2024-05-09T00:03:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.591+0000 7f590df3d700 1 -- 172.21.15.81:0/2623429889 wait complete. 2024-05-09T00:03:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.592+0000 7f590df3d700 1 Processor -- start 2024-05-09T00:03:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f590df3d700 1 -- start start 2024-05-09T00:03:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f590df3d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5908069420 0x7f5908197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f590df3d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5908106250 0x7f5908197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f590df3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590819bc20 0x7f590819c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f590df3d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590819c6a0 con 0x7f590819bc20 2024-05-09T00:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f590df3d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590819c810 con 0x7f5908069420 2024-05-09T00:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f590df3d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590819c9d0 con 0x7f5908106250 2024-05-09T00:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f5907fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590819bc20 0x7f590819c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f5907fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590819bc20 0x7f590819c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59688/0 (socket says 172.21.15.81:59688) 2024-05-09T00:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f5907fff700 1 -- 172.21.15.81:0/48779266 learned_addr learned my addr 172.21.15.81:0/48779266 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f5906ffd700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5908106250 0x7f5908197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f59077fe700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5908069420 0x7f5908197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f5907fff700 1 -- 172.21.15.81:0/48779266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5908106250 msgr2=0x7f5908197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f5907fff700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5908106250 0x7f5908197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f5907fff700 1 -- 172.21.15.81:0/48779266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5908069420 msgr2=0x7f5908197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f5907fff700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5908069420 0x7f5908197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f5907fff700 1 -- 172.21.15.81:0/48779266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5900009d00 con 0x7f590819bc20 2024-05-09T00:03:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.593+0000 7f59077fe700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5908069420 0x7f5908197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.594+0000 7f5907fff700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590819bc20 0x7f590819c0a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5900007fd0 tx=0x7f59000094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.594+0000 7f5904ff9700 1 -- 172.21.15.81:0/48779266 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590000e040 con 0x7f590819bc20 2024-05-09T00:03:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.594+0000 7f5904ff9700 1 -- 172.21.15.81:0/48779266 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5900007950 con 0x7f590819bc20 2024-05-09T00:03:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.594+0000 7f590df3d700 1 -- 172.21.15.81:0/48779266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59081a3ed0 con 0x7f590819bc20 2024-05-09T00:03:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.594+0000 7f5904ff9700 1 -- 172.21.15.81:0/48779266 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590001b6b0 con 0x7f590819bc20 2024-05-09T00:03:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.594+0000 7f590df3d700 1 -- 172.21.15.81:0/48779266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59081a4300 con 0x7f590819bc20 2024-05-09T00:03:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.596+0000 7f5904ff9700 1 -- 172.21.15.81:0/48779266 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f5900005050 con 0x7f590819bc20 2024-05-09T00:03:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.597+0000 7f5904ff9700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f58f40a13b0 0x7f58f40a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.597+0000 7f5904ff9700 1 -- 172.21.15.81:0/48779266 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f59000ce740 con 0x7f590819bc20 2024-05-09T00:03:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.597+0000 7f59077fe700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f58f40a13b0 0x7f58f40a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.597+0000 7f59077fe700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f58f40a13b0 0x7f58f40a3870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f58f0005fd0 tx=0x7f58f0005e30 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f591a0f7b80 1 Processor -- start 2024-05-09T00:03:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f591a0f7b80 1 -- start start 2024-05-09T00:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f591a0f7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb4950 0x55c15eeb4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f591a0f7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb5270 0x55c15eeaef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f591a0f7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeaf480 0x55c15eeaf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f591a0f7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15ee060f0 con 0x55c15eeb5270 2024-05-09T00:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f591a0f7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15ee03ab0 con 0x55c15eeaf480 2024-05-09T00:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f591a0f7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15edff3a0 con 0x55c15eeb4950 2024-05-09T00:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f5906ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb5270 0x55c15eeaef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f5906ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb5270 0x55c15eeaef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59696/0 (socket says 172.21.15.81:59696) 2024-05-09T00:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f5906ffd700 1 -- 172.21.15.81:0/1954613779 learned_addr learned my addr 172.21.15.81:0/1954613779 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f5907fff700 1 --2- 172.21.15.81:0/1954613779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeaf480 0x55c15eeaf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f59077fe700 1 --2- 172.21.15.81:0/1954613779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb4950 0x55c15eeb4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f5906ffd700 1 -- 172.21.15.81:0/1954613779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb4950 msgr2=0x55c15eeb4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f5906ffd700 1 --2- 172.21.15.81:0/1954613779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb4950 0x55c15eeb4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f5906ffd700 1 -- 172.21.15.81:0/1954613779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeaf480 msgr2=0x55c15eeaf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f5906ffd700 1 --2- 172.21.15.81:0/1954613779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeaf480 0x55c15eeaf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f5906ffd700 1 -- 172.21.15.81:0/1954613779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c15ec80350 con 0x55c15eeb5270 2024-05-09T00:03:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f59077fe700 1 --2- 172.21.15.81:0/1954613779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb4950 0x55c15eeb4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f5907fff700 1 --2- 172.21.15.81:0/1954613779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeaf480 0x55c15eeaf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.598+0000 7f5906ffd700 1 --2- 172.21.15.81:0/1954613779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb5270 0x55c15eeaef40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f58f800ac60 tx=0x7f58f800af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60fe69ec3a15f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.599+0000 7f58fdffb700 1 -- 172.21.15.81:0/1954613779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f800fe90 con 0x55c15eeb5270 2024-05-09T00:03:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.599+0000 7f58fdffb700 1 -- 172.21.15.81:0/1954613779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58f80044f0 con 0x55c15eeb5270 2024-05-09T00:03:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.599+0000 7f58fdffb700 1 -- 172.21.15.81:0/1954613779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f8018690 con 0x55c15eeb5270 2024-05-09T00:03:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.599+0000 7f591a0f7b80 1 -- 172.21.15.81:0/1954613779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb5270 msgr2=0x55c15eeaef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.599+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/1954613779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb5270 0x55c15eeaef40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f58f800ac60 tx=0x7f58f800af70 comp rx=0 tx=0).stop 2024-05-09T00:03:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.599+0000 7f591a0f7b80 1 -- 172.21.15.81:0/1954613779 shutdown_connections 2024-05-09T00:03:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.599+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/1954613779 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeaf480 0x55c15eeaf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.599+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/1954613779 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb4950 0x55c15eeb4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.599+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/1954613779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb5270 0x55c15eeaef40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.599+0000 7f591a0f7b80 1 -- 172.21.15.81:0/1954613779 >> 172.21.15.81:0/1954613779 conn(0x55c15ee0d1b0 msgr2=0x55c15eea9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.599+0000 7f591a0f7b80 1 -- 172.21.15.81:0/1954613779 shutdown_connections 2024-05-09T00:03:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.599+0000 7f591a0f7b80 1 -- 172.21.15.81:0/1954613779 wait complete. 2024-05-09T00:03:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.600+0000 7f591a0f7b80 1 -- start start 2024-05-09T00:03:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.600+0000 7f591a0f7b80 1 Processor -- start 2024-05-09T00:03:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.600+0000 7f591a0f7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeaf480 0x55c15eebb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.600+0000 7f591a0f7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeb4950 0x55c15eeb8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.600+0000 7f591a0f7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb5270 0x55c15eeb8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.600+0000 7f591a0f7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15ed9b500 con 0x55c15eeaf480 2024-05-09T00:03:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.600+0000 7f591a0f7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15ed9b1a0 con 0x55c15eeb4950 2024-05-09T00:03:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.600+0000 7f591a0f7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15ec82640 con 0x55c15eeb5270 2024-05-09T00:03:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.600+0000 7f591a0f7b80 10 client.0 _ll_register_callbacks cb 0x55c15eda4ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.600+0000 7f59077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeaf480 0x55c15eebb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.600+0000 7f59077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeaf480 0x55c15eebb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59706/0 (socket says 172.21.15.81:59706) 2024-05-09T00:03:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.600+0000 7f59077fe700 1 -- 172.21.15.81:0/1534408293 learned_addr learned my addr 172.21.15.81:0/1534408293 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f5907fff700 1 --2- 172.21.15.81:0/1534408293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb5270 0x55c15eeb8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f59077fe700 1 -- 172.21.15.81:0/1534408293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb5270 msgr2=0x55c15eeb8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f59077fe700 1 --2- 172.21.15.81:0/1534408293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb5270 0x55c15eeb8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f59077fe700 1 -- 172.21.15.81:0/1534408293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeb4950 msgr2=0x55c15eeb8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f5906ffd700 1 --2- 172.21.15.81:0/1534408293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeb4950 0x55c15eeb8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f59077fe700 1 --2- 172.21.15.81:0/1534408293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeb4950 0x55c15eeb8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f59077fe700 1 -- 172.21.15.81:0/1534408293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f800a890 con 0x55c15eeaf480 2024-05-09T00:03:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f5907fff700 1 --2- 172.21.15.81:0/1534408293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb5270 0x55c15eeb8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f59077fe700 1 --2- 172.21.15.81:0/1534408293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeaf480 0x55c15eebb1a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f58f000a5c0 tx=0x7f58f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f716fb56af45fbbd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f58e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f58e6ffd700 1 -- 172.21.15.81:0/1534408293 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f000fa50 con 0x55c15eeaf480 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f58e6ffd700 1 -- 172.21.15.81:0/1534408293 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f58f000fbb0 con 0x55c15eeaf480 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f591a0f7b80 1 -- 172.21.15.81:0/1534408293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c15ed58210 con 0x55c15eeaf480 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f58e6ffd700 1 -- 172.21.15.81:0/1534408293 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58f000fd70 con 0x55c15eeaf480 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f591a0f7b80 10 client.15558 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f591a0f7b80 1 -- 172.21.15.81:0/1534408293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c15ec2cb00 con 0x55c15eeaf480 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.601+0000 7f58e6ffd700 1 -- 172.21.15.81:0/1534408293 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c15ed58210 con 0x55c15eeaf480 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.602+0000 7f58e6ffd700 1 -- 172.21.15.81:0/1534408293 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f58f0023020 con 0x55c15eeaf480 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.602+0000 7f591a0f7b80 10 client.15558 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.602+0000 7f591a0f7b80 10 client.15558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.602+0000 7f591a0f7b80 20 client.15558 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.602+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/1534408293 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c15eec8bd0 0x55c15eecaff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.602+0000 7f591a0f7b80 4 client.15558 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.602+0000 7f591a0f7b80 1 -- 172.21.15.81:0/1534408293 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c15ee7e7b0 con 0x55c15eec8bd0 2024-05-09T00:03:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.602+0000 7f5906ffd700 1 --2- 172.21.15.81:0/1534408293 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c15eec8bd0 0x55c15eecaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.602+0000 7f5906ffd700 1 --2- 172.21.15.81:0/1534408293 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c15eec8bd0 0x55c15eecaff0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26e1c91ec72f697f server_cookie=548e06871e66555a in_seq=0 out_seq=0 2024-05-09T00:03:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.602+0000 7f58e6ffd700 10 client.15558 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f58e6ffd700 1 -- 172.21.15.81:0/1534408293 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c15ee7e7b0 con 0x55c15eec8bd0 2024-05-09T00:03:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f58e6ffd700 10 client.15558 handle_command_reply: tid=0 2024-05-09T00:03:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f591a0f7b80 1 client.15558 shutdown 2024-05-09T00:03:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f591a0f7b80 1 -- 172.21.15.81:0/1534408293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeaf480 msgr2=0x55c15eebb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/1534408293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeaf480 0x55c15eebb1a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f58f000a5c0 tx=0x7f58f0004750 comp rx=0 tx=0).stop 2024-05-09T00:03:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f591a0f7b80 1 -- 172.21.15.81:0/1534408293 shutdown_connections 2024-05-09T00:03:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/1534408293 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c15eec8bd0 0x55c15eecaff0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/1534408293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb5270 0x55c15eeb8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/1534408293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeaf480 0x55c15eebb1a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f58e6ffd700 0 client.15558 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:36.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/1534408293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeb4950 0x55c15eeb8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f591a0f7b80 1 -- 172.21.15.81:0/1534408293 >> 172.21.15.81:0/1534408293 conn(0x55c15ee0d1b0 msgr2=0x55c15eeb34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:36.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f591a0f7b80 1 -- 172.21.15.81:0/1534408293 shutdown_connections 2024-05-09T00:03:36.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f591a0f7b80 1 -- 172.21.15.81:0/1534408293 wait complete. 2024-05-09T00:03:36.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.603+0000 7f591a0f7b80 20 client.15558 trim_cache size 0 max 16384 2024-05-09T00:03:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.619+0000 7f591a0f7b80 1 Processor -- start 2024-05-09T00:03:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.619+0000 7f591a0f7b80 1 -- start start 2024-05-09T00:03:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.619+0000 7f591a0f7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeaf480 0x55c15eeb8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.615 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.619+0000 7f591a0f7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb4950 0x55c15eea9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.619+0000 7f591a0f7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb5270 0x55c15eead5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.619+0000 7f591a0f7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15eeaa5f0 con 0x55c15eeb5270 2024-05-09T00:03:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.619+0000 7f591a0f7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15eeab0f0 con 0x55c15eeaf480 2024-05-09T00:03:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.619+0000 7f591a0f7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15eed01c0 con 0x55c15eeb4950 2024-05-09T00:03:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.620+0000 7f5907fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb5270 0x55c15eead5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.620+0000 7f5907fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb5270 0x55c15eead5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59714/0 (socket says 172.21.15.81:59714) 2024-05-09T00:03:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.620+0000 7f5907fff700 1 -- 172.21.15.81:0/3424295073 learned_addr learned my addr 172.21.15.81:0/3424295073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.620+0000 7f59077fe700 1 --2- 172.21.15.81:0/3424295073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeaf480 0x55c15eeb8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.620+0000 7f5906ffd700 1 --2- 172.21.15.81:0/3424295073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb4950 0x55c15eea9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.620+0000 7f5907fff700 1 -- 172.21.15.81:0/3424295073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb4950 msgr2=0x55c15eea9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.620+0000 7f5907fff700 1 --2- 172.21.15.81:0/3424295073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb4950 0x55c15eea9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.620+0000 7f5907fff700 1 -- 172.21.15.81:0/3424295073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeaf480 msgr2=0x55c15eeb8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.620+0000 7f5907fff700 1 --2- 172.21.15.81:0/3424295073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeaf480 0x55c15eeb8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.616 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.620+0000 7f5907fff700 1 -- 172.21.15.81:0/3424295073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c15edc5500 con 0x55c15eeb5270 2024-05-09T00:03:36.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.620+0000 7f5907fff700 1 --2- 172.21.15.81:0/3424295073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb5270 0x55c15eead5f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5900005b10 tx=0x7f59000099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339202fc9fbccaaf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:36.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.620+0000 7f58fe7fc700 1 -- 172.21.15.81:0/3424295073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59000bb0b0 con 0x55c15eeb5270 2024-05-09T00:03:36.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.620+0000 7f58fe7fc700 1 -- 172.21.15.81:0/3424295073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5900084e90 con 0x55c15eeb5270 2024-05-09T00:03:36.617 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.620+0000 7f58fe7fc700 1 -- 172.21.15.81:0/3424295073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590009f4c0 con 0x55c15eeb5270 2024-05-09T00:03:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.621+0000 7f591a0f7b80 1 -- 172.21.15.81:0/3424295073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb5270 msgr2=0x55c15eead5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.621+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/3424295073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb5270 0x55c15eead5f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5900005b10 tx=0x7f59000099e0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.621+0000 7f591a0f7b80 1 -- 172.21.15.81:0/3424295073 shutdown_connections 2024-05-09T00:03:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.621+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/3424295073 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeaf480 0x55c15eeb8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.620 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.621+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/3424295073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb5270 0x55c15eead5f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.621+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/3424295073 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeb4950 0x55c15eea9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.621+0000 7f591a0f7b80 1 -- 172.21.15.81:0/3424295073 >> 172.21.15.81:0/3424295073 conn(0x55c15ee0d1b0 msgr2=0x55c15eec46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.621+0000 7f591a0f7b80 1 -- 172.21.15.81:0/3424295073 shutdown_connections 2024-05-09T00:03:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.621+0000 7f591a0f7b80 1 -- 172.21.15.81:0/3424295073 wait complete. 2024-05-09T00:03:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.621+0000 7f591a0f7b80 1 -- start start 2024-05-09T00:03:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f591a0f7b80 1 Processor -- start 2024-05-09T00:03:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f591a0f7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeaf480 0x55c15eebdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f591a0f7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb4950 0x55c15eebe130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f591a0f7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeb5270 0x55c15eebe670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f591a0f7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15ef1e150 con 0x55c15eeb4950 2024-05-09T00:03:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f591a0f7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15ef1e290 con 0x55c15eeb5270 2024-05-09T00:03:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f591a0f7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15ef1e3d0 con 0x55c15eeaf480 2024-05-09T00:03:36.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f591a0f7b80 10 client.0 _ll_register_callbacks cb 0x55c15eda4ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f5906ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb4950 0x55c15eebe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f5906ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb4950 0x55c15eebe130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59716/0 (socket says 172.21.15.81:59716) 2024-05-09T00:03:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f5906ffd700 1 -- 172.21.15.81:0/3512837800 learned_addr learned my addr 172.21.15.81:0/3512837800 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f5907fff700 1 --2- 172.21.15.81:0/3512837800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeb5270 0x55c15eebe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f59077fe700 1 --2- 172.21.15.81:0/3512837800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeaf480 0x55c15eebdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f5906ffd700 1 -- 172.21.15.81:0/3512837800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeaf480 msgr2=0x55c15eebdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f5906ffd700 1 --2- 172.21.15.81:0/3512837800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeaf480 0x55c15eebdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f5906ffd700 1 -- 172.21.15.81:0/3512837800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeb5270 msgr2=0x55c15eebe670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f5906ffd700 1 --2- 172.21.15.81:0/3512837800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeb5270 0x55c15eebe670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.622+0000 7f5906ffd700 1 -- 172.21.15.81:0/3512837800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59081a4300 con 0x55c15eeb4950 2024-05-09T00:03:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f5906ffd700 1 --2- 172.21.15.81:0/3512837800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb4950 0x55c15eebe130 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55c15eeaa790 tx=0x7f58f8005d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9547dd94ed578aa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f58e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:36.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f58e6ffd700 1 -- 172.21.15.81:0/3512837800 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f800fea0 con 0x55c15eeb4950 2024-05-09T00:03:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f58e6ffd700 1 -- 172.21.15.81:0/3512837800 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f58f8003c90 con 0x55c15eeb4950 2024-05-09T00:03:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f591a0f7b80 1 -- 172.21.15.81:0/3512837800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58f80044f0 con 0x55c15eeb4950 2024-05-09T00:03:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f58e6ffd700 1 -- 172.21.15.81:0/3512837800 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58f8003e50 con 0x55c15eeb4950 2024-05-09T00:03:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f591a0f7b80 10 client.15564 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f591a0f7b80 1 -- 172.21.15.81:0/3512837800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c15ec84c70 con 0x55c15eeb4950 2024-05-09T00:03:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f58e6ffd700 1 -- 172.21.15.81:0/3512837800 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58f80044f0 con 0x55c15eeb4950 2024-05-09T00:03:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f58e6ffd700 1 -- 172.21.15.81:0/3512837800 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f58f802f030 con 0x55c15eeb4950 2024-05-09T00:03:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f591a0f7b80 10 client.15564 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f591a0f7b80 10 client.15564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f591a0f7b80 20 client.15564 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/3512837800 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c15ef1fb30 0x55c15ef21f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f591a0f7b80 4 client.15564 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:03:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f591a0f7b80 1 -- 172.21.15.81:0/3512837800 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c15edf7e60 con 0x55c15ef1fb30 2024-05-09T00:03:36.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.623+0000 7f59077fe700 1 --2- 172.21.15.81:0/3512837800 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c15ef1fb30 0x55c15ef21f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:36.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.624+0000 7f58e6ffd700 10 client.15564 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:36.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.624+0000 7f59077fe700 1 --2- 172.21.15.81:0/3512837800 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c15ef1fb30 0x55c15ef21f50 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=944667a4e365c855 server_cookie=649a70409c172395 in_seq=0 out_seq=0 2024-05-09T00:03:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f58e6ffd700 1 -- 172.21.15.81:0/3512837800 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c15edf7e60 con 0x55c15ef1fb30 2024-05-09T00:03:36.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f58e6ffd700 10 client.15564 handle_command_reply: tid=0 2024-05-09T00:03:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f591a0f7b80 1 client.15564 shutdown 2024-05-09T00:03:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f591a0f7b80 1 -- 172.21.15.81:0/3512837800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb4950 msgr2=0x55c15eebe130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/3512837800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb4950 0x55c15eebe130 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55c15eeaa790 tx=0x7f58f8005d00 comp rx=0 tx=0).stop 2024-05-09T00:03:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f591a0f7b80 1 -- 172.21.15.81:0/3512837800 shutdown_connections 2024-05-09T00:03:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/3512837800 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c15ef1fb30 0x55c15ef21f50 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/3512837800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c15eeb5270 0x55c15eebe670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/3512837800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c15eeaf480 0x55c15eebdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f58e6ffd700 0 client.15564 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f591a0f7b80 1 --2- 172.21.15.81:0/3512837800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c15eeb4950 0x55c15eebe130 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f591a0f7b80 1 -- 172.21.15.81:0/3512837800 >> 172.21.15.81:0/3512837800 conn(0x55c15ee0d1b0 msgr2=0x55c15eeb6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f591a0f7b80 1 -- 172.21.15.81:0/3512837800 shutdown_connections 2024-05-09T00:03:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f591a0f7b80 1 -- 172.21.15.81:0/3512837800 wait complete. 2024-05-09T00:03:36.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.630+0000 7f591a0f7b80 20 client.15564 trim_cache size 0 max 16384 2024-05-09T00:03:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:03:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:03:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:03:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:03:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.631+0000 7f590df3d700 1 -- 172.21.15.81:0/48779266 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f58f40a13b0 msgr2=0x7f58f40a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.631+0000 7f590df3d700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f58f40a13b0 0x7f58f40a3870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f58f0005fd0 tx=0x7f58f0005e30 comp rx=0 tx=0).stop 2024-05-09T00:03:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.631+0000 7f590df3d700 1 -- 172.21.15.81:0/48779266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590819bc20 msgr2=0x7f590819c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.631+0000 7f590df3d700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590819bc20 0x7f590819c0a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5900007fd0 tx=0x7f59000094c0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.631+0000 7f590df3d700 1 -- 172.21.15.81:0/48779266 shutdown_connections 2024-05-09T00:03:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.631+0000 7f590df3d700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f58f40a13b0 0x7f58f40a3870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.631+0000 7f590df3d700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5908069420 0x7f5908197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.631+0000 7f590df3d700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f590819bc20 0x7f590819c0a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.631+0000 7f590df3d700 1 --2- 172.21.15.81:0/48779266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5908106250 0x7f5908197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:36.628 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.631+0000 7f590df3d700 1 -- 172.21.15.81:0/48779266 >> 172.21.15.81:0/48779266 conn(0x7f5908076f40 msgr2=0x7f59080fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.631+0000 7f590df3d700 1 -- 172.21.15.81:0/48779266 shutdown_connections 2024-05-09T00:03:36.629 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:36.631+0000 7f590df3d700 1 -- 172.21.15.81:0/48779266 wait complete. 2024-05-09T00:03:37.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:36 smithi150 ceph-mon[46187]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-09T00:03:37.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:36 smithi171 ceph-mon[47351]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-09T00:03:37.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:36 smithi081 ceph-mon[42474]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-09T00:03:38.771 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:03:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.915+0000 7fb4c9764700 1 -- 172.21.15.81:0/1854109323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c4105190 msgr2=0x7fb4c410cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.915+0000 7fb4c9764700 1 --2- 172.21.15.81:0/1854109323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c4105190 0x7fb4c410cd10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00b0a0 tx=0x7fb4bc00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.915+0000 7fb4c9764700 1 -- 172.21.15.81:0/1854109323 shutdown_connections 2024-05-09T00:03:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.915+0000 7fb4c9764700 1 --2- 172.21.15.81:0/1854109323 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4c4100070 0x7fb4c4100450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.915+0000 7fb4c9764700 1 --2- 172.21.15.81:0/1854109323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c4105190 0x7fb4c410cd10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.915+0000 7fb4c9764700 1 --2- 172.21.15.81:0/1854109323 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4c4100a20 0x7fb4c4104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.915+0000 7fb4c9764700 1 -- 172.21.15.81:0/1854109323 >> 172.21.15.81:0/1854109323 conn(0x7fb4c4076fa0 msgr2=0x7fb4c40773b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.915+0000 7fb4c9764700 1 -- 172.21.15.81:0/1854109323 shutdown_connections 2024-05-09T00:03:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.915+0000 7fb4c9764700 1 -- 172.21.15.81:0/1854109323 wait complete. 2024-05-09T00:03:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.916+0000 7fb4c9764700 1 Processor -- start 2024-05-09T00:03:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.916+0000 7fb4c9764700 1 -- start start 2024-05-09T00:03:38.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.916+0000 7fb4c9764700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c4100070 0x7fb4c4197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.916+0000 7fb4c9764700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4c4105190 0x7fb4c4197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.916+0000 7fb4c9764700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4c419bee0 0x7fb4c419c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.916+0000 7fb4c9764700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c419c960 con 0x7fb4c4100070 2024-05-09T00:03:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.916+0000 7fb4c9764700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c419cad0 con 0x7fb4c419bee0 2024-05-09T00:03:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.916+0000 7fb4c9764700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c419cc90 con 0x7fb4c4105190 2024-05-09T00:03:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.916+0000 7fb4c2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c4100070 0x7fb4c4197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.917+0000 7fb4c2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c4100070 0x7fb4c4197650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39102/0 (socket says 172.21.15.81:39102) 2024-05-09T00:03:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.917+0000 7fb4c2ffd700 1 -- 172.21.15.81:0/3890715148 learned_addr learned my addr 172.21.15.81:0/3890715148 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.917+0000 7fb4c37fe700 1 --2- 172.21.15.81:0/3890715148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4c419bee0 0x7fb4c419c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.917+0000 7fb4c2ffd700 1 -- 172.21.15.81:0/3890715148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4c4105190 msgr2=0x7fb4c4197b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.917+0000 7fb4c2ffd700 1 --2- 172.21.15.81:0/3890715148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4c4105190 0x7fb4c4197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.917+0000 7fb4c2ffd700 1 -- 172.21.15.81:0/3890715148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4c419bee0 msgr2=0x7fb4c419c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.917+0000 7fb4c2ffd700 1 --2- 172.21.15.81:0/3890715148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4c419bee0 0x7fb4c419c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.917+0000 7fb4c2ffd700 1 -- 172.21.15.81:0/3890715148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4bc009d00 con 0x7fb4c4100070 2024-05-09T00:03:38.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.917+0000 7fb4c2ffd700 1 --2- 172.21.15.81:0/3890715148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c4100070 0x7fb4c4197650 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00d950 tx=0x7fb4ac00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:38.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.917+0000 7fb4bbfff700 1 -- 172.21.15.81:0/3890715148 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac009940 con 0x7fb4c4100070 2024-05-09T00:03:38.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.917+0000 7fb4bbfff700 1 -- 172.21.15.81:0/3890715148 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4ac010460 con 0x7fb4c4100070 2024-05-09T00:03:38.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.917+0000 7fb4c9764700 1 -- 172.21.15.81:0/3890715148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4c41a41f0 con 0x7fb4c4100070 2024-05-09T00:03:38.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.917+0000 7fb4bbfff700 1 -- 172.21.15.81:0/3890715148 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac00f620 con 0x7fb4c4100070 2024-05-09T00:03:38.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.917+0000 7fb4c9764700 1 -- 172.21.15.81:0/3890715148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c41a46d0 con 0x7fb4c4100070 2024-05-09T00:03:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.919+0000 7fb4bbfff700 1 -- 172.21.15.81:0/3890715148 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7fb4ac0108d0 con 0x7fb4c4100070 2024-05-09T00:03:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.920+0000 7fb4bbfff700 1 --2- 172.21.15.81:0/3890715148 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb4b00a13b0 0x7fb4b00a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.920+0000 7fb4bbfff700 1 -- 172.21.15.81:0/3890715148 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb4ac0cce50 con 0x7fb4c4100070 2024-05-09T00:03:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.920+0000 7fb4c27fc700 1 --2- 172.21.15.81:0/3890715148 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb4b00a13b0 0x7fb4b00a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.920+0000 7fb4c27fc700 1 --2- 172.21.15.81:0/3890715148 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb4b00a13b0 0x7fb4b00a3870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4005e90 tx=0x7fb4b4005d00 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.921+0000 7fb4d591eb80 1 Processor -- start 2024-05-09T00:03:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.921+0000 7fb4d591eb80 1 -- start start 2024-05-09T00:03:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.921+0000 7fb4d591eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87b1210 0x55e4f87b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.921+0000 7fb4d591eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1b30 0x55e4f87ab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.921+0000 7fb4d591eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87abca0 0x55e4f87ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.921+0000 7fb4d591eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f86fe150 con 0x55e4f87b1b30 2024-05-09T00:03:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.921+0000 7fb4d591eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f86fbb10 con 0x55e4f87abca0 2024-05-09T00:03:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.921+0000 7fb4d591eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f86f7400 con 0x55e4f87b1210 2024-05-09T00:03:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.921+0000 7fb4c27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1b30 0x55e4f87ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.921+0000 7fb4c27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1b30 0x55e4f87ab760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39114/0 (socket says 172.21.15.81:39114) 2024-05-09T00:03:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.921+0000 7fb4c27fc700 1 -- 172.21.15.81:0/211375190 learned_addr learned my addr 172.21.15.81:0/211375190 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.922+0000 7fb4c37fe700 1 --2- 172.21.15.81:0/211375190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87abca0 0x55e4f87ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.922+0000 7fb4c2ffd700 1 --2- 172.21.15.81:0/211375190 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87b1210 0x55e4f87b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.922+0000 7fb4c27fc700 1 -- 172.21.15.81:0/211375190 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87b1210 msgr2=0x55e4f87b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.922+0000 7fb4c27fc700 1 --2- 172.21.15.81:0/211375190 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87b1210 0x55e4f87b15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.922+0000 7fb4c27fc700 1 -- 172.21.15.81:0/211375190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87abca0 msgr2=0x55e4f87ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.922+0000 7fb4c27fc700 1 --2- 172.21.15.81:0/211375190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87abca0 0x55e4f87ac0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.922+0000 7fb4c27fc700 1 -- 172.21.15.81:0/211375190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4f85783b0 con 0x55e4f87b1b30 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.922+0000 7fb4c37fe700 1 --2- 172.21.15.81:0/211375190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87abca0 0x55e4f87ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.922+0000 7fb4c27fc700 1 --2- 172.21.15.81:0/211375190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1b30 0x55e4f87ab760 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400db90 tx=0x7fb4b4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd8e3b553381235 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.922+0000 7fb4b97fa700 1 -- 172.21.15.81:0/211375190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4021070 con 0x55e4f87b1b30 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.922+0000 7fb4b97fa700 1 -- 172.21.15.81:0/211375190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4b4010db0 con 0x55e4f87b1b30 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.922+0000 7fb4b97fa700 1 -- 172.21.15.81:0/211375190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4005280 con 0x55e4f87b1b30 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.923+0000 7fb4d591eb80 1 -- 172.21.15.81:0/211375190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1b30 msgr2=0x55e4f87ab760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.923+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/211375190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1b30 0x55e4f87ab760 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400db90 tx=0x7fb4b4010000 comp rx=0 tx=0).stop 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.923+0000 7fb4d591eb80 1 -- 172.21.15.81:0/211375190 shutdown_connections 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.923+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/211375190 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87abca0 0x55e4f87ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.923+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/211375190 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87b1210 0x55e4f87b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.923+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/211375190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1b30 0x55e4f87ab760 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.923+0000 7fb4d591eb80 1 -- 172.21.15.81:0/211375190 >> 172.21.15.81:0/211375190 conn(0x55e4f8705210 msgr2=0x55e4f87a1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.923+0000 7fb4d591eb80 1 -- 172.21.15.81:0/211375190 shutdown_connections 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.923+0000 7fb4d591eb80 1 -- 172.21.15.81:0/211375190 wait complete. 2024-05-09T00:03:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.923+0000 7fb4d591eb80 1 -- start start 2024-05-09T00:03:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.923+0000 7fb4d591eb80 1 Processor -- start 2024-05-09T00:03:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4d591eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87abca0 0x55e4f87b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4d591eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1210 0x55e4f87b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4d591eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87b1b30 0x55e4f87b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4d591eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f8693560 con 0x55e4f87b1210 2024-05-09T00:03:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4d591eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f8693200 con 0x55e4f87b1b30 2024-05-09T00:03:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4d591eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f857a6a0 con 0x55e4f87abca0 2024-05-09T00:03:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4d591eb80 10 client.0 _ll_register_callbacks cb 0x55e4f869cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4c27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1210 0x55e4f87b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4c27fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1210 0x55e4f87b53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39128/0 (socket says 172.21.15.81:39128) 2024-05-09T00:03:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4c27fc700 1 -- 172.21.15.81:0/22235980 learned_addr learned my addr 172.21.15.81:0/22235980 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4c27fc700 1 -- 172.21.15.81:0/22235980 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87abca0 msgr2=0x55e4f87b4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:38.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4c2ffd700 1 --2- 172.21.15.81:0/22235980 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87abca0 0x55e4f87b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4c27fc700 1 --2- 172.21.15.81:0/22235980 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87abca0 0x55e4f87b4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4c27fc700 1 -- 172.21.15.81:0/22235980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87b1b30 msgr2=0x55e4f87b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:38.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4c37fe700 1 --2- 172.21.15.81:0/22235980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87b1b30 0x55e4f87b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4c27fc700 1 --2- 172.21.15.81:0/22235980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87b1b30 0x55e4f87b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4c27fc700 1 -- 172.21.15.81:0/22235980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b400d840 con 0x55e4f87b1210 2024-05-09T00:03:38.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4c37fe700 1 --2- 172.21.15.81:0/22235980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87b1b30 0x55e4f87b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:38.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4c27fc700 1 --2- 172.21.15.81:0/22235980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1210 0x55e4f87b53a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400db60 tx=0x7fb4b4004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffefdf713ab183f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:38.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4aa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:38.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4aa7fc700 1 -- 172.21.15.81:0/22235980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4021070 con 0x55e4f87b1210 2024-05-09T00:03:38.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4aa7fc700 1 -- 172.21.15.81:0/22235980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb4b4010b00 con 0x55e4f87b1210 2024-05-09T00:03:38.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4d591eb80 1 -- 172.21.15.81:0/22235980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4f8650270 con 0x55e4f87b1210 2024-05-09T00:03:38.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4aa7fc700 1 -- 172.21.15.81:0/22235980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4b4004020 con 0x55e4f87b1210 2024-05-09T00:03:38.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4d591eb80 10 client.15576 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:38.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.924+0000 7fb4d591eb80 1 -- 172.21.15.81:0/22235980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e4f8524b60 con 0x55e4f87b1210 2024-05-09T00:03:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.925+0000 7fb4aa7fc700 1 -- 172.21.15.81:0/22235980 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e4f8650270 con 0x55e4f87b1210 2024-05-09T00:03:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.925+0000 7fb4aa7fc700 1 -- 172.21.15.81:0/22235980 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb4b4003680 con 0x55e4f87b1210 2024-05-09T00:03:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.925+0000 7fb4d591eb80 10 client.15576 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.925+0000 7fb4d591eb80 10 client.15576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.925+0000 7fb4d591eb80 20 client.15576 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.925+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/22235980 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e4f87c5390 0x55e4f87c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.925+0000 7fb4d591eb80 4 client.15576 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:03:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.925+0000 7fb4d591eb80 1 -- 172.21.15.81:0/22235980 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4f8776810 con 0x55e4f87c5390 2024-05-09T00:03:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.925+0000 7fb4c2ffd700 1 --2- 172.21.15.81:0/22235980 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e4f87c5390 0x55e4f87c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.926+0000 7fb4aa7fc700 10 client.15576 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.926+0000 7fb4c2ffd700 1 --2- 172.21.15.81:0/22235980 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e4f87c5390 0x55e4f87c77b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9a2f98a6ed0bcbb server_cookie=363f5da31b3c350f in_seq=0 out_seq=0 2024-05-09T00:03:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.926+0000 7fb4aa7fc700 1 -- 172.21.15.81:0/22235980 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e4f8776810 con 0x55e4f87c5390 2024-05-09T00:03:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.926+0000 7fb4aa7fc700 10 client.15576 handle_command_reply: tid=0 2024-05-09T00:03:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.926+0000 7fb4d591eb80 1 client.15576 shutdown 2024-05-09T00:03:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.926+0000 7fb4d591eb80 1 -- 172.21.15.81:0/22235980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1210 msgr2=0x55e4f87b53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.926+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/22235980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1210 0x55e4f87b53a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400db60 tx=0x7fb4b4004970 comp rx=0 tx=0).stop 2024-05-09T00:03:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.926+0000 7fb4d591eb80 1 -- 172.21.15.81:0/22235980 shutdown_connections 2024-05-09T00:03:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.926+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/22235980 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e4f87c5390 0x55e4f87c77b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.926+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/22235980 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87b1b30 0x55e4f87b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.926+0000 7fb4aa7fc700 0 client.15576 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.926+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/22235980 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87abca0 0x55e4f87b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.926+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/22235980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1210 0x55e4f87b53a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.926+0000 7fb4d591eb80 1 -- 172.21.15.81:0/22235980 >> 172.21.15.81:0/22235980 conn(0x55e4f8705210 msgr2=0x55e4f87a15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:38.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.927+0000 7fb4d591eb80 1 -- 172.21.15.81:0/22235980 shutdown_connections 2024-05-09T00:03:38.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.927+0000 7fb4d591eb80 1 -- 172.21.15.81:0/22235980 wait complete. 2024-05-09T00:03:38.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.927+0000 7fb4d591eb80 20 client.15576 trim_cache size 0 max 16384 2024-05-09T00:03:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.944+0000 7fb4d591eb80 1 Processor -- start 2024-05-09T00:03:38.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.944+0000 7fb4d591eb80 1 -- start start 2024-05-09T00:03:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4d591eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87abca0 0x55e4f87b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4d591eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87b1b30 0x55e4f87a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4d591eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87ac080 0x55e4f87b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4d591eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f87b64d0 con 0x55e4f87abca0 2024-05-09T00:03:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4d591eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f87a29f0 con 0x55e4f87b1b30 2024-05-09T00:03:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4d591eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f879edc0 con 0x55e4f87ac080 2024-05-09T00:03:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4c2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87abca0 0x55e4f87b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4c2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87abca0 0x55e4f87b07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39130/0 (socket says 172.21.15.81:39130) 2024-05-09T00:03:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4c2ffd700 1 -- 172.21.15.81:0/2788701623 learned_addr learned my addr 172.21.15.81:0/2788701623 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4c27fc700 1 --2- 172.21.15.81:0/2788701623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87b1b30 0x55e4f87a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4c37fe700 1 --2- 172.21.15.81:0/2788701623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87ac080 0x55e4f87b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4c2ffd700 1 -- 172.21.15.81:0/2788701623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87ac080 msgr2=0x55e4f87b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4c2ffd700 1 --2- 172.21.15.81:0/2788701623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87ac080 0x55e4f87b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4c2ffd700 1 -- 172.21.15.81:0/2788701623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87b1b30 msgr2=0x55e4f87a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4c2ffd700 1 --2- 172.21.15.81:0/2788701623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87b1b30 0x55e4f87a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4c2ffd700 1 -- 172.21.15.81:0/2788701623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4f86bd560 con 0x55e4f87abca0 2024-05-09T00:03:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4c37fe700 1 --2- 172.21.15.81:0/2788701623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87ac080 0x55e4f87b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:38.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4c2ffd700 1 --2- 172.21.15.81:0/2788701623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87abca0 0x55e4f87b07c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac096740 tx=0x7fb4ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191b285f2782e583 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4b9ffb700 1 -- 172.21.15.81:0/2788701623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac0b1070 con 0x55e4f87abca0 2024-05-09T00:03:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4b9ffb700 1 -- 172.21.15.81:0/2788701623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4ac0a2150 con 0x55e4f87abca0 2024-05-09T00:03:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.945+0000 7fb4b9ffb700 1 -- 172.21.15.81:0/2788701623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ac0991c0 con 0x55e4f87abca0 2024-05-09T00:03:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.946+0000 7fb4d591eb80 1 -- 172.21.15.81:0/2788701623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87abca0 msgr2=0x55e4f87b07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.946+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/2788701623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87abca0 0x55e4f87b07c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac096740 tx=0x7fb4ac000bc0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.946+0000 7fb4d591eb80 1 -- 172.21.15.81:0/2788701623 shutdown_connections 2024-05-09T00:03:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.946+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/2788701623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87ac080 0x55e4f87b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.946+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/2788701623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87abca0 0x55e4f87b07c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.946+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/2788701623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87b1b30 0x55e4f87a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.946+0000 7fb4d591eb80 1 -- 172.21.15.81:0/2788701623 >> 172.21.15.81:0/2788701623 conn(0x55e4f8705210 msgr2=0x55e4f87b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.946+0000 7fb4d591eb80 1 -- 172.21.15.81:0/2788701623 shutdown_connections 2024-05-09T00:03:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.946+0000 7fb4d591eb80 1 -- 172.21.15.81:0/2788701623 wait complete. 2024-05-09T00:03:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4d591eb80 1 -- start start 2024-05-09T00:03:38.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4d591eb80 1 Processor -- start 2024-05-09T00:03:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4d591eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87abca0 0x55e4f8814be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4d591eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87ac080 0x55e4f8815120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4d591eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1b30 0x55e4f87bb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4d591eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f87bbe90 con 0x55e4f87b1b30 2024-05-09T00:03:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4d591eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f87bc000 con 0x55e4f87abca0 2024-05-09T00:03:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4d591eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4f87bc1c0 con 0x55e4f87ac080 2024-05-09T00:03:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4d591eb80 10 client.0 _ll_register_callbacks cb 0x55e4f869cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1b30 0x55e4f87bb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1b30 0x55e4f87bb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39140/0 (socket says 172.21.15.81:39140) 2024-05-09T00:03:38.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4c37fe700 1 -- 172.21.15.81:0/1662694743 learned_addr learned my addr 172.21.15.81:0/1662694743 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:38.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4c2ffd700 1 --2- 172.21.15.81:0/1662694743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87abca0 0x55e4f8814be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4c27fc700 1 --2- 172.21.15.81:0/1662694743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87ac080 0x55e4f8815120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4c37fe700 1 -- 172.21.15.81:0/1662694743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87ac080 msgr2=0x55e4f8815120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:38.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4c37fe700 1 --2- 172.21.15.81:0/1662694743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87ac080 0x55e4f8815120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4c37fe700 1 -- 172.21.15.81:0/1662694743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87abca0 msgr2=0x55e4f8814be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:38.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4c37fe700 1 --2- 172.21.15.81:0/1662694743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87abca0 0x55e4f8814be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4c37fe700 1 -- 172.21.15.81:0/1662694743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c41a46d0 con 0x55e4f87b1b30 2024-05-09T00:03:38.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4c27fc700 1 --2- 172.21.15.81:0/1662694743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87ac080 0x55e4f8815120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:38.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4c37fe700 1 --2- 172.21.15.81:0/1662694743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1b30 0x55e4f87bb8c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00b0a0 tx=0x7fb4bc009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a77d10bf6d5a13 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:38.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.947+0000 7fb4aa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4aa7fc700 1 -- 172.21.15.81:0/1662694743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc00e040 con 0x55e4f87b1b30 2024-05-09T00:03:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4aa7fc700 1 -- 172.21.15.81:0/1662694743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb4bc0076e0 con 0x55e4f87b1b30 2024-05-09T00:03:38.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4d591eb80 1 -- 172.21.15.81:0/1662694743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4b4010db0 con 0x55e4f87b1b30 2024-05-09T00:03:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4aa7fc700 1 -- 172.21.15.81:0/1662694743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4bc009b80 con 0x55e4f87b1b30 2024-05-09T00:03:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4d591eb80 10 client.15582 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4d591eb80 1 -- 172.21.15.81:0/1662694743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e4f857ccd0 con 0x55e4f87b1b30 2024-05-09T00:03:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4aa7fc700 1 -- 172.21.15.81:0/1662694743 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4b4010db0 con 0x55e4f87b1b30 2024-05-09T00:03:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4aa7fc700 1 -- 172.21.15.81:0/1662694743 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb4bc024030 con 0x55e4f87b1b30 2024-05-09T00:03:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4d591eb80 10 client.15582 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4d591eb80 10 client.15582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4d591eb80 20 client.15582 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/1662694743 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e4f881dc00 0x55e4f8820020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4d591eb80 4 client.15582 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:03:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4d591eb80 1 -- 172.21.15.81:0/1662694743 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e4f86efec0 con 0x55e4f881dc00 2024-05-09T00:03:38.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4c2ffd700 1 --2- 172.21.15.81:0/1662694743 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e4f881dc00 0x55e4f8820020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4aa7fc700 10 client.15582 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4c2ffd700 1 --2- 172.21.15.81:0/1662694743 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e4f881dc00 0x55e4f8820020 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f55893fcbf590bef server_cookie=7168850b444d1466 in_seq=0 out_seq=0 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4aa7fc700 1 -- 172.21.15.81:0/1662694743 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e4f86efec0 con 0x55e4f881dc00 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.951+0000 7fb4aa7fc700 10 client.15582 handle_command_reply: tid=0 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4d591eb80 1 client.15582 shutdown 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4d591eb80 1 -- 172.21.15.81:0/1662694743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1b30 msgr2=0x55e4f87bb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/1662694743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1b30 0x55e4f87bb8c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc00b0a0 tx=0x7fb4bc009440 comp rx=0 tx=0).stop 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4d591eb80 1 -- 172.21.15.81:0/1662694743 shutdown_connections 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/1662694743 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e4f881dc00 0x55e4f8820020 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/1662694743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e4f87abca0 0x55e4f8814be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4aa7fc700 0 client.15582 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/1662694743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e4f87b1b30 0x55e4f87bb8c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4d591eb80 1 --2- 172.21.15.81:0/1662694743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e4f87ac080 0x55e4f8815120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4d591eb80 1 -- 172.21.15.81:0/1662694743 >> 172.21.15.81:0/1662694743 conn(0x55e4f8705210 msgr2=0x55e4f87b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:38.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4d591eb80 1 -- 172.21.15.81:0/1662694743 shutdown_connections 2024-05-09T00:03:38.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4d591eb80 1 -- 172.21.15.81:0/1662694743 wait complete. 2024-05-09T00:03:38.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4d591eb80 20 client.15582 trim_cache size 0 max 16384 2024-05-09T00:03:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:03:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:03:38.952 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:03:38.952 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:03:38.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4c9764700 1 -- 172.21.15.81:0/3890715148 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb4b00a13b0 msgr2=0x7fb4b00a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:38.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4c9764700 1 --2- 172.21.15.81:0/3890715148 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb4b00a13b0 0x7fb4b00a3870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4005e90 tx=0x7fb4b4005d00 comp rx=0 tx=0).stop 2024-05-09T00:03:38.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4c9764700 1 -- 172.21.15.81:0/3890715148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c4100070 msgr2=0x7fb4c4197650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:38.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4c9764700 1 --2- 172.21.15.81:0/3890715148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c4100070 0x7fb4c4197650 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac00d950 tx=0x7fb4ac00dc60 comp rx=0 tx=0).stop 2024-05-09T00:03:38.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4c9764700 1 -- 172.21.15.81:0/3890715148 shutdown_connections 2024-05-09T00:03:38.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4c9764700 1 --2- 172.21.15.81:0/3890715148 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb4b00a13b0 0x7fb4b00a3870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4c9764700 1 --2- 172.21.15.81:0/3890715148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb4c419bee0 0x7fb4c419c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4c9764700 1 --2- 172.21.15.81:0/3890715148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c4100070 0x7fb4c4197650 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4c9764700 1 --2- 172.21.15.81:0/3890715148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb4c4105190 0x7fb4c4197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4c9764700 1 -- 172.21.15.81:0/3890715148 >> 172.21.15.81:0/3890715148 conn(0x7fb4c4076fa0 msgr2=0x7fb4c4069910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4c9764700 1 -- 172.21.15.81:0/3890715148 shutdown_connections 2024-05-09T00:03:38.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:38.953+0000 7fb4c9764700 1 -- 172.21.15.81:0/3890715148 wait complete. 2024-05-09T00:03:38.961 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:03:38.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:03:39.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.089+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2686292659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b8105060 msgr2=0x7f23b810cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.089+0000 7f23bc9b5700 1 --2- 172.21.15.81:0/2686292659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b8105060 0x7f23b810cbe0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f23b000b0a0 tx=0x7f23b000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.089+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2686292659 shutdown_connections 2024-05-09T00:03:39.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.089+0000 7f23bc9b5700 1 --2- 172.21.15.81:0/2686292659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b8105060 0x7f23b810cbe0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.089+0000 7f23bc9b5700 1 --2- 172.21.15.81:0/2686292659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23b80fff40 0x7f23b8100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.089+0000 7f23bc9b5700 1 --2- 172.21.15.81:0/2686292659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23b81008f0 0x7f23b8104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.089+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2686292659 >> 172.21.15.81:0/2686292659 conn(0x7f23b80fb7e0 msgr2=0x7f23b80fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.089+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2686292659 shutdown_connections 2024-05-09T00:03:39.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.089+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2686292659 wait complete. 2024-05-09T00:03:39.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.090+0000 7f23bc9b5700 1 Processor -- start 2024-05-09T00:03:39.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.090+0000 7f23bc9b5700 1 -- start start 2024-05-09T00:03:39.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.090+0000 7f23bc9b5700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23b80fff40 0x7f23b8195d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.090+0000 7f23bc9b5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b8105060 0x7f23b8196250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.090+0000 7f23bc9b5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23b81a31a0 0x7f23b81a5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.090+0000 7f23bc9b5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81a5ad0 con 0x7f23b8105060 2024-05-09T00:03:39.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.090+0000 7f23bc9b5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81a5c40 con 0x7f23b81a31a0 2024-05-09T00:03:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.090+0000 7f23bc9b5700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81a5e00 con 0x7f23b80fff40 2024-05-09T00:03:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.090+0000 7f23b5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b8105060 0x7f23b8196250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.090+0000 7f23b5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b8105060 0x7f23b8196250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39168/0 (socket says 172.21.15.81:39168) 2024-05-09T00:03:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.090+0000 7f23b5d9b700 1 -- 172.21.15.81:0/2199371946 learned_addr learned my addr 172.21.15.81:0/2199371946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.090+0000 7f23b6d9d700 1 --2- 172.21.15.81:0/2199371946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23b81a31a0 0x7f23b81a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.090+0000 7f23b659c700 1 --2- 172.21.15.81:0/2199371946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23b80fff40 0x7f23b8195d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.091+0000 7f23b5d9b700 1 -- 172.21.15.81:0/2199371946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23b80fff40 msgr2=0x7f23b8195d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.091+0000 7f23b5d9b700 1 --2- 172.21.15.81:0/2199371946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23b80fff40 0x7f23b8195d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.091+0000 7f23b5d9b700 1 -- 172.21.15.81:0/2199371946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23b81a31a0 msgr2=0x7f23b81a5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.091+0000 7f23b5d9b700 1 --2- 172.21.15.81:0/2199371946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23b81a31a0 0x7f23b81a5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.091+0000 7f23b5d9b700 1 -- 172.21.15.81:0/2199371946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b0009d00 con 0x7f23b8105060 2024-05-09T00:03:39.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.091+0000 7f23b5d9b700 1 --2- 172.21.15.81:0/2199371946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b8105060 0x7f23b8196250 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00c9e0 tx=0x7f23ac00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.091+0000 7f23a77fe700 1 -- 172.21.15.81:0/2199371946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac007aa0 con 0x7f23b8105060 2024-05-09T00:03:39.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.091+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2199371946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b81a60e0 con 0x7f23b8105060 2024-05-09T00:03:39.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.091+0000 7f23a77fe700 1 -- 172.21.15.81:0/2199371946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23ac00ce80 con 0x7f23b8105060 2024-05-09T00:03:39.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.091+0000 7f23a77fe700 1 -- 172.21.15.81:0/2199371946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac018660 con 0x7f23b8105060 2024-05-09T00:03:39.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.091+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2199371946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b81a65f0 con 0x7f23b8105060 2024-05-09T00:03:39.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.092+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2199371946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b8108330 con 0x7f23b8105060 2024-05-09T00:03:39.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.093+0000 7f23a77fe700 1 -- 172.21.15.81:0/2199371946 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f23ac00f450 con 0x7f23b8105060 2024-05-09T00:03:39.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.094+0000 7f23a77fe700 1 --2- 172.21.15.81:0/2199371946 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f23a00a13b0 0x7f23a00a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.094+0000 7f23b659c700 1 --2- 172.21.15.81:0/2199371946 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f23a00a13b0 0x7f23a00a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.094+0000 7f23a77fe700 1 -- 172.21.15.81:0/2199371946 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f23ac0cd110 con 0x7f23b8105060 2024-05-09T00:03:39.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.094+0000 7f23b659c700 1 --2- 172.21.15.81:0/2199371946 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f23a00a13b0 0x7f23a00a3870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23a8005950 tx=0x7f23a800b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.097+0000 7f23a77fe700 1 -- 172.21.15.81:0/2199371946 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f23ac0963a0 con 0x7f23b8105060 2024-05-09T00:03:39.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:38 smithi081 ceph-mon[42474]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-09T00:03:39.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:38 smithi150 ceph-mon[46187]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-09T00:03:39.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:38 smithi171 ceph-mon[47351]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-09T00:03:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.339+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2199371946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23b8101410 con 0x7f23b8105060 2024-05-09T00:03:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.340+0000 7f23a77fe700 1 -- 172.21.15.81:0/2199371946 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10864 (secure 0 0 0) 0x7f23ac0999c0 con 0x7f23b8105060 2024-05-09T00:03:39.334 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:03:39.334 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:03:00.676924+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:03:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.342+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2199371946 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f23a00a13b0 msgr2=0x7f23a00a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.342+0000 7f23bc9b5700 1 --2- 172.21.15.81:0/2199371946 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f23a00a13b0 0x7f23a00a3870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23a8005950 tx=0x7f23a800b410 comp rx=0 tx=0).stop 2024-05-09T00:03:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.342+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2199371946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b8105060 msgr2=0x7f23b8196250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.342+0000 7f23bc9b5700 1 --2- 172.21.15.81:0/2199371946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b8105060 0x7f23b8196250 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f23ac00c9e0 tx=0x7f23ac00ccf0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.342+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2199371946 shutdown_connections 2024-05-09T00:03:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.342+0000 7f23bc9b5700 1 --2- 172.21.15.81:0/2199371946 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f23a00a13b0 0x7f23a00a3870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.342+0000 7f23bc9b5700 1 --2- 172.21.15.81:0/2199371946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23b81a31a0 0x7f23b81a5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.342+0000 7f23bc9b5700 1 --2- 172.21.15.81:0/2199371946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f23b80fff40 0x7f23b8195d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.342+0000 7f23bc9b5700 1 --2- 172.21.15.81:0/2199371946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23b8105060 0x7f23b8196250 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.342+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2199371946 >> 172.21.15.81:0/2199371946 conn(0x7f23b80fb7e0 msgr2=0x7f23b80fc320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.343+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2199371946 shutdown_connections 2024-05-09T00:03:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.343+0000 7f23bc9b5700 1 -- 172.21.15.81:0/2199371946 wait complete. 2024-05-09T00:03:39.338 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-05-09T00:03:39.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:03:39.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.478+0000 7f69dd3ec700 1 -- 172.21.15.81:0/1113350289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d8105ec0 msgr2=0x7f69d81062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.478+0000 7f69dd3ec700 1 --2- 172.21.15.81:0/1113350289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d8105ec0 0x7f69d81062a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f69cc009990 tx=0x7f69cc009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.478+0000 7f69dd3ec700 1 -- 172.21.15.81:0/1113350289 shutdown_connections 2024-05-09T00:03:39.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.478+0000 7f69dd3ec700 1 --2- 172.21.15.81:0/1113350289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69d81007c0 0x7f69d810cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.478+0000 7f69dd3ec700 1 --2- 172.21.15.81:0/1113350289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d8105ec0 0x7f69d81062a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.478+0000 7f69dd3ec700 1 --2- 172.21.15.81:0/1113350289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d80ffe00 0x7f69d8100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.478+0000 7f69dd3ec700 1 -- 172.21.15.81:0/1113350289 >> 172.21.15.81:0/1113350289 conn(0x7f69d8076f10 msgr2=0x7f69d8077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.478+0000 7f69dd3ec700 1 -- 172.21.15.81:0/1113350289 shutdown_connections 2024-05-09T00:03:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.478+0000 7f69dd3ec700 1 -- 172.21.15.81:0/1113350289 wait complete. 2024-05-09T00:03:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.478+0000 7f69dd3ec700 1 Processor -- start 2024-05-09T00:03:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.478+0000 7f69dd3ec700 1 -- start start 2024-05-09T00:03:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69dd3ec700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69d80ffe00 0x7f69d8197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69dd3ec700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d81007c0 0x7f69d8197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69dd3ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d8105ec0 0x7f69d819bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69dd3ec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d819c320 con 0x7f69d8105ec0 2024-05-09T00:03:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69dd3ec700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d819c490 con 0x7f69d81007c0 2024-05-09T00:03:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69dd3ec700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d819c650 con 0x7f69d80ffe00 2024-05-09T00:03:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69d77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d8105ec0 0x7f69d819bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69d77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d8105ec0 0x7f69d819bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39184/0 (socket says 172.21.15.81:39184) 2024-05-09T00:03:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69d77fe700 1 -- 172.21.15.81:0/75871582 learned_addr learned my addr 172.21.15.81:0/75871582 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69d67fc700 1 --2- 172.21.15.81:0/75871582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d81007c0 0x7f69d8197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/75871582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69d80ffe00 0x7f69d8197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69d77fe700 1 -- 172.21.15.81:0/75871582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69d80ffe00 msgr2=0x7f69d8197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69d77fe700 1 --2- 172.21.15.81:0/75871582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69d80ffe00 0x7f69d8197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69d77fe700 1 -- 172.21.15.81:0/75871582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d81007c0 msgr2=0x7f69d8197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69d77fe700 1 --2- 172.21.15.81:0/75871582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d81007c0 0x7f69d8197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69d77fe700 1 -- 172.21.15.81:0/75871582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc0095f0 con 0x7f69d8105ec0 2024-05-09T00:03:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69d77fe700 1 --2- 172.21.15.81:0/75871582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d8105ec0 0x7f69d819bce0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f69d0007ee0 tx=0x7f69d000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69bffff700 1 -- 172.21.15.81:0/75871582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0017070 con 0x7f69d8105ec0 2024-05-09T00:03:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69dd3ec700 1 -- 172.21.15.81:0/75871582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d819c930 con 0x7f69d8105ec0 2024-05-09T00:03:39.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69bffff700 1 -- 172.21.15.81:0/75871582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69d000f040 con 0x7f69d8105ec0 2024-05-09T00:03:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69bffff700 1 -- 172.21.15.81:0/75871582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0005740 con 0x7f69d8105ec0 2024-05-09T00:03:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.479+0000 7f69dd3ec700 1 -- 172.21.15.81:0/75871582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d81a4170 con 0x7f69d8105ec0 2024-05-09T00:03:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.482+0000 7f69bffff700 1 -- 172.21.15.81:0/75871582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f69d000dc60 con 0x7f69d8105ec0 2024-05-09T00:03:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.482+0000 7f69bffff700 1 --2- 172.21.15.81:0/75871582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f69c00a13b0 0x7f69c00a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.482+0000 7f69bffff700 1 -- 172.21.15.81:0/75871582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f69d00cc760 con 0x7f69d8105ec0 2024-05-09T00:03:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.482+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/75871582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f69c00a13b0 0x7f69c00a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.483+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/75871582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f69c00a13b0 0x7f69c00a3870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00b5c0 tx=0x7f69cc01a040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.483+0000 7f69e95a6b80 1 Processor -- start 2024-05-09T00:03:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.483+0000 7f69e95a6b80 1 -- start start 2024-05-09T00:03:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.483+0000 7f69e95a6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2ee00 0x55967ff2f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.483+0000 7f69e95a6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff2f720 0x55967ff29350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.483+0000 7f69e95a6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff29890 0x55967ff29cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.483+0000 7f69e95a6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967fe80150 con 0x55967ff2ee00 2024-05-09T00:03:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.483+0000 7f69e95a6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967fe7db10 con 0x55967ff29890 2024-05-09T00:03:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.483+0000 7f69e95a6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967fe79400 con 0x55967ff2f720 2024-05-09T00:03:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.483+0000 7f69d6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2ee00 0x55967ff2f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.483+0000 7f69d6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2ee00 0x55967ff2f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39194/0 (socket says 172.21.15.81:39194) 2024-05-09T00:03:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.483+0000 7f69d6ffd700 1 -- 172.21.15.81:0/4269475201 learned_addr learned my addr 172.21.15.81:0/4269475201 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.484+0000 7f69d67fc700 1 --2- 172.21.15.81:0/4269475201 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff2f720 0x55967ff29350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.484+0000 7f69d77fe700 1 --2- 172.21.15.81:0/4269475201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff29890 0x55967ff29cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.484+0000 7f69d6ffd700 1 -- 172.21.15.81:0/4269475201 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff2f720 msgr2=0x55967ff29350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.484+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/4269475201 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff2f720 0x55967ff29350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.484+0000 7f69d6ffd700 1 -- 172.21.15.81:0/4269475201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff29890 msgr2=0x55967ff29cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.484+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/4269475201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff29890 0x55967ff29cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.484+0000 7f69d6ffd700 1 -- 172.21.15.81:0/4269475201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55967fcfa3b0 con 0x55967ff2ee00 2024-05-09T00:03:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.484+0000 7f69d77fe700 1 --2- 172.21.15.81:0/4269475201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff29890 0x55967ff29cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.484+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/4269475201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2ee00 0x55967ff2f1e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f69cc015000 tx=0x7f69cc01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11e066e6ffad840 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.484+0000 7f69bd7fa700 1 -- 172.21.15.81:0/4269475201 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc02a070 con 0x55967ff2ee00 2024-05-09T00:03:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.484+0000 7f69bd7fa700 1 -- 172.21.15.81:0/4269475201 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69cc004c60 con 0x55967ff2ee00 2024-05-09T00:03:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.484+0000 7f69bd7fa700 1 -- 172.21.15.81:0/4269475201 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc01d040 con 0x55967ff2ee00 2024-05-09T00:03:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 -- 172.21.15.81:0/4269475201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2ee00 msgr2=0x55967ff2f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/4269475201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2ee00 0x55967ff2f1e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f69cc015000 tx=0x7f69cc01e000 comp rx=0 tx=0).stop 2024-05-09T00:03:39.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 -- 172.21.15.81:0/4269475201 shutdown_connections 2024-05-09T00:03:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/4269475201 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff29890 0x55967ff29cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/4269475201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2ee00 0x55967ff2f1e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/4269475201 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff2f720 0x55967ff29350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 -- 172.21.15.81:0/4269475201 >> 172.21.15.81:0/4269475201 conn(0x55967fe87210 msgr2=0x55967ff23df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 -- 172.21.15.81:0/4269475201 shutdown_connections 2024-05-09T00:03:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 -- 172.21.15.81:0/4269475201 wait complete. 2024-05-09T00:03:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 -- start start 2024-05-09T00:03:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 Processor -- start 2024-05-09T00:03:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff29890 0x55967ff32ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff2ee00 0x55967ff33010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2f720 0x55967ff33550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967fe15560 con 0x55967ff2f720 2024-05-09T00:03:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967fe15200 con 0x55967ff2ee00 2024-05-09T00:03:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967fcfc6a0 con 0x55967ff29890 2024-05-09T00:03:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69e95a6b80 10 client.0 _ll_register_callbacks cb 0x55967fe1eb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69d77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2f720 0x55967ff33550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69d77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2f720 0x55967ff33550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39210/0 (socket says 172.21.15.81:39210) 2024-05-09T00:03:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.485+0000 7f69d77fe700 1 -- 172.21.15.81:0/4250095297 learned_addr learned my addr 172.21.15.81:0/4250095297 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff29890 0x55967ff32ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69d67fc700 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff2ee00 0x55967ff33010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69d77fe700 1 -- 172.21.15.81:0/4250095297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff29890 msgr2=0x55967ff32ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69d77fe700 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff29890 0x55967ff32ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69d77fe700 1 -- 172.21.15.81:0/4250095297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff2ee00 msgr2=0x55967ff33010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69d77fe700 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff2ee00 0x55967ff33010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69d77fe700 1 -- 172.21.15.81:0/4250095297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d810d550 con 0x55967ff2f720 2024-05-09T00:03:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff29890 0x55967ff32ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69d67fc700 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff2ee00 0x55967ff33010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69d77fe700 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2f720 0x55967ff33550 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f69d0099320 tx=0x7f69d0099030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95320446b8a7f61b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69baff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69baff5700 1 -- 172.21.15.81:0/4250095297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d009d450 con 0x55967ff2f720 2024-05-09T00:03:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69baff5700 1 -- 172.21.15.81:0/4250095297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f69d00a1aa0 con 0x55967ff2f720 2024-05-09T00:03:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69e95a6b80 1 -- 172.21.15.81:0/4250095297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55967fdd2270 con 0x55967ff2f720 2024-05-09T00:03:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69baff5700 1 -- 172.21.15.81:0/4250095297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69d00058a0 con 0x55967ff2f720 2024-05-09T00:03:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69e95a6b80 10 client.15600 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:39.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69e95a6b80 1 -- 172.21.15.81:0/4250095297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55967fca6b60 con 0x55967ff2f720 2024-05-09T00:03:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69baff5700 1 -- 172.21.15.81:0/4250095297 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55967fdd2270 con 0x55967ff2f720 2024-05-09T00:03:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.486+0000 7f69baff5700 1 -- 172.21.15.81:0/4250095297 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f69d0005010 con 0x55967ff2f720 2024-05-09T00:03:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.487+0000 7f69e95a6b80 10 client.15600 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.487+0000 7f69e95a6b80 10 client.15600 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:03:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.487+0000 7f69e95a6b80 20 client.15600 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.487+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55967ff431f0 0x55967ff45610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.487+0000 7f69e95a6b80 4 client.15600 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:03:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.487+0000 7f69e95a6b80 1 -- 172.21.15.81:0/4250095297 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55967fef8810 con 0x55967ff431f0 2024-05-09T00:03:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.487+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55967ff431f0 0x55967ff45610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.487+0000 7f69baff5700 10 client.15600 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:03:39.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.487+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55967ff431f0 0x55967ff45610 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5403c5f43764b2f4 server_cookie=9b89aa8be8135b8e in_seq=0 out_seq=0 2024-05-09T00:03:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69baff5700 1 -- 172.21.15.81:0/4250095297 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55967fef8810 con 0x55967ff431f0 2024-05-09T00:03:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69baff5700 10 client.15600 handle_command_reply: tid=0 2024-05-09T00:03:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69e95a6b80 1 client.15600 shutdown 2024-05-09T00:03:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69e95a6b80 1 -- 172.21.15.81:0/4250095297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2f720 msgr2=0x55967ff33550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2f720 0x55967ff33550 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f69d0099320 tx=0x7f69d0099030 comp rx=0 tx=0).stop 2024-05-09T00:03:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69e95a6b80 1 -- 172.21.15.81:0/4250095297 shutdown_connections 2024-05-09T00:03:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2f720 0x55967ff33550 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff29890 0x55967ff32ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55967ff431f0 0x55967ff45610 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/4250095297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff2ee00 0x55967ff33010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69baff5700 0 client.15600 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:03:39.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69e95a6b80 1 -- 172.21.15.81:0/4250095297 >> 172.21.15.81:0/4250095297 conn(0x55967fe87210 msgr2=0x55967ff235a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69e95a6b80 1 -- 172.21.15.81:0/4250095297 shutdown_connections 2024-05-09T00:03:39.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69e95a6b80 1 -- 172.21.15.81:0/4250095297 wait complete. 2024-05-09T00:03:39.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.488+0000 7f69e95a6b80 20 client.15600 trim_cache size 0 max 16384 2024-05-09T00:03:39.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.501+0000 7f69e95a6b80 1 Processor -- start 2024-05-09T00:03:39.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.501+0000 7f69e95a6b80 1 -- start start 2024-05-09T00:03:39.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.501+0000 7f69e95a6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff29890 0x55967ff455e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.501+0000 7f69e95a6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff2ee00 0x55967ff23d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.501+0000 7f69e95a6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2f720 0x55967ff33020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.501+0000 7f69e95a6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967ff25070 con 0x55967ff2f720 2024-05-09T00:03:39.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.501+0000 7f69e95a6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967ff3fd10 con 0x55967ff29890 2024-05-09T00:03:39.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.501+0000 7f69e95a6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967ff25a20 con 0x55967ff2ee00 2024-05-09T00:03:39.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.501+0000 7f69d77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2f720 0x55967ff33020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.502+0000 7f69d77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2f720 0x55967ff33020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39212/0 (socket says 172.21.15.81:39212) 2024-05-09T00:03:39.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.502+0000 7f69d77fe700 1 -- 172.21.15.81:0/2634659962 learned_addr learned my addr 172.21.15.81:0/2634659962 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.502+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/2634659962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff29890 0x55967ff455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.502+0000 7f69d67fc700 1 --2- 172.21.15.81:0/2634659962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff2ee00 0x55967ff23d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.502+0000 7f69d77fe700 1 -- 172.21.15.81:0/2634659962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff2ee00 msgr2=0x55967ff23d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.502+0000 7f69d77fe700 1 --2- 172.21.15.81:0/2634659962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff2ee00 0x55967ff23d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.502+0000 7f69d77fe700 1 -- 172.21.15.81:0/2634659962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff29890 msgr2=0x55967ff455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.502+0000 7f69d77fe700 1 --2- 172.21.15.81:0/2634659962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff29890 0x55967ff455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.502+0000 7f69d77fe700 1 -- 172.21.15.81:0/2634659962 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55967fe3f560 con 0x55967ff2f720 2024-05-09T00:03:39.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.502+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/2634659962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff29890 0x55967ff455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:39.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.502+0000 7f69d77fe700 1 --2- 172.21.15.81:0/2634659962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2f720 0x55967ff33020 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f69d0096090 tx=0x7f69d0099780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c724b978db89a317 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.502+0000 7f69bdffb700 1 -- 172.21.15.81:0/2634659962 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d00a1aa0 con 0x55967ff2f720 2024-05-09T00:03:39.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.502+0000 7f69bdffb700 1 -- 172.21.15.81:0/2634659962 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69d009d450 con 0x55967ff2f720 2024-05-09T00:03:39.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.502+0000 7f69bdffb700 1 -- 172.21.15.81:0/2634659962 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0005b00 con 0x55967ff2f720 2024-05-09T00:03:39.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 -- 172.21.15.81:0/2634659962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2f720 msgr2=0x55967ff33020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/2634659962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2f720 0x55967ff33020 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f69d0096090 tx=0x7f69d0099780 comp rx=0 tx=0).stop 2024-05-09T00:03:39.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 -- 172.21.15.81:0/2634659962 shutdown_connections 2024-05-09T00:03:39.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/2634659962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff29890 0x55967ff455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/2634659962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff2f720 0x55967ff33020 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/2634659962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff2ee00 0x55967ff23d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 -- 172.21.15.81:0/2634659962 >> 172.21.15.81:0/2634659962 conn(0x55967fe87210 msgr2=0x55967ff20210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 -- 172.21.15.81:0/2634659962 shutdown_connections 2024-05-09T00:03:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 -- 172.21.15.81:0/2634659962 wait complete. 2024-05-09T00:03:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 -- start start 2024-05-09T00:03:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 Processor -- start 2024-05-09T00:03:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff29890 0x55967ff3a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff2ee00 0x55967ff380c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff2f720 0x55967ff38600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967ff38cf0 con 0x55967ff29890 2024-05-09T00:03:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967ff38e60 con 0x55967ff2ee00 2024-05-09T00:03:39.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967ff986f0 con 0x55967ff2f720 2024-05-09T00:03:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69e95a6b80 10 client.0 _ll_register_callbacks cb 0x55967fe1eb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69d6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff29890 0x55967ff3a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69d6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff29890 0x55967ff3a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39216/0 (socket says 172.21.15.81:39216) 2024-05-09T00:03:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69d6ffd700 1 -- 172.21.15.81:0/2517123029 learned_addr learned my addr 172.21.15.81:0/2517123029 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.503+0000 7f69d67fc700 1 --2- 172.21.15.81:0/2517123029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff2ee00 0x55967ff380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69d6ffd700 1 -- 172.21.15.81:0/2517123029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff2f720 msgr2=0x55967ff38600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/2517123029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff2f720 0x55967ff38600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69d6ffd700 1 -- 172.21.15.81:0/2517123029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff2ee00 msgr2=0x55967ff380c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/2517123029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff2ee00 0x55967ff380c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69d6ffd700 1 -- 172.21.15.81:0/2517123029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55967fca6b60 con 0x55967ff29890 2024-05-09T00:03:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69d6ffd700 1 --2- 172.21.15.81:0/2517123029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff29890 0x55967ff3a490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f69cc005330 tx=0x7f69cc005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b2e4a2b0b899c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69baff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69baff5700 1 -- 172.21.15.81:0/2517123029 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69cc01d040 con 0x55967ff29890 2024-05-09T00:03:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69baff5700 1 -- 172.21.15.81:0/2517123029 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f69cc028040 con 0x55967ff29890 2024-05-09T00:03:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69e95a6b80 1 -- 172.21.15.81:0/2517123029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f69cc004c60 con 0x55967ff29890 2024-05-09T00:03:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69baff5700 1 -- 172.21.15.81:0/2517123029 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69cc02a040 con 0x55967ff29890 2024-05-09T00:03:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69e95a6b80 10 client.15606 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69e95a6b80 1 -- 172.21.15.81:0/2517123029 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55967fcfecd0 con 0x55967ff29890 2024-05-09T00:03:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69baff5700 1 -- 172.21.15.81:0/2517123029 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f69cc004c60 con 0x55967ff29890 2024-05-09T00:03:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69baff5700 1 -- 172.21.15.81:0/2517123029 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f69cc00b7d0 con 0x55967ff29890 2024-05-09T00:03:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69e95a6b80 10 client.15606 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:39.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69e95a6b80 10 client.15606 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:03:39.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69e95a6b80 20 client.15606 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:39.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/2517123029 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55967ff99940 0x55967ff9bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69e95a6b80 4 client.15606 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:03:39.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.504+0000 7f69e95a6b80 1 -- 172.21.15.81:0/2517123029 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55967fe71ec0 con 0x55967ff99940 2024-05-09T00:03:39.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69d67fc700 1 --2- 172.21.15.81:0/2517123029 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55967ff99940 0x55967ff9bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69baff5700 10 client.15606 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:03:39.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69d67fc700 1 --2- 172.21.15.81:0/2517123029 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55967ff99940 0x55967ff9bd60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=849a6a0958e79529 server_cookie=bb2a3da637c4d2ce in_seq=0 out_seq=0 2024-05-09T00:03:39.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69baff5700 1 -- 172.21.15.81:0/2517123029 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55967fe71ec0 con 0x55967ff99940 2024-05-09T00:03:39.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69baff5700 10 client.15606 handle_command_reply: tid=0 2024-05-09T00:03:39.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69e95a6b80 1 client.15606 shutdown 2024-05-09T00:03:39.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69e95a6b80 1 -- 172.21.15.81:0/2517123029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff29890 msgr2=0x55967ff3a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/2517123029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff29890 0x55967ff3a490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f69cc005330 tx=0x7f69cc005fd0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69e95a6b80 1 -- 172.21.15.81:0/2517123029 shutdown_connections 2024-05-09T00:03:39.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/2517123029 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55967ff2f720 0x55967ff38600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/2517123029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55967ff29890 0x55967ff3a490 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/2517123029 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55967ff99940 0x55967ff9bd60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69e95a6b80 1 --2- 172.21.15.81:0/2517123029 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55967ff2ee00 0x55967ff380c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69baff5700 0 client.15606 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:03:39.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69e95a6b80 1 -- 172.21.15.81:0/2517123029 >> 172.21.15.81:0/2517123029 conn(0x55967fe87210 msgr2=0x55967ff31360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69e95a6b80 1 -- 172.21.15.81:0/2517123029 shutdown_connections 2024-05-09T00:03:39.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.505+0000 7f69e95a6b80 1 -- 172.21.15.81:0/2517123029 wait complete. 2024-05-09T00:03:39.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.506+0000 7f69e95a6b80 20 client.15606 trim_cache size 0 max 16384 2024-05-09T00:03:39.510 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:03:39.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.506+0000 7f69dd3ec700 1 -- 172.21.15.81:0/75871582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f69c00a13b0 msgr2=0x7f69c00a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.506+0000 7f69dd3ec700 1 --2- 172.21.15.81:0/75871582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f69c00a13b0 0x7f69c00a3870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00b5c0 tx=0x7f69cc01a040 comp rx=0 tx=0).stop 2024-05-09T00:03:39.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.506+0000 7f69dd3ec700 1 -- 172.21.15.81:0/75871582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d8105ec0 msgr2=0x7f69d819bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.506+0000 7f69dd3ec700 1 --2- 172.21.15.81:0/75871582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d8105ec0 0x7f69d819bce0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f69d0007ee0 tx=0x7f69d000d3b0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.506+0000 7f69dd3ec700 1 -- 172.21.15.81:0/75871582 shutdown_connections 2024-05-09T00:03:39.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.506+0000 7f69dd3ec700 1 --2- 172.21.15.81:0/75871582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f69c00a13b0 0x7f69c00a3870 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.506+0000 7f69dd3ec700 1 --2- 172.21.15.81:0/75871582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d8105ec0 0x7f69d819bce0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.506+0000 7f69dd3ec700 1 --2- 172.21.15.81:0/75871582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f69d80ffe00 0x7f69d8197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.506+0000 7f69dd3ec700 1 --2- 172.21.15.81:0/75871582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f69d81007c0 0x7f69d8197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.506+0000 7f69dd3ec700 1 -- 172.21.15.81:0/75871582 >> 172.21.15.81:0/75871582 conn(0x7f69d8076f10 msgr2=0x7f69d8104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.506+0000 7f69dd3ec700 1 -- 172.21.15.81:0/75871582 shutdown_connections 2024-05-09T00:03:39.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.506+0000 7f69dd3ec700 1 -- 172.21.15.81:0/75871582 wait complete. 2024-05-09T00:03:39.513 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:03:39.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.643+0000 7f2840b6a700 1 -- 172.21.15.81:0/663912909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c105180 msgr2=0x7f283c10cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.643+0000 7f2840b6a700 1 --2- 172.21.15.81:0/663912909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c105180 0x7f283c10cd00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f282c00b0a0 tx=0x7f282c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.643+0000 7f2840b6a700 1 -- 172.21.15.81:0/663912909 shutdown_connections 2024-05-09T00:03:39.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.643+0000 7f2840b6a700 1 --2- 172.21.15.81:0/663912909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c105180 0x7f283c10cd00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.643+0000 7f2840b6a700 1 --2- 172.21.15.81:0/663912909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f283c100060 0x7f283c100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.643+0000 7f2840b6a700 1 --2- 172.21.15.81:0/663912909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f283c100a10 0x7f283c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.643+0000 7f2840b6a700 1 -- 172.21.15.81:0/663912909 >> 172.21.15.81:0/663912909 conn(0x7f283c076f40 msgr2=0x7f283c077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.643+0000 7f2840b6a700 1 -- 172.21.15.81:0/663912909 shutdown_connections 2024-05-09T00:03:39.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.643+0000 7f2840b6a700 1 -- 172.21.15.81:0/663912909 wait complete. 2024-05-09T00:03:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f2840b6a700 1 Processor -- start 2024-05-09T00:03:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f2840b6a700 1 -- start start 2024-05-09T00:03:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f2840b6a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f283c100060 0x7f283c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f2840b6a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f283c105180 0x7f283c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f2840b6a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c198dd0 0x7f283c1a33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f2840b6a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c1a3a70 con 0x7f283c198dd0 2024-05-09T00:03:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f2840b6a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c1a3be0 con 0x7f283c105180 2024-05-09T00:03:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f2840b6a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c1a3da0 con 0x7f283c100060 2024-05-09T00:03:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f283ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c198dd0 0x7f283c1a33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f283ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c198dd0 0x7f283c1a33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39242/0 (socket says 172.21.15.81:39242) 2024-05-09T00:03:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f283ad9d700 1 -- 172.21.15.81:0/3632506371 learned_addr learned my addr 172.21.15.81:0/3632506371 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f2839d9b700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f283c105180 0x7f283c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f283a59c700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f283c100060 0x7f283c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f283ad9d700 1 -- 172.21.15.81:0/3632506371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f283c100060 msgr2=0x7f283c198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f283ad9d700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f283c100060 0x7f283c198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f283ad9d700 1 -- 172.21.15.81:0/3632506371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f283c105180 msgr2=0x7f283c198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f283ad9d700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f283c105180 0x7f283c198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f283ad9d700 1 -- 172.21.15.81:0/3632506371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c009d00 con 0x7f283c198dd0 2024-05-09T00:03:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f283a59c700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f283c100060 0x7f283c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.644+0000 7f283ad9d700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c198dd0 0x7f283c1a33d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f282c006130 tx=0x7f282c0093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.645+0000 7f28337fe700 1 -- 172.21.15.81:0/3632506371 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c00e040 con 0x7f283c198dd0 2024-05-09T00:03:39.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.645+0000 7f28337fe700 1 -- 172.21.15.81:0/3632506371 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f282c004e40 con 0x7f283c198dd0 2024-05-09T00:03:39.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.645+0000 7f2840b6a700 1 -- 172.21.15.81:0/3632506371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283c1a4020 con 0x7f283c198dd0 2024-05-09T00:03:39.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.645+0000 7f28337fe700 1 -- 172.21.15.81:0/3632506371 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c01b7d0 con 0x7f283c198dd0 2024-05-09T00:03:39.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.645+0000 7f2840b6a700 1 -- 172.21.15.81:0/3632506371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283c1a44f0 con 0x7f283c198dd0 2024-05-09T00:03:39.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.647+0000 7f28337fe700 1 -- 172.21.15.81:0/3632506371 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f282c01da40 con 0x7f283c198dd0 2024-05-09T00:03:39.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.648+0000 7f28337fe700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28280a1430 0x7f28280a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.648+0000 7f28337fe700 1 -- 172.21.15.81:0/3632506371 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f282c0ce850 con 0x7f283c198dd0 2024-05-09T00:03:39.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.648+0000 7f283a59c700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28280a1430 0x7f28280a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.648+0000 7f283a59c700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28280a1430 0x7f28280a38f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2834005fd0 tx=0x7f2834005dc0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.648+0000 7f284cd24b80 1 Processor -- start 2024-05-09T00:03:39.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.648+0000 7f284cd24b80 1 -- start start 2024-05-09T00:03:39.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f284cd24b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7efe00 0x55c83e7f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f284cd24b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7f0720 0x55c83e7ea350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f284cd24b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7ea890 0x55c83e7eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f284cd24b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c83e741150 con 0x55c83e7f0720 2024-05-09T00:03:39.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f284cd24b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c83e73eb10 con 0x55c83e7efe00 2024-05-09T00:03:39.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f284cd24b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c83e73a400 con 0x55c83e7ea890 2024-05-09T00:03:39.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f2839d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7f0720 0x55c83e7ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f2839d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7f0720 0x55c83e7ea350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39244/0 (socket says 172.21.15.81:39244) 2024-05-09T00:03:39.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f2839d9b700 1 -- 172.21.15.81:0/377328628 learned_addr learned my addr 172.21.15.81:0/377328628 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f2839d9b700 1 -- 172.21.15.81:0/377328628 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7ea890 msgr2=0x55c83e7eacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f2839d9b700 1 --2- 172.21.15.81:0/377328628 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7ea890 0x55c83e7eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f2839d9b700 1 -- 172.21.15.81:0/377328628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7efe00 msgr2=0x55c83e7f01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f2839d9b700 1 --2- 172.21.15.81:0/377328628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7efe00 0x55c83e7f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f2839d9b700 1 -- 172.21.15.81:0/377328628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c83e5bb3b0 con 0x55c83e7f0720 2024-05-09T00:03:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f2839d9b700 1 --2- 172.21.15.81:0/377328628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7f0720 0x55c83e7ea350 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f282400dc80 tx=0x7f282400df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9232c6ae3e95935 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f2830ff9700 1 -- 172.21.15.81:0/377328628 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282400fc20 con 0x55c83e7f0720 2024-05-09T00:03:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f2830ff9700 1 -- 172.21.15.81:0/377328628 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f282400fd80 con 0x55c83e7f0720 2024-05-09T00:03:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.649+0000 7f2830ff9700 1 -- 172.21.15.81:0/377328628 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282401b700 con 0x55c83e7f0720 2024-05-09T00:03:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.650+0000 7f284cd24b80 1 -- 172.21.15.81:0/377328628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7f0720 msgr2=0x55c83e7ea350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.650+0000 7f284cd24b80 1 --2- 172.21.15.81:0/377328628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7f0720 0x55c83e7ea350 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f282400dc80 tx=0x7f282400df90 comp rx=0 tx=0).stop 2024-05-09T00:03:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.650+0000 7f284cd24b80 1 -- 172.21.15.81:0/377328628 shutdown_connections 2024-05-09T00:03:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.650+0000 7f284cd24b80 1 --2- 172.21.15.81:0/377328628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7efe00 0x55c83e7f01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.650+0000 7f284cd24b80 1 --2- 172.21.15.81:0/377328628 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7ea890 0x55c83e7eacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.650+0000 7f284cd24b80 1 --2- 172.21.15.81:0/377328628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7f0720 0x55c83e7ea350 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.650+0000 7f284cd24b80 1 -- 172.21.15.81:0/377328628 >> 172.21.15.81:0/377328628 conn(0x55c83e748210 msgr2=0x55c83e7e4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.650+0000 7f284cd24b80 1 -- 172.21.15.81:0/377328628 shutdown_connections 2024-05-09T00:03:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.650+0000 7f284cd24b80 1 -- 172.21.15.81:0/377328628 wait complete. 2024-05-09T00:03:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.650+0000 7f284cd24b80 1 -- start start 2024-05-09T00:03:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f284cd24b80 1 Processor -- start 2024-05-09T00:03:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f284cd24b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7ea890 0x55c83e7f3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f284cd24b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7efe00 0x55c83e7f40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f284cd24b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7f0720 0x55c83e7f4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f284cd24b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c83e6d6560 con 0x55c83e7efe00 2024-05-09T00:03:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f284cd24b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c83e6d6200 con 0x55c83e7f0720 2024-05-09T00:03:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f284cd24b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c83e5bd6a0 con 0x55c83e7ea890 2024-05-09T00:03:39.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f284cd24b80 10 client.0 _ll_register_callbacks cb 0x55c83e6dfb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f2839d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7efe00 0x55c83e7f40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f2839d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7efe00 0x55c83e7f40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39260/0 (socket says 172.21.15.81:39260) 2024-05-09T00:03:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f2839d9b700 1 -- 172.21.15.81:0/2098728499 learned_addr learned my addr 172.21.15.81:0/2098728499 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f283ad9d700 1 --2- 172.21.15.81:0/2098728499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7f0720 0x55c83e7f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f283a59c700 1 --2- 172.21.15.81:0/2098728499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7ea890 0x55c83e7f3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f2839d9b700 1 -- 172.21.15.81:0/2098728499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7ea890 msgr2=0x55c83e7f3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f2839d9b700 1 --2- 172.21.15.81:0/2098728499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7ea890 0x55c83e7f3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f2839d9b700 1 -- 172.21.15.81:0/2098728499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7f0720 msgr2=0x55c83e7f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f2839d9b700 1 --2- 172.21.15.81:0/2098728499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7f0720 0x55c83e7f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f2839d9b700 1 -- 172.21.15.81:0/2098728499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f282400d8e0 con 0x55c83e7efe00 2024-05-09T00:03:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f2839d9b700 1 --2- 172.21.15.81:0/2098728499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7efe00 0x55c83e7f40d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2824000c00 tx=0x7f282400fc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c1900c5eab5b5e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f2821ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.651+0000 7f2821ffb700 1 -- 172.21.15.81:0/2098728499 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824020070 con 0x55c83e7efe00 2024-05-09T00:03:39.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.652+0000 7f2821ffb700 1 -- 172.21.15.81:0/2098728499 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2824004250 con 0x55c83e7efe00 2024-05-09T00:03:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.652+0000 7f284cd24b80 1 -- 172.21.15.81:0/2098728499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c83e693270 con 0x55c83e7efe00 2024-05-09T00:03:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.652+0000 7f2821ffb700 1 -- 172.21.15.81:0/2098728499 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2824005ce0 con 0x55c83e7efe00 2024-05-09T00:03:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.652+0000 7f284cd24b80 10 client.15618 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.652+0000 7f284cd24b80 1 -- 172.21.15.81:0/2098728499 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c83e567b60 con 0x55c83e7efe00 2024-05-09T00:03:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.652+0000 7f2821ffb700 1 -- 172.21.15.81:0/2098728499 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2824032020 con 0x55c83e7efe00 2024-05-09T00:03:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.652+0000 7f2821ffb700 1 -- 172.21.15.81:0/2098728499 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f28240038e0 con 0x55c83e7efe00 2024-05-09T00:03:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.652+0000 7f284cd24b80 10 client.15618 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.652+0000 7f284cd24b80 10 client.15618 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:03:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.652+0000 7f284cd24b80 20 client.15618 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.652+0000 7f284cd24b80 1 --2- 172.21.15.81:0/2098728499 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55c83e804230 0x55c83e806650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.652+0000 7f284cd24b80 4 client.15618 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:03:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.652+0000 7f284cd24b80 1 -- 172.21.15.81:0/2098728499 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c83e7b9810 con 0x55c83e804230 2024-05-09T00:03:39.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.652+0000 7f283a59c700 1 --2- 172.21.15.81:0/2098728499 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55c83e804230 0x55c83e806650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.653+0000 7f2821ffb700 10 client.15618 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:03:39.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.653+0000 7f283a59c700 1 --2- 172.21.15.81:0/2098728499 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55c83e804230 0x55c83e806650 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=64822d5c2ad8dfef server_cookie=ffc3bdc318b3bd80 in_seq=0 out_seq=0 2024-05-09T00:03:39.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.653+0000 7f2821ffb700 1 -- 172.21.15.81:0/2098728499 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c83e7b9810 con 0x55c83e804230 2024-05-09T00:03:39.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.653+0000 7f2821ffb700 10 client.15618 handle_command_reply: tid=0 2024-05-09T00:03:39.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.653+0000 7f284cd24b80 1 client.15618 shutdown 2024-05-09T00:03:39.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.654+0000 7f284cd24b80 1 -- 172.21.15.81:0/2098728499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7efe00 msgr2=0x55c83e7f40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.654+0000 7f284cd24b80 1 --2- 172.21.15.81:0/2098728499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7efe00 0x55c83e7f40d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2824000c00 tx=0x7f282400fc50 comp rx=0 tx=0).stop 2024-05-09T00:03:39.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.654+0000 7f284cd24b80 1 -- 172.21.15.81:0/2098728499 shutdown_connections 2024-05-09T00:03:39.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.654+0000 7f284cd24b80 1 --2- 172.21.15.81:0/2098728499 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55c83e804230 0x55c83e806650 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.654+0000 7f284cd24b80 1 --2- 172.21.15.81:0/2098728499 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7f0720 0x55c83e7f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.654+0000 7f2821ffb700 0 client.15618 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:03:39.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.654+0000 7f284cd24b80 1 --2- 172.21.15.81:0/2098728499 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7ea890 0x55c83e7f3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.654+0000 7f284cd24b80 1 --2- 172.21.15.81:0/2098728499 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7efe00 0x55c83e7f40d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.654+0000 7f284cd24b80 1 -- 172.21.15.81:0/2098728499 >> 172.21.15.81:0/2098728499 conn(0x55c83e748210 msgr2=0x55c83e7e45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.654+0000 7f284cd24b80 1 -- 172.21.15.81:0/2098728499 shutdown_connections 2024-05-09T00:03:39.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.654+0000 7f284cd24b80 1 -- 172.21.15.81:0/2098728499 wait complete. 2024-05-09T00:03:39.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.654+0000 7f284cd24b80 20 client.15618 trim_cache size 0 max 16384 2024-05-09T00:03:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f284cd24b80 1 Processor -- start 2024-05-09T00:03:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f284cd24b80 1 -- start start 2024-05-09T00:03:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f284cd24b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7ea890 0x55c83e7ef390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f284cd24b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7efe00 0x55c83e7e4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f284cd24b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7f0720 0x55c83e7f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f284cd24b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c83e7e58e0 con 0x55c83e7f0720 2024-05-09T00:03:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f284cd24b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c83e7ea6f0 con 0x55c83e7ea890 2024-05-09T00:03:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f284cd24b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c83e7e6640 con 0x55c83e7efe00 2024-05-09T00:03:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f283ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7f0720 0x55c83e7f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f283ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7f0720 0x55c83e7f40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39268/0 (socket says 172.21.15.81:39268) 2024-05-09T00:03:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f283ad9d700 1 -- 172.21.15.81:0/2524544910 learned_addr learned my addr 172.21.15.81:0/2524544910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f283a59c700 1 --2- 172.21.15.81:0/2524544910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7ea890 0x55c83e7ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f2839d9b700 1 --2- 172.21.15.81:0/2524544910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7efe00 0x55c83e7e4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f283ad9d700 1 -- 172.21.15.81:0/2524544910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7efe00 msgr2=0x55c83e7e4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f283ad9d700 1 --2- 172.21.15.81:0/2524544910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7efe00 0x55c83e7e4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f283ad9d700 1 -- 172.21.15.81:0/2524544910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7ea890 msgr2=0x55c83e7ef390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f283ad9d700 1 --2- 172.21.15.81:0/2524544910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7ea890 0x55c83e7ef390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.667+0000 7f283ad9d700 1 -- 172.21.15.81:0/2524544910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c83e700560 con 0x55c83e7f0720 2024-05-09T00:03:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.668+0000 7f283ad9d700 1 --2- 172.21.15.81:0/2524544910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7f0720 0x55c83e7f40e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f282c01dd90 tx=0x7f282c09b570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c1ddb64680f3ed server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.668+0000 7f28317fa700 1 -- 172.21.15.81:0/2524544910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c09b100 con 0x55c83e7f0720 2024-05-09T00:03:39.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.668+0000 7f28317fa700 1 -- 172.21.15.81:0/2524544910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f282c007930 con 0x55c83e7f0720 2024-05-09T00:03:39.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.668+0000 7f28317fa700 1 -- 172.21.15.81:0/2524544910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c099bd0 con 0x55c83e7f0720 2024-05-09T00:03:39.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.668+0000 7f284cd24b80 1 -- 172.21.15.81:0/2524544910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7f0720 msgr2=0x55c83e7f40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.668+0000 7f284cd24b80 1 --2- 172.21.15.81:0/2524544910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7f0720 0x55c83e7f40e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f282c01dd90 tx=0x7f282c09b570 comp rx=0 tx=0).stop 2024-05-09T00:03:39.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.668+0000 7f284cd24b80 1 -- 172.21.15.81:0/2524544910 shutdown_connections 2024-05-09T00:03:39.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.668+0000 7f284cd24b80 1 --2- 172.21.15.81:0/2524544910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7ea890 0x55c83e7ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.668+0000 7f284cd24b80 1 --2- 172.21.15.81:0/2524544910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7f0720 0x55c83e7f40e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.668+0000 7f284cd24b80 1 --2- 172.21.15.81:0/2524544910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7efe00 0x55c83e7e4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.668+0000 7f284cd24b80 1 -- 172.21.15.81:0/2524544910 >> 172.21.15.81:0/2524544910 conn(0x55c83e748210 msgr2=0x55c83e7eec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.668+0000 7f284cd24b80 1 -- 172.21.15.81:0/2524544910 shutdown_connections 2024-05-09T00:03:39.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.668+0000 7f284cd24b80 1 -- 172.21.15.81:0/2524544910 wait complete. 2024-05-09T00:03:39.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f284cd24b80 1 -- start start 2024-05-09T00:03:39.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f284cd24b80 1 Processor -- start 2024-05-09T00:03:39.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f284cd24b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7ea890 0x55c83e7f9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f284cd24b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7efe00 0x55c83e7f9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f284cd24b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7f0720 0x55c83e7f9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f284cd24b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c83e859820 con 0x55c83e7efe00 2024-05-09T00:03:39.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f284cd24b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c83e859990 con 0x55c83e7f0720 2024-05-09T00:03:39.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f284cd24b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c83e859b50 con 0x55c83e7ea890 2024-05-09T00:03:39.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f284cd24b80 10 client.0 _ll_register_callbacks cb 0x55c83e6dfb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:39.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f2839d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7efe00 0x55c83e7f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f2839d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7efe00 0x55c83e7f9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39270/0 (socket says 172.21.15.81:39270) 2024-05-09T00:03:39.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f2839d9b700 1 -- 172.21.15.81:0/57329237 learned_addr learned my addr 172.21.15.81:0/57329237 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f283a59c700 1 --2- 172.21.15.81:0/57329237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7ea890 0x55c83e7f9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f283ad9d700 1 --2- 172.21.15.81:0/57329237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7f0720 0x55c83e7f9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.669+0000 7f2839d9b700 1 -- 172.21.15.81:0/57329237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7ea890 msgr2=0x55c83e7f9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f2839d9b700 1 --2- 172.21.15.81:0/57329237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7ea890 0x55c83e7f9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f2839d9b700 1 -- 172.21.15.81:0/57329237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7f0720 msgr2=0x55c83e7f9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f2839d9b700 1 --2- 172.21.15.81:0/57329237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7f0720 0x55c83e7f9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f2839d9b700 1 -- 172.21.15.81:0/57329237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283c1a44f0 con 0x55c83e7efe00 2024-05-09T00:03:39.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f283ad9d700 1 --2- 172.21.15.81:0/57329237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7f0720 0x55c83e7f9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:39.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f2839d9b700 1 --2- 172.21.15.81:0/57329237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7efe00 0x55c83e7f9690 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x55c83e7e5a70 tx=0x7f2824012fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba622ef51e6bffd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f2821ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:39.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f2821ffb700 1 -- 172.21.15.81:0/57329237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2824020040 con 0x55c83e7efe00 2024-05-09T00:03:39.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f2821ffb700 1 -- 172.21.15.81:0/57329237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2824000e40 con 0x55c83e7efe00 2024-05-09T00:03:39.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f284cd24b80 1 -- 172.21.15.81:0/57329237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f282400fd80 con 0x55c83e7efe00 2024-05-09T00:03:39.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f2821ffb700 1 -- 172.21.15.81:0/57329237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2824003680 con 0x55c83e7efe00 2024-05-09T00:03:39.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f284cd24b80 10 client.15624 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:39.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f284cd24b80 1 -- 172.21.15.81:0/57329237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c83e5bfcd0 con 0x55c83e7efe00 2024-05-09T00:03:39.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f2821ffb700 1 -- 172.21.15.81:0/57329237 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2824043020 con 0x55c83e7efe00 2024-05-09T00:03:39.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f2821ffb700 1 -- 172.21.15.81:0/57329237 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2824005040 con 0x55c83e7efe00 2024-05-09T00:03:39.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f284cd24b80 10 client.15624 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:39.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f284cd24b80 10 client.15624 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:03:39.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f284cd24b80 20 client.15624 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:39.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f284cd24b80 1 --2- 172.21.15.81:0/57329237 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55c83e85afd0 0x55c83e85d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f284cd24b80 4 client.15624 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:03:39.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.670+0000 7f284cd24b80 1 -- 172.21.15.81:0/57329237 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c83e732ec0 con 0x55c83e85afd0 2024-05-09T00:03:39.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f283a59c700 1 --2- 172.21.15.81:0/57329237 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55c83e85afd0 0x55c83e85d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f283a59c700 1 --2- 172.21.15.81:0/57329237 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55c83e85afd0 0x55c83e85d3c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9b659fa76c1547dc server_cookie=4dcd637f974a57c2 in_seq=0 out_seq=0 2024-05-09T00:03:39.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f2821ffb700 10 client.15624 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:03:39.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f2821ffb700 1 -- 172.21.15.81:0/57329237 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c83e732ec0 con 0x55c83e85afd0 2024-05-09T00:03:39.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f2821ffb700 10 client.15624 handle_command_reply: tid=0 2024-05-09T00:03:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f284cd24b80 1 client.15624 shutdown 2024-05-09T00:03:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f284cd24b80 1 -- 172.21.15.81:0/57329237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7efe00 msgr2=0x55c83e7f9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f284cd24b80 1 --2- 172.21.15.81:0/57329237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7efe00 0x55c83e7f9690 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x55c83e7e5a70 tx=0x7f2824012fc0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f284cd24b80 1 -- 172.21.15.81:0/57329237 shutdown_connections 2024-05-09T00:03:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f284cd24b80 1 --2- 172.21.15.81:0/57329237 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55c83e85afd0 0x55c83e85d3c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f284cd24b80 1 --2- 172.21.15.81:0/57329237 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c83e7f0720 0x55c83e7f9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f284cd24b80 1 --2- 172.21.15.81:0/57329237 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c83e7ea890 0x55c83e7f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f284cd24b80 1 --2- 172.21.15.81:0/57329237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c83e7efe00 0x55c83e7f9690 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f2821ffb700 0 client.15624 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:03:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f284cd24b80 1 -- 172.21.15.81:0/57329237 >> 172.21.15.81:0/57329237 conn(0x55c83e748210 msgr2=0x55c83e7f5430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f284cd24b80 1 -- 172.21.15.81:0/57329237 shutdown_connections 2024-05-09T00:03:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f284cd24b80 1 -- 172.21.15.81:0/57329237 wait complete. 2024-05-09T00:03:39.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.671+0000 7f284cd24b80 20 client.15624 trim_cache size 0 max 16384 2024-05-09T00:03:39.674 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:03:39.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.672+0000 7f2840b6a700 1 -- 172.21.15.81:0/3632506371 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28280a1430 msgr2=0x7f28280a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.672+0000 7f2840b6a700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28280a1430 0x7f28280a38f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2834005fd0 tx=0x7f2834005dc0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.672+0000 7f2840b6a700 1 -- 172.21.15.81:0/3632506371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c198dd0 msgr2=0x7f283c1a33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.672+0000 7f2840b6a700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c198dd0 0x7f283c1a33d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f282c006130 tx=0x7f282c0093b0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.672+0000 7f2840b6a700 1 -- 172.21.15.81:0/3632506371 shutdown_connections 2024-05-09T00:03:39.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.672+0000 7f2840b6a700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28280a1430 0x7f28280a38f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.672+0000 7f2840b6a700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f283c198dd0 0x7f283c1a33d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.672+0000 7f2840b6a700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f283c100060 0x7f283c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.672+0000 7f2840b6a700 1 --2- 172.21.15.81:0/3632506371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f283c105180 0x7f283c198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.672+0000 7f2840b6a700 1 -- 172.21.15.81:0/3632506371 >> 172.21.15.81:0/3632506371 conn(0x7f283c076f40 msgr2=0x7f283c106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.672+0000 7f2840b6a700 1 -- 172.21.15.81:0/3632506371 shutdown_connections 2024-05-09T00:03:39.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.672+0000 7f2840b6a700 1 -- 172.21.15.81:0/3632506371 wait complete. 2024-05-09T00:03:39.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:03:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.807+0000 7fecc1615700 1 -- 172.21.15.81:0/2362133821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc101160 msgr2=0x7fecbc101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.807+0000 7fecc1615700 1 --2- 172.21.15.81:0/2362133821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc101160 0x7fecbc101540 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fecb0009990 tx=0x7fecb0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.807+0000 7fecc1615700 1 -- 172.21.15.81:0/2362133821 shutdown_connections 2024-05-09T00:03:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.807+0000 7fecc1615700 1 --2- 172.21.15.81:0/2362133821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecbc106280 0x7fecbc10de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.807+0000 7fecc1615700 1 --2- 172.21.15.81:0/2362133821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc101160 0x7fecbc101540 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.807+0000 7fecc1615700 1 --2- 172.21.15.81:0/2362133821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecbc101b10 0x7fecbc105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.807+0000 7fecc1615700 1 -- 172.21.15.81:0/2362133821 >> 172.21.15.81:0/2362133821 conn(0x7fecbc0fc9e0 msgr2=0x7fecbc0fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.807+0000 7fecc1615700 1 -- 172.21.15.81:0/2362133821 shutdown_connections 2024-05-09T00:03:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.807+0000 7fecc1615700 1 -- 172.21.15.81:0/2362133821 wait complete. 2024-05-09T00:03:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecc1615700 1 Processor -- start 2024-05-09T00:03:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecc1615700 1 -- start start 2024-05-09T00:03:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecc1615700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc101160 0x7fecbc197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecc1615700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecbc106280 0x7fecbc197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecc1615700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecbc19bd10 0x7fecbc19c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecc1615700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc19c790 con 0x7fecbc101160 2024-05-09T00:03:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecc1615700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc19c900 con 0x7fecbc19bd10 2024-05-09T00:03:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecc1615700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc19cac0 con 0x7fecbc106280 2024-05-09T00:03:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecbaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc101160 0x7fecbc197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecbaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc101160 0x7fecbc197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39284/0 (socket says 172.21.15.81:39284) 2024-05-09T00:03:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecbaffd700 1 -- 172.21.15.81:0/705312500 learned_addr learned my addr 172.21.15.81:0/705312500 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecba7fc700 1 --2- 172.21.15.81:0/705312500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecbc106280 0x7fecbc197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecbb7fe700 1 --2- 172.21.15.81:0/705312500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecbc19bd10 0x7fecbc19c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecbaffd700 1 -- 172.21.15.81:0/705312500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecbc106280 msgr2=0x7fecbc197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecbaffd700 1 --2- 172.21.15.81:0/705312500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecbc106280 0x7fecbc197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecbaffd700 1 -- 172.21.15.81:0/705312500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecbc19bd10 msgr2=0x7fecbc19c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecbaffd700 1 --2- 172.21.15.81:0/705312500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecbc19bd10 0x7fecbc19c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.808+0000 7fecbaffd700 1 -- 172.21.15.81:0/705312500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb00095f0 con 0x7fecbc101160 2024-05-09T00:03:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.809+0000 7fecbaffd700 1 --2- 172.21.15.81:0/705312500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc101160 0x7fecbc197430 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fecb0005910 tx=0x7fecb0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.809+0000 7feca3fff700 1 -- 172.21.15.81:0/705312500 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb001d070 con 0x7fecbc101160 2024-05-09T00:03:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.809+0000 7feca3fff700 1 -- 172.21.15.81:0/705312500 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecb0022470 con 0x7fecbc101160 2024-05-09T00:03:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.809+0000 7fecc1615700 1 -- 172.21.15.81:0/705312500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecbc1a3fc0 con 0x7fecbc101160 2024-05-09T00:03:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.809+0000 7feca3fff700 1 -- 172.21.15.81:0/705312500 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0017650 con 0x7fecbc101160 2024-05-09T00:03:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.809+0000 7fecc1615700 1 -- 172.21.15.81:0/705312500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecbc1a4380 con 0x7fecbc101160 2024-05-09T00:03:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.811+0000 7feca3fff700 1 -- 172.21.15.81:0/705312500 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7fecb00225e0 con 0x7fecbc101160 2024-05-09T00:03:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.812+0000 7feca3fff700 1 --2- 172.21.15.81:0/705312500 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7feca40a13b0 0x7feca40a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.812+0000 7fecba7fc700 1 --2- 172.21.15.81:0/705312500 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7feca40a13b0 0x7feca40a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.812+0000 7feca3fff700 1 -- 172.21.15.81:0/705312500 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fecb00ce2f0 con 0x7fecbc101160 2024-05-09T00:03:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.812+0000 7fecba7fc700 1 --2- 172.21.15.81:0/705312500 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7feca40a13b0 0x7feca40a3870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fecbc198980 tx=0x7fecac009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.812+0000 7feccd7cfb80 1 Processor -- start 2024-05-09T00:03:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.812+0000 7feccd7cfb80 1 -- start start 2024-05-09T00:03:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7feccd7cfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24fe00 0x5616ab2501e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7feccd7cfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab250720 0x5616ab24a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7feccd7cfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 0x5616ab24acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7feccd7cfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ab1a1150 con 0x5616ab24fe00 2024-05-09T00:03:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7feccd7cfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ab19eb10 con 0x5616ab250720 2024-05-09T00:03:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7feccd7cfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ab19a400 con 0x5616ab24a890 2024-05-09T00:03:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7fecbaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24fe00 0x5616ab2501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7fecbaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24fe00 0x5616ab2501e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39300/0 (socket says 172.21.15.81:39300) 2024-05-09T00:03:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7fecbaffd700 1 -- 172.21.15.81:0/3296369324 learned_addr learned my addr 172.21.15.81:0/3296369324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7fecba7fc700 1 --2- 172.21.15.81:0/3296369324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab250720 0x5616ab24a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7fecbaffd700 1 -- 172.21.15.81:0/3296369324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 msgr2=0x5616ab24acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7fecbb7fe700 1 --2- 172.21.15.81:0/3296369324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 0x5616ab24acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7fecbaffd700 1 --2- 172.21.15.81:0/3296369324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 0x5616ab24acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7fecbaffd700 1 -- 172.21.15.81:0/3296369324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab250720 msgr2=0x5616ab24a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7fecbaffd700 1 --2- 172.21.15.81:0/3296369324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab250720 0x5616ab24a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7fecbaffd700 1 -- 172.21.15.81:0/3296369324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616ab01b3b0 con 0x5616ab24fe00 2024-05-09T00:03:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7fecba7fc700 1 --2- 172.21.15.81:0/3296369324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab250720 0x5616ab24a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7fecbaffd700 1 --2- 172.21.15.81:0/3296369324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24fe00 0x5616ab2501e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fecb009b2b0 tx=0x7fecb0022f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222bc3ff45f2cb0f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7feca17fa700 1 -- 172.21.15.81:0/3296369324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb009ac80 con 0x5616ab24fe00 2024-05-09T00:03:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7feca17fa700 1 -- 172.21.15.81:0/3296369324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecb009ba20 con 0x5616ab24fe00 2024-05-09T00:03:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.813+0000 7feca17fa700 1 -- 172.21.15.81:0/3296369324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb009aa70 con 0x5616ab24fe00 2024-05-09T00:03:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.814+0000 7feccd7cfb80 1 -- 172.21.15.81:0/3296369324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24fe00 msgr2=0x5616ab2501e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.814+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/3296369324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24fe00 0x5616ab2501e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fecb009b2b0 tx=0x7fecb0022f90 comp rx=0 tx=0).stop 2024-05-09T00:03:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.814+0000 7feccd7cfb80 1 -- 172.21.15.81:0/3296369324 shutdown_connections 2024-05-09T00:03:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.814+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/3296369324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 0x5616ab24acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.814+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/3296369324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24fe00 0x5616ab2501e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.814+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/3296369324 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab250720 0x5616ab24a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.814+0000 7feccd7cfb80 1 -- 172.21.15.81:0/3296369324 >> 172.21.15.81:0/3296369324 conn(0x5616ab1a8210 msgr2=0x5616ab244df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.814+0000 7feccd7cfb80 1 -- 172.21.15.81:0/3296369324 shutdown_connections 2024-05-09T00:03:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.814+0000 7feccd7cfb80 1 -- 172.21.15.81:0/3296369324 wait complete. 2024-05-09T00:03:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.814+0000 7feccd7cfb80 1 -- start start 2024-05-09T00:03:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.814+0000 7feccd7cfb80 1 Processor -- start 2024-05-09T00:03:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7feccd7cfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 0x5616ab256710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7feccd7cfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24fe00 0x5616ab253990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7feccd7cfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab250720 0x5616ab254080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7feccd7cfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ab136560 con 0x5616ab24fe00 2024-05-09T00:03:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7feccd7cfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ab136200 con 0x5616ab250720 2024-05-09T00:03:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7feccd7cfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ab01d6a0 con 0x5616ab24a890 2024-05-09T00:03:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7feccd7cfb80 10 client.0 _ll_register_callbacks cb 0x5616ab13fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7fecba7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24fe00 0x5616ab253990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7fecba7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24fe00 0x5616ab253990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39314/0 (socket says 172.21.15.81:39314) 2024-05-09T00:03:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7fecba7fc700 1 -- 172.21.15.81:0/1767777040 learned_addr learned my addr 172.21.15.81:0/1767777040 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7fecbaffd700 1 --2- 172.21.15.81:0/1767777040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 0x5616ab256710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7fecbb7fe700 1 --2- 172.21.15.81:0/1767777040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab250720 0x5616ab254080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7fecba7fc700 1 -- 172.21.15.81:0/1767777040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 msgr2=0x5616ab256710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7fecba7fc700 1 --2- 172.21.15.81:0/1767777040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 0x5616ab256710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7fecba7fc700 1 -- 172.21.15.81:0/1767777040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab250720 msgr2=0x5616ab254080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7fecba7fc700 1 --2- 172.21.15.81:0/1767777040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab250720 0x5616ab254080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7fecba7fc700 1 -- 172.21.15.81:0/1767777040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecbc1a4380 con 0x5616ab24fe00 2024-05-09T00:03:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7fecba7fc700 1 --2- 172.21.15.81:0/1767777040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24fe00 0x5616ab253990 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fecac004510 tx=0x7fecac0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330310ce507d3ed1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7fec9eff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7fec9eff5700 1 -- 172.21.15.81:0/1767777040 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac027640 con 0x5616ab24fe00 2024-05-09T00:03:39.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7fec9eff5700 1 -- 172.21.15.81:0/1767777040 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fecac004540 con 0x5616ab24fe00 2024-05-09T00:03:39.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.815+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1767777040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5616ab0f3270 con 0x5616ab24fe00 2024-05-09T00:03:39.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.816+0000 7fec9eff5700 1 -- 172.21.15.81:0/1767777040 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecac0277a0 con 0x5616ab24fe00 2024-05-09T00:03:39.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.816+0000 7feccd7cfb80 10 client.15636 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:39.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.816+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1767777040 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5616aafc7b60 con 0x5616ab24fe00 2024-05-09T00:03:39.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.816+0000 7fec9eff5700 1 -- 172.21.15.81:0/1767777040 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5616ab0f3270 con 0x5616ab24fe00 2024-05-09T00:03:39.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.816+0000 7fec9eff5700 1 -- 172.21.15.81:0/1767777040 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fecac030b00 con 0x5616ab24fe00 2024-05-09T00:03:39.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.816+0000 7feccd7cfb80 10 client.15636 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:39.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.816+0000 7feccd7cfb80 10 client.15636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:39.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.816+0000 7feccd7cfb80 20 client.15636 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:39.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.816+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/1767777040 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5616ab263dc0 0x5616ab2661e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.816+0000 7feccd7cfb80 4 client.15636 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:03:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.816+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1767777040 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5616ab219810 con 0x5616ab263dc0 2024-05-09T00:03:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.816+0000 7fecbaffd700 1 --2- 172.21.15.81:0/1767777040 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5616ab263dc0 0x5616ab2661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.817+0000 7fecbaffd700 1 --2- 172.21.15.81:0/1767777040 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5616ab263dc0 0x5616ab2661e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc8304a0c9412c38 server_cookie=8db15137b1d33d6d in_seq=0 out_seq=0 2024-05-09T00:03:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.817+0000 7fec9eff5700 10 client.15636 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.817+0000 7fec9eff5700 1 -- 172.21.15.81:0/1767777040 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5616ab219810 con 0x5616ab263dc0 2024-05-09T00:03:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.817+0000 7fec9eff5700 10 client.15636 handle_command_reply: tid=0 2024-05-09T00:03:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.817+0000 7feccd7cfb80 1 client.15636 shutdown 2024-05-09T00:03:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.818+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1767777040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24fe00 msgr2=0x5616ab253990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.818+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/1767777040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24fe00 0x5616ab253990 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fecac004510 tx=0x7fecac0047c0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.818+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1767777040 shutdown_connections 2024-05-09T00:03:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.818+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/1767777040 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5616ab263dc0 0x5616ab2661e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.818+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/1767777040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab250720 0x5616ab254080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.818+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/1767777040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 0x5616ab256710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.818+0000 7fec9eff5700 0 client.15636 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.818+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/1767777040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24fe00 0x5616ab253990 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.818+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1767777040 >> 172.21.15.81:0/1767777040 conn(0x5616ab1a8210 msgr2=0x5616ab2445a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.818+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1767777040 shutdown_connections 2024-05-09T00:03:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.818+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1767777040 wait complete. 2024-05-09T00:03:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.818+0000 7feccd7cfb80 20 client.15636 trim_cache size 0 max 16384 2024-05-09T00:03:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7feccd7cfb80 1 Processor -- start 2024-05-09T00:03:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7feccd7cfb80 1 -- start start 2024-05-09T00:03:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7feccd7cfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24a890 0x5616ab254020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7feccd7cfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab24fe00 0x5616ab244d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7feccd7cfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab250720 0x5616ab256240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7feccd7cfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ab241dc0 con 0x5616ab24a890 2024-05-09T00:03:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7feccd7cfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ab26b3f0 con 0x5616ab24fe00 2024-05-09T00:03:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7feccd7cfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ab24a350 con 0x5616ab250720 2024-05-09T00:03:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7fecbaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24a890 0x5616ab254020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7fecbaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24a890 0x5616ab254020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39328/0 (socket says 172.21.15.81:39328) 2024-05-09T00:03:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7fecbaffd700 1 -- 172.21.15.81:0/3460382524 learned_addr learned my addr 172.21.15.81:0/3460382524 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7fecba7fc700 1 --2- 172.21.15.81:0/3460382524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab24fe00 0x5616ab244d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7fecbb7fe700 1 --2- 172.21.15.81:0/3460382524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab250720 0x5616ab256240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7fecbaffd700 1 -- 172.21.15.81:0/3460382524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab250720 msgr2=0x5616ab256240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7fecbaffd700 1 --2- 172.21.15.81:0/3460382524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab250720 0x5616ab256240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7fecbaffd700 1 -- 172.21.15.81:0/3460382524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab24fe00 msgr2=0x5616ab244d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7fecbaffd700 1 --2- 172.21.15.81:0/3460382524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab24fe00 0x5616ab244d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7fecbaffd700 1 -- 172.21.15.81:0/3460382524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616ab160560 con 0x5616ab24a890 2024-05-09T00:03:39.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.831+0000 7fecbb7fe700 1 --2- 172.21.15.81:0/3460382524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab250720 0x5616ab256240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.832+0000 7fecbaffd700 1 --2- 172.21.15.81:0/3460382524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24a890 0x5616ab254020 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fecb0097820 tx=0x7fecb0066040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7d75bdcf8597fb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.832+0000 7feca1ffb700 1 -- 172.21.15.81:0/3460382524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb009ac80 con 0x5616ab24a890 2024-05-09T00:03:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.832+0000 7feca1ffb700 1 -- 172.21.15.81:0/3460382524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecb009b320 con 0x5616ab24a890 2024-05-09T00:03:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.832+0000 7feca1ffb700 1 -- 172.21.15.81:0/3460382524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb009aa70 con 0x5616ab24a890 2024-05-09T00:03:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.832+0000 7feccd7cfb80 1 -- 172.21.15.81:0/3460382524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24a890 msgr2=0x5616ab254020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.832+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/3460382524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24a890 0x5616ab254020 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fecb0097820 tx=0x7fecb0066040 comp rx=0 tx=0).stop 2024-05-09T00:03:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.832+0000 7feccd7cfb80 1 -- 172.21.15.81:0/3460382524 shutdown_connections 2024-05-09T00:03:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.832+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/3460382524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab250720 0x5616ab256240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.832+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/3460382524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab24a890 0x5616ab254020 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.832+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/3460382524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab24fe00 0x5616ab244d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.832+0000 7feccd7cfb80 1 -- 172.21.15.81:0/3460382524 >> 172.21.15.81:0/3460382524 conn(0x5616ab1a8210 msgr2=0x5616ab24db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.832+0000 7feccd7cfb80 1 -- 172.21.15.81:0/3460382524 shutdown_connections 2024-05-09T00:03:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.832+0000 7feccd7cfb80 1 -- 172.21.15.81:0/3460382524 wait complete. 2024-05-09T00:03:39.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7feccd7cfb80 1 -- start start 2024-05-09T00:03:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7feccd7cfb80 1 Processor -- start 2024-05-09T00:03:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7feccd7cfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 0x5616ab25b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7feccd7cfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab24fe00 0x5616ab24ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7feccd7cfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab250720 0x5616ab24d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7feccd7cfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ab24b860 con 0x5616ab250720 2024-05-09T00:03:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7feccd7cfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ab24b9a0 con 0x5616ab24fe00 2024-05-09T00:03:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7feccd7cfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ab24bb60 con 0x5616ab24a890 2024-05-09T00:03:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7feccd7cfb80 10 client.0 _ll_register_callbacks cb 0x5616ab13fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7fecbb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab250720 0x5616ab24d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7fecbb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab250720 0x5616ab24d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39342/0 (socket says 172.21.15.81:39342) 2024-05-09T00:03:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7fecbb7fe700 1 -- 172.21.15.81:0/1355067479 learned_addr learned my addr 172.21.15.81:0/1355067479 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7fecba7fc700 1 --2- 172.21.15.81:0/1355067479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab24fe00 0x5616ab24ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7fecbaffd700 1 --2- 172.21.15.81:0/1355067479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 0x5616ab25b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7fecbb7fe700 1 -- 172.21.15.81:0/1355067479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 msgr2=0x5616ab25b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7fecbb7fe700 1 --2- 172.21.15.81:0/1355067479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 0x5616ab25b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7fecbb7fe700 1 -- 172.21.15.81:0/1355067479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab24fe00 msgr2=0x5616ab24ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7fecbb7fe700 1 --2- 172.21.15.81:0/1355067479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab24fe00 0x5616ab24ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7fecbb7fe700 1 -- 172.21.15.81:0/1355067479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb00b7040 con 0x5616ab250720 2024-05-09T00:03:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7fecbb7fe700 1 --2- 172.21.15.81:0/1355067479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab250720 0x5616ab24d150 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fecb4004040 tx=0x7fecb4004350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e666bae52babc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.833+0000 7fec9eff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7fec9eff5700 1 -- 172.21.15.81:0/1355067479 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4007710 con 0x5616ab250720 2024-05-09T00:03:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7fec9eff5700 1 -- 172.21.15.81:0/1355067479 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fecb4007870 con 0x5616ab250720 2024-05-09T00:03:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1355067479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fecb009ba20 con 0x5616ab250720 2024-05-09T00:03:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7fec9eff5700 1 -- 172.21.15.81:0/1355067479 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecb4007a70 con 0x5616ab250720 2024-05-09T00:03:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7feccd7cfb80 10 client.15642 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1355067479 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5616ab01fcd0 con 0x5616ab250720 2024-05-09T00:03:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7fec9eff5700 1 -- 172.21.15.81:0/1355067479 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecb009ba20 con 0x5616ab250720 2024-05-09T00:03:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7fec9eff5700 1 -- 172.21.15.81:0/1355067479 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fecb4018d20 con 0x5616ab250720 2024-05-09T00:03:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7feccd7cfb80 10 client.15642 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7feccd7cfb80 10 client.15642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7feccd7cfb80 20 client.15642 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/1355067479 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5616ab2bad70 0x5616ab2bd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7feccd7cfb80 4 client.15642 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:03:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1355067479 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5616ab192ec0 con 0x5616ab2bad70 2024-05-09T00:03:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.834+0000 7fecbaffd700 1 --2- 172.21.15.81:0/1355067479 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5616ab2bad70 0x5616ab2bd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7fec9eff5700 10 client.15642 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7fecbaffd700 1 --2- 172.21.15.81:0/1355067479 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5616ab2bad70 0x5616ab2bd190 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c781aab285d80c3b server_cookie=b8e4a91cf4a5843a in_seq=0 out_seq=0 2024-05-09T00:03:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7fec9eff5700 1 -- 172.21.15.81:0/1355067479 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5616ab192ec0 con 0x5616ab2bad70 2024-05-09T00:03:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7fec9eff5700 10 client.15642 handle_command_reply: tid=0 2024-05-09T00:03:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7feccd7cfb80 1 client.15642 shutdown 2024-05-09T00:03:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1355067479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab250720 msgr2=0x5616ab24d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/1355067479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab250720 0x5616ab24d150 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fecb4004040 tx=0x7fecb4004350 comp rx=0 tx=0).stop 2024-05-09T00:03:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1355067479 shutdown_connections 2024-05-09T00:03:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/1355067479 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5616ab2bad70 0x5616ab2bd190 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/1355067479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5616ab250720 0x5616ab24d150 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/1355067479 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5616ab24a890 0x5616ab25b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7fec9eff5700 0 client.15642 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7feccd7cfb80 1 --2- 172.21.15.81:0/1355067479 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5616ab24fe00 0x5616ab24ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1355067479 >> 172.21.15.81:0/1355067479 conn(0x5616ab1a8210 msgr2=0x5616ab25f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1355067479 shutdown_connections 2024-05-09T00:03:39.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7feccd7cfb80 1 -- 172.21.15.81:0/1355067479 wait complete. 2024-05-09T00:03:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.835+0000 7feccd7cfb80 20 client.15642 trim_cache size 0 max 16384 2024-05-09T00:03:39.837 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:03:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.836+0000 7fecc1615700 1 -- 172.21.15.81:0/705312500 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7feca40a13b0 msgr2=0x7feca40a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.836+0000 7fecc1615700 1 --2- 172.21.15.81:0/705312500 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7feca40a13b0 0x7feca40a3870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fecbc198980 tx=0x7fecac009260 comp rx=0 tx=0).stop 2024-05-09T00:03:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.836+0000 7fecc1615700 1 -- 172.21.15.81:0/705312500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc101160 msgr2=0x7fecbc197430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.836+0000 7fecc1615700 1 --2- 172.21.15.81:0/705312500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc101160 0x7fecbc197430 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fecb0005910 tx=0x7fecb0004730 comp rx=0 tx=0).stop 2024-05-09T00:03:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.836+0000 7fecc1615700 1 -- 172.21.15.81:0/705312500 shutdown_connections 2024-05-09T00:03:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.836+0000 7fecc1615700 1 --2- 172.21.15.81:0/705312500 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7feca40a13b0 0x7feca40a3870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.836+0000 7fecc1615700 1 --2- 172.21.15.81:0/705312500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fecbc19bd10 0x7fecbc19c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.836+0000 7fecc1615700 1 --2- 172.21.15.81:0/705312500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecbc101160 0x7fecbc197430 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.836+0000 7fecc1615700 1 --2- 172.21.15.81:0/705312500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecbc106280 0x7fecbc197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.836+0000 7fecc1615700 1 -- 172.21.15.81:0/705312500 >> 172.21.15.81:0/705312500 conn(0x7fecbc0fc9e0 msgr2=0x7fecbc0fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.836+0000 7fecc1615700 1 -- 172.21.15.81:0/705312500 shutdown_connections 2024-05-09T00:03:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:39.836+0000 7fecc1615700 1 -- 172.21.15.81:0/705312500 wait complete. 2024-05-09T00:03:40.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:39 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2199371946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:03:40.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:39 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2199371946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:03:40.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:39 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2199371946' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:03:40.842 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:03:40.843 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:03:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.991+0000 7f239bfc7700 1 -- 172.21.15.81:0/3038508920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2394100a10 msgr2=0x7f2394104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.991+0000 7f239bfc7700 1 --2- 172.21.15.81:0/3038508920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2394100a10 0x7f2394104a40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2388009990 tx=0x7f2388009ca0 comp rx=0 tx=0).stop 2024-05-09T00:03:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.991+0000 7f239bfc7700 1 -- 172.21.15.81:0/3038508920 shutdown_connections 2024-05-09T00:03:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.991+0000 7f239bfc7700 1 --2- 172.21.15.81:0/3038508920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2394100060 0x7f2394100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.991+0000 7f239bfc7700 1 --2- 172.21.15.81:0/3038508920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2394105170 0x7f239410ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.991+0000 7f239bfc7700 1 --2- 172.21.15.81:0/3038508920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2394100a10 0x7f2394104a40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.991+0000 7f239bfc7700 1 -- 172.21.15.81:0/3038508920 >> 172.21.15.81:0/3038508920 conn(0x7f2394076f30 msgr2=0x7f2394077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.992+0000 7f239bfc7700 1 -- 172.21.15.81:0/3038508920 shutdown_connections 2024-05-09T00:03:40.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.992+0000 7f239bfc7700 1 -- 172.21.15.81:0/3038508920 wait complete. 2024-05-09T00:03:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.992+0000 7f239bfc7700 1 Processor -- start 2024-05-09T00:03:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.992+0000 7f239bfc7700 1 -- start start 2024-05-09T00:03:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.992+0000 7f239bfc7700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2394100060 0x7f2394196350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.992+0000 7f239bfc7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2394105170 0x7f2394196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.992+0000 7f239bfc7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239419ac30 0x7f239419b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.992+0000 7f239bfc7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239419b6b0 con 0x7f239419ac30 2024-05-09T00:03:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.992+0000 7f239bfc7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239419b820 con 0x7f2394105170 2024-05-09T00:03:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.992+0000 7f239bfc7700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239419b9e0 con 0x7f2394100060 2024-05-09T00:03:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f239a564700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239419ac30 0x7f239419b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f239a564700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239419ac30 0x7f239419b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39362/0 (socket says 172.21.15.81:39362) 2024-05-09T00:03:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f239a564700 1 -- 172.21.15.81:0/2480349218 learned_addr learned my addr 172.21.15.81:0/2480349218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f2399d63700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2394100060 0x7f2394196350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:40.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f2399562700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2394105170 0x7f2394196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f239a564700 1 -- 172.21.15.81:0/2480349218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2394100060 msgr2=0x7f2394196350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f239a564700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2394100060 0x7f2394196350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f239a564700 1 -- 172.21.15.81:0/2480349218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2394105170 msgr2=0x7f2394196890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f239a564700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2394105170 0x7f2394196890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f239a564700 1 -- 172.21.15.81:0/2480349218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23880095f0 con 0x7f239419ac30 2024-05-09T00:03:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f2399562700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2394105170 0x7f2394196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f239a564700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239419ac30 0x7f239419b0b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2384007ee0 tx=0x7f238400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f2392ffd700 1 -- 172.21.15.81:0/2480349218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238400ddd0 con 0x7f239419ac30 2024-05-09T00:03:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f2392ffd700 1 -- 172.21.15.81:0/2480349218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f238400f040 con 0x7f239419ac30 2024-05-09T00:03:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f239bfc7700 1 -- 172.21.15.81:0/2480349218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23941a2f40 con 0x7f239419ac30 2024-05-09T00:03:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f2392ffd700 1 -- 172.21.15.81:0/2480349218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23840048e0 con 0x7f239419ac30 2024-05-09T00:03:40.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.993+0000 7f239bfc7700 1 -- 172.21.15.81:0/2480349218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23941a33d0 con 0x7f239419ac30 2024-05-09T00:03:40.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.995+0000 7f2392ffd700 1 -- 172.21.15.81:0/2480349218 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f2384003a00 con 0x7f239419ac30 2024-05-09T00:03:40.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.996+0000 7f2392ffd700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f237c0a1430 0x7f237c0a38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:40.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.996+0000 7f2399d63700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f237c0a1430 0x7f237c0a38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:40.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.996+0000 7f2392ffd700 1 -- 172.21.15.81:0/2480349218 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f23840cc890 con 0x7f239419ac30 2024-05-09T00:03:40.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.996+0000 7f2399d63700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f237c0a1430 0x7f237c0a38f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f238c005950 tx=0x7f238c00b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:40.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.997+0000 7f23a8181b80 1 Processor -- start 2024-05-09T00:03:40.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.997+0000 7f23a8181b80 1 -- start start 2024-05-09T00:03:40.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.997+0000 7f23a8181b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 0x55d4842cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.997+0000 7f23a8181b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d4842c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.997+0000 7f23a8181b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842c9910 0x55d4842c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.997+0000 7f23a8181b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4842201d0 con 0x55d4842cf7a0 2024-05-09T00:03:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.997+0000 7f23a8181b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d48421db90 con 0x55d4842c9910 2024-05-09T00:03:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.997+0000 7f23a8181b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d484219480 con 0x55d4842cee80 2024-05-09T00:03:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.997+0000 7f2399562700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d4842c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.997+0000 7f2399562700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d4842c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39368/0 (socket says 172.21.15.81:39368) 2024-05-09T00:03:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.997+0000 7f2399562700 1 -- 172.21.15.81:0/2304199382 learned_addr learned my addr 172.21.15.81:0/2304199382 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.997+0000 7f2399d63700 1 --2- 172.21.15.81:0/2304199382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 0x55d4842cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.998+0000 7f239a564700 1 --2- 172.21.15.81:0/2304199382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842c9910 0x55d4842c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.998+0000 7f2399562700 1 -- 172.21.15.81:0/2304199382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 msgr2=0x55d4842cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.998+0000 7f2399562700 1 --2- 172.21.15.81:0/2304199382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 0x55d4842cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.998+0000 7f2399562700 1 -- 172.21.15.81:0/2304199382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842c9910 msgr2=0x55d4842c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:40.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.998+0000 7f2399562700 1 --2- 172.21.15.81:0/2304199382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842c9910 0x55d4842c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.998+0000 7f2399562700 1 -- 172.21.15.81:0/2304199382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d48409a430 con 0x55d4842cf7a0 2024-05-09T00:03:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.998+0000 7f2399562700 1 --2- 172.21.15.81:0/2304199382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d4842c93d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2388003720 tx=0x7f2388009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da43ab0d381acac7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.998+0000 7f237bfff700 1 -- 172.21.15.81:0/2304199382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388020070 con 0x55d4842cf7a0 2024-05-09T00:03:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.998+0000 7f237bfff700 1 -- 172.21.15.81:0/2304199382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2388005500 con 0x55d4842cf7a0 2024-05-09T00:03:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.998+0000 7f237bfff700 1 -- 172.21.15.81:0/2304199382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2388019600 con 0x55d4842cf7a0 2024-05-09T00:03:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.999+0000 7f23a8181b80 1 -- 172.21.15.81:0/2304199382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 msgr2=0x55d4842c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.999+0000 7f23a8181b80 1 --2- 172.21.15.81:0/2304199382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d4842c93d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2388003720 tx=0x7f2388009510 comp rx=0 tx=0).stop 2024-05-09T00:03:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.999+0000 7f23a8181b80 1 -- 172.21.15.81:0/2304199382 shutdown_connections 2024-05-09T00:03:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.999+0000 7f23a8181b80 1 --2- 172.21.15.81:0/2304199382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842c9910 0x55d4842c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.999+0000 7f23a8181b80 1 --2- 172.21.15.81:0/2304199382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 0x55d4842cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.999+0000 7f23a8181b80 1 --2- 172.21.15.81:0/2304199382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d4842c93d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.999+0000 7f23a8181b80 1 -- 172.21.15.81:0/2304199382 >> 172.21.15.81:0/2304199382 conn(0x55d484227290 msgr2=0x55d4842c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.999+0000 7f23a8181b80 1 -- 172.21.15.81:0/2304199382 shutdown_connections 2024-05-09T00:03:40.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.999+0000 7f23a8181b80 1 -- 172.21.15.81:0/2304199382 wait complete. 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.999+0000 7f23a8181b80 1 -- start start 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:40.999+0000 7f23a8181b80 1 Processor -- start 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f23a8181b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842c9910 0x55d4842d2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f23a8181b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842cee80 0x55d4842d3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f23a8181b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d4842d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f23a8181b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4841b55e0 con 0x55d4842cf7a0 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f23a8181b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4841b5280 con 0x55d4842cee80 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f23a8181b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d48409c720 con 0x55d4842c9910 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f23a8181b80 10 client.0 _ll_register_callbacks cb 0x55d4841bebb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f239a564700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d4842d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f239a564700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d4842d35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39374/0 (socket says 172.21.15.81:39374) 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f239a564700 1 -- 172.21.15.81:0/2514468167 learned_addr learned my addr 172.21.15.81:0/2514468167 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f2399562700 1 --2- 172.21.15.81:0/2514468167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842cee80 0x55d4842d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f2399d63700 1 --2- 172.21.15.81:0/2514468167 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842c9910 0x55d4842d2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f239a564700 1 -- 172.21.15.81:0/2514468167 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842c9910 msgr2=0x55d4842d2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f239a564700 1 --2- 172.21.15.81:0/2514468167 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842c9910 0x55d4842d2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f239a564700 1 -- 172.21.15.81:0/2514468167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842cee80 msgr2=0x55d4842d3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f239a564700 1 --2- 172.21.15.81:0/2514468167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842cee80 0x55d4842d3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f239a564700 1 -- 172.21.15.81:0/2514468167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239410d560 con 0x55d4842cf7a0 2024-05-09T00:03:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f2399d63700 1 --2- 172.21.15.81:0/2514468167 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842c9910 0x55d4842d2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f239a564700 1 --2- 172.21.15.81:0/2514468167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d4842d35b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f23840996a0 tx=0x7f2384099610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780934b2e8a2981d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f23797fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f23797fa700 1 -- 172.21.15.81:0/2514468167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2384099710 con 0x55d4842cf7a0 2024-05-09T00:03:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f23797fa700 1 -- 172.21.15.81:0/2514468167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f238409d540 con 0x55d4842cf7a0 2024-05-09T00:03:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f23a8181b80 1 -- 172.21.15.81:0/2514468167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4841722f0 con 0x55d4842cf7a0 2024-05-09T00:03:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f23797fa700 1 -- 172.21.15.81:0/2514468167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23840a1b90 con 0x55d4842cf7a0 2024-05-09T00:03:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f23a8181b80 10 client.15654 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.000+0000 7f23a8181b80 1 -- 172.21.15.81:0/2514468167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55d484046be0 con 0x55d4842cf7a0 2024-05-09T00:03:41.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.001+0000 7f23797fa700 1 -- 172.21.15.81:0/2514468167 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d4841722f0 con 0x55d4842cf7a0 2024-05-09T00:03:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.001+0000 7f23797fa700 1 -- 172.21.15.81:0/2514468167 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2384064f30 con 0x55d4842cf7a0 2024-05-09T00:03:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.001+0000 7f23a8181b80 10 client.15654 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.001+0000 7f23a8181b80 10 client.15654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.001+0000 7f23a8181b80 20 client.15654 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.001+0000 7f23a8181b80 1 --2- 172.21.15.81:0/2514468167 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d4842e3250 0x55d4842e5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.001+0000 7f23a8181b80 4 client.15654 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:03:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.001+0000 7f23a8181b80 1 -- 172.21.15.81:0/2514468167 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d484298890 con 0x55d4842e3250 2024-05-09T00:03:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.001+0000 7f2399d63700 1 --2- 172.21.15.81:0/2514468167 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d4842e3250 0x55d4842e5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.001+0000 7f23797fa700 10 client.15654 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.001+0000 7f2399d63700 1 --2- 172.21.15.81:0/2514468167 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d4842e3250 0x55d4842e5670 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38ce8adf1cc4ff07 server_cookie=edc158622a217857 in_seq=0 out_seq=0 2024-05-09T00:03:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23797fa700 1 -- 172.21.15.81:0/2514468167 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d484298890 con 0x55d4842e3250 2024-05-09T00:03:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23797fa700 10 client.15654 handle_command_reply: tid=0 2024-05-09T00:03:41.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23a8181b80 1 client.15654 shutdown 2024-05-09T00:03:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23a8181b80 1 -- 172.21.15.81:0/2514468167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 msgr2=0x55d4842d35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23a8181b80 1 --2- 172.21.15.81:0/2514468167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d4842d35b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f23840996a0 tx=0x7f2384099610 comp rx=0 tx=0).stop 2024-05-09T00:03:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23a8181b80 1 -- 172.21.15.81:0/2514468167 shutdown_connections 2024-05-09T00:03:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23a8181b80 1 --2- 172.21.15.81:0/2514468167 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d4842e3250 0x55d4842e5670 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23a8181b80 1 --2- 172.21.15.81:0/2514468167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d4842d35b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23797fa700 0 client.15654 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23a8181b80 1 --2- 172.21.15.81:0/2514468167 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842c9910 0x55d4842d2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23a8181b80 1 --2- 172.21.15.81:0/2514468167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842cee80 0x55d4842d3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23a8181b80 1 -- 172.21.15.81:0/2514468167 >> 172.21.15.81:0/2514468167 conn(0x55d484227290 msgr2=0x55d4842c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23a8181b80 1 -- 172.21.15.81:0/2514468167 shutdown_connections 2024-05-09T00:03:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23a8181b80 1 -- 172.21.15.81:0/2514468167 wait complete. 2024-05-09T00:03:41.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.002+0000 7f23a8181b80 20 client.15654 trim_cache size 0 max 16384 2024-05-09T00:03:41.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f23a8181b80 1 Processor -- start 2024-05-09T00:03:41.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f23a8181b80 1 -- start start 2024-05-09T00:03:41.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f23a8181b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842c9910 0x55d4842ce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f23a8181b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 0x55d4842c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f23a8181b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842cf7a0 0x55d4842d33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f23a8181b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4842d5b00 con 0x55d4842c9910 2024-05-09T00:03:41.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f23a8181b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4842d4130 con 0x55d4842cf7a0 2024-05-09T00:03:41.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f23a8181b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4842c5ed0 con 0x55d4842cee80 2024-05-09T00:03:41.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f2399d63700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842c9910 0x55d4842ce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f2399d63700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842c9910 0x55d4842ce4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39390/0 (socket says 172.21.15.81:39390) 2024-05-09T00:03:41.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f2399d63700 1 -- 172.21.15.81:0/351180304 learned_addr learned my addr 172.21.15.81:0/351180304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:41.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f2399562700 1 --2- 172.21.15.81:0/351180304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 0x55d4842c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f239a564700 1 --2- 172.21.15.81:0/351180304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842cf7a0 0x55d4842d33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f2399d63700 1 -- 172.21.15.81:0/351180304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 msgr2=0x55d4842c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:41.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f2399d63700 1 --2- 172.21.15.81:0/351180304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 0x55d4842c3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f2399d63700 1 -- 172.21.15.81:0/351180304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842cf7a0 msgr2=0x55d4842d33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f2399d63700 1 --2- 172.21.15.81:0/351180304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842cf7a0 0x55d4842d33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f2399d63700 1 -- 172.21.15.81:0/351180304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4842c0560 con 0x55d4842c9910 2024-05-09T00:03:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f2399d63700 1 --2- 172.21.15.81:0/351180304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842c9910 0x55d4842ce4b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f238c010a40 tx=0x7f238c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14f7821ab75455f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.020+0000 7f2390ff9700 1 -- 172.21.15.81:0/351180304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c025070 con 0x55d4842c9910 2024-05-09T00:03:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.021+0000 7f2390ff9700 1 -- 172.21.15.81:0/351180304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f238c015070 con 0x55d4842c9910 2024-05-09T00:03:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.021+0000 7f2390ff9700 1 -- 172.21.15.81:0/351180304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c0264b0 con 0x55d4842c9910 2024-05-09T00:03:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.021+0000 7f23a8181b80 1 -- 172.21.15.81:0/351180304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842c9910 msgr2=0x55d4842ce4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.021+0000 7f23a8181b80 1 --2- 172.21.15.81:0/351180304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842c9910 0x55d4842ce4b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f238c010a40 tx=0x7f238c013000 comp rx=0 tx=0).stop 2024-05-09T00:03:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.021+0000 7f23a8181b80 1 -- 172.21.15.81:0/351180304 shutdown_connections 2024-05-09T00:03:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.021+0000 7f23a8181b80 1 --2- 172.21.15.81:0/351180304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842cf7a0 0x55d4842d33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.021+0000 7f23a8181b80 1 --2- 172.21.15.81:0/351180304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842c9910 0x55d4842ce4b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.021+0000 7f23a8181b80 1 --2- 172.21.15.81:0/351180304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 0x55d4842c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.021+0000 7f23a8181b80 1 -- 172.21.15.81:0/351180304 >> 172.21.15.81:0/351180304 conn(0x55d484227290 msgr2=0x55d4842d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:41.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.021+0000 7f23a8181b80 1 -- 172.21.15.81:0/351180304 shutdown_connections 2024-05-09T00:03:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.021+0000 7f23a8181b80 1 -- 172.21.15.81:0/351180304 wait complete. 2024-05-09T00:03:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.021+0000 7f23a8181b80 1 -- start start 2024-05-09T00:03:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.021+0000 7f23a8181b80 1 Processor -- start 2024-05-09T00:03:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f23a8181b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842c9910 0x55d4842d9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f23a8181b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 0x55d4842d9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f23a8181b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d484339780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f23a8181b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d484339cc0 con 0x55d4842cf7a0 2024-05-09T00:03:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f23a8181b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d484339e30 con 0x55d4842c9910 2024-05-09T00:03:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f23a8181b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d484339ff0 con 0x55d4842cee80 2024-05-09T00:03:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f23a8181b80 10 client.0 _ll_register_callbacks cb 0x55d4841bebb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f239a564700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d484339780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f239a564700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d484339780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39396/0 (socket says 172.21.15.81:39396) 2024-05-09T00:03:41.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f239a564700 1 -- 172.21.15.81:0/3190417146 learned_addr learned my addr 172.21.15.81:0/3190417146 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:41.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f2399d63700 1 --2- 172.21.15.81:0/3190417146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842c9910 0x55d4842d9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f2399562700 1 --2- 172.21.15.81:0/3190417146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 0x55d4842d9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f239a564700 1 -- 172.21.15.81:0/3190417146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 msgr2=0x55d4842d9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:41.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f239a564700 1 --2- 172.21.15.81:0/3190417146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 0x55d4842d9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f239a564700 1 -- 172.21.15.81:0/3190417146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842c9910 msgr2=0x55d4842d9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:41.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f239a564700 1 --2- 172.21.15.81:0/3190417146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842c9910 0x55d4842d9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.022+0000 7f239a564700 1 -- 172.21.15.81:0/3190417146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c00bdd0 con 0x55d4842cf7a0 2024-05-09T00:03:41.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f239a564700 1 --2- 172.21.15.81:0/3190417146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d484339780 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2384009570 tx=0x7f2384098c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9d2deb27efde2a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23797fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:41.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23797fa700 1 -- 172.21.15.81:0/3190417146 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2384099070 con 0x55d4842cf7a0 2024-05-09T00:03:41.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23797fa700 1 -- 172.21.15.81:0/3190417146 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f238409d540 con 0x55d4842cf7a0 2024-05-09T00:03:41.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23a8181b80 1 -- 172.21.15.81:0/3190417146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2388005500 con 0x55d4842cf7a0 2024-05-09T00:03:41.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23797fa700 1 -- 172.21.15.81:0/3190417146 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2384099710 con 0x55d4842cf7a0 2024-05-09T00:03:41.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23a8181b80 10 client.15660 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:41.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23a8181b80 1 -- 172.21.15.81:0/3190417146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55d4841df5e0 con 0x55d4842cf7a0 2024-05-09T00:03:41.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23797fa700 1 -- 172.21.15.81:0/3190417146 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2388005500 con 0x55d4842cf7a0 2024-05-09T00:03:41.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23797fa700 1 -- 172.21.15.81:0/3190417146 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f238409a2e0 con 0x55d4842cf7a0 2024-05-09T00:03:41.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23a8181b80 10 client.15660 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:41.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23a8181b80 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:41.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23a8181b80 20 client.15660 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:41.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23a8181b80 1 --2- 172.21.15.81:0/3190417146 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d48433b4b0 0x55d48433d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23a8181b80 4 client.15660 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:03:41.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f23a8181b80 1 -- 172.21.15.81:0/3190417146 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55d484211f40 con 0x55d48433b4b0 2024-05-09T00:03:41.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.023+0000 7f2399d63700 1 --2- 172.21.15.81:0/3190417146 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d48433b4b0 0x55d48433d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.024+0000 7f2399d63700 1 --2- 172.21.15.81:0/3190417146 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d48433b4b0 0x55d48433d8a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27223ed7d60f1c3b server_cookie=a5ec2780ce7ce407 in_seq=0 out_seq=0 2024-05-09T00:03:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.024+0000 7f23797fa700 10 client.15660 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23797fa700 1 -- 172.21.15.81:0/3190417146 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d484211f40 con 0x55d48433b4b0 2024-05-09T00:03:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23797fa700 10 client.15660 handle_command_reply: tid=0 2024-05-09T00:03:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23a8181b80 1 client.15660 shutdown 2024-05-09T00:03:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23a8181b80 1 -- 172.21.15.81:0/3190417146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 msgr2=0x55d484339780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23a8181b80 1 --2- 172.21.15.81:0/3190417146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d484339780 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f2384009570 tx=0x7f2384098c00 comp rx=0 tx=0).stop 2024-05-09T00:03:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23a8181b80 1 -- 172.21.15.81:0/3190417146 shutdown_connections 2024-05-09T00:03:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23a8181b80 1 --2- 172.21.15.81:0/3190417146 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d48433b4b0 0x55d48433d8a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23a8181b80 1 --2- 172.21.15.81:0/3190417146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d4842c9910 0x55d4842d9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23797fa700 0 client.15660 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23a8181b80 1 --2- 172.21.15.81:0/3190417146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d4842cf7a0 0x55d484339780 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23a8181b80 1 --2- 172.21.15.81:0/3190417146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d4842cee80 0x55d4842d9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23a8181b80 1 -- 172.21.15.81:0/3190417146 >> 172.21.15.81:0/3190417146 conn(0x55d484227290 msgr2=0x55d4842d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:41.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23a8181b80 1 -- 172.21.15.81:0/3190417146 shutdown_connections 2024-05-09T00:03:41.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23a8181b80 1 -- 172.21.15.81:0/3190417146 wait complete. 2024-05-09T00:03:41.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.025+0000 7f23a8181b80 20 client.15660 trim_cache size 0 max 16384 2024-05-09T00:03:41.026 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:03:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:03:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "0356ae91-1256-491d-96e3-8ecebbe30a8a", 2024-05-09T00:03:41.026 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:03:41.026 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:03:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.026+0000 7f239bfc7700 1 -- 172.21.15.81:0/2480349218 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f237c0a1430 msgr2=0x7f237c0a38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.026+0000 7f239bfc7700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f237c0a1430 0x7f237c0a38f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f238c005950 tx=0x7f238c00b410 comp rx=0 tx=0).stop 2024-05-09T00:03:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.026+0000 7f239bfc7700 1 -- 172.21.15.81:0/2480349218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239419ac30 msgr2=0x7f239419b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.026+0000 7f239bfc7700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239419ac30 0x7f239419b0b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2384007ee0 tx=0x7f238400d3b0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.026+0000 7f239bfc7700 1 -- 172.21.15.81:0/2480349218 shutdown_connections 2024-05-09T00:03:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.026+0000 7f239bfc7700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f237c0a1430 0x7f237c0a38f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.026+0000 7f239bfc7700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f239419ac30 0x7f239419b0b0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.026+0000 7f239bfc7700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2394100060 0x7f2394196350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.026+0000 7f239bfc7700 1 --2- 172.21.15.81:0/2480349218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2394105170 0x7f2394196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.026+0000 7f239bfc7700 1 -- 172.21.15.81:0/2480349218 >> 172.21.15.81:0/2480349218 conn(0x7f2394076f30 msgr2=0x7f23940fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:41.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.026+0000 7f239bfc7700 1 -- 172.21.15.81:0/2480349218 shutdown_connections 2024-05-09T00:03:41.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.026+0000 7f239bfc7700 1 -- 172.21.15.81:0/2480349218 wait complete. 2024-05-09T00:03:41.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:03:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.163+0000 7f4e71810700 1 -- 172.21.15.81:0/44450977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c1062a0 msgr2=0x7f4e6c10de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.163+0000 7f4e71810700 1 --2- 172.21.15.81:0/44450977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c1062a0 0x7f4e6c10de20 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400b0a0 tx=0x7f4e6400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.163+0000 7f4e71810700 1 -- 172.21.15.81:0/44450977 shutdown_connections 2024-05-09T00:03:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.163+0000 7f4e71810700 1 --2- 172.21.15.81:0/44450977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e6c069440 0x7f4e6c069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.163+0000 7f4e71810700 1 --2- 172.21.15.81:0/44450977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c1062a0 0x7f4e6c10de20 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.163+0000 7f4e71810700 1 --2- 172.21.15.81:0/44450977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e6c069df0 0x7f4e6c105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.163+0000 7f4e71810700 1 -- 172.21.15.81:0/44450977 >> 172.21.15.81:0/44450977 conn(0x7f4e6c076ba0 msgr2=0x7f4e6c076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.163+0000 7f4e71810700 1 -- 172.21.15.81:0/44450977 shutdown_connections 2024-05-09T00:03:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.163+0000 7f4e71810700 1 -- 172.21.15.81:0/44450977 wait complete. 2024-05-09T00:03:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e71810700 1 Processor -- start 2024-05-09T00:03:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e71810700 1 -- start start 2024-05-09T00:03:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e71810700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e6c069440 0x7f4e6c1996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e71810700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c1062a0 0x7f4e6c199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e71810700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e6c19dfa0 0x7f4e6c19e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e71810700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c19ea20 con 0x7f4e6c1062a0 2024-05-09T00:03:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e71810700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c19eb90 con 0x7f4e6c069440 2024-05-09T00:03:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e71810700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c19ed50 con 0x7f4e6c19dfa0 2024-05-09T00:03:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e6a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c1062a0 0x7f4e6c199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e6a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c1062a0 0x7f4e6c199c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39410/0 (socket says 172.21.15.81:39410) 2024-05-09T00:03:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/2375716781 learned_addr learned my addr 172.21.15.81:0/2375716781 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e6b7fe700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e6c19dfa0 0x7f4e6c19e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e6affd700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e6c069440 0x7f4e6c1996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/2375716781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e6c19dfa0 msgr2=0x7f4e6c19e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e6a7fc700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e6c19dfa0 0x7f4e6c19e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/2375716781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e6c069440 msgr2=0x7f4e6c1996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e6a7fc700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e6c069440 0x7f4e6c1996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/2375716781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e64009d00 con 0x7f4e6c1062a0 2024-05-09T00:03:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.164+0000 7f4e6affd700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e6c069440 0x7f4e6c1996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.165+0000 7f4e6a7fc700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c1062a0 0x7f4e6c199c00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00e970 tx=0x7f4e5c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.165+0000 7f4e7080e700 1 -- 172.21.15.81:0/2375716781 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c009790 con 0x7f4e6c1062a0 2024-05-09T00:03:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.165+0000 7f4e7080e700 1 -- 172.21.15.81:0/2375716781 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e5c00eec0 con 0x7f4e6c1062a0 2024-05-09T00:03:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.165+0000 7f4e71810700 1 -- 172.21.15.81:0/2375716781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6c1a62b0 con 0x7f4e6c1062a0 2024-05-09T00:03:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.165+0000 7f4e7080e700 1 -- 172.21.15.81:0/2375716781 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c005590 con 0x7f4e6c1062a0 2024-05-09T00:03:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.165+0000 7f4e71810700 1 -- 172.21.15.81:0/2375716781 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6c1a6790 con 0x7f4e6c1062a0 2024-05-09T00:03:41.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.167+0000 7f4e7080e700 1 -- 172.21.15.81:0/2375716781 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f4e5c00cbd0 con 0x7f4e6c1062a0 2024-05-09T00:03:41.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.168+0000 7f4e7080e700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4e540a13b0 0x7f4e540a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.168+0000 7f4e6affd700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4e540a13b0 0x7f4e540a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.168+0000 7f4e7080e700 1 -- 172.21.15.81:0/2375716781 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f4e5c014070 con 0x7f4e6c1062a0 2024-05-09T00:03:41.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.168+0000 7f4e6affd700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4e540a13b0 0x7f4e540a3870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4e60005950 tx=0x7f4e600058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e7d9cab80 1 Processor -- start 2024-05-09T00:03:41.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e7d9cab80 1 -- start start 2024-05-09T00:03:41.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e7d9cab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f58301e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e7d9cab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f582a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e7d9cab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f582acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e7d9cab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f5781150 con 0x5653f582fe00 2024-05-09T00:03:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e7d9cab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f577eb10 con 0x5653f5830720 2024-05-09T00:03:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e7d9cab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f577a400 con 0x5653f582a890 2024-05-09T00:03:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e6affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f58301e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e6affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f58301e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39420/0 (socket says 172.21.15.81:39420) 2024-05-09T00:03:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e6affd700 1 -- 172.21.15.81:0/508408727 learned_addr learned my addr 172.21.15.81:0/508408727 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e6a7fc700 1 --2- 172.21.15.81:0/508408727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f582a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e6b7fe700 1 --2- 172.21.15.81:0/508408727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f582acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e6affd700 1 -- 172.21.15.81:0/508408727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 msgr2=0x5653f582acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e6affd700 1 --2- 172.21.15.81:0/508408727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f582acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e6affd700 1 -- 172.21.15.81:0/508408727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 msgr2=0x5653f582a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e6affd700 1 --2- 172.21.15.81:0/508408727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f582a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e6affd700 1 -- 172.21.15.81:0/508408727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653f55fb3b0 con 0x5653f582fe00 2024-05-09T00:03:41.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e6affd700 1 --2- 172.21.15.81:0/508408727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f58301e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000ff00 tx=0x7f4e60012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=623c15e3249329a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.169+0000 7f4e51ffb700 1 -- 172.21.15.81:0/508408727 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60017040 con 0x5653f582fe00 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.170+0000 7f4e51ffb700 1 -- 172.21.15.81:0/508408727 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e60003d40 con 0x5653f582fe00 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.170+0000 7f4e51ffb700 1 -- 172.21.15.81:0/508408727 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6001fd10 con 0x5653f582fe00 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.170+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/508408727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 msgr2=0x5653f58301e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.170+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/508408727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f58301e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000ff00 tx=0x7f4e60012000 comp rx=0 tx=0).stop 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.170+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/508408727 shutdown_connections 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.170+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/508408727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f582acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.170+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/508408727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f58301e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.170+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/508408727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f582a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.170+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/508408727 >> 172.21.15.81:0/508408727 conn(0x5653f5788210 msgr2=0x5653f5824df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.170+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/508408727 shutdown_connections 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.170+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/508408727 wait complete. 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e7d9cab80 1 -- start start 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e7d9cab80 1 Processor -- start 2024-05-09T00:03:41.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e7d9cab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f5833a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e7d9cab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5833f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e7d9cab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f5834480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e7d9cab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f5716560 con 0x5653f582fe00 2024-05-09T00:03:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e7d9cab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f5716200 con 0x5653f5830720 2024-05-09T00:03:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e7d9cab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f55fd6a0 con 0x5653f582a890 2024-05-09T00:03:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e7d9cab80 10 client.0 _ll_register_callbacks cb 0x5653f571fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e6a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5833f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e6a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5833f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39422/0 (socket says 172.21.15.81:39422) 2024-05-09T00:03:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/319400622 learned_addr learned my addr 172.21.15.81:0/319400622 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e6affd700 1 --2- 172.21.15.81:0/319400622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f5833a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e6b7fe700 1 --2- 172.21.15.81:0/319400622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f5834480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/319400622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 msgr2=0x5653f5833a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e6a7fc700 1 --2- 172.21.15.81:0/319400622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f5833a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/319400622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 msgr2=0x5653f5834480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e6a7fc700 1 --2- 172.21.15.81:0/319400622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f5834480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.171+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/319400622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6000fbe0 con 0x5653f582fe00 2024-05-09T00:03:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e6a7fc700 1 --2- 172.21.15.81:0/319400622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5833f40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c096550 tx=0x7f4e5c09a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e573987efa76cf35 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e4affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e4affd700 1 -- 172.21.15.81:0/319400622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0a24d0 con 0x5653f582fe00 2024-05-09T00:03:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e4affd700 1 -- 172.21.15.81:0/319400622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f4e5c09a4c0 con 0x5653f582fe00 2024-05-09T00:03:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/319400622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653f56d3270 con 0x5653f582fe00 2024-05-09T00:03:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e4affd700 1 -- 172.21.15.81:0/319400622 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e5c07a050 con 0x5653f582fe00 2024-05-09T00:03:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e7d9cab80 10 client.15672 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/319400622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5653f55a7b60 con 0x5653f582fe00 2024-05-09T00:03:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e4affd700 1 -- 172.21.15.81:0/319400622 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5653f56d3270 con 0x5653f582fe00 2024-05-09T00:03:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e4affd700 1 -- 172.21.15.81:0/319400622 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4e5c0a2040 con 0x5653f582fe00 2024-05-09T00:03:41.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e7d9cab80 10 client.15672 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e7d9cab80 10 client.15672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e7d9cab80 20 client.15672 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/319400622 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5653f58440d0 0x5653f58464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e7d9cab80 4 client.15672 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:03:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.172+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/319400622 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653f57f9810 con 0x5653f58440d0 2024-05-09T00:03:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.173+0000 7f4e6affd700 1 --2- 172.21.15.81:0/319400622 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5653f58440d0 0x5653f58464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.173+0000 7f4e4affd700 10 client.15672 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.173+0000 7f4e6affd700 1 --2- 172.21.15.81:0/319400622 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5653f58440d0 0x5653f58464f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc79f1c821fcf01a server_cookie=bcd13a9e257cdc30 in_seq=0 out_seq=0 2024-05-09T00:03:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.173+0000 7f4e4affd700 1 -- 172.21.15.81:0/319400622 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5653f57f9810 con 0x5653f58440d0 2024-05-09T00:03:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.173+0000 7f4e4affd700 10 client.15672 handle_command_reply: tid=0 2024-05-09T00:03:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.173+0000 7f4e7d9cab80 1 client.15672 shutdown 2024-05-09T00:03:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.174+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/319400622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 msgr2=0x5653f5833f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.174+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/319400622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5833f40 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c096550 tx=0x7f4e5c09a0d0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.174+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/319400622 shutdown_connections 2024-05-09T00:03:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.174+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/319400622 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5653f58440d0 0x5653f58464f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.174+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/319400622 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f5834480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.174+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/319400622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f5833a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.174+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/319400622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5833f40 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.174+0000 7f4e4affd700 0 client.15672 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.174+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/319400622 >> 172.21.15.81:0/319400622 conn(0x5653f5788210 msgr2=0x5653f58245a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.174+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/319400622 shutdown_connections 2024-05-09T00:03:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.174+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/319400622 wait complete. 2024-05-09T00:03:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.174+0000 7f4e7d9cab80 20 client.15672 trim_cache size 0 max 16384 2024-05-09T00:03:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e7d9cab80 1 Processor -- start 2024-05-09T00:03:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e7d9cab80 1 -- start start 2024-05-09T00:03:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e7d9cab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f582a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e7d9cab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5824d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e7d9cab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f58342a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e7d9cab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f5821dc0 con 0x5653f582fe00 2024-05-09T00:03:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e7d9cab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f584b6c0 con 0x5653f5830720 2024-05-09T00:03:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e7d9cab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f581f800 con 0x5653f582a890 2024-05-09T00:03:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e6a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5824d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e6a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5824d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39438/0 (socket says 172.21.15.81:39438) 2024-05-09T00:03:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/729179784 learned_addr learned my addr 172.21.15.81:0/729179784 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e6b7fe700 1 --2- 172.21.15.81:0/729179784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f58342a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e6affd700 1 --2- 172.21.15.81:0/729179784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f582a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/729179784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 msgr2=0x5653f582a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e6a7fc700 1 --2- 172.21.15.81:0/729179784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f582a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/729179784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 msgr2=0x5653f58342a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e6a7fc700 1 --2- 172.21.15.81:0/729179784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f58342a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/729179784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653f5740560 con 0x5653f582fe00 2024-05-09T00:03:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e6b7fe700 1 --2- 172.21.15.81:0/729179784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f58342a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e6a7fc700 1 --2- 172.21.15.81:0/729179784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5824d20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00c5b0 tx=0x7f4e5c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35888f7a5ae5e31f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.191+0000 7f4e527fc700 1 -- 172.21.15.81:0/729179784 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c07a050 con 0x5653f582fe00 2024-05-09T00:03:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.192+0000 7f4e527fc700 1 -- 172.21.15.81:0/729179784 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e5c0999b0 con 0x5653f582fe00 2024-05-09T00:03:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.192+0000 7f4e527fc700 1 -- 172.21.15.81:0/729179784 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c099540 con 0x5653f582fe00 2024-05-09T00:03:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.192+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/729179784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 msgr2=0x5653f5824d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.192+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/729179784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5824d20 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00c5b0 tx=0x7f4e5c00ced0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.192+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/729179784 shutdown_connections 2024-05-09T00:03:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.192+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/729179784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f58342a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.192+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/729179784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f582a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.192+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/729179784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5824d20 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.192+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/729179784 >> 172.21.15.81:0/729179784 conn(0x5653f5788210 msgr2=0x5653f58322d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.192+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/729179784 shutdown_connections 2024-05-09T00:03:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.192+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/729179784 wait complete. 2024-05-09T00:03:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.192+0000 7f4e7d9cab80 1 -- start start 2024-05-09T00:03:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e7d9cab80 1 Processor -- start 2024-05-09T00:03:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e7d9cab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f5839340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e7d9cab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5839880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e7d9cab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f5899590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e7d9cab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f5899ad0 con 0x5653f582fe00 2024-05-09T00:03:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e7d9cab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f5899c10 con 0x5653f5830720 2024-05-09T00:03:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e7d9cab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653f5899d50 con 0x5653f582a890 2024-05-09T00:03:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e7d9cab80 10 client.0 _ll_register_callbacks cb 0x5653f571fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e6a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5839880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e6a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5839880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39446/0 (socket says 172.21.15.81:39446) 2024-05-09T00:03:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/2218238508 learned_addr learned my addr 172.21.15.81:0/2218238508 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e6b7fe700 1 --2- 172.21.15.81:0/2218238508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f5899590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e6affd700 1 --2- 172.21.15.81:0/2218238508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f5839340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/2218238508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 msgr2=0x5653f5839340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e6a7fc700 1 --2- 172.21.15.81:0/2218238508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f5839340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/2218238508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 msgr2=0x5653f5899590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e6a7fc700 1 --2- 172.21.15.81:0/2218238508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f5899590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e6a7fc700 1 -- 172.21.15.81:0/2218238508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653f55a7b60 con 0x5653f582fe00 2024-05-09T00:03:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e6affd700 1 --2- 172.21.15.81:0/2218238508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f5839340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e6a7fc700 1 --2- 172.21.15.81:0/2218238508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5839880 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c096550 tx=0x7f4e5c099c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77d00bfa18792f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.193+0000 7f4e4affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e4affd700 1 -- 172.21.15.81:0/2218238508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c07a040 con 0x5653f582fe00 2024-05-09T00:03:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e4affd700 1 -- 172.21.15.81:0/2218238508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f4e5c0a2040 con 0x5653f582fe00 2024-05-09T00:03:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/2218238508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e60003d40 con 0x5653f582fe00 2024-05-09T00:03:41.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e4affd700 1 -- 172.21.15.81:0/2218238508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e5c0b8250 con 0x5653f582fe00 2024-05-09T00:03:41.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e7d9cab80 10 client.15678 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:41.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/2218238508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5653f55ffcd0 con 0x5653f582fe00 2024-05-09T00:03:41.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e4affd700 1 -- 172.21.15.81:0/2218238508 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e60003d40 con 0x5653f582fe00 2024-05-09T00:03:41.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e4affd700 1 -- 172.21.15.81:0/2218238508 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4e5c099040 con 0x5653f582fe00 2024-05-09T00:03:41.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e7d9cab80 10 client.15678 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:41.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e7d9cab80 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:41.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e7d9cab80 20 client.15678 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:41.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/2218238508 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5653f589b020 0x5653f589d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:41.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e7d9cab80 4 client.15678 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:03:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/2218238508 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5653f5772ec0 con 0x5653f589b020 2024-05-09T00:03:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.194+0000 7f4e6affd700 1 --2- 172.21.15.81:0/2218238508 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5653f589b020 0x5653f589d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e4affd700 10 client.15678 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e6affd700 1 --2- 172.21.15.81:0/2218238508 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5653f589b020 0x5653f589d410 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22525e9d123a56e3 server_cookie=c9953fce24ce3acf in_seq=0 out_seq=0 2024-05-09T00:03:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e4affd700 1 -- 172.21.15.81:0/2218238508 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x7f4e60031110 con 0x5653f589b020 2024-05-09T00:03:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e4affd700 10 client.15678 handle_command_reply: tid=0 2024-05-09T00:03:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e7d9cab80 1 client.15678 shutdown 2024-05-09T00:03:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/2218238508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 msgr2=0x5653f5839880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/2218238508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5839880 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c096550 tx=0x7f4e5c099c10 comp rx=0 tx=0).stop 2024-05-09T00:03:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/2218238508 shutdown_connections 2024-05-09T00:03:41.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/2218238508 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5653f589b020 0x5653f589d410 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/2218238508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5653f5830720 0x5653f5899590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e4affd700 0 client.15678 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:41.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/2218238508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5653f582a890 0x5653f5839340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e7d9cab80 1 --2- 172.21.15.81:0/2218238508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5653f582fe00 0x5653f5839880 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/2218238508 >> 172.21.15.81:0/2218238508 conn(0x5653f5788210 msgr2=0x5653f5830b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:41.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/2218238508 shutdown_connections 2024-05-09T00:03:41.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e7d9cab80 1 -- 172.21.15.81:0/2218238508 wait complete. 2024-05-09T00:03:41.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.195+0000 7f4e7d9cab80 20 client.15678 trim_cache size 0 max 16384 2024-05-09T00:03:41.198 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:03:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:03:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:03:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: "0356ae91-1256-491d-96e3-8ecebbe30a8a": { 2024-05-09T00:03:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:03:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "0356ae91-1256-491d-96e3-8ecebbe30a8a", 2024-05-09T00:03:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:03:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:03:41.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:03:41.199 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:03:41.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.196+0000 7f4e71810700 1 -- 172.21.15.81:0/2375716781 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4e540a13b0 msgr2=0x7f4e540a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.196+0000 7f4e71810700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4e540a13b0 0x7f4e540a3870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4e60005950 tx=0x7f4e600058e0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.196+0000 7f4e71810700 1 -- 172.21.15.81:0/2375716781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c1062a0 msgr2=0x7f4e6c199c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:41.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.196+0000 7f4e71810700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c1062a0 0x7f4e6c199c00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c00e970 tx=0x7f4e5c00ec80 comp rx=0 tx=0).stop 2024-05-09T00:03:41.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.196+0000 7f4e71810700 1 -- 172.21.15.81:0/2375716781 shutdown_connections 2024-05-09T00:03:41.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.196+0000 7f4e71810700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4e540a13b0 0x7f4e540a3870 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.196+0000 7f4e71810700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e6c069440 0x7f4e6c1996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.196+0000 7f4e71810700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e6c19dfa0 0x7f4e6c19e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.196+0000 7f4e71810700 1 --2- 172.21.15.81:0/2375716781 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e6c1062a0 0x7f4e6c199c00 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:41.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.196+0000 7f4e71810700 1 -- 172.21.15.81:0/2375716781 >> 172.21.15.81:0/2375716781 conn(0x7f4e6c076ba0 msgr2=0x7f4e6c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:41.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.196+0000 7f4e71810700 1 -- 172.21.15.81:0/2375716781 shutdown_connections 2024-05-09T00:03:41.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:03:41.196+0000 7f4e71810700 1 -- 172.21.15.81:0/2375716781 wait complete. 2024-05-09T00:03:41.201 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:40 smithi081 ceph-mon[42474]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 8 op/s 2024-05-09T00:03:41.202 INFO:tasks.cephfs.filesystem:scrub status for tag:0356ae91-1256-491d-96e3-8ecebbe30a8a - {'path': '/', 'tag': '0356ae91-1256-491d-96e3-8ecebbe30a8a', 'options': 'recursive,force'} 2024-05-09T00:03:41.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:40 smithi150 ceph-mon[46187]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 8 op/s 2024-05-09T00:03:41.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:40 smithi171 ceph-mon[47351]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 8 op/s 2024-05-09T00:03:42.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:41 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:03:42.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:41 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:03:42.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:41 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:03:42.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:41 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:03:42.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:41 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:03:42.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:41 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:03:42.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:41 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:03:42.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:41 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:03:42.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:41 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:03:42.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:41 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:03:42.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:41 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:03:42.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:41 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:03:43.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:42 smithi150 ceph-mon[46187]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-05-09T00:03:43.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:42 smithi171 ceph-mon[47351]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-05-09T00:03:43.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:42 smithi081 ceph-mon[42474]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 6 op/s 2024-05-09T00:03:44.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:44 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:03:44.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:44 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:03:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:44 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:03:45.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:45 smithi171 ceph-mon[47351]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-09T00:03:45.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:45 smithi081 ceph-mon[42474]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-09T00:03:46.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:45 smithi150 ceph-mon[46187]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 9 op/s 2024-05-09T00:03:47.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:46 smithi150 ceph-mon[46187]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-09T00:03:47.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:46 smithi171 ceph-mon[47351]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-09T00:03:47.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:46 smithi081 ceph-mon[42474]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-09T00:03:49.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:48 smithi150 ceph-mon[46187]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-09T00:03:49.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:48 smithi171 ceph-mon[47351]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-09T00:03:49.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:48 smithi081 ceph-mon[42474]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-09T00:03:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.750+0000 7f31a4e5d700 1 -- 172.21.15.81:0/434225127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31a0105130 msgr2=0x7f31a010ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.750+0000 7f31a4e5d700 1 --2- 172.21.15.81:0/434225127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31a0105130 0x7f31a010ccb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f319800b0a0 tx=0x7f319800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.750+0000 7f31a4e5d700 1 -- 172.21.15.81:0/434225127 shutdown_connections 2024-05-09T00:03:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.750+0000 7f31a4e5d700 1 --2- 172.21.15.81:0/434225127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31a0105130 0x7f31a010ccb0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.750+0000 7f31a4e5d700 1 --2- 172.21.15.81:0/434225127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31a0100010 0x7f31a01003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.750+0000 7f31a4e5d700 1 --2- 172.21.15.81:0/434225127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a01009c0 0x7f31a0104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.750+0000 7f31a4e5d700 1 -- 172.21.15.81:0/434225127 >> 172.21.15.81:0/434225127 conn(0x7f31a0076f40 msgr2=0x7f31a0077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:49.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.750+0000 7f31a4e5d700 1 -- 172.21.15.81:0/434225127 shutdown_connections 2024-05-09T00:03:49.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.750+0000 7f31a4e5d700 1 -- 172.21.15.81:0/434225127 wait complete. 2024-05-09T00:03:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f31a4e5d700 1 Processor -- start 2024-05-09T00:03:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f31a4e5d700 1 -- start start 2024-05-09T00:03:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f31a4e5d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31a0100010 0x7f31a0197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f31a4e5d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31a0105130 0x7f31a0197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f31a4e5d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a019bde0 0x7f31a019c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f31a4e5d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a019c860 con 0x7f31a0100010 2024-05-09T00:03:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f31a4e5d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a019c9d0 con 0x7f31a019bde0 2024-05-09T00:03:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f31a4e5d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a019cb90 con 0x7f31a0105130 2024-05-09T00:03:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f319e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31a0100010 0x7f31a0197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f319e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31a0100010 0x7f31a0197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35844/0 (socket says 172.21.15.81:35844) 2024-05-09T00:03:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f319e59c700 1 -- 172.21.15.81:0/3704835052 learned_addr learned my addr 172.21.15.81:0/3704835052 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f319dd9b700 1 --2- 172.21.15.81:0/3704835052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31a0105130 0x7f31a0197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f319ed9d700 1 --2- 172.21.15.81:0/3704835052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a019bde0 0x7f31a019c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f319e59c700 1 -- 172.21.15.81:0/3704835052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31a0105130 msgr2=0x7f31a0197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:49.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f319e59c700 1 --2- 172.21.15.81:0/3704835052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31a0105130 0x7f31a0197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f319e59c700 1 -- 172.21.15.81:0/3704835052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a019bde0 msgr2=0x7f31a019c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f319e59c700 1 --2- 172.21.15.81:0/3704835052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a019bde0 0x7f31a019c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f319e59c700 1 -- 172.21.15.81:0/3704835052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3198009d00 con 0x7f31a0100010 2024-05-09T00:03:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.751+0000 7f319e59c700 1 --2- 172.21.15.81:0/3704835052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31a0100010 0x7f31a0197500 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f319000d950 tx=0x7f319000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.752+0000 7f318f7fe700 1 -- 172.21.15.81:0/3704835052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319000f890 con 0x7f31a0100010 2024-05-09T00:03:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.752+0000 7f318f7fe700 1 -- 172.21.15.81:0/3704835052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3190010460 con 0x7f31a0100010 2024-05-09T00:03:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.752+0000 7f31a4e5d700 1 -- 172.21.15.81:0/3704835052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a01a40f0 con 0x7f31a0100010 2024-05-09T00:03:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.752+0000 7f318f7fe700 1 -- 172.21.15.81:0/3704835052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319000e610 con 0x7f31a0100010 2024-05-09T00:03:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.752+0000 7f31a4e5d700 1 -- 172.21.15.81:0/3704835052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a01a45d0 con 0x7f31a0100010 2024-05-09T00:03:49.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.754+0000 7f318f7fe700 1 -- 172.21.15.81:0/3704835052 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f31900108d0 con 0x7f31a0100010 2024-05-09T00:03:49.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.754+0000 7f318f7fe700 1 --2- 172.21.15.81:0/3704835052 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f31880a13b0 0x7f31880a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.754+0000 7f318f7fe700 1 -- 172.21.15.81:0/3704835052 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f31900ccd50 con 0x7f31a0100010 2024-05-09T00:03:49.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.754+0000 7f319dd9b700 1 --2- 172.21.15.81:0/3704835052 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f31880a13b0 0x7f31880a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.755+0000 7f319dd9b700 1 --2- 172.21.15.81:0/3704835052 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f31880a13b0 0x7f31880a3870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f31a0198a50 tx=0x7f3194009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:49.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.755+0000 7f31b1017b80 1 Processor -- start 2024-05-09T00:03:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f31b1017b80 1 -- start start 2024-05-09T00:03:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f31b1017b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b6950 0x55e0bb1b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f31b1017b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b7270 0x55e0bb1b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f31b1017b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b1480 0x55e0bb1b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f31b1017b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bb1080f0 con 0x55e0bb1b7270 2024-05-09T00:03:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f31b1017b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bb105ab0 con 0x55e0bb1b6950 2024-05-09T00:03:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f31b1017b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bb1013a0 con 0x55e0bb1b1480 2024-05-09T00:03:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f319dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b7270 0x55e0bb1b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f319dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b7270 0x55e0bb1b0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35852/0 (socket says 172.21.15.81:35852) 2024-05-09T00:03:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f319dd9b700 1 -- 172.21.15.81:0/958861184 learned_addr learned my addr 172.21.15.81:0/958861184 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f319ed9d700 1 --2- 172.21.15.81:0/958861184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b1480 0x55e0bb1b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f319dd9b700 1 -- 172.21.15.81:0/958861184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b1480 msgr2=0x55e0bb1b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f319dd9b700 1 --2- 172.21.15.81:0/958861184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b1480 0x55e0bb1b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f319e59c700 1 --2- 172.21.15.81:0/958861184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b6950 0x55e0bb1b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f319dd9b700 1 -- 172.21.15.81:0/958861184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b6950 msgr2=0x55e0bb1b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f319dd9b700 1 --2- 172.21.15.81:0/958861184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b6950 0x55e0bb1b6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f319dd9b700 1 -- 172.21.15.81:0/958861184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0baf82350 con 0x55e0bb1b7270 2024-05-09T00:03:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f319ed9d700 1 --2- 172.21.15.81:0/958861184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b1480 0x55e0bb1b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:03:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f319dd9b700 1 --2- 172.21.15.81:0/958861184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b7270 0x55e0bb1b0f40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3194011d10 tx=0x7f3194014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914ffb066e9543fa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f318cff9700 1 -- 172.21.15.81:0/958861184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194011d40 con 0x55e0bb1b7270 2024-05-09T00:03:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f318cff9700 1 -- 172.21.15.81:0/958861184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31940044e0 con 0x55e0bb1b7270 2024-05-09T00:03:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.756+0000 7f318cff9700 1 -- 172.21.15.81:0/958861184 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3194003be0 con 0x55e0bb1b7270 2024-05-09T00:03:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.757+0000 7f31b1017b80 1 -- 172.21.15.81:0/958861184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b7270 msgr2=0x55e0bb1b0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.757+0000 7f31b1017b80 1 --2- 172.21.15.81:0/958861184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b7270 0x55e0bb1b0f40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3194011d10 tx=0x7f3194014000 comp rx=0 tx=0).stop 2024-05-09T00:03:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.757+0000 7f31b1017b80 1 -- 172.21.15.81:0/958861184 shutdown_connections 2024-05-09T00:03:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.757+0000 7f31b1017b80 1 --2- 172.21.15.81:0/958861184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b6950 0x55e0bb1b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.757+0000 7f31b1017b80 1 --2- 172.21.15.81:0/958861184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b1480 0x55e0bb1b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.757+0000 7f31b1017b80 1 --2- 172.21.15.81:0/958861184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b7270 0x55e0bb1b0f40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.757+0000 7f31b1017b80 1 -- 172.21.15.81:0/958861184 >> 172.21.15.81:0/958861184 conn(0x55e0bb10f1b0 msgr2=0x55e0bb1ab840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.757+0000 7f31b1017b80 1 -- 172.21.15.81:0/958861184 shutdown_connections 2024-05-09T00:03:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.757+0000 7f31b1017b80 1 -- 172.21.15.81:0/958861184 wait complete. 2024-05-09T00:03:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f31b1017b80 1 -- start start 2024-05-09T00:03:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f31b1017b80 1 Processor -- start 2024-05-09T00:03:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f31b1017b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b1480 0x55e0bb1bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f31b1017b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b6950 0x55e0bb1ba5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f31b1017b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b7270 0x55e0bb1bacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f31b1017b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bb09d500 con 0x55e0bb1b1480 2024-05-09T00:03:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f31b1017b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bb09d1a0 con 0x55e0bb1b7270 2024-05-09T00:03:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f31b1017b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0baf84640 con 0x55e0bb1b6950 2024-05-09T00:03:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f31b1017b80 10 client.0 _ll_register_callbacks cb 0x55e0bb0a6ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f319e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b1480 0x55e0bb1bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f319e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b1480 0x55e0bb1bd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35856/0 (socket says 172.21.15.81:35856) 2024-05-09T00:03:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f319e59c700 1 -- 172.21.15.81:0/1904296129 learned_addr learned my addr 172.21.15.81:0/1904296129 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f319dd9b700 1 --2- 172.21.15.81:0/1904296129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b6950 0x55e0bb1ba5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f319ed9d700 1 --2- 172.21.15.81:0/1904296129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b7270 0x55e0bb1bacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f319e59c700 1 -- 172.21.15.81:0/1904296129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b6950 msgr2=0x55e0bb1ba5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f319e59c700 1 --2- 172.21.15.81:0/1904296129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b6950 0x55e0bb1ba5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f319e59c700 1 -- 172.21.15.81:0/1904296129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b7270 msgr2=0x55e0bb1bacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f319e59c700 1 --2- 172.21.15.81:0/1904296129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b7270 0x55e0bb1bacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f319e59c700 1 -- 172.21.15.81:0/1904296129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3194017070 con 0x55e0bb1b1480 2024-05-09T00:03:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.758+0000 7f319ed9d700 1 --2- 172.21.15.81:0/1904296129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b7270 0x55e0bb1bacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f319e59c700 1 --2- 172.21.15.81:0/1904296129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b1480 0x55e0bb1bd240 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3190099910 tx=0x7f319009a450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69cbc0975874a569 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:49.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f3185ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f3185ffb700 1 -- 172.21.15.81:0/1904296129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3190099100 con 0x55e0bb1b1480 2024-05-09T00:03:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f3185ffb700 1 -- 172.21.15.81:0/1904296129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f3190099260 con 0x55e0bb1b1480 2024-05-09T00:03:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f31b1017b80 1 -- 172.21.15.81:0/1904296129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0bb05a210 con 0x55e0bb1b1480 2024-05-09T00:03:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f3185ffb700 1 -- 172.21.15.81:0/1904296129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31900a1c00 con 0x55e0bb1b1480 2024-05-09T00:03:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f31b1017b80 10 client.15690 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f31b1017b80 1 -- 172.21.15.81:0/1904296129 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e0baf2eb00 con 0x55e0bb1b1480 2024-05-09T00:03:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f3185ffb700 1 -- 172.21.15.81:0/1904296129 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e0bb05a210 con 0x55e0bb1b1480 2024-05-09T00:03:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f3185ffb700 1 -- 172.21.15.81:0/1904296129 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f31900b22c0 con 0x55e0bb1b1480 2024-05-09T00:03:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f31b1017b80 10 client.15690 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f31b1017b80 10 client.15690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f31b1017b80 20 client.15690 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f31b1017b80 1 --2- 172.21.15.81:0/1904296129 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0bb1cab50 0x55e0bb1ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f31b1017b80 4 client.15690 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:03:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f31b1017b80 1 -- 172.21.15.81:0/1904296129 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0bb1807b0 con 0x55e0bb1cab50 2024-05-09T00:03:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.759+0000 7f319dd9b700 1 --2- 172.21.15.81:0/1904296129 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0bb1cab50 0x55e0bb1ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.760+0000 7f319dd9b700 1 --2- 172.21.15.81:0/1904296129 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0bb1cab50 0x55e0bb1ccf40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bc62f01d159f77f server_cookie=bd32d42bb346a7fb in_seq=0 out_seq=0 2024-05-09T00:03:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.760+0000 7f3185ffb700 10 client.15690 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.760+0000 7f3185ffb700 1 -- 172.21.15.81:0/1904296129 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e0bb1807b0 con 0x55e0bb1cab50 2024-05-09T00:03:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.760+0000 7f3185ffb700 10 client.15690 handle_command_reply: tid=0 2024-05-09T00:03:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.761+0000 7f31b1017b80 1 client.15690 shutdown 2024-05-09T00:03:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.761+0000 7f31b1017b80 1 -- 172.21.15.81:0/1904296129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b1480 msgr2=0x55e0bb1bd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.761+0000 7f31b1017b80 1 --2- 172.21.15.81:0/1904296129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b1480 0x55e0bb1bd240 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3190099910 tx=0x7f319009a450 comp rx=0 tx=0).stop 2024-05-09T00:03:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.761+0000 7f31b1017b80 1 -- 172.21.15.81:0/1904296129 shutdown_connections 2024-05-09T00:03:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.761+0000 7f31b1017b80 1 --2- 172.21.15.81:0/1904296129 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0bb1cab50 0x55e0bb1ccf40 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.761+0000 7f31b1017b80 1 --2- 172.21.15.81:0/1904296129 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b7270 0x55e0bb1bacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.761+0000 7f3185ffb700 0 client.15690 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.761+0000 7f31b1017b80 1 --2- 172.21.15.81:0/1904296129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b1480 0x55e0bb1bd240 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.761+0000 7f31b1017b80 1 --2- 172.21.15.81:0/1904296129 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b6950 0x55e0bb1ba5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.761+0000 7f31b1017b80 1 -- 172.21.15.81:0/1904296129 >> 172.21.15.81:0/1904296129 conn(0x55e0bb10f1b0 msgr2=0x55e0bb1b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.761+0000 7f31b1017b80 1 -- 172.21.15.81:0/1904296129 shutdown_connections 2024-05-09T00:03:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.761+0000 7f31b1017b80 1 -- 172.21.15.81:0/1904296129 wait complete. 2024-05-09T00:03:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.761+0000 7f31b1017b80 20 client.15690 trim_cache size 0 max 16384 2024-05-09T00:03:49.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f31b1017b80 1 Processor -- start 2024-05-09T00:03:49.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f31b1017b80 1 -- start start 2024-05-09T00:03:49.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f31b1017b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b1480 0x55e0bb1ab910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f31b1017b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b6950 0x55e0bb1ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f31b1017b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b7270 0x55e0bb1bcd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f31b1017b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bb1a6370 con 0x55e0bb1b6950 2024-05-09T00:03:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f31b1017b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bb1ac360 con 0x55e0bb1b1480 2024-05-09T00:03:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f31b1017b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bb1bbb30 con 0x55e0bb1b7270 2024-05-09T00:03:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f319dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b6950 0x55e0bb1ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f319dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b6950 0x55e0bb1ad4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35866/0 (socket says 172.21.15.81:35866) 2024-05-09T00:03:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f319dd9b700 1 -- 172.21.15.81:0/1281164948 learned_addr learned my addr 172.21.15.81:0/1281164948 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f319e59c700 1 --2- 172.21.15.81:0/1281164948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b1480 0x55e0bb1ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f319ed9d700 1 --2- 172.21.15.81:0/1281164948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b7270 0x55e0bb1bcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f319dd9b700 1 -- 172.21.15.81:0/1281164948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b7270 msgr2=0x55e0bb1bcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f319dd9b700 1 --2- 172.21.15.81:0/1281164948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b7270 0x55e0bb1bcd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f319dd9b700 1 -- 172.21.15.81:0/1281164948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b1480 msgr2=0x55e0bb1ab910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f319dd9b700 1 --2- 172.21.15.81:0/1281164948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b1480 0x55e0bb1ab910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f319dd9b700 1 -- 172.21.15.81:0/1281164948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0bb0c7500 con 0x55e0bb1b6950 2024-05-09T00:03:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.776+0000 7f319dd9b700 1 --2- 172.21.15.81:0/1281164948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b6950 0x55e0bb1ad4d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3194009fd0 tx=0x7f3194003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540394fb9e471ff9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.777+0000 7f318d7fa700 1 -- 172.21.15.81:0/1281164948 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319402c040 con 0x55e0bb1b6950 2024-05-09T00:03:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.777+0000 7f318d7fa700 1 -- 172.21.15.81:0/1281164948 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3194003680 con 0x55e0bb1b6950 2024-05-09T00:03:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.777+0000 7f318d7fa700 1 -- 172.21.15.81:0/1281164948 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31940048b0 con 0x55e0bb1b6950 2024-05-09T00:03:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.777+0000 7f31b1017b80 1 -- 172.21.15.81:0/1281164948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b6950 msgr2=0x55e0bb1ad4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.777+0000 7f31b1017b80 1 --2- 172.21.15.81:0/1281164948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b6950 0x55e0bb1ad4d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3194009fd0 tx=0x7f3194003820 comp rx=0 tx=0).stop 2024-05-09T00:03:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.777+0000 7f31b1017b80 1 -- 172.21.15.81:0/1281164948 shutdown_connections 2024-05-09T00:03:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.777+0000 7f31b1017b80 1 --2- 172.21.15.81:0/1281164948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b1480 0x55e0bb1ab910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.777+0000 7f31b1017b80 1 --2- 172.21.15.81:0/1281164948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b7270 0x55e0bb1bcd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.777+0000 7f31b1017b80 1 --2- 172.21.15.81:0/1281164948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b6950 0x55e0bb1ad4d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.777+0000 7f31b1017b80 1 -- 172.21.15.81:0/1281164948 >> 172.21.15.81:0/1281164948 conn(0x55e0bb10f1b0 msgr2=0x55e0bb1c66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.777+0000 7f31b1017b80 1 -- 172.21.15.81:0/1281164948 shutdown_connections 2024-05-09T00:03:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.777+0000 7f31b1017b80 1 -- 172.21.15.81:0/1281164948 wait complete. 2024-05-09T00:03:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f31b1017b80 1 -- start start 2024-05-09T00:03:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f31b1017b80 1 Processor -- start 2024-05-09T00:03:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f31b1017b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b1480 0x55e0bb1c2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f31b1017b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b6950 0x55e0bb1b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f31b1017b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b7270 0x55e0bb1b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f31b1017b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bb1b5fd0 con 0x55e0bb1b6950 2024-05-09T00:03:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f31b1017b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bb1b6140 con 0x55e0bb1b1480 2024-05-09T00:03:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f31b1017b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0bb1b48c0 con 0x55e0bb1b7270 2024-05-09T00:03:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f31b1017b80 10 client.0 _ll_register_callbacks cb 0x55e0bb0a6ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:03:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f319dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b6950 0x55e0bb1b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f319dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b6950 0x55e0bb1b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35874/0 (socket says 172.21.15.81:35874) 2024-05-09T00:03:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f319dd9b700 1 -- 172.21.15.81:0/3211892088 learned_addr learned my addr 172.21.15.81:0/3211892088 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:03:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f319ed9d700 1 --2- 172.21.15.81:0/3211892088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b7270 0x55e0bb1b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f319e59c700 1 --2- 172.21.15.81:0/3211892088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b1480 0x55e0bb1c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f319dd9b700 1 -- 172.21.15.81:0/3211892088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b7270 msgr2=0x55e0bb1b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f319dd9b700 1 --2- 172.21.15.81:0/3211892088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b7270 0x55e0bb1b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f319dd9b700 1 -- 172.21.15.81:0/3211892088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b1480 msgr2=0x55e0bb1c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:03:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f319dd9b700 1 --2- 172.21.15.81:0/3211892088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b1480 0x55e0bb1c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f319dd9b700 1 -- 172.21.15.81:0/3211892088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0baf82350 con 0x55e0bb1b6950 2024-05-09T00:03:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f319e59c700 1 --2- 172.21.15.81:0/3211892088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b1480 0x55e0bb1c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:03:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f319dd9b700 1 --2- 172.21.15.81:0/3211892088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b6950 0x55e0bb1b56f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3194005950 tx=0x7f31940090d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a028d66931911ee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:03:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.778+0000 7f3185ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:03:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f3185ffb700 1 -- 172.21.15.81:0/3211892088 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319402c070 con 0x55e0bb1b6950 2024-05-09T00:03:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f3185ffb700 1 -- 172.21.15.81:0/3211892088 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f3194005050 con 0x55e0bb1b6950 2024-05-09T00:03:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f31b1017b80 1 -- 172.21.15.81:0/3211892088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f31940044e0 con 0x55e0bb1b6950 2024-05-09T00:03:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f3185ffb700 1 -- 172.21.15.81:0/3211892088 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3194005210 con 0x55e0bb1b6950 2024-05-09T00:03:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f31b1017b80 10 client.15696 fetch_fsmap learned FSMap version 24 2024-05-09T00:03:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f31b1017b80 1 -- 172.21.15.81:0/3211892088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e0baf86c70 con 0x55e0bb1b6950 2024-05-09T00:03:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f3185ffb700 1 -- 172.21.15.81:0/3211892088 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31940044e0 con 0x55e0bb1b6950 2024-05-09T00:03:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f3185ffb700 1 -- 172.21.15.81:0/3211892088 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3194024030 con 0x55e0bb1b6950 2024-05-09T00:03:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f31b1017b80 10 client.15696 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:03:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f31b1017b80 10 client.15696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:03:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f31b1017b80 20 client.15696 populate_metadata read hostname 'smithi081' 2024-05-09T00:03:49.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f31b1017b80 1 --2- 172.21.15.81:0/3211892088 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0bb221ae0 0x55e0bb223f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:03:49.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f31b1017b80 4 client.15696 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:03:49.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f31b1017b80 1 -- 172.21.15.81:0/3211892088 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e0bb0f9e60 con 0x55e0bb221ae0 2024-05-09T00:03:49.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.779+0000 7f319e59c700 1 --2- 172.21.15.81:0/3211892088 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0bb221ae0 0x55e0bb223f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:03:49.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.780+0000 7f3185ffb700 10 client.15696 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:49.780 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.780+0000 7f319e59c700 1 --2- 172.21.15.81:0/3211892088 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0bb221ae0 0x55e0bb223f00 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c41031f6f6433000 server_cookie=83ebb9f942507fd6 in_seq=0 out_seq=0 2024-05-09T00:03:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.786+0000 7f3185ffb700 1 -- 172.21.15.81:0/3211892088 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e0bb0f9e60 con 0x55e0bb221ae0 2024-05-09T00:03:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.786+0000 7f3185ffb700 10 client.15696 handle_command_reply: tid=0 2024-05-09T00:03:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.786+0000 7f31b1017b80 1 client.15696 shutdown 2024-05-09T00:03:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31b1017b80 1 -- 172.21.15.81:0/3211892088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b6950 msgr2=0x55e0bb1b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31b1017b80 1 --2- 172.21.15.81:0/3211892088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b6950 0x55e0bb1b56f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3194005950 tx=0x7f31940090d0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31b1017b80 1 -- 172.21.15.81:0/3211892088 shutdown_connections 2024-05-09T00:03:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31b1017b80 1 --2- 172.21.15.81:0/3211892088 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0bb221ae0 0x55e0bb223f00 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31b1017b80 1 --2- 172.21.15.81:0/3211892088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0bb1b1480 0x55e0bb1c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31b1017b80 1 --2- 172.21.15.81:0/3211892088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0bb1b7270 0x55e0bb1b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f3185ffb700 0 client.15696 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:03:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31b1017b80 1 --2- 172.21.15.81:0/3211892088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0bb1b6950 0x55e0bb1b56f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31b1017b80 1 -- 172.21.15.81:0/3211892088 >> 172.21.15.81:0/3211892088 conn(0x55e0bb10f1b0 msgr2=0x55e0bb1b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31b1017b80 1 -- 172.21.15.81:0/3211892088 shutdown_connections 2024-05-09T00:03:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31b1017b80 1 -- 172.21.15.81:0/3211892088 wait complete. 2024-05-09T00:03:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31b1017b80 20 client.15696 trim_cache size 0 max 16384 2024-05-09T00:03:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:03:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:03:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:03:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:03:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31a4e5d700 1 -- 172.21.15.81:0/3704835052 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f31880a13b0 msgr2=0x7f31880a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31a4e5d700 1 --2- 172.21.15.81:0/3704835052 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f31880a13b0 0x7f31880a3870 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f31a0198a50 tx=0x7f3194009260 comp rx=0 tx=0).stop 2024-05-09T00:03:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31a4e5d700 1 -- 172.21.15.81:0/3704835052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31a0100010 msgr2=0x7f31a0197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:03:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31a4e5d700 1 --2- 172.21.15.81:0/3704835052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31a0100010 0x7f31a0197500 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f319000d950 tx=0x7f319000dc60 comp rx=0 tx=0).stop 2024-05-09T00:03:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31a4e5d700 1 -- 172.21.15.81:0/3704835052 shutdown_connections 2024-05-09T00:03:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31a4e5d700 1 --2- 172.21.15.81:0/3704835052 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f31880a13b0 0x7f31880a3870 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31a4e5d700 1 --2- 172.21.15.81:0/3704835052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31a019bde0 0x7f31a019c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31a4e5d700 1 --2- 172.21.15.81:0/3704835052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31a0100010 0x7f31a0197500 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31a4e5d700 1 --2- 172.21.15.81:0/3704835052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31a0105130 0x7f31a0197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:03:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31a4e5d700 1 -- 172.21.15.81:0/3704835052 >> 172.21.15.81:0/3704835052 conn(0x7f31a0076f40 msgr2=0x7f31a0069470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:03:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31a4e5d700 1 -- 172.21.15.81:0/3704835052 shutdown_connections 2024-05-09T00:03:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:03:49.787+0000 7f31a4e5d700 1 -- 172.21.15.81:0/3704835052 wait complete. 2024-05-09T00:03:51.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:50 smithi150 ceph-mon[46187]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-05-09T00:03:51.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:50 smithi171 ceph-mon[47351]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-05-09T00:03:51.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:50 smithi081 ceph-mon[42474]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-05-09T00:03:53.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:52 smithi150 ceph-mon[46187]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-05-09T00:03:53.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:52 smithi171 ceph-mon[47351]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-05-09T00:03:53.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:52 smithi081 ceph-mon[42474]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-05-09T00:03:55.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:54 smithi150 ceph-mon[46187]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-09T00:03:55.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:54 smithi171 ceph-mon[47351]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-09T00:03:55.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:54 smithi081 ceph-mon[42474]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-09T00:03:57.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:56 smithi150 ceph-mon[46187]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-09T00:03:57.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:56 smithi171 ceph-mon[47351]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-09T00:03:57.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:56 smithi081 ceph-mon[42474]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-09T00:03:59.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:03:58 smithi150 ceph-mon[46187]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-09T00:03:59.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:03:58 smithi171 ceph-mon[47351]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-09T00:03:59.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:03:58 smithi081 ceph-mon[42474]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-05-09T00:04:00.619 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:04:00 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:04:00.371+0000 7fcfeea88700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:04:00.619 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:04:00 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:04:00.371+0000 7fcfeea88700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:04:00.619 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:04:00 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:04:00.371+0000 7fcfeea88700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:04:00.619 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:04:00 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:04:00.371+0000 7fcfeea88700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:04:00.620 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:04:00 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:04:00.371+0000 7fcfeea88700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-09T00:04:01.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:00 smithi150 ceph-mon[46187]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-09T00:04:01.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:00 smithi171 ceph-mon[47351]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-09T00:04:01.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:00 smithi081 ceph-mon[42474]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2024-05-09T00:04:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.909+0000 7f545e591700 1 -- 172.21.15.81:0/2700300299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5458101110 msgr2=0x7f54581014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.909+0000 7f545e591700 1 --2- 172.21.15.81:0/2700300299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5458101110 0x7f54581014f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5448009990 tx=0x7f5448009ca0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.910+0000 7f545e591700 1 -- 172.21.15.81:0/2700300299 shutdown_connections 2024-05-09T00:04:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.910+0000 7f545e591700 1 --2- 172.21.15.81:0/2700300299 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5458106230 0x7f545810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.910+0000 7f545e591700 1 --2- 172.21.15.81:0/2700300299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5458101110 0x7f54581014f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.910+0000 7f545e591700 1 --2- 172.21.15.81:0/2700300299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5458101ac0 0x7f5458105b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.910+0000 7f545e591700 1 -- 172.21.15.81:0/2700300299 >> 172.21.15.81:0/2700300299 conn(0x7f54580fc990 msgr2=0x7f54580fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.910+0000 7f545e591700 1 -- 172.21.15.81:0/2700300299 shutdown_connections 2024-05-09T00:04:02.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.910+0000 7f545e591700 1 -- 172.21.15.81:0/2700300299 wait complete. 2024-05-09T00:04:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.910+0000 7f545e591700 1 Processor -- start 2024-05-09T00:04:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.910+0000 7f545e591700 1 -- start start 2024-05-09T00:04:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f545e591700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5458101110 0x7f54580732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f545e591700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5458106230 0x7f54580737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f545e591700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5458073d20 0x7f54581a5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f545e591700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54581a5b30 con 0x7f5458106230 2024-05-09T00:04:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f545e591700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54581a5ca0 con 0x7f5458073d20 2024-05-09T00:04:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f545e591700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54581a5e60 con 0x7f5458101110 2024-05-09T00:04:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f54577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5458106230 0x7f54580737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f54577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5458106230 0x7f54580737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47218/0 (socket says 172.21.15.81:47218) 2024-05-09T00:04:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f54577fe700 1 -- 172.21.15.81:0/1966252416 learned_addr learned my addr 172.21.15.81:0/1966252416 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f5457fff700 1 --2- 172.21.15.81:0/1966252416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5458101110 0x7f54580732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f545cb2e700 1 --2- 172.21.15.81:0/1966252416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5458073d20 0x7f54581a5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f54577fe700 1 -- 172.21.15.81:0/1966252416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5458101110 msgr2=0x7f54580732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f54577fe700 1 --2- 172.21.15.81:0/1966252416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5458101110 0x7f54580732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f54577fe700 1 -- 172.21.15.81:0/1966252416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5458073d20 msgr2=0x7f54581a5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f54577fe700 1 --2- 172.21.15.81:0/1966252416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5458073d20 0x7f54581a5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f54577fe700 1 -- 172.21.15.81:0/1966252416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480095f0 con 0x7f5458106230 2024-05-09T00:04:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f54577fe700 1 --2- 172.21.15.81:0/1966252416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5458106230 0x7f54580737e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f544c00e970 tx=0x7f544c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.911+0000 7f54557fa700 1 -- 172.21.15.81:0/1966252416 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c009790 con 0x7f5458106230 2024-05-09T00:04:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.912+0000 7f545e591700 1 -- 172.21.15.81:0/1966252416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54581a6140 con 0x7f5458106230 2024-05-09T00:04:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.912+0000 7f54557fa700 1 -- 172.21.15.81:0/1966252416 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f544c00c7e0 con 0x7f5458106230 2024-05-09T00:04:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.912+0000 7f54557fa700 1 -- 172.21.15.81:0/1966252416 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c0054e0 con 0x7f5458106230 2024-05-09T00:04:02.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.912+0000 7f545e591700 1 -- 172.21.15.81:0/1966252416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54581a6650 con 0x7f5458106230 2024-05-09T00:04:02.909 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.915+0000 7f54557fa700 1 -- 172.21.15.81:0/1966252416 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7f544c00c950 con 0x7f5458106230 2024-05-09T00:04:02.909 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.915+0000 7f546a74bb80 1 Processor -- start 2024-05-09T00:04:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.915+0000 7f546a74bb80 1 -- start start 2024-05-09T00:04:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.915+0000 7f546a74bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877f950 0x5614a877fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.915+0000 7f546a74bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a8780270 0x5614a8779f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.915+0000 7f546a74bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a877a480 0x5614a877a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.915+0000 7f546a74bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614a86d10f0 con 0x5614a877f950 2024-05-09T00:04:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.915+0000 7f546a74bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614a86ceab0 con 0x5614a877a480 2024-05-09T00:04:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f546a74bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614a86ca3a0 con 0x5614a8780270 2024-05-09T00:04:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f54557fa700 1 --2- 172.21.15.81:0/1966252416 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f54400a1440 0x7f54400a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f545cb2e700 1 --2- 172.21.15.81:0/1966252416 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f54400a1440 0x7f54400a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f54557fa700 1 -- 172.21.15.81:0/1966252416 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f544c014070 con 0x7f5458106230 2024-05-09T00:04:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f54577fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a877a480 0x5614a877a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f545cb2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877f950 0x5614a877fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f54577fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a877a480 0x5614a877a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.81:33850/0 (socket says 172.21.15.81:33850) 2024-05-09T00:04:02.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f545cb2e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877f950 0x5614a877fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47230/0 (socket says 172.21.15.81:47230) 2024-05-09T00:04:02.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f54577fe700 1 -- 172.21.15.81:0/3584142522 learned_addr learned my addr 172.21.15.81:0/3584142522 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:02.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f54577fe700 1 -- 172.21.15.81:0/3584142522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a8780270 msgr2=0x5614a8779f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:04:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f54577fe700 1 --2- 172.21.15.81:0/3584142522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a8780270 0x5614a8779f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f54577fe700 1 -- 172.21.15.81:0/3584142522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877f950 msgr2=0x5614a877fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f54577fe700 1 --2- 172.21.15.81:0/3584142522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877f950 0x5614a877fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f54577fe700 1 -- 172.21.15.81:0/3584142522 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614a854b350 con 0x5614a877a480 2024-05-09T00:04:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f545cb2e700 1 --2- 172.21.15.81:0/1966252416 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f54400a1440 0x7f54400a3900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5450009ec0 tx=0x7f54500092f0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:02.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.916+0000 7f54577fe700 1 --2- 172.21.15.81:0/3584142522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a877a480 0x5614a877a8a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f544c096b80 tx=0x7f544c005910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe480d4bdfa592ef server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.919+0000 7f543e7fc700 1 -- 172.21.15.81:0/3584142522 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c00cc50 con 0x5614a877a480 2024-05-09T00:04:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.919+0000 7f543e7fc700 1 -- 172.21.15.81:0/3584142522 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f544c0cd030 con 0x5614a877a480 2024-05-09T00:04:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.919+0000 7f543e7fc700 1 -- 172.21.15.81:0/3584142522 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c0056f0 con 0x5614a877a480 2024-05-09T00:04:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.919+0000 7f546a74bb80 1 -- 172.21.15.81:0/3584142522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a877a480 msgr2=0x5614a877a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.919+0000 7f546a74bb80 1 --2- 172.21.15.81:0/3584142522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a877a480 0x5614a877a8a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f544c096b80 tx=0x7f544c005910 comp rx=0 tx=0).stop 2024-05-09T00:04:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.919+0000 7f546a74bb80 1 -- 172.21.15.81:0/3584142522 shutdown_connections 2024-05-09T00:04:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.919+0000 7f546a74bb80 1 --2- 172.21.15.81:0/3584142522 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a877a480 0x5614a877a8a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.919+0000 7f546a74bb80 1 --2- 172.21.15.81:0/3584142522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877f950 0x5614a877fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.919+0000 7f546a74bb80 1 --2- 172.21.15.81:0/3584142522 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a8780270 0x5614a8779f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.919+0000 7f546a74bb80 1 -- 172.21.15.81:0/3584142522 >> 172.21.15.81:0/3584142522 conn(0x5614a86d81b0 msgr2=0x5614a8774840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.919+0000 7f546a74bb80 1 -- 172.21.15.81:0/3584142522 shutdown_connections 2024-05-09T00:04:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.919+0000 7f546a74bb80 1 -- 172.21.15.81:0/3584142522 wait complete. 2024-05-09T00:04:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.920+0000 7f546a74bb80 1 -- start start 2024-05-09T00:04:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.920+0000 7f546a74bb80 1 Processor -- start 2024-05-09T00:04:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.920+0000 7f546a74bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a877a480 0x5614a8786280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.920+0000 7f546a74bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877f950 0x5614a8783570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.920+0000 7f546a74bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a8780270 0x5614a8783c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.920+0000 7f546a74bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614a8666500 con 0x5614a8780270 2024-05-09T00:04:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.920+0000 7f546a74bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614a86661a0 con 0x5614a877a480 2024-05-09T00:04:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.920+0000 7f546a74bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614a854d640 con 0x5614a877f950 2024-05-09T00:04:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.920+0000 7f546a74bb80 10 client.0 _ll_register_callbacks cb 0x5614a866fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:02.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f5457fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a877a480 0x5614a8786280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f54577fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877f950 0x5614a8783570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f5457fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a877a480 0x5614a8786280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.81:33860/0 (socket says 172.21.15.81:33860) 2024-05-09T00:04:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f54577fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877f950 0x5614a8783570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:34476/0 (socket says 172.21.15.81:34476) 2024-05-09T00:04:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f5457fff700 1 -- 172.21.15.81:0/1754645378 learned_addr learned my addr 172.21.15.81:0/1754645378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f545cb2e700 1 --2- 172.21.15.81:0/1754645378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a8780270 0x5614a8783c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f5457fff700 1 -- 172.21.15.81:0/1754645378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877f950 msgr2=0x5614a8783570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f5457fff700 1 --2- 172.21.15.81:0/1754645378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877f950 0x5614a8783570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f5457fff700 1 -- 172.21.15.81:0/1754645378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a8780270 msgr2=0x5614a8783c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f5457fff700 1 --2- 172.21.15.81:0/1754645378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a8780270 0x5614a8783c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f5457fff700 1 -- 172.21.15.81:0/1754645378 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54581a6650 con 0x5614a877a480 2024-05-09T00:04:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f5457fff700 1 --2- 172.21.15.81:0/1754645378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a877a480 0x5614a8786280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5448015000 tx=0x7f5448005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=681b7567a5059973 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f54377fe700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-05-09T00:04:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f54377fe700 1 -- 172.21.15.81:0/1754645378 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544801d070 con 0x5614a877a480 2024-05-09T00:04:02.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f546a74bb80 1 -- 172.21.15.81:0/1754645378 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5614a8623210 con 0x5614a877a480 2024-05-09T00:04:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f54377fe700 1 -- 172.21.15.81:0/1754645378 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f5448004500 con 0x5614a877a480 2024-05-09T00:04:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f54377fe700 1 -- 172.21.15.81:0/1754645378 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54480046c0 con 0x5614a877a480 2024-05-09T00:04:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f546a74bb80 10 client.25211 fetch_fsmap learned FSMap version 24 2024-05-09T00:04:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.921+0000 7f546a74bb80 1 -- 172.21.15.81:0/1754645378 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5614a84f7b00 con 0x5614a877a480 2024-05-09T00:04:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.922+0000 7f54377fe700 1 -- 172.21.15.81:0/1754645378 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5614a8623210 con 0x5614a877a480 2024-05-09T00:04:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.922+0000 7f54377fe700 1 -- 172.21.15.81:0/1754645378 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f544800f4f0 con 0x5614a877a480 2024-05-09T00:04:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.922+0000 7f546a74bb80 10 client.25211 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:04:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.922+0000 7f546a74bb80 10 client.25211 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.922+0000 7f546a74bb80 20 client.25211 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.922+0000 7f546a74bb80 1 --2- 172.21.15.81:0/1754645378 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5614a8793bc0 0x5614a8795fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.922+0000 7f546a74bb80 4 client.25211 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.922+0000 7f546a74bb80 1 -- 172.21.15.81:0/1754645378 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614a87497b0 con 0x5614a8793bc0 2024-05-09T00:04:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.922+0000 7f54577fe700 1 --2- 172.21.15.81:0/1754645378 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5614a8793bc0 0x5614a8795fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.922+0000 7f54377fe700 10 client.25211 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:02.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.922+0000 7f54577fe700 1 --2- 172.21.15.81:0/1754645378 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5614a8793bc0 0x5614a8795fe0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5382f91a297fba2 server_cookie=92dffbbb1291d741 in_seq=0 out_seq=0 2024-05-09T00:04:02.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f54377fe700 1 -- 172.21.15.81:0/1754645378 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5614a87497b0 con 0x5614a8793bc0 2024-05-09T00:04:02.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f54377fe700 10 client.25211 handle_command_reply: tid=0 2024-05-09T00:04:02.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f546a74bb80 1 client.25211 shutdown 2024-05-09T00:04:02.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f546a74bb80 1 -- 172.21.15.81:0/1754645378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a877a480 msgr2=0x5614a8786280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:02.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f546a74bb80 1 --2- 172.21.15.81:0/1754645378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a877a480 0x5614a8786280 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5448015000 tx=0x7f5448005750 comp rx=0 tx=0).stop 2024-05-09T00:04:02.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f546a74bb80 1 -- 172.21.15.81:0/1754645378 shutdown_connections 2024-05-09T00:04:02.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f546a74bb80 1 --2- 172.21.15.81:0/1754645378 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5614a8793bc0 0x5614a8795fe0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f546a74bb80 1 --2- 172.21.15.81:0/1754645378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a877a480 0x5614a8786280 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f546a74bb80 1 --2- 172.21.15.81:0/1754645378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a8780270 0x5614a8783c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f546a74bb80 1 --2- 172.21.15.81:0/1754645378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877f950 0x5614a8783570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f546a74bb80 1 -- 172.21.15.81:0/1754645378 >> 172.21.15.81:0/1754645378 conn(0x5614a86d81b0 msgr2=0x5614a877e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:02.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f54377fe700 0 client.25211 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:02.923 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f546a74bb80 1 -- 172.21.15.81:0/1754645378 shutdown_connections 2024-05-09T00:04:02.923 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f546a74bb80 1 -- 172.21.15.81:0/1754645378 wait complete. 2024-05-09T00:04:02.923 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.923+0000 7f546a74bb80 20 client.25211 trim_cache size 0 max 16384 2024-05-09T00:04:02.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.938+0000 7f546a74bb80 1 Processor -- start 2024-05-09T00:04:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.938+0000 7f546a74bb80 1 -- start start 2024-05-09T00:04:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.938+0000 7f546a74bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877a480 0x5614a8774910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.938+0000 7f546a74bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877f950 0x5614a8782e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.938+0000 7f546a74bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a8780270 0x5614a8785db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.938+0000 7f546a74bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614a8784b70 con 0x5614a877f950 2024-05-09T00:04:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.938+0000 7f546a74bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614a87760f0 con 0x5614a8780270 2024-05-09T00:04:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.938+0000 7f546a74bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614a8775660 con 0x5614a877a480 2024-05-09T00:04:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.939+0000 7f54577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877f950 0x5614a8782e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.939+0000 7f54577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877f950 0x5614a8782e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47248/0 (socket says 172.21.15.81:47248) 2024-05-09T00:04:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.939+0000 7f54577fe700 1 -- 172.21.15.81:0/4064066878 learned_addr learned my addr 172.21.15.81:0/4064066878 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.939+0000 7f5457fff700 1 --2- 172.21.15.81:0/4064066878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877a480 0x5614a8774910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.939+0000 7f54577fe700 1 -- 172.21.15.81:0/4064066878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877a480 msgr2=0x5614a8774910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:02.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.939+0000 7f54577fe700 1 --2- 172.21.15.81:0/4064066878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877a480 0x5614a8774910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.939+0000 7f54577fe700 1 -- 172.21.15.81:0/4064066878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a8780270 msgr2=0x5614a8785db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.939+0000 7f54577fe700 1 --2- 172.21.15.81:0/4064066878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a8780270 0x5614a8785db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.939+0000 7f54577fe700 1 -- 172.21.15.81:0/4064066878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614a8690500 con 0x5614a877f950 2024-05-09T00:04:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.939+0000 7f54577fe700 1 --2- 172.21.15.81:0/4064066878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877f950 0x5614a8782e50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f544c099e10 tx=0x7f544c096580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b997a9164183d4c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.939+0000 7f543effd700 1 -- 172.21.15.81:0/4064066878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c09a190 con 0x5614a877f950 2024-05-09T00:04:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.939+0000 7f543effd700 1 -- 172.21.15.81:0/4064066878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f544c09a810 con 0x5614a877f950 2024-05-09T00:04:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.939+0000 7f543effd700 1 -- 172.21.15.81:0/4064066878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c09a370 con 0x5614a877f950 2024-05-09T00:04:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.940+0000 7f546a74bb80 1 -- 172.21.15.81:0/4064066878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877f950 msgr2=0x5614a8782e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:02.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.940+0000 7f546a74bb80 1 --2- 172.21.15.81:0/4064066878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877f950 0x5614a8782e50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f544c099e10 tx=0x7f544c096580 comp rx=0 tx=0).stop 2024-05-09T00:04:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.943+0000 7f546a74bb80 1 -- 172.21.15.81:0/4064066878 shutdown_connections 2024-05-09T00:04:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.943+0000 7f546a74bb80 1 --2- 172.21.15.81:0/4064066878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a8780270 0x5614a8785db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.943+0000 7f546a74bb80 1 --2- 172.21.15.81:0/4064066878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877a480 0x5614a8774910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.943+0000 7f546a74bb80 1 --2- 172.21.15.81:0/4064066878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877f950 0x5614a8782e50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.943+0000 7f546a74bb80 1 -- 172.21.15.81:0/4064066878 >> 172.21.15.81:0/4064066878 conn(0x5614a86d81b0 msgr2=0x5614a87785d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.943+0000 7f546a74bb80 1 -- 172.21.15.81:0/4064066878 shutdown_connections 2024-05-09T00:04:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.943+0000 7f546a74bb80 1 -- 172.21.15.81:0/4064066878 wait complete. 2024-05-09T00:04:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.943+0000 7f546a74bb80 1 -- start start 2024-05-09T00:04:02.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.943+0000 7f546a74bb80 1 Processor -- start 2024-05-09T00:04:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.943+0000 7f546a74bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877a480 0x5614a878b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.943+0000 7f546a74bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877f950 0x5614a877d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.943+0000 7f546a74bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a8780270 0x5614a877db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f546a74bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614a877e210 con 0x5614a877a480 2024-05-09T00:04:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f546a74bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614a877e380 con 0x5614a8780270 2024-05-09T00:04:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f546a74bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614a877e540 con 0x5614a877f950 2024-05-09T00:04:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f546a74bb80 10 client.0 _ll_register_callbacks cb 0x5614a866fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f54577fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877f950 0x5614a877d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.940 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f545cb2e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a8780270 0x5614a877db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f54577fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877f950 0x5614a877d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:34504/0 (socket says 172.21.15.81:34504) 2024-05-09T00:04:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f54577fe700 1 -- 172.21.15.81:0/4269673092 learned_addr learned my addr 172.21.15.81:0/4269673092 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f5457fff700 1 --2- 172.21.15.81:0/4269673092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877a480 0x5614a878b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f545cb2e700 1 -- 172.21.15.81:0/4269673092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877f950 msgr2=0x5614a877d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f545cb2e700 1 --2- 172.21.15.81:0/4269673092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877f950 0x5614a877d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f545cb2e700 1 -- 172.21.15.81:0/4269673092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877a480 msgr2=0x5614a878b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f545cb2e700 1 --2- 172.21.15.81:0/4269673092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877a480 0x5614a878b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f545cb2e700 1 -- 172.21.15.81:0/4269673092 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614a854b350 con 0x5614a8780270 2024-05-09T00:04:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f54577fe700 1 --2- 172.21.15.81:0/4269673092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877f950 0x5614a877d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:04:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f545cb2e700 1 --2- 172.21.15.81:0/4269673092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a8780270 0x5614a877db30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5450009230 tx=0x7f5450004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27c11a27ce3471fe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f54377fe700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-05-09T00:04:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f54377fe700 1 -- 172.21.15.81:0/4269673092 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545000e070 con 0x5614a8780270 2024-05-09T00:04:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.944+0000 7f546a74bb80 1 -- 172.21.15.81:0/4269673092 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f544c0cd030 con 0x5614a8780270 2024-05-09T00:04:02.941 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.945+0000 7f54377fe700 1 -- 172.21.15.81:0/4269673092 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f545001ae80 con 0x5614a8780270 2024-05-09T00:04:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.945+0000 7f54377fe700 1 -- 172.21.15.81:0/4269673092 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5450008570 con 0x5614a8780270 2024-05-09T00:04:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.945+0000 7f546a74bb80 10 client.25214 fetch_fsmap learned FSMap version 24 2024-05-09T00:04:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.945+0000 7f546a74bb80 1 -- 172.21.15.81:0/4269673092 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5614a854fc70 con 0x5614a8780270 2024-05-09T00:04:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.945+0000 7f54377fe700 1 -- 172.21.15.81:0/4269673092 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f544c0cd030 con 0x5614a8780270 2024-05-09T00:04:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.945+0000 7f54377fe700 1 -- 172.21.15.81:0/4269673092 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5450004440 con 0x5614a8780270 2024-05-09T00:04:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.945+0000 7f546a74bb80 10 client.25214 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:04:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.945+0000 7f546a74bb80 10 client.25214 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.945+0000 7f546a74bb80 20 client.25214 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.945+0000 7f546a74bb80 1 --2- 172.21.15.81:0/4269673092 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5614a87eaac0 0x5614a87ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.945+0000 7f546a74bb80 4 client.25214 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:04:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.945+0000 7f546a74bb80 1 -- 172.21.15.81:0/4269673092 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5614a86c2e60 con 0x5614a87eaac0 2024-05-09T00:04:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.945+0000 7f5457fff700 1 --2- 172.21.15.81:0/4269673092 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5614a87eaac0 0x5614a87ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:02.942 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.946+0000 7f54377fe700 10 client.25214 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:02.943 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:02.946+0000 7f5457fff700 1 --2- 172.21.15.81:0/4269673092 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5614a87eaac0 0x5614a87ecee0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66b793b721a90981 server_cookie=d128a1d3409168ac in_seq=0 out_seq=0 2024-05-09T00:04:03.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:02 smithi150 ceph-mon[46187]: mgrmap e24: x(active, since 63s), standbys: y, z 2024-05-09T00:04:03.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:02 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:04:03.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:02 smithi150 ceph-mon[46187]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-09T00:04:03.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:02 smithi171 ceph-mon[47351]: mgrmap e24: x(active, since 63s), standbys: y, z 2024-05-09T00:04:03.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:02 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:04:03.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:02 smithi171 ceph-mon[47351]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-09T00:04:03.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:02 smithi081 ceph-mon[42474]: mgrmap e24: x(active, since 63s), standbys: y, z 2024-05-09T00:04:03.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:02 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:04:03.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:02 smithi081 ceph-mon[42474]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-05-09T00:04:04.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:03 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:04.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:03 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:04:04.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:03 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:04:04.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:03 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:04.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:03 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:04:04.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:03 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:04:04.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:03 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:04:04.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:03 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:04:04.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:03 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:04:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.473+0000 7f54377fe700 1 -- 172.21.15.81:0/4269673092 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5614a86c2e60 con 0x5614a87eaac0 2024-05-09T00:04:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.473+0000 7f54377fe700 10 client.25214 handle_command_reply: tid=0 2024-05-09T00:04:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.473+0000 7f546a74bb80 1 client.25214 shutdown 2024-05-09T00:04:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.474+0000 7f546a74bb80 1 -- 172.21.15.81:0/4269673092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a8780270 msgr2=0x5614a877db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.474+0000 7f546a74bb80 1 --2- 172.21.15.81:0/4269673092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a8780270 0x5614a877db30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5450009230 tx=0x7f5450004b40 comp rx=0 tx=0).stop 2024-05-09T00:04:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.474+0000 7f546a74bb80 1 -- 172.21.15.81:0/4269673092 shutdown_connections 2024-05-09T00:04:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.474+0000 7f546a74bb80 1 --2- 172.21.15.81:0/4269673092 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5614a87eaac0 0x5614a87ecee0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.474+0000 7f546a74bb80 1 --2- 172.21.15.81:0/4269673092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5614a8780270 0x5614a877db30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.474+0000 7f54377fe700 0 client.25214 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.474+0000 7f546a74bb80 1 --2- 172.21.15.81:0/4269673092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5614a877a480 0x5614a878b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.474+0000 7f546a74bb80 1 --2- 172.21.15.81:0/4269673092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5614a877f950 0x5614a877d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.474+0000 7f546a74bb80 1 -- 172.21.15.81:0/4269673092 >> 172.21.15.81:0/4269673092 conn(0x5614a86d81b0 msgr2=0x5614a878f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.474+0000 7f546a74bb80 1 -- 172.21.15.81:0/4269673092 shutdown_connections 2024-05-09T00:04:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.474+0000 7f546a74bb80 1 -- 172.21.15.81:0/4269673092 wait complete. 2024-05-09T00:04:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.474+0000 7f546a74bb80 20 client.25214 trim_cache size 0 max 16384 2024-05-09T00:04:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:04:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:04:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:04:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:04:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.475+0000 7f545e591700 1 -- 172.21.15.81:0/1966252416 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f54400a1440 msgr2=0x7f54400a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.475+0000 7f545e591700 1 --2- 172.21.15.81:0/1966252416 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f54400a1440 0x7f54400a3900 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5450009ec0 tx=0x7f54500092f0 comp rx=0 tx=0).stop 2024-05-09T00:04:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.475+0000 7f545e591700 1 -- 172.21.15.81:0/1966252416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5458106230 msgr2=0x7f54580737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.475+0000 7f545e591700 1 --2- 172.21.15.81:0/1966252416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5458106230 0x7f54580737e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f544c00e970 tx=0x7f544c00ec80 comp rx=0 tx=0).stop 2024-05-09T00:04:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.475+0000 7f545e591700 1 -- 172.21.15.81:0/1966252416 shutdown_connections 2024-05-09T00:04:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.475+0000 7f545e591700 1 --2- 172.21.15.81:0/1966252416 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f54400a1440 0x7f54400a3900 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.475+0000 7f545e591700 1 --2- 172.21.15.81:0/1966252416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5458073d20 0x7f54581a5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.475+0000 7f545e591700 1 --2- 172.21.15.81:0/1966252416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5458101110 0x7f54580732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.475+0000 7f545e591700 1 --2- 172.21.15.81:0/1966252416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5458106230 0x7f54580737e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.475+0000 7f545e591700 1 -- 172.21.15.81:0/1966252416 >> 172.21.15.81:0/1966252416 conn(0x7f54580fc990 msgr2=0x7f54580fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.475+0000 7f545e591700 1 -- 172.21.15.81:0/1966252416 shutdown_connections 2024-05-09T00:04:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:04.475+0000 7f545e591700 1 -- 172.21.15.81:0/1966252416 wait complete. 2024-05-09T00:04:05.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:04 smithi150 ceph-mon[46187]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-09T00:04:05.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-mon[47351]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-09T00:04:05.303 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: *** Caught signal (Segmentation fault) ** 2024-05-09T00:04:05.303 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: in thread 7f882019f700 thread_name:md_log_replay 2024-05-09T00:04:05.303 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable) 2024-05-09T00:04:05.303 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8830d60d20] 2024-05-09T00:04:05.303 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 2: /usr/bin/ceph-mds(+0x4be5a2) [0x555dad0b45a2] 2024-05-09T00:04:05.303 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x555dad0b67f3] 2024-05-09T00:04:05.303 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 4: (MDLog::_replay_thread()+0x699) [0x555dad114079] 2024-05-09T00:04:05.303 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 5: (MDLog::ReplayThread::entry()+0x11) [0x555dacdcb5f1] 2024-05-09T00:04:05.303 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f8830d561ca] 2024-05-09T00:04:05.303 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 7: clone() 2024-05-09T00:04:05.304 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 2024-05-09T00:04:04.953+0000 7f882019f700 -1 *** Caught signal (Segmentation fault) ** 2024-05-09T00:04:05.304 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: in thread 7f882019f700 thread_name:md_log_replay 2024-05-09T00:04:05.304 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 2024-05-09T00:04:05.304 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable) 2024-05-09T00:04:05.304 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8830d60d20] 2024-05-09T00:04:05.304 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 2: /usr/bin/ceph-mds(+0x4be5a2) [0x555dad0b45a2] 2024-05-09T00:04:05.304 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x555dad0b67f3] 2024-05-09T00:04:05.304 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 4: (MDLog::_replay_thread()+0x699) [0x555dad114079] 2024-05-09T00:04:05.304 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 5: (MDLog::ReplayThread::entry()+0x11) [0x555dacdcb5f1] 2024-05-09T00:04:05.304 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f8830d561ca] 2024-05-09T00:04:05.304 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 7: clone() 2024-05-09T00:04:05.304 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-05-09T00:04:05.304 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 2024-05-09T00:04:05.304 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 0> 2024-05-09T00:04:04.953+0000 7f882019f700 -1 *** Caught signal (Segmentation fault) ** 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: in thread 7f882019f700 thread_name:md_log_replay 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable) 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8830d60d20] 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 2: /usr/bin/ceph-mds(+0x4be5a2) [0x555dad0b45a2] 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x555dad0b67f3] 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 4: (MDLog::_replay_thread()+0x699) [0x555dad114079] 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 5: (MDLog::ReplayThread::entry()+0x11) [0x555dacdcb5f1] 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f8830d561ca] 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 7: clone() 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 0> 2024-05-09T00:04:04.953+0000 7f882019f700 -1 *** Caught signal (Segmentation fault) ** 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: in thread 7f882019f700 thread_name:md_log_replay 2024-05-09T00:04:05.305 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 2024-05-09T00:04:05.306 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable) 2024-05-09T00:04:05.306 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f8830d60d20] 2024-05-09T00:04:05.306 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 2: /usr/bin/ceph-mds(+0x4be5a2) [0x555dad0b45a2] 2024-05-09T00:04:05.306 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x555dad0b67f3] 2024-05-09T00:04:05.306 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 4: (MDLog::_replay_thread()+0x699) [0x555dad114079] 2024-05-09T00:04:05.306 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 5: (MDLog::ReplayThread::entry()+0x11) [0x555dacdcb5f1] 2024-05-09T00:04:05.306 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f8830d561ca] 2024-05-09T00:04:05.306 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 7: clone() 2024-05-09T00:04:05.306 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-05-09T00:04:05.306 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[83907]: 2024-05-09T00:04:05.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:04 smithi081 ceph-mon[42474]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-09T00:04:05.802 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:05 smithi171 systemd[1]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.c.service: Main process exited, code=exited, status=139/n/a 2024-05-09T00:04:05.802 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:05 smithi171 systemd[1]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.c.service: Failed with result 'exit-code'. 2024-05-09T00:04:07.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:06 smithi150 ceph-mon[46187]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-09T00:04:07.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:06 smithi171 ceph-mon[47351]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-09T00:04:07.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:06 smithi081 ceph-mon[42474]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-09T00:04:09.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:08 smithi150 ceph-mon[46187]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-09T00:04:09.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:08 smithi171 ceph-mon[47351]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-09T00:04:09.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:08 smithi081 ceph-mon[42474]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-09T00:04:11.203 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:04:11.232 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:10 smithi081 ceph-mon[42474]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-05-09T00:04:11.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:10 smithi150 ceph-mon[46187]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-05-09T00:04:11.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:10 smithi171 ceph-mon[47351]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-05-09T00:04:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.376+0000 7fb78eaf7700 1 -- 172.21.15.81:0/2957476019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7880fff40 msgr2=0x7fb78810c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.376+0000 7fb78eaf7700 1 --2- 172.21.15.81:0/2957476019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7880fff40 0x7fb78810c400 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c240 tx=0x7fb78000c550 comp rx=0 tx=0).stop 2024-05-09T00:04:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.376+0000 7fb78eaf7700 1 -- 172.21.15.81:0/2957476019 shutdown_connections 2024-05-09T00:04:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.376+0000 7fb78eaf7700 1 --2- 172.21.15.81:0/2957476019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb788105640 0x7fb788105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.376+0000 7fb78eaf7700 1 --2- 172.21.15.81:0/2957476019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7880fff40 0x7fb78810c400 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.376+0000 7fb78eaf7700 1 --2- 172.21.15.81:0/2957476019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7880ff580 0x7fb7880ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.376+0000 7fb78eaf7700 1 -- 172.21.15.81:0/2957476019 >> 172.21.15.81:0/2957476019 conn(0x7fb7880763a0 msgr2=0x7fb7880fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.377+0000 7fb78eaf7700 1 -- 172.21.15.81:0/2957476019 shutdown_connections 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.377+0000 7fb78eaf7700 1 -- 172.21.15.81:0/2957476019 wait complete. 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.377+0000 7fb78eaf7700 1 Processor -- start 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.377+0000 7fb78eaf7700 1 -- start start 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.377+0000 7fb78eaf7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7880ff580 0x7fb7881995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.377+0000 7fb78eaf7700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7880fff40 0x7fb788199b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.377+0000 7fb78eaf7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb788105640 0x7fb78819ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.377+0000 7fb78eaf7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78819e510 con 0x7fb788105640 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.377+0000 7fb78eaf7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78819e680 con 0x7fb7880ff580 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.377+0000 7fb78eaf7700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78819e840 con 0x7fb7880fff40 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.378+0000 7fb78c893700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7880ff580 0x7fb7881995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.378+0000 7fb787fff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7880fff40 0x7fb788199b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.378+0000 7fb78c893700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7880ff580 0x7fb7881995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.81:39398/0 (socket says 172.21.15.81:39398) 2024-05-09T00:04:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.378+0000 7fb78c893700 1 -- 172.21.15.81:0/4051226575 learned_addr learned my addr 172.21.15.81:0/4051226575 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:11.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.378+0000 7fb78d094700 1 --2- 172.21.15.81:0/4051226575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb788105640 0x7fb78819ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.378+0000 7fb78c893700 1 -- 172.21.15.81:0/4051226575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7880fff40 msgr2=0x7fb788199b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.378+0000 7fb78c893700 1 --2- 172.21.15.81:0/4051226575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7880fff40 0x7fb788199b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.378+0000 7fb78c893700 1 -- 172.21.15.81:0/4051226575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb788105640 msgr2=0x7fb78819ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.378+0000 7fb78c893700 1 --2- 172.21.15.81:0/4051226575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb788105640 0x7fb78819ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.378+0000 7fb78c893700 1 -- 172.21.15.81:0/4051226575 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb78000ae10 con 0x7fb7880ff580 2024-05-09T00:04:11.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.378+0000 7fb78d094700 1 --2- 172.21.15.81:0/4051226575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb788105640 0x7fb78819ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:04:11.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.378+0000 7fb78c893700 1 --2- 172.21.15.81:0/4051226575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7880ff580 0x7fb7881995f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00e9a0 tx=0x7fb77c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:11.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.379+0000 7fb785ffb700 1 -- 172.21.15.81:0/4051226575 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c009790 con 0x7fb7880ff580 2024-05-09T00:04:11.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.379+0000 7fb78eaf7700 1 -- 172.21.15.81:0/4051226575 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb78819eb20 con 0x7fb7880ff580 2024-05-09T00:04:11.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.379+0000 7fb78eaf7700 1 -- 172.21.15.81:0/4051226575 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7881a6360 con 0x7fb7880ff580 2024-05-09T00:04:11.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.379+0000 7fb785ffb700 1 -- 172.21.15.81:0/4051226575 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb77c010430 con 0x7fb7880ff580 2024-05-09T00:04:11.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.379+0000 7fb785ffb700 1 -- 172.21.15.81:0/4051226575 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c018680 con 0x7fb7880ff580 2024-05-09T00:04:11.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.383+0000 7fb79acb1b80 1 Processor -- start 2024-05-09T00:04:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.383+0000 7fb785ffb700 1 -- 172.21.15.81:0/4051226575 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7fb77c00ca10 con 0x7fb7880ff580 2024-05-09T00:04:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.383+0000 7fb785ffb700 1 --2- 172.21.15.81:0/4051226575 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb7780a14b0 0x7fb7780a3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.383+0000 7fb785ffb700 1 -- 172.21.15.81:0/4051226575 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb77c014070 con 0x7fb7880ff580 2024-05-09T00:04:11.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.383+0000 7fb78d094700 1 --2- 172.21.15.81:0/4051226575 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb7780a14b0 0x7fb7780a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb79acb1b80 1 -- start start 2024-05-09T00:04:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb79acb1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0de00 0x55c6a4d0e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb79acb1b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d0e720 0x55c6a4d08350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb79acb1b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d08890 0x55c6a4d08cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb79acb1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6a4c5f150 con 0x55c6a4d0de00 2024-05-09T00:04:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb79acb1b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6a4c5cb10 con 0x55c6a4d0e720 2024-05-09T00:04:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb79acb1b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6a4c58400 con 0x55c6a4d08890 2024-05-09T00:04:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb78c893700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0de00 0x55c6a4d0e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb78c893700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0de00 0x55c6a4d0e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40062/0 (socket says 172.21.15.81:40062) 2024-05-09T00:04:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb78c893700 1 -- 172.21.15.81:0/2610798854 learned_addr learned my addr 172.21.15.81:0/2610798854 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb787fff700 1 --2- 172.21.15.81:0/2610798854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d0e720 0x55c6a4d08350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb78c893700 1 -- 172.21.15.81:0/2610798854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d08890 msgr2=0x55c6a4d08cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:04:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb78c893700 1 --2- 172.21.15.81:0/2610798854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d08890 0x55c6a4d08cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb78c893700 1 -- 172.21.15.81:0/2610798854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d0e720 msgr2=0x55c6a4d08350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb78c893700 1 --2- 172.21.15.81:0/2610798854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d0e720 0x55c6a4d08350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb78d094700 1 --2- 172.21.15.81:0/4051226575 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb7780a14b0 0x7fb7780a3970 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c8e0 tx=0x7fb78000c1d0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.384+0000 7fb78c893700 1 -- 172.21.15.81:0/2610798854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6a4ad93b0 con 0x55c6a4d0de00 2024-05-09T00:04:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.385+0000 7fb78c893700 1 --2- 172.21.15.81:0/2610798854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0de00 0x55c6a4d0e1e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00c2d0 tx=0x7fb77c099870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8adb8e4a7d499b03 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.385+0000 7fb772ffd700 1 -- 172.21.15.81:0/2610798854 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c09aea0 con 0x55c6a4d0de00 2024-05-09T00:04:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.385+0000 7fb772ffd700 1 -- 172.21.15.81:0/2610798854 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb77c09dcc0 con 0x55c6a4d0de00 2024-05-09T00:04:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.385+0000 7fb772ffd700 1 -- 172.21.15.81:0/2610798854 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77c0a20e0 con 0x55c6a4d0de00 2024-05-09T00:04:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.385+0000 7fb79acb1b80 1 -- 172.21.15.81:0/2610798854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0de00 msgr2=0x55c6a4d0e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.385+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/2610798854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0de00 0x55c6a4d0e1e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00c2d0 tx=0x7fb77c099870 comp rx=0 tx=0).stop 2024-05-09T00:04:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.386+0000 7fb79acb1b80 1 -- 172.21.15.81:0/2610798854 shutdown_connections 2024-05-09T00:04:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.386+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/2610798854 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d08890 0x55c6a4d08cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.386+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/2610798854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0de00 0x55c6a4d0e1e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.386+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/2610798854 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d0e720 0x55c6a4d08350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.386+0000 7fb79acb1b80 1 -- 172.21.15.81:0/2610798854 >> 172.21.15.81:0/2610798854 conn(0x55c6a4c66210 msgr2=0x55c6a4d02df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.386+0000 7fb79acb1b80 1 -- 172.21.15.81:0/2610798854 shutdown_connections 2024-05-09T00:04:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.386+0000 7fb79acb1b80 1 -- 172.21.15.81:0/2610798854 wait complete. 2024-05-09T00:04:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.386+0000 7fb79acb1b80 1 -- start start 2024-05-09T00:04:11.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.386+0000 7fb79acb1b80 1 Processor -- start 2024-05-09T00:04:11.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.387+0000 7fb79acb1b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d08890 0x55c6a4d11a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.387+0000 7fb79acb1b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d0de00 0x55c6a4d11f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.387+0000 7fb79acb1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0e720 0x55c6a4d124d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.387+0000 7fb79acb1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6a4bf4560 con 0x55c6a4d0e720 2024-05-09T00:04:11.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.387+0000 7fb79acb1b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6a4bf4200 con 0x55c6a4d08890 2024-05-09T00:04:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.387+0000 7fb79acb1b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6a4adb6a0 con 0x55c6a4d0de00 2024-05-09T00:04:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.387+0000 7fb79acb1b80 10 client.0 _ll_register_callbacks cb 0x55c6a4bfdb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.387+0000 7fb787fff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d0de00 0x55c6a4d11f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.387+0000 7fb787fff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d0de00 0x55c6a4d11f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:47646/0 (socket says 172.21.15.81:47646) 2024-05-09T00:04:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.387+0000 7fb787fff700 1 -- 172.21.15.81:0/2664323327 learned_addr learned my addr 172.21.15.81:0/2664323327 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.387+0000 7fb78c893700 1 --2- 172.21.15.81:0/2664323327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d08890 0x55c6a4d11a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.388+0000 7fb787fff700 1 -- 172.21.15.81:0/2664323327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d08890 msgr2=0x55c6a4d11a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.388+0000 7fb787fff700 1 --2- 172.21.15.81:0/2664323327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d08890 0x55c6a4d11a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.388+0000 7fb787fff700 1 -- 172.21.15.81:0/2664323327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0e720 msgr2=0x55c6a4d124d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:04:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.388+0000 7fb78d094700 1 --2- 172.21.15.81:0/2664323327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0e720 0x55c6a4d124d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.388+0000 7fb787fff700 1 --2- 172.21.15.81:0/2664323327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0e720 0x55c6a4d124d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.388+0000 7fb787fff700 1 -- 172.21.15.81:0/2664323327 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7881a6360 con 0x55c6a4d0de00 2024-05-09T00:04:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.388+0000 7fb78d094700 1 --2- 172.21.15.81:0/2664323327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0e720 0x55c6a4d124d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:11.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.388+0000 7fb787fff700 1 --2- 172.21.15.81:0/2664323327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d0de00 0x55c6a4d11f90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb774007e80 tx=0x7fb7740116c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1874edc267779c76 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:11.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.389+0000 7fb767fff700 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-05-09T00:04:11.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.389+0000 7fb767fff700 1 -- 172.21.15.81:0/2664323327 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774004460 con 0x55c6a4d0de00 2024-05-09T00:04:11.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.389+0000 7fb767fff700 1 -- 172.21.15.81:0/2664323327 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb774011e50 con 0x55c6a4d0de00 2024-05-09T00:04:11.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.389+0000 7fb79acb1b80 1 -- 172.21.15.81:0/2664323327 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c6a4bb1270 con 0x55c6a4d0de00 2024-05-09T00:04:11.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.391+0000 7fb767fff700 1 -- 172.21.15.81:0/2664323327 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb774003680 con 0x55c6a4d0de00 2024-05-09T00:04:11.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.391+0000 7fb79acb1b80 10 client.25264 fetch_fsmap learned FSMap version 24 2024-05-09T00:04:11.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.391+0000 7fb79acb1b80 1 -- 172.21.15.81:0/2664323327 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c6a4a85b60 con 0x55c6a4d0de00 2024-05-09T00:04:11.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.396+0000 7fb767fff700 1 -- 172.21.15.81:0/2664323327 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c6a4bb1270 con 0x55c6a4d0de00 2024-05-09T00:04:11.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.396+0000 7fb767fff700 1 -- 172.21.15.81:0/2664323327 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb77401b8e0 con 0x55c6a4d0de00 2024-05-09T00:04:11.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.396+0000 7fb79acb1b80 10 client.25264 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:04:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.396+0000 7fb79acb1b80 10 client.25264 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.396+0000 7fb79acb1b80 20 client.25264 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.396+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/2664323327 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c6a4d22230 0x55c6a4d24650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.396+0000 7fb79acb1b80 4 client.25264 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.396+0000 7fb79acb1b80 1 -- 172.21.15.81:0/2664323327 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c6a4cd7810 con 0x55c6a4d22230 2024-05-09T00:04:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.396+0000 7fb78c893700 1 --2- 172.21.15.81:0/2664323327 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c6a4d22230 0x55c6a4d24650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.396+0000 7fb78c893700 1 --2- 172.21.15.81:0/2664323327 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c6a4d22230 0x55c6a4d24650 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a65f43c4d75f8e8 server_cookie=17fcc26fc68fdea2 in_seq=0 out_seq=0 2024-05-09T00:04:11.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.396+0000 7fb767fff700 10 client.25264 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.397+0000 7fb767fff700 1 -- 172.21.15.81:0/2664323327 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c6a4cd7810 con 0x55c6a4d22230 2024-05-09T00:04:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.397+0000 7fb767fff700 10 client.25264 handle_command_reply: tid=0 2024-05-09T00:04:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.397+0000 7fb79acb1b80 1 client.25264 shutdown 2024-05-09T00:04:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.397+0000 7fb79acb1b80 1 -- 172.21.15.81:0/2664323327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d0de00 msgr2=0x55c6a4d11f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.397+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/2664323327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d0de00 0x55c6a4d11f90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb774007e80 tx=0x7fb7740116c0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.397+0000 7fb79acb1b80 1 -- 172.21.15.81:0/2664323327 shutdown_connections 2024-05-09T00:04:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.397+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/2664323327 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c6a4d22230 0x55c6a4d24650 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.397+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/2664323327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d08890 0x55c6a4d11a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.397+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/2664323327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0e720 0x55c6a4d124d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.397+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/2664323327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d0de00 0x55c6a4d11f90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.397+0000 7fb79acb1b80 1 -- 172.21.15.81:0/2664323327 >> 172.21.15.81:0/2664323327 conn(0x55c6a4c66210 msgr2=0x55c6a4d025a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:11.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.397+0000 7fb767fff700 0 client.25264 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.402+0000 7fb79acb1b80 1 -- 172.21.15.81:0/2664323327 shutdown_connections 2024-05-09T00:04:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.402+0000 7fb79acb1b80 1 -- 172.21.15.81:0/2664323327 wait complete. 2024-05-09T00:04:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.402+0000 7fb79acb1b80 20 client.25264 trim_cache size 0 max 16384 2024-05-09T00:04:11.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.419+0000 7fb79acb1b80 1 Processor -- start 2024-05-09T00:04:11.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.419+0000 7fb79acb1b80 1 -- start start 2024-05-09T00:04:11.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.419+0000 7fb79acb1b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d08890 0x55c6a4d02d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.419+0000 7fb79acb1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0de00 0x55c6a4d19160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.419+0000 7fb79acb1b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d0e720 0x55c6a4d196a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.419+0000 7fb79acb1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6a4d092a0 con 0x55c6a4d0de00 2024-05-09T00:04:11.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.419+0000 7fb79acb1b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6a4d04070 con 0x55c6a4d08890 2024-05-09T00:04:11.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.419+0000 7fb79acb1b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6a4d1f900 con 0x55c6a4d0e720 2024-05-09T00:04:11.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.419+0000 7fb787fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0de00 0x55c6a4d19160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.419+0000 7fb787fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0de00 0x55c6a4d19160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40074/0 (socket says 172.21.15.81:40074) 2024-05-09T00:04:11.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.419+0000 7fb787fff700 1 -- 172.21.15.81:0/3999288874 learned_addr learned my addr 172.21.15.81:0/3999288874 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:11.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.419+0000 7fb78c893700 1 --2- 172.21.15.81:0/3999288874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d08890 0x55c6a4d02d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.419+0000 7fb78d094700 1 --2- 172.21.15.81:0/3999288874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d0e720 0x55c6a4d196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.420+0000 7fb787fff700 1 -- 172.21.15.81:0/3999288874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d0e720 msgr2=0x55c6a4d196a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:11.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.420+0000 7fb787fff700 1 --2- 172.21.15.81:0/3999288874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d0e720 0x55c6a4d196a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.420+0000 7fb787fff700 1 -- 172.21.15.81:0/3999288874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d08890 msgr2=0x55c6a4d02d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:11.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.420+0000 7fb787fff700 1 --2- 172.21.15.81:0/3999288874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d08890 0x55c6a4d02d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.420+0000 7fb787fff700 1 -- 172.21.15.81:0/3999288874 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6a4c1e560 con 0x55c6a4d0de00 2024-05-09T00:04:11.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.420+0000 7fb78d094700 1 --2- 172.21.15.81:0/3999288874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d0e720 0x55c6a4d196a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:11.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.420+0000 7fb787fff700 1 --2- 172.21.15.81:0/3999288874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0de00 0x55c6a4d19160 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb7740077c0 tx=0x7fb77401be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbaa9b500ccda2d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:11.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.420+0000 7fb7737fe700 1 -- 172.21.15.81:0/3999288874 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7740054d0 con 0x55c6a4d0de00 2024-05-09T00:04:11.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.420+0000 7fb7737fe700 1 -- 172.21.15.81:0/3999288874 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb774011e50 con 0x55c6a4d0de00 2024-05-09T00:04:11.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.420+0000 7fb7737fe700 1 -- 172.21.15.81:0/3999288874 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7740039f0 con 0x55c6a4d0de00 2024-05-09T00:04:11.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.421+0000 7fb79acb1b80 1 -- 172.21.15.81:0/3999288874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0de00 msgr2=0x55c6a4d19160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.421+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/3999288874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0de00 0x55c6a4d19160 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb7740077c0 tx=0x7fb77401be90 comp rx=0 tx=0).stop 2024-05-09T00:04:11.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.421+0000 7fb79acb1b80 1 -- 172.21.15.81:0/3999288874 shutdown_connections 2024-05-09T00:04:11.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.421+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/3999288874 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d08890 0x55c6a4d02d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.421+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/3999288874 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d0e720 0x55c6a4d196a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.421+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/3999288874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0de00 0x55c6a4d19160 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.421+0000 7fb79acb1b80 1 -- 172.21.15.81:0/3999288874 >> 172.21.15.81:0/3999288874 conn(0x55c6a4c66210 msgr2=0x55c6a4d0bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:11.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.421+0000 7fb79acb1b80 1 -- 172.21.15.81:0/3999288874 shutdown_connections 2024-05-09T00:04:11.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.421+0000 7fb79acb1b80 1 -- 172.21.15.81:0/3999288874 wait complete. 2024-05-09T00:04:11.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.421+0000 7fb79acb1b80 1 -- start start 2024-05-09T00:04:11.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.421+0000 7fb79acb1b80 1 Processor -- start 2024-05-09T00:04:11.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.422+0000 7fb79acb1b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d08890 0x55c6a4d19660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.422+0000 7fb79acb1b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d0de00 0x55c6a4d15140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.422+0000 7fb79acb1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0e720 0x55c6a4d15880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.422+0000 7fb79acb1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6a4d15f90 con 0x55c6a4d0e720 2024-05-09T00:04:11.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.422+0000 7fb79acb1b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6a4d77720 con 0x55c6a4d0de00 2024-05-09T00:04:11.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.422+0000 7fb79acb1b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6a4d77860 con 0x55c6a4d08890 2024-05-09T00:04:11.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.422+0000 7fb79acb1b80 10 client.0 _ll_register_callbacks cb 0x55c6a4bfdb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:11.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.422+0000 7fb78d094700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0e720 0x55c6a4d15880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.422+0000 7fb78d094700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0e720 0x55c6a4d15880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40076/0 (socket says 172.21.15.81:40076) 2024-05-09T00:04:11.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.422+0000 7fb78d094700 1 -- 172.21.15.81:0/359403631 learned_addr learned my addr 172.21.15.81:0/359403631 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.422+0000 7fb78c893700 1 --2- 172.21.15.81:0/359403631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d08890 0x55c6a4d19660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.422+0000 7fb787fff700 1 --2- 172.21.15.81:0/359403631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d0de00 0x55c6a4d15140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.423+0000 7fb78d094700 1 -- 172.21.15.81:0/359403631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d08890 msgr2=0x55c6a4d19660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.423+0000 7fb78d094700 1 --2- 172.21.15.81:0/359403631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d08890 0x55c6a4d19660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.423+0000 7fb78d094700 1 -- 172.21.15.81:0/359403631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d0de00 msgr2=0x55c6a4d15140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.423+0000 7fb78d094700 1 --2- 172.21.15.81:0/359403631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d0de00 0x55c6a4d15140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.423+0000 7fb78d094700 1 -- 172.21.15.81:0/359403631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c6a4a85b60 con 0x55c6a4d0e720 2024-05-09T00:04:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.423+0000 7fb78d094700 1 --2- 172.21.15.81:0/359403631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0e720 0x55c6a4d15880 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb780006070 tx=0x7fb78000aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc52c943ecef5bbb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.423+0000 7fb767fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.423+0000 7fb767fff700 1 -- 172.21.15.81:0/359403631 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78000f040 con 0x55c6a4d0e720 2024-05-09T00:04:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.423+0000 7fb767fff700 1 -- 172.21.15.81:0/359403631 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb780007d90 con 0x55c6a4d0e720 2024-05-09T00:04:11.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.423+0000 7fb79acb1b80 1 -- 172.21.15.81:0/359403631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb77c09dcc0 con 0x55c6a4d0e720 2024-05-09T00:04:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.423+0000 7fb767fff700 1 -- 172.21.15.81:0/359403631 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb78002a460 con 0x55c6a4d0e720 2024-05-09T00:04:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.423+0000 7fb79acb1b80 10 client.15732 fetch_fsmap learned FSMap version 24 2024-05-09T00:04:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.423+0000 7fb79acb1b80 1 -- 172.21.15.81:0/359403631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c6a4addcd0 con 0x55c6a4d0e720 2024-05-09T00:04:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.423+0000 7fb767fff700 1 -- 172.21.15.81:0/359403631 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb77c09dcc0 con 0x55c6a4d0e720 2024-05-09T00:04:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.424+0000 7fb767fff700 1 -- 172.21.15.81:0/359403631 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb780008200 con 0x55c6a4d0e720 2024-05-09T00:04:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.424+0000 7fb79acb1b80 10 client.15732 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:04:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.424+0000 7fb79acb1b80 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:11.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.424+0000 7fb79acb1b80 20 client.15732 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:11.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.424+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/359403631 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c6a4d78e10 0x55c6a4d7b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.424+0000 7fb79acb1b80 4 client.15732 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:04:11.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.424+0000 7fb79acb1b80 1 -- 172.21.15.81:0/359403631 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c6a4c50ec0 con 0x55c6a4d78e10 2024-05-09T00:04:11.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.424+0000 7fb78c893700 1 --2- 172.21.15.81:0/359403631 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c6a4d78e10 0x55c6a4d7b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.424+0000 7fb767fff700 10 client.15732 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:11.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.424+0000 7fb78c893700 1 --2- 172.21.15.81:0/359403631 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c6a4d78e10 0x55c6a4d7b230 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e454f13d781d123 server_cookie=e86fe4ebf280b0c7 in_seq=0 out_seq=0 2024-05-09T00:04:11.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.424+0000 7fb767fff700 1 -- 172.21.15.81:0/359403631 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c6a4c50ec0 con 0x55c6a4d78e10 2024-05-09T00:04:11.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.424+0000 7fb767fff700 10 client.15732 handle_command_reply: tid=0 2024-05-09T00:04:11.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.425+0000 7fb79acb1b80 1 client.15732 shutdown 2024-05-09T00:04:11.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.425+0000 7fb79acb1b80 1 -- 172.21.15.81:0/359403631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0e720 msgr2=0x55c6a4d15880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.425+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/359403631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0e720 0x55c6a4d15880 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb780006070 tx=0x7fb78000aaf0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.425+0000 7fb79acb1b80 1 -- 172.21.15.81:0/359403631 shutdown_connections 2024-05-09T00:04:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.425+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/359403631 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c6a4d78e10 0x55c6a4d7b230 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.425+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/359403631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c6a4d0e720 0x55c6a4d15880 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.425+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/359403631 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c6a4d08890 0x55c6a4d19660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.425+0000 7fb767fff700 0 client.15732 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.425+0000 7fb79acb1b80 1 --2- 172.21.15.81:0/359403631 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c6a4d0de00 0x55c6a4d15140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.425+0000 7fb79acb1b80 1 -- 172.21.15.81:0/359403631 >> 172.21.15.81:0/359403631 conn(0x55c6a4c66210 msgr2=0x55c6a4d10340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:11.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.425+0000 7fb79acb1b80 1 -- 172.21.15.81:0/359403631 shutdown_connections 2024-05-09T00:04:11.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.425+0000 7fb79acb1b80 1 -- 172.21.15.81:0/359403631 wait complete. 2024-05-09T00:04:11.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.425+0000 7fb79acb1b80 20 client.15732 trim_cache size 0 max 16384 2024-05-09T00:04:11.433 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:04:11.434 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:04:11.434 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:04:11.434 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:04:11.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.426+0000 7fb78eaf7700 1 -- 172.21.15.81:0/4051226575 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb7780a14b0 msgr2=0x7fb7780a3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.426+0000 7fb78eaf7700 1 --2- 172.21.15.81:0/4051226575 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb7780a14b0 0x7fb7780a3970 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb78000c8e0 tx=0x7fb78000c1d0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.426+0000 7fb78eaf7700 1 -- 172.21.15.81:0/4051226575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7880ff580 msgr2=0x7fb7881995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.426+0000 7fb78eaf7700 1 --2- 172.21.15.81:0/4051226575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7880ff580 0x7fb7881995f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb77c00e9a0 tx=0x7fb77c00ecb0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.426+0000 7fb78eaf7700 1 -- 172.21.15.81:0/4051226575 shutdown_connections 2024-05-09T00:04:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.426+0000 7fb78eaf7700 1 --2- 172.21.15.81:0/4051226575 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb7780a14b0 0x7fb7780a3970 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.426+0000 7fb78eaf7700 1 --2- 172.21.15.81:0/4051226575 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb7880ff580 0x7fb7881995f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.426+0000 7fb78eaf7700 1 --2- 172.21.15.81:0/4051226575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb788105640 0x7fb78819ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.426+0000 7fb78eaf7700 1 --2- 172.21.15.81:0/4051226575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb7880fff40 0x7fb788199b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.426+0000 7fb78eaf7700 1 -- 172.21.15.81:0/4051226575 >> 172.21.15.81:0/4051226575 conn(0x7fb7880763a0 msgr2=0x7fb7880fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.426+0000 7fb78eaf7700 1 -- 172.21.15.81:0/4051226575 shutdown_connections 2024-05-09T00:04:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.426+0000 7fb78eaf7700 1 -- 172.21.15.81:0/4051226575 wait complete. 2024-05-09T00:04:11.439 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:04:11.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:04:11.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.643+0000 7fe4d2856700 1 -- 172.21.15.81:0/669096464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc101fd0 msgr2=0x7fe4cc1023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.643+0000 7fe4d2856700 1 --2- 172.21.15.81:0/669096464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc101fd0 0x7fe4cc1023b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009990 tx=0x7fe4bc009ca0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.643+0000 7fe4d2856700 1 -- 172.21.15.81:0/669096464 shutdown_connections 2024-05-09T00:04:11.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.643+0000 7fe4d2856700 1 --2- 172.21.15.81:0/669096464 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4cc10b3f0 0x7fe4cc10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.643+0000 7fe4d2856700 1 --2- 172.21.15.81:0/669096464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc101fd0 0x7fe4cc1023b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.643+0000 7fe4d2856700 1 --2- 172.21.15.81:0/669096464 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4cc1028f0 0x7fe4cc10add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.643+0000 7fe4d2856700 1 -- 172.21.15.81:0/669096464 >> 172.21.15.81:0/669096464 conn(0x7fe4cc0fb7d0 msgr2=0x7fe4cc0fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:11.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.643+0000 7fe4d2856700 1 -- 172.21.15.81:0/669096464 shutdown_connections 2024-05-09T00:04:11.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.643+0000 7fe4d2856700 1 -- 172.21.15.81:0/669096464 wait complete. 2024-05-09T00:04:11.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.644+0000 7fe4d2856700 1 Processor -- start 2024-05-09T00:04:11.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.644+0000 7fe4d2856700 1 -- start start 2024-05-09T00:04:11.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.644+0000 7fe4d2856700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc101fd0 0x7fe4cc197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.644+0000 7fe4d2856700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4cc1028f0 0x7fe4cc1977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.644+0000 7fe4d2856700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4cc10b3f0 0x7fe4cc19bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.644+0000 7fe4d2856700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc19c190 con 0x7fe4cc101fd0 2024-05-09T00:04:11.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.644+0000 7fe4d2856700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc19c300 con 0x7fe4cc10b3f0 2024-05-09T00:04:11.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.644+0000 7fe4d2856700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc19c4c0 con 0x7fe4cc1028f0 2024-05-09T00:04:11.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.644+0000 7fe4cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc101fd0 0x7fe4cc197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.644+0000 7fe4cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc101fd0 0x7fe4cc197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40096/0 (socket says 172.21.15.81:40096) 2024-05-09T00:04:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.644+0000 7fe4cbfff700 1 -- 172.21.15.81:0/3183109442 learned_addr learned my addr 172.21.15.81:0/3183109442 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.644+0000 7fe4d0df3700 1 --2- 172.21.15.81:0/3183109442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4cc10b3f0 0x7fe4cc19bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.644+0000 7fe4cb7fe700 1 --2- 172.21.15.81:0/3183109442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4cc1028f0 0x7fe4cc1977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.645+0000 7fe4cbfff700 1 -- 172.21.15.81:0/3183109442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4cc1028f0 msgr2=0x7fe4cc1977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.645+0000 7fe4cbfff700 1 --2- 172.21.15.81:0/3183109442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4cc1028f0 0x7fe4cc1977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.645+0000 7fe4cbfff700 1 -- 172.21.15.81:0/3183109442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4cc10b3f0 msgr2=0x7fe4cc19bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.645+0000 7fe4cbfff700 1 --2- 172.21.15.81:0/3183109442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4cc10b3f0 0x7fe4cc19bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.645+0000 7fe4cbfff700 1 -- 172.21.15.81:0/3183109442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc0095f0 con 0x7fe4cc101fd0 2024-05-09T00:04:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.645+0000 7fe4cbfff700 1 --2- 172.21.15.81:0/3183109442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc101fd0 0x7fe4cc197270 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009fd0 tx=0x7fe4bc00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.645+0000 7fe4c97fa700 1 -- 172.21.15.81:0/3183109442 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc01d070 con 0x7fe4cc101fd0 2024-05-09T00:04:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.645+0000 7fe4d2856700 1 -- 172.21.15.81:0/3183109442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4cc19c740 con 0x7fe4cc101fd0 2024-05-09T00:04:11.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.645+0000 7fe4d2856700 1 -- 172.21.15.81:0/3183109442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc1a3fe0 con 0x7fe4cc101fd0 2024-05-09T00:04:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.645+0000 7fe4c97fa700 1 -- 172.21.15.81:0/3183109442 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4bc005050 con 0x7fe4cc101fd0 2024-05-09T00:04:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.645+0000 7fe4c97fa700 1 -- 172.21.15.81:0/3183109442 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc004ad0 con 0x7fe4cc101fd0 2024-05-09T00:04:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.646+0000 7fe4b2ffd700 1 -- 172.21.15.81:0/3183109442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ac0052f0 con 0x7fe4cc101fd0 2024-05-09T00:04:11.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.647+0000 7fe4c97fa700 1 -- 172.21.15.81:0/3183109442 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7fe4bc004c30 con 0x7fe4cc101fd0 2024-05-09T00:04:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.648+0000 7fe4c97fa700 1 --2- 172.21.15.81:0/3183109442 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe4b40a14c0 0x7fe4b40a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.648+0000 7fe4c97fa700 1 -- 172.21.15.81:0/3183109442 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fe4bc0cdd40 con 0x7fe4cc101fd0 2024-05-09T00:04:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.648+0000 7fe4cb7fe700 1 --2- 172.21.15.81:0/3183109442 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe4b40a14c0 0x7fe4b40a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:11.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.649+0000 7fe4cb7fe700 1 --2- 172.21.15.81:0/3183109442 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe4b40a14c0 0x7fe4b40a3980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc1987c0 tx=0x7fe4c000b360 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:11.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.654+0000 7fe4c97fa700 1 -- 172.21.15.81:0/3183109442 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe4bc096fe0 con 0x7fe4cc101fd0 2024-05-09T00:04:11.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.954+0000 7fe4b2ffd700 1 -- 172.21.15.81:0/3183109442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4ac005160 con 0x7fe4cc101fd0 2024-05-09T00:04:11.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.956+0000 7fe4c97fa700 1 -- 172.21.15.81:0/3183109442 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10864 (secure 0 0 0) 0x7fe4bc026090 con 0x7fe4cc101fd0 2024-05-09T00:04:11.950 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:04:11.951 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:03:00.676924+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24463":{"gid":24463,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/781467444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":781467444},{"type":"v1","addr":"172.21.15.171:6837","nonce":781467444}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:04:11.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.958+0000 7fe4b2ffd700 1 -- 172.21.15.81:0/3183109442 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe4b40a14c0 msgr2=0x7fe4b40a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.958+0000 7fe4b2ffd700 1 --2- 172.21.15.81:0/3183109442 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe4b40a14c0 0x7fe4b40a3980 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc1987c0 tx=0x7fe4c000b360 comp rx=0 tx=0).stop 2024-05-09T00:04:11.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.958+0000 7fe4b2ffd700 1 -- 172.21.15.81:0/3183109442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc101fd0 msgr2=0x7fe4cc197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:11.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.958+0000 7fe4b2ffd700 1 --2- 172.21.15.81:0/3183109442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc101fd0 0x7fe4cc197270 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009fd0 tx=0x7fe4bc00f670 comp rx=0 tx=0).stop 2024-05-09T00:04:11.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.962+0000 7fe4b2ffd700 1 -- 172.21.15.81:0/3183109442 shutdown_connections 2024-05-09T00:04:11.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.962+0000 7fe4b2ffd700 1 --2- 172.21.15.81:0/3183109442 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe4b40a14c0 0x7fe4b40a3980 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.962+0000 7fe4b2ffd700 1 --2- 172.21.15.81:0/3183109442 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4cc10b3f0 0x7fe4cc19bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.962+0000 7fe4b2ffd700 1 --2- 172.21.15.81:0/3183109442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4cc101fd0 0x7fe4cc197270 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.962+0000 7fe4b2ffd700 1 --2- 172.21.15.81:0/3183109442 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4cc1028f0 0x7fe4cc1977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:11.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.962+0000 7fe4b2ffd700 1 -- 172.21.15.81:0/3183109442 >> 172.21.15.81:0/3183109442 conn(0x7fe4cc0fb7d0 msgr2=0x7fe4cc0fc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:11.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.962+0000 7fe4b2ffd700 1 -- 172.21.15.81:0/3183109442 shutdown_connections 2024-05-09T00:04:11.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:11.962+0000 7fe4b2ffd700 1 -- 172.21.15.81:0/3183109442 wait complete. 2024-05-09T00:04:11.956 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 24 2024-05-09T00:04:11.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:04:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.116+0000 7fb3db09b700 1 -- 172.21.15.81:0/3700872255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4101b10 msgr2=0x7fb3d4105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.116+0000 7fb3db09b700 1 --2- 172.21.15.81:0/3700872255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4101b10 0x7fb3d4105b50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009990 tx=0x7fb3c0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.116+0000 7fb3db09b700 1 -- 172.21.15.81:0/3700872255 shutdown_connections 2024-05-09T00:04:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.116+0000 7fb3db09b700 1 --2- 172.21.15.81:0/3700872255 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d4101160 0x7fb3d4101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.116+0000 7fb3db09b700 1 --2- 172.21.15.81:0/3700872255 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4106280 0x7fb3d410de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.116+0000 7fb3db09b700 1 --2- 172.21.15.81:0/3700872255 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d4101b10 0x7fb3d4105b50 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.117+0000 7fb3db09b700 1 -- 172.21.15.81:0/3700872255 >> 172.21.15.81:0/3700872255 conn(0x7fb3d40fc9e0 msgr2=0x7fb3d40fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.120+0000 7fb3db09b700 1 -- 172.21.15.81:0/3700872255 shutdown_connections 2024-05-09T00:04:12.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.120+0000 7fb3db09b700 1 -- 172.21.15.81:0/3700872255 wait complete. 2024-05-09T00:04:12.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.121+0000 7fb3db09b700 1 Processor -- start 2024-05-09T00:04:12.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.121+0000 7fb3db09b700 1 -- start start 2024-05-09T00:04:12.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.121+0000 7fb3db09b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d4101160 0x7fb3d4072a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.121+0000 7fb3db09b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4106280 0x7fb3d406aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.121+0000 7fb3db09b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d406afd0 0x7fb3d406b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.121+0000 7fb3db09b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d41ac200 con 0x7fb3d406afd0 2024-05-09T00:04:12.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.121+0000 7fb3db09b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d41ac370 con 0x7fb3d4101160 2024-05-09T00:04:12.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.121+0000 7fb3d9638700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d406afd0 0x7fb3d406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.122+0000 7fb3db09b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40731d0 con 0x7fb3d4106280 2024-05-09T00:04:12.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.122+0000 7fb3d9638700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d406afd0 0x7fb3d406b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40112/0 (socket says 172.21.15.81:40112) 2024-05-09T00:04:12.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.122+0000 7fb3d9638700 1 -- 172.21.15.81:0/757410858 learned_addr learned my addr 172.21.15.81:0/757410858 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.122+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/757410858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4106280 0x7fb3d406aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.122+0000 7fb3d8e37700 1 --2- 172.21.15.81:0/757410858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d4101160 0x7fb3d4072a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.122+0000 7fb3d3fff700 1 -- 172.21.15.81:0/757410858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d4101160 msgr2=0x7fb3d4072a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.122+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/757410858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d4101160 0x7fb3d4072a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.122+0000 7fb3d3fff700 1 -- 172.21.15.81:0/757410858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d406afd0 msgr2=0x7fb3d406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.122+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/757410858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d406afd0 0x7fb3d406b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.122+0000 7fb3d3fff700 1 -- 172.21.15.81:0/757410858 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c8009520 con 0x7fb3d4106280 2024-05-09T00:04:12.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.122+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/757410858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4106280 0x7fb3d406aa90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0006010 tx=0x7fb3c0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.122+0000 7fb3d1ffb700 1 -- 172.21.15.81:0/757410858 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c001d070 con 0x7fb3d4106280 2024-05-09T00:04:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.123+0000 7fb3db09b700 1 -- 172.21.15.81:0/757410858 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c00095f0 con 0x7fb3d4106280 2024-05-09T00:04:12.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.123+0000 7fb3d1ffb700 1 -- 172.21.15.81:0/757410858 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3c0022470 con 0x7fb3d4106280 2024-05-09T00:04:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.123+0000 7fb3d1ffb700 1 -- 172.21.15.81:0/757410858 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0017650 con 0x7fb3d4106280 2024-05-09T00:04:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.123+0000 7fb3db09b700 1 -- 172.21.15.81:0/757410858 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d4073740 con 0x7fb3d4106280 2024-05-09T00:04:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.126+0000 7fb3d1ffb700 1 -- 172.21.15.81:0/757410858 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7fb3c0022870 con 0x7fb3d4106280 2024-05-09T00:04:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.126+0000 7fb3e7255b80 1 Processor -- start 2024-05-09T00:04:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.126+0000 7fb3e7255b80 1 -- start start 2024-05-09T00:04:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3d1ffb700 1 --2- 172.21.15.81:0/757410858 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb3c40a14c0 0x7fb3c40a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3e7255b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f5e00 0x55ca511f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3e7255b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca511f0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3e7255b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f0890 0x55ca511f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3e7255b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca51147150 con 0x55ca511f0890 2024-05-09T00:04:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3e7255b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca51144b10 con 0x55ca511f6720 2024-05-09T00:04:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3e7255b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca51140400 con 0x55ca511f5e00 2024-05-09T00:04:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3d1ffb700 1 -- 172.21.15.81:0/757410858 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb3c00ce130 con 0x7fb3d4106280 2024-05-09T00:04:12.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3d3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca511f0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3d3fff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca511f0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.81:39474/0 (socket says 172.21.15.81:39474) 2024-05-09T00:04:12.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3d3fff700 1 -- 172.21.15.81:0/148251949 learned_addr learned my addr 172.21.15.81:0/148251949 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3d9638700 1 --2- 172.21.15.81:0/148251949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f0890 0x55ca511f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3d3fff700 1 -- 172.21.15.81:0/148251949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f5e00 msgr2=0x55ca511f61e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:04:12.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/148251949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f5e00 0x55ca511f61e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3d3fff700 1 -- 172.21.15.81:0/148251949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f0890 msgr2=0x55ca511f0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/148251949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f0890 0x55ca511f0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3d3fff700 1 -- 172.21.15.81:0/148251949 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca50fc13b0 con 0x55ca511f6720 2024-05-09T00:04:12.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.127+0000 7fb3d9638700 1 --2- 172.21.15.81:0/757410858 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb3c40a14c0 0x7fb3c40a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.128+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/148251949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca511f0350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb3c009b020 tx=0x7fb3c009abd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc2696f3c2699ec8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.128+0000 7fb3beffd700 1 -- 172.21.15.81:0/148251949 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c009b090 con 0x55ca511f6720 2024-05-09T00:04:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.128+0000 7fb3beffd700 1 -- 172.21.15.81:0/148251949 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3c009e070 con 0x55ca511f6720 2024-05-09T00:04:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.128+0000 7fb3beffd700 1 -- 172.21.15.81:0/148251949 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c009b510 con 0x55ca511f6720 2024-05-09T00:04:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.128+0000 7fb3d9638700 1 --2- 172.21.15.81:0/757410858 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb3c40a14c0 0x7fb3c40a3980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009d30 tx=0x7fb3cc00b040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.129+0000 7fb3e7255b80 1 -- 172.21.15.81:0/148251949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 msgr2=0x55ca511f0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.129+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/148251949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca511f0350 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb3c009b020 tx=0x7fb3c009abd0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.129+0000 7fb3e7255b80 1 -- 172.21.15.81:0/148251949 shutdown_connections 2024-05-09T00:04:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.129+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/148251949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f0890 0x55ca511f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.129+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/148251949 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f5e00 0x55ca511f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.129+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/148251949 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca511f0350 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.129+0000 7fb3e7255b80 1 -- 172.21.15.81:0/148251949 >> 172.21.15.81:0/148251949 conn(0x55ca5114e210 msgr2=0x55ca511eadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.129+0000 7fb3e7255b80 1 -- 172.21.15.81:0/148251949 shutdown_connections 2024-05-09T00:04:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.129+0000 7fb3e7255b80 1 -- 172.21.15.81:0/148251949 wait complete. 2024-05-09T00:04:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.129+0000 7fb3e7255b80 1 -- start start 2024-05-09T00:04:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.129+0000 7fb3e7255b80 1 Processor -- start 2024-05-09T00:04:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.130+0000 7fb3e7255b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f0890 0x55ca511fc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.130+0000 7fb3e7255b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f5e00 0x55ca511f9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.130+0000 7fb3e7255b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca511fa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.130+0000 7fb3e7255b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca510dc560 con 0x55ca511f0890 2024-05-09T00:04:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.130+0000 7fb3e7255b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca510dc200 con 0x55ca511f6720 2024-05-09T00:04:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.130+0000 7fb3e7255b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca50fc36a0 con 0x55ca511f5e00 2024-05-09T00:04:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.130+0000 7fb3e7255b80 10 client.0 _ll_register_callbacks cb 0x55ca510e5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.130+0000 7fb3d3fff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f5e00 0x55ca511f9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.130+0000 7fb3d3fff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f5e00 0x55ca511f9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:47736/0 (socket says 172.21.15.81:47736) 2024-05-09T00:04:12.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.130+0000 7fb3d3fff700 1 -- 172.21.15.81:0/1958848747 learned_addr learned my addr 172.21.15.81:0/1958848747 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3d9638700 1 --2- 172.21.15.81:0/1958848747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca511fa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3d3fff700 1 -- 172.21.15.81:0/1958848747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 msgr2=0x55ca511fa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/1958848747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca511fa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3d3fff700 1 -- 172.21.15.81:0/1958848747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f0890 msgr2=0x55ca511fc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/1958848747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f0890 0x55ca511fc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3d3fff700 1 -- 172.21.15.81:0/1958848747 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d4073740 con 0x55ca511f5e00 2024-05-09T00:04:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3d9638700 1 --2- 172.21.15.81:0/1958848747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca511fa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/1958848747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f5e00 0x55ca511f9af0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009580 tx=0x7fb3c0005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f3beee6f2950e87 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3b3fff700 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-05-09T00:04:12.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3b3fff700 1 -- 172.21.15.81:0/1958848747 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c00b9400 con 0x55ca511f5e00 2024-05-09T00:04:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3e7255b80 1 -- 172.21.15.81:0/1958848747 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca51099270 con 0x55ca511f5e00 2024-05-09T00:04:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3b3fff700 1 -- 172.21.15.81:0/1958848747 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb3c009eec0 con 0x55ca511f5e00 2024-05-09T00:04:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3b3fff700 1 -- 172.21.15.81:0/1958848747 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3c009b2f0 con 0x55ca511f5e00 2024-05-09T00:04:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3e7255b80 10 client.25282 fetch_fsmap learned FSMap version 24 2024-05-09T00:04:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.131+0000 7fb3e7255b80 1 -- 172.21.15.81:0/1958848747 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ca50f6db60 con 0x55ca511f5e00 2024-05-09T00:04:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.132+0000 7fb3b3fff700 1 -- 172.21.15.81:0/1958848747 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ca51099270 con 0x55ca511f5e00 2024-05-09T00:04:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.133+0000 7fb3b3fff700 1 -- 172.21.15.81:0/1958848747 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb3c0083070 con 0x55ca511f5e00 2024-05-09T00:04:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.133+0000 7fb3e7255b80 10 client.25282 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:04:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.133+0000 7fb3e7255b80 10 client.25282 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:04:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.133+0000 7fb3e7255b80 20 client.25282 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.133+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/1958848747 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ca512121e0 0x55ca512145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.133+0000 7fb3e7255b80 4 client.25282 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.133+0000 7fb3e7255b80 1 -- 172.21.15.81:0/1958848747 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca511bf810 con 0x55ca512121e0 2024-05-09T00:04:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.133+0000 7fb3d8e37700 1 --2- 172.21.15.81:0/1958848747 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ca512121e0 0x55ca512145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.133+0000 7fb3b3fff700 10 client.25282 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:04:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.133+0000 7fb3d8e37700 1 --2- 172.21.15.81:0/1958848747 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ca512121e0 0x55ca512145d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d5a3b94e0929e62d server_cookie=b931b0aaf5c75d95 in_seq=0 out_seq=0 2024-05-09T00:04:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.134+0000 7fb3b3fff700 1 -- 172.21.15.81:0/1958848747 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ca511bf810 con 0x55ca512121e0 2024-05-09T00:04:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.134+0000 7fb3b3fff700 10 client.25282 handle_command_reply: tid=0 2024-05-09T00:04:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.134+0000 7fb3e7255b80 1 client.25282 shutdown 2024-05-09T00:04:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.134+0000 7fb3e7255b80 1 -- 172.21.15.81:0/1958848747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f5e00 msgr2=0x55ca511f9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.134+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/1958848747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f5e00 0x55ca511f9af0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009580 tx=0x7fb3c0005c00 comp rx=0 tx=0).stop 2024-05-09T00:04:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.134+0000 7fb3e7255b80 1 -- 172.21.15.81:0/1958848747 shutdown_connections 2024-05-09T00:04:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.134+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/1958848747 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ca512121e0 0x55ca512145d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.134+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/1958848747 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca511fa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.134+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/1958848747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f0890 0x55ca511fc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.134+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/1958848747 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f5e00 0x55ca511f9af0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.134+0000 7fb3e7255b80 1 -- 172.21.15.81:0/1958848747 >> 172.21.15.81:0/1958848747 conn(0x55ca5114e210 msgr2=0x55ca511ea5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.134+0000 7fb3b3fff700 0 client.25282 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:04:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.135+0000 7fb3e7255b80 1 -- 172.21.15.81:0/1958848747 shutdown_connections 2024-05-09T00:04:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.135+0000 7fb3e7255b80 1 -- 172.21.15.81:0/1958848747 wait complete. 2024-05-09T00:04:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.135+0000 7fb3e7255b80 20 client.25282 trim_cache size 0 max 16384 2024-05-09T00:04:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.158+0000 7fb3e7255b80 1 Processor -- start 2024-05-09T00:04:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3e7255b80 1 -- start start 2024-05-09T00:04:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3e7255b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f0890 0x55ca511f0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3e7255b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f5e00 0x55ca511ead20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3e7255b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca512096f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3e7255b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca511f6580 con 0x55ca511f5e00 2024-05-09T00:04:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3e7255b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca511e7dc0 con 0x55ca511f6720 2024-05-09T00:04:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3e7255b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca512197c0 con 0x55ca511f0890 2024-05-09T00:04:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3d3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f5e00 0x55ca511ead20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3d8e37700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f0890 0x55ca511f0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3d8e37700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f0890 0x55ca511f0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:47740/0 (socket says 172.21.15.81:47740) 2024-05-09T00:04:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3d8e37700 1 -- 172.21.15.81:0/4270782080 learned_addr learned my addr 172.21.15.81:0/4270782080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3d9638700 1 --2- 172.21.15.81:0/4270782080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca512096f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3d8e37700 1 -- 172.21.15.81:0/4270782080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 msgr2=0x55ca512096f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3d8e37700 1 --2- 172.21.15.81:0/4270782080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca512096f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3d8e37700 1 -- 172.21.15.81:0/4270782080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f5e00 msgr2=0x55ca511ead20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3d8e37700 1 --2- 172.21.15.81:0/4270782080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f5e00 0x55ca511ead20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.159+0000 7fb3d8e37700 1 -- 172.21.15.81:0/4270782080 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca511f0f40 con 0x55ca511f0890 2024-05-09T00:04:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.160+0000 7fb3d8e37700 1 --2- 172.21.15.81:0/4270782080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f0890 0x55ca511f0350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55ca51214eb0 tx=0x7fb3c8009980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f43d136e5a9cf61b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.160+0000 7fb3bf7fe700 1 -- 172.21.15.81:0/4270782080 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8016040 con 0x55ca511f0890 2024-05-09T00:04:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.160+0000 7fb3bf7fe700 1 -- 172.21.15.81:0/4270782080 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3c8018e30 con 0x55ca511f0890 2024-05-09T00:04:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.160+0000 7fb3bf7fe700 1 -- 172.21.15.81:0/4270782080 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c8010690 con 0x55ca511f0890 2024-05-09T00:04:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.161+0000 7fb3e7255b80 1 -- 172.21.15.81:0/4270782080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f0890 msgr2=0x55ca511f0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.161+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/4270782080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f0890 0x55ca511f0350 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x55ca51214eb0 tx=0x7fb3c8009980 comp rx=0 tx=0).stop 2024-05-09T00:04:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.161+0000 7fb3e7255b80 1 -- 172.21.15.81:0/4270782080 shutdown_connections 2024-05-09T00:04:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.161+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/4270782080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f6720 0x55ca512096f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.161+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/4270782080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f0890 0x55ca511f0350 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.161+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/4270782080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f5e00 0x55ca511ead20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.161+0000 7fb3e7255b80 1 -- 172.21.15.81:0/4270782080 >> 172.21.15.81:0/4270782080 conn(0x55ca5114e210 msgr2=0x55ca511f3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.161+0000 7fb3e7255b80 1 -- 172.21.15.81:0/4270782080 shutdown_connections 2024-05-09T00:04:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.161+0000 7fb3e7255b80 1 -- 172.21.15.81:0/4270782080 wait complete. 2024-05-09T00:04:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.162+0000 7fb3e7255b80 1 -- start start 2024-05-09T00:04:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.162+0000 7fb3e7255b80 1 Processor -- start 2024-05-09T00:04:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.162+0000 7fb3e7255b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f0890 0x55ca512078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.162+0000 7fb3e7255b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f5e00 0x55ca51207e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.162+0000 7fb3e7255b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f6720 0x55ca512676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.162+0000 7fb3e7255b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca51208590 con 0x55ca511f5e00 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.162+0000 7fb3e7255b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca51267c20 con 0x55ca511f0890 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.162+0000 7fb3e7255b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca51267de0 con 0x55ca511f6720 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.162+0000 7fb3e7255b80 10 client.0 _ll_register_callbacks cb 0x55ca510e5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.162+0000 7fb3d3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f5e00 0x55ca51207e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.162+0000 7fb3d3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f5e00 0x55ca51207e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40144/0 (socket says 172.21.15.81:40144) 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.162+0000 7fb3d3fff700 1 -- 172.21.15.81:0/3255392598 learned_addr learned my addr 172.21.15.81:0/3255392598 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3d9638700 1 --2- 172.21.15.81:0/3255392598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f6720 0x55ca512676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3d8e37700 1 --2- 172.21.15.81:0/3255392598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f0890 0x55ca512078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3d3fff700 1 -- 172.21.15.81:0/3255392598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f6720 msgr2=0x55ca512676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/3255392598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f6720 0x55ca512676b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3d3fff700 1 -- 172.21.15.81:0/3255392598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f0890 msgr2=0x55ca512078c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/3255392598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f0890 0x55ca512078c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3d3fff700 1 -- 172.21.15.81:0/3255392598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c8009e00 con 0x55ca511f5e00 2024-05-09T00:04:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3d8e37700 1 --2- 172.21.15.81:0/3255392598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f0890 0x55ca512078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3d3fff700 1 --2- 172.21.15.81:0/3255392598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f5e00 0x55ca51207e00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb3c00a2f50 tx=0x7fb3c009a8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea9448c3b038048 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3b3fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3b3fff700 1 -- 172.21.15.81:0/3255392598 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c009b2f0 con 0x55ca511f5e00 2024-05-09T00:04:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3b3fff700 1 -- 172.21.15.81:0/3255392598 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb3c009eec0 con 0x55ca511f5e00 2024-05-09T00:04:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3e7255b80 1 -- 172.21.15.81:0/3255392598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb3c009e070 con 0x55ca511f5e00 2024-05-09T00:04:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3b3fff700 1 -- 172.21.15.81:0/3255392598 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb3c009a9f0 con 0x55ca511f5e00 2024-05-09T00:04:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.163+0000 7fb3e7255b80 10 client.15753 fetch_fsmap learned FSMap version 24 2024-05-09T00:04:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.164+0000 7fb3e7255b80 1 -- 172.21.15.81:0/3255392598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ca51106560 con 0x55ca511f5e00 2024-05-09T00:04:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.164+0000 7fb3b3fff700 1 -- 172.21.15.81:0/3255392598 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb3c009e070 con 0x55ca511f5e00 2024-05-09T00:04:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.164+0000 7fb3b3fff700 1 -- 172.21.15.81:0/3255392598 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb3c00a9030 con 0x55ca511f5e00 2024-05-09T00:04:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.164+0000 7fb3e7255b80 10 client.15753 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:04:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.164+0000 7fb3e7255b80 10 client.15753 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:04:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.164+0000 7fb3e7255b80 20 client.15753 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.164+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/3255392598 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ca51269120 0x55ca5126b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.164+0000 7fb3e7255b80 4 client.15753 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:04:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.164+0000 7fb3e7255b80 1 -- 172.21.15.81:0/3255392598 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ca51138ec0 con 0x55ca51269120 2024-05-09T00:04:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.164+0000 7fb3d8e37700 1 --2- 172.21.15.81:0/3255392598 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ca51269120 0x55ca5126b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3b3fff700 10 client.15753 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:04:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3d8e37700 1 --2- 172.21.15.81:0/3255392598 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ca51269120 0x55ca5126b540 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f14fb5070ab0b2af server_cookie=56dc5bf7dec3dd62 in_seq=0 out_seq=0 2024-05-09T00:04:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3b3fff700 1 -- 172.21.15.81:0/3255392598 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ca51138ec0 con 0x55ca51269120 2024-05-09T00:04:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3b3fff700 10 client.15753 handle_command_reply: tid=0 2024-05-09T00:04:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3e7255b80 1 client.15753 shutdown 2024-05-09T00:04:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3e7255b80 1 -- 172.21.15.81:0/3255392598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f5e00 msgr2=0x55ca51207e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/3255392598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f5e00 0x55ca51207e00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb3c00a2f50 tx=0x7fb3c009a8d0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3e7255b80 1 -- 172.21.15.81:0/3255392598 shutdown_connections 2024-05-09T00:04:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/3255392598 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ca51269120 0x55ca5126b540 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/3255392598 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ca511f0890 0x55ca512078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/3255392598 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ca511f6720 0x55ca512676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3b3fff700 0 client.15753 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:04:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3e7255b80 1 --2- 172.21.15.81:0/3255392598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ca511f5e00 0x55ca51207e00 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3e7255b80 1 -- 172.21.15.81:0/3255392598 >> 172.21.15.81:0/3255392598 conn(0x55ca5114e210 msgr2=0x55ca511f8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3e7255b80 1 -- 172.21.15.81:0/3255392598 shutdown_connections 2024-05-09T00:04:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.165+0000 7fb3e7255b80 1 -- 172.21.15.81:0/3255392598 wait complete. 2024-05-09T00:04:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.166+0000 7fb3e7255b80 20 client.15753 trim_cache size 0 max 16384 2024-05-09T00:04:12.164 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:04:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.169+0000 7fb3db09b700 1 -- 172.21.15.81:0/757410858 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb3c40a14c0 msgr2=0x7fb3c40a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.169+0000 7fb3db09b700 1 --2- 172.21.15.81:0/757410858 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb3c40a14c0 0x7fb3c40a3980 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009d30 tx=0x7fb3cc00b040 comp rx=0 tx=0).stop 2024-05-09T00:04:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.169+0000 7fb3db09b700 1 -- 172.21.15.81:0/757410858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4106280 msgr2=0x7fb3d406aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.169+0000 7fb3db09b700 1 --2- 172.21.15.81:0/757410858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4106280 0x7fb3d406aa90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0006010 tx=0x7fb3c0004730 comp rx=0 tx=0).stop 2024-05-09T00:04:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.169+0000 7fb3db09b700 1 -- 172.21.15.81:0/757410858 shutdown_connections 2024-05-09T00:04:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.169+0000 7fb3db09b700 1 --2- 172.21.15.81:0/757410858 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb3c40a14c0 0x7fb3c40a3980 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.169+0000 7fb3db09b700 1 --2- 172.21.15.81:0/757410858 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb3d4101160 0x7fb3d4072a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.169+0000 7fb3db09b700 1 --2- 172.21.15.81:0/757410858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3d406afd0 0x7fb3d406b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.169+0000 7fb3db09b700 1 --2- 172.21.15.81:0/757410858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3d4106280 0x7fb3d406aa90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.169+0000 7fb3db09b700 1 -- 172.21.15.81:0/757410858 >> 172.21.15.81:0/757410858 conn(0x7fb3d40fc9e0 msgr2=0x7fb3d40fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.169+0000 7fb3db09b700 1 -- 172.21.15.81:0/757410858 shutdown_connections 2024-05-09T00:04:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.169+0000 7fb3db09b700 1 -- 172.21.15.81:0/757410858 wait complete. 2024-05-09T00:04:12.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:04:12.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:11 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3183109442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:04:12.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:11 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3183109442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:04:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.318+0000 7fde58be4700 1 -- 172.21.15.81:0/1449192589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde54100060 msgr2=0x7fde54100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.318+0000 7fde58be4700 1 --2- 172.21.15.81:0/1449192589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde54100060 0x7fde54100440 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fde4400ba80 tx=0x7fde4400bd90 comp rx=0 tx=0).stop 2024-05-09T00:04:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.318+0000 7fde58be4700 1 -- 172.21.15.81:0/1449192589 shutdown_connections 2024-05-09T00:04:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.318+0000 7fde58be4700 1 --2- 172.21.15.81:0/1449192589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde54105160 0x7fde5410cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.318+0000 7fde58be4700 1 --2- 172.21.15.81:0/1449192589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde54100060 0x7fde54100440 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.318+0000 7fde58be4700 1 --2- 172.21.15.81:0/1449192589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde54100a10 0x7fde54104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.318+0000 7fde58be4700 1 -- 172.21.15.81:0/1449192589 >> 172.21.15.81:0/1449192589 conn(0x7fde54076f40 msgr2=0x7fde54077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.318+0000 7fde58be4700 1 -- 172.21.15.81:0/1449192589 shutdown_connections 2024-05-09T00:04:12.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.318+0000 7fde58be4700 1 -- 172.21.15.81:0/1449192589 wait complete. 2024-05-09T00:04:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.319+0000 7fde58be4700 1 Processor -- start 2024-05-09T00:04:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.319+0000 7fde58be4700 1 -- start start 2024-05-09T00:04:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.319+0000 7fde58be4700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde54100060 0x7fde541951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.319+0000 7fde58be4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde54105160 0x7fde54195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.319+0000 7fde58be4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde54199a50 0x7fde54199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.319+0000 7fde58be4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5419a4d0 con 0x7fde54199a50 2024-05-09T00:04:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.319+0000 7fde58be4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5419a640 con 0x7fde54105160 2024-05-09T00:04:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.319+0000 7fde58be4700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5419a800 con 0x7fde54100060 2024-05-09T00:04:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.319+0000 7fde52d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde54199a50 0x7fde54199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde52d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde54199a50 0x7fde54199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40150/0 (socket says 172.21.15.81:40150) 2024-05-09T00:04:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde52d9d700 1 -- 172.21.15.81:0/1814112831 learned_addr learned my addr 172.21.15.81:0/1814112831 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde5259c700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde54100060 0x7fde541951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde51d9b700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde54105160 0x7fde54195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde5259c700 1 -- 172.21.15.81:0/1814112831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde54105160 msgr2=0x7fde54195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde5259c700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde54105160 0x7fde54195700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde5259c700 1 -- 172.21.15.81:0/1814112831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde54199a50 msgr2=0x7fde54199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde5259c700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde54199a50 0x7fde54199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde5259c700 1 -- 172.21.15.81:0/1814112831 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde4400b730 con 0x7fde54100060 2024-05-09T00:04:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde51d9b700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde54105160 0x7fde54195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde5259c700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde54100060 0x7fde541951c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde4400ba50 tx=0x7fde4400db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde437fe700 1 -- 172.21.15.81:0/1814112831 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde44010040 con 0x7fde54100060 2024-05-09T00:04:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde437fe700 1 -- 172.21.15.81:0/1814112831 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde44005700 con 0x7fde54100060 2024-05-09T00:04:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde437fe700 1 -- 172.21.15.81:0/1814112831 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4401d680 con 0x7fde54100060 2024-05-09T00:04:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.320+0000 7fde58be4700 1 -- 172.21.15.81:0/1814112831 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde541a1d00 con 0x7fde54100060 2024-05-09T00:04:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.321+0000 7fde58be4700 1 -- 172.21.15.81:0/1814112831 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde541a20d0 con 0x7fde54100060 2024-05-09T00:04:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.325+0000 7fde64d9eb80 1 Processor -- start 2024-05-09T00:04:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.326+0000 7fde64d9eb80 1 -- start start 2024-05-09T00:04:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.326+0000 7fde437fe700 1 -- 172.21.15.81:0/1814112831 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7fde440038a0 con 0x7fde54100060 2024-05-09T00:04:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.326+0000 7fde64d9eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e28b7e0 0x55854e28bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.326+0000 7fde64d9eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e27d350 0x55854e27d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.326+0000 7fde64d9eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e2924e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.326+0000 7fde64d9eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854e1d4150 con 0x55854e27d350 2024-05-09T00:04:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.326+0000 7fde64d9eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854e1d1b10 con 0x55854e28b7e0 2024-05-09T00:04:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.326+0000 7fde64d9eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854e1cd400 con 0x55854e27dd10 2024-05-09T00:04:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.326+0000 7fde52d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e28b7e0 0x55854e28bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.326+0000 7fde5259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e27d350 0x55854e27d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.326+0000 7fde52d9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e28b7e0 0x55854e28bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.81:39526/0 (socket says 172.21.15.81:39526) 2024-05-09T00:04:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.326+0000 7fde52d9d700 1 -- 172.21.15.81:0/3167716309 learned_addr learned my addr 172.21.15.81:0/3167716309 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.326+0000 7fde51d9b700 1 --2- 172.21.15.81:0/3167716309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e2924e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.327+0000 7fde52d9d700 1 -- 172.21.15.81:0/3167716309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 msgr2=0x55854e2924e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.327+0000 7fde52d9d700 1 --2- 172.21.15.81:0/3167716309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e2924e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.327+0000 7fde437fe700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fde3c0a14c0 0x7fde3c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.327+0000 7fde52d9d700 1 -- 172.21.15.81:0/3167716309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e27d350 msgr2=0x55854e27d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.327+0000 7fde52d9d700 1 --2- 172.21.15.81:0/3167716309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e27d350 0x55854e27d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.327+0000 7fde52d9d700 1 -- 172.21.15.81:0/3167716309 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55854e04e3b0 con 0x55854e28b7e0 2024-05-09T00:04:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.327+0000 7fde437fe700 1 -- 172.21.15.81:0/1814112831 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fde440cda40 con 0x7fde54100060 2024-05-09T00:04:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.327+0000 7fde52d9d700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fde3c0a14c0 0x7fde3c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.327+0000 7fde52d9d700 1 --2- 172.21.15.81:0/3167716309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e28b7e0 0x55854e28bbc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009f10 tx=0x7fde4c0091b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c44d0690a8a3311d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.327+0000 7fde40ff9700 1 -- 172.21.15.81:0/3167716309 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0146e0 con 0x55854e28b7e0 2024-05-09T00:04:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.327+0000 7fde52d9d700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fde3c0a14c0 0x7fde3c0a3980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fde4c01f000 tx=0x7fde4c020000 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.327+0000 7fde40ff9700 1 -- 172.21.15.81:0/3167716309 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde4c01c070 con 0x55854e28b7e0 2024-05-09T00:04:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.327+0000 7fde40ff9700 1 -- 172.21.15.81:0/3167716309 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c022980 con 0x55854e28b7e0 2024-05-09T00:04:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.328+0000 7fde64d9eb80 1 -- 172.21.15.81:0/3167716309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e28b7e0 msgr2=0x55854e28bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.328+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/3167716309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e28b7e0 0x55854e28bbc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009f10 tx=0x7fde4c0091b0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.329+0000 7fde64d9eb80 1 -- 172.21.15.81:0/3167716309 shutdown_connections 2024-05-09T00:04:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.329+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/3167716309 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e28b7e0 0x55854e28bbc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.329+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/3167716309 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e2924e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.329+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/3167716309 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e27d350 0x55854e27d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.329+0000 7fde64d9eb80 1 -- 172.21.15.81:0/3167716309 >> 172.21.15.81:0/3167716309 conn(0x55854e1db210 msgr2=0x55854e277d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.329+0000 7fde64d9eb80 1 -- 172.21.15.81:0/3167716309 shutdown_connections 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.329+0000 7fde64d9eb80 1 -- 172.21.15.81:0/3167716309 wait complete. 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.329+0000 7fde64d9eb80 1 -- start start 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.329+0000 7fde64d9eb80 1 Processor -- start 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde64d9eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e27d350 0x55854e28f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde64d9eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e28fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde64d9eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e290220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde64d9eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854e169560 con 0x55854e28b7e0 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde64d9eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854e169200 con 0x55854e27d350 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde64d9eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854e0506a0 con 0x55854e27dd10 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde64d9eb80 10 client.0 _ll_register_callbacks cb 0x55854e172b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde52d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e290220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde52d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e290220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40174/0 (socket says 172.21.15.81:40174) 2024-05-09T00:04:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde52d9d700 1 -- 172.21.15.81:0/2849984817 learned_addr learned my addr 172.21.15.81:0/2849984817 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde51d9b700 1 --2- 172.21.15.81:0/2849984817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e28fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde52d9d700 1 -- 172.21.15.81:0/2849984817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 msgr2=0x55854e28fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde52d9d700 1 --2- 172.21.15.81:0/2849984817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e28fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde52d9d700 1 -- 172.21.15.81:0/2849984817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e27d350 msgr2=0x55854e28f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde52d9d700 1 --2- 172.21.15.81:0/2849984817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e27d350 0x55854e28f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.330+0000 7fde52d9d700 1 -- 172.21.15.81:0/2849984817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde4c009b70 con 0x55854e28b7e0 2024-05-09T00:04:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.331+0000 7fde52d9d700 1 --2- 172.21.15.81:0/2849984817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e290220 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fde4c015040 tx=0x7fde4c009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a044d05a0a84f99a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.331+0000 7fde39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.331+0000 7fde39ffb700 1 -- 172.21.15.81:0/2849984817 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c0229f0 con 0x55854e28b7e0 2024-05-09T00:04:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.331+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2849984817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55854e126270 con 0x55854e28b7e0 2024-05-09T00:04:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.331+0000 7fde39ffb700 1 -- 172.21.15.81:0/2849984817 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fde4c0144e0 con 0x55854e28b7e0 2024-05-09T00:04:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.331+0000 7fde39ffb700 1 -- 172.21.15.81:0/2849984817 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde4c015760 con 0x55854e28b7e0 2024-05-09T00:04:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.331+0000 7fde64d9eb80 10 client.15765 fetch_fsmap learned FSMap version 24 2024-05-09T00:04:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.331+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2849984817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55854dffab60 con 0x55854e28b7e0 2024-05-09T00:04:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.331+0000 7fde39ffb700 1 -- 172.21.15.81:0/2849984817 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55854e126270 con 0x55854e28b7e0 2024-05-09T00:04:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.332+0000 7fde39ffb700 1 -- 172.21.15.81:0/2849984817 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fde4c02c820 con 0x55854e28b7e0 2024-05-09T00:04:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.332+0000 7fde64d9eb80 10 client.15765 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:04:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.332+0000 7fde64d9eb80 10 client.15765 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:04:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.332+0000 7fde64d9eb80 20 client.15765 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.332+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2849984817 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55854e2826e0 0x55854e284b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.332+0000 7fde64d9eb80 4 client.15765 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.332+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2849984817 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55854e24c810 con 0x55854e2826e0 2024-05-09T00:04:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.332+0000 7fde5259c700 1 --2- 172.21.15.81:0/2849984817 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55854e2826e0 0x55854e284b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.332+0000 7fde39ffb700 10 client.15765 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:04:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.332+0000 7fde5259c700 1 --2- 172.21.15.81:0/2849984817 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55854e2826e0 0x55854e284b00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3d34952419858c22 server_cookie=5e508a1879f3dbec in_seq=0 out_seq=0 2024-05-09T00:04:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.333+0000 7fde39ffb700 1 -- 172.21.15.81:0/2849984817 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55854e24c810 con 0x55854e2826e0 2024-05-09T00:04:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.333+0000 7fde39ffb700 10 client.15765 handle_command_reply: tid=0 2024-05-09T00:04:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.333+0000 7fde64d9eb80 1 client.15765 shutdown 2024-05-09T00:04:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.333+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2849984817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 msgr2=0x55854e290220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.333+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2849984817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e290220 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fde4c015040 tx=0x7fde4c009a50 comp rx=0 tx=0).stop 2024-05-09T00:04:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.333+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2849984817 shutdown_connections 2024-05-09T00:04:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.333+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2849984817 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55854e2826e0 0x55854e284b00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.333+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2849984817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e27d350 0x55854e28f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.333+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2849984817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e290220 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.333+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2849984817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e28fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.333+0000 7fde39ffb700 0 client.15765 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:04:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.333+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2849984817 >> 172.21.15.81:0/2849984817 conn(0x55854e1db210 msgr2=0x55854e277ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.334+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2849984817 shutdown_connections 2024-05-09T00:04:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.334+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2849984817 wait complete. 2024-05-09T00:04:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.334+0000 7fde64d9eb80 20 client.15765 trim_cache size 0 max 16384 2024-05-09T00:04:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.347+0000 7fde64d9eb80 1 Processor -- start 2024-05-09T00:04:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.347+0000 7fde64d9eb80 1 -- start start 2024-05-09T00:04:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.347+0000 7fde64d9eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e27d350 0x55854e27e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.347+0000 7fde64d9eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e279a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.347+0000 7fde64d9eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e277d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.347+0000 7fde64d9eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854e274dc0 con 0x55854e28b7e0 2024-05-09T00:04:12.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.347+0000 7fde64d9eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854e2b13a0 con 0x55854e27d350 2024-05-09T00:04:12.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.347+0000 7fde64d9eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854e28dcf0 con 0x55854e27dd10 2024-05-09T00:04:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde52d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e277d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde51d9b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e279a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde51d9b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e279a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:47798/0 (socket says 172.21.15.81:47798) 2024-05-09T00:04:12.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde52d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e277d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40176/0 (socket says 172.21.15.81:40176) 2024-05-09T00:04:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde51d9b700 1 -- 172.21.15.81:0/2934763776 learned_addr learned my addr 172.21.15.81:0/2934763776 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde5259c700 1 --2- 172.21.15.81:0/2934763776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e27d350 0x55854e27e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde52d9d700 1 -- 172.21.15.81:0/2934763776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 msgr2=0x55854e279a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde52d9d700 1 --2- 172.21.15.81:0/2934763776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e279a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde52d9d700 1 -- 172.21.15.81:0/2934763776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e27d350 msgr2=0x55854e27e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde52d9d700 1 --2- 172.21.15.81:0/2934763776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e27d350 0x55854e27e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde52d9d700 1 -- 172.21.15.81:0/2934763776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55854e193560 con 0x55854e28b7e0 2024-05-09T00:04:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde52d9d700 1 --2- 172.21.15.81:0/2934763776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e277d20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fde4c002230 tx=0x7fde4c009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c7e782d740e6488 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde417fa700 1 -- 172.21.15.81:0/2934763776 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c02cea0 con 0x55854e28b7e0 2024-05-09T00:04:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde417fa700 1 -- 172.21.15.81:0/2934763776 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde4c026070 con 0x55854e28b7e0 2024-05-09T00:04:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.348+0000 7fde417fa700 1 -- 172.21.15.81:0/2934763776 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c02c6e0 con 0x55854e28b7e0 2024-05-09T00:04:12.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.349+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2934763776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 msgr2=0x55854e277d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.349+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2934763776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e277d20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fde4c002230 tx=0x7fde4c009550 comp rx=0 tx=0).stop 2024-05-09T00:04:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.349+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2934763776 shutdown_connections 2024-05-09T00:04:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.349+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2934763776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e27d350 0x55854e27e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.349+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2934763776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e277d20 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.349+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2934763776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e279a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.349+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2934763776 >> 172.21.15.81:0/2934763776 conn(0x55854e1db210 msgr2=0x55854e28e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.349+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2934763776 shutdown_connections 2024-05-09T00:04:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.349+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2934763776 wait complete. 2024-05-09T00:04:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.350+0000 7fde64d9eb80 1 -- start start 2024-05-09T00:04:12.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.350+0000 7fde64d9eb80 1 Processor -- start 2024-05-09T00:04:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.350+0000 7fde64d9eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e27d350 0x55854e296a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.350+0000 7fde64d9eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e296f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.350+0000 7fde64d9eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e285440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.350+0000 7fde64d9eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854e285980 con 0x55854e28b7e0 2024-05-09T00:04:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.350+0000 7fde64d9eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854e285af0 con 0x55854e27d350 2024-05-09T00:04:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.350+0000 7fde64d9eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854e285cb0 con 0x55854e27dd10 2024-05-09T00:04:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.350+0000 7fde64d9eb80 10 client.0 _ll_register_callbacks cb 0x55854e172b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.351+0000 7fde52d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e285440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.351+0000 7fde52d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e285440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40186/0 (socket says 172.21.15.81:40186) 2024-05-09T00:04:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.351+0000 7fde52d9d700 1 -- 172.21.15.81:0/2965593926 learned_addr learned my addr 172.21.15.81:0/2965593926 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.351+0000 7fde5259c700 1 --2- 172.21.15.81:0/2965593926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e27d350 0x55854e296a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.351+0000 7fde52d9d700 1 -- 172.21.15.81:0/2965593926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 msgr2=0x55854e296f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:04:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.351+0000 7fde52d9d700 1 --2- 172.21.15.81:0/2965593926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e296f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.351+0000 7fde52d9d700 1 -- 172.21.15.81:0/2965593926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e27d350 msgr2=0x55854e296a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.351+0000 7fde52d9d700 1 --2- 172.21.15.81:0/2965593926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e27d350 0x55854e296a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.351+0000 7fde52d9d700 1 -- 172.21.15.81:0/2965593926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55854dffab60 con 0x55854e28b7e0 2024-05-09T00:04:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.351+0000 7fde52d9d700 1 --2- 172.21.15.81:0/2965593926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e285440 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fde4c015010 tx=0x7fde4c02cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47640d4ed5f26fe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.351+0000 7fde39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.351+0000 7fde39ffb700 1 -- 172.21.15.81:0/2965593926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c009e40 con 0x55854e28b7e0 2024-05-09T00:04:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.352+0000 7fde39ffb700 1 -- 172.21.15.81:0/2965593926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fde4c0229a0 con 0x55854e28b7e0 2024-05-09T00:04:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.352+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2965593926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fde4c01c070 con 0x55854e28b7e0 2024-05-09T00:04:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.352+0000 7fde39ffb700 1 -- 172.21.15.81:0/2965593926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde4c004c80 con 0x55854e28b7e0 2024-05-09T00:04:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.352+0000 7fde64d9eb80 10 client.15771 fetch_fsmap learned FSMap version 24 2024-05-09T00:04:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.352+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2965593926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55854e052cd0 con 0x55854e28b7e0 2024-05-09T00:04:12.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.352+0000 7fde39ffb700 1 -- 172.21.15.81:0/2965593926 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde4c01c070 con 0x55854e28b7e0 2024-05-09T00:04:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.352+0000 7fde39ffb700 1 -- 172.21.15.81:0/2965593926 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fde4c014970 con 0x55854e28b7e0 2024-05-09T00:04:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.352+0000 7fde64d9eb80 10 client.15771 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:04:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.352+0000 7fde64d9eb80 10 client.15771 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:04:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.352+0000 7fde64d9eb80 20 client.15771 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.352+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2965593926 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55854e2fed60 0x55854e301150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.352+0000 7fde64d9eb80 4 client.15771 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:04:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.352+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2965593926 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55854e1c5ec0 con 0x55854e2fed60 2024-05-09T00:04:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.352+0000 7fde5259c700 1 --2- 172.21.15.81:0/2965593926 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55854e2fed60 0x55854e301150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.353+0000 7fde39ffb700 10 client.15771 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:04:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.353+0000 7fde5259c700 1 --2- 172.21.15.81:0/2965593926 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55854e2fed60 0x55854e301150 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7e5e3bfcbff19800 server_cookie=ff441c84a44c256c in_seq=0 out_seq=0 2024-05-09T00:04:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.353+0000 7fde39ffb700 1 -- 172.21.15.81:0/2965593926 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55854e1c5ec0 con 0x55854e2fed60 2024-05-09T00:04:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.353+0000 7fde39ffb700 10 client.15771 handle_command_reply: tid=0 2024-05-09T00:04:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.353+0000 7fde64d9eb80 1 client.15771 shutdown 2024-05-09T00:04:12.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.353+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2965593926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 msgr2=0x55854e285440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.353+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2965593926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e285440 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fde4c015010 tx=0x7fde4c02cc30 comp rx=0 tx=0).stop 2024-05-09T00:04:12.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.353+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2965593926 shutdown_connections 2024-05-09T00:04:12.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.353+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2965593926 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55854e2fed60 0x55854e301150 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.353+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2965593926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55854e27d350 0x55854e296a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.353+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2965593926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55854e28b7e0 0x55854e285440 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.353+0000 7fde39ffb700 0 client.15771 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:04:12.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.353+0000 7fde64d9eb80 1 --2- 172.21.15.81:0/2965593926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55854e27dd10 0x55854e296f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.353+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2965593926 >> 172.21.15.81:0/2965593926 conn(0x55854e1db210 msgr2=0x55854e28a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2965593926 shutdown_connections 2024-05-09T00:04:12.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde64d9eb80 1 -- 172.21.15.81:0/2965593926 wait complete. 2024-05-09T00:04:12.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde64d9eb80 20 client.15771 trim_cache size 0 max 16384 2024-05-09T00:04:12.353 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:04:12.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde58be4700 1 -- 172.21.15.81:0/1814112831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fde3c0a14c0 msgr2=0x7fde3c0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde58be4700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fde3c0a14c0 0x7fde3c0a3980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fde4c01f000 tx=0x7fde4c020000 comp rx=0 tx=0).stop 2024-05-09T00:04:12.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde58be4700 1 -- 172.21.15.81:0/1814112831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde54100060 msgr2=0x7fde541951c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde58be4700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde54100060 0x7fde541951c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde4400ba50 tx=0x7fde4400db60 comp rx=0 tx=0).stop 2024-05-09T00:04:12.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde58be4700 1 -- 172.21.15.81:0/1814112831 shutdown_connections 2024-05-09T00:04:12.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde58be4700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fde3c0a14c0 0x7fde3c0a3980 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde58be4700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde54199a50 0x7fde54199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde58be4700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde54100060 0x7fde541951c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde58be4700 1 --2- 172.21.15.81:0/1814112831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fde54105160 0x7fde54195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde58be4700 1 -- 172.21.15.81:0/1814112831 >> 172.21.15.81:0/1814112831 conn(0x7fde54076f40 msgr2=0x7fde54103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde58be4700 1 -- 172.21.15.81:0/1814112831 shutdown_connections 2024-05-09T00:04:12.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.354+0000 7fde58be4700 1 -- 172.21.15.81:0/1814112831 wait complete. 2024-05-09T00:04:12.360 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:11 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3183109442' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:04:12.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:04:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.495+0000 7fe6ec46e700 1 -- 172.21.15.81:0/1349687238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e4101e20 msgr2=0x7fe6e40691d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.495+0000 7fe6ec46e700 1 --2- 172.21.15.81:0/1349687238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e4101e20 0x7fe6e40691d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0009990 tx=0x7fe6e0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.496+0000 7fe6ec46e700 1 -- 172.21.15.81:0/1349687238 shutdown_connections 2024-05-09T00:04:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.496+0000 7fe6ec46e700 1 --2- 172.21.15.81:0/1349687238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6e410d7f0 0x7fe6e410fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.496+0000 7fe6ec46e700 1 --2- 172.21.15.81:0/1349687238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e4101e20 0x7fe6e40691d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.496+0000 7fe6ec46e700 1 --2- 172.21.15.81:0/1349687238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6e4069710 0x7fe6e4069b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.496+0000 7fe6ec46e700 1 -- 172.21.15.81:0/1349687238 >> 172.21.15.81:0/1349687238 conn(0x7fe6e4076ba0 msgr2=0x7fe6e4076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.496+0000 7fe6ec46e700 1 -- 172.21.15.81:0/1349687238 shutdown_connections 2024-05-09T00:04:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.496+0000 7fe6ec46e700 1 -- 172.21.15.81:0/1349687238 wait complete. 2024-05-09T00:04:12.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.497+0000 7fe6ec46e700 1 Processor -- start 2024-05-09T00:04:12.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ec46e700 1 -- start start 2024-05-09T00:04:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ec46e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6e4069710 0x7fe6e4199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ec46e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6e4101e20 0x7fe6e4199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ec46e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e410d7f0 0x7fe6e419de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ec46e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e419e450 con 0x7fe6e410d7f0 2024-05-09T00:04:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ec46e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e419e5c0 con 0x7fe6e4101e20 2024-05-09T00:04:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ec46e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e419e780 con 0x7fe6e4069710 2024-05-09T00:04:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ea20a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6e4069710 0x7fe6e4199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6eaa0b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e410d7f0 0x7fe6e419de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ea20a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6e4069710 0x7fe6e4199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:47828/0 (socket says 172.21.15.81:47828) 2024-05-09T00:04:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ea20a700 1 -- 172.21.15.81:0/1665290415 learned_addr learned my addr 172.21.15.81:0/1665290415 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6e9a09700 1 --2- 172.21.15.81:0/1665290415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6e4101e20 0x7fe6e4199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ea20a700 1 -- 172.21.15.81:0/1665290415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6e4101e20 msgr2=0x7fe6e4199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ea20a700 1 --2- 172.21.15.81:0/1665290415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6e4101e20 0x7fe6e4199a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ea20a700 1 -- 172.21.15.81:0/1665290415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e410d7f0 msgr2=0x7fe6e419de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ea20a700 1 --2- 172.21.15.81:0/1665290415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e410d7f0 0x7fe6e419de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6ea20a700 1 -- 172.21.15.81:0/1665290415 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e00095f0 con 0x7fe6e4069710 2024-05-09T00:04:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.501+0000 7fe6eaa0b700 1 --2- 172.21.15.81:0/1665290415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e410d7f0 0x7fe6e419de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:04:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.502+0000 7fe6ea20a700 1 --2- 172.21.15.81:0/1665290415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6e4069710 0x7fe6e4199530 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000f6a0 tx=0x7fe6e000f6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.502+0000 7fe6db7fe700 1 -- 172.21.15.81:0/1665290415 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e001d070 con 0x7fe6e4069710 2024-05-09T00:04:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.502+0000 7fe6ec46e700 1 -- 172.21.15.81:0/1665290415 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e419ea00 con 0x7fe6e4069710 2024-05-09T00:04:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.502+0000 7fe6ec46e700 1 -- 172.21.15.81:0/1665290415 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e41a62a0 con 0x7fe6e4069710 2024-05-09T00:04:12.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.502+0000 7fe6db7fe700 1 -- 172.21.15.81:0/1665290415 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6e000fbf0 con 0x7fe6e4069710 2024-05-09T00:04:12.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.502+0000 7fe6db7fe700 1 -- 172.21.15.81:0/1665290415 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e0017650 con 0x7fe6e4069710 2024-05-09T00:04:12.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.505+0000 7fe6f8628b80 1 Processor -- start 2024-05-09T00:04:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.505+0000 7fe6f8628b80 1 -- start start 2024-05-09T00:04:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6f8628b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911aae00 0x556f911ab1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6f8628b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911ab720 0x556f911a5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6f8628b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911a5890 0x556f911a5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6f8628b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f910fc150 con 0x556f911a5890 2024-05-09T00:04:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6f8628b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f910f9b10 con 0x556f911aae00 2024-05-09T00:04:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6f8628b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f910f5400 con 0x556f911ab720 2024-05-09T00:04:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6e9a09700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911a5890 0x556f911a5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6e9a09700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911a5890 0x556f911a5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40214/0 (socket says 172.21.15.81:40214) 2024-05-09T00:04:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6e9a09700 1 -- 172.21.15.81:0/3496858332 learned_addr learned my addr 172.21.15.81:0/3496858332 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6ea20a700 1 --2- 172.21.15.81:0/3496858332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911ab720 0x556f911a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6db7fe700 1 -- 172.21.15.81:0/1665290415 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7fe6e00050d0 con 0x7fe6e4069710 2024-05-09T00:04:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6eaa0b700 1 --2- 172.21.15.81:0/3496858332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911aae00 0x556f911ab1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6e9a09700 1 -- 172.21.15.81:0/3496858332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911ab720 msgr2=0x556f911a5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6e9a09700 1 --2- 172.21.15.81:0/3496858332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911ab720 0x556f911a5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6e9a09700 1 -- 172.21.15.81:0/3496858332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911aae00 msgr2=0x556f911ab1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6e9a09700 1 --2- 172.21.15.81:0/3496858332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911aae00 0x556f911ab1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6e9a09700 1 -- 172.21.15.81:0/3496858332 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f90f763b0 con 0x556f911a5890 2024-05-09T00:04:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6eaa0b700 1 --2- 172.21.15.81:0/3496858332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911aae00 0x556f911ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.506+0000 7fe6e9a09700 1 --2- 172.21.15.81:0/3496858332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911a5890 0x556f911a5cd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4008c30 tx=0x7fe6d4008f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfb150bdc5ba609 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.507+0000 7fe6db7fe700 1 --2- 172.21.15.81:0/1665290415 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6d00a1540 0x7fe6d00a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.507+0000 7fe6eaa0b700 1 --2- 172.21.15.81:0/1665290415 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6d00a1540 0x7fe6d00a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.507+0000 7fe6db7fe700 1 -- 172.21.15.81:0/1665290415 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fe6e00ce050 con 0x7fe6e4069710 2024-05-09T00:04:12.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.508+0000 7fe6d8da4700 1 -- 172.21.15.81:0/3496858332 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4020070 con 0x556f911a5890 2024-05-09T00:04:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.508+0000 7fe6d8da4700 1 -- 172.21.15.81:0/3496858332 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6d401ca20 con 0x556f911a5890 2024-05-09T00:04:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.508+0000 7fe6d8da4700 1 -- 172.21.15.81:0/3496858332 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d4005020 con 0x556f911a5890 2024-05-09T00:04:12.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.508+0000 7fe6eaa0b700 1 --2- 172.21.15.81:0/1665290415 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6d00a1540 0x7fe6d00a3a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc007fd0 tx=0x7fe6dc009040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.508+0000 7fe6f8628b80 1 -- 172.21.15.81:0/3496858332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911a5890 msgr2=0x556f911a5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.508+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/3496858332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911a5890 0x556f911a5cd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4008c30 tx=0x7fe6d4008f40 comp rx=0 tx=0).stop 2024-05-09T00:04:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.508+0000 7fe6f8628b80 1 -- 172.21.15.81:0/3496858332 shutdown_connections 2024-05-09T00:04:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.508+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/3496858332 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911aae00 0x556f911ab1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.508+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/3496858332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911a5890 0x556f911a5cd0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.508+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/3496858332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911ab720 0x556f911a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.508+0000 7fe6f8628b80 1 -- 172.21.15.81:0/3496858332 >> 172.21.15.81:0/3496858332 conn(0x556f91103210 msgr2=0x556f9119fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.509+0000 7fe6f8628b80 1 -- 172.21.15.81:0/3496858332 shutdown_connections 2024-05-09T00:04:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.509+0000 7fe6f8628b80 1 -- 172.21.15.81:0/3496858332 wait complete. 2024-05-09T00:04:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.509+0000 7fe6f8628b80 1 -- start start 2024-05-09T00:04:12.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.509+0000 7fe6f8628b80 1 Processor -- start 2024-05-09T00:04:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.509+0000 7fe6f8628b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911a5890 0x556f911b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.509+0000 7fe6f8628b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911aae00 0x556f911aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.509+0000 7fe6f8628b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911ab720 0x556f911af210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.509+0000 7fe6f8628b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f91091560 con 0x556f911aae00 2024-05-09T00:04:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.509+0000 7fe6f8628b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f91091200 con 0x556f911a5890 2024-05-09T00:04:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.509+0000 7fe6f8628b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f90f786a0 con 0x556f911ab720 2024-05-09T00:04:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.509+0000 7fe6f8628b80 10 client.0 _ll_register_callbacks cb 0x556f9109ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.510+0000 7fe6eaa0b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911ab720 0x556f911af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.510+0000 7fe6eaa0b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911ab720 0x556f911af210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:47856/0 (socket says 172.21.15.81:47856) 2024-05-09T00:04:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.510+0000 7fe6eaa0b700 1 -- 172.21.15.81:0/236300141 learned_addr learned my addr 172.21.15.81:0/236300141 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.510+0000 7fe6ea20a700 1 --2- 172.21.15.81:0/236300141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911a5890 0x556f911b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.510+0000 7fe6eaa0b700 1 -- 172.21.15.81:0/236300141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911a5890 msgr2=0x556f911b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.510+0000 7fe6eaa0b700 1 --2- 172.21.15.81:0/236300141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911a5890 0x556f911b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.510+0000 7fe6eaa0b700 1 -- 172.21.15.81:0/236300141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911aae00 msgr2=0x556f911aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.510+0000 7fe6eaa0b700 1 --2- 172.21.15.81:0/236300141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911aae00 0x556f911aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.510+0000 7fe6eaa0b700 1 -- 172.21.15.81:0/236300141 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d4008890 con 0x556f911ab720 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.510+0000 7fe6eaa0b700 1 --2- 172.21.15.81:0/236300141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911ab720 0x556f911af210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc007760 tx=0x7fe6dc004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30d1ce53f93b55a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.510+0000 7fe6cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.511+0000 7fe6cdffb700 1 -- 172.21.15.81:0/236300141 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc025070 con 0x556f911ab720 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.511+0000 7fe6f8628b80 1 -- 172.21.15.81:0/236300141 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f9104e270 con 0x556f911ab720 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.511+0000 7fe6cdffb700 1 -- 172.21.15.81:0/236300141 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fe6dc016e40 con 0x556f911ab720 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.511+0000 7fe6cdffb700 1 -- 172.21.15.81:0/236300141 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6dc015e80 con 0x556f911ab720 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.511+0000 7fe6f8628b80 10 client.25312 fetch_fsmap learned FSMap version 24 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.511+0000 7fe6f8628b80 1 -- 172.21.15.81:0/236300141 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x556f90f22b60 con 0x556f911ab720 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.511+0000 7fe6cdffb700 1 -- 172.21.15.81:0/236300141 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556f9104e270 con 0x556f911ab720 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.511+0000 7fe6cdffb700 1 -- 172.21.15.81:0/236300141 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe6dc028020 con 0x556f911ab720 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.511+0000 7fe6f8628b80 10 client.25312 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.511+0000 7fe6f8628b80 10 client.25312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:12.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.511+0000 7fe6f8628b80 20 client.25312 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:12.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.511+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/236300141 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f911d0250 0x556f911d2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.511+0000 7fe6f8628b80 4 client.25312 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:12.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.511+0000 7fe6f8628b80 1 -- 172.21.15.81:0/236300141 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f91174810 con 0x556f911d0250 2024-05-09T00:04:12.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.512+0000 7fe6ea20a700 1 --2- 172.21.15.81:0/236300141 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f911d0250 0x556f911d2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.512+0000 7fe6ea20a700 1 --2- 172.21.15.81:0/236300141 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f911d0250 0x556f911d2670 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c69ac9451dbfd927 server_cookie=1cef4844cf269247 in_seq=0 out_seq=0 2024-05-09T00:04:12.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.512+0000 7fe6cdffb700 10 client.25312 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6cdffb700 1 -- 172.21.15.81:0/236300141 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556f91174810 con 0x556f911d0250 2024-05-09T00:04:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6cdffb700 10 client.25312 handle_command_reply: tid=0 2024-05-09T00:04:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6f8628b80 1 client.25312 shutdown 2024-05-09T00:04:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6f8628b80 1 -- 172.21.15.81:0/236300141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911ab720 msgr2=0x556f911af210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/236300141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911ab720 0x556f911af210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc007760 tx=0x7fe6dc004b40 comp rx=0 tx=0).stop 2024-05-09T00:04:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6f8628b80 1 -- 172.21.15.81:0/236300141 shutdown_connections 2024-05-09T00:04:12.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/236300141 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f911d0250 0x556f911d2670 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/236300141 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911a5890 0x556f911b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/236300141 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911ab720 0x556f911af210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/236300141 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911aae00 0x556f911aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6f8628b80 1 -- 172.21.15.81:0/236300141 >> 172.21.15.81:0/236300141 conn(0x556f91103210 msgr2=0x556f9119f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6cdffb700 0 client.25312 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:12.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6f8628b80 1 -- 172.21.15.81:0/236300141 shutdown_connections 2024-05-09T00:04:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6f8628b80 1 -- 172.21.15.81:0/236300141 wait complete. 2024-05-09T00:04:12.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.513+0000 7fe6f8628b80 20 client.25312 trim_cache size 0 max 16384 2024-05-09T00:04:12.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.526+0000 7fe6f8628b80 1 Processor -- start 2024-05-09T00:04:12.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.526+0000 7fe6f8628b80 1 -- start start 2024-05-09T00:04:12.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6f8628b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911a5890 0x556f9119fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6f8628b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911aae00 0x556f911b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6f8628b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911ab720 0x556f911b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6f8628b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f911ab590 con 0x556f911aae00 2024-05-09T00:04:12.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6f8628b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f911d78a0 con 0x556f911ab720 2024-05-09T00:04:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6f8628b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f911cd840 con 0x556f911a5890 2024-05-09T00:04:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6ea20a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911a5890 0x556f9119fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6ea20a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911a5890 0x556f9119fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:47860/0 (socket says 172.21.15.81:47860) 2024-05-09T00:04:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6ea20a700 1 -- 172.21.15.81:0/1377406424 learned_addr learned my addr 172.21.15.81:0/1377406424 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6eaa0b700 1 --2- 172.21.15.81:0/1377406424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911ab720 0x556f911b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6ea20a700 1 -- 172.21.15.81:0/1377406424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911ab720 msgr2=0x556f911b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6ea20a700 1 --2- 172.21.15.81:0/1377406424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911ab720 0x556f911b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6ea20a700 1 -- 172.21.15.81:0/1377406424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911aae00 msgr2=0x556f911b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6e9a09700 1 --2- 172.21.15.81:0/1377406424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911aae00 0x556f911b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6ea20a700 1 --2- 172.21.15.81:0/1377406424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911aae00 0x556f911b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6ea20a700 1 -- 172.21.15.81:0/1377406424 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f910bb560 con 0x556f911a5890 2024-05-09T00:04:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.527+0000 7fe6e9a09700 1 --2- 172.21.15.81:0/1377406424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911aae00 0x556f911b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:12.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.528+0000 7fe6ea20a700 1 --2- 172.21.15.81:0/1377406424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911a5890 0x556f9119fd20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0097a20 tx=0x7fe6e00a1040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=738ec48c75da74e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.528+0000 7fe6d95a5700 1 -- 172.21.15.81:0/1377406424 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e00972f0 con 0x556f911a5890 2024-05-09T00:04:12.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.528+0000 7fe6d95a5700 1 -- 172.21.15.81:0/1377406424 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6e009ad80 con 0x556f911a5890 2024-05-09T00:04:12.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.528+0000 7fe6d95a5700 1 -- 172.21.15.81:0/1377406424 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e009b040 con 0x556f911a5890 2024-05-09T00:04:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.528+0000 7fe6f8628b80 1 -- 172.21.15.81:0/1377406424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911a5890 msgr2=0x556f9119fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.528+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/1377406424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911a5890 0x556f9119fd20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe6e0097a20 tx=0x7fe6e00a1040 comp rx=0 tx=0).stop 2024-05-09T00:04:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 -- 172.21.15.81:0/1377406424 shutdown_connections 2024-05-09T00:04:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/1377406424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911ab720 0x556f911b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/1377406424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911a5890 0x556f9119fd20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/1377406424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911aae00 0x556f911b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 -- 172.21.15.81:0/1377406424 >> 172.21.15.81:0/1377406424 conn(0x556f91103210 msgr2=0x556f911a8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 -- 172.21.15.81:0/1377406424 shutdown_connections 2024-05-09T00:04:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 -- 172.21.15.81:0/1377406424 wait complete. 2024-05-09T00:04:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 -- start start 2024-05-09T00:04:12.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 Processor -- start 2024-05-09T00:04:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911a5890 0x556f911b6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911aae00 0x556f911b4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911ab720 0x556f911b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f911b4da0 con 0x556f911ab720 2024-05-09T00:04:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f911b4f10 con 0x556f911a5890 2024-05-09T00:04:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f91225790 con 0x556f911aae00 2024-05-09T00:04:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.529+0000 7fe6f8628b80 10 client.0 _ll_register_callbacks cb 0x556f9109ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6ea20a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911a5890 0x556f911b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6ea20a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911a5890 0x556f911b6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.81:39590/0 (socket says 172.21.15.81:39590) 2024-05-09T00:04:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6ea20a700 1 -- 172.21.15.81:0/620231731 learned_addr learned my addr 172.21.15.81:0/620231731 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6ea20a700 1 -- 172.21.15.81:0/620231731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911aae00 msgr2=0x556f911b4180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:04:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6ea20a700 1 --2- 172.21.15.81:0/620231731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911aae00 0x556f911b4180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6ea20a700 1 -- 172.21.15.81:0/620231731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911ab720 msgr2=0x556f911b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:12.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6ea20a700 1 --2- 172.21.15.81:0/620231731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911ab720 0x556f911b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6ea20a700 1 -- 172.21.15.81:0/620231731 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e41a62a0 con 0x556f911a5890 2024-05-09T00:04:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6ea20a700 1 --2- 172.21.15.81:0/620231731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911a5890 0x556f911b6470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe6e009af40 tx=0x7fe6e0005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7392c0e90124bd25 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-05-09T00:04:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6cdffb700 1 -- 172.21.15.81:0/620231731 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e00d5070 con 0x556f911a5890 2024-05-09T00:04:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6cdffb700 1 -- 172.21.15.81:0/620231731 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fe6e00a10b0 con 0x556f911a5890 2024-05-09T00:04:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6f8628b80 1 -- 172.21.15.81:0/620231731 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe6d401ca20 con 0x556f911a5890 2024-05-09T00:04:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6cdffb700 1 -- 172.21.15.81:0/620231731 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6e009a910 con 0x556f911a5890 2024-05-09T00:04:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6f8628b80 10 client.25277 fetch_fsmap learned FSMap version 24 2024-05-09T00:04:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.530+0000 7fe6f8628b80 1 -- 172.21.15.81:0/620231731 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x556f90f7acd0 con 0x556f911a5890 2024-05-09T00:04:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.531+0000 7fe6cdffb700 1 -- 172.21.15.81:0/620231731 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6e00b2020 con 0x556f911a5890 2024-05-09T00:04:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.531+0000 7fe6cdffb700 1 -- 172.21.15.81:0/620231731 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe6e00d0110 con 0x556f911a5890 2024-05-09T00:04:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.531+0000 7fe6f8628b80 10 client.25277 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:04:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.531+0000 7fe6f8628b80 10 client.25277 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:12.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.531+0000 7fe6f8628b80 20 client.25277 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.531+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/620231731 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f91226830 0x556f91228c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.531+0000 7fe6f8628b80 4 client.25277 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:04:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.531+0000 7fe6f8628b80 1 -- 172.21.15.81:0/620231731 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556f910edec0 con 0x556f91226830 2024-05-09T00:04:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.531+0000 7fe6e9a09700 1 --2- 172.21.15.81:0/620231731 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f91226830 0x556f91228c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.531+0000 7fe6cdffb700 10 client.25277 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.531+0000 7fe6e9a09700 1 --2- 172.21.15.81:0/620231731 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f91226830 0x556f91228c50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57ad56e10b91a092 server_cookie=98e43d407d541e84 in_seq=0 out_seq=0 2024-05-09T00:04:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6cdffb700 1 -- 172.21.15.81:0/620231731 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556f910edec0 con 0x556f91226830 2024-05-09T00:04:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6cdffb700 10 client.25277 handle_command_reply: tid=0 2024-05-09T00:04:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6f8628b80 1 client.25277 shutdown 2024-05-09T00:04:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6f8628b80 1 -- 172.21.15.81:0/620231731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911a5890 msgr2=0x556f911b6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/620231731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911a5890 0x556f911b6470 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe6e009af40 tx=0x7fe6e0005a00 comp rx=0 tx=0).stop 2024-05-09T00:04:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6f8628b80 1 -- 172.21.15.81:0/620231731 shutdown_connections 2024-05-09T00:04:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/620231731 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f91226830 0x556f91228c50 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/620231731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f911a5890 0x556f911b6470 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/620231731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f911ab720 0x556f911b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6f8628b80 1 --2- 172.21.15.81:0/620231731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f911aae00 0x556f911b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6f8628b80 1 -- 172.21.15.81:0/620231731 >> 172.21.15.81:0/620231731 conn(0x556f91103210 msgr2=0x556f911ae360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6cdffb700 0 client.25277 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:12.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6f8628b80 1 -- 172.21.15.81:0/620231731 shutdown_connections 2024-05-09T00:04:12.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6f8628b80 1 -- 172.21.15.81:0/620231731 wait complete. 2024-05-09T00:04:12.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.532+0000 7fe6f8628b80 20 client.25277 trim_cache size 0 max 16384 2024-05-09T00:04:12.532 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:04:12.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.533+0000 7fe6ec46e700 1 -- 172.21.15.81:0/1665290415 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6d00a1540 msgr2=0x7fe6d00a3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.533+0000 7fe6ec46e700 1 --2- 172.21.15.81:0/1665290415 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6d00a1540 0x7fe6d00a3a00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc007fd0 tx=0x7fe6dc009040 comp rx=0 tx=0).stop 2024-05-09T00:04:12.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.533+0000 7fe6ec46e700 1 -- 172.21.15.81:0/1665290415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6e4069710 msgr2=0x7fe6e4199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:12.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.533+0000 7fe6ec46e700 1 --2- 172.21.15.81:0/1665290415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6e4069710 0x7fe6e4199530 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe6e000f6a0 tx=0x7fe6e000f6d0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.533+0000 7fe6ec46e700 1 -- 172.21.15.81:0/1665290415 shutdown_connections 2024-05-09T00:04:12.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.533+0000 7fe6ec46e700 1 --2- 172.21.15.81:0/1665290415 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6d00a1540 0x7fe6d00a3a00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.533+0000 7fe6ec46e700 1 --2- 172.21.15.81:0/1665290415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6e410d7f0 0x7fe6e419de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.533+0000 7fe6ec46e700 1 --2- 172.21.15.81:0/1665290415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6e4069710 0x7fe6e4199530 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.533+0000 7fe6ec46e700 1 --2- 172.21.15.81:0/1665290415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6e4101e20 0x7fe6e4199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.533+0000 7fe6ec46e700 1 -- 172.21.15.81:0/1665290415 >> 172.21.15.81:0/1665290415 conn(0x7fe6e4076ba0 msgr2=0x7fe6e40ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.533+0000 7fe6ec46e700 1 -- 172.21.15.81:0/1665290415 shutdown_connections 2024-05-09T00:04:12.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:12.533+0000 7fe6ec46e700 1 -- 172.21.15.81:0/1665290415 wait complete. 2024-05-09T00:04:13.263 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:12 smithi150 ceph-mon[46187]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-09T00:04:13.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:12 smithi171 ceph-mon[47351]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-09T00:04:13.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:12 smithi081 ceph-mon[42474]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-05-09T00:04:13.543 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:04:13.543 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:04:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.685+0000 7fcc263d9700 1 -- 172.21.15.81:0/129182380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc20100a10 msgr2=0x7fcc20104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.685+0000 7fcc263d9700 1 --2- 172.21.15.81:0/129182380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc20100a10 0x7fcc20104a30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcc14009990 tx=0x7fcc14009ca0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.686+0000 7fcc263d9700 1 -- 172.21.15.81:0/129182380 shutdown_connections 2024-05-09T00:04:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.686+0000 7fcc263d9700 1 --2- 172.21.15.81:0/129182380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc20105160 0x7fcc2010cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.686+0000 7fcc263d9700 1 --2- 172.21.15.81:0/129182380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc20100060 0x7fcc20100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.686+0000 7fcc263d9700 1 --2- 172.21.15.81:0/129182380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc20100a10 0x7fcc20104a30 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.686+0000 7fcc263d9700 1 -- 172.21.15.81:0/129182380 >> 172.21.15.81:0/129182380 conn(0x7fcc20076f40 msgr2=0x7fcc20077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.686+0000 7fcc263d9700 1 -- 172.21.15.81:0/129182380 shutdown_connections 2024-05-09T00:04:13.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.686+0000 7fcc263d9700 1 -- 172.21.15.81:0/129182380 wait complete. 2024-05-09T00:04:13.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.686+0000 7fcc263d9700 1 Processor -- start 2024-05-09T00:04:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.687+0000 7fcc263d9700 1 -- start start 2024-05-09T00:04:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.687+0000 7fcc263d9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc20100060 0x7fcc2006a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.687+0000 7fcc263d9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc20105160 0x7fcc2006af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.687+0000 7fcc263d9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc2006b5a0 0x7fcc2006ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.687+0000 7fcc263d9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2006f3f0 con 0x7fcc20100060 2024-05-09T00:04:13.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.687+0000 7fcc263d9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2006f560 con 0x7fcc2006b5a0 2024-05-09T00:04:13.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.687+0000 7fcc263d9700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2006f720 con 0x7fcc20105160 2024-05-09T00:04:13.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.687+0000 7fcc1f7fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc20105160 0x7fcc2006af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.687+0000 7fcc1f7fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc20105160 0x7fcc2006af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:47890/0 (socket says 172.21.15.81:47890) 2024-05-09T00:04:13.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.687+0000 7fcc1f7fe700 1 -- 172.21.15.81:0/2755966075 learned_addr learned my addr 172.21.15.81:0/2755966075 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:13.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.687+0000 7fcc24976700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc2006b5a0 0x7fcc2006ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.688+0000 7fcc1ffff700 1 --2- 172.21.15.81:0/2755966075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc20100060 0x7fcc2006a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.688+0000 7fcc1f7fe700 1 -- 172.21.15.81:0/2755966075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc2006b5a0 msgr2=0x7fcc2006ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.688+0000 7fcc1f7fe700 1 --2- 172.21.15.81:0/2755966075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc2006b5a0 0x7fcc2006ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.688+0000 7fcc1f7fe700 1 -- 172.21.15.81:0/2755966075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc20100060 msgr2=0x7fcc2006a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.688+0000 7fcc1f7fe700 1 --2- 172.21.15.81:0/2755966075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc20100060 0x7fcc2006a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.688+0000 7fcc1f7fe700 1 -- 172.21.15.81:0/2755966075 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc140095f0 con 0x7fcc20105160 2024-05-09T00:04:13.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.688+0000 7fcc24976700 1 --2- 172.21.15.81:0/2755966075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc2006b5a0 0x7fcc2006ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:04:13.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.688+0000 7fcc1f7fe700 1 --2- 172.21.15.81:0/2755966075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc20105160 0x7fcc2006af00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcc140059d0 tx=0x7fcc14009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:13.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.688+0000 7fcc1d7fa700 1 -- 172.21.15.81:0/2755966075 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1403f070 con 0x7fcc20105160 2024-05-09T00:04:13.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.688+0000 7fcc263d9700 1 -- 172.21.15.81:0/2755966075 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2006f9a0 con 0x7fcc20105160 2024-05-09T00:04:13.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.688+0000 7fcc263d9700 1 -- 172.21.15.81:0/2755966075 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc20199da0 con 0x7fcc20105160 2024-05-09T00:04:13.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.688+0000 7fcc1d7fa700 1 -- 172.21.15.81:0/2755966075 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc1400fb30 con 0x7fcc20105160 2024-05-09T00:04:13.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.689+0000 7fcc1d7fa700 1 -- 172.21.15.81:0/2755966075 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc14044ae0 con 0x7fcc20105160 2024-05-09T00:04:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.692+0000 7fcc1d7fa700 1 -- 172.21.15.81:0/2755966075 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7fcc14044c40 con 0x7fcc20105160 2024-05-09T00:04:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.692+0000 7fcc32593b80 1 Processor -- start 2024-05-09T00:04:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.692+0000 7fcc1d7fa700 1 --2- 172.21.15.81:0/2755966075 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcc080a1440 0x7fcc080a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.693+0000 7fcc1d7fa700 1 -- 172.21.15.81:0/2755966075 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fcc140efcd0 con 0x7fcc20105160 2024-05-09T00:04:13.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.693+0000 7fcc32593b80 1 -- start start 2024-05-09T00:04:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.693+0000 7fcc24976700 1 --2- 172.21.15.81:0/2755966075 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcc080a1440 0x7fcc080a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.693+0000 7fcc32593b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36690 0x55bcb2a36a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.693+0000 7fcc32593b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a30be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.693+0000 7fcc32593b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a31120 0x55bcb2a31560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.693+0000 7fcc32593b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcb297f1d0 con 0x55bcb2a31120 2024-05-09T00:04:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.693+0000 7fcc32593b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcb297cb90 con 0x55bcb2a36fb0 2024-05-09T00:04:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.693+0000 7fcc32593b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcb2978480 con 0x55bcb2a36690 2024-05-09T00:04:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc1f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a30be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc1f7fe700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a30be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.81:39618/0 (socket says 172.21.15.81:39618) 2024-05-09T00:04:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc1f7fe700 1 -- 172.21.15.81:0/2802937175 learned_addr learned my addr 172.21.15.81:0/2802937175 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc1ffff700 1 --2- 172.21.15.81:0/2802937175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36690 0x55bcb2a36a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc24976700 1 --2- 172.21.15.81:0/2802937175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a31120 0x55bcb2a31560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc1f7fe700 1 -- 172.21.15.81:0/2802937175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36690 msgr2=0x55bcb2a36a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc1f7fe700 1 --2- 172.21.15.81:0/2802937175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36690 0x55bcb2a36a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc1f7fe700 1 -- 172.21.15.81:0/2802937175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a31120 msgr2=0x55bcb2a31560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc1f7fe700 1 --2- 172.21.15.81:0/2802937175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a31120 0x55bcb2a31560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc1f7fe700 1 -- 172.21.15.81:0/2802937175 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcb27f9430 con 0x55bcb2a36fb0 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc24976700 1 --2- 172.21.15.81:0/2755966075 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcc080a1440 0x7fcc080a3900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcc18007fd0 tx=0x7fcc1800da80 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc1f7fe700 1 --2- 172.21.15.81:0/2802937175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a30be0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcc140bcc90 tx=0x7fcc140445e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=185f7453e41ef6ef server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc067fc700 1 -- 172.21.15.81:0/2802937175 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc140bcd00 con 0x55bcb2a36fb0 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc067fc700 1 -- 172.21.15.81:0/2802937175 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc140c0b30 con 0x55bcb2a36fb0 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.694+0000 7fcc067fc700 1 -- 172.21.15.81:0/2802937175 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc140c4c60 con 0x55bcb2a36fb0 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.695+0000 7fcc32593b80 1 -- 172.21.15.81:0/2802937175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36fb0 msgr2=0x55bcb2a30be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.695+0000 7fcc32593b80 1 --2- 172.21.15.81:0/2802937175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a30be0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcc140bcc90 tx=0x7fcc140445e0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.695+0000 7fcc32593b80 1 -- 172.21.15.81:0/2802937175 shutdown_connections 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.695+0000 7fcc32593b80 1 --2- 172.21.15.81:0/2802937175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a31120 0x55bcb2a31560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.695+0000 7fcc32593b80 1 --2- 172.21.15.81:0/2802937175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36690 0x55bcb2a36a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.695+0000 7fcc32593b80 1 --2- 172.21.15.81:0/2802937175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a30be0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.695+0000 7fcc32593b80 1 -- 172.21.15.81:0/2802937175 >> 172.21.15.81:0/2802937175 conn(0x55bcb2986290 msgr2=0x55bcb2a22e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.695+0000 7fcc32593b80 1 -- 172.21.15.81:0/2802937175 shutdown_connections 2024-05-09T00:04:13.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.695+0000 7fcc32593b80 1 -- 172.21.15.81:0/2802937175 wait complete. 2024-05-09T00:04:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.696+0000 7fcc32593b80 1 -- start start 2024-05-09T00:04:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.696+0000 7fcc32593b80 1 Processor -- start 2024-05-09T00:04:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.696+0000 7fcc32593b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a31120 0x55bcb2a3cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.696+0000 7fcc32593b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a36690 0x55bcb2a3a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.696+0000 7fcc32593b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a3aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.696+0000 7fcc32593b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcb29145e0 con 0x55bcb2a36690 2024-05-09T00:04:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.696+0000 7fcc32593b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcb2914280 con 0x55bcb2a31120 2024-05-09T00:04:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.696+0000 7fcc32593b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcb27fb720 con 0x55bcb2a36fb0 2024-05-09T00:04:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.696+0000 7fcc32593b80 10 client.0 _ll_register_callbacks cb 0x55bcb291dbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.697+0000 7fcc24976700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a3aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.697+0000 7fcc24976700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a3aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:47920/0 (socket says 172.21.15.81:47920) 2024-05-09T00:04:13.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.697+0000 7fcc24976700 1 -- 172.21.15.81:0/4024881286 learned_addr learned my addr 172.21.15.81:0/4024881286 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:13.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.697+0000 7fcc1ffff700 1 --2- 172.21.15.81:0/4024881286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a31120 0x55bcb2a3cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.697+0000 7fcc24976700 1 -- 172.21.15.81:0/4024881286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a31120 msgr2=0x55bcb2a3cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.697+0000 7fcc24976700 1 --2- 172.21.15.81:0/4024881286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a31120 0x55bcb2a3cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.697+0000 7fcc24976700 1 -- 172.21.15.81:0/4024881286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a36690 msgr2=0x55bcb2a3a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.697+0000 7fcc24976700 1 --2- 172.21.15.81:0/4024881286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a36690 0x55bcb2a3a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.697+0000 7fcc24976700 1 -- 172.21.15.81:0/4024881286 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc20199da0 con 0x55bcb2a36fb0 2024-05-09T00:04:13.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.697+0000 7fcc24976700 1 --2- 172.21.15.81:0/4024881286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a3aa40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcc18016fd0 tx=0x7fcc18004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53f0b96ff27b4713 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:13.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.697+0000 7fcbff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-05-09T00:04:13.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.697+0000 7fcbff7fe700 1 -- 172.21.15.81:0/4024881286 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18017e50 con 0x55bcb2a36fb0 2024-05-09T00:04:13.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.698+0000 7fcc32593b80 1 -- 172.21.15.81:0/4024881286 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bcb28d12f0 con 0x55bcb2a36fb0 2024-05-09T00:04:13.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.698+0000 7fcbff7fe700 1 -- 172.21.15.81:0/4024881286 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fcc18022480 con 0x55bcb2a36fb0 2024-05-09T00:04:13.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.698+0000 7fcbff7fe700 1 -- 172.21.15.81:0/4024881286 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc18022640 con 0x55bcb2a36fb0 2024-05-09T00:04:13.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.698+0000 7fcc32593b80 10 client.25327 fetch_fsmap learned FSMap version 24 2024-05-09T00:04:13.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.698+0000 7fcc32593b80 1 -- 172.21.15.81:0/4024881286 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55bcb27a5be0 con 0x55bcb2a36fb0 2024-05-09T00:04:13.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.698+0000 7fcbff7fe700 1 -- 172.21.15.81:0/4024881286 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bcb28d12f0 con 0x55bcb2a36fb0 2024-05-09T00:04:13.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.698+0000 7fcbff7fe700 1 -- 172.21.15.81:0/4024881286 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcc18021a60 con 0x55bcb2a36fb0 2024-05-09T00:04:13.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.698+0000 7fcc32593b80 10 client.25327 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:04:13.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.698+0000 7fcc32593b80 10 client.25327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:13.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.698+0000 7fcc32593b80 20 client.25327 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:13.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.698+0000 7fcc32593b80 1 --2- 172.21.15.81:0/4024881286 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bcb2a4a750 0x55bcb2a4cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.698+0000 7fcc32593b80 4 client.25327 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:13.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.698+0000 7fcc32593b80 1 -- 172.21.15.81:0/4024881286 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bcb29f7890 con 0x55bcb2a4a750 2024-05-09T00:04:13.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.699+0000 7fcc1ffff700 1 --2- 172.21.15.81:0/4024881286 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bcb2a4a750 0x55bcb2a4cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.699+0000 7fcc1ffff700 1 --2- 172.21.15.81:0/4024881286 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bcb2a4a750 0x55bcb2a4cb70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=369b196aa6d7d53e server_cookie=f1c43155c7f90efd in_seq=0 out_seq=0 2024-05-09T00:04:13.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.699+0000 7fcbff7fe700 10 client.25327 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:13.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcbff7fe700 1 -- 172.21.15.81:0/4024881286 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bcb29f7890 con 0x55bcb2a4a750 2024-05-09T00:04:13.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcbff7fe700 10 client.25327 handle_command_reply: tid=0 2024-05-09T00:04:13.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcc32593b80 1 client.25327 shutdown 2024-05-09T00:04:13.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcc32593b80 1 -- 172.21.15.81:0/4024881286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36fb0 msgr2=0x55bcb2a3aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcc32593b80 1 --2- 172.21.15.81:0/4024881286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a3aa40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcc18016fd0 tx=0x7fcc18004b40 comp rx=0 tx=0).stop 2024-05-09T00:04:13.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcc32593b80 1 -- 172.21.15.81:0/4024881286 shutdown_connections 2024-05-09T00:04:13.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcc32593b80 1 --2- 172.21.15.81:0/4024881286 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bcb2a4a750 0x55bcb2a4cb70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcc32593b80 1 --2- 172.21.15.81:0/4024881286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a31120 0x55bcb2a3cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcc32593b80 1 --2- 172.21.15.81:0/4024881286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a3aa40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcc32593b80 1 --2- 172.21.15.81:0/4024881286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a36690 0x55bcb2a3a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcc32593b80 1 -- 172.21.15.81:0/4024881286 >> 172.21.15.81:0/4024881286 conn(0x55bcb2986290 msgr2=0x55bcb2a22620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:13.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcbff7fe700 0 client.25327 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:13.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcc32593b80 1 -- 172.21.15.81:0/4024881286 shutdown_connections 2024-05-09T00:04:13.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcc32593b80 1 -- 172.21.15.81:0/4024881286 wait complete. 2024-05-09T00:04:13.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.700+0000 7fcc32593b80 20 client.25327 trim_cache size 0 max 16384 2024-05-09T00:04:13.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.719+0000 7fcc32593b80 1 Processor -- start 2024-05-09T00:04:13.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.719+0000 7fcc32593b80 1 -- start start 2024-05-09T00:04:13.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.719+0000 7fcc32593b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a31120 0x55bcb2a30be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.719+0000 7fcc32593b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36690 0x55bcb2a22da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.719+0000 7fcc32593b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a41770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.719+0000 7fcc32593b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcb2a240f0 con 0x55bcb2a31120 2024-05-09T00:04:13.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.719+0000 7fcc32593b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcb2a1fe40 con 0x55bcb2a36fb0 2024-05-09T00:04:13.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.719+0000 7fcc32593b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcb2a24ed0 con 0x55bcb2a36690 2024-05-09T00:04:13.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.719+0000 7fcc1ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a31120 0x55bcb2a30be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.720+0000 7fcc1ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a31120 0x55bcb2a30be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40296/0 (socket says 172.21.15.81:40296) 2024-05-09T00:04:13.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.720+0000 7fcc1ffff700 1 -- 172.21.15.81:0/4042355350 learned_addr learned my addr 172.21.15.81:0/4042355350 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:13.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.720+0000 7fcc1f7fe700 1 --2- 172.21.15.81:0/4042355350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36690 0x55bcb2a22da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.720+0000 7fcc24976700 1 --2- 172.21.15.81:0/4042355350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a41770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.720+0000 7fcc1ffff700 1 -- 172.21.15.81:0/4042355350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36690 msgr2=0x55bcb2a22da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.720+0000 7fcc1ffff700 1 --2- 172.21.15.81:0/4042355350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36690 0x55bcb2a22da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.720+0000 7fcc1ffff700 1 -- 172.21.15.81:0/4042355350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36fb0 msgr2=0x55bcb2a41770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.720+0000 7fcc1ffff700 1 --2- 172.21.15.81:0/4042355350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a41770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.720+0000 7fcc1ffff700 1 -- 172.21.15.81:0/4042355350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcb2a1f560 con 0x55bcb2a31120 2024-05-09T00:04:13.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.720+0000 7fcc1ffff700 1 --2- 172.21.15.81:0/4042355350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a31120 0x55bcb2a30be0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000ba50 tx=0x7fcc1000b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314eae89040f447a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:13.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.720+0000 7fcc06ffd700 1 -- 172.21.15.81:0/4042355350 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10016070 con 0x55bcb2a31120 2024-05-09T00:04:13.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.720+0000 7fcc06ffd700 1 -- 172.21.15.81:0/4042355350 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc10017040 con 0x55bcb2a31120 2024-05-09T00:04:13.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.720+0000 7fcc06ffd700 1 -- 172.21.15.81:0/4042355350 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc100053a0 con 0x55bcb2a31120 2024-05-09T00:04:13.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.721+0000 7fcc32593b80 1 -- 172.21.15.81:0/4042355350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a31120 msgr2=0x55bcb2a30be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.721+0000 7fcc32593b80 1 --2- 172.21.15.81:0/4042355350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a31120 0x55bcb2a30be0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000ba50 tx=0x7fcc1000b410 comp rx=0 tx=0).stop 2024-05-09T00:04:13.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.721+0000 7fcc32593b80 1 -- 172.21.15.81:0/4042355350 shutdown_connections 2024-05-09T00:04:13.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.721+0000 7fcc32593b80 1 --2- 172.21.15.81:0/4042355350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a41770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.721+0000 7fcc32593b80 1 --2- 172.21.15.81:0/4042355350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a31120 0x55bcb2a30be0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.721+0000 7fcc32593b80 1 --2- 172.21.15.81:0/4042355350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a36690 0x55bcb2a22da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.721+0000 7fcc32593b80 1 -- 172.21.15.81:0/4042355350 >> 172.21.15.81:0/4042355350 conn(0x55bcb2986290 msgr2=0x55bcb2a344b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:13.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.721+0000 7fcc32593b80 1 -- 172.21.15.81:0/4042355350 shutdown_connections 2024-05-09T00:04:13.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.722+0000 7fcc32593b80 1 -- 172.21.15.81:0/4042355350 wait complete. 2024-05-09T00:04:13.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.722+0000 7fcc32593b80 1 -- start start 2024-05-09T00:04:13.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.722+0000 7fcc32593b80 1 Processor -- start 2024-05-09T00:04:13.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.722+0000 7fcc32593b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a31120 0x55bcb2a41990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.722+0000 7fcc32593b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36690 0x55bcb2a3fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.722+0000 7fcc32593b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a40350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.722+0000 7fcc32593b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcb2a408d0 con 0x55bcb2a36fb0 2024-05-09T00:04:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc32593b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcb2a40a40 con 0x55bcb2a36690 2024-05-09T00:04:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc32593b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcb2a40c00 con 0x55bcb2a31120 2024-05-09T00:04:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc32593b80 10 client.0 _ll_register_callbacks cb 0x7fcc18016b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc24976700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a40350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc24976700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a40350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40312/0 (socket says 172.21.15.81:40312) 2024-05-09T00:04:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc24976700 1 -- 172.21.15.81:0/3222638436 learned_addr learned my addr 172.21.15.81:0/3222638436 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc1ffff700 1 --2- 172.21.15.81:0/3222638436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a31120 0x55bcb2a41990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc1f7fe700 1 --2- 172.21.15.81:0/3222638436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36690 0x55bcb2a3fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc1ffff700 1 -- 172.21.15.81:0/3222638436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36690 msgr2=0x55bcb2a3fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc1ffff700 1 --2- 172.21.15.81:0/3222638436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36690 0x55bcb2a3fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc1ffff700 1 -- 172.21.15.81:0/3222638436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a36fb0 msgr2=0x55bcb2a40350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc1ffff700 1 --2- 172.21.15.81:0/3222638436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a40350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc1ffff700 1 -- 172.21.15.81:0/3222638436 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc10004410 con 0x55bcb2a31120 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc24976700 1 --2- 172.21.15.81:0/3222638436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a40350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcc1ffff700 1 --2- 172.21.15.81:0/3222638436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a31120 0x55bcb2a41990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcc10003960 tx=0x7fcc1001f4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f1f1ec9cbc2a2be server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.723+0000 7fcbff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.724+0000 7fcbff7fe700 1 -- 172.21.15.81:0/3222638436 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10016050 con 0x55bcb2a31120 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.724+0000 7fcbff7fe700 1 -- 172.21.15.81:0/3222638436 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fcc100047c0 con 0x55bcb2a31120 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.724+0000 7fcc32593b80 1 -- 172.21.15.81:0/3222638436 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcc140c0b30 con 0x55bcb2a31120 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.724+0000 7fcbff7fe700 1 -- 172.21.15.81:0/3222638436 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc1001f910 con 0x55bcb2a31120 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.724+0000 7fcc32593b80 10 client.25333 fetch_fsmap learned FSMap version 24 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.724+0000 7fcc32593b80 1 -- 172.21.15.81:0/3222638436 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55bcb293e5e0 con 0x55bcb2a31120 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.724+0000 7fcbff7fe700 1 -- 172.21.15.81:0/3222638436 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc140c0b30 con 0x55bcb2a31120 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.725+0000 7fcbff7fe700 1 -- 172.21.15.81:0/3222638436 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcc10005000 con 0x55bcb2a31120 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.725+0000 7fcc32593b80 10 client.25333 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:04:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.725+0000 7fcc32593b80 10 client.25333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:13.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.725+0000 7fcc32593b80 20 client.25333 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:13.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.725+0000 7fcc32593b80 1 --2- 172.21.15.81:0/3222638436 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bcb2a9c090 0x55bcb2a9c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.725+0000 7fcc32593b80 4 client.25333 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:04:13.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.725+0000 7fcc32593b80 1 -- 172.21.15.81:0/3222638436 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55bcb2970f40 con 0x55bcb2a9c090 2024-05-09T00:04:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.725+0000 7fcc1f7fe700 1 --2- 172.21.15.81:0/3222638436 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bcb2a9c090 0x55bcb2a9c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.726+0000 7fcbff7fe700 10 client.25333 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.726+0000 7fcc1f7fe700 1 --2- 172.21.15.81:0/3222638436 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bcb2a9c090 0x55bcb2a9c470 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=471ae5fad176f971 server_cookie=cf8de28719f1f569 in_seq=0 out_seq=0 2024-05-09T00:04:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.727+0000 7fcbff7fe700 1 -- 172.21.15.81:0/3222638436 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55bcb2970f40 con 0x55bcb2a9c090 2024-05-09T00:04:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.727+0000 7fcbff7fe700 10 client.25333 handle_command_reply: tid=0 2024-05-09T00:04:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.727+0000 7fcc32593b80 1 client.25333 shutdown 2024-05-09T00:04:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.727+0000 7fcc32593b80 1 -- 172.21.15.81:0/3222638436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a31120 msgr2=0x55bcb2a41990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.727+0000 7fcc32593b80 1 --2- 172.21.15.81:0/3222638436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a31120 0x55bcb2a41990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcc10003960 tx=0x7fcc1001f4a0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.727+0000 7fcc32593b80 1 -- 172.21.15.81:0/3222638436 shutdown_connections 2024-05-09T00:04:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.727+0000 7fcc32593b80 1 --2- 172.21.15.81:0/3222638436 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bcb2a9c090 0x55bcb2a9c470 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.727+0000 7fcc32593b80 1 --2- 172.21.15.81:0/3222638436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bcb2a36fb0 0x55bcb2a40350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.727+0000 7fcc32593b80 1 --2- 172.21.15.81:0/3222638436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bcb2a31120 0x55bcb2a41990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.727+0000 7fcc32593b80 1 --2- 172.21.15.81:0/3222638436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bcb2a36690 0x55bcb2a3fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.727+0000 7fcc32593b80 1 -- 172.21.15.81:0/3222638436 >> 172.21.15.81:0/3222638436 conn(0x55bcb2986290 msgr2=0x55bcb2a38be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.727+0000 7fcbff7fe700 0 client.25333 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.727+0000 7fcc32593b80 1 -- 172.21.15.81:0/3222638436 shutdown_connections 2024-05-09T00:04:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.728+0000 7fcc32593b80 1 -- 172.21.15.81:0/3222638436 wait complete. 2024-05-09T00:04:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.728+0000 7fcc32593b80 20 client.25333 trim_cache size 0 max 16384 2024-05-09T00:04:13.725 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:04:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:04:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "8d3ccb97-b7ed-4a2c-9c29-a4e967aa132a", 2024-05-09T00:04:13.725 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:04:13.725 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:04:13.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.728+0000 7fcc263d9700 1 -- 172.21.15.81:0/2755966075 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcc080a1440 msgr2=0x7fcc080a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.728+0000 7fcc263d9700 1 --2- 172.21.15.81:0/2755966075 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcc080a1440 0x7fcc080a3900 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcc18007fd0 tx=0x7fcc1800da80 comp rx=0 tx=0).stop 2024-05-09T00:04:13.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.728+0000 7fcc263d9700 1 -- 172.21.15.81:0/2755966075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc20105160 msgr2=0x7fcc2006af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.728+0000 7fcc263d9700 1 --2- 172.21.15.81:0/2755966075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc20105160 0x7fcc2006af00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcc140059d0 tx=0x7fcc14009580 comp rx=0 tx=0).stop 2024-05-09T00:04:13.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.728+0000 7fcc263d9700 1 -- 172.21.15.81:0/2755966075 shutdown_connections 2024-05-09T00:04:13.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.728+0000 7fcc263d9700 1 --2- 172.21.15.81:0/2755966075 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcc080a1440 0x7fcc080a3900 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.728+0000 7fcc263d9700 1 --2- 172.21.15.81:0/2755966075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcc2006b5a0 0x7fcc2006ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.728+0000 7fcc263d9700 1 --2- 172.21.15.81:0/2755966075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc20100060 0x7fcc2006a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.728+0000 7fcc263d9700 1 --2- 172.21.15.81:0/2755966075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc20105160 0x7fcc2006af00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.728+0000 7fcc263d9700 1 -- 172.21.15.81:0/2755966075 >> 172.21.15.81:0/2755966075 conn(0x7fcc20076f40 msgr2=0x7fcc200fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:13.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.729+0000 7fcc263d9700 1 -- 172.21.15.81:0/2755966075 shutdown_connections 2024-05-09T00:04:13.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.729+0000 7fcc263d9700 1 -- 172.21.15.81:0/2755966075 wait complete. 2024-05-09T00:04:13.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:04:13.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.937+0000 7f47b0cee700 1 -- 172.21.15.81:0/2689860310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac106280 msgr2=0x7f47ac10de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.937+0000 7f47b0cee700 1 --2- 172.21.15.81:0/2689860310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac106280 0x7f47ac10de00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f47a400b0a0 tx=0x7f47a400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.937+0000 7f47b0cee700 1 -- 172.21.15.81:0/2689860310 shutdown_connections 2024-05-09T00:04:13.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.937+0000 7f47b0cee700 1 --2- 172.21.15.81:0/2689860310 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47ac101160 0x7f47ac101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.937+0000 7f47b0cee700 1 --2- 172.21.15.81:0/2689860310 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac106280 0x7f47ac10de00 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.937+0000 7f47b0cee700 1 --2- 172.21.15.81:0/2689860310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ac101b10 0x7f47ac105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.937+0000 7f47b0cee700 1 -- 172.21.15.81:0/2689860310 >> 172.21.15.81:0/2689860310 conn(0x7f47ac0fc9e0 msgr2=0x7f47ac0fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.938+0000 7f47b0cee700 1 -- 172.21.15.81:0/2689860310 shutdown_connections 2024-05-09T00:04:13.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.938+0000 7f47b0cee700 1 -- 172.21.15.81:0/2689860310 wait complete. 2024-05-09T00:04:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.938+0000 7f47b0cee700 1 Processor -- start 2024-05-09T00:04:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.939+0000 7f47b0cee700 1 -- start start 2024-05-09T00:04:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.939+0000 7f47b0cee700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ac101160 0x7f47ac0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.939+0000 7f47b0cee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac106280 0x7f47ac0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.939+0000 7f47b0cee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47ac074f60 0x7f47ac073d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.939+0000 7f47b0cee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac1aa0b0 con 0x7f47ac106280 2024-05-09T00:04:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.939+0000 7f47b0cee700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac19b610 con 0x7f47ac074f60 2024-05-09T00:04:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.939+0000 7f47b0cee700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ac19b7d0 con 0x7f47ac101160 2024-05-09T00:04:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.939+0000 7f47aad9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47ac074f60 0x7f47ac073d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.939+0000 7f47aad9d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47ac074f60 0x7f47ac073d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.81:39658/0 (socket says 172.21.15.81:39658) 2024-05-09T00:04:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.939+0000 7f47aad9d700 1 -- 172.21.15.81:0/4097280058 learned_addr learned my addr 172.21.15.81:0/4097280058 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.939+0000 7f47a9d9b700 1 --2- 172.21.15.81:0/4097280058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac106280 0x7f47ac0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.939+0000 7f47aad9d700 1 -- 172.21.15.81:0/4097280058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ac101160 msgr2=0x7f47ac0732a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:04:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.939+0000 7f47aad9d700 1 --2- 172.21.15.81:0/4097280058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ac101160 0x7f47ac0732a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.940+0000 7f47aad9d700 1 -- 172.21.15.81:0/4097280058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac106280 msgr2=0x7f47ac0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.940+0000 7f47aad9d700 1 --2- 172.21.15.81:0/4097280058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac106280 0x7f47ac0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.940+0000 7f47aad9d700 1 -- 172.21.15.81:0/4097280058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c009520 con 0x7f47ac074f60 2024-05-09T00:04:13.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.940+0000 7f47a9d9b700 1 --2- 172.21.15.81:0/4097280058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac106280 0x7f47ac0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:13.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.940+0000 7f47aad9d700 1 --2- 172.21.15.81:0/4097280058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47ac074f60 0x7f47ac073d60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f47a4006130 tx=0x7f47a4007da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:13.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.940+0000 7f479b7fe700 1 -- 172.21.15.81:0/4097280058 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a400e040 con 0x7f47ac074f60 2024-05-09T00:04:13.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.940+0000 7f47b0cee700 1 -- 172.21.15.81:0/4097280058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a4009d00 con 0x7f47ac074f60 2024-05-09T00:04:13.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.940+0000 7f479b7fe700 1 -- 172.21.15.81:0/4097280058 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47a400bdc0 con 0x7f47ac074f60 2024-05-09T00:04:13.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.940+0000 7f479b7fe700 1 -- 172.21.15.81:0/4097280058 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a401b6b0 con 0x7f47ac074f60 2024-05-09T00:04:13.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.940+0000 7f47b0cee700 1 -- 172.21.15.81:0/4097280058 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ac19bd90 con 0x7f47ac074f60 2024-05-09T00:04:13.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.943+0000 7f479b7fe700 1 -- 172.21.15.81:0/4097280058 <== mon.2 v2:172.21.15.150:3300/0 4 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7f47a401b810 con 0x7f47ac074f60 2024-05-09T00:04:13.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.944+0000 7f479b7fe700 1 --2- 172.21.15.81:0/4097280058 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f47940a14c0 0x7f47940a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.944+0000 7f479b7fe700 1 -- 172.21.15.81:0/4097280058 <== mon.2 v2:172.21.15.150:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f47a40ce4c0 con 0x7f47ac074f60 2024-05-09T00:04:13.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.945+0000 7f47bcea8b80 1 Processor -- start 2024-05-09T00:04:13.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.945+0000 7f47bcea8b80 1 -- start start 2024-05-09T00:04:13.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.945+0000 7f47bcea8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ea21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.945+0000 7f47bcea8b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43ea2720 0x562b43e9c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.945+0000 7f47bcea8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43e9c890 0x562b43e9ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.945+0000 7f47bcea8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b43df3150 con 0x562b43e9c890 2024-05-09T00:04:13.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.945+0000 7f47bcea8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b43df0b10 con 0x562b43ea1e00 2024-05-09T00:04:13.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.946+0000 7f47bcea8b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b43dec400 con 0x562b43ea2720 2024-05-09T00:04:13.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.946+0000 7f47aa59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ea21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.946+0000 7f47aad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43e9c890 0x562b43e9ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.946+0000 7f47aa59c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ea21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.81:39662/0 (socket says 172.21.15.81:39662) 2024-05-09T00:04:13.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.946+0000 7f47aa59c700 1 -- 172.21.15.81:0/1266969063 learned_addr learned my addr 172.21.15.81:0/1266969063 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:13.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.946+0000 7f47a9d9b700 1 --2- 172.21.15.81:0/1266969063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43ea2720 0x562b43e9c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.946+0000 7f47aa59c700 1 -- 172.21.15.81:0/1266969063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43ea2720 msgr2=0x562b43e9c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.946+0000 7f47aa59c700 1 --2- 172.21.15.81:0/1266969063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43ea2720 0x562b43e9c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.946+0000 7f47aa59c700 1 -- 172.21.15.81:0/1266969063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43e9c890 msgr2=0x562b43e9ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.946+0000 7f47aa59c700 1 --2- 172.21.15.81:0/1266969063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43e9c890 0x562b43e9ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.946+0000 7f47aa59c700 1 -- 172.21.15.81:0/1266969063 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b43c6d3b0 con 0x562b43ea1e00 2024-05-09T00:04:13.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.946+0000 7f47a9d9b700 1 --2- 172.21.15.81:0/1266969063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43ea2720 0x562b43e9c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:13.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.946+0000 7f47aa59c700 1 --2- 172.21.15.81:0/1266969063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ea21e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f479c009de0 tx=0x7f479c0106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a507dfc13bc92742 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:13.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.947+0000 7f47aa59c700 1 --2- 172.21.15.81:0/4097280058 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f47940a14c0 0x7f47940a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.947+0000 7f4798ff9700 1 -- 172.21.15.81:0/1266969063 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c01e040 con 0x562b43ea1e00 2024-05-09T00:04:13.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.947+0000 7f4798ff9700 1 -- 172.21.15.81:0/1266969063 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f479c010e90 con 0x562b43ea1e00 2024-05-09T00:04:13.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.947+0000 7f4798ff9700 1 -- 172.21.15.81:0/1266969063 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c011a70 con 0x562b43ea1e00 2024-05-09T00:04:13.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.948+0000 7f47bcea8b80 1 -- 172.21.15.81:0/1266969063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 msgr2=0x562b43ea21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.948+0000 7f47aa59c700 1 --2- 172.21.15.81:0/4097280058 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f47940a14c0 0x7f47940a3980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f479c00a010 tx=0x7f479c011cb0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:13.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.948+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/1266969063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ea21e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f479c009de0 tx=0x7f479c0106b0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.948+0000 7f47bcea8b80 1 -- 172.21.15.81:0/1266969063 shutdown_connections 2024-05-09T00:04:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.948+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/1266969063 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ea21e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.948+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/1266969063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43e9c890 0x562b43e9ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.948+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/1266969063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43ea2720 0x562b43e9c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.948+0000 7f47bcea8b80 1 -- 172.21.15.81:0/1266969063 >> 172.21.15.81:0/1266969063 conn(0x562b43dfa210 msgr2=0x562b43e96df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.948+0000 7f47bcea8b80 1 -- 172.21.15.81:0/1266969063 shutdown_connections 2024-05-09T00:04:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.948+0000 7f47bcea8b80 1 -- 172.21.15.81:0/1266969063 wait complete. 2024-05-09T00:04:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.949+0000 7f47bcea8b80 1 -- start start 2024-05-09T00:04:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.949+0000 7f47bcea8b80 1 Processor -- start 2024-05-09T00:04:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.949+0000 7f47bcea8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43e9c890 0x562b43ea8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.949+0000 7f47bcea8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ea5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.949+0000 7f47bcea8b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43ea2720 0x562b43ea6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.949+0000 7f47bcea8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b43d88560 con 0x562b43e9c890 2024-05-09T00:04:13.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.949+0000 7f47bcea8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b43d88200 con 0x562b43ea1e00 2024-05-09T00:04:13.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.949+0000 7f47bcea8b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b43c6f6a0 con 0x562b43ea2720 2024-05-09T00:04:13.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.949+0000 7f47a9d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ea5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.949+0000 7f47a9d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ea5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.81:39670/0 (socket says 172.21.15.81:39670) 2024-05-09T00:04:13.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.950+0000 7f47a9d9b700 1 -- 172.21.15.81:0/603931983 learned_addr learned my addr 172.21.15.81:0/603931983 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:13.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.950+0000 7f47a9d9b700 1 -- 172.21.15.81:0/603931983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43ea2720 msgr2=0x562b43ea6240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:04:13.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.950+0000 7f47a9d9b700 1 --2- 172.21.15.81:0/603931983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43ea2720 0x562b43ea6240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.950+0000 7f47a9d9b700 1 -- 172.21.15.81:0/603931983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43e9c890 msgr2=0x562b43ea8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.950+0000 7f47a9d9b700 1 --2- 172.21.15.81:0/603931983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43e9c890 0x562b43ea8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.951+0000 7f47a9d9b700 1 -- 172.21.15.81:0/603931983 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c009a90 con 0x562b43ea1e00 2024-05-09T00:04:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.951+0000 7f47bcea8b80 10 client.0 _ll_register_callbacks cb 0x562b43d91b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.951+0000 7f47bcea8b80 1 -- 172.21.15.81:0/603931983 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b43d45270 con 0x562b43ea1e00 2024-05-09T00:04:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.951+0000 7f47a9d9b700 1 --2- 172.21.15.81:0/603931983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ea5b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47a000e720 tx=0x7f47a000eae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7713c5c789ee048e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.951+0000 7f4791ffb700 10 client.25304 ms_handle_connect on v2:172.21.15.150:3300/0 2024-05-09T00:04:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.951+0000 7f4791ffb700 1 -- 172.21.15.81:0/603931983 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a000f8f0 con 0x562b43ea1e00 2024-05-09T00:04:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.951+0000 7f4791ffb700 1 -- 172.21.15.81:0/603931983 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f47a000fa50 con 0x562b43ea1e00 2024-05-09T00:04:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.952+0000 7f4791ffb700 1 -- 172.21.15.81:0/603931983 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47a000fc50 con 0x562b43ea1e00 2024-05-09T00:04:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.952+0000 7f47bcea8b80 10 client.25304 fetch_fsmap learned FSMap version 24 2024-05-09T00:04:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.952+0000 7f47bcea8b80 1 -- 172.21.15.81:0/603931983 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({fsmap=24}) v3 -- 0x562b43c19b60 con 0x562b43ea1e00 2024-05-09T00:04:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.952+0000 7f4791ffb700 1 -- 172.21.15.81:0/603931983 <== mon.2 v2:172.21.15.150:3300/0 4 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f47a0017440 con 0x562b43ea1e00 2024-05-09T00:04:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.952+0000 7f47bcea8b80 10 client.25304 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:04:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.952+0000 7f47bcea8b80 10 client.25304 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:13.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.952+0000 7f47bcea8b80 20 client.25304 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:13.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.952+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/603931983 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562b43ec6ef0 0x562b43ec9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.952+0000 7f47bcea8b80 4 client.25304 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:13.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.952+0000 7f47bcea8b80 1 -- 172.21.15.81:0/603931983 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b43e6b810 con 0x562b43ec6ef0 2024-05-09T00:04:13.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.952+0000 7f47aa59c700 1 --2- 172.21.15.81:0/603931983 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562b43ec6ef0 0x562b43ec9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.953+0000 7f4791ffb700 10 client.25304 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:13.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.953+0000 7f47aa59c700 1 --2- 172.21.15.81:0/603931983 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562b43ec6ef0 0x562b43ec9390 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=408ac1eba958d960 server_cookie=126357b62699d11f in_seq=0 out_seq=0 2024-05-09T00:04:13.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f4791ffb700 1 -- 172.21.15.81:0/603931983 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562b43e6b810 con 0x562b43ec6ef0 2024-05-09T00:04:13.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f4791ffb700 10 client.25304 handle_command_reply: tid=0 2024-05-09T00:04:13.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f47bcea8b80 1 client.25304 shutdown 2024-05-09T00:04:13.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f47bcea8b80 1 -- 172.21.15.81:0/603931983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 msgr2=0x562b43ea5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/603931983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ea5b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47a000e720 tx=0x7f47a000eae0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f47bcea8b80 1 -- 172.21.15.81:0/603931983 shutdown_connections 2024-05-09T00:04:13.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/603931983 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562b43ec6ef0 0x562b43ec9390 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/603931983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43ea2720 0x562b43ea6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f4791ffb700 0 client.25304 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/603931983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43e9c890 0x562b43ea8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/603931983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ea5b50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f47bcea8b80 1 -- 172.21.15.81:0/603931983 >> 172.21.15.81:0/603931983 conn(0x562b43dfa210 msgr2=0x562b43e965a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f47bcea8b80 1 -- 172.21.15.81:0/603931983 shutdown_connections 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f47bcea8b80 1 -- 172.21.15.81:0/603931983 wait complete. 2024-05-09T00:04:13.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.954+0000 7f47bcea8b80 20 client.25304 trim_cache size 0 max 16384 2024-05-09T00:04:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.987+0000 7f47bcea8b80 1 Processor -- start 2024-05-09T00:04:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.987+0000 7f47bcea8b80 1 -- start start 2024-05-09T00:04:13.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.987+0000 7f47bcea8b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43e9c890 0x562b43e9c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.987+0000 7f47bcea8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43e96d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.987+0000 7f47bcea8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43ea2720 0x562b43ebe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.987+0000 7f47bcea8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b43e93dc0 con 0x562b43ea2720 2024-05-09T00:04:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.987+0000 7f47bcea8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b43e98640 con 0x562b43ea1e00 2024-05-09T00:04:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.987+0000 7f47bcea8b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b43e91800 con 0x562b43e9c890 2024-05-09T00:04:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.987+0000 7f47aad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43ea2720 0x562b43ebe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.987+0000 7f47a9d9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43e96d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.987+0000 7f47aad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43ea2720 0x562b43ebe140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40346/0 (socket says 172.21.15.81:40346) 2024-05-09T00:04:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.987+0000 7f47aa59c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43e9c890 0x562b43e9c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.987+0000 7f47aad9d700 1 -- 172.21.15.81:0/2238852876 learned_addr learned my addr 172.21.15.81:0/2238852876 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.988+0000 7f47a9d9b700 1 -- 172.21.15.81:0/2238852876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43e9c890 msgr2=0x562b43e9c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.988+0000 7f47a9d9b700 1 --2- 172.21.15.81:0/2238852876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43e9c890 0x562b43e9c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.988+0000 7f47a9d9b700 1 -- 172.21.15.81:0/2238852876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43ea2720 msgr2=0x562b43ebe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.988+0000 7f47a9d9b700 1 --2- 172.21.15.81:0/2238852876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43ea2720 0x562b43ebe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.988+0000 7f47a9d9b700 1 -- 172.21.15.81:0/2238852876 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b43e9cf40 con 0x562b43ea1e00 2024-05-09T00:04:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.988+0000 7f47aa59c700 1 --2- 172.21.15.81:0/2238852876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43e9c890 0x562b43e9c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:04:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.988+0000 7f47a9d9b700 1 --2- 172.21.15.81:0/2238852876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43e96d20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f47a0001eb0 tx=0x7f47a0011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2af3d83d32518a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.988+0000 7f47997fa700 1 -- 172.21.15.81:0/2238852876 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0017be0 con 0x562b43ea1e00 2024-05-09T00:04:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.988+0000 7f47997fa700 1 -- 172.21.15.81:0/2238852876 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562b43d45270 con 0x562b43ea1e00 2024-05-09T00:04:13.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.988+0000 7f47997fa700 1 -- 172.21.15.81:0/2238852876 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0004c70 con 0x562b43ea1e00 2024-05-09T00:04:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.989+0000 7f47bcea8b80 1 -- 172.21.15.81:0/2238852876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 msgr2=0x562b43e96d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.989+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/2238852876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43e96d20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f47a0001eb0 tx=0x7f47a0011000 comp rx=0 tx=0).stop 2024-05-09T00:04:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.989+0000 7f47bcea8b80 1 -- 172.21.15.81:0/2238852876 shutdown_connections 2024-05-09T00:04:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.989+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/2238852876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43ea2720 0x562b43ebe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.989+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/2238852876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43e9c890 0x562b43e9c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.989+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/2238852876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43e96d20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.989+0000 7f47bcea8b80 1 -- 172.21.15.81:0/2238852876 >> 172.21.15.81:0/2238852876 conn(0x562b43dfa210 msgr2=0x562b43ec2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.989+0000 7f47bcea8b80 1 -- 172.21.15.81:0/2238852876 shutdown_connections 2024-05-09T00:04:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.989+0000 7f47bcea8b80 1 -- 172.21.15.81:0/2238852876 wait complete. 2024-05-09T00:04:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.990+0000 7f47bcea8b80 1 -- start start 2024-05-09T00:04:13.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.990+0000 7f47bcea8b80 1 Processor -- start 2024-05-09T00:04:13.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.990+0000 7f47bcea8b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43e9c890 0x562b43ebe430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.990+0000 7f47bcea8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ebc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.990+0000 7f47bcea8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43ea2720 0x562b43ebce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.990+0000 7f47bcea8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b43ebd4f0 con 0x562b43ea2720 2024-05-09T00:04:13.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.990+0000 7f47bcea8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b43ebd660 con 0x562b43ea1e00 2024-05-09T00:04:13.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.990+0000 7f47bcea8b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b43f1d4c0 con 0x562b43e9c890 2024-05-09T00:04:13.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.990+0000 7f47bcea8b80 10 client.0 _ll_register_callbacks cb 0x7f47a000cbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:13.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.990+0000 7f47aad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43ea2720 0x562b43ebce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f47aad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43ea2720 0x562b43ebce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40352/0 (socket says 172.21.15.81:40352) 2024-05-09T00:04:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f47aad9d700 1 -- 172.21.15.81:0/871015579 learned_addr learned my addr 172.21.15.81:0/871015579 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f47aa59c700 1 --2- 172.21.15.81:0/871015579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43e9c890 0x562b43ebe430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f47a9d9b700 1 --2- 172.21.15.81:0/871015579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ebc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f47aad9d700 1 -- 172.21.15.81:0/871015579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43e9c890 msgr2=0x562b43ebe430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f47aad9d700 1 --2- 172.21.15.81:0/871015579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43e9c890 0x562b43ebe430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f47aad9d700 1 -- 172.21.15.81:0/871015579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 msgr2=0x562b43ebc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f47aad9d700 1 --2- 172.21.15.81:0/871015579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ebc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f47aad9d700 1 -- 172.21.15.81:0/871015579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c02c040 con 0x562b43ea2720 2024-05-09T00:04:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f47aa59c700 1 --2- 172.21.15.81:0/871015579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43e9c890 0x562b43ebe430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f47aad9d700 1 --2- 172.21.15.81:0/871015579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43ea2720 0x562b43ebce10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009fd0 tx=0x7f47a409af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14493791d49a1caa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f4791ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f4791ffb700 1 -- 172.21.15.81:0/871015579 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a401cea0 con 0x562b43ea2720 2024-05-09T00:04:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f47bcea8b80 1 -- 172.21.15.81:0/871015579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f479c010e90 con 0x562b43ea2720 2024-05-09T00:04:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.991+0000 7f4791ffb700 1 -- 172.21.15.81:0/871015579 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f47a409ba40 con 0x562b43ea2720 2024-05-09T00:04:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.992+0000 7f4791ffb700 1 -- 172.21.15.81:0/871015579 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47a409b340 con 0x562b43ea2720 2024-05-09T00:04:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.992+0000 7f47bcea8b80 10 client.15807 fetch_fsmap learned FSMap version 24 2024-05-09T00:04:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.992+0000 7f47bcea8b80 1 -- 172.21.15.81:0/871015579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x562b43c19b60 con 0x562b43ea2720 2024-05-09T00:04:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.992+0000 7f4791ffb700 1 -- 172.21.15.81:0/871015579 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f479c010e90 con 0x562b43ea2720 2024-05-09T00:04:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.993+0000 7f4791ffb700 1 -- 172.21.15.81:0/871015579 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f47a4097130 con 0x562b43ea2720 2024-05-09T00:04:13.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.993+0000 7f47bcea8b80 10 client.15807 fetch_fsmap finished waiting for FSMap version 24 2024-05-09T00:04:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.993+0000 7f47bcea8b80 10 client.15807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.993+0000 7f47bcea8b80 20 client.15807 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.993+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/871015579 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562b43f1e9c0 0x562b43f20db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.993+0000 7f47bcea8b80 4 client.15807 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:04:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.993+0000 7f47bcea8b80 1 -- 172.21.15.81:0/871015579 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562b43de4ec0 con 0x562b43f1e9c0 2024-05-09T00:04:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.993+0000 7f47aa59c700 1 --2- 172.21.15.81:0/871015579 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562b43f1e9c0 0x562b43f20db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f4791ffb700 10 client.15807 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f47aa59c700 1 --2- 172.21.15.81:0/871015579 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562b43f1e9c0 0x562b43f20db0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=693e8fc6efaa18b9 server_cookie=467e5c5509c77e7a in_seq=0 out_seq=0 2024-05-09T00:04:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f4791ffb700 1 -- 172.21.15.81:0/871015579 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562b43de4ec0 con 0x562b43f1e9c0 2024-05-09T00:04:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f4791ffb700 10 client.15807 handle_command_reply: tid=0 2024-05-09T00:04:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f47bcea8b80 1 client.15807 shutdown 2024-05-09T00:04:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f47bcea8b80 1 -- 172.21.15.81:0/871015579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43ea2720 msgr2=0x562b43ebce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/871015579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43ea2720 0x562b43ebce10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009fd0 tx=0x7f47a409af50 comp rx=0 tx=0).stop 2024-05-09T00:04:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f47bcea8b80 1 -- 172.21.15.81:0/871015579 shutdown_connections 2024-05-09T00:04:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/871015579 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562b43f1e9c0 0x562b43f20db0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/871015579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562b43ea2720 0x562b43ebce10 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f4791ffb700 0 client.15807 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/871015579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562b43e9c890 0x562b43ebe430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f47bcea8b80 1 --2- 172.21.15.81:0/871015579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562b43ea1e00 0x562b43ebc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f47bcea8b80 1 -- 172.21.15.81:0/871015579 >> 172.21.15.81:0/871015579 conn(0x562b43dfa210 msgr2=0x562b43ea43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f47bcea8b80 1 -- 172.21.15.81:0/871015579 shutdown_connections 2024-05-09T00:04:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f47bcea8b80 1 -- 172.21.15.81:0/871015579 wait complete. 2024-05-09T00:04:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.994+0000 7f47bcea8b80 20 client.15807 trim_cache size 0 max 16384 2024-05-09T00:04:13.995 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:04:13.996 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:04:13.996 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:04:13.996 INFO:teuthology.orchestra.run.smithi081.stdout: "8d3ccb97-b7ed-4a2c-9c29-a4e967aa132a": { 2024-05-09T00:04:13.996 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:04:13.996 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "8d3ccb97-b7ed-4a2c-9c29-a4e967aa132a", 2024-05-09T00:04:13.996 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:04:13.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:04:13.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:04:13.996 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:04:13.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.995+0000 7f47b0cee700 1 -- 172.21.15.81:0/4097280058 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f47940a14c0 msgr2=0x7f47940a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.995+0000 7f47b0cee700 1 --2- 172.21.15.81:0/4097280058 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f47940a14c0 0x7f47940a3980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f479c00a010 tx=0x7f479c011cb0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.995+0000 7f47b0cee700 1 -- 172.21.15.81:0/4097280058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47ac074f60 msgr2=0x7f47ac073d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:13.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.995+0000 7f47b0cee700 1 --2- 172.21.15.81:0/4097280058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47ac074f60 0x7f47ac073d60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f47a4006130 tx=0x7f47a4007da0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.995+0000 7f47b0cee700 1 -- 172.21.15.81:0/4097280058 shutdown_connections 2024-05-09T00:04:13.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.995+0000 7f47b0cee700 1 --2- 172.21.15.81:0/4097280058 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f47940a14c0 0x7f47940a3980 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.995+0000 7f47b0cee700 1 --2- 172.21.15.81:0/4097280058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f47ac074f60 0x7f47ac073d60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.995+0000 7f47b0cee700 1 --2- 172.21.15.81:0/4097280058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f47ac101160 0x7f47ac0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.995+0000 7f47b0cee700 1 --2- 172.21.15.81:0/4097280058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f47ac106280 0x7f47ac0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:13.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.995+0000 7f47b0cee700 1 -- 172.21.15.81:0/4097280058 >> 172.21.15.81:0/4097280058 conn(0x7f47ac0fc9e0 msgr2=0x7f47ac0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:13.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.995+0000 7f47b0cee700 1 -- 172.21.15.81:0/4097280058 shutdown_connections 2024-05-09T00:04:13.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:13.995+0000 7f47b0cee700 1 -- 172.21.15.81:0/4097280058 wait complete. 2024-05-09T00:04:14.005 INFO:tasks.cephfs.filesystem:scrub status for tag:8d3ccb97-b7ed-4a2c-9c29-a4e967aa132a - {'path': '/', 'tag': '8d3ccb97-b7ed-4a2c-9c29-a4e967aa132a', 'options': 'recursive,force'} 2024-05-09T00:04:14.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:14 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:04:14.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:14 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:04:14.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:14 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:04:14.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:14 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:04:14.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:14 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:04:14.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:14 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:04:14.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:14 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:04:14.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:14 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:04:14.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:14 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:04:14.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:14 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:04:15.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:14 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:04:15.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:14 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:04:15.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:14 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:04:15.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:14 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:04:15.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:14 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:04:15.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:15 smithi171 ceph-mon[47351]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-09T00:04:15.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:15 smithi081 ceph-mon[42474]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-09T00:04:16.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:15 smithi150 ceph-mon[46187]: pgmap v41: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-09T00:04:16.059 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:15 smithi171 systemd[1]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.c.service: Service RestartSec=10s expired, scheduling restart. 2024-05-09T00:04:16.059 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:15 smithi171 systemd[1]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.c.service: Scheduled restart job, restart counter is at 1. 2024-05-09T00:04:16.059 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:15 smithi171 systemd[1]: Stopped Ceph mds.c for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:04:16.059 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:15 smithi171 systemd[1]: Starting Ceph mds.c for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:04:16.541 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:16 smithi171 ceph-mds[87483]: -- 172.21.15.171:0/1987177370 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5564c0a0c1a0 con 0x5564c09e3000 2024-05-09T00:04:16.541 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:16 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[87460]: starting mds.c at 2024-05-09T00:04:16.541 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:16 smithi171 bash[87446]: dc5f980fe32d0f132b4dedce9b46df3bcb67aa6f1c9c39bfbeaa0907a34b8f21 2024-05-09T00:04:16.541 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:04:16 smithi171 systemd[1]: Started Ceph mds.c for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:04:16.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:16 smithi171 ceph-mon[47351]: daemon mds.c restarted 2024-05-09T00:04:16.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:16 smithi171 ceph-mon[47351]: osdmap e83: 12 total, 12 up, 12 in 2024-05-09T00:04:16.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:16 smithi081 ceph-mon[42474]: daemon mds.c restarted 2024-05-09T00:04:16.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:16 smithi081 ceph-mon[42474]: osdmap e83: 12 total, 12 up, 12 in 2024-05-09T00:04:17.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:16 smithi150 ceph-mon[46187]: daemon mds.c restarted 2024-05-09T00:04:17.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:16 smithi150 ceph-mon[46187]: osdmap e83: 12 total, 12 up, 12 in 2024-05-09T00:04:17.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.644+0000 7f800c4a4700 1 -- 172.21.15.81:0/1234170287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8004104de0 msgr2=0x7f80041051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.644+0000 7f800c4a4700 1 --2- 172.21.15.81:0/1234170287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8004104de0 0x7f80041051c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f80000099c0 tx=0x7f8000009cd0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.644+0000 7f800c4a4700 1 -- 172.21.15.81:0/1234170287 shutdown_connections 2024-05-09T00:04:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.644+0000 7f800c4a4700 1 --2- 172.21.15.81:0/1234170287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8004100a40 0x7f800410cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.644+0000 7f800c4a4700 1 --2- 172.21.15.81:0/1234170287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8004104de0 0x7f80041051c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.644+0000 7f800c4a4700 1 --2- 172.21.15.81:0/1234170287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8004100080 0x7f8004100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.644+0000 7f800c4a4700 1 -- 172.21.15.81:0/1234170287 >> 172.21.15.81:0/1234170287 conn(0x7f8004076c10 msgr2=0x7f8004077020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.645+0000 7f800c4a4700 1 -- 172.21.15.81:0/1234170287 shutdown_connections 2024-05-09T00:04:17.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.645+0000 7f800c4a4700 1 -- 172.21.15.81:0/1234170287 wait complete. 2024-05-09T00:04:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.645+0000 7f800c4a4700 1 Processor -- start 2024-05-09T00:04:17.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.645+0000 7f800c4a4700 1 -- start start 2024-05-09T00:04:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800c4a4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8004100080 0x7f8004195f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800c4a4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8004100a40 0x7f80041964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800c4a4700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8004104de0 0x7f800419afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800c4a4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8004196cf0 con 0x7f8004100080 2024-05-09T00:04:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800c4a4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800419b510 con 0x7f8004100a40 2024-05-09T00:04:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800c4a4700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800419b6d0 con 0x7f8004104de0 2024-05-09T00:04:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800a240700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8004100080 0x7f8004195f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800a240700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8004100080 0x7f8004195f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43876/0 (socket says 172.21.15.81:43876) 2024-05-09T00:04:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800a240700 1 -- 172.21.15.81:0/2330783537 learned_addr learned my addr 172.21.15.81:0/2330783537 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800a240700 1 -- 172.21.15.81:0/2330783537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8004104de0 msgr2=0x7f800419afd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-09T00:04:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800a240700 1 --2- 172.21.15.81:0/2330783537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8004104de0 0x7f800419afd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800a240700 1 -- 172.21.15.81:0/2330783537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8004100a40 msgr2=0x7f80041964c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:04:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800a240700 1 --2- 172.21.15.81:0/2330783537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8004100a40 0x7f80041964c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800a240700 1 -- 172.21.15.81:0/2330783537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80000095f0 con 0x7f8004100080 2024-05-09T00:04:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.646+0000 7f800a240700 1 --2- 172.21.15.81:0/2330783537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8004100080 0x7f8004195f80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f800000b580 tx=0x7f8000005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.647+0000 7f7ffb7fe700 1 -- 172.21.15.81:0/2330783537 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800001d070 con 0x7f8004100080 2024-05-09T00:04:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.647+0000 7f7ffb7fe700 1 -- 172.21.15.81:0/2330783537 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f800000fcf0 con 0x7f8004100080 2024-05-09T00:04:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.647+0000 7f7ffb7fe700 1 -- 172.21.15.81:0/2330783537 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8000022d50 con 0x7f8004100080 2024-05-09T00:04:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.647+0000 7f800c4a4700 1 -- 172.21.15.81:0/2330783537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800419b950 con 0x7f8004100080 2024-05-09T00:04:17.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.647+0000 7f800c4a4700 1 -- 172.21.15.81:0/2330783537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800419bdb0 con 0x7f8004100080 2024-05-09T00:04:17.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.651+0000 7f7ffb7fe700 1 -- 172.21.15.81:0/2330783537 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7f8000022470 con 0x7f8004100080 2024-05-09T00:04:17.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.651+0000 7f7ffb7fe700 1 --2- 172.21.15.81:0/2330783537 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7ff00a14c0 0x7f7ff00a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.652+0000 7f7ffb7fe700 1 -- 172.21.15.81:0/2330783537 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f80000ce530 con 0x7f8004100080 2024-05-09T00:04:17.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.652+0000 7f8009a3f700 1 --2- 172.21.15.81:0/2330783537 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7ff00a14c0 0x7f7ff00a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:17.647 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.653+0000 7f801865eb80 1 Processor -- start 2024-05-09T00:04:17.647 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.654+0000 7f801865eb80 1 -- start start 2024-05-09T00:04:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.654+0000 7f801865eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf0950 0x559a49bf0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.654+0000 7f801865eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49bf1270 0x559a49beaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.654+0000 7f801865eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49beb480 0x559a49beb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.654+0000 7f801865eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a49b420f0 con 0x559a49bf1270 2024-05-09T00:04:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.654+0000 7f801865eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a49b3fab0 con 0x559a49beb480 2024-05-09T00:04:17.648 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.654+0000 7f801865eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a49b3b3a0 con 0x559a49bf0950 2024-05-09T00:04:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.654+0000 7f800a240700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf0950 0x559a49bf0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:17.649 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.655+0000 7f800a240700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf0950 0x559a49bf0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:60650/0 (socket says 172.21.15.81:60650) 2024-05-09T00:04:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.655+0000 7f800a240700 1 -- 172.21.15.81:0/3243513209 learned_addr learned my addr 172.21.15.81:0/3243513209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.655+0000 7f800a240700 1 -- 172.21.15.81:0/3243513209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49beb480 msgr2=0x559a49beb8a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:04:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.655+0000 7f800a240700 1 --2- 172.21.15.81:0/3243513209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49beb480 0x559a49beb8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.655+0000 7f800a240700 1 -- 172.21.15.81:0/3243513209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49bf1270 msgr2=0x559a49beaf40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:04:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.655+0000 7f800a240700 1 --2- 172.21.15.81:0/3243513209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49bf1270 0x559a49beaf40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.655+0000 7f800a240700 1 -- 172.21.15.81:0/3243513209 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a499bc350 con 0x559a49bf0950 2024-05-09T00:04:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.655+0000 7f800a240700 1 --2- 172.21.15.81:0/3243513209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf0950 0x559a49bf0d30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f800000ffd0 tx=0x7f8000009cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=794ce5ab69c2eabe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.655+0000 7f8009a3f700 1 --2- 172.21.15.81:0/2330783537 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7ff00a14c0 0x7f7ff00a3980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x559a49be6790 tx=0x7f7ff400b3f0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.655+0000 7f7ff8da4700 1 -- 172.21.15.81:0/3243513209 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800009ad10 con 0x559a49bf0950 2024-05-09T00:04:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.655+0000 7f7ff8da4700 1 -- 172.21.15.81:0/3243513209 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f800009bab0 con 0x559a49bf0950 2024-05-09T00:04:17.650 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.655+0000 7f7ff8da4700 1 -- 172.21.15.81:0/3243513209 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80000a3310 con 0x559a49bf0950 2024-05-09T00:04:17.651 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.656+0000 7f801865eb80 1 -- 172.21.15.81:0/3243513209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf0950 msgr2=0x559a49bf0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:17.651 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.656+0000 7f801865eb80 1 --2- 172.21.15.81:0/3243513209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf0950 0x559a49bf0d30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f800000ffd0 tx=0x7f8000009cd0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.651 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.656+0000 7f801865eb80 1 -- 172.21.15.81:0/3243513209 shutdown_connections 2024-05-09T00:04:17.652 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.657+0000 7f801865eb80 1 --2- 172.21.15.81:0/3243513209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49beb480 0x559a49beb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.652 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.657+0000 7f801865eb80 1 --2- 172.21.15.81:0/3243513209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf0950 0x559a49bf0d30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.652 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.657+0000 7f801865eb80 1 --2- 172.21.15.81:0/3243513209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49bf1270 0x559a49beaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.652 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.657+0000 7f801865eb80 1 -- 172.21.15.81:0/3243513209 >> 172.21.15.81:0/3243513209 conn(0x559a49b491b0 msgr2=0x559a49be5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:17.652 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.657+0000 7f801865eb80 1 -- 172.21.15.81:0/3243513209 shutdown_connections 2024-05-09T00:04:17.652 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.657+0000 7f801865eb80 1 -- 172.21.15.81:0/3243513209 wait complete. 2024-05-09T00:04:17.652 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.657+0000 7f801865eb80 1 -- start start 2024-05-09T00:04:17.652 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.657+0000 7f801865eb80 1 Processor -- start 2024-05-09T00:04:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.658+0000 7f801865eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49beb480 0x559a49bf71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.658+0000 7f801865eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49bf0950 0x559a49bf4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.658+0000 7f801865eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49bf1270 0x559a49bf4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.658+0000 7f801865eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a49ad7500 con 0x559a49bf1270 2024-05-09T00:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.658+0000 7f801865eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a49ad71a0 con 0x559a49bf0950 2024-05-09T00:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.658+0000 7f801865eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a499be640 con 0x559a49beb480 2024-05-09T00:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.658+0000 7f801865eb80 10 client.0 _ll_register_callbacks cb 0x559a49ae0ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.658+0000 7f800a240700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49beb480 0x559a49bf71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.658+0000 7f800a240700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49beb480 0x559a49bf71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:60654/0 (socket says 172.21.15.81:60654) 2024-05-09T00:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.658+0000 7f800a240700 1 -- 172.21.15.81:0/4031473817 learned_addr learned my addr 172.21.15.81:0/4031473817 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.658+0000 7f800a240700 1 -- 172.21.15.81:0/4031473817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49bf0950 msgr2=0x559a49bf4490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.658+0000 7f800a240700 1 --2- 172.21.15.81:0/4031473817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49bf0950 0x559a49bf4490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.658+0000 7f800a240700 1 -- 172.21.15.81:0/4031473817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49bf1270 msgr2=0x559a49bf4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.658+0000 7f800a240700 1 --2- 172.21.15.81:0/4031473817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49bf1270 0x559a49bf4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.659+0000 7f800a240700 1 -- 172.21.15.81:0/4031473817 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800419bdb0 con 0x559a49beb480 2024-05-09T00:04:17.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.659+0000 7f800a240700 1 --2- 172.21.15.81:0/4031473817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49beb480 0x559a49bf71a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8000000c00 tx=0x7f800009ac00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44ced1d1b92a772 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.659+0000 7f7fedffb700 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-05-09T00:04:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.659+0000 7f7fedffb700 1 -- 172.21.15.81:0/4031473817 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800009ad10 con 0x559a49beb480 2024-05-09T00:04:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.659+0000 7f801865eb80 1 -- 172.21.15.81:0/4031473817 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a49a94210 con 0x559a49beb480 2024-05-09T00:04:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.659+0000 7f7fedffb700 1 -- 172.21.15.81:0/4031473817 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f800009f1e0 con 0x559a49beb480 2024-05-09T00:04:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.659+0000 7f7fedffb700 1 -- 172.21.15.81:0/4031473817 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80000a3520 con 0x559a49beb480 2024-05-09T00:04:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.659+0000 7f801865eb80 10 client.25351 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.659+0000 7f801865eb80 1 -- 172.21.15.81:0/4031473817 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559a49968b00 con 0x559a49beb480 2024-05-09T00:04:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.659+0000 7f7fedffb700 1 -- 172.21.15.81:0/4031473817 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559a49a94210 con 0x559a49beb480 2024-05-09T00:04:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.659+0000 7f7fedffb700 1 -- 172.21.15.81:0/4031473817 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f80000a1310 con 0x559a49beb480 2024-05-09T00:04:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.660+0000 7f801865eb80 10 client.25351 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.660+0000 7f801865eb80 10 client.25351 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.660+0000 7f801865eb80 20 client.25351 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:17.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.660+0000 7f801865eb80 1 --2- 172.21.15.81:0/4031473817 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559a49c15420 0x559a49c17840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.660+0000 7f801865eb80 4 client.25351 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:17.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.660+0000 7f801865eb80 1 -- 172.21.15.81:0/4031473817 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a49bba7b0 con 0x559a49c15420 2024-05-09T00:04:17.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.660+0000 7f8009a3f700 1 --2- 172.21.15.81:0/4031473817 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559a49c15420 0x559a49c17840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:17.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.660+0000 7f7fedffb700 10 client.25351 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:17.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.660+0000 7f8009a3f700 1 --2- 172.21.15.81:0/4031473817 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559a49c15420 0x559a49c17840 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68e5cab8e92af852 server_cookie=fe9ba6d23f5fc7a6 in_seq=0 out_seq=0 2024-05-09T00:04:17.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.661+0000 7f7fedffb700 1 -- 172.21.15.81:0/4031473817 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559a49bba7b0 con 0x559a49c15420 2024-05-09T00:04:17.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.661+0000 7f7fedffb700 10 client.25351 handle_command_reply: tid=0 2024-05-09T00:04:17.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.661+0000 7f801865eb80 1 client.25351 shutdown 2024-05-09T00:04:17.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.661+0000 7f801865eb80 1 -- 172.21.15.81:0/4031473817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49beb480 msgr2=0x559a49bf71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:17.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.661+0000 7f801865eb80 1 --2- 172.21.15.81:0/4031473817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49beb480 0x559a49bf71a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8000000c00 tx=0x7f800009ac00 comp rx=0 tx=0).stop 2024-05-09T00:04:17.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.661+0000 7f801865eb80 1 -- 172.21.15.81:0/4031473817 shutdown_connections 2024-05-09T00:04:17.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.661+0000 7f801865eb80 1 --2- 172.21.15.81:0/4031473817 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559a49c15420 0x559a49c17840 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.661+0000 7f801865eb80 1 --2- 172.21.15.81:0/4031473817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49bf1270 0x559a49bf4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.661+0000 7f801865eb80 1 --2- 172.21.15.81:0/4031473817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49beb480 0x559a49bf71a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.661+0000 7f801865eb80 1 --2- 172.21.15.81:0/4031473817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49bf0950 0x559a49bf4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.661+0000 7f801865eb80 1 -- 172.21.15.81:0/4031473817 >> 172.21.15.81:0/4031473817 conn(0x559a49b491b0 msgr2=0x559a49be9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:17.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.661+0000 7f7fedffb700 0 client.25351 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:17.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.661+0000 7f801865eb80 1 -- 172.21.15.81:0/4031473817 shutdown_connections 2024-05-09T00:04:17.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.661+0000 7f801865eb80 1 -- 172.21.15.81:0/4031473817 wait complete. 2024-05-09T00:04:17.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.662+0000 7f801865eb80 20 client.25351 trim_cache size 0 max 16384 2024-05-09T00:04:17.684 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.690+0000 7f801865eb80 1 Processor -- start 2024-05-09T00:04:17.684 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.690+0000 7f801865eb80 1 -- start start 2024-05-09T00:04:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.690+0000 7f801865eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49beb480 0x559a49bf4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.690+0000 7f801865eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49bf0950 0x559a49be5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.690+0000 7f801865eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf1270 0x559a49beb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.690+0000 7f801865eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a49be65f0 con 0x559a49beb480 2024-05-09T00:04:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.690+0000 7f801865eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a49bebda0 con 0x559a49bf0950 2024-05-09T00:04:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.690+0000 7f801865eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a49bf5400 con 0x559a49bf1270 2024-05-09T00:04:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.690+0000 7f800aa41700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf1270 0x559a49beb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.690+0000 7f800aa41700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf1270 0x559a49beb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:60656/0 (socket says 172.21.15.81:60656) 2024-05-09T00:04:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.690+0000 7f800aa41700 1 -- 172.21.15.81:0/691797767 learned_addr learned my addr 172.21.15.81:0/691797767 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.691+0000 7f800a240700 1 --2- 172.21.15.81:0/691797767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49beb480 0x559a49bf4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.691+0000 7f800aa41700 1 -- 172.21.15.81:0/691797767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49bf0950 msgr2=0x559a49be5910 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:04:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.691+0000 7f800aa41700 1 --2- 172.21.15.81:0/691797767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49bf0950 0x559a49be5910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.691+0000 7f800aa41700 1 -- 172.21.15.81:0/691797767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49beb480 msgr2=0x559a49bf4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:17.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.691+0000 7f800aa41700 1 --2- 172.21.15.81:0/691797767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49beb480 0x559a49bf4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.691+0000 7f800aa41700 1 -- 172.21.15.81:0/691797767 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a49b01500 con 0x559a49bf1270 2024-05-09T00:04:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.691+0000 7f800aa41700 1 --2- 172.21.15.81:0/691797767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf1270 0x559a49beb860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc008e90 tx=0x7f7ffc00d3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67c89a5a26fa5eb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.691+0000 7f7ff95a5700 1 -- 172.21.15.81:0/691797767 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00dcf0 con 0x559a49bf1270 2024-05-09T00:04:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.691+0000 7f7ff95a5700 1 -- 172.21.15.81:0/691797767 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ffc00de50 con 0x559a49bf1270 2024-05-09T00:04:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.691+0000 7f7ff95a5700 1 -- 172.21.15.81:0/691797767 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc012740 con 0x559a49bf1270 2024-05-09T00:04:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.692+0000 7f801865eb80 1 -- 172.21.15.81:0/691797767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf1270 msgr2=0x559a49beb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.692+0000 7f801865eb80 1 --2- 172.21.15.81:0/691797767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf1270 0x559a49beb860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc008e90 tx=0x7f7ffc00d3c0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.692+0000 7f801865eb80 1 -- 172.21.15.81:0/691797767 shutdown_connections 2024-05-09T00:04:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.692+0000 7f801865eb80 1 --2- 172.21.15.81:0/691797767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf1270 0x559a49beb860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.692+0000 7f801865eb80 1 --2- 172.21.15.81:0/691797767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49beb480 0x559a49bf4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.692+0000 7f801865eb80 1 --2- 172.21.15.81:0/691797767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49bf0950 0x559a49be5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.692+0000 7f801865eb80 1 -- 172.21.15.81:0/691797767 >> 172.21.15.81:0/691797767 conn(0x559a49b491b0 msgr2=0x559a49be9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.692+0000 7f801865eb80 1 -- 172.21.15.81:0/691797767 shutdown_connections 2024-05-09T00:04:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.692+0000 7f801865eb80 1 -- 172.21.15.81:0/691797767 wait complete. 2024-05-09T00:04:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.693+0000 7f801865eb80 1 -- start start 2024-05-09T00:04:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.693+0000 7f801865eb80 1 Processor -- start 2024-05-09T00:04:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.693+0000 7f801865eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49beb480 0x559a49bfb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.693+0000 7f801865eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf0950 0x559a49bfbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.693+0000 7f801865eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49bf1270 0x559a49bf9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.693+0000 7f801865eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a49bf4e70 con 0x559a49bf1270 2024-05-09T00:04:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.693+0000 7f801865eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a49bf9d60 con 0x559a49beb480 2024-05-09T00:04:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.693+0000 7f801865eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a49bf9ed0 con 0x559a49bf0950 2024-05-09T00:04:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.693+0000 7f801865eb80 10 client.0 _ll_register_callbacks cb 0x559a49ae0ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:17.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.693+0000 7f8009a3f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf0950 0x559a49bfbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.693+0000 7f800aa41700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49bf1270 0x559a49bf9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.693+0000 7f8009a3f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf0950 0x559a49bfbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:60672/0 (socket says 172.21.15.81:60672) 2024-05-09T00:04:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.694+0000 7f8009a3f700 1 -- 172.21.15.81:0/4020592349 learned_addr learned my addr 172.21.15.81:0/4020592349 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.694+0000 7f800a240700 1 --2- 172.21.15.81:0/4020592349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49beb480 0x559a49bfb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.694+0000 7f800aa41700 1 -- 172.21.15.81:0/4020592349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf0950 msgr2=0x559a49bfbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.694+0000 7f800aa41700 1 --2- 172.21.15.81:0/4020592349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf0950 0x559a49bfbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.694+0000 7f800aa41700 1 -- 172.21.15.81:0/4020592349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49beb480 msgr2=0x559a49bfb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.694+0000 7f800aa41700 1 --2- 172.21.15.81:0/4020592349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49beb480 0x559a49bfb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.694+0000 7f800aa41700 1 -- 172.21.15.81:0/4020592349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ffc008b40 con 0x559a49bf1270 2024-05-09T00:04:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.694+0000 7f8009a3f700 1 --2- 172.21.15.81:0/4020592349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf0950 0x559a49bfbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:04:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.694+0000 7f800a240700 1 --2- 172.21.15.81:0/4020592349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49beb480 0x559a49bfb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:04:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.694+0000 7f800aa41700 1 --2- 172.21.15.81:0/4020592349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49bf1270 0x559a49bf9820 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc013ba0 tx=0x7f7ffc00dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0fcdcba8e4b4a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:17.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.694+0000 7f7fedffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.694+0000 7f7fedffb700 1 -- 172.21.15.81:0/4020592349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc003e90 con 0x559a49bf1270 2024-05-09T00:04:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.694+0000 7f7fedffb700 1 -- 172.21.15.81:0/4020592349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f7ffc013420 con 0x559a49bf1270 2024-05-09T00:04:17.692 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.694+0000 7f801865eb80 1 -- 172.21.15.81:0/4020592349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f800009bab0 con 0x559a49bf1270 2024-05-09T00:04:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.695+0000 7f7fedffb700 1 -- 172.21.15.81:0/4020592349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ffc0135e0 con 0x559a49bf1270 2024-05-09T00:04:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.695+0000 7f801865eb80 10 client.15825 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.695+0000 7f801865eb80 1 -- 172.21.15.81:0/4020592349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559a499c0c70 con 0x559a49bf1270 2024-05-09T00:04:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.695+0000 7f7fedffb700 1 -- 172.21.15.81:0/4020592349 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f800009bab0 con 0x559a49bf1270 2024-05-09T00:04:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.695+0000 7f7fedffb700 1 -- 172.21.15.81:0/4020592349 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7ffc025440 con 0x559a49bf1270 2024-05-09T00:04:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.695+0000 7f801865eb80 10 client.15825 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.695+0000 7f801865eb80 10 client.15825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.695+0000 7f801865eb80 20 client.15825 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.695+0000 7f801865eb80 1 --2- 172.21.15.81:0/4020592349 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559a49c6b650 0x559a49c6da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.695+0000 7f801865eb80 4 client.15825 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:04:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.695+0000 7f801865eb80 1 -- 172.21.15.81:0/4020592349 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559a49b33e60 con 0x559a49c6b650 2024-05-09T00:04:17.693 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.696+0000 7f800a240700 1 --2- 172.21.15.81:0/4020592349 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559a49c6b650 0x559a49c6da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.696+0000 7f7fedffb700 10 client.15825 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.696+0000 7f800a240700 1 --2- 172.21.15.81:0/4020592349 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559a49c6b650 0x559a49c6da70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8225829e50b0ecb6 server_cookie=6ad3a491ae65bc61 in_seq=0 out_seq=0 2024-05-09T00:04:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.700+0000 7f7fedffb700 1 -- 172.21.15.81:0/4020592349 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559a49b33e60 con 0x559a49c6b650 2024-05-09T00:04:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.700+0000 7f7fedffb700 10 client.15825 handle_command_reply: tid=0 2024-05-09T00:04:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.700+0000 7f801865eb80 1 client.15825 shutdown 2024-05-09T00:04:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.701+0000 7f801865eb80 1 -- 172.21.15.81:0/4020592349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49bf1270 msgr2=0x559a49bf9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.701+0000 7f801865eb80 1 --2- 172.21.15.81:0/4020592349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49bf1270 0x559a49bf9820 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc013ba0 tx=0x7f7ffc00dd20 comp rx=0 tx=0).stop 2024-05-09T00:04:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.701+0000 7f801865eb80 1 -- 172.21.15.81:0/4020592349 shutdown_connections 2024-05-09T00:04:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.701+0000 7f801865eb80 1 --2- 172.21.15.81:0/4020592349 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559a49c6b650 0x559a49c6da70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.701+0000 7f801865eb80 1 --2- 172.21.15.81:0/4020592349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559a49beb480 0x559a49bfb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.701+0000 7f801865eb80 1 --2- 172.21.15.81:0/4020592349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559a49bf1270 0x559a49bf9820 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.701+0000 7f7fedffb700 0 client.15825 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.701+0000 7f801865eb80 1 --2- 172.21.15.81:0/4020592349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559a49bf0950 0x559a49bfbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.701+0000 7f801865eb80 1 -- 172.21.15.81:0/4020592349 >> 172.21.15.81:0/4020592349 conn(0x559a49b491b0 msgr2=0x559a49be70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.701+0000 7f801865eb80 1 -- 172.21.15.81:0/4020592349 shutdown_connections 2024-05-09T00:04:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.701+0000 7f801865eb80 1 -- 172.21.15.81:0/4020592349 wait complete. 2024-05-09T00:04:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.702+0000 7f801865eb80 20 client.15825 trim_cache size 0 max 16384 2024-05-09T00:04:17.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:04:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:04:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:04:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:04:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.702+0000 7f800c4a4700 1 -- 172.21.15.81:0/2330783537 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7ff00a14c0 msgr2=0x7f7ff00a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.702+0000 7f800c4a4700 1 --2- 172.21.15.81:0/2330783537 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7ff00a14c0 0x7f7ff00a3980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x559a49be6790 tx=0x7f7ff400b3f0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.702+0000 7f800c4a4700 1 -- 172.21.15.81:0/2330783537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8004100080 msgr2=0x7f8004195f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.702+0000 7f800c4a4700 1 --2- 172.21.15.81:0/2330783537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8004100080 0x7f8004195f80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f800000b580 tx=0x7f8000005ef0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.703+0000 7f800c4a4700 1 -- 172.21.15.81:0/2330783537 shutdown_connections 2024-05-09T00:04:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.703+0000 7f800c4a4700 1 --2- 172.21.15.81:0/2330783537 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7ff00a14c0 0x7f7ff00a3980 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.703+0000 7f800c4a4700 1 --2- 172.21.15.81:0/2330783537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8004104de0 0x7f800419afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.703+0000 7f800c4a4700 1 --2- 172.21.15.81:0/2330783537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8004100080 0x7f8004195f80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.703+0000 7f800c4a4700 1 --2- 172.21.15.81:0/2330783537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8004100a40 0x7f80041964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.703+0000 7f800c4a4700 1 -- 172.21.15.81:0/2330783537 >> 172.21.15.81:0/2330783537 conn(0x7f8004076c10 msgr2=0x7f80040fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.703+0000 7f800c4a4700 1 -- 172.21.15.81:0/2330783537 shutdown_connections 2024-05-09T00:04:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:17.703+0000 7f800c4a4700 1 -- 172.21.15.81:0/2330783537 wait complete. 2024-05-09T00:04:17.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:17 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:04:17.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:17 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.171:6836/1110919655,v1:172.21.15.171:6837/1110919655] up:boot 2024-05-09T00:04:17.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:17 smithi171 ceph-mon[47351]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-05-09T00:04:17.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:17 smithi171 ceph-mon[47351]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T00:04:17.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:17 smithi171 ceph-mon[47351]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-05-09T00:04:17.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:17 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:04:17.869 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:17 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.171:6836/1110919655,v1:172.21.15.171:6837/1110919655] up:boot 2024-05-09T00:04:17.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:17 smithi081 ceph-mon[42474]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-05-09T00:04:17.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:17 smithi081 ceph-mon[42474]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T00:04:17.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:17 smithi081 ceph-mon[42474]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-05-09T00:04:18.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:17 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:04:18.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:17 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.171:6836/1110919655,v1:172.21.15.171:6837/1110919655] up:boot 2024-05-09T00:04:18.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:17 smithi150 ceph-mon[46187]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2024-05-09T00:04:18.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:17 smithi150 ceph-mon[46187]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-05-09T00:04:18.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:17 smithi150 ceph-mon[46187]: pgmap v43: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-05-09T00:04:19.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:18 smithi150 ceph-mon[46187]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-05-09T00:04:19.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:18 smithi171 ceph-mon[47351]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-05-09T00:04:19.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:18 smithi081 ceph-mon[42474]: pgmap v44: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-05-09T00:04:21.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:20 smithi150 ceph-mon[46187]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 307 B/s wr, 7 op/s 2024-05-09T00:04:21.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:20 smithi171 ceph-mon[47351]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 307 B/s wr, 7 op/s 2024-05-09T00:04:21.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:20 smithi081 ceph-mon[42474]: pgmap v45: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 307 B/s wr, 7 op/s 2024-05-09T00:04:23.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:22 smithi150 ceph-mon[46187]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 307 B/s wr, 7 op/s 2024-05-09T00:04:23.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:22 smithi171 ceph-mon[47351]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 307 B/s wr, 7 op/s 2024-05-09T00:04:23.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:22 smithi081 ceph-mon[42474]: pgmap v46: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 307 B/s wr, 7 op/s 2024-05-09T00:04:25.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:24 smithi150 ceph-mon[46187]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 307 B/s wr, 7 op/s 2024-05-09T00:04:25.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:24 smithi171 ceph-mon[47351]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 307 B/s wr, 7 op/s 2024-05-09T00:04:25.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:24 smithi081 ceph-mon[42474]: pgmap v47: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 307 B/s wr, 7 op/s 2024-05-09T00:04:27.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:26 smithi150 ceph-mon[46187]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 287 B/s wr, 6 op/s 2024-05-09T00:04:27.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:26 smithi171 ceph-mon[47351]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 287 B/s wr, 6 op/s 2024-05-09T00:04:27.446 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:26 smithi081 ceph-mon[42474]: pgmap v48: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 287 B/s wr, 6 op/s 2024-05-09T00:04:29.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:28 smithi150 ceph-mon[46187]: pgmap v49: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-09T00:04:29.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:28 smithi171 ceph-mon[47351]: pgmap v49: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-09T00:04:29.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:28 smithi081 ceph-mon[42474]: pgmap v49: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-09T00:04:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.863+0000 7ffbd590d700 1 -- 172.21.15.81:0/3853819989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbd00ffdd0 msgr2=0x7ffbd010dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.863+0000 7ffbd590d700 1 --2- 172.21.15.81:0/3853819989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbd00ffdd0 0x7ffbd010dde0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800b0d0 tx=0x7ffbc800b3e0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.863+0000 7ffbd590d700 1 -- 172.21.15.81:0/3853819989 shutdown_connections 2024-05-09T00:04:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.863+0000 7ffbd590d700 1 --2- 172.21.15.81:0/3853819989 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbd00ffdd0 0x7ffbd010dde0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.863+0000 7ffbd590d700 1 --2- 172.21.15.81:0/3853819989 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd0107020 0x7ffbd0107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.863+0000 7ffbd590d700 1 --2- 172.21.15.81:0/3853819989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbd00ff410 0x7ffbd00ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.863+0000 7ffbd590d700 1 -- 172.21.15.81:0/3853819989 >> 172.21.15.81:0/3853819989 conn(0x7ffbd00763a0 msgr2=0x7ffbd00fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.863+0000 7ffbd590d700 1 -- 172.21.15.81:0/3853819989 shutdown_connections 2024-05-09T00:04:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.863+0000 7ffbd590d700 1 -- 172.21.15.81:0/3853819989 wait complete. 2024-05-09T00:04:30.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.864+0000 7ffbd590d700 1 Processor -- start 2024-05-09T00:04:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.864+0000 7ffbd590d700 1 -- start start 2024-05-09T00:04:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbd590d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd00ff410 0x7ffbd01952f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbd590d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbd00ffdd0 0x7ffbd0195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.861 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbd590d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbd0107020 0x7ffbd0199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbd590d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd019a210 con 0x7ffbd00ffdd0 2024-05-09T00:04:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbd590d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd019a380 con 0x7ffbd0107020 2024-05-09T00:04:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbd590d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd019a540 con 0x7ffbd00ff410 2024-05-09T00:04:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbce7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbd00ffdd0 0x7ffbd0195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbce7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbd00ffdd0 0x7ffbd0195830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54434/0 (socket says 172.21.15.81:54434) 2024-05-09T00:04:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbce7fc700 1 -- 172.21.15.81:0/3500655037 learned_addr learned my addr 172.21.15.81:0/3500655037 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbceffd700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd00ff410 0x7ffbd01952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbcf7fe700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbd0107020 0x7ffbd0199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbce7fc700 1 -- 172.21.15.81:0/3500655037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd00ff410 msgr2=0x7ffbd01952f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbce7fc700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd00ff410 0x7ffbd01952f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbce7fc700 1 -- 172.21.15.81:0/3500655037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbd0107020 msgr2=0x7ffbd0199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbce7fc700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbd0107020 0x7ffbd0199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.862 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbce7fc700 1 -- 172.21.15.81:0/3500655037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc8009d00 con 0x7ffbd00ffdd0 2024-05-09T00:04:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.865+0000 7ffbcf7fe700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbd0107020 0x7ffbd0199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.866+0000 7ffbce7fc700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbd00ffdd0 0x7ffbd0195830 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400c9b0 tx=0x7ffbc400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.866+0000 7ffbd490b700 1 -- 172.21.15.81:0/3500655037 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4007b00 con 0x7ffbd00ffdd0 2024-05-09T00:04:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.866+0000 7ffbd590d700 1 -- 172.21.15.81:0/3500655037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd019a820 con 0x7ffbd00ffdd0 2024-05-09T00:04:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.866+0000 7ffbd590d700 1 -- 172.21.15.81:0/3500655037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd01a2060 con 0x7ffbd00ffdd0 2024-05-09T00:04:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.866+0000 7ffbd490b700 1 -- 172.21.15.81:0/3500655037 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffbc4007c60 con 0x7ffbd00ffdd0 2024-05-09T00:04:30.863 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.866+0000 7ffbd490b700 1 -- 172.21.15.81:0/3500655037 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4018660 con 0x7ffbd00ffdd0 2024-05-09T00:04:30.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.870+0000 7ffbe1ac7b80 1 Processor -- start 2024-05-09T00:04:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbe1ac7b80 1 -- start start 2024-05-09T00:04:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbe1ac7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dfe950 0x55b911dfed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbe1ac7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dff270 0x55b911df8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbe1ac7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911df9480 0x55b911df98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbe1ac7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b911d500f0 con 0x55b911dff270 2024-05-09T00:04:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbe1ac7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b911d4dab0 con 0x55b911df9480 2024-05-09T00:04:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbe1ac7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b911d493a0 con 0x55b911dfe950 2024-05-09T00:04:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbceffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dff270 0x55b911df8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbceffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dff270 0x55b911df8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54438/0 (socket says 172.21.15.81:54438) 2024-05-09T00:04:30.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbceffd700 1 -- 172.21.15.81:0/1113831307 learned_addr learned my addr 172.21.15.81:0/1113831307 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbceffd700 1 -- 172.21.15.81:0/1113831307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dfe950 msgr2=0x55b911dfed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:30.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbceffd700 1 --2- 172.21.15.81:0/1113831307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dfe950 0x55b911dfed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbceffd700 1 -- 172.21.15.81:0/1113831307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911df9480 msgr2=0x55b911df98a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:04:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbceffd700 1 --2- 172.21.15.81:0/1113831307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911df9480 0x55b911df98a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.871+0000 7ffbceffd700 1 -- 172.21.15.81:0/1113831307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b911bca350 con 0x55b911dff270 2024-05-09T00:04:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.872+0000 7ffbceffd700 1 --2- 172.21.15.81:0/1113831307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dff270 0x55b911df8f40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00153c0 tx=0x7ffbc000d670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d3a86a485e3be3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.872+0000 7ffbb5ffb700 1 -- 172.21.15.81:0/1113831307 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0012040 con 0x55b911dff270 2024-05-09T00:04:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.872+0000 7ffbb5ffb700 1 -- 172.21.15.81:0/1113831307 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffbc0013040 con 0x55b911dff270 2024-05-09T00:04:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.872+0000 7ffbb5ffb700 1 -- 172.21.15.81:0/1113831307 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0003c50 con 0x55b911dff270 2024-05-09T00:04:30.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.873+0000 7ffbd490b700 1 -- 172.21.15.81:0/3500655037 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ffbc40187c0 con 0x7ffbd00ffdd0 2024-05-09T00:04:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.873+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1113831307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dff270 msgr2=0x55b911df8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.873+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/1113831307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dff270 0x55b911df8f40 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00153c0 tx=0x7ffbc000d670 comp rx=0 tx=0).stop 2024-05-09T00:04:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.873+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1113831307 shutdown_connections 2024-05-09T00:04:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.873+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/1113831307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911df9480 0x55b911df98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.873+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/1113831307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dfe950 0x55b911dfed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.873+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/1113831307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dff270 0x55b911df8f40 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.869 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.873+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1113831307 >> 172.21.15.81:0/1113831307 conn(0x55b911d571b0 msgr2=0x55b911df3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.874+0000 7ffbd490b700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffbb80a1310 0x7ffbb80a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.874+0000 7ffbd490b700 1 -- 172.21.15.81:0/3500655037 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ffbc40cca70 con 0x7ffbd00ffdd0 2024-05-09T00:04:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.874+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1113831307 shutdown_connections 2024-05-09T00:04:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.874+0000 7ffbceffd700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffbb80a1310 0x7ffbb80a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.874+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1113831307 wait complete. 2024-05-09T00:04:30.870 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.875+0000 7ffbe1ac7b80 1 -- start start 2024-05-09T00:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.875+0000 7ffbceffd700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffbb80a1310 0x7ffbb80a37d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0015a60 tx=0x7ffbc0003790 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.875+0000 7ffbe1ac7b80 1 Processor -- start 2024-05-09T00:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.875+0000 7ffbe1ac7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911df9480 0x55b911e05210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.875+0000 7ffbe1ac7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911dfe950 0x55b911e02550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.875+0000 7ffbe1ac7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dff270 0x55b911e02c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.875+0000 7ffbe1ac7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b911ce5500 con 0x55b911dff270 2024-05-09T00:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.875+0000 7ffbe1ac7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b911ce51a0 con 0x55b911dfe950 2024-05-09T00:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.875+0000 7ffbe1ac7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b911bcc640 con 0x55b911df9480 2024-05-09T00:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.876+0000 7ffbe1ac7b80 10 client.0 _ll_register_callbacks cb 0x55b911ceead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.876+0000 7ffbcf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dff270 0x55b911e02c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.876+0000 7ffbceffd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911df9480 0x55b911e05210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.876+0000 7ffbcf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dff270 0x55b911e02c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54448/0 (socket says 172.21.15.81:54448) 2024-05-09T00:04:30.871 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.876+0000 7ffbcf7fe700 1 -- 172.21.15.81:0/2234664511 learned_addr learned my addr 172.21.15.81:0/2234664511 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.876+0000 7ffbcf7fe700 1 -- 172.21.15.81:0/2234664511 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911df9480 msgr2=0x55b911e05210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.876+0000 7ffbcf7fe700 1 --2- 172.21.15.81:0/2234664511 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911df9480 0x55b911e05210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.876+0000 7ffbcf7fe700 1 -- 172.21.15.81:0/2234664511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911dfe950 msgr2=0x55b911e02550 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.876+0000 7ffbcf7fe700 1 --2- 172.21.15.81:0/2234664511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911dfe950 0x55b911e02550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.876+0000 7ffbcf7fe700 1 -- 172.21.15.81:0/2234664511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc000ddf0 con 0x55b911dff270 2024-05-09T00:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.876+0000 7ffbcf7fe700 1 --2- 172.21.15.81:0/2234664511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dff270 0x55b911e02c90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009610 tx=0x7ffbc8008f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dbbf046044808db server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.876+0000 7ffbaeffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.877+0000 7ffbaeffd700 1 -- 172.21.15.81:0/2234664511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc800e040 con 0x55b911dff270 2024-05-09T00:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.877+0000 7ffbaeffd700 1 -- 172.21.15.81:0/2234664511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ffbc800be30 con 0x55b911dff270 2024-05-09T00:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.877+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/2234664511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b911ca2210 con 0x55b911dff270 2024-05-09T00:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.877+0000 7ffbaeffd700 1 -- 172.21.15.81:0/2234664511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbc8004a50 con 0x55b911dff270 2024-05-09T00:04:30.873 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.877+0000 7ffbe1ac7b80 10 client.15834 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.877+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/2234664511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b911b76b00 con 0x55b911dff270 2024-05-09T00:04:30.874 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.877+0000 7ffbaeffd700 1 -- 172.21.15.81:0/2234664511 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b911ca2210 con 0x55b911dff270 2024-05-09T00:04:30.875 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.878+0000 7ffbaeffd700 1 -- 172.21.15.81:0/2234664511 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ffbc8019070 con 0x55b911dff270 2024-05-09T00:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.878+0000 7ffbe1ac7b80 10 client.15834 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.878+0000 7ffbe1ac7b80 10 client.15834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.878+0000 7ffbe1ac7b80 20 client.15834 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.878+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/2234664511 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b911e1ac60 0x55b911e1d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.878+0000 7ffbe1ac7b80 4 client.15834 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.878+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/2234664511 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b911dc87b0 con 0x55b911e1ac60 2024-05-09T00:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.879+0000 7ffbceffd700 1 --2- 172.21.15.81:0/2234664511 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b911e1ac60 0x55b911e1d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.879+0000 7ffbceffd700 1 --2- 172.21.15.81:0/2234664511 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b911e1ac60 0x55b911e1d080 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25e341adbe4d6ed0 server_cookie=e357f374b904b882 in_seq=0 out_seq=0 2024-05-09T00:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.879+0000 7ffbaeffd700 10 client.15834 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.880+0000 7ffbaeffd700 1 -- 172.21.15.81:0/2234664511 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b911dc87b0 con 0x55b911e1ac60 2024-05-09T00:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.880+0000 7ffbaeffd700 10 client.15834 handle_command_reply: tid=0 2024-05-09T00:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.880+0000 7ffbe1ac7b80 1 client.15834 shutdown 2024-05-09T00:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.880+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/2234664511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dff270 msgr2=0x55b911e02c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:30.876 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.880+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/2234664511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dff270 0x55b911e02c90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8009610 tx=0x7ffbc8008f00 comp rx=0 tx=0).stop 2024-05-09T00:04:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.880+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/2234664511 shutdown_connections 2024-05-09T00:04:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.880+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/2234664511 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b911e1ac60 0x55b911e1d080 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.880+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/2234664511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dff270 0x55b911e02c90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.880+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/2234664511 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911df9480 0x55b911e05210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.880+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/2234664511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911dfe950 0x55b911e02550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.880+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/2234664511 >> 172.21.15.81:0/2234664511 conn(0x55b911d571b0 msgr2=0x55b911dfd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.880+0000 7ffbaeffd700 0 client.15834 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.880+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/2234664511 shutdown_connections 2024-05-09T00:04:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.880+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/2234664511 wait complete. 2024-05-09T00:04:30.877 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.881+0000 7ffbe1ac7b80 20 client.15834 trim_cache size 0 max 16384 2024-05-09T00:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.895+0000 7ffbe1ac7b80 1 Processor -- start 2024-05-09T00:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.895+0000 7ffbe1ac7b80 1 -- start start 2024-05-09T00:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.896+0000 7ffbe1ac7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911df9480 0x55b911df50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.896+0000 7ffbe1ac7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911dfe950 0x55b911df3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.896+0000 7ffbe1ac7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dff270 0x55b911defe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.896+0000 7ffbe1ac7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b911df0340 con 0x55b911df9480 2024-05-09T00:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.896+0000 7ffbe1ac7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b911df8140 con 0x55b911dfe950 2024-05-09T00:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.896+0000 7ffbe1ac7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b911dfed30 con 0x55b911dff270 2024-05-09T00:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.896+0000 7ffbcf7fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dff270 0x55b911defe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.896+0000 7ffbcf7fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dff270 0x55b911defe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:37720/0 (socket says 172.21.15.81:37720) 2024-05-09T00:04:30.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.896+0000 7ffbcf7fe700 1 -- 172.21.15.81:0/1069192467 learned_addr learned my addr 172.21.15.81:0/1069192467 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.896+0000 7ffbceffd700 1 --2- 172.21.15.81:0/1069192467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911df9480 0x55b911df50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.896+0000 7ffbce7fc700 1 --2- 172.21.15.81:0/1069192467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911dfe950 0x55b911df3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.896+0000 7ffbceffd700 1 -- 172.21.15.81:0/1069192467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dff270 msgr2=0x55b911defe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.897+0000 7ffbceffd700 1 --2- 172.21.15.81:0/1069192467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dff270 0x55b911defe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.897+0000 7ffbceffd700 1 -- 172.21.15.81:0/1069192467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911dfe950 msgr2=0x55b911df3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.897+0000 7ffbceffd700 1 --2- 172.21.15.81:0/1069192467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911dfe950 0x55b911df3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.897+0000 7ffbceffd700 1 -- 172.21.15.81:0/1069192467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b911d0f500 con 0x55b911df9480 2024-05-09T00:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.897+0000 7ffbcf7fe700 1 --2- 172.21.15.81:0/1069192467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dff270 0x55b911defe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.897+0000 7ffbceffd700 1 --2- 172.21.15.81:0/1069192467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911df9480 0x55b911df50f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0000c00 tx=0x7ffbc0024040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9b4946af65a64b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.897+0000 7ffbb67fc700 1 -- 172.21.15.81:0/1069192467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0012040 con 0x55b911df9480 2024-05-09T00:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.897+0000 7ffbb67fc700 1 -- 172.21.15.81:0/1069192467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffbc000b2c0 con 0x55b911df9480 2024-05-09T00:04:30.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.897+0000 7ffbb67fc700 1 -- 172.21.15.81:0/1069192467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc0033440 con 0x55b911df9480 2024-05-09T00:04:30.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.898+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1069192467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911df9480 msgr2=0x55b911df50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.898+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/1069192467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911df9480 0x55b911df50f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0000c00 tx=0x7ffbc0024040 comp rx=0 tx=0).stop 2024-05-09T00:04:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.898+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1069192467 shutdown_connections 2024-05-09T00:04:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.898+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/1069192467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dff270 0x55b911defe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.898+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/1069192467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911df9480 0x55b911df50f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.898+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/1069192467 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911dfe950 0x55b911df3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.898+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1069192467 >> 172.21.15.81:0/1069192467 conn(0x55b911d571b0 msgr2=0x55b911e01de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.898+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1069192467 shutdown_connections 2024-05-09T00:04:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.898+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1069192467 wait complete. 2024-05-09T00:04:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.898+0000 7ffbe1ac7b80 1 -- start start 2024-05-09T00:04:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbe1ac7b80 1 Processor -- start 2024-05-09T00:04:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbe1ac7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911df9480 0x55b911dfdd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbe1ac7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dfe950 0x55b911e21940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbe1ac7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dff270 0x55b911dfc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbe1ac7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b911e22200 con 0x55b911dfe950 2024-05-09T00:04:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbe1ac7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b911dfc930 con 0x55b911df9480 2024-05-09T00:04:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbe1ac7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b911dfcaf0 con 0x55b911dff270 2024-05-09T00:04:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbe1ac7b80 10 client.0 _ll_register_callbacks cb 0x55b911ceead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbceffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911df9480 0x55b911dfdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbceffd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911df9480 0x55b911dfdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.150:3300/0 says I am v2:172.21.15.81:47318/0 (socket says 172.21.15.81:47318) 2024-05-09T00:04:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbceffd700 1 -- 172.21.15.81:0/1633015534 learned_addr learned my addr 172.21.15.81:0/1633015534 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbcf7fe700 1 --2- 172.21.15.81:0/1633015534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dff270 0x55b911dfc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbceffd700 1 -- 172.21.15.81:0/1633015534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dff270 msgr2=0x55b911dfc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbceffd700 1 --2- 172.21.15.81:0/1633015534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dff270 0x55b911dfc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbceffd700 1 -- 172.21.15.81:0/1633015534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dfe950 msgr2=0x55b911e21940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbceffd700 1 --2- 172.21.15.81:0/1633015534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dfe950 0x55b911e21940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.899+0000 7ffbceffd700 1 -- 172.21.15.81:0/1633015534 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b911b76b00 con 0x55b911df9480 2024-05-09T00:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.900+0000 7ffbceffd700 1 --2- 172.21.15.81:0/1633015534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911df9480 0x55b911dfdd80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0005d20 tx=0x7ffbc0033ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccbd966932c897da server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.900+0000 7ffbaeffd700 10 client.0 ms_handle_connect on v2:172.21.15.150:3300/0 2024-05-09T00:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.900+0000 7ffbaeffd700 1 -- 172.21.15.81:0/1633015534 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00052b0 con 0x55b911df9480 2024-05-09T00:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.900+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1633015534 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffbc0013040 con 0x55b911df9480 2024-05-09T00:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.900+0000 7ffbaeffd700 1 -- 172.21.15.81:0/1633015534 <== mon.2 v2:172.21.15.150:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ffbc0005410 con 0x55b911df9480 2024-05-09T00:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.900+0000 7ffbaeffd700 1 -- 172.21.15.81:0/1633015534 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbc00055d0 con 0x55b911df9480 2024-05-09T00:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.900+0000 7ffbe1ac7b80 10 client.25328 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.900+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1633015534 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7ffbc0028070 con 0x55b911df9480 2024-05-09T00:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.900+0000 7ffbaeffd700 1 -- 172.21.15.81:0/1633015534 <== mon.2 v2:172.21.15.150:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffbc0013040 con 0x55b911df9480 2024-05-09T00:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.901+0000 7ffbaeffd700 1 -- 172.21.15.81:0/1633015534 <== mon.2 v2:172.21.15.150:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ffbc000c9e0 con 0x55b911df9480 2024-05-09T00:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.901+0000 7ffbe1ac7b80 10 client.25328 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.901+0000 7ffbe1ac7b80 10 client.25328 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.901+0000 7ffbe1ac7b80 20 client.25328 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:30.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.901+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/1633015534 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b911e8b490 0x55b911e8d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.901+0000 7ffbe1ac7b80 4 client.25328 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:04:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.901+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1633015534 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b911d41e60 con 0x55b911e8b490 2024-05-09T00:04:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.901+0000 7ffbce7fc700 1 --2- 172.21.15.81:0/1633015534 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b911e8b490 0x55b911e8d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.901+0000 7ffbaeffd700 10 client.25328 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:30.900 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.901+0000 7ffbce7fc700 1 --2- 172.21.15.81:0/1633015534 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b911e8b490 0x55b911e8d880 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b787c2b885e57c47 server_cookie=8d2ee0e2cca386fb in_seq=0 out_seq=0 2024-05-09T00:04:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbaeffd700 1 -- 172.21.15.81:0/1633015534 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b911d41e60 con 0x55b911e8b490 2024-05-09T00:04:30.902 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbaeffd700 10 client.25328 handle_command_reply: tid=0 2024-05-09T00:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbe1ac7b80 1 client.25328 shutdown 2024-05-09T00:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1633015534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911df9480 msgr2=0x55b911dfdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/1633015534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911df9480 0x55b911dfdd80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0005d20 tx=0x7ffbc0033ec0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1633015534 shutdown_connections 2024-05-09T00:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/1633015534 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b911e8b490 0x55b911e8d880 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/1633015534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b911df9480 0x55b911dfdd80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/1633015534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b911dff270 0x55b911dfc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbaeffd700 0 client.25328 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbe1ac7b80 1 --2- 172.21.15.81:0/1633015534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b911dfe950 0x55b911e21940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1633015534 >> 172.21.15.81:0/1633015534 conn(0x55b911d571b0 msgr2=0x55b911df7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1633015534 shutdown_connections 2024-05-09T00:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbe1ac7b80 1 -- 172.21.15.81:0/1633015534 wait complete. 2024-05-09T00:04:30.903 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.907+0000 7ffbe1ac7b80 20 client.25328 trim_cache size 0 max 16384 2024-05-09T00:04:30.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:04:30.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:04:30.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:04:30.904 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:04:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.908+0000 7ffbd590d700 1 -- 172.21.15.81:0/3500655037 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffbb80a1310 msgr2=0x7ffbb80a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.908+0000 7ffbd590d700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffbb80a1310 0x7ffbb80a37d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffbc0015a60 tx=0x7ffbc0003790 comp rx=0 tx=0).stop 2024-05-09T00:04:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.908+0000 7ffbd590d700 1 -- 172.21.15.81:0/3500655037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbd00ffdd0 msgr2=0x7ffbd0195830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.908+0000 7ffbd590d700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbd00ffdd0 0x7ffbd0195830 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400c9b0 tx=0x7ffbc400ccc0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.908+0000 7ffbd590d700 1 -- 172.21.15.81:0/3500655037 shutdown_connections 2024-05-09T00:04:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.908+0000 7ffbd590d700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffbb80a1310 0x7ffbb80a37d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.908+0000 7ffbd590d700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffbd0107020 0x7ffbd0199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.908+0000 7ffbd590d700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffbd00ff410 0x7ffbd01952f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.908+0000 7ffbd590d700 1 --2- 172.21.15.81:0/3500655037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbd00ffdd0 0x7ffbd0195830 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.908+0000 7ffbd590d700 1 -- 172.21.15.81:0/3500655037 >> 172.21.15.81:0/3500655037 conn(0x7ffbd00763a0 msgr2=0x7ffbd0103f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:30.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.908+0000 7ffbd590d700 1 -- 172.21.15.81:0/3500655037 shutdown_connections 2024-05-09T00:04:30.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:30.908+0000 7ffbd590d700 1 -- 172.21.15.81:0/3500655037 wait complete. 2024-05-09T00:04:31.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:30 smithi150 ceph-mon[46187]: mgrmap e25: x(active, since 91s), standbys: y, z 2024-05-09T00:04:31.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:30 smithi150 ceph-mon[46187]: pgmap v50: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-09T00:04:31.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:30 smithi171 ceph-mon[47351]: mgrmap e25: x(active, since 91s), standbys: y, z 2024-05-09T00:04:31.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:30 smithi171 ceph-mon[47351]: pgmap v50: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-09T00:04:31.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:30 smithi081 ceph-mon[42474]: mgrmap e25: x(active, since 91s), standbys: y, z 2024-05-09T00:04:31.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:30 smithi081 ceph-mon[42474]: pgmap v50: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-09T00:04:33.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:32 smithi150 ceph-mon[46187]: pgmap v51: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-09T00:04:33.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:32 smithi171 ceph-mon[47351]: pgmap v51: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-09T00:04:33.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:32 smithi081 ceph-mon[42474]: pgmap v51: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 682 B/s wr, 6 op/s 2024-05-09T00:04:34.098 INFO:tasks.workunit.client.0.smithi081.stderr:Updating files: 98% (12038/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-09T00:04:34.542 INFO:tasks.workunit.client.0.smithi081.stderr:Note: switching to 'd21e4f961318b56f0d915caa2490c3711bf13c34'. 2024-05-09T00:04:34.543 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-05-09T00:04:34.543 INFO:tasks.workunit.client.0.smithi081.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-09T00:04:34.543 INFO:tasks.workunit.client.0.smithi081.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-09T00:04:34.543 INFO:tasks.workunit.client.0.smithi081.stderr:state without impacting any branches by switching back to a branch. 2024-05-09T00:04:34.543 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-05-09T00:04:34.543 INFO:tasks.workunit.client.0.smithi081.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-09T00:04:34.543 INFO:tasks.workunit.client.0.smithi081.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-09T00:04:34.543 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-05-09T00:04:34.543 INFO:tasks.workunit.client.0.smithi081.stderr: git switch -c 2024-05-09T00:04:34.543 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-05-09T00:04:34.543 INFO:tasks.workunit.client.0.smithi081.stderr:Or undo this operation with: 2024-05-09T00:04:34.543 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-05-09T00:04:34.543 INFO:tasks.workunit.client.0.smithi081.stderr: git switch - 2024-05-09T00:04:34.544 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-05-09T00:04:34.544 INFO:tasks.workunit.client.0.smithi081.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-09T00:04:34.544 INFO:tasks.workunit.client.0.smithi081.stderr: 2024-05-09T00:04:34.544 INFO:tasks.workunit.client.0.smithi081.stderr:HEAD is now at d21e4f96131 Merge PR #57343 into wip-pdonnell-testing-20240508.150423-reef 2024-05-09T00:04:34.549 DEBUG:teuthology.orchestra.run.smithi081:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-09T00:04:34.616 INFO:tasks.workunit.client.0.smithi081.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-09T00:04:34.618 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T00:04:34.618 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-09T00:04:35.120 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-09T00:04:35.177 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-09T00:04:35.214 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-09T00:04:35.216 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T00:04:35.216 INFO:tasks.workunit.client.0.smithi081.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-09T00:04:35.253 INFO:tasks.workunit.client.0.smithi081.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-09T00:04:35.256 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-09T00:04:35.256 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-09T00:04:35.263 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:34 smithi150 ceph-mon[46187]: pgmap v52: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-09T00:04:35.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:34 smithi171 ceph-mon[47351]: pgmap v52: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-09T00:04:35.314 INFO:tasks.workunit:Running workunits matching fs/test_o_trunc.sh on client.0... 2024-05-09T00:04:35.315 INFO:tasks.workunit:Running workunit fs/test_o_trunc.sh... 2024-05-09T00:04:35.315 DEBUG:teuthology.orchestra.run.smithi081:workunit test fs/test_o_trunc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d21e4f961318b56f0d915caa2490c3711bf13c34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-05-09T00:04:35.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:34 smithi081 ceph-mon[42474]: pgmap v52: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 9 op/s 2024-05-09T00:04:35.378 INFO:tasks.workunit.client.0.smithi081.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc.sh 2024-05-09T00:04:35.378 INFO:tasks.workunit.client.0.smithi081.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs 2024-05-09T00:04:35.378 INFO:tasks.workunit.client.0.smithi081.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/test_o_trunc trunc.foo 600 2024-05-09T00:04:37.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:36 smithi150 ceph-mon[46187]: pgmap v53: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-09T00:04:37.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:36 smithi171 ceph-mon[47351]: pgmap v53: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-09T00:04:37.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:36 smithi081 ceph-mon[42474]: pgmap v53: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-09T00:04:39.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:38 smithi150 ceph-mon[46187]: pgmap v54: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-09T00:04:39.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:38 smithi171 ceph-mon[47351]: pgmap v54: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-09T00:04:39.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:38 smithi081 ceph-mon[42474]: pgmap v54: 97 pgs: 97 active+clean; 1.3 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 938 B/s wr, 6 op/s 2024-05-09T00:04:41.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:40 smithi150 ceph-mon[46187]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.3 KiB/s wr, 11 op/s 2024-05-09T00:04:41.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:40 smithi171 ceph-mon[47351]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.3 KiB/s wr, 11 op/s 2024-05-09T00:04:41.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:40 smithi081 ceph-mon[42474]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.3 KiB/s wr, 11 op/s 2024-05-09T00:04:43.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:42 smithi150 ceph-mon[46187]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.7 KiB/s wr, 7 op/s 2024-05-09T00:04:43.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:42 smithi171 ceph-mon[47351]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.7 KiB/s wr, 7 op/s 2024-05-09T00:04:43.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:42 smithi081 ceph-mon[42474]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.7 KiB/s wr, 7 op/s 2024-05-09T00:04:44.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:04:44.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.031+0000 7f00b231d700 1 -- 172.21.15.81:0/2127909995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00ac0ffdd0 msgr2=0x7f00ac10dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.031+0000 7f00b231d700 1 --2- 172.21.15.81:0/2127909995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00ac0ffdd0 0x7f00ac10dde0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f00a400b0d0 tx=0x7f00a400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.031+0000 7f00b231d700 1 -- 172.21.15.81:0/2127909995 shutdown_connections 2024-05-09T00:04:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.031+0000 7f00b231d700 1 --2- 172.21.15.81:0/2127909995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00ac0ffdd0 0x7f00ac10dde0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.031+0000 7f00b231d700 1 --2- 172.21.15.81:0/2127909995 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00ac107020 0x7f00ac107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.031+0000 7f00b231d700 1 --2- 172.21.15.81:0/2127909995 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00ac0ff410 0x7f00ac0ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.031+0000 7f00b231d700 1 -- 172.21.15.81:0/2127909995 >> 172.21.15.81:0/2127909995 conn(0x7f00ac0763a0 msgr2=0x7f00ac0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.032+0000 7f00b231d700 1 -- 172.21.15.81:0/2127909995 shutdown_connections 2024-05-09T00:04:44.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.032+0000 7f00b231d700 1 -- 172.21.15.81:0/2127909995 wait complete. 2024-05-09T00:04:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.032+0000 7f00b231d700 1 Processor -- start 2024-05-09T00:04:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.032+0000 7f00b231d700 1 -- start start 2024-05-09T00:04:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00b231d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00ac0ff410 0x7f00ac1975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00b231d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00ac0ffdd0 0x7f00ac197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00b231d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00ac107020 0x7f00ac19be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00b231d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac19c4c0 con 0x7f00ac107020 2024-05-09T00:04:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00b231d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac19c630 con 0x7f00ac0ff410 2024-05-09T00:04:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00b231d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac19c7f0 con 0x7f00ac0ffdd0 2024-05-09T00:04:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00b08ba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00ac107020 0x7f00ac19be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00b08ba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00ac107020 0x7f00ac19be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41620/0 (socket says 172.21.15.81:41620) 2024-05-09T00:04:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00b08ba700 1 -- 172.21.15.81:0/2231560849 learned_addr learned my addr 172.21.15.81:0/2231560849 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00abfff700 1 --2- 172.21.15.81:0/2231560849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00ac0ff410 0x7f00ac1975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00ab7fe700 1 --2- 172.21.15.81:0/2231560849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00ac0ffdd0 0x7f00ac197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00b08ba700 1 -- 172.21.15.81:0/2231560849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00ac0ffdd0 msgr2=0x7f00ac197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00b08ba700 1 --2- 172.21.15.81:0/2231560849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00ac0ffdd0 0x7f00ac197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00b08ba700 1 -- 172.21.15.81:0/2231560849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00ac0ff410 msgr2=0x7f00ac1975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00b08ba700 1 --2- 172.21.15.81:0/2231560849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00ac0ff410 0x7f00ac1975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.033+0000 7f00b08ba700 1 -- 172.21.15.81:0/2231560849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a4009d00 con 0x7f00ac107020 2024-05-09T00:04:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.034+0000 7f00b08ba700 1 --2- 172.21.15.81:0/2231560849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00ac107020 0x7f00ac19be80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f00a400bd50 tx=0x7f00a400bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.034+0000 7f00a97fa700 1 -- 172.21.15.81:0/2231560849 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a400e040 con 0x7f00ac107020 2024-05-09T00:04:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.034+0000 7f00b231d700 1 -- 172.21.15.81:0/2231560849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ac19ca70 con 0x7f00ac107020 2024-05-09T00:04:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.034+0000 7f00a97fa700 1 -- 172.21.15.81:0/2231560849 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00a401b8e0 con 0x7f00ac107020 2024-05-09T00:04:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.034+0000 7f00a97fa700 1 -- 172.21.15.81:0/2231560849 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a4012810 con 0x7f00ac107020 2024-05-09T00:04:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.034+0000 7f00b231d700 1 -- 172.21.15.81:0/2231560849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ac1a4310 con 0x7f00ac107020 2024-05-09T00:04:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.036+0000 7f00a97fa700 1 -- 172.21.15.81:0/2231560849 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f00a401ba50 con 0x7f00ac107020 2024-05-09T00:04:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.037+0000 7f00a97fa700 1 --2- 172.21.15.81:0/2231560849 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f00940a1290 0x7f00940a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.037+0000 7f00a97fa700 1 -- 172.21.15.81:0/2231560849 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f00a40cdbf0 con 0x7f00ac107020 2024-05-09T00:04:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.037+0000 7f00abfff700 1 --2- 172.21.15.81:0/2231560849 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f00940a1290 0x7f00940a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.037+0000 7f00abfff700 1 --2- 172.21.15.81:0/2231560849 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f00940a1290 0x7f00940a3750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f009c009be0 tx=0x7f009c009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00be4d7b80 1 Processor -- start 2024-05-09T00:04:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00be4d7b80 1 -- start start 2024-05-09T00:04:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00be4d7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831540 0x55fec8831920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00be4d7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831e60 0x55fec8835900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00be4d7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8835e40 0x55fec88362a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00be4d7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec87840f0 con 0x55fec8831e60 2024-05-09T00:04:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00be4d7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec8781ab0 con 0x55fec8835e40 2024-05-09T00:04:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00be4d7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec877d3a0 con 0x55fec8831540 2024-05-09T00:04:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831e60 0x55fec8835900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831e60 0x55fec8835900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41634/0 (socket says 172.21.15.81:41634) 2024-05-09T00:04:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00ab7fe700 1 -- 172.21.15.81:0/3140473085 learned_addr learned my addr 172.21.15.81:0/3140473085 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00abfff700 1 --2- 172.21.15.81:0/3140473085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831540 0x55fec8831920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00b08ba700 1 --2- 172.21.15.81:0/3140473085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8835e40 0x55fec88362a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00ab7fe700 1 -- 172.21.15.81:0/3140473085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831540 msgr2=0x55fec8831920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00ab7fe700 1 --2- 172.21.15.81:0/3140473085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831540 0x55fec8831920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00ab7fe700 1 -- 172.21.15.81:0/3140473085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8835e40 msgr2=0x55fec88362a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00ab7fe700 1 --2- 172.21.15.81:0/3140473085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8835e40 0x55fec88362a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00ab7fe700 1 -- 172.21.15.81:0/3140473085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fec85fe350 con 0x55fec8831e60 2024-05-09T00:04:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.039+0000 7f00abfff700 1 --2- 172.21.15.81:0/3140473085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831540 0x55fec8831920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.040+0000 7f00ab7fe700 1 --2- 172.21.15.81:0/3140473085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831e60 0x55fec8835900 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009d20 tx=0x7f00a0011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929c1fbec5624c24 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.040+0000 7f00927fc700 1 -- 172.21.15.81:0/3140473085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0019630 con 0x55fec8831e60 2024-05-09T00:04:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.040+0000 7f00927fc700 1 -- 172.21.15.81:0/3140473085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00a0019c50 con 0x55fec8831e60 2024-05-09T00:04:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.040+0000 7f00927fc700 1 -- 172.21.15.81:0/3140473085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a000ebd0 con 0x55fec8831e60 2024-05-09T00:04:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.040+0000 7f00be4d7b80 1 -- 172.21.15.81:0/3140473085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831e60 msgr2=0x55fec8835900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.040+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/3140473085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831e60 0x55fec8835900 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009d20 tx=0x7f00a0011720 comp rx=0 tx=0).stop 2024-05-09T00:04:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.041+0000 7f00be4d7b80 1 -- 172.21.15.81:0/3140473085 shutdown_connections 2024-05-09T00:04:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.041+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/3140473085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8835e40 0x55fec88362a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.041+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/3140473085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831540 0x55fec8831920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.041+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/3140473085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831e60 0x55fec8835900 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.041+0000 7f00be4d7b80 1 -- 172.21.15.81:0/3140473085 >> 172.21.15.81:0/3140473085 conn(0x55fec878b1b0 msgr2=0x55fec8827840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.041+0000 7f00be4d7b80 1 -- 172.21.15.81:0/3140473085 shutdown_connections 2024-05-09T00:04:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.041+0000 7f00be4d7b80 1 -- 172.21.15.81:0/3140473085 wait complete. 2024-05-09T00:04:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.041+0000 7f00be4d7b80 1 -- start start 2024-05-09T00:04:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.041+0000 7f00be4d7b80 1 Processor -- start 2024-05-09T00:04:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00be4d7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831540 0x55fec883d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00be4d7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831e60 0x55fec883a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00be4d7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8835e40 0x55fec883b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00be4d7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec8719500 con 0x55fec8831540 2024-05-09T00:04:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00be4d7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec87191a0 con 0x55fec8835e40 2024-05-09T00:04:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00be4d7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec8600640 con 0x55fec8831e60 2024-05-09T00:04:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00be4d7b80 10 client.0 _ll_register_callbacks cb 0x55fec8722ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00ab7fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831e60 0x55fec883a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00ab7fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831e60 0x55fec883a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:56148/0 (socket says 172.21.15.81:56148) 2024-05-09T00:04:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00ab7fe700 1 -- 172.21.15.81:0/1937406365 learned_addr learned my addr 172.21.15.81:0/1937406365 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00abfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831540 0x55fec883d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00ab7fe700 1 -- 172.21.15.81:0/1937406365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8835e40 msgr2=0x55fec883b030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:04:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00ab7fe700 1 --2- 172.21.15.81:0/1937406365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8835e40 0x55fec883b030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00ab7fe700 1 -- 172.21.15.81:0/1937406365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831540 msgr2=0x55fec883d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00ab7fe700 1 --2- 172.21.15.81:0/1937406365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831540 0x55fec883d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00ab7fe700 1 -- 172.21.15.81:0/1937406365 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a0009980 con 0x55fec8831e60 2024-05-09T00:04:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.042+0000 7f00abfff700 1 --2- 172.21.15.81:0/1937406365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831540 0x55fec883d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:04:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.043+0000 7f00ab7fe700 1 --2- 172.21.15.81:0/1937406365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831e60 0x55fec883a940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00a0005920 tx=0x7f00a0005e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1ad71c9fd5ff56c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.043+0000 7f008b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-05-09T00:04:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.043+0000 7f008b7fe700 1 -- 172.21.15.81:0/1937406365 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a000ec70 con 0x55fec8831e60 2024-05-09T00:04:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.043+0000 7f00be4d7b80 1 -- 172.21.15.81:0/1937406365 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fec86d6210 con 0x55fec8831e60 2024-05-09T00:04:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.043+0000 7f008b7fe700 1 -- 172.21.15.81:0/1937406365 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f00a000edd0 con 0x55fec8831e60 2024-05-09T00:04:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.043+0000 7f008b7fe700 1 -- 172.21.15.81:0/1937406365 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00a0004020 con 0x55fec8831e60 2024-05-09T00:04:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.044+0000 7f00be4d7b80 10 client.25384 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.044+0000 7f00be4d7b80 1 -- 172.21.15.81:0/1937406365 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fec85aab00 con 0x55fec8831e60 2024-05-09T00:04:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.044+0000 7f008b7fe700 1 -- 172.21.15.81:0/1937406365 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fec86d6210 con 0x55fec8831e60 2024-05-09T00:04:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.044+0000 7f008b7fe700 1 -- 172.21.15.81:0/1937406365 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f00a0005040 con 0x55fec8831e60 2024-05-09T00:04:44.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.045+0000 7f00be4d7b80 10 client.25384 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.045+0000 7f00be4d7b80 10 client.25384 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.045+0000 7f00be4d7b80 20 client.25384 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.045+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/1937406365 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fec884afc0 0x55fec884d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.045+0000 7f00be4d7b80 4 client.25384 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.045+0000 7f00be4d7b80 1 -- 172.21.15.81:0/1937406365 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fec87fc7b0 con 0x55fec884afc0 2024-05-09T00:04:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.045+0000 7f00abfff700 1 --2- 172.21.15.81:0/1937406365 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fec884afc0 0x55fec884d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.045+0000 7f00abfff700 1 --2- 172.21.15.81:0/1937406365 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fec884afc0 0x55fec884d3e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8514492bd9783b0 server_cookie=b4ac1bb84bf3fef in_seq=0 out_seq=0 2024-05-09T00:04:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.045+0000 7f008b7fe700 10 client.25384 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.046+0000 7f008b7fe700 1 -- 172.21.15.81:0/1937406365 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fec87fc7b0 con 0x55fec884afc0 2024-05-09T00:04:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.046+0000 7f008b7fe700 10 client.25384 handle_command_reply: tid=0 2024-05-09T00:04:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.046+0000 7f00be4d7b80 1 client.25384 shutdown 2024-05-09T00:04:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.046+0000 7f00be4d7b80 1 -- 172.21.15.81:0/1937406365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831e60 msgr2=0x55fec883a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.046+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/1937406365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831e60 0x55fec883a940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00a0005920 tx=0x7f00a0005e20 comp rx=0 tx=0).stop 2024-05-09T00:04:44.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.046+0000 7f00be4d7b80 1 -- 172.21.15.81:0/1937406365 shutdown_connections 2024-05-09T00:04:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.046+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/1937406365 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fec884afc0 0x55fec884d3e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.046+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/1937406365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8835e40 0x55fec883b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.046+0000 7f008b7fe700 0 client.25384 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.046+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/1937406365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831540 0x55fec883d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.046+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/1937406365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831e60 0x55fec883a940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.046+0000 7f00be4d7b80 1 -- 172.21.15.81:0/1937406365 >> 172.21.15.81:0/1937406365 conn(0x55fec878b1b0 msgr2=0x55fec882bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.046+0000 7f00be4d7b80 1 -- 172.21.15.81:0/1937406365 shutdown_connections 2024-05-09T00:04:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.046+0000 7f00be4d7b80 1 -- 172.21.15.81:0/1937406365 wait complete. 2024-05-09T00:04:44.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.047+0000 7f00be4d7b80 20 client.25384 trim_cache size 0 max 16384 2024-05-09T00:04:44.057 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00be4d7b80 1 Processor -- start 2024-05-09T00:04:44.057 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00be4d7b80 1 -- start start 2024-05-09T00:04:44.057 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00be4d7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831540 0x55fec8827910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.057 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00be4d7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831e60 0x55fec8838230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.057 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00be4d7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8835e40 0x55fec8839e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.057 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00be4d7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec8822330 con 0x55fec8831e60 2024-05-09T00:04:44.057 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00be4d7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec8847b70 con 0x55fec8835e40 2024-05-09T00:04:44.057 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00be4d7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec8834ad0 con 0x55fec8831540 2024-05-09T00:04:44.057 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831e60 0x55fec8838230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.057 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831e60 0x55fec8838230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41648/0 (socket says 172.21.15.81:41648) 2024-05-09T00:04:44.057 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00ab7fe700 1 -- 172.21.15.81:0/198599134 learned_addr learned my addr 172.21.15.81:0/198599134 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00abfff700 1 --2- 172.21.15.81:0/198599134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831540 0x55fec8827910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00b08ba700 1 --2- 172.21.15.81:0/198599134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8835e40 0x55fec8839e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00ab7fe700 1 -- 172.21.15.81:0/198599134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831540 msgr2=0x55fec8827910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00ab7fe700 1 --2- 172.21.15.81:0/198599134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831540 0x55fec8827910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00ab7fe700 1 -- 172.21.15.81:0/198599134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8835e40 msgr2=0x55fec8839e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00ab7fe700 1 --2- 172.21.15.81:0/198599134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8835e40 0x55fec8839e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.062+0000 7f00ab7fe700 1 -- 172.21.15.81:0/198599134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fec8743500 con 0x55fec8831e60 2024-05-09T00:04:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.063+0000 7f00ab7fe700 1 --2- 172.21.15.81:0/198599134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831e60 0x55fec8838230 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f00a0000c00 tx=0x7f00a0011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a4ee48059f2786 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.063+0000 7f0092ffd700 1 -- 172.21.15.81:0/198599134 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a000e8e0 con 0x55fec8831e60 2024-05-09T00:04:44.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.063+0000 7f0092ffd700 1 -- 172.21.15.81:0/198599134 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00a00056c0 con 0x55fec8831e60 2024-05-09T00:04:44.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.063+0000 7f0092ffd700 1 -- 172.21.15.81:0/198599134 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0023660 con 0x55fec8831e60 2024-05-09T00:04:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.063+0000 7f00be4d7b80 1 -- 172.21.15.81:0/198599134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831e60 msgr2=0x55fec8838230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.063+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/198599134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831e60 0x55fec8838230 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f00a0000c00 tx=0x7f00a0011720 comp rx=0 tx=0).stop 2024-05-09T00:04:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.064+0000 7f00be4d7b80 1 -- 172.21.15.81:0/198599134 shutdown_connections 2024-05-09T00:04:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.064+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/198599134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8835e40 0x55fec8839e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.064+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/198599134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8831540 0x55fec8827910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.064+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/198599134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831e60 0x55fec8838230 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.064+0000 7f00be4d7b80 1 -- 172.21.15.81:0/198599134 >> 172.21.15.81:0/198599134 conn(0x55fec878b1b0 msgr2=0x55fec882bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.064+0000 7f00be4d7b80 1 -- 172.21.15.81:0/198599134 shutdown_connections 2024-05-09T00:04:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.064+0000 7f00be4d7b80 1 -- 172.21.15.81:0/198599134 wait complete. 2024-05-09T00:04:44.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.064+0000 7f00be4d7b80 1 -- start start 2024-05-09T00:04:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.064+0000 7f00be4d7b80 1 Processor -- start 2024-05-09T00:04:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00be4d7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831540 0x55fec8842460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00be4d7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8831e60 0x55fec883fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00be4d7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8835e40 0x55fec8840600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00be4d7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec8840ca0 con 0x55fec8831540 2024-05-09T00:04:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00be4d7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec8840e10 con 0x55fec8831e60 2024-05-09T00:04:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00be4d7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fec88a0480 con 0x55fec8835e40 2024-05-09T00:04:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00be4d7b80 10 client.0 _ll_register_callbacks cb 0x7f00a0009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00abfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831540 0x55fec8842460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00abfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831540 0x55fec8842460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41650/0 (socket says 172.21.15.81:41650) 2024-05-09T00:04:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00abfff700 1 -- 172.21.15.81:0/166797977 learned_addr learned my addr 172.21.15.81:0/166797977 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00ab7fe700 1 --2- 172.21.15.81:0/166797977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8831e60 0x55fec883fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00b08ba700 1 --2- 172.21.15.81:0/166797977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8835e40 0x55fec8840600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.064 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00abfff700 1 -- 172.21.15.81:0/166797977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8835e40 msgr2=0x55fec8840600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00abfff700 1 --2- 172.21.15.81:0/166797977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8835e40 0x55fec8840600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00abfff700 1 -- 172.21.15.81:0/166797977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8831e60 msgr2=0x55fec883fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00abfff700 1 --2- 172.21.15.81:0/166797977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8831e60 0x55fec883fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00abfff700 1 -- 172.21.15.81:0/166797977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fec85aab00 con 0x55fec8831540 2024-05-09T00:04:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00ab7fe700 1 --2- 172.21.15.81:0/166797977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8831e60 0x55fec883fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00abfff700 1 --2- 172.21.15.81:0/166797977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831540 0x55fec8842460 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x55fec884dc80 tx=0x7f009c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f5e83704ed01e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f008b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f008b7fe700 1 -- 172.21.15.81:0/166797977 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c024040 con 0x55fec8831540 2024-05-09T00:04:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f008b7fe700 1 -- 172.21.15.81:0/166797977 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f009c01f730 con 0x55fec8831540 2024-05-09T00:04:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.065+0000 7f00be4d7b80 1 -- 172.21.15.81:0/166797977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f00a0019c50 con 0x55fec8831540 2024-05-09T00:04:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.066+0000 7f008b7fe700 1 -- 172.21.15.81:0/166797977 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f009c01f8f0 con 0x55fec8831540 2024-05-09T00:04:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.066+0000 7f00be4d7b80 10 client.15855 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.066+0000 7f00be4d7b80 1 -- 172.21.15.81:0/166797977 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fec8602c70 con 0x55fec8831540 2024-05-09T00:04:44.065 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.066+0000 7f008b7fe700 1 -- 172.21.15.81:0/166797977 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00a0019c50 con 0x55fec8831540 2024-05-09T00:04:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.066+0000 7f008b7fe700 1 -- 172.21.15.81:0/166797977 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f009c03b480 con 0x55fec8831540 2024-05-09T00:04:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.066+0000 7f00be4d7b80 10 client.15855 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.066+0000 7f00be4d7b80 10 client.15855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.066+0000 7f00be4d7b80 20 client.15855 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.066+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/166797977 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fec88a1c70 0x55fec88a4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.066+0000 7f00be4d7b80 4 client.15855 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:04:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.066+0000 7f00be4d7b80 1 -- 172.21.15.81:0/166797977 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fec8775e60 con 0x55fec88a1c70 2024-05-09T00:04:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.066+0000 7f00ab7fe700 1 --2- 172.21.15.81:0/166797977 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fec88a1c70 0x55fec88a4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.067+0000 7f00ab7fe700 1 --2- 172.21.15.81:0/166797977 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fec88a1c70 0x55fec88a4090 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0a74e52ed748382 server_cookie=1274cdc91b11abaf in_seq=0 out_seq=0 2024-05-09T00:04:44.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.067+0000 7f008b7fe700 10 client.15855 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.075+0000 7f008b7fe700 1 -- 172.21.15.81:0/166797977 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fec8775e60 con 0x55fec88a1c70 2024-05-09T00:04:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.076+0000 7f008b7fe700 10 client.15855 handle_command_reply: tid=0 2024-05-09T00:04:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.076+0000 7f00be4d7b80 1 client.15855 shutdown 2024-05-09T00:04:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.076+0000 7f00be4d7b80 1 -- 172.21.15.81:0/166797977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831540 msgr2=0x55fec8842460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.076+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/166797977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831540 0x55fec8842460 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x55fec884dc80 tx=0x7f009c0047c0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.076+0000 7f00be4d7b80 1 -- 172.21.15.81:0/166797977 shutdown_connections 2024-05-09T00:04:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.076+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/166797977 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fec88a1c70 0x55fec88a4090 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.076+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/166797977 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fec8835e40 0x55fec8840600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.076+0000 7f008b7fe700 0 client.15855 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.076+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/166797977 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fec8831540 0x55fec8842460 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.076+0000 7f00be4d7b80 1 --2- 172.21.15.81:0/166797977 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fec8831e60 0x55fec883fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.076+0000 7f00be4d7b80 1 -- 172.21.15.81:0/166797977 >> 172.21.15.81:0/166797977 conn(0x55fec878b1b0 msgr2=0x55fec88291e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.076+0000 7f00be4d7b80 1 -- 172.21.15.81:0/166797977 shutdown_connections 2024-05-09T00:04:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.076+0000 7f00be4d7b80 1 -- 172.21.15.81:0/166797977 wait complete. 2024-05-09T00:04:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.076+0000 7f00be4d7b80 20 client.15855 trim_cache size 0 max 16384 2024-05-09T00:04:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:04:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:04:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:04:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:04:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.077+0000 7f00b231d700 1 -- 172.21.15.81:0/2231560849 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f00940a1290 msgr2=0x7f00940a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.077+0000 7f00b231d700 1 --2- 172.21.15.81:0/2231560849 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f00940a1290 0x7f00940a3750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f009c009be0 tx=0x7f009c009260 comp rx=0 tx=0).stop 2024-05-09T00:04:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.077+0000 7f00b231d700 1 -- 172.21.15.81:0/2231560849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00ac107020 msgr2=0x7f00ac19be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.077+0000 7f00b231d700 1 --2- 172.21.15.81:0/2231560849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00ac107020 0x7f00ac19be80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f00a400bd50 tx=0x7f00a400bd80 comp rx=0 tx=0).stop 2024-05-09T00:04:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.077+0000 7f00b231d700 1 -- 172.21.15.81:0/2231560849 shutdown_connections 2024-05-09T00:04:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.077+0000 7f00b231d700 1 --2- 172.21.15.81:0/2231560849 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f00940a1290 0x7f00940a3750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.077+0000 7f00b231d700 1 --2- 172.21.15.81:0/2231560849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f00ac0ff410 0x7f00ac1975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.077+0000 7f00b231d700 1 --2- 172.21.15.81:0/2231560849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00ac107020 0x7f00ac19be80 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.077+0000 7f00b231d700 1 --2- 172.21.15.81:0/2231560849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f00ac0ffdd0 0x7f00ac197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.077+0000 7f00b231d700 1 -- 172.21.15.81:0/2231560849 >> 172.21.15.81:0/2231560849 conn(0x7f00ac0763a0 msgr2=0x7f00ac103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.077+0000 7f00b231d700 1 -- 172.21.15.81:0/2231560849 shutdown_connections 2024-05-09T00:04:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:44.077+0000 7f00b231d700 1 -- 172.21.15.81:0/2231560849 wait complete. 2024-05-09T00:04:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.154+0000 7f5fb35ec700 1 -- 172.21.15.81:0/2744615286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fac101140 msgr2=0x7f5fac104c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.154+0000 7f5fb35ec700 1 --2- 172.21.15.81:0/2744615286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fac101140 0x7f5fac104c60 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009990 tx=0x7f5f9c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.154+0000 7f5fb35ec700 1 -- 172.21.15.81:0/2744615286 shutdown_connections 2024-05-09T00:04:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.154+0000 7f5fb35ec700 1 --2- 172.21.15.81:0/2744615286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fac105390 0x7f5fac10cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.154+0000 7f5fb35ec700 1 --2- 172.21.15.81:0/2744615286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fac100790 0x7f5fac100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.154+0000 7f5fb35ec700 1 --2- 172.21.15.81:0/2744615286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fac101140 0x7f5fac104c60 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.154+0000 7f5fb35ec700 1 -- 172.21.15.81:0/2744615286 >> 172.21.15.81:0/2744615286 conn(0x7f5fac0763a0 msgr2=0x7f5fac0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.154+0000 7f5fb35ec700 1 -- 172.21.15.81:0/2744615286 shutdown_connections 2024-05-09T00:04:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.154+0000 7f5fb35ec700 1 -- 172.21.15.81:0/2744615286 wait complete. 2024-05-09T00:04:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb35ec700 1 Processor -- start 2024-05-09T00:04:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb35ec700 1 -- start start 2024-05-09T00:04:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb35ec700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fac100790 0x7f5fac197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb35ec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fac105390 0x7f5fac197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb35ec700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fac19be70 0x7f5fac19c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb35ec700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac19c8f0 con 0x7f5fac105390 2024-05-09T00:04:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb35ec700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac19ca60 con 0x7f5fac100790 2024-05-09T00:04:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb35ec700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac19cc20 con 0x7f5fac19be70 2024-05-09T00:04:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb0b87700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fac105390 0x7f5fac197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb0b87700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fac105390 0x7f5fac197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41656/0 (socket says 172.21.15.81:41656) 2024-05-09T00:04:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb0b87700 1 -- 172.21.15.81:0/2507798605 learned_addr learned my addr 172.21.15.81:0/2507798605 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb1388700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fac100790 0x7f5fac197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb1b89700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fac19be70 0x7f5fac19c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb0b87700 1 -- 172.21.15.81:0/2507798605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fac19be70 msgr2=0x7f5fac19c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb0b87700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fac19be70 0x7f5fac19c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb0b87700 1 -- 172.21.15.81:0/2507798605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fac100790 msgr2=0x7f5fac197590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb0b87700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fac100790 0x7f5fac197590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb0b87700 1 -- 172.21.15.81:0/2507798605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c0095f0 con 0x7f5fac105390 2024-05-09T00:04:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.155+0000 7f5fb1b89700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fac19be70 0x7f5fac19c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.156+0000 7f5fb0b87700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fac105390 0x7f5fac197ad0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c0059d0 tx=0x7f5f9c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.156+0000 7f5fa27fc700 1 -- 172.21.15.81:0/2507798605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c01d070 con 0x7f5fac105390 2024-05-09T00:04:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.156+0000 7f5fb35ec700 1 -- 172.21.15.81:0/2507798605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fac1a4120 con 0x7f5fac105390 2024-05-09T00:04:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.156+0000 7f5fa27fc700 1 -- 172.21.15.81:0/2507798605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f9c00fb30 con 0x7f5fac105390 2024-05-09T00:04:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.156+0000 7f5fa27fc700 1 -- 172.21.15.81:0/2507798605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c022bf0 con 0x7f5fac105390 2024-05-09T00:04:44.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.156+0000 7f5fb35ec700 1 -- 172.21.15.81:0/2507798605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fac1a45a0 con 0x7f5fac105390 2024-05-09T00:04:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.158+0000 7f5fa27fc700 1 -- 172.21.15.81:0/2507798605 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f5f9c00fca0 con 0x7f5fac105390 2024-05-09T00:04:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.158+0000 7f5fa27fc700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5f980a1290 0x7f5f980a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.159+0000 7f5fb1388700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5f980a1290 0x7f5f980a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.159+0000 7f5fa27fc700 1 -- 172.21.15.81:0/2507798605 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f5f9c0ce1d0 con 0x7f5fac105390 2024-05-09T00:04:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.159+0000 7f5fb1388700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5f980a1290 0x7f5f980a3750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8005950 tx=0x7f5fa800a300 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.159+0000 7f5fbf7a6b80 1 Processor -- start 2024-05-09T00:04:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fbf7a6b80 1 -- start start 2024-05-09T00:04:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fbf7a6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fbf7a6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e14720 0x55aee3e0e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fbf7a6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e0e890 0x55aee3e0ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fbf7a6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee3d65150 con 0x55aee3e14720 2024-05-09T00:04:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fbf7a6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee3d62b10 con 0x55aee3e0e890 2024-05-09T00:04:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fbf7a6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee3d5e400 con 0x55aee3e13e00 2024-05-09T00:04:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fb0b87700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e14720 0x55aee3e0e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fb0b87700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e14720 0x55aee3e0e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41668/0 (socket says 172.21.15.81:41668) 2024-05-09T00:04:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fb0b87700 1 -- 172.21.15.81:0/412796616 learned_addr learned my addr 172.21.15.81:0/412796616 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fb1b89700 1 --2- 172.21.15.81:0/412796616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e0e890 0x55aee3e0ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fb0b87700 1 -- 172.21.15.81:0/412796616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 msgr2=0x55aee3e141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fb1388700 1 --2- 172.21.15.81:0/412796616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fb0b87700 1 --2- 172.21.15.81:0/412796616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e141e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fb0b87700 1 -- 172.21.15.81:0/412796616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e0e890 msgr2=0x55aee3e0ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fb0b87700 1 --2- 172.21.15.81:0/412796616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e0e890 0x55aee3e0ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fb0b87700 1 -- 172.21.15.81:0/412796616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aee3bdf3b0 con 0x55aee3e14720 2024-05-09T00:04:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5fb0b87700 1 --2- 172.21.15.81:0/412796616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e14720 0x55aee3e0e350 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c0a3230 tx=0x7f5f9c0226c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1207f14d470448b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5f977fe700 1 -- 172.21.15.81:0/412796616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c09f1a0 con 0x55aee3e14720 2024-05-09T00:04:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5f977fe700 1 -- 172.21.15.81:0/412796616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f9c0a3760 con 0x55aee3e14720 2024-05-09T00:04:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.160+0000 7f5f977fe700 1 -- 172.21.15.81:0/412796616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c09aac0 con 0x55aee3e14720 2024-05-09T00:04:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.161+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/412796616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e14720 msgr2=0x55aee3e0e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.161+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/412796616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e14720 0x55aee3e0e350 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c0a3230 tx=0x7f5f9c0226c0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.161+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/412796616 shutdown_connections 2024-05-09T00:04:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.161+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/412796616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e0e890 0x55aee3e0ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.161+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/412796616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e141e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.161+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/412796616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e14720 0x55aee3e0e350 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.161+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/412796616 >> 172.21.15.81:0/412796616 conn(0x55aee3d6c210 msgr2=0x55aee3e08df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.161+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/412796616 shutdown_connections 2024-05-09T00:04:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.161+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/412796616 wait complete. 2024-05-09T00:04:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.161+0000 7f5fbf7a6b80 1 -- start start 2024-05-09T00:04:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fbf7a6b80 1 Processor -- start 2024-05-09T00:04:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fbf7a6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e0e890 0x55aee3e17a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fbf7a6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e17f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fbf7a6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e14720 0x55aee3e184d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fbf7a6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee3cfa560 con 0x55aee3e0e890 2024-05-09T00:04:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fbf7a6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee3cfa200 con 0x55aee3e14720 2024-05-09T00:04:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fbf7a6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee3be16a0 con 0x55aee3e13e00 2024-05-09T00:04:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fbf7a6b80 10 client.0 _ll_register_callbacks cb 0x55aee3d03b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fb1388700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e0e890 0x55aee3e17a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fb1388700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e0e890 0x55aee3e17a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41682/0 (socket says 172.21.15.81:41682) 2024-05-09T00:04:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fb1388700 1 -- 172.21.15.81:0/3649905248 learned_addr learned my addr 172.21.15.81:0/3649905248 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fb1b89700 1 --2- 172.21.15.81:0/3649905248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e14720 0x55aee3e184d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fb0b87700 1 --2- 172.21.15.81:0/3649905248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e17f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fb1388700 1 -- 172.21.15.81:0/3649905248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 msgr2=0x55aee3e17f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fb1388700 1 --2- 172.21.15.81:0/3649905248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e17f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fb1388700 1 -- 172.21.15.81:0/3649905248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e14720 msgr2=0x55aee3e184d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fb1388700 1 --2- 172.21.15.81:0/3649905248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e14720 0x55aee3e184d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.162+0000 7f5fb1388700 1 -- 172.21.15.81:0/3649905248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fac1a45a0 con 0x55aee3e0e890 2024-05-09T00:04:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5fb1388700 1 --2- 172.21.15.81:0/3649905248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e0e890 0x55aee3e17a50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80109e0 tx=0x7f5fa80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1d8603e81e8ea9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5f94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5f94ff9700 1 -- 172.21.15.81:0/3649905248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800fee0 con 0x55aee3e0e890 2024-05-09T00:04:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5f94ff9700 1 -- 172.21.15.81:0/3649905248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f5fa801b820 con 0x55aee3e0e890 2024-05-09T00:04:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3649905248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aee3cb7270 con 0x55aee3e0e890 2024-05-09T00:04:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5f94ff9700 1 -- 172.21.15.81:0/3649905248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fa801b9e0 con 0x55aee3e0e890 2024-05-09T00:04:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5fbf7a6b80 10 client.15867 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:44.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3649905248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55aee3b8bb60 con 0x55aee3e0e890 2024-05-09T00:04:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5f94ff9700 1 -- 172.21.15.81:0/3649905248 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5fa8031080 con 0x55aee3e0e890 2024-05-09T00:04:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5f94ff9700 1 -- 172.21.15.81:0/3649905248 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5fa802b030 con 0x55aee3e0e890 2024-05-09T00:04:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5fbf7a6b80 10 client.15867 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5fbf7a6b80 10 client.15867 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5fbf7a6b80 20 client.15867 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/3649905248 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55aee3e27e80 0x55aee3e2a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5fbf7a6b80 4 client.15867 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.163+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3649905248 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aee3ddd810 con 0x55aee3e27e80 2024-05-09T00:04:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.164+0000 7f5fb0b87700 1 --2- 172.21.15.81:0/3649905248 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55aee3e27e80 0x55aee3e2a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.164+0000 7f5fb0b87700 1 --2- 172.21.15.81:0/3649905248 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55aee3e27e80 0x55aee3e2a2a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=230ae32b336552ac server_cookie=d1d2434bbf3abfaf in_seq=0 out_seq=0 2024-05-09T00:04:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.164+0000 7f5f94ff9700 10 client.15867 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5f94ff9700 1 -- 172.21.15.81:0/3649905248 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55aee3ddd810 con 0x55aee3e27e80 2024-05-09T00:04:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5f94ff9700 10 client.15867 handle_command_reply: tid=0 2024-05-09T00:04:44.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5fbf7a6b80 1 client.15867 shutdown 2024-05-09T00:04:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3649905248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e0e890 msgr2=0x55aee3e17a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/3649905248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e0e890 0x55aee3e17a50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80109e0 tx=0x7f5fa80047c0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3649905248 shutdown_connections 2024-05-09T00:04:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/3649905248 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55aee3e27e80 0x55aee3e2a2a0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/3649905248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e14720 0x55aee3e184d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/3649905248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e0e890 0x55aee3e17a50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5f94ff9700 0 client.15867 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/3649905248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e17f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3649905248 >> 172.21.15.81:0/3649905248 conn(0x55aee3d6c210 msgr2=0x55aee3e085a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3649905248 shutdown_connections 2024-05-09T00:04:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3649905248 wait complete. 2024-05-09T00:04:44.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.165+0000 7f5fbf7a6b80 20 client.15867 trim_cache size 0 max 16384 2024-05-09T00:04:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.182+0000 7f5fbf7a6b80 1 Processor -- start 2024-05-09T00:04:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.182+0000 7f5fbf7a6b80 1 -- start start 2024-05-09T00:04:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.182+0000 7f5fbf7a6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e0e890 0x55aee3e0e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.182+0000 7f5fbf7a6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e08d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.182+0000 7f5fbf7a6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e14720 0x55aee3e1eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.182+0000 7f5fbf7a6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee3e01120 con 0x55aee3e14720 2024-05-09T00:04:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.182+0000 7f5fbf7a6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee3e05df0 con 0x55aee3e0e890 2024-05-09T00:04:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.182+0000 7f5fbf7a6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee3e0aa90 con 0x55aee3e13e00 2024-05-09T00:04:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.183+0000 7f5fb1b89700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e14720 0x55aee3e1eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.183+0000 7f5fb1b89700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e14720 0x55aee3e1eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41688/0 (socket says 172.21.15.81:41688) 2024-05-09T00:04:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.183+0000 7f5fb1b89700 1 -- 172.21.15.81:0/1876817757 learned_addr learned my addr 172.21.15.81:0/1876817757 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.183+0000 7f5fb0b87700 1 --2- 172.21.15.81:0/1876817757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e08d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.183+0000 7f5fb1388700 1 --2- 172.21.15.81:0/1876817757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e0e890 0x55aee3e0e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.183+0000 7f5fb1b89700 1 -- 172.21.15.81:0/1876817757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 msgr2=0x55aee3e08d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.183+0000 7f5fb1b89700 1 --2- 172.21.15.81:0/1876817757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e08d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.183+0000 7f5fb1b89700 1 -- 172.21.15.81:0/1876817757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e0e890 msgr2=0x55aee3e0e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.183+0000 7f5fb1b89700 1 --2- 172.21.15.81:0/1876817757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e0e890 0x55aee3e0e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.183+0000 7f5fb1b89700 1 -- 172.21.15.81:0/1876817757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aee3d24560 con 0x55aee3e14720 2024-05-09T00:04:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.183+0000 7f5fb1b89700 1 --2- 172.21.15.81:0/1876817757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e14720 0x55aee3e1eee0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4007580 tx=0x7f5fa40075b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de3822bcf61ee18 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.183+0000 7f5f97fff700 1 -- 172.21.15.81:0/1876817757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4017610 con 0x55aee3e14720 2024-05-09T00:04:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.183+0000 7f5f97fff700 1 -- 172.21.15.81:0/1876817757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5fa400f040 con 0x55aee3e14720 2024-05-09T00:04:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.183+0000 7f5f97fff700 1 -- 172.21.15.81:0/1876817757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa401fa30 con 0x55aee3e14720 2024-05-09T00:04:44.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.184+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/1876817757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e14720 msgr2=0x55aee3e1eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.184+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/1876817757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e14720 0x55aee3e1eee0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4007580 tx=0x7f5fa40075b0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.184+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/1876817757 shutdown_connections 2024-05-09T00:04:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.184+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/1876817757 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e0e890 0x55aee3e0e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.184+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/1876817757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e14720 0x55aee3e1eee0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.184+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/1876817757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e08d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.184+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/1876817757 >> 172.21.15.81:0/1876817757 conn(0x55aee3d6c210 msgr2=0x55aee3e18350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.184+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/1876817757 shutdown_connections 2024-05-09T00:04:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.184+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/1876817757 wait complete. 2024-05-09T00:04:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.184+0000 7f5fbf7a6b80 1 -- start start 2024-05-09T00:04:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.184+0000 7f5fbf7a6b80 1 Processor -- start 2024-05-09T00:04:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.184+0000 7f5fbf7a6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e0e890 0x55aee3e77c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.184+0000 7f5fbf7a6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e781b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.184+0000 7f5fbf7a6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e14720 0x55aee3e72330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fbf7a6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee3e729d0 con 0x55aee3e0e890 2024-05-09T00:04:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fbf7a6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee3e72b40 con 0x55aee3e14720 2024-05-09T00:04:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fbf7a6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aee3e72d00 con 0x55aee3e13e00 2024-05-09T00:04:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fbf7a6b80 10 client.0 _ll_register_callbacks cb 0x55aee3d03b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fb1388700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e0e890 0x55aee3e77c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fb1388700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e0e890 0x55aee3e77c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41692/0 (socket says 172.21.15.81:41692) 2024-05-09T00:04:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fb1388700 1 -- 172.21.15.81:0/3008345564 learned_addr learned my addr 172.21.15.81:0/3008345564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fb0b87700 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e781b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fb1b89700 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e14720 0x55aee3e72330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fb1388700 1 -- 172.21.15.81:0/3008345564 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 msgr2=0x55aee3e781b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fb1388700 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e781b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fb1388700 1 -- 172.21.15.81:0/3008345564 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e14720 msgr2=0x55aee3e72330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fb1388700 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e14720 0x55aee3e72330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fb1388700 1 -- 172.21.15.81:0/3008345564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa4009d10 con 0x55aee3e0e890 2024-05-09T00:04:44.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fb0b87700 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e781b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fb1b89700 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e14720 0x55aee3e72330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fb1388700 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e0e890 0x55aee3e77c70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8025cc0 tx=0x7f5fa800a370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163d80e7e6ca62 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5f94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5f94ff9700 1 -- 172.21.15.81:0/3008345564 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa801b620 con 0x55aee3e0e890 2024-05-09T00:04:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5f94ff9700 1 -- 172.21.15.81:0/3008345564 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f5fa801b780 con 0x55aee3e0e890 2024-05-09T00:04:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3008345564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f9c0a3760 con 0x55aee3e0e890 2024-05-09T00:04:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5f94ff9700 1 -- 172.21.15.81:0/3008345564 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fa801b940 con 0x55aee3e0e890 2024-05-09T00:04:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fbf7a6b80 10 client.15873 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.185+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3008345564 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55aee3be3cd0 con 0x55aee3e0e890 2024-05-09T00:04:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.186+0000 7f5f94ff9700 1 -- 172.21.15.81:0/3008345564 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5fa8042080 con 0x55aee3e0e890 2024-05-09T00:04:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.186+0000 7f5f94ff9700 1 -- 172.21.15.81:0/3008345564 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5fa803c030 con 0x55aee3e0e890 2024-05-09T00:04:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.186+0000 7f5fbf7a6b80 10 client.15873 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:44.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.186+0000 7f5fbf7a6b80 10 client.15873 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.186+0000 7f5fbf7a6b80 20 client.15873 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.186+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55aee3e7fb00 0x55aee3e81f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.186+0000 7f5fbf7a6b80 4 client.15873 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:04:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.186+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3008345564 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55aee3d56ec0 con 0x55aee3e7fb00 2024-05-09T00:04:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.186+0000 7f5fb0b87700 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55aee3e7fb00 0x55aee3e81f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.186+0000 7f5f94ff9700 10 client.15873 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.186+0000 7f5fb0b87700 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55aee3e7fb00 0x55aee3e81f20 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83ca938bc2115b8d server_cookie=bde74413bcb2b9c4 in_seq=0 out_seq=0 2024-05-09T00:04:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.186+0000 7f5f94ff9700 1 -- 172.21.15.81:0/3008345564 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55aee3d56ec0 con 0x55aee3e7fb00 2024-05-09T00:04:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.186+0000 7f5f94ff9700 10 client.15873 handle_command_reply: tid=0 2024-05-09T00:04:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.186+0000 7f5fbf7a6b80 1 client.15873 shutdown 2024-05-09T00:04:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3008345564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e0e890 msgr2=0x55aee3e77c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e0e890 0x55aee3e77c70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8025cc0 tx=0x7f5fa800a370 comp rx=0 tx=0).stop 2024-05-09T00:04:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3008345564 shutdown_connections 2024-05-09T00:04:44.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55aee3e7fb00 0x55aee3e81f20 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aee3e14720 0x55aee3e72330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aee3e0e890 0x55aee3e77c70 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5f94ff9700 0 client.15873 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fbf7a6b80 1 --2- 172.21.15.81:0/3008345564 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aee3e13e00 0x55aee3e781b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3008345564 >> 172.21.15.81:0/3008345564 conn(0x55aee3d6c210 msgr2=0x55aee3e192f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3008345564 shutdown_connections 2024-05-09T00:04:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fbf7a6b80 1 -- 172.21.15.81:0/3008345564 wait complete. 2024-05-09T00:04:44.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fbf7a6b80 20 client.15873 trim_cache size 0 max 16384 2024-05-09T00:04:44.188 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:04:44.188 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:04:44.188 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:04:44.189 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:04:44.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fb35ec700 1 -- 172.21.15.81:0/2507798605 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5f980a1290 msgr2=0x7f5f980a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fb35ec700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5f980a1290 0x7f5f980a3750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8005950 tx=0x7f5fa800a300 comp rx=0 tx=0).stop 2024-05-09T00:04:44.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fb35ec700 1 -- 172.21.15.81:0/2507798605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fac105390 msgr2=0x7f5fac197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fb35ec700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fac105390 0x7f5fac197ad0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c0059d0 tx=0x7f5f9c009580 comp rx=0 tx=0).stop 2024-05-09T00:04:44.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fb35ec700 1 -- 172.21.15.81:0/2507798605 shutdown_connections 2024-05-09T00:04:44.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fb35ec700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5f980a1290 0x7f5f980a3750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fb35ec700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5fac100790 0x7f5fac197590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fb35ec700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fac19be70 0x7f5fac19c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fb35ec700 1 --2- 172.21.15.81:0/2507798605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fac105390 0x7f5fac197ad0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fb35ec700 1 -- 172.21.15.81:0/2507798605 >> 172.21.15.81:0/2507798605 conn(0x7f5fac0763a0 msgr2=0x7f5fac0ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fb35ec700 1 -- 172.21.15.81:0/2507798605 shutdown_connections 2024-05-09T00:04:44.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.187+0000 7f5fb35ec700 1 -- 172.21.15.81:0/2507798605 wait complete. 2024-05-09T00:04:44.193 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:04:44.193 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:04:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.362+0000 7f7659fba700 1 -- 172.21.15.81:0/2285599341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76540fff40 msgr2=0x7f7654100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.362+0000 7f7659fba700 1 --2- 172.21.15.81:0/2285599341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76540fff40 0x7f7654100320 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7648009990 tx=0x7f7648009ca0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.362+0000 7f7659fba700 1 -- 172.21.15.81:0/2285599341 shutdown_connections 2024-05-09T00:04:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.362+0000 7f7659fba700 1 --2- 172.21.15.81:0/2285599341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7654105060 0x7f765410cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.362+0000 7f7659fba700 1 --2- 172.21.15.81:0/2285599341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76540fff40 0x7f7654100320 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.362+0000 7f7659fba700 1 --2- 172.21.15.81:0/2285599341 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76541008f0 0x7f7654104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.362+0000 7f7659fba700 1 -- 172.21.15.81:0/2285599341 >> 172.21.15.81:0/2285599341 conn(0x7f76540fb7e0 msgr2=0x7f76540fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.362+0000 7f7659fba700 1 -- 172.21.15.81:0/2285599341 shutdown_connections 2024-05-09T00:04:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.362+0000 7f7659fba700 1 -- 172.21.15.81:0/2285599341 wait complete. 2024-05-09T00:04:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.362+0000 7f7659fba700 1 Processor -- start 2024-05-09T00:04:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7659fba700 1 -- start start 2024-05-09T00:04:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7659fba700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76540fff40 0x7f76541972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7659fba700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7654105060 0x7f7654197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7659fba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765419bbd0 0x7f765419c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7659fba700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765419c650 con 0x7f765419bbd0 2024-05-09T00:04:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7659fba700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765419c7c0 con 0x7f7654105060 2024-05-09T00:04:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7659fba700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765419c980 con 0x7f76540fff40 2024-05-09T00:04:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7653fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765419bbd0 0x7f765419c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7653fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765419bbd0 0x7f765419c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41706/0 (socket says 172.21.15.81:41706) 2024-05-09T00:04:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7653fff700 1 -- 172.21.15.81:0/281279103 learned_addr learned my addr 172.21.15.81:0/281279103 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7652ffd700 1 --2- 172.21.15.81:0/281279103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7654105060 0x7f7654197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f76537fe700 1 --2- 172.21.15.81:0/281279103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76540fff40 0x7f76541972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7653fff700 1 -- 172.21.15.81:0/281279103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76540fff40 msgr2=0x7f76541972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7653fff700 1 --2- 172.21.15.81:0/281279103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76540fff40 0x7f76541972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7653fff700 1 -- 172.21.15.81:0/281279103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7654105060 msgr2=0x7f7654197830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7653fff700 1 --2- 172.21.15.81:0/281279103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7654105060 0x7f7654197830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7653fff700 1 -- 172.21.15.81:0/281279103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76480095f0 con 0x7f765419bbd0 2024-05-09T00:04:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.363+0000 7f7653fff700 1 --2- 172.21.15.81:0/281279103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765419bbd0 0x7f765419c050 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f764c00ef30 tx=0x7f764c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.364+0000 7f7650ff9700 1 -- 172.21.15.81:0/281279103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c018070 con 0x7f765419bbd0 2024-05-09T00:04:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.364+0000 7f7650ff9700 1 -- 172.21.15.81:0/281279103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f764c00f040 con 0x7f765419bbd0 2024-05-09T00:04:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.364+0000 7f7659fba700 1 -- 172.21.15.81:0/281279103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76541a3e80 con 0x7f765419bbd0 2024-05-09T00:04:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.364+0000 7f7650ff9700 1 -- 172.21.15.81:0/281279103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c00cd00 con 0x7f765419bbd0 2024-05-09T00:04:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.364+0000 7f7659fba700 1 -- 172.21.15.81:0/281279103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76541a4360 con 0x7f765419bbd0 2024-05-09T00:04:44.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.365+0000 7f7659fba700 1 -- 172.21.15.81:0/281279103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76541092e0 con 0x7f765419bbd0 2024-05-09T00:04:44.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.366+0000 7f7650ff9700 1 -- 172.21.15.81:0/281279103 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f764c003a00 con 0x7f765419bbd0 2024-05-09T00:04:44.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.366+0000 7f7650ff9700 1 --2- 172.21.15.81:0/281279103 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f763c0a1290 0x7f763c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.366+0000 7f76537fe700 1 --2- 172.21.15.81:0/281279103 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f763c0a1290 0x7f763c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.366+0000 7f7650ff9700 1 -- 172.21.15.81:0/281279103 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f764c0cd0f0 con 0x7f765419bbd0 2024-05-09T00:04:44.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.367+0000 7f76537fe700 1 --2- 172.21.15.81:0/281279103 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f763c0a1290 0x7f763c0a3750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f764800b2e0 tx=0x7f7648005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.370+0000 7f7650ff9700 1 -- 172.21.15.81:0/281279103 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f764c0965d0 con 0x7f765419bbd0 2024-05-09T00:04:44.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.611+0000 7f7659fba700 1 -- 172.21.15.81:0/281279103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7654198690 con 0x7f765419bbd0 2024-05-09T00:04:44.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.612+0000 7f7650ff9700 1 -- 172.21.15.81:0/281279103 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7f764c025380 con 0x7f765419bbd0 2024-05-09T00:04:44.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:04:44.606 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:04:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.614+0000 7f7659fba700 1 -- 172.21.15.81:0/281279103 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f763c0a1290 msgr2=0x7f763c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.614+0000 7f7659fba700 1 --2- 172.21.15.81:0/281279103 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f763c0a1290 0x7f763c0a3750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f764800b2e0 tx=0x7f7648005960 comp rx=0 tx=0).stop 2024-05-09T00:04:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.614+0000 7f7659fba700 1 -- 172.21.15.81:0/281279103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765419bbd0 msgr2=0x7f765419c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.614+0000 7f7659fba700 1 --2- 172.21.15.81:0/281279103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765419bbd0 0x7f765419c050 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f764c00ef30 tx=0x7f764c00c3a0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.614+0000 7f7659fba700 1 -- 172.21.15.81:0/281279103 shutdown_connections 2024-05-09T00:04:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.614+0000 7f7659fba700 1 --2- 172.21.15.81:0/281279103 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f763c0a1290 0x7f763c0a3750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.614+0000 7f7659fba700 1 --2- 172.21.15.81:0/281279103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f765419bbd0 0x7f765419c050 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.614+0000 7f7659fba700 1 --2- 172.21.15.81:0/281279103 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76540fff40 0x7f76541972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.614+0000 7f7659fba700 1 --2- 172.21.15.81:0/281279103 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7654105060 0x7f7654197830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.614+0000 7f7659fba700 1 -- 172.21.15.81:0/281279103 >> 172.21.15.81:0/281279103 conn(0x7f76540fb7e0 msgr2=0x7f76540683d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.614+0000 7f7659fba700 1 -- 172.21.15.81:0/281279103 shutdown_connections 2024-05-09T00:04:44.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.614+0000 7f7659fba700 1 -- 172.21.15.81:0/281279103 wait complete. 2024-05-09T00:04:44.610 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:04:44.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:04:44.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.752+0000 7f53b14c8700 1 -- 172.21.15.81:0/3857869360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53ac105160 msgr2=0x7f53ac10cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.752+0000 7f53b14c8700 1 --2- 172.21.15.81:0/3857869360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53ac105160 0x7f53ac10cce0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f53a400b0a0 tx=0x7f53a400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.752+0000 7f53b14c8700 1 -- 172.21.15.81:0/3857869360 shutdown_connections 2024-05-09T00:04:44.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.752+0000 7f53b14c8700 1 --2- 172.21.15.81:0/3857869360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53ac105160 0x7f53ac10cce0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.752+0000 7f53b14c8700 1 --2- 172.21.15.81:0/3857869360 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53ac100060 0x7f53ac100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.752+0000 7f53b14c8700 1 --2- 172.21.15.81:0/3857869360 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53ac100a10 0x7f53ac104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.752+0000 7f53b14c8700 1 -- 172.21.15.81:0/3857869360 >> 172.21.15.81:0/3857869360 conn(0x7f53ac076f40 msgr2=0x7f53ac077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.752+0000 7f53b14c8700 1 -- 172.21.15.81:0/3857869360 shutdown_connections 2024-05-09T00:04:44.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.752+0000 7f53b14c8700 1 -- 172.21.15.81:0/3857869360 wait complete. 2024-05-09T00:04:44.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.752+0000 7f53b14c8700 1 Processor -- start 2024-05-09T00:04:44.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53b14c8700 1 -- start start 2024-05-09T00:04:44.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53b14c8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53ac100060 0x7f53ac196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53b14c8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53ac105160 0x7f53ac1969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53b14c8700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53ac19ad40 0x7f53ac19b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53b14c8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac19b7c0 con 0x7f53ac100060 2024-05-09T00:04:44.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53b14c8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac19b930 con 0x7f53ac105160 2024-05-09T00:04:44.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53b14c8700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac19baf0 con 0x7f53ac19ad40 2024-05-09T00:04:44.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53aaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53ac100060 0x7f53ac196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53aaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53ac100060 0x7f53ac196460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41732/0 (socket says 172.21.15.81:41732) 2024-05-09T00:04:44.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53aaffd700 1 -- 172.21.15.81:0/3708114438 learned_addr learned my addr 172.21.15.81:0/3708114438 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53aa7fc700 1 --2- 172.21.15.81:0/3708114438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53ac105160 0x7f53ac1969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53ab7fe700 1 --2- 172.21.15.81:0/3708114438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53ac19ad40 0x7f53ac19b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53aaffd700 1 -- 172.21.15.81:0/3708114438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53ac19ad40 msgr2=0x7f53ac19b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53aaffd700 1 --2- 172.21.15.81:0/3708114438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53ac19ad40 0x7f53ac19b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53aaffd700 1 -- 172.21.15.81:0/3708114438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53ac105160 msgr2=0x7f53ac1969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53aaffd700 1 --2- 172.21.15.81:0/3708114438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53ac105160 0x7f53ac1969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.753+0000 7f53aaffd700 1 -- 172.21.15.81:0/3708114438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a4009d00 con 0x7f53ac100060 2024-05-09T00:04:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.754+0000 7f53aaffd700 1 --2- 172.21.15.81:0/3708114438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53ac100060 0x7f53ac196460 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f53a000d740 tx=0x7f53a000da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.754+0000 7f5393fff700 1 -- 172.21.15.81:0/3708114438 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a000f900 con 0x7f53ac100060 2024-05-09T00:04:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.754+0000 7f5393fff700 1 -- 172.21.15.81:0/3708114438 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53a0017420 con 0x7f53ac100060 2024-05-09T00:04:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.754+0000 7f53b14c8700 1 -- 172.21.15.81:0/3708114438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ac068050 con 0x7f53ac100060 2024-05-09T00:04:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.754+0000 7f5393fff700 1 -- 172.21.15.81:0/3708114438 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a000e680 con 0x7f53ac100060 2024-05-09T00:04:44.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.754+0000 7f53b14c8700 1 -- 172.21.15.81:0/3708114438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac068560 con 0x7f53ac100060 2024-05-09T00:04:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.756+0000 7f5393fff700 1 -- 172.21.15.81:0/3708114438 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f53a0017590 con 0x7f53ac100060 2024-05-09T00:04:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.757+0000 7f5393fff700 1 --2- 172.21.15.81:0/3708114438 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f53940a1290 0x7f53940a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.757+0000 7f53aa7fc700 1 --2- 172.21.15.81:0/3708114438 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f53940a1290 0x7f53940a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.757+0000 7f5393fff700 1 -- 172.21.15.81:0/3708114438 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f53a0013070 con 0x7f53ac100060 2024-05-09T00:04:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.757+0000 7f53aa7fc700 1 --2- 172.21.15.81:0/3708114438 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f53940a1290 0x7f53940a3750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f53ac1979b0 tx=0x7f539c00b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53bd682b80 1 Processor -- start 2024-05-09T00:04:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53bd682b80 1 -- start start 2024-05-09T00:04:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53bd682b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f24e00 0x55a2f6f251e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53bd682b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f25720 0x55a2f6f1f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53bd682b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f1f890 0x55a2f6f1fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53bd682b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6e76150 con 0x55a2f6f1f890 2024-05-09T00:04:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53bd682b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6e73b10 con 0x55a2f6f25720 2024-05-09T00:04:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53bd682b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6e6f400 con 0x55a2f6f24e00 2024-05-09T00:04:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f1f890 0x55a2f6f1fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f1f890 0x55a2f6f1fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41734/0 (socket says 172.21.15.81:41734) 2024-05-09T00:04:44.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53ab7fe700 1 -- 172.21.15.81:0/1438370169 learned_addr learned my addr 172.21.15.81:0/1438370169 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53aa7fc700 1 --2- 172.21.15.81:0/1438370169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f25720 0x55a2f6f1f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53aaffd700 1 --2- 172.21.15.81:0/1438370169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f24e00 0x55a2f6f251e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53ab7fe700 1 -- 172.21.15.81:0/1438370169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f24e00 msgr2=0x55a2f6f251e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53ab7fe700 1 --2- 172.21.15.81:0/1438370169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f24e00 0x55a2f6f251e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53ab7fe700 1 -- 172.21.15.81:0/1438370169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f25720 msgr2=0x55a2f6f1f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53ab7fe700 1 --2- 172.21.15.81:0/1438370169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f25720 0x55a2f6f1f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.758+0000 7f53ab7fe700 1 -- 172.21.15.81:0/1438370169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2f6cf03b0 con 0x55a2f6f1f890 2024-05-09T00:04:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.759+0000 7f53ab7fe700 1 --2- 172.21.15.81:0/1438370169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f1f890 0x55a2f6f1fcd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f53a4015000 tx=0x7f53a4007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248c836c77df2ba7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.759+0000 7f53917fa700 1 -- 172.21.15.81:0/1438370169 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a400e040 con 0x55a2f6f1f890 2024-05-09T00:04:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.759+0000 7f53917fa700 1 -- 172.21.15.81:0/1438370169 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53a4009b80 con 0x55a2f6f1f890 2024-05-09T00:04:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.759+0000 7f53917fa700 1 -- 172.21.15.81:0/1438370169 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a4007950 con 0x55a2f6f1f890 2024-05-09T00:04:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.759+0000 7f53bd682b80 1 -- 172.21.15.81:0/1438370169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f1f890 msgr2=0x55a2f6f1fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.759+0000 7f53bd682b80 1 --2- 172.21.15.81:0/1438370169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f1f890 0x55a2f6f1fcd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f53a4015000 tx=0x7f53a4007ca0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.759+0000 7f53bd682b80 1 -- 172.21.15.81:0/1438370169 shutdown_connections 2024-05-09T00:04:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.759+0000 7f53bd682b80 1 --2- 172.21.15.81:0/1438370169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f1f890 0x55a2f6f1fcd0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.759+0000 7f53bd682b80 1 --2- 172.21.15.81:0/1438370169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f24e00 0x55a2f6f251e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.759+0000 7f53bd682b80 1 --2- 172.21.15.81:0/1438370169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f25720 0x55a2f6f1f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.759+0000 7f53bd682b80 1 -- 172.21.15.81:0/1438370169 >> 172.21.15.81:0/1438370169 conn(0x55a2f6e7d210 msgr2=0x55a2f6f19df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.759+0000 7f53bd682b80 1 -- 172.21.15.81:0/1438370169 shutdown_connections 2024-05-09T00:04:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.759+0000 7f53bd682b80 1 -- 172.21.15.81:0/1438370169 wait complete. 2024-05-09T00:04:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53bd682b80 1 -- start start 2024-05-09T00:04:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53bd682b80 1 Processor -- start 2024-05-09T00:04:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53bd682b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f1f890 0x55a2f6f28ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53bd682b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f24e00 0x55a2f6f29010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53bd682b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f25720 0x55a2f6f29550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53bd682b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6e0b560 con 0x55a2f6f24e00 2024-05-09T00:04:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53bd682b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6e0b200 con 0x55a2f6f25720 2024-05-09T00:04:44.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53bd682b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6cf26a0 con 0x55a2f6f1f890 2024-05-09T00:04:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53bd682b80 10 client.0 _ll_register_callbacks cb 0x55a2f6e14b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53aa7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f24e00 0x55a2f6f29010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53aa7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f24e00 0x55a2f6f29010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41744/0 (socket says 172.21.15.81:41744) 2024-05-09T00:04:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53aa7fc700 1 -- 172.21.15.81:0/1255922116 learned_addr learned my addr 172.21.15.81:0/1255922116 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53ab7fe700 1 --2- 172.21.15.81:0/1255922116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f25720 0x55a2f6f29550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53aaffd700 1 --2- 172.21.15.81:0/1255922116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f1f890 0x55a2f6f28ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53aa7fc700 1 -- 172.21.15.81:0/1255922116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f1f890 msgr2=0x55a2f6f28ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.760+0000 7f53aa7fc700 1 --2- 172.21.15.81:0/1255922116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f1f890 0x55a2f6f28ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f53aa7fc700 1 -- 172.21.15.81:0/1255922116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f25720 msgr2=0x55a2f6f29550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f53aa7fc700 1 --2- 172.21.15.81:0/1255922116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f25720 0x55a2f6f29550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f53aa7fc700 1 -- 172.21.15.81:0/1255922116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac10d550 con 0x55a2f6f24e00 2024-05-09T00:04:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f53aa7fc700 1 --2- 172.21.15.81:0/1255922116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f24e00 0x55a2f6f29010 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f53ac06a6d0 tx=0x7f539c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a3ef3498ce5ff2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f538eff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f538eff5700 1 -- 172.21.15.81:0/1255922116 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539c028470 con 0x55a2f6f24e00 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f53bd682b80 1 -- 172.21.15.81:0/1255922116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2f6eee810 con 0x55a2f6f24e00 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f538eff5700 1 -- 172.21.15.81:0/1255922116 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f539c017070 con 0x55a2f6f24e00 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f538eff5700 1 -- 172.21.15.81:0/1255922116 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f539c0285d0 con 0x55a2f6f24e00 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f53bd682b80 10 client.15891 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f53bd682b80 1 -- 172.21.15.81:0/1255922116 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a2f6c9cb60 con 0x55a2f6f24e00 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f538eff5700 1 -- 172.21.15.81:0/1255922116 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a2f6eee810 con 0x55a2f6f24e00 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f538eff5700 1 -- 172.21.15.81:0/1255922116 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f539c0317a0 con 0x55a2f6f24e00 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f53bd682b80 10 client.15891 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f53bd682b80 10 client.15891 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f53bd682b80 20 client.15891 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f53bd682b80 1 --2- 172.21.15.81:0/1255922116 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55a2f6f391c0 0x55a2f6f3b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f53bd682b80 4 client.15891 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.761+0000 7f53bd682b80 1 -- 172.21.15.81:0/1255922116 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2f6e67ec0 con 0x55a2f6f391c0 2024-05-09T00:04:44.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.762+0000 7f53aaffd700 1 --2- 172.21.15.81:0/1255922116 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55a2f6f391c0 0x55a2f6f3b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.762+0000 7f538eff5700 10 client.15891 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:04:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.762+0000 7f53aaffd700 1 --2- 172.21.15.81:0/1255922116 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55a2f6f391c0 0x55a2f6f3b5e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a047968f76bf63ee server_cookie=e71134e7190f3eed in_seq=0 out_seq=0 2024-05-09T00:04:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f538eff5700 1 -- 172.21.15.81:0/1255922116 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a2f6e67ec0 con 0x55a2f6f391c0 2024-05-09T00:04:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f538eff5700 10 client.15891 handle_command_reply: tid=0 2024-05-09T00:04:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f53bd682b80 1 client.15891 shutdown 2024-05-09T00:04:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f53bd682b80 1 -- 172.21.15.81:0/1255922116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f24e00 msgr2=0x55a2f6f29010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f53bd682b80 1 --2- 172.21.15.81:0/1255922116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f24e00 0x55a2f6f29010 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f53ac06a6d0 tx=0x7f539c0047c0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f53bd682b80 1 -- 172.21.15.81:0/1255922116 shutdown_connections 2024-05-09T00:04:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f53bd682b80 1 --2- 172.21.15.81:0/1255922116 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55a2f6f391c0 0x55a2f6f3b5e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f53bd682b80 1 --2- 172.21.15.81:0/1255922116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f25720 0x55a2f6f29550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f538eff5700 0 client.15891 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:04:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f53bd682b80 1 --2- 172.21.15.81:0/1255922116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f1f890 0x55a2f6f28ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f53bd682b80 1 --2- 172.21.15.81:0/1255922116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f24e00 0x55a2f6f29010 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f53bd682b80 1 -- 172.21.15.81:0/1255922116 >> 172.21.15.81:0/1255922116 conn(0x55a2f6e7d210 msgr2=0x55a2f6f195a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f53bd682b80 1 -- 172.21.15.81:0/1255922116 shutdown_connections 2024-05-09T00:04:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f53bd682b80 1 -- 172.21.15.81:0/1255922116 wait complete. 2024-05-09T00:04:44.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.763+0000 7f53bd682b80 20 client.15891 trim_cache size 0 max 16384 2024-05-09T00:04:44.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.776+0000 7f53bd682b80 1 Processor -- start 2024-05-09T00:04:44.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.776+0000 7f53bd682b80 1 -- start start 2024-05-09T00:04:44.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.776+0000 7f53bd682b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f1f890 0x55a2f6f1f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.776+0000 7f53bd682b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f24e00 0x55a2f6f19d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.776+0000 7f53bd682b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f25720 0x55a2f6f30100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.776+0000 7f53bd682b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6f2baa0 con 0x55a2f6f25720 2024-05-09T00:04:44.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.776+0000 7f53bd682b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6f2a0f0 con 0x55a2f6f1f890 2024-05-09T00:04:44.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.776+0000 7f53bd682b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6f255b0 con 0x55a2f6f24e00 2024-05-09T00:04:44.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.776+0000 7f53ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f25720 0x55a2f6f30100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.776+0000 7f53ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f25720 0x55a2f6f30100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41750/0 (socket says 172.21.15.81:41750) 2024-05-09T00:04:44.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.776+0000 7f53ab7fe700 1 -- 172.21.15.81:0/3818157347 learned_addr learned my addr 172.21.15.81:0/3818157347 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f53ab7fe700 1 -- 172.21.15.81:0/3818157347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f24e00 msgr2=0x55a2f6f19d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f53ab7fe700 1 --2- 172.21.15.81:0/3818157347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f24e00 0x55a2f6f19d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f53ab7fe700 1 -- 172.21.15.81:0/3818157347 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f1f890 msgr2=0x55a2f6f1f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f53ab7fe700 1 --2- 172.21.15.81:0/3818157347 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f1f890 0x55a2f6f1f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f53ab7fe700 1 -- 172.21.15.81:0/3818157347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2f6e35560 con 0x55a2f6f25720 2024-05-09T00:04:44.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f53ab7fe700 1 --2- 172.21.15.81:0/3818157347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f25720 0x55a2f6f30100 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f53a400b830 tx=0x7f53a4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0644b054f6548cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f5391ffb700 1 -- 172.21.15.81:0/3818157347 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a400e040 con 0x55a2f6f25720 2024-05-09T00:04:44.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f5391ffb700 1 -- 172.21.15.81:0/3818157347 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53a4003a00 con 0x55a2f6f25720 2024-05-09T00:04:44.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f5391ffb700 1 -- 172.21.15.81:0/3818157347 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a402e6e0 con 0x55a2f6f25720 2024-05-09T00:04:44.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f53bd682b80 1 -- 172.21.15.81:0/3818157347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f25720 msgr2=0x55a2f6f30100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f53bd682b80 1 --2- 172.21.15.81:0/3818157347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f25720 0x55a2f6f30100 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f53a400b830 tx=0x7f53a4003f10 comp rx=0 tx=0).stop 2024-05-09T00:04:44.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f53bd682b80 1 -- 172.21.15.81:0/3818157347 shutdown_connections 2024-05-09T00:04:44.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f53bd682b80 1 --2- 172.21.15.81:0/3818157347 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f1f890 0x55a2f6f1f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f53bd682b80 1 --2- 172.21.15.81:0/3818157347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f25720 0x55a2f6f30100 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.777+0000 7f53bd682b80 1 --2- 172.21.15.81:0/3818157347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f24e00 0x55a2f6f19d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53bd682b80 1 -- 172.21.15.81:0/3818157347 >> 172.21.15.81:0/3818157347 conn(0x55a2f6e7d210 msgr2=0x55a2f6f1fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53bd682b80 1 -- 172.21.15.81:0/3818157347 shutdown_connections 2024-05-09T00:04:44.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53bd682b80 1 -- 172.21.15.81:0/3818157347 wait complete. 2024-05-09T00:04:44.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53bd682b80 1 -- start start 2024-05-09T00:04:44.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53bd682b80 1 Processor -- start 2024-05-09T00:04:44.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53bd682b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f1f890 0x55a2f6f2c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53bd682b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f24e00 0x55a2f6f2c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53bd682b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f25720 0x55a2f6f2cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53bd682b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6f8e750 con 0x55a2f6f25720 2024-05-09T00:04:44.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53bd682b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6f8e890 con 0x55a2f6f1f890 2024-05-09T00:04:44.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53bd682b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2f6f8e9d0 con 0x55a2f6f24e00 2024-05-09T00:04:44.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53bd682b80 10 client.0 _ll_register_callbacks cb 0x55a2f6e14b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:44.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f25720 0x55a2f6f2cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f25720 0x55a2f6f2cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41754/0 (socket says 172.21.15.81:41754) 2024-05-09T00:04:44.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53ab7fe700 1 -- 172.21.15.81:0/2848477527 learned_addr learned my addr 172.21.15.81:0/2848477527 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53aaffd700 1 --2- 172.21.15.81:0/2848477527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f1f890 0x55a2f6f2c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53aa7fc700 1 --2- 172.21.15.81:0/2848477527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f24e00 0x55a2f6f2c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53ab7fe700 1 -- 172.21.15.81:0/2848477527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f24e00 msgr2=0x55a2f6f2c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53ab7fe700 1 --2- 172.21.15.81:0/2848477527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f24e00 0x55a2f6f2c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53ab7fe700 1 -- 172.21.15.81:0/2848477527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f1f890 msgr2=0x55a2f6f2c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53ab7fe700 1 --2- 172.21.15.81:0/2848477527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f1f890 0x55a2f6f2c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.778+0000 7f53ab7fe700 1 -- 172.21.15.81:0/2848477527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a2f6cf03b0 con 0x55a2f6f25720 2024-05-09T00:04:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f53ab7fe700 1 --2- 172.21.15.81:0/2848477527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f25720 0x55a2f6f2cb60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f53a400d010 tx=0x7f53a4009180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6126ce95f0efe39c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f538eff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f538eff5700 1 -- 172.21.15.81:0/2848477527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a400e040 con 0x55a2f6f25720 2024-05-09T00:04:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f538eff5700 1 -- 172.21.15.81:0/2848477527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f53a402e480 con 0x55a2f6f25720 2024-05-09T00:04:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f53bd682b80 1 -- 172.21.15.81:0/2848477527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2f6dc8270 con 0x55a2f6f25720 2024-05-09T00:04:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f538eff5700 1 -- 172.21.15.81:0/2848477527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53a402e640 con 0x55a2f6f25720 2024-05-09T00:04:44.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f53bd682b80 10 client.15897 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f53bd682b80 1 -- 172.21.15.81:0/2848477527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a2f6cf4cd0 con 0x55a2f6f25720 2024-05-09T00:04:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f538eff5700 1 -- 172.21.15.81:0/2848477527 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a2f6dc8270 con 0x55a2f6f25720 2024-05-09T00:04:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f538eff5700 1 -- 172.21.15.81:0/2848477527 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f53a4019070 con 0x55a2f6f25720 2024-05-09T00:04:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f53bd682b80 10 client.15897 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f53bd682b80 10 client.15897 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:04:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f53bd682b80 20 client.15897 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f53bd682b80 1 --2- 172.21.15.81:0/2848477527 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55a2f6f8fd40 0x55a2f6f92130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f53bd682b80 4 client.15897 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:04:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.779+0000 7f53bd682b80 1 -- 172.21.15.81:0/2848477527 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a2f6cbdcf0 con 0x55a2f6f8fd40 2024-05-09T00:04:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f53aaffd700 1 --2- 172.21.15.81:0/2848477527 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55a2f6f8fd40 0x55a2f6f92130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f53aaffd700 1 --2- 172.21.15.81:0/2848477527 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55a2f6f8fd40 0x55a2f6f92130 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dc55e6b9a5e95244 server_cookie=60ccbcc8bfcad6fe in_seq=0 out_seq=0 2024-05-09T00:04:44.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f538eff5700 10 client.15897 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:04:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f538eff5700 1 -- 172.21.15.81:0/2848477527 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a2f6cbdcf0 con 0x55a2f6f8fd40 2024-05-09T00:04:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f538eff5700 10 client.15897 handle_command_reply: tid=0 2024-05-09T00:04:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f53bd682b80 1 client.15897 shutdown 2024-05-09T00:04:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f53bd682b80 1 -- 172.21.15.81:0/2848477527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f25720 msgr2=0x55a2f6f2cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f53bd682b80 1 --2- 172.21.15.81:0/2848477527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f25720 0x55a2f6f2cb60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f53a400d010 tx=0x7f53a4009180 comp rx=0 tx=0).stop 2024-05-09T00:04:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f53bd682b80 1 -- 172.21.15.81:0/2848477527 shutdown_connections 2024-05-09T00:04:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f53bd682b80 1 --2- 172.21.15.81:0/2848477527 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55a2f6f8fd40 0x55a2f6f92130 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f53bd682b80 1 --2- 172.21.15.81:0/2848477527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a2f6f1f890 0x55a2f6f2c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f53bd682b80 1 --2- 172.21.15.81:0/2848477527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a2f6f25720 0x55a2f6f2cb60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f538eff5700 0 client.15897 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:04:44.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f53bd682b80 1 --2- 172.21.15.81:0/2848477527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a2f6f24e00 0x55a2f6f2c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f53bd682b80 1 -- 172.21.15.81:0/2848477527 >> 172.21.15.81:0/2848477527 conn(0x55a2f6e7d210 msgr2=0x55a2f6f273a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f53bd682b80 1 -- 172.21.15.81:0/2848477527 shutdown_connections 2024-05-09T00:04:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f53bd682b80 1 -- 172.21.15.81:0/2848477527 wait complete. 2024-05-09T00:04:44.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.780+0000 7f53bd682b80 20 client.15897 trim_cache size 0 max 16384 2024-05-09T00:04:44.783 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:04:44.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.781+0000 7f53b14c8700 1 -- 172.21.15.81:0/3708114438 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f53940a1290 msgr2=0x7f53940a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.781+0000 7f53b14c8700 1 --2- 172.21.15.81:0/3708114438 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f53940a1290 0x7f53940a3750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f53ac1979b0 tx=0x7f539c00b410 comp rx=0 tx=0).stop 2024-05-09T00:04:44.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.781+0000 7f53b14c8700 1 -- 172.21.15.81:0/3708114438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53ac100060 msgr2=0x7f53ac196460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.781+0000 7f53b14c8700 1 --2- 172.21.15.81:0/3708114438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53ac100060 0x7f53ac196460 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f53a000d740 tx=0x7f53a000da50 comp rx=0 tx=0).stop 2024-05-09T00:04:44.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.781+0000 7f53b14c8700 1 -- 172.21.15.81:0/3708114438 shutdown_connections 2024-05-09T00:04:44.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.781+0000 7f53b14c8700 1 --2- 172.21.15.81:0/3708114438 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f53940a1290 0x7f53940a3750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.781+0000 7f53b14c8700 1 --2- 172.21.15.81:0/3708114438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53ac19ad40 0x7f53ac19b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.781+0000 7f53b14c8700 1 --2- 172.21.15.81:0/3708114438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53ac100060 0x7f53ac196460 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.781+0000 7f53b14c8700 1 --2- 172.21.15.81:0/3708114438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53ac105160 0x7f53ac1969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.781+0000 7f53b14c8700 1 -- 172.21.15.81:0/3708114438 >> 172.21.15.81:0/3708114438 conn(0x7f53ac076f40 msgr2=0x7f53ac0fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.781+0000 7f53b14c8700 1 -- 172.21.15.81:0/3708114438 shutdown_connections 2024-05-09T00:04:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.781+0000 7f53b14c8700 1 -- 172.21.15.81:0/3708114438 wait complete. 2024-05-09T00:04:44.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:04:44.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.918+0000 7f252db67700 1 -- 172.21.15.81:0/2612287588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2528101b10 msgr2=0x7f2528105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.918+0000 7f252db67700 1 --2- 172.21.15.81:0/2612287588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2528101b10 0x7f2528105b50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2510009990 tx=0x7f2510009ca0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.918+0000 7f252db67700 1 -- 172.21.15.81:0/2612287588 shutdown_connections 2024-05-09T00:04:44.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.918+0000 7f252db67700 1 --2- 172.21.15.81:0/2612287588 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2528106280 0x7f252810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.918+0000 7f252db67700 1 --2- 172.21.15.81:0/2612287588 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2528101160 0x7f2528101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.918+0000 7f252db67700 1 --2- 172.21.15.81:0/2612287588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2528101b10 0x7f2528105b50 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.918+0000 7f252db67700 1 -- 172.21.15.81:0/2612287588 >> 172.21.15.81:0/2612287588 conn(0x7f25280fc9c0 msgr2=0x7f25280fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.918+0000 7f252db67700 1 -- 172.21.15.81:0/2612287588 shutdown_connections 2024-05-09T00:04:44.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.918+0000 7f252db67700 1 -- 172.21.15.81:0/2612287588 wait complete. 2024-05-09T00:04:44.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.919+0000 7f252db67700 1 Processor -- start 2024-05-09T00:04:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.919+0000 7f252db67700 1 -- start start 2024-05-09T00:04:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.919+0000 7f252db67700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2528101160 0x7f2528199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.919+0000 7f252db67700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2528106280 0x7f2528199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.919+0000 7f252db67700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252819df30 0x7f252819e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.919+0000 7f252db67700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252819e9b0 con 0x7f252819df30 2024-05-09T00:04:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.919+0000 7f252db67700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252819eb20 con 0x7f2528106280 2024-05-09T00:04:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.919+0000 7f252db67700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252819ece0 con 0x7f2528101160 2024-05-09T00:04:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.919+0000 7f2527fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252819df30 0x7f252819e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.919+0000 7f2527fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252819df30 0x7f252819e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41776/0 (socket says 172.21.15.81:41776) 2024-05-09T00:04:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.919+0000 7f2527fff700 1 -- 172.21.15.81:0/2856175260 learned_addr learned my addr 172.21.15.81:0/2856175260 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.919+0000 7f2526ffd700 1 --2- 172.21.15.81:0/2856175260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2528106280 0x7f2528199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.920+0000 7f25277fe700 1 --2- 172.21.15.81:0/2856175260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2528101160 0x7f2528199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.920+0000 7f2527fff700 1 -- 172.21.15.81:0/2856175260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2528101160 msgr2=0x7f2528199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.920+0000 7f2527fff700 1 --2- 172.21.15.81:0/2856175260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2528101160 0x7f2528199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.920+0000 7f2527fff700 1 -- 172.21.15.81:0/2856175260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2528106280 msgr2=0x7f2528199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.920+0000 7f2527fff700 1 --2- 172.21.15.81:0/2856175260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2528106280 0x7f2528199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.920+0000 7f2527fff700 1 -- 172.21.15.81:0/2856175260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25100095f0 con 0x7f252819df30 2024-05-09T00:04:44.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.920+0000 7f2527fff700 1 --2- 172.21.15.81:0/2856175260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252819df30 0x7f252819e3b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f251800d980 tx=0x7f251800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.920+0000 7f2524ff9700 1 -- 172.21.15.81:0/2856175260 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518004a30 con 0x7f252819df30 2024-05-09T00:04:44.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.920+0000 7f252db67700 1 -- 172.21.15.81:0/2856175260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25281a6240 con 0x7f252819df30 2024-05-09T00:04:44.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.920+0000 7f2524ff9700 1 -- 172.21.15.81:0/2856175260 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f251800b5c0 con 0x7f252819df30 2024-05-09T00:04:44.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.920+0000 7f2524ff9700 1 -- 172.21.15.81:0/2856175260 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518009b50 con 0x7f252819df30 2024-05-09T00:04:44.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.920+0000 7f252db67700 1 -- 172.21.15.81:0/2856175260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25281a6720 con 0x7f252819df30 2024-05-09T00:04:44.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.922+0000 7f2524ff9700 1 -- 172.21.15.81:0/2856175260 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f2518009cb0 con 0x7f252819df30 2024-05-09T00:04:44.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.923+0000 7f2524ff9700 1 --2- 172.21.15.81:0/2856175260 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f25140a1290 0x7f25140a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.923+0000 7f25277fe700 1 --2- 172.21.15.81:0/2856175260 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f25140a1290 0x7f25140a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.923+0000 7f2524ff9700 1 -- 172.21.15.81:0/2856175260 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f25180ccbc0 con 0x7f252819df30 2024-05-09T00:04:44.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.923+0000 7f25277fe700 1 --2- 172.21.15.81:0/2856175260 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f25140a1290 0x7f25140a3750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2520009f20 tx=0x7f25200094f0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f2539d21b80 1 Processor -- start 2024-05-09T00:04:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f2539d21b80 1 -- start start 2024-05-09T00:04:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f2539d21b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9be00 0x55aa98c9c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f2539d21b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9c720 0x55aa98c96350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f2539d21b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c96890 0x55aa98c96cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f2539d21b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa98bed150 con 0x55aa98c9be00 2024-05-09T00:04:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f2539d21b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa98beab10 con 0x55aa98c96890 2024-05-09T00:04:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f2539d21b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa98be6400 con 0x55aa98c9c720 2024-05-09T00:04:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f25277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9be00 0x55aa98c9c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f25277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9be00 0x55aa98c9c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41780/0 (socket says 172.21.15.81:41780) 2024-05-09T00:04:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f25277fe700 1 -- 172.21.15.81:0/686356959 learned_addr learned my addr 172.21.15.81:0/686356959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f2527fff700 1 --2- 172.21.15.81:0/686356959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c96890 0x55aa98c96cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f2526ffd700 1 --2- 172.21.15.81:0/686356959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9c720 0x55aa98c96350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f25277fe700 1 -- 172.21.15.81:0/686356959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9c720 msgr2=0x55aa98c96350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f25277fe700 1 --2- 172.21.15.81:0/686356959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9c720 0x55aa98c96350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f25277fe700 1 -- 172.21.15.81:0/686356959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c96890 msgr2=0x55aa98c96cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f25277fe700 1 --2- 172.21.15.81:0/686356959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c96890 0x55aa98c96cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f25277fe700 1 -- 172.21.15.81:0/686356959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa98a673b0 con 0x55aa98c9be00 2024-05-09T00:04:44.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f2526ffd700 1 --2- 172.21.15.81:0/686356959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9c720 0x55aa98c96350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:44.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f2527fff700 1 --2- 172.21.15.81:0/686356959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c96890 0x55aa98c96cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:44.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f25277fe700 1 --2- 172.21.15.81:0/686356959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9be00 0x55aa98c9c1e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f252000ce80 tx=0x7f2520011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815381479d4d455e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.924+0000 7f251dffb700 1 -- 172.21.15.81:0/686356959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252001c070 con 0x55aa98c9be00 2024-05-09T00:04:44.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.925+0000 7f251dffb700 1 -- 172.21.15.81:0/686356959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2520017bb0 con 0x55aa98c9be00 2024-05-09T00:04:44.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.925+0000 7f251dffb700 1 -- 172.21.15.81:0/686356959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520011070 con 0x55aa98c9be00 2024-05-09T00:04:44.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.925+0000 7f2539d21b80 1 -- 172.21.15.81:0/686356959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9be00 msgr2=0x55aa98c9c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.925+0000 7f2539d21b80 1 --2- 172.21.15.81:0/686356959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9be00 0x55aa98c9c1e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f252000ce80 tx=0x7f2520011000 comp rx=0 tx=0).stop 2024-05-09T00:04:44.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.925+0000 7f2539d21b80 1 -- 172.21.15.81:0/686356959 shutdown_connections 2024-05-09T00:04:44.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.925+0000 7f2539d21b80 1 --2- 172.21.15.81:0/686356959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c96890 0x55aa98c96cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.925+0000 7f2539d21b80 1 --2- 172.21.15.81:0/686356959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9be00 0x55aa98c9c1e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.925+0000 7f2539d21b80 1 --2- 172.21.15.81:0/686356959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9c720 0x55aa98c96350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.925+0000 7f2539d21b80 1 -- 172.21.15.81:0/686356959 >> 172.21.15.81:0/686356959 conn(0x55aa98bf4210 msgr2=0x55aa98c90df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.925+0000 7f2539d21b80 1 -- 172.21.15.81:0/686356959 shutdown_connections 2024-05-09T00:04:44.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.925+0000 7f2539d21b80 1 -- 172.21.15.81:0/686356959 wait complete. 2024-05-09T00:04:44.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f2539d21b80 1 -- start start 2024-05-09T00:04:44.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f2539d21b80 1 Processor -- start 2024-05-09T00:04:44.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f2539d21b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c96890 0x55aa98c9fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f2539d21b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9be00 0x55aa98c9ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f2539d21b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c9c720 0x55aa98ca04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f2539d21b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa98b82560 con 0x55aa98c96890 2024-05-09T00:04:44.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f2539d21b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa98b82200 con 0x55aa98c9c720 2024-05-09T00:04:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f2539d21b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa98a696a0 con 0x55aa98c9be00 2024-05-09T00:04:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f2539d21b80 10 client.0 _ll_register_callbacks cb 0x55aa98b8bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f25277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c96890 0x55aa98c9fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f25277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c96890 0x55aa98c9fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41782/0 (socket says 172.21.15.81:41782) 2024-05-09T00:04:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f25277fe700 1 -- 172.21.15.81:0/742063653 learned_addr learned my addr 172.21.15.81:0/742063653 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f2526ffd700 1 --2- 172.21.15.81:0/742063653 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9be00 0x55aa98c9ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f2527fff700 1 --2- 172.21.15.81:0/742063653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c9c720 0x55aa98ca04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f25277fe700 1 -- 172.21.15.81:0/742063653 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9be00 msgr2=0x55aa98c9ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f25277fe700 1 --2- 172.21.15.81:0/742063653 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9be00 0x55aa98c9ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f25277fe700 1 -- 172.21.15.81:0/742063653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c9c720 msgr2=0x55aa98ca04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f25277fe700 1 --2- 172.21.15.81:0/742063653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c9c720 0x55aa98ca04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f25277fe700 1 -- 172.21.15.81:0/742063653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252000cb30 con 0x55aa98c96890 2024-05-09T00:04:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.926+0000 7f2527fff700 1 --2- 172.21.15.81:0/742063653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c9c720 0x55aa98ca04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:44.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f25277fe700 1 --2- 172.21.15.81:0/742063653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c96890 0x55aa98c9fa60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f252000ce50 tx=0x7f25200229f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6a11d387ca2a86 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2506ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:44.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2506ffd700 1 -- 172.21.15.81:0/742063653 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520031070 con 0x55aa98c96890 2024-05-09T00:04:44.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2506ffd700 1 -- 172.21.15.81:0/742063653 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2520006e40 con 0x55aa98c96890 2024-05-09T00:04:44.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2539d21b80 1 -- 172.21.15.81:0/742063653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa98b3f270 con 0x55aa98c96890 2024-05-09T00:04:44.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2506ffd700 1 -- 172.21.15.81:0/742063653 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f252001c040 con 0x55aa98c96890 2024-05-09T00:04:44.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2539d21b80 10 client.15909 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:44.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2539d21b80 1 -- 172.21.15.81:0/742063653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55aa98a13b60 con 0x55aa98c96890 2024-05-09T00:04:44.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2506ffd700 1 -- 172.21.15.81:0/742063653 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55aa98b3f270 con 0x55aa98c96890 2024-05-09T00:04:44.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2506ffd700 1 -- 172.21.15.81:0/742063653 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2520034020 con 0x55aa98c96890 2024-05-09T00:04:44.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2539d21b80 10 client.15909 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:44.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2539d21b80 10 client.15909 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:04:44.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2539d21b80 20 client.15909 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:44.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2539d21b80 1 --2- 172.21.15.81:0/742063653 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55aa98cb0070 0x55aa98cb2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2539d21b80 4 client.15909 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:44.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.927+0000 7f2539d21b80 1 -- 172.21.15.81:0/742063653 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa98c65810 con 0x55aa98cb0070 2024-05-09T00:04:44.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.928+0000 7f2526ffd700 1 --2- 172.21.15.81:0/742063653 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55aa98cb0070 0x55aa98cb2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.928+0000 7f2526ffd700 1 --2- 172.21.15.81:0/742063653 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55aa98cb0070 0x55aa98cb2490 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=685c2a61d455d7f9 server_cookie=cb0ca945ac4adf5b in_seq=0 out_seq=0 2024-05-09T00:04:44.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.928+0000 7f2506ffd700 10 client.15909 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:04:44.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2506ffd700 1 -- 172.21.15.81:0/742063653 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55aa98c65810 con 0x55aa98cb0070 2024-05-09T00:04:44.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2506ffd700 10 client.15909 handle_command_reply: tid=0 2024-05-09T00:04:44.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2539d21b80 1 client.15909 shutdown 2024-05-09T00:04:44.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2539d21b80 1 -- 172.21.15.81:0/742063653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c96890 msgr2=0x55aa98c9fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2539d21b80 1 --2- 172.21.15.81:0/742063653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c96890 0x55aa98c9fa60 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f252000ce50 tx=0x7f25200229f0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2539d21b80 1 -- 172.21.15.81:0/742063653 shutdown_connections 2024-05-09T00:04:44.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2539d21b80 1 --2- 172.21.15.81:0/742063653 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55aa98cb0070 0x55aa98cb2490 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2539d21b80 1 --2- 172.21.15.81:0/742063653 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c9c720 0x55aa98ca04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2539d21b80 1 --2- 172.21.15.81:0/742063653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c96890 0x55aa98c9fa60 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2506ffd700 0 client.15909 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:04:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2539d21b80 1 --2- 172.21.15.81:0/742063653 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9be00 0x55aa98c9ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2539d21b80 1 -- 172.21.15.81:0/742063653 >> 172.21.15.81:0/742063653 conn(0x55aa98bf4210 msgr2=0x55aa98c905a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2539d21b80 1 -- 172.21.15.81:0/742063653 shutdown_connections 2024-05-09T00:04:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2539d21b80 1 -- 172.21.15.81:0/742063653 wait complete. 2024-05-09T00:04:44.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.929+0000 7f2539d21b80 20 client.15909 trim_cache size 0 max 16384 2024-05-09T00:04:44.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.942+0000 7f2539d21b80 1 Processor -- start 2024-05-09T00:04:44.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.942+0000 7f2539d21b80 1 -- start start 2024-05-09T00:04:44.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2539d21b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c96890 0x55aa98cabc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2539d21b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c9be00 0x55aa98c90d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2539d21b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9c720 0x55aa98ca0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2539d21b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa98c8ddc0 con 0x55aa98c9c720 2024-05-09T00:04:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2539d21b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa98cb7660 con 0x55aa98c9be00 2024-05-09T00:04:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2539d21b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa98c8b800 con 0x55aa98c96890 2024-05-09T00:04:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2527fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9c720 0x55aa98ca0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2527fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9c720 0x55aa98ca0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41798/0 (socket says 172.21.15.81:41798) 2024-05-09T00:04:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2527fff700 1 -- 172.21.15.81:0/649892533 learned_addr learned my addr 172.21.15.81:0/649892533 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2526ffd700 1 --2- 172.21.15.81:0/649892533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c9be00 0x55aa98c90d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2527fff700 1 -- 172.21.15.81:0/649892533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c96890 msgr2=0x55aa98cabc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f25277fe700 1 --2- 172.21.15.81:0/649892533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c96890 0x55aa98cabc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2527fff700 1 --2- 172.21.15.81:0/649892533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c96890 0x55aa98cabc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2527fff700 1 -- 172.21.15.81:0/649892533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c9be00 msgr2=0x55aa98c90d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2527fff700 1 --2- 172.21.15.81:0/649892533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c9be00 0x55aa98c90d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2527fff700 1 -- 172.21.15.81:0/649892533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa98bac560 con 0x55aa98c9c720 2024-05-09T00:04:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f25277fe700 1 --2- 172.21.15.81:0/649892533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c96890 0x55aa98cabc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f2527fff700 1 --2- 172.21.15.81:0/649892533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9c720 0x55aa98ca0340 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2518009fd0 tx=0x7f2518099ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89637113199dc0f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f251e7fc700 1 -- 172.21.15.81:0/649892533 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251809a390 con 0x55aa98c9c720 2024-05-09T00:04:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f251e7fc700 1 -- 172.21.15.81:0/649892533 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2518099c90 con 0x55aa98c9c720 2024-05-09T00:04:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.943+0000 7f251e7fc700 1 -- 172.21.15.81:0/649892533 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518099ef0 con 0x55aa98c9c720 2024-05-09T00:04:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.944+0000 7f2539d21b80 1 -- 172.21.15.81:0/649892533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9c720 msgr2=0x55aa98ca0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.944+0000 7f2539d21b80 1 --2- 172.21.15.81:0/649892533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9c720 0x55aa98ca0340 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2518009fd0 tx=0x7f2518099ae0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.944+0000 7f2539d21b80 1 -- 172.21.15.81:0/649892533 shutdown_connections 2024-05-09T00:04:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.944+0000 7f2539d21b80 1 --2- 172.21.15.81:0/649892533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9c720 0x55aa98ca0340 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.944+0000 7f2539d21b80 1 --2- 172.21.15.81:0/649892533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c96890 0x55aa98cabc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.944+0000 7f2539d21b80 1 --2- 172.21.15.81:0/649892533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c9be00 0x55aa98c90d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.944+0000 7f2539d21b80 1 -- 172.21.15.81:0/649892533 >> 172.21.15.81:0/649892533 conn(0x55aa98bf4210 msgr2=0x55aa98c92870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.944+0000 7f2539d21b80 1 -- 172.21.15.81:0/649892533 shutdown_connections 2024-05-09T00:04:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.944+0000 7f2539d21b80 1 -- 172.21.15.81:0/649892533 wait complete. 2024-05-09T00:04:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.944+0000 7f2539d21b80 1 -- start start 2024-05-09T00:04:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.944+0000 7f2539d21b80 1 Processor -- start 2024-05-09T00:04:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2539d21b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c96890 0x55aa98ca5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2539d21b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9be00 0x55aa98ca5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2539d21b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9c720 0x55aa98ca5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2539d21b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa98d05580 con 0x55aa98c9c720 2024-05-09T00:04:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2539d21b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa98d056c0 con 0x55aa98c96890 2024-05-09T00:04:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2539d21b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa98d05880 con 0x55aa98c9be00 2024-05-09T00:04:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2539d21b80 10 client.0 _ll_register_callbacks cb 0x55aa98b8bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2527fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9c720 0x55aa98ca5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2527fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9c720 0x55aa98ca5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41810/0 (socket says 172.21.15.81:41810) 2024-05-09T00:04:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2527fff700 1 -- 172.21.15.81:0/3803565997 learned_addr learned my addr 172.21.15.81:0/3803565997 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f25277fe700 1 --2- 172.21.15.81:0/3803565997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c96890 0x55aa98ca5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2526ffd700 1 --2- 172.21.15.81:0/3803565997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9be00 0x55aa98ca5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2527fff700 1 -- 172.21.15.81:0/3803565997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9be00 msgr2=0x55aa98ca5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2527fff700 1 --2- 172.21.15.81:0/3803565997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9be00 0x55aa98ca5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2527fff700 1 -- 172.21.15.81:0/3803565997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c96890 msgr2=0x55aa98ca5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2527fff700 1 --2- 172.21.15.81:0/3803565997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c96890 0x55aa98ca5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2527fff700 1 -- 172.21.15.81:0/3803565997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25281a6720 con 0x55aa98c9c720 2024-05-09T00:04:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2527fff700 1 --2- 172.21.15.81:0/3803565997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9c720 0x55aa98ca5bd0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2518096190 tx=0x7f2518004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e999eccb4ab91c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2506ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2506ffd700 1 -- 172.21.15.81:0/3803565997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25180a2110 con 0x55aa98c9c720 2024-05-09T00:04:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2506ffd700 1 -- 172.21.15.81:0/3803565997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2518099180 con 0x55aa98c9c720 2024-05-09T00:04:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.945+0000 7f2539d21b80 1 -- 172.21.15.81:0/3803565997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2520017bb0 con 0x55aa98c9c720 2024-05-09T00:04:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.946+0000 7f2506ffd700 1 -- 172.21.15.81:0/3803565997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2518099360 con 0x55aa98c9c720 2024-05-09T00:04:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.946+0000 7f2539d21b80 10 client.15915 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.946+0000 7f2539d21b80 1 -- 172.21.15.81:0/3803565997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55aa98a6bcd0 con 0x55aa98c9c720 2024-05-09T00:04:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.946+0000 7f2506ffd700 1 -- 172.21.15.81:0/3803565997 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f251807e020 con 0x55aa98c9c720 2024-05-09T00:04:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.946+0000 7f2506ffd700 1 -- 172.21.15.81:0/3803565997 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f25180a1c80 con 0x55aa98c9c720 2024-05-09T00:04:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.946+0000 7f2539d21b80 10 client.15915 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.946+0000 7f2539d21b80 10 client.15915 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:04:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.946+0000 7f2539d21b80 20 client.15915 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.946+0000 7f2539d21b80 1 --2- 172.21.15.81:0/3803565997 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55aa98d06ae0 0x55aa98d08ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.946+0000 7f2539d21b80 4 client.15915 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:04:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.946+0000 7f2539d21b80 1 -- 172.21.15.81:0/3803565997 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55aa98bdeec0 con 0x55aa98d06ae0 2024-05-09T00:04:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.946+0000 7f25277fe700 1 --2- 172.21.15.81:0/3803565997 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55aa98d06ae0 0x55aa98d08ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2506ffd700 10 client.15915 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:04:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f25277fe700 1 --2- 172.21.15.81:0/3803565997 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55aa98d06ae0 0x55aa98d08ed0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3c88166aa2cffd52 server_cookie=2d27eb697b01ba9d in_seq=0 out_seq=0 2024-05-09T00:04:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2506ffd700 1 -- 172.21.15.81:0/3803565997 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55aa98bdeec0 con 0x55aa98d06ae0 2024-05-09T00:04:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2506ffd700 10 client.15915 handle_command_reply: tid=0 2024-05-09T00:04:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2539d21b80 1 client.15915 shutdown 2024-05-09T00:04:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2539d21b80 1 -- 172.21.15.81:0/3803565997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9c720 msgr2=0x55aa98ca5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2539d21b80 1 --2- 172.21.15.81:0/3803565997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9c720 0x55aa98ca5bd0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2518096190 tx=0x7f2518004db0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2539d21b80 1 -- 172.21.15.81:0/3803565997 shutdown_connections 2024-05-09T00:04:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2539d21b80 1 --2- 172.21.15.81:0/3803565997 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55aa98d06ae0 0x55aa98d08ed0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2539d21b80 1 --2- 172.21.15.81:0/3803565997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55aa98c96890 0x55aa98ca5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2539d21b80 1 --2- 172.21.15.81:0/3803565997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55aa98c9c720 0x55aa98ca5bd0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2539d21b80 1 --2- 172.21.15.81:0/3803565997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55aa98c9be00 0x55aa98ca5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2506ffd700 0 client.15915 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:04:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2539d21b80 1 -- 172.21.15.81:0/3803565997 >> 172.21.15.81:0/3803565997 conn(0x55aa98bf4210 msgr2=0x55aa98c99c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2539d21b80 1 -- 172.21.15.81:0/3803565997 shutdown_connections 2024-05-09T00:04:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2539d21b80 1 -- 172.21.15.81:0/3803565997 wait complete. 2024-05-09T00:04:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.947+0000 7f2539d21b80 20 client.15915 trim_cache size 0 max 16384 2024-05-09T00:04:44.949 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:04:44.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.948+0000 7f252db67700 1 -- 172.21.15.81:0/2856175260 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f25140a1290 msgr2=0x7f25140a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.948+0000 7f252db67700 1 --2- 172.21.15.81:0/2856175260 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f25140a1290 0x7f25140a3750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2520009f20 tx=0x7f25200094f0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.948+0000 7f252db67700 1 -- 172.21.15.81:0/2856175260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252819df30 msgr2=0x7f252819e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:44.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.948+0000 7f252db67700 1 --2- 172.21.15.81:0/2856175260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252819df30 0x7f252819e3b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f251800d980 tx=0x7f251800dc90 comp rx=0 tx=0).stop 2024-05-09T00:04:44.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.948+0000 7f252db67700 1 -- 172.21.15.81:0/2856175260 shutdown_connections 2024-05-09T00:04:44.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.948+0000 7f252db67700 1 --2- 172.21.15.81:0/2856175260 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f25140a1290 0x7f25140a3750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.948+0000 7f252db67700 1 --2- 172.21.15.81:0/2856175260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f252819df30 0x7f252819e3b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.948+0000 7f252db67700 1 --2- 172.21.15.81:0/2856175260 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2528101160 0x7f2528199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.948+0000 7f252db67700 1 --2- 172.21.15.81:0/2856175260 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2528106280 0x7f2528199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:44.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.948+0000 7f252db67700 1 -- 172.21.15.81:0/2856175260 >> 172.21.15.81:0/2856175260 conn(0x7f25280fc9c0 msgr2=0x7f25280fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:44.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.948+0000 7f252db67700 1 -- 172.21.15.81:0/2856175260 shutdown_connections 2024-05-09T00:04:44.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:44.948+0000 7f252db67700 1 -- 172.21.15.81:0/2856175260 wait complete. 2024-05-09T00:04:44.952 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:44 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/281279103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:04:44.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:04:45.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:44 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/281279103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:04:45.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:44 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/281279103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:04:45.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.084+0000 7f7698c8e700 1 -- 172.21.15.81:0/261016341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7694100a10 msgr2=0x7f7694104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:45.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.084+0000 7f7698c8e700 1 --2- 172.21.15.81:0/261016341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7694100a10 0x7f7694104a30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f767c009990 tx=0x7f767c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.084+0000 7f7698c8e700 1 -- 172.21.15.81:0/261016341 shutdown_connections 2024-05-09T00:04:45.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.084+0000 7f7698c8e700 1 --2- 172.21.15.81:0/261016341 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7694100060 0x7f7694100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.084+0000 7f7698c8e700 1 --2- 172.21.15.81:0/261016341 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7694105160 0x7f769410cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.084+0000 7f7698c8e700 1 --2- 172.21.15.81:0/261016341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7694100a10 0x7f7694104a30 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.084+0000 7f7698c8e700 1 -- 172.21.15.81:0/261016341 >> 172.21.15.81:0/261016341 conn(0x7f7694076f40 msgr2=0x7f7694077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:45.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.084+0000 7f7698c8e700 1 -- 172.21.15.81:0/261016341 shutdown_connections 2024-05-09T00:04:45.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.084+0000 7f7698c8e700 1 -- 172.21.15.81:0/261016341 wait complete. 2024-05-09T00:04:45.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.085+0000 7f7698c8e700 1 Processor -- start 2024-05-09T00:04:45.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.085+0000 7f7698c8e700 1 -- start start 2024-05-09T00:04:45.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.085+0000 7f7698c8e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7694100060 0x7f7694196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.085+0000 7f7698c8e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7694105160 0x7f7694196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.085+0000 7f7698c8e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f769419ab10 0x7f769419af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.085+0000 7f7698c8e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769419b590 con 0x7f7694105160 2024-05-09T00:04:45.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.085+0000 7f7698c8e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769419b700 con 0x7f769419ab10 2024-05-09T00:04:45.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.085+0000 7f7698c8e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769419b8c0 con 0x7f7694100060 2024-05-09T00:04:45.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.085+0000 7f7691d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7694105160 0x7f7694196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.085+0000 7f7691d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7694105160 0x7f7694196770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41830/0 (socket says 172.21.15.81:41830) 2024-05-09T00:04:45.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.085+0000 7f7691d9b700 1 -- 172.21.15.81:0/3471631680 learned_addr learned my addr 172.21.15.81:0/3471631680 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:45.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.085+0000 7f769259c700 1 --2- 172.21.15.81:0/3471631680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7694100060 0x7f7694196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.085+0000 7f7692d9d700 1 --2- 172.21.15.81:0/3471631680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f769419ab10 0x7f769419af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.086+0000 7f7691d9b700 1 -- 172.21.15.81:0/3471631680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7694100060 msgr2=0x7f7694196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:45.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.086+0000 7f7691d9b700 1 --2- 172.21.15.81:0/3471631680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7694100060 0x7f7694196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.086+0000 7f7691d9b700 1 -- 172.21.15.81:0/3471631680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f769419ab10 msgr2=0x7f769419af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:45.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.086+0000 7f7691d9b700 1 --2- 172.21.15.81:0/3471631680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f769419ab10 0x7f769419af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.086+0000 7f7691d9b700 1 -- 172.21.15.81:0/3471631680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767c0095f0 con 0x7f7694105160 2024-05-09T00:04:45.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.086+0000 7f7691d9b700 1 --2- 172.21.15.81:0/3471631680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7694105160 0x7f7694196770 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f767c0059d0 tx=0x7f767c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:45.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.086+0000 7f768b7fe700 1 -- 172.21.15.81:0/3471631680 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c01d070 con 0x7f7694105160 2024-05-09T00:04:45.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.086+0000 7f7698c8e700 1 -- 172.21.15.81:0/3471631680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76941a2dc0 con 0x7f7694105160 2024-05-09T00:04:45.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.086+0000 7f768b7fe700 1 -- 172.21.15.81:0/3471631680 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f767c00fb30 con 0x7f7694105160 2024-05-09T00:04:45.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.086+0000 7f768b7fe700 1 -- 172.21.15.81:0/3471631680 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c022bf0 con 0x7f7694105160 2024-05-09T00:04:45.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.086+0000 7f7698c8e700 1 -- 172.21.15.81:0/3471631680 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76941a31e0 con 0x7f7694105160 2024-05-09T00:04:45.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.088+0000 7f768b7fe700 1 -- 172.21.15.81:0/3471631680 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f767c00fca0 con 0x7f7694105160 2024-05-09T00:04:45.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.089+0000 7f768b7fe700 1 --2- 172.21.15.81:0/3471631680 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76800a1290 0x7f76800a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.089+0000 7f769259c700 1 --2- 172.21.15.81:0/3471631680 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76800a1290 0x7f76800a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.089+0000 7f768b7fe700 1 -- 172.21.15.81:0/3471631680 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f767c0ce0d0 con 0x7f7694105160 2024-05-09T00:04:45.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.089+0000 7f76a4e48b80 1 Processor -- start 2024-05-09T00:04:45.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.089+0000 7f769259c700 1 --2- 172.21.15.81:0/3471631680 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76800a1290 0x7f76800a3750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f768400f440 tx=0x7f76840079e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:45.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.089+0000 7f76a4e48b80 1 -- start start 2024-05-09T00:04:45.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f76a4e48b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99cfb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f76a4e48b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cfb720 0x55fb99cf5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f76a4e48b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cf5890 0x55fb99cf5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f76a4e48b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb99c4c150 con 0x55fb99cfae00 2024-05-09T00:04:45.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f76a4e48b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb99c49b10 con 0x55fb99cf5890 2024-05-09T00:04:45.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f76a4e48b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb99c45400 con 0x55fb99cfb720 2024-05-09T00:04:45.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f769259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99cfb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f769259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99cfb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41844/0 (socket says 172.21.15.81:41844) 2024-05-09T00:04:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f769259c700 1 -- 172.21.15.81:0/93097700 learned_addr learned my addr 172.21.15.81:0/93097700 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f7692d9d700 1 --2- 172.21.15.81:0/93097700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cf5890 0x55fb99cf5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f769259c700 1 -- 172.21.15.81:0/93097700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cfb720 msgr2=0x55fb99cf5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f769259c700 1 --2- 172.21.15.81:0/93097700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cfb720 0x55fb99cf5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f769259c700 1 -- 172.21.15.81:0/93097700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cf5890 msgr2=0x55fb99cf5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f769259c700 1 --2- 172.21.15.81:0/93097700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cf5890 0x55fb99cf5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f769259c700 1 -- 172.21.15.81:0/93097700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb99ac63b0 con 0x55fb99cfae00 2024-05-09T00:04:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f769259c700 1 --2- 172.21.15.81:0/93097700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99cfb1e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7684014770 tx=0x7f7684012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1263188e0668191 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f7688ff9700 1 -- 172.21.15.81:0/93097700 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684020440 con 0x55fb99cfae00 2024-05-09T00:04:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f7688ff9700 1 -- 172.21.15.81:0/93097700 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7684019070 con 0x55fb99cfae00 2024-05-09T00:04:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.090+0000 7f7688ff9700 1 -- 172.21.15.81:0/93097700 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76840157c0 con 0x55fb99cfae00 2024-05-09T00:04:45.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.091+0000 7f76a4e48b80 1 -- 172.21.15.81:0/93097700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 msgr2=0x55fb99cfb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:45.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.091+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/93097700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99cfb1e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f7684014770 tx=0x7f7684012000 comp rx=0 tx=0).stop 2024-05-09T00:04:45.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.091+0000 7f76a4e48b80 1 -- 172.21.15.81:0/93097700 shutdown_connections 2024-05-09T00:04:45.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.091+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/93097700 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cf5890 0x55fb99cf5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.091+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/93097700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99cfb1e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.091+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/93097700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cfb720 0x55fb99cf5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.091+0000 7f76a4e48b80 1 -- 172.21.15.81:0/93097700 >> 172.21.15.81:0/93097700 conn(0x55fb99c53210 msgr2=0x55fb99cefdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:45.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.091+0000 7f76a4e48b80 1 -- 172.21.15.81:0/93097700 shutdown_connections 2024-05-09T00:04:45.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.091+0000 7f76a4e48b80 1 -- 172.21.15.81:0/93097700 wait complete. 2024-05-09T00:04:45.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.091+0000 7f76a4e48b80 1 -- start start 2024-05-09T00:04:45.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f76a4e48b80 1 Processor -- start 2024-05-09T00:04:45.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f76a4e48b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cf5890 0x55fb99cfeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f76a4e48b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99cff0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f76a4e48b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 0x55fb99cff610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f76a4e48b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb99be1560 con 0x55fb99cfae00 2024-05-09T00:04:45.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f76a4e48b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb99be1200 con 0x55fb99cfb720 2024-05-09T00:04:45.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f76a4e48b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb99ac86a0 con 0x55fb99cf5890 2024-05-09T00:04:45.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f76a4e48b80 10 client.0 _ll_register_callbacks cb 0x55fb99beab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:45.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f7691d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99cff0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f7691d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99cff0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41858/0 (socket says 172.21.15.81:41858) 2024-05-09T00:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f7691d9b700 1 -- 172.21.15.81:0/2298848209 learned_addr learned my addr 172.21.15.81:0/2298848209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f769259c700 1 --2- 172.21.15.81:0/2298848209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cf5890 0x55fb99cfeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f7692d9d700 1 --2- 172.21.15.81:0/2298848209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 0x55fb99cff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f7691d9b700 1 -- 172.21.15.81:0/2298848209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cf5890 msgr2=0x55fb99cfeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f7691d9b700 1 --2- 172.21.15.81:0/2298848209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cf5890 0x55fb99cfeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f7691d9b700 1 -- 172.21.15.81:0/2298848209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 msgr2=0x55fb99cff610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f7691d9b700 1 --2- 172.21.15.81:0/2298848209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 0x55fb99cff610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f7691d9b700 1 -- 172.21.15.81:0/2298848209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7684014450 con 0x55fb99cfae00 2024-05-09T00:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f7691d9b700 1 --2- 172.21.15.81:0/2298848209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99cff0d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f767c097770 tx=0x7f767c09abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d699b1acb0f70e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.092+0000 7f7679ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f7679ffb700 1 -- 172.21.15.81:0/2298848209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c09a960 con 0x55fb99cfae00 2024-05-09T00:04:45.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f7679ffb700 1 -- 172.21.15.81:0/2298848209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f767c09b270 con 0x55fb99cfae00 2024-05-09T00:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f76a4e48b80 1 -- 172.21.15.81:0/2298848209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb99b9e270 con 0x55fb99cfae00 2024-05-09T00:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f7679ffb700 1 -- 172.21.15.81:0/2298848209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f767c09f0a0 con 0x55fb99cfae00 2024-05-09T00:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f76a4e48b80 10 client.15927 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f76a4e48b80 1 -- 172.21.15.81:0/2298848209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fb99a72b60 con 0x55fb99cfae00 2024-05-09T00:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f7679ffb700 1 -- 172.21.15.81:0/2298848209 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fb99b9e270 con 0x55fb99cfae00 2024-05-09T00:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f7679ffb700 1 -- 172.21.15.81:0/2298848209 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f767c0a11e0 con 0x55fb99cfae00 2024-05-09T00:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f76a4e48b80 10 client.15927 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f76a4e48b80 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f76a4e48b80 20 client.15927 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/2298848209 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fb99d0ef00 0x55fb99d11320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f76a4e48b80 4 client.15927 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f76a4e48b80 1 -- 172.21.15.81:0/2298848209 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb99cc4810 con 0x55fb99d0ef00 2024-05-09T00:04:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.093+0000 7f769259c700 1 --2- 172.21.15.81:0/2298848209 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fb99d0ef00 0x55fb99d11320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.094+0000 7f7679ffb700 10 client.15927 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.094+0000 7f769259c700 1 --2- 172.21.15.81:0/2298848209 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fb99d0ef00 0x55fb99d11320 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0c36185136401f3 server_cookie=d76ecc7878ac31cd in_seq=0 out_seq=0 2024-05-09T00:04:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.094+0000 7f7679ffb700 1 -- 172.21.15.81:0/2298848209 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fb99cc4810 con 0x55fb99d0ef00 2024-05-09T00:04:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.094+0000 7f7679ffb700 10 client.15927 handle_command_reply: tid=0 2024-05-09T00:04:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.094+0000 7f76a4e48b80 1 client.15927 shutdown 2024-05-09T00:04:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.094+0000 7f76a4e48b80 1 -- 172.21.15.81:0/2298848209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 msgr2=0x55fb99cff0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.094+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/2298848209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99cff0d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f767c097770 tx=0x7f767c09abd0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.094+0000 7f76a4e48b80 1 -- 172.21.15.81:0/2298848209 shutdown_connections 2024-05-09T00:04:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.094+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/2298848209 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fb99d0ef00 0x55fb99d11320 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.094+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/2298848209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 0x55fb99cff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.094+0000 7f7679ffb700 0 client.15927 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.094+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/2298848209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cf5890 0x55fb99cfeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.094+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/2298848209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99cff0d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.095+0000 7f76a4e48b80 1 -- 172.21.15.81:0/2298848209 >> 172.21.15.81:0/2298848209 conn(0x55fb99c53210 msgr2=0x55fb99cef5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.095+0000 7f76a4e48b80 1 -- 172.21.15.81:0/2298848209 shutdown_connections 2024-05-09T00:04:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.095+0000 7f76a4e48b80 1 -- 172.21.15.81:0/2298848209 wait complete. 2024-05-09T00:04:45.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.095+0000 7f76a4e48b80 20 client.15927 trim_cache size 0 max 16384 2024-05-09T00:04:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.107+0000 7f76a4e48b80 1 Processor -- start 2024-05-09T00:04:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f76a4e48b80 1 -- start start 2024-05-09T00:04:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f76a4e48b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cf5890 0x55fb99cf5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f76a4e48b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cfae00 0x55fb99cefd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f76a4e48b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 0x55fb99cfd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f76a4e48b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb99d00190 con 0x55fb99cf5890 2024-05-09T00:04:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f76a4e48b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb99cecdc0 con 0x55fb99cfb720 2024-05-09T00:04:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f76a4e48b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb99cf0ae0 con 0x55fb99cfae00 2024-05-09T00:04:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f769259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cf5890 0x55fb99cf5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f769259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cf5890 0x55fb99cf5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41862/0 (socket says 172.21.15.81:41862) 2024-05-09T00:04:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f769259c700 1 -- 172.21.15.81:0/702788804 learned_addr learned my addr 172.21.15.81:0/702788804 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f7692d9d700 1 --2- 172.21.15.81:0/702788804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 0x55fb99cfd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f7691d9b700 1 --2- 172.21.15.81:0/702788804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cfae00 0x55fb99cefd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f769259c700 1 -- 172.21.15.81:0/702788804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cfae00 msgr2=0x55fb99cefd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f769259c700 1 --2- 172.21.15.81:0/702788804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cfae00 0x55fb99cefd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f769259c700 1 -- 172.21.15.81:0/702788804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 msgr2=0x55fb99cfd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f769259c700 1 --2- 172.21.15.81:0/702788804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 0x55fb99cfd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f769259c700 1 -- 172.21.15.81:0/702788804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb99c0b560 con 0x55fb99cf5890 2024-05-09T00:04:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f7691d9b700 1 --2- 172.21.15.81:0/702788804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cfae00 0x55fb99cefd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f7692d9d700 1 --2- 172.21.15.81:0/702788804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 0x55fb99cfd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f769259c700 1 --2- 172.21.15.81:0/702788804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cf5890 0x55fb99cf5350 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f768400fb90 tx=0x7f7684020f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59d11a2bf6ff78a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f76897fa700 1 -- 172.21.15.81:0/702788804 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684037070 con 0x55fb99cf5890 2024-05-09T00:04:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f76897fa700 1 -- 172.21.15.81:0/702788804 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7684033860 con 0x55fb99cf5890 2024-05-09T00:04:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.108+0000 7f76897fa700 1 -- 172.21.15.81:0/702788804 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684020440 con 0x55fb99cf5890 2024-05-09T00:04:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.109+0000 7f76a4e48b80 1 -- 172.21.15.81:0/702788804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cf5890 msgr2=0x55fb99cf5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.109+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/702788804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cf5890 0x55fb99cf5350 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f768400fb90 tx=0x7f7684020f60 comp rx=0 tx=0).stop 2024-05-09T00:04:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.109+0000 7f76a4e48b80 1 -- 172.21.15.81:0/702788804 shutdown_connections 2024-05-09T00:04:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.109+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/702788804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 0x55fb99cfd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.109+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/702788804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cf5890 0x55fb99cf5350 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.109+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/702788804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cfae00 0x55fb99cefd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.109+0000 7f76a4e48b80 1 -- 172.21.15.81:0/702788804 >> 172.21.15.81:0/702788804 conn(0x55fb99c53210 msgr2=0x55fb99cf5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:45.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.109+0000 7f76a4e48b80 1 -- 172.21.15.81:0/702788804 shutdown_connections 2024-05-09T00:04:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.109+0000 7f76a4e48b80 1 -- 172.21.15.81:0/702788804 wait complete. 2024-05-09T00:04:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.109+0000 7f76a4e48b80 1 -- start start 2024-05-09T00:04:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.109+0000 7f76a4e48b80 1 Processor -- start 2024-05-09T00:04:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.109+0000 7f76a4e48b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cf5890 0x55fb99d04150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.109+0000 7f76a4e48b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99d04690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f76a4e48b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 0x55fb99d68810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f76a4e48b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb99d04f30 con 0x55fb99cfae00 2024-05-09T00:04:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f76a4e48b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb99d68d50 con 0x55fb99cfb720 2024-05-09T00:04:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f76a4e48b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb99d68e90 con 0x55fb99cf5890 2024-05-09T00:04:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f76a4e48b80 10 client.0 _ll_register_callbacks cb 0x55fb99beab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7691d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99d04690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7691d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99d04690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41870/0 (socket says 172.21.15.81:41870) 2024-05-09T00:04:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7691d9b700 1 -- 172.21.15.81:0/125660488 learned_addr learned my addr 172.21.15.81:0/125660488 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7692d9d700 1 --2- 172.21.15.81:0/125660488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 0x55fb99d68810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7691d9b700 1 -- 172.21.15.81:0/125660488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cf5890 msgr2=0x55fb99d04150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7691d9b700 1 --2- 172.21.15.81:0/125660488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cf5890 0x55fb99d04150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7691d9b700 1 -- 172.21.15.81:0/125660488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 msgr2=0x55fb99d68810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7691d9b700 1 --2- 172.21.15.81:0/125660488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 0x55fb99d68810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7691d9b700 1 -- 172.21.15.81:0/125660488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb99ac63b0 con 0x55fb99cfae00 2024-05-09T00:04:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7692d9d700 1 --2- 172.21.15.81:0/125660488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 0x55fb99d68810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7691d9b700 1 --2- 172.21.15.81:0/125660488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99d04690 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f767c097ce0 tx=0x7f767c005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ad5c81c474a316 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7679ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7679ffb700 1 -- 172.21.15.81:0/125660488 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c09a960 con 0x55fb99cfae00 2024-05-09T00:04:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7679ffb700 1 -- 172.21.15.81:0/125660488 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f767c0b2030 con 0x55fb99cfae00 2024-05-09T00:04:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f76a4e48b80 1 -- 172.21.15.81:0/125660488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7684019070 con 0x55fb99cfae00 2024-05-09T00:04:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7679ffb700 1 -- 172.21.15.81:0/125660488 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f767c09b270 con 0x55fb99cfae00 2024-05-09T00:04:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f76a4e48b80 10 client.15933 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f76a4e48b80 1 -- 172.21.15.81:0/125660488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fb99acacd0 con 0x55fb99cfae00 2024-05-09T00:04:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.110+0000 7f7679ffb700 1 -- 172.21.15.81:0/125660488 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7684019070 con 0x55fb99cfae00 2024-05-09T00:04:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.111+0000 7f7679ffb700 1 -- 172.21.15.81:0/125660488 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f767c097060 con 0x55fb99cfae00 2024-05-09T00:04:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.111+0000 7f76a4e48b80 10 client.15933 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.111+0000 7f76a4e48b80 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.111+0000 7f76a4e48b80 20 client.15933 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.111+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/125660488 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fb99d0ef00 0x55fb99d6bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.111+0000 7f76a4e48b80 4 client.15933 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:04:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.111+0000 7f76a4e48b80 1 -- 172.21.15.81:0/125660488 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fb99c3dec0 con 0x55fb99d0ef00 2024-05-09T00:04:45.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.111+0000 7f769259c700 1 --2- 172.21.15.81:0/125660488 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fb99d0ef00 0x55fb99d6bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:45.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.111+0000 7f7679ffb700 10 client.15933 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:45.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.111+0000 7f769259c700 1 --2- 172.21.15.81:0/125660488 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fb99d0ef00 0x55fb99d6bfd0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=147b40fcfde296cb server_cookie=6ece651025622087 in_seq=0 out_seq=0 2024-05-09T00:04:45.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.111+0000 7f7679ffb700 1 -- 172.21.15.81:0/125660488 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fb99c3dec0 con 0x55fb99d0ef00 2024-05-09T00:04:45.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.111+0000 7f7679ffb700 10 client.15933 handle_command_reply: tid=0 2024-05-09T00:04:45.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.111+0000 7f76a4e48b80 1 client.15933 shutdown 2024-05-09T00:04:45.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f76a4e48b80 1 -- 172.21.15.81:0/125660488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 msgr2=0x55fb99d04690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:45.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/125660488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99d04690 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f767c097ce0 tx=0x7f767c005ad0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f76a4e48b80 1 -- 172.21.15.81:0/125660488 shutdown_connections 2024-05-09T00:04:45.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/125660488 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fb99d0ef00 0x55fb99d6bfd0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/125660488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb99cfb720 0x55fb99d68810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f7679ffb700 0 client.15933 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:45.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/125660488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb99cf5890 0x55fb99d04150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f76a4e48b80 1 --2- 172.21.15.81:0/125660488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb99cfae00 0x55fb99d04690 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f76a4e48b80 1 -- 172.21.15.81:0/125660488 >> 172.21.15.81:0/125660488 conn(0x55fb99c53210 msgr2=0x55fb99cfd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:45.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f76a4e48b80 1 -- 172.21.15.81:0/125660488 shutdown_connections 2024-05-09T00:04:45.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f76a4e48b80 1 -- 172.21.15.81:0/125660488 wait complete. 2024-05-09T00:04:45.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f76a4e48b80 20 client.15933 trim_cache size 0 max 16384 2024-05-09T00:04:45.118 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:04:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f7698c8e700 1 -- 172.21.15.81:0/3471631680 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76800a1290 msgr2=0x7f76800a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f7698c8e700 1 --2- 172.21.15.81:0/3471631680 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76800a1290 0x7f76800a3750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f768400f440 tx=0x7f76840079e0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f7698c8e700 1 -- 172.21.15.81:0/3471631680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7694105160 msgr2=0x7f7694196770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:45.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f7698c8e700 1 --2- 172.21.15.81:0/3471631680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7694105160 0x7f7694196770 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f767c0059d0 tx=0x7f767c009580 comp rx=0 tx=0).stop 2024-05-09T00:04:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f7698c8e700 1 -- 172.21.15.81:0/3471631680 shutdown_connections 2024-05-09T00:04:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f7698c8e700 1 --2- 172.21.15.81:0/3471631680 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76800a1290 0x7f76800a3750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f7698c8e700 1 --2- 172.21.15.81:0/3471631680 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f769419ab10 0x7f769419af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f7698c8e700 1 --2- 172.21.15.81:0/3471631680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7694100060 0x7f7694196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f7698c8e700 1 --2- 172.21.15.81:0/3471631680 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7694105160 0x7f7694196770 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:45.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f7698c8e700 1 -- 172.21.15.81:0/3471631680 >> 172.21.15.81:0/3471631680 conn(0x7f7694076f40 msgr2=0x7f76940fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f7698c8e700 1 -- 172.21.15.81:0/3471631680 shutdown_connections 2024-05-09T00:04:45.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:45.112+0000 7f7698c8e700 1 -- 172.21.15.81:0/3471631680 wait complete. 2024-05-09T00:04:46.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:45 smithi150 ceph-mon[46187]: pgmap v57: 97 pgs: 97 active+clean; 1.5 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2024-05-09T00:04:46.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:45 smithi171 ceph-mon[47351]: pgmap v57: 97 pgs: 97 active+clean; 1.5 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2024-05-09T00:04:46.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:45 smithi081 ceph-mon[42474]: pgmap v57: 97 pgs: 97 active+clean; 1.5 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 15 op/s 2024-05-09T00:04:46.123 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:04:46.126 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:04:46.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.263+0000 7f4e17595700 1 -- 172.21.15.81:0/677178704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e101062a0 msgr2=0x7f4e1010de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.263+0000 7f4e17595700 1 --2- 172.21.15.81:0/677178704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e101062a0 0x7f4e1010de20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800b0d0 tx=0x7f4e0800b3e0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.263+0000 7f4e17595700 1 -- 172.21.15.81:0/677178704 shutdown_connections 2024-05-09T00:04:46.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.263+0000 7f4e17595700 1 --2- 172.21.15.81:0/677178704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e100697a0 0x7f4e10069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.263+0000 7f4e17595700 1 --2- 172.21.15.81:0/677178704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e101062a0 0x7f4e1010de20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.263+0000 7f4e17595700 1 --2- 172.21.15.81:0/677178704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e1006a150 0x7f4e10105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.263+0000 7f4e17595700 1 -- 172.21.15.81:0/677178704 >> 172.21.15.81:0/677178704 conn(0x7f4e10076f40 msgr2=0x7f4e10077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.263+0000 7f4e17595700 1 -- 172.21.15.81:0/677178704 shutdown_connections 2024-05-09T00:04:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.263+0000 7f4e17595700 1 -- 172.21.15.81:0/677178704 wait complete. 2024-05-09T00:04:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.263+0000 7f4e17595700 1 Processor -- start 2024-05-09T00:04:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.263+0000 7f4e17595700 1 -- start start 2024-05-09T00:04:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e17595700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e100697a0 0x7f4e101974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e17595700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e101062a0 0x7f4e101979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e17595700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e1019bd90 0x7f4e1019c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e17595700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1019c810 con 0x7f4e101062a0 2024-05-09T00:04:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e17595700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1019c980 con 0x7f4e100697a0 2024-05-09T00:04:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e17595700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1019cb40 con 0x7f4e1019bd90 2024-05-09T00:04:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e14b30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e101062a0 0x7f4e101979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e14b30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e101062a0 0x7f4e101979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41898/0 (socket says 172.21.15.81:41898) 2024-05-09T00:04:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e14b30700 1 -- 172.21.15.81:0/309696938 learned_addr learned my addr 172.21.15.81:0/309696938 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e15331700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e100697a0 0x7f4e101974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e15b32700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e1019bd90 0x7f4e1019c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e14b30700 1 -- 172.21.15.81:0/309696938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e1019bd90 msgr2=0x7f4e1019c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e14b30700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e1019bd90 0x7f4e1019c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e14b30700 1 -- 172.21.15.81:0/309696938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e100697a0 msgr2=0x7f4e101974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e14b30700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e100697a0 0x7f4e101974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e14b30700 1 -- 172.21.15.81:0/309696938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e08009d00 con 0x7f4e101062a0 2024-05-09T00:04:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e15331700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e100697a0 0x7f4e101974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e14b30700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e101062a0 0x7f4e101979f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00d980 tx=0x7f4e0c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e067fc700 1 -- 172.21.15.81:0/309696938 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c009b40 con 0x7f4e101062a0 2024-05-09T00:04:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e17595700 1 -- 172.21.15.81:0/309696938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e101a40a0 con 0x7f4e101062a0 2024-05-09T00:04:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e067fc700 1 -- 172.21.15.81:0/309696938 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e0c00de60 con 0x7f4e101062a0 2024-05-09T00:04:46.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e067fc700 1 -- 172.21.15.81:0/309696938 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00f620 con 0x7f4e101062a0 2024-05-09T00:04:46.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.264+0000 7f4e17595700 1 -- 172.21.15.81:0/309696938 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e101a45d0 con 0x7f4e101062a0 2024-05-09T00:04:46.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.267+0000 7f4e067fc700 1 -- 172.21.15.81:0/309696938 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4e0c010460 con 0x7f4e101062a0 2024-05-09T00:04:46.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.267+0000 7f4e067fc700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4dfc0a1290 0x7f4dfc0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.267+0000 7f4e067fc700 1 -- 172.21.15.81:0/309696938 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f4e0c0cc870 con 0x7f4e101062a0 2024-05-09T00:04:46.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.267+0000 7f4e15331700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4dfc0a1290 0x7f4dfc0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.268+0000 7f4e15331700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4dfc0a1290 0x7f4dfc0a3750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4e00005950 tx=0x7f4e00005f50 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:46.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.268+0000 7f4e2374fb80 1 Processor -- start 2024-05-09T00:04:46.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.268+0000 7f4e2374fb80 1 -- start start 2024-05-09T00:04:46.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e2374fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae84e80 0x563adae85260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e2374fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae7f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e2374fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae7f910 0x563adae7fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e2374fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adadd61d0 con 0x563adae857a0 2024-05-09T00:04:46.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e2374fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adadd3b90 con 0x563adae7f910 2024-05-09T00:04:46.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e2374fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adadcf480 con 0x563adae84e80 2024-05-09T00:04:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e14b30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae7f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e14b30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae7f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41904/0 (socket says 172.21.15.81:41904) 2024-05-09T00:04:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e14b30700 1 -- 172.21.15.81:0/3824332962 learned_addr learned my addr 172.21.15.81:0/3824332962 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e14b30700 1 -- 172.21.15.81:0/3824332962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae84e80 msgr2=0x563adae85260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e15331700 1 --2- 172.21.15.81:0/3824332962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae84e80 0x563adae85260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e15b32700 1 --2- 172.21.15.81:0/3824332962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae7f910 0x563adae7fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e14b30700 1 --2- 172.21.15.81:0/3824332962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae84e80 0x563adae85260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e14b30700 1 -- 172.21.15.81:0/3824332962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae7f910 msgr2=0x563adae7fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e14b30700 1 --2- 172.21.15.81:0/3824332962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae7f910 0x563adae7fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e14b30700 1 -- 172.21.15.81:0/3824332962 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563adac50430 con 0x563adae857a0 2024-05-09T00:04:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e15b32700 1 --2- 172.21.15.81:0/3824332962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae7f910 0x563adae7fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:46.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4e14b30700 1 --2- 172.21.15.81:0/3824332962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae7f3d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0a18d0 tx=0x7f4e0c0993b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b13064787b697746 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4dfb7fe700 1 -- 172.21.15.81:0/3824332962 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c09d7b0 con 0x563adae857a0 2024-05-09T00:04:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4dfb7fe700 1 -- 172.21.15.81:0/3824332962 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e0c0a1e00 con 0x563adae857a0 2024-05-09T00:04:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.269+0000 7f4dfb7fe700 1 -- 172.21.15.81:0/3824332962 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0990d0 con 0x563adae857a0 2024-05-09T00:04:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.270+0000 7f4e2374fb80 1 -- 172.21.15.81:0/3824332962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 msgr2=0x563adae7f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.270+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/3824332962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae7f3d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0a18d0 tx=0x7f4e0c0993b0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.270+0000 7f4e2374fb80 1 -- 172.21.15.81:0/3824332962 shutdown_connections 2024-05-09T00:04:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.270+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/3824332962 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae7f910 0x563adae7fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.270+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/3824332962 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae84e80 0x563adae85260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.270+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/3824332962 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae7f3d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.270+0000 7f4e2374fb80 1 -- 172.21.15.81:0/3824332962 >> 172.21.15.81:0/3824332962 conn(0x563adaddd290 msgr2=0x563adae79e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.270+0000 7f4e2374fb80 1 -- 172.21.15.81:0/3824332962 shutdown_connections 2024-05-09T00:04:46.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.270+0000 7f4e2374fb80 1 -- 172.21.15.81:0/3824332962 wait complete. 2024-05-09T00:04:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.270+0000 7f4e2374fb80 1 -- start start 2024-05-09T00:04:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.270+0000 7f4e2374fb80 1 Processor -- start 2024-05-09T00:04:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e2374fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae7f910 0x563adae88bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e2374fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae84e80 0x563adae89130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e2374fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae89670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e2374fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adad6b5e0 con 0x563adae857a0 2024-05-09T00:04:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e2374fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adad6b280 con 0x563adae84e80 2024-05-09T00:04:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e2374fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adac52720 con 0x563adae7f910 2024-05-09T00:04:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e2374fb80 10 client.0 _ll_register_callbacks cb 0x563adad74bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e15b32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae89670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e15b32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae89670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41920/0 (socket says 172.21.15.81:41920) 2024-05-09T00:04:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e15b32700 1 -- 172.21.15.81:0/613150585 learned_addr learned my addr 172.21.15.81:0/613150585 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:46.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e14b30700 1 --2- 172.21.15.81:0/613150585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae84e80 0x563adae89130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e15331700 1 --2- 172.21.15.81:0/613150585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae7f910 0x563adae88bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e15b32700 1 -- 172.21.15.81:0/613150585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae7f910 msgr2=0x563adae88bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e15b32700 1 --2- 172.21.15.81:0/613150585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae7f910 0x563adae88bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e15b32700 1 -- 172.21.15.81:0/613150585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae84e80 msgr2=0x563adae89130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e15b32700 1 --2- 172.21.15.81:0/613150585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae84e80 0x563adae89130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e15b32700 1 -- 172.21.15.81:0/613150585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e101a45d0 con 0x563adae857a0 2024-05-09T00:04:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4e15b32700 1 --2- 172.21.15.81:0/613150585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae89670 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4e080092e0 tx=0x7f4e08009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=100555bf5c6c19f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.271+0000 7f4df8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4df8ff9700 1 -- 172.21.15.81:0/613150585 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0800e040 con 0x563adae857a0 2024-05-09T00:04:46.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4df8ff9700 1 -- 172.21.15.81:0/613150585 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f4e08004c60 con 0x563adae857a0 2024-05-09T00:04:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4e2374fb80 1 -- 172.21.15.81:0/613150585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563adad282f0 con 0x563adae857a0 2024-05-09T00:04:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4df8ff9700 1 -- 172.21.15.81:0/613150585 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e08004e20 con 0x563adae857a0 2024-05-09T00:04:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4e2374fb80 10 client.15945 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4e2374fb80 1 -- 172.21.15.81:0/613150585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563adabfcbe0 con 0x563adae857a0 2024-05-09T00:04:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4df8ff9700 1 -- 172.21.15.81:0/613150585 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563adad282f0 con 0x563adae857a0 2024-05-09T00:04:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4df8ff9700 1 -- 172.21.15.81:0/613150585 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4e08019070 con 0x563adae857a0 2024-05-09T00:04:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4e2374fb80 10 client.15945 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4e2374fb80 10 client.15945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4e2374fb80 20 client.15945 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:46.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/613150585 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563adae99110 0x563adae9b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4e2374fb80 4 client.15945 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:46.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4e2374fb80 1 -- 172.21.15.81:0/613150585 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563adae4e890 con 0x563adae99110 2024-05-09T00:04:46.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.272+0000 7f4e15331700 1 --2- 172.21.15.81:0/613150585 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563adae99110 0x563adae9b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.273+0000 7f4df8ff9700 10 client.15945 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:46.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.273+0000 7f4e15331700 1 --2- 172.21.15.81:0/613150585 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563adae99110 0x563adae9b530 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f505793ca0c4a9 server_cookie=1ccf6731f5c2c9a8 in_seq=0 out_seq=0 2024-05-09T00:04:46.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4df8ff9700 1 -- 172.21.15.81:0/613150585 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563adae4e890 con 0x563adae99110 2024-05-09T00:04:46.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4df8ff9700 10 client.15945 handle_command_reply: tid=0 2024-05-09T00:04:46.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4e2374fb80 1 client.15945 shutdown 2024-05-09T00:04:46.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4e2374fb80 1 -- 172.21.15.81:0/613150585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 msgr2=0x563adae89670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/613150585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae89670 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4e080092e0 tx=0x7f4e08009310 comp rx=0 tx=0).stop 2024-05-09T00:04:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4e2374fb80 1 -- 172.21.15.81:0/613150585 shutdown_connections 2024-05-09T00:04:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/613150585 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563adae99110 0x563adae9b530 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/613150585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae89670 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/613150585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae7f910 0x563adae88bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4df8ff9700 0 client.15945 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/613150585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae84e80 0x563adae89130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4e2374fb80 1 -- 172.21.15.81:0/613150585 >> 172.21.15.81:0/613150585 conn(0x563adaddd290 msgr2=0x563adae79620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4e2374fb80 1 -- 172.21.15.81:0/613150585 shutdown_connections 2024-05-09T00:04:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4e2374fb80 1 -- 172.21.15.81:0/613150585 wait complete. 2024-05-09T00:04:46.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.274+0000 7f4e2374fb80 20 client.15945 trim_cache size 0 max 16384 2024-05-09T00:04:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.291+0000 7f4e2374fb80 1 Processor -- start 2024-05-09T00:04:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.291+0000 7f4e2374fb80 1 -- start start 2024-05-09T00:04:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e2374fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae7f910 0x563adae79da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e2374fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae84e80 0x563adae90120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e2374fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae857a0 0x563adae90660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e2374fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adad282f0 con 0x563adae84e80 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e2374fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adae8a1a0 con 0x563adae857a0 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e2374fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adae88a00 con 0x563adae7f910 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e14b30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae84e80 0x563adae90120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e14b30700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae84e80 0x563adae90120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41936/0 (socket says 172.21.15.81:41936) 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e14b30700 1 -- 172.21.15.81:0/3339275867 learned_addr learned my addr 172.21.15.81:0/3339275867 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e14b30700 1 -- 172.21.15.81:0/3339275867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae7f910 msgr2=0x563adae79da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e14b30700 1 --2- 172.21.15.81:0/3339275867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae7f910 0x563adae79da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e14b30700 1 -- 172.21.15.81:0/3339275867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae857a0 msgr2=0x563adae90660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e15b32700 1 --2- 172.21.15.81:0/3339275867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae857a0 0x563adae90660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e14b30700 1 --2- 172.21.15.81:0/3339275867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae857a0 0x563adae90660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e14b30700 1 -- 172.21.15.81:0/3339275867 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563adae76560 con 0x563adae84e80 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e15b32700 1 --2- 172.21.15.81:0/3339275867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae857a0 0x563adae90660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4e14b30700 1 --2- 172.21.15.81:0/3339275867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae84e80 0x563adae90120 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c097cd0 tx=0x7f4e0c099880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8c63e9edb96364 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4dfbfff700 1 -- 172.21.15.81:0/3339275867 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c09d7b0 con 0x563adae84e80 2024-05-09T00:04:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4dfbfff700 1 -- 172.21.15.81:0/3339275867 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e0c097d20 con 0x563adae84e80 2024-05-09T00:04:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.292+0000 7f4dfbfff700 1 -- 172.21.15.81:0/3339275867 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c099be0 con 0x563adae84e80 2024-05-09T00:04:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.293+0000 7f4e2374fb80 1 -- 172.21.15.81:0/3339275867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae84e80 msgr2=0x563adae90120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.293+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/3339275867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae84e80 0x563adae90120 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c097cd0 tx=0x7f4e0c099880 comp rx=0 tx=0).stop 2024-05-09T00:04:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.293+0000 7f4e2374fb80 1 -- 172.21.15.81:0/3339275867 shutdown_connections 2024-05-09T00:04:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.293+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/3339275867 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae857a0 0x563adae90660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.293+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/3339275867 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae7f910 0x563adae79da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.293+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/3339275867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae84e80 0x563adae90120 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.293+0000 7f4e2374fb80 1 -- 172.21.15.81:0/3339275867 >> 172.21.15.81:0/3339275867 conn(0x563adaddd290 msgr2=0x563adae874e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.293+0000 7f4e2374fb80 1 -- 172.21.15.81:0/3339275867 shutdown_connections 2024-05-09T00:04:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.293+0000 7f4e2374fb80 1 -- 172.21.15.81:0/3339275867 wait complete. 2024-05-09T00:04:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.293+0000 7f4e2374fb80 1 -- start start 2024-05-09T00:04:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.293+0000 7f4e2374fb80 1 Processor -- start 2024-05-09T00:04:46.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e2374fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae7f910 0x563adae814d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e2374fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae84e80 0x563adae81a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e2374fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae81f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e2374fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adaeef610 con 0x563adae857a0 2024-05-09T00:04:46.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e2374fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adaeef750 con 0x563adae84e80 2024-05-09T00:04:46.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e2374fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563adaeef890 con 0x563adae7f910 2024-05-09T00:04:46.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e2374fb80 10 client.0 _ll_register_callbacks cb 0x563adad74bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:46.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e15b32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae81f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e15b32700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae81f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41938/0 (socket says 172.21.15.81:41938) 2024-05-09T00:04:46.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e15b32700 1 -- 172.21.15.81:0/2348051477 learned_addr learned my addr 172.21.15.81:0/2348051477 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:46.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e15331700 1 --2- 172.21.15.81:0/2348051477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae7f910 0x563adae814d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e14b30700 1 --2- 172.21.15.81:0/2348051477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae84e80 0x563adae81a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e15b32700 1 -- 172.21.15.81:0/2348051477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae7f910 msgr2=0x563adae814d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e15b32700 1 --2- 172.21.15.81:0/2348051477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae7f910 0x563adae814d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e15b32700 1 -- 172.21.15.81:0/2348051477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae84e80 msgr2=0x563adae81a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e15b32700 1 --2- 172.21.15.81:0/2348051477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae84e80 0x563adae81a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e15b32700 1 -- 172.21.15.81:0/2348051477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563adac50430 con 0x563adae857a0 2024-05-09T00:04:46.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e14b30700 1 --2- 172.21.15.81:0/2348051477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae84e80 0x563adae81a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4e15b32700 1 --2- 172.21.15.81:0/2348051477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae81f50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4e0802ebf0 tx=0x7f4e08006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ef14e1e4cf1a3c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.294+0000 7f4df8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4df8ff9700 1 -- 172.21.15.81:0/2348051477 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0800e070 con 0x563adae857a0 2024-05-09T00:04:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4df8ff9700 1 -- 172.21.15.81:0/2348051477 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f4e080076b0 con 0x563adae857a0 2024-05-09T00:04:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4e2374fb80 1 -- 172.21.15.81:0/2348051477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e0c0a1e00 con 0x563adae857a0 2024-05-09T00:04:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4df8ff9700 1 -- 172.21.15.81:0/2348051477 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e0800b820 con 0x563adae857a0 2024-05-09T00:04:46.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4e2374fb80 10 client.15951 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4e2374fb80 1 -- 172.21.15.81:0/2348051477 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563adae7ffc0 con 0x563adae857a0 2024-05-09T00:04:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4df8ff9700 1 -- 172.21.15.81:0/2348051477 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e0c0a1e00 con 0x563adae857a0 2024-05-09T00:04:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4df8ff9700 1 -- 172.21.15.81:0/2348051477 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4e0800b500 con 0x563adae857a0 2024-05-09T00:04:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4e2374fb80 10 client.15951 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4e2374fb80 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:46.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4e2374fb80 20 client.15951 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:46.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/2348051477 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563adaef0d30 0x563adaef3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4e2374fb80 4 client.15951 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:04:46.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4e2374fb80 1 -- 172.21.15.81:0/2348051477 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x563adadc7f40 con 0x563adaef0d30 2024-05-09T00:04:46.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.295+0000 7f4e15331700 1 --2- 172.21.15.81:0/2348051477 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563adaef0d30 0x563adaef3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.296+0000 7f4df8ff9700 10 client.15951 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:46.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.296+0000 7f4e15331700 1 --2- 172.21.15.81:0/2348051477 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563adaef0d30 0x563adaef3150 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84fe1e4cfaf87d38 server_cookie=1002cca10f85db9d in_seq=0 out_seq=0 2024-05-09T00:04:46.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.297+0000 7f4df8ff9700 1 -- 172.21.15.81:0/2348051477 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x563adadc7f40 con 0x563adaef0d30 2024-05-09T00:04:46.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.297+0000 7f4df8ff9700 10 client.15951 handle_command_reply: tid=0 2024-05-09T00:04:46.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.297+0000 7f4e2374fb80 1 client.15951 shutdown 2024-05-09T00:04:46.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.297+0000 7f4e2374fb80 1 -- 172.21.15.81:0/2348051477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 msgr2=0x563adae81f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.297+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/2348051477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae81f50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f4e0802ebf0 tx=0x7f4e08006000 comp rx=0 tx=0).stop 2024-05-09T00:04:46.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.297+0000 7f4e2374fb80 1 -- 172.21.15.81:0/2348051477 shutdown_connections 2024-05-09T00:04:46.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.297+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/2348051477 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563adaef0d30 0x563adaef3150 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.297+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/2348051477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563adae857a0 0x563adae81f50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.297+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/2348051477 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563adae7f910 0x563adae814d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.297+0000 7f4e2374fb80 1 --2- 172.21.15.81:0/2348051477 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563adae84e80 0x563adae81a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.297+0000 7f4e2374fb80 1 -- 172.21.15.81:0/2348051477 >> 172.21.15.81:0/2348051477 conn(0x563adaddd290 msgr2=0x563adae83ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:46.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.297+0000 7f4df8ff9700 0 client.15951 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:46.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.297+0000 7f4e2374fb80 1 -- 172.21.15.81:0/2348051477 shutdown_connections 2024-05-09T00:04:46.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.297+0000 7f4e2374fb80 1 -- 172.21.15.81:0/2348051477 wait complete. 2024-05-09T00:04:46.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.298+0000 7f4e2374fb80 20 client.15951 trim_cache size 0 max 16384 2024-05-09T00:04:46.301 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:04:46.302 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:04:46.302 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "c5e27361-8f1a-49c3-93c6-de578068c0d6", 2024-05-09T00:04:46.302 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:04:46.302 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:04:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.298+0000 7f4e17595700 1 -- 172.21.15.81:0/309696938 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4dfc0a1290 msgr2=0x7f4dfc0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.298+0000 7f4e17595700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4dfc0a1290 0x7f4dfc0a3750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4e00005950 tx=0x7f4e00005f50 comp rx=0 tx=0).stop 2024-05-09T00:04:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.298+0000 7f4e17595700 1 -- 172.21.15.81:0/309696938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e101062a0 msgr2=0x7f4e101979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.298+0000 7f4e17595700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e101062a0 0x7f4e101979f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00d980 tx=0x7f4e0c00dd40 comp rx=0 tx=0).stop 2024-05-09T00:04:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.298+0000 7f4e17595700 1 -- 172.21.15.81:0/309696938 shutdown_connections 2024-05-09T00:04:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.298+0000 7f4e17595700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4dfc0a1290 0x7f4dfc0a3750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.298+0000 7f4e17595700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4e100697a0 0x7f4e101974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.298+0000 7f4e17595700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4e1019bd90 0x7f4e1019c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.298+0000 7f4e17595700 1 --2- 172.21.15.81:0/309696938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e101062a0 0x7f4e101979f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.298+0000 7f4e17595700 1 -- 172.21.15.81:0/309696938 >> 172.21.15.81:0/309696938 conn(0x7f4e10076f40 msgr2=0x7f4e101073d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.298+0000 7f4e17595700 1 -- 172.21.15.81:0/309696938 shutdown_connections 2024-05-09T00:04:46.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.298+0000 7f4e17595700 1 -- 172.21.15.81:0/309696938 wait complete. 2024-05-09T00:04:46.307 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:04:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.438+0000 7fe1ef9e2700 1 -- 172.21.15.81:0/2788522284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8105160 msgr2=0x7fe1e810cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.438+0000 7fe1ef9e2700 1 --2- 172.21.15.81:0/2788522284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8105160 0x7fe1e810cce0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000b0a0 tx=0x7fe1e000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.438+0000 7fe1ef9e2700 1 -- 172.21.15.81:0/2788522284 shutdown_connections 2024-05-09T00:04:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.438+0000 7fe1ef9e2700 1 --2- 172.21.15.81:0/2788522284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e8100060 0x7fe1e8100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.438+0000 7fe1ef9e2700 1 --2- 172.21.15.81:0/2788522284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8105160 0x7fe1e810cce0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.438+0000 7fe1ef9e2700 1 --2- 172.21.15.81:0/2788522284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1e8100a10 0x7fe1e8104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.438+0000 7fe1ef9e2700 1 -- 172.21.15.81:0/2788522284 >> 172.21.15.81:0/2788522284 conn(0x7fe1e8076f40 msgr2=0x7fe1e8077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.438+0000 7fe1ef9e2700 1 -- 172.21.15.81:0/2788522284 shutdown_connections 2024-05-09T00:04:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.438+0000 7fe1ef9e2700 1 -- 172.21.15.81:0/2788522284 wait complete. 2024-05-09T00:04:46.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.438+0000 7fe1ef9e2700 1 Processor -- start 2024-05-09T00:04:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.438+0000 7fe1ef9e2700 1 -- start start 2024-05-09T00:04:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ef9e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8100060 0x7fe1e81974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ef9e2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e8105160 0x7fe1e8197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ef9e2700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1e819bdb0 0x7fe1e819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ef9e2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e819c830 con 0x7fe1e8100060 2024-05-09T00:04:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ef9e2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e819c9a0 con 0x7fe1e8105160 2024-05-09T00:04:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ef9e2700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e819cb60 con 0x7fe1e819bdb0 2024-05-09T00:04:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ed77e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8100060 0x7fe1e81974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ed77e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8100060 0x7fe1e81974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41952/0 (socket says 172.21.15.81:41952) 2024-05-09T00:04:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ed77e700 1 -- 172.21.15.81:0/3529213050 learned_addr learned my addr 172.21.15.81:0/3529213050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e8105160 0x7fe1e8197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1edf7f700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1e819bdb0 0x7fe1e819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ed77e700 1 -- 172.21.15.81:0/3529213050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1e819bdb0 msgr2=0x7fe1e819c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ed77e700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1e819bdb0 0x7fe1e819c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ed77e700 1 -- 172.21.15.81:0/3529213050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e8105160 msgr2=0x7fe1e8197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ed77e700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e8105160 0x7fe1e8197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ed77e700 1 -- 172.21.15.81:0/3529213050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e0009d00 con 0x7fe1e8100060 2024-05-09T00:04:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e8105160 0x7fe1e8197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ed77e700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8100060 0x7fe1e81974d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800d950 tx=0x7fe1d800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1de7fc700 1 -- 172.21.15.81:0/3529213050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8009b40 con 0x7fe1e8100060 2024-05-09T00:04:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1de7fc700 1 -- 172.21.15.81:0/3529213050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1d8009ca0 con 0x7fe1e8100060 2024-05-09T00:04:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ef9e2700 1 -- 172.21.15.81:0/3529213050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e81a40c0 con 0x7fe1e8100060 2024-05-09T00:04:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1de7fc700 1 -- 172.21.15.81:0/3529213050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800f620 con 0x7fe1e8100060 2024-05-09T00:04:46.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.439+0000 7fe1ef9e2700 1 -- 172.21.15.81:0/3529213050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e81a45a0 con 0x7fe1e8100060 2024-05-09T00:04:46.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.442+0000 7fe1de7fc700 1 -- 172.21.15.81:0/3529213050 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe1d8010460 con 0x7fe1e8100060 2024-05-09T00:04:46.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.442+0000 7fe1de7fc700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1d40a1290 0x7fe1d40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.442+0000 7fe1de7fc700 1 -- 172.21.15.81:0/3529213050 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fe1d80cd070 con 0x7fe1e8100060 2024-05-09T00:04:46.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.442+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1d40a1290 0x7fe1d40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.443+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1d40a1290 0x7fe1d40a3750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4005fd0 tx=0x7fe1e400a5e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:46.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.443+0000 7fe1fbb9cb80 1 Processor -- start 2024-05-09T00:04:46.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.443+0000 7fe1fbb9cb80 1 -- start start 2024-05-09T00:04:46.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.443+0000 7fe1fbb9cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef5e00 0x556c63ef61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.443+0000 7fe1fbb9cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef6720 0x556c63ef0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.443+0000 7fe1fbb9cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63ef0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.443+0000 7fe1fbb9cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c63e47150 con 0x556c63ef0890 2024-05-09T00:04:46.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.443+0000 7fe1fbb9cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c63e44b10 con 0x556c63ef5e00 2024-05-09T00:04:46.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.443+0000 7fe1fbb9cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c63e40400 con 0x556c63ef6720 2024-05-09T00:04:46.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.443+0000 7fe1edf7f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63ef0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.444+0000 7fe1edf7f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63ef0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41960/0 (socket says 172.21.15.81:41960) 2024-05-09T00:04:46.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.444+0000 7fe1edf7f700 1 -- 172.21.15.81:0/3254898124 learned_addr learned my addr 172.21.15.81:0/3254898124 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:46.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.444+0000 7fe1ed77e700 1 --2- 172.21.15.81:0/3254898124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef5e00 0x556c63ef61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.444+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/3254898124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef6720 0x556c63ef0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.444+0000 7fe1edf7f700 1 -- 172.21.15.81:0/3254898124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef6720 msgr2=0x556c63ef0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.444+0000 7fe1edf7f700 1 --2- 172.21.15.81:0/3254898124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef6720 0x556c63ef0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.444+0000 7fe1edf7f700 1 -- 172.21.15.81:0/3254898124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef5e00 msgr2=0x556c63ef61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.444+0000 7fe1edf7f700 1 --2- 172.21.15.81:0/3254898124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef5e00 0x556c63ef61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.444+0000 7fe1edf7f700 1 -- 172.21.15.81:0/3254898124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c63cc13b0 con 0x556c63ef0890 2024-05-09T00:04:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.444+0000 7fe1ed77e700 1 --2- 172.21.15.81:0/3254898124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef5e00 0x556c63ef61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.444+0000 7fe1edf7f700 1 --2- 172.21.15.81:0/3254898124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63ef0cd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0015000 tx=0x7fe1e0007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a3d1cb95b82c5c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.444+0000 7fe1d37fe700 1 -- 172.21.15.81:0/3254898124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000e050 con 0x556c63ef0890 2024-05-09T00:04:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.444+0000 7fe1d37fe700 1 -- 172.21.15.81:0/3254898124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1e0007e40 con 0x556c63ef0890 2024-05-09T00:04:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.444+0000 7fe1d37fe700 1 -- 172.21.15.81:0/3254898124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00052a0 con 0x556c63ef0890 2024-05-09T00:04:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.445+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/3254898124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 msgr2=0x556c63ef0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.445+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/3254898124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63ef0cd0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0015000 tx=0x7fe1e0007b70 comp rx=0 tx=0).stop 2024-05-09T00:04:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.445+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/3254898124 shutdown_connections 2024-05-09T00:04:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.445+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/3254898124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef5e00 0x556c63ef61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.445+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/3254898124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63ef0cd0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.445+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/3254898124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef6720 0x556c63ef0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.445+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/3254898124 >> 172.21.15.81:0/3254898124 conn(0x556c63e4e210 msgr2=0x556c63eeadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:46.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.445+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/3254898124 shutdown_connections 2024-05-09T00:04:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.445+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/3254898124 wait complete. 2024-05-09T00:04:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.445+0000 7fe1fbb9cb80 1 -- start start 2024-05-09T00:04:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.445+0000 7fe1fbb9cb80 1 Processor -- start 2024-05-09T00:04:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1fbb9cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63efc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1fbb9cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef5e00 0x556c63ef9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1fbb9cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef6720 0x556c63efa150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1fbb9cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c63ddc560 con 0x556c63ef0890 2024-05-09T00:04:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1fbb9cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c63ddc200 con 0x556c63ef5e00 2024-05-09T00:04:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1fbb9cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c63cc36a0 con 0x556c63ef6720 2024-05-09T00:04:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1fbb9cb80 10 client.0 _ll_register_callbacks cb 0x556c63de5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1ed77e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63efc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1ed77e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63efc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41976/0 (socket says 172.21.15.81:41976) 2024-05-09T00:04:46.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1ed77e700 1 -- 172.21.15.81:0/3023210223 learned_addr learned my addr 172.21.15.81:0/3023210223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/3023210223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef5e00 0x556c63ef9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1edf7f700 1 --2- 172.21.15.81:0/3023210223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef6720 0x556c63efa150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1ed77e700 1 -- 172.21.15.81:0/3023210223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef6720 msgr2=0x556c63efa150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1ed77e700 1 --2- 172.21.15.81:0/3023210223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef6720 0x556c63efa150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1ed77e700 1 -- 172.21.15.81:0/3023210223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef5e00 msgr2=0x556c63ef9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1ed77e700 1 --2- 172.21.15.81:0/3023210223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef5e00 0x556c63ef9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1ed77e700 1 -- 172.21.15.81:0/3023210223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e810d550 con 0x556c63ef0890 2024-05-09T00:04:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/3023210223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef5e00 0x556c63ef9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1ed77e700 1 --2- 172.21.15.81:0/3023210223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63efc720 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe1d809a110 tx=0x7fe1d809a880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e6bfac80cb2f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1d0ff9700 1 -- 172.21.15.81:0/3023210223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8010910 con 0x556c63ef0890 2024-05-09T00:04:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1d0ff9700 1 -- 172.21.15.81:0/3023210223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fe1d809c070 con 0x556c63ef0890 2024-05-09T00:04:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.446+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/3023210223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c63d99270 con 0x556c63ef0890 2024-05-09T00:04:46.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.447+0000 7fe1d0ff9700 1 -- 172.21.15.81:0/3023210223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1d80a2600 con 0x556c63ef0890 2024-05-09T00:04:46.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.447+0000 7fe1fbb9cb80 10 client.15963 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:46.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.447+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/3023210223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556c63c6db60 con 0x556c63ef0890 2024-05-09T00:04:46.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.447+0000 7fe1d0ff9700 1 -- 172.21.15.81:0/3023210223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556c63d99270 con 0x556c63ef0890 2024-05-09T00:04:46.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.447+0000 7fe1d0ff9700 1 -- 172.21.15.81:0/3023210223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe1d809a450 con 0x556c63ef0890 2024-05-09T00:04:46.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.447+0000 7fe1fbb9cb80 10 client.15963 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:46.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.447+0000 7fe1fbb9cb80 10 client.15963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:46.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.447+0000 7fe1fbb9cb80 20 client.15963 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:46.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.447+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/3023210223 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c63f0a190 0x556c63f0c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.447+0000 7fe1fbb9cb80 4 client.15963 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:46.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.447+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/3023210223 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c63ebf810 con 0x556c63f0a190 2024-05-09T00:04:46.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.447+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/3023210223 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c63f0a190 0x556c63f0c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1d0ff9700 10 client.15963 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:46.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/3023210223 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c63f0a190 0x556c63f0c5b0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dc19ad3ec31ffed server_cookie=976789f93f8af578 in_seq=0 out_seq=0 2024-05-09T00:04:46.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1d0ff9700 1 -- 172.21.15.81:0/3023210223 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556c63ebf810 con 0x556c63f0a190 2024-05-09T00:04:46.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1d0ff9700 10 client.15963 handle_command_reply: tid=0 2024-05-09T00:04:46.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1fbb9cb80 1 client.15963 shutdown 2024-05-09T00:04:46.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/3023210223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 msgr2=0x556c63efc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/3023210223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63efc720 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fe1d809a110 tx=0x7fe1d809a880 comp rx=0 tx=0).stop 2024-05-09T00:04:46.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/3023210223 shutdown_connections 2024-05-09T00:04:46.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/3023210223 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c63f0a190 0x556c63f0c5b0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/3023210223 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef6720 0x556c63efa150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/3023210223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63efc720 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1d0ff9700 0 client.15963 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:46.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/3023210223 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef5e00 0x556c63ef9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/3023210223 >> 172.21.15.81:0/3023210223 conn(0x556c63e4e210 msgr2=0x556c63eea5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:46.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/3023210223 shutdown_connections 2024-05-09T00:04:46.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.448+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/3023210223 wait complete. 2024-05-09T00:04:46.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.449+0000 7fe1fbb9cb80 20 client.15963 trim_cache size 0 max 16384 2024-05-09T00:04:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1fbb9cb80 1 Processor -- start 2024-05-09T00:04:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1fbb9cb80 1 -- start start 2024-05-09T00:04:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1fbb9cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef0890 0x556c63ef0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1fbb9cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef5e00 0x556c63ef0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1fbb9cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef6720 0x556c63eead20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1fbb9cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c63ee5800 con 0x556c63ef5e00 2024-05-09T00:04:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1fbb9cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c63ef7f80 con 0x556c63ef0890 2024-05-09T00:04:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1fbb9cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c63ef1230 con 0x556c63ef6720 2024-05-09T00:04:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1ecf7d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef5e00 0x556c63ef0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1ecf7d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef5e00 0x556c63ef0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41982/0 (socket says 172.21.15.81:41982) 2024-05-09T00:04:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1ecf7d700 1 -- 172.21.15.81:0/599477416 learned_addr learned my addr 172.21.15.81:0/599477416 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1ed77e700 1 --2- 172.21.15.81:0/599477416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef0890 0x556c63ef0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1ecf7d700 1 -- 172.21.15.81:0/599477416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef6720 msgr2=0x556c63eead20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/599477416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef6720 0x556c63eead20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1ecf7d700 1 -- 172.21.15.81:0/599477416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef0890 msgr2=0x556c63ef0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/599477416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef0890 0x556c63ef0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1ecf7d700 1 -- 172.21.15.81:0/599477416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c63e06560 con 0x556c63ef5e00 2024-05-09T00:04:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1ed77e700 1 --2- 172.21.15.81:0/599477416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef0890 0x556c63ef0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/599477416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef5e00 0x556c63ef0c70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8198a20 tx=0x7fe1e4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979e00e32e231354 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1d3fff700 1 -- 172.21.15.81:0/599477416 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4023040 con 0x556c63ef5e00 2024-05-09T00:04:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1d3fff700 1 -- 172.21.15.81:0/599477416 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1e401f820 con 0x556c63ef5e00 2024-05-09T00:04:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.466+0000 7fe1d3fff700 1 -- 172.21.15.81:0/599477416 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4010690 con 0x556c63ef5e00 2024-05-09T00:04:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.467+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/599477416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef5e00 msgr2=0x556c63ef0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.467+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/599477416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef5e00 0x556c63ef0c70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8198a20 tx=0x7fe1e4014000 comp rx=0 tx=0).stop 2024-05-09T00:04:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.467+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/599477416 shutdown_connections 2024-05-09T00:04:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.467+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/599477416 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef0890 0x556c63ef0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.467+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/599477416 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef6720 0x556c63eead20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.467+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/599477416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef5e00 0x556c63ef0c70 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.467+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/599477416 >> 172.21.15.81:0/599477416 conn(0x556c63e4e210 msgr2=0x556c63f10f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.467+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/599477416 shutdown_connections 2024-05-09T00:04:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.467+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/599477416 wait complete. 2024-05-09T00:04:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.467+0000 7fe1fbb9cb80 1 -- start start 2024-05-09T00:04:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.467+0000 7fe1fbb9cb80 1 Processor -- start 2024-05-09T00:04:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1fbb9cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63f58b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1fbb9cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef5e00 0x556c63f59060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1fbb9cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef6720 0x556c63efd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1fbb9cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c63efddd0 con 0x556c63ef0890 2024-05-09T00:04:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1fbb9cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c63efdf40 con 0x556c63ef6720 2024-05-09T00:04:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1fbb9cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c63efe100 con 0x556c63ef5e00 2024-05-09T00:04:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1fbb9cb80 10 client.0 _ll_register_callbacks cb 0x556c63de5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1ed77e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63f58b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1ed77e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63f58b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41992/0 (socket says 172.21.15.81:41992) 2024-05-09T00:04:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1ed77e700 1 -- 172.21.15.81:0/520671969 learned_addr learned my addr 172.21.15.81:0/520671969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/520671969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef5e00 0x556c63f59060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1edf7f700 1 --2- 172.21.15.81:0/520671969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef6720 0x556c63efd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1ed77e700 1 -- 172.21.15.81:0/520671969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef5e00 msgr2=0x556c63f59060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1ed77e700 1 --2- 172.21.15.81:0/520671969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef5e00 0x556c63f59060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1ed77e700 1 -- 172.21.15.81:0/520671969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef6720 msgr2=0x556c63efd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1ed77e700 1 --2- 172.21.15.81:0/520671969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef6720 0x556c63efd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1ed77e700 1 -- 172.21.15.81:0/520671969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e400e8c0 con 0x556c63ef0890 2024-05-09T00:04:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1edf7f700 1 --2- 172.21.15.81:0/520671969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef6720 0x556c63efd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1ed77e700 1 --2- 172.21.15.81:0/520671969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63f58b20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80cd2d0 tx=0x7fe1d809a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16095a24a7d5144e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.468+0000 7fe1d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1d0ff9700 1 -- 172.21.15.81:0/520671969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8014040 con 0x556c63ef0890 2024-05-09T00:04:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1d0ff9700 1 -- 172.21.15.81:0/520671969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fe1d809c040 con 0x556c63ef0890 2024-05-09T00:04:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/520671969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1e0007e40 con 0x556c63ef0890 2024-05-09T00:04:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1d0ff9700 1 -- 172.21.15.81:0/520671969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1d80b8520 con 0x556c63ef0890 2024-05-09T00:04:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1fbb9cb80 10 client.15969 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/520671969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556c63cc5cd0 con 0x556c63ef0890 2024-05-09T00:04:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1d0ff9700 1 -- 172.21.15.81:0/520671969 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1d80a6020 con 0x556c63ef0890 2024-05-09T00:04:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1d0ff9700 1 -- 172.21.15.81:0/520671969 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe1d8082030 con 0x556c63ef0890 2024-05-09T00:04:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1fbb9cb80 10 client.15969 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1fbb9cb80 10 client.15969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1fbb9cb80 20 client.15969 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/520671969 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c63f61620 0x556c63f63a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1fbb9cb80 4 client.15969 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:04:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/520671969 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556c63e38ec0 con 0x556c63f61620 2024-05-09T00:04:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.469+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/520671969 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c63f61620 0x556c63f63a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.470+0000 7fe1d0ff9700 10 client.15969 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.470+0000 7fe1ecf7d700 1 --2- 172.21.15.81:0/520671969 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c63f61620 0x556c63f63a40 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ad2193763a35fc4 server_cookie=544ebd7929b90d0d in_seq=0 out_seq=0 2024-05-09T00:04:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1d0ff9700 1 -- 172.21.15.81:0/520671969 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556c63e38ec0 con 0x556c63f61620 2024-05-09T00:04:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1d0ff9700 10 client.15969 handle_command_reply: tid=0 2024-05-09T00:04:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1fbb9cb80 1 client.15969 shutdown 2024-05-09T00:04:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/520671969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 msgr2=0x556c63f58b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/520671969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63f58b20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80cd2d0 tx=0x7fe1d809a5f0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/520671969 shutdown_connections 2024-05-09T00:04:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/520671969 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c63f61620 0x556c63f63a40 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/520671969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c63ef6720 0x556c63efd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/520671969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c63ef0890 0x556c63f58b20 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1fbb9cb80 1 --2- 172.21.15.81:0/520671969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c63ef5e00 0x556c63f59060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1d0ff9700 0 client.15969 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/520671969 >> 172.21.15.81:0/520671969 conn(0x556c63e4e210 msgr2=0x556c63ef8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/520671969 shutdown_connections 2024-05-09T00:04:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1fbb9cb80 1 -- 172.21.15.81:0/520671969 wait complete. 2024-05-09T00:04:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1fbb9cb80 20 client.15969 trim_cache size 0 max 16384 2024-05-09T00:04:46.472 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:04:46.472 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:04:46.472 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:04:46.472 INFO:teuthology.orchestra.run.smithi081.stdout: "c5e27361-8f1a-49c3-93c6-de578068c0d6": { 2024-05-09T00:04:46.472 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:04:46.472 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "c5e27361-8f1a-49c3-93c6-de578068c0d6", 2024-05-09T00:04:46.472 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:04:46.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:04:46.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:04:46.472 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:04:46.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1ef9e2700 1 -- 172.21.15.81:0/3529213050 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1d40a1290 msgr2=0x7fe1d40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1ef9e2700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1d40a1290 0x7fe1d40a3750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4005fd0 tx=0x7fe1e400a5e0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1ef9e2700 1 -- 172.21.15.81:0/3529213050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8100060 msgr2=0x7fe1e81974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:46.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1ef9e2700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8100060 0x7fe1e81974d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800d950 tx=0x7fe1d800dd10 comp rx=0 tx=0).stop 2024-05-09T00:04:46.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1ef9e2700 1 -- 172.21.15.81:0/3529213050 shutdown_connections 2024-05-09T00:04:46.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1ef9e2700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1d40a1290 0x7fe1d40a3750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1ef9e2700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe1e819bdb0 0x7fe1e819c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1ef9e2700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1e8100060 0x7fe1e81974d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1ef9e2700 1 --2- 172.21.15.81:0/3529213050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe1e8105160 0x7fe1e8197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1ef9e2700 1 -- 172.21.15.81:0/3529213050 >> 172.21.15.81:0/3529213050 conn(0x7fe1e8076f40 msgr2=0x7fe1e80682d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1ef9e2700 1 -- 172.21.15.81:0/3529213050 shutdown_connections 2024-05-09T00:04:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:04:46.471+0000 7fe1ef9e2700 1 -- 172.21.15.81:0/3529213050 wait complete. 2024-05-09T00:04:46.477 INFO:tasks.cephfs.filesystem:scrub status for tag:c5e27361-8f1a-49c3-93c6-de578068c0d6 - {'path': '/', 'tag': 'c5e27361-8f1a-49c3-93c6-de578068c0d6', 'options': 'recursive,force'} 2024-05-09T00:04:46.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:46 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:04:46.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:46 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:04:46.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:46 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:04:46.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:46 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:04:47.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:46 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:04:47.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:46 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:04:47.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:46 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:04:47.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:46 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:04:47.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:46 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:04:47.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:46 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:04:47.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:46 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:04:47.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:46 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:04:48.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:47 smithi150 ceph-mon[46187]: pgmap v58: 97 pgs: 97 active+clean; 1.5 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-05-09T00:04:48.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:47 smithi171 ceph-mon[47351]: pgmap v58: 97 pgs: 97 active+clean; 1.5 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-05-09T00:04:48.119 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:47 smithi081 ceph-mon[42474]: pgmap v58: 97 pgs: 97 active+clean; 1.5 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-05-09T00:04:49.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:48 smithi150 ceph-mon[46187]: pgmap v59: 97 pgs: 97 active+clean; 1.5 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-05-09T00:04:49.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:48 smithi171 ceph-mon[47351]: pgmap v59: 97 pgs: 97 active+clean; 1.5 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-05-09T00:04:49.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:48 smithi081 ceph-mon[42474]: pgmap v59: 97 pgs: 97 active+clean; 1.5 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-05-09T00:04:50.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:49 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:04:50.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:49 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:04:50.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:49 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:04:51.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:50 smithi150 ceph-mon[46187]: pgmap v60: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-05-09T00:04:51.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:50 smithi171 ceph-mon[47351]: pgmap v60: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-05-09T00:04:51.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:50 smithi081 ceph-mon[42474]: pgmap v60: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-05-09T00:04:53.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:52 smithi150 ceph-mon[46187]: pgmap v61: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-05-09T00:04:53.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:52 smithi171 ceph-mon[47351]: pgmap v61: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-05-09T00:04:53.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:52 smithi081 ceph-mon[42474]: pgmap v61: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 16 KiB/s wr, 13 op/s 2024-05-09T00:04:55.263 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:54 smithi150 ceph-mon[46187]: pgmap v62: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-05-09T00:04:55.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:54 smithi171 ceph-mon[47351]: pgmap v62: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-05-09T00:04:55.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:54 smithi081 ceph-mon[42474]: pgmap v62: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 18 op/s 2024-05-09T00:04:57.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.199+0000 7fa781f2f700 1 -- 172.21.15.81:0/2164780062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa77c101aa0 msgr2=0x7fa77c105ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:57.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.199+0000 7fa781f2f700 1 --2- 172.21.15.81:0/2164780062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa77c101aa0 0x7fa77c105ae0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009990 tx=0x7fa76c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.199+0000 7fa781f2f700 1 -- 172.21.15.81:0/2164780062 shutdown_connections 2024-05-09T00:04:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.199+0000 7fa781f2f700 1 --2- 172.21.15.81:0/2164780062 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa77c1010f0 0x7fa77c1014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.199+0000 7fa781f2f700 1 --2- 172.21.15.81:0/2164780062 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa77c106210 0x7fa77c10dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.199+0000 7fa781f2f700 1 --2- 172.21.15.81:0/2164780062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa77c101aa0 0x7fa77c105ae0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.199+0000 7fa781f2f700 1 -- 172.21.15.81:0/2164780062 >> 172.21.15.81:0/2164780062 conn(0x7fa77c0fc9d0 msgr2=0x7fa77c0fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.199+0000 7fa781f2f700 1 -- 172.21.15.81:0/2164780062 shutdown_connections 2024-05-09T00:04:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.199+0000 7fa781f2f700 1 -- 172.21.15.81:0/2164780062 wait complete. 2024-05-09T00:04:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.199+0000 7fa781f2f700 1 Processor -- start 2024-05-09T00:04:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa781f2f700 1 -- start start 2024-05-09T00:04:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa781f2f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa77c1010f0 0x7fa77c197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa781f2f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa77c106210 0x7fa77c1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa781f2f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa77c19bc40 0x7fa77c19c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa781f2f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c19c6c0 con 0x7fa77c19bc40 2024-05-09T00:04:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa781f2f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c19c830 con 0x7fa77c106210 2024-05-09T00:04:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa781f2f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77c19c9f0 con 0x7fa77c1010f0 2024-05-09T00:04:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa77bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa77c19bc40 0x7fa77c19c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa77bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa77c19bc40 0x7fa77c19c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36864/0 (socket says 172.21.15.81:36864) 2024-05-09T00:04:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa77bfff700 1 -- 172.21.15.81:0/1396765239 learned_addr learned my addr 172.21.15.81:0/1396765239 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa77affd700 1 --2- 172.21.15.81:0/1396765239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa77c106210 0x7fa77c1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/1396765239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa77c1010f0 0x7fa77c197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa77bfff700 1 -- 172.21.15.81:0/1396765239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa77c1010f0 msgr2=0x7fa77c197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa77bfff700 1 --2- 172.21.15.81:0/1396765239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa77c1010f0 0x7fa77c197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa77bfff700 1 -- 172.21.15.81:0/1396765239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa77c106210 msgr2=0x7fa77c1978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa77bfff700 1 --2- 172.21.15.81:0/1396765239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa77c106210 0x7fa77c1978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa77bfff700 1 -- 172.21.15.81:0/1396765239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c0095f0 con 0x7fa77c19bc40 2024-05-09T00:04:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.200+0000 7fa77bfff700 1 --2- 172.21.15.81:0/1396765239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa77c19bc40 0x7fa77c19c0c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa774007ee0 tx=0x7fa77400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.201+0000 7fa778ff9700 1 -- 172.21.15.81:0/1396765239 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774017070 con 0x7fa77c19bc40 2024-05-09T00:04:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.201+0000 7fa778ff9700 1 -- 172.21.15.81:0/1396765239 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa77400f040 con 0x7fa77c19bc40 2024-05-09T00:04:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.201+0000 7fa781f2f700 1 -- 172.21.15.81:0/1396765239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77c1a3f50 con 0x7fa77c19bc40 2024-05-09T00:04:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.201+0000 7fa778ff9700 1 -- 172.21.15.81:0/1396765239 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa774005740 con 0x7fa77c19bc40 2024-05-09T00:04:57.199 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.201+0000 7fa781f2f700 1 -- 172.21.15.81:0/1396765239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77c1a4380 con 0x7fa77c19bc40 2024-05-09T00:04:57.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.203+0000 7fa778ff9700 1 -- 172.21.15.81:0/1396765239 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa77400dc60 con 0x7fa77c19bc40 2024-05-09T00:04:57.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.203+0000 7fa778ff9700 1 --2- 172.21.15.81:0/1396765239 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa7680a1290 0x7fa7680a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.204+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/1396765239 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa7680a1290 0x7fa7680a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.204+0000 7fa778ff9700 1 -- 172.21.15.81:0/1396765239 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa7740cc410 con 0x7fa77c19bc40 2024-05-09T00:04:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.204+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/1396765239 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa7680a1290 0x7fa7680a3750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa764009bd0 tx=0x7fa764009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa78e0e9b80 1 Processor -- start 2024-05-09T00:04:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa78e0e9b80 1 -- start start 2024-05-09T00:04:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa78e0e9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837016950 0x55b837016d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa78e0e9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837017270 0x55b837010f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa78e0e9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837011480 0x55b8370118a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa78e0e9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b836f680f0 con 0x55b837016950 2024-05-09T00:04:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa78e0e9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b836f65ab0 con 0x55b837011480 2024-05-09T00:04:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa78e0e9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b836f613a0 con 0x55b837017270 2024-05-09T00:04:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa77b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837016950 0x55b837016d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa77b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837016950 0x55b837016d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36870/0 (socket says 172.21.15.81:36870) 2024-05-09T00:04:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa77b7fe700 1 -- 172.21.15.81:0/2636916692 learned_addr learned my addr 172.21.15.81:0/2636916692 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa77affd700 1 --2- 172.21.15.81:0/2636916692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837017270 0x55b837010f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa77bfff700 1 --2- 172.21.15.81:0/2636916692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837011480 0x55b8370118a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa77b7fe700 1 -- 172.21.15.81:0/2636916692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837017270 msgr2=0x55b837010f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/2636916692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837017270 0x55b837010f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa77b7fe700 1 -- 172.21.15.81:0/2636916692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837011480 msgr2=0x55b8370118a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/2636916692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837011480 0x55b8370118a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.205+0000 7fa77b7fe700 1 -- 172.21.15.81:0/2636916692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b836de2350 con 0x55b837016950 2024-05-09T00:04:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.206+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/2636916692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837016950 0x55b837016d30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa764011e40 tx=0x7fa764014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a07c066fdb2af20 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.206+0000 7fa771ffb700 1 -- 172.21.15.81:0/2636916692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa764012dc0 con 0x55b837016950 2024-05-09T00:04:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.206+0000 7fa771ffb700 1 -- 172.21.15.81:0/2636916692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa764016070 con 0x55b837016950 2024-05-09T00:04:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.206+0000 7fa771ffb700 1 -- 172.21.15.81:0/2636916692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76401d610 con 0x55b837016950 2024-05-09T00:04:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.206+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/2636916692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837016950 msgr2=0x55b837016d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.206+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/2636916692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837016950 0x55b837016d30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa764011e40 tx=0x7fa764014000 comp rx=0 tx=0).stop 2024-05-09T00:04:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.206+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/2636916692 shutdown_connections 2024-05-09T00:04:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.206+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/2636916692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837011480 0x55b8370118a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.206+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/2636916692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837016950 0x55b837016d30 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.206+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/2636916692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837017270 0x55b837010f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.206+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/2636916692 >> 172.21.15.81:0/2636916692 conn(0x55b836f6f1b0 msgr2=0x55b83700b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.206+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/2636916692 shutdown_connections 2024-05-09T00:04:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.207+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/2636916692 wait complete. 2024-05-09T00:04:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.207+0000 7fa78e0e9b80 1 -- start start 2024-05-09T00:04:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.207+0000 7fa78e0e9b80 1 Processor -- start 2024-05-09T00:04:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.207+0000 7fa78e0e9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837011480 0x55b83701d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.207+0000 7fa78e0e9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837016950 0x55b83701a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.207+0000 7fa78e0e9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837017270 0x55b83701ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.207+0000 7fa78e0e9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b836efd500 con 0x55b837011480 2024-05-09T00:04:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.207+0000 7fa78e0e9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b836efd1a0 con 0x55b837016950 2024-05-09T00:04:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.207+0000 7fa78e0e9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b836de4640 con 0x55b837017270 2024-05-09T00:04:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.207+0000 7fa78e0e9b80 10 client.0 _ll_register_callbacks cb 0x55b836f06ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.207+0000 7fa77b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837011480 0x55b83701d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.207+0000 7fa77b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837011480 0x55b83701d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36880/0 (socket says 172.21.15.81:36880) 2024-05-09T00:04:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.207+0000 7fa77b7fe700 1 -- 172.21.15.81:0/1769815531 learned_addr learned my addr 172.21.15.81:0/1769815531 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa77bfff700 1 --2- 172.21.15.81:0/1769815531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837017270 0x55b83701ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa77affd700 1 --2- 172.21.15.81:0/1769815531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837016950 0x55b83701a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa77b7fe700 1 -- 172.21.15.81:0/1769815531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837017270 msgr2=0x55b83701ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/1769815531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837017270 0x55b83701ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.214 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa77b7fe700 1 -- 172.21.15.81:0/1769815531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837016950 msgr2=0x55b83701a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/1769815531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837016950 0x55b83701a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa77b7fe700 1 -- 172.21.15.81:0/1769815531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa764011af0 con 0x55b837011480 2024-05-09T00:04:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa77affd700 1 --2- 172.21.15.81:0/1769815531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837016950 0x55b83701a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/1769815531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837011480 0x55b83701d1b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa764011e10 tx=0x7fa76401f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a068ac93eeb5239 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa75affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa75affd700 1 -- 172.21.15.81:0/1769815531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76402c070 con 0x55b837011480 2024-05-09T00:04:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa75affd700 1 -- 172.21.15.81:0/1769815531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa764018070 con 0x55b837011480 2024-05-09T00:04:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/1769815531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b836eba210 con 0x55b837011480 2024-05-09T00:04:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa75affd700 1 -- 172.21.15.81:0/1769815531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa764005ce0 con 0x55b837011480 2024-05-09T00:04:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa78e0e9b80 10 client.15981 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.208+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/1769815531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b836d8eb00 con 0x55b837011480 2024-05-09T00:04:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.209+0000 7fa75affd700 1 -- 172.21.15.81:0/1769815531 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa76403e020 con 0x55b837011480 2024-05-09T00:04:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.209+0000 7fa75affd700 1 -- 172.21.15.81:0/1769815531 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa764004b20 con 0x55b837011480 2024-05-09T00:04:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.209+0000 7fa78e0e9b80 10 client.15981 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.209+0000 7fa78e0e9b80 10 client.15981 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.209+0000 7fa78e0e9b80 20 client.15981 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.209+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/1769815531 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b83702aa50 0x55b83702ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.209+0000 7fa78e0e9b80 4 client.15981 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:04:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.209+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/1769815531 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b836fe07b0 con 0x55b83702aa50 2024-05-09T00:04:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.209+0000 7fa77affd700 1 --2- 172.21.15.81:0/1769815531 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b83702aa50 0x55b83702ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.210+0000 7fa75affd700 10 client.15981 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.210+0000 7fa77affd700 1 --2- 172.21.15.81:0/1769815531 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b83702aa50 0x55b83702ce40 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4475450a4c3b5fb5 server_cookie=70ae49c7c22467a4 in_seq=0 out_seq=0 2024-05-09T00:04:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.210+0000 7fa75affd700 1 -- 172.21.15.81:0/1769815531 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b836fe07b0 con 0x55b83702aa50 2024-05-09T00:04:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.210+0000 7fa75affd700 10 client.15981 handle_command_reply: tid=0 2024-05-09T00:04:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.210+0000 7fa78e0e9b80 1 client.15981 shutdown 2024-05-09T00:04:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.210+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/1769815531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837011480 msgr2=0x55b83701d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.210+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/1769815531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837011480 0x55b83701d1b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa764011e10 tx=0x7fa76401f6a0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.210+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/1769815531 shutdown_connections 2024-05-09T00:04:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.210+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/1769815531 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b83702aa50 0x55b83702ce40 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.210+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/1769815531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837017270 0x55b83701ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.210+0000 7fa75affd700 0 client.15981 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.210+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/1769815531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837011480 0x55b83701d1b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.210+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/1769815531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837016950 0x55b83701a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.210+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/1769815531 >> 172.21.15.81:0/1769815531 conn(0x55b836f6f1b0 msgr2=0x55b83700ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.211+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/1769815531 shutdown_connections 2024-05-09T00:04:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.211+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/1769815531 wait complete. 2024-05-09T00:04:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.211+0000 7fa78e0e9b80 20 client.15981 trim_cache size 0 max 16384 2024-05-09T00:04:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.225+0000 7fa78e0e9b80 1 Processor -- start 2024-05-09T00:04:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.225+0000 7fa78e0e9b80 1 -- start start 2024-05-09T00:04:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa78e0e9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837011480 0x55b83700b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa78e0e9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837016950 0x55b83701cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa78e0e9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837017270 0x55b837021c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa78e0e9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83701baf0 con 0x55b837011480 2024-05-09T00:04:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa78e0e9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8370170f0 con 0x55b837016950 2024-05-09T00:04:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa78e0e9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83701b180 con 0x55b837017270 2024-05-09T00:04:57.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa77b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837011480 0x55b83700b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa77b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837011480 0x55b83700b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36894/0 (socket says 172.21.15.81:36894) 2024-05-09T00:04:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa77b7fe700 1 -- 172.21.15.81:0/33969267 learned_addr learned my addr 172.21.15.81:0/33969267 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa77b7fe700 1 -- 172.21.15.81:0/33969267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837017270 msgr2=0x55b837021c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/33969267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837017270 0x55b837021c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa77b7fe700 1 -- 172.21.15.81:0/33969267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837016950 msgr2=0x55b83701cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/33969267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837016950 0x55b83701cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa77b7fe700 1 -- 172.21.15.81:0/33969267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b836f27500 con 0x55b837011480 2024-05-09T00:04:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/33969267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837011480 0x55b83700b910 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa764004e80 tx=0x7fa764011820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45267532ab51354 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa7727fc700 1 -- 172.21.15.81:0/33969267 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76402c070 con 0x55b837011480 2024-05-09T00:04:57.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa7727fc700 1 -- 172.21.15.81:0/33969267 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa76403e030 con 0x55b837011480 2024-05-09T00:04:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.226+0000 7fa7727fc700 1 -- 172.21.15.81:0/33969267 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76401f7c0 con 0x55b837011480 2024-05-09T00:04:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.227+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/33969267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837011480 msgr2=0x55b83700b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.227+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/33969267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837011480 0x55b83700b910 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa764004e80 tx=0x7fa764011820 comp rx=0 tx=0).stop 2024-05-09T00:04:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.227+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/33969267 shutdown_connections 2024-05-09T00:04:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.227+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/33969267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837017270 0x55b837021c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.227+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/33969267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837011480 0x55b83700b910 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.227+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/33969267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837016950 0x55b83701cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.227+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/33969267 >> 172.21.15.81:0/33969267 conn(0x55b836f6f1b0 msgr2=0x55b837018dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.227+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/33969267 shutdown_connections 2024-05-09T00:04:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.227+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/33969267 wait complete. 2024-05-09T00:04:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.227+0000 7fa78e0e9b80 1 -- start start 2024-05-09T00:04:57.227 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.227+0000 7fa78e0e9b80 1 Processor -- start 2024-05-09T00:04:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa78e0e9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837011480 0x55b837020dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa78e0e9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837016950 0x55b837021300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa78e0e9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837017270 0x55b837021840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa78e0e9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b837022560 con 0x55b837016950 2024-05-09T00:04:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa78e0e9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b83707ff20 con 0x55b837017270 2024-05-09T00:04:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa78e0e9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8370800e0 con 0x55b837011480 2024-05-09T00:04:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa78e0e9b80 10 client.0 _ll_register_callbacks cb 0x55b836f06ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:04:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa77affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837016950 0x55b837021300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa77affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837016950 0x55b837021300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:36910/0 (socket says 172.21.15.81:36910) 2024-05-09T00:04:57.228 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa77affd700 1 -- 172.21.15.81:0/2535445441 learned_addr learned my addr 172.21.15.81:0/2535445441 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:04:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/2535445441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837011480 0x55b837020dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa77bfff700 1 --2- 172.21.15.81:0/2535445441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837017270 0x55b837021840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa77affd700 1 -- 172.21.15.81:0/2535445441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837011480 msgr2=0x55b837020dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa77affd700 1 --2- 172.21.15.81:0/2535445441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837011480 0x55b837020dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa77affd700 1 -- 172.21.15.81:0/2535445441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837017270 msgr2=0x55b837021840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:04:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa77affd700 1 --2- 172.21.15.81:0/2535445441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837017270 0x55b837021840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa77affd700 1 -- 172.21.15.81:0/2535445441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b836d8eb00 con 0x55b837016950 2024-05-09T00:04:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/2535445441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837011480 0x55b837020dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:04:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa77affd700 1 --2- 172.21.15.81:0/2535445441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837016950 0x55b837021300 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009990 tx=0x7fa76c005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95af7af810a8d8c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:04:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa75affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:04:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.228+0000 7fa75affd700 1 -- 172.21.15.81:0/2535445441 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c01d070 con 0x55b837016950 2024-05-09T00:04:57.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.229+0000 7fa75affd700 1 -- 172.21.15.81:0/2535445441 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa76c00bcd0 con 0x55b837016950 2024-05-09T00:04:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.229+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/2535445441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa764016070 con 0x55b837016950 2024-05-09T00:04:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.229+0000 7fa75affd700 1 -- 172.21.15.81:0/2535445441 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa76c00be90 con 0x55b837016950 2024-05-09T00:04:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.229+0000 7fa78e0e9b80 10 client.15987 fetch_fsmap learned FSMap version 26 2024-05-09T00:04:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.229+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/2535445441 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b836de6c70 con 0x55b837016950 2024-05-09T00:04:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.229+0000 7fa75affd700 1 -- 172.21.15.81:0/2535445441 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa764016070 con 0x55b837016950 2024-05-09T00:04:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.229+0000 7fa75affd700 1 -- 172.21.15.81:0/2535445441 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa76c00f610 con 0x55b837016950 2024-05-09T00:04:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.229+0000 7fa78e0e9b80 10 client.15987 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:04:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.229+0000 7fa78e0e9b80 10 client.15987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:04:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.229+0000 7fa78e0e9b80 20 client.15987 populate_metadata read hostname 'smithi081' 2024-05-09T00:04:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.229+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/2535445441 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b837081920 0x55b837083d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:04:57.230 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.229+0000 7fa78e0e9b80 4 client.15987 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:04:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.229+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/2535445441 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b836f59e60 con 0x55b837081920 2024-05-09T00:04:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.229+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/2535445441 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b837081920 0x55b837083d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:04:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.230+0000 7fa75affd700 10 client.15987 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:57.231 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.230+0000 7fa77b7fe700 1 --2- 172.21.15.81:0/2535445441 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b837081920 0x55b837083d40 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e411ffa2a307c88d server_cookie=f50c15c584a62915 in_seq=0 out_seq=0 2024-05-09T00:04:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa75affd700 1 -- 172.21.15.81:0/2535445441 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b836f59e60 con 0x55b837081920 2024-05-09T00:04:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa75affd700 10 client.15987 handle_command_reply: tid=0 2024-05-09T00:04:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa78e0e9b80 1 client.15987 shutdown 2024-05-09T00:04:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/2535445441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837016950 msgr2=0x55b837021300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/2535445441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837016950 0x55b837021300 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009990 tx=0x7fa76c005520 comp rx=0 tx=0).stop 2024-05-09T00:04:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/2535445441 shutdown_connections 2024-05-09T00:04:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/2535445441 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b837081920 0x55b837083d40 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/2535445441 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b837017270 0x55b837021840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa75affd700 0 client.15987 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:04:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/2535445441 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b837011480 0x55b837020dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa78e0e9b80 1 --2- 172.21.15.81:0/2535445441 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b837016950 0x55b837021300 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/2535445441 >> 172.21.15.81:0/2535445441 conn(0x55b836f6f1b0 msgr2=0x55b837019c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/2535445441 shutdown_connections 2024-05-09T00:04:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa78e0e9b80 1 -- 172.21.15.81:0/2535445441 wait complete. 2024-05-09T00:04:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.243+0000 7fa78e0e9b80 20 client.15987 trim_cache size 0 max 16384 2024-05-09T00:04:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:04:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:04:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:04:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:04:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.244+0000 7fa781f2f700 1 -- 172.21.15.81:0/1396765239 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa7680a1290 msgr2=0x7fa7680a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.244+0000 7fa781f2f700 1 --2- 172.21.15.81:0/1396765239 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa7680a1290 0x7fa7680a3750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa764009bd0 tx=0x7fa764009260 comp rx=0 tx=0).stop 2024-05-09T00:04:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.244+0000 7fa781f2f700 1 -- 172.21.15.81:0/1396765239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa77c19bc40 msgr2=0x7fa77c19c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:04:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.244+0000 7fa781f2f700 1 --2- 172.21.15.81:0/1396765239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa77c19bc40 0x7fa77c19c0c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa774007ee0 tx=0x7fa77400d3b0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.244+0000 7fa781f2f700 1 -- 172.21.15.81:0/1396765239 shutdown_connections 2024-05-09T00:04:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.244+0000 7fa781f2f700 1 --2- 172.21.15.81:0/1396765239 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa7680a1290 0x7fa7680a3750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.244+0000 7fa781f2f700 1 --2- 172.21.15.81:0/1396765239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa77c19bc40 0x7fa77c19c0c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.244+0000 7fa781f2f700 1 --2- 172.21.15.81:0/1396765239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa77c1010f0 0x7fa77c197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.244+0000 7fa781f2f700 1 --2- 172.21.15.81:0/1396765239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa77c106210 0x7fa77c1978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:04:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.244+0000 7fa781f2f700 1 -- 172.21.15.81:0/1396765239 >> 172.21.15.81:0/1396765239 conn(0x7fa77c0fc9d0 msgr2=0x7fa77c0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:04:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.244+0000 7fa781f2f700 1 -- 172.21.15.81:0/1396765239 shutdown_connections 2024-05-09T00:04:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:04:57.244+0000 7fa781f2f700 1 -- 172.21.15.81:0/1396765239 wait complete. 2024-05-09T00:04:57.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:56 smithi150 ceph-mon[46187]: pgmap v63: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-05-09T00:04:57.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:56 smithi171 ceph-mon[47351]: pgmap v63: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-05-09T00:04:57.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:56 smithi081 ceph-mon[42474]: pgmap v63: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-05-09T00:04:59.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:04:58 smithi150 ceph-mon[46187]: pgmap v64: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-05-09T00:04:59.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:04:58 smithi171 ceph-mon[47351]: pgmap v64: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-05-09T00:04:59.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:04:58 smithi081 ceph-mon[42474]: pgmap v64: 97 pgs: 97 active+clean; 1.6 MiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 11 op/s 2024-05-09T00:05:01.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:00 smithi150 ceph-mon[46187]: pgmap v65: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-05-09T00:05:01.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:00 smithi171 ceph-mon[47351]: pgmap v65: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-05-09T00:05:01.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:00 smithi081 ceph-mon[42474]: pgmap v65: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 18 op/s 2024-05-09T00:05:03.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:02 smithi150 ceph-mon[46187]: pgmap v66: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-05-09T00:05:03.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:02 smithi171 ceph-mon[47351]: pgmap v66: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-05-09T00:05:03.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:02 smithi081 ceph-mon[42474]: pgmap v66: 97 pgs: 97 active+clean; 1.7 MiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 17 KiB/s wr, 12 op/s 2024-05-09T00:05:04.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:03 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:05:04.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:03 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:05:04.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:03 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:05:04.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:03 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:05:04.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:03 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:05:04.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:03 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:05:04.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:03 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:05:04.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:03 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:05:04.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:03 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:05:04.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:03 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:05:04.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:03 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:05:04.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:03 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:05:05.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:04 smithi150 ceph-mon[46187]: pgmap v67: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 48 KiB/s wr, 32 op/s 2024-05-09T00:05:05.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:05 smithi171 ceph-mon[47351]: pgmap v67: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 48 KiB/s wr, 32 op/s 2024-05-09T00:05:05.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:04 smithi081 ceph-mon[42474]: pgmap v67: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 48 KiB/s wr, 32 op/s 2024-05-09T00:05:07.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:06 smithi150 ceph-mon[46187]: pgmap v68: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 41 KiB/s wr, 27 op/s 2024-05-09T00:05:07.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:06 smithi171 ceph-mon[47351]: pgmap v68: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 41 KiB/s wr, 27 op/s 2024-05-09T00:05:07.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:06 smithi081 ceph-mon[42474]: pgmap v68: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 41 KiB/s wr, 27 op/s 2024-05-09T00:05:09.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:08 smithi150 ceph-mon[46187]: pgmap v69: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 41 KiB/s wr, 27 op/s 2024-05-09T00:05:09.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:08 smithi171 ceph-mon[47351]: pgmap v69: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 41 KiB/s wr, 27 op/s 2024-05-09T00:05:09.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:08 smithi081 ceph-mon[42474]: pgmap v69: 97 pgs: 97 active+clean; 1.8 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 41 KiB/s wr, 27 op/s 2024-05-09T00:05:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.361+0000 7efcb63f9700 1 -- 172.21.15.81:0/921049555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb0100760 msgr2=0x7efcb010cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.361+0000 7efcb63f9700 1 --2- 172.21.15.81:0/921049555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb0100760 0x7efcb010cc00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7efca800b0a0 tx=0x7efca800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.361+0000 7efcb63f9700 1 -- 172.21.15.81:0/921049555 shutdown_connections 2024-05-09T00:05:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.361+0000 7efcb63f9700 1 --2- 172.21.15.81:0/921049555 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb0105e60 0x7efcb0106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.361+0000 7efcb63f9700 1 --2- 172.21.15.81:0/921049555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb0100760 0x7efcb010cc00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.361+0000 7efcb63f9700 1 --2- 172.21.15.81:0/921049555 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcb00ffda0 0x7efcb0100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.361+0000 7efcb63f9700 1 -- 172.21.15.81:0/921049555 >> 172.21.15.81:0/921049555 conn(0x7efcb0076f10 msgr2=0x7efcb0077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.361+0000 7efcb63f9700 1 -- 172.21.15.81:0/921049555 shutdown_connections 2024-05-09T00:05:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.361+0000 7efcb63f9700 1 -- 172.21.15.81:0/921049555 wait complete. 2024-05-09T00:05:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.361+0000 7efcb63f9700 1 Processor -- start 2024-05-09T00:05:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.361+0000 7efcb63f9700 1 -- start start 2024-05-09T00:05:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcb63f9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb00ffda0 0x7efcb01981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcb63f9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb0100760 0x7efcb0198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcb63f9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcb0105e60 0x7efcb01a3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcb63f9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb0198f90 con 0x7efcb0100760 2024-05-09T00:05:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcb63f9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb01a3790 con 0x7efcb00ffda0 2024-05-09T00:05:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcb63f9700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb01a38d0 con 0x7efcb0105e60 2024-05-09T00:05:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcaf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb0100760 0x7efcb0198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcaf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb0100760 0x7efcb0198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34710/0 (socket says 172.21.15.81:34710) 2024-05-09T00:05:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcaf7fe700 1 -- 172.21.15.81:0/1066335186 learned_addr learned my addr 172.21.15.81:0/1066335186 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcaffff700 1 --2- 172.21.15.81:0/1066335186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb00ffda0 0x7efcb01981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcb4996700 1 --2- 172.21.15.81:0/1066335186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcb0105e60 0x7efcb01a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcaf7fe700 1 -- 172.21.15.81:0/1066335186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcb0105e60 msgr2=0x7efcb01a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcaf7fe700 1 --2- 172.21.15.81:0/1066335186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcb0105e60 0x7efcb01a3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcaf7fe700 1 -- 172.21.15.81:0/1066335186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb00ffda0 msgr2=0x7efcb01981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcaf7fe700 1 --2- 172.21.15.81:0/1066335186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb00ffda0 0x7efcb01981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.362+0000 7efcaf7fe700 1 -- 172.21.15.81:0/1066335186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca8009d00 con 0x7efcb0100760 2024-05-09T00:05:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.363+0000 7efcaf7fe700 1 --2- 172.21.15.81:0/1066335186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb0100760 0x7efcb0198710 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7efca400d950 tx=0x7efca400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.363+0000 7efcad7fa700 1 -- 172.21.15.81:0/1066335186 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca400f890 con 0x7efcb0100760 2024-05-09T00:05:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.363+0000 7efcad7fa700 1 -- 172.21.15.81:0/1066335186 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efca4010460 con 0x7efcb0100760 2024-05-09T00:05:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.363+0000 7efcb63f9700 1 -- 172.21.15.81:0/1066335186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb01a3b60 con 0x7efcb0100760 2024-05-09T00:05:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.363+0000 7efcad7fa700 1 -- 172.21.15.81:0/1066335186 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca40195c0 con 0x7efcb0100760 2024-05-09T00:05:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.363+0000 7efcb63f9700 1 -- 172.21.15.81:0/1066335186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb01a4070 con 0x7efcb0100760 2024-05-09T00:05:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.365+0000 7efcad7fa700 1 -- 172.21.15.81:0/1066335186 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7efca40108d0 con 0x7efcb0100760 2024-05-09T00:05:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.366+0000 7efcad7fa700 1 --2- 172.21.15.81:0/1066335186 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efc980a1290 0x7efc980a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.366+0000 7efcaffff700 1 --2- 172.21.15.81:0/1066335186 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efc980a1290 0x7efc980a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.366+0000 7efcad7fa700 1 -- 172.21.15.81:0/1066335186 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7efca40ccad0 con 0x7efcb0100760 2024-05-09T00:05:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.366+0000 7efcaffff700 1 --2- 172.21.15.81:0/1066335186 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efc980a1290 0x7efc980a3750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efca00045b0 tx=0x7efca000b3c0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.367+0000 7efcc25b3b80 1 Processor -- start 2024-05-09T00:05:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.367+0000 7efcc25b3b80 1 -- start start 2024-05-09T00:05:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.367+0000 7efcc25b3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba05950 0x56293ba05d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.367+0000 7efcc25b3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba06270 0x56293b9fff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.368 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.367+0000 7efcc25b3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba00480 0x56293ba008a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.367+0000 7efcc25b3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293b9570f0 con 0x56293ba06270 2024-05-09T00:05:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.367+0000 7efcc25b3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293b954ab0 con 0x56293ba05950 2024-05-09T00:05:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.367+0000 7efcc25b3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293b9503a0 con 0x56293ba00480 2024-05-09T00:05:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.367+0000 7efcaf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba06270 0x56293b9fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.367+0000 7efcaf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba06270 0x56293b9fff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34718/0 (socket says 172.21.15.81:34718) 2024-05-09T00:05:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.367+0000 7efcaf7fe700 1 -- 172.21.15.81:0/2184223056 learned_addr learned my addr 172.21.15.81:0/2184223056 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.367+0000 7efcb4996700 1 --2- 172.21.15.81:0/2184223056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba00480 0x56293ba008a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.367+0000 7efcaffff700 1 --2- 172.21.15.81:0/2184223056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba05950 0x56293ba05d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.368+0000 7efcaf7fe700 1 -- 172.21.15.81:0/2184223056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba00480 msgr2=0x56293ba008a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.368+0000 7efcaf7fe700 1 --2- 172.21.15.81:0/2184223056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba00480 0x56293ba008a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.368+0000 7efcaf7fe700 1 -- 172.21.15.81:0/2184223056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba05950 msgr2=0x56293ba05d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.368+0000 7efcaf7fe700 1 --2- 172.21.15.81:0/2184223056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba05950 0x56293ba05d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.368+0000 7efcaf7fe700 1 -- 172.21.15.81:0/2184223056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56293b7d1350 con 0x56293ba06270 2024-05-09T00:05:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.368+0000 7efcaf7fe700 1 --2- 172.21.15.81:0/2184223056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba06270 0x56293b9fff40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7efca40a1af0 tx=0x7efca409a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926e0668a119c2b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.368+0000 7efc967fc700 1 -- 172.21.15.81:0/2184223056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca40a2020 con 0x56293ba06270 2024-05-09T00:05:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.368+0000 7efc967fc700 1 -- 172.21.15.81:0/2184223056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efca40962b0 con 0x56293ba06270 2024-05-09T00:05:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.368+0000 7efc967fc700 1 -- 172.21.15.81:0/2184223056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca40992d0 con 0x56293ba06270 2024-05-09T00:05:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.368+0000 7efcc25b3b80 1 -- 172.21.15.81:0/2184223056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba06270 msgr2=0x56293b9fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.368+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/2184223056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba06270 0x56293b9fff40 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7efca40a1af0 tx=0x7efca409a320 comp rx=0 tx=0).stop 2024-05-09T00:05:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 -- 172.21.15.81:0/2184223056 shutdown_connections 2024-05-09T00:05:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/2184223056 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba05950 0x56293ba05d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/2184223056 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba00480 0x56293ba008a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/2184223056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba06270 0x56293b9fff40 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 -- 172.21.15.81:0/2184223056 >> 172.21.15.81:0/2184223056 conn(0x56293b95e1b0 msgr2=0x56293b9fa840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:10.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 -- 172.21.15.81:0/2184223056 shutdown_connections 2024-05-09T00:05:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 -- 172.21.15.81:0/2184223056 wait complete. 2024-05-09T00:05:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 -- start start 2024-05-09T00:05:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 Processor -- start 2024-05-09T00:05:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba00480 0x56293ba0c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba05950 0x56293ba09590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba06270 0x56293ba09cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293b8ec500 con 0x56293ba06270 2024-05-09T00:05:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293b8ec1a0 con 0x56293ba00480 2024-05-09T00:05:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293b7d3640 con 0x56293ba05950 2024-05-09T00:05:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.369+0000 7efcc25b3b80 10 client.0 _ll_register_callbacks cb 0x56293b8f5ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcb4996700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba06270 0x56293ba09cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcb4996700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba06270 0x56293ba09cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34728/0 (socket says 172.21.15.81:34728) 2024-05-09T00:05:10.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcb4996700 1 -- 172.21.15.81:0/3046520987 learned_addr learned my addr 172.21.15.81:0/3046520987 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcaf7fe700 1 --2- 172.21.15.81:0/3046520987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba05950 0x56293ba09590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcaffff700 1 --2- 172.21.15.81:0/3046520987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba00480 0x56293ba0c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcb4996700 1 -- 172.21.15.81:0/3046520987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba05950 msgr2=0x56293ba09590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcb4996700 1 --2- 172.21.15.81:0/3046520987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba05950 0x56293ba09590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcb4996700 1 -- 172.21.15.81:0/3046520987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba00480 msgr2=0x56293ba0c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcb4996700 1 --2- 172.21.15.81:0/3046520987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba00480 0x56293ba0c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcb4996700 1 -- 172.21.15.81:0/3046520987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb01a4070 con 0x56293ba06270 2024-05-09T00:05:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcaffff700 1 --2- 172.21.15.81:0/3046520987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba00480 0x56293ba0c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcb4996700 1 --2- 172.21.15.81:0/3046520987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba06270 0x56293ba09cd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7efca8009300 tx=0x7efca8009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7623f9148f09ddb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efc8f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efc8f7fe700 1 -- 172.21.15.81:0/3046520987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca800e040 con 0x56293ba06270 2024-05-09T00:05:10.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efc8f7fe700 1 -- 172.21.15.81:0/3046520987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7efca8003e10 con 0x56293ba06270 2024-05-09T00:05:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcc25b3b80 1 -- 172.21.15.81:0/3046520987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56293b8a9210 con 0x56293ba06270 2024-05-09T00:05:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efc8f7fe700 1 -- 172.21.15.81:0/3046520987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efca80074e0 con 0x56293ba06270 2024-05-09T00:05:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcc25b3b80 10 client.15999 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.370+0000 7efcc25b3b80 1 -- 172.21.15.81:0/3046520987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56293b77db00 con 0x56293ba06270 2024-05-09T00:05:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.371+0000 7efc8f7fe700 1 -- 172.21.15.81:0/3046520987 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56293b8a9210 con 0x56293ba06270 2024-05-09T00:05:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.371+0000 7efc8f7fe700 1 -- 172.21.15.81:0/3046520987 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7efca8019070 con 0x56293ba06270 2024-05-09T00:05:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.371+0000 7efcc25b3b80 10 client.15999 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.371+0000 7efcc25b3b80 10 client.15999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.371+0000 7efcc25b3b80 20 client.15999 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.371+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/3046520987 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56293ba19b70 0x56293ba1bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.371+0000 7efcc25b3b80 4 client.15999 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.371+0000 7efcc25b3b80 1 -- 172.21.15.81:0/3046520987 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56293b9cf7b0 con 0x56293ba19b70 2024-05-09T00:05:10.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.371+0000 7efcaffff700 1 --2- 172.21.15.81:0/3046520987 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56293ba19b70 0x56293ba1bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.371+0000 7efc8f7fe700 10 client.15999 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.371+0000 7efcaffff700 1 --2- 172.21.15.81:0/3046520987 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56293ba19b70 0x56293ba1bf90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92214048c184518a server_cookie=ae1fc79618543328 in_seq=0 out_seq=0 2024-05-09T00:05:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efc8f7fe700 1 -- 172.21.15.81:0/3046520987 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56293b9cf7b0 con 0x56293ba19b70 2024-05-09T00:05:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efc8f7fe700 10 client.15999 handle_command_reply: tid=0 2024-05-09T00:05:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efcc25b3b80 1 client.15999 shutdown 2024-05-09T00:05:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efcc25b3b80 1 -- 172.21.15.81:0/3046520987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba06270 msgr2=0x56293ba09cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/3046520987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba06270 0x56293ba09cd0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7efca8009300 tx=0x7efca8009330 comp rx=0 tx=0).stop 2024-05-09T00:05:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efcc25b3b80 1 -- 172.21.15.81:0/3046520987 shutdown_connections 2024-05-09T00:05:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/3046520987 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56293ba19b70 0x56293ba1bf90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/3046520987 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba00480 0x56293ba0c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/3046520987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba06270 0x56293ba09cd0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efc8f7fe700 0 client.15999 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:10.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/3046520987 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba05950 0x56293ba09590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efcc25b3b80 1 -- 172.21.15.81:0/3046520987 >> 172.21.15.81:0/3046520987 conn(0x56293b95e1b0 msgr2=0x56293ba044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efcc25b3b80 1 -- 172.21.15.81:0/3046520987 shutdown_connections 2024-05-09T00:05:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efcc25b3b80 1 -- 172.21.15.81:0/3046520987 wait complete. 2024-05-09T00:05:10.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.372+0000 7efcc25b3b80 20 client.15999 trim_cache size 0 max 16384 2024-05-09T00:05:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.387+0000 7efcc25b3b80 1 Processor -- start 2024-05-09T00:05:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.387+0000 7efcc25b3b80 1 -- start start 2024-05-09T00:05:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.387+0000 7efcc25b3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba00480 0x56293ba1bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.387+0000 7efcc25b3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba05950 0x56293b9fa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.387+0000 7efcc25b3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba06270 0x56293b9f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.387+0000 7efcc25b3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293ba0ab80 con 0x56293ba05950 2024-05-09T00:05:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.387+0000 7efcc25b3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293b9fc510 con 0x56293ba06270 2024-05-09T00:05:10.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.387+0000 7efcc25b3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293b9f57e0 con 0x56293ba00480 2024-05-09T00:05:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.387+0000 7efcaf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba05950 0x56293b9fa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.387+0000 7efcaf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba05950 0x56293b9fa910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34742/0 (socket says 172.21.15.81:34742) 2024-05-09T00:05:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.387+0000 7efcaf7fe700 1 -- 172.21.15.81:0/4104320267 learned_addr learned my addr 172.21.15.81:0/4104320267 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.388+0000 7efcb4996700 1 --2- 172.21.15.81:0/4104320267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba06270 0x56293b9f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.388+0000 7efcaf7fe700 1 -- 172.21.15.81:0/4104320267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba00480 msgr2=0x56293ba1bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.388+0000 7efcaffff700 1 --2- 172.21.15.81:0/4104320267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba00480 0x56293ba1bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.388+0000 7efcaf7fe700 1 --2- 172.21.15.81:0/4104320267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba00480 0x56293ba1bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.388+0000 7efcaf7fe700 1 -- 172.21.15.81:0/4104320267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba06270 msgr2=0x56293b9f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.388+0000 7efcaf7fe700 1 --2- 172.21.15.81:0/4104320267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba06270 0x56293b9f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.388+0000 7efcaf7fe700 1 -- 172.21.15.81:0/4104320267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56293b916500 con 0x56293ba05950 2024-05-09T00:05:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.388+0000 7efcaf7fe700 1 --2- 172.21.15.81:0/4104320267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba05950 0x56293b9fa910 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7efca4096610 tx=0x7efca4010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aee4a6b78f9529 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:10.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.388+0000 7efc96ffd700 1 -- 172.21.15.81:0/4104320267 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca40b6070 con 0x56293ba05950 2024-05-09T00:05:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.388+0000 7efc96ffd700 1 -- 172.21.15.81:0/4104320267 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efca40b1070 con 0x56293ba05950 2024-05-09T00:05:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.388+0000 7efc96ffd700 1 -- 172.21.15.81:0/4104320267 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca409a020 con 0x56293ba05950 2024-05-09T00:05:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 -- 172.21.15.81:0/4104320267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba05950 msgr2=0x56293b9fa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/4104320267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba05950 0x56293b9fa910 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7efca4096610 tx=0x7efca4010cd0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 -- 172.21.15.81:0/4104320267 shutdown_connections 2024-05-09T00:05:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/4104320267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba06270 0x56293b9f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/4104320267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba00480 0x56293ba1bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/4104320267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba05950 0x56293b9fa910 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 -- 172.21.15.81:0/4104320267 >> 172.21.15.81:0/4104320267 conn(0x56293b95e1b0 msgr2=0x56293b9fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 -- 172.21.15.81:0/4104320267 shutdown_connections 2024-05-09T00:05:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 -- 172.21.15.81:0/4104320267 wait complete. 2024-05-09T00:05:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 -- start start 2024-05-09T00:05:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 Processor -- start 2024-05-09T00:05:10.389 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba00480 0x56293ba10dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba05950 0x56293ba07d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba06270 0x56293ba08270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293ba087b0 con 0x56293ba05950 2024-05-09T00:05:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293ba08920 con 0x56293ba00480 2024-05-09T00:05:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.389+0000 7efcc25b3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56293ba08ae0 con 0x56293ba06270 2024-05-09T00:05:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcc25b3b80 10 client.0 _ll_register_callbacks cb 0x56293b8f5ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcaf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba05950 0x56293ba07d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcaf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba05950 0x56293ba07d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34746/0 (socket says 172.21.15.81:34746) 2024-05-09T00:05:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcaf7fe700 1 -- 172.21.15.81:0/1488844456 learned_addr learned my addr 172.21.15.81:0/1488844456 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcaffff700 1 --2- 172.21.15.81:0/1488844456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba00480 0x56293ba10dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcaf7fe700 1 -- 172.21.15.81:0/1488844456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba06270 msgr2=0x56293ba08270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcb4996700 1 --2- 172.21.15.81:0/1488844456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba06270 0x56293ba08270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcaf7fe700 1 --2- 172.21.15.81:0/1488844456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba06270 0x56293ba08270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcaf7fe700 1 -- 172.21.15.81:0/1488844456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba00480 msgr2=0x56293ba10dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcaf7fe700 1 --2- 172.21.15.81:0/1488844456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba00480 0x56293ba10dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcaf7fe700 1 -- 172.21.15.81:0/1488844456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56293b7d1350 con 0x56293ba05950 2024-05-09T00:05:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcaffff700 1 --2- 172.21.15.81:0/1488844456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba00480 0x56293ba10dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcaf7fe700 1 --2- 172.21.15.81:0/1488844456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba05950 0x56293ba07d30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7efca4097ef0 tx=0x7efca4096010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f183ce7c441ed1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efc8f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efc8f7fe700 1 -- 172.21.15.81:0/1488844456 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca40b6050 con 0x56293ba05950 2024-05-09T00:05:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcc25b3b80 1 -- 172.21.15.81:0/1488844456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efca40962b0 con 0x56293ba05950 2024-05-09T00:05:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efc8f7fe700 1 -- 172.21.15.81:0/1488844456 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7efca40b9050 con 0x56293ba05950 2024-05-09T00:05:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efc8f7fe700 1 -- 172.21.15.81:0/1488844456 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efca40a1b90 con 0x56293ba05950 2024-05-09T00:05:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcc25b3b80 10 client.16005 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efcc25b3b80 1 -- 172.21.15.81:0/1488844456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56293b7d5c70 con 0x56293ba05950 2024-05-09T00:05:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.390+0000 7efc8f7fe700 1 -- 172.21.15.81:0/1488844456 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efca40962b0 con 0x56293ba05950 2024-05-09T00:05:10.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.391+0000 7efc8f7fe700 1 -- 172.21.15.81:0/1488844456 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7efca4098c00 con 0x56293ba05950 2024-05-09T00:05:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.391+0000 7efcc25b3b80 10 client.16005 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.391+0000 7efcc25b3b80 10 client.16005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.391+0000 7efcc25b3b80 20 client.16005 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.391+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/1488844456 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56293ba74640 0x56293ba76a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.391+0000 7efcc25b3b80 4 client.16005 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:05:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.391+0000 7efcc25b3b80 1 -- 172.21.15.81:0/1488844456 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56293b948e60 con 0x56293ba74640 2024-05-09T00:05:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.391+0000 7efcaffff700 1 --2- 172.21.15.81:0/1488844456 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56293ba74640 0x56293ba76a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.391+0000 7efc8f7fe700 10 client.16005 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:10.392 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.391+0000 7efcaffff700 1 --2- 172.21.15.81:0/1488844456 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56293ba74640 0x56293ba76a30 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=685842b9d3a9e965 server_cookie=e5b35bc8add3df35 in_seq=0 out_seq=0 2024-05-09T00:05:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.404+0000 7efc8f7fe700 1 -- 172.21.15.81:0/1488844456 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56293b948e60 con 0x56293ba74640 2024-05-09T00:05:10.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.404+0000 7efc8f7fe700 10 client.16005 handle_command_reply: tid=0 2024-05-09T00:05:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.404+0000 7efcc25b3b80 1 client.16005 shutdown 2024-05-09T00:05:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.404+0000 7efcc25b3b80 1 -- 172.21.15.81:0/1488844456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba05950 msgr2=0x56293ba07d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.404+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/1488844456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba05950 0x56293ba07d30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7efca4097ef0 tx=0x7efca4096010 comp rx=0 tx=0).stop 2024-05-09T00:05:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.404+0000 7efcc25b3b80 1 -- 172.21.15.81:0/1488844456 shutdown_connections 2024-05-09T00:05:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.404+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/1488844456 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56293ba74640 0x56293ba76a30 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.404+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/1488844456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56293ba00480 0x56293ba10dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.404+0000 7efc8f7fe700 0 client.16005 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.404+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/1488844456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56293ba06270 0x56293ba08270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.404+0000 7efcc25b3b80 1 --2- 172.21.15.81:0/1488844456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56293ba05950 0x56293ba07d30 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.404+0000 7efcc25b3b80 1 -- 172.21.15.81:0/1488844456 >> 172.21.15.81:0/1488844456 conn(0x56293b95e1b0 msgr2=0x56293b9fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.404+0000 7efcc25b3b80 1 -- 172.21.15.81:0/1488844456 shutdown_connections 2024-05-09T00:05:10.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.404+0000 7efcc25b3b80 1 -- 172.21.15.81:0/1488844456 wait complete. 2024-05-09T00:05:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.405+0000 7efcc25b3b80 20 client.16005 trim_cache size 0 max 16384 2024-05-09T00:05:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:05:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:05:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:05:10.401 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:05:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.405+0000 7efcb63f9700 1 -- 172.21.15.81:0/1066335186 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efc980a1290 msgr2=0x7efc980a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.405+0000 7efcb63f9700 1 --2- 172.21.15.81:0/1066335186 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efc980a1290 0x7efc980a3750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efca00045b0 tx=0x7efca000b3c0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.405+0000 7efcb63f9700 1 -- 172.21.15.81:0/1066335186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb0100760 msgr2=0x7efcb0198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.405+0000 7efcb63f9700 1 --2- 172.21.15.81:0/1066335186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb0100760 0x7efcb0198710 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7efca400d950 tx=0x7efca400dc60 comp rx=0 tx=0).stop 2024-05-09T00:05:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.405+0000 7efcb63f9700 1 -- 172.21.15.81:0/1066335186 shutdown_connections 2024-05-09T00:05:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.405+0000 7efcb63f9700 1 --2- 172.21.15.81:0/1066335186 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efc980a1290 0x7efc980a3750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.405+0000 7efcb63f9700 1 --2- 172.21.15.81:0/1066335186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb00ffda0 0x7efcb01981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.405+0000 7efcb63f9700 1 --2- 172.21.15.81:0/1066335186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcb0105e60 0x7efcb01a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.405+0000 7efcb63f9700 1 --2- 172.21.15.81:0/1066335186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb0100760 0x7efcb0198710 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.405+0000 7efcb63f9700 1 -- 172.21.15.81:0/1066335186 >> 172.21.15.81:0/1066335186 conn(0x7efcb0076f10 msgr2=0x7efcb00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.405+0000 7efcb63f9700 1 -- 172.21.15.81:0/1066335186 shutdown_connections 2024-05-09T00:05:10.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:10.405+0000 7efcb63f9700 1 -- 172.21.15.81:0/1066335186 wait complete. 2024-05-09T00:05:11.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:10 smithi150 ceph-mon[46187]: pgmap v70: 97 pgs: 97 active+clean; 1.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 50 KiB/s wr, 31 op/s 2024-05-09T00:05:11.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:10 smithi171 ceph-mon[47351]: pgmap v70: 97 pgs: 97 active+clean; 1.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 50 KiB/s wr, 31 op/s 2024-05-09T00:05:11.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:10 smithi081 ceph-mon[42474]: pgmap v70: 97 pgs: 97 active+clean; 1.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 50 KiB/s wr, 31 op/s 2024-05-09T00:05:13.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:12 smithi150 ceph-mon[46187]: pgmap v71: 97 pgs: 97 active+clean; 1.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-05-09T00:05:13.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:12 smithi171 ceph-mon[47351]: pgmap v71: 97 pgs: 97 active+clean; 1.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-05-09T00:05:13.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:12 smithi081 ceph-mon[42474]: pgmap v71: 97 pgs: 97 active+clean; 1.9 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 40 KiB/s wr, 24 op/s 2024-05-09T00:05:15.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:14 smithi150 ceph-mon[46187]: pgmap v72: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 52 KiB/s wr, 31 op/s 2024-05-09T00:05:15.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:14 smithi171 ceph-mon[47351]: pgmap v72: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 52 KiB/s wr, 31 op/s 2024-05-09T00:05:15.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:14 smithi081 ceph-mon[42474]: pgmap v72: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 52 KiB/s wr, 31 op/s 2024-05-09T00:05:16.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:05:16.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.620+0000 7f0ba9ef1700 1 -- 172.21.15.81:0/2943754892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba4069740 msgr2=0x7f0ba4069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.620+0000 7f0ba9ef1700 1 --2- 172.21.15.81:0/2943754892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba4069740 0x7f0ba4069b20 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f0b940099c0 tx=0x7f0b94009cd0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.620+0000 7f0ba9ef1700 1 -- 172.21.15.81:0/2943754892 shutdown_connections 2024-05-09T00:05:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.620+0000 7f0ba9ef1700 1 --2- 172.21.15.81:0/2943754892 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ba41062a0 0x7f0ba410de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.620+0000 7f0ba9ef1700 1 --2- 172.21.15.81:0/2943754892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba4069740 0x7f0ba4069b20 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.620+0000 7f0ba9ef1700 1 --2- 172.21.15.81:0/2943754892 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ba406a0f0 0x7f0ba4105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.620+0000 7f0ba9ef1700 1 -- 172.21.15.81:0/2943754892 >> 172.21.15.81:0/2943754892 conn(0x7f0ba4076f70 msgr2=0x7f0ba4077380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.621+0000 7f0ba9ef1700 1 -- 172.21.15.81:0/2943754892 shutdown_connections 2024-05-09T00:05:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.621+0000 7f0ba9ef1700 1 -- 172.21.15.81:0/2943754892 wait complete. 2024-05-09T00:05:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.621+0000 7f0ba9ef1700 1 Processor -- start 2024-05-09T00:05:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.621+0000 7f0ba9ef1700 1 -- start start 2024-05-09T00:05:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba9ef1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba4069740 0x7f0ba4197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba9ef1700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ba41062a0 0x7f0ba41978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba9ef1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ba419bc50 0x7f0ba419c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba9ef1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba419c6d0 con 0x7f0ba4069740 2024-05-09T00:05:16.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba9ef1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba419c840 con 0x7f0ba419bc50 2024-05-09T00:05:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba9ef1700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba419ca00 con 0x7f0ba41062a0 2024-05-09T00:05:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba4069740 0x7f0ba4197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba4069740 0x7f0ba4197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34772/0 (socket says 172.21.15.81:34772) 2024-05-09T00:05:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba37fe700 1 -- 172.21.15.81:0/1221830060 learned_addr learned my addr 172.21.15.81:0/1221830060 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba3fff700 1 --2- 172.21.15.81:0/1221830060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ba419bc50 0x7f0ba419c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba2ffd700 1 --2- 172.21.15.81:0/1221830060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ba41062a0 0x7f0ba41978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba37fe700 1 -- 172.21.15.81:0/1221830060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ba41062a0 msgr2=0x7f0ba41978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba37fe700 1 --2- 172.21.15.81:0/1221830060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ba41062a0 0x7f0ba41978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba37fe700 1 -- 172.21.15.81:0/1221830060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ba419bc50 msgr2=0x7f0ba419c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba37fe700 1 --2- 172.21.15.81:0/1221830060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ba419bc50 0x7f0ba419c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba37fe700 1 -- 172.21.15.81:0/1221830060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b940095f0 con 0x7f0ba4069740 2024-05-09T00:05:16.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba37fe700 1 --2- 172.21.15.81:0/1221830060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba4069740 0x7f0ba4197370 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400b580 tx=0x7f0b94005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba0ff9700 1 -- 172.21.15.81:0/1221830060 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9401d070 con 0x7f0ba4069740 2024-05-09T00:05:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba9ef1700 1 -- 172.21.15.81:0/1221830060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba41a3f00 con 0x7f0ba4069740 2024-05-09T00:05:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba0ff9700 1 -- 172.21.15.81:0/1221830060 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b9400fc30 con 0x7f0ba4069740 2024-05-09T00:05:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba0ff9700 1 -- 172.21.15.81:0/1221830060 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94022df0 con 0x7f0ba4069740 2024-05-09T00:05:16.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.622+0000 7f0ba9ef1700 1 -- 172.21.15.81:0/1221830060 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba41a4320 con 0x7f0ba4069740 2024-05-09T00:05:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.624+0000 7f0ba0ff9700 1 -- 172.21.15.81:0/1221830060 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f0b94022500 con 0x7f0ba4069740 2024-05-09T00:05:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.625+0000 7f0ba0ff9700 1 --2- 172.21.15.81:0/1221830060 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0b8c0a1290 0x7f0b8c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.625+0000 7f0ba2ffd700 1 --2- 172.21.15.81:0/1221830060 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0b8c0a1290 0x7f0b8c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.625+0000 7f0ba0ff9700 1 -- 172.21.15.81:0/1221830060 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f0b940cde20 con 0x7f0ba4069740 2024-05-09T00:05:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.625+0000 7f0ba2ffd700 1 --2- 172.21.15.81:0/1221830060 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0b8c0a1290 0x7f0b8c0a3750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0b98005950 tx=0x7f0b980058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0bb60abb80 1 Processor -- start 2024-05-09T00:05:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0bb60abb80 1 -- start start 2024-05-09T00:05:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0bb60abb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e0e00 0x555eb79e11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0bb60abb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79e1720 0x555eb79db350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0bb60abb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79db890 0x555eb79dbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0bb60abb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb7932150 con 0x555eb79db890 2024-05-09T00:05:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0bb60abb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb792fb10 con 0x555eb79e1720 2024-05-09T00:05:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0bb60abb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb792b400 con 0x555eb79e0e00 2024-05-09T00:05:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0ba3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79db890 0x555eb79dbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0ba3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79db890 0x555eb79dbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34786/0 (socket says 172.21.15.81:34786) 2024-05-09T00:05:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0ba3fff700 1 -- 172.21.15.81:0/1411893059 learned_addr learned my addr 172.21.15.81:0/1411893059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0ba2ffd700 1 --2- 172.21.15.81:0/1411893059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79e1720 0x555eb79db350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0ba37fe700 1 --2- 172.21.15.81:0/1411893059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e0e00 0x555eb79e11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0ba3fff700 1 -- 172.21.15.81:0/1411893059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e0e00 msgr2=0x555eb79e11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:16.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0ba3fff700 1 --2- 172.21.15.81:0/1411893059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e0e00 0x555eb79e11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.626+0000 7f0ba3fff700 1 -- 172.21.15.81:0/1411893059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79e1720 msgr2=0x555eb79db350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.627+0000 7f0ba3fff700 1 --2- 172.21.15.81:0/1411893059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79e1720 0x555eb79db350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.627+0000 7f0ba3fff700 1 -- 172.21.15.81:0/1411893059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555eb77ac3b0 con 0x555eb79db890 2024-05-09T00:05:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.627+0000 7f0ba37fe700 1 --2- 172.21.15.81:0/1411893059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e0e00 0x555eb79e11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.627+0000 7f0ba3fff700 1 --2- 172.21.15.81:0/1411893059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79db890 0x555eb79dbcd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009d20 tx=0x7f0b9c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556481df9d84474b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.627+0000 7f0b89ffb700 1 -- 172.21.15.81:0/1411893059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c018070 con 0x555eb79db890 2024-05-09T00:05:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.627+0000 7f0b89ffb700 1 -- 172.21.15.81:0/1411893059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b9c00f050 con 0x555eb79db890 2024-05-09T00:05:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.627+0000 7f0b89ffb700 1 -- 172.21.15.81:0/1411893059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c005a00 con 0x555eb79db890 2024-05-09T00:05:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.627+0000 7f0bb60abb80 1 -- 172.21.15.81:0/1411893059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79db890 msgr2=0x555eb79dbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.627+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/1411893059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79db890 0x555eb79dbcd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009d20 tx=0x7f0b9c0077e0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.627+0000 7f0bb60abb80 1 -- 172.21.15.81:0/1411893059 shutdown_connections 2024-05-09T00:05:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.627+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/1411893059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79db890 0x555eb79dbcd0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.627+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/1411893059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e0e00 0x555eb79e11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.627+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/1411893059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79e1720 0x555eb79db350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.627+0000 7f0bb60abb80 1 -- 172.21.15.81:0/1411893059 >> 172.21.15.81:0/1411893059 conn(0x555eb7939210 msgr2=0x555eb79d5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.628+0000 7f0bb60abb80 1 -- 172.21.15.81:0/1411893059 shutdown_connections 2024-05-09T00:05:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.628+0000 7f0bb60abb80 1 -- 172.21.15.81:0/1411893059 wait complete. 2024-05-09T00:05:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.628+0000 7f0bb60abb80 1 -- start start 2024-05-09T00:05:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.628+0000 7f0bb60abb80 1 Processor -- start 2024-05-09T00:05:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.628+0000 7f0bb60abb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79db890 0x555eb79e4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.628+0000 7f0bb60abb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e0e00 0x555eb79e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.628+0000 7f0bb60abb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79e1720 0x555eb79e5510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.628+0000 7f0bb60abb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb78c7560 con 0x555eb79db890 2024-05-09T00:05:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.628+0000 7f0bb60abb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb78c7200 con 0x555eb79e1720 2024-05-09T00:05:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.628+0000 7f0bb60abb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb77ae6a0 con 0x555eb79e0e00 2024-05-09T00:05:16.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.628+0000 7f0bb60abb80 10 client.0 _ll_register_callbacks cb 0x555eb78d0b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.628+0000 7f0ba37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79db890 0x555eb79e4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.628+0000 7f0ba37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79db890 0x555eb79e4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34800/0 (socket says 172.21.15.81:34800) 2024-05-09T00:05:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0ba37fe700 1 -- 172.21.15.81:0/2375343528 learned_addr learned my addr 172.21.15.81:0/2375343528 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0ba3fff700 1 --2- 172.21.15.81:0/2375343528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79e1720 0x555eb79e5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0ba2ffd700 1 --2- 172.21.15.81:0/2375343528 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e0e00 0x555eb79e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0ba37fe700 1 -- 172.21.15.81:0/2375343528 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e0e00 msgr2=0x555eb79e4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0ba37fe700 1 --2- 172.21.15.81:0/2375343528 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e0e00 0x555eb79e4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0ba37fe700 1 -- 172.21.15.81:0/2375343528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79e1720 msgr2=0x555eb79e5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0ba37fe700 1 --2- 172.21.15.81:0/2375343528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79e1720 0x555eb79e5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0ba37fe700 1 -- 172.21.15.81:0/2375343528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9c009980 con 0x555eb79db890 2024-05-09T00:05:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0ba3fff700 1 --2- 172.21.15.81:0/2375343528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79e1720 0x555eb79e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0ba37fe700 1 --2- 172.21.15.81:0/2375343528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79db890 0x555eb79e4a90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0b94000c00 tx=0x7f0b9409b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a3cb01403ad611 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0b82ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:16.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0b82ffd700 1 -- 172.21.15.81:0/2375343528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9409edf0 con 0x555eb79db890 2024-05-09T00:05:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0b82ffd700 1 -- 172.21.15.81:0/2375343528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f0b940a33b0 con 0x555eb79db890 2024-05-09T00:05:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0bb60abb80 1 -- 172.21.15.81:0/2375343528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555eb7884270 con 0x555eb79db890 2024-05-09T00:05:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0b82ffd700 1 -- 172.21.15.81:0/2375343528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b94099360 con 0x555eb79db890 2024-05-09T00:05:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0bb60abb80 10 client.16017 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0bb60abb80 1 -- 172.21.15.81:0/2375343528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555eb7758b60 con 0x555eb79db890 2024-05-09T00:05:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0b82ffd700 1 -- 172.21.15.81:0/2375343528 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555eb7884270 con 0x555eb79db890 2024-05-09T00:05:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.629+0000 7f0b82ffd700 1 -- 172.21.15.81:0/2375343528 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0b9409a4b0 con 0x555eb79db890 2024-05-09T00:05:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.630+0000 7f0bb60abb80 10 client.16017 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.630+0000 7f0bb60abb80 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.630+0000 7f0bb60abb80 20 client.16017 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.630+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/2375343528 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555eb79f4d60 0x555eb79f7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.630+0000 7f0bb60abb80 4 client.16017 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.630+0000 7f0bb60abb80 1 -- 172.21.15.81:0/2375343528 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555eb79aa810 con 0x555eb79f4d60 2024-05-09T00:05:16.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.630+0000 7f0ba2ffd700 1 --2- 172.21.15.81:0/2375343528 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555eb79f4d60 0x555eb79f7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.630+0000 7f0b82ffd700 10 client.16017 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.630+0000 7f0ba2ffd700 1 --2- 172.21.15.81:0/2375343528 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555eb79f4d60 0x555eb79f7150 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b53ba6b7e99a5ba server_cookie=84895b1119505968 in_seq=0 out_seq=0 2024-05-09T00:05:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0b82ffd700 1 -- 172.21.15.81:0/2375343528 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555eb79aa810 con 0x555eb79f4d60 2024-05-09T00:05:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0b82ffd700 10 client.16017 handle_command_reply: tid=0 2024-05-09T00:05:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0bb60abb80 1 client.16017 shutdown 2024-05-09T00:05:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0bb60abb80 1 -- 172.21.15.81:0/2375343528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79db890 msgr2=0x555eb79e4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/2375343528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79db890 0x555eb79e4a90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0b94000c00 tx=0x7f0b9409b6c0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0bb60abb80 1 -- 172.21.15.81:0/2375343528 shutdown_connections 2024-05-09T00:05:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/2375343528 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555eb79f4d60 0x555eb79f7150 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/2375343528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79e1720 0x555eb79e5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0b82ffd700 0 client.16017 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/2375343528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79db890 0x555eb79e4a90 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/2375343528 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e0e00 0x555eb79e4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0bb60abb80 1 -- 172.21.15.81:0/2375343528 >> 172.21.15.81:0/2375343528 conn(0x555eb7939210 msgr2=0x555eb79d55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:16.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0bb60abb80 1 -- 172.21.15.81:0/2375343528 shutdown_connections 2024-05-09T00:05:16.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0bb60abb80 1 -- 172.21.15.81:0/2375343528 wait complete. 2024-05-09T00:05:16.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.631+0000 7f0bb60abb80 20 client.16017 trim_cache size 0 max 16384 2024-05-09T00:05:16.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.648+0000 7f0bb60abb80 1 Processor -- start 2024-05-09T00:05:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.648+0000 7f0bb60abb80 1 -- start start 2024-05-09T00:05:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.648+0000 7f0bb60abb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79db890 0x555eb79db350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.648+0000 7f0bb60abb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79e0e00 0x555eb79f0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.648+0000 7f0bb60abb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e1720 0x555eb79d5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.648+0000 7f0bb60abb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb79d2dc0 con 0x555eb79e0e00 2024-05-09T00:05:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.648+0000 7f0bb60abb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb79e1560 con 0x555eb79db890 2024-05-09T00:05:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.648+0000 7f0bb60abb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb79fc360 con 0x555eb79e1720 2024-05-09T00:05:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.649+0000 7f0ba2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79e0e00 0x555eb79f0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.649+0000 7f0ba2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79e0e00 0x555eb79f0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34802/0 (socket says 172.21.15.81:34802) 2024-05-09T00:05:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.649+0000 7f0ba2ffd700 1 -- 172.21.15.81:0/520278828 learned_addr learned my addr 172.21.15.81:0/520278828 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.649+0000 7f0ba37fe700 1 --2- 172.21.15.81:0/520278828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79db890 0x555eb79db350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.649+0000 7f0ba2ffd700 1 -- 172.21.15.81:0/520278828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e1720 msgr2=0x555eb79d5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.649+0000 7f0ba2ffd700 1 --2- 172.21.15.81:0/520278828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e1720 0x555eb79d5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.649+0000 7f0ba2ffd700 1 -- 172.21.15.81:0/520278828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79db890 msgr2=0x555eb79db350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.649+0000 7f0ba2ffd700 1 --2- 172.21.15.81:0/520278828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79db890 0x555eb79db350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.649+0000 7f0ba2ffd700 1 -- 172.21.15.81:0/520278828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555eb78f1560 con 0x555eb79e0e00 2024-05-09T00:05:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.649+0000 7f0ba2ffd700 1 --2- 172.21.15.81:0/520278828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79e0e00 0x555eb79f0c20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800ba40 tx=0x7f0b98015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf5b1ce390594be server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.649+0000 7f0b8a7fc700 1 -- 172.21.15.81:0/520278828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98025040 con 0x555eb79e0e00 2024-05-09T00:05:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.649+0000 7f0b8a7fc700 1 -- 172.21.15.81:0/520278828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b98027e50 con 0x555eb79e0e00 2024-05-09T00:05:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.649+0000 7f0b8a7fc700 1 -- 172.21.15.81:0/520278828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98011440 con 0x555eb79e0e00 2024-05-09T00:05:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.650+0000 7f0bb60abb80 1 -- 172.21.15.81:0/520278828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79e0e00 msgr2=0x555eb79f0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.650+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/520278828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79e0e00 0x555eb79f0c20 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0b9800ba40 tx=0x7f0b98015000 comp rx=0 tx=0).stop 2024-05-09T00:05:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.650+0000 7f0bb60abb80 1 -- 172.21.15.81:0/520278828 shutdown_connections 2024-05-09T00:05:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.650+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/520278828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79db890 0x555eb79db350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.650+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/520278828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e1720 0x555eb79d5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.650+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/520278828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79e0e00 0x555eb79f0c20 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.650+0000 7f0bb60abb80 1 -- 172.21.15.81:0/520278828 >> 172.21.15.81:0/520278828 conn(0x555eb7939210 msgr2=0x555eb79e3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.650+0000 7f0bb60abb80 1 -- 172.21.15.81:0/520278828 shutdown_connections 2024-05-09T00:05:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.650+0000 7f0bb60abb80 1 -- 172.21.15.81:0/520278828 wait complete. 2024-05-09T00:05:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.650+0000 7f0bb60abb80 1 -- start start 2024-05-09T00:05:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.650+0000 7f0bb60abb80 1 Processor -- start 2024-05-09T00:05:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0bb60abb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79db890 0x555eb79ec170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0bb60abb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79e0e00 0x555eb79ec6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0bb60abb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e1720 0x555eb79ea950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0bb60abb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb79eb060 con 0x555eb79e0e00 2024-05-09T00:05:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0bb60abb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb79eb1d0 con 0x555eb79db890 2024-05-09T00:05:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0bb60abb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eb79eb390 con 0x555eb79e1720 2024-05-09T00:05:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0bb60abb80 10 client.0 _ll_register_callbacks cb 0x555eb78d0b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0ba2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79e0e00 0x555eb79ec6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0ba2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79e0e00 0x555eb79ec6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34808/0 (socket says 172.21.15.81:34808) 2024-05-09T00:05:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0ba2ffd700 1 -- 172.21.15.81:0/4189705450 learned_addr learned my addr 172.21.15.81:0/4189705450 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0ba3fff700 1 --2- 172.21.15.81:0/4189705450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e1720 0x555eb79ea950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0ba37fe700 1 --2- 172.21.15.81:0/4189705450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79db890 0x555eb79ec170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0ba2ffd700 1 -- 172.21.15.81:0/4189705450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e1720 msgr2=0x555eb79ea950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0ba2ffd700 1 --2- 172.21.15.81:0/4189705450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e1720 0x555eb79ea950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0ba2ffd700 1 -- 172.21.15.81:0/4189705450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79db890 msgr2=0x555eb79ec170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0ba2ffd700 1 --2- 172.21.15.81:0/4189705450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79db890 0x555eb79ec170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0ba2ffd700 1 -- 172.21.15.81:0/4189705450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9800fa10 con 0x555eb79e0e00 2024-05-09T00:05:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0ba37fe700 1 --2- 172.21.15.81:0/4189705450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79db890 0x555eb79ec170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0ba2ffd700 1 --2- 172.21.15.81:0/4189705450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79e0e00 0x555eb79ec6b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0b98020bc0 tx=0x7f0b98027360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b627d8ae8b68b5fa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0b82ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0b82ffd700 1 -- 172.21.15.81:0/4189705450 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98025070 con 0x555eb79e0e00 2024-05-09T00:05:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0bb60abb80 1 -- 172.21.15.81:0/4189705450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b9c00f050 con 0x555eb79e0e00 2024-05-09T00:05:16.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0b82ffd700 1 -- 172.21.15.81:0/4189705450 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f0b98005040 con 0x555eb79e0e00 2024-05-09T00:05:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.651+0000 7f0b82ffd700 1 -- 172.21.15.81:0/4189705450 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b980278d0 con 0x555eb79e0e00 2024-05-09T00:05:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.652+0000 7f0bb60abb80 10 client.16023 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.652+0000 7f0bb60abb80 1 -- 172.21.15.81:0/4189705450 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555eb77b0cd0 con 0x555eb79e0e00 2024-05-09T00:05:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.652+0000 7f0b82ffd700 1 -- 172.21.15.81:0/4189705450 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b9c00f050 con 0x555eb79e0e00 2024-05-09T00:05:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.652+0000 7f0b82ffd700 1 -- 172.21.15.81:0/4189705450 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0b98011440 con 0x555eb79e0e00 2024-05-09T00:05:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.652+0000 7f0bb60abb80 10 client.16023 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.652+0000 7f0bb60abb80 10 client.16023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.652+0000 7f0bb60abb80 20 client.16023 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.652+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/4189705450 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555eb7a4c580 0x555eb7a4e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.652+0000 7f0bb60abb80 4 client.16023 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:05:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.652+0000 7f0bb60abb80 1 -- 172.21.15.81:0/4189705450 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555eb7923ec0 con 0x555eb7a4c580 2024-05-09T00:05:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.652+0000 7f0ba37fe700 1 --2- 172.21.15.81:0/4189705450 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555eb7a4c580 0x555eb7a4e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.652+0000 7f0b82ffd700 10 client.16023 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:16.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.652+0000 7f0ba37fe700 1 --2- 172.21.15.81:0/4189705450 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555eb7a4c580 0x555eb7a4e9a0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc07e16a62a37659 server_cookie=916cae05a6797ecd in_seq=0 out_seq=0 2024-05-09T00:05:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0b82ffd700 1 -- 172.21.15.81:0/4189705450 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x555eb7923ec0 con 0x555eb7a4c580 2024-05-09T00:05:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0b82ffd700 10 client.16023 handle_command_reply: tid=0 2024-05-09T00:05:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0bb60abb80 1 client.16023 shutdown 2024-05-09T00:05:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0bb60abb80 1 -- 172.21.15.81:0/4189705450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79e0e00 msgr2=0x555eb79ec6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/4189705450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79e0e00 0x555eb79ec6b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0b98020bc0 tx=0x7f0b98027360 comp rx=0 tx=0).stop 2024-05-09T00:05:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0bb60abb80 1 -- 172.21.15.81:0/4189705450 shutdown_connections 2024-05-09T00:05:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/4189705450 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555eb7a4c580 0x555eb7a4e9a0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/4189705450 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555eb79db890 0x555eb79ec170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/4189705450 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555eb79e1720 0x555eb79ea950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0b82ffd700 0 client.16023 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0bb60abb80 1 --2- 172.21.15.81:0/4189705450 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555eb79e0e00 0x555eb79ec6b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0bb60abb80 1 -- 172.21.15.81:0/4189705450 >> 172.21.15.81:0/4189705450 conn(0x555eb7939210 msgr2=0x555eb79dfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0bb60abb80 1 -- 172.21.15.81:0/4189705450 shutdown_connections 2024-05-09T00:05:16.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0bb60abb80 1 -- 172.21.15.81:0/4189705450 wait complete. 2024-05-09T00:05:16.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0bb60abb80 20 client.16023 trim_cache size 0 max 16384 2024-05-09T00:05:16.655 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:05:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:05:16.655 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:05:16.655 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:05:16.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0ba9ef1700 1 -- 172.21.15.81:0/1221830060 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0b8c0a1290 msgr2=0x7f0b8c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:16.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0ba9ef1700 1 --2- 172.21.15.81:0/1221830060 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0b8c0a1290 0x7f0b8c0a3750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0b98005950 tx=0x7f0b980058e0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0ba9ef1700 1 -- 172.21.15.81:0/1221830060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba4069740 msgr2=0x7f0ba4197370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:16.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.653+0000 7f0ba9ef1700 1 --2- 172.21.15.81:0/1221830060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba4069740 0x7f0ba4197370 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400b580 tx=0x7f0b94005e80 comp rx=0 tx=0).stop 2024-05-09T00:05:16.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.654+0000 7f0ba9ef1700 1 -- 172.21.15.81:0/1221830060 shutdown_connections 2024-05-09T00:05:16.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.654+0000 7f0ba9ef1700 1 --2- 172.21.15.81:0/1221830060 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0b8c0a1290 0x7f0b8c0a3750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.654+0000 7f0ba9ef1700 1 --2- 172.21.15.81:0/1221830060 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0ba419bc50 0x7f0ba419c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.654+0000 7f0ba9ef1700 1 --2- 172.21.15.81:0/1221830060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ba4069740 0x7f0ba4197370 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.654+0000 7f0ba9ef1700 1 --2- 172.21.15.81:0/1221830060 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0ba41062a0 0x7f0ba41978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.654+0000 7f0ba9ef1700 1 -- 172.21.15.81:0/1221830060 >> 172.21.15.81:0/1221830060 conn(0x7f0ba4076f70 msgr2=0x7f0ba40fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:16.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.654+0000 7f0ba9ef1700 1 -- 172.21.15.81:0/1221830060 shutdown_connections 2024-05-09T00:05:16.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.654+0000 7f0ba9ef1700 1 -- 172.21.15.81:0/1221830060 wait complete. 2024-05-09T00:05:16.660 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:05:16.661 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:05:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.787+0000 7fc7e22ea700 1 -- 172.21.15.81:0/2609836543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7dc10b3d0 msgr2=0x7fc7dc10d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.787+0000 7fc7e22ea700 1 --2- 172.21.15.81:0/2609836543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7dc10b3d0 0x7fc7dc10d870 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400b0a0 tx=0x7fc7d400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.788+0000 7fc7e22ea700 1 -- 172.21.15.81:0/2609836543 shutdown_connections 2024-05-09T00:05:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.788+0000 7fc7e22ea700 1 --2- 172.21.15.81:0/2609836543 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7dc102000 0x7fc7dc1023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.788+0000 7fc7e22ea700 1 --2- 172.21.15.81:0/2609836543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7dc10b3d0 0x7fc7dc10d870 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.788+0000 7fc7e22ea700 1 --2- 172.21.15.81:0/2609836543 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7dc102920 0x7fc7dc10ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.788+0000 7fc7e22ea700 1 -- 172.21.15.81:0/2609836543 >> 172.21.15.81:0/2609836543 conn(0x7fc7dc0fb7e0 msgr2=0x7fc7dc0fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.788+0000 7fc7e22ea700 1 -- 172.21.15.81:0/2609836543 shutdown_connections 2024-05-09T00:05:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.788+0000 7fc7e22ea700 1 -- 172.21.15.81:0/2609836543 wait complete. 2024-05-09T00:05:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.788+0000 7fc7e22ea700 1 Processor -- start 2024-05-09T00:05:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.788+0000 7fc7e22ea700 1 -- start start 2024-05-09T00:05:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7e22ea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7dc102000 0x7fc7dc0ffc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7e22ea700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7dc102920 0x7fc7dc100190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7e22ea700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7dc10b3d0 0x7fc7dc1006d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7e22ea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc1a5790 con 0x7fc7dc102000 2024-05-09T00:05:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7e22ea700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc1a5900 con 0x7fc7dc10b3d0 2024-05-09T00:05:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7e22ea700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc1a5ac0 con 0x7fc7dc102920 2024-05-09T00:05:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7dc102000 0x7fc7dc0ffc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7dc102000 0x7fc7dc0ffc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34818/0 (socket says 172.21.15.81:34818) 2024-05-09T00:05:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7dbfff700 1 -- 172.21.15.81:0/4091051092 learned_addr learned my addr 172.21.15.81:0/4091051092 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7db7fe700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7dc102920 0x7fc7dc100190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7dbfff700 1 -- 172.21.15.81:0/4091051092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7dc102920 msgr2=0x7fc7dc100190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:16.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7e0887700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7dc10b3d0 0x7fc7dc1006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7dbfff700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7dc102920 0x7fc7dc100190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7dbfff700 1 -- 172.21.15.81:0/4091051092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7dc10b3d0 msgr2=0x7fc7dc1006d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7dbfff700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7dc10b3d0 0x7fc7dc1006d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7dbfff700 1 -- 172.21.15.81:0/4091051092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d4009d00 con 0x7fc7dc102000 2024-05-09T00:05:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7db7fe700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7dc102920 0x7fc7dc100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7dbfff700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7dc102000 0x7fc7dc0ffc50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000d950 tx=0x7fc7d000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7d97fa700 1 -- 172.21.15.81:0/4091051092 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0009b40 con 0x7fc7dc102000 2024-05-09T00:05:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7e22ea700 1 -- 172.21.15.81:0/4091051092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7dc1a5da0 con 0x7fc7dc102000 2024-05-09T00:05:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7d97fa700 1 -- 172.21.15.81:0/4091051092 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d0009ca0 con 0x7fc7dc102000 2024-05-09T00:05:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7d97fa700 1 -- 172.21.15.81:0/4091051092 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000f620 con 0x7fc7dc102000 2024-05-09T00:05:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.789+0000 7fc7e22ea700 1 -- 172.21.15.81:0/4091051092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7dc1a6250 con 0x7fc7dc102000 2024-05-09T00:05:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.790+0000 7fc7e22ea700 1 -- 172.21.15.81:0/4091051092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7dc106550 con 0x7fc7dc102000 2024-05-09T00:05:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.791+0000 7fc7d97fa700 1 -- 172.21.15.81:0/4091051092 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc7d0010460 con 0x7fc7dc102000 2024-05-09T00:05:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.792+0000 7fc7d97fa700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc7c40a1290 0x7fc7c40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.792+0000 7fc7db7fe700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc7c40a1290 0x7fc7c40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.792+0000 7fc7d97fa700 1 -- 172.21.15.81:0/4091051092 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fc7d00cd070 con 0x7fc7dc102000 2024-05-09T00:05:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.792+0000 7fc7db7fe700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc7c40a1290 0x7fc7c40a3750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc005fd0 tx=0x7fc7cc005d40 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:16.796+0000 7fc7d97fa700 1 -- 172.21.15.81:0/4091051092 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc7d00964c0 con 0x7fc7dc102000 2024-05-09T00:05:17.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.043+0000 7fc7e22ea700 1 -- 172.21.15.81:0/4091051092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7dc101180 con 0x7fc7dc102000 2024-05-09T00:05:17.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.043+0000 7fc7d97fa700 1 -- 172.21.15.81:0/4091051092 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7fc7d0099ae0 con 0x7fc7dc102000 2024-05-09T00:05:17.038 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:05:17.038 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:05:17.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.045+0000 7fc7e22ea700 1 -- 172.21.15.81:0/4091051092 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc7c40a1290 msgr2=0x7fc7c40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.045+0000 7fc7e22ea700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc7c40a1290 0x7fc7c40a3750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc005fd0 tx=0x7fc7cc005d40 comp rx=0 tx=0).stop 2024-05-09T00:05:17.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.045+0000 7fc7e22ea700 1 -- 172.21.15.81:0/4091051092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7dc102000 msgr2=0x7fc7dc0ffc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.045+0000 7fc7e22ea700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7dc102000 0x7fc7dc0ffc50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000d950 tx=0x7fc7d000dd10 comp rx=0 tx=0).stop 2024-05-09T00:05:17.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.045+0000 7fc7e22ea700 1 -- 172.21.15.81:0/4091051092 shutdown_connections 2024-05-09T00:05:17.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.045+0000 7fc7e22ea700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc7c40a1290 0x7fc7c40a3750 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.045+0000 7fc7e22ea700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7dc10b3d0 0x7fc7dc1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.045+0000 7fc7e22ea700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7dc102000 0x7fc7dc0ffc50 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.045+0000 7fc7e22ea700 1 --2- 172.21.15.81:0/4091051092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7dc102920 0x7fc7dc100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.045+0000 7fc7e22ea700 1 -- 172.21.15.81:0/4091051092 >> 172.21.15.81:0/4091051092 conn(0x7fc7dc0fb7e0 msgr2=0x7fc7dc0fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.045+0000 7fc7e22ea700 1 -- 172.21.15.81:0/4091051092 shutdown_connections 2024-05-09T00:05:17.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.045+0000 7fc7e22ea700 1 -- 172.21.15.81:0/4091051092 wait complete. 2024-05-09T00:05:17.041 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:05:17.053 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:05:17.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.183+0000 7fadd9ba0700 1 -- 172.21.15.81:0/2556548909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd410b390 msgr2=0x7fadd410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.183+0000 7fadd9ba0700 1 --2- 172.21.15.81:0/2556548909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd410b390 0x7fadd410d850 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fadcc00b0a0 tx=0x7fadcc00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.183+0000 7fadd9ba0700 1 -- 172.21.15.81:0/2556548909 shutdown_connections 2024-05-09T00:05:17.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.183+0000 7fadd9ba0700 1 --2- 172.21.15.81:0/2556548909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd4101f70 0x7fadd4102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.183+0000 7fadd9ba0700 1 --2- 172.21.15.81:0/2556548909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd410b390 0x7fadd410d850 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.183+0000 7fadd9ba0700 1 --2- 172.21.15.81:0/2556548909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadd4102890 0x7fadd410ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.183+0000 7fadd9ba0700 1 -- 172.21.15.81:0/2556548909 >> 172.21.15.81:0/2556548909 conn(0x7fadd40fb770 msgr2=0x7fadd40fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.183+0000 7fadd9ba0700 1 -- 172.21.15.81:0/2556548909 shutdown_connections 2024-05-09T00:05:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.183+0000 7fadd9ba0700 1 -- 172.21.15.81:0/2556548909 wait complete. 2024-05-09T00:05:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.183+0000 7fadd9ba0700 1 Processor -- start 2024-05-09T00:05:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.183+0000 7fadd9ba0700 1 -- start start 2024-05-09T00:05:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd9ba0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd4101f70 0x7fadd4197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd9ba0700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadd4102890 0x7fadd4197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd9ba0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd410b390 0x7fadd419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd9ba0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd419c350 con 0x7fadd410b390 2024-05-09T00:05:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd9ba0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd419c4c0 con 0x7fadd4101f70 2024-05-09T00:05:17.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd9ba0700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd419c680 con 0x7fadd4102890 2024-05-09T00:05:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd939f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd410b390 0x7fadd419bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd939f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd410b390 0x7fadd419bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34846/0 (socket says 172.21.15.81:34846) 2024-05-09T00:05:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd939f700 1 -- 172.21.15.81:0/1055468314 learned_addr learned my addr 172.21.15.81:0/1055468314 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd4101f70 0x7fadd4197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd939f700 1 -- 172.21.15.81:0/1055468314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadd4102890 msgr2=0x7fadd4197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd3fff700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadd4102890 0x7fadd4197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd939f700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadd4102890 0x7fadd4197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd939f700 1 -- 172.21.15.81:0/1055468314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd4101f70 msgr2=0x7fadd4197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd939f700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd4101f70 0x7fadd4197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd939f700 1 -- 172.21.15.81:0/1055468314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc009d00 con 0x7fadd410b390 2024-05-09T00:05:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd4101f70 0x7fadd4197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd939f700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd410b390 0x7fadd419bd10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0077f0 tx=0x7fadcc0078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd1ffb700 1 -- 172.21.15.81:0/1055468314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc00e040 con 0x7fadd410b390 2024-05-09T00:05:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd1ffb700 1 -- 172.21.15.81:0/1055468314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadcc004c60 con 0x7fadd410b390 2024-05-09T00:05:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd9ba0700 1 -- 172.21.15.81:0/1055468314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd419c900 con 0x7fadd410b390 2024-05-09T00:05:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.184+0000 7fadd1ffb700 1 -- 172.21.15.81:0/1055468314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc0053b0 con 0x7fadd410b390 2024-05-09T00:05:17.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.185+0000 7fadd9ba0700 1 -- 172.21.15.81:0/1055468314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd41a41a0 con 0x7fadd410b390 2024-05-09T00:05:17.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.187+0000 7fadd1ffb700 1 -- 172.21.15.81:0/1055468314 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fadcc01ba10 con 0x7fadd410b390 2024-05-09T00:05:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.187+0000 7fadd1ffb700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fadc40a1290 0x7fadc40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.188+0000 7fadd1ffb700 1 -- 172.21.15.81:0/1055468314 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fadcc0ce480 con 0x7fadd410b390 2024-05-09T00:05:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.188+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fadc40a1290 0x7fadc40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.188+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fadc40a1290 0x7fadc40a3750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fadc8005950 tx=0x7fadc8005f50 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.188+0000 7fade6fbcb80 1 Processor -- start 2024-05-09T00:05:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.188+0000 7fade6fbcb80 1 -- start start 2024-05-09T00:05:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fade6fbcb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31050 0x55cf24e31430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fade6fbcb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e31970 0x55cf24e2b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fade6fbcb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e2b890 0x55cf24e2bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fade6fbcb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf24d82150 con 0x55cf24e31050 2024-05-09T00:05:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fade6fbcb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf24d7fb10 con 0x55cf24e2b890 2024-05-09T00:05:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fade6fbcb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf24d7b400 con 0x55cf24e31970 2024-05-09T00:05:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fadd8b9e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31050 0x55cf24e31430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fadd8b9e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31050 0x55cf24e31430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34858/0 (socket says 172.21.15.81:34858) 2024-05-09T00:05:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fadd8b9e700 1 -- 172.21.15.81:0/532493052 learned_addr learned my addr 172.21.15.81:0/532493052 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fadd939f700 1 --2- 172.21.15.81:0/532493052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e2b890 0x55cf24e2bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fadd8b9e700 1 -- 172.21.15.81:0/532493052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e31970 msgr2=0x55cf24e2b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/532493052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e31970 0x55cf24e2b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fadd8b9e700 1 -- 172.21.15.81:0/532493052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e2b890 msgr2=0x55cf24e2bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/532493052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e2b890 0x55cf24e2bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fadd8b9e700 1 -- 172.21.15.81:0/532493052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf24bfc3b0 con 0x55cf24e31050 2024-05-09T00:05:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fadd939f700 1 --2- 172.21.15.81:0/532493052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e2b890 0x55cf24e2bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/532493052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31050 0x55cf24e31430 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fadc800ed30 tx=0x7fadc8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83ca6eeaaf80ccb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fadbeffd700 1 -- 172.21.15.81:0/532493052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8010d80 con 0x55cf24e31050 2024-05-09T00:05:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fadbeffd700 1 -- 172.21.15.81:0/532493052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadc8004cf0 con 0x55cf24e31050 2024-05-09T00:05:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.189+0000 7fadbeffd700 1 -- 172.21.15.81:0/532493052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc801d6b0 con 0x55cf24e31050 2024-05-09T00:05:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.190+0000 7fade6fbcb80 1 -- 172.21.15.81:0/532493052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31050 msgr2=0x55cf24e31430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.190+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/532493052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31050 0x55cf24e31430 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fadc800ed30 tx=0x7fadc8011000 comp rx=0 tx=0).stop 2024-05-09T00:05:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.190+0000 7fade6fbcb80 1 -- 172.21.15.81:0/532493052 shutdown_connections 2024-05-09T00:05:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.190+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/532493052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e2b890 0x55cf24e2bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.190+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/532493052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31050 0x55cf24e31430 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.190+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/532493052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e31970 0x55cf24e2b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.190+0000 7fade6fbcb80 1 -- 172.21.15.81:0/532493052 >> 172.21.15.81:0/532493052 conn(0x55cf24d89210 msgr2=0x55cf24e262d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.190+0000 7fade6fbcb80 1 -- 172.21.15.81:0/532493052 shutdown_connections 2024-05-09T00:05:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.190+0000 7fade6fbcb80 1 -- 172.21.15.81:0/532493052 wait complete. 2024-05-09T00:05:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.190+0000 7fade6fbcb80 1 -- start start 2024-05-09T00:05:17.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.190+0000 7fade6fbcb80 1 Processor -- start 2024-05-09T00:05:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fade6fbcb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e2b890 0x55cf24e378e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fade6fbcb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31050 0x55cf24e34bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fade6fbcb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e31970 0x55cf24e35310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fade6fbcb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf24d17560 con 0x55cf24e31050 2024-05-09T00:05:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fade6fbcb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf24d17200 con 0x55cf24e31970 2024-05-09T00:05:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fade6fbcb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf24bfe6a0 con 0x55cf24e2b890 2024-05-09T00:05:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fade6fbcb80 10 client.0 _ll_register_callbacks cb 0x55cf24d20b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fadd3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31050 0x55cf24e34bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fadd3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31050 0x55cf24e34bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34860/0 (socket says 172.21.15.81:34860) 2024-05-09T00:05:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fadd3fff700 1 -- 172.21.15.81:0/3461455758 learned_addr learned my addr 172.21.15.81:0/3461455758 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/3461455758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e2b890 0x55cf24e378e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fadd939f700 1 --2- 172.21.15.81:0/3461455758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e31970 0x55cf24e35310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fadd3fff700 1 -- 172.21.15.81:0/3461455758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e2b890 msgr2=0x55cf24e378e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fadd3fff700 1 --2- 172.21.15.81:0/3461455758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e2b890 0x55cf24e378e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fadd3fff700 1 -- 172.21.15.81:0/3461455758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e31970 msgr2=0x55cf24e35310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.191+0000 7fadd3fff700 1 --2- 172.21.15.81:0/3461455758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e31970 0x55cf24e35310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fadd3fff700 1 -- 172.21.15.81:0/3461455758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc800ea10 con 0x55cf24e31050 2024-05-09T00:05:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fadd3fff700 1 --2- 172.21.15.81:0/3461455758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31050 0x55cf24e34bd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009f90 tx=0x7fadc000e5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8795a176c6a8ea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fadb3fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fadb3fff700 1 -- 172.21.15.81:0/3461455758 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc0011670 con 0x55cf24e31050 2024-05-09T00:05:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fadb3fff700 1 -- 172.21.15.81:0/3461455758 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fadc000ee60 con 0x55cf24e31050 2024-05-09T00:05:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fade6fbcb80 1 -- 172.21.15.81:0/3461455758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cf24cd4270 con 0x55cf24e31050 2024-05-09T00:05:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fadb3fff700 1 -- 172.21.15.81:0/3461455758 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadc00117d0 con 0x55cf24e31050 2024-05-09T00:05:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fade6fbcb80 10 client.16041 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fade6fbcb80 1 -- 172.21.15.81:0/3461455758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cf24ba8b60 con 0x55cf24e31050 2024-05-09T00:05:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fadb3fff700 1 -- 172.21.15.81:0/3461455758 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cf24cd4270 con 0x55cf24e31050 2024-05-09T00:05:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fadb3fff700 1 -- 172.21.15.81:0/3461455758 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fadc000c070 con 0x55cf24e31050 2024-05-09T00:05:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fade6fbcb80 10 client.16041 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fade6fbcb80 10 client.16041 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:05:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fade6fbcb80 20 client.16041 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/3461455758 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55cf24e45300 0x55cf24e47720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fade6fbcb80 4 client.16041 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.192+0000 7fade6fbcb80 1 -- 172.21.15.81:0/3461455758 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cf24dfa810 con 0x55cf24e45300 2024-05-09T00:05:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.193+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/3461455758 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55cf24e45300 0x55cf24e47720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.193+0000 7fadb3fff700 10 client.16041 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:05:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.193+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/3461455758 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55cf24e45300 0x55cf24e47720 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=221feaeeb2729abe server_cookie=7aa5e1155622d6c4 in_seq=0 out_seq=0 2024-05-09T00:05:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fadb3fff700 1 -- 172.21.15.81:0/3461455758 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cf24dfa810 con 0x55cf24e45300 2024-05-09T00:05:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fadb3fff700 10 client.16041 handle_command_reply: tid=0 2024-05-09T00:05:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fade6fbcb80 1 client.16041 shutdown 2024-05-09T00:05:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fade6fbcb80 1 -- 172.21.15.81:0/3461455758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31050 msgr2=0x55cf24e34bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/3461455758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31050 0x55cf24e34bd0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fadc0009f90 tx=0x7fadc000e5d0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fade6fbcb80 1 -- 172.21.15.81:0/3461455758 shutdown_connections 2024-05-09T00:05:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/3461455758 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55cf24e45300 0x55cf24e47720 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/3461455758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e31970 0x55cf24e35310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fadb3fff700 0 client.16041 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:05:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/3461455758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e2b890 0x55cf24e378e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/3461455758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31050 0x55cf24e34bd0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fade6fbcb80 1 -- 172.21.15.81:0/3461455758 >> 172.21.15.81:0/3461455758 conn(0x55cf24d89210 msgr2=0x55cf24e260b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fade6fbcb80 1 -- 172.21.15.81:0/3461455758 shutdown_connections 2024-05-09T00:05:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fade6fbcb80 1 -- 172.21.15.81:0/3461455758 wait complete. 2024-05-09T00:05:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.194+0000 7fade6fbcb80 20 client.16041 trim_cache size 0 max 16384 2024-05-09T00:05:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.207+0000 7fade6fbcb80 1 Processor -- start 2024-05-09T00:05:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.207+0000 7fade6fbcb80 1 -- start start 2024-05-09T00:05:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.207+0000 7fade6fbcb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e2b890 0x55cf24e24d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.207+0000 7fade6fbcb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e31050 0x55cf24e37410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.207+0000 7fade6fbcb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31970 0x55cf24e2ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.207+0000 7fade6fbcb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf24e22dc0 con 0x55cf24e31970 2024-05-09T00:05:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.207+0000 7fade6fbcb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf24e4c8f0 con 0x55cf24e31050 2024-05-09T00:05:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.207+0000 7fade6fbcb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf24e2b350 con 0x55cf24e2b890 2024-05-09T00:05:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.207+0000 7fadd939f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31970 0x55cf24e2ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.207+0000 7fadd939f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31970 0x55cf24e2ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34866/0 (socket says 172.21.15.81:34866) 2024-05-09T00:05:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.207+0000 7fadd939f700 1 -- 172.21.15.81:0/4194815382 learned_addr learned my addr 172.21.15.81:0/4194815382 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.208+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/4194815382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e2b890 0x55cf24e24d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.208+0000 7fadd3fff700 1 --2- 172.21.15.81:0/4194815382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e31050 0x55cf24e37410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.208+0000 7fadd939f700 1 -- 172.21.15.81:0/4194815382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e2b890 msgr2=0x55cf24e24d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.208+0000 7fadd939f700 1 --2- 172.21.15.81:0/4194815382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e2b890 0x55cf24e24d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.208+0000 7fadd939f700 1 -- 172.21.15.81:0/4194815382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e31050 msgr2=0x55cf24e37410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.208+0000 7fadd939f700 1 --2- 172.21.15.81:0/4194815382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e31050 0x55cf24e37410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.208+0000 7fadd939f700 1 -- 172.21.15.81:0/4194815382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf24d41560 con 0x55cf24e31970 2024-05-09T00:05:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.208+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/4194815382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e2b890 0x55cf24e24d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.208+0000 7fadd939f700 1 --2- 172.21.15.81:0/4194815382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31970 0x55cf24e2ec80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009fd0 tx=0x7fadcc0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c13d12c21d6bf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.208+0000 7fadbf7fe700 1 -- 172.21.15.81:0/4194815382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc09bce0 con 0x55cf24e31970 2024-05-09T00:05:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.208+0000 7fadbf7fe700 1 -- 172.21.15.81:0/4194815382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadcc09b5e0 con 0x55cf24e31970 2024-05-09T00:05:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.208+0000 7fadbf7fe700 1 -- 172.21.15.81:0/4194815382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc097e80 con 0x55cf24e31970 2024-05-09T00:05:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.208+0000 7fade6fbcb80 1 -- 172.21.15.81:0/4194815382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31970 msgr2=0x55cf24e2ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.208+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/4194815382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31970 0x55cf24e2ec80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fadcc009fd0 tx=0x7fadcc0099e0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 -- 172.21.15.81:0/4194815382 shutdown_connections 2024-05-09T00:05:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/4194815382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31970 0x55cf24e2ec80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/4194815382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e2b890 0x55cf24e24d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/4194815382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e31050 0x55cf24e37410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 -- 172.21.15.81:0/4194815382 >> 172.21.15.81:0/4194815382 conn(0x55cf24d89210 msgr2=0x55cf24e27820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 -- 172.21.15.81:0/4194815382 shutdown_connections 2024-05-09T00:05:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 -- 172.21.15.81:0/4194815382 wait complete. 2024-05-09T00:05:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 -- start start 2024-05-09T00:05:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 Processor -- start 2024-05-09T00:05:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e2b890 0x55cf24e3c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e31050 0x55cf24e2dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31970 0x55cf24e2e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf24e2cb10 con 0x55cf24e31970 2024-05-09T00:05:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf24e2cc80 con 0x55cf24e2b890 2024-05-09T00:05:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.209+0000 7fade6fbcb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf24e2ce40 con 0x55cf24e31050 2024-05-09T00:05:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fade6fbcb80 10 client.0 _ll_register_callbacks cb 0x55cf24d20b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadd939f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31970 0x55cf24e2e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadd939f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31970 0x55cf24e2e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34878/0 (socket says 172.21.15.81:34878) 2024-05-09T00:05:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadd939f700 1 -- 172.21.15.81:0/2143135895 learned_addr learned my addr 172.21.15.81:0/2143135895 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/2143135895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e2b890 0x55cf24e3c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadd3fff700 1 --2- 172.21.15.81:0/2143135895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e31050 0x55cf24e2dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadd939f700 1 -- 172.21.15.81:0/2143135895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e31050 msgr2=0x55cf24e2dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadd939f700 1 --2- 172.21.15.81:0/2143135895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e31050 0x55cf24e2dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadd939f700 1 -- 172.21.15.81:0/2143135895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e2b890 msgr2=0x55cf24e3c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadd939f700 1 --2- 172.21.15.81:0/2143135895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e2b890 0x55cf24e3c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadd939f700 1 -- 172.21.15.81:0/2143135895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd41a41a0 con 0x55cf24e31970 2024-05-09T00:05:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadd939f700 1 --2- 172.21.15.81:0/2143135895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31970 0x55cf24e2e340 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fadcc09b290 tx=0x7fadcc00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408420f1c30e6315 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadb3fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadb3fff700 1 -- 172.21.15.81:0/2143135895 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadcc09f230 con 0x55cf24e31970 2024-05-09T00:05:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadb3fff700 1 -- 172.21.15.81:0/2143135895 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fadcc09f410 con 0x55cf24e31970 2024-05-09T00:05:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fade6fbcb80 1 -- 172.21.15.81:0/2143135895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fadc8004cf0 con 0x55cf24e31970 2024-05-09T00:05:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadb3fff700 1 -- 172.21.15.81:0/2143135895 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadcc0a39d0 con 0x55cf24e31970 2024-05-09T00:05:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fade6fbcb80 10 client.16047 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fade6fbcb80 1 -- 172.21.15.81:0/2143135895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cf24c00cd0 con 0x55cf24e31970 2024-05-09T00:05:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.210+0000 7fadb3fff700 1 -- 172.21.15.81:0/2143135895 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadc8004cf0 con 0x55cf24e31970 2024-05-09T00:05:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.211+0000 7fadb3fff700 1 -- 172.21.15.81:0/2143135895 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fadcc09aad0 con 0x55cf24e31970 2024-05-09T00:05:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.211+0000 7fade6fbcb80 10 client.16047 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.211+0000 7fade6fbcb80 10 client.16047 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:05:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.211+0000 7fade6fbcb80 20 client.16047 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.211+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/2143135895 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55cf24ea02d0 0x55cf24ea26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.211+0000 7fade6fbcb80 4 client.16047 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:05:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.211+0000 7fade6fbcb80 1 -- 172.21.15.81:0/2143135895 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cf24d73ec0 con 0x55cf24ea02d0 2024-05-09T00:05:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.211+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/2143135895 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55cf24ea02d0 0x55cf24ea26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.211+0000 7fadd8b9e700 1 --2- 172.21.15.81:0/2143135895 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55cf24ea02d0 0x55cf24ea26c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7918ce7b32d6a6a9 server_cookie=2eac54f02d48108c in_seq=0 out_seq=0 2024-05-09T00:05:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.211+0000 7fadb3fff700 10 client.16047 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:05:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.211+0000 7fadb3fff700 1 -- 172.21.15.81:0/2143135895 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cf24d73ec0 con 0x55cf24ea02d0 2024-05-09T00:05:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.211+0000 7fadb3fff700 10 client.16047 handle_command_reply: tid=0 2024-05-09T00:05:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fade6fbcb80 1 client.16047 shutdown 2024-05-09T00:05:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fade6fbcb80 1 -- 172.21.15.81:0/2143135895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31970 msgr2=0x55cf24e2e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/2143135895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31970 0x55cf24e2e340 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fadcc09b290 tx=0x7fadcc00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fade6fbcb80 1 -- 172.21.15.81:0/2143135895 shutdown_connections 2024-05-09T00:05:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/2143135895 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55cf24ea02d0 0x55cf24ea26c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/2143135895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cf24e2b890 0x55cf24e3c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fadb3fff700 0 client.16047 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:05:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/2143135895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cf24e31970 0x55cf24e2e340 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fade6fbcb80 1 --2- 172.21.15.81:0/2143135895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cf24e31050 0x55cf24e2dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fade6fbcb80 1 -- 172.21.15.81:0/2143135895 >> 172.21.15.81:0/2143135895 conn(0x55cf24d89210 msgr2=0x55cf24e2ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fade6fbcb80 1 -- 172.21.15.81:0/2143135895 shutdown_connections 2024-05-09T00:05:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fade6fbcb80 1 -- 172.21.15.81:0/2143135895 wait complete. 2024-05-09T00:05:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fade6fbcb80 20 client.16047 trim_cache size 0 max 16384 2024-05-09T00:05:17.218 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:05:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fadd9ba0700 1 -- 172.21.15.81:0/1055468314 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fadc40a1290 msgr2=0x7fadc40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fadd9ba0700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fadc40a1290 0x7fadc40a3750 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fadc8005950 tx=0x7fadc8005f50 comp rx=0 tx=0).stop 2024-05-09T00:05:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fadd9ba0700 1 -- 172.21.15.81:0/1055468314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd410b390 msgr2=0x7fadd419bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fadd9ba0700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd410b390 0x7fadd419bd10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fadcc0077f0 tx=0x7fadcc0078d0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fadd9ba0700 1 -- 172.21.15.81:0/1055468314 shutdown_connections 2024-05-09T00:05:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fadd9ba0700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fadc40a1290 0x7fadc40a3750 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fadd9ba0700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fadd4101f70 0x7fadd4197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fadd9ba0700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadd410b390 0x7fadd419bd10 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fadd9ba0700 1 --2- 172.21.15.81:0/1055468314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fadd4102890 0x7fadd4197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.212+0000 7fadd9ba0700 1 -- 172.21.15.81:0/1055468314 >> 172.21.15.81:0/1055468314 conn(0x7fadd40fb770 msgr2=0x7fadd40fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.213+0000 7fadd9ba0700 1 -- 172.21.15.81:0/1055468314 shutdown_connections 2024-05-09T00:05:17.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.213+0000 7fadd9ba0700 1 -- 172.21.15.81:0/1055468314 wait complete. 2024-05-09T00:05:17.221 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:05:17.244 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:16 smithi081 ceph-mon[42474]: pgmap v73: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:17.263 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:16 smithi150 ceph-mon[46187]: pgmap v73: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:17.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:16 smithi171 ceph-mon[47351]: pgmap v73: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:17.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.350+0000 7fd3e7423700 1 -- 172.21.15.81:0/3882018610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e0101180 msgr2=0x7fd3e0101560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.350+0000 7fd3e7423700 1 --2- 172.21.15.81:0/3882018610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e0101180 0x7fd3e0101560 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0009990 tx=0x7fd3d0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.350+0000 7fd3e7423700 1 -- 172.21.15.81:0/3882018610 shutdown_connections 2024-05-09T00:05:17.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.350+0000 7fd3e7423700 1 --2- 172.21.15.81:0/3882018610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e01062a0 0x7fd3e010de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.350+0000 7fd3e7423700 1 --2- 172.21.15.81:0/3882018610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e0101180 0x7fd3e0101560 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.350+0000 7fd3e7423700 1 --2- 172.21.15.81:0/3882018610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3e0101b30 0x7fd3e0105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.350+0000 7fd3e7423700 1 -- 172.21.15.81:0/3882018610 >> 172.21.15.81:0/3882018610 conn(0x7fd3e00fc9e0 msgr2=0x7fd3e00fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.350+0000 7fd3e7423700 1 -- 172.21.15.81:0/3882018610 shutdown_connections 2024-05-09T00:05:17.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.350+0000 7fd3e7423700 1 -- 172.21.15.81:0/3882018610 wait complete. 2024-05-09T00:05:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.350+0000 7fd3e7423700 1 Processor -- start 2024-05-09T00:05:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e7423700 1 -- start start 2024-05-09T00:05:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e7423700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3e0101180 0x7fd3e00732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e7423700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e01062a0 0x7fd3e00737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e7423700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e0073d20 0x7fd3e01a5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e7423700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e01a5c90 con 0x7fd3e01062a0 2024-05-09T00:05:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e7423700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e01a5e00 con 0x7fd3e0073d20 2024-05-09T00:05:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e7423700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e01a5fc0 con 0x7fd3e0101180 2024-05-09T00:05:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e49be700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e01062a0 0x7fd3e00737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e49be700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e01062a0 0x7fd3e00737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54984/0 (socket says 172.21.15.81:54984) 2024-05-09T00:05:17.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e49be700 1 -- 172.21.15.81:0/1189155656 learned_addr learned my addr 172.21.15.81:0/1189155656 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3e0101180 0x7fd3e00732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e59c0700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e0073d20 0x7fd3e01a5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e49be700 1 -- 172.21.15.81:0/1189155656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3e0101180 msgr2=0x7fd3e00732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e49be700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3e0101180 0x7fd3e00732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e49be700 1 -- 172.21.15.81:0/1189155656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e0073d20 msgr2=0x7fd3e01a5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e49be700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e0073d20 0x7fd3e01a5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e49be700 1 -- 172.21.15.81:0/1189155656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d00095f0 con 0x7fd3e01062a0 2024-05-09T00:05:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e59c0700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e0073d20 0x7fd3e01a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3e0101180 0x7fd3e00732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e49be700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e01062a0 0x7fd3e00737e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00c8f0 tx=0x7fd3dc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3d67fc700 1 -- 172.21.15.81:0/1189155656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc007b00 con 0x7fd3e01062a0 2024-05-09T00:05:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3e7423700 1 -- 172.21.15.81:0/1189155656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e01a62a0 con 0x7fd3e01062a0 2024-05-09T00:05:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3d67fc700 1 -- 172.21.15.81:0/1189155656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3dc007c60 con 0x7fd3e01062a0 2024-05-09T00:05:17.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.351+0000 7fd3d67fc700 1 -- 172.21.15.81:0/1189155656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc018660 con 0x7fd3e01062a0 2024-05-09T00:05:17.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.352+0000 7fd3e7423700 1 -- 172.21.15.81:0/1189155656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e01a6800 con 0x7fd3e01062a0 2024-05-09T00:05:17.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.354+0000 7fd3d67fc700 1 -- 172.21.15.81:0/1189155656 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fd3dc00f450 con 0x7fd3e01062a0 2024-05-09T00:05:17.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.354+0000 7fd3d67fc700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd3cc0a1290 0x7fd3cc0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.354+0000 7fd3d67fc700 1 -- 172.21.15.81:0/1189155656 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fd3dc0ccc80 con 0x7fd3e01062a0 2024-05-09T00:05:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.354+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd3cc0a1290 0x7fd3cc0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.355+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd3cc0a1290 0x7fd3cc0a3750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0006010 tx=0x7fd3d000b540 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.355+0000 7fd3f35ddb80 1 Processor -- start 2024-05-09T00:05:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.355+0000 7fd3f35ddb80 1 -- start start 2024-05-09T00:05:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.355+0000 7fd3f35ddb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daee00 0x55bfd0daf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.355+0000 7fd3f35ddb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0daf720 0x55bfd0da9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.355+0000 7fd3f35ddb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0da9890 0x55bfd0da9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.355+0000 7fd3f35ddb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd0d00150 con 0x55bfd0daee00 2024-05-09T00:05:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.355+0000 7fd3f35ddb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd0cfdb10 con 0x55bfd0daf720 2024-05-09T00:05:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.355+0000 7fd3f35ddb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd0cf9400 con 0x55bfd0da9890 2024-05-09T00:05:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.356+0000 7fd3e51bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daee00 0x55bfd0daf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.356+0000 7fd3e51bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daee00 0x55bfd0daf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55000/0 (socket says 172.21.15.81:55000) 2024-05-09T00:05:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.356+0000 7fd3e51bf700 1 -- 172.21.15.81:0/3999574579 learned_addr learned my addr 172.21.15.81:0/3999574579 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.356+0000 7fd3e49be700 1 --2- 172.21.15.81:0/3999574579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0daf720 0x55bfd0da9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.356+0000 7fd3e51bf700 1 -- 172.21.15.81:0/3999574579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0da9890 msgr2=0x55bfd0da9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.356+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/3999574579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0da9890 0x55bfd0da9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.356+0000 7fd3e51bf700 1 -- 172.21.15.81:0/3999574579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0daf720 msgr2=0x55bfd0da9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.356+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/3999574579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0daf720 0x55bfd0da9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.356+0000 7fd3e51bf700 1 -- 172.21.15.81:0/3999574579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfd0b7a3b0 con 0x55bfd0daee00 2024-05-09T00:05:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.356+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/3999574579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daee00 0x55bfd0daf1e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0005ef0 tx=0x7fd3d001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eac6836772c6125 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.356+0000 7fd3cb7fe700 1 -- 172.21.15.81:0/3999574579 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d002b070 con 0x55bfd0daee00 2024-05-09T00:05:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.356+0000 7fd3cb7fe700 1 -- 172.21.15.81:0/3999574579 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3d001e040 con 0x55bfd0daee00 2024-05-09T00:05:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.356+0000 7fd3cb7fe700 1 -- 172.21.15.81:0/3999574579 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d000f460 con 0x55bfd0daee00 2024-05-09T00:05:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.357+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/3999574579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daee00 msgr2=0x55bfd0daf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.357+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/3999574579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daee00 0x55bfd0daf1e0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0005ef0 tx=0x7fd3d001f000 comp rx=0 tx=0).stop 2024-05-09T00:05:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.357+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/3999574579 shutdown_connections 2024-05-09T00:05:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.357+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/3999574579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0da9890 0x55bfd0da9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.357+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/3999574579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daee00 0x55bfd0daf1e0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.357+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/3999574579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0daf720 0x55bfd0da9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.357+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/3999574579 >> 172.21.15.81:0/3999574579 conn(0x55bfd0d07210 msgr2=0x55bfd0da3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.357+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/3999574579 shutdown_connections 2024-05-09T00:05:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.357+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/3999574579 wait complete. 2024-05-09T00:05:17.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.357+0000 7fd3f35ddb80 1 -- start start 2024-05-09T00:05:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.357+0000 7fd3f35ddb80 1 Processor -- start 2024-05-09T00:05:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3f35ddb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0da9890 0x55bfd0db2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3f35ddb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daee00 0x55bfd0db3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3f35ddb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daf720 0x55bfd0db3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3f35ddb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd0c95560 con 0x55bfd0daf720 2024-05-09T00:05:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3f35ddb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd0c95200 con 0x55bfd0da9890 2024-05-09T00:05:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3f35ddb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd0b7c6a0 con 0x55bfd0daee00 2024-05-09T00:05:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3f35ddb80 10 client.0 _ll_register_callbacks cb 0x55bfd0c9eb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3e59c0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daf720 0x55bfd0db3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3e59c0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daf720 0x55bfd0db3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55010/0 (socket says 172.21.15.81:55010) 2024-05-09T00:05:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3e59c0700 1 -- 172.21.15.81:0/2321787028 learned_addr learned my addr 172.21.15.81:0/2321787028 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3e49be700 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daee00 0x55bfd0db3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0da9890 0x55bfd0db2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3e59c0700 1 -- 172.21.15.81:0/2321787028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daee00 msgr2=0x55bfd0db3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3e59c0700 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daee00 0x55bfd0db3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3e59c0700 1 -- 172.21.15.81:0/2321787028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0da9890 msgr2=0x55bfd0db2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3e59c0700 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0da9890 0x55bfd0db2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3e59c0700 1 -- 172.21.15.81:0/2321787028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e010e690 con 0x55bfd0daf720 2024-05-09T00:05:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3e49be700 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daee00 0x55bfd0db3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.358+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0da9890 0x55bfd0db2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3e59c0700 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daf720 0x55bfd0db3670 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800c960 tx=0x7fd3d800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b153a3fb0fbf44 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3c8ff9700 1 -- 172.21.15.81:0/2321787028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d800ab80 con 0x55bfd0daf720 2024-05-09T00:05:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3c8ff9700 1 -- 172.21.15.81:0/2321787028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fd3d8006e40 con 0x55bfd0daf720 2024-05-09T00:05:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/2321787028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bfd0c52270 con 0x55bfd0daf720 2024-05-09T00:05:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3c8ff9700 1 -- 172.21.15.81:0/2321787028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3d800ce40 con 0x55bfd0daf720 2024-05-09T00:05:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3f35ddb80 10 client.16059 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/2321787028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bfd0b26b60 con 0x55bfd0daf720 2024-05-09T00:05:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3c8ff9700 1 -- 172.21.15.81:0/2321787028 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bfd0c52270 con 0x55bfd0daf720 2024-05-09T00:05:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3c8ff9700 1 -- 172.21.15.81:0/2321787028 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd3d8016020 con 0x55bfd0daf720 2024-05-09T00:05:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3f35ddb80 10 client.16059 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3f35ddb80 10 client.16059 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:05:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3f35ddb80 20 client.16059 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55bfd0dc32a0 0x55bfd0dc56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3f35ddb80 4 client.16059 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/2321787028 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bfd0d78810 con 0x55bfd0dc32a0 2024-05-09T00:05:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.359+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55bfd0dc32a0 0x55bfd0dc56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.360+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55bfd0dc32a0 0x55bfd0dc56c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f36f5a75597e124e server_cookie=344257e20e26c63b in_seq=0 out_seq=0 2024-05-09T00:05:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.360+0000 7fd3c8ff9700 10 client.16059 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:05:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.360+0000 7fd3c8ff9700 1 -- 172.21.15.81:0/2321787028 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bfd0d78810 con 0x55bfd0dc32a0 2024-05-09T00:05:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.360+0000 7fd3c8ff9700 10 client.16059 handle_command_reply: tid=0 2024-05-09T00:05:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.361+0000 7fd3f35ddb80 1 client.16059 shutdown 2024-05-09T00:05:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.361+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/2321787028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daf720 msgr2=0x55bfd0db3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.361+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daf720 0x55bfd0db3670 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd3d800c960 tx=0x7fd3d800cd20 comp rx=0 tx=0).stop 2024-05-09T00:05:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.361+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/2321787028 shutdown_connections 2024-05-09T00:05:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.361+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55bfd0dc32a0 0x55bfd0dc56c0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.361+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0da9890 0x55bfd0db2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.361+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daf720 0x55bfd0db3670 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.361+0000 7fd3c8ff9700 0 client.16059 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:05:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.361+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/2321787028 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daee00 0x55bfd0db3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.361+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/2321787028 >> 172.21.15.81:0/2321787028 conn(0x55bfd0d07210 msgr2=0x55bfd0da35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.361+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/2321787028 shutdown_connections 2024-05-09T00:05:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.361+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/2321787028 wait complete. 2024-05-09T00:05:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.361+0000 7fd3f35ddb80 20 client.16059 trim_cache size 0 max 16384 2024-05-09T00:05:17.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.374+0000 7fd3f35ddb80 1 Processor -- start 2024-05-09T00:05:17.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.374+0000 7fd3f35ddb80 1 -- start start 2024-05-09T00:05:17.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.374+0000 7fd3f35ddb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0da9890 0x55bfd0db24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.374+0000 7fd3f35ddb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daee00 0x55bfd0da3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.374+0000 7fd3f35ddb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daf720 0x55bfd0db32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.374+0000 7fd3f35ddb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd0db0bc0 con 0x55bfd0daee00 2024-05-09T00:05:17.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.374+0000 7fd3f35ddb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd0db4100 con 0x55bfd0da9890 2024-05-09T00:05:17.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.374+0000 7fd3f35ddb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd0da4e80 con 0x55bfd0daf720 2024-05-09T00:05:17.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.374+0000 7fd3e49be700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daee00 0x55bfd0da3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.374+0000 7fd3e49be700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daee00 0x55bfd0da3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55024/0 (socket says 172.21.15.81:55024) 2024-05-09T00:05:17.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.374+0000 7fd3e49be700 1 -- 172.21.15.81:0/200516276 learned_addr learned my addr 172.21.15.81:0/200516276 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.374+0000 7fd3e59c0700 1 --2- 172.21.15.81:0/200516276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daf720 0x55bfd0db32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/200516276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0da9890 0x55bfd0db24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3e49be700 1 -- 172.21.15.81:0/200516276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daf720 msgr2=0x55bfd0db32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3e49be700 1 --2- 172.21.15.81:0/200516276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daf720 0x55bfd0db32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3e49be700 1 -- 172.21.15.81:0/200516276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0da9890 msgr2=0x55bfd0db24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3e49be700 1 --2- 172.21.15.81:0/200516276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0da9890 0x55bfd0db24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3e49be700 1 -- 172.21.15.81:0/200516276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfd0cbf560 con 0x55bfd0daee00 2024-05-09T00:05:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3e49be700 1 --2- 172.21.15.81:0/200516276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daee00 0x55bfd0da3d20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc005950 tx=0x7fd3dc0996f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284744961cb341f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3cbfff700 1 -- 172.21.15.81:0/200516276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc099d90 con 0x55bfd0daee00 2024-05-09T00:05:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3cbfff700 1 -- 172.21.15.81:0/200516276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3dc09dbc0 con 0x55bfd0daee00 2024-05-09T00:05:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3cbfff700 1 -- 172.21.15.81:0/200516276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc09a250 con 0x55bfd0daee00 2024-05-09T00:05:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/200516276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daee00 msgr2=0x55bfd0da3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/200516276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daee00 0x55bfd0da3d20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc005950 tx=0x7fd3dc0996f0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/200516276 shutdown_connections 2024-05-09T00:05:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/200516276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0da9890 0x55bfd0db24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/200516276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daf720 0x55bfd0db32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/200516276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0daee00 0x55bfd0da3d20 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/200516276 >> 172.21.15.81:0/200516276 conn(0x55bfd0d07210 msgr2=0x55bfd0db2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/200516276 shutdown_connections 2024-05-09T00:05:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.375+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/200516276 wait complete. 2024-05-09T00:05:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.376+0000 7fd3f35ddb80 1 -- start start 2024-05-09T00:05:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.376+0000 7fd3f35ddb80 1 Processor -- start 2024-05-09T00:05:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.376+0000 7fd3f35ddb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0da9890 0x55bfd0db8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.376+0000 7fd3f35ddb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daee00 0x55bfd0db9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.376+0000 7fd3f35ddb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0daf720 0x55bfd0db9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.376+0000 7fd3f35ddb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd0e19770 con 0x55bfd0da9890 2024-05-09T00:05:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.376+0000 7fd3f35ddb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd0e198b0 con 0x55bfd0daf720 2024-05-09T00:05:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.376+0000 7fd3f35ddb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd0e199f0 con 0x55bfd0daee00 2024-05-09T00:05:17.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.376+0000 7fd3f35ddb80 10 client.0 _ll_register_callbacks cb 0x55bfd0c9eb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.376+0000 7fd3e51bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0da9890 0x55bfd0db8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.376+0000 7fd3e51bf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0da9890 0x55bfd0db8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55036/0 (socket says 172.21.15.81:55036) 2024-05-09T00:05:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.376+0000 7fd3e51bf700 1 -- 172.21.15.81:0/3910820191 learned_addr learned my addr 172.21.15.81:0/3910820191 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.376+0000 7fd3e49be700 1 --2- 172.21.15.81:0/3910820191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daee00 0x55bfd0db9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3e51bf700 1 -- 172.21.15.81:0/3910820191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daee00 msgr2=0x55bfd0db9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/3910820191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daee00 0x55bfd0db9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3e51bf700 1 -- 172.21.15.81:0/3910820191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0daf720 msgr2=0x55bfd0db9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3e59c0700 1 --2- 172.21.15.81:0/3910820191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0daf720 0x55bfd0db9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/3910820191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0daf720 0x55bfd0db9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3e51bf700 1 -- 172.21.15.81:0/3910820191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e01a6800 con 0x55bfd0da9890 2024-05-09T00:05:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3e51bf700 1 --2- 172.21.15.81:0/3910820191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0da9890 0x55bfd0db8b10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0005340 tx=0x7fd3d0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f382099bf11e5a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3c8ff9700 1 -- 172.21.15.81:0/3910820191 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d002b040 con 0x55bfd0da9890 2024-05-09T00:05:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3c8ff9700 1 -- 172.21.15.81:0/3910820191 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fd3d0004830 con 0x55bfd0da9890 2024-05-09T00:05:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/3910820191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd3d001e040 con 0x55bfd0da9890 2024-05-09T00:05:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3c8ff9700 1 -- 172.21.15.81:0/3910820191 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3d00049f0 con 0x55bfd0da9890 2024-05-09T00:05:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3f35ddb80 10 client.16065 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/3910820191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bfd0b7ecd0 con 0x55bfd0da9890 2024-05-09T00:05:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3c8ff9700 1 -- 172.21.15.81:0/3910820191 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3d0046020 con 0x55bfd0da9890 2024-05-09T00:05:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3c8ff9700 1 -- 172.21.15.81:0/3910820191 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd3d0036040 con 0x55bfd0da9890 2024-05-09T00:05:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3f35ddb80 10 client.16065 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3f35ddb80 10 client.16065 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:05:17.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3f35ddb80 20 client.16065 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/3910820191 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55bfd0e1acb0 0x55bfd0e1d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3f35ddb80 4 client.16065 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:05:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.377+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/3910820191 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bfd0cf1ec0 con 0x55bfd0e1acb0 2024-05-09T00:05:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3e49be700 1 --2- 172.21.15.81:0/3910820191 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55bfd0e1acb0 0x55bfd0e1d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3e49be700 1 --2- 172.21.15.81:0/3910820191 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55bfd0e1acb0 0x55bfd0e1d0a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8cded7b440cdd212 server_cookie=fa0ac2b948c508bd in_seq=0 out_seq=0 2024-05-09T00:05:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3c8ff9700 10 client.16065 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:05:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3c8ff9700 1 -- 172.21.15.81:0/3910820191 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bfd0cf1ec0 con 0x55bfd0e1acb0 2024-05-09T00:05:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3c8ff9700 10 client.16065 handle_command_reply: tid=0 2024-05-09T00:05:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3f35ddb80 1 client.16065 shutdown 2024-05-09T00:05:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/3910820191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0da9890 msgr2=0x55bfd0db8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/3910820191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0da9890 0x55bfd0db8b10 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0005340 tx=0x7fd3d0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/3910820191 shutdown_connections 2024-05-09T00:05:17.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/3910820191 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55bfd0e1acb0 0x55bfd0e1d0a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/3910820191 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bfd0daf720 0x55bfd0db9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3c8ff9700 0 client.16065 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:05:17.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/3910820191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bfd0da9890 0x55bfd0db8b10 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3f35ddb80 1 --2- 172.21.15.81:0/3910820191 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bfd0daee00 0x55bfd0db9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.378+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/3910820191 >> 172.21.15.81:0/3910820191 conn(0x55bfd0d07210 msgr2=0x55bfd0dae3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/3910820191 shutdown_connections 2024-05-09T00:05:17.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3f35ddb80 1 -- 172.21.15.81:0/3910820191 wait complete. 2024-05-09T00:05:17.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3f35ddb80 20 client.16065 trim_cache size 0 max 16384 2024-05-09T00:05:17.384 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:05:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3e7423700 1 -- 172.21.15.81:0/1189155656 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd3cc0a1290 msgr2=0x7fd3cc0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3e7423700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd3cc0a1290 0x7fd3cc0a3750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0006010 tx=0x7fd3d000b540 comp rx=0 tx=0).stop 2024-05-09T00:05:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3e7423700 1 -- 172.21.15.81:0/1189155656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e01062a0 msgr2=0x7fd3e00737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3e7423700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e01062a0 0x7fd3e00737e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00c8f0 tx=0x7fd3dc00ccb0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3e7423700 1 -- 172.21.15.81:0/1189155656 shutdown_connections 2024-05-09T00:05:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3e7423700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd3cc0a1290 0x7fd3cc0a3750 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3e7423700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd3e0073d20 0x7fd3e01a5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3e7423700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd3e0101180 0x7fd3e00732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3e7423700 1 --2- 172.21.15.81:0/1189155656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3e01062a0 0x7fd3e00737e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3e7423700 1 -- 172.21.15.81:0/1189155656 >> 172.21.15.81:0/1189155656 conn(0x7fd3e00fc9e0 msgr2=0x7fd3e00fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3e7423700 1 -- 172.21.15.81:0/1189155656 shutdown_connections 2024-05-09T00:05:17.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.379+0000 7fd3e7423700 1 -- 172.21.15.81:0/1189155656 wait complete. 2024-05-09T00:05:17.387 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:05:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.556+0000 7fcd9213f700 1 -- 172.21.15.81:0/2737538100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c069740 msgr2=0x7fcd8c069b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.556+0000 7fcd9213f700 1 --2- 172.21.15.81:0/2737538100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c069740 0x7fcd8c069b20 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0099c0 tx=0x7fcd7c009cd0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.556+0000 7fcd9213f700 1 -- 172.21.15.81:0/2737538100 shutdown_connections 2024-05-09T00:05:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.556+0000 7fcd9213f700 1 --2- 172.21.15.81:0/2737538100 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd8c1062a0 0x7fcd8c10de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.556+0000 7fcd9213f700 1 --2- 172.21.15.81:0/2737538100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c069740 0x7fcd8c069b20 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.556+0000 7fcd9213f700 1 --2- 172.21.15.81:0/2737538100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd8c06a0f0 0x7fcd8c105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.556+0000 7fcd9213f700 1 -- 172.21.15.81:0/2737538100 >> 172.21.15.81:0/2737538100 conn(0x7fcd8c076f70 msgr2=0x7fcd8c077380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.557+0000 7fcd9213f700 1 -- 172.21.15.81:0/2737538100 shutdown_connections 2024-05-09T00:05:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.557+0000 7fcd9213f700 1 -- 172.21.15.81:0/2737538100 wait complete. 2024-05-09T00:05:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.557+0000 7fcd9213f700 1 Processor -- start 2024-05-09T00:05:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.557+0000 7fcd9213f700 1 -- start start 2024-05-09T00:05:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.557+0000 7fcd9213f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c069740 0x7fcd8c197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.557+0000 7fcd9213f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd8c1062a0 0x7fcd8c1978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.557+0000 7fcd9213f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd8c19bc70 0x7fcd8c19c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.557+0000 7fcd9213f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c19c6f0 con 0x7fcd8c069740 2024-05-09T00:05:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd9213f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c19c860 con 0x7fcd8c1062a0 2024-05-09T00:05:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd9213f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8c19ca20 con 0x7fcd8c19bc70 2024-05-09T00:05:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd8b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c069740 0x7fcd8c197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd8b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c069740 0x7fcd8c197390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55052/0 (socket says 172.21.15.81:55052) 2024-05-09T00:05:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd8b7fe700 1 -- 172.21.15.81:0/3875914059 learned_addr learned my addr 172.21.15.81:0/3875914059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd8bfff700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd8c19bc70 0x7fcd8c19c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd8affd700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd8c1062a0 0x7fcd8c1978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd8b7fe700 1 -- 172.21.15.81:0/3875914059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd8c19bc70 msgr2=0x7fcd8c19c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd8b7fe700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd8c19bc70 0x7fcd8c19c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd8b7fe700 1 -- 172.21.15.81:0/3875914059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd8c1062a0 msgr2=0x7fcd8c1978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd8b7fe700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd8c1062a0 0x7fcd8c1978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd8b7fe700 1 -- 172.21.15.81:0/3875914059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c0095f0 con 0x7fcd8c069740 2024-05-09T00:05:17.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd8bfff700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd8c19bc70 0x7fcd8c19c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd8affd700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd8c1062a0 0x7fcd8c1978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd8b7fe700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c069740 0x7fcd8c197390 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00b580 tx=0x7fcd7c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd88ff9700 1 -- 172.21.15.81:0/3875914059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c01d070 con 0x7fcd8c069740 2024-05-09T00:05:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd9213f700 1 -- 172.21.15.81:0/3875914059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8c1a3f20 con 0x7fcd8c069740 2024-05-09T00:05:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd88ff9700 1 -- 172.21.15.81:0/3875914059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd7c00fc30 con 0x7fcd8c069740 2024-05-09T00:05:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd88ff9700 1 -- 172.21.15.81:0/3875914059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c022df0 con 0x7fcd8c069740 2024-05-09T00:05:17.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.558+0000 7fcd9213f700 1 -- 172.21.15.81:0/3875914059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8c1a42f0 con 0x7fcd8c069740 2024-05-09T00:05:17.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.561+0000 7fcd88ff9700 1 -- 172.21.15.81:0/3875914059 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fcd7c022500 con 0x7fcd8c069740 2024-05-09T00:05:17.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.561+0000 7fcd88ff9700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcd740a1290 0x7fcd740a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.562+0000 7fcd8affd700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcd740a1290 0x7fcd740a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.562+0000 7fcd88ff9700 1 -- 172.21.15.81:0/3875914059 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fcd7c0cde20 con 0x7fcd8c069740 2024-05-09T00:05:17.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.562+0000 7fcd8affd700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcd740a1290 0x7fcd740a3750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcd80005950 tx=0x7fcd800058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.562+0000 7fcd9e2f9b80 1 Processor -- start 2024-05-09T00:05:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.562+0000 7fcd9e2f9b80 1 -- start start 2024-05-09T00:05:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.562+0000 7fcd9e2f9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df73fe00 0x55f3df7401e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.562+0000 7fcd9e2f9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df740720 0x55f3df73a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.562+0000 7fcd9e2f9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73a890 0x55f3df73acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.562+0000 7fcd9e2f9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df691150 con 0x55f3df740720 2024-05-09T00:05:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.562+0000 7fcd9e2f9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df68eb10 con 0x55f3df73a890 2024-05-09T00:05:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.562+0000 7fcd9e2f9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df68a400 con 0x55f3df73fe00 2024-05-09T00:05:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.563+0000 7fcd8affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df740720 0x55f3df73a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.563+0000 7fcd8affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df740720 0x55f3df73a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55066/0 (socket says 172.21.15.81:55066) 2024-05-09T00:05:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.563+0000 7fcd8affd700 1 -- 172.21.15.81:0/402366021 learned_addr learned my addr 172.21.15.81:0/402366021 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.563+0000 7fcd8bfff700 1 --2- 172.21.15.81:0/402366021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73a890 0x55f3df73acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.563+0000 7fcd8affd700 1 -- 172.21.15.81:0/402366021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df73fe00 msgr2=0x55f3df7401e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.563+0000 7fcd8affd700 1 --2- 172.21.15.81:0/402366021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df73fe00 0x55f3df7401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.563+0000 7fcd8affd700 1 -- 172.21.15.81:0/402366021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73a890 msgr2=0x55f3df73acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.563+0000 7fcd8affd700 1 --2- 172.21.15.81:0/402366021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73a890 0x55f3df73acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.563+0000 7fcd8affd700 1 -- 172.21.15.81:0/402366021 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3df50b3b0 con 0x55f3df740720 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.563+0000 7fcd8bfff700 1 --2- 172.21.15.81:0/402366021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73a890 0x55f3df73acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.563+0000 7fcd8affd700 1 --2- 172.21.15.81:0/402366021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df740720 0x55f3df73a350 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000b5d0 tx=0x7fcd80012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329c9be0c509e941 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.563+0000 7fcd71ffb700 1 -- 172.21.15.81:0/402366021 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd80017040 con 0x55f3df740720 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.563+0000 7fcd71ffb700 1 -- 172.21.15.81:0/402366021 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd80003d40 con 0x55f3df740720 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.563+0000 7fcd71ffb700 1 -- 172.21.15.81:0/402366021 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8001fca0 con 0x55f3df740720 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.564+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/402366021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df740720 msgr2=0x55f3df73a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.564+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/402366021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df740720 0x55f3df73a350 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000b5d0 tx=0x7fcd80012000 comp rx=0 tx=0).stop 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.564+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/402366021 shutdown_connections 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.564+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/402366021 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73a890 0x55f3df73acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.564+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/402366021 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df73fe00 0x55f3df7401e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.564+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/402366021 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df740720 0x55f3df73a350 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.564+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/402366021 >> 172.21.15.81:0/402366021 conn(0x55f3df698210 msgr2=0x55f3df734df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.564+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/402366021 shutdown_connections 2024-05-09T00:05:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.564+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/402366021 wait complete. 2024-05-09T00:05:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.564+0000 7fcd9e2f9b80 1 -- start start 2024-05-09T00:05:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.564+0000 7fcd9e2f9b80 1 Processor -- start 2024-05-09T00:05:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd9e2f9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df73a890 0x55f3df743c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd9e2f9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73fe00 0x55f3df744160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd9e2f9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df740720 0x55f3df7446a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd9e2f9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df626560 con 0x55f3df73fe00 2024-05-09T00:05:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd9e2f9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df626200 con 0x55f3df740720 2024-05-09T00:05:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd9e2f9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df50d6a0 con 0x55f3df73a890 2024-05-09T00:05:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd9e2f9b80 10 client.0 _ll_register_callbacks cb 0x55f3df62fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd8affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73fe00 0x55f3df744160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd8affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73fe00 0x55f3df744160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55068/0 (socket says 172.21.15.81:55068) 2024-05-09T00:05:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd8affd700 1 -- 172.21.15.81:0/3492624378 learned_addr learned my addr 172.21.15.81:0/3492624378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd8bfff700 1 --2- 172.21.15.81:0/3492624378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df740720 0x55f3df7446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd8b7fe700 1 --2- 172.21.15.81:0/3492624378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df73a890 0x55f3df743c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd8affd700 1 -- 172.21.15.81:0/3492624378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df73a890 msgr2=0x55f3df743c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd8affd700 1 --2- 172.21.15.81:0/3492624378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df73a890 0x55f3df743c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd8affd700 1 -- 172.21.15.81:0/3492624378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df740720 msgr2=0x55f3df7446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd8affd700 1 --2- 172.21.15.81:0/3492624378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df740720 0x55f3df7446a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd8affd700 1 -- 172.21.15.81:0/3492624378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8000fbb0 con 0x55f3df73fe00 2024-05-09T00:05:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd8affd700 1 --2- 172.21.15.81:0/3492624378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73fe00 0x55f3df744160 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcd800046c0 tx=0x7fcd80003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9179347e12e8072f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd6affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd6affd700 1 -- 172.21.15.81:0/3492624378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8001fd50 con 0x55f3df73fe00 2024-05-09T00:05:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd6affd700 1 -- 172.21.15.81:0/3492624378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fcd8002a440 con 0x55f3df73fe00 2024-05-09T00:05:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.565+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3492624378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3df5e3270 con 0x55f3df73fe00 2024-05-09T00:05:17.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.566+0000 7fcd6affd700 1 -- 172.21.15.81:0/3492624378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd8002a600 con 0x55f3df73fe00 2024-05-09T00:05:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.566+0000 7fcd9e2f9b80 10 client.16077 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.566+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3492624378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f3df4b7b60 con 0x55f3df73fe00 2024-05-09T00:05:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.566+0000 7fcd6affd700 1 -- 172.21.15.81:0/3492624378 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f3df5e3270 con 0x55f3df73fe00 2024-05-09T00:05:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.566+0000 7fcd6affd700 1 -- 172.21.15.81:0/3492624378 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcd8001d040 con 0x55f3df73fe00 2024-05-09T00:05:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.566+0000 7fcd9e2f9b80 10 client.16077 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.566+0000 7fcd9e2f9b80 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.566+0000 7fcd9e2f9b80 20 client.16077 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.566+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3492624378 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f3df754100 0x55f3df756520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.566+0000 7fcd9e2f9b80 4 client.16077 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.566+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3492624378 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3df709810 con 0x55f3df754100 2024-05-09T00:05:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.566+0000 7fcd8b7fe700 1 --2- 172.21.15.81:0/3492624378 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f3df754100 0x55f3df756520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd8b7fe700 1 --2- 172.21.15.81:0/3492624378 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f3df754100 0x55f3df756520 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e098d1049f257151 server_cookie=805ec1e5989ecc0f in_seq=0 out_seq=0 2024-05-09T00:05:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd6affd700 10 client.16077 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:17.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd6affd700 1 -- 172.21.15.81:0/3492624378 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f3df709810 con 0x55f3df754100 2024-05-09T00:05:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd6affd700 10 client.16077 handle_command_reply: tid=0 2024-05-09T00:05:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd9e2f9b80 1 client.16077 shutdown 2024-05-09T00:05:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3492624378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73fe00 msgr2=0x55f3df744160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3492624378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73fe00 0x55f3df744160 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcd800046c0 tx=0x7fcd80003960 comp rx=0 tx=0).stop 2024-05-09T00:05:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3492624378 shutdown_connections 2024-05-09T00:05:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3492624378 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f3df754100 0x55f3df756520 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3492624378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df740720 0x55f3df7446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd6affd700 0 client.16077 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3492624378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df73a890 0x55f3df743c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3492624378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73fe00 0x55f3df744160 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3492624378 >> 172.21.15.81:0/3492624378 conn(0x55f3df698210 msgr2=0x55f3df7345a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3492624378 shutdown_connections 2024-05-09T00:05:17.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.567+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3492624378 wait complete. 2024-05-09T00:05:17.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.568+0000 7fcd9e2f9b80 20 client.16077 trim_cache size 0 max 16384 2024-05-09T00:05:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.580+0000 7fcd9e2f9b80 1 Processor -- start 2024-05-09T00:05:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.580+0000 7fcd9e2f9b80 1 -- start start 2024-05-09T00:05:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd9e2f9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73a890 0x55f3df73f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd9e2f9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73fe00 0x55f3df734d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd9e2f9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df740720 0x55f3df7424f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd9e2f9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df709810 con 0x55f3df73fe00 2024-05-09T00:05:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd9e2f9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df5e3270 con 0x55f3df73a890 2024-05-09T00:05:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd9e2f9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df745180 con 0x55f3df740720 2024-05-09T00:05:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd8affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73fe00 0x55f3df734d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd8affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73fe00 0x55f3df734d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55076/0 (socket says 172.21.15.81:55076) 2024-05-09T00:05:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd8affd700 1 -- 172.21.15.81:0/3126919149 learned_addr learned my addr 172.21.15.81:0/3126919149 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd8b7fe700 1 --2- 172.21.15.81:0/3126919149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73a890 0x55f3df73f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd8bfff700 1 --2- 172.21.15.81:0/3126919149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df740720 0x55f3df7424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd8affd700 1 -- 172.21.15.81:0/3126919149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df740720 msgr2=0x55f3df7424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd8affd700 1 --2- 172.21.15.81:0/3126919149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df740720 0x55f3df7424f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd8affd700 1 -- 172.21.15.81:0/3126919149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73a890 msgr2=0x55f3df73f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd8affd700 1 --2- 172.21.15.81:0/3126919149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73a890 0x55f3df73f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd8affd700 1 -- 172.21.15.81:0/3126919149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3df650560 con 0x55f3df73fe00 2024-05-09T00:05:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd8b7fe700 1 --2- 172.21.15.81:0/3126919149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73a890 0x55f3df73f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd8affd700 1 --2- 172.21.15.81:0/3126919149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73fe00 0x55f3df734d20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcd8003d480 tx=0x7fcd80003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b3e37449661d21 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd727fc700 1 -- 172.21.15.81:0/3126919149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000fe80 con 0x55f3df73fe00 2024-05-09T00:05:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd727fc700 1 -- 172.21.15.81:0/3126919149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd8003d7f0 con 0x55f3df73fe00 2024-05-09T00:05:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.581+0000 7fcd727fc700 1 -- 172.21.15.81:0/3126919149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8002a6a0 con 0x55f3df73fe00 2024-05-09T00:05:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.582+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3126919149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73fe00 msgr2=0x55f3df734d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.582+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3126919149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73fe00 0x55f3df734d20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcd8003d480 tx=0x7fcd80003f30 comp rx=0 tx=0).stop 2024-05-09T00:05:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.582+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3126919149 shutdown_connections 2024-05-09T00:05:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.582+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3126919149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73a890 0x55f3df73f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.582+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3126919149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df740720 0x55f3df7424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.582+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3126919149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73fe00 0x55f3df734d20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.582+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3126919149 >> 172.21.15.81:0/3126919149 conn(0x55f3df698210 msgr2=0x55f3df73ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.582+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3126919149 shutdown_connections 2024-05-09T00:05:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.582+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3126919149 wait complete. 2024-05-09T00:05:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.582+0000 7fcd9e2f9b80 1 -- start start 2024-05-09T00:05:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.582+0000 7fcd9e2f9b80 1 Processor -- start 2024-05-09T00:05:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd9e2f9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73a890 0x55f3df74a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd9e2f9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73fe00 0x55f3df74a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd9e2f9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df740720 0x55f3df74ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd9e2f9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df7ada10 con 0x55f3df73a890 2024-05-09T00:05:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd9e2f9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df7adb50 con 0x55f3df73fe00 2024-05-09T00:05:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd9e2f9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3df7add10 con 0x55f3df740720 2024-05-09T00:05:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd9e2f9b80 10 client.0 _ll_register_callbacks cb 0x55f3df62fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd8b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73a890 0x55f3df74a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd8b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73a890 0x55f3df74a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55090/0 (socket says 172.21.15.81:55090) 2024-05-09T00:05:17.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd8b7fe700 1 -- 172.21.15.81:0/3750162663 learned_addr learned my addr 172.21.15.81:0/3750162663 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd8affd700 1 --2- 172.21.15.81:0/3750162663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73fe00 0x55f3df74a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd8bfff700 1 --2- 172.21.15.81:0/3750162663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df740720 0x55f3df74ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd8b7fe700 1 -- 172.21.15.81:0/3750162663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df740720 msgr2=0x55f3df74ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd8b7fe700 1 --2- 172.21.15.81:0/3750162663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df740720 0x55f3df74ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd8b7fe700 1 -- 172.21.15.81:0/3750162663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73fe00 msgr2=0x55f3df74a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd8b7fe700 1 --2- 172.21.15.81:0/3750162663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73fe00 0x55f3df74a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd8b7fe700 1 -- 172.21.15.81:0/3750162663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3df4b7b60 con 0x55f3df73a890 2024-05-09T00:05:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd8bfff700 1 --2- 172.21.15.81:0/3750162663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df740720 0x55f3df74ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd8b7fe700 1 --2- 172.21.15.81:0/3750162663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73a890 0x55f3df74a390 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c09af50 tx=0x7fcd7c0a11b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cf48911e108b62 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd6affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd6affd700 1 -- 172.21.15.81:0/3750162663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7c0a33b0 con 0x55f3df73a890 2024-05-09T00:05:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd6affd700 1 -- 172.21.15.81:0/3750162663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fcd7c099360 con 0x55f3df73a890 2024-05-09T00:05:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.583+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3750162663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd80003d40 con 0x55f3df73a890 2024-05-09T00:05:17.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.584+0000 7fcd6affd700 1 -- 172.21.15.81:0/3750162663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd7c019040 con 0x55f3df73a890 2024-05-09T00:05:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.584+0000 7fcd9e2f9b80 10 client.16083 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.584+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3750162663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f3df50fcd0 con 0x55f3df73a890 2024-05-09T00:05:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.584+0000 7fcd6affd700 1 -- 172.21.15.81:0/3750162663 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd7c0b7020 con 0x55f3df73a890 2024-05-09T00:05:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.584+0000 7fcd6affd700 1 -- 172.21.15.81:0/3750162663 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcd7c09a4b0 con 0x55f3df73a890 2024-05-09T00:05:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.584+0000 7fcd9e2f9b80 10 client.16083 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.584+0000 7fcd9e2f9b80 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.584+0000 7fcd9e2f9b80 20 client.16083 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.584+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3750162663 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f3df754100 0x55f3df7b1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.584+0000 7fcd9e2f9b80 4 client.16083 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:05:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.584+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3750162663 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f3df682ec0 con 0x55f3df754100 2024-05-09T00:05:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.584+0000 7fcd8affd700 1 --2- 172.21.15.81:0/3750162663 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f3df754100 0x55f3df7b1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.584+0000 7fcd6affd700 10 client.16083 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.584+0000 7fcd8affd700 1 --2- 172.21.15.81:0/3750162663 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f3df754100 0x55f3df7b1100 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b8f253eb7705f22 server_cookie=192930c1d9dbb98a in_seq=0 out_seq=0 2024-05-09T00:05:17.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd6affd700 1 -- 172.21.15.81:0/3750162663 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f3df682ec0 con 0x55f3df754100 2024-05-09T00:05:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd6affd700 10 client.16083 handle_command_reply: tid=0 2024-05-09T00:05:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9e2f9b80 1 client.16083 shutdown 2024-05-09T00:05:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3750162663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73a890 msgr2=0x55f3df74a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3750162663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73a890 0x55f3df74a390 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c09af50 tx=0x7fcd7c0a11b0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3750162663 shutdown_connections 2024-05-09T00:05:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3750162663 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f3df754100 0x55f3df7b1100 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3750162663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f3df740720 0x55f3df74ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3750162663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f3df73a890 0x55f3df74a390 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd6affd700 0 client.16083 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9e2f9b80 1 --2- 172.21.15.81:0/3750162663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f3df73fe00 0x55f3df74a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3750162663 >> 172.21.15.81:0/3750162663 conn(0x55f3df698210 msgr2=0x55f3df7424f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3750162663 shutdown_connections 2024-05-09T00:05:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9e2f9b80 1 -- 172.21.15.81:0/3750162663 wait complete. 2024-05-09T00:05:17.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9e2f9b80 20 client.16083 trim_cache size 0 max 16384 2024-05-09T00:05:17.591 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:05:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9213f700 1 -- 172.21.15.81:0/3875914059 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcd740a1290 msgr2=0x7fcd740a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9213f700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcd740a1290 0x7fcd740a3750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcd80005950 tx=0x7fcd800058e0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9213f700 1 -- 172.21.15.81:0/3875914059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c069740 msgr2=0x7fcd8c197390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.585+0000 7fcd9213f700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c069740 0x7fcd8c197390 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c00b580 tx=0x7fcd7c005e80 comp rx=0 tx=0).stop 2024-05-09T00:05:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.586+0000 7fcd9213f700 1 -- 172.21.15.81:0/3875914059 shutdown_connections 2024-05-09T00:05:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.586+0000 7fcd9213f700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcd740a1290 0x7fcd740a3750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.586+0000 7fcd9213f700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcd8c19bc70 0x7fcd8c19c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.586+0000 7fcd9213f700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c069740 0x7fcd8c197390 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.586+0000 7fcd9213f700 1 --2- 172.21.15.81:0/3875914059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcd8c1062a0 0x7fcd8c1978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.586+0000 7fcd9213f700 1 -- 172.21.15.81:0/3875914059 >> 172.21.15.81:0/3875914059 conn(0x7fcd8c076f70 msgr2=0x7fcd8c0fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.586+0000 7fcd9213f700 1 -- 172.21.15.81:0/3875914059 shutdown_connections 2024-05-09T00:05:17.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:17.586+0000 7fcd9213f700 1 -- 172.21.15.81:0/3875914059 wait complete. 2024-05-09T00:05:18.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:17 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/4091051092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:05:18.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:17 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/4091051092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:05:18.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:17 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/4091051092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:05:18.594 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:05:18.594 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:05:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.739+0000 7fba8694c700 1 -- 172.21.15.81:0/3103272733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba80105640 msgr2=0x7fba80105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.739+0000 7fba8694c700 1 --2- 172.21.15.81:0/3103272733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba80105640 0x7fba80105a20 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fba740099c0 tx=0x7fba74009cd0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.739+0000 7fba8694c700 1 -- 172.21.15.81:0/3103272733 shutdown_connections 2024-05-09T00:05:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.739+0000 7fba8694c700 1 --2- 172.21.15.81:0/3103272733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba800fff40 0x7fba8010c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.739+0000 7fba8694c700 1 --2- 172.21.15.81:0/3103272733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba80105640 0x7fba80105a20 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.739+0000 7fba8694c700 1 --2- 172.21.15.81:0/3103272733 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba800ff580 0x7fba800ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.739+0000 7fba8694c700 1 -- 172.21.15.81:0/3103272733 >> 172.21.15.81:0/3103272733 conn(0x7fba800763a0 msgr2=0x7fba800fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.739+0000 7fba8694c700 1 -- 172.21.15.81:0/3103272733 shutdown_connections 2024-05-09T00:05:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.739+0000 7fba8694c700 1 -- 172.21.15.81:0/3103272733 wait complete. 2024-05-09T00:05:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.739+0000 7fba8694c700 1 Processor -- start 2024-05-09T00:05:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba8694c700 1 -- start start 2024-05-09T00:05:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba8694c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba800ff580 0x7fba80196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba8694c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba800fff40 0x7fba801967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba8694c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba80105640 0x7fba8019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba8694c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8019b130 con 0x7fba800fff40 2024-05-09T00:05:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba8694c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8019b2a0 con 0x7fba80105640 2024-05-09T00:05:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba8694c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8019b460 con 0x7fba800ff580 2024-05-09T00:05:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba7f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba800fff40 0x7fba801967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba7ffff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba800ff580 0x7fba80196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba7f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba800fff40 0x7fba801967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55098/0 (socket says 172.21.15.81:55098) 2024-05-09T00:05:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba7f7fe700 1 -- 172.21.15.81:0/2026035913 learned_addr learned my addr 172.21.15.81:0/2026035913 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba7ffff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba800ff580 0x7fba80196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:55060/0 (socket says 172.21.15.81:55060) 2024-05-09T00:05:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba84ee9700 1 --2- 172.21.15.81:0/2026035913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba80105640 0x7fba8019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba7f7fe700 1 -- 172.21.15.81:0/2026035913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba800ff580 msgr2=0x7fba80196260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba7f7fe700 1 --2- 172.21.15.81:0/2026035913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba800ff580 0x7fba80196260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba7f7fe700 1 -- 172.21.15.81:0/2026035913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba80105640 msgr2=0x7fba8019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba7f7fe700 1 --2- 172.21.15.81:0/2026035913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba80105640 0x7fba8019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.740+0000 7fba7f7fe700 1 -- 172.21.15.81:0/2026035913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba740095f0 con 0x7fba800fff40 2024-05-09T00:05:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.741+0000 7fba7f7fe700 1 --2- 172.21.15.81:0/2026035913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba800fff40 0x7fba801967a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fba7000c920 tx=0x7fba7000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.741+0000 7fba7d7fa700 1 -- 172.21.15.81:0/2026035913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba70007b00 con 0x7fba800fff40 2024-05-09T00:05:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.741+0000 7fba8694c700 1 -- 172.21.15.81:0/2026035913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8019b740 con 0x7fba800fff40 2024-05-09T00:05:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.741+0000 7fba7d7fa700 1 -- 172.21.15.81:0/2026035913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba7000ce70 con 0x7fba800fff40 2024-05-09T00:05:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.741+0000 7fba7d7fa700 1 -- 172.21.15.81:0/2026035913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba70005460 con 0x7fba800fff40 2024-05-09T00:05:18.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.741+0000 7fba8694c700 1 -- 172.21.15.81:0/2026035913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba801a2f80 con 0x7fba800fff40 2024-05-09T00:05:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.743+0000 7fba7d7fa700 1 -- 172.21.15.81:0/2026035913 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fba70004750 con 0x7fba800fff40 2024-05-09T00:05:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.744+0000 7fba7d7fa700 1 --2- 172.21.15.81:0/2026035913 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fba680a1290 0x7fba680a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.744+0000 7fba7d7fa700 1 -- 172.21.15.81:0/2026035913 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fba700cc920 con 0x7fba800fff40 2024-05-09T00:05:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.744+0000 7fba7ffff700 1 --2- 172.21.15.81:0/2026035913 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fba680a1290 0x7fba680a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.744+0000 7fba92b06b80 1 Processor -- start 2024-05-09T00:05:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.744+0000 7fba92b06b80 1 -- start start 2024-05-09T00:05:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.744+0000 7fba7ffff700 1 --2- 172.21.15.81:0/2026035913 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fba680a1290 0x7fba680a3750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fba74009990 tx=0x7fba74005c60 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba92b06b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d922e80 0x55f92d923260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba92b06b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d9237a0 0x55f92d91d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba92b06b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d91d910 0x55f92d91dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba92b06b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f92d8741d0 con 0x55f92d91d910 2024-05-09T00:05:18.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba92b06b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f92d871b90 con 0x55f92d9237a0 2024-05-09T00:05:18.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba92b06b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f92d86d480 con 0x55f92d922e80 2024-05-09T00:05:18.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba84ee9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d91d910 0x55f92d91dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba84ee9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d91d910 0x55f92d91dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55104/0 (socket says 172.21.15.81:55104) 2024-05-09T00:05:18.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba84ee9700 1 -- 172.21.15.81:0/3866443618 learned_addr learned my addr 172.21.15.81:0/3866443618 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:18.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba7f7fe700 1 --2- 172.21.15.81:0/3866443618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d9237a0 0x55f92d91d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba7ffff700 1 --2- 172.21.15.81:0/3866443618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d922e80 0x55f92d923260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba84ee9700 1 -- 172.21.15.81:0/3866443618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d922e80 msgr2=0x55f92d923260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba84ee9700 1 --2- 172.21.15.81:0/3866443618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d922e80 0x55f92d923260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba84ee9700 1 -- 172.21.15.81:0/3866443618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d9237a0 msgr2=0x55f92d91d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba84ee9700 1 --2- 172.21.15.81:0/3866443618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d9237a0 0x55f92d91d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba84ee9700 1 -- 172.21.15.81:0/3866443618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f92d6ee430 con 0x55f92d91d910 2024-05-09T00:05:18.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba7f7fe700 1 --2- 172.21.15.81:0/3866443618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d9237a0 0x55f92d91d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:18.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba84ee9700 1 --2- 172.21.15.81:0/3866443618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d91d910 0x55f92d91dd50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fba78008550 tx=0x7fba78008860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8972c584f6427ffa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:18.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba667fc700 1 -- 172.21.15.81:0/3866443618 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78003c00 con 0x55f92d91d910 2024-05-09T00:05:18.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba667fc700 1 -- 172.21.15.81:0/3866443618 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba78010040 con 0x55f92d91d910 2024-05-09T00:05:18.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.745+0000 7fba667fc700 1 -- 172.21.15.81:0/3866443618 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78012760 con 0x55f92d91d910 2024-05-09T00:05:18.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.746+0000 7fba92b06b80 1 -- 172.21.15.81:0/3866443618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d91d910 msgr2=0x55f92d91dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.746+0000 7fba92b06b80 1 --2- 172.21.15.81:0/3866443618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d91d910 0x55f92d91dd50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fba78008550 tx=0x7fba78008860 comp rx=0 tx=0).stop 2024-05-09T00:05:18.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.746+0000 7fba92b06b80 1 -- 172.21.15.81:0/3866443618 shutdown_connections 2024-05-09T00:05:18.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.746+0000 7fba92b06b80 1 --2- 172.21.15.81:0/3866443618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d91d910 0x55f92d91dd50 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.746+0000 7fba92b06b80 1 --2- 172.21.15.81:0/3866443618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d922e80 0x55f92d923260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.746+0000 7fba92b06b80 1 --2- 172.21.15.81:0/3866443618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d9237a0 0x55f92d91d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.746+0000 7fba92b06b80 1 -- 172.21.15.81:0/3866443618 >> 172.21.15.81:0/3866443618 conn(0x55f92d87b290 msgr2=0x55f92d917e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:18.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.746+0000 7fba92b06b80 1 -- 172.21.15.81:0/3866443618 shutdown_connections 2024-05-09T00:05:18.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.746+0000 7fba92b06b80 1 -- 172.21.15.81:0/3866443618 wait complete. 2024-05-09T00:05:18.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.746+0000 7fba92b06b80 1 -- start start 2024-05-09T00:05:18.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba92b06b80 1 Processor -- start 2024-05-09T00:05:18.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba92b06b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d91d910 0x55f92d9297f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba92b06b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d922e80 0x55f92d926a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba92b06b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d9237a0 0x55f92d927160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba92b06b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f92d8095e0 con 0x55f92d922e80 2024-05-09T00:05:18.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba92b06b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f92d809280 con 0x55f92d91d910 2024-05-09T00:05:18.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba92b06b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f92d6f0720 con 0x55f92d9237a0 2024-05-09T00:05:18.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba92b06b80 10 client.0 _ll_register_callbacks cb 0x55f92d812bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:18.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba7f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d922e80 0x55f92d926a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba7f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d922e80 0x55f92d926a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55106/0 (socket says 172.21.15.81:55106) 2024-05-09T00:05:18.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba7f7fe700 1 -- 172.21.15.81:0/3137482222 learned_addr learned my addr 172.21.15.81:0/3137482222 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:18.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba7ffff700 1 --2- 172.21.15.81:0/3137482222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d91d910 0x55f92d9297f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba84ee9700 1 --2- 172.21.15.81:0/3137482222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d9237a0 0x55f92d927160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba7f7fe700 1 -- 172.21.15.81:0/3137482222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d9237a0 msgr2=0x55f92d927160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba7f7fe700 1 --2- 172.21.15.81:0/3137482222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d9237a0 0x55f92d927160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba7f7fe700 1 -- 172.21.15.81:0/3137482222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d91d910 msgr2=0x55f92d9297f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba7f7fe700 1 --2- 172.21.15.81:0/3137482222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d91d910 0x55f92d9297f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba7f7fe700 1 -- 172.21.15.81:0/3137482222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba78007d90 con 0x55f92d922e80 2024-05-09T00:05:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.747+0000 7fba7ffff700 1 --2- 172.21.15.81:0/3137482222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d91d910 0x55f92d9297f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba7f7fe700 1 --2- 172.21.15.81:0/3137482222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d922e80 0x55f92d926a70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fba70099730 tx=0x7fba70099620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba847f95b7a3b1d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba5f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba5f7fe700 1 -- 172.21.15.81:0/3137482222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba700b1070 con 0x55f92d922e80 2024-05-09T00:05:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba5f7fe700 1 -- 172.21.15.81:0/3137482222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fba7009d860 con 0x55f92d922e80 2024-05-09T00:05:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba92b06b80 1 -- 172.21.15.81:0/3137482222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f92d7c62f0 con 0x55f92d922e80 2024-05-09T00:05:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba5f7fe700 1 -- 172.21.15.81:0/3137482222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba700a1eb0 con 0x55f92d922e80 2024-05-09T00:05:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba92b06b80 10 client.16095 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba92b06b80 1 -- 172.21.15.81:0/3137482222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f92d69abe0 con 0x55f92d922e80 2024-05-09T00:05:18.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba5f7fe700 1 -- 172.21.15.81:0/3137482222 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba70063020 con 0x55f92d922e80 2024-05-09T00:05:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba5f7fe700 1 -- 172.21.15.81:0/3137482222 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fba70098f20 con 0x55f92d922e80 2024-05-09T00:05:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba92b06b80 10 client.16095 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba92b06b80 10 client.16095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba92b06b80 20 client.16095 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba92b06b80 1 --2- 172.21.15.81:0/3137482222 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f92d936fd0 0x55f92d9393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba92b06b80 4 client.16095 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.748+0000 7fba92b06b80 1 -- 172.21.15.81:0/3137482222 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f92d8ec890 con 0x55f92d936fd0 2024-05-09T00:05:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.749+0000 7fba7ffff700 1 --2- 172.21.15.81:0/3137482222 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f92d936fd0 0x55f92d9393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.749+0000 7fba7ffff700 1 --2- 172.21.15.81:0/3137482222 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f92d936fd0 0x55f92d9393f0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c96ad641e4a5498 server_cookie=deb982474f4db41e in_seq=0 out_seq=0 2024-05-09T00:05:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.749+0000 7fba5f7fe700 10 client.16095 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.749+0000 7fba5f7fe700 1 -- 172.21.15.81:0/3137482222 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f92d8ec890 con 0x55f92d936fd0 2024-05-09T00:05:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.749+0000 7fba5f7fe700 10 client.16095 handle_command_reply: tid=0 2024-05-09T00:05:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.750+0000 7fba92b06b80 1 client.16095 shutdown 2024-05-09T00:05:18.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.750+0000 7fba92b06b80 1 -- 172.21.15.81:0/3137482222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d922e80 msgr2=0x55f92d926a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.750+0000 7fba92b06b80 1 --2- 172.21.15.81:0/3137482222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d922e80 0x55f92d926a70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fba70099730 tx=0x7fba70099620 comp rx=0 tx=0).stop 2024-05-09T00:05:18.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.750+0000 7fba92b06b80 1 -- 172.21.15.81:0/3137482222 shutdown_connections 2024-05-09T00:05:18.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.750+0000 7fba92b06b80 1 --2- 172.21.15.81:0/3137482222 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f92d936fd0 0x55f92d9393f0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.750+0000 7fba92b06b80 1 --2- 172.21.15.81:0/3137482222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d91d910 0x55f92d9297f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.750+0000 7fba5f7fe700 0 client.16095 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:18.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.750+0000 7fba92b06b80 1 --2- 172.21.15.81:0/3137482222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d9237a0 0x55f92d927160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.750+0000 7fba92b06b80 1 --2- 172.21.15.81:0/3137482222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d922e80 0x55f92d926a70 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.750+0000 7fba92b06b80 1 -- 172.21.15.81:0/3137482222 >> 172.21.15.81:0/3137482222 conn(0x55f92d87b290 msgr2=0x55f92d917620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:18.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.750+0000 7fba92b06b80 1 -- 172.21.15.81:0/3137482222 shutdown_connections 2024-05-09T00:05:18.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.750+0000 7fba92b06b80 1 -- 172.21.15.81:0/3137482222 wait complete. 2024-05-09T00:05:18.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.750+0000 7fba92b06b80 20 client.16095 trim_cache size 0 max 16384 2024-05-09T00:05:18.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.767+0000 7fba92b06b80 1 Processor -- start 2024-05-09T00:05:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.767+0000 7fba92b06b80 1 -- start start 2024-05-09T00:05:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.767+0000 7fba92b06b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d91d910 0x55f92d917da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.767+0000 7fba92b06b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d922e80 0x55f92d922270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.767+0000 7fba92b06b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d9237a0 0x55f92d92e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.767+0000 7fba92b06b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f92d928110 con 0x55f92d922e80 2024-05-09T00:05:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.767+0000 7fba92b06b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f92d93e670 con 0x55f92d9237a0 2024-05-09T00:05:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.767+0000 7fba92b06b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f92d923290 con 0x55f92d91d910 2024-05-09T00:05:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.768+0000 7fba7f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d922e80 0x55f92d922270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.768+0000 7fba7f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d922e80 0x55f92d922270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55110/0 (socket says 172.21.15.81:55110) 2024-05-09T00:05:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.768+0000 7fba7f7fe700 1 -- 172.21.15.81:0/1983931774 learned_addr learned my addr 172.21.15.81:0/1983931774 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.768+0000 7fba7ffff700 1 --2- 172.21.15.81:0/1983931774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d91d910 0x55f92d917da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.768+0000 7fba84ee9700 1 --2- 172.21.15.81:0/1983931774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d9237a0 0x55f92d92e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.768+0000 7fba7f7fe700 1 -- 172.21.15.81:0/1983931774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d91d910 msgr2=0x55f92d917da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.768+0000 7fba7f7fe700 1 --2- 172.21.15.81:0/1983931774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d91d910 0x55f92d917da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.768+0000 7fba7f7fe700 1 -- 172.21.15.81:0/1983931774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d9237a0 msgr2=0x55f92d92e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.768+0000 7fba7f7fe700 1 --2- 172.21.15.81:0/1983931774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d9237a0 0x55f92d92e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.768+0000 7fba7f7fe700 1 -- 172.21.15.81:0/1983931774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f92d914560 con 0x55f92d922e80 2024-05-09T00:05:18.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.768+0000 7fba7f7fe700 1 --2- 172.21.15.81:0/1983931774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d922e80 0x55f92d922270 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fba700a1980 tx=0x7fba70000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb28e4dc06f188d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:18.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.768+0000 7fba66ffd700 1 -- 172.21.15.81:0/1983931774 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba700b1070 con 0x55f92d922e80 2024-05-09T00:05:18.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.768+0000 7fba66ffd700 1 -- 172.21.15.81:0/1983931774 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba70063030 con 0x55f92d922e80 2024-05-09T00:05:18.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.768+0000 7fba66ffd700 1 -- 172.21.15.81:0/1983931774 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba700652c0 con 0x55f92d922e80 2024-05-09T00:05:18.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.769+0000 7fba92b06b80 1 -- 172.21.15.81:0/1983931774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d922e80 msgr2=0x55f92d922270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.769+0000 7fba92b06b80 1 --2- 172.21.15.81:0/1983931774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d922e80 0x55f92d922270 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fba700a1980 tx=0x7fba70000bc0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.769+0000 7fba92b06b80 1 -- 172.21.15.81:0/1983931774 shutdown_connections 2024-05-09T00:05:18.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.769+0000 7fba92b06b80 1 --2- 172.21.15.81:0/1983931774 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d9237a0 0x55f92d92e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.769+0000 7fba92b06b80 1 --2- 172.21.15.81:0/1983931774 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d91d910 0x55f92d917da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.769+0000 7fba92b06b80 1 --2- 172.21.15.81:0/1983931774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d922e80 0x55f92d922270 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.769+0000 7fba92b06b80 1 -- 172.21.15.81:0/1983931774 >> 172.21.15.81:0/1983931774 conn(0x55f92d87b290 msgr2=0x55f92d921b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:18.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.769+0000 7fba92b06b80 1 -- 172.21.15.81:0/1983931774 shutdown_connections 2024-05-09T00:05:18.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.769+0000 7fba92b06b80 1 -- 172.21.15.81:0/1983931774 wait complete. 2024-05-09T00:05:18.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.769+0000 7fba92b06b80 1 -- start start 2024-05-09T00:05:18.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.769+0000 7fba92b06b80 1 Processor -- start 2024-05-09T00:05:18.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba92b06b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d91d910 0x55f92d920230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba92b06b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d922e80 0x55f92d91ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba92b06b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d9237a0 0x55f92d91efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba92b06b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f92d91f6b0 con 0x55f92d9237a0 2024-05-09T00:05:18.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba92b06b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f92d91f820 con 0x55f92d91d910 2024-05-09T00:05:18.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba92b06b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f92d98f530 con 0x55f92d922e80 2024-05-09T00:05:18.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba92b06b80 10 client.0 _ll_register_callbacks cb 0x55f92d812bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:18.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba84ee9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d9237a0 0x55f92d91efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba84ee9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d9237a0 0x55f92d91efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55114/0 (socket says 172.21.15.81:55114) 2024-05-09T00:05:18.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba84ee9700 1 -- 172.21.15.81:0/84649254 learned_addr learned my addr 172.21.15.81:0/84649254 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:18.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba7f7fe700 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d922e80 0x55f92d91ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba7ffff700 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d91d910 0x55f92d920230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba84ee9700 1 -- 172.21.15.81:0/84649254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d922e80 msgr2=0x55f92d91ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba84ee9700 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d922e80 0x55f92d91ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba84ee9700 1 -- 172.21.15.81:0/84649254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d91d910 msgr2=0x55f92d920230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba84ee9700 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d91d910 0x55f92d920230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba84ee9700 1 -- 172.21.15.81:0/84649254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f92d69abe0 con 0x55f92d9237a0 2024-05-09T00:05:18.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba7ffff700 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d91d910 0x55f92d920230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:18.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba7f7fe700 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d922e80 0x55f92d91ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba84ee9700 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d9237a0 0x55f92d91efa0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fba78008550 tx=0x7fba78012cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2c072342645a02 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba5f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba5f7fe700 1 -- 172.21.15.81:0/84649254 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78007c10 con 0x55f92d9237a0 2024-05-09T00:05:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba5f7fe700 1 -- 172.21.15.81:0/84649254 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fba7800d070 con 0x55f92d9237a0 2024-05-09T00:05:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.770+0000 7fba92b06b80 1 -- 172.21.15.81:0/84649254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fba78010040 con 0x55f92d9237a0 2024-05-09T00:05:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.771+0000 7fba5f7fe700 1 -- 172.21.15.81:0/84649254 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba78004a90 con 0x55f92d9237a0 2024-05-09T00:05:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.771+0000 7fba92b06b80 10 client.16101 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.771+0000 7fba92b06b80 1 -- 172.21.15.81:0/84649254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f92d8335e0 con 0x55f92d9237a0 2024-05-09T00:05:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.771+0000 7fba5f7fe700 1 -- 172.21.15.81:0/84649254 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba78010040 con 0x55f92d9237a0 2024-05-09T00:05:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.771+0000 7fba5f7fe700 1 -- 172.21.15.81:0/84649254 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fba7801c070 con 0x55f92d9237a0 2024-05-09T00:05:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.771+0000 7fba92b06b80 10 client.16101 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.771+0000 7fba92b06b80 10 client.16101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.771+0000 7fba92b06b80 20 client.16101 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:18.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.771+0000 7fba92b06b80 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f92d990d00 0x55f92d993120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.771+0000 7fba92b06b80 4 client.16101 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:05:18.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.771+0000 7fba92b06b80 1 -- 172.21.15.81:0/84649254 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f92d865f40 con 0x55f92d990d00 2024-05-09T00:05:18.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.771+0000 7fba7ffff700 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f92d990d00 0x55f92d993120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.771+0000 7fba7ffff700 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f92d990d00 0x55f92d993120 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8afefa0227a5a4b2 server_cookie=2bc5148d007cc7f4 in_seq=0 out_seq=0 2024-05-09T00:05:18.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.771+0000 7fba5f7fe700 10 client.16101 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.772+0000 7fba5f7fe700 1 -- 172.21.15.81:0/84649254 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f92d865f40 con 0x55f92d990d00 2024-05-09T00:05:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.772+0000 7fba5f7fe700 10 client.16101 handle_command_reply: tid=0 2024-05-09T00:05:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba92b06b80 1 client.16101 shutdown 2024-05-09T00:05:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba92b06b80 1 -- 172.21.15.81:0/84649254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d9237a0 msgr2=0x55f92d91efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba92b06b80 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d9237a0 0x55f92d91efa0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fba78008550 tx=0x7fba78012cc0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba92b06b80 1 -- 172.21.15.81:0/84649254 shutdown_connections 2024-05-09T00:05:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba92b06b80 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f92d990d00 0x55f92d993120 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba92b06b80 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f92d91d910 0x55f92d920230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba92b06b80 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f92d9237a0 0x55f92d91efa0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba5f7fe700 0 client.16101 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba92b06b80 1 --2- 172.21.15.81:0/84649254 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f92d922e80 0x55f92d91ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba92b06b80 1 -- 172.21.15.81:0/84649254 >> 172.21.15.81:0/84649254 conn(0x55f92d87b290 msgr2=0x55f92d925340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba92b06b80 1 -- 172.21.15.81:0/84649254 shutdown_connections 2024-05-09T00:05:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba92b06b80 1 -- 172.21.15.81:0/84649254 wait complete. 2024-05-09T00:05:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba92b06b80 20 client.16101 trim_cache size 0 max 16384 2024-05-09T00:05:18.774 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:05:18.775 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:05:18.775 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "5bef5b7f-5de9-44b4-ab56-329a6b409b85", 2024-05-09T00:05:18.775 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:05:18.775 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:05:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba8694c700 1 -- 172.21.15.81:0/2026035913 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fba680a1290 msgr2=0x7fba680a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba8694c700 1 --2- 172.21.15.81:0/2026035913 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fba680a1290 0x7fba680a3750 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fba74009990 tx=0x7fba74005c60 comp rx=0 tx=0).stop 2024-05-09T00:05:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba8694c700 1 -- 172.21.15.81:0/2026035913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba800fff40 msgr2=0x7fba801967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.773+0000 7fba8694c700 1 --2- 172.21.15.81:0/2026035913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba800fff40 0x7fba801967a0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fba7000c920 tx=0x7fba7000cc30 comp rx=0 tx=0).stop 2024-05-09T00:05:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.774+0000 7fba8694c700 1 -- 172.21.15.81:0/2026035913 shutdown_connections 2024-05-09T00:05:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.774+0000 7fba8694c700 1 --2- 172.21.15.81:0/2026035913 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fba680a1290 0x7fba680a3750 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.774+0000 7fba8694c700 1 --2- 172.21.15.81:0/2026035913 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fba80105640 0x7fba8019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.774+0000 7fba8694c700 1 --2- 172.21.15.81:0/2026035913 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba800ff580 0x7fba80196260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.774+0000 7fba8694c700 1 --2- 172.21.15.81:0/2026035913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba800fff40 0x7fba801967a0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.774+0000 7fba8694c700 1 -- 172.21.15.81:0/2026035913 >> 172.21.15.81:0/2026035913 conn(0x7fba800763a0 msgr2=0x7fba80103130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.774+0000 7fba8694c700 1 -- 172.21.15.81:0/2026035913 shutdown_connections 2024-05-09T00:05:18.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.774+0000 7fba8694c700 1 -- 172.21.15.81:0/2026035913 wait complete. 2024-05-09T00:05:18.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:05:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.910+0000 7f942778c700 1 -- 172.21.15.81:0/3063910955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9420100ab0 msgr2=0x7f942010ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.910+0000 7f942778c700 1 --2- 172.21.15.81:0/3063910955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9420100ab0 0x7f942010ccc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f941800b0d0 tx=0x7f941800b3e0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.910+0000 7f942778c700 1 -- 172.21.15.81:0/3063910955 shutdown_connections 2024-05-09T00:05:18.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.910+0000 7f942778c700 1 --2- 172.21.15.81:0/3063910955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9420100ab0 0x7f942010ccc0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.910+0000 7f942778c700 1 --2- 172.21.15.81:0/3063910955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9420105f90 0x7f9420106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.910+0000 7f942778c700 1 --2- 172.21.15.81:0/3063910955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94201000f0 0x7f9420100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.910+0000 7f942778c700 1 -- 172.21.15.81:0/3063910955 >> 172.21.15.81:0/3063910955 conn(0x7f9420076ba0 msgr2=0x7f9420076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.910+0000 7f942778c700 1 -- 172.21.15.81:0/3063910955 shutdown_connections 2024-05-09T00:05:18.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.910+0000 7f942778c700 1 -- 172.21.15.81:0/3063910955 wait complete. 2024-05-09T00:05:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.910+0000 7f942778c700 1 Processor -- start 2024-05-09T00:05:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f942778c700 1 -- start start 2024-05-09T00:05:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f942778c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94201000f0 0x7f9420197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f942778c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9420100ab0 0x7f94201979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f942778c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9420105f90 0x7f942019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f942778c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942019c350 con 0x7f9420105f90 2024-05-09T00:05:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f942778c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942019c4c0 con 0x7f9420100ab0 2024-05-09T00:05:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f942778c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942019c680 con 0x7f94201000f0 2024-05-09T00:05:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f9425d29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9420105f90 0x7f942019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f9425d29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9420105f90 0x7f942019bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55136/0 (socket says 172.21.15.81:55136) 2024-05-09T00:05:18.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f9425d29700 1 -- 172.21.15.81:0/86822125 learned_addr learned my addr 172.21.15.81:0/86822125 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:18.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f9425528700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94201000f0 0x7f9420197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f9424d27700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9420100ab0 0x7f94201979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f9425d29700 1 -- 172.21.15.81:0/86822125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94201000f0 msgr2=0x7f9420197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f9425d29700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94201000f0 0x7f9420197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f9425d29700 1 -- 172.21.15.81:0/86822125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9420100ab0 msgr2=0x7f94201979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f9425d29700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9420100ab0 0x7f94201979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f9425d29700 1 -- 172.21.15.81:0/86822125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9418009d00 con 0x7f9420105f90 2024-05-09T00:05:18.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f9424d27700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9420100ab0 0x7f94201979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:18.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f9425d29700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9420105f90 0x7f942019bd10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f94180094c0 tx=0x7f94180094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:18.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f94167fc700 1 -- 172.21.15.81:0/86822125 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941800e040 con 0x7f9420105f90 2024-05-09T00:05:18.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f94167fc700 1 -- 172.21.15.81:0/86822125 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f941801d940 con 0x7f9420105f90 2024-05-09T00:05:18.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.911+0000 7f942778c700 1 -- 172.21.15.81:0/86822125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942019c900 con 0x7f9420105f90 2024-05-09T00:05:18.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.912+0000 7f94167fc700 1 -- 172.21.15.81:0/86822125 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941801b9e0 con 0x7f9420105f90 2024-05-09T00:05:18.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.912+0000 7f942778c700 1 -- 172.21.15.81:0/86822125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94201a41a0 con 0x7f9420105f90 2024-05-09T00:05:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.914+0000 7f94167fc700 1 -- 172.21.15.81:0/86822125 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f941801d480 con 0x7f9420105f90 2024-05-09T00:05:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.914+0000 7f94167fc700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f940c0a1290 0x7f940c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.914+0000 7f94167fc700 1 -- 172.21.15.81:0/86822125 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f94180ce530 con 0x7f9420105f90 2024-05-09T00:05:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.914+0000 7f9425528700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f940c0a1290 0x7f940c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.915+0000 7f9425528700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f940c0a1290 0x7f940c0a3750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9420067bb0 tx=0x7f941000a380 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.915+0000 7f9433946b80 1 Processor -- start 2024-05-09T00:05:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.915+0000 7f9433946b80 1 -- start start 2024-05-09T00:05:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.915+0000 7f9433946b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58f0e00 0x5576c58f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.915+0000 7f9433946b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f1720 0x5576c58eb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.915+0000 7f9433946b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58eb890 0x5576c58ebcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9433946b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c5842150 con 0x5576c58eb890 2024-05-09T00:05:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9433946b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c583fb10 con 0x5576c58f0e00 2024-05-09T00:05:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9433946b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c583b400 con 0x5576c58f1720 2024-05-09T00:05:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9425d29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58eb890 0x5576c58ebcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9425d29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58eb890 0x5576c58ebcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55148/0 (socket says 172.21.15.81:55148) 2024-05-09T00:05:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9425d29700 1 -- 172.21.15.81:0/2094115476 learned_addr learned my addr 172.21.15.81:0/2094115476 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9425528700 1 --2- 172.21.15.81:0/2094115476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58f0e00 0x5576c58f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9424d27700 1 --2- 172.21.15.81:0/2094115476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f1720 0x5576c58eb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9425d29700 1 -- 172.21.15.81:0/2094115476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f1720 msgr2=0x5576c58eb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9425d29700 1 --2- 172.21.15.81:0/2094115476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f1720 0x5576c58eb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9425d29700 1 -- 172.21.15.81:0/2094115476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58f0e00 msgr2=0x5576c58f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9425d29700 1 --2- 172.21.15.81:0/2094115476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58f0e00 0x5576c58f11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9425d29700 1 -- 172.21.15.81:0/2094115476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576c56bc3b0 con 0x5576c58eb890 2024-05-09T00:05:18.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9424d27700 1 --2- 172.21.15.81:0/2094115476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f1720 0x5576c58eb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:18.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f9425d29700 1 --2- 172.21.15.81:0/2094115476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58eb890 0x5576c58ebcd0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9418098140 tx=0x7f94180099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf8b91c2e9f250bf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:18.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.916+0000 7f940b7fe700 1 -- 172.21.15.81:0/2094115476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180bb0b0 con 0x5576c58eb890 2024-05-09T00:05:18.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.917+0000 7f940b7fe700 1 -- 172.21.15.81:0/2094115476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f941809b6d0 con 0x5576c58eb890 2024-05-09T00:05:18.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.917+0000 7f940b7fe700 1 -- 172.21.15.81:0/2094115476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9418099b00 con 0x5576c58eb890 2024-05-09T00:05:18.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.917+0000 7f9433946b80 1 -- 172.21.15.81:0/2094115476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58eb890 msgr2=0x5576c58ebcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.917+0000 7f9433946b80 1 --2- 172.21.15.81:0/2094115476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58eb890 0x5576c58ebcd0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9418098140 tx=0x7f94180099e0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.917+0000 7f9433946b80 1 -- 172.21.15.81:0/2094115476 shutdown_connections 2024-05-09T00:05:18.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.917+0000 7f9433946b80 1 --2- 172.21.15.81:0/2094115476 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58f0e00 0x5576c58f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.917+0000 7f9433946b80 1 --2- 172.21.15.81:0/2094115476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58eb890 0x5576c58ebcd0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.917+0000 7f9433946b80 1 --2- 172.21.15.81:0/2094115476 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f1720 0x5576c58eb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.917+0000 7f9433946b80 1 -- 172.21.15.81:0/2094115476 >> 172.21.15.81:0/2094115476 conn(0x5576c5849210 msgr2=0x5576c58e5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:18.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.917+0000 7f9433946b80 1 -- 172.21.15.81:0/2094115476 shutdown_connections 2024-05-09T00:05:18.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.917+0000 7f9433946b80 1 -- 172.21.15.81:0/2094115476 wait complete. 2024-05-09T00:05:18.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.918+0000 7f9433946b80 1 -- start start 2024-05-09T00:05:18.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.918+0000 7f9433946b80 1 Processor -- start 2024-05-09T00:05:18.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.918+0000 7f9433946b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58eb890 0x5576c58f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.918+0000 7f9433946b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f0e00 0x5576c58f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.918+0000 7f9433946b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f1720 0x5576c58f5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.918+0000 7f9433946b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c57d7560 con 0x5576c58f1720 2024-05-09T00:05:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.918+0000 7f9433946b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c57d7200 con 0x5576c58eb890 2024-05-09T00:05:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.918+0000 7f9433946b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c56be6a0 con 0x5576c58f0e00 2024-05-09T00:05:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.918+0000 7f9433946b80 10 client.0 _ll_register_callbacks cb 0x5576c57e0b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.918+0000 7f9425d29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f1720 0x5576c58f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.918+0000 7f9425d29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f1720 0x5576c58f5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55162/0 (socket says 172.21.15.81:55162) 2024-05-09T00:05:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.918+0000 7f9425d29700 1 -- 172.21.15.81:0/1481268519 learned_addr learned my addr 172.21.15.81:0/1481268519 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.918+0000 7f9425528700 1 --2- 172.21.15.81:0/1481268519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58eb890 0x5576c58f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.918+0000 7f9424d27700 1 --2- 172.21.15.81:0/1481268519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f0e00 0x5576c58f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9425d29700 1 -- 172.21.15.81:0/1481268519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f0e00 msgr2=0x5576c58f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9425d29700 1 --2- 172.21.15.81:0/1481268519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f0e00 0x5576c58f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9425d29700 1 -- 172.21.15.81:0/1481268519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58eb890 msgr2=0x5576c58f76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9425d29700 1 --2- 172.21.15.81:0/1481268519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58eb890 0x5576c58f76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9425d29700 1 -- 172.21.15.81:0/1481268519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94201a41a0 con 0x5576c58f1720 2024-05-09T00:05:18.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9425d29700 1 --2- 172.21.15.81:0/1481268519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f1720 0x5576c58f5280 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f94180cc240 tx=0x7f941809f500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b967d244389ea0ac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:18.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9408ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:18.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9408ff9700 1 -- 172.21.15.81:0/1481268519 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180bb040 con 0x5576c58f1720 2024-05-09T00:05:18.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9408ff9700 1 -- 172.21.15.81:0/1481268519 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f941801dd40 con 0x5576c58f1720 2024-05-09T00:05:18.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9433946b80 1 -- 172.21.15.81:0/1481268519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5576c5794270 con 0x5576c58f1720 2024-05-09T00:05:18.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9408ff9700 1 -- 172.21.15.81:0/1481268519 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9418097de0 con 0x5576c58f1720 2024-05-09T00:05:18.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9433946b80 10 client.16113 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:18.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9433946b80 1 -- 172.21.15.81:0/1481268519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5576c5668b60 con 0x5576c58f1720 2024-05-09T00:05:18.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9408ff9700 1 -- 172.21.15.81:0/1481268519 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5576c5794270 con 0x5576c58f1720 2024-05-09T00:05:18.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9408ff9700 1 -- 172.21.15.81:0/1481268519 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f941809b930 con 0x5576c58f1720 2024-05-09T00:05:18.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9433946b80 10 client.16113 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:18.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9433946b80 10 client.16113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9433946b80 20 client.16113 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9433946b80 1 --2- 172.21.15.81:0/1481268519 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5576c5904a60 0x5576c5906e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9433946b80 4 client.16113 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.919+0000 7f9433946b80 1 -- 172.21.15.81:0/1481268519 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5576c58ba810 con 0x5576c5904a60 2024-05-09T00:05:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.920+0000 7f9425528700 1 --2- 172.21.15.81:0/1481268519 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5576c5904a60 0x5576c5906e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.920+0000 7f9408ff9700 10 client.16113 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.920+0000 7f9425528700 1 --2- 172.21.15.81:0/1481268519 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5576c5904a60 0x5576c5906e50 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33dc7d83d1f78ca7 server_cookie=d67272a08dc0b05a in_seq=0 out_seq=0 2024-05-09T00:05:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9408ff9700 1 -- 172.21.15.81:0/1481268519 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5576c58ba810 con 0x5576c5904a60 2024-05-09T00:05:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9408ff9700 10 client.16113 handle_command_reply: tid=0 2024-05-09T00:05:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9433946b80 1 client.16113 shutdown 2024-05-09T00:05:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9433946b80 1 -- 172.21.15.81:0/1481268519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f1720 msgr2=0x5576c58f5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9433946b80 1 --2- 172.21.15.81:0/1481268519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f1720 0x5576c58f5280 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f94180cc240 tx=0x7f941809f500 comp rx=0 tx=0).stop 2024-05-09T00:05:18.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9433946b80 1 -- 172.21.15.81:0/1481268519 shutdown_connections 2024-05-09T00:05:18.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9433946b80 1 --2- 172.21.15.81:0/1481268519 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5576c5904a60 0x5576c5906e50 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9433946b80 1 --2- 172.21.15.81:0/1481268519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58eb890 0x5576c58f76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9433946b80 1 --2- 172.21.15.81:0/1481268519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f1720 0x5576c58f5280 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9433946b80 1 --2- 172.21.15.81:0/1481268519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f0e00 0x5576c58f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9408ff9700 0 client.16113 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:18.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9433946b80 1 -- 172.21.15.81:0/1481268519 >> 172.21.15.81:0/1481268519 conn(0x5576c5849210 msgr2=0x5576c58e55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:18.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9433946b80 1 -- 172.21.15.81:0/1481268519 shutdown_connections 2024-05-09T00:05:18.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9433946b80 1 -- 172.21.15.81:0/1481268519 wait complete. 2024-05-09T00:05:18.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.921+0000 7f9433946b80 20 client.16113 trim_cache size 0 max 16384 2024-05-09T00:05:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.938+0000 7f9433946b80 1 Processor -- start 2024-05-09T00:05:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.938+0000 7f9433946b80 1 -- start start 2024-05-09T00:05:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.938+0000 7f9433946b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58eb890 0x5576c58eb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9433946b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f0e00 0x5576c58f0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9433946b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58f1720 0x5576c58e5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9433946b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c58f5ac0 con 0x5576c58f0e00 2024-05-09T00:05:18.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9433946b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c58e2dc0 con 0x5576c58f1720 2024-05-09T00:05:18.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9433946b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c58e7e50 con 0x5576c58eb890 2024-05-09T00:05:18.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9424d27700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f0e00 0x5576c58f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9424d27700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f0e00 0x5576c58f0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55174/0 (socket says 172.21.15.81:55174) 2024-05-09T00:05:18.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9424d27700 1 -- 172.21.15.81:0/96946130 learned_addr learned my addr 172.21.15.81:0/96946130 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:18.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9425d29700 1 --2- 172.21.15.81:0/96946130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58f1720 0x5576c58e5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9425528700 1 --2- 172.21.15.81:0/96946130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58eb890 0x5576c58eb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9424d27700 1 -- 172.21.15.81:0/96946130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58eb890 msgr2=0x5576c58eb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9424d27700 1 --2- 172.21.15.81:0/96946130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58eb890 0x5576c58eb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9424d27700 1 -- 172.21.15.81:0/96946130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58f1720 msgr2=0x5576c58e5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9424d27700 1 --2- 172.21.15.81:0/96946130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58f1720 0x5576c58e5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9424d27700 1 -- 172.21.15.81:0/96946130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576c5801560 con 0x5576c58f0e00 2024-05-09T00:05:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f9424d27700 1 --2- 172.21.15.81:0/96946130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f0e00 0x5576c58f0340 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9420198980 tx=0x7f941c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65cb8cb09600384 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f940bfff700 1 -- 172.21.15.81:0/96946130 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c011c70 con 0x5576c58f0e00 2024-05-09T00:05:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f940bfff700 1 -- 172.21.15.81:0/96946130 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f941c016070 con 0x5576c58f0e00 2024-05-09T00:05:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.939+0000 7f940bfff700 1 -- 172.21.15.81:0/96946130 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c01a6c0 con 0x5576c58f0e00 2024-05-09T00:05:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.940+0000 7f9433946b80 1 -- 172.21.15.81:0/96946130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f0e00 msgr2=0x5576c58f0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.940+0000 7f9433946b80 1 --2- 172.21.15.81:0/96946130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f0e00 0x5576c58f0340 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9420198980 tx=0x7f941c009f60 comp rx=0 tx=0).stop 2024-05-09T00:05:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.940+0000 7f9433946b80 1 -- 172.21.15.81:0/96946130 shutdown_connections 2024-05-09T00:05:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.940+0000 7f9433946b80 1 --2- 172.21.15.81:0/96946130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58f1720 0x5576c58e5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.940+0000 7f9433946b80 1 --2- 172.21.15.81:0/96946130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58eb890 0x5576c58eb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.940+0000 7f9433946b80 1 --2- 172.21.15.81:0/96946130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f0e00 0x5576c58f0340 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.940+0000 7f9433946b80 1 -- 172.21.15.81:0/96946130 >> 172.21.15.81:0/96946130 conn(0x5576c5849210 msgr2=0x5576c58efc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.940+0000 7f9433946b80 1 -- 172.21.15.81:0/96946130 shutdown_connections 2024-05-09T00:05:18.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.940+0000 7f9433946b80 1 -- 172.21.15.81:0/96946130 wait complete. 2024-05-09T00:05:18.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.940+0000 7f9433946b80 1 -- start start 2024-05-09T00:05:18.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.940+0000 7f9433946b80 1 Processor -- start 2024-05-09T00:05:18.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9433946b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58eb890 0x5576c58faa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9433946b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f0e00 0x5576c58faf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9433946b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f1720 0x5576c58fb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9433946b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c595af00 con 0x5576c58f1720 2024-05-09T00:05:18.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9433946b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c595b040 con 0x5576c58eb890 2024-05-09T00:05:18.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9433946b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576c595b1b0 con 0x5576c58f0e00 2024-05-09T00:05:18.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9433946b80 10 client.0 _ll_register_callbacks cb 0x5576c57e0b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:18.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9425d29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f1720 0x5576c58fb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9425d29700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f1720 0x5576c58fb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55176/0 (socket says 172.21.15.81:55176) 2024-05-09T00:05:18.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9425d29700 1 -- 172.21.15.81:0/463291831 learned_addr learned my addr 172.21.15.81:0/463291831 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:18.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9425528700 1 --2- 172.21.15.81:0/463291831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58eb890 0x5576c58faa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9424d27700 1 --2- 172.21.15.81:0/463291831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f0e00 0x5576c58faf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9425d29700 1 -- 172.21.15.81:0/463291831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f0e00 msgr2=0x5576c58faf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9425d29700 1 --2- 172.21.15.81:0/463291831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f0e00 0x5576c58faf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9425d29700 1 -- 172.21.15.81:0/463291831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58eb890 msgr2=0x5576c58faa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:18.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9425d29700 1 --2- 172.21.15.81:0/463291831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58eb890 0x5576c58faa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9425d29700 1 -- 172.21.15.81:0/463291831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c0098e0 con 0x5576c58f1720 2024-05-09T00:05:18.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9425d29700 1 --2- 172.21.15.81:0/463291831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f1720 0x5576c58fb4c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9418099a20 tx=0x7f941809b130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ac17a8dfda4d69d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:18.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9408ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:18.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9408ff9700 1 -- 172.21.15.81:0/463291831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94180a3ac0 con 0x5576c58f1720 2024-05-09T00:05:18.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9408ff9700 1 -- 172.21.15.81:0/463291831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f94180bb0b0 con 0x5576c58f1720 2024-05-09T00:05:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9433946b80 1 -- 172.21.15.81:0/463291831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f941809b6d0 con 0x5576c58f1720 2024-05-09T00:05:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9408ff9700 1 -- 172.21.15.81:0/463291831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f941809b930 con 0x5576c58f1720 2024-05-09T00:05:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9433946b80 10 client.16119 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.941+0000 7f9433946b80 1 -- 172.21.15.81:0/463291831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5576c56c0cd0 con 0x5576c58f1720 2024-05-09T00:05:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.942+0000 7f9408ff9700 1 -- 172.21.15.81:0/463291831 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f941809b6d0 con 0x5576c58f1720 2024-05-09T00:05:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.942+0000 7f9408ff9700 1 -- 172.21.15.81:0/463291831 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f941809ac40 con 0x5576c58f1720 2024-05-09T00:05:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.942+0000 7f9433946b80 10 client.16119 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.942+0000 7f9433946b80 10 client.16119 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.942+0000 7f9433946b80 20 client.16119 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.942+0000 7f9433946b80 1 --2- 172.21.15.81:0/463291831 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5576c595c4b0 0x5576c595e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.942+0000 7f9433946b80 4 client.16119 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:05:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.942+0000 7f9433946b80 1 -- 172.21.15.81:0/463291831 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5576c5833ec0 con 0x5576c595c4b0 2024-05-09T00:05:18.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.942+0000 7f9425528700 1 --2- 172.21.15.81:0/463291831 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5576c595c4b0 0x5576c595e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.942+0000 7f9408ff9700 10 client.16119 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.942+0000 7f9425528700 1 --2- 172.21.15.81:0/463291831 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5576c595c4b0 0x5576c595e8a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf9e545108ed37de server_cookie=92626f77af80c0bd in_seq=0 out_seq=0 2024-05-09T00:05:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9408ff9700 1 -- 172.21.15.81:0/463291831 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5576c5833ec0 con 0x5576c595c4b0 2024-05-09T00:05:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9408ff9700 10 client.16119 handle_command_reply: tid=0 2024-05-09T00:05:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9433946b80 1 client.16119 shutdown 2024-05-09T00:05:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9433946b80 1 -- 172.21.15.81:0/463291831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f1720 msgr2=0x5576c58fb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9433946b80 1 --2- 172.21.15.81:0/463291831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f1720 0x5576c58fb4c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9418099a20 tx=0x7f941809b130 comp rx=0 tx=0).stop 2024-05-09T00:05:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9433946b80 1 -- 172.21.15.81:0/463291831 shutdown_connections 2024-05-09T00:05:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9433946b80 1 --2- 172.21.15.81:0/463291831 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5576c595c4b0 0x5576c595e8a0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9433946b80 1 --2- 172.21.15.81:0/463291831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5576c58eb890 0x5576c58faa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9408ff9700 0 client.16119 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9433946b80 1 --2- 172.21.15.81:0/463291831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5576c58f1720 0x5576c58fb4c0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9433946b80 1 --2- 172.21.15.81:0/463291831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5576c58f0e00 0x5576c58faf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9433946b80 1 -- 172.21.15.81:0/463291831 >> 172.21.15.81:0/463291831 conn(0x5576c5849210 msgr2=0x5576c58f04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:18.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9433946b80 1 -- 172.21.15.81:0/463291831 shutdown_connections 2024-05-09T00:05:18.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9433946b80 1 -- 172.21.15.81:0/463291831 wait complete. 2024-05-09T00:05:18.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f9433946b80 20 client.16119 trim_cache size 0 max 16384 2024-05-09T00:05:18.949 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:05:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:05:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:05:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "5bef5b7f-5de9-44b4-ab56-329a6b409b85": { 2024-05-09T00:05:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:05:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "5bef5b7f-5de9-44b4-ab56-329a6b409b85", 2024-05-09T00:05:18.949 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:05:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:05:18.950 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:05:18.950 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:05:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f942778c700 1 -- 172.21.15.81:0/86822125 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f940c0a1290 msgr2=0x7f940c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f942778c700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f940c0a1290 0x7f940c0a3750 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9420067bb0 tx=0x7f941000a380 comp rx=0 tx=0).stop 2024-05-09T00:05:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f942778c700 1 -- 172.21.15.81:0/86822125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9420105f90 msgr2=0x7f942019bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.943+0000 7f942778c700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9420105f90 0x7f942019bd10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f94180094c0 tx=0x7f94180094f0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.944+0000 7f942778c700 1 -- 172.21.15.81:0/86822125 shutdown_connections 2024-05-09T00:05:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.944+0000 7f942778c700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f940c0a1290 0x7f940c0a3750 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.944+0000 7f942778c700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9420105f90 0x7f942019bd10 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.944+0000 7f942778c700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94201000f0 0x7f9420197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.944+0000 7f942778c700 1 --2- 172.21.15.81:0/86822125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9420100ab0 0x7f94201979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.944+0000 7f942778c700 1 -- 172.21.15.81:0/86822125 >> 172.21.15.81:0/86822125 conn(0x7f9420076ba0 msgr2=0x7f94200691e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.944+0000 7f942778c700 1 -- 172.21.15.81:0/86822125 shutdown_connections 2024-05-09T00:05:18.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:18.944+0000 7f942778c700 1 -- 172.21.15.81:0/86822125 wait complete. 2024-05-09T00:05:18.952 INFO:tasks.cephfs.filesystem:scrub status for tag:5bef5b7f-5de9-44b4-ab56-329a6b409b85 - {'path': '/', 'tag': '5bef5b7f-5de9-44b4-ab56-329a6b409b85', 'options': 'recursive,force'} 2024-05-09T00:05:19.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:18 smithi150 ceph-mon[46187]: pgmap v74: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:19.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:18 smithi171 ceph-mon[47351]: pgmap v74: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:19.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:18 smithi081 ceph-mon[42474]: pgmap v74: 97 pgs: 97 active+clean; 2.0 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:20.263 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:19 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:05:20.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:19 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:05:20.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:19 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:05:20.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:19 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:05:20.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:19 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:05:20.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:19 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:05:20.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:19 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:05:20.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:19 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:05:20.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:19 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:05:20.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:19 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:05:20.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:19 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:05:20.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:19 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:05:20.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:19 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:05:20.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:19 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:05:20.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:19 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:05:21.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:21 smithi150 ceph-mon[46187]: pgmap v75: 97 pgs: 97 active+clean; 2.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 18 op/s 2024-05-09T00:05:21.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:21 smithi171 ceph-mon[47351]: pgmap v75: 97 pgs: 97 active+clean; 2.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 18 op/s 2024-05-09T00:05:21.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:21 smithi081 ceph-mon[42474]: pgmap v75: 97 pgs: 97 active+clean; 2.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 30 KiB/s wr, 18 op/s 2024-05-09T00:05:23.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:22 smithi150 ceph-mon[46187]: pgmap v76: 97 pgs: 97 active+clean; 2.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-05-09T00:05:23.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:22 smithi171 ceph-mon[47351]: pgmap v76: 97 pgs: 97 active+clean; 2.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-05-09T00:05:23.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:22 smithi081 ceph-mon[42474]: pgmap v76: 97 pgs: 97 active+clean; 2.1 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-05-09T00:05:23.518 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.524+0000 7fc42958a700 1 -- 172.21.15.81:0/765450847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc424107000 msgr2=0x7fc4241073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.524+0000 7fc42958a700 1 --2- 172.21.15.81:0/765450847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc424107000 0x7fc4241073e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc418009990 tx=0x7fc418009ca0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.524+0000 7fc42958a700 1 -- 172.21.15.81:0/765450847 shutdown_connections 2024-05-09T00:05:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.524+0000 7fc42958a700 1 --2- 172.21.15.81:0/765450847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc424068ca0 0x7fc42410dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.524+0000 7fc42958a700 1 --2- 172.21.15.81:0/765450847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc424107000 0x7fc4241073e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.524+0000 7fc42958a700 1 --2- 172.21.15.81:0/765450847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4240682e0 0x7fc424068760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.524+0000 7fc42958a700 1 -- 172.21.15.81:0/765450847 >> 172.21.15.81:0/765450847 conn(0x7fc424076f10 msgr2=0x7fc424077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.524+0000 7fc42958a700 1 -- 172.21.15.81:0/765450847 shutdown_connections 2024-05-09T00:05:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.524+0000 7fc42958a700 1 -- 172.21.15.81:0/765450847 wait complete. 2024-05-09T00:05:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.525+0000 7fc42958a700 1 Processor -- start 2024-05-09T00:05:23.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.525+0000 7fc42958a700 1 -- start start 2024-05-09T00:05:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.525+0000 7fc42958a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4240682e0 0x7fc424197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.525+0000 7fc42958a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc424068ca0 0x7fc424197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.525+0000 7fc42958a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc424107000 0x7fc42419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.525+0000 7fc42958a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42419c230 con 0x7fc4240682e0 2024-05-09T00:05:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.525+0000 7fc42958a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42419c3a0 con 0x7fc424107000 2024-05-09T00:05:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.525+0000 7fc42958a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42419c560 con 0x7fc424068ca0 2024-05-09T00:05:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.525+0000 7fc422ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4240682e0 0x7fc424197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.525+0000 7fc422ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4240682e0 0x7fc424197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55204/0 (socket says 172.21.15.81:55204) 2024-05-09T00:05:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.525+0000 7fc422ffd700 1 -- 172.21.15.81:0/201583161 learned_addr learned my addr 172.21.15.81:0/201583161 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.525+0000 7fc4227fc700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc424068ca0 0x7fc424197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.525+0000 7fc4237fe700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc424107000 0x7fc42419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.526+0000 7fc422ffd700 1 -- 172.21.15.81:0/201583161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc424068ca0 msgr2=0x7fc424197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.526+0000 7fc422ffd700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc424068ca0 0x7fc424197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.526+0000 7fc422ffd700 1 -- 172.21.15.81:0/201583161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc424107000 msgr2=0x7fc42419bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.526+0000 7fc422ffd700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc424107000 0x7fc42419bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.526+0000 7fc422ffd700 1 -- 172.21.15.81:0/201583161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4180095f0 con 0x7fc4240682e0 2024-05-09T00:05:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.526+0000 7fc4237fe700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc424107000 0x7fc42419bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.526+0000 7fc422ffd700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4240682e0 0x7fc424197310 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc418005910 tx=0x7fc418004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.526+0000 7fc40bfff700 1 -- 172.21.15.81:0/201583161 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41801d070 con 0x7fc4240682e0 2024-05-09T00:05:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.526+0000 7fc40bfff700 1 -- 172.21.15.81:0/201583161 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc418022470 con 0x7fc4240682e0 2024-05-09T00:05:23.522 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.526+0000 7fc42958a700 1 -- 172.21.15.81:0/201583161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42419c7e0 con 0x7fc4240682e0 2024-05-09T00:05:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.526+0000 7fc40bfff700 1 -- 172.21.15.81:0/201583161 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc418017650 con 0x7fc4240682e0 2024-05-09T00:05:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.526+0000 7fc42958a700 1 -- 172.21.15.81:0/201583161 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4241a4080 con 0x7fc4240682e0 2024-05-09T00:05:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.528+0000 7fc40bfff700 1 -- 172.21.15.81:0/201583161 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc4180225e0 con 0x7fc4240682e0 2024-05-09T00:05:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.529+0000 7fc40bfff700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc40c0a1310 0x7fc40c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.529+0000 7fc4227fc700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc40c0a1310 0x7fc40c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.529+0000 7fc40bfff700 1 -- 172.21.15.81:0/201583161 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fc4180ce0c0 con 0x7fc4240682e0 2024-05-09T00:05:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.529+0000 7fc4227fc700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc40c0a1310 0x7fc40c0a37d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc424198860 tx=0x7fc414009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc435744b80 1 Processor -- start 2024-05-09T00:05:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc435744b80 1 -- start start 2024-05-09T00:05:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc435744b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35540 0x564b62b35920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc435744b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b35e60 0x564b62b39900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc435744b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b39e40 0x564b62b3a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc435744b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b62a880f0 con 0x564b62b39e40 2024-05-09T00:05:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc435744b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b62a85ab0 con 0x564b62b35e60 2024-05-09T00:05:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc435744b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b62a813a0 con 0x564b62b35540 2024-05-09T00:05:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc4237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b39e40 0x564b62b3a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.526 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc4237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b39e40 0x564b62b3a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55210/0 (socket says 172.21.15.81:55210) 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc4237fe700 1 -- 172.21.15.81:0/2653599527 learned_addr learned my addr 172.21.15.81:0/2653599527 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc4227fc700 1 --2- 172.21.15.81:0/2653599527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b35e60 0x564b62b39900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc422ffd700 1 --2- 172.21.15.81:0/2653599527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35540 0x564b62b35920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc4237fe700 1 -- 172.21.15.81:0/2653599527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35540 msgr2=0x564b62b35920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc4237fe700 1 --2- 172.21.15.81:0/2653599527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35540 0x564b62b35920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc4237fe700 1 -- 172.21.15.81:0/2653599527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b35e60 msgr2=0x564b62b39900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc4237fe700 1 --2- 172.21.15.81:0/2653599527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b35e60 0x564b62b39900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.530+0000 7fc4237fe700 1 -- 172.21.15.81:0/2653599527 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b62902350 con 0x564b62b39e40 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.531+0000 7fc4237fe700 1 --2- 172.21.15.81:0/2653599527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b39e40 0x564b62b3a2a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009e60 tx=0x7fc41c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e629a3f056f0f199 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.531+0000 7fc4097fa700 1 -- 172.21.15.81:0/2653599527 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c014610 con 0x564b62b39e40 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.531+0000 7fc4097fa700 1 -- 172.21.15.81:0/2653599527 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc41c00f050 con 0x564b62b39e40 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.531+0000 7fc4097fa700 1 -- 172.21.15.81:0/2653599527 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41c0139b0 con 0x564b62b39e40 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.531+0000 7fc435744b80 1 -- 172.21.15.81:0/2653599527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b39e40 msgr2=0x564b62b3a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.531+0000 7fc435744b80 1 --2- 172.21.15.81:0/2653599527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b39e40 0x564b62b3a2a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc41c009e60 tx=0x7fc41c0077e0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.531+0000 7fc435744b80 1 -- 172.21.15.81:0/2653599527 shutdown_connections 2024-05-09T00:05:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.531+0000 7fc435744b80 1 --2- 172.21.15.81:0/2653599527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b39e40 0x564b62b3a2a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.531+0000 7fc435744b80 1 --2- 172.21.15.81:0/2653599527 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35540 0x564b62b35920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.531+0000 7fc435744b80 1 --2- 172.21.15.81:0/2653599527 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b35e60 0x564b62b39900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc435744b80 1 -- 172.21.15.81:0/2653599527 >> 172.21.15.81:0/2653599527 conn(0x564b62a8f1b0 msgr2=0x564b62b2b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc435744b80 1 -- 172.21.15.81:0/2653599527 shutdown_connections 2024-05-09T00:05:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc435744b80 1 -- 172.21.15.81:0/2653599527 wait complete. 2024-05-09T00:05:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc435744b80 1 -- start start 2024-05-09T00:05:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc435744b80 1 Processor -- start 2024-05-09T00:05:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc435744b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35540 0x564b62b41680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc435744b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b35e60 0x564b62b3e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc435744b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b39e40 0x564b62b3f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc435744b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b62a1d500 con 0x564b62b35540 2024-05-09T00:05:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc435744b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b62a1d1a0 con 0x564b62b35e60 2024-05-09T00:05:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc435744b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b62904640 con 0x564b62b39e40 2024-05-09T00:05:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc435744b80 10 client.0 _ll_register_callbacks cb 0x564b62a26ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc422ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35540 0x564b62b41680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc422ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35540 0x564b62b41680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55212/0 (socket says 172.21.15.81:55212) 2024-05-09T00:05:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc422ffd700 1 -- 172.21.15.81:0/4288413753 learned_addr learned my addr 172.21.15.81:0/4288413753 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.532+0000 7fc4227fc700 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b35e60 0x564b62b3e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc422ffd700 1 -- 172.21.15.81:0/4288413753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b39e40 msgr2=0x564b62b3f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc4237fe700 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b39e40 0x564b62b3f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc422ffd700 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b39e40 0x564b62b3f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc422ffd700 1 -- 172.21.15.81:0/4288413753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b35e60 msgr2=0x564b62b3e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc422ffd700 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b35e60 0x564b62b3e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc422ffd700 1 -- 172.21.15.81:0/4288413753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41c009a90 con 0x564b62b35540 2024-05-09T00:05:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc4227fc700 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b35e60 0x564b62b3e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc4237fe700 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b39e40 0x564b62b3f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc422ffd700 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35540 0x564b62b41680 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc4180cb960 tx=0x7fc41809b010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d627bd723f23ee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc406ff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc406ff5700 1 -- 172.21.15.81:0/4288413753 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41809ab10 con 0x564b62b35540 2024-05-09T00:05:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc406ff5700 1 -- 172.21.15.81:0/4288413753 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fc41809bb20 con 0x564b62b35540 2024-05-09T00:05:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc435744b80 1 -- 172.21.15.81:0/4288413753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b629da210 con 0x564b62b35540 2024-05-09T00:05:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc406ff5700 1 -- 172.21.15.81:0/4288413753 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc41809b420 con 0x564b62b35540 2024-05-09T00:05:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc435744b80 10 client.16131 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc435744b80 1 -- 172.21.15.81:0/4288413753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564b628aeb00 con 0x564b62b35540 2024-05-09T00:05:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc406ff5700 1 -- 172.21.15.81:0/4288413753 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564b629da210 con 0x564b62b35540 2024-05-09T00:05:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc406ff5700 1 -- 172.21.15.81:0/4288413753 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc4180b9020 con 0x564b62b35540 2024-05-09T00:05:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc435744b80 10 client.16131 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc435744b80 10 client.16131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc435744b80 20 client.16131 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc435744b80 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564b62b4ece0 0x564b62b510d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc435744b80 4 client.16131 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.533+0000 7fc435744b80 1 -- 172.21.15.81:0/4288413753 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b62b007b0 con 0x564b62b4ece0 2024-05-09T00:05:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.534+0000 7fc4227fc700 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564b62b4ece0 0x564b62b510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.534+0000 7fc406ff5700 10 client.16131 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.534+0000 7fc4227fc700 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564b62b4ece0 0x564b62b510d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7284b30681f9d117 server_cookie=77e0054449755682 in_seq=0 out_seq=0 2024-05-09T00:05:23.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc406ff5700 1 -- 172.21.15.81:0/4288413753 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564b62b007b0 con 0x564b62b4ece0 2024-05-09T00:05:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc406ff5700 10 client.16131 handle_command_reply: tid=0 2024-05-09T00:05:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc435744b80 1 client.16131 shutdown 2024-05-09T00:05:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc435744b80 1 -- 172.21.15.81:0/4288413753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35540 msgr2=0x564b62b41680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc435744b80 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35540 0x564b62b41680 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc4180cb960 tx=0x7fc41809b010 comp rx=0 tx=0).stop 2024-05-09T00:05:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc435744b80 1 -- 172.21.15.81:0/4288413753 shutdown_connections 2024-05-09T00:05:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc435744b80 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564b62b4ece0 0x564b62b510d0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc435744b80 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b39e40 0x564b62b3f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc406ff5700 0 client.16131 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc435744b80 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35540 0x564b62b41680 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc435744b80 1 --2- 172.21.15.81:0/4288413753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b35e60 0x564b62b3e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc435744b80 1 -- 172.21.15.81:0/4288413753 >> 172.21.15.81:0/4288413753 conn(0x564b62a8f1b0 msgr2=0x564b62b2ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc435744b80 1 -- 172.21.15.81:0/4288413753 shutdown_connections 2024-05-09T00:05:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc435744b80 1 -- 172.21.15.81:0/4288413753 wait complete. 2024-05-09T00:05:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.535+0000 7fc435744b80 20 client.16131 trim_cache size 0 max 16384 2024-05-09T00:05:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc435744b80 1 Processor -- start 2024-05-09T00:05:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc435744b80 1 -- start start 2024-05-09T00:05:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc435744b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35540 0x564b62b4aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc435744b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35e60 0x564b62b2b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc435744b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b39e40 0x564b62b2d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc435744b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b62b2da50 con 0x564b62b35e60 2024-05-09T00:05:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc435744b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b62b3f8f0 con 0x564b62b39e40 2024-05-09T00:05:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc435744b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b62b38af0 con 0x564b62b35540 2024-05-09T00:05:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc4227fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35e60 0x564b62b2b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc4227fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35e60 0x564b62b2b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55226/0 (socket says 172.21.15.81:55226) 2024-05-09T00:05:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc4227fc700 1 -- 172.21.15.81:0/444737019 learned_addr learned my addr 172.21.15.81:0/444737019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:23.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc4227fc700 1 -- 172.21.15.81:0/444737019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35540 msgr2=0x564b62b4aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc4237fe700 1 --2- 172.21.15.81:0/444737019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b39e40 0x564b62b2d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc422ffd700 1 --2- 172.21.15.81:0/444737019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35540 0x564b62b4aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc4227fc700 1 --2- 172.21.15.81:0/444737019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35540 0x564b62b4aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc4227fc700 1 -- 172.21.15.81:0/444737019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b39e40 msgr2=0x564b62b2d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc4227fc700 1 --2- 172.21.15.81:0/444737019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b39e40 0x564b62b2d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc4227fc700 1 -- 172.21.15.81:0/444737019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b62a47500 con 0x564b62b35e60 2024-05-09T00:05:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc422ffd700 1 --2- 172.21.15.81:0/444737019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35540 0x564b62b4aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.550+0000 7fc4227fc700 1 --2- 172.21.15.81:0/444737019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35e60 0x564b62b2b910 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x564b62b519e0 tx=0x7fc414014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6ab21fee01b561 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.551+0000 7fc409ffb700 1 -- 172.21.15.81:0/444737019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4140294e0 con 0x564b62b35e60 2024-05-09T00:05:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.551+0000 7fc409ffb700 1 -- 172.21.15.81:0/444737019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc414023040 con 0x564b62b35e60 2024-05-09T00:05:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.551+0000 7fc409ffb700 1 -- 172.21.15.81:0/444737019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41401d670 con 0x564b62b35e60 2024-05-09T00:05:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.551+0000 7fc435744b80 1 -- 172.21.15.81:0/444737019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35e60 msgr2=0x564b62b2b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.551+0000 7fc435744b80 1 --2- 172.21.15.81:0/444737019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35e60 0x564b62b2b910 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x564b62b519e0 tx=0x7fc414014000 comp rx=0 tx=0).stop 2024-05-09T00:05:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.551+0000 7fc435744b80 1 -- 172.21.15.81:0/444737019 shutdown_connections 2024-05-09T00:05:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.551+0000 7fc435744b80 1 --2- 172.21.15.81:0/444737019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b39e40 0x564b62b2d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.551+0000 7fc435744b80 1 --2- 172.21.15.81:0/444737019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35540 0x564b62b4aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.551+0000 7fc435744b80 1 --2- 172.21.15.81:0/444737019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35e60 0x564b62b2b910 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.551+0000 7fc435744b80 1 -- 172.21.15.81:0/444737019 >> 172.21.15.81:0/444737019 conn(0x564b62a8f1b0 msgr2=0x564b62b2ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.551+0000 7fc435744b80 1 -- 172.21.15.81:0/444737019 shutdown_connections 2024-05-09T00:05:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.551+0000 7fc435744b80 1 -- 172.21.15.81:0/444737019 wait complete. 2024-05-09T00:05:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.551+0000 7fc435744b80 1 -- start start 2024-05-09T00:05:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc435744b80 1 Processor -- start 2024-05-09T00:05:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc435744b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35540 0x564b62b43fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc435744b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35e60 0x564b62b44500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc435744b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b39e40 0x564b62b44a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc435744b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b62ba41b0 con 0x564b62b35540 2024-05-09T00:05:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc435744b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b62ba42f0 con 0x564b62b39e40 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc435744b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b62ba4430 con 0x564b62b35e60 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc435744b80 10 client.0 _ll_register_callbacks cb 0x564b62a26ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc422ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35540 0x564b62b43fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc422ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35540 0x564b62b43fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55232/0 (socket says 172.21.15.81:55232) 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc422ffd700 1 -- 172.21.15.81:0/3673666837 learned_addr learned my addr 172.21.15.81:0/3673666837 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc4237fe700 1 --2- 172.21.15.81:0/3673666837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b39e40 0x564b62b44a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc4227fc700 1 --2- 172.21.15.81:0/3673666837 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35e60 0x564b62b44500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc422ffd700 1 -- 172.21.15.81:0/3673666837 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35e60 msgr2=0x564b62b44500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc422ffd700 1 --2- 172.21.15.81:0/3673666837 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35e60 0x564b62b44500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc422ffd700 1 -- 172.21.15.81:0/3673666837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b39e40 msgr2=0x564b62b44a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc422ffd700 1 --2- 172.21.15.81:0/3673666837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b39e40 0x564b62b44a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc422ffd700 1 -- 172.21.15.81:0/3673666837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc414017070 con 0x564b62b35540 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc422ffd700 1 --2- 172.21.15.81:0/3673666837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35540 0x564b62b43fc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc41809aef0 tx=0x7fc4180975e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a184bf5b9e4dd5d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.552+0000 7fc406ff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc406ff5700 1 -- 172.21.15.81:0/3673666837 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41809bb20 con 0x564b62b35540 2024-05-09T00:05:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc406ff5700 1 -- 172.21.15.81:0/3673666837 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fc418099a80 con 0x564b62b35540 2024-05-09T00:05:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc435744b80 1 -- 172.21.15.81:0/3673666837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc41c00f050 con 0x564b62b35540 2024-05-09T00:05:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc406ff5700 1 -- 172.21.15.81:0/3673666837 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc41809b420 con 0x564b62b35540 2024-05-09T00:05:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc435744b80 10 client.16137 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc435744b80 1 -- 172.21.15.81:0/3673666837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564b62906c70 con 0x564b62b35540 2024-05-09T00:05:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc406ff5700 1 -- 172.21.15.81:0/3673666837 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc41c00f050 con 0x564b62b35540 2024-05-09T00:05:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc406ff5700 1 -- 172.21.15.81:0/3673666837 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc4180a9070 con 0x564b62b35540 2024-05-09T00:05:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc435744b80 10 client.16137 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc435744b80 10 client.16137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc435744b80 20 client.16137 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc435744b80 1 --2- 172.21.15.81:0/3673666837 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564b62ba5650 0x564b62ba7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc435744b80 4 client.16137 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:05:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc435744b80 1 -- 172.21.15.81:0/3673666837 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564b62a79e60 con 0x564b62ba5650 2024-05-09T00:05:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.553+0000 7fc4227fc700 1 --2- 172.21.15.81:0/3673666837 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564b62ba5650 0x564b62ba7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.554+0000 7fc406ff5700 10 client.16137 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.554+0000 7fc4227fc700 1 --2- 172.21.15.81:0/3673666837 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564b62ba5650 0x564b62ba7a40 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65dd20d299b8e514 server_cookie=20c5354be347af3c in_seq=0 out_seq=0 2024-05-09T00:05:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc406ff5700 1 -- 172.21.15.81:0/3673666837 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564b62a79e60 con 0x564b62ba5650 2024-05-09T00:05:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc406ff5700 10 client.16137 handle_command_reply: tid=0 2024-05-09T00:05:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc435744b80 1 client.16137 shutdown 2024-05-09T00:05:23.562 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc435744b80 1 -- 172.21.15.81:0/3673666837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35540 msgr2=0x564b62b43fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc435744b80 1 --2- 172.21.15.81:0/3673666837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35540 0x564b62b43fc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc41809aef0 tx=0x7fc4180975e0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc435744b80 1 -- 172.21.15.81:0/3673666837 shutdown_connections 2024-05-09T00:05:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc435744b80 1 --2- 172.21.15.81:0/3673666837 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564b62ba5650 0x564b62ba7a40 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc435744b80 1 --2- 172.21.15.81:0/3673666837 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b62b39e40 0x564b62b44a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc406ff5700 0 client.16137 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc435744b80 1 --2- 172.21.15.81:0/3673666837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b62b35540 0x564b62b43fc0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc435744b80 1 --2- 172.21.15.81:0/3673666837 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b62b35e60 0x564b62b44500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc435744b80 1 -- 172.21.15.81:0/3673666837 >> 172.21.15.81:0/3673666837 conn(0x564b62a8f1b0 msgr2=0x564b62b306e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc435744b80 1 -- 172.21.15.81:0/3673666837 shutdown_connections 2024-05-09T00:05:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc435744b80 1 -- 172.21.15.81:0/3673666837 wait complete. 2024-05-09T00:05:23.563 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.568+0000 7fc435744b80 20 client.16137 trim_cache size 0 max 16384 2024-05-09T00:05:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:05:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:05:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:05:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:05:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.569+0000 7fc42958a700 1 -- 172.21.15.81:0/201583161 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc40c0a1310 msgr2=0x7fc40c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.569+0000 7fc42958a700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc40c0a1310 0x7fc40c0a37d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc424198860 tx=0x7fc414009260 comp rx=0 tx=0).stop 2024-05-09T00:05:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.569+0000 7fc42958a700 1 -- 172.21.15.81:0/201583161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4240682e0 msgr2=0x7fc424197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.569+0000 7fc42958a700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4240682e0 0x7fc424197310 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fc418005910 tx=0x7fc418004730 comp rx=0 tx=0).stop 2024-05-09T00:05:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.569+0000 7fc42958a700 1 -- 172.21.15.81:0/201583161 shutdown_connections 2024-05-09T00:05:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.569+0000 7fc42958a700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc40c0a1310 0x7fc40c0a37d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.569+0000 7fc42958a700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc424107000 0x7fc42419bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.569+0000 7fc42958a700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4240682e0 0x7fc424197310 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.569+0000 7fc42958a700 1 --2- 172.21.15.81:0/201583161 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc424068ca0 0x7fc424197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.569+0000 7fc42958a700 1 -- 172.21.15.81:0/201583161 >> 172.21.15.81:0/201583161 conn(0x7fc424076f10 msgr2=0x7fc4240fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.569+0000 7fc42958a700 1 -- 172.21.15.81:0/201583161 shutdown_connections 2024-05-09T00:05:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:23.569+0000 7fc42958a700 1 -- 172.21.15.81:0/201583161 wait complete. 2024-05-09T00:05:25.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:24 smithi150 ceph-mon[46187]: pgmap v77: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-05-09T00:05:25.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:24 smithi171 ceph-mon[47351]: pgmap v77: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-05-09T00:05:25.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:24 smithi081 ceph-mon[42474]: pgmap v77: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 34 KiB/s wr, 21 op/s 2024-05-09T00:05:27.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:26 smithi150 ceph-mon[46187]: pgmap v78: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-05-09T00:05:27.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:26 smithi171 ceph-mon[47351]: pgmap v78: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-05-09T00:05:27.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:26 smithi081 ceph-mon[42474]: pgmap v78: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-05-09T00:05:29.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:28 smithi150 ceph-mon[46187]: pgmap v79: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-05-09T00:05:29.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:28 smithi171 ceph-mon[47351]: pgmap v79: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-05-09T00:05:29.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:28 smithi081 ceph-mon[42474]: pgmap v79: 97 pgs: 97 active+clean; 2.2 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 13 op/s 2024-05-09T00:05:31.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:30 smithi150 ceph-mon[46187]: pgmap v80: 97 pgs: 97 active+clean; 2.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-05-09T00:05:31.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:30 smithi171 ceph-mon[47351]: pgmap v80: 97 pgs: 97 active+clean; 2.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-05-09T00:05:31.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:30 smithi081 ceph-mon[42474]: pgmap v80: 97 pgs: 97 active+clean; 2.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-05-09T00:05:33.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:32 smithi150 ceph-mon[46187]: pgmap v81: 97 pgs: 97 active+clean; 2.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-05-09T00:05:33.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:32 smithi171 ceph-mon[47351]: pgmap v81: 97 pgs: 97 active+clean; 2.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-05-09T00:05:33.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:32 smithi081 ceph-mon[42474]: pgmap v81: 97 pgs: 97 active+clean; 2.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 22 KiB/s wr, 12 op/s 2024-05-09T00:05:35.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:34 smithi150 ceph-mon[46187]: pgmap v82: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-05-09T00:05:35.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:34 smithi171 ceph-mon[47351]: pgmap v82: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-05-09T00:05:35.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:34 smithi081 ceph-mon[42474]: pgmap v82: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 KiB/s wr, 17 op/s 2024-05-09T00:05:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.689+0000 7f62b3ae5700 1 -- 172.21.15.81:0/2720812610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac104d80 msgr2=0x7f62ac105160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.689+0000 7f62b3ae5700 1 --2- 172.21.15.81:0/2720812610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac104d80 0x7f62ac105160 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f629c009990 tx=0x7f629c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.689+0000 7f62b3ae5700 1 -- 172.21.15.81:0/2720812610 shutdown_connections 2024-05-09T00:05:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.689+0000 7f62b3ae5700 1 --2- 172.21.15.81:0/2720812610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62ac100ee0 0x7f62ac10cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.689+0000 7f62b3ae5700 1 --2- 172.21.15.81:0/2720812610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac104d80 0x7f62ac105160 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.689+0000 7f62b3ae5700 1 --2- 172.21.15.81:0/2720812610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62ac100520 0x7f62ac1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.689+0000 7f62b3ae5700 1 -- 172.21.15.81:0/2720812610 >> 172.21.15.81:0/2720812610 conn(0x7f62ac0763a0 msgr2=0x7f62ac0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.689+0000 7f62b3ae5700 1 -- 172.21.15.81:0/2720812610 shutdown_connections 2024-05-09T00:05:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.689+0000 7f62b3ae5700 1 -- 172.21.15.81:0/2720812610 wait complete. 2024-05-09T00:05:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b3ae5700 1 Processor -- start 2024-05-09T00:05:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b3ae5700 1 -- start start 2024-05-09T00:05:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b3ae5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62ac100520 0x7f62ac1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b3ae5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac100ee0 0x7f62ac196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b3ae5700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62ac104d80 0x7f62ac19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b3ae5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac19b1f0 con 0x7f62ac100ee0 2024-05-09T00:05:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b3ae5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac19b360 con 0x7f62ac100520 2024-05-09T00:05:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b3ae5700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac19b520 con 0x7f62ac104d80 2024-05-09T00:05:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b1080700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac100ee0 0x7f62ac196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b1080700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac100ee0 0x7f62ac196810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32916/0 (socket says 172.21.15.81:32916) 2024-05-09T00:05:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b1080700 1 -- 172.21.15.81:0/596414947 learned_addr learned my addr 172.21.15.81:0/596414947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b1881700 1 --2- 172.21.15.81:0/596414947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62ac100520 0x7f62ac1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b2082700 1 --2- 172.21.15.81:0/596414947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62ac104d80 0x7f62ac19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b1080700 1 -- 172.21.15.81:0/596414947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62ac104d80 msgr2=0x7f62ac19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b1080700 1 --2- 172.21.15.81:0/596414947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62ac104d80 0x7f62ac19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b1080700 1 -- 172.21.15.81:0/596414947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62ac100520 msgr2=0x7f62ac1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b1080700 1 --2- 172.21.15.81:0/596414947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62ac100520 0x7f62ac1962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.690+0000 7f62b1080700 1 -- 172.21.15.81:0/596414947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c0095f0 con 0x7f62ac100ee0 2024-05-09T00:05:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.691+0000 7f62b1080700 1 --2- 172.21.15.81:0/596414947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac100ee0 0x7f62ac196810 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009970 tx=0x7f62a8009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.691+0000 7f62a2ffd700 1 -- 172.21.15.81:0/596414947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8012070 con 0x7f62ac100ee0 2024-05-09T00:05:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.691+0000 7f62b3ae5700 1 -- 172.21.15.81:0/596414947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac19b800 con 0x7f62ac100ee0 2024-05-09T00:05:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.691+0000 7f62a2ffd700 1 -- 172.21.15.81:0/596414947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62a800d260 con 0x7f62ac100ee0 2024-05-09T00:05:36.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.691+0000 7f62a2ffd700 1 -- 172.21.15.81:0/596414947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8017870 con 0x7f62ac100ee0 2024-05-09T00:05:36.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.691+0000 7f62b3ae5700 1 -- 172.21.15.81:0/596414947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac0ff5f0 con 0x7f62ac100ee0 2024-05-09T00:05:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.693+0000 7f62a2ffd700 1 -- 172.21.15.81:0/596414947 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f62a8007af0 con 0x7f62ac100ee0 2024-05-09T00:05:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.694+0000 7f62a2ffd700 1 --2- 172.21.15.81:0/596414947 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f62980a1290 0x7f62980a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.694+0000 7f62b1881700 1 --2- 172.21.15.81:0/596414947 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f62980a1290 0x7f62980a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.694+0000 7f62a2ffd700 1 -- 172.21.15.81:0/596414947 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f62a80cdf70 con 0x7f62ac100ee0 2024-05-09T00:05:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.694+0000 7f62b1881700 1 --2- 172.21.15.81:0/596414947 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f62980a1290 0x7f62980a3750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f629c00b5c0 tx=0x7f629c005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.695+0000 7f62bfc9fb80 1 Processor -- start 2024-05-09T00:05:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.695+0000 7f62bfc9fb80 1 -- start start 2024-05-09T00:05:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.695+0000 7f62bfc9fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c14011ce0 0x561c140120c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.695+0000 7f62bfc9fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c1400d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.695+0000 7f62bfc9fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c1400dd10 0x561c14019a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.695+0000 7f62bfc9fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c13f600f0 con 0x561c1400d350 2024-05-09T00:05:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.695+0000 7f62bfc9fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c13f5dab0 con 0x561c1400dd10 2024-05-09T00:05:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.695+0000 7f62bfc9fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c13f593a0 con 0x561c14011ce0 2024-05-09T00:05:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.695+0000 7f62b1080700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c1400d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.695+0000 7f62b1080700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c1400d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32926/0 (socket says 172.21.15.81:32926) 2024-05-09T00:05:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.695+0000 7f62b1080700 1 -- 172.21.15.81:0/466622049 learned_addr learned my addr 172.21.15.81:0/466622049 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.695+0000 7f62b2082700 1 --2- 172.21.15.81:0/466622049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c1400dd10 0x561c14019a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.695+0000 7f62b1881700 1 --2- 172.21.15.81:0/466622049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c14011ce0 0x561c140120c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.696+0000 7f62b1080700 1 -- 172.21.15.81:0/466622049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c14011ce0 msgr2=0x561c140120c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.696+0000 7f62b1080700 1 --2- 172.21.15.81:0/466622049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c14011ce0 0x561c140120c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.696+0000 7f62b1080700 1 -- 172.21.15.81:0/466622049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c1400dd10 msgr2=0x561c14019a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.696+0000 7f62b1080700 1 --2- 172.21.15.81:0/466622049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c1400dd10 0x561c14019a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.696+0000 7f62b1080700 1 -- 172.21.15.81:0/466622049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c13dda350 con 0x561c1400d350 2024-05-09T00:05:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.696+0000 7f62b2082700 1 --2- 172.21.15.81:0/466622049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c1400dd10 0x561c14019a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.696+0000 7f62b1080700 1 --2- 172.21.15.81:0/466622049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c1400d7d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f62a8097af0 tx=0x7f62a809af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291431ff356c9e25 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.696+0000 7f6297fff700 1 -- 172.21.15.81:0/466622049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a809eeb0 con 0x561c1400d350 2024-05-09T00:05:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.696+0000 7f6297fff700 1 -- 172.21.15.81:0/466622049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62a80a3500 con 0x561c1400d350 2024-05-09T00:05:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.696+0000 7f6297fff700 1 -- 172.21.15.81:0/466622049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a80a32d0 con 0x561c1400d350 2024-05-09T00:05:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.697+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/466622049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 msgr2=0x561c1400d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.697+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/466622049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c1400d7d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f62a8097af0 tx=0x7f62a809af80 comp rx=0 tx=0).stop 2024-05-09T00:05:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.697+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/466622049 shutdown_connections 2024-05-09T00:05:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.697+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/466622049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c1400dd10 0x561c14019a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.697+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/466622049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c14011ce0 0x561c140120c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.697+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/466622049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c1400d7d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.697+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/466622049 >> 172.21.15.81:0/466622049 conn(0x561c13f671b0 msgr2=0x561c14003840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.697+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/466622049 shutdown_connections 2024-05-09T00:05:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.697+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/466622049 wait complete. 2024-05-09T00:05:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.697+0000 7f62bfc9fb80 1 -- start start 2024-05-09T00:05:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.697+0000 7f62bfc9fb80 1 Processor -- start 2024-05-09T00:05:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62bfc9fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c14019a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62bfc9fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c1400dd10 0x561c14016d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62bfc9fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c14011ce0 0x561c140174c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62bfc9fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c13ef5500 con 0x561c1400d350 2024-05-09T00:05:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62bfc9fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c13ef51a0 con 0x561c14011ce0 2024-05-09T00:05:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62bfc9fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c13ddc640 con 0x561c1400dd10 2024-05-09T00:05:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62bfc9fb80 10 client.0 _ll_register_callbacks cb 0x561c13efead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62b1881700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c14019a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62b1881700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c14019a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32930/0 (socket says 172.21.15.81:32930) 2024-05-09T00:05:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62b1881700 1 -- 172.21.15.81:0/2361109034 learned_addr learned my addr 172.21.15.81:0/2361109034 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62b1080700 1 --2- 172.21.15.81:0/2361109034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c1400dd10 0x561c14016d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62b1881700 1 -- 172.21.15.81:0/2361109034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c1400dd10 msgr2=0x561c14016d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62b1881700 1 --2- 172.21.15.81:0/2361109034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c1400dd10 0x561c14016d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62b1881700 1 -- 172.21.15.81:0/2361109034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c14011ce0 msgr2=0x561c140174c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62b1881700 1 --2- 172.21.15.81:0/2361109034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c14011ce0 0x561c140174c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62b1881700 1 -- 172.21.15.81:0/2361109034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac0ff5f0 con 0x561c1400d350 2024-05-09T00:05:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62b1881700 1 --2- 172.21.15.81:0/2361109034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c14019a40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f629c009990 tx=0x7f629c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331b93cae29a5167 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62957fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62957fa700 1 -- 172.21.15.81:0/2361109034 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c01d040 con 0x561c1400d350 2024-05-09T00:05:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62957fa700 1 -- 172.21.15.81:0/2361109034 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f629c00f660 con 0x561c1400d350 2024-05-09T00:05:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2361109034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c13eb2210 con 0x561c1400d350 2024-05-09T00:05:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62957fa700 1 -- 172.21.15.81:0/2361109034 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f629c00f820 con 0x561c1400d350 2024-05-09T00:05:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62bfc9fb80 10 client.16149 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.698+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2361109034 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561c13d86b00 con 0x561c1400d350 2024-05-09T00:05:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.699+0000 7f62957fa700 1 -- 172.21.15.81:0/2361109034 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f629c03c020 con 0x561c1400d350 2024-05-09T00:05:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.699+0000 7f62957fa700 1 -- 172.21.15.81:0/2361109034 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f629c02e070 con 0x561c1400d350 2024-05-09T00:05:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.699+0000 7f62bfc9fb80 10 client.16149 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.699+0000 7f62bfc9fb80 10 client.16149 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:36.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.699+0000 7f62bfc9fb80 20 client.16149 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.699+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/2361109034 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561c140270b0 0x561c140294d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.699+0000 7f62bfc9fb80 4 client.16149 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.699+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2361109034 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c13fd87b0 con 0x561c140270b0 2024-05-09T00:05:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.699+0000 7f62b1080700 1 --2- 172.21.15.81:0/2361109034 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561c140270b0 0x561c140294d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.699+0000 7f62957fa700 10 client.16149 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.699+0000 7f62b1080700 1 --2- 172.21.15.81:0/2361109034 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561c140270b0 0x561c140294d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40c079d635fd02e0 server_cookie=a96c01ffbe410d54 in_seq=0 out_seq=0 2024-05-09T00:05:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.700+0000 7f62957fa700 1 -- 172.21.15.81:0/2361109034 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561c13fd87b0 con 0x561c140270b0 2024-05-09T00:05:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.700+0000 7f62957fa700 10 client.16149 handle_command_reply: tid=0 2024-05-09T00:05:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.700+0000 7f62bfc9fb80 1 client.16149 shutdown 2024-05-09T00:05:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.700+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2361109034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 msgr2=0x561c14019a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.700+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/2361109034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c14019a40 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f629c009990 tx=0x7f629c009310 comp rx=0 tx=0).stop 2024-05-09T00:05:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.700+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2361109034 shutdown_connections 2024-05-09T00:05:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.700+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/2361109034 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561c140270b0 0x561c140294d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.700+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/2361109034 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c14011ce0 0x561c140174c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.700+0000 7f62957fa700 0 client.16149 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.700+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/2361109034 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c14019a40 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.700+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/2361109034 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c1400dd10 0x561c14016d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.700+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2361109034 >> 172.21.15.81:0/2361109034 conn(0x561c13f671b0 msgr2=0x561c14007f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.700+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2361109034 shutdown_connections 2024-05-09T00:05:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.700+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2361109034 wait complete. 2024-05-09T00:05:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.701+0000 7f62bfc9fb80 20 client.16149 trim_cache size 0 max 16384 2024-05-09T00:05:36.713 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.715+0000 7f62bfc9fb80 1 Processor -- start 2024-05-09T00:05:36.713 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.715+0000 7f62bfc9fb80 1 -- start start 2024-05-09T00:05:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62bfc9fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c1400d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62bfc9fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c1400dd10 0x561c14010790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62bfc9fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c14011ce0 0x561c14005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62bfc9fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c140152d0 con 0x561c1400d350 2024-05-09T00:05:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62bfc9fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c14012bc0 con 0x561c14011ce0 2024-05-09T00:05:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62bfc9fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c140294a0 con 0x561c1400dd10 2024-05-09T00:05:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62b1881700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c1400d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62b1881700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c1400d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32938/0 (socket says 172.21.15.81:32938) 2024-05-09T00:05:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62b1881700 1 -- 172.21.15.81:0/228401428 learned_addr learned my addr 172.21.15.81:0/228401428 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62b1881700 1 -- 172.21.15.81:0/228401428 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c1400dd10 msgr2=0x561c14010790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62b1881700 1 --2- 172.21.15.81:0/228401428 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c1400dd10 0x561c14010790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62b1881700 1 -- 172.21.15.81:0/228401428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c14011ce0 msgr2=0x561c14005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62b1881700 1 --2- 172.21.15.81:0/228401428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c14011ce0 0x561c14005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62b1881700 1 -- 172.21.15.81:0/228401428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c13f1f500 con 0x561c1400d350 2024-05-09T00:05:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62b1881700 1 --2- 172.21.15.81:0/228401428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c1400d730 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f629c00bc60 tx=0x7f629c017e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbccb06947859b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62a0da4700 1 -- 172.21.15.81:0/228401428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c01d070 con 0x561c1400d350 2024-05-09T00:05:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62a0da4700 1 -- 172.21.15.81:0/228401428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f629c03c030 con 0x561c1400d350 2024-05-09T00:05:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.716+0000 7f62a0da4700 1 -- 172.21.15.81:0/228401428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629c00fd90 con 0x561c1400d350 2024-05-09T00:05:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.717+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/228401428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 msgr2=0x561c1400d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.717+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/228401428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c1400d730 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f629c00bc60 tx=0x7f629c017e00 comp rx=0 tx=0).stop 2024-05-09T00:05:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.717+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/228401428 shutdown_connections 2024-05-09T00:05:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.717+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/228401428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c14011ce0 0x561c14005240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.717+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/228401428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c1400d350 0x561c1400d730 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.717+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/228401428 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c1400dd10 0x561c14010790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.717+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/228401428 >> 172.21.15.81:0/228401428 conn(0x561c13f671b0 msgr2=0x561c14008820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.717+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/228401428 shutdown_connections 2024-05-09T00:05:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.717+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/228401428 wait complete. 2024-05-09T00:05:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.717+0000 7f62bfc9fb80 1 -- start start 2024-05-09T00:05:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.717+0000 7f62bfc9fb80 1 Processor -- start 2024-05-09T00:05:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62bfc9fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c1400d350 0x561c1401bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62bfc9fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c1400dd10 0x561c1401c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62bfc9fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c14011ce0 0x561c1401c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62bfc9fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c1407c5b0 con 0x561c14011ce0 2024-05-09T00:05:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62bfc9fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c1407c6f0 con 0x561c1400d350 2024-05-09T00:05:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62bfc9fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c1407c830 con 0x561c1400dd10 2024-05-09T00:05:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62bfc9fb80 10 client.0 _ll_register_callbacks cb 0x561c13efead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62b2082700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c14011ce0 0x561c1401c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62b2082700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c14011ce0 0x561c1401c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32946/0 (socket says 172.21.15.81:32946) 2024-05-09T00:05:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62b2082700 1 -- 172.21.15.81:0/2705111831 learned_addr learned my addr 172.21.15.81:0/2705111831 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62b1881700 1 --2- 172.21.15.81:0/2705111831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c1400d350 0x561c1401bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62b1080700 1 --2- 172.21.15.81:0/2705111831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c1400dd10 0x561c1401c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62b2082700 1 -- 172.21.15.81:0/2705111831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c1400dd10 msgr2=0x561c1401c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62b2082700 1 --2- 172.21.15.81:0/2705111831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c1400dd10 0x561c1401c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62b2082700 1 -- 172.21.15.81:0/2705111831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c1400d350 msgr2=0x561c1401bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62b2082700 1 --2- 172.21.15.81:0/2705111831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c1400d350 0x561c1401bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62b2082700 1 -- 172.21.15.81:0/2705111831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c13d86b00 con 0x561c14011ce0 2024-05-09T00:05:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62b2082700 1 --2- 172.21.15.81:0/2705111831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c14011ce0 0x561c1401c590 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f62a4004040 tx=0x7f62a4004400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f449adf4515432e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62957fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62957fa700 1 -- 172.21.15.81:0/2705111831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40079d0 con 0x561c14011ce0 2024-05-09T00:05:36.717 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.718+0000 7f62957fa700 1 -- 172.21.15.81:0/2705111831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f62a4007b30 con 0x561c14011ce0 2024-05-09T00:05:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.719+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2705111831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f62a80a3500 con 0x561c14011ce0 2024-05-09T00:05:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.719+0000 7f62957fa700 1 -- 172.21.15.81:0/2705111831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62a4007cf0 con 0x561c14011ce0 2024-05-09T00:05:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.719+0000 7f62bfc9fb80 10 client.16155 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.719+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2705111831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561c13ddec70 con 0x561c14011ce0 2024-05-09T00:05:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.719+0000 7f62957fa700 1 -- 172.21.15.81:0/2705111831 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62a80a3500 con 0x561c14011ce0 2024-05-09T00:05:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.719+0000 7f62957fa700 1 -- 172.21.15.81:0/2705111831 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f62a4014040 con 0x561c14011ce0 2024-05-09T00:05:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.719+0000 7f62bfc9fb80 10 client.16155 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.719+0000 7f62bfc9fb80 10 client.16155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.719+0000 7f62bfc9fb80 20 client.16155 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.719+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/2705111831 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561c1407e060 0x561c14080480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.719+0000 7f62bfc9fb80 4 client.16155 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:05:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.719+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2705111831 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561c13f51e60 con 0x561c1407e060 2024-05-09T00:05:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.719+0000 7f62b1881700 1 --2- 172.21.15.81:0/2705111831 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561c1407e060 0x561c14080480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:36.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.720+0000 7f62957fa700 10 client.16155 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:36.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.720+0000 7f62b1881700 1 --2- 172.21.15.81:0/2705111831 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561c1407e060 0x561c14080480 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b42755ec3459604 server_cookie=a9383591adabab53 in_seq=0 out_seq=0 2024-05-09T00:05:36.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62957fa700 1 -- 172.21.15.81:0/2705111831 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561c13f51e60 con 0x561c1407e060 2024-05-09T00:05:36.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62957fa700 10 client.16155 handle_command_reply: tid=0 2024-05-09T00:05:36.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62bfc9fb80 1 client.16155 shutdown 2024-05-09T00:05:36.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2705111831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c14011ce0 msgr2=0x561c1401c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:36.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/2705111831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c14011ce0 0x561c1401c590 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f62a4004040 tx=0x7f62a4004400 comp rx=0 tx=0).stop 2024-05-09T00:05:36.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2705111831 shutdown_connections 2024-05-09T00:05:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/2705111831 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561c1407e060 0x561c14080480 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/2705111831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561c1400d350 0x561c1401bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/2705111831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561c14011ce0 0x561c1401c590 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62957fa700 0 client.16155 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62bfc9fb80 1 --2- 172.21.15.81:0/2705111831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561c1400dd10 0x561c1401c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2705111831 >> 172.21.15.81:0/2705111831 conn(0x561c13f671b0 msgr2=0x561c14005150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2705111831 shutdown_connections 2024-05-09T00:05:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62bfc9fb80 1 -- 172.21.15.81:0/2705111831 wait complete. 2024-05-09T00:05:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62bfc9fb80 20 client.16155 trim_cache size 0 max 16384 2024-05-09T00:05:36.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:05:36.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:05:36.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:05:36.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:05:36.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62b3ae5700 1 -- 172.21.15.81:0/596414947 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f62980a1290 msgr2=0x7f62980a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62b3ae5700 1 --2- 172.21.15.81:0/596414947 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f62980a1290 0x7f62980a3750 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f629c00b5c0 tx=0x7f629c005960 comp rx=0 tx=0).stop 2024-05-09T00:05:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.734+0000 7f62b3ae5700 1 -- 172.21.15.81:0/596414947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac100ee0 msgr2=0x7f62ac196810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.735+0000 7f62b3ae5700 1 --2- 172.21.15.81:0/596414947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac100ee0 0x7f62ac196810 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f62a8009970 tx=0x7f62a8009c80 comp rx=0 tx=0).stop 2024-05-09T00:05:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.735+0000 7f62b3ae5700 1 -- 172.21.15.81:0/596414947 shutdown_connections 2024-05-09T00:05:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.735+0000 7f62b3ae5700 1 --2- 172.21.15.81:0/596414947 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f62980a1290 0x7f62980a3750 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.735+0000 7f62b3ae5700 1 --2- 172.21.15.81:0/596414947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f62ac100520 0x7f62ac1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.735+0000 7f62b3ae5700 1 --2- 172.21.15.81:0/596414947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f62ac104d80 0x7f62ac19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.735+0000 7f62b3ae5700 1 --2- 172.21.15.81:0/596414947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62ac100ee0 0x7f62ac196810 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.735+0000 7f62b3ae5700 1 -- 172.21.15.81:0/596414947 >> 172.21.15.81:0/596414947 conn(0x7f62ac0763a0 msgr2=0x7f62ac102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.735+0000 7f62b3ae5700 1 -- 172.21.15.81:0/596414947 shutdown_connections 2024-05-09T00:05:36.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:36.735+0000 7f62b3ae5700 1 -- 172.21.15.81:0/596414947 wait complete. 2024-05-09T00:05:37.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:36 smithi150 ceph-mon[46187]: pgmap v83: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-05-09T00:05:37.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:36 smithi171 ceph-mon[47351]: pgmap v83: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-05-09T00:05:37.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:36 smithi081 ceph-mon[42474]: pgmap v83: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-05-09T00:05:38.867 INFO:tasks.workunit.client.0.smithi081.stdout:1/600: open fd = 3 2024-05-09T00:05:38.867 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.867 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.867 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.867 INFO:tasks.workunit.client.0.smithi081.stdout:2/600: open fd = 3 2024-05-09T00:05:38.867 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.868 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.868 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.868 INFO:tasks.workunit.client.0.smithi081.stdout:3/600: open fd = 3 2024-05-09T00:05:38.868 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.868 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.868 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.868 INFO:tasks.workunit.client.0.smithi081.stdout:4/600: open fd = 3 2024-05-09T00:05:38.868 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.868 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.868 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.868 INFO:tasks.workunit.client.0.smithi081.stdout:5/600: open fd = 3 2024-05-09T00:05:38.868 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.868 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:6/600: open fd = 3 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:7/600: open fd = 3 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:8/600: open fd = 3 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:9/600: open fd = 3 2024-05-09T00:05:38.869 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:10/600: open fd = 3 2024-05-09T00:05:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:11/600: open fd = 3 2024-05-09T00:05:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:12/600: open fd = 3 2024-05-09T00:05:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.870 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:13/600: open fd = 3 2024-05-09T00:05:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:14/600: open fd = 3 2024-05-09T00:05:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:15/600: open fd = 3 2024-05-09T00:05:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.871 INFO:tasks.workunit.client.0.smithi081.stdout:16/600: open fd = 3 2024-05-09T00:05:38.872 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.872 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.872 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.872 INFO:tasks.workunit.client.0.smithi081.stdout:17/600: open fd = 3 2024-05-09T00:05:38.872 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.872 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.872 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.872 INFO:tasks.workunit.client.0.smithi081.stdout:18/600: open fd = 3 2024-05-09T00:05:38.872 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.872 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.872 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.873 INFO:tasks.workunit.client.0.smithi081.stdout:19/600: open fd = 3 2024-05-09T00:05:38.873 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.873 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.873 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.873 INFO:tasks.workunit.client.0.smithi081.stdout:20/600: open fd = 3 2024-05-09T00:05:38.873 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.873 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.873 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.873 INFO:tasks.workunit.client.0.smithi081.stdout:21/600: open fd = 3 2024-05-09T00:05:38.873 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.873 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.873 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:22/600: open fd = 3 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:23/600: open fd = 3 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:24/600: open fd = 3 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:25/600: open fd = 3 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.874 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.875 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.875 INFO:tasks.workunit.client.0.smithi081.stdout:26/600: open fd = 3 2024-05-09T00:05:38.875 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.875 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.875 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.875 INFO:tasks.workunit.client.0.smithi081.stdout:27/600: open fd = 3 2024-05-09T00:05:38.875 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.875 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.875 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.875 INFO:tasks.workunit.client.0.smithi081.stdout:28/600: open fd = 3 2024-05-09T00:05:38.875 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.875 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.875 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.875 INFO:tasks.workunit.client.0.smithi081.stdout:29/600: open fd = 3 2024-05-09T00:05:38.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.876 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.876 INFO:tasks.workunit.client.0.smithi081.stdout:30/600: open fd = 3 2024-05-09T00:05:38.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.876 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.876 INFO:tasks.workunit.client.0.smithi081.stdout:31/600: open fd = 3 2024-05-09T00:05:38.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.876 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.876 INFO:tasks.workunit.client.0.smithi081.stdout:32/600: open fd = 3 2024-05-09T00:05:38.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.877 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.877 INFO:tasks.workunit.client.0.smithi081.stdout:33/600: open fd = 3 2024-05-09T00:05:38.877 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.877 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.877 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.877 INFO:tasks.workunit.client.0.smithi081.stdout:34/600: open fd = 3 2024-05-09T00:05:38.877 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.878 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.878 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.878 INFO:tasks.workunit.client.0.smithi081.stdout:35/600: open fd = 3 2024-05-09T00:05:38.878 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.878 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.878 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.878 INFO:tasks.workunit.client.0.smithi081.stdout:36/600: open fd = 3 2024-05-09T00:05:38.878 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.878 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:37/600: open fd = 3 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:38/600: open fd = 3 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:39/600: open fd = 3 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:40/600: open fd = 3 2024-05-09T00:05:38.879 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:41/600: open fd = 3 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:42/600: open fd = 3 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:43/600: open fd = 3 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.880 INFO:tasks.workunit.client.0.smithi081.stdout:44/600: open fd = 3 2024-05-09T00:05:38.881 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.881 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.881 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.881 INFO:tasks.workunit.client.0.smithi081.stdout:45/600: open fd = 3 2024-05-09T00:05:38.881 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.881 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.881 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.881 INFO:tasks.workunit.client.0.smithi081.stdout:46/600: open fd = 3 2024-05-09T00:05:38.881 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.881 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:47/600: open fd = 3 2024-05-09T00:05:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:48/600: open fd = 3 2024-05-09T00:05:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:49/600: open fd = 3 2024-05-09T00:05:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.882 INFO:tasks.workunit.client.0.smithi081.stdout:50/600: open fd = 3 2024-05-09T00:05:38.883 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.883 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.883 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.883 INFO:tasks.workunit.client.0.smithi081.stdout:51/600: open fd = 3 2024-05-09T00:05:38.883 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.883 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.883 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.883 INFO:tasks.workunit.client.0.smithi081.stdout:52/600: open fd = 3 2024-05-09T00:05:38.883 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.883 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.883 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.883 INFO:tasks.workunit.client.0.smithi081.stdout:53/600: open fd = 3 2024-05-09T00:05:38.883 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:54/600: open fd = 3 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:55/600: open fd = 3 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:56/600: open fd = 3 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.884 INFO:tasks.workunit.client.0.smithi081.stdout:57/600: open fd = 3 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:58/600: open fd = 3 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:59/600: open fd = 3 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:60/600: open fd = 3 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.885 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.886 INFO:tasks.workunit.client.0.smithi081.stdout:61/600: open fd = 3 2024-05-09T00:05:38.886 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.886 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.886 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.886 INFO:tasks.workunit.client.0.smithi081.stdout:62/600: open fd = 3 2024-05-09T00:05:38.886 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.886 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.886 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:38.886 INFO:tasks.workunit.client.0.smithi081.stdout:63/600: open fd = 3 2024-05-09T00:05:38.886 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.886 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:05:38.886 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:05:39.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:38 smithi150 ceph-mon[46187]: pgmap v84: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-05-09T00:05:39.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:38 smithi171 ceph-mon[47351]: pgmap v84: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-05-09T00:05:39.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:38 smithi081 ceph-mon[42474]: pgmap v84: 97 pgs: 97 active+clean; 2.4 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 18 KiB/s wr, 9 op/s 2024-05-09T00:05:41.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:40 smithi150 ceph-mon[46187]: pgmap v85: 97 pgs: 97 active+clean; 2.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 17 op/s 2024-05-09T00:05:41.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:40 smithi171 ceph-mon[47351]: pgmap v85: 97 pgs: 97 active+clean; 2.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 17 op/s 2024-05-09T00:05:41.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:40 smithi081 ceph-mon[42474]: pgmap v85: 97 pgs: 97 active+clean; 2.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 17 op/s 2024-05-09T00:05:43.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:42 smithi150 ceph-mon[46187]: pgmap v86: 97 pgs: 97 active+clean; 2.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:43.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:42 smithi171 ceph-mon[47351]: pgmap v86: 97 pgs: 97 active+clean; 2.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:43.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:42 smithi081 ceph-mon[42474]: pgmap v86: 97 pgs: 97 active+clean; 2.5 MiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:45.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:44 smithi150 ceph-mon[46187]: pgmap v87: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 16 op/s 2024-05-09T00:05:45.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:44 smithi171 ceph-mon[47351]: pgmap v87: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 16 op/s 2024-05-09T00:05:45.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:44 smithi081 ceph-mon[42474]: pgmap v87: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 KiB/s wr, 16 op/s 2024-05-09T00:05:47.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:46 smithi150 ceph-mon[46187]: pgmap v88: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:47.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:46 smithi171 ceph-mon[47351]: pgmap v88: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:47.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:46 smithi081 ceph-mon[42474]: pgmap v88: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:48.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:05:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.111+0000 7fc92ab09700 1 -- 172.21.15.81:0/3504032733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc924105160 msgr2=0x7fc92410cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.111+0000 7fc92ab09700 1 --2- 172.21.15.81:0/3504032733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc924105160 0x7fc92410cce0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00b0a0 tx=0x7fc91c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.111+0000 7fc92ab09700 1 -- 172.21.15.81:0/3504032733 shutdown_connections 2024-05-09T00:05:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.111+0000 7fc92ab09700 1 --2- 172.21.15.81:0/3504032733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc924105160 0x7fc92410cce0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.111+0000 7fc92ab09700 1 --2- 172.21.15.81:0/3504032733 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc924100060 0x7fc924100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.111+0000 7fc92ab09700 1 --2- 172.21.15.81:0/3504032733 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc924100a10 0x7fc924104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.111+0000 7fc92ab09700 1 -- 172.21.15.81:0/3504032733 >> 172.21.15.81:0/3504032733 conn(0x7fc924076f40 msgr2=0x7fc924077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.111+0000 7fc92ab09700 1 -- 172.21.15.81:0/3504032733 shutdown_connections 2024-05-09T00:05:49.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.111+0000 7fc92ab09700 1 -- 172.21.15.81:0/3504032733 wait complete. 2024-05-09T00:05:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.112+0000 7fc92ab09700 1 Processor -- start 2024-05-09T00:05:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.112+0000 7fc92ab09700 1 -- start start 2024-05-09T00:05:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.112+0000 7fc92ab09700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc924100060 0x7fc9241964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.112+0000 7fc92ab09700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc924105160 0x7fc924196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.112+0000 7fc92ab09700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc92419ad60 0x7fc92419b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.112+0000 7fc92ab09700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92419b7e0 con 0x7fc924105160 2024-05-09T00:05:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.112+0000 7fc92ab09700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92419b950 con 0x7fc924100060 2024-05-09T00:05:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.112+0000 7fc92ab09700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92419bb10 con 0x7fc92419ad60 2024-05-09T00:05:49.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.112+0000 7fc923fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc924105160 0x7fc924196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.112+0000 7fc923fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc924105160 0x7fc924196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59208/0 (socket says 172.21.15.81:59208) 2024-05-09T00:05:49.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.112+0000 7fc923fff700 1 -- 172.21.15.81:0/2385258813 learned_addr learned my addr 172.21.15.81:0/2385258813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.112+0000 7fc9288a5700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc924100060 0x7fc9241964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.112+0000 7fc9290a6700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc92419ad60 0x7fc92419b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.113+0000 7fc923fff700 1 -- 172.21.15.81:0/2385258813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc92419ad60 msgr2=0x7fc92419b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.113+0000 7fc923fff700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc92419ad60 0x7fc92419b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.113+0000 7fc923fff700 1 -- 172.21.15.81:0/2385258813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc924100060 msgr2=0x7fc9241964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.113+0000 7fc923fff700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc924100060 0x7fc9241964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.113+0000 7fc923fff700 1 -- 172.21.15.81:0/2385258813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c009d00 con 0x7fc924105160 2024-05-09T00:05:49.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.113+0000 7fc9290a6700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc92419ad60 0x7fc92419b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:49.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.113+0000 7fc923fff700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc924105160 0x7fc924196a10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc91000b500 tx=0x7fc91000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.113+0000 7fc921ffb700 1 -- 172.21.15.81:0/2385258813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910011830 con 0x7fc924105160 2024-05-09T00:05:49.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.113+0000 7fc921ffb700 1 -- 172.21.15.81:0/2385258813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc910011e50 con 0x7fc924105160 2024-05-09T00:05:49.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.113+0000 7fc92ab09700 1 -- 172.21.15.81:0/2385258813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9241a3070 con 0x7fc924105160 2024-05-09T00:05:49.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.113+0000 7fc921ffb700 1 -- 172.21.15.81:0/2385258813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000f2e0 con 0x7fc924105160 2024-05-09T00:05:49.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.113+0000 7fc92ab09700 1 -- 172.21.15.81:0/2385258813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9241a3550 con 0x7fc924105160 2024-05-09T00:05:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.115+0000 7fc921ffb700 1 -- 172.21.15.81:0/2385258813 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc9100105a0 con 0x7fc924105160 2024-05-09T00:05:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.116+0000 7fc921ffb700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc9140a1310 0x7fc9140a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.116+0000 7fc9288a5700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc9140a1310 0x7fc9140a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.116+0000 7fc921ffb700 1 -- 172.21.15.81:0/2385258813 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fc9100cc670 con 0x7fc924105160 2024-05-09T00:05:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.116+0000 7fc9288a5700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc9140a1310 0x7fc9140a37d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc918009a10 tx=0x7fc918009190 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.116+0000 7fc936cc3b80 1 Processor -- start 2024-05-09T00:05:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc936cc3b80 1 -- start start 2024-05-09T00:05:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc936cc3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1ee00 0x55b67bf1f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc936cc3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf19350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc936cc3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf19890 0x55b67bf19cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc936cc3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67be70150 con 0x55b67bf1f720 2024-05-09T00:05:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc936cc3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67be6db10 con 0x55b67bf1ee00 2024-05-09T00:05:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc936cc3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67be69400 con 0x55b67bf19890 2024-05-09T00:05:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc923fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf19350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc923fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf19350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59210/0 (socket says 172.21.15.81:59210) 2024-05-09T00:05:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc923fff700 1 -- 172.21.15.81:0/3713240910 learned_addr learned my addr 172.21.15.81:0/3713240910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc9288a5700 1 --2- 172.21.15.81:0/3713240910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1ee00 0x55b67bf1f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc9290a6700 1 --2- 172.21.15.81:0/3713240910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf19890 0x55b67bf19cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc923fff700 1 -- 172.21.15.81:0/3713240910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf19890 msgr2=0x55b67bf19cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc923fff700 1 --2- 172.21.15.81:0/3713240910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf19890 0x55b67bf19cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc923fff700 1 -- 172.21.15.81:0/3713240910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1ee00 msgr2=0x55b67bf1f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc923fff700 1 --2- 172.21.15.81:0/3713240910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1ee00 0x55b67bf1f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc923fff700 1 -- 172.21.15.81:0/3713240910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b67bcea3b0 con 0x55b67bf1f720 2024-05-09T00:05:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc923fff700 1 --2- 172.21.15.81:0/3713240910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf19350 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc9100962c0 tx=0x7fc910099460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fabcff69316eb22 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc90effd700 1 -- 172.21.15.81:0/3713240910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91009d680 con 0x55b67bf1f720 2024-05-09T00:05:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc90effd700 1 -- 172.21.15.81:0/3713240910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9100a1cd0 con 0x55b67bf1f720 2024-05-09T00:05:49.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.117+0000 7fc90effd700 1 -- 172.21.15.81:0/3713240910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910098f40 con 0x55b67bf1f720 2024-05-09T00:05:49.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.118+0000 7fc936cc3b80 1 -- 172.21.15.81:0/3713240910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 msgr2=0x55b67bf19350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.118+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/3713240910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf19350 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc9100962c0 tx=0x7fc910099460 comp rx=0 tx=0).stop 2024-05-09T00:05:49.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.118+0000 7fc936cc3b80 1 -- 172.21.15.81:0/3713240910 shutdown_connections 2024-05-09T00:05:49.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.118+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/3713240910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1ee00 0x55b67bf1f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.118+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/3713240910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf19890 0x55b67bf19cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.118+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/3713240910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf19350 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.118+0000 7fc936cc3b80 1 -- 172.21.15.81:0/3713240910 >> 172.21.15.81:0/3713240910 conn(0x55b67be77210 msgr2=0x55b67bf13df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.118+0000 7fc936cc3b80 1 -- 172.21.15.81:0/3713240910 shutdown_connections 2024-05-09T00:05:49.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.118+0000 7fc936cc3b80 1 -- 172.21.15.81:0/3713240910 wait complete. 2024-05-09T00:05:49.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.118+0000 7fc936cc3b80 1 -- start start 2024-05-09T00:05:49.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc936cc3b80 1 Processor -- start 2024-05-09T00:05:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc936cc3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf19890 0x55b67bf22a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc936cc3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf1ee00 0x55b67bf22f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc936cc3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf23490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc936cc3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67be05560 con 0x55b67bf1f720 2024-05-09T00:05:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc936cc3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67be05200 con 0x55b67bf19890 2024-05-09T00:05:49.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc936cc3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67bcec6a0 con 0x55b67bf1ee00 2024-05-09T00:05:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc936cc3b80 10 client.0 _ll_register_callbacks cb 0x55b67be0eb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc9290a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf23490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc9290a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf23490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59224/0 (socket says 172.21.15.81:59224) 2024-05-09T00:05:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc9290a6700 1 -- 172.21.15.81:0/516709316 learned_addr learned my addr 172.21.15.81:0/516709316 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc9288a5700 1 --2- 172.21.15.81:0/516709316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf19890 0x55b67bf22a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc923fff700 1 --2- 172.21.15.81:0/516709316 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf1ee00 0x55b67bf22f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc9290a6700 1 -- 172.21.15.81:0/516709316 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf1ee00 msgr2=0x55b67bf22f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc9290a6700 1 --2- 172.21.15.81:0/516709316 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf1ee00 0x55b67bf22f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc9290a6700 1 -- 172.21.15.81:0/516709316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf19890 msgr2=0x55b67bf22a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc9290a6700 1 --2- 172.21.15.81:0/516709316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf19890 0x55b67bf22a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc9290a6700 1 -- 172.21.15.81:0/516709316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9241a3550 con 0x55b67bf1f720 2024-05-09T00:05:49.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.119+0000 7fc923fff700 1 --2- 172.21.15.81:0/516709316 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf1ee00 0x55b67bf22f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:49.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc9290a6700 1 --2- 172.21.15.81:0/516709316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf23490 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009380 tx=0x7fc91c0093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45af743ded34a200 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc903fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:49.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc903fff700 1 -- 172.21.15.81:0/516709316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c00e040 con 0x55b67bf1f720 2024-05-09T00:05:49.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc936cc3b80 1 -- 172.21.15.81:0/516709316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b67bdc2270 con 0x55b67bf1f720 2024-05-09T00:05:49.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc903fff700 1 -- 172.21.15.81:0/516709316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fc91c0074e0 con 0x55b67bf1f720 2024-05-09T00:05:49.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc903fff700 1 -- 172.21.15.81:0/516709316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc91c004e60 con 0x55b67bf1f720 2024-05-09T00:05:49.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc936cc3b80 10 client.16167 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:49.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc936cc3b80 1 -- 172.21.15.81:0/516709316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b67bc96b60 con 0x55b67bf1f720 2024-05-09T00:05:49.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc903fff700 1 -- 172.21.15.81:0/516709316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc91c031080 con 0x55b67bf1f720 2024-05-09T00:05:49.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc903fff700 1 -- 172.21.15.81:0/516709316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc91c02b030 con 0x55b67bf1f720 2024-05-09T00:05:49.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc936cc3b80 10 client.16167 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:49.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc936cc3b80 10 client.16167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:49.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc936cc3b80 20 client.16167 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:49.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/516709316 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b67bf33180 0x55b67bf355a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc936cc3b80 4 client.16167 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:49.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.120+0000 7fc936cc3b80 1 -- 172.21.15.81:0/516709316 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b67bee8810 con 0x55b67bf33180 2024-05-09T00:05:49.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.121+0000 7fc9288a5700 1 --2- 172.21.15.81:0/516709316 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b67bf33180 0x55b67bf355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.121+0000 7fc903fff700 10 client.16167 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:49.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.121+0000 7fc9288a5700 1 --2- 172.21.15.81:0/516709316 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b67bf33180 0x55b67bf355a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84ca7243fb002769 server_cookie=126158c92092d99b in_seq=0 out_seq=0 2024-05-09T00:05:49.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc903fff700 1 -- 172.21.15.81:0/516709316 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b67bee8810 con 0x55b67bf33180 2024-05-09T00:05:49.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc903fff700 10 client.16167 handle_command_reply: tid=0 2024-05-09T00:05:49.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc936cc3b80 1 client.16167 shutdown 2024-05-09T00:05:49.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc936cc3b80 1 -- 172.21.15.81:0/516709316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 msgr2=0x55b67bf23490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/516709316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf23490 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc91c009380 tx=0x7fc91c0093b0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc936cc3b80 1 -- 172.21.15.81:0/516709316 shutdown_connections 2024-05-09T00:05:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/516709316 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b67bf33180 0x55b67bf355a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/516709316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf19890 0x55b67bf22a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/516709316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf23490 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc903fff700 0 client.16167 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:49.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/516709316 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf1ee00 0x55b67bf22f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc936cc3b80 1 -- 172.21.15.81:0/516709316 >> 172.21.15.81:0/516709316 conn(0x55b67be77210 msgr2=0x55b67bf135a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc936cc3b80 1 -- 172.21.15.81:0/516709316 shutdown_connections 2024-05-09T00:05:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc936cc3b80 1 -- 172.21.15.81:0/516709316 wait complete. 2024-05-09T00:05:49.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.122+0000 7fc936cc3b80 20 client.16167 trim_cache size 0 max 16384 2024-05-09T00:05:49.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.139+0000 7fc936cc3b80 1 Processor -- start 2024-05-09T00:05:49.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.139+0000 7fc936cc3b80 1 -- start start 2024-05-09T00:05:49.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.139+0000 7fc936cc3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf19890 0x55b67bf19350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.139+0000 7fc936cc3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1ee00 0x55b67bf13d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.139+0000 7fc936cc3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf2a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.139+0000 7fc936cc3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67bf10dc0 con 0x55b67bf1f720 2024-05-09T00:05:49.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.139+0000 7fc936cc3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67bf0e800 con 0x55b67bf1ee00 2024-05-09T00:05:49.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.139+0000 7fc936cc3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67bf3a790 con 0x55b67bf19890 2024-05-09T00:05:49.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc9290a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf2a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc9290a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf2a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59238/0 (socket says 172.21.15.81:59238) 2024-05-09T00:05:49.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc9290a6700 1 -- 172.21.15.81:0/4049502820 learned_addr learned my addr 172.21.15.81:0/4049502820 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc923fff700 1 --2- 172.21.15.81:0/4049502820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1ee00 0x55b67bf13d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc9288a5700 1 --2- 172.21.15.81:0/4049502820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf19890 0x55b67bf19350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc9290a6700 1 -- 172.21.15.81:0/4049502820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf19890 msgr2=0x55b67bf19350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc9290a6700 1 --2- 172.21.15.81:0/4049502820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf19890 0x55b67bf19350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc9290a6700 1 -- 172.21.15.81:0/4049502820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1ee00 msgr2=0x55b67bf13d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc9290a6700 1 --2- 172.21.15.81:0/4049502820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1ee00 0x55b67bf13d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc9290a6700 1 -- 172.21.15.81:0/4049502820 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b67be2f560 con 0x55b67bf1f720 2024-05-09T00:05:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc9288a5700 1 --2- 172.21.15.81:0/4049502820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf19890 0x55b67bf19350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc9290a6700 1 --2- 172.21.15.81:0/4049502820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf2a0a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc91c005b60 tx=0x7fc91c005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbba2aea87ca3ba1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc90f7fe700 1 -- 172.21.15.81:0/4049502820 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c00e070 con 0x55b67bf1f720 2024-05-09T00:05:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc90f7fe700 1 -- 172.21.15.81:0/4049502820 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b67bdc2270 con 0x55b67bf1f720 2024-05-09T00:05:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.140+0000 7fc90f7fe700 1 -- 172.21.15.81:0/4049502820 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c025950 con 0x55b67bf1f720 2024-05-09T00:05:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 -- 172.21.15.81:0/4049502820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 msgr2=0x55b67bf2a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/4049502820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf2a0a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fc91c005b60 tx=0x7fc91c005b90 comp rx=0 tx=0).stop 2024-05-09T00:05:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 -- 172.21.15.81:0/4049502820 shutdown_connections 2024-05-09T00:05:49.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/4049502820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf1f720 0x55b67bf2a0a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/4049502820 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf19890 0x55b67bf19350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/4049502820 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1ee00 0x55b67bf13d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 -- 172.21.15.81:0/4049502820 >> 172.21.15.81:0/4049502820 conn(0x55b67be77210 msgr2=0x55b67bf1cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 -- 172.21.15.81:0/4049502820 shutdown_connections 2024-05-09T00:05:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 -- 172.21.15.81:0/4049502820 wait complete. 2024-05-09T00:05:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 -- start start 2024-05-09T00:05:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 Processor -- start 2024-05-09T00:05:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf19890 0x55b67bf26470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf1ee00 0x55b67bf269b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1f720 0x55b67bf826b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67bf82bf0 con 0x55b67bf19890 2024-05-09T00:05:49.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67bf82d60 con 0x55b67bf1f720 2024-05-09T00:05:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.141+0000 7fc936cc3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b67bf82f20 con 0x55b67bf1ee00 2024-05-09T00:05:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc936cc3b80 10 client.0 _ll_register_callbacks cb 0x55b67be0eb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc9288a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf19890 0x55b67bf26470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc9288a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf19890 0x55b67bf26470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59242/0 (socket says 172.21.15.81:59242) 2024-05-09T00:05:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc9288a5700 1 -- 172.21.15.81:0/4275539154 learned_addr learned my addr 172.21.15.81:0/4275539154 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc923fff700 1 --2- 172.21.15.81:0/4275539154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf1ee00 0x55b67bf269b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc9290a6700 1 --2- 172.21.15.81:0/4275539154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1f720 0x55b67bf826b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc9288a5700 1 -- 172.21.15.81:0/4275539154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf1ee00 msgr2=0x55b67bf269b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc9288a5700 1 --2- 172.21.15.81:0/4275539154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf1ee00 0x55b67bf269b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc9288a5700 1 -- 172.21.15.81:0/4275539154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1f720 msgr2=0x55b67bf826b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc9288a5700 1 --2- 172.21.15.81:0/4275539154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1f720 0x55b67bf826b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc9288a5700 1 -- 172.21.15.81:0/4275539154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b67bc96b60 con 0x55b67bf19890 2024-05-09T00:05:49.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc9290a6700 1 --2- 172.21.15.81:0/4275539154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1f720 0x55b67bf826b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:49.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc9288a5700 1 --2- 172.21.15.81:0/4275539154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf19890 0x55b67bf26470 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x55b67bf35eb0 tx=0x7fc918004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a905108c76c4d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc903fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:49.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc903fff700 1 -- 172.21.15.81:0/4275539154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918028070 con 0x55b67bf19890 2024-05-09T00:05:49.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc903fff700 1 -- 172.21.15.81:0/4275539154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fc91800ed70 con 0x55b67bf19890 2024-05-09T00:05:49.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc936cc3b80 1 -- 172.21.15.81:0/4275539154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9100a1cd0 con 0x55b67bf19890 2024-05-09T00:05:49.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc903fff700 1 -- 172.21.15.81:0/4275539154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9180281d0 con 0x55b67bf19890 2024-05-09T00:05:49.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc936cc3b80 10 client.16173 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:49.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.142+0000 7fc936cc3b80 1 -- 172.21.15.81:0/4275539154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b67bceecd0 con 0x55b67bf19890 2024-05-09T00:05:49.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.143+0000 7fc903fff700 1 -- 172.21.15.81:0/4275539154 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9100a1cd0 con 0x55b67bf19890 2024-05-09T00:05:49.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.143+0000 7fc903fff700 1 -- 172.21.15.81:0/4275539154 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc918015790 con 0x55b67bf19890 2024-05-09T00:05:49.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.143+0000 7fc936cc3b80 10 client.16173 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:49.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.143+0000 7fc936cc3b80 10 client.16173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:49.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.143+0000 7fc936cc3b80 20 client.16173 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:49.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.143+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/4275539154 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b67bf8a650 0x55b67bf8ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.143+0000 7fc936cc3b80 4 client.16173 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:05:49.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.143+0000 7fc936cc3b80 1 -- 172.21.15.81:0/4275539154 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b67be61ec0 con 0x55b67bf8a650 2024-05-09T00:05:49.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.143+0000 7fc923fff700 1 --2- 172.21.15.81:0/4275539154 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b67bf8a650 0x55b67bf8ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.143+0000 7fc903fff700 10 client.16173 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:49.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.143+0000 7fc923fff700 1 --2- 172.21.15.81:0/4275539154 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b67bf8a650 0x55b67bf8ca70 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e777ba9cad1dc64d server_cookie=d219875ccba91fe2 in_seq=0 out_seq=0 2024-05-09T00:05:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc903fff700 1 -- 172.21.15.81:0/4275539154 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b67be61ec0 con 0x55b67bf8a650 2024-05-09T00:05:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc903fff700 10 client.16173 handle_command_reply: tid=0 2024-05-09T00:05:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc936cc3b80 1 client.16173 shutdown 2024-05-09T00:05:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc936cc3b80 1 -- 172.21.15.81:0/4275539154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf19890 msgr2=0x55b67bf26470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/4275539154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf19890 0x55b67bf26470 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x55b67bf35eb0 tx=0x7fc918004750 comp rx=0 tx=0).stop 2024-05-09T00:05:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc936cc3b80 1 -- 172.21.15.81:0/4275539154 shutdown_connections 2024-05-09T00:05:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/4275539154 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b67bf8a650 0x55b67bf8ca70 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/4275539154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b67bf1f720 0x55b67bf826b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/4275539154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b67bf19890 0x55b67bf26470 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc903fff700 0 client.16173 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:49.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc936cc3b80 1 --2- 172.21.15.81:0/4275539154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b67bf1ee00 0x55b67bf269b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc936cc3b80 1 -- 172.21.15.81:0/4275539154 >> 172.21.15.81:0/4275539154 conn(0x55b67be77210 msgr2=0x55b67bf21040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc936cc3b80 1 -- 172.21.15.81:0/4275539154 shutdown_connections 2024-05-09T00:05:49.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc936cc3b80 1 -- 172.21.15.81:0/4275539154 wait complete. 2024-05-09T00:05:49.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc936cc3b80 20 client.16173 trim_cache size 0 max 16384 2024-05-09T00:05:49.156 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:05:49.156 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:05:49.157 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:05:49.157 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:05:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc92ab09700 1 -- 172.21.15.81:0/2385258813 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc9140a1310 msgr2=0x7fc9140a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc92ab09700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc9140a1310 0x7fc9140a37d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc918009a10 tx=0x7fc918009190 comp rx=0 tx=0).stop 2024-05-09T00:05:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc92ab09700 1 -- 172.21.15.81:0/2385258813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc924105160 msgr2=0x7fc924196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc92ab09700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc924105160 0x7fc924196a10 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc91000b500 tx=0x7fc91000b810 comp rx=0 tx=0).stop 2024-05-09T00:05:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc92ab09700 1 -- 172.21.15.81:0/2385258813 shutdown_connections 2024-05-09T00:05:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc92ab09700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc9140a1310 0x7fc9140a37d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc92ab09700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc924100060 0x7fc9241964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc92ab09700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc92419ad60 0x7fc92419b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc92ab09700 1 --2- 172.21.15.81:0/2385258813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc924105160 0x7fc924196a10 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.144+0000 7fc92ab09700 1 -- 172.21.15.81:0/2385258813 >> 172.21.15.81:0/2385258813 conn(0x7fc924076f40 msgr2=0x7fc9240fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.145+0000 7fc92ab09700 1 -- 172.21.15.81:0/2385258813 shutdown_connections 2024-05-09T00:05:49.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.145+0000 7fc92ab09700 1 -- 172.21.15.81:0/2385258813 wait complete. 2024-05-09T00:05:49.159 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:05:49.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:05:49.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:48 smithi150 ceph-mon[46187]: pgmap v89: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.287+0000 7ff86a550700 1 -- 172.21.15.81:0/623995688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff864101fd0 msgr2=0x7ff8641023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.287+0000 7ff86a550700 1 --2- 172.21.15.81:0/623995688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff864101fd0 0x7ff8641023b0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff854009990 tx=0x7ff854009ca0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.287+0000 7ff86a550700 1 -- 172.21.15.81:0/623995688 shutdown_connections 2024-05-09T00:05:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.287+0000 7ff86a550700 1 --2- 172.21.15.81:0/623995688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff86410b3f0 0x7ff86410d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.287+0000 7ff86a550700 1 --2- 172.21.15.81:0/623995688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff864101fd0 0x7ff8641023b0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.287+0000 7ff86a550700 1 --2- 172.21.15.81:0/623995688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff8641028f0 0x7ff86410add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.287+0000 7ff86a550700 1 -- 172.21.15.81:0/623995688 >> 172.21.15.81:0/623995688 conn(0x7ff8640fb7d0 msgr2=0x7ff8640fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.287+0000 7ff86a550700 1 -- 172.21.15.81:0/623995688 shutdown_connections 2024-05-09T00:05:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.287+0000 7ff86a550700 1 -- 172.21.15.81:0/623995688 wait complete. 2024-05-09T00:05:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff86a550700 1 Processor -- start 2024-05-09T00:05:49.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff86a550700 1 -- start start 2024-05-09T00:05:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff86a550700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff864101fd0 0x7ff8641972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff86a550700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8641028f0 0x7ff864197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff86a550700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff86410b3f0 0x7ff86419bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff86a550700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86419c1a0 con 0x7ff86410b3f0 2024-05-09T00:05:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff86a550700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86419c310 con 0x7ff864101fd0 2024-05-09T00:05:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff86a550700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86419c4d0 con 0x7ff8641028f0 2024-05-09T00:05:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff868aed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff86410b3f0 0x7ff86419bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff868aed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff86410b3f0 0x7ff86419bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59256/0 (socket says 172.21.15.81:59256) 2024-05-09T00:05:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff868aed700 1 -- 172.21.15.81:0/1171391335 learned_addr learned my addr 172.21.15.81:0/1171391335 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff863fff700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff864101fd0 0x7ff8641972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff8637fe700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8641028f0 0x7ff864197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff868aed700 1 -- 172.21.15.81:0/1171391335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8641028f0 msgr2=0x7ff864197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff868aed700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8641028f0 0x7ff864197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff868aed700 1 -- 172.21.15.81:0/1171391335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff864101fd0 msgr2=0x7ff8641972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff868aed700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff864101fd0 0x7ff8641972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff868aed700 1 -- 172.21.15.81:0/1171391335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8540095f0 con 0x7ff86410b3f0 2024-05-09T00:05:49.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff863fff700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff864101fd0 0x7ff8641972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.288+0000 7ff8637fe700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8641028f0 0x7ff864197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.289+0000 7ff868aed700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff86410b3f0 0x7ff86419bb60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff85c007ee0 tx=0x7ff85c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.289+0000 7ff8617fa700 1 -- 172.21.15.81:0/1171391335 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c017070 con 0x7ff86410b3f0 2024-05-09T00:05:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.289+0000 7ff8617fa700 1 -- 172.21.15.81:0/1171391335 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff85c00f040 con 0x7ff86410b3f0 2024-05-09T00:05:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.289+0000 7ff8617fa700 1 -- 172.21.15.81:0/1171391335 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c005740 con 0x7ff86410b3f0 2024-05-09T00:05:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.289+0000 7ff86a550700 1 -- 172.21.15.81:0/1171391335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86419c7b0 con 0x7ff86410b3f0 2024-05-09T00:05:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.289+0000 7ff86a550700 1 -- 172.21.15.81:0/1171391335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8641a3ff0 con 0x7ff86410b3f0 2024-05-09T00:05:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.290+0000 7ff86a550700 1 -- 172.21.15.81:0/1171391335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff864106520 con 0x7ff86410b3f0 2024-05-09T00:05:49.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.291+0000 7ff8617fa700 1 -- 172.21.15.81:0/1171391335 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ff85c0058a0 con 0x7ff86410b3f0 2024-05-09T00:05:49.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.291+0000 7ff8617fa700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff8500a1290 0x7ff8500a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.291+0000 7ff863fff700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff8500a1290 0x7ff8500a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.291+0000 7ff8617fa700 1 -- 172.21.15.81:0/1171391335 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ff85c0cc510 con 0x7ff86410b3f0 2024-05-09T00:05:49.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.292+0000 7ff863fff700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff8500a1290 0x7ff8500a3750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff85400b5c0 tx=0x7ff854005fb0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.296+0000 7ff8617fa700 1 -- 172.21.15.81:0/1171391335 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff85c095960 con 0x7ff86410b3f0 2024-05-09T00:05:49.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:48 smithi171 ceph-mon[47351]: pgmap v89: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:49.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:48 smithi081 ceph-mon[42474]: pgmap v89: 97 pgs: 97 active+clean; 2.6 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-09T00:05:49.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.538+0000 7ff86a550700 1 -- 172.21.15.81:0/1171391335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff864069cb0 con 0x7ff86410b3f0 2024-05-09T00:05:49.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.539+0000 7ff8617fa700 1 -- 172.21.15.81:0/1171391335 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7ff85c098f80 con 0x7ff86410b3f0 2024-05-09T00:05:49.533 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:05:49.533 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:05:49.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.541+0000 7ff86a550700 1 -- 172.21.15.81:0/1171391335 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff8500a1290 msgr2=0x7ff8500a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.541+0000 7ff86a550700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff8500a1290 0x7ff8500a3750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff85400b5c0 tx=0x7ff854005fb0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.541+0000 7ff86a550700 1 -- 172.21.15.81:0/1171391335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff86410b3f0 msgr2=0x7ff86419bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.541+0000 7ff86a550700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff86410b3f0 0x7ff86419bb60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff85c007ee0 tx=0x7ff85c00d3b0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.541+0000 7ff86a550700 1 -- 172.21.15.81:0/1171391335 shutdown_connections 2024-05-09T00:05:49.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.541+0000 7ff86a550700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff8500a1290 0x7ff8500a3750 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.541+0000 7ff86a550700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff864101fd0 0x7ff8641972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.541+0000 7ff86a550700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff86410b3f0 0x7ff86419bb60 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.541+0000 7ff86a550700 1 --2- 172.21.15.81:0/1171391335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff8641028f0 0x7ff864197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.541+0000 7ff86a550700 1 -- 172.21.15.81:0/1171391335 >> 172.21.15.81:0/1171391335 conn(0x7ff8640fb7d0 msgr2=0x7ff8640fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.541+0000 7ff86a550700 1 -- 172.21.15.81:0/1171391335 shutdown_connections 2024-05-09T00:05:49.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.541+0000 7ff86a550700 1 -- 172.21.15.81:0/1171391335 wait complete. 2024-05-09T00:05:49.536 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:05:49.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:05:49.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.678+0000 7f620126b700 1 -- 172.21.15.81:0/1157901672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc105170 msgr2=0x7f61fc10ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.678+0000 7f620126b700 1 --2- 172.21.15.81:0/1157901672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc105170 0x7f61fc10ccf0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009990 tx=0x7f61f4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.678+0000 7f620126b700 1 -- 172.21.15.81:0/1157901672 shutdown_connections 2024-05-09T00:05:49.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.678+0000 7f620126b700 1 --2- 172.21.15.81:0/1157901672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc105170 0x7f61fc10ccf0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.678+0000 7f620126b700 1 --2- 172.21.15.81:0/1157901672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61fc100060 0x7f61fc100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.678+0000 7f620126b700 1 --2- 172.21.15.81:0/1157901672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61fc100a10 0x7f61fc104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.678+0000 7f620126b700 1 -- 172.21.15.81:0/1157901672 >> 172.21.15.81:0/1157901672 conn(0x7f61fc076f30 msgr2=0x7f61fc077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.678+0000 7f620126b700 1 -- 172.21.15.81:0/1157901672 shutdown_connections 2024-05-09T00:05:49.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.678+0000 7f620126b700 1 -- 172.21.15.81:0/1157901672 wait complete. 2024-05-09T00:05:49.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f620126b700 1 Processor -- start 2024-05-09T00:05:49.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f620126b700 1 -- start start 2024-05-09T00:05:49.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f620126b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61fc100060 0x7f61fc196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f620126b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc105170 0x7f61fc196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f620126b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61fc19aaf0 0x7f61fc19af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f620126b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc19b570 con 0x7f61fc105170 2024-05-09T00:05:49.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f620126b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc19b6e0 con 0x7f61fc19aaf0 2024-05-09T00:05:49.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f620126b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc19b8a0 con 0x7f61fc100060 2024-05-09T00:05:49.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f61fa7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc105170 0x7f61fc196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f61fa7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc105170 0x7f61fc196750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59276/0 (socket says 172.21.15.81:59276) 2024-05-09T00:05:49.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f61fa7fc700 1 -- 172.21.15.81:0/1304913829 learned_addr learned my addr 172.21.15.81:0/1304913829 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f61fb7fe700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61fc19aaf0 0x7f61fc19af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f61faffd700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61fc100060 0x7f61fc196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f61fa7fc700 1 -- 172.21.15.81:0/1304913829 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61fc100060 msgr2=0x7f61fc196210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f61fa7fc700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61fc100060 0x7f61fc196210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f61fa7fc700 1 -- 172.21.15.81:0/1304913829 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61fc19aaf0 msgr2=0x7f61fc19af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.679+0000 7f61fa7fc700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61fc19aaf0 0x7f61fc19af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.680+0000 7f61fa7fc700 1 -- 172.21.15.81:0/1304913829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f40095f0 con 0x7f61fc105170 2024-05-09T00:05:49.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.680+0000 7f61fb7fe700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61fc19aaf0 0x7f61fc19af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:49.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.680+0000 7f61fa7fc700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc105170 0x7f61fc196750 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f61f000c8f0 tx=0x7f61f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.680+0000 7f61e3fff700 1 -- 172.21.15.81:0/1304913829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0007b00 con 0x7f61fc105170 2024-05-09T00:05:49.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.680+0000 7f620126b700 1 -- 172.21.15.81:0/1304913829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61fc1a2e00 con 0x7f61fc105170 2024-05-09T00:05:49.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.680+0000 7f61e3fff700 1 -- 172.21.15.81:0/1304913829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61f0007c60 con 0x7f61fc105170 2024-05-09T00:05:49.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.680+0000 7f61e3fff700 1 -- 172.21.15.81:0/1304913829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0018660 con 0x7f61fc105170 2024-05-09T00:05:49.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.680+0000 7f620126b700 1 -- 172.21.15.81:0/1304913829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61fc1a3290 con 0x7f61fc105170 2024-05-09T00:05:49.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.682+0000 7f61e3fff700 1 -- 172.21.15.81:0/1304913829 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f61f000f450 con 0x7f61fc105170 2024-05-09T00:05:49.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.683+0000 7f61e3fff700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f61e40a1290 0x7f61e40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.683+0000 7f61faffd700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f61e40a1290 0x7f61e40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.683+0000 7f61e3fff700 1 -- 172.21.15.81:0/1304913829 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f61f00ccc20 con 0x7f61fc105170 2024-05-09T00:05:49.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.683+0000 7f61faffd700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f61e40a1290 0x7f61e40a3750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00e270 tx=0x7f61ec009040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f620d425b80 1 Processor -- start 2024-05-09T00:05:49.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f620d425b80 1 -- start start 2024-05-09T00:05:49.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f620d425b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b20e00 0x559505b211e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f620d425b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b21720 0x559505b1b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f620d425b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b1bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f620d425b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559505a72150 con 0x559505b1b890 2024-05-09T00:05:49.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f620d425b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559505a6fb10 con 0x559505b20e00 2024-05-09T00:05:49.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f620d425b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559505a6b400 con 0x559505b21720 2024-05-09T00:05:49.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f61fb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b1bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f61fb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b1bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59286/0 (socket says 172.21.15.81:59286) 2024-05-09T00:05:49.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f61fb7fe700 1 -- 172.21.15.81:0/1396753367 learned_addr learned my addr 172.21.15.81:0/1396753367 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f61fa7fc700 1 --2- 172.21.15.81:0/1396753367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b21720 0x559505b1b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f61faffd700 1 --2- 172.21.15.81:0/1396753367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b20e00 0x559505b211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f61fb7fe700 1 -- 172.21.15.81:0/1396753367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b21720 msgr2=0x559505b1b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f61fb7fe700 1 --2- 172.21.15.81:0/1396753367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b21720 0x559505b1b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f61fb7fe700 1 -- 172.21.15.81:0/1396753367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b20e00 msgr2=0x559505b211e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f61fb7fe700 1 --2- 172.21.15.81:0/1396753367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b20e00 0x559505b211e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f61fb7fe700 1 -- 172.21.15.81:0/1396753367 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595058ec3b0 con 0x559505b1b890 2024-05-09T00:05:49.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f61fa7fc700 1 --2- 172.21.15.81:0/1396753367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b21720 0x559505b1b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:49.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.684+0000 7f61fb7fe700 1 --2- 172.21.15.81:0/1396753367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b1bcd0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f61f4005bc0 tx=0x7f61f4005bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8c00ec50f3b3ef server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.685+0000 7f61e17fa700 1 -- 172.21.15.81:0/1396753367 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f40054a0 con 0x559505b1b890 2024-05-09T00:05:49.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.685+0000 7f61e17fa700 1 -- 172.21.15.81:0/1396753367 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61f401e040 con 0x559505b1b890 2024-05-09T00:05:49.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.685+0000 7f61e17fa700 1 -- 172.21.15.81:0/1396753367 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4004990 con 0x559505b1b890 2024-05-09T00:05:49.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.685+0000 7f620d425b80 1 -- 172.21.15.81:0/1396753367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 msgr2=0x559505b1bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.685+0000 7f620d425b80 1 --2- 172.21.15.81:0/1396753367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b1bcd0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f61f4005bc0 tx=0x7f61f4005bf0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.685+0000 7f620d425b80 1 -- 172.21.15.81:0/1396753367 shutdown_connections 2024-05-09T00:05:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.685+0000 7f620d425b80 1 --2- 172.21.15.81:0/1396753367 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b20e00 0x559505b211e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.685+0000 7f620d425b80 1 --2- 172.21.15.81:0/1396753367 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b1bcd0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.685+0000 7f620d425b80 1 --2- 172.21.15.81:0/1396753367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b21720 0x559505b1b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.685+0000 7f620d425b80 1 -- 172.21.15.81:0/1396753367 >> 172.21.15.81:0/1396753367 conn(0x559505a79210 msgr2=0x559505b15df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.685+0000 7f620d425b80 1 -- 172.21.15.81:0/1396753367 shutdown_connections 2024-05-09T00:05:49.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.685+0000 7f620d425b80 1 -- 172.21.15.81:0/1396753367 wait complete. 2024-05-09T00:05:49.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f620d425b80 1 -- start start 2024-05-09T00:05:49.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f620d425b80 1 Processor -- start 2024-05-09T00:05:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f620d425b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b28160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f620d425b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b20e00 0x559505b286a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f620d425b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b21720 0x559505b28be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f620d425b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559505a07560 con 0x559505b1b890 2024-05-09T00:05:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f620d425b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559505a07200 con 0x559505b21720 2024-05-09T00:05:49.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f620d425b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595058ee6a0 con 0x559505b20e00 2024-05-09T00:05:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f620d425b80 10 client.0 _ll_register_callbacks cb 0x559505a10b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f61faffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b28160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f61faffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b28160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59290/0 (socket says 172.21.15.81:59290) 2024-05-09T00:05:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f61faffd700 1 -- 172.21.15.81:0/211708798 learned_addr learned my addr 172.21.15.81:0/211708798 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f61fa7fc700 1 --2- 172.21.15.81:0/211708798 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b20e00 0x559505b286a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f61fb7fe700 1 --2- 172.21.15.81:0/211708798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b21720 0x559505b28be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f61faffd700 1 -- 172.21.15.81:0/211708798 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b20e00 msgr2=0x559505b286a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f61faffd700 1 --2- 172.21.15.81:0/211708798 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b20e00 0x559505b286a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f61faffd700 1 -- 172.21.15.81:0/211708798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b21720 msgr2=0x559505b28be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f61faffd700 1 --2- 172.21.15.81:0/211708798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b21720 0x559505b28be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f61faffd700 1 -- 172.21.15.81:0/211708798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61fc10d560 con 0x559505b1b890 2024-05-09T00:05:49.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.686+0000 7f61fb7fe700 1 --2- 172.21.15.81:0/211708798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b21720 0x559505b28be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:49.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f61faffd700 1 --2- 172.21.15.81:0/211708798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b28160 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0159e0 tx=0x7f61ec004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d34e1e080ea514 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f61deff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:49.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f61deff5700 1 -- 172.21.15.81:0/211708798 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec00edf0 con 0x559505b1b890 2024-05-09T00:05:49.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f620d425b80 1 -- 172.21.15.81:0/211708798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595059c4270 con 0x559505b1b890 2024-05-09T00:05:49.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f61deff5700 1 -- 172.21.15.81:0/211708798 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f61ec013a80 con 0x559505b1b890 2024-05-09T00:05:49.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f61deff5700 1 -- 172.21.15.81:0/211708798 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61ec015e50 con 0x559505b1b890 2024-05-09T00:05:49.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f620d425b80 10 client.16191 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:49.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f620d425b80 1 -- 172.21.15.81:0/211708798 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559505898b60 con 0x559505b1b890 2024-05-09T00:05:49.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f61deff5700 1 -- 172.21.15.81:0/211708798 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5595059c4270 con 0x559505b1b890 2024-05-09T00:05:49.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f61deff5700 1 -- 172.21.15.81:0/211708798 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f61ec02a3b0 con 0x559505b1b890 2024-05-09T00:05:49.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f620d425b80 10 client.16191 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:49.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f620d425b80 10 client.16191 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:05:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f620d425b80 20 client.16191 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f620d425b80 1 --2- 172.21.15.81:0/211708798 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x559505b373b0 0x559505b397d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f620d425b80 4 client.16191 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.687+0000 7f620d425b80 1 -- 172.21.15.81:0/211708798 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559505aea810 con 0x559505b373b0 2024-05-09T00:05:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.688+0000 7f61fa7fc700 1 --2- 172.21.15.81:0/211708798 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x559505b373b0 0x559505b397d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.688+0000 7f61deff5700 10 client.16191 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:05:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.688+0000 7f61fa7fc700 1 --2- 172.21.15.81:0/211708798 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x559505b373b0 0x559505b397d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c9d1f522c72a45a server_cookie=54b12563a15816bb in_seq=0 out_seq=0 2024-05-09T00:05:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f61deff5700 1 -- 172.21.15.81:0/211708798 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559505aea810 con 0x559505b373b0 2024-05-09T00:05:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f61deff5700 10 client.16191 handle_command_reply: tid=0 2024-05-09T00:05:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f620d425b80 1 client.16191 shutdown 2024-05-09T00:05:49.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f620d425b80 1 -- 172.21.15.81:0/211708798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 msgr2=0x559505b28160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f620d425b80 1 --2- 172.21.15.81:0/211708798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b28160 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0159e0 tx=0x7f61ec004b40 comp rx=0 tx=0).stop 2024-05-09T00:05:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f620d425b80 1 -- 172.21.15.81:0/211708798 shutdown_connections 2024-05-09T00:05:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f620d425b80 1 --2- 172.21.15.81:0/211708798 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x559505b373b0 0x559505b397d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f620d425b80 1 --2- 172.21.15.81:0/211708798 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b21720 0x559505b28be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f61deff5700 0 client.16191 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:05:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f620d425b80 1 --2- 172.21.15.81:0/211708798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b28160 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f620d425b80 1 --2- 172.21.15.81:0/211708798 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b20e00 0x559505b286a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f620d425b80 1 -- 172.21.15.81:0/211708798 >> 172.21.15.81:0/211708798 conn(0x559505a79210 msgr2=0x559505b155a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f620d425b80 1 -- 172.21.15.81:0/211708798 shutdown_connections 2024-05-09T00:05:49.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f620d425b80 1 -- 172.21.15.81:0/211708798 wait complete. 2024-05-09T00:05:49.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.689+0000 7f620d425b80 20 client.16191 trim_cache size 0 max 16384 2024-05-09T00:05:49.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.702+0000 7f620d425b80 1 Processor -- start 2024-05-09T00:05:49.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.702+0000 7f620d425b80 1 -- start start 2024-05-09T00:05:49.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f620d425b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b17a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f620d425b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b20e00 0x559505b1f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f620d425b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b21720 0x559505b3e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f620d425b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559505b33ec0 con 0x559505b1b890 2024-05-09T00:05:49.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f620d425b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559505b25270 con 0x559505b20e00 2024-05-09T00:05:49.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f620d425b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559505b1c230 con 0x559505b21720 2024-05-09T00:05:49.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f61faffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b17a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f61faffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b17a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59296/0 (socket says 172.21.15.81:59296) 2024-05-09T00:05:49.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f61faffd700 1 -- 172.21.15.81:0/3798271269 learned_addr learned my addr 172.21.15.81:0/3798271269 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f61faffd700 1 -- 172.21.15.81:0/3798271269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b21720 msgr2=0x559505b3e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f61faffd700 1 --2- 172.21.15.81:0/3798271269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b21720 0x559505b3e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f61faffd700 1 -- 172.21.15.81:0/3798271269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b20e00 msgr2=0x559505b1f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f61faffd700 1 --2- 172.21.15.81:0/3798271269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b20e00 0x559505b1f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f61faffd700 1 -- 172.21.15.81:0/3798271269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559505a31560 con 0x559505b1b890 2024-05-09T00:05:49.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f61faffd700 1 --2- 172.21.15.81:0/3798271269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b17a00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0159b0 tx=0x7f61ec007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13e525b002b11e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f61e1ffb700 1 -- 172.21.15.81:0/3798271269 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec015e50 con 0x559505b1b890 2024-05-09T00:05:49.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f61e1ffb700 1 -- 172.21.15.81:0/3798271269 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61ec0136c0 con 0x559505b1b890 2024-05-09T00:05:49.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.703+0000 7f61e1ffb700 1 -- 172.21.15.81:0/3798271269 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec033630 con 0x559505b1b890 2024-05-09T00:05:49.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.704+0000 7f620d425b80 1 -- 172.21.15.81:0/3798271269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 msgr2=0x559505b17a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.704+0000 7f620d425b80 1 --2- 172.21.15.81:0/3798271269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b17a00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f61ec0159b0 tx=0x7f61ec007e10 comp rx=0 tx=0).stop 2024-05-09T00:05:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.704+0000 7f620d425b80 1 -- 172.21.15.81:0/3798271269 shutdown_connections 2024-05-09T00:05:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.704+0000 7f620d425b80 1 --2- 172.21.15.81:0/3798271269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b21720 0x559505b3e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.704+0000 7f620d425b80 1 --2- 172.21.15.81:0/3798271269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b1b890 0x559505b17a00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.704+0000 7f620d425b80 1 --2- 172.21.15.81:0/3798271269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b20e00 0x559505b1f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.704+0000 7f620d425b80 1 -- 172.21.15.81:0/3798271269 >> 172.21.15.81:0/3798271269 conn(0x559505a79210 msgr2=0x559505b32bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.704+0000 7f620d425b80 1 -- 172.21.15.81:0/3798271269 shutdown_connections 2024-05-09T00:05:49.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.704+0000 7f620d425b80 1 -- 172.21.15.81:0/3798271269 wait complete. 2024-05-09T00:05:49.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.704+0000 7f620d425b80 1 -- start start 2024-05-09T00:05:49.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.704+0000 7f620d425b80 1 Processor -- start 2024-05-09T00:05:49.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f620d425b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b1b890 0x559505b29e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f620d425b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b20e00 0x559505b2a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f620d425b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b21720 0x559505b8c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f620d425b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559505b2aba0 con 0x559505b21720 2024-05-09T00:05:49.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f620d425b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559505b2ad10 con 0x559505b1b890 2024-05-09T00:05:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f620d425b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559505b8ce70 con 0x559505b20e00 2024-05-09T00:05:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f620d425b80 10 client.0 _ll_register_callbacks cb 0x559505a10b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61fb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b21720 0x559505b8c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61fb7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b21720 0x559505b8c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59308/0 (socket says 172.21.15.81:59308) 2024-05-09T00:05:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61fb7fe700 1 -- 172.21.15.81:0/1996341303 learned_addr learned my addr 172.21.15.81:0/1996341303 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61fa7fc700 1 --2- 172.21.15.81:0/1996341303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b20e00 0x559505b2a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61faffd700 1 --2- 172.21.15.81:0/1996341303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b1b890 0x559505b29e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61fb7fe700 1 -- 172.21.15.81:0/1996341303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b20e00 msgr2=0x559505b2a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61fb7fe700 1 --2- 172.21.15.81:0/1996341303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b20e00 0x559505b2a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61fb7fe700 1 -- 172.21.15.81:0/1996341303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b1b890 msgr2=0x559505b29e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61fb7fe700 1 --2- 172.21.15.81:0/1996341303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b1b890 0x559505b29e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61fb7fe700 1 -- 172.21.15.81:0/1996341303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559505898b60 con 0x559505b21720 2024-05-09T00:05:49.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61faffd700 1 --2- 172.21.15.81:0/1996341303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b1b890 0x559505b29e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:49.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61fb7fe700 1 --2- 172.21.15.81:0/1996341303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b21720 0x559505b8c8b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009990 tx=0x7f61f400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da40269fea6574a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61deff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61deff5700 1 -- 172.21.15.81:0/1996341303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4004700 con 0x559505b21720 2024-05-09T00:05:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f61deff5700 1 -- 172.21.15.81:0/1996341303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f61f400be80 con 0x559505b21720 2024-05-09T00:05:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.705+0000 7f620d425b80 1 -- 172.21.15.81:0/1996341303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61f401e040 con 0x559505b21720 2024-05-09T00:05:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.706+0000 7f61deff5700 1 -- 172.21.15.81:0/1996341303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61f4005710 con 0x559505b21720 2024-05-09T00:05:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.706+0000 7f620d425b80 10 client.16197 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.706+0000 7f620d425b80 1 -- 172.21.15.81:0/1996341303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5595058f0cd0 con 0x559505b21720 2024-05-09T00:05:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.706+0000 7f61deff5700 1 -- 172.21.15.81:0/1996341303 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61f401e040 con 0x559505b21720 2024-05-09T00:05:49.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.706+0000 7f61deff5700 1 -- 172.21.15.81:0/1996341303 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f61f400f760 con 0x559505b21720 2024-05-09T00:05:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.706+0000 7f620d425b80 10 client.16197 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.706+0000 7f620d425b80 10 client.16197 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:05:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.706+0000 7f620d425b80 20 client.16197 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.706+0000 7f620d425b80 1 --2- 172.21.15.81:0/1996341303 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x559505b8e2d0 0x559505b906c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.706+0000 7f620d425b80 4 client.16197 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:05:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.706+0000 7f620d425b80 1 -- 172.21.15.81:0/1996341303 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559505a63ec0 con 0x559505b8e2d0 2024-05-09T00:05:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.706+0000 7f61faffd700 1 --2- 172.21.15.81:0/1996341303 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x559505b8e2d0 0x559505b906c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.706+0000 7f61deff5700 10 client.16197 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:05:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.706+0000 7f61faffd700 1 --2- 172.21.15.81:0/1996341303 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x559505b8e2d0 0x559505b906c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8eac525b6bf7823 server_cookie=1ad5c8b62781c56f in_seq=0 out_seq=0 2024-05-09T00:05:49.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f61deff5700 1 -- 172.21.15.81:0/1996341303 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559505a63ec0 con 0x559505b8e2d0 2024-05-09T00:05:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f61deff5700 10 client.16197 handle_command_reply: tid=0 2024-05-09T00:05:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620d425b80 1 client.16197 shutdown 2024-05-09T00:05:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620d425b80 1 -- 172.21.15.81:0/1996341303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b21720 msgr2=0x559505b8c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620d425b80 1 --2- 172.21.15.81:0/1996341303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b21720 0x559505b8c8b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009990 tx=0x7f61f400ba50 comp rx=0 tx=0).stop 2024-05-09T00:05:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620d425b80 1 -- 172.21.15.81:0/1996341303 shutdown_connections 2024-05-09T00:05:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620d425b80 1 --2- 172.21.15.81:0/1996341303 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x559505b8e2d0 0x559505b906c0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620d425b80 1 --2- 172.21.15.81:0/1996341303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559505b1b890 0x559505b29e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f61deff5700 0 client.16197 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:05:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620d425b80 1 --2- 172.21.15.81:0/1996341303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559505b21720 0x559505b8c8b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620d425b80 1 --2- 172.21.15.81:0/1996341303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559505b20e00 0x559505b2a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620d425b80 1 -- 172.21.15.81:0/1996341303 >> 172.21.15.81:0/1996341303 conn(0x559505a79210 msgr2=0x559505b3e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620d425b80 1 -- 172.21.15.81:0/1996341303 shutdown_connections 2024-05-09T00:05:49.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620d425b80 1 -- 172.21.15.81:0/1996341303 wait complete. 2024-05-09T00:05:49.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620d425b80 20 client.16197 trim_cache size 0 max 16384 2024-05-09T00:05:49.722 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:05:49.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620126b700 1 -- 172.21.15.81:0/1304913829 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f61e40a1290 msgr2=0x7f61e40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620126b700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f61e40a1290 0x7f61e40a3750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00e270 tx=0x7f61ec009040 comp rx=0 tx=0).stop 2024-05-09T00:05:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620126b700 1 -- 172.21.15.81:0/1304913829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc105170 msgr2=0x7f61fc196750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.707+0000 7f620126b700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc105170 0x7f61fc196750 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f61f000c8f0 tx=0x7f61f000ccb0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.708+0000 7f620126b700 1 -- 172.21.15.81:0/1304913829 shutdown_connections 2024-05-09T00:05:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.708+0000 7f620126b700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f61e40a1290 0x7f61e40a3750 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.708+0000 7f620126b700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61fc19aaf0 0x7f61fc19af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.708+0000 7f620126b700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61fc100060 0x7f61fc196210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.708+0000 7f620126b700 1 --2- 172.21.15.81:0/1304913829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc105170 0x7f61fc196750 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.708+0000 7f620126b700 1 -- 172.21.15.81:0/1304913829 >> 172.21.15.81:0/1304913829 conn(0x7f61fc076f30 msgr2=0x7f61fc0fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.708+0000 7f620126b700 1 -- 172.21.15.81:0/1304913829 shutdown_connections 2024-05-09T00:05:49.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.708+0000 7f620126b700 1 -- 172.21.15.81:0/1304913829 wait complete. 2024-05-09T00:05:49.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:05:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.845+0000 7f150d39e700 1 -- 172.21.15.81:0/894038835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150810db90 msgr2=0x7f150810ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.845+0000 7f150d39e700 1 --2- 172.21.15.81:0/894038835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150810db90 0x7f150810ff80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f150000b0a0 tx=0x7f150000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.845+0000 7f150d39e700 1 -- 172.21.15.81:0/894038835 shutdown_connections 2024-05-09T00:05:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.845+0000 7f150d39e700 1 --2- 172.21.15.81:0/894038835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1508101d90 0x7f1508102170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.845+0000 7f150d39e700 1 --2- 172.21.15.81:0/894038835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150810db90 0x7f150810ff80 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.845+0000 7f150d39e700 1 --2- 172.21.15.81:0/894038835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f15080ff4a0 0x7f15080ff920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.842 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.845+0000 7f150d39e700 1 -- 172.21.15.81:0/894038835 >> 172.21.15.81:0/894038835 conn(0x7f15080763a0 msgr2=0x7f15080fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.845+0000 7f150d39e700 1 -- 172.21.15.81:0/894038835 shutdown_connections 2024-05-09T00:05:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.845+0000 7f150d39e700 1 -- 172.21.15.81:0/894038835 wait complete. 2024-05-09T00:05:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.846+0000 7f150d39e700 1 Processor -- start 2024-05-09T00:05:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.846+0000 7f150d39e700 1 -- start start 2024-05-09T00:05:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.846+0000 7f150d39e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15080ff4a0 0x7f15081996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.846+0000 7f150d39e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1508101d90 0x7f1508199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.846+0000 7f150d39e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150810db90 0x7f150819df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.846+0000 7f150d39e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150819e5c0 con 0x7f150810db90 2024-05-09T00:05:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.846+0000 7f150d39e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150819e730 con 0x7f15080ff4a0 2024-05-09T00:05:49.843 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.846+0000 7f150d39e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150819e8f0 con 0x7f1508101d90 2024-05-09T00:05:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.846+0000 7f15077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150810db90 0x7f150819df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.846+0000 7f15077fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150810db90 0x7f150819df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59318/0 (socket says 172.21.15.81:59318) 2024-05-09T00:05:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.846+0000 7f15077fe700 1 -- 172.21.15.81:0/3572099831 learned_addr learned my addr 172.21.15.81:0/3572099831 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.846+0000 7f1506ffd700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15080ff4a0 0x7f15081996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.847+0000 7f15067fc700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1508101d90 0x7f1508199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.847+0000 7f15077fe700 1 -- 172.21.15.81:0/3572099831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1508101d90 msgr2=0x7f1508199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.847+0000 7f15077fe700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1508101d90 0x7f1508199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.847+0000 7f15077fe700 1 -- 172.21.15.81:0/3572099831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15080ff4a0 msgr2=0x7f15081996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.847+0000 7f15077fe700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15080ff4a0 0x7f15081996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.847+0000 7f15077fe700 1 -- 172.21.15.81:0/3572099831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1500009d00 con 0x7f150810db90 2024-05-09T00:05:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.847+0000 7f15067fc700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1508101d90 0x7f1508199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:49.844 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.847+0000 7f15077fe700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150810db90 0x7f150819df80 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f150000b070 tx=0x7f1500007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.847+0000 7f14effff700 1 -- 172.21.15.81:0/3572099831 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150000e040 con 0x7f150810db90 2024-05-09T00:05:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.847+0000 7f150d39e700 1 -- 172.21.15.81:0/3572099831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150819eb70 con 0x7f150810db90 2024-05-09T00:05:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.847+0000 7f14effff700 1 -- 172.21.15.81:0/3572099831 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1500009440 con 0x7f150810db90 2024-05-09T00:05:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.847+0000 7f14effff700 1 -- 172.21.15.81:0/3572099831 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150001b450 con 0x7f150810db90 2024-05-09T00:05:49.845 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.847+0000 7f150d39e700 1 -- 172.21.15.81:0/3572099831 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15081a6410 con 0x7f150810db90 2024-05-09T00:05:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.851+0000 7f1519558b80 1 Processor -- start 2024-05-09T00:05:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.851+0000 7f14effff700 1 -- 172.21.15.81:0/3572099831 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f150001d480 con 0x7f150810db90 2024-05-09T00:05:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.851+0000 7f1519558b80 1 -- start start 2024-05-09T00:05:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.851+0000 7f1519558b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a606b950 0x5644a606bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.851+0000 7f1519558b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606c270 0x5644a6065f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.851+0000 7f1519558b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a6066480 0x5644a60668a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.851+0000 7f1519558b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5fbd0f0 con 0x5644a606c270 2024-05-09T00:05:49.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.851+0000 7f1519558b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5fbaab0 con 0x5644a6066480 2024-05-09T00:05:49.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.851+0000 7f1519558b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5fb63a0 con 0x5644a606b950 2024-05-09T00:05:49.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.851+0000 7f1506ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606c270 0x5644a6065f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.851+0000 7f1506ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606c270 0x5644a6065f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59326/0 (socket says 172.21.15.81:59326) 2024-05-09T00:05:49.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.851+0000 7f1506ffd700 1 -- 172.21.15.81:0/853578203 learned_addr learned my addr 172.21.15.81:0/853578203 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.851+0000 7f15067fc700 1 --2- 172.21.15.81:0/853578203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a606b950 0x5644a606bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.851+0000 7f14effff700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14f00a1290 0x7f14f00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.852+0000 7f15067fc700 1 --2- 172.21.15.81:0/853578203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a6066480 0x5644a60668a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.852+0000 7f15077fe700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14f00a1290 0x7f14f00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.852+0000 7f1506ffd700 1 -- 172.21.15.81:0/853578203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a606b950 msgr2=0x5644a606bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.852+0000 7f1506ffd700 1 --2- 172.21.15.81:0/853578203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a606b950 0x5644a606bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.852+0000 7f1506ffd700 1 -- 172.21.15.81:0/853578203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a6066480 msgr2=0x5644a60668a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.852+0000 7f1506ffd700 1 --2- 172.21.15.81:0/853578203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a6066480 0x5644a60668a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.852+0000 7f1506ffd700 1 -- 172.21.15.81:0/853578203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644a5e37350 con 0x5644a606c270 2024-05-09T00:05:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.852+0000 7f15067fc700 1 --2- 172.21.15.81:0/853578203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a6066480 0x5644a60668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.852+0000 7f14effff700 1 -- 172.21.15.81:0/3572099831 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f15000ce210 con 0x7f150810db90 2024-05-09T00:05:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.852+0000 7f1506ffd700 1 --2- 172.21.15.81:0/853578203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606c270 0x5644a6065f40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f14f800bcf0 tx=0x7f14f80103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1684e75684cc7b41 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.852+0000 7f14ed7fa700 1 -- 172.21.15.81:0/853578203 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f8010c50 con 0x5644a606c270 2024-05-09T00:05:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.852+0000 7f15077fe700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14f00a1290 0x7f14f00a3750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1500061c40 tx=0x7f1500086040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.852+0000 7f14ed7fa700 1 -- 172.21.15.81:0/853578203 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14f8015070 con 0x5644a606c270 2024-05-09T00:05:49.856 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.852+0000 7f14ed7fa700 1 -- 172.21.15.81:0/853578203 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f8005020 con 0x5644a606c270 2024-05-09T00:05:49.856 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.853+0000 7f1519558b80 1 -- 172.21.15.81:0/853578203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606c270 msgr2=0x5644a6065f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.856 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.853+0000 7f1519558b80 1 --2- 172.21.15.81:0/853578203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606c270 0x5644a6065f40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f14f800bcf0 tx=0x7f14f80103d0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.856 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.853+0000 7f1519558b80 1 -- 172.21.15.81:0/853578203 shutdown_connections 2024-05-09T00:05:49.856 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.853+0000 7f1519558b80 1 --2- 172.21.15.81:0/853578203 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a6066480 0x5644a60668a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.856 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.853+0000 7f1519558b80 1 --2- 172.21.15.81:0/853578203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a606b950 0x5644a606bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.856 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.853+0000 7f1519558b80 1 --2- 172.21.15.81:0/853578203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606c270 0x5644a6065f40 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.856 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.853+0000 7f1519558b80 1 -- 172.21.15.81:0/853578203 >> 172.21.15.81:0/853578203 conn(0x5644a5fc41b0 msgr2=0x5644a6060840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.856 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.853+0000 7f1519558b80 1 -- 172.21.15.81:0/853578203 shutdown_connections 2024-05-09T00:05:49.856 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.853+0000 7f1519558b80 1 -- 172.21.15.81:0/853578203 wait complete. 2024-05-09T00:05:49.856 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.853+0000 7f1519558b80 1 -- start start 2024-05-09T00:05:49.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.853+0000 7f1519558b80 1 Processor -- start 2024-05-09T00:05:49.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1519558b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a6066480 0x5644a60721c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1519558b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b950 0x5644a606f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1519558b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a606c270 0x5644a606fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1519558b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5f52500 con 0x5644a606b950 2024-05-09T00:05:49.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1519558b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5f521a0 con 0x5644a6066480 2024-05-09T00:05:49.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1519558b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a5e39640 con 0x5644a606c270 2024-05-09T00:05:49.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1519558b80 10 client.0 _ll_register_callbacks cb 0x5644a5f5bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:49.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1506ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b950 0x5644a606f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1506ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b950 0x5644a606f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59332/0 (socket says 172.21.15.81:59332) 2024-05-09T00:05:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1506ffd700 1 -- 172.21.15.81:0/3832858751 learned_addr learned my addr 172.21.15.81:0/3832858751 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f15067fc700 1 --2- 172.21.15.81:0/3832858751 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a6066480 0x5644a60721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f15067fc700 1 --2- 172.21.15.81:0/3832858751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a606c270 0x5644a606fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1506ffd700 1 -- 172.21.15.81:0/3832858751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a606c270 msgr2=0x5644a606fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1506ffd700 1 --2- 172.21.15.81:0/3832858751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a606c270 0x5644a606fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1506ffd700 1 -- 172.21.15.81:0/3832858751 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a6066480 msgr2=0x5644a60721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1506ffd700 1 --2- 172.21.15.81:0/3832858751 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a6066480 0x5644a60721c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1506ffd700 1 -- 172.21.15.81:0/3832858751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f800b920 con 0x5644a606b950 2024-05-09T00:05:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1506ffd700 1 --2- 172.21.15.81:0/3832858751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b950 0x5644a606f550 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f14f8004ab0 tx=0x7f14f8010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cd1945a93aec03 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f14eaff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f14eaff5700 1 -- 172.21.15.81:0/3832858751 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f8020070 con 0x5644a606b950 2024-05-09T00:05:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f14eaff5700 1 -- 172.21.15.81:0/3832858751 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f14f8017070 con 0x5644a606b950 2024-05-09T00:05:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.854+0000 7f1519558b80 1 -- 172.21.15.81:0/3832858751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644a5f0f210 con 0x5644a606b950 2024-05-09T00:05:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.855+0000 7f14eaff5700 1 -- 172.21.15.81:0/3832858751 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14f80047c0 con 0x5644a606b950 2024-05-09T00:05:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.855+0000 7f1519558b80 10 client.16209 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.855+0000 7f1519558b80 1 -- 172.21.15.81:0/3832858751 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5644a5de3b00 con 0x5644a606b950 2024-05-09T00:05:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.855+0000 7f14eaff5700 1 -- 172.21.15.81:0/3832858751 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14f8031080 con 0x5644a606b950 2024-05-09T00:05:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.855+0000 7f14eaff5700 1 -- 172.21.15.81:0/3832858751 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f14f802b030 con 0x5644a606b950 2024-05-09T00:05:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.855+0000 7f1519558b80 10 client.16209 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.855+0000 7f1519558b80 10 client.16209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:49.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.855+0000 7f1519558b80 20 client.16209 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.855+0000 7f1519558b80 1 --2- 172.21.15.81:0/3832858751 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5644a607fa80 0x5644a6081ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.855+0000 7f1519558b80 4 client.16209 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.855+0000 7f1519558b80 1 -- 172.21.15.81:0/3832858751 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5644a60357b0 con 0x5644a607fa80 2024-05-09T00:05:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.855+0000 7f15067fc700 1 --2- 172.21.15.81:0/3832858751 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5644a607fa80 0x5644a6081ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.856+0000 7f14eaff5700 10 client.16209 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.856+0000 7f15067fc700 1 --2- 172.21.15.81:0/3832858751 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5644a607fa80 0x5644a6081ea0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3598243b5885a5f9 server_cookie=e947bda024c971ac in_seq=0 out_seq=0 2024-05-09T00:05:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.856+0000 7f14eaff5700 1 -- 172.21.15.81:0/3832858751 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5644a60357b0 con 0x5644a607fa80 2024-05-09T00:05:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.856+0000 7f14eaff5700 10 client.16209 handle_command_reply: tid=0 2024-05-09T00:05:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.856+0000 7f1519558b80 1 client.16209 shutdown 2024-05-09T00:05:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.856+0000 7f1519558b80 1 -- 172.21.15.81:0/3832858751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b950 msgr2=0x5644a606f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.856+0000 7f1519558b80 1 --2- 172.21.15.81:0/3832858751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b950 0x5644a606f550 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f14f8004ab0 tx=0x7f14f8010c80 comp rx=0 tx=0).stop 2024-05-09T00:05:49.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.857+0000 7f1519558b80 1 -- 172.21.15.81:0/3832858751 shutdown_connections 2024-05-09T00:05:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.857+0000 7f1519558b80 1 --2- 172.21.15.81:0/3832858751 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5644a607fa80 0x5644a6081ea0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.857+0000 7f1519558b80 1 --2- 172.21.15.81:0/3832858751 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a6066480 0x5644a60721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.857+0000 7f1519558b80 1 --2- 172.21.15.81:0/3832858751 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a606c270 0x5644a606fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.857+0000 7f1519558b80 1 --2- 172.21.15.81:0/3832858751 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b950 0x5644a606f550 secure :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f14f8004ab0 tx=0x7f14f8010c80 comp rx=0 tx=0).stop 2024-05-09T00:05:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.857+0000 7f1519558b80 1 -- 172.21.15.81:0/3832858751 >> 172.21.15.81:0/3832858751 conn(0x5644a5fc41b0 msgr2=0x5644a6069460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.857+0000 7f14eaff5700 0 client.16209 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.857+0000 7f1519558b80 1 -- 172.21.15.81:0/3832858751 shutdown_connections 2024-05-09T00:05:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.857+0000 7f1519558b80 1 -- 172.21.15.81:0/3832858751 wait complete. 2024-05-09T00:05:49.861 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.857+0000 7f1519558b80 20 client.16209 trim_cache size 0 max 16384 2024-05-09T00:05:49.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.860+0000 7fcaaf8ba700 1 -- 172.21.15.81:0/3479333112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa8073c70 msgr2=0x7fcaa810d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.860+0000 7fcaaf8ba700 1 --2- 172.21.15.81:0/3479333112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa8073c70 0x7fcaa810d270 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fca98009990 tx=0x7fca98009ca0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.860+0000 7fcaaf8ba700 1 -- 172.21.15.81:0/3479333112 shutdown_connections 2024-05-09T00:05:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.860+0000 7fcaaf8ba700 1 --2- 172.21.15.81:0/3479333112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcaa810d7b0 0x7fcaa810fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.860+0000 7fcaaf8ba700 1 --2- 172.21.15.81:0/3479333112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcaa8073350 0x7fcaa8073730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.860+0000 7fcaaf8ba700 1 --2- 172.21.15.81:0/3479333112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa8073c70 0x7fcaa810d270 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.860+0000 7fcaaf8ba700 1 -- 172.21.15.81:0/3479333112 >> 172.21.15.81:0/3479333112 conn(0x7fcaa80fc9e0 msgr2=0x7fcaa80fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.860+0000 7fcaaf8ba700 1 -- 172.21.15.81:0/3479333112 shutdown_connections 2024-05-09T00:05:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.860+0000 7fcaaf8ba700 1 -- 172.21.15.81:0/3479333112 wait complete. 2024-05-09T00:05:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.861+0000 7fcaaf8ba700 1 Processor -- start 2024-05-09T00:05:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.861+0000 7fcaaf8ba700 1 -- start start 2024-05-09T00:05:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.861+0000 7fcaaf8ba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa8073350 0x7fcaa81996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.861+0000 7fcaaf8ba700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcaa8073c70 0x7fcaa8199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.861+0000 7fcaaf8ba700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcaa810d7b0 0x7fcaa819df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.861+0000 7fcaaf8ba700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa819e5c0 con 0x7fcaa8073350 2024-05-09T00:05:49.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.861+0000 7fcaaf8ba700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa819e730 con 0x7fcaa810d7b0 2024-05-09T00:05:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.861+0000 7fcaaf8ba700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa819e8f0 con 0x7fcaa8073c70 2024-05-09T00:05:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.861+0000 7fcaad656700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa8073350 0x7fcaa81996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.861+0000 7fcaad656700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa8073350 0x7fcaa81996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59350/0 (socket says 172.21.15.81:59350) 2024-05-09T00:05:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.861+0000 7fcaad656700 1 -- 172.21.15.81:0/3351265074 learned_addr learned my addr 172.21.15.81:0/3351265074 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.861+0000 7fcaace55700 1 --2- 172.21.15.81:0/3351265074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcaa8073c70 0x7fcaa8199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.861+0000 7fcaade57700 1 --2- 172.21.15.81:0/3351265074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcaa810d7b0 0x7fcaa819df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.862+0000 7fcaad656700 1 -- 172.21.15.81:0/3351265074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcaa8073c70 msgr2=0x7fcaa8199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.862+0000 7fcaad656700 1 --2- 172.21.15.81:0/3351265074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcaa8073c70 0x7fcaa8199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.862+0000 7fcaad656700 1 -- 172.21.15.81:0/3351265074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcaa810d7b0 msgr2=0x7fcaa819df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.862+0000 7fcaad656700 1 --2- 172.21.15.81:0/3351265074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcaa810d7b0 0x7fcaa819df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.862+0000 7fcaad656700 1 -- 172.21.15.81:0/3351265074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca980095f0 con 0x7fcaa8073350 2024-05-09T00:05:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.862+0000 7fcaad656700 1 --2- 172.21.15.81:0/3351265074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa8073350 0x7fcaa81996a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400b530 tx=0x7fcaa400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.862+0000 7fca9e7fc700 1 -- 172.21.15.81:0/3351265074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4011830 con 0x7fcaa8073350 2024-05-09T00:05:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.862+0000 7fcaaf8ba700 1 -- 172.21.15.81:0/3351265074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa819ebd0 con 0x7fcaa8073350 2024-05-09T00:05:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.862+0000 7fca9e7fc700 1 -- 172.21.15.81:0/3351265074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaa4011e50 con 0x7fcaa8073350 2024-05-09T00:05:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.862+0000 7fca9e7fc700 1 -- 172.21.15.81:0/3351265074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa400f2e0 con 0x7fcaa8073350 2024-05-09T00:05:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.862+0000 7fcaaf8ba700 1 -- 172.21.15.81:0/3351265074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa81a6410 con 0x7fcaa8073350 2024-05-09T00:05:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.865+0000 7fca9e7fc700 1 -- 172.21.15.81:0/3351265074 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fcaa4010380 con 0x7fcaa8073350 2024-05-09T00:05:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.865+0000 7fcabba74b80 1 Processor -- start 2024-05-09T00:05:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcabba74b80 1 -- start start 2024-05-09T00:05:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fca9e7fc700 1 --2- 172.21.15.81:0/3351265074 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fca940a1290 0x7fca940a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcabba74b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffa41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcabba74b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ffa4720 0x56343ff9e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcabba74b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ff9e890 0x56343ff9ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcabba74b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343fef5150 con 0x56343ff9e890 2024-05-09T00:05:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcabba74b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343fef2b10 con 0x56343ffa3e00 2024-05-09T00:05:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcabba74b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343feee400 con 0x56343ffa4720 2024-05-09T00:05:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fca9e7fc700 1 -- 172.21.15.81:0/3351265074 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fcaa40cc7a0 con 0x7fcaa8073350 2024-05-09T00:05:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcaade57700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ff9e890 0x56343ff9ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcaade57700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ff9e890 0x56343ff9ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59352/0 (socket says 172.21.15.81:59352) 2024-05-09T00:05:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcaade57700 1 -- 172.21.15.81:0/1001641569 learned_addr learned my addr 172.21.15.81:0/1001641569 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcaade57700 1 --2- 172.21.15.81:0/3351265074 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fca940a1290 0x7fca940a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcaad656700 1 --2- 172.21.15.81:0/1001641569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffa41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcaace55700 1 --2- 172.21.15.81:0/1001641569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ffa4720 0x56343ff9e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcaad656700 1 -- 172.21.15.81:0/1001641569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ffa4720 msgr2=0x56343ff9e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcaad656700 1 --2- 172.21.15.81:0/1001641569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ffa4720 0x56343ff9e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcaad656700 1 -- 172.21.15.81:0/1001641569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ff9e890 msgr2=0x56343ff9ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcaad656700 1 --2- 172.21.15.81:0/1001641569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ff9e890 0x56343ff9ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcaad656700 1 -- 172.21.15.81:0/1001641569 --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56343fd6f3b0 con 0x56343ffa3e00 2024-05-09T00:05:49.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcaade57700 1 --2- 172.21.15.81:0/1001641569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ff9e890 0x56343ff9ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:05:49.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.866+0000 7fcaade57700 1 --2- 172.21.15.81:0/3351265074 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fca940a1290 0x7fca940a3750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000acc0 tx=0x7fcaa0009a30 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.867+0000 7fcaad656700 1 --2- 172.21.15.81:0/1001641569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffa41e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40c9fc0 tx=0x7fcaa4004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25b49c14521403c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.867+0000 7fca937fe700 1 -- 172.21.15.81:0/1001641569 <== mon.2 v2:172.21.15.150:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4017ac0 con 0x56343ffa3e00 2024-05-09T00:05:49.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.867+0000 7fca937fe700 1 -- 172.21.15.81:0/1001641569 <== mon.2 v2:172.21.15.150:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaa40186e0 con 0x56343ffa3e00 2024-05-09T00:05:49.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.867+0000 7fca937fe700 1 -- 172.21.15.81:0/1001641569 <== mon.2 v2:172.21.15.150:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4010660 con 0x56343ffa3e00 2024-05-09T00:05:49.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.867+0000 7fcabba74b80 1 -- 172.21.15.81:0/1001641569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 msgr2=0x56343ffa41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.867+0000 7fcabba74b80 1 --2- 172.21.15.81:0/1001641569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffa41e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40c9fc0 tx=0x7fcaa4004860 comp rx=0 tx=0).stop 2024-05-09T00:05:49.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.867+0000 7fcabba74b80 1 -- 172.21.15.81:0/1001641569 shutdown_connections 2024-05-09T00:05:49.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 1 --2- 172.21.15.81:0/1001641569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffa41e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 1 --2- 172.21.15.81:0/1001641569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ff9e890 0x56343ff9ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 1 --2- 172.21.15.81:0/1001641569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ffa4720 0x56343ff9e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 1 -- 172.21.15.81:0/1001641569 >> 172.21.15.81:0/1001641569 conn(0x56343fefc210 msgr2=0x56343ff98df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 1 -- 172.21.15.81:0/1001641569 shutdown_connections 2024-05-09T00:05:49.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 1 -- 172.21.15.81:0/1001641569 wait complete. 2024-05-09T00:05:49.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 1 -- start start 2024-05-09T00:05:49.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 1 Processor -- start 2024-05-09T00:05:49.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 0x56343ffa7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffa7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa4720 0x56343ffa8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343fe8a560 con 0x56343ffa4720 2024-05-09T00:05:49.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343fe8a200 con 0x56343ffa3e00 2024-05-09T00:05:49.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343fd716a0 con 0x56343ff9e890 2024-05-09T00:05:49.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcabba74b80 10 client.0 _ll_register_callbacks cb 0x56343fe93b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:49.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.868+0000 7fcaade57700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa4720 0x56343ffa8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fcaade57700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa4720 0x56343ffa8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59362/0 (socket says 172.21.15.81:59362) 2024-05-09T00:05:49.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fcaade57700 1 -- 172.21.15.81:0/4106268738 learned_addr learned my addr 172.21.15.81:0/4106268738 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fcaace55700 1 --2- 172.21.15.81:0/4106268738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffa7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fcaad656700 1 --2- 172.21.15.81:0/4106268738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 0x56343ffa7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fcaade57700 1 -- 172.21.15.81:0/4106268738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 msgr2=0x56343ffa7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fcaade57700 1 --2- 172.21.15.81:0/4106268738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 0x56343ffa7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fcaade57700 1 -- 172.21.15.81:0/4106268738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 msgr2=0x56343ffa7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fcaade57700 1 --2- 172.21.15.81:0/4106268738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffa7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fcaade57700 1 -- 172.21.15.81:0/4106268738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa0012050 con 0x56343ffa4720 2024-05-09T00:05:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fcaace55700 1 --2- 172.21.15.81:0/4106268738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffa7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:05:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fcaade57700 1 --2- 172.21.15.81:0/4106268738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa4720 0x56343ffa8510 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0016dd0 tx=0x7fcaa00097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fdd8d40956de3f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fca90ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fca90ff9700 1 -- 172.21.15.81:0/4106268738 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa001e070 con 0x56343ffa4720 2024-05-09T00:05:49.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fcabba74b80 1 -- 172.21.15.81:0/4106268738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56343fe47270 con 0x56343ffa4720 2024-05-09T00:05:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fca90ff9700 1 -- 172.21.15.81:0/4106268738 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fcaa0006e40 con 0x56343ffa4720 2024-05-09T00:05:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fca90ff9700 1 -- 172.21.15.81:0/4106268738 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcaa0019800 con 0x56343ffa4720 2024-05-09T00:05:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fcabba74b80 10 client.16221 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.869+0000 7fcabba74b80 1 -- 172.21.15.81:0/4106268738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fcaa81a6410 con 0x56343ffa4720 2024-05-09T00:05:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.870+0000 7fca90ff9700 1 -- 172.21.15.81:0/4106268738 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56343fe47270 con 0x56343ffa4720 2024-05-09T00:05:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.870+0000 7fca90ff9700 1 -- 172.21.15.81:0/4106268738 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcaa002aa00 con 0x56343ffa4720 2024-05-09T00:05:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.870+0000 7fcabba74b80 10 client.16221 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.870+0000 7fcabba74b80 10 client.16221 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:05:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.870+0000 7fcabba74b80 20 client.16221 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.870+0000 7fcabba74b80 1 --2- 172.21.15.81:0/4106268738 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56343ffb8160 0x56343ffba580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.870+0000 7fcabba74b80 4 client.16221 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:49.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.870+0000 7fcabba74b80 1 -- 172.21.15.81:0/4106268738 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56343ff6d810 con 0x56343ffb8160 2024-05-09T00:05:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.870+0000 7fcaad656700 1 --2- 172.21.15.81:0/4106268738 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56343ffb8160 0x56343ffba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.871+0000 7fca90ff9700 10 client.16221 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:05:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.871+0000 7fcaad656700 1 --2- 172.21.15.81:0/4106268738 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56343ffb8160 0x56343ffba580 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9116ac488abb541 server_cookie=c16f46fa5b7fc92b in_seq=0 out_seq=0 2024-05-09T00:05:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.871+0000 7fca90ff9700 1 -- 172.21.15.81:0/4106268738 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56343ff6d810 con 0x56343ffb8160 2024-05-09T00:05:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.871+0000 7fca90ff9700 10 client.16221 handle_command_reply: tid=0 2024-05-09T00:05:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.871+0000 7fcabba74b80 1 client.16221 shutdown 2024-05-09T00:05:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.872+0000 7fcabba74b80 1 -- 172.21.15.81:0/4106268738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa4720 msgr2=0x56343ffa8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.872+0000 7fcabba74b80 1 --2- 172.21.15.81:0/4106268738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa4720 0x56343ffa8510 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0016dd0 tx=0x7fcaa00097c0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.872+0000 7fcabba74b80 1 -- 172.21.15.81:0/4106268738 shutdown_connections 2024-05-09T00:05:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.872+0000 7fcabba74b80 1 --2- 172.21.15.81:0/4106268738 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56343ffb8160 0x56343ffba580 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.872+0000 7fcabba74b80 1 --2- 172.21.15.81:0/4106268738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa4720 0x56343ffa8510 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.872+0000 7fcabba74b80 1 --2- 172.21.15.81:0/4106268738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 0x56343ffa7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.872+0000 7fcabba74b80 1 --2- 172.21.15.81:0/4106268738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffa7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.872+0000 7fcabba74b80 1 -- 172.21.15.81:0/4106268738 >> 172.21.15.81:0/4106268738 conn(0x56343fefc210 msgr2=0x56343ff985a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.872+0000 7fca90ff9700 0 client.16221 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:05:49.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.872+0000 7fcabba74b80 1 -- 172.21.15.81:0/4106268738 shutdown_connections 2024-05-09T00:05:49.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.872+0000 7fcabba74b80 1 -- 172.21.15.81:0/4106268738 wait complete. 2024-05-09T00:05:49.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.872+0000 7fcabba74b80 20 client.16221 trim_cache size 0 max 16384 2024-05-09T00:05:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f1519558b80 1 Processor -- start 2024-05-09T00:05:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f1519558b80 1 -- start start 2024-05-09T00:05:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f1519558b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a6066480 0x5644a6060910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f1519558b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a606c270 0x5644a6071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f1519558b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b2c0 0x5644a60646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f1519558b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a6070af0 con 0x5644a606b2c0 2024-05-09T00:05:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f1519558b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a6070440 con 0x5644a606c270 2024-05-09T00:05:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f1519558b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a6062120 con 0x5644a6066480 2024-05-09T00:05:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f15067fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b2c0 0x5644a60646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f15067fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b2c0 0x5644a60646d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59374/0 (socket says 172.21.15.81:59374) 2024-05-09T00:05:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f15067fc700 1 -- 172.21.15.81:0/2980111335 learned_addr learned my addr 172.21.15.81:0/2980111335 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f1506ffd700 1 --2- 172.21.15.81:0/2980111335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a606c270 0x5644a6071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f15067fc700 1 --2- 172.21.15.81:0/2980111335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a6066480 0x5644a6060910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f15067fc700 1 -- 172.21.15.81:0/2980111335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a6066480 msgr2=0x5644a6060910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f15067fc700 1 --2- 172.21.15.81:0/2980111335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a6066480 0x5644a6060910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f15067fc700 1 -- 172.21.15.81:0/2980111335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a606c270 msgr2=0x5644a6071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f15067fc700 1 --2- 172.21.15.81:0/2980111335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a606c270 0x5644a6071cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.875+0000 7f15067fc700 1 -- 172.21.15.81:0/2980111335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644a5f7c500 con 0x5644a606b2c0 2024-05-09T00:05:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.876+0000 7f15067fc700 1 --2- 172.21.15.81:0/2980111335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b2c0 0x5644a60646d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00caa0 tx=0x7f14fc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70defaeabadc434e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.876+0000 7f14edffb700 1 -- 172.21.15.81:0/2980111335 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc011b40 con 0x5644a606b2c0 2024-05-09T00:05:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.876+0000 7f14edffb700 1 -- 172.21.15.81:0/2980111335 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14fc01a040 con 0x5644a606b2c0 2024-05-09T00:05:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.876+0000 7f14edffb700 1 -- 172.21.15.81:0/2980111335 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc00f6b0 con 0x5644a606b2c0 2024-05-09T00:05:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.876+0000 7f1519558b80 1 -- 172.21.15.81:0/2980111335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b2c0 msgr2=0x5644a60646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.876+0000 7f1519558b80 1 --2- 172.21.15.81:0/2980111335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b2c0 0x5644a60646d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00caa0 tx=0x7f14fc0047c0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 -- 172.21.15.81:0/2980111335 shutdown_connections 2024-05-09T00:05:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 --2- 172.21.15.81:0/2980111335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b2c0 0x5644a60646d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 --2- 172.21.15.81:0/2980111335 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a6066480 0x5644a6060910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 --2- 172.21.15.81:0/2980111335 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a606c270 0x5644a6071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 -- 172.21.15.81:0/2980111335 >> 172.21.15.81:0/2980111335 conn(0x5644a5fc41b0 msgr2=0x5644a6062460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 -- 172.21.15.81:0/2980111335 shutdown_connections 2024-05-09T00:05:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 -- 172.21.15.81:0/2980111335 wait complete. 2024-05-09T00:05:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 -- start start 2024-05-09T00:05:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 Processor -- start 2024-05-09T00:05:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a6066480 0x5644a6076c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b2c0 0x5644a6077180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a606c270 0x5644a6069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a6069d10 con 0x5644a606b2c0 2024-05-09T00:05:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a6069e80 con 0x5644a606c270 2024-05-09T00:05:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644a606a040 con 0x5644a6066480 2024-05-09T00:05:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1519558b80 10 client.0 _ll_register_callbacks cb 0x5644a5f5bad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1506ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b2c0 0x5644a6077180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1506ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b2c0 0x5644a6077180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59384/0 (socket says 172.21.15.81:59384) 2024-05-09T00:05:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f1506ffd700 1 -- 172.21.15.81:0/1988813963 learned_addr learned my addr 172.21.15.81:0/1988813963 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.877+0000 7f15067fc700 1 --2- 172.21.15.81:0/1988813963 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a6066480 0x5644a6076c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f15067fc700 1 --2- 172.21.15.81:0/1988813963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a606c270 0x5644a6069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f1506ffd700 1 -- 172.21.15.81:0/1988813963 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a6066480 msgr2=0x5644a6076c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f1506ffd700 1 --2- 172.21.15.81:0/1988813963 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a6066480 0x5644a6076c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f1506ffd700 1 -- 172.21.15.81:0/1988813963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a606c270 msgr2=0x5644a6069600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f1506ffd700 1 --2- 172.21.15.81:0/1988813963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a606c270 0x5644a6069600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f1506ffd700 1 -- 172.21.15.81:0/1988813963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14fc012960 con 0x5644a606b2c0 2024-05-09T00:05:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f15067fc700 1 --2- 172.21.15.81:0/1988813963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a606c270 0x5644a6069600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f1506ffd700 1 --2- 172.21.15.81:0/1988813963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b2c0 0x5644a6077180 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f14f800bc10 tx=0x7f14f800b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6f5daa4b22b40 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f14eaff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f14eaff5700 1 -- 172.21.15.81:0/1988813963 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f8020040 con 0x5644a606b2c0 2024-05-09T00:05:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f14eaff5700 1 -- 172.21.15.81:0/1988813963 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f14f8017070 con 0x5644a606b2c0 2024-05-09T00:05:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f1519558b80 1 -- 172.21.15.81:0/1988813963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f14f8015070 con 0x5644a606b2c0 2024-05-09T00:05:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f14eaff5700 1 -- 172.21.15.81:0/1988813963 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14f8012d90 con 0x5644a606b2c0 2024-05-09T00:05:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f1519558b80 10 client.16227 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f1519558b80 1 -- 172.21.15.81:0/1988813963 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5644a5e3bc70 con 0x5644a606b2c0 2024-05-09T00:05:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.878+0000 7f14eaff5700 1 -- 172.21.15.81:0/1988813963 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14f8015070 con 0x5644a606b2c0 2024-05-09T00:05:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.879+0000 7f14eaff5700 1 -- 172.21.15.81:0/1988813963 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f14f8004520 con 0x5644a606b2c0 2024-05-09T00:05:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.879+0000 7f1519558b80 10 client.16227 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.879+0000 7f1519558b80 10 client.16227 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.879+0000 7f1519558b80 20 client.16227 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.879+0000 7f1519558b80 1 --2- 172.21.15.81:0/1988813963 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5644a60d6ef0 0x5644a60d9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.879+0000 7f1519558b80 4 client.16227 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:05:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.879+0000 7f1519558b80 1 -- 172.21.15.81:0/1988813963 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5644a5faee60 con 0x5644a60d6ef0 2024-05-09T00:05:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.879+0000 7f15067fc700 1 --2- 172.21.15.81:0/1988813963 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5644a60d6ef0 0x5644a60d9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.879+0000 7f15067fc700 1 --2- 172.21.15.81:0/1988813963 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5644a60d6ef0 0x5644a60d9310 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f626ad6471ec5b2d server_cookie=82ce0117ba1da902 in_seq=0 out_seq=0 2024-05-09T00:05:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.879+0000 7f14eaff5700 10 client.16227 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:49.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.887+0000 7fcabba74b80 1 Processor -- start 2024-05-09T00:05:49.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.887+0000 7fcabba74b80 1 -- start start 2024-05-09T00:05:49.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcabba74b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 0x56343ffa41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcabba74b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa3e00 0x56343ff9ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcabba74b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa4720 0x56343ff98d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcabba74b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343ffa9100 con 0x56343ffa3e00 2024-05-09T00:05:49.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcabba74b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343ff95dc0 con 0x56343ffa4720 2024-05-09T00:05:49.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcabba74b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343ffbf770 con 0x56343ff9e890 2024-05-09T00:05:49.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcaace55700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa3e00 0x56343ff9ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcaace55700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa3e00 0x56343ff9ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59398/0 (socket says 172.21.15.81:59398) 2024-05-09T00:05:49.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcaad656700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 0x56343ffa41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcaace55700 1 -- 172.21.15.81:0/2907857352 learned_addr learned my addr 172.21.15.81:0/2907857352 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcaade57700 1 --2- 172.21.15.81:0/2907857352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa4720 0x56343ff98d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcaace55700 1 -- 172.21.15.81:0/2907857352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 msgr2=0x56343ffa41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcaace55700 1 --2- 172.21.15.81:0/2907857352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 0x56343ffa41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcaace55700 1 -- 172.21.15.81:0/2907857352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa4720 msgr2=0x56343ff98d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcaace55700 1 --2- 172.21.15.81:0/2907857352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa4720 0x56343ff98d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcaace55700 1 -- 172.21.15.81:0/2907857352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56343fd1bb60 con 0x56343ffa3e00 2024-05-09T00:05:49.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fcaace55700 1 --2- 172.21.15.81:0/2907857352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa3e00 0x56343ff9ec70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fca98015000 tx=0x7fca98005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa88ae7d5cd07be6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fca93fff700 1 -- 172.21.15.81:0/2907857352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9801d070 con 0x56343ffa3e00 2024-05-09T00:05:49.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fca93fff700 1 -- 172.21.15.81:0/2907857352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca9801e040 con 0x56343ffa3e00 2024-05-09T00:05:49.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.888+0000 7fca93fff700 1 -- 172.21.15.81:0/2907857352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9800f6c0 con 0x56343ffa3e00 2024-05-09T00:05:49.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.889+0000 7fcabba74b80 1 -- 172.21.15.81:0/2907857352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa3e00 msgr2=0x56343ff9ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.889+0000 7fcabba74b80 1 --2- 172.21.15.81:0/2907857352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa3e00 0x56343ff9ec70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fca98015000 tx=0x7fca98005960 comp rx=0 tx=0).stop 2024-05-09T00:05:49.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.889+0000 7fcabba74b80 1 -- 172.21.15.81:0/2907857352 shutdown_connections 2024-05-09T00:05:49.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.889+0000 7fcabba74b80 1 --2- 172.21.15.81:0/2907857352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa4720 0x56343ff98d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.889+0000 7fcabba74b80 1 --2- 172.21.15.81:0/2907857352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 0x56343ffa41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.889+0000 7fcabba74b80 1 --2- 172.21.15.81:0/2907857352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa3e00 0x56343ff9ec70 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.889+0000 7fcabba74b80 1 -- 172.21.15.81:0/2907857352 >> 172.21.15.81:0/2907857352 conn(0x56343fefc210 msgr2=0x56343ff95210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.889+0000 7fcabba74b80 1 -- 172.21.15.81:0/2907857352 shutdown_connections 2024-05-09T00:05:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.889+0000 7fcabba74b80 1 -- 172.21.15.81:0/2907857352 wait complete. 2024-05-09T00:05:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.890+0000 7fcabba74b80 1 -- start start 2024-05-09T00:05:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.890+0000 7fcabba74b80 1 Processor -- start 2024-05-09T00:05:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.890+0000 7fcabba74b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 0x56343ffaf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.890+0000 7fcabba74b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffaf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.890+0000 7fcabba74b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa4720 0x56343ff9f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.890+0000 7fcabba74b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343ff9fee0 con 0x56343ffa4720 2024-05-09T00:05:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.890+0000 7fcabba74b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343ffa0050 con 0x56343ffa3e00 2024-05-09T00:05:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.890+0000 7fcabba74b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56343ffa0210 con 0x56343ff9e890 2024-05-09T00:05:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.890+0000 7fcabba74b80 10 client.0 _ll_register_callbacks cb 0x56343fe93b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.890+0000 7fcaade57700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa4720 0x56343ff9f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.890+0000 7fcaade57700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa4720 0x56343ff9f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59408/0 (socket says 172.21.15.81:59408) 2024-05-09T00:05:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.890+0000 7fcaade57700 1 -- 172.21.15.81:0/1621273703 learned_addr learned my addr 172.21.15.81:0/1621273703 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:49.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.890+0000 7fcaad656700 1 --2- 172.21.15.81:0/1621273703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 0x56343ffaf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.890+0000 7fcaace55700 1 --2- 172.21.15.81:0/1621273703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffaf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcaade57700 1 -- 172.21.15.81:0/1621273703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 msgr2=0x56343ffaf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcaade57700 1 --2- 172.21.15.81:0/1621273703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 0x56343ffaf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcaade57700 1 -- 172.21.15.81:0/1621273703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 msgr2=0x56343ffaf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcaade57700 1 --2- 172.21.15.81:0/1621273703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffaf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcaade57700 1 -- 172.21.15.81:0/1621273703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa8110860 con 0x56343ffa4720 2024-05-09T00:05:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcaace55700 1 --2- 172.21.15.81:0/1621273703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffaf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcaade57700 1 --2- 172.21.15.81:0/1621273703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa4720 0x56343ff9f9a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0017010 tx=0x7fcaa000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810cfe56f3ea186b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fca90ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fca90ff9700 1 -- 172.21.15.81:0/1621273703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa001e050 con 0x56343ffa4720 2024-05-09T00:05:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fca90ff9700 1 -- 172.21.15.81:0/1621273703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fcaa002a5d0 con 0x56343ffa4720 2024-05-09T00:05:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcabba74b80 1 -- 172.21.15.81:0/1621273703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcaa40186e0 con 0x56343ffa4720 2024-05-09T00:05:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fca90ff9700 1 -- 172.21.15.81:0/1621273703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcaa000aa40 con 0x56343ffa4720 2024-05-09T00:05:49.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcabba74b80 10 client.16233 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcabba74b80 1 -- 172.21.15.81:0/1621273703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56343feb4560 con 0x56343ffa4720 2024-05-09T00:05:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fca90ff9700 1 -- 172.21.15.81:0/1621273703 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaa0040020 con 0x56343ffa4720 2024-05-09T00:05:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fca90ff9700 1 -- 172.21.15.81:0/1621273703 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcaa0018930 con 0x56343ffa4720 2024-05-09T00:05:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcabba74b80 10 client.16233 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcabba74b80 10 client.16233 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:05:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcabba74b80 20 client.16233 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcabba74b80 1 --2- 172.21.15.81:0/1621273703 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56344000e6b0 0x563440010aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcabba74b80 4 client.16233 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:05:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.891+0000 7fcabba74b80 1 -- 172.21.15.81:0/1621273703 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56343fee6ec0 con 0x56344000e6b0 2024-05-09T00:05:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fcaad656700 1 --2- 172.21.15.81:0/1621273703 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56344000e6b0 0x563440010aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fcaad656700 1 --2- 172.21.15.81:0/1621273703 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56344000e6b0 0x563440010aa0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5f510ab205e7d778 server_cookie=ed7889acd34f18bb in_seq=0 out_seq=0 2024-05-09T00:05:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fca90ff9700 10 client.16233 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:05:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fca90ff9700 1 -- 172.21.15.81:0/1621273703 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56343fee6ec0 con 0x56344000e6b0 2024-05-09T00:05:49.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fca90ff9700 10 client.16233 handle_command_reply: tid=0 2024-05-09T00:05:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fcabba74b80 1 client.16233 shutdown 2024-05-09T00:05:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fcabba74b80 1 -- 172.21.15.81:0/1621273703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa4720 msgr2=0x56343ff9f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fcabba74b80 1 --2- 172.21.15.81:0/1621273703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa4720 0x56343ff9f9a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0017010 tx=0x7fcaa000f000 comp rx=0 tx=0).stop 2024-05-09T00:05:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fcabba74b80 1 -- 172.21.15.81:0/1621273703 shutdown_connections 2024-05-09T00:05:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fcabba74b80 1 --2- 172.21.15.81:0/1621273703 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56344000e6b0 0x563440010aa0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fcabba74b80 1 --2- 172.21.15.81:0/1621273703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56343ffa4720 0x56343ff9f9a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fcabba74b80 1 --2- 172.21.15.81:0/1621273703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56343ff9e890 0x56343ffaf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fcabba74b80 1 --2- 172.21.15.81:0/1621273703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56343ffa3e00 0x56343ffaf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fcabba74b80 1 -- 172.21.15.81:0/1621273703 >> 172.21.15.81:0/1621273703 conn(0x56343fefc210 msgr2=0x56343ff9ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.892+0000 7fca90ff9700 0 client.16233 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:05:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcabba74b80 1 -- 172.21.15.81:0/1621273703 shutdown_connections 2024-05-09T00:05:49.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcabba74b80 1 -- 172.21.15.81:0/1621273703 wait complete. 2024-05-09T00:05:49.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcabba74b80 20 client.16233 trim_cache size 0 max 16384 2024-05-09T00:05:49.909 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:05:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcaaf8ba700 1 -- 172.21.15.81:0/3351265074 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fca940a1290 msgr2=0x7fca940a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcaaf8ba700 1 --2- 172.21.15.81:0/3351265074 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fca940a1290 0x7fca940a3750 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000acc0 tx=0x7fcaa0009a30 comp rx=0 tx=0).stop 2024-05-09T00:05:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcaaf8ba700 1 -- 172.21.15.81:0/3351265074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa8073350 msgr2=0x7fcaa81996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcaaf8ba700 1 --2- 172.21.15.81:0/3351265074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa8073350 0x7fcaa81996a0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400b530 tx=0x7fcaa400b840 comp rx=0 tx=0).stop 2024-05-09T00:05:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcaaf8ba700 1 -- 172.21.15.81:0/3351265074 shutdown_connections 2024-05-09T00:05:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcaaf8ba700 1 --2- 172.21.15.81:0/3351265074 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fca940a1290 0x7fca940a3750 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcaaf8ba700 1 --2- 172.21.15.81:0/3351265074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcaa810d7b0 0x7fcaa819df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcaaf8ba700 1 --2- 172.21.15.81:0/3351265074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcaa8073350 0x7fcaa81996a0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcaaf8ba700 1 --2- 172.21.15.81:0/3351265074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcaa8073c70 0x7fcaa8199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcaaf8ba700 1 -- 172.21.15.81:0/3351265074 >> 172.21.15.81:0/3351265074 conn(0x7fcaa80fc9e0 msgr2=0x7fcaa80fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcaaf8ba700 1 -- 172.21.15.81:0/3351265074 shutdown_connections 2024-05-09T00:05:49.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:49.893+0000 7fcaaf8ba700 1 -- 172.21.15.81:0/3351265074 wait complete. 2024-05-09T00:05:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f14eaff5700 1 -- 172.21.15.81:0/1988813963 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5644a5faee60 con 0x5644a60d6ef0 2024-05-09T00:05:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f14eaff5700 10 client.16227 handle_command_reply: tid=0 2024-05-09T00:05:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f1519558b80 1 client.16227 shutdown 2024-05-09T00:05:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f1519558b80 1 -- 172.21.15.81:0/1988813963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b2c0 msgr2=0x5644a6077180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f1519558b80 1 --2- 172.21.15.81:0/1988813963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b2c0 0x5644a6077180 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f14f800bc10 tx=0x7f14f800b520 comp rx=0 tx=0).stop 2024-05-09T00:05:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f1519558b80 1 -- 172.21.15.81:0/1988813963 shutdown_connections 2024-05-09T00:05:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f1519558b80 1 --2- 172.21.15.81:0/1988813963 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5644a60d6ef0 0x5644a60d9310 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f1519558b80 1 --2- 172.21.15.81:0/1988813963 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5644a606c270 0x5644a6069600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f1519558b80 1 --2- 172.21.15.81:0/1988813963 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5644a6066480 0x5644a6076c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f1519558b80 1 --2- 172.21.15.81:0/1988813963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5644a606b2c0 0x5644a6077180 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f1519558b80 1 -- 172.21.15.81:0/1988813963 >> 172.21.15.81:0/1988813963 conn(0x5644a5fc41b0 msgr2=0x5644a60646d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f14eaff5700 0 client.16227 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f1519558b80 1 -- 172.21.15.81:0/1988813963 shutdown_connections 2024-05-09T00:05:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f1519558b80 1 -- 172.21.15.81:0/1988813963 wait complete. 2024-05-09T00:05:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.894+0000 7f1519558b80 20 client.16227 trim_cache size 0 max 16384 2024-05-09T00:05:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:05:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:05:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:05:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:05:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.895+0000 7f150d39e700 1 -- 172.21.15.81:0/3572099831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14f00a1290 msgr2=0x7f14f00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.895+0000 7f150d39e700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14f00a1290 0x7f14f00a3750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1500061c40 tx=0x7f1500086040 comp rx=0 tx=0).stop 2024-05-09T00:05:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.895+0000 7f150d39e700 1 -- 172.21.15.81:0/3572099831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150810db90 msgr2=0x7f150819df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.895+0000 7f150d39e700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150810db90 0x7f150819df80 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f150000b070 tx=0x7f1500007870 comp rx=0 tx=0).stop 2024-05-09T00:05:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.895+0000 7f150d39e700 1 -- 172.21.15.81:0/3572099831 shutdown_connections 2024-05-09T00:05:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.895+0000 7f150d39e700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14f00a1290 0x7f14f00a3750 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.895+0000 7f150d39e700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f15080ff4a0 0x7f15081996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.895+0000 7f150d39e700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f150810db90 0x7f150819df80 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.895+0000 7f150d39e700 1 --2- 172.21.15.81:0/3572099831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1508101d90 0x7f1508199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.895+0000 7f150d39e700 1 -- 172.21.15.81:0/3572099831 >> 172.21.15.81:0/3572099831 conn(0x7f15080763a0 msgr2=0x7f150810f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.895+0000 7f150d39e700 1 -- 172.21.15.81:0/3572099831 shutdown_connections 2024-05-09T00:05:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:05:49.895+0000 7f150d39e700 1 -- 172.21.15.81:0/3572099831 wait complete. 2024-05-09T00:05:49.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:05:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.048+0000 7fa90687c700 1 -- 172.21.15.81:0/3021294167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa900105170 msgr2=0x7fa90010ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.048+0000 7fa90687c700 1 --2- 172.21.15.81:0/3021294167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa900105170 0x7fa90010ccf0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800b0a0 tx=0x7fa8f800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.048+0000 7fa90687c700 1 -- 172.21.15.81:0/3021294167 shutdown_connections 2024-05-09T00:05:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.048+0000 7fa90687c700 1 --2- 172.21.15.81:0/3021294167 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa900100060 0x7fa900100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.048+0000 7fa90687c700 1 --2- 172.21.15.81:0/3021294167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa900105170 0x7fa90010ccf0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.048+0000 7fa90687c700 1 --2- 172.21.15.81:0/3021294167 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa900100a10 0x7fa900104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.048+0000 7fa90687c700 1 -- 172.21.15.81:0/3021294167 >> 172.21.15.81:0/3021294167 conn(0x7fa900076f30 msgr2=0x7fa900077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.048+0000 7fa90687c700 1 -- 172.21.15.81:0/3021294167 shutdown_connections 2024-05-09T00:05:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.048+0000 7fa90687c700 1 -- 172.21.15.81:0/3021294167 wait complete. 2024-05-09T00:05:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.048+0000 7fa90687c700 1 Processor -- start 2024-05-09T00:05:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.048+0000 7fa90687c700 1 -- start start 2024-05-09T00:05:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa90687c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa900100060 0x7fa900101ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa90687c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa900105170 0x7fa900102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa90687c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa900102560 0x7fa9001a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa90687c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9001a5d20 con 0x7fa900105170 2024-05-09T00:05:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa90687c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9001a5e90 con 0x7fa900102560 2024-05-09T00:05:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa90687c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9001a6050 con 0x7fa900100060 2024-05-09T00:05:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa8ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa900105170 0x7fa900102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa8ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa900105170 0x7fa900102020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59416/0 (socket says 172.21.15.81:59416) 2024-05-09T00:05:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa8ff7fe700 1 -- 172.21.15.81:0/490202313 learned_addr learned my addr 172.21.15.81:0/490202313 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa8ff7fe700 1 -- 172.21.15.81:0/490202313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa900100060 msgr2=0x7fa900101ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa8ff7fe700 1 --2- 172.21.15.81:0/490202313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa900100060 0x7fa900101ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa8ff7fe700 1 -- 172.21.15.81:0/490202313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa900102560 msgr2=0x7fa9001a56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa8ff7fe700 1 --2- 172.21.15.81:0/490202313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa900102560 0x7fa9001a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa8ff7fe700 1 -- 172.21.15.81:0/490202313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f8009d00 con 0x7fa900105170 2024-05-09T00:05:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa8ff7fe700 1 --2- 172.21.15.81:0/490202313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa900105170 0x7fa900102020 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800d980 tx=0x7fa8e800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa8fd7fa700 1 -- 172.21.15.81:0/490202313 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e8009b40 con 0x7fa900105170 2024-05-09T00:05:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa8fd7fa700 1 -- 172.21.15.81:0/490202313 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8e800de60 con 0x7fa900105170 2024-05-09T00:05:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa90687c700 1 -- 172.21.15.81:0/490202313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9001a6330 con 0x7fa900105170 2024-05-09T00:05:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa8fd7fa700 1 -- 172.21.15.81:0/490202313 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e800f620 con 0x7fa900105170 2024-05-09T00:05:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.049+0000 7fa90687c700 1 -- 172.21.15.81:0/490202313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9001a6840 con 0x7fa900105170 2024-05-09T00:05:50.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.051+0000 7fa8fd7fa700 1 -- 172.21.15.81:0/490202313 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa8e8010460 con 0x7fa900105170 2024-05-09T00:05:50.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.052+0000 7fa8fd7fa700 1 --2- 172.21.15.81:0/490202313 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa8ec0a1290 0x7fa8ec0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.052+0000 7fa8fffff700 1 --2- 172.21.15.81:0/490202313 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa8ec0a1290 0x7fa8ec0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.052+0000 7fa8fd7fa700 1 -- 172.21.15.81:0/490202313 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa8e80cc890 con 0x7fa900105170 2024-05-09T00:05:50.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.053+0000 7fa8fffff700 1 --2- 172.21.15.81:0/490202313 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa8ec0a1290 0x7fa8ec0a3750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0005fd0 tx=0x7fa8f0005f60 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:50.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.053+0000 7fa912a36b80 1 Processor -- start 2024-05-09T00:05:50.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.053+0000 7fa912a36b80 1 -- start start 2024-05-09T00:05:50.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.053+0000 7fa912a36b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 0x55c734ff61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.053+0000 7fa912a36b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734ff0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.053+0000 7fa912a36b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff0890 0x55c734ff0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.053+0000 7fa912a36b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c734f47150 con 0x55c734ff6720 2024-05-09T00:05:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.053+0000 7fa912a36b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c734f44b10 con 0x55c734ff5e00 2024-05-09T00:05:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.053+0000 7fa912a36b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c734f40400 con 0x55c734ff0890 2024-05-09T00:05:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.053+0000 7fa8ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734ff0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.053+0000 7fa8ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734ff0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59420/0 (socket says 172.21.15.81:59420) 2024-05-09T00:05:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.053+0000 7fa8ff7fe700 1 -- 172.21.15.81:0/2773412699 learned_addr learned my addr 172.21.15.81:0/2773412699 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.053+0000 7fa8fffff700 1 --2- 172.21.15.81:0/2773412699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 0x55c734ff61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.054+0000 7fa904e19700 1 --2- 172.21.15.81:0/2773412699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff0890 0x55c734ff0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.054+0000 7fa8ff7fe700 1 -- 172.21.15.81:0/2773412699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff0890 msgr2=0x55c734ff0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.054+0000 7fa8ff7fe700 1 --2- 172.21.15.81:0/2773412699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff0890 0x55c734ff0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.054+0000 7fa8ff7fe700 1 -- 172.21.15.81:0/2773412699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 msgr2=0x55c734ff61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:50.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.054+0000 7fa8ff7fe700 1 --2- 172.21.15.81:0/2773412699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 0x55c734ff61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.054+0000 7fa8ff7fe700 1 -- 172.21.15.81:0/2773412699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c734dc13b0 con 0x55c734ff6720 2024-05-09T00:05:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.054+0000 7fa8ff7fe700 1 --2- 172.21.15.81:0/2773412699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734ff0350 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80a18b0 tx=0x7fa8e809a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ab58933bdc74a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.054+0000 7fa8f67fc700 1 -- 172.21.15.81:0/2773412699 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e809d790 con 0x55c734ff6720 2024-05-09T00:05:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.054+0000 7fa8f67fc700 1 -- 172.21.15.81:0/2773412699 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8e80a1de0 con 0x55c734ff6720 2024-05-09T00:05:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.054+0000 7fa8f67fc700 1 -- 172.21.15.81:0/2773412699 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80990b0 con 0x55c734ff6720 2024-05-09T00:05:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.055+0000 7fa912a36b80 1 -- 172.21.15.81:0/2773412699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 msgr2=0x55c734ff0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.055+0000 7fa912a36b80 1 --2- 172.21.15.81:0/2773412699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734ff0350 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80a18b0 tx=0x7fa8e809a060 comp rx=0 tx=0).stop 2024-05-09T00:05:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.055+0000 7fa912a36b80 1 -- 172.21.15.81:0/2773412699 shutdown_connections 2024-05-09T00:05:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.055+0000 7fa912a36b80 1 --2- 172.21.15.81:0/2773412699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 0x55c734ff61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.055+0000 7fa912a36b80 1 --2- 172.21.15.81:0/2773412699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff0890 0x55c734ff0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.055+0000 7fa912a36b80 1 --2- 172.21.15.81:0/2773412699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734ff0350 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.055+0000 7fa912a36b80 1 -- 172.21.15.81:0/2773412699 >> 172.21.15.81:0/2773412699 conn(0x55c734f4e210 msgr2=0x55c734feadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:50.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.055+0000 7fa912a36b80 1 -- 172.21.15.81:0/2773412699 shutdown_connections 2024-05-09T00:05:50.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.055+0000 7fa912a36b80 1 -- 172.21.15.81:0/2773412699 wait complete. 2024-05-09T00:05:50.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.055+0000 7fa912a36b80 1 -- start start 2024-05-09T00:05:50.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.055+0000 7fa912a36b80 1 Processor -- start 2024-05-09T00:05:50.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.055+0000 7fa912a36b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff0890 0x55c734ff9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.055+0000 7fa912a36b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 0x55c734ffa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa912a36b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff6720 0x55c734ffa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa912a36b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c734edc560 con 0x55c734ff0890 2024-05-09T00:05:50.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa912a36b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c734edc200 con 0x55c734ff5e00 2024-05-09T00:05:50.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa912a36b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c734dc36a0 con 0x55c734ff6720 2024-05-09T00:05:50.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa912a36b80 10 client.0 _ll_register_callbacks cb 0x55c734ee5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:50.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa8fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff0890 0x55c734ff9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa8fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff0890 0x55c734ff9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59424/0 (socket says 172.21.15.81:59424) 2024-05-09T00:05:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa8fffff700 1 -- 172.21.15.81:0/2987829841 learned_addr learned my addr 172.21.15.81:0/2987829841 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa8ff7fe700 1 --2- 172.21.15.81:0/2987829841 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 0x55c734ffa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa904e19700 1 --2- 172.21.15.81:0/2987829841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff6720 0x55c734ffa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa8fffff700 1 -- 172.21.15.81:0/2987829841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff6720 msgr2=0x55c734ffa5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa8fffff700 1 --2- 172.21.15.81:0/2987829841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff6720 0x55c734ffa5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa8fffff700 1 -- 172.21.15.81:0/2987829841 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 msgr2=0x55c734ffa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa8fffff700 1 --2- 172.21.15.81:0/2987829841 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 0x55c734ffa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa8fffff700 1 -- 172.21.15.81:0/2987829841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e8084040 con 0x55c734ff0890 2024-05-09T00:05:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa904e19700 1 --2- 172.21.15.81:0/2987829841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff6720 0x55c734ffa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa8fffff700 1 --2- 172.21.15.81:0/2987829841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff0890 0x55c734ff9b70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00046b0 tx=0x7fa8f000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c4b5e621f2f1fd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa8df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa8df7fe700 1 -- 172.21.15.81:0/2987829841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0003b10 con 0x55c734ff0890 2024-05-09T00:05:50.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa8df7fe700 1 -- 172.21.15.81:0/2987829841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa8f001a040 con 0x55c734ff0890 2024-05-09T00:05:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa912a36b80 1 -- 172.21.15.81:0/2987829841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c734e99270 con 0x55c734ff0890 2024-05-09T00:05:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.056+0000 7fa8df7fe700 1 -- 172.21.15.81:0/2987829841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8f0003c70 con 0x55c734ff0890 2024-05-09T00:05:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.057+0000 7fa912a36b80 10 client.16245 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.057+0000 7fa912a36b80 1 -- 172.21.15.81:0/2987829841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c734d6db60 con 0x55c734ff0890 2024-05-09T00:05:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.057+0000 7fa8df7fe700 1 -- 172.21.15.81:0/2987829841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c734e99270 con 0x55c734ff0890 2024-05-09T00:05:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.057+0000 7fa8df7fe700 1 -- 172.21.15.81:0/2987829841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa8f001f400 con 0x55c734ff0890 2024-05-09T00:05:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.057+0000 7fa912a36b80 10 client.16245 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.057+0000 7fa912a36b80 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.057+0000 7fa912a36b80 20 client.16245 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.057+0000 7fa912a36b80 1 --2- 172.21.15.81:0/2987829841 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c73500a2d0 0x55c73500c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.057+0000 7fa912a36b80 4 client.16245 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.057+0000 7fa912a36b80 1 -- 172.21.15.81:0/2987829841 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c734fbf810 con 0x55c73500a2d0 2024-05-09T00:05:50.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.057+0000 7fa8ff7fe700 1 --2- 172.21.15.81:0/2987829841 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c73500a2d0 0x55c73500c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa8df7fe700 10 client.16245 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:50.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa8ff7fe700 1 --2- 172.21.15.81:0/2987829841 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c73500a2d0 0x55c73500c6f0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fc7a355584b600f server_cookie=c59a2b2b82ab1841 in_seq=0 out_seq=0 2024-05-09T00:05:50.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa8df7fe700 1 -- 172.21.15.81:0/2987829841 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c734fbf810 con 0x55c73500a2d0 2024-05-09T00:05:50.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa8df7fe700 10 client.16245 handle_command_reply: tid=0 2024-05-09T00:05:50.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa912a36b80 1 client.16245 shutdown 2024-05-09T00:05:50.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa912a36b80 1 -- 172.21.15.81:0/2987829841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff0890 msgr2=0x55c734ff9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:50.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa912a36b80 1 --2- 172.21.15.81:0/2987829841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff0890 0x55c734ff9b70 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa8f00046b0 tx=0x7fa8f000dab0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa912a36b80 1 -- 172.21.15.81:0/2987829841 shutdown_connections 2024-05-09T00:05:50.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa912a36b80 1 --2- 172.21.15.81:0/2987829841 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c73500a2d0 0x55c73500c6f0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa912a36b80 1 --2- 172.21.15.81:0/2987829841 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff6720 0x55c734ffa5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa912a36b80 1 --2- 172.21.15.81:0/2987829841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff0890 0x55c734ff9b70 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa8df7fe700 0 client.16245 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:50.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa912a36b80 1 --2- 172.21.15.81:0/2987829841 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 0x55c734ffa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa912a36b80 1 -- 172.21.15.81:0/2987829841 >> 172.21.15.81:0/2987829841 conn(0x55c734f4e210 msgr2=0x55c734fea5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:50.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa912a36b80 1 -- 172.21.15.81:0/2987829841 shutdown_connections 2024-05-09T00:05:50.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.058+0000 7fa912a36b80 1 -- 172.21.15.81:0/2987829841 wait complete. 2024-05-09T00:05:50.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.059+0000 7fa912a36b80 20 client.16245 trim_cache size 0 max 16384 2024-05-09T00:05:50.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.071+0000 7fa912a36b80 1 Processor -- start 2024-05-09T00:05:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa912a36b80 1 -- start start 2024-05-09T00:05:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa912a36b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff0890 0x55c734ff0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa912a36b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff5e00 0x55c734fead20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa912a36b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734ffa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa912a36b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c734fec7e0 con 0x55c734ff6720 2024-05-09T00:05:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa912a36b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7350118c0 con 0x55c734ff0890 2024-05-09T00:05:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa912a36b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c734fe5800 con 0x55c734ff5e00 2024-05-09T00:05:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa904e19700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734ffa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa904e19700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734ffa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59430/0 (socket says 172.21.15.81:59430) 2024-05-09T00:05:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa904e19700 1 -- 172.21.15.81:0/346881445 learned_addr learned my addr 172.21.15.81:0/346881445 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa904e19700 1 -- 172.21.15.81:0/346881445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff5e00 msgr2=0x55c734fead20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa8ff7fe700 1 --2- 172.21.15.81:0/346881445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff5e00 0x55c734fead20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa8fffff700 1 --2- 172.21.15.81:0/346881445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff0890 0x55c734ff0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa904e19700 1 --2- 172.21.15.81:0/346881445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff5e00 0x55c734fead20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa904e19700 1 -- 172.21.15.81:0/346881445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff0890 msgr2=0x55c734ff0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa904e19700 1 --2- 172.21.15.81:0/346881445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff0890 0x55c734ff0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa904e19700 1 -- 172.21.15.81:0/346881445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c734f06560 con 0x55c734ff6720 2024-05-09T00:05:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa8ff7fe700 1 --2- 172.21.15.81:0/346881445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff5e00 0x55c734fead20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa904e19700 1 --2- 172.21.15.81:0/346881445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734ffa410 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8007b30 tx=0x7fa8f8007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7725521289fdb9c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa8f6ffd700 1 -- 172.21.15.81:0/346881445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f800e030 con 0x55c734ff6720 2024-05-09T00:05:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa8f6ffd700 1 -- 172.21.15.81:0/346881445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8f8003a00 con 0x55c734ff6720 2024-05-09T00:05:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.072+0000 7fa8f6ffd700 1 -- 172.21.15.81:0/346881445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f8005040 con 0x55c734ff6720 2024-05-09T00:05:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.073+0000 7fa912a36b80 1 -- 172.21.15.81:0/346881445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 msgr2=0x55c734ffa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.073+0000 7fa912a36b80 1 --2- 172.21.15.81:0/346881445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734ffa410 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa8f8007b30 tx=0x7fa8f8007b60 comp rx=0 tx=0).stop 2024-05-09T00:05:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.073+0000 7fa912a36b80 1 -- 172.21.15.81:0/346881445 shutdown_connections 2024-05-09T00:05:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.073+0000 7fa912a36b80 1 --2- 172.21.15.81:0/346881445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff0890 0x55c734ff0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.073+0000 7fa912a36b80 1 --2- 172.21.15.81:0/346881445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734ffa410 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.073+0000 7fa912a36b80 1 --2- 172.21.15.81:0/346881445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff5e00 0x55c734fead20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.073+0000 7fa912a36b80 1 -- 172.21.15.81:0/346881445 >> 172.21.15.81:0/346881445 conn(0x55c734f4e210 msgr2=0x55c734ff8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:50.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.073+0000 7fa912a36b80 1 -- 172.21.15.81:0/346881445 shutdown_connections 2024-05-09T00:05:50.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.073+0000 7fa912a36b80 1 -- 172.21.15.81:0/346881445 wait complete. 2024-05-09T00:05:50.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.073+0000 7fa912a36b80 1 -- start start 2024-05-09T00:05:50.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa912a36b80 1 Processor -- start 2024-05-09T00:05:50.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa912a36b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff0890 0x55c734fff090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa912a36b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 0x55c734fff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa912a36b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734fffb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa912a36b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c73505f820 con 0x55c734ff6720 2024-05-09T00:05:50.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa912a36b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c73505f990 con 0x55c734ff5e00 2024-05-09T00:05:50.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa912a36b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c73505fb50 con 0x55c734ff0890 2024-05-09T00:05:50.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa912a36b80 10 client.0 _ll_register_callbacks cb 0x55c734ee5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa904e19700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734fffb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa904e19700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734fffb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59446/0 (socket says 172.21.15.81:59446) 2024-05-09T00:05:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa904e19700 1 -- 172.21.15.81:0/932500092 learned_addr learned my addr 172.21.15.81:0/932500092 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa8ff7fe700 1 --2- 172.21.15.81:0/932500092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 0x55c734fff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa8fffff700 1 --2- 172.21.15.81:0/932500092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff0890 0x55c734fff090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa904e19700 1 -- 172.21.15.81:0/932500092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff0890 msgr2=0x55c734fff090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa904e19700 1 --2- 172.21.15.81:0/932500092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff0890 0x55c734fff090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa904e19700 1 -- 172.21.15.81:0/932500092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 msgr2=0x55c734fff5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa904e19700 1 --2- 172.21.15.81:0/932500092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 0x55c734fff5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa904e19700 1 -- 172.21.15.81:0/932500092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90010d560 con 0x55c734ff6720 2024-05-09T00:05:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa904e19700 1 --2- 172.21.15.81:0/932500092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734fffb10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800b830 tx=0x7fa8f8003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40649290941397eb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.074+0000 7fa8df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:50.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa8df7fe700 1 -- 172.21.15.81:0/932500092 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f800e040 con 0x55c734ff6720 2024-05-09T00:05:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa8df7fe700 1 -- 172.21.15.81:0/932500092 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa8f8009410 con 0x55c734ff6720 2024-05-09T00:05:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa912a36b80 1 -- 172.21.15.81:0/932500092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa8e80a1de0 con 0x55c734ff6720 2024-05-09T00:05:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa8df7fe700 1 -- 172.21.15.81:0/932500092 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8f8005050 con 0x55c734ff6720 2024-05-09T00:05:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa912a36b80 10 client.16251 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa912a36b80 1 -- 172.21.15.81:0/932500092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c734dc5cd0 con 0x55c734ff6720 2024-05-09T00:05:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa8df7fe700 1 -- 172.21.15.81:0/932500092 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa8f8039080 con 0x55c734ff6720 2024-05-09T00:05:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa8df7fe700 1 -- 172.21.15.81:0/932500092 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa8f8033030 con 0x55c734ff6720 2024-05-09T00:05:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa912a36b80 10 client.16251 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa912a36b80 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa912a36b80 20 client.16251 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa912a36b80 1 --2- 172.21.15.81:0/932500092 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c735060e30 0x55c735063220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa912a36b80 4 client.16251 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:05:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa912a36b80 1 -- 172.21.15.81:0/932500092 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c734f38ec0 con 0x55c735060e30 2024-05-09T00:05:50.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.075+0000 7fa8fffff700 1 --2- 172.21.15.81:0/932500092 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c735060e30 0x55c735063220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa8df7fe700 10 client.16251 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa8fffff700 1 --2- 172.21.15.81:0/932500092 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c735060e30 0x55c735063220 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73484c6852014e34 server_cookie=f9addfba25c2eda8 in_seq=0 out_seq=0 2024-05-09T00:05:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa8df7fe700 1 -- 172.21.15.81:0/932500092 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c734f38ec0 con 0x55c735060e30 2024-05-09T00:05:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa8df7fe700 10 client.16251 handle_command_reply: tid=0 2024-05-09T00:05:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa912a36b80 1 client.16251 shutdown 2024-05-09T00:05:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa912a36b80 1 -- 172.21.15.81:0/932500092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 msgr2=0x55c734fffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa912a36b80 1 --2- 172.21.15.81:0/932500092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734fffb10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa8f800b830 tx=0x7fa8f8003ed0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa912a36b80 1 -- 172.21.15.81:0/932500092 shutdown_connections 2024-05-09T00:05:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa912a36b80 1 --2- 172.21.15.81:0/932500092 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c735060e30 0x55c735063220 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa912a36b80 1 --2- 172.21.15.81:0/932500092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c734ff6720 0x55c734fffb10 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa8df7fe700 0 client.16251 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa912a36b80 1 --2- 172.21.15.81:0/932500092 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c734ff0890 0x55c734fff090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa912a36b80 1 --2- 172.21.15.81:0/932500092 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c734ff5e00 0x55c734fff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa912a36b80 1 -- 172.21.15.81:0/932500092 >> 172.21.15.81:0/932500092 conn(0x55c734f4e210 msgr2=0x55c734ff4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:50.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa912a36b80 1 -- 172.21.15.81:0/932500092 shutdown_connections 2024-05-09T00:05:50.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa912a36b80 1 -- 172.21.15.81:0/932500092 wait complete. 2024-05-09T00:05:50.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.076+0000 7fa912a36b80 20 client.16251 trim_cache size 0 max 16384 2024-05-09T00:05:50.078 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:05:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.077+0000 7fa90687c700 1 -- 172.21.15.81:0/490202313 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa8ec0a1290 msgr2=0x7fa8ec0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.077+0000 7fa90687c700 1 --2- 172.21.15.81:0/490202313 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa8ec0a1290 0x7fa8ec0a3750 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0005fd0 tx=0x7fa8f0005f60 comp rx=0 tx=0).stop 2024-05-09T00:05:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.077+0000 7fa90687c700 1 -- 172.21.15.81:0/490202313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa900105170 msgr2=0x7fa900102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.077+0000 7fa90687c700 1 --2- 172.21.15.81:0/490202313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa900105170 0x7fa900102020 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa8e800d980 tx=0x7fa8e800dd40 comp rx=0 tx=0).stop 2024-05-09T00:05:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.077+0000 7fa90687c700 1 -- 172.21.15.81:0/490202313 shutdown_connections 2024-05-09T00:05:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.077+0000 7fa90687c700 1 --2- 172.21.15.81:0/490202313 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa8ec0a1290 0x7fa8ec0a3750 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.077+0000 7fa90687c700 1 --2- 172.21.15.81:0/490202313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa900102560 0x7fa9001a56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.077+0000 7fa90687c700 1 --2- 172.21.15.81:0/490202313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa900100060 0x7fa900101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.077+0000 7fa90687c700 1 --2- 172.21.15.81:0/490202313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa900105170 0x7fa900102020 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.077+0000 7fa90687c700 1 -- 172.21.15.81:0/490202313 >> 172.21.15.81:0/490202313 conn(0x7fa900076f30 msgr2=0x7fa900069530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:50.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.077+0000 7fa90687c700 1 -- 172.21.15.81:0/490202313 shutdown_connections 2024-05-09T00:05:50.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:50.077+0000 7fa90687c700 1 -- 172.21.15.81:0/490202313 wait complete. 2024-05-09T00:05:50.263 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:49 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1171391335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:05:50.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:49 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1171391335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:05:50.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:49 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1171391335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:05:51.083 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:05:51.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:05:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.229+0000 7f30b2bff700 1 -- 172.21.15.81:0/4091372744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac1013a0 msgr2=0x7f30ac10cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.229+0000 7f30b2bff700 1 --2- 172.21.15.81:0/4091372744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac1013a0 0x7f30ac10cce0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f30a400b0d0 tx=0x7f30a400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 -- 172.21.15.81:0/4091372744 shutdown_connections 2024-05-09T00:05:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 --2- 172.21.15.81:0/4091372744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30ac104e50 0x7f30ac105230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 --2- 172.21.15.81:0/4091372744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac1013a0 0x7f30ac10cce0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 --2- 172.21.15.81:0/4091372744 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30ac1009e0 0x7f30ac100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 -- 172.21.15.81:0/4091372744 >> 172.21.15.81:0/4091372744 conn(0x7f30ac075070 msgr2=0x7f30ac075480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:51.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 -- 172.21.15.81:0/4091372744 shutdown_connections 2024-05-09T00:05:51.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 -- 172.21.15.81:0/4091372744 wait complete. 2024-05-09T00:05:51.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 Processor -- start 2024-05-09T00:05:51.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 -- start start 2024-05-09T00:05:51.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30ac1009e0 0x7f30ac197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac1013a0 0x7f30ac197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30ac104e50 0x7f30ac19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac19c370 con 0x7f30ac1013a0 2024-05-09T00:05:51.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac19c4e0 con 0x7f30ac1009e0 2024-05-09T00:05:51.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30b2bff700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac19c6a0 con 0x7f30ac104e50 2024-05-09T00:05:51.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.230+0000 7f30abfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac1013a0 0x7f30ac197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30abfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac1013a0 0x7f30ac197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59476/0 (socket says 172.21.15.81:59476) 2024-05-09T00:05:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30abfff700 1 -- 172.21.15.81:0/2492927746 learned_addr learned my addr 172.21.15.81:0/2492927746 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30b099b700 1 --2- 172.21.15.81:0/2492927746 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30ac1009e0 0x7f30ac197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30b119c700 1 --2- 172.21.15.81:0/2492927746 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30ac104e50 0x7f30ac19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30abfff700 1 -- 172.21.15.81:0/2492927746 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30ac104e50 msgr2=0x7f30ac19bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30abfff700 1 --2- 172.21.15.81:0/2492927746 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30ac104e50 0x7f30ac19bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30abfff700 1 -- 172.21.15.81:0/2492927746 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30ac1009e0 msgr2=0x7f30ac197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30abfff700 1 --2- 172.21.15.81:0/2492927746 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30ac1009e0 0x7f30ac197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30abfff700 1 -- 172.21.15.81:0/2492927746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a4009d00 con 0x7f30ac1013a0 2024-05-09T00:05:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30abfff700 1 --2- 172.21.15.81:0/2492927746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac1013a0 0x7f30ac197990 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f309800d950 tx=0x7f309800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30a9ffb700 1 -- 172.21.15.81:0/2492927746 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3098009940 con 0x7f30ac1013a0 2024-05-09T00:05:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30a9ffb700 1 -- 172.21.15.81:0/2492927746 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3098010460 con 0x7f30ac1013a0 2024-05-09T00:05:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30b2bff700 1 -- 172.21.15.81:0/2492927746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ac19c980 con 0x7f30ac1013a0 2024-05-09T00:05:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30a9ffb700 1 -- 172.21.15.81:0/2492927746 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800f620 con 0x7f30ac1013a0 2024-05-09T00:05:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.231+0000 7f30b2bff700 1 -- 172.21.15.81:0/2492927746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ac1a41c0 con 0x7f30ac1013a0 2024-05-09T00:05:51.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.233+0000 7f30a9ffb700 1 -- 172.21.15.81:0/2492927746 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f30980108d0 con 0x7f30ac1013a0 2024-05-09T00:05:51.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.234+0000 7f30a9ffb700 1 --2- 172.21.15.81:0/2492927746 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f309c0a1310 0x7f309c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.234+0000 7f30a9ffb700 1 -- 172.21.15.81:0/2492927746 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f30980ccb30 con 0x7f30ac1013a0 2024-05-09T00:05:51.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.234+0000 7f30b099b700 1 --2- 172.21.15.81:0/2492927746 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f309c0a1310 0x7f309c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.235+0000 7f30b099b700 1 --2- 172.21.15.81:0/2492927746 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f309c0a1310 0x7f309c0a37d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f30a0005950 tx=0x7f30a000b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:51.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.235+0000 7f30bedb9b80 1 Processor -- start 2024-05-09T00:05:51.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.235+0000 7f30bedb9b80 1 -- start start 2024-05-09T00:05:51.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30bedb9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 0x55f141d59260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30bedb9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d597a0 0x55f141d533d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30bedb9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d53910 0x55f141d53d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30bedb9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f141caa1d0 con 0x55f141d53910 2024-05-09T00:05:51.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30bedb9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f141ca7b90 con 0x55f141d597a0 2024-05-09T00:05:51.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30bedb9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f141ca3480 con 0x55f141d58e80 2024-05-09T00:05:51.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30b119c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d53910 0x55f141d53d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30b119c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d53910 0x55f141d53d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59482/0 (socket says 172.21.15.81:59482) 2024-05-09T00:05:51.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30b119c700 1 -- 172.21.15.81:0/1817289605 learned_addr learned my addr 172.21.15.81:0/1817289605 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:51.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30b099b700 1 --2- 172.21.15.81:0/1817289605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 0x55f141d59260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30b119c700 1 -- 172.21.15.81:0/1817289605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 msgr2=0x55f141d59260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30abfff700 1 --2- 172.21.15.81:0/1817289605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d597a0 0x55f141d533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30b119c700 1 --2- 172.21.15.81:0/1817289605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 0x55f141d59260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30b119c700 1 -- 172.21.15.81:0/1817289605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d597a0 msgr2=0x55f141d533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30b119c700 1 --2- 172.21.15.81:0/1817289605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d597a0 0x55f141d533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30b119c700 1 -- 172.21.15.81:0/1817289605 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f141b24430 con 0x55f141d53910 2024-05-09T00:05:51.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30b099b700 1 --2- 172.21.15.81:0/1817289605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 0x55f141d59260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:51.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30abfff700 1 --2- 172.21.15.81:0/1817289605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d597a0 0x55f141d533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:51.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f30b119c700 1 --2- 172.21.15.81:0/1817289605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d53910 0x55f141d53d50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009c50 tx=0x7f30a4009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7868136b100721ae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:51.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f3096ffd700 1 -- 172.21.15.81:0/1817289605 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a400e050 con 0x55f141d53910 2024-05-09T00:05:51.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f3096ffd700 1 -- 172.21.15.81:0/1817289605 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30a4007d70 con 0x55f141d53910 2024-05-09T00:05:51.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.236+0000 7f3096ffd700 1 -- 172.21.15.81:0/1817289605 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a4007860 con 0x55f141d53910 2024-05-09T00:05:51.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.237+0000 7f30bedb9b80 1 -- 172.21.15.81:0/1817289605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d53910 msgr2=0x55f141d53d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.237+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/1817289605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d53910 0x55f141d53d50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009c50 tx=0x7f30a4009c80 comp rx=0 tx=0).stop 2024-05-09T00:05:51.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.237+0000 7f30bedb9b80 1 -- 172.21.15.81:0/1817289605 shutdown_connections 2024-05-09T00:05:51.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.237+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/1817289605 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d53910 0x55f141d53d50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.237+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/1817289605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 0x55f141d59260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.237+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/1817289605 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d597a0 0x55f141d533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.237+0000 7f30bedb9b80 1 -- 172.21.15.81:0/1817289605 >> 172.21.15.81:0/1817289605 conn(0x55f141cb1290 msgr2=0x55f141d4de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:51.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.237+0000 7f30bedb9b80 1 -- 172.21.15.81:0/1817289605 shutdown_connections 2024-05-09T00:05:51.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.237+0000 7f30bedb9b80 1 -- 172.21.15.81:0/1817289605 wait complete. 2024-05-09T00:05:51.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.237+0000 7f30bedb9b80 1 -- start start 2024-05-09T00:05:51.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30bedb9b80 1 Processor -- start 2024-05-09T00:05:51.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30bedb9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d53910 0x55f141d5f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30bedb9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 0x55f141d5caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30bedb9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d597a0 0x55f141d5d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30bedb9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f141c3f5e0 con 0x55f141d597a0 2024-05-09T00:05:51.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30bedb9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f141c3f280 con 0x55f141d53910 2024-05-09T00:05:51.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30bedb9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f141b26720 con 0x55f141d58e80 2024-05-09T00:05:51.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30bedb9b80 10 client.0 _ll_register_callbacks cb 0x55f141c48bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:51.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30b119c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d597a0 0x55f141d5d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30b119c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d597a0 0x55f141d5d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59488/0 (socket says 172.21.15.81:59488) 2024-05-09T00:05:51.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30b119c700 1 -- 172.21.15.81:0/3714466087 learned_addr learned my addr 172.21.15.81:0/3714466087 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:51.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30b099b700 1 --2- 172.21.15.81:0/3714466087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d53910 0x55f141d5f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30abfff700 1 --2- 172.21.15.81:0/3714466087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 0x55f141d5caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30b119c700 1 -- 172.21.15.81:0/3714466087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 msgr2=0x55f141d5caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30b119c700 1 --2- 172.21.15.81:0/3714466087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 0x55f141d5caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30b119c700 1 -- 172.21.15.81:0/3714466087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d53910 msgr2=0x55f141d5f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30b119c700 1 --2- 172.21.15.81:0/3714466087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d53910 0x55f141d5f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.238+0000 7f30b119c700 1 -- 172.21.15.81:0/3714466087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ac10d5e0 con 0x55f141d597a0 2024-05-09T00:05:51.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f30b119c700 1 --2- 172.21.15.81:0/3714466087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d597a0 0x55f141d5d230 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f30a400b0d0 tx=0x7f30a40099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac8a376a9a6eb97 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:51.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f308bfff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:51.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f308bfff700 1 -- 172.21.15.81:0/3714466087 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a40076b0 con 0x55f141d597a0 2024-05-09T00:05:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f30bedb9b80 1 -- 172.21.15.81:0/3714466087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f141bfc2f0 con 0x55f141d597a0 2024-05-09T00:05:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f308bfff700 1 -- 172.21.15.81:0/3714466087 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f30a4007810 con 0x55f141d597a0 2024-05-09T00:05:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f308bfff700 1 -- 172.21.15.81:0/3714466087 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30a40079d0 con 0x55f141d597a0 2024-05-09T00:05:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f30bedb9b80 10 client.16263 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f30bedb9b80 1 -- 172.21.15.81:0/3714466087 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f141ad0be0 con 0x55f141d597a0 2024-05-09T00:05:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f308bfff700 1 -- 172.21.15.81:0/3714466087 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f141bfc2f0 con 0x55f141d597a0 2024-05-09T00:05:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f308bfff700 1 -- 172.21.15.81:0/3714466087 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f30a400b100 con 0x55f141d597a0 2024-05-09T00:05:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f30bedb9b80 10 client.16263 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f30bedb9b80 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f30bedb9b80 20 client.16263 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:51.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/3714466087 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f141d6cc00 0x55f141d6f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f30bedb9b80 4 client.16263 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.239+0000 7f30bedb9b80 1 -- 172.21.15.81:0/3714466087 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f141d22890 con 0x55f141d6cc00 2024-05-09T00:05:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.240+0000 7f30b099b700 1 --2- 172.21.15.81:0/3714466087 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f141d6cc00 0x55f141d6f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.240+0000 7f308bfff700 10 client.16263 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.240+0000 7f30b099b700 1 --2- 172.21.15.81:0/3714466087 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f141d6cc00 0x55f141d6f020 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2dabb0e28f25bb1e server_cookie=a5a0594aee0de7c3 in_seq=0 out_seq=0 2024-05-09T00:05:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f308bfff700 1 -- 172.21.15.81:0/3714466087 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f141d22890 con 0x55f141d6cc00 2024-05-09T00:05:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f308bfff700 10 client.16263 handle_command_reply: tid=0 2024-05-09T00:05:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f30bedb9b80 1 client.16263 shutdown 2024-05-09T00:05:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f30bedb9b80 1 -- 172.21.15.81:0/3714466087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d597a0 msgr2=0x55f141d5d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/3714466087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d597a0 0x55f141d5d230 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f30a400b0d0 tx=0x7f30a40099e0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f30bedb9b80 1 -- 172.21.15.81:0/3714466087 shutdown_connections 2024-05-09T00:05:51.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/3714466087 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f141d6cc00 0x55f141d6f020 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/3714466087 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d53910 0x55f141d5f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f308bfff700 0 client.16263 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:51.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/3714466087 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d597a0 0x55f141d5d230 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/3714466087 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 0x55f141d5caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f30bedb9b80 1 -- 172.21.15.81:0/3714466087 >> 172.21.15.81:0/3714466087 conn(0x55f141cb1290 msgr2=0x55f141d4d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:51.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f30bedb9b80 1 -- 172.21.15.81:0/3714466087 shutdown_connections 2024-05-09T00:05:51.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f30bedb9b80 1 -- 172.21.15.81:0/3714466087 wait complete. 2024-05-09T00:05:51.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.241+0000 7f30bedb9b80 20 client.16263 trim_cache size 0 max 16384 2024-05-09T00:05:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.258+0000 7f30bedb9b80 1 Processor -- start 2024-05-09T00:05:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.258+0000 7f30bedb9b80 1 -- start start 2024-05-09T00:05:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30bedb9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d53910 0x55f141d5ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30bedb9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 0x55f141d58470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30bedb9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d597a0 0x55f141d4dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30bedb9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f141d5e0a0 con 0x55f141d597a0 2024-05-09T00:05:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30bedb9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f141d589b0 con 0x55f141d53910 2024-05-09T00:05:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30bedb9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f141d54320 con 0x55f141d58e80 2024-05-09T00:05:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30b119c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d597a0 0x55f141d4dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30b119c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d597a0 0x55f141d4dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59500/0 (socket says 172.21.15.81:59500) 2024-05-09T00:05:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30b119c700 1 -- 172.21.15.81:0/1657300330 learned_addr learned my addr 172.21.15.81:0/1657300330 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:51.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30abfff700 1 --2- 172.21.15.81:0/1657300330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 0x55f141d58470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30b099b700 1 --2- 172.21.15.81:0/1657300330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d53910 0x55f141d5ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30b119c700 1 -- 172.21.15.81:0/1657300330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 msgr2=0x55f141d58470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30b119c700 1 --2- 172.21.15.81:0/1657300330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 0x55f141d58470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30b119c700 1 -- 172.21.15.81:0/1657300330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d53910 msgr2=0x55f141d5ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30b119c700 1 --2- 172.21.15.81:0/1657300330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d53910 0x55f141d5ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30b119c700 1 -- 172.21.15.81:0/1657300330 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f141c695e0 con 0x55f141d597a0 2024-05-09T00:05:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30abfff700 1 --2- 172.21.15.81:0/1657300330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 0x55f141d58470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30b099b700 1 --2- 172.21.15.81:0/1657300330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d53910 0x55f141d5ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30b119c700 1 --2- 172.21.15.81:0/1657300330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d597a0 0x55f141d4dda0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f30a4002230 tx=0x7f30a4004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b0a4f1e1788c49 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30977fe700 1 -- 172.21.15.81:0/1657300330 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a400e040 con 0x55f141d597a0 2024-05-09T00:05:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30977fe700 1 -- 172.21.15.81:0/1657300330 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30a4009b80 con 0x55f141d597a0 2024-05-09T00:05:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.259+0000 7f30977fe700 1 -- 172.21.15.81:0/1657300330 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a4005a60 con 0x55f141d597a0 2024-05-09T00:05:51.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.260+0000 7f30bedb9b80 1 -- 172.21.15.81:0/1657300330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d597a0 msgr2=0x55f141d4dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.260+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/1657300330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d597a0 0x55f141d4dda0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f30a4002230 tx=0x7f30a4004a50 comp rx=0 tx=0).stop 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.260+0000 7f30bedb9b80 1 -- 172.21.15.81:0/1657300330 shutdown_connections 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.260+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/1657300330 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d53910 0x55f141d5ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.260+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/1657300330 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d597a0 0x55f141d4dda0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.260+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/1657300330 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d58e80 0x55f141d58470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.260+0000 7f30bedb9b80 1 -- 172.21.15.81:0/1657300330 >> 172.21.15.81:0/1657300330 conn(0x55f141cb1290 msgr2=0x55f141d5b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.260+0000 7f30bedb9b80 1 -- 172.21.15.81:0/1657300330 shutdown_connections 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.260+0000 7f30bedb9b80 1 -- 172.21.15.81:0/1657300330 wait complete. 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.260+0000 7f30bedb9b80 1 -- start start 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.260+0000 7f30bedb9b80 1 Processor -- start 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30bedb9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d53910 0x55f141d60f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30bedb9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d58e80 0x55f141d614c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30bedb9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d597a0 0x55f141dc74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30bedb9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f141d61c70 con 0x55f141d53910 2024-05-09T00:05:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30bedb9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f141d61de0 con 0x55f141d58e80 2024-05-09T00:05:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30bedb9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f141dc7a40 con 0x55f141d597a0 2024-05-09T00:05:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30bedb9b80 10 client.0 _ll_register_callbacks cb 0x55f141c48bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30b099b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d53910 0x55f141d60f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30b099b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d53910 0x55f141d60f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59508/0 (socket says 172.21.15.81:59508) 2024-05-09T00:05:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30b099b700 1 -- 172.21.15.81:0/2149020619 learned_addr learned my addr 172.21.15.81:0/2149020619 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30abfff700 1 --2- 172.21.15.81:0/2149020619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d58e80 0x55f141d614c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30b119c700 1 --2- 172.21.15.81:0/2149020619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d597a0 0x55f141dc74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30b099b700 1 -- 172.21.15.81:0/2149020619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d597a0 msgr2=0x55f141dc74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30b099b700 1 --2- 172.21.15.81:0/2149020619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d597a0 0x55f141dc74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30b099b700 1 -- 172.21.15.81:0/2149020619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d58e80 msgr2=0x55f141d614c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30b099b700 1 --2- 172.21.15.81:0/2149020619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d58e80 0x55f141d614c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30b099b700 1 -- 172.21.15.81:0/2149020619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f141ad0be0 con 0x55f141d53910 2024-05-09T00:05:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30b099b700 1 --2- 172.21.15.81:0/2149020619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d53910 0x55f141d60f80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f30a0005d90 tx=0x7f30a00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7418ed8650c23bb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f308bfff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f308bfff700 1 -- 172.21.15.81:0/2149020619 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a002a070 con 0x55f141d53910 2024-05-09T00:05:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f308bfff700 1 -- 172.21.15.81:0/2149020619 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f30a0017070 con 0x55f141d53910 2024-05-09T00:05:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30bedb9b80 1 -- 172.21.15.81:0/2149020619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f141c9bf40 con 0x55f141d53910 2024-05-09T00:05:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f308bfff700 1 -- 172.21.15.81:0/2149020619 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30a0025070 con 0x55f141d53910 2024-05-09T00:05:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30bedb9b80 10 client.16269 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.261+0000 7f30bedb9b80 1 -- 172.21.15.81:0/2149020619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f141b28d50 con 0x55f141d53910 2024-05-09T00:05:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.262+0000 7f308bfff700 1 -- 172.21.15.81:0/2149020619 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f141c9bf40 con 0x55f141d53910 2024-05-09T00:05:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.262+0000 7f308bfff700 1 -- 172.21.15.81:0/2149020619 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f30a002d020 con 0x55f141d53910 2024-05-09T00:05:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.262+0000 7f30bedb9b80 10 client.16269 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.262+0000 7f30bedb9b80 10 client.16269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.262+0000 7f30bedb9b80 20 client.16269 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.262+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/2149020619 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f141dc9250 0x55f141dcb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.262+0000 7f30bedb9b80 4 client.16269 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:05:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.262+0000 7f30bedb9b80 1 -- 172.21.15.81:0/2149020619 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f141af1d70 con 0x55f141dc9250 2024-05-09T00:05:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.262+0000 7f30abfff700 1 --2- 172.21.15.81:0/2149020619 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f141dc9250 0x55f141dcb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.262+0000 7f308bfff700 10 client.16269 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.262+0000 7f30abfff700 1 --2- 172.21.15.81:0/2149020619 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f141dc9250 0x55f141dcb670 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cc9095391e54bf server_cookie=d58bb5d43871b876 in_seq=0 out_seq=0 2024-05-09T00:05:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.263+0000 7f308bfff700 1 -- 172.21.15.81:0/2149020619 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f141af1d70 con 0x55f141dc9250 2024-05-09T00:05:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.263+0000 7f308bfff700 10 client.16269 handle_command_reply: tid=0 2024-05-09T00:05:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.263+0000 7f30bedb9b80 1 client.16269 shutdown 2024-05-09T00:05:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.263+0000 7f30bedb9b80 1 -- 172.21.15.81:0/2149020619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d53910 msgr2=0x55f141d60f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.263+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/2149020619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d53910 0x55f141d60f80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f30a0005d90 tx=0x7f30a00047c0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30bedb9b80 1 -- 172.21.15.81:0/2149020619 shutdown_connections 2024-05-09T00:05:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/2149020619 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f141dc9250 0x55f141dcb670 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/2149020619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f141d597a0 0x55f141dc74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/2149020619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f141d53910 0x55f141d60f80 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f308bfff700 0 client.16269 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30bedb9b80 1 --2- 172.21.15.81:0/2149020619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f141d58e80 0x55f141d614c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30bedb9b80 1 -- 172.21.15.81:0/2149020619 >> 172.21.15.81:0/2149020619 conn(0x55f141cb1290 msgr2=0x55f141d5bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30bedb9b80 1 -- 172.21.15.81:0/2149020619 shutdown_connections 2024-05-09T00:05:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30bedb9b80 1 -- 172.21.15.81:0/2149020619 wait complete. 2024-05-09T00:05:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30bedb9b80 20 client.16269 trim_cache size 0 max 16384 2024-05-09T00:05:51.264 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:05:51.264 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:05:51.264 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "085f73c1-4ebc-413d-aa37-4edc0073ef37", 2024-05-09T00:05:51.265 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:05:51.265 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:05:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30b2bff700 1 -- 172.21.15.81:0/2492927746 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f309c0a1310 msgr2=0x7f309c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30b2bff700 1 --2- 172.21.15.81:0/2492927746 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f309c0a1310 0x7f309c0a37d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f30a0005950 tx=0x7f30a000b410 comp rx=0 tx=0).stop 2024-05-09T00:05:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30b2bff700 1 -- 172.21.15.81:0/2492927746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac1013a0 msgr2=0x7f30ac197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30b2bff700 1 --2- 172.21.15.81:0/2492927746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac1013a0 0x7f30ac197990 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f309800d950 tx=0x7f309800dc60 comp rx=0 tx=0).stop 2024-05-09T00:05:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30b2bff700 1 -- 172.21.15.81:0/2492927746 shutdown_connections 2024-05-09T00:05:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30b2bff700 1 --2- 172.21.15.81:0/2492927746 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f309c0a1310 0x7f309c0a37d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30b2bff700 1 --2- 172.21.15.81:0/2492927746 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30ac1009e0 0x7f30ac197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30b2bff700 1 --2- 172.21.15.81:0/2492927746 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30ac104e50 0x7f30ac19bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30b2bff700 1 --2- 172.21.15.81:0/2492927746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac1013a0 0x7f30ac197990 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30b2bff700 1 -- 172.21.15.81:0/2492927746 >> 172.21.15.81:0/2492927746 conn(0x7f30ac075070 msgr2=0x7f30ac0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30b2bff700 1 -- 172.21.15.81:0/2492927746 shutdown_connections 2024-05-09T00:05:51.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.264+0000 7f30b2bff700 1 -- 172.21.15.81:0/2492927746 wait complete. 2024-05-09T00:05:51.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:51 smithi150 ceph-mon[46187]: pgmap v90: 97 pgs: 97 active+clean; 2.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-05-09T00:05:51.269 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:51 smithi081 ceph-mon[42474]: pgmap v90: 97 pgs: 97 active+clean; 2.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-05-09T00:05:51.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:05:51.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:51 smithi171 ceph-mon[47351]: pgmap v90: 97 pgs: 97 active+clean; 2.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 19 op/s 2024-05-09T00:05:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.400+0000 7f2334e47700 1 -- 172.21.15.81:0/1860277151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2330101570 msgr2=0x7f2330104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.400+0000 7f2334e47700 1 --2- 172.21.15.81:0/1860277151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2330101570 0x7f2330104aa0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2320009990 tx=0x7f2320009ca0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.400+0000 7f2334e47700 1 -- 172.21.15.81:0/1860277151 shutdown_connections 2024-05-09T00:05:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.400+0000 7f2334e47700 1 --2- 172.21.15.81:0/1860277151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23301051d0 0x7f233010cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.400+0000 7f2334e47700 1 --2- 172.21.15.81:0/1860277151 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2330100bc0 0x7f2330100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.400+0000 7f2334e47700 1 --2- 172.21.15.81:0/1860277151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2330101570 0x7f2330104aa0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.400+0000 7f2334e47700 1 -- 172.21.15.81:0/1860277151 >> 172.21.15.81:0/1860277151 conn(0x7f2330075120 msgr2=0x7f2330075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.400+0000 7f2334e47700 1 -- 172.21.15.81:0/1860277151 shutdown_connections 2024-05-09T00:05:51.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.400+0000 7f2334e47700 1 -- 172.21.15.81:0/1860277151 wait complete. 2024-05-09T00:05:51.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.401+0000 7f2334e47700 1 Processor -- start 2024-05-09T00:05:51.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.401+0000 7f2334e47700 1 -- start start 2024-05-09T00:05:51.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.401+0000 7f2334e47700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2330100bc0 0x7f23301973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.401+0000 7f2334e47700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23301051d0 0x7f2330197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.401+0000 7f2334e47700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233019bc60 0x7f233019c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.401+0000 7f2334e47700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233019c6e0 con 0x7f233019bc60 2024-05-09T00:05:51.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.401+0000 7f2334e47700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233019c850 con 0x7f23301051d0 2024-05-09T00:05:51.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.401+0000 7f2334e47700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233019ca10 con 0x7f2330100bc0 2024-05-09T00:05:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.401+0000 7f232ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233019bc60 0x7f233019c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.401+0000 7f232ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233019bc60 0x7f233019c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59524/0 (socket says 172.21.15.81:59524) 2024-05-09T00:05:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.401+0000 7f232ed9d700 1 -- 172.21.15.81:0/1116222377 learned_addr learned my addr 172.21.15.81:0/1116222377 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.401+0000 7f232e59c700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2330100bc0 0x7f23301973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.402+0000 7f232dd9b700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23301051d0 0x7f2330197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.402+0000 7f232ed9d700 1 -- 172.21.15.81:0/1116222377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2330100bc0 msgr2=0x7f23301973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.402+0000 7f232ed9d700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2330100bc0 0x7f23301973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.402+0000 7f232ed9d700 1 -- 172.21.15.81:0/1116222377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23301051d0 msgr2=0x7f2330197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.402+0000 7f232ed9d700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23301051d0 0x7f2330197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.402+0000 7f232ed9d700 1 -- 172.21.15.81:0/1116222377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200095f0 con 0x7f233019bc60 2024-05-09T00:05:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.402+0000 7f232e59c700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2330100bc0 0x7f23301973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.402+0000 7f232ed9d700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233019bc60 0x7f233019c0e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2328007d70 tx=0x7f232800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:51.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.402+0000 7f231f7fe700 1 -- 172.21.15.81:0/1116222377 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232800ad40 con 0x7f233019bc60 2024-05-09T00:05:51.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.402+0000 7f231f7fe700 1 -- 172.21.15.81:0/1116222377 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23280128e0 con 0x7f233019bc60 2024-05-09T00:05:51.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.402+0000 7f2334e47700 1 -- 172.21.15.81:0/1116222377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23301a3f70 con 0x7f233019bc60 2024-05-09T00:05:51.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.402+0000 7f231f7fe700 1 -- 172.21.15.81:0/1116222377 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328011780 con 0x7f233019bc60 2024-05-09T00:05:51.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.402+0000 7f2334e47700 1 -- 172.21.15.81:0/1116222377 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23301a4400 con 0x7f233019bc60 2024-05-09T00:05:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.404+0000 7f231f7fe700 1 -- 172.21.15.81:0/1116222377 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f2328011920 con 0x7f233019bc60 2024-05-09T00:05:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.405+0000 7f231f7fe700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f23180a1290 0x7f23180a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.405+0000 7f232e59c700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f23180a1290 0x7f23180a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.405+0000 7f231f7fe700 1 -- 172.21.15.81:0/1116222377 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f23280cced0 con 0x7f233019bc60 2024-05-09T00:05:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.405+0000 7f232e59c700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f23180a1290 0x7f23180a3750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2324005950 tx=0x7f2324005f50 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.405+0000 7f2341001b80 1 Processor -- start 2024-05-09T00:05:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.405+0000 7f2341001b80 1 -- start start 2024-05-09T00:05:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f2341001b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4be00 0x5592a9c4c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f2341001b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c4c720 0x5592a9c46350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f2341001b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c46890 0x5592a9c46cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f2341001b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a9b9d150 con 0x5592a9c46890 2024-05-09T00:05:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f2341001b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a9b9ab10 con 0x5592a9c4be00 2024-05-09T00:05:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f2341001b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a9b96400 con 0x5592a9c4c720 2024-05-09T00:05:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f232ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c46890 0x5592a9c46cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f232ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c46890 0x5592a9c46cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59532/0 (socket says 172.21.15.81:59532) 2024-05-09T00:05:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f232ed9d700 1 -- 172.21.15.81:0/350764930 learned_addr learned my addr 172.21.15.81:0/350764930 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f232e59c700 1 --2- 172.21.15.81:0/350764930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4be00 0x5592a9c4c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f232ed9d700 1 -- 172.21.15.81:0/350764930 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c4c720 msgr2=0x5592a9c46350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f232ed9d700 1 --2- 172.21.15.81:0/350764930 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c4c720 0x5592a9c46350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f232ed9d700 1 -- 172.21.15.81:0/350764930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4be00 msgr2=0x5592a9c4c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f232ed9d700 1 --2- 172.21.15.81:0/350764930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4be00 0x5592a9c4c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f232ed9d700 1 -- 172.21.15.81:0/350764930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592a9a173b0 con 0x5592a9c46890 2024-05-09T00:05:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f232e59c700 1 --2- 172.21.15.81:0/350764930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4be00 0x5592a9c4c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f232ed9d700 1 --2- 172.21.15.81:0/350764930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c46890 0x5592a9c46cd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f23280ca6d0 tx=0x7f2328099c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594af9e0ad8bc03b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f231cff9700 1 -- 172.21.15.81:0/350764930 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23280a2570 con 0x5592a9c46890 2024-05-09T00:05:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f231cff9700 1 -- 172.21.15.81:0/350764930 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2328012a50 con 0x5592a9c46890 2024-05-09T00:05:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.406+0000 7f231cff9700 1 -- 172.21.15.81:0/350764930 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328099a10 con 0x5592a9c46890 2024-05-09T00:05:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.407+0000 7f2341001b80 1 -- 172.21.15.81:0/350764930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c46890 msgr2=0x5592a9c46cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.407+0000 7f2341001b80 1 --2- 172.21.15.81:0/350764930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c46890 0x5592a9c46cd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f23280ca6d0 tx=0x7f2328099c80 comp rx=0 tx=0).stop 2024-05-09T00:05:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.407+0000 7f2341001b80 1 -- 172.21.15.81:0/350764930 shutdown_connections 2024-05-09T00:05:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.407+0000 7f2341001b80 1 --2- 172.21.15.81:0/350764930 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4be00 0x5592a9c4c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.407+0000 7f2341001b80 1 --2- 172.21.15.81:0/350764930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c46890 0x5592a9c46cd0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.407+0000 7f2341001b80 1 --2- 172.21.15.81:0/350764930 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c4c720 0x5592a9c46350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.407+0000 7f2341001b80 1 -- 172.21.15.81:0/350764930 >> 172.21.15.81:0/350764930 conn(0x5592a9ba4210 msgr2=0x5592a9c40df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.407+0000 7f2341001b80 1 -- 172.21.15.81:0/350764930 shutdown_connections 2024-05-09T00:05:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.407+0000 7f2341001b80 1 -- 172.21.15.81:0/350764930 wait complete. 2024-05-09T00:05:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.407+0000 7f2341001b80 1 -- start start 2024-05-09T00:05:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f2341001b80 1 Processor -- start 2024-05-09T00:05:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f2341001b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c46890 0x5592a9c4fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f2341001b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4be00 0x5592a9c50160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f2341001b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4c720 0x5592a9c506a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f2341001b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a9b32560 con 0x5592a9c4be00 2024-05-09T00:05:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f2341001b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a9b32200 con 0x5592a9c4c720 2024-05-09T00:05:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f2341001b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a9a196a0 con 0x5592a9c46890 2024-05-09T00:05:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f232dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4be00 0x5592a9c50160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f2341001b80 10 client.0 _ll_register_callbacks cb 0x5592a9b3bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:51.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f232dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4be00 0x5592a9c50160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59546/0 (socket says 172.21.15.81:59546) 2024-05-09T00:05:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f232dd9b700 1 -- 172.21.15.81:0/936641383 learned_addr learned my addr 172.21.15.81:0/936641383 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f232ed9d700 1 --2- 172.21.15.81:0/936641383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4c720 0x5592a9c506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f232e59c700 1 --2- 172.21.15.81:0/936641383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c46890 0x5592a9c4fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f232dd9b700 1 -- 172.21.15.81:0/936641383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c46890 msgr2=0x5592a9c4fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f232dd9b700 1 --2- 172.21.15.81:0/936641383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c46890 0x5592a9c4fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f232dd9b700 1 -- 172.21.15.81:0/936641383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4c720 msgr2=0x5592a9c506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f232dd9b700 1 --2- 172.21.15.81:0/936641383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4c720 0x5592a9c506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.408+0000 7f232dd9b700 1 -- 172.21.15.81:0/936641383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23301a4400 con 0x5592a9c4be00 2024-05-09T00:05:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f232dd9b700 1 --2- 172.21.15.81:0/936641383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4be00 0x5592a9c50160 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2330073690 tx=0x7f2320005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5fab996677470dc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2315ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2315ffb700 1 -- 172.21.15.81:0/936641383 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232000bb80 con 0x5592a9c4be00 2024-05-09T00:05:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2315ffb700 1 -- 172.21.15.81:0/936641383 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f232000bce0 con 0x5592a9c4be00 2024-05-09T00:05:51.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2341001b80 1 -- 172.21.15.81:0/936641383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5592a9aef270 con 0x5592a9c4be00 2024-05-09T00:05:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2315ffb700 1 -- 172.21.15.81:0/936641383 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f232000bea0 con 0x5592a9c4be00 2024-05-09T00:05:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2341001b80 10 client.16281 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2341001b80 1 -- 172.21.15.81:0/936641383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5592a99c3b60 con 0x5592a9c4be00 2024-05-09T00:05:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2315ffb700 1 -- 172.21.15.81:0/936641383 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f232002f020 con 0x5592a9c4be00 2024-05-09T00:05:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2315ffb700 1 -- 172.21.15.81:0/936641383 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f232000f5e0 con 0x5592a9c4be00 2024-05-09T00:05:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2341001b80 10 client.16281 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2341001b80 10 client.16281 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2341001b80 20 client.16281 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2341001b80 1 --2- 172.21.15.81:0/936641383 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5592a9c601d0 0x5592a9c625f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2341001b80 4 client.16281 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:05:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f2341001b80 1 -- 172.21.15.81:0/936641383 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5592a9c15810 con 0x5592a9c601d0 2024-05-09T00:05:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.409+0000 7f232e59c700 1 --2- 172.21.15.81:0/936641383 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5592a9c601d0 0x5592a9c625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.410+0000 7f2315ffb700 10 client.16281 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.410+0000 7f232e59c700 1 --2- 172.21.15.81:0/936641383 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5592a9c601d0 0x5592a9c625f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa7dbb80bf4f095e server_cookie=d170fdd6dc91cc79 in_seq=0 out_seq=0 2024-05-09T00:05:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.410+0000 7f2315ffb700 1 -- 172.21.15.81:0/936641383 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5592a9c15810 con 0x5592a9c601d0 2024-05-09T00:05:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.410+0000 7f2315ffb700 10 client.16281 handle_command_reply: tid=0 2024-05-09T00:05:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.410+0000 7f2341001b80 1 client.16281 shutdown 2024-05-09T00:05:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.411+0000 7f2341001b80 1 -- 172.21.15.81:0/936641383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4be00 msgr2=0x5592a9c50160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.411+0000 7f2341001b80 1 --2- 172.21.15.81:0/936641383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4be00 0x5592a9c50160 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2330073690 tx=0x7f2320005750 comp rx=0 tx=0).stop 2024-05-09T00:05:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.411+0000 7f2341001b80 1 -- 172.21.15.81:0/936641383 shutdown_connections 2024-05-09T00:05:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.411+0000 7f2341001b80 1 --2- 172.21.15.81:0/936641383 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5592a9c601d0 0x5592a9c625f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.411+0000 7f2341001b80 1 --2- 172.21.15.81:0/936641383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4c720 0x5592a9c506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.411+0000 7f2341001b80 1 --2- 172.21.15.81:0/936641383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c46890 0x5592a9c4fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.411+0000 7f2315ffb700 0 client.16281 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.411+0000 7f2341001b80 1 --2- 172.21.15.81:0/936641383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4be00 0x5592a9c50160 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.411+0000 7f2341001b80 1 -- 172.21.15.81:0/936641383 >> 172.21.15.81:0/936641383 conn(0x5592a9ba4210 msgr2=0x5592a9c405a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.411+0000 7f2341001b80 1 -- 172.21.15.81:0/936641383 shutdown_connections 2024-05-09T00:05:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.411+0000 7f2341001b80 1 -- 172.21.15.81:0/936641383 wait complete. 2024-05-09T00:05:51.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.411+0000 7f2341001b80 20 client.16281 trim_cache size 0 max 16384 2024-05-09T00:05:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f2341001b80 1 Processor -- start 2024-05-09T00:05:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f2341001b80 1 -- start start 2024-05-09T00:05:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f2341001b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c46890 0x5592a9c46350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f2341001b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4be00 0x5592a9c4b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f2341001b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4c720 0x5592a9c40d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f2341001b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a9c67800 con 0x5592a9c4be00 2024-05-09T00:05:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f2341001b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a9c4c430 con 0x5592a9c4c720 2024-05-09T00:05:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f2341001b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a9c49870 con 0x5592a9c46890 2024-05-09T00:05:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f232dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4be00 0x5592a9c4b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f232dd9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4be00 0x5592a9c4b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59562/0 (socket says 172.21.15.81:59562) 2024-05-09T00:05:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f232dd9b700 1 -- 172.21.15.81:0/488147088 learned_addr learned my addr 172.21.15.81:0/488147088 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f232e59c700 1 --2- 172.21.15.81:0/488147088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c46890 0x5592a9c46350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f232ed9d700 1 --2- 172.21.15.81:0/488147088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4c720 0x5592a9c40d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f232dd9b700 1 -- 172.21.15.81:0/488147088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c46890 msgr2=0x5592a9c46350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f232dd9b700 1 --2- 172.21.15.81:0/488147088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c46890 0x5592a9c46350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f232dd9b700 1 -- 172.21.15.81:0/488147088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4c720 msgr2=0x5592a9c40d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f232dd9b700 1 --2- 172.21.15.81:0/488147088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4c720 0x5592a9c40d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f232dd9b700 1 -- 172.21.15.81:0/488147088 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592a9b5c560 con 0x5592a9c4be00 2024-05-09T00:05:51.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f232ed9d700 1 --2- 172.21.15.81:0/488147088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4c720 0x5592a9c40d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:05:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f232e59c700 1 --2- 172.21.15.81:0/488147088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c46890 0x5592a9c46350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.428+0000 7f232dd9b700 1 --2- 172.21.15.81:0/488147088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4be00 0x5592a9c4b420 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f23200098e0 tx=0x7f2320001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556629177690457d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.429+0000 7f231d7fa700 1 -- 172.21.15.81:0/488147088 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232000f660 con 0x5592a9c4be00 2024-05-09T00:05:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.429+0000 7f231d7fa700 1 -- 172.21.15.81:0/488147088 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f232002f030 con 0x5592a9c4be00 2024-05-09T00:05:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.429+0000 7f231d7fa700 1 -- 172.21.15.81:0/488147088 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320004960 con 0x5592a9c4be00 2024-05-09T00:05:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.429+0000 7f2341001b80 1 -- 172.21.15.81:0/488147088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4be00 msgr2=0x5592a9c4b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.429+0000 7f2341001b80 1 --2- 172.21.15.81:0/488147088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4be00 0x5592a9c4b420 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f23200098e0 tx=0x7f2320001e50 comp rx=0 tx=0).stop 2024-05-09T00:05:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.429+0000 7f2341001b80 1 -- 172.21.15.81:0/488147088 shutdown_connections 2024-05-09T00:05:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.429+0000 7f2341001b80 1 --2- 172.21.15.81:0/488147088 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c4c720 0x5592a9c40d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.429+0000 7f2341001b80 1 --2- 172.21.15.81:0/488147088 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c46890 0x5592a9c46350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.429+0000 7f2341001b80 1 --2- 172.21.15.81:0/488147088 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4be00 0x5592a9c4b420 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.429+0000 7f2341001b80 1 -- 172.21.15.81:0/488147088 >> 172.21.15.81:0/488147088 conn(0x5592a9ba4210 msgr2=0x5592a9c4ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:51.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.429+0000 7f2341001b80 1 -- 172.21.15.81:0/488147088 shutdown_connections 2024-05-09T00:05:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.429+0000 7f2341001b80 1 -- 172.21.15.81:0/488147088 wait complete. 2024-05-09T00:05:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.429+0000 7f2341001b80 1 -- start start 2024-05-09T00:05:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f2341001b80 1 Processor -- start 2024-05-09T00:05:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f2341001b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c46890 0x5592a9c55370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f2341001b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c4be00 0x5592a9c558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f2341001b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4c720 0x5592a9caf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f2341001b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a9cafc50 con 0x5592a9c4c720 2024-05-09T00:05:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f2341001b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a9cafd90 con 0x5592a9c46890 2024-05-09T00:05:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f2341001b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a9caff50 con 0x5592a9c4be00 2024-05-09T00:05:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f2341001b80 10 client.0 _ll_register_callbacks cb 0x5592a9b3bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:05:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f232ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4c720 0x5592a9caf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f232ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4c720 0x5592a9caf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59570/0 (socket says 172.21.15.81:59570) 2024-05-09T00:05:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f232ed9d700 1 -- 172.21.15.81:0/4045726169 learned_addr learned my addr 172.21.15.81:0/4045726169 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:05:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f232dd9b700 1 --2- 172.21.15.81:0/4045726169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c4be00 0x5592a9c558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f232e59c700 1 --2- 172.21.15.81:0/4045726169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c46890 0x5592a9c55370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f232ed9d700 1 -- 172.21.15.81:0/4045726169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c4be00 msgr2=0x5592a9c558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f232ed9d700 1 --2- 172.21.15.81:0/4045726169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c4be00 0x5592a9c558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f232ed9d700 1 -- 172.21.15.81:0/4045726169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c46890 msgr2=0x5592a9c55370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:05:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f232ed9d700 1 --2- 172.21.15.81:0/4045726169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c46890 0x5592a9c55370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f232ed9d700 1 -- 172.21.15.81:0/4045726169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5592a99c3b60 con 0x5592a9c4c720 2024-05-09T00:05:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f232e59c700 1 --2- 172.21.15.81:0/4045726169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c46890 0x5592a9c55370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:05:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f232ed9d700 1 --2- 172.21.15.81:0/4045726169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4c720 0x5592a9caf710 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2328098670 tx=0x7f2328006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a1189c1c2946e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:05:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.430+0000 7f2315ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:05:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f2315ffb700 1 -- 172.21.15.81:0/4045726169 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23280a2570 con 0x5592a9c4c720 2024-05-09T00:05:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f2315ffb700 1 -- 172.21.15.81:0/4045726169 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2328099a20 con 0x5592a9c4c720 2024-05-09T00:05:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f2341001b80 1 -- 172.21.15.81:0/4045726169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2328012a50 con 0x5592a9c4c720 2024-05-09T00:05:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f2315ffb700 1 -- 172.21.15.81:0/4045726169 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23280b8300 con 0x5592a9c4c720 2024-05-09T00:05:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f2341001b80 10 client.16287 fetch_fsmap learned FSMap version 26 2024-05-09T00:05:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f2341001b80 1 -- 172.21.15.81:0/4045726169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5592a9a1bcd0 con 0x5592a9c4c720 2024-05-09T00:05:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f2315ffb700 1 -- 172.21.15.81:0/4045726169 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2328012a50 con 0x5592a9c4c720 2024-05-09T00:05:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f2315ffb700 1 -- 172.21.15.81:0/4045726169 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f23280b8020 con 0x5592a9c4c720 2024-05-09T00:05:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f2341001b80 10 client.16287 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:05:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f2341001b80 10 client.16287 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:05:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f2341001b80 20 client.16287 populate_metadata read hostname 'smithi081' 2024-05-09T00:05:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f2341001b80 1 --2- 172.21.15.81:0/4045726169 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5592a9cb7460 0x5592a9cb9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:05:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f2341001b80 4 client.16287 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:05:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f2341001b80 1 -- 172.21.15.81:0/4045726169 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5592a9b8eec0 con 0x5592a9cb7460 2024-05-09T00:05:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.431+0000 7f232e59c700 1 --2- 172.21.15.81:0/4045726169 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5592a9cb7460 0x5592a9cb9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:05:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2315ffb700 10 client.16287 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f232e59c700 1 --2- 172.21.15.81:0/4045726169 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5592a9cb7460 0x5592a9cb9880 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48fd91aa5ad76a9b server_cookie=49dc483d92a5aca3 in_seq=0 out_seq=0 2024-05-09T00:05:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2315ffb700 1 -- 172.21.15.81:0/4045726169 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5592a9b8eec0 con 0x5592a9cb7460 2024-05-09T00:05:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2315ffb700 10 client.16287 handle_command_reply: tid=0 2024-05-09T00:05:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2341001b80 1 client.16287 shutdown 2024-05-09T00:05:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2341001b80 1 -- 172.21.15.81:0/4045726169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4c720 msgr2=0x5592a9caf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2341001b80 1 --2- 172.21.15.81:0/4045726169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4c720 0x5592a9caf710 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2328098670 tx=0x7f2328006040 comp rx=0 tx=0).stop 2024-05-09T00:05:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2341001b80 1 -- 172.21.15.81:0/4045726169 shutdown_connections 2024-05-09T00:05:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2341001b80 1 --2- 172.21.15.81:0/4045726169 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5592a9cb7460 0x5592a9cb9880 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2341001b80 1 --2- 172.21.15.81:0/4045726169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5592a9c46890 0x5592a9c55370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2341001b80 1 --2- 172.21.15.81:0/4045726169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5592a9c4c720 0x5592a9caf710 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2315ffb700 0 client.16287 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:05:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2341001b80 1 --2- 172.21.15.81:0/4045726169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5592a9c4be00 0x5592a9c558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2341001b80 1 -- 172.21.15.81:0/4045726169 >> 172.21.15.81:0/4045726169 conn(0x5592a9ba4210 msgr2=0x5592a9c4cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2341001b80 1 -- 172.21.15.81:0/4045726169 shutdown_connections 2024-05-09T00:05:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2341001b80 1 -- 172.21.15.81:0/4045726169 wait complete. 2024-05-09T00:05:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.432+0000 7f2341001b80 20 client.16287 trim_cache size 0 max 16384 2024-05-09T00:05:51.435 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:05:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:05:51.435 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:05:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "085f73c1-4ebc-413d-aa37-4edc0073ef37": { 2024-05-09T00:05:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:05:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "085f73c1-4ebc-413d-aa37-4edc0073ef37", 2024-05-09T00:05:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:05:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:05:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:05:51.436 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:05:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.433+0000 7f2334e47700 1 -- 172.21.15.81:0/1116222377 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f23180a1290 msgr2=0x7f23180a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.433+0000 7f2334e47700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f23180a1290 0x7f23180a3750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2324005950 tx=0x7f2324005f50 comp rx=0 tx=0).stop 2024-05-09T00:05:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.433+0000 7f2334e47700 1 -- 172.21.15.81:0/1116222377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233019bc60 msgr2=0x7f233019c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:05:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.433+0000 7f2334e47700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233019bc60 0x7f233019c0e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2328007d70 tx=0x7f232800a340 comp rx=0 tx=0).stop 2024-05-09T00:05:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.433+0000 7f2334e47700 1 -- 172.21.15.81:0/1116222377 shutdown_connections 2024-05-09T00:05:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.433+0000 7f2334e47700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f23180a1290 0x7f23180a3750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.433+0000 7f2334e47700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f233019bc60 0x7f233019c0e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.433+0000 7f2334e47700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2330100bc0 0x7f23301973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.433+0000 7f2334e47700 1 --2- 172.21.15.81:0/1116222377 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f23301051d0 0x7f2330197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:05:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.433+0000 7f2334e47700 1 -- 172.21.15.81:0/1116222377 >> 172.21.15.81:0/1116222377 conn(0x7f2330075120 msgr2=0x7f23300fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:05:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.433+0000 7f2334e47700 1 -- 172.21.15.81:0/1116222377 shutdown_connections 2024-05-09T00:05:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:05:51.433+0000 7f2334e47700 1 -- 172.21.15.81:0/1116222377 wait complete. 2024-05-09T00:05:51.438 INFO:tasks.cephfs.filesystem:scrub status for tag:085f73c1-4ebc-413d-aa37-4edc0073ef37 - {'path': '/', 'tag': '085f73c1-4ebc-413d-aa37-4edc0073ef37', 'options': 'recursive,force'} 2024-05-09T00:05:52.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:52 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:05:52.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:52 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:05:52.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:52 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:05:52.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:52 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:05:52.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:52 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:05:52.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:52 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:05:52.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:52 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:05:52.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:52 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:05:52.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:52 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:05:52.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:52 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:05:52.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:52 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:05:52.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:52 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:05:53.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:53 smithi150 ceph-mon[46187]: pgmap v91: 97 pgs: 97 active+clean; 2.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-05-09T00:05:53.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:53 smithi171 ceph-mon[47351]: pgmap v91: 97 pgs: 97 active+clean; 2.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-05-09T00:05:53.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:53 smithi081 ceph-mon[42474]: pgmap v91: 97 pgs: 97 active+clean; 2.7 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 12 op/s 2024-05-09T00:05:54.802 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:54 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:05:54.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:54 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:05:55.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:54 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:05:55.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:55 smithi081 ceph-mon[42474]: pgmap v92: 97 pgs: 97 active+clean; 2.8 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 18 op/s 2024-05-09T00:05:56.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:55 smithi150 ceph-mon[46187]: pgmap v92: 97 pgs: 97 active+clean; 2.8 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 18 op/s 2024-05-09T00:05:56.052 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:55 smithi171 ceph-mon[47351]: pgmap v92: 97 pgs: 97 active+clean; 2.8 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 29 KiB/s wr, 18 op/s 2024-05-09T00:05:57.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:57 smithi150 ceph-mon[46187]: pgmap v93: 97 pgs: 97 active+clean; 2.8 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-05-09T00:05:57.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:57 smithi171 ceph-mon[47351]: pgmap v93: 97 pgs: 97 active+clean; 2.8 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-05-09T00:05:57.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:56 smithi081 ceph-mon[42474]: pgmap v93: 97 pgs: 97 active+clean; 2.8 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-05-09T00:05:59.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:05:59 smithi150 ceph-mon[46187]: pgmap v94: 97 pgs: 97 active+clean; 2.8 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-05-09T00:05:59.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:05:59 smithi171 ceph-mon[47351]: pgmap v94: 97 pgs: 97 active+clean; 2.8 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-05-09T00:05:59.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:05:58 smithi081 ceph-mon[42474]: pgmap v94: 97 pgs: 97 active+clean; 2.8 MiB data, 391 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 21 KiB/s wr, 13 op/s 2024-05-09T00:06:01.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:00 smithi150 ceph-mon[46187]: pgmap v95: 97 pgs: 97 active+clean; 2.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-05-09T00:06:01.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:00 smithi171 ceph-mon[47351]: pgmap v95: 97 pgs: 97 active+clean; 2.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-05-09T00:06:01.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:00 smithi081 ceph-mon[42474]: pgmap v95: 97 pgs: 97 active+clean; 2.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 18 op/s 2024-05-09T00:06:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.015+0000 7fbf86861700 1 -- 172.21.15.81:0/3441613746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf80100200 msgr2=0x7fbf8010dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.015+0000 7fbf86861700 1 --2- 172.21.15.81:0/3441613746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf80100200 0x7fbf8010dde0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800b0a0 tx=0x7fbf7800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.015+0000 7fbf86861700 1 -- 172.21.15.81:0/3441613746 shutdown_connections 2024-05-09T00:06:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.015+0000 7fbf86861700 1 --2- 172.21.15.81:0/3441613746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf80100200 0x7fbf8010dde0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.015+0000 7fbf86861700 1 --2- 172.21.15.81:0/3441613746 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf80105f40 0x7fbf80106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.015+0000 7fbf86861700 1 --2- 172.21.15.81:0/3441613746 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf800ff840 0x7fbf800ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.015+0000 7fbf86861700 1 -- 172.21.15.81:0/3441613746 >> 172.21.15.81:0/3441613746 conn(0x7fbf80075120 msgr2=0x7fbf80075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.015+0000 7fbf86861700 1 -- 172.21.15.81:0/3441613746 shutdown_connections 2024-05-09T00:06:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.015+0000 7fbf86861700 1 -- 172.21.15.81:0/3441613746 wait complete. 2024-05-09T00:06:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.015+0000 7fbf86861700 1 Processor -- start 2024-05-09T00:06:03.011 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.015+0000 7fbf86861700 1 -- start start 2024-05-09T00:06:03.013 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf86861700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf800ff840 0x7fbf80100a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf86861700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf80100200 0x7fbf80100f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf86861700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf80105f40 0x7fbf801014a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf86861700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf801a5770 con 0x7fbf800ff840 2024-05-09T00:06:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf86861700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf801a58e0 con 0x7fbf80100200 2024-05-09T00:06:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf86861700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf801a5aa0 con 0x7fbf80105f40 2024-05-09T00:06:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf7ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf800ff840 0x7fbf80100a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf7ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf800ff840 0x7fbf80100a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53618/0 (socket says 172.21.15.81:53618) 2024-05-09T00:06:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf7ffff700 1 -- 172.21.15.81:0/3079554173 learned_addr learned my addr 172.21.15.81:0/3079554173 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf84dfe700 1 --2- 172.21.15.81:0/3079554173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf80105f40 0x7fbf801014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf7ffff700 1 -- 172.21.15.81:0/3079554173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf80105f40 msgr2=0x7fbf801014a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf7ffff700 1 --2- 172.21.15.81:0/3079554173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf80105f40 0x7fbf801014a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf7ffff700 1 -- 172.21.15.81:0/3079554173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf80100200 msgr2=0x7fbf80100f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf7ffff700 1 --2- 172.21.15.81:0/3079554173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf80100200 0x7fbf80100f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf7ffff700 1 -- 172.21.15.81:0/3079554173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf78009d00 con 0x7fbf800ff840 2024-05-09T00:06:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.016+0000 7fbf7ffff700 1 --2- 172.21.15.81:0/3079554173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf800ff840 0x7fbf80100a20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400d980 tx=0x7fbf7400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.017+0000 7fbf7d7fa700 1 -- 172.21.15.81:0/3079554173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400bb60 con 0x7fbf800ff840 2024-05-09T00:06:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.017+0000 7fbf86861700 1 -- 172.21.15.81:0/3079554173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf801a5d80 con 0x7fbf800ff840 2024-05-09T00:06:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.017+0000 7fbf7d7fa700 1 -- 172.21.15.81:0/3079554173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf74007640 con 0x7fbf800ff840 2024-05-09T00:06:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.017+0000 7fbf7d7fa700 1 -- 172.21.15.81:0/3079554173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74004e90 con 0x7fbf800ff840 2024-05-09T00:06:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.017+0000 7fbf86861700 1 -- 172.21.15.81:0/3079554173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf801a6280 con 0x7fbf800ff840 2024-05-09T00:06:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.019+0000 7fbf7d7fa700 1 -- 172.21.15.81:0/3079554173 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fbf7400bcc0 con 0x7fbf800ff840 2024-05-09T00:06:03.021 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.019+0000 7fbf7d7fa700 1 --2- 172.21.15.81:0/3079554173 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbf680a1290 0x7fbf680a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.022 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.019+0000 7fbf7d7fa700 1 -- 172.21.15.81:0/3079554173 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fbf740ccb90 con 0x7fbf800ff840 2024-05-09T00:06:03.022 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.019+0000 7fbf7f7fe700 1 --2- 172.21.15.81:0/3079554173 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbf680a1290 0x7fbf680a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.022 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.020+0000 7fbf7f7fe700 1 --2- 172.21.15.81:0/3079554173 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbf680a1290 0x7fbf680a3750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbf70005fd0 tx=0x7fbf70005d00 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:03.022 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.020+0000 7fbf92a1bb80 1 Processor -- start 2024-05-09T00:06:03.022 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.020+0000 7fbf92a1bb80 1 -- start start 2024-05-09T00:06:03.022 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.020+0000 7fbf92a1bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bc950 0x55c0ed8bcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.022 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.020+0000 7fbf92a1bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8bd270 0x55c0ed8b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.022 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf92a1bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8b7480 0x55c0ed8b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.022 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf92a1bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ed80e0f0 con 0x55c0ed8b7480 2024-05-09T00:06:03.022 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf92a1bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ed80bab0 con 0x55c0ed8bd270 2024-05-09T00:06:03.022 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf92a1bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ed8073a0 con 0x55c0ed8bc950 2024-05-09T00:06:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf84dfe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8b7480 0x55c0ed8b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf84dfe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8b7480 0x55c0ed8b78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53626/0 (socket says 172.21.15.81:53626) 2024-05-09T00:06:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf84dfe700 1 -- 172.21.15.81:0/1881516272 learned_addr learned my addr 172.21.15.81:0/1881516272 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf7ffff700 1 --2- 172.21.15.81:0/1881516272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bc950 0x55c0ed8bcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf7f7fe700 1 --2- 172.21.15.81:0/1881516272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8bd270 0x55c0ed8b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf84dfe700 1 -- 172.21.15.81:0/1881516272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bc950 msgr2=0x55c0ed8bcd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf84dfe700 1 --2- 172.21.15.81:0/1881516272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bc950 0x55c0ed8bcd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf84dfe700 1 -- 172.21.15.81:0/1881516272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8bd270 msgr2=0x55c0ed8b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf84dfe700 1 --2- 172.21.15.81:0/1881516272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8bd270 0x55c0ed8b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf84dfe700 1 -- 172.21.15.81:0/1881516272 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0ed688350 con 0x55c0ed8b7480 2024-05-09T00:06:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf7f7fe700 1 --2- 172.21.15.81:0/1881516272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8bd270 0x55c0ed8b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:03.023 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf84dfe700 1 --2- 172.21.15.81:0/1881516272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8b7480 0x55c0ed8b78a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fbf78007bc0 tx=0x7fbf78007bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197fea19d3c55553 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf667fc700 1 -- 172.21.15.81:0/1881516272 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7800e050 con 0x55c0ed8b7480 2024-05-09T00:06:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf667fc700 1 -- 172.21.15.81:0/1881516272 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf78007e10 con 0x55c0ed8b7480 2024-05-09T00:06:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.021+0000 7fbf667fc700 1 -- 172.21.15.81:0/1881516272 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78005240 con 0x55c0ed8b7480 2024-05-09T00:06:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.022+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/1881516272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8b7480 msgr2=0x55c0ed8b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.022+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/1881516272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8b7480 0x55c0ed8b78a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fbf78007bc0 tx=0x7fbf78007bf0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.022+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/1881516272 shutdown_connections 2024-05-09T00:06:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.022+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/1881516272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8b7480 0x55c0ed8b78a0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.022+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/1881516272 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bc950 0x55c0ed8bcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.024 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.022+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/1881516272 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8bd270 0x55c0ed8b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.022+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/1881516272 >> 172.21.15.81:0/1881516272 conn(0x55c0ed8151b0 msgr2=0x55c0ed8b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.022+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/1881516272 shutdown_connections 2024-05-09T00:06:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.022+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/1881516272 wait complete. 2024-05-09T00:06:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.022+0000 7fbf92a1bb80 1 -- start start 2024-05-09T00:06:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf92a1bb80 1 Processor -- start 2024-05-09T00:06:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf92a1bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8b7480 0x55c0ed8c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf92a1bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bc950 0x55c0ed8c0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf92a1bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8bd270 0x55c0ed8c0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf92a1bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ed7a3500 con 0x55c0ed8bd270 2024-05-09T00:06:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf92a1bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ed7a31a0 con 0x55c0ed8b7480 2024-05-09T00:06:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf92a1bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ed68a640 con 0x55c0ed8bc950 2024-05-09T00:06:03.025 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf92a1bb80 10 client.0 _ll_register_callbacks cb 0x55c0ed7acad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf84dfe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8bd270 0x55c0ed8c0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf84dfe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8bd270 0x55c0ed8c0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53628/0 (socket says 172.21.15.81:53628) 2024-05-09T00:06:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf84dfe700 1 -- 172.21.15.81:0/1354032515 learned_addr learned my addr 172.21.15.81:0/1354032515 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf7ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8b7480 0x55c0ed8c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf7f7fe700 1 --2- 172.21.15.81:0/1354032515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bc950 0x55c0ed8c0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf84dfe700 1 -- 172.21.15.81:0/1354032515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bc950 msgr2=0x55c0ed8c0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf84dfe700 1 --2- 172.21.15.81:0/1354032515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bc950 0x55c0ed8c0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf84dfe700 1 -- 172.21.15.81:0/1354032515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8b7480 msgr2=0x55c0ed8c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf84dfe700 1 --2- 172.21.15.81:0/1354032515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8b7480 0x55c0ed8c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf84dfe700 1 -- 172.21.15.81:0/1354032515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8010e650 con 0x55c0ed8bd270 2024-05-09T00:06:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.023+0000 7fbf7ffff700 1 --2- 172.21.15.81:0/1354032515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8b7480 0x55c0ed8c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:06:03.026 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf84dfe700 1 --2- 172.21.15.81:0/1354032515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8bd270 0x55c0ed8c0c60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009a20 tx=0x7fbf78007a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dce7e4f086d9a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf5f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf5f7fe700 1 -- 172.21.15.81:0/1354032515 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78004e60 con 0x55c0ed8bd270 2024-05-09T00:06:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf5f7fe700 1 -- 172.21.15.81:0/1354032515 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fbf78005040 con 0x55c0ed8bd270 2024-05-09T00:06:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/1354032515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0ed760210 con 0x55c0ed8bd270 2024-05-09T00:06:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf5f7fe700 1 -- 172.21.15.81:0/1354032515 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf78005200 con 0x55c0ed8bd270 2024-05-09T00:06:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf92a1bb80 10 client.16299 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/1354032515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c0ed634b00 con 0x55c0ed8bd270 2024-05-09T00:06:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf5f7fe700 1 -- 172.21.15.81:0/1354032515 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c0ed760210 con 0x55c0ed8bd270 2024-05-09T00:06:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf5f7fe700 1 -- 172.21.15.81:0/1354032515 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbf7800b0d0 con 0x55c0ed8bd270 2024-05-09T00:06:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf92a1bb80 10 client.16299 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf92a1bb80 10 client.16299 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf92a1bb80 20 client.16299 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:03.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/1354032515 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c0ed8d0780 0x55c0ed8d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf92a1bb80 4 client.16299 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.024+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/1354032515 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0ed8867b0 con 0x55c0ed8d0780 2024-05-09T00:06:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.025+0000 7fbf7ffff700 1 --2- 172.21.15.81:0/1354032515 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c0ed8d0780 0x55c0ed8d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.025+0000 7fbf7ffff700 1 --2- 172.21.15.81:0/1354032515 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c0ed8d0780 0x55c0ed8d2ba0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8949b4fc672542f server_cookie=49779aad70bad09c in_seq=0 out_seq=0 2024-05-09T00:06:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.025+0000 7fbf5f7fe700 10 client.16299 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf5f7fe700 1 -- 172.21.15.81:0/1354032515 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c0ed8867b0 con 0x55c0ed8d0780 2024-05-09T00:06:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf5f7fe700 10 client.16299 handle_command_reply: tid=0 2024-05-09T00:06:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf92a1bb80 1 client.16299 shutdown 2024-05-09T00:06:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/1354032515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8bd270 msgr2=0x55c0ed8c0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/1354032515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8bd270 0x55c0ed8c0c60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbf78009a20 tx=0x7fbf78007a70 comp rx=0 tx=0).stop 2024-05-09T00:06:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/1354032515 shutdown_connections 2024-05-09T00:06:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/1354032515 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c0ed8d0780 0x55c0ed8d2ba0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/1354032515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8b7480 0x55c0ed8c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/1354032515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8bd270 0x55c0ed8c0c60 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/1354032515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bc950 0x55c0ed8c0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf5f7fe700 0 client.16299 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:03.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/1354032515 >> 172.21.15.81:0/1354032515 conn(0x55c0ed8151b0 msgr2=0x55c0ed8ba460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:03.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/1354032515 shutdown_connections 2024-05-09T00:06:03.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/1354032515 wait complete. 2024-05-09T00:06:03.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.026+0000 7fbf92a1bb80 20 client.16299 trim_cache size 0 max 16384 2024-05-09T00:06:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.041+0000 7fbf92a1bb80 1 Processor -- start 2024-05-09T00:06:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.041+0000 7fbf92a1bb80 1 -- start start 2024-05-09T00:06:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.041+0000 7fbf92a1bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8b7480 0x55c0ed8bcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.041+0000 7fbf92a1bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8bc950 0x55c0ed8b1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf92a1bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bd270 0x55c0ed8b7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf92a1bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ed8b7da0 con 0x55c0ed8b7480 2024-05-09T00:06:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf92a1bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ed8bc580 con 0x55c0ed8bc950 2024-05-09T00:06:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf92a1bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ed8b6170 con 0x55c0ed8bd270 2024-05-09T00:06:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf7ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8b7480 0x55c0ed8bcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf7ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8b7480 0x55c0ed8bcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53640/0 (socket says 172.21.15.81:53640) 2024-05-09T00:06:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf7ffff700 1 -- 172.21.15.81:0/960929395 learned_addr learned my addr 172.21.15.81:0/960929395 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf7ffff700 1 -- 172.21.15.81:0/960929395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bd270 msgr2=0x55c0ed8b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf7ffff700 1 --2- 172.21.15.81:0/960929395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bd270 0x55c0ed8b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf7ffff700 1 -- 172.21.15.81:0/960929395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8bc950 msgr2=0x55c0ed8b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf7ffff700 1 --2- 172.21.15.81:0/960929395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8bc950 0x55c0ed8b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf7ffff700 1 -- 172.21.15.81:0/960929395 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0ed7cd500 con 0x55c0ed8b7480 2024-05-09T00:06:03.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf7ffff700 1 --2- 172.21.15.81:0/960929395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8b7480 0x55c0ed8bcd30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fbf740ca340 tx=0x7fbf74099730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34ab2dded21c136 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf66ffd700 1 -- 172.21.15.81:0/960929395 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf740a2120 con 0x55c0ed8b7480 2024-05-09T00:06:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf66ffd700 1 -- 172.21.15.81:0/960929395 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf74022df0 con 0x55c0ed8b7480 2024-05-09T00:06:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.042+0000 7fbf66ffd700 1 -- 172.21.15.81:0/960929395 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf740993f0 con 0x55c0ed8b7480 2024-05-09T00:06:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.043+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/960929395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8b7480 msgr2=0x55c0ed8bcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.043+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/960929395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8b7480 0x55c0ed8bcd30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fbf740ca340 tx=0x7fbf74099730 comp rx=0 tx=0).stop 2024-05-09T00:06:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.043+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/960929395 shutdown_connections 2024-05-09T00:06:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.043+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/960929395 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bd270 0x55c0ed8b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.043+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/960929395 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8b7480 0x55c0ed8bcd30 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.043+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/960929395 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8bc950 0x55c0ed8b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.043+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/960929395 >> 172.21.15.81:0/960929395 conn(0x55c0ed8151b0 msgr2=0x55c0ed8ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.043+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/960929395 shutdown_connections 2024-05-09T00:06:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.043+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/960929395 wait complete. 2024-05-09T00:06:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.043+0000 7fbf92a1bb80 1 -- start start 2024-05-09T00:06:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.043+0000 7fbf92a1bb80 1 Processor -- start 2024-05-09T00:06:03.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf92a1bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8b7480 0x55c0ed8c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf92a1bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8bc950 0x55c0ed8c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf92a1bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bd270 0x55c0ed8c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf92a1bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ed8c84f0 con 0x55c0ed8bc950 2024-05-09T00:06:03.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf92a1bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ed8c4630 con 0x55c0ed8b7480 2024-05-09T00:06:03.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf92a1bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0ed8c47f0 con 0x55c0ed8bd270 2024-05-09T00:06:03.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf92a1bb80 10 client.0 _ll_register_callbacks cb 0x55c0ed7acad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf7f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8bc950 0x55c0ed8c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf7f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8bc950 0x55c0ed8c3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53644/0 (socket says 172.21.15.81:53644) 2024-05-09T00:06:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf7f7fe700 1 -- 172.21.15.81:0/2872531558 learned_addr learned my addr 172.21.15.81:0/2872531558 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf7ffff700 1 --2- 172.21.15.81:0/2872531558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8b7480 0x55c0ed8c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf7f7fe700 1 -- 172.21.15.81:0/2872531558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bd270 msgr2=0x55c0ed8c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf84dfe700 1 --2- 172.21.15.81:0/2872531558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bd270 0x55c0ed8c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf7f7fe700 1 --2- 172.21.15.81:0/2872531558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bd270 0x55c0ed8c40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf7f7fe700 1 -- 172.21.15.81:0/2872531558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8b7480 msgr2=0x55c0ed8c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf7f7fe700 1 --2- 172.21.15.81:0/2872531558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8b7480 0x55c0ed8c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf7f7fe700 1 -- 172.21.15.81:0/2872531558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf801a6280 con 0x55c0ed8bc950 2024-05-09T00:06:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf7ffff700 1 --2- 172.21.15.81:0/2872531558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8b7480 0x55c0ed8c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf7f7fe700 1 --2- 172.21.15.81:0/2872531558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8bc950 0x55c0ed8c3bb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000a690 tx=0x7fbf7000cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6bb496c68b92b9d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.044+0000 7fbf5f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf5f7fe700 1 -- 172.21.15.81:0/2872531558 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf70004220 con 0x55c0ed8bc950 2024-05-09T00:06:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf5f7fe700 1 -- 172.21.15.81:0/2872531558 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fbf70017040 con 0x55c0ed8bc950 2024-05-09T00:06:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/2872531558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf78007e10 con 0x55c0ed8bc950 2024-05-09T00:06:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf5f7fe700 1 -- 172.21.15.81:0/2872531558 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf70004380 con 0x55c0ed8bc950 2024-05-09T00:06:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf92a1bb80 10 client.16305 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/2872531558 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c0ed68cc70 con 0x55c0ed8bc950 2024-05-09T00:06:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf5f7fe700 1 -- 172.21.15.81:0/2872531558 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbf78007e10 con 0x55c0ed8bc950 2024-05-09T00:06:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf5f7fe700 1 -- 172.21.15.81:0/2872531558 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbf70005460 con 0x55c0ed8bc950 2024-05-09T00:06:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf92a1bb80 10 client.16305 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf92a1bb80 10 client.16305 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf92a1bb80 20 client.16305 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/2872531558 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c0ed927150 0x55c0ed929570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf92a1bb80 4 client.16305 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:06:03.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/2872531558 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c0ed7ffe60 con 0x55c0ed927150 2024-05-09T00:06:03.047 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.045+0000 7fbf7ffff700 1 --2- 172.21.15.81:0/2872531558 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c0ed927150 0x55c0ed929570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:03.047 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.046+0000 7fbf7ffff700 1 --2- 172.21.15.81:0/2872531558 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c0ed927150 0x55c0ed929570 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8515fa9837988bfe server_cookie=7d47a8f8622fca15 in_seq=0 out_seq=0 2024-05-09T00:06:03.047 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.046+0000 7fbf5f7fe700 10 client.16305 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf5f7fe700 1 -- 172.21.15.81:0/2872531558 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c0ed7ffe60 con 0x55c0ed927150 2024-05-09T00:06:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf5f7fe700 10 client.16305 handle_command_reply: tid=0 2024-05-09T00:06:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf92a1bb80 1 client.16305 shutdown 2024-05-09T00:06:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/2872531558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8bc950 msgr2=0x55c0ed8c3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/2872531558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8bc950 0x55c0ed8c3bb0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbf7000a690 tx=0x7fbf7000cfd0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/2872531558 shutdown_connections 2024-05-09T00:06:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/2872531558 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c0ed927150 0x55c0ed929570 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.058 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/2872531558 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c0ed8b7480 0x55c0ed8c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf5f7fe700 0 client.16305 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:03.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/2872531558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c0ed8bd270 0x55c0ed8c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf92a1bb80 1 --2- 172.21.15.81:0/2872531558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c0ed8bc950 0x55c0ed8c3bb0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/2872531558 >> 172.21.15.81:0/2872531558 conn(0x55c0ed8151b0 msgr2=0x55c0ed8b6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:03.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/2872531558 shutdown_connections 2024-05-09T00:06:03.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf92a1bb80 1 -- 172.21.15.81:0/2872531558 wait complete. 2024-05-09T00:06:03.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.062+0000 7fbf92a1bb80 20 client.16305 trim_cache size 0 max 16384 2024-05-09T00:06:03.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:06:03.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:06:03.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:06:03.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:06:03.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.063+0000 7fbf86861700 1 -- 172.21.15.81:0/3079554173 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbf680a1290 msgr2=0x7fbf680a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.063+0000 7fbf86861700 1 --2- 172.21.15.81:0/3079554173 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbf680a1290 0x7fbf680a3750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbf70005fd0 tx=0x7fbf70005d00 comp rx=0 tx=0).stop 2024-05-09T00:06:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.063+0000 7fbf86861700 1 -- 172.21.15.81:0/3079554173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf800ff840 msgr2=0x7fbf80100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.063+0000 7fbf86861700 1 --2- 172.21.15.81:0/3079554173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf800ff840 0x7fbf80100a20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400d980 tx=0x7fbf7400dd40 comp rx=0 tx=0).stop 2024-05-09T00:06:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.063+0000 7fbf86861700 1 -- 172.21.15.81:0/3079554173 shutdown_connections 2024-05-09T00:06:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.063+0000 7fbf86861700 1 --2- 172.21.15.81:0/3079554173 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbf680a1290 0x7fbf680a3750 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.063+0000 7fbf86861700 1 --2- 172.21.15.81:0/3079554173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbf80105f40 0x7fbf801014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.063+0000 7fbf86861700 1 --2- 172.21.15.81:0/3079554173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf800ff840 0x7fbf80100a20 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.063+0000 7fbf86861700 1 --2- 172.21.15.81:0/3079554173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbf80100200 0x7fbf80100f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.063+0000 7fbf86861700 1 -- 172.21.15.81:0/3079554173 >> 172.21.15.81:0/3079554173 conn(0x7fbf80075120 msgr2=0x7fbf800fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.063+0000 7fbf86861700 1 -- 172.21.15.81:0/3079554173 shutdown_connections 2024-05-09T00:06:03.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:03.063+0000 7fbf86861700 1 -- 172.21.15.81:0/3079554173 wait complete. 2024-05-09T00:06:03.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:03 smithi150 ceph-mon[46187]: pgmap v96: 97 pgs: 97 active+clean; 2.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-05-09T00:06:03.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:02 smithi171 ceph-mon[47351]: pgmap v96: 97 pgs: 97 active+clean; 2.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-05-09T00:06:03.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:02 smithi081 ceph-mon[42474]: pgmap v96: 97 pgs: 97 active+clean; 2.9 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 11 op/s 2024-05-09T00:06:04.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:04 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:06:04.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:04 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:06:04.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:04 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:06:05.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:05 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:06:05.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:05 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:06:05.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:05 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:06:05.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:05 smithi150 ceph-mon[46187]: pgmap v97: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 55 KiB/s wr, 33 op/s 2024-05-09T00:06:05.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:05 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:06:05.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:05 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:06:05.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:05 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:06:05.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:05 smithi171 ceph-mon[47351]: pgmap v97: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 55 KiB/s wr, 33 op/s 2024-05-09T00:06:05.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:05 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:06:05.414 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:05 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:06:05.414 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:05 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:06:05.414 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:05 smithi081 ceph-mon[42474]: pgmap v97: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 55 KiB/s wr, 33 op/s 2024-05-09T00:06:07.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:06 smithi150 ceph-mon[46187]: pgmap v98: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-05-09T00:06:07.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:06 smithi171 ceph-mon[47351]: pgmap v98: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-05-09T00:06:07.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:06 smithi081 ceph-mon[42474]: pgmap v98: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-05-09T00:06:09.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:09 smithi150 ceph-mon[46187]: pgmap v99: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-05-09T00:06:09.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:09 smithi171 ceph-mon[47351]: pgmap v99: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-05-09T00:06:09.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:08 smithi081 ceph-mon[42474]: pgmap v99: 97 pgs: 97 active+clean; 3.1 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 47 KiB/s wr, 27 op/s 2024-05-09T00:06:11.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:11 smithi150 ceph-mon[46187]: pgmap v100: 97 pgs: 97 active+clean; 3.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 60 KiB/s wr, 32 op/s 2024-05-09T00:06:11.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:11 smithi171 ceph-mon[47351]: pgmap v100: 97 pgs: 97 active+clean; 3.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 60 KiB/s wr, 32 op/s 2024-05-09T00:06:11.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:11 smithi081 ceph-mon[42474]: pgmap v100: 97 pgs: 97 active+clean; 3.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 60 KiB/s wr, 32 op/s 2024-05-09T00:06:13.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:13 smithi150 ceph-mon[46187]: pgmap v101: 97 pgs: 97 active+clean; 3.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 50 KiB/s wr, 27 op/s 2024-05-09T00:06:13.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:13 smithi171 ceph-mon[47351]: pgmap v101: 97 pgs: 97 active+clean; 3.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 50 KiB/s wr, 27 op/s 2024-05-09T00:06:13.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:13 smithi081 ceph-mon[42474]: pgmap v101: 97 pgs: 97 active+clean; 3.2 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 50 KiB/s wr, 27 op/s 2024-05-09T00:06:15.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:15 smithi150 ceph-mon[46187]: pgmap v102: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 60 KiB/s wr, 32 op/s 2024-05-09T00:06:15.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:15 smithi171 ceph-mon[47351]: pgmap v102: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 60 KiB/s wr, 32 op/s 2024-05-09T00:06:15.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:15 smithi081 ceph-mon[42474]: pgmap v102: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 60 KiB/s wr, 32 op/s 2024-05-09T00:06:16.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.182+0000 7fae1c5ff700 1 -- 172.21.15.81:0/2377354451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae14101ac0 msgr2=0x7fae14105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:16.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.182+0000 7fae1c5ff700 1 --2- 172.21.15.81:0/2377354451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae14101ac0 0x7fae14105b00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fae08009990 tx=0x7fae08009ca0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 -- 172.21.15.81:0/2377354451 shutdown_connections 2024-05-09T00:06:16.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 --2- 172.21.15.81:0/2377354451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae14106230 0x7fae1410ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 --2- 172.21.15.81:0/2377354451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae14101110 0x7fae141014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 --2- 172.21.15.81:0/2377354451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae14101ac0 0x7fae14105b00 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 -- 172.21.15.81:0/2377354451 >> 172.21.15.81:0/2377354451 conn(0x7fae140fc950 msgr2=0x7fae140fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 -- 172.21.15.81:0/2377354451 shutdown_connections 2024-05-09T00:06:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 -- 172.21.15.81:0/2377354451 wait complete. 2024-05-09T00:06:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 Processor -- start 2024-05-09T00:06:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 -- start start 2024-05-09T00:06:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae14101110 0x7fae140732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae14106230 0x7fae140737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae14073d20 0x7fae141a55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae141a5bf0 con 0x7fae14101110 2024-05-09T00:06:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae141a5d60 con 0x7fae14106230 2024-05-09T00:06:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.183+0000 7fae1c5ff700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae141a5f20 con 0x7fae14073d20 2024-05-09T00:06:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae1a39b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae14101110 0x7fae140732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae1a39b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae14101110 0x7fae140732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49010/0 (socket says 172.21.15.81:49010) 2024-05-09T00:06:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae1a39b700 1 -- 172.21.15.81:0/3024603357 learned_addr learned my addr 172.21.15.81:0/3024603357 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:16.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae19b9a700 1 --2- 172.21.15.81:0/3024603357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae14106230 0x7fae140737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae1ab9c700 1 --2- 172.21.15.81:0/3024603357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae14073d20 0x7fae141a55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae1a39b700 1 -- 172.21.15.81:0/3024603357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae14073d20 msgr2=0x7fae141a55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae1a39b700 1 --2- 172.21.15.81:0/3024603357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae14073d20 0x7fae141a55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae1a39b700 1 -- 172.21.15.81:0/3024603357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae14106230 msgr2=0x7fae140737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae1a39b700 1 --2- 172.21.15.81:0/3024603357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae14106230 0x7fae140737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae1a39b700 1 -- 172.21.15.81:0/3024603357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae080095f0 con 0x7fae14101110 2024-05-09T00:06:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae1a39b700 1 --2- 172.21.15.81:0/3024603357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae14101110 0x7fae140732a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fae1000d950 tx=0x7fae1000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae077fe700 1 -- 172.21.15.81:0/3024603357 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1000f890 con 0x7fae14101110 2024-05-09T00:06:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae077fe700 1 -- 172.21.15.81:0/3024603357 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae10010460 con 0x7fae14101110 2024-05-09T00:06:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae1c5ff700 1 -- 172.21.15.81:0/3024603357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae141a6200 con 0x7fae14101110 2024-05-09T00:06:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae077fe700 1 -- 172.21.15.81:0/3024603357 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1000e610 con 0x7fae14101110 2024-05-09T00:06:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.184+0000 7fae1c5ff700 1 -- 172.21.15.81:0/3024603357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae141a6730 con 0x7fae14101110 2024-05-09T00:06:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.186+0000 7fae077fe700 1 -- 172.21.15.81:0/3024603357 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fae100108d0 con 0x7fae14101110 2024-05-09T00:06:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.187+0000 7fae077fe700 1 --2- 172.21.15.81:0/3024603357 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fae000a1310 0x7fae000a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.187+0000 7fae077fe700 1 -- 172.21.15.81:0/3024603357 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fae100cca70 con 0x7fae14101110 2024-05-09T00:06:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.187+0000 7fae19b9a700 1 --2- 172.21.15.81:0/3024603357 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fae000a1310 0x7fae000a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.187+0000 7fae19b9a700 1 --2- 172.21.15.81:0/3024603357 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fae000a1310 0x7fae000a37d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fae0800b5c0 tx=0x7fae08005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.188+0000 7fae287b9b80 1 Processor -- start 2024-05-09T00:06:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.188+0000 7fae287b9b80 1 -- start start 2024-05-09T00:06:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.188+0000 7fae287b9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aef950 0x556bc5aefd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae287b9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5ae9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae287b9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aea480 0x556bc5aea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae287b9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc5a410f0 con 0x556bc5af0270 2024-05-09T00:06:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae287b9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc5a3eab0 con 0x556bc5aea480 2024-05-09T00:06:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae287b9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc5a3a3a0 con 0x556bc5aef950 2024-05-09T00:06:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae19b9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5ae9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae19b9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5ae9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49012/0 (socket says 172.21.15.81:49012) 2024-05-09T00:06:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae19b9a700 1 -- 172.21.15.81:0/636271937 learned_addr learned my addr 172.21.15.81:0/636271937 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae1a39b700 1 --2- 172.21.15.81:0/636271937 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aef950 0x556bc5aefd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae1ab9c700 1 --2- 172.21.15.81:0/636271937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aea480 0x556bc5aea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae19b9a700 1 -- 172.21.15.81:0/636271937 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aef950 msgr2=0x556bc5aefd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae19b9a700 1 --2- 172.21.15.81:0/636271937 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aef950 0x556bc5aefd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae19b9a700 1 -- 172.21.15.81:0/636271937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aea480 msgr2=0x556bc5aea8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae19b9a700 1 --2- 172.21.15.81:0/636271937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aea480 0x556bc5aea8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae19b9a700 1 -- 172.21.15.81:0/636271937 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bc58bb350 con 0x556bc5af0270 2024-05-09T00:06:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae19b9a700 1 --2- 172.21.15.81:0/636271937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5ae9f40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fae08015000 tx=0x7fae08020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3d84565886584 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae04ff9700 1 -- 172.21.15.81:0/636271937 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0800bc00 con 0x556bc5af0270 2024-05-09T00:06:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae04ff9700 1 -- 172.21.15.81:0/636271937 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae0801e040 con 0x556bc5af0270 2024-05-09T00:06:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.189+0000 7fae04ff9700 1 -- 172.21.15.81:0/636271937 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0800f6c0 con 0x556bc5af0270 2024-05-09T00:06:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.190+0000 7fae287b9b80 1 -- 172.21.15.81:0/636271937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 msgr2=0x556bc5ae9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.190+0000 7fae287b9b80 1 --2- 172.21.15.81:0/636271937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5ae9f40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fae08015000 tx=0x7fae08020000 comp rx=0 tx=0).stop 2024-05-09T00:06:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.190+0000 7fae287b9b80 1 -- 172.21.15.81:0/636271937 shutdown_connections 2024-05-09T00:06:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.190+0000 7fae287b9b80 1 --2- 172.21.15.81:0/636271937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aea480 0x556bc5aea8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.190+0000 7fae287b9b80 1 --2- 172.21.15.81:0/636271937 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aef950 0x556bc5aefd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.190+0000 7fae287b9b80 1 --2- 172.21.15.81:0/636271937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5ae9f40 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.190+0000 7fae287b9b80 1 -- 172.21.15.81:0/636271937 >> 172.21.15.81:0/636271937 conn(0x556bc5a481b0 msgr2=0x556bc5ae4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.190+0000 7fae287b9b80 1 -- 172.21.15.81:0/636271937 shutdown_connections 2024-05-09T00:06:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.190+0000 7fae287b9b80 1 -- 172.21.15.81:0/636271937 wait complete. 2024-05-09T00:06:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae287b9b80 1 -- start start 2024-05-09T00:06:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae287b9b80 1 Processor -- start 2024-05-09T00:06:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae287b9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aea480 0x556bc5af6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae287b9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aef950 0x556bc5af35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae287b9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5af3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae287b9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc59d6500 con 0x556bc5af0270 2024-05-09T00:06:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae287b9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc59d61a0 con 0x556bc5aea480 2024-05-09T00:06:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae287b9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc58bd640 con 0x556bc5aef950 2024-05-09T00:06:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae287b9b80 10 client.0 _ll_register_callbacks cb 0x556bc59dfad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae1ab9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5af3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae1ab9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5af3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49020/0 (socket says 172.21.15.81:49020) 2024-05-09T00:06:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae1ab9c700 1 -- 172.21.15.81:0/343801368 learned_addr learned my addr 172.21.15.81:0/343801368 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae19b9a700 1 --2- 172.21.15.81:0/343801368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aef950 0x556bc5af35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae1a39b700 1 --2- 172.21.15.81:0/343801368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aea480 0x556bc5af6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae1ab9c700 1 -- 172.21.15.81:0/343801368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aef950 msgr2=0x556bc5af35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae1ab9c700 1 --2- 172.21.15.81:0/343801368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aef950 0x556bc5af35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae1ab9c700 1 -- 172.21.15.81:0/343801368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aea480 msgr2=0x556bc5af6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae1ab9c700 1 --2- 172.21.15.81:0/343801368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aea480 0x556bc5af6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae1ab9c700 1 -- 172.21.15.81:0/343801368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1410e620 con 0x556bc5af0270 2024-05-09T00:06:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae1a39b700 1 --2- 172.21.15.81:0/343801368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aea480 0x556bc5af6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fae1ab9c700 1 --2- 172.21.15.81:0/343801368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5af3d20 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fae0c004070 tx=0x7fae0c004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19d8e19f7462b7d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.191+0000 7fadfdffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.192+0000 7fadfdffb700 1 -- 172.21.15.81:0/343801368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c0079d0 con 0x556bc5af0270 2024-05-09T00:06:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.192+0000 7fae287b9b80 1 -- 172.21.15.81:0/343801368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556bc5993210 con 0x556bc5af0270 2024-05-09T00:06:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.192+0000 7fadfdffb700 1 -- 172.21.15.81:0/343801368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fae0c007b30 con 0x556bc5af0270 2024-05-09T00:06:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.192+0000 7fadfdffb700 1 -- 172.21.15.81:0/343801368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae0c007cf0 con 0x556bc5af0270 2024-05-09T00:06:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.192+0000 7fae287b9b80 10 client.16317 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.192+0000 7fae287b9b80 1 -- 172.21.15.81:0/343801368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556bc5867b00 con 0x556bc5af0270 2024-05-09T00:06:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.192+0000 7fadfdffb700 1 -- 172.21.15.81:0/343801368 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556bc5993210 con 0x556bc5af0270 2024-05-09T00:06:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.192+0000 7fadfdffb700 1 -- 172.21.15.81:0/343801368 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fae0c014040 con 0x556bc5af0270 2024-05-09T00:06:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.192+0000 7fae287b9b80 10 client.16317 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.192+0000 7fae287b9b80 10 client.16317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.192+0000 7fae287b9b80 20 client.16317 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.192+0000 7fae287b9b80 1 --2- 172.21.15.81:0/343801368 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556bc5b03ca0 0x556bc5b060c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.192+0000 7fae287b9b80 4 client.16317 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.192+0000 7fae287b9b80 1 -- 172.21.15.81:0/343801368 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556bc5ab97b0 con 0x556bc5b03ca0 2024-05-09T00:06:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.193+0000 7fae1a39b700 1 --2- 172.21.15.81:0/343801368 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556bc5b03ca0 0x556bc5b060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.193+0000 7fadfdffb700 10 client.16317 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.193+0000 7fae1a39b700 1 --2- 172.21.15.81:0/343801368 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556bc5b03ca0 0x556bc5b060c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1679445d8d09f43b server_cookie=e15d65196fbebd87 in_seq=0 out_seq=0 2024-05-09T00:06:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.193+0000 7fadfdffb700 1 -- 172.21.15.81:0/343801368 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556bc5ab97b0 con 0x556bc5b03ca0 2024-05-09T00:06:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.193+0000 7fadfdffb700 10 client.16317 handle_command_reply: tid=0 2024-05-09T00:06:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.194+0000 7fae287b9b80 1 client.16317 shutdown 2024-05-09T00:06:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.194+0000 7fae287b9b80 1 -- 172.21.15.81:0/343801368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 msgr2=0x556bc5af3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.194+0000 7fae287b9b80 1 --2- 172.21.15.81:0/343801368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5af3d20 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fae0c004070 tx=0x7fae0c004380 comp rx=0 tx=0).stop 2024-05-09T00:06:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.194+0000 7fae287b9b80 1 -- 172.21.15.81:0/343801368 shutdown_connections 2024-05-09T00:06:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.194+0000 7fae287b9b80 1 --2- 172.21.15.81:0/343801368 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556bc5b03ca0 0x556bc5b060c0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.194+0000 7fae287b9b80 1 --2- 172.21.15.81:0/343801368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aea480 0x556bc5af6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.194+0000 7fae287b9b80 1 --2- 172.21.15.81:0/343801368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5af3d20 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.194+0000 7fae287b9b80 1 --2- 172.21.15.81:0/343801368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aef950 0x556bc5af35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.194+0000 7fadfdffb700 0 client.16317 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:16.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.194+0000 7fae287b9b80 1 -- 172.21.15.81:0/343801368 >> 172.21.15.81:0/343801368 conn(0x556bc5a481b0 msgr2=0x556bc5aee4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:16.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.194+0000 7fae287b9b80 1 -- 172.21.15.81:0/343801368 shutdown_connections 2024-05-09T00:06:16.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.194+0000 7fae287b9b80 1 -- 172.21.15.81:0/343801368 wait complete. 2024-05-09T00:06:16.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.194+0000 7fae287b9b80 20 client.16317 trim_cache size 0 max 16384 2024-05-09T00:06:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae287b9b80 1 Processor -- start 2024-05-09T00:06:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae287b9b80 1 -- start start 2024-05-09T00:06:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae287b9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aea480 0x556bc5ae4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae287b9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aef950 0x556bc5aff6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae287b9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5af3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae287b9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc5afffb0 con 0x556bc5af0270 2024-05-09T00:06:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae287b9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc5ae9210 con 0x556bc5aef950 2024-05-09T00:06:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae287b9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc5adca40 con 0x556bc5aea480 2024-05-09T00:06:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae1ab9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5af3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae1a39b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aea480 0x556bc5ae4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae1ab9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5af3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49036/0 (socket says 172.21.15.81:49036) 2024-05-09T00:06:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae1ab9c700 1 -- 172.21.15.81:0/1370707229 learned_addr learned my addr 172.21.15.81:0/1370707229 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae19b9a700 1 --2- 172.21.15.81:0/1370707229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aef950 0x556bc5aff6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae1ab9c700 1 -- 172.21.15.81:0/1370707229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aea480 msgr2=0x556bc5ae4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae1ab9c700 1 --2- 172.21.15.81:0/1370707229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aea480 0x556bc5ae4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae1ab9c700 1 -- 172.21.15.81:0/1370707229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aef950 msgr2=0x556bc5aff6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae1ab9c700 1 --2- 172.21.15.81:0/1370707229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aef950 0x556bc5aff6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae1ab9c700 1 -- 172.21.15.81:0/1370707229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bc5a00500 con 0x556bc5af0270 2024-05-09T00:06:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae19b9a700 1 --2- 172.21.15.81:0/1370707229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aef950 0x556bc5aff6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.209+0000 7fae1ab9c700 1 --2- 172.21.15.81:0/1370707229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5af3be0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fae0c015390 tx=0x7fae0c015600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c2430a7a787bdb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.210+0000 7fae057fa700 1 -- 172.21.15.81:0/1370707229 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c009540 con 0x556bc5af0270 2024-05-09T00:06:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.210+0000 7fae057fa700 1 -- 172.21.15.81:0/1370707229 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae0c00f040 con 0x556bc5af0270 2024-05-09T00:06:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.210+0000 7fae057fa700 1 -- 172.21.15.81:0/1370707229 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c007a30 con 0x556bc5af0270 2024-05-09T00:06:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.210+0000 7fae287b9b80 1 -- 172.21.15.81:0/1370707229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 msgr2=0x556bc5af3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.210+0000 7fae287b9b80 1 --2- 172.21.15.81:0/1370707229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5af3be0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fae0c015390 tx=0x7fae0c015600 comp rx=0 tx=0).stop 2024-05-09T00:06:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.210+0000 7fae287b9b80 1 -- 172.21.15.81:0/1370707229 shutdown_connections 2024-05-09T00:06:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.210+0000 7fae287b9b80 1 --2- 172.21.15.81:0/1370707229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5af0270 0x556bc5af3be0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.210+0000 7fae287b9b80 1 --2- 172.21.15.81:0/1370707229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aea480 0x556bc5ae4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.210+0000 7fae287b9b80 1 --2- 172.21.15.81:0/1370707229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5aef950 0x556bc5aff6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.210+0000 7fae287b9b80 1 -- 172.21.15.81:0/1370707229 >> 172.21.15.81:0/1370707229 conn(0x556bc5a481b0 msgr2=0x556bc5ae9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.210+0000 7fae287b9b80 1 -- 172.21.15.81:0/1370707229 shutdown_connections 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.210+0000 7fae287b9b80 1 -- 172.21.15.81:0/1370707229 wait complete. 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae287b9b80 1 -- start start 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae287b9b80 1 Processor -- start 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae287b9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aea480 0x556bc5afae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae287b9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5aef950 0x556bc5af1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae287b9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5af0270 0x556bc5af23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae287b9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc5af2930 con 0x556bc5aef950 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae287b9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc5af2a70 con 0x556bc5af0270 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae287b9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bc5af2c30 con 0x556bc5aea480 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae287b9b80 10 client.0 _ll_register_callbacks cb 0x556bc59dfad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae19b9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5aef950 0x556bc5af1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae19b9a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5aef950 0x556bc5af1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49052/0 (socket says 172.21.15.81:49052) 2024-05-09T00:06:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae19b9a700 1 -- 172.21.15.81:0/1771956795 learned_addr learned my addr 172.21.15.81:0/1771956795 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae1a39b700 1 --2- 172.21.15.81:0/1771956795 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aea480 0x556bc5afae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae1ab9c700 1 --2- 172.21.15.81:0/1771956795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5af0270 0x556bc5af23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae19b9a700 1 -- 172.21.15.81:0/1771956795 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aea480 msgr2=0x556bc5afae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae19b9a700 1 --2- 172.21.15.81:0/1771956795 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aea480 0x556bc5afae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae19b9a700 1 -- 172.21.15.81:0/1771956795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5af0270 msgr2=0x556bc5af23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae19b9a700 1 --2- 172.21.15.81:0/1771956795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5af0270 0x556bc5af23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae19b9a700 1 -- 172.21.15.81:0/1771956795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bc5867b00 con 0x556bc5aef950 2024-05-09T00:06:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.211+0000 7fae1a39b700 1 --2- 172.21.15.81:0/1771956795 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aea480 0x556bc5afae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:06:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fae19b9a700 1 --2- 172.21.15.81:0/1771956795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5aef950 0x556bc5af1eb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x556bc5ae5790 tx=0x7fae08005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16bd33d5646fffe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fadfdffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fadfdffb700 1 -- 172.21.15.81:0/1771956795 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae08004b50 con 0x556bc5aef950 2024-05-09T00:06:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fadfdffb700 1 -- 172.21.15.81:0/1771956795 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fae08004cb0 con 0x556bc5aef950 2024-05-09T00:06:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fae287b9b80 1 -- 172.21.15.81:0/1771956795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae0801e040 con 0x556bc5aef950 2024-05-09T00:06:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fadfdffb700 1 -- 172.21.15.81:0/1771956795 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae08004e70 con 0x556bc5aef950 2024-05-09T00:06:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fae287b9b80 10 client.16323 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fae287b9b80 1 -- 172.21.15.81:0/1771956795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556bc58bfc70 con 0x556bc5aef950 2024-05-09T00:06:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fadfdffb700 1 -- 172.21.15.81:0/1771956795 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae0801e040 con 0x556bc5aef950 2024-05-09T00:06:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fadfdffb700 1 -- 172.21.15.81:0/1771956795 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fae0802f6a0 con 0x556bc5aef950 2024-05-09T00:06:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fae287b9b80 10 client.16323 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fae287b9b80 10 client.16323 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fae287b9b80 20 client.16323 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fae287b9b80 1 --2- 172.21.15.81:0/1771956795 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556bc5b5a5b0 0x556bc5b5c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fae287b9b80 4 client.16323 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:06:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fae287b9b80 1 -- 172.21.15.81:0/1771956795 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556bc5a32e60 con 0x556bc5b5a5b0 2024-05-09T00:06:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.212+0000 7fae1a39b700 1 --2- 172.21.15.81:0/1771956795 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556bc5b5a5b0 0x556bc5b5c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.213+0000 7fae1a39b700 1 --2- 172.21.15.81:0/1771956795 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556bc5b5a5b0 0x556bc5b5c9a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25f2c36232284a8d server_cookie=ab322487a532a276 in_seq=0 out_seq=0 2024-05-09T00:06:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.213+0000 7fadfdffb700 10 client.16323 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.226+0000 7fadfdffb700 1 -- 172.21.15.81:0/1771956795 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556bc5a32e60 con 0x556bc5b5a5b0 2024-05-09T00:06:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.226+0000 7fadfdffb700 10 client.16323 handle_command_reply: tid=0 2024-05-09T00:06:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.226+0000 7fae287b9b80 1 client.16323 shutdown 2024-05-09T00:06:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.226+0000 7fae287b9b80 1 -- 172.21.15.81:0/1771956795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5aef950 msgr2=0x556bc5af1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.226+0000 7fae287b9b80 1 --2- 172.21.15.81:0/1771956795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5aef950 0x556bc5af1eb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x556bc5ae5790 tx=0x7fae08005c70 comp rx=0 tx=0).stop 2024-05-09T00:06:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.226+0000 7fae287b9b80 1 -- 172.21.15.81:0/1771956795 shutdown_connections 2024-05-09T00:06:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.226+0000 7fae287b9b80 1 --2- 172.21.15.81:0/1771956795 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556bc5b5a5b0 0x556bc5b5c9a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.226+0000 7fae287b9b80 1 --2- 172.21.15.81:0/1771956795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556bc5af0270 0x556bc5af23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.226+0000 7fae287b9b80 1 --2- 172.21.15.81:0/1771956795 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556bc5aea480 0x556bc5afae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.226+0000 7fadfdffb700 0 client.16323 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.226+0000 7fae287b9b80 1 --2- 172.21.15.81:0/1771956795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556bc5aef950 0x556bc5af1eb0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.226+0000 7fae287b9b80 1 -- 172.21.15.81:0/1771956795 >> 172.21.15.81:0/1771956795 conn(0x556bc5a481b0 msgr2=0x556bc5ae9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae287b9b80 1 -- 172.21.15.81:0/1771956795 shutdown_connections 2024-05-09T00:06:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae287b9b80 1 -- 172.21.15.81:0/1771956795 wait complete. 2024-05-09T00:06:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae287b9b80 20 client.16323 trim_cache size 0 max 16384 2024-05-09T00:06:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:06:16.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:06:16.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:06:16.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:06:16.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae1c5ff700 1 -- 172.21.15.81:0/3024603357 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fae000a1310 msgr2=0x7fae000a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:16.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae1c5ff700 1 --2- 172.21.15.81:0/3024603357 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fae000a1310 0x7fae000a37d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fae0800b5c0 tx=0x7fae08005960 comp rx=0 tx=0).stop 2024-05-09T00:06:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae1c5ff700 1 -- 172.21.15.81:0/3024603357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae14101110 msgr2=0x7fae140732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae1c5ff700 1 --2- 172.21.15.81:0/3024603357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae14101110 0x7fae140732a0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fae1000d950 tx=0x7fae1000dc60 comp rx=0 tx=0).stop 2024-05-09T00:06:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae1c5ff700 1 -- 172.21.15.81:0/3024603357 shutdown_connections 2024-05-09T00:06:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae1c5ff700 1 --2- 172.21.15.81:0/3024603357 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fae000a1310 0x7fae000a37d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae1c5ff700 1 --2- 172.21.15.81:0/3024603357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fae14073d20 0x7fae141a55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae1c5ff700 1 --2- 172.21.15.81:0/3024603357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae14101110 0x7fae140732a0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae1c5ff700 1 --2- 172.21.15.81:0/3024603357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fae14106230 0x7fae140737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae1c5ff700 1 -- 172.21.15.81:0/3024603357 >> 172.21.15.81:0/3024603357 conn(0x7fae140fc950 msgr2=0x7fae140fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae1c5ff700 1 -- 172.21.15.81:0/3024603357 shutdown_connections 2024-05-09T00:06:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:16.227+0000 7fae1c5ff700 1 -- 172.21.15.81:0/3024603357 wait complete. 2024-05-09T00:06:17.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:17 smithi150 ceph-mon[46187]: pgmap v103: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-05-09T00:06:17.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:17 smithi171 ceph-mon[47351]: pgmap v103: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-05-09T00:06:17.369 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:17 smithi081 ceph-mon[42474]: pgmap v103: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-05-09T00:06:19.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:19 smithi150 ceph-mon[46187]: pgmap v104: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-05-09T00:06:19.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:19 smithi171 ceph-mon[47351]: pgmap v104: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-05-09T00:06:19.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:19 smithi081 ceph-mon[42474]: pgmap v104: 97 pgs: 97 active+clean; 3.3 MiB data, 392 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 23 KiB/s wr, 9 op/s 2024-05-09T00:06:21.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:21 smithi150 ceph-mon[46187]: pgmap v105: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-05-09T00:06:21.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:21 smithi171 ceph-mon[47351]: pgmap v105: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-05-09T00:06:21.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:21 smithi081 ceph-mon[42474]: pgmap v105: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 38 KiB/s wr, 17 op/s 2024-05-09T00:06:21.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:06:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.583+0000 7ff70576d700 1 -- 172.21.15.81:0/1341061532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7000ffdd0 msgr2=0x7ff70010dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.583+0000 7ff70576d700 1 --2- 172.21.15.81:0/1341061532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7000ffdd0 0x7ff70010dda0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800b0a0 tx=0x7ff6f800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.583+0000 7ff70576d700 1 -- 172.21.15.81:0/1341061532 shutdown_connections 2024-05-09T00:06:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.583+0000 7ff70576d700 1 --2- 172.21.15.81:0/1341061532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7000ffdd0 0x7ff70010dda0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.583+0000 7ff70576d700 1 --2- 172.21.15.81:0/1341061532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff700105ef0 0x7ff7001062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.583+0000 7ff70576d700 1 --2- 172.21.15.81:0/1341061532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7000ff410 0x7ff7000ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.583+0000 7ff70576d700 1 -- 172.21.15.81:0/1341061532 >> 172.21.15.81:0/1341061532 conn(0x7ff7000763a0 msgr2=0x7ff7000fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.583+0000 7ff70576d700 1 -- 172.21.15.81:0/1341061532 shutdown_connections 2024-05-09T00:06:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.583+0000 7ff70576d700 1 -- 172.21.15.81:0/1341061532 wait complete. 2024-05-09T00:06:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff70576d700 1 Processor -- start 2024-05-09T00:06:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff70576d700 1 -- start start 2024-05-09T00:06:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff70576d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7000ff410 0x7ff700197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff70576d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7000ffdd0 0x7ff700197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff70576d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff700105ef0 0x7ff70019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff70576d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70019c450 con 0x7ff7000ff410 2024-05-09T00:06:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff70576d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70019c5c0 con 0x7ff7000ffdd0 2024-05-09T00:06:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff70576d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70019c780 con 0x7ff700105ef0 2024-05-09T00:06:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff6feffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7000ff410 0x7ff700197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff6feffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7000ff410 0x7ff700197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39636/0 (socket says 172.21.15.81:39636) 2024-05-09T00:06:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff6feffd700 1 -- 172.21.15.81:0/3609893412 learned_addr learned my addr 172.21.15.81:0/3609893412 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff6fe7fc700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7000ffdd0 0x7ff700197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff700105ef0 0x7ff70019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff6feffd700 1 -- 172.21.15.81:0/3609893412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff700105ef0 msgr2=0x7ff70019be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff6feffd700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff700105ef0 0x7ff70019be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff6feffd700 1 -- 172.21.15.81:0/3609893412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7000ffdd0 msgr2=0x7ff700197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff6feffd700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7000ffdd0 0x7ff700197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff6feffd700 1 -- 172.21.15.81:0/3609893412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f8009d00 con 0x7ff7000ff410 2024-05-09T00:06:21.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.584+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff700105ef0 0x7ff70019be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:21.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.585+0000 7ff6feffd700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7000ff410 0x7ff700197530 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff6f400e9a0 tx=0x7ff6f400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:21.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.585+0000 7ff6e7fff700 1 -- 172.21.15.81:0/3609893412 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4009790 con 0x7ff7000ff410 2024-05-09T00:06:21.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.585+0000 7ff6e7fff700 1 -- 172.21.15.81:0/3609893412 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6f400cbd0 con 0x7ff7000ff410 2024-05-09T00:06:21.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.585+0000 7ff70576d700 1 -- 172.21.15.81:0/3609893412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70019ca60 con 0x7ff7000ff410 2024-05-09T00:06:21.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.585+0000 7ff6e7fff700 1 -- 172.21.15.81:0/3609893412 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4018680 con 0x7ff7000ff410 2024-05-09T00:06:21.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.585+0000 7ff70576d700 1 -- 172.21.15.81:0/3609893412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7001a42a0 con 0x7ff7000ff410 2024-05-09T00:06:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.587+0000 7ff6e7fff700 1 -- 172.21.15.81:0/3609893412 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ff6f400cd40 con 0x7ff7000ff410 2024-05-09T00:06:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.587+0000 7ff6e7fff700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff6e80a1290 0x7ff6e80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.588+0000 7ff6e7fff700 1 -- 172.21.15.81:0/3609893412 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ff6f4014070 con 0x7ff7000ff410 2024-05-09T00:06:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.588+0000 7ff6fe7fc700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff6e80a1290 0x7ff6e80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.588+0000 7ff6fe7fc700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff6e80a1290 0x7ff6e80a3750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0005950 tx=0x7ff6f00058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.588+0000 7ff711927b80 1 Processor -- start 2024-05-09T00:06:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.588+0000 7ff711927b80 1 -- start start 2024-05-09T00:06:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.588+0000 7ff711927b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb09091e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.588+0000 7ff711927b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0909720 0x55afb0903350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff711927b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0903890 0x55afb0903cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff711927b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb085a150 con 0x55afb0903890 2024-05-09T00:06:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff711927b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb0857b10 con 0x55afb0908e00 2024-05-09T00:06:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff711927b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb0853400 con 0x55afb0909720 2024-05-09T00:06:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0903890 0x55afb0903cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0903890 0x55afb0903cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39652/0 (socket says 172.21.15.81:39652) 2024-05-09T00:06:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/2878954249 learned_addr learned my addr 172.21.15.81:0/2878954249 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6fe7fc700 1 --2- 172.21.15.81:0/2878954249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0909720 0x55afb0903350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6feffd700 1 --2- 172.21.15.81:0/2878954249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb09091e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/2878954249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0909720 msgr2=0x55afb0903350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/2878954249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0909720 0x55afb0903350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/2878954249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 msgr2=0x55afb09091e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/2878954249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb09091e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/2878954249 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55afb06d43b0 con 0x55afb0903890 2024-05-09T00:06:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6feffd700 1 --2- 172.21.15.81:0/2878954249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb09091e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/2878954249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0903890 0x55afb0903cd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8006130 tx=0x7ff6f80092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6317a13e3c5903cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6e57fa700 1 -- 172.21.15.81:0/2878954249 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f800e040 con 0x55afb0903890 2024-05-09T00:06:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6e57fa700 1 -- 172.21.15.81:0/2878954249 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6f8007d30 con 0x55afb0903890 2024-05-09T00:06:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.589+0000 7ff6e57fa700 1 -- 172.21.15.81:0/2878954249 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8007810 con 0x55afb0903890 2024-05-09T00:06:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.590+0000 7ff711927b80 1 -- 172.21.15.81:0/2878954249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0903890 msgr2=0x55afb0903cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.590+0000 7ff711927b80 1 --2- 172.21.15.81:0/2878954249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0903890 0x55afb0903cd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8006130 tx=0x7ff6f80092e0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.590+0000 7ff711927b80 1 -- 172.21.15.81:0/2878954249 shutdown_connections 2024-05-09T00:06:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.590+0000 7ff711927b80 1 --2- 172.21.15.81:0/2878954249 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb09091e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.590+0000 7ff711927b80 1 --2- 172.21.15.81:0/2878954249 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0903890 0x55afb0903cd0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.590+0000 7ff711927b80 1 --2- 172.21.15.81:0/2878954249 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0909720 0x55afb0903350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.590+0000 7ff711927b80 1 -- 172.21.15.81:0/2878954249 >> 172.21.15.81:0/2878954249 conn(0x55afb0861210 msgr2=0x55afb08fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.590+0000 7ff711927b80 1 -- 172.21.15.81:0/2878954249 shutdown_connections 2024-05-09T00:06:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.590+0000 7ff711927b80 1 -- 172.21.15.81:0/2878954249 wait complete. 2024-05-09T00:06:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.590+0000 7ff711927b80 1 -- start start 2024-05-09T00:06:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.590+0000 7ff711927b80 1 Processor -- start 2024-05-09T00:06:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff711927b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0903890 0x55afb090cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff711927b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb090cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff711927b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0909720 0x55afb090d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff711927b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb07ef560 con 0x55afb0903890 2024-05-09T00:06:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff711927b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb07ef200 con 0x55afb0908e00 2024-05-09T00:06:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff711927b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb06d66a0 con 0x55afb0909720 2024-05-09T00:06:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff711927b80 10 client.0 _ll_register_callbacks cb 0x55afb07f8b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff6feffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0903890 0x55afb090cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff6feffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0903890 0x55afb090cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39666/0 (socket says 172.21.15.81:39666) 2024-05-09T00:06:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff6feffd700 1 -- 172.21.15.81:0/3363657514 learned_addr learned my addr 172.21.15.81:0/3363657514 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/3363657514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0909720 0x55afb090d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff6fe7fc700 1 --2- 172.21.15.81:0/3363657514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb090cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff6feffd700 1 -- 172.21.15.81:0/3363657514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0909720 msgr2=0x55afb090d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff6feffd700 1 --2- 172.21.15.81:0/3363657514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0909720 0x55afb090d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff6feffd700 1 -- 172.21.15.81:0/3363657514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 msgr2=0x55afb090cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff6feffd700 1 --2- 172.21.15.81:0/3363657514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb090cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff6feffd700 1 -- 172.21.15.81:0/3363657514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70010e750 con 0x55afb0903890 2024-05-09T00:06:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff6feffd700 1 --2- 172.21.15.81:0/3363657514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0903890 0x55afb090cab0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4099e30 tx=0x7ff6f409a970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5374e26eefdf778 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff6e2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.591+0000 7ff6e2ff5700 1 -- 172.21.15.81:0/3363657514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f40a25b0 con 0x55afb0903890 2024-05-09T00:06:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.592+0000 7ff6e2ff5700 1 -- 172.21.15.81:0/3363657514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ff6f40a2120 con 0x55afb0903890 2024-05-09T00:06:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.592+0000 7ff711927b80 1 -- 172.21.15.81:0/3363657514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55afb07ac270 con 0x55afb0903890 2024-05-09T00:06:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.592+0000 7ff6e2ff5700 1 -- 172.21.15.81:0/3363657514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6f40a22e0 con 0x55afb0903890 2024-05-09T00:06:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.592+0000 7ff711927b80 10 client.16335 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.592+0000 7ff711927b80 1 -- 172.21.15.81:0/3363657514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55afb0680b60 con 0x55afb0903890 2024-05-09T00:06:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.592+0000 7ff6e2ff5700 1 -- 172.21.15.81:0/3363657514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55afb07ac270 con 0x55afb0903890 2024-05-09T00:06:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.592+0000 7ff6e2ff5700 1 -- 172.21.15.81:0/3363657514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff6f4099300 con 0x55afb0903890 2024-05-09T00:06:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.592+0000 7ff711927b80 10 client.16335 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.592+0000 7ff711927b80 10 client.16335 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.592+0000 7ff711927b80 20 client.16335 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.592+0000 7ff711927b80 1 --2- 172.21.15.81:0/3363657514 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55afb091d0f0 0x55afb091f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.592+0000 7ff711927b80 4 client.16335 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.592+0000 7ff711927b80 1 -- 172.21.15.81:0/3363657514 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55afb08d2810 con 0x55afb091d0f0 2024-05-09T00:06:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.592+0000 7ff6fe7fc700 1 --2- 172.21.15.81:0/3363657514 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55afb091d0f0 0x55afb091f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.593+0000 7ff6e2ff5700 10 client.16335 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.593+0000 7ff6fe7fc700 1 --2- 172.21.15.81:0/3363657514 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55afb091d0f0 0x55afb091f510 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd336b8180e32732 server_cookie=bf22788163a3eb2e in_seq=0 out_seq=0 2024-05-09T00:06:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.593+0000 7ff6e2ff5700 1 -- 172.21.15.81:0/3363657514 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55afb08d2810 con 0x55afb091d0f0 2024-05-09T00:06:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.593+0000 7ff6e2ff5700 10 client.16335 handle_command_reply: tid=0 2024-05-09T00:06:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.594+0000 7ff711927b80 1 client.16335 shutdown 2024-05-09T00:06:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.594+0000 7ff711927b80 1 -- 172.21.15.81:0/3363657514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0903890 msgr2=0x55afb090cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.594+0000 7ff711927b80 1 --2- 172.21.15.81:0/3363657514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0903890 0x55afb090cab0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4099e30 tx=0x7ff6f409a970 comp rx=0 tx=0).stop 2024-05-09T00:06:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.594+0000 7ff711927b80 1 -- 172.21.15.81:0/3363657514 shutdown_connections 2024-05-09T00:06:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.594+0000 7ff711927b80 1 --2- 172.21.15.81:0/3363657514 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55afb091d0f0 0x55afb091f510 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.594+0000 7ff711927b80 1 --2- 172.21.15.81:0/3363657514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0909720 0x55afb090d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.594+0000 7ff711927b80 1 --2- 172.21.15.81:0/3363657514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0903890 0x55afb090cab0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.594+0000 7ff6e2ff5700 0 client.16335 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.594+0000 7ff711927b80 1 --2- 172.21.15.81:0/3363657514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb090cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.594+0000 7ff711927b80 1 -- 172.21.15.81:0/3363657514 >> 172.21.15.81:0/3363657514 conn(0x55afb0861210 msgr2=0x55afb08fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.594+0000 7ff711927b80 1 -- 172.21.15.81:0/3363657514 shutdown_connections 2024-05-09T00:06:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.594+0000 7ff711927b80 1 -- 172.21.15.81:0/3363657514 wait complete. 2024-05-09T00:06:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.594+0000 7ff711927b80 20 client.16335 trim_cache size 0 max 16384 2024-05-09T00:06:21.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.611+0000 7ff711927b80 1 Processor -- start 2024-05-09T00:06:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.611+0000 7ff711927b80 1 -- start start 2024-05-09T00:06:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.611+0000 7ff711927b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0903890 0x55afb0903350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.611+0000 7ff711927b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb0918bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.611+0000 7ff711927b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0909720 0x55afb08fdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.611+0000 7ff711927b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb0924740 con 0x55afb0909720 2024-05-09T00:06:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.611+0000 7ff711927b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb08f8800 con 0x55afb0908e00 2024-05-09T00:06:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.611+0000 7ff711927b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb090b020 con 0x55afb0903890 2024-05-09T00:06:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.611+0000 7ff6ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0909720 0x55afb08fdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.612+0000 7ff6ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0909720 0x55afb08fdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39680/0 (socket says 172.21.15.81:39680) 2024-05-09T00:06:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.612+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/3333862325 learned_addr learned my addr 172.21.15.81:0/3333862325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.612+0000 7ff6feffd700 1 --2- 172.21.15.81:0/3333862325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0903890 0x55afb0903350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.612+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/3333862325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0903890 msgr2=0x55afb0903350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:21.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.612+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/3333862325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0903890 0x55afb0903350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.612+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/3333862325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 msgr2=0x55afb0918bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.612+0000 7ff6fe7fc700 1 --2- 172.21.15.81:0/3333862325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb0918bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.612+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/3333862325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb0918bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.612+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/3333862325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55afb0819560 con 0x55afb0909720 2024-05-09T00:06:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.612+0000 7ff6fe7fc700 1 --2- 172.21.15.81:0/3333862325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb0918bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.612+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/3333862325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0909720 0x55afb08fdd20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009350 tx=0x7ff6f8009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4453af2992d42b2e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.612+0000 7ff6e5ffb700 1 -- 172.21.15.81:0/3333862325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f800e040 con 0x55afb0909720 2024-05-09T00:06:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.612+0000 7ff6e5ffb700 1 -- 172.21.15.81:0/3333862325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6f8007bb0 con 0x55afb0909720 2024-05-09T00:06:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.612+0000 7ff6e5ffb700 1 -- 172.21.15.81:0/3333862325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f801d470 con 0x55afb0909720 2024-05-09T00:06:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 -- 172.21.15.81:0/3333862325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0909720 msgr2=0x55afb08fdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 --2- 172.21.15.81:0/3333862325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0909720 0x55afb08fdd20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8009350 tx=0x7ff6f8009b80 comp rx=0 tx=0).stop 2024-05-09T00:06:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 -- 172.21.15.81:0/3333862325 shutdown_connections 2024-05-09T00:06:21.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 --2- 172.21.15.81:0/3333862325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0909720 0x55afb08fdd20 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 --2- 172.21.15.81:0/3333862325 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0903890 0x55afb0903350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 --2- 172.21.15.81:0/3333862325 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb0918bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 -- 172.21.15.81:0/3333862325 >> 172.21.15.81:0/3333862325 conn(0x55afb0861210 msgr2=0x55afb08fa210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 -- 172.21.15.81:0/3333862325 shutdown_connections 2024-05-09T00:06:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 -- 172.21.15.81:0/3333862325 wait complete. 2024-05-09T00:06:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 -- start start 2024-05-09T00:06:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 Processor -- start 2024-05-09T00:06:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0903890 0x55afb09145e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb09049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0909720 0x55afb09050e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb09057f0 con 0x55afb0909720 2024-05-09T00:06:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb0905960 con 0x55afb0908e00 2024-05-09T00:06:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afb0905b20 con 0x55afb0903890 2024-05-09T00:06:21.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff711927b80 10 client.0 _ll_register_callbacks cb 0x55afb07f8b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff6ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0909720 0x55afb09050e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff6ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0909720 0x55afb09050e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39696/0 (socket says 172.21.15.81:39696) 2024-05-09T00:06:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.613+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/3730666552 learned_addr learned my addr 172.21.15.81:0/3730666552 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff6feffd700 1 --2- 172.21.15.81:0/3730666552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0903890 0x55afb09145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff6fe7fc700 1 --2- 172.21.15.81:0/3730666552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb09049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/3730666552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0903890 msgr2=0x55afb09145e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/3730666552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0903890 0x55afb09145e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/3730666552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 msgr2=0x55afb09049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/3730666552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb09049a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff6ff7fe700 1 -- 172.21.15.81:0/3730666552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55afb06d43b0 con 0x55afb0909720 2024-05-09T00:06:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff6ff7fe700 1 --2- 172.21.15.81:0/3730666552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0909720 0x55afb09050e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800b000 tx=0x7ff6f8006060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c23b87249b6fba6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff6e2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff6e2ff5700 1 -- 172.21.15.81:0/3730666552 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f800e040 con 0x55afb0909720 2024-05-09T00:06:21.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff6e2ff5700 1 -- 172.21.15.81:0/3730666552 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ff6f8007b30 con 0x55afb0909720 2024-05-09T00:06:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff711927b80 1 -- 172.21.15.81:0/3730666552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55afb084bec0 con 0x55afb0909720 2024-05-09T00:06:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff6e2ff5700 1 -- 172.21.15.81:0/3730666552 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6f802e480 con 0x55afb0909720 2024-05-09T00:06:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff711927b80 10 client.16341 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff711927b80 1 -- 172.21.15.81:0/3730666552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55afb06d8cd0 con 0x55afb0909720 2024-05-09T00:06:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.614+0000 7ff6e2ff5700 1 -- 172.21.15.81:0/3730666552 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55afb084bec0 con 0x55afb0909720 2024-05-09T00:06:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff6e2ff5700 1 -- 172.21.15.81:0/3730666552 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff6f8024070 con 0x55afb0909720 2024-05-09T00:06:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff711927b80 10 client.16341 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff711927b80 10 client.16341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff711927b80 20 client.16341 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:21.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff711927b80 1 --2- 172.21.15.81:0/3730666552 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55afb091d0f0 0x55afb0979df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff711927b80 4 client.16341 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:06:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff711927b80 1 -- 172.21.15.81:0/3730666552 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55afb06a1cf0 con 0x55afb091d0f0 2024-05-09T00:06:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff6feffd700 1 --2- 172.21.15.81:0/3730666552 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55afb091d0f0 0x55afb0979df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff6e2ff5700 10 client.16341 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff6feffd700 1 --2- 172.21.15.81:0/3730666552 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55afb091d0f0 0x55afb0979df0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4b9c9beeff4687e server_cookie=f50c7ae9b8851323 in_seq=0 out_seq=0 2024-05-09T00:06:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff6e2ff5700 1 -- 172.21.15.81:0/3730666552 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55afb06a1cf0 con 0x55afb091d0f0 2024-05-09T00:06:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff6e2ff5700 10 client.16341 handle_command_reply: tid=0 2024-05-09T00:06:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff711927b80 1 client.16341 shutdown 2024-05-09T00:06:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff711927b80 1 -- 172.21.15.81:0/3730666552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0909720 msgr2=0x55afb09050e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.615+0000 7ff711927b80 1 --2- 172.21.15.81:0/3730666552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0909720 0x55afb09050e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800b000 tx=0x7ff6f8006060 comp rx=0 tx=0).stop 2024-05-09T00:06:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff711927b80 1 -- 172.21.15.81:0/3730666552 shutdown_connections 2024-05-09T00:06:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff711927b80 1 --2- 172.21.15.81:0/3730666552 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55afb091d0f0 0x55afb0979df0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff711927b80 1 --2- 172.21.15.81:0/3730666552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55afb0909720 0x55afb09050e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff6e2ff5700 0 client.16341 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff711927b80 1 --2- 172.21.15.81:0/3730666552 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55afb0903890 0x55afb09145e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff711927b80 1 --2- 172.21.15.81:0/3730666552 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55afb0908e00 0x55afb09049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff711927b80 1 -- 172.21.15.81:0/3730666552 >> 172.21.15.81:0/3730666552 conn(0x55afb0861210 msgr2=0x55afb090b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff711927b80 1 -- 172.21.15.81:0/3730666552 shutdown_connections 2024-05-09T00:06:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff711927b80 1 -- 172.21.15.81:0/3730666552 wait complete. 2024-05-09T00:06:21.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff711927b80 20 client.16341 trim_cache size 0 max 16384 2024-05-09T00:06:21.618 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:06:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:06:21.618 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:06:21.619 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:06:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff70576d700 1 -- 172.21.15.81:0/3609893412 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff6e80a1290 msgr2=0x7ff6e80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff70576d700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff6e80a1290 0x7ff6e80a3750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0005950 tx=0x7ff6f00058e0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff70576d700 1 -- 172.21.15.81:0/3609893412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7000ff410 msgr2=0x7ff700197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff70576d700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7000ff410 0x7ff700197530 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ff6f400e9a0 tx=0x7ff6f400ed60 comp rx=0 tx=0).stop 2024-05-09T00:06:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff70576d700 1 -- 172.21.15.81:0/3609893412 shutdown_connections 2024-05-09T00:06:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff70576d700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff6e80a1290 0x7ff6e80a3750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff70576d700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff700105ef0 0x7ff70019be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff70576d700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7000ff410 0x7ff700197530 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff70576d700 1 --2- 172.21.15.81:0/3609893412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff7000ffdd0 0x7ff700197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff70576d700 1 -- 172.21.15.81:0/3609893412 >> 172.21.15.81:0/3609893412 conn(0x7ff7000763a0 msgr2=0x7ff700103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff70576d700 1 -- 172.21.15.81:0/3609893412 shutdown_connections 2024-05-09T00:06:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.616+0000 7ff70576d700 1 -- 172.21.15.81:0/3609893412 wait complete. 2024-05-09T00:06:21.625 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:06:21.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:06:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.753+0000 7f6db83fb700 1 -- 172.21.15.81:0/3005120677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db00fff50 msgr2=0x7f6db0100330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:21.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.753+0000 7f6db83fb700 1 --2- 172.21.15.81:0/3005120677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db00fff50 0x7f6db0100330 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6da0009990 tx=0x7f6da0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.753+0000 7f6db83fb700 1 -- 172.21.15.81:0/3005120677 shutdown_connections 2024-05-09T00:06:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.753+0000 7f6db83fb700 1 --2- 172.21.15.81:0/3005120677 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6db0105070 0x7f6db010cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.753+0000 7f6db83fb700 1 --2- 172.21.15.81:0/3005120677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db00fff50 0x7f6db0100330 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.753+0000 7f6db83fb700 1 --2- 172.21.15.81:0/3005120677 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6db0100900 0x7f6db0104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.753+0000 7f6db83fb700 1 -- 172.21.15.81:0/3005120677 >> 172.21.15.81:0/3005120677 conn(0x7f6db00fb810 msgr2=0x7f6db00fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.753+0000 7f6db83fb700 1 -- 172.21.15.81:0/3005120677 shutdown_connections 2024-05-09T00:06:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.754+0000 7f6db83fb700 1 -- 172.21.15.81:0/3005120677 wait complete. 2024-05-09T00:06:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.754+0000 7f6db83fb700 1 Processor -- start 2024-05-09T00:06:21.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.754+0000 7f6db83fb700 1 -- start start 2024-05-09T00:06:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.754+0000 7f6db83fb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6db00fff50 0x7f6db01961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.754+0000 7f6db83fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db0105070 0x7f6db0196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.754+0000 7f6db83fb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6db019aa80 0x7f6db019af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.754+0000 7f6db83fb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db019b500 con 0x7f6db0105070 2024-05-09T00:06:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.754+0000 7f6db83fb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db019b670 con 0x7f6db00fff50 2024-05-09T00:06:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.754+0000 7f6db83fb700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db019b830 con 0x7f6db019aa80 2024-05-09T00:06:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.754+0000 7f6db5996700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db0105070 0x7f6db0196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.754+0000 7f6db5996700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db0105070 0x7f6db0196730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39720/0 (socket says 172.21.15.81:39720) 2024-05-09T00:06:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.754+0000 7f6db5996700 1 -- 172.21.15.81:0/1720277999 learned_addr learned my addr 172.21.15.81:0/1720277999 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.755+0000 7f6db6197700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6db00fff50 0x7f6db01961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.755+0000 7f6db6998700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6db019aa80 0x7f6db019af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.755+0000 7f6db5996700 1 -- 172.21.15.81:0/1720277999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6db019aa80 msgr2=0x7f6db019af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.755+0000 7f6db5996700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6db019aa80 0x7f6db019af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.755+0000 7f6db5996700 1 -- 172.21.15.81:0/1720277999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6db00fff50 msgr2=0x7f6db01961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.755+0000 7f6db5996700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6db00fff50 0x7f6db01961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.755+0000 7f6db5996700 1 -- 172.21.15.81:0/1720277999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da00095f0 con 0x7f6db0105070 2024-05-09T00:06:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.755+0000 7f6db6998700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6db019aa80 0x7f6db019af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.755+0000 7f6db5996700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db0105070 0x7f6db0196730 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00e970 tx=0x7f6dac00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.755+0000 7f6da77fe700 1 -- 172.21.15.81:0/1720277999 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac009790 con 0x7f6db0105070 2024-05-09T00:06:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.755+0000 7f6da77fe700 1 -- 172.21.15.81:0/1720277999 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6dac004cf0 con 0x7f6db0105070 2024-05-09T00:06:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.755+0000 7f6db83fb700 1 -- 172.21.15.81:0/1720277999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db01a2d90 con 0x7f6db0105070 2024-05-09T00:06:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.755+0000 7f6da77fe700 1 -- 172.21.15.81:0/1720277999 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac005680 con 0x7f6db0105070 2024-05-09T00:06:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.755+0000 7f6db83fb700 1 -- 172.21.15.81:0/1720277999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db01a3210 con 0x7f6db0105070 2024-05-09T00:06:21.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.756+0000 7f6db83fb700 1 -- 172.21.15.81:0/1720277999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db01082e0 con 0x7f6db0105070 2024-05-09T00:06:21.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.757+0000 7f6da77fe700 1 -- 172.21.15.81:0/1720277999 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6dac004750 con 0x7f6db0105070 2024-05-09T00:06:21.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.758+0000 7f6da77fe700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6d9c0a1290 0x7f6d9c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:21.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.758+0000 7f6db6197700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6d9c0a1290 0x7f6d9c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:21.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.758+0000 7f6da77fe700 1 -- 172.21.15.81:0/1720277999 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f6dac014070 con 0x7f6db0105070 2024-05-09T00:06:21.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.758+0000 7f6db6197700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6d9c0a1290 0x7f6d9c0a3750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6da00095c0 tx=0x7f6da0009510 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:21.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:21.761+0000 7f6da77fe700 1 -- 172.21.15.81:0/1720277999 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6dac096630 con 0x7f6db0105070 2024-05-09T00:06:22.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.007+0000 7f6db83fb700 1 -- 172.21.15.81:0/1720277999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6db0101420 con 0x7f6db0105070 2024-05-09T00:06:22.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.007+0000 7f6da77fe700 1 -- 172.21.15.81:0/1720277999 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7f6dac099c50 con 0x7f6db0105070 2024-05-09T00:06:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:06:22.002 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:06:22.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.010+0000 7f6db83fb700 1 -- 172.21.15.81:0/1720277999 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6d9c0a1290 msgr2=0x7f6d9c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.010+0000 7f6db83fb700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6d9c0a1290 0x7f6d9c0a3750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6da00095c0 tx=0x7f6da0009510 comp rx=0 tx=0).stop 2024-05-09T00:06:22.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.010+0000 7f6db83fb700 1 -- 172.21.15.81:0/1720277999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db0105070 msgr2=0x7f6db0196730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.010+0000 7f6db83fb700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db0105070 0x7f6db0196730 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6dac00e970 tx=0x7f6dac00ed30 comp rx=0 tx=0).stop 2024-05-09T00:06:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.010+0000 7f6db83fb700 1 -- 172.21.15.81:0/1720277999 shutdown_connections 2024-05-09T00:06:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.010+0000 7f6db83fb700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6d9c0a1290 0x7f6d9c0a3750 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.010+0000 7f6db83fb700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6db00fff50 0x7f6db01961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.010+0000 7f6db83fb700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6db019aa80 0x7f6db019af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.010+0000 7f6db83fb700 1 --2- 172.21.15.81:0/1720277999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6db0105070 0x7f6db0196730 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.010+0000 7f6db83fb700 1 -- 172.21.15.81:0/1720277999 >> 172.21.15.81:0/1720277999 conn(0x7f6db00fb810 msgr2=0x7f6db00fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.010+0000 7f6db83fb700 1 -- 172.21.15.81:0/1720277999 shutdown_connections 2024-05-09T00:06:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.010+0000 7f6db83fb700 1 -- 172.21.15.81:0/1720277999 wait complete. 2024-05-09T00:06:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:06:22.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:06:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.149+0000 7fc5d7659700 1 -- 172.21.15.81:0/115170550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d0105160 msgr2=0x7fc5d010cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.149+0000 7fc5d7659700 1 --2- 172.21.15.81:0/115170550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d0105160 0x7fc5d010cce0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800b0a0 tx=0x7fc5c800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.149+0000 7fc5d7659700 1 -- 172.21.15.81:0/115170550 shutdown_connections 2024-05-09T00:06:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.149+0000 7fc5d7659700 1 --2- 172.21.15.81:0/115170550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d0105160 0x7fc5d010cce0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.149+0000 7fc5d7659700 1 --2- 172.21.15.81:0/115170550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5d0100060 0x7fc5d0100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.149+0000 7fc5d7659700 1 --2- 172.21.15.81:0/115170550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5d0100a10 0x7fc5d0104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.149+0000 7fc5d7659700 1 -- 172.21.15.81:0/115170550 >> 172.21.15.81:0/115170550 conn(0x7fc5d0076f40 msgr2=0x7fc5d0077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.150+0000 7fc5d7659700 1 -- 172.21.15.81:0/115170550 shutdown_connections 2024-05-09T00:06:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.150+0000 7fc5d7659700 1 -- 172.21.15.81:0/115170550 wait complete. 2024-05-09T00:06:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.150+0000 7fc5d7659700 1 Processor -- start 2024-05-09T00:06:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.150+0000 7fc5d7659700 1 -- start start 2024-05-09T00:06:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.150+0000 7fc5d7659700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d0100060 0x7fc5d0196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.150+0000 7fc5d7659700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5d0105160 0x7fc5d0196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.150+0000 7fc5d7659700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5d019ac10 0x7fc5d019b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.150+0000 7fc5d7659700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d019b690 con 0x7fc5d0100060 2024-05-09T00:06:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.150+0000 7fc5d7659700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d019b800 con 0x7fc5d019ac10 2024-05-09T00:06:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.150+0000 7fc5d7659700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d019b9c0 con 0x7fc5d0105160 2024-05-09T00:06:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.150+0000 7fc5d53f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d0100060 0x7fc5d0196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.150+0000 7fc5d53f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d0100060 0x7fc5d0196330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39734/0 (socket says 172.21.15.81:39734) 2024-05-09T00:06:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.150+0000 7fc5d53f5700 1 -- 172.21.15.81:0/13952742 learned_addr learned my addr 172.21.15.81:0/13952742 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.151+0000 7fc5d4bf4700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5d0105160 0x7fc5d0196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.151+0000 7fc5d53f5700 1 -- 172.21.15.81:0/13952742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5d0105160 msgr2=0x7fc5d0196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.151+0000 7fc5d53f5700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5d0105160 0x7fc5d0196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.151+0000 7fc5d5bf6700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5d019ac10 0x7fc5d019b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.151+0000 7fc5d53f5700 1 -- 172.21.15.81:0/13952742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5d019ac10 msgr2=0x7fc5d019b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.151+0000 7fc5d53f5700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5d019ac10 0x7fc5d019b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.151+0000 7fc5d53f5700 1 -- 172.21.15.81:0/13952742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c8009d00 con 0x7fc5d0100060 2024-05-09T00:06:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.151+0000 7fc5d5bf6700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5d019ac10 0x7fc5d019b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.151+0000 7fc5d53f5700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d0100060 0x7fc5d0196330 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4007b50 tx=0x7fc5c4007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.151+0000 7fc5c27fc700 1 -- 172.21.15.81:0/13952742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4011070 con 0x7fc5d0100060 2024-05-09T00:06:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.151+0000 7fc5c27fc700 1 -- 172.21.15.81:0/13952742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5c400c2e0 con 0x7fc5d0100060 2024-05-09T00:06:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.151+0000 7fc5d7659700 1 -- 172.21.15.81:0/13952742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d0068050 con 0x7fc5d0100060 2024-05-09T00:06:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.151+0000 7fc5c27fc700 1 -- 172.21.15.81:0/13952742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c400aa30 con 0x7fc5d0100060 2024-05-09T00:06:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.151+0000 7fc5d7659700 1 -- 172.21.15.81:0/13952742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d00685b0 con 0x7fc5d0100060 2024-05-09T00:06:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.153+0000 7fc5c27fc700 1 -- 172.21.15.81:0/13952742 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc5c400ec80 con 0x7fc5d0100060 2024-05-09T00:06:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.154+0000 7fc5c27fc700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc5bc0a1310 0x7fc5bc0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.154+0000 7fc5d4bf4700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc5bc0a1310 0x7fc5bc0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.154+0000 7fc5c27fc700 1 -- 172.21.15.81:0/13952742 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fc5c40cda50 con 0x7fc5d0100060 2024-05-09T00:06:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.154+0000 7fc5d4bf4700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc5bc0a1310 0x7fc5bc0a37d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0197880 tx=0x7fc5cc009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5e3813b80 1 Processor -- start 2024-05-09T00:06:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5e3813b80 1 -- start start 2024-05-09T00:06:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5e3813b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 0x5604c4e001e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5e3813b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4e00720 0x5604c4dfa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5e3813b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dfa890 0x5604c4dfacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5e3813b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c4d51150 con 0x5604c4dfa890 2024-05-09T00:06:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5e3813b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c4d4eb10 con 0x5604c4e00720 2024-05-09T00:06:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5e3813b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c4d4a400 con 0x5604c4dffe00 2024-05-09T00:06:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5d5bf6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dfa890 0x5604c4dfacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5d5bf6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dfa890 0x5604c4dfacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39742/0 (socket says 172.21.15.81:39742) 2024-05-09T00:06:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5d5bf6700 1 -- 172.21.15.81:0/808497923 learned_addr learned my addr 172.21.15.81:0/808497923 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5d53f5700 1 --2- 172.21.15.81:0/808497923 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 0x5604c4e001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5d4bf4700 1 --2- 172.21.15.81:0/808497923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4e00720 0x5604c4dfa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5d5bf6700 1 -- 172.21.15.81:0/808497923 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 msgr2=0x5604c4e001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5d5bf6700 1 --2- 172.21.15.81:0/808497923 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 0x5604c4e001e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5d5bf6700 1 -- 172.21.15.81:0/808497923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4e00720 msgr2=0x5604c4dfa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5d5bf6700 1 --2- 172.21.15.81:0/808497923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4e00720 0x5604c4dfa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5d5bf6700 1 -- 172.21.15.81:0/808497923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604c4bcb3b0 con 0x5604c4dfa890 2024-05-09T00:06:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.155+0000 7fc5d5bf6700 1 --2- 172.21.15.81:0/808497923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dfa890 0x5604c4dfacd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009cc0 tx=0x7fc5c80092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f4887c228712e0f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.156+0000 7fc5bb7fe700 1 -- 172.21.15.81:0/808497923 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c800e040 con 0x5604c4dfa890 2024-05-09T00:06:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.156+0000 7fc5bb7fe700 1 -- 172.21.15.81:0/808497923 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5c80074e0 con 0x5604c4dfa890 2024-05-09T00:06:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.156+0000 7fc5bb7fe700 1 -- 172.21.15.81:0/808497923 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8004cb0 con 0x5604c4dfa890 2024-05-09T00:06:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.156+0000 7fc5e3813b80 1 -- 172.21.15.81:0/808497923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dfa890 msgr2=0x5604c4dfacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.156+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/808497923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dfa890 0x5604c4dfacd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009cc0 tx=0x7fc5c80092e0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.156+0000 7fc5e3813b80 1 -- 172.21.15.81:0/808497923 shutdown_connections 2024-05-09T00:06:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.156+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/808497923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dfa890 0x5604c4dfacd0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.156+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/808497923 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 0x5604c4e001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.156+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/808497923 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4e00720 0x5604c4dfa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.156+0000 7fc5e3813b80 1 -- 172.21.15.81:0/808497923 >> 172.21.15.81:0/808497923 conn(0x5604c4d58210 msgr2=0x5604c4df4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.156+0000 7fc5e3813b80 1 -- 172.21.15.81:0/808497923 shutdown_connections 2024-05-09T00:06:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.156+0000 7fc5e3813b80 1 -- 172.21.15.81:0/808497923 wait complete. 2024-05-09T00:06:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.157+0000 7fc5e3813b80 1 -- start start 2024-05-09T00:06:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.157+0000 7fc5e3813b80 1 Processor -- start 2024-05-09T00:06:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.157+0000 7fc5e3813b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4dfa890 0x5604c4e03ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.157+0000 7fc5e3813b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 0x5604c4e04010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.157+0000 7fc5e3813b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4e00720 0x5604c4e04550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.157+0000 7fc5e3813b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c4ce6560 con 0x5604c4e00720 2024-05-09T00:06:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.157+0000 7fc5e3813b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c4ce6200 con 0x5604c4dfa890 2024-05-09T00:06:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.157+0000 7fc5e3813b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c4bcd6a0 con 0x5604c4dffe00 2024-05-09T00:06:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.157+0000 7fc5e3813b80 10 client.0 _ll_register_callbacks cb 0x5604c4cefb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.157+0000 7fc5d5bf6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4e00720 0x5604c4e04550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.157+0000 7fc5d5bf6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4e00720 0x5604c4e04550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39744/0 (socket says 172.21.15.81:39744) 2024-05-09T00:06:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.157+0000 7fc5d5bf6700 1 -- 172.21.15.81:0/2295226736 learned_addr learned my addr 172.21.15.81:0/2295226736 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.157+0000 7fc5d53f5700 1 --2- 172.21.15.81:0/2295226736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4dfa890 0x5604c4e03ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.157+0000 7fc5d4bf4700 1 --2- 172.21.15.81:0/2295226736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 0x5604c4e04010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5d5bf6700 1 -- 172.21.15.81:0/2295226736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 msgr2=0x5604c4e04010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5d5bf6700 1 --2- 172.21.15.81:0/2295226736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 0x5604c4e04010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5d5bf6700 1 -- 172.21.15.81:0/2295226736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4dfa890 msgr2=0x5604c4e03ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5d5bf6700 1 --2- 172.21.15.81:0/2295226736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4dfa890 0x5604c4e03ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5d5bf6700 1 -- 172.21.15.81:0/2295226736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d010d550 con 0x5604c4e00720 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5d4bf4700 1 --2- 172.21.15.81:0/2295226736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 0x5604c4e04010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5d5bf6700 1 --2- 172.21.15.81:0/2295226736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4e00720 0x5604c4e04550 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800b3f0 tx=0x7fc5c800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4093036ae53fc51e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5b8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5b8ff9700 1 -- 172.21.15.81:0/2295226736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c800e040 con 0x5604c4e00720 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5b8ff9700 1 -- 172.21.15.81:0/2295226736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fc5c8007d50 con 0x5604c4e00720 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2295226736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604c4ca3270 con 0x5604c4e00720 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5b8ff9700 1 -- 172.21.15.81:0/2295226736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5c8004a50 con 0x5604c4e00720 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5e3813b80 10 client.16359 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2295226736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5604c4b77b60 con 0x5604c4e00720 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5b8ff9700 1 -- 172.21.15.81:0/2295226736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5604c4ca3270 con 0x5604c4e00720 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5b8ff9700 1 -- 172.21.15.81:0/2295226736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc5c8019040 con 0x5604c4e00720 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5e3813b80 10 client.16359 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5e3813b80 10 client.16359 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:06:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5e3813b80 20 client.16359 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/2295226736 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5604c4e13e80 0x5604c4e162a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5e3813b80 4 client.16359 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.158+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2295226736 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604c4dc9810 con 0x5604c4e13e80 2024-05-09T00:06:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.159+0000 7fc5d53f5700 1 --2- 172.21.15.81:0/2295226736 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5604c4e13e80 0x5604c4e162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.159+0000 7fc5b8ff9700 10 client.16359 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:06:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.159+0000 7fc5d53f5700 1 --2- 172.21.15.81:0/2295226736 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5604c4e13e80 0x5604c4e162a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c943effc7174f36d server_cookie=d129ef836bb2ed8d in_seq=0 out_seq=0 2024-05-09T00:06:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5b8ff9700 1 -- 172.21.15.81:0/2295226736 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5604c4dc9810 con 0x5604c4e13e80 2024-05-09T00:06:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5b8ff9700 10 client.16359 handle_command_reply: tid=0 2024-05-09T00:06:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5e3813b80 1 client.16359 shutdown 2024-05-09T00:06:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2295226736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4e00720 msgr2=0x5604c4e04550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/2295226736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4e00720 0x5604c4e04550 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc5c800b3f0 tx=0x7fc5c800bf60 comp rx=0 tx=0).stop 2024-05-09T00:06:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2295226736 shutdown_connections 2024-05-09T00:06:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/2295226736 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5604c4e13e80 0x5604c4e162a0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/2295226736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4dfa890 0x5604c4e03ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5b8ff9700 0 client.16359 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:06:22.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/2295226736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4e00720 0x5604c4e04550 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/2295226736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 0x5604c4e04010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2295226736 >> 172.21.15.81:0/2295226736 conn(0x5604c4d58210 msgr2=0x5604c4df45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2295226736 shutdown_connections 2024-05-09T00:06:22.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2295226736 wait complete. 2024-05-09T00:06:22.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.160+0000 7fc5e3813b80 20 client.16359 trim_cache size 0 max 16384 2024-05-09T00:06:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.173+0000 7fc5e3813b80 1 Processor -- start 2024-05-09T00:06:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.173+0000 7fc5e3813b80 1 -- start start 2024-05-09T00:06:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5e3813b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dfa890 0x5604c4dfa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5e3813b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 0x5604c4e16270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5e3813b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4e00720 0x5604c4dfac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5e3813b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c4e050f0 con 0x5604c4dfa890 2024-05-09T00:06:22.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5e3813b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c4e00580 con 0x5604c4e00720 2024-05-09T00:06:22.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5e3813b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c4df6e50 con 0x5604c4dffe00 2024-05-09T00:06:22.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5d53f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dfa890 0x5604c4dfa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5d53f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dfa890 0x5604c4dfa350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39758/0 (socket says 172.21.15.81:39758) 2024-05-09T00:06:22.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5d53f5700 1 -- 172.21.15.81:0/116556675 learned_addr learned my addr 172.21.15.81:0/116556675 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5d53f5700 1 -- 172.21.15.81:0/116556675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 msgr2=0x5604c4e16270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5d53f5700 1 --2- 172.21.15.81:0/116556675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 0x5604c4e16270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5d5bf6700 1 --2- 172.21.15.81:0/116556675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4e00720 0x5604c4dfac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5d53f5700 1 -- 172.21.15.81:0/116556675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4e00720 msgr2=0x5604c4dfac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5d53f5700 1 --2- 172.21.15.81:0/116556675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4e00720 0x5604c4dfac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5d53f5700 1 -- 172.21.15.81:0/116556675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604c4d10560 con 0x5604c4dfa890 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5d53f5700 1 --2- 172.21.15.81:0/116556675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dfa890 0x5604c4dfa350 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4007b20 tx=0x7fc5c40cd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f6bdd4fa7d617 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5bbfff700 1 -- 172.21.15.81:0/116556675 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4098f00 con 0x5604c4dfa890 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5bbfff700 1 -- 172.21.15.81:0/116556675 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5c409adc0 con 0x5604c4dfa890 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.174+0000 7fc5bbfff700 1 -- 172.21.15.81:0/116556675 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40a2db0 con 0x5604c4dfa890 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.175+0000 7fc5e3813b80 1 -- 172.21.15.81:0/116556675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dfa890 msgr2=0x5604c4dfa350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.175+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/116556675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dfa890 0x5604c4dfa350 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4007b20 tx=0x7fc5c40cd040 comp rx=0 tx=0).stop 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.175+0000 7fc5e3813b80 1 -- 172.21.15.81:0/116556675 shutdown_connections 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.175+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/116556675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4e00720 0x5604c4dfac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.175+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/116556675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dfa890 0x5604c4dfa350 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.175+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/116556675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4dffe00 0x5604c4e16270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.175+0000 7fc5e3813b80 1 -- 172.21.15.81:0/116556675 >> 172.21.15.81:0/116556675 conn(0x5604c4d58210 msgr2=0x5604c4df1210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.175+0000 7fc5e3813b80 1 -- 172.21.15.81:0/116556675 shutdown_connections 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.175+0000 7fc5e3813b80 1 -- 172.21.15.81:0/116556675 wait complete. 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.175+0000 7fc5e3813b80 1 -- start start 2024-05-09T00:06:22.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.175+0000 7fc5e3813b80 1 Processor -- start 2024-05-09T00:06:22.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5e3813b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4dfa890 0x5604c4e0b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5e3813b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dffe00 0x5604c4dfb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5e3813b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4e00720 0x5604c4dfc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5e3813b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c4dfc7f0 con 0x5604c4dffe00 2024-05-09T00:06:22.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5e3813b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c4dfc960 con 0x5604c4dfa890 2024-05-09T00:06:22.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5e3813b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604c4dfcb20 con 0x5604c4e00720 2024-05-09T00:06:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5e3813b80 10 client.0 _ll_register_callbacks cb 0x5604c4cefb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5d4bf4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dffe00 0x5604c4dfb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5d4bf4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dffe00 0x5604c4dfb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39772/0 (socket says 172.21.15.81:39772) 2024-05-09T00:06:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5d4bf4700 1 -- 172.21.15.81:0/2457768378 learned_addr learned my addr 172.21.15.81:0/2457768378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5d53f5700 1 --2- 172.21.15.81:0/2457768378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4dfa890 0x5604c4e0b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5d5bf6700 1 --2- 172.21.15.81:0/2457768378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4e00720 0x5604c4dfc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5d4bf4700 1 -- 172.21.15.81:0/2457768378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4e00720 msgr2=0x5604c4dfc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5d4bf4700 1 --2- 172.21.15.81:0/2457768378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4e00720 0x5604c4dfc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5d4bf4700 1 -- 172.21.15.81:0/2457768378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4dfa890 msgr2=0x5604c4e0b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5d4bf4700 1 --2- 172.21.15.81:0/2457768378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4dfa890 0x5604c4e0b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5d4bf4700 1 -- 172.21.15.81:0/2457768378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d00685b0 con 0x5604c4dffe00 2024-05-09T00:06:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5d53f5700 1 --2- 172.21.15.81:0/2457768378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4dfa890 0x5604c4e0b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5d4bf4700 1 --2- 172.21.15.81:0/2457768378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dffe00 0x5604c4dfb9a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009a90 tx=0x7fc5cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d086c701407e48 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5b8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5b8ff9700 1 -- 172.21.15.81:0/2457768378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5cc01e830 con 0x5604c4dffe00 2024-05-09T00:06:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5b8ff9700 1 -- 172.21.15.81:0/2457768378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fc5cc017070 con 0x5604c4dffe00 2024-05-09T00:06:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2457768378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc5c80074e0 con 0x5604c4dffe00 2024-05-09T00:06:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5b8ff9700 1 -- 172.21.15.81:0/2457768378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5cc01e990 con 0x5604c4dffe00 2024-05-09T00:06:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5e3813b80 10 client.16365 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.176+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2457768378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5604c4bcfcd0 con 0x5604c4dffe00 2024-05-09T00:06:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.177+0000 7fc5b8ff9700 1 -- 172.21.15.81:0/2457768378 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc5c80074e0 con 0x5604c4dffe00 2024-05-09T00:06:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.177+0000 7fc5b8ff9700 1 -- 172.21.15.81:0/2457768378 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc5cc031b90 con 0x5604c4dffe00 2024-05-09T00:06:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.177+0000 7fc5e3813b80 10 client.16365 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.177+0000 7fc5e3813b80 10 client.16365 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:06:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.177+0000 7fc5e3813b80 20 client.16365 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:22.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.177+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/2457768378 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5604c4e6f090 0x5604c4e714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.177+0000 7fc5e3813b80 4 client.16365 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:06:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.177+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2457768378 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5604c4d42ec0 con 0x5604c4e6f090 2024-05-09T00:06:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.177+0000 7fc5d53f5700 1 --2- 172.21.15.81:0/2457768378 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5604c4e6f090 0x5604c4e714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.177+0000 7fc5b8ff9700 10 client.16365 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:06:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.177+0000 7fc5d53f5700 1 --2- 172.21.15.81:0/2457768378 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5604c4e6f090 0x5604c4e714b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=40fc9d6e0d96150e server_cookie=21ad8c358aeb52d in_seq=0 out_seq=0 2024-05-09T00:06:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5b8ff9700 1 -- 172.21.15.81:0/2457768378 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5604c4d42ec0 con 0x5604c4e6f090 2024-05-09T00:06:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5b8ff9700 10 client.16365 handle_command_reply: tid=0 2024-05-09T00:06:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5e3813b80 1 client.16365 shutdown 2024-05-09T00:06:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2457768378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dffe00 msgr2=0x5604c4dfb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/2457768378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dffe00 0x5604c4dfb9a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009a90 tx=0x7fc5cc004750 comp rx=0 tx=0).stop 2024-05-09T00:06:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2457768378 shutdown_connections 2024-05-09T00:06:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/2457768378 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5604c4e6f090 0x5604c4e714b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/2457768378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5604c4dfa890 0x5604c4e0b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5b8ff9700 0 client.16365 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:06:22.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/2457768378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5604c4e00720 0x5604c4dfc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5e3813b80 1 --2- 172.21.15.81:0/2457768378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5604c4dffe00 0x5604c4dfb9a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2457768378 >> 172.21.15.81:0/2457768378 conn(0x5604c4d58210 msgr2=0x5604c4dfac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2457768378 shutdown_connections 2024-05-09T00:06:22.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5e3813b80 1 -- 172.21.15.81:0/2457768378 wait complete. 2024-05-09T00:06:22.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5e3813b80 20 client.16365 trim_cache size 0 max 16384 2024-05-09T00:06:22.179 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:06:22.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5d7659700 1 -- 172.21.15.81:0/13952742 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc5bc0a1310 msgr2=0x7fc5bc0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5d7659700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc5bc0a1310 0x7fc5bc0a37d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0197880 tx=0x7fc5cc009260 comp rx=0 tx=0).stop 2024-05-09T00:06:22.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5d7659700 1 -- 172.21.15.81:0/13952742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d0100060 msgr2=0x7fc5d0196330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5d7659700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d0100060 0x7fc5d0196330 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4007b50 tx=0x7fc5c4007f10 comp rx=0 tx=0).stop 2024-05-09T00:06:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5d7659700 1 -- 172.21.15.81:0/13952742 shutdown_connections 2024-05-09T00:06:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5d7659700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc5bc0a1310 0x7fc5bc0a37d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5d7659700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc5d019ac10 0x7fc5d019b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5d7659700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc5d0100060 0x7fc5d0196330 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5d7659700 1 --2- 172.21.15.81:0/13952742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc5d0105160 0x7fc5d0196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.178+0000 7fc5d7659700 1 -- 172.21.15.81:0/13952742 >> 172.21.15.81:0/13952742 conn(0x7fc5d0076f40 msgr2=0x7fc5d00fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.179+0000 7fc5d7659700 1 -- 172.21.15.81:0/13952742 shutdown_connections 2024-05-09T00:06:22.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.179+0000 7fc5d7659700 1 -- 172.21.15.81:0/13952742 wait complete. 2024-05-09T00:06:22.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:06:22.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.314+0000 7f8297768700 1 -- 172.21.15.81:0/3569954760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8290105390 msgr2=0x7f829010cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.314+0000 7f8297768700 1 --2- 172.21.15.81:0/3569954760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8290105390 0x7f829010cf10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f828800b0a0 tx=0x7f828800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 -- 172.21.15.81:0/3569954760 shutdown_connections 2024-05-09T00:06:22.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 --2- 172.21.15.81:0/3569954760 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8290100790 0x7f8290100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 --2- 172.21.15.81:0/3569954760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8290105390 0x7f829010cf10 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 --2- 172.21.15.81:0/3569954760 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8290101140 0x7f8290104c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 -- 172.21.15.81:0/3569954760 >> 172.21.15.81:0/3569954760 conn(0x7f82900763a0 msgr2=0x7f82900fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 -- 172.21.15.81:0/3569954760 shutdown_connections 2024-05-09T00:06:22.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 -- 172.21.15.81:0/3569954760 wait complete. 2024-05-09T00:06:22.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 Processor -- start 2024-05-09T00:06:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 -- start start 2024-05-09T00:06:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8290100790 0x7f82901976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8290105390 0x7f8290197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f829019bfd0 0x7f829019c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829019ca50 con 0x7f8290105390 2024-05-09T00:06:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829019cbc0 con 0x7f829019bfd0 2024-05-09T00:06:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8297768700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829019cd80 con 0x7f8290100790 2024-05-09T00:06:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.315+0000 7f8294d03700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8290105390 0x7f8290197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.316+0000 7f8294d03700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8290105390 0x7f8290197c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39790/0 (socket says 172.21.15.81:39790) 2024-05-09T00:06:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.316+0000 7f8294d03700 1 -- 172.21.15.81:0/1206472125 learned_addr learned my addr 172.21.15.81:0/1206472125 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.316+0000 7f8295504700 1 --2- 172.21.15.81:0/1206472125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8290100790 0x7f82901976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.316+0000 7f8294d03700 1 -- 172.21.15.81:0/1206472125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8290100790 msgr2=0x7f82901976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.316+0000 7f8294d03700 1 --2- 172.21.15.81:0/1206472125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8290100790 0x7f82901976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.316+0000 7f8294d03700 1 -- 172.21.15.81:0/1206472125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f829019bfd0 msgr2=0x7f829019c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.316+0000 7f8294d03700 1 --2- 172.21.15.81:0/1206472125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f829019bfd0 0x7f829019c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.316+0000 7f8294d03700 1 -- 172.21.15.81:0/1206472125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8288009d00 con 0x7f8290105390 2024-05-09T00:06:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.316+0000 7f8294d03700 1 --2- 172.21.15.81:0/1206472125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8290105390 0x7f8290197c30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f828000c8f0 tx=0x7f828000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.316+0000 7f82867fc700 1 -- 172.21.15.81:0/1206472125 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280007b00 con 0x7f8290105390 2024-05-09T00:06:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.316+0000 7f82867fc700 1 -- 172.21.15.81:0/1206472125 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8280007c60 con 0x7f8290105390 2024-05-09T00:06:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.316+0000 7f82867fc700 1 -- 172.21.15.81:0/1206472125 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280018660 con 0x7f8290105390 2024-05-09T00:06:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.316+0000 7f8297768700 1 -- 172.21.15.81:0/1206472125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82901a42e0 con 0x7f8290105390 2024-05-09T00:06:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.316+0000 7f8297768700 1 -- 172.21.15.81:0/1206472125 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82901a4770 con 0x7f8290105390 2024-05-09T00:06:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.318+0000 7f82867fc700 1 -- 172.21.15.81:0/1206472125 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f828000f450 con 0x7f8290105390 2024-05-09T00:06:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.319+0000 7f82867fc700 1 --2- 172.21.15.81:0/1206472125 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f827c0a1290 0x7f827c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.319+0000 7f8295504700 1 --2- 172.21.15.81:0/1206472125 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f827c0a1290 0x7f827c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.319+0000 7f82867fc700 1 -- 172.21.15.81:0/1206472125 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f82800ccbc0 con 0x7f8290105390 2024-05-09T00:06:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.319+0000 7f8295504700 1 --2- 172.21.15.81:0/1206472125 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f827c0a1290 0x7f827c0a3750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f828c005950 tx=0x7f828c0058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f82a3922b80 1 Processor -- start 2024-05-09T00:06:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f82a3922b80 1 -- start start 2024-05-09T00:06:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f82a3922b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da811e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f82a3922b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da81720 0x55da7da7b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f82a3922b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 0x55da7da7bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f82a3922b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da7d9d2150 con 0x55da7da80e00 2024-05-09T00:06:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f82a3922b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da7d9cfb10 con 0x55da7da81720 2024-05-09T00:06:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f82a3922b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da7d9cb400 con 0x55da7da7b890 2024-05-09T00:06:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f8295504700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da811e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f8295504700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da811e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39794/0 (socket says 172.21.15.81:39794) 2024-05-09T00:06:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f8295504700 1 -- 172.21.15.81:0/2682997642 learned_addr learned my addr 172.21.15.81:0/2682997642 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f8294d03700 1 --2- 172.21.15.81:0/2682997642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da81720 0x55da7da7b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f8295d05700 1 --2- 172.21.15.81:0/2682997642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 0x55da7da7bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f8295504700 1 -- 172.21.15.81:0/2682997642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 msgr2=0x55da7da7bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f8295504700 1 --2- 172.21.15.81:0/2682997642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 0x55da7da7bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f8295504700 1 -- 172.21.15.81:0/2682997642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da81720 msgr2=0x55da7da7b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f8295504700 1 --2- 172.21.15.81:0/2682997642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da81720 0x55da7da7b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f8295504700 1 -- 172.21.15.81:0/2682997642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da7d84c3b0 con 0x55da7da80e00 2024-05-09T00:06:22.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.320+0000 7f8295d05700 1 --2- 172.21.15.81:0/2682997642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 0x55da7da7bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.321+0000 7f8295504700 1 --2- 172.21.15.81:0/2682997642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da811e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f828c00fd70 tx=0x7f828c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5326b1ca562b5fed server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.321+0000 7f827b7fe700 1 -- 172.21.15.81:0/2682997642 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c011bb0 con 0x55da7da80e00 2024-05-09T00:06:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.321+0000 7f827b7fe700 1 -- 172.21.15.81:0/2682997642 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f828c011d10 con 0x55da7da80e00 2024-05-09T00:06:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.321+0000 7f827b7fe700 1 -- 172.21.15.81:0/2682997642 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c01d610 con 0x55da7da80e00 2024-05-09T00:06:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.321+0000 7f82a3922b80 1 -- 172.21.15.81:0/2682997642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 msgr2=0x55da7da811e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 --2- 172.21.15.81:0/2682997642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da811e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f828c00fd70 tx=0x7f828c012000 comp rx=0 tx=0).stop 2024-05-09T00:06:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 -- 172.21.15.81:0/2682997642 shutdown_connections 2024-05-09T00:06:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 --2- 172.21.15.81:0/2682997642 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 0x55da7da7bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 --2- 172.21.15.81:0/2682997642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da811e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 --2- 172.21.15.81:0/2682997642 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da81720 0x55da7da7b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 -- 172.21.15.81:0/2682997642 >> 172.21.15.81:0/2682997642 conn(0x55da7d9d9210 msgr2=0x55da7da75df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 -- 172.21.15.81:0/2682997642 shutdown_connections 2024-05-09T00:06:22.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 -- 172.21.15.81:0/2682997642 wait complete. 2024-05-09T00:06:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 -- start start 2024-05-09T00:06:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 Processor -- start 2024-05-09T00:06:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 0x55da7da84b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da850d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da81720 0x55da7da85610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da7d967560 con 0x55da7da80e00 2024-05-09T00:06:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da7d967200 con 0x55da7da81720 2024-05-09T00:06:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.322+0000 7f82a3922b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da7d84e6a0 con 0x55da7da7b890 2024-05-09T00:06:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f82a3922b80 10 client.0 _ll_register_callbacks cb 0x55da7d970b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8294d03700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da850d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8294d03700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da850d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39798/0 (socket says 172.21.15.81:39798) 2024-05-09T00:06:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8294d03700 1 -- 172.21.15.81:0/3001848380 learned_addr learned my addr 172.21.15.81:0/3001848380 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8295d05700 1 --2- 172.21.15.81:0/3001848380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da81720 0x55da7da85610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8295504700 1 --2- 172.21.15.81:0/3001848380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 0x55da7da84b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8294d03700 1 -- 172.21.15.81:0/3001848380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 msgr2=0x55da7da84b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8294d03700 1 --2- 172.21.15.81:0/3001848380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 0x55da7da84b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8294d03700 1 -- 172.21.15.81:0/3001848380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da81720 msgr2=0x55da7da85610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8294d03700 1 --2- 172.21.15.81:0/3001848380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da81720 0x55da7da85610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8294d03700 1 -- 172.21.15.81:0/3001848380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c00fa20 con 0x55da7da80e00 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8295504700 1 --2- 172.21.15.81:0/3001848380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 0x55da7da84b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8294d03700 1 --2- 172.21.15.81:0/3001848380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da850d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8280099c60 tx=0x7f8280007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879958042a5fd3ca server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8278ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8278ff9700 1 -- 172.21.15.81:0/3001848380 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828009a130 con 0x55da7da80e00 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8278ff9700 1 -- 172.21.15.81:0/3001848380 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f828000f910 con 0x55da7da80e00 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f82a3922b80 1 -- 172.21.15.81:0/3001848380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da7d924270 con 0x55da7da80e00 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f8278ff9700 1 -- 172.21.15.81:0/3001848380 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f828009db00 con 0x55da7da80e00 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f82a3922b80 10 client.16377 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.323+0000 7f82a3922b80 1 -- 172.21.15.81:0/3001848380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55da7d7f8b60 con 0x55da7da80e00 2024-05-09T00:06:22.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.324+0000 7f8278ff9700 1 -- 172.21.15.81:0/3001848380 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55da7d924270 con 0x55da7da80e00 2024-05-09T00:06:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.324+0000 7f8278ff9700 1 -- 172.21.15.81:0/3001848380 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f82800a1d50 con 0x55da7da80e00 2024-05-09T00:06:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.324+0000 7f82a3922b80 10 client.16377 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.324+0000 7f82a3922b80 10 client.16377 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:06:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.324+0000 7f82a3922b80 20 client.16377 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.324+0000 7f82a3922b80 1 --2- 172.21.15.81:0/3001848380 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55da7da94f40 0x55da7da97360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.324+0000 7f82a3922b80 4 client.16377 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.324+0000 7f82a3922b80 1 -- 172.21.15.81:0/3001848380 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da7da4a810 con 0x55da7da94f40 2024-05-09T00:06:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.324+0000 7f8295504700 1 --2- 172.21.15.81:0/3001848380 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55da7da94f40 0x55da7da97360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.324+0000 7f8278ff9700 10 client.16377 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:06:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.324+0000 7f8295504700 1 --2- 172.21.15.81:0/3001848380 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55da7da94f40 0x55da7da97360 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a930d3ce64829fee server_cookie=19b9509643ceab0b in_seq=0 out_seq=0 2024-05-09T00:06:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.325+0000 7f8278ff9700 1 -- 172.21.15.81:0/3001848380 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55da7da4a810 con 0x55da7da94f40 2024-05-09T00:06:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.325+0000 7f8278ff9700 10 client.16377 handle_command_reply: tid=0 2024-05-09T00:06:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.325+0000 7f82a3922b80 1 client.16377 shutdown 2024-05-09T00:06:22.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.325+0000 7f82a3922b80 1 -- 172.21.15.81:0/3001848380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 msgr2=0x55da7da850d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.325+0000 7f82a3922b80 1 --2- 172.21.15.81:0/3001848380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da850d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8280099c60 tx=0x7f8280007f10 comp rx=0 tx=0).stop 2024-05-09T00:06:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.325+0000 7f82a3922b80 1 -- 172.21.15.81:0/3001848380 shutdown_connections 2024-05-09T00:06:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.325+0000 7f82a3922b80 1 --2- 172.21.15.81:0/3001848380 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55da7da94f40 0x55da7da97360 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.325+0000 7f82a3922b80 1 --2- 172.21.15.81:0/3001848380 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da81720 0x55da7da85610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.325+0000 7f82a3922b80 1 --2- 172.21.15.81:0/3001848380 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 0x55da7da84b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.325+0000 7f8278ff9700 0 client.16377 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:06:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.325+0000 7f82a3922b80 1 --2- 172.21.15.81:0/3001848380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da850d0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.325+0000 7f82a3922b80 1 -- 172.21.15.81:0/3001848380 >> 172.21.15.81:0/3001848380 conn(0x55da7d9d9210 msgr2=0x55da7da755a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.325+0000 7f82a3922b80 1 -- 172.21.15.81:0/3001848380 shutdown_connections 2024-05-09T00:06:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.325+0000 7f82a3922b80 1 -- 172.21.15.81:0/3001848380 wait complete. 2024-05-09T00:06:22.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.326+0000 7f82a3922b80 20 client.16377 trim_cache size 0 max 16384 2024-05-09T00:06:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.338+0000 7f82a3922b80 1 Processor -- start 2024-05-09T00:06:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.338+0000 7f82a3922b80 1 -- start start 2024-05-09T00:06:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f82a3922b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 0x55da7da97330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f82a3922b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da80e00 0x55da7da75d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f82a3922b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da81720 0x55da7da85430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f82a3922b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da7da7b6d0 con 0x55da7da81720 2024-05-09T00:06:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f82a3922b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da7da9c570 con 0x55da7da80e00 2024-05-09T00:06:22.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f82a3922b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da7da87b40 con 0x55da7da7b890 2024-05-09T00:06:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f8295d05700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da81720 0x55da7da85430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f8295d05700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da81720 0x55da7da85430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39812/0 (socket says 172.21.15.81:39812) 2024-05-09T00:06:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f8295d05700 1 -- 172.21.15.81:0/704626438 learned_addr learned my addr 172.21.15.81:0/704626438 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f8295d05700 1 -- 172.21.15.81:0/704626438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 msgr2=0x55da7da97330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f8295504700 1 --2- 172.21.15.81:0/704626438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 0x55da7da97330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f8295d05700 1 --2- 172.21.15.81:0/704626438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 0x55da7da97330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f8295d05700 1 -- 172.21.15.81:0/704626438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da80e00 msgr2=0x55da7da75d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f8295d05700 1 --2- 172.21.15.81:0/704626438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da80e00 0x55da7da75d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f8295d05700 1 -- 172.21.15.81:0/704626438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da7d991560 con 0x55da7da81720 2024-05-09T00:06:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f8295d05700 1 --2- 172.21.15.81:0/704626438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da81720 0x55da7da85430 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f8288015000 tx=0x7f8288007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2edc69a6d5c7b2a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f827bfff700 1 -- 172.21.15.81:0/704626438 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828800e040 con 0x55da7da81720 2024-05-09T00:06:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f827bfff700 1 -- 172.21.15.81:0/704626438 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8288007e90 con 0x55da7da81720 2024-05-09T00:06:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.339+0000 7f827bfff700 1 -- 172.21.15.81:0/704626438 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82880256c0 con 0x55da7da81720 2024-05-09T00:06:22.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.340+0000 7f82a3922b80 1 -- 172.21.15.81:0/704626438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da81720 msgr2=0x55da7da85430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.340+0000 7f82a3922b80 1 --2- 172.21.15.81:0/704626438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da81720 0x55da7da85430 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f8288015000 tx=0x7f8288007c40 comp rx=0 tx=0).stop 2024-05-09T00:06:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.340+0000 7f82a3922b80 1 -- 172.21.15.81:0/704626438 shutdown_connections 2024-05-09T00:06:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.340+0000 7f82a3922b80 1 --2- 172.21.15.81:0/704626438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da81720 0x55da7da85430 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.340+0000 7f82a3922b80 1 --2- 172.21.15.81:0/704626438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da7b890 0x55da7da97330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.340+0000 7f82a3922b80 1 --2- 172.21.15.81:0/704626438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da80e00 0x55da7da75d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.340+0000 7f82a3922b80 1 -- 172.21.15.81:0/704626438 >> 172.21.15.81:0/704626438 conn(0x55da7d9d9210 msgr2=0x55da7da72210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.340+0000 7f82a3922b80 1 -- 172.21.15.81:0/704626438 shutdown_connections 2024-05-09T00:06:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.340+0000 7f82a3922b80 1 -- 172.21.15.81:0/704626438 wait complete. 2024-05-09T00:06:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.340+0000 7f82a3922b80 1 -- start start 2024-05-09T00:06:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.340+0000 7f82a3922b80 1 Processor -- start 2024-05-09T00:06:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f82a3922b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da7b890 0x55da7da8a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f82a3922b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da8a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f82a3922b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da81720 0x55da7daea440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f82a3922b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da7da8aea0 con 0x55da7da80e00 2024-05-09T00:06:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f82a3922b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da7da8b010 con 0x55da7da7b890 2024-05-09T00:06:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f82a3922b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da7daeaa00 con 0x55da7da81720 2024-05-09T00:06:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f82a3922b80 10 client.0 _ll_register_callbacks cb 0x55da7d970b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f8294d03700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da8a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f8294d03700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da8a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39820/0 (socket says 172.21.15.81:39820) 2024-05-09T00:06:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f8294d03700 1 -- 172.21.15.81:0/4057153711 learned_addr learned my addr 172.21.15.81:0/4057153711 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f8295504700 1 --2- 172.21.15.81:0/4057153711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da7b890 0x55da7da8a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f8295d05700 1 --2- 172.21.15.81:0/4057153711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da81720 0x55da7daea440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f8294d03700 1 -- 172.21.15.81:0/4057153711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da81720 msgr2=0x55da7daea440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f8294d03700 1 --2- 172.21.15.81:0/4057153711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da81720 0x55da7daea440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f8294d03700 1 -- 172.21.15.81:0/4057153711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da7b890 msgr2=0x55da7da8a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f8294d03700 1 --2- 172.21.15.81:0/4057153711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da7b890 0x55da7da8a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f8294d03700 1 -- 172.21.15.81:0/4057153711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829010d780 con 0x55da7da80e00 2024-05-09T00:06:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f8294d03700 1 --2- 172.21.15.81:0/4057153711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da8a690 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8280096180 tx=0x7f82800993d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a0f710b4f62943 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f8278ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f8278ff9700 1 -- 172.21.15.81:0/4057153711 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280099aa0 con 0x55da7da80e00 2024-05-09T00:06:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.341+0000 7f8278ff9700 1 -- 172.21.15.81:0/4057153711 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f828000f910 con 0x55da7da80e00 2024-05-09T00:06:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.342+0000 7f82a3922b80 1 -- 172.21.15.81:0/4057153711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f828c011d10 con 0x55da7da80e00 2024-05-09T00:06:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.342+0000 7f8278ff9700 1 -- 172.21.15.81:0/4057153711 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82800add10 con 0x55da7da80e00 2024-05-09T00:06:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.342+0000 7f82a3922b80 10 client.16383 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.342+0000 7f82a3922b80 1 -- 172.21.15.81:0/4057153711 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55da7d850cd0 con 0x55da7da80e00 2024-05-09T00:06:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.342+0000 7f8278ff9700 1 -- 172.21.15.81:0/4057153711 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f828c011d10 con 0x55da7da80e00 2024-05-09T00:06:22.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.342+0000 7f8278ff9700 1 -- 172.21.15.81:0/4057153711 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f828009ea20 con 0x55da7da80e00 2024-05-09T00:06:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.342+0000 7f82a3922b80 10 client.16383 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.342+0000 7f82a3922b80 10 client.16383 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:06:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.342+0000 7f82a3922b80 20 client.16383 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.342+0000 7f82a3922b80 1 --2- 172.21.15.81:0/4057153711 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55da7daebf60 0x55da7daee380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.342+0000 7f82a3922b80 4 client.16383 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:06:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.342+0000 7f82a3922b80 1 -- 172.21.15.81:0/4057153711 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55da7d9c3ec0 con 0x55da7daebf60 2024-05-09T00:06:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.342+0000 7f8295504700 1 --2- 172.21.15.81:0/4057153711 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55da7daebf60 0x55da7daee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f8295504700 1 --2- 172.21.15.81:0/4057153711 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55da7daebf60 0x55da7daee380 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a4817b3ecf81517f server_cookie=1f9baa1d4b0ca71a in_seq=0 out_seq=0 2024-05-09T00:06:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f8278ff9700 10 client.16383 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:06:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f8278ff9700 1 -- 172.21.15.81:0/4057153711 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55da7d9c3ec0 con 0x55da7daebf60 2024-05-09T00:06:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f8278ff9700 10 client.16383 handle_command_reply: tid=0 2024-05-09T00:06:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f82a3922b80 1 client.16383 shutdown 2024-05-09T00:06:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f82a3922b80 1 -- 172.21.15.81:0/4057153711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 msgr2=0x55da7da8a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f82a3922b80 1 --2- 172.21.15.81:0/4057153711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da8a690 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f8280096180 tx=0x7f82800993d0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f82a3922b80 1 -- 172.21.15.81:0/4057153711 shutdown_connections 2024-05-09T00:06:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f82a3922b80 1 --2- 172.21.15.81:0/4057153711 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55da7daebf60 0x55da7daee380 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f82a3922b80 1 --2- 172.21.15.81:0/4057153711 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55da7da7b890 0x55da7da8a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f82a3922b80 1 --2- 172.21.15.81:0/4057153711 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55da7da81720 0x55da7daea440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f8278ff9700 0 client.16383 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:06:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f82a3922b80 1 --2- 172.21.15.81:0/4057153711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55da7da80e00 0x55da7da8a690 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f82a3922b80 1 -- 172.21.15.81:0/4057153711 >> 172.21.15.81:0/4057153711 conn(0x55da7d9d9210 msgr2=0x55da7da833a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f82a3922b80 1 -- 172.21.15.81:0/4057153711 shutdown_connections 2024-05-09T00:06:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f82a3922b80 1 -- 172.21.15.81:0/4057153711 wait complete. 2024-05-09T00:06:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f82a3922b80 20 client.16383 trim_cache size 0 max 16384 2024-05-09T00:06:22.344 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:06:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f8297768700 1 -- 172.21.15.81:0/1206472125 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f827c0a1290 msgr2=0x7f827c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f8297768700 1 --2- 172.21.15.81:0/1206472125 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f827c0a1290 0x7f827c0a3750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f828c005950 tx=0x7f828c0058e0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f8297768700 1 -- 172.21.15.81:0/1206472125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8290105390 msgr2=0x7f8290197c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.343+0000 7f8297768700 1 --2- 172.21.15.81:0/1206472125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8290105390 0x7f8290197c30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f828000c8f0 tx=0x7f828000ccb0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.344+0000 7f8297768700 1 -- 172.21.15.81:0/1206472125 shutdown_connections 2024-05-09T00:06:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.344+0000 7f8297768700 1 --2- 172.21.15.81:0/1206472125 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f827c0a1290 0x7f827c0a3750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.344+0000 7f8297768700 1 --2- 172.21.15.81:0/1206472125 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f829019bfd0 0x7f829019c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.344+0000 7f8297768700 1 --2- 172.21.15.81:0/1206472125 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8290100790 0x7f82901976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.344+0000 7f8297768700 1 --2- 172.21.15.81:0/1206472125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8290105390 0x7f8290197c30 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.344+0000 7f8297768700 1 -- 172.21.15.81:0/1206472125 >> 172.21.15.81:0/1206472125 conn(0x7f82900763a0 msgr2=0x7f82900ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.344+0000 7f8297768700 1 -- 172.21.15.81:0/1206472125 shutdown_connections 2024-05-09T00:06:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.344+0000 7f8297768700 1 -- 172.21.15.81:0/1206472125 wait complete. 2024-05-09T00:06:22.348 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:22 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1720277999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:06:22.349 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:06:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.479+0000 7fd168505700 1 -- 172.21.15.81:0/1324165675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1601062a0 msgr2=0x7fd16010de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.479+0000 7fd168505700 1 --2- 172.21.15.81:0/1324165675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1601062a0 0x7fd16010de20 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fd15800b0d0 tx=0x7fd15800b3e0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.479+0000 7fd168505700 1 -- 172.21.15.81:0/1324165675 shutdown_connections 2024-05-09T00:06:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.479+0000 7fd168505700 1 --2- 172.21.15.81:0/1324165675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd160069740 0x7fd160069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.479+0000 7fd168505700 1 --2- 172.21.15.81:0/1324165675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1601062a0 0x7fd16010de20 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.479+0000 7fd168505700 1 --2- 172.21.15.81:0/1324165675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd16006a0f0 0x7fd160105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.479+0000 7fd168505700 1 -- 172.21.15.81:0/1324165675 >> 172.21.15.81:0/1324165675 conn(0x7fd160076f70 msgr2=0x7fd160077380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.479+0000 7fd168505700 1 -- 172.21.15.81:0/1324165675 shutdown_connections 2024-05-09T00:06:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.479+0000 7fd168505700 1 -- 172.21.15.81:0/1324165675 wait complete. 2024-05-09T00:06:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.479+0000 7fd168505700 1 Processor -- start 2024-05-09T00:06:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.479+0000 7fd168505700 1 -- start start 2024-05-09T00:06:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd168505700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd160069740 0x7fd1601974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd168505700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1601062a0 0x7fd1601979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd168505700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd16019bd90 0x7fd16019c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd168505700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16019c810 con 0x7fd16019bd90 2024-05-09T00:06:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd168505700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16019c980 con 0x7fd1601062a0 2024-05-09T00:06:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd168505700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16019cb40 con 0x7fd160069740 2024-05-09T00:06:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd166aa2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd16019bd90 0x7fd16019c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd166aa2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd16019bd90 0x7fd16019c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39842/0 (socket says 172.21.15.81:39842) 2024-05-09T00:06:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd166aa2700 1 -- 172.21.15.81:0/4170253126 learned_addr learned my addr 172.21.15.81:0/4170253126 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd1662a1700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd160069740 0x7fd1601974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd165aa0700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1601062a0 0x7fd1601979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd166aa2700 1 -- 172.21.15.81:0/4170253126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd160069740 msgr2=0x7fd1601974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd166aa2700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd160069740 0x7fd1601974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd166aa2700 1 -- 172.21.15.81:0/4170253126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1601062a0 msgr2=0x7fd1601979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd166aa2700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1601062a0 0x7fd1601979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd166aa2700 1 -- 172.21.15.81:0/4170253126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd158009d00 con 0x7fd16019bd90 2024-05-09T00:06:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd165aa0700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1601062a0 0x7fd1601979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd166aa2700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd16019bd90 0x7fd16019c210 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd15800bd50 tx=0x7fd15800bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd1577fe700 1 -- 172.21.15.81:0/4170253126 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15800e040 con 0x7fd16019bd90 2024-05-09T00:06:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd1577fe700 1 -- 172.21.15.81:0/4170253126 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd15801d930 con 0x7fd16019bd90 2024-05-09T00:06:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd168505700 1 -- 172.21.15.81:0/4170253126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1601a4040 con 0x7fd16019bd90 2024-05-09T00:06:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd1577fe700 1 -- 172.21.15.81:0/4170253126 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15801ba10 con 0x7fd16019bd90 2024-05-09T00:06:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.480+0000 7fd168505700 1 -- 172.21.15.81:0/4170253126 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1601a4510 con 0x7fd16019bd90 2024-05-09T00:06:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.483+0000 7fd1577fe700 1 -- 172.21.15.81:0/4170253126 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fd15801d470 con 0x7fd16019bd90 2024-05-09T00:06:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.483+0000 7fd1577fe700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd14c0a1310 0x7fd14c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.484+0000 7fd1662a1700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd14c0a1310 0x7fd14c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.484+0000 7fd1577fe700 1 -- 172.21.15.81:0/4170253126 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fd1580ce090 con 0x7fd16019bd90 2024-05-09T00:06:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.484+0000 7fd1662a1700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd14c0a1310 0x7fd14c0a37d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd150005950 tx=0x7fd15000b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.484+0000 7fd1746bfb80 1 Processor -- start 2024-05-09T00:06:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1746bfb80 1 -- start start 2024-05-09T00:06:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1746bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0829e00 0x55c2d082a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1746bfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 0x55c2d0824350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1746bfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d0824890 0x55c2d0824cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1746bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d077b150 con 0x55c2d0829e00 2024-05-09T00:06:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1746bfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d0778b10 con 0x55c2d082a720 2024-05-09T00:06:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1746bfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d0774400 con 0x55c2d0824890 2024-05-09T00:06:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1662a1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0829e00 0x55c2d082a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1662a1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0829e00 0x55c2d082a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39844/0 (socket says 172.21.15.81:39844) 2024-05-09T00:06:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1662a1700 1 -- 172.21.15.81:0/1673905926 learned_addr learned my addr 172.21.15.81:0/1673905926 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd165aa0700 1 --2- 172.21.15.81:0/1673905926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 0x55c2d0824350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd166aa2700 1 --2- 172.21.15.81:0/1673905926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d0824890 0x55c2d0824cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1662a1700 1 -- 172.21.15.81:0/1673905926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d0824890 msgr2=0x55c2d0824cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1662a1700 1 --2- 172.21.15.81:0/1673905926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d0824890 0x55c2d0824cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1662a1700 1 -- 172.21.15.81:0/1673905926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 msgr2=0x55c2d0824350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1662a1700 1 --2- 172.21.15.81:0/1673905926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 0x55c2d0824350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1662a1700 1 -- 172.21.15.81:0/1673905926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2d05f53b0 con 0x55c2d0829e00 2024-05-09T00:06:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd1662a1700 1 --2- 172.21.15.81:0/1673905926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0829e00 0x55c2d082a1e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd150010fa0 tx=0x7fd150013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b6a3778873b9b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.485+0000 7fd154ff9700 1 -- 172.21.15.81:0/1673905926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150011db0 con 0x55c2d0829e00 2024-05-09T00:06:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.486+0000 7fd154ff9700 1 -- 172.21.15.81:0/1673905926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd150015070 con 0x55c2d0829e00 2024-05-09T00:06:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.486+0000 7fd154ff9700 1 -- 172.21.15.81:0/1673905926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15001c610 con 0x55c2d0829e00 2024-05-09T00:06:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.486+0000 7fd1746bfb80 1 -- 172.21.15.81:0/1673905926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0829e00 msgr2=0x55c2d082a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.486+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/1673905926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0829e00 0x55c2d082a1e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fd150010fa0 tx=0x7fd150013000 comp rx=0 tx=0).stop 2024-05-09T00:06:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.486+0000 7fd1746bfb80 1 -- 172.21.15.81:0/1673905926 shutdown_connections 2024-05-09T00:06:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.486+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/1673905926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d0824890 0x55c2d0824cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.486+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/1673905926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0829e00 0x55c2d082a1e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.486+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/1673905926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 0x55c2d0824350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.486+0000 7fd1746bfb80 1 -- 172.21.15.81:0/1673905926 >> 172.21.15.81:0/1673905926 conn(0x55c2d0782210 msgr2=0x55c2d081edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.486+0000 7fd1746bfb80 1 -- 172.21.15.81:0/1673905926 shutdown_connections 2024-05-09T00:06:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.486+0000 7fd1746bfb80 1 -- 172.21.15.81:0/1673905926 wait complete. 2024-05-09T00:06:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd1746bfb80 1 -- start start 2024-05-09T00:06:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd1746bfb80 1 Processor -- start 2024-05-09T00:06:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd1746bfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d0824890 0x55c2d082da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd1746bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0829e00 0x55c2d082df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd1746bfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d082a720 0x55c2d082e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd1746bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d0710560 con 0x55c2d0829e00 2024-05-09T00:06:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd1746bfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d0710200 con 0x55c2d0824890 2024-05-09T00:06:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd1746bfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d05f76a0 con 0x55c2d082a720 2024-05-09T00:06:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd1746bfb80 10 client.0 _ll_register_callbacks cb 0x55c2d0719b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd165aa0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0829e00 0x55c2d082df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd165aa0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0829e00 0x55c2d082df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39860/0 (socket says 172.21.15.81:39860) 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd165aa0700 1 -- 172.21.15.81:0/2111732828 learned_addr learned my addr 172.21.15.81:0/2111732828 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd1662a1700 1 --2- 172.21.15.81:0/2111732828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d0824890 0x55c2d082da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd166aa2700 1 --2- 172.21.15.81:0/2111732828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d082a720 0x55c2d082e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd165aa0700 1 -- 172.21.15.81:0/2111732828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d082a720 msgr2=0x55c2d082e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd165aa0700 1 --2- 172.21.15.81:0/2111732828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d082a720 0x55c2d082e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd165aa0700 1 -- 172.21.15.81:0/2111732828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d0824890 msgr2=0x55c2d082da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd165aa0700 1 --2- 172.21.15.81:0/2111732828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d0824890 0x55c2d082da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.487+0000 7fd165aa0700 1 -- 172.21.15.81:0/2111732828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd150010c50 con 0x55c2d0829e00 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd165aa0700 1 --2- 172.21.15.81:0/2111732828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0829e00 0x55c2d082df70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009880 tx=0x7fd15c009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f056bc03db5089e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd149ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd149ffb700 1 -- 172.21.15.81:0/2111732828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c003cd0 con 0x55c2d0829e00 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd149ffb700 1 -- 172.21.15.81:0/2111732828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fd15c003e30 con 0x55c2d0829e00 2024-05-09T00:06:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd1746bfb80 1 -- 172.21.15.81:0/2111732828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2d06cd270 con 0x55c2d0829e00 2024-05-09T00:06:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd149ffb700 1 -- 172.21.15.81:0/2111732828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd15c01b440 con 0x55c2d0829e00 2024-05-09T00:06:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd1746bfb80 10 client.16395 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd1746bfb80 1 -- 172.21.15.81:0/2111732828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c2d05a1b60 con 0x55c2d0829e00 2024-05-09T00:06:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd149ffb700 1 -- 172.21.15.81:0/2111732828 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c2d06cd270 con 0x55c2d0829e00 2024-05-09T00:06:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd149ffb700 1 -- 172.21.15.81:0/2111732828 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd15c0247b0 con 0x55c2d0829e00 2024-05-09T00:06:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd1746bfb80 10 client.16395 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd1746bfb80 10 client.16395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd1746bfb80 20 client.16395 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/2111732828 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2d083e130 0x55c2d0840550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd1746bfb80 4 client.16395 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.488+0000 7fd1746bfb80 1 -- 172.21.15.81:0/2111732828 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c2d07f3810 con 0x55c2d083e130 2024-05-09T00:06:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.489+0000 7fd1662a1700 1 --2- 172.21.15.81:0/2111732828 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2d083e130 0x55c2d0840550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.489+0000 7fd1662a1700 1 --2- 172.21.15.81:0/2111732828 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2d083e130 0x55c2d0840550 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d39f7784c6450502 server_cookie=848a9df43ee7d807 in_seq=0 out_seq=0 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.489+0000 7fd149ffb700 10 client.16395 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd149ffb700 1 -- 172.21.15.81:0/2111732828 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c2d07f3810 con 0x55c2d083e130 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd149ffb700 10 client.16395 handle_command_reply: tid=0 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd1746bfb80 1 client.16395 shutdown 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd1746bfb80 1 -- 172.21.15.81:0/2111732828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0829e00 msgr2=0x55c2d082df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/2111732828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0829e00 0x55c2d082df70 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009880 tx=0x7fd15c009b90 comp rx=0 tx=0).stop 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd1746bfb80 1 -- 172.21.15.81:0/2111732828 shutdown_connections 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/2111732828 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2d083e130 0x55c2d0840550 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/2111732828 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d0824890 0x55c2d082da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/2111732828 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d082a720 0x55c2d082e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd149ffb700 0 client.16395 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/2111732828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0829e00 0x55c2d082df70 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd1746bfb80 1 -- 172.21.15.81:0/2111732828 >> 172.21.15.81:0/2111732828 conn(0x55c2d0782210 msgr2=0x55c2d081e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd1746bfb80 1 -- 172.21.15.81:0/2111732828 shutdown_connections 2024-05-09T00:06:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd1746bfb80 1 -- 172.21.15.81:0/2111732828 wait complete. 2024-05-09T00:06:22.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.490+0000 7fd1746bfb80 20 client.16395 trim_cache size 0 max 16384 2024-05-09T00:06:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.503+0000 7fd1746bfb80 1 Processor -- start 2024-05-09T00:06:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.503+0000 7fd1746bfb80 1 -- start start 2024-05-09T00:06:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.503+0000 7fd1746bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0824890 0x55c2d0824c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.503+0000 7fd1746bfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d0829e00 0x55c2d081ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.503+0000 7fd1746bfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 0x55c2d082e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.503+0000 7fd1746bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d08457d0 con 0x55c2d0824890 2024-05-09T00:06:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.503+0000 7fd1746bfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d0819830 con 0x55c2d082a720 2024-05-09T00:06:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.503+0000 7fd1746bfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d081fa50 con 0x55c2d0829e00 2024-05-09T00:06:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.503+0000 7fd1662a1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0824890 0x55c2d0824c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.504+0000 7fd1662a1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0824890 0x55c2d0824c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39874/0 (socket says 172.21.15.81:39874) 2024-05-09T00:06:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.504+0000 7fd1662a1700 1 -- 172.21.15.81:0/2914428984 learned_addr learned my addr 172.21.15.81:0/2914428984 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.504+0000 7fd1662a1700 1 -- 172.21.15.81:0/2914428984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d0829e00 msgr2=0x55c2d081ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.504+0000 7fd1662a1700 1 --2- 172.21.15.81:0/2914428984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d0829e00 0x55c2d081ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.504+0000 7fd1662a1700 1 -- 172.21.15.81:0/2914428984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 msgr2=0x55c2d082e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.504+0000 7fd166aa2700 1 --2- 172.21.15.81:0/2914428984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 0x55c2d082e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.504+0000 7fd1662a1700 1 --2- 172.21.15.81:0/2914428984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 0x55c2d082e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.504+0000 7fd1662a1700 1 -- 172.21.15.81:0/2914428984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2d073a560 con 0x55c2d0824890 2024-05-09T00:06:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.504+0000 7fd166aa2700 1 --2- 172.21.15.81:0/2914428984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 0x55c2d082e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.504+0000 7fd1662a1700 1 --2- 172.21.15.81:0/2914428984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0824890 0x55c2d0824c70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd150010f70 tx=0x7fd15001eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f31f1eed37a854 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.504+0000 7fd1557fa700 1 -- 172.21.15.81:0/2914428984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15002c070 con 0x55c2d0824890 2024-05-09T00:06:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.504+0000 7fd1557fa700 1 -- 172.21.15.81:0/2914428984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd15002d040 con 0x55c2d0824890 2024-05-09T00:06:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.504+0000 7fd1557fa700 1 -- 172.21.15.81:0/2914428984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150004690 con 0x55c2d0824890 2024-05-09T00:06:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.505+0000 7fd1746bfb80 1 -- 172.21.15.81:0/2914428984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0824890 msgr2=0x55c2d0824c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.505+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/2914428984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0824890 0x55c2d0824c70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd150010f70 tx=0x7fd15001eb00 comp rx=0 tx=0).stop 2024-05-09T00:06:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.505+0000 7fd1746bfb80 1 -- 172.21.15.81:0/2914428984 shutdown_connections 2024-05-09T00:06:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.505+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/2914428984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 0x55c2d082e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.505+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/2914428984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0824890 0x55c2d0824c70 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.505+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/2914428984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d0829e00 0x55c2d081ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.505+0000 7fd1746bfb80 1 -- 172.21.15.81:0/2914428984 >> 172.21.15.81:0/2914428984 conn(0x55c2d0782210 msgr2=0x55c2d082c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.505+0000 7fd1746bfb80 1 -- 172.21.15.81:0/2914428984 shutdown_connections 2024-05-09T00:06:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.505+0000 7fd1746bfb80 1 -- 172.21.15.81:0/2914428984 wait complete. 2024-05-09T00:06:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.505+0000 7fd1746bfb80 1 -- start start 2024-05-09T00:06:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.505+0000 7fd1746bfb80 1 Processor -- start 2024-05-09T00:06:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.505+0000 7fd1746bfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0824890 0x55c2d08314f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1746bfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d0829e00 0x55c2d0831a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1746bfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 0x55c2d088d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1746bfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d088db30 con 0x55c2d0824890 2024-05-09T00:06:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1746bfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d088dca0 con 0x55c2d082a720 2024-05-09T00:06:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1746bfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2d088de60 con 0x55c2d0829e00 2024-05-09T00:06:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1746bfb80 10 client.0 _ll_register_callbacks cb 0x55c2d0719b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1662a1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0824890 0x55c2d08314f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1662a1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0824890 0x55c2d08314f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39882/0 (socket says 172.21.15.81:39882) 2024-05-09T00:06:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1662a1700 1 -- 172.21.15.81:0/3108358143 learned_addr learned my addr 172.21.15.81:0/3108358143 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd166aa2700 1 --2- 172.21.15.81:0/3108358143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 0x55c2d088d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd165aa0700 1 --2- 172.21.15.81:0/3108358143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d0829e00 0x55c2d0831a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1662a1700 1 -- 172.21.15.81:0/3108358143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d0829e00 msgr2=0x55c2d0831a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1662a1700 1 --2- 172.21.15.81:0/3108358143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d0829e00 0x55c2d0831a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1662a1700 1 -- 172.21.15.81:0/3108358143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 msgr2=0x55c2d088d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1662a1700 1 --2- 172.21.15.81:0/3108358143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 0x55c2d088d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1662a1700 1 -- 172.21.15.81:0/3108358143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2d05f53b0 con 0x55c2d0824890 2024-05-09T00:06:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd166aa2700 1 --2- 172.21.15.81:0/3108358143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 0x55c2d088d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1662a1700 1 --2- 172.21.15.81:0/3108358143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0824890 0x55c2d08314f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd150005d90 tx=0x7fd1500051e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbaa8aeb247633e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd149ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd149ffb700 1 -- 172.21.15.81:0/3108358143 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15002c040 con 0x55c2d0824890 2024-05-09T00:06:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd149ffb700 1 -- 172.21.15.81:0/3108358143 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fd150017070 con 0x55c2d0824890 2024-05-09T00:06:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1746bfb80 1 -- 172.21.15.81:0/3108358143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd150015070 con 0x55c2d0824890 2024-05-09T00:06:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd149ffb700 1 -- 172.21.15.81:0/3108358143 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd150011da0 con 0x55c2d0824890 2024-05-09T00:06:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1746bfb80 10 client.16401 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.506+0000 7fd1746bfb80 1 -- 172.21.15.81:0/3108358143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c2d05f9cd0 con 0x55c2d0824890 2024-05-09T00:06:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.507+0000 7fd149ffb700 1 -- 172.21.15.81:0/3108358143 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd150015070 con 0x55c2d0824890 2024-05-09T00:06:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.507+0000 7fd149ffb700 1 -- 172.21.15.81:0/3108358143 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd1500350b0 con 0x55c2d0824890 2024-05-09T00:06:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.507+0000 7fd1746bfb80 10 client.16401 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.507+0000 7fd1746bfb80 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.507+0000 7fd1746bfb80 20 client.16401 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.507+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/3108358143 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2d08950f0 0x55c2d08974e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.507+0000 7fd1746bfb80 4 client.16401 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:06:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.507+0000 7fd1746bfb80 1 -- 172.21.15.81:0/3108358143 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c2d076cec0 con 0x55c2d08950f0 2024-05-09T00:06:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.507+0000 7fd165aa0700 1 --2- 172.21.15.81:0/3108358143 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2d08950f0 0x55c2d08974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.507+0000 7fd149ffb700 10 client.16401 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.507+0000 7fd165aa0700 1 --2- 172.21.15.81:0/3108358143 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2d08950f0 0x55c2d08974e0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e65970a65a9c205 server_cookie=1bb4d86e0d0737de in_seq=0 out_seq=0 2024-05-09T00:06:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd149ffb700 1 -- 172.21.15.81:0/3108358143 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c2d076cec0 con 0x55c2d08950f0 2024-05-09T00:06:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd149ffb700 10 client.16401 handle_command_reply: tid=0 2024-05-09T00:06:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd1746bfb80 1 client.16401 shutdown 2024-05-09T00:06:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd1746bfb80 1 -- 172.21.15.81:0/3108358143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0824890 msgr2=0x55c2d08314f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/3108358143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0824890 0x55c2d08314f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fd150005d90 tx=0x7fd1500051e0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd1746bfb80 1 -- 172.21.15.81:0/3108358143 shutdown_connections 2024-05-09T00:06:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/3108358143 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2d08950f0 0x55c2d08974e0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/3108358143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2d082a720 0x55c2d088d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd149ffb700 0 client.16401 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/3108358143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2d0824890 0x55c2d08314f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd1746bfb80 1 --2- 172.21.15.81:0/3108358143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2d0829e00 0x55c2d0831a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd1746bfb80 1 -- 172.21.15.81:0/3108358143 >> 172.21.15.81:0/3108358143 conn(0x55c2d0782210 msgr2=0x55c2d0828b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd1746bfb80 1 -- 172.21.15.81:0/3108358143 shutdown_connections 2024-05-09T00:06:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd1746bfb80 1 -- 172.21.15.81:0/3108358143 wait complete. 2024-05-09T00:06:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd1746bfb80 20 client.16401 trim_cache size 0 max 16384 2024-05-09T00:06:22.510 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:06:22.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd168505700 1 -- 172.21.15.81:0/4170253126 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd14c0a1310 msgr2=0x7fd14c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd168505700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd14c0a1310 0x7fd14c0a37d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd150005950 tx=0x7fd15000b410 comp rx=0 tx=0).stop 2024-05-09T00:06:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd168505700 1 -- 172.21.15.81:0/4170253126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd16019bd90 msgr2=0x7fd16019c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd168505700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd16019bd90 0x7fd16019c210 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd15800bd50 tx=0x7fd15800bd80 comp rx=0 tx=0).stop 2024-05-09T00:06:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd168505700 1 -- 172.21.15.81:0/4170253126 shutdown_connections 2024-05-09T00:06:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd168505700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd14c0a1310 0x7fd14c0a37d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd168505700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd16019bd90 0x7fd16019c210 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd168505700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd160069740 0x7fd1601974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd168505700 1 --2- 172.21.15.81:0/4170253126 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd1601062a0 0x7fd1601979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd168505700 1 -- 172.21.15.81:0/4170253126 >> 172.21.15.81:0/4170253126 conn(0x7fd160076f70 msgr2=0x7fd1600ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd168505700 1 -- 172.21.15.81:0/4170253126 shutdown_connections 2024-05-09T00:06:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:22.508+0000 7fd168505700 1 -- 172.21.15.81:0/4170253126 wait complete. 2024-05-09T00:06:22.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:22 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1720277999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:06:22.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:22 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1720277999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:06:23.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:23 smithi081 ceph-mon[42474]: pgmap v106: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:23.514 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:23 smithi150 ceph-mon[46187]: pgmap v106: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:23.516 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:06:23.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:06:23.552 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:23 smithi171 ceph-mon[47351]: pgmap v106: 97 pgs: 97 active+clean; 3.5 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:23.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.661+0000 7f4539c9f700 1 -- 172.21.15.81:0/84803524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4534100a10 msgr2=0x7f4534104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.661+0000 7f4539c9f700 1 --2- 172.21.15.81:0/84803524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4534100a10 0x7f4534104a50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4528009990 tx=0x7f4528009ca0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.661+0000 7f4539c9f700 1 -- 172.21.15.81:0/84803524 shutdown_connections 2024-05-09T00:06:23.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.661+0000 7f4539c9f700 1 --2- 172.21.15.81:0/84803524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4534105180 0x7f453410cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.661+0000 7f4539c9f700 1 --2- 172.21.15.81:0/84803524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4534100060 0x7f4534100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.661+0000 7f4539c9f700 1 --2- 172.21.15.81:0/84803524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4534100a10 0x7f4534104a50 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.661+0000 7f4539c9f700 1 -- 172.21.15.81:0/84803524 >> 172.21.15.81:0/84803524 conn(0x7f4534076f40 msgr2=0x7f4534077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.661+0000 7f4539c9f700 1 -- 172.21.15.81:0/84803524 shutdown_connections 2024-05-09T00:06:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.661+0000 7f4539c9f700 1 -- 172.21.15.81:0/84803524 wait complete. 2024-05-09T00:06:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.662+0000 7f4539c9f700 1 Processor -- start 2024-05-09T00:06:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.662+0000 7f4539c9f700 1 -- start start 2024-05-09T00:06:23.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.662+0000 7f4539c9f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4534100060 0x7f45341962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.662+0000 7f4539c9f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4534105180 0x7f4534196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.662+0000 7f4539c9f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f453419ab60 0x7f453419afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.662+0000 7f4539c9f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453419b5e0 con 0x7f4534100060 2024-05-09T00:06:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.662+0000 7f4539c9f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453419b750 con 0x7f453419ab60 2024-05-09T00:06:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.662+0000 7f4539c9f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453419b910 con 0x7f4534105180 2024-05-09T00:06:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.662+0000 7f45337fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4534100060 0x7f45341962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.662+0000 7f45337fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4534100060 0x7f45341962d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39896/0 (socket says 172.21.15.81:39896) 2024-05-09T00:06:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.662+0000 7f45337fe700 1 -- 172.21.15.81:0/3310694581 learned_addr learned my addr 172.21.15.81:0/3310694581 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.663+0000 7f4533fff700 1 --2- 172.21.15.81:0/3310694581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f453419ab60 0x7f453419afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.663+0000 7f45337fe700 1 -- 172.21.15.81:0/3310694581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4534105180 msgr2=0x7f4534196810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.663+0000 7f45337fe700 1 --2- 172.21.15.81:0/3310694581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4534105180 0x7f4534196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.663+0000 7f45337fe700 1 -- 172.21.15.81:0/3310694581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f453419ab60 msgr2=0x7f453419afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.663+0000 7f45337fe700 1 --2- 172.21.15.81:0/3310694581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f453419ab60 0x7f453419afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.663+0000 7f45337fe700 1 -- 172.21.15.81:0/3310694581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45280095f0 con 0x7f4534100060 2024-05-09T00:06:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.663+0000 7f4533fff700 1 --2- 172.21.15.81:0/3310694581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f453419ab60 0x7f453419afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.663+0000 7f45337fe700 1 --2- 172.21.15.81:0/3310694581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4534100060 0x7f45341962d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f452400c9b0 tx=0x7f452400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.663+0000 7f4530ff9700 1 -- 172.21.15.81:0/3310694581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4524007b00 con 0x7f4534100060 2024-05-09T00:06:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.663+0000 7f4530ff9700 1 -- 172.21.15.81:0/3310694581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4524007c60 con 0x7f4534100060 2024-05-09T00:06:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.663+0000 7f4539c9f700 1 -- 172.21.15.81:0/3310694581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45341a2e70 con 0x7f4534100060 2024-05-09T00:06:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.663+0000 7f4530ff9700 1 -- 172.21.15.81:0/3310694581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4524018660 con 0x7f4534100060 2024-05-09T00:06:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.663+0000 7f4539c9f700 1 -- 172.21.15.81:0/3310694581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45341a32f0 con 0x7f4534100060 2024-05-09T00:06:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.665+0000 7f4530ff9700 1 -- 172.21.15.81:0/3310694581 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4524018880 con 0x7f4534100060 2024-05-09T00:06:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.666+0000 7f4530ff9700 1 --2- 172.21.15.81:0/3310694581 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f451c0a1290 0x7f451c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.666+0000 7f4532ffd700 1 --2- 172.21.15.81:0/3310694581 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f451c0a1290 0x7f451c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.666+0000 7f4530ff9700 1 -- 172.21.15.81:0/3310694581 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f45240ccdc0 con 0x7f4534100060 2024-05-09T00:06:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.666+0000 7f4532ffd700 1 --2- 172.21.15.81:0/3310694581 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f451c0a1290 0x7f451c0a3750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f452800b5c0 tx=0x7f4528005fb0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:23.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4545e59b80 1 Processor -- start 2024-05-09T00:06:23.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4545e59b80 1 -- start start 2024-05-09T00:06:23.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4545e59b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e6be80 0x55e0c5e6c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4545e59b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e663d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4545e59b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e66910 0x55e0c5e66d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4545e59b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5dbd1d0 con 0x55e0c5e66910 2024-05-09T00:06:23.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4545e59b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5dbab90 con 0x55e0c5e6c7a0 2024-05-09T00:06:23.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4545e59b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5db6480 con 0x55e0c5e6be80 2024-05-09T00:06:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4533fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e66910 0x55e0c5e66d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4533fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e66910 0x55e0c5e66d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39902/0 (socket says 172.21.15.81:39902) 2024-05-09T00:06:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4533fff700 1 -- 172.21.15.81:0/241722731 learned_addr learned my addr 172.21.15.81:0/241722731 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f45337fe700 1 --2- 172.21.15.81:0/241722731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e6be80 0x55e0c5e6c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4532ffd700 1 --2- 172.21.15.81:0/241722731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e663d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4533fff700 1 -- 172.21.15.81:0/241722731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e6be80 msgr2=0x55e0c5e6c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4533fff700 1 --2- 172.21.15.81:0/241722731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e6be80 0x55e0c5e6c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4533fff700 1 -- 172.21.15.81:0/241722731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 msgr2=0x55e0c5e663d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4533fff700 1 --2- 172.21.15.81:0/241722731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e663d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.667+0000 7f4533fff700 1 -- 172.21.15.81:0/241722731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0c5c37430 con 0x55e0c5e66910 2024-05-09T00:06:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.668+0000 7f4533fff700 1 --2- 172.21.15.81:0/241722731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e66910 0x55e0c5e66d50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f452c009cd0 tx=0x7f452c007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0a29bee24f3bdd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.668+0000 7f4519ffb700 1 -- 172.21.15.81:0/241722731 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c014400 con 0x55e0c5e66910 2024-05-09T00:06:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.668+0000 7f4519ffb700 1 -- 172.21.15.81:0/241722731 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f452c014a20 con 0x55e0c5e66910 2024-05-09T00:06:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.668+0000 7f4519ffb700 1 -- 172.21.15.81:0/241722731 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c013a40 con 0x55e0c5e66910 2024-05-09T00:06:23.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.668+0000 7f4545e59b80 1 -- 172.21.15.81:0/241722731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e66910 msgr2=0x55e0c5e66d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.668+0000 7f4545e59b80 1 --2- 172.21.15.81:0/241722731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e66910 0x55e0c5e66d50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f452c009cd0 tx=0x7f452c007500 comp rx=0 tx=0).stop 2024-05-09T00:06:23.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.668+0000 7f4545e59b80 1 -- 172.21.15.81:0/241722731 shutdown_connections 2024-05-09T00:06:23.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.668+0000 7f4545e59b80 1 --2- 172.21.15.81:0/241722731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e66910 0x55e0c5e66d50 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.668+0000 7f4545e59b80 1 --2- 172.21.15.81:0/241722731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e6be80 0x55e0c5e6c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.668+0000 7f4545e59b80 1 --2- 172.21.15.81:0/241722731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e663d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.668+0000 7f4545e59b80 1 -- 172.21.15.81:0/241722731 >> 172.21.15.81:0/241722731 conn(0x55e0c5dc4290 msgr2=0x55e0c5e60e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:23.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.668+0000 7f4545e59b80 1 -- 172.21.15.81:0/241722731 shutdown_connections 2024-05-09T00:06:23.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.668+0000 7f4545e59b80 1 -- 172.21.15.81:0/241722731 wait complete. 2024-05-09T00:06:23.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.669+0000 7f4545e59b80 1 -- start start 2024-05-09T00:06:23.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.669+0000 7f4545e59b80 1 Processor -- start 2024-05-09T00:06:23.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.669+0000 7f4545e59b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 0x55e0c5e71f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.669+0000 7f4545e59b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6be80 0x55e0c5e724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.669+0000 7f4545e59b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e76ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.669+0000 7f4545e59b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5d525e0 con 0x55e0c5e6be80 2024-05-09T00:06:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.669+0000 7f4545e59b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5d52280 con 0x55e0c5e6c7a0 2024-05-09T00:06:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.669+0000 7f4545e59b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5c39720 con 0x55e0c5e66910 2024-05-09T00:06:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.669+0000 7f4545e59b80 10 client.0 _ll_register_callbacks cb 0x55e0c5d5bbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.669+0000 7f4532ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6be80 0x55e0c5e724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4532ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6be80 0x55e0c5e724c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39910/0 (socket says 172.21.15.81:39910) 2024-05-09T00:06:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4532ffd700 1 -- 172.21.15.81:0/175723612 learned_addr learned my addr 172.21.15.81:0/175723612 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f45337fe700 1 --2- 172.21.15.81:0/175723612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 0x55e0c5e71f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4533fff700 1 --2- 172.21.15.81:0/175723612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e76ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4532ffd700 1 -- 172.21.15.81:0/175723612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 msgr2=0x55e0c5e71f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4532ffd700 1 --2- 172.21.15.81:0/175723612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 0x55e0c5e71f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4532ffd700 1 -- 172.21.15.81:0/175723612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 msgr2=0x55e0c5e76ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4532ffd700 1 --2- 172.21.15.81:0/175723612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e76ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4532ffd700 1 -- 172.21.15.81:0/175723612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452c009900 con 0x55e0c5e6be80 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4532ffd700 1 --2- 172.21.15.81:0/175723612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6be80 0x55e0c5e724c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4528009990 tx=0x7f4528000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88023bfa7590411 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4512ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4512ffd700 1 -- 172.21.15.81:0/175723612 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452802b040 con 0x55e0c5e6be80 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4512ffd700 1 -- 172.21.15.81:0/175723612 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f452800fbc0 con 0x55e0c5e6be80 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4545e59b80 1 -- 172.21.15.81:0/175723612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0c5d0f2f0 con 0x55e0c5e6be80 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4512ffd700 1 -- 172.21.15.81:0/175723612 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f452801d070 con 0x55e0c5e6be80 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4545e59b80 10 client.16413 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4545e59b80 1 -- 172.21.15.81:0/175723612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e0c5be3be0 con 0x55e0c5e6be80 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.670+0000 7f4512ffd700 1 -- 172.21.15.81:0/175723612 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f452803c020 con 0x55e0c5e6be80 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.671+0000 7f4512ffd700 1 -- 172.21.15.81:0/175723612 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4528003790 con 0x55e0c5e6be80 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.671+0000 7f4545e59b80 10 client.16413 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.671+0000 7f4545e59b80 10 client.16413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.671+0000 7f4545e59b80 20 client.16413 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:23.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.671+0000 7f4545e59b80 1 --2- 172.21.15.81:0/175723612 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0c5e824b0 0x55e0c5e848d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.671+0000 7f4545e59b80 4 client.16413 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.671+0000 7f4545e59b80 1 -- 172.21.15.81:0/175723612 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0c5e35890 con 0x55e0c5e824b0 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.671+0000 7f45337fe700 1 --2- 172.21.15.81:0/175723612 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0c5e824b0 0x55e0c5e848d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.671+0000 7f4512ffd700 10 client.16413 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.671+0000 7f45337fe700 1 --2- 172.21.15.81:0/175723612 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0c5e824b0 0x55e0c5e848d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2086d2fee4f1ddba server_cookie=b9a297ef5cc24556 in_seq=0 out_seq=0 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4512ffd700 1 -- 172.21.15.81:0/175723612 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e0c5e35890 con 0x55e0c5e824b0 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4512ffd700 10 client.16413 handle_command_reply: tid=0 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4545e59b80 1 client.16413 shutdown 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4545e59b80 1 -- 172.21.15.81:0/175723612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6be80 msgr2=0x55e0c5e724c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4545e59b80 1 --2- 172.21.15.81:0/175723612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6be80 0x55e0c5e724c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4528009990 tx=0x7f4528000bc0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4545e59b80 1 -- 172.21.15.81:0/175723612 shutdown_connections 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4545e59b80 1 --2- 172.21.15.81:0/175723612 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0c5e824b0 0x55e0c5e848d0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4545e59b80 1 --2- 172.21.15.81:0/175723612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e76ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4545e59b80 1 --2- 172.21.15.81:0/175723612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 0x55e0c5e71f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4512ffd700 0 client.16413 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:23.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4545e59b80 1 --2- 172.21.15.81:0/175723612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6be80 0x55e0c5e724c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4545e59b80 1 -- 172.21.15.81:0/175723612 >> 172.21.15.81:0/175723612 conn(0x55e0c5dc4290 msgr2=0x55e0c5e60620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:23.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4545e59b80 1 -- 172.21.15.81:0/175723612 shutdown_connections 2024-05-09T00:06:23.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4545e59b80 1 -- 172.21.15.81:0/175723612 wait complete. 2024-05-09T00:06:23.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.672+0000 7f4545e59b80 20 client.16413 trim_cache size 0 max 16384 2024-05-09T00:06:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.689+0000 7f4545e59b80 1 Processor -- start 2024-05-09T00:06:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4545e59b80 1 -- start start 2024-05-09T00:06:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4545e59b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 0x55e0c5e663d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4545e59b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6be80 0x55e0c5e76ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4545e59b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e60da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4545e59b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5e6c4e0 con 0x55e0c5e6c7a0 2024-05-09T00:06:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4545e59b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5e779a0 con 0x55e0c5e6be80 2024-05-09T00:06:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4545e59b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5e7efb0 con 0x55e0c5e66910 2024-05-09T00:06:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4533fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e60da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4533fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e60da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39926/0 (socket says 172.21.15.81:39926) 2024-05-09T00:06:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4533fff700 1 -- 172.21.15.81:0/3569304893 learned_addr learned my addr 172.21.15.81:0/3569304893 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f45337fe700 1 --2- 172.21.15.81:0/3569304893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 0x55e0c5e663d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4532ffd700 1 --2- 172.21.15.81:0/3569304893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6be80 0x55e0c5e76ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4533fff700 1 -- 172.21.15.81:0/3569304893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 msgr2=0x55e0c5e663d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4533fff700 1 --2- 172.21.15.81:0/3569304893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 0x55e0c5e663d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4533fff700 1 -- 172.21.15.81:0/3569304893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6be80 msgr2=0x55e0c5e76ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4533fff700 1 --2- 172.21.15.81:0/3569304893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6be80 0x55e0c5e76ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4533fff700 1 -- 172.21.15.81:0/3569304893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0c5e5d560 con 0x55e0c5e6c7a0 2024-05-09T00:06:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4532ffd700 1 --2- 172.21.15.81:0/3569304893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6be80 0x55e0c5e76ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f4533fff700 1 --2- 172.21.15.81:0/3569304893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e60da0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f452c000f80 tx=0x7f452c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86d3640b254ee205 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f451a7fc700 1 -- 172.21.15.81:0/3569304893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c014d90 con 0x55e0c5e6c7a0 2024-05-09T00:06:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f451a7fc700 1 -- 172.21.15.81:0/3569304893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f452c014400 con 0x55e0c5e6c7a0 2024-05-09T00:06:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.690+0000 7f451a7fc700 1 -- 172.21.15.81:0/3569304893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c005500 con 0x55e0c5e6c7a0 2024-05-09T00:06:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.691+0000 7f4545e59b80 1 -- 172.21.15.81:0/3569304893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6c7a0 msgr2=0x55e0c5e60da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.691+0000 7f4545e59b80 1 --2- 172.21.15.81:0/3569304893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e60da0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f452c000f80 tx=0x7f452c009820 comp rx=0 tx=0).stop 2024-05-09T00:06:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.691+0000 7f4545e59b80 1 -- 172.21.15.81:0/3569304893 shutdown_connections 2024-05-09T00:06:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.691+0000 7f4545e59b80 1 --2- 172.21.15.81:0/3569304893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e60da0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.691+0000 7f4545e59b80 1 --2- 172.21.15.81:0/3569304893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 0x55e0c5e663d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.691+0000 7f4545e59b80 1 --2- 172.21.15.81:0/3569304893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6be80 0x55e0c5e76ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.691+0000 7f4545e59b80 1 -- 172.21.15.81:0/3569304893 >> 172.21.15.81:0/3569304893 conn(0x55e0c5dc4290 msgr2=0x55e0c5e6e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.691+0000 7f4545e59b80 1 -- 172.21.15.81:0/3569304893 shutdown_connections 2024-05-09T00:06:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.691+0000 7f4545e59b80 1 -- 172.21.15.81:0/3569304893 wait complete. 2024-05-09T00:06:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.691+0000 7f4545e59b80 1 -- start start 2024-05-09T00:06:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4545e59b80 1 Processor -- start 2024-05-09T00:06:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4545e59b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 0x55e0c5e7b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4545e59b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6be80 0x55e0c5e7b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4545e59b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e7bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4545e59b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5ed89b0 con 0x55e0c5e6be80 2024-05-09T00:06:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4545e59b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5ed8af0 con 0x55e0c5e6c7a0 2024-05-09T00:06:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4545e59b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0c5ed8cb0 con 0x55e0c5e66910 2024-05-09T00:06:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4545e59b80 10 client.0 _ll_register_callbacks cb 0x55e0c5d5bbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:23.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4532ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6be80 0x55e0c5e7b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4532ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6be80 0x55e0c5e7b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39942/0 (socket says 172.21.15.81:39942) 2024-05-09T00:06:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4532ffd700 1 -- 172.21.15.81:0/2429921515 learned_addr learned my addr 172.21.15.81:0/2429921515 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f45337fe700 1 --2- 172.21.15.81:0/2429921515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 0x55e0c5e7b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4533fff700 1 --2- 172.21.15.81:0/2429921515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e7bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4532ffd700 1 -- 172.21.15.81:0/2429921515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 msgr2=0x55e0c5e7b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4532ffd700 1 --2- 172.21.15.81:0/2429921515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 0x55e0c5e7b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4532ffd700 1 -- 172.21.15.81:0/2429921515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 msgr2=0x55e0c5e7bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4532ffd700 1 --2- 172.21.15.81:0/2429921515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e7bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4532ffd700 1 -- 172.21.15.81:0/2429921515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0c5c37430 con 0x55e0c5e6be80 2024-05-09T00:06:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4532ffd700 1 --2- 172.21.15.81:0/2429921515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6be80 0x55e0c5e7b5d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f452801f040 tx=0x7f4528005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49753c2e39e69ec server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4512ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.692+0000 7f4512ffd700 1 -- 172.21.15.81:0/2429921515 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452802b070 con 0x55e0c5e6be80 2024-05-09T00:06:23.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.693+0000 7f4512ffd700 1 -- 172.21.15.81:0/2429921515 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f452803d080 con 0x55e0c5e6be80 2024-05-09T00:06:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.693+0000 7f4545e59b80 1 -- 172.21.15.81:0/2429921515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f452c014a20 con 0x55e0c5e6be80 2024-05-09T00:06:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.693+0000 7f4512ffd700 1 -- 172.21.15.81:0/2429921515 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f452801d040 con 0x55e0c5e6be80 2024-05-09T00:06:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.693+0000 7f4545e59b80 10 client.16419 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.693+0000 7f4545e59b80 1 -- 172.21.15.81:0/2429921515 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e0c5d7c5e0 con 0x55e0c5e6be80 2024-05-09T00:06:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.693+0000 7f4512ffd700 1 -- 172.21.15.81:0/2429921515 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f452c014a20 con 0x55e0c5e6be80 2024-05-09T00:06:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.693+0000 7f4512ffd700 1 -- 172.21.15.81:0/2429921515 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f45280418f0 con 0x55e0c5e6be80 2024-05-09T00:06:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.693+0000 7f4545e59b80 10 client.16419 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.693+0000 7f4545e59b80 10 client.16419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.693+0000 7f4545e59b80 20 client.16419 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.693+0000 7f4545e59b80 1 --2- 172.21.15.81:0/2429921515 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0c5eda0f0 0x55e0c5edc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.693+0000 7f4545e59b80 4 client.16419 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:06:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.693+0000 7f4545e59b80 1 -- 172.21.15.81:0/2429921515 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55e0c5daef40 con 0x55e0c5eda0f0 2024-05-09T00:06:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.693+0000 7f45337fe700 1 --2- 172.21.15.81:0/2429921515 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0c5eda0f0 0x55e0c5edc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.694+0000 7f4512ffd700 10 client.16419 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.694+0000 7f45337fe700 1 --2- 172.21.15.81:0/2429921515 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0c5eda0f0 0x55e0c5edc510 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cd29e813bff8c28 server_cookie=d43f3a7ab53742c2 in_seq=0 out_seq=0 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4512ffd700 1 -- 172.21.15.81:0/2429921515 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e0c5daef40 con 0x55e0c5eda0f0 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4512ffd700 10 client.16419 handle_command_reply: tid=0 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4545e59b80 1 client.16419 shutdown 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4545e59b80 1 -- 172.21.15.81:0/2429921515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6be80 msgr2=0x55e0c5e7b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4545e59b80 1 --2- 172.21.15.81:0/2429921515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6be80 0x55e0c5e7b5d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f452801f040 tx=0x7f4528005d50 comp rx=0 tx=0).stop 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4545e59b80 1 -- 172.21.15.81:0/2429921515 shutdown_connections 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4545e59b80 1 --2- 172.21.15.81:0/2429921515 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e0c5eda0f0 0x55e0c5edc510 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4545e59b80 1 --2- 172.21.15.81:0/2429921515 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e0c5e6c7a0 0x55e0c5e7bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4545e59b80 1 --2- 172.21.15.81:0/2429921515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e0c5e66910 0x55e0c5e7b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4545e59b80 1 --2- 172.21.15.81:0/2429921515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e0c5e6be80 0x55e0c5e7b5d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4545e59b80 1 -- 172.21.15.81:0/2429921515 >> 172.21.15.81:0/2429921515 conn(0x55e0c5dc4290 msgr2=0x55e0c5e71d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4512ffd700 0 client.16419 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4545e59b80 1 -- 172.21.15.81:0/2429921515 shutdown_connections 2024-05-09T00:06:23.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4545e59b80 1 -- 172.21.15.81:0/2429921515 wait complete. 2024-05-09T00:06:23.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.695+0000 7f4545e59b80 20 client.16419 trim_cache size 0 max 16384 2024-05-09T00:06:23.697 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:06:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:06:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "8d297caf-abc0-4b04-a6aa-a61886a4161d", 2024-05-09T00:06:23.697 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:06:23.697 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:06:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.696+0000 7f4539c9f700 1 -- 172.21.15.81:0/3310694581 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f451c0a1290 msgr2=0x7f451c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.696+0000 7f4539c9f700 1 --2- 172.21.15.81:0/3310694581 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f451c0a1290 0x7f451c0a3750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f452800b5c0 tx=0x7f4528005fb0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.696+0000 7f4539c9f700 1 -- 172.21.15.81:0/3310694581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4534100060 msgr2=0x7f45341962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.696+0000 7f4539c9f700 1 --2- 172.21.15.81:0/3310694581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4534100060 0x7f45341962d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f452400c9b0 tx=0x7f452400cd70 comp rx=0 tx=0).stop 2024-05-09T00:06:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.696+0000 7f4539c9f700 1 -- 172.21.15.81:0/3310694581 shutdown_connections 2024-05-09T00:06:23.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.696+0000 7f4539c9f700 1 --2- 172.21.15.81:0/3310694581 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f451c0a1290 0x7f451c0a3750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.696+0000 7f4539c9f700 1 --2- 172.21.15.81:0/3310694581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f453419ab60 0x7f453419afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.696+0000 7f4539c9f700 1 --2- 172.21.15.81:0/3310694581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4534100060 0x7f45341962d0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.696+0000 7f4539c9f700 1 --2- 172.21.15.81:0/3310694581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4534105180 0x7f4534196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.696+0000 7f4539c9f700 1 -- 172.21.15.81:0/3310694581 >> 172.21.15.81:0/3310694581 conn(0x7f4534076f40 msgr2=0x7f45340ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.696+0000 7f4539c9f700 1 -- 172.21.15.81:0/3310694581 shutdown_connections 2024-05-09T00:06:23.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.696+0000 7f4539c9f700 1 -- 172.21.15.81:0/3310694581 wait complete. 2024-05-09T00:06:23.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:06:23.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.832+0000 7fb1b17d3700 1 -- 172.21.15.81:0/1111913896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac100a10 msgr2=0x7fb1ac104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.832+0000 7fb1b17d3700 1 --2- 172.21.15.81:0/1111913896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac100a10 0x7fb1ac104a30 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009990 tx=0x7fb19c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.832+0000 7fb1b17d3700 1 -- 172.21.15.81:0/1111913896 shutdown_connections 2024-05-09T00:06:23.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.832+0000 7fb1b17d3700 1 --2- 172.21.15.81:0/1111913896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1ac100060 0x7fb1ac100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.832+0000 7fb1b17d3700 1 --2- 172.21.15.81:0/1111913896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac105160 0x7fb1ac10cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.832+0000 7fb1b17d3700 1 --2- 172.21.15.81:0/1111913896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac100a10 0x7fb1ac104a30 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.832+0000 7fb1b17d3700 1 -- 172.21.15.81:0/1111913896 >> 172.21.15.81:0/1111913896 conn(0x7fb1ac076f40 msgr2=0x7fb1ac077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:23.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.832+0000 7fb1b17d3700 1 -- 172.21.15.81:0/1111913896 shutdown_connections 2024-05-09T00:06:23.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.832+0000 7fb1b17d3700 1 -- 172.21.15.81:0/1111913896 wait complete. 2024-05-09T00:06:23.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.832+0000 7fb1b17d3700 1 Processor -- start 2024-05-09T00:06:23.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1b17d3700 1 -- start start 2024-05-09T00:06:23.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1b17d3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1ac100060 0x7fb1ac199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1b17d3700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac105160 0x7fb1ac199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1b17d3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac19df00 0x7fb1ac19e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1b17d3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac19e980 con 0x7fb1ac19df00 2024-05-09T00:06:23.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1b17d3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac19eaf0 con 0x7fb1ac100060 2024-05-09T00:06:23.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1b17d3700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac19ecb0 con 0x7fb1ac105160 2024-05-09T00:06:23.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac19df00 0x7fb1ac19e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac19df00 0x7fb1ac19e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39948/0 (socket says 172.21.15.81:39948) 2024-05-09T00:06:23.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1ab7fe700 1 -- 172.21.15.81:0/2949351258 learned_addr learned my addr 172.21.15.81:0/2949351258 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:23.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1ac100060 0x7fb1ac199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1aa7fc700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac105160 0x7fb1ac199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1ab7fe700 1 -- 172.21.15.81:0/2949351258 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac105160 msgr2=0x7fb1ac199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1ab7fe700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac105160 0x7fb1ac199b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1ab7fe700 1 -- 172.21.15.81:0/2949351258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1ac100060 msgr2=0x7fb1ac199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1ab7fe700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1ac100060 0x7fb1ac199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1ab7fe700 1 -- 172.21.15.81:0/2949351258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c0095f0 con 0x7fb1ac19df00 2024-05-09T00:06:23.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1aa7fc700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac105160 0x7fb1ac199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:23.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1ac100060 0x7fb1ac199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:23.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.833+0000 7fb1ab7fe700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac19df00 0x7fb1ac19e380 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4007ee0 tx=0x7fb1a400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:23.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.834+0000 7fb193fff700 1 -- 172.21.15.81:0/2949351258 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4017070 con 0x7fb1ac19df00 2024-05-09T00:06:23.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.834+0000 7fb193fff700 1 -- 172.21.15.81:0/2949351258 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1a400f040 con 0x7fb1ac19df00 2024-05-09T00:06:23.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.834+0000 7fb1b17d3700 1 -- 172.21.15.81:0/2949351258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac1a6210 con 0x7fb1ac19df00 2024-05-09T00:06:23.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.834+0000 7fb193fff700 1 -- 172.21.15.81:0/2949351258 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4005740 con 0x7fb1ac19df00 2024-05-09T00:06:23.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.834+0000 7fb1b17d3700 1 -- 172.21.15.81:0/2949351258 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac1a66a0 con 0x7fb1ac19df00 2024-05-09T00:06:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.836+0000 7fb193fff700 1 -- 172.21.15.81:0/2949351258 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fb1a40058a0 con 0x7fb1ac19df00 2024-05-09T00:06:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.836+0000 7fb193fff700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1940a1290 0x7fb1940a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.836+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1940a1290 0x7fb1940a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.836+0000 7fb193fff700 1 -- 172.21.15.81:0/2949351258 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb1a40cc510 con 0x7fb1ac19df00 2024-05-09T00:06:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.837+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1940a1290 0x7fb1940a3750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009cb0 tx=0x7fb1a0009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.837+0000 7fb1bd98db80 1 Processor -- start 2024-05-09T00:06:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.837+0000 7fb1bd98db80 1 -- start start 2024-05-09T00:06:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.837+0000 7fb1bd98db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352fe00 0x5653535301e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.837+0000 7fb1bd98db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565353530720 0x56535352a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.837+0000 7fb1bd98db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352a890 0x56535352acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.837+0000 7fb1bd98db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565353481150 con 0x56535352a890 2024-05-09T00:06:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.837+0000 7fb1bd98db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535347eb10 con 0x56535352fe00 2024-05-09T00:06:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.837+0000 7fb1bd98db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535347a400 con 0x565353530720 2024-05-09T00:06:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.837+0000 7fb1ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352a890 0x56535352acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.837+0000 7fb1ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352a890 0x56535352acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39956/0 (socket says 172.21.15.81:39956) 2024-05-09T00:06:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.837+0000 7fb1ab7fe700 1 -- 172.21.15.81:0/1394083699 learned_addr learned my addr 172.21.15.81:0/1394083699 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.838+0000 7fb1aa7fc700 1 --2- 172.21.15.81:0/1394083699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565353530720 0x56535352a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.838+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/1394083699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352fe00 0x5653535301e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.838+0000 7fb1ab7fe700 1 -- 172.21.15.81:0/1394083699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565353530720 msgr2=0x56535352a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.838+0000 7fb1ab7fe700 1 --2- 172.21.15.81:0/1394083699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565353530720 0x56535352a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.838+0000 7fb1ab7fe700 1 -- 172.21.15.81:0/1394083699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352fe00 msgr2=0x5653535301e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.838+0000 7fb1ab7fe700 1 --2- 172.21.15.81:0/1394083699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352fe00 0x5653535301e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.838+0000 7fb1ab7fe700 1 -- 172.21.15.81:0/1394083699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653532fb3b0 con 0x56535352a890 2024-05-09T00:06:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.838+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/1394083699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352fe00 0x5653535301e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.838+0000 7fb1ab7fe700 1 --2- 172.21.15.81:0/1394083699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352a890 0x56535352acd0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40a1570 tx=0x7fb1a4095a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a39d9c6ef3f4d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.838+0000 7fb1917fa700 1 -- 172.21.15.81:0/1394083699 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a40b90d0 con 0x56535352a890 2024-05-09T00:06:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.838+0000 7fb1917fa700 1 -- 172.21.15.81:0/1394083699 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1a4099620 con 0x56535352a890 2024-05-09T00:06:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.838+0000 7fb1917fa700 1 -- 172.21.15.81:0/1394083699 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400de10 con 0x56535352a890 2024-05-09T00:06:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 -- 172.21.15.81:0/1394083699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352a890 msgr2=0x56535352acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/1394083699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352a890 0x56535352acd0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40a1570 tx=0x7fb1a4095a90 comp rx=0 tx=0).stop 2024-05-09T00:06:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 -- 172.21.15.81:0/1394083699 shutdown_connections 2024-05-09T00:06:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/1394083699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352fe00 0x5653535301e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/1394083699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352a890 0x56535352acd0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/1394083699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565353530720 0x56535352a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 -- 172.21.15.81:0/1394083699 >> 172.21.15.81:0/1394083699 conn(0x565353488210 msgr2=0x565353524df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:23.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 -- 172.21.15.81:0/1394083699 shutdown_connections 2024-05-09T00:06:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 -- 172.21.15.81:0/1394083699 wait complete. 2024-05-09T00:06:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 -- start start 2024-05-09T00:06:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 Processor -- start 2024-05-09T00:06:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56535352a890 0x565353533a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352fe00 0x565353533fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565353530720 0x565353534510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565353416560 con 0x56535352fe00 2024-05-09T00:06:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x565353416200 con 0x565353530720 2024-05-09T00:06:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653532fd6a0 con 0x56535352a890 2024-05-09T00:06:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1bd98db80 10 client.0 _ll_register_callbacks cb 0x56535341fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.839+0000 7fb1aa7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352fe00 0x565353533fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb1aa7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352fe00 0x565353533fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39958/0 (socket says 172.21.15.81:39958) 2024-05-09T00:06:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb1aa7fc700 1 -- 172.21.15.81:0/2085774014 learned_addr learned my addr 172.21.15.81:0/2085774014 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb1ab7fe700 1 --2- 172.21.15.81:0/2085774014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565353530720 0x565353534510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/2085774014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56535352a890 0x565353533a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb1aa7fc700 1 -- 172.21.15.81:0/2085774014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56535352a890 msgr2=0x565353533a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb1aa7fc700 1 --2- 172.21.15.81:0/2085774014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56535352a890 0x565353533a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb1aa7fc700 1 -- 172.21.15.81:0/2085774014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565353530720 msgr2=0x565353534510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb1aa7fc700 1 --2- 172.21.15.81:0/2085774014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565353530720 0x565353534510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb1aa7fc700 1 -- 172.21.15.81:0/2085774014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac1a66a0 con 0x56535352fe00 2024-05-09T00:06:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb1aa7fc700 1 --2- 172.21.15.81:0/2085774014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352fe00 0x565353533fd0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009990 tx=0x7fb19c005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a3f6a2349ad8af server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb18eff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb18eff5700 1 -- 172.21.15.81:0/2085774014 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c020040 con 0x56535352fe00 2024-05-09T00:06:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb18eff5700 1 -- 172.21.15.81:0/2085774014 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb19c004500 con 0x56535352fe00 2024-05-09T00:06:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb1bd98db80 1 -- 172.21.15.81:0/2085774014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5653533d3270 con 0x56535352fe00 2024-05-09T00:06:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb18eff5700 1 -- 172.21.15.81:0/2085774014 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb19c00bee0 con 0x56535352fe00 2024-05-09T00:06:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb1bd98db80 10 client.16431 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb1bd98db80 1 -- 172.21.15.81:0/2085774014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5653532a7b60 con 0x56535352fe00 2024-05-09T00:06:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.840+0000 7fb18eff5700 1 -- 172.21.15.81:0/2085774014 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb19c031020 con 0x56535352fe00 2024-05-09T00:06:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.841+0000 7fb18eff5700 1 -- 172.21.15.81:0/2085774014 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb19c00f5b0 con 0x56535352fe00 2024-05-09T00:06:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.841+0000 7fb1bd98db80 10 client.16431 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.841+0000 7fb1bd98db80 10 client.16431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.841+0000 7fb1bd98db80 20 client.16431 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.841+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/2085774014 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5653535441a0 0x5653535465c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.841+0000 7fb1bd98db80 4 client.16431 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.841+0000 7fb1bd98db80 1 -- 172.21.15.81:0/2085774014 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653534f9810 con 0x5653535441a0 2024-05-09T00:06:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.841+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/2085774014 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5653535441a0 0x5653535465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.841+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/2085774014 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5653535441a0 0x5653535465c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b678ca548e86aa3 server_cookie=96c6935eb2d29caa in_seq=0 out_seq=0 2024-05-09T00:06:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.841+0000 7fb18eff5700 10 client.16431 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb18eff5700 1 -- 172.21.15.81:0/2085774014 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5653534f9810 con 0x5653535441a0 2024-05-09T00:06:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb18eff5700 10 client.16431 handle_command_reply: tid=0 2024-05-09T00:06:23.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb1bd98db80 1 client.16431 shutdown 2024-05-09T00:06:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb1bd98db80 1 -- 172.21.15.81:0/2085774014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352fe00 msgr2=0x565353533fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/2085774014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352fe00 0x565353533fd0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009990 tx=0x7fb19c005720 comp rx=0 tx=0).stop 2024-05-09T00:06:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb1bd98db80 1 -- 172.21.15.81:0/2085774014 shutdown_connections 2024-05-09T00:06:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/2085774014 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5653535441a0 0x5653535465c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/2085774014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565353530720 0x565353534510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/2085774014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56535352a890 0x565353533a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb18eff5700 0 client.16431 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/2085774014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352fe00 0x565353533fd0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb1bd98db80 1 -- 172.21.15.81:0/2085774014 >> 172.21.15.81:0/2085774014 conn(0x565353488210 msgr2=0x5653535245a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb1bd98db80 1 -- 172.21.15.81:0/2085774014 shutdown_connections 2024-05-09T00:06:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb1bd98db80 1 -- 172.21.15.81:0/2085774014 wait complete. 2024-05-09T00:06:23.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.842+0000 7fb1bd98db80 20 client.16431 trim_cache size 0 max 16384 2024-05-09T00:06:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.859+0000 7fb1bd98db80 1 Processor -- start 2024-05-09T00:06:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.859+0000 7fb1bd98db80 1 -- start start 2024-05-09T00:06:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1bd98db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352a890 0x56535352a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1bd98db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352fe00 0x56535352f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1bd98db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565353530720 0x565353524d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1bd98db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565353521e30 con 0x56535352a890 2024-05-09T00:06:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1bd98db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535354b7c0 con 0x56535352fe00 2024-05-09T00:06:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1bd98db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535351f830 con 0x565353530720 2024-05-09T00:06:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1aaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352a890 0x56535352a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1aaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352a890 0x56535352a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39960/0 (socket says 172.21.15.81:39960) 2024-05-09T00:06:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1aaffd700 1 -- 172.21.15.81:0/732003767 learned_addr learned my addr 172.21.15.81:0/732003767 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1ab7fe700 1 --2- 172.21.15.81:0/732003767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565353530720 0x565353524d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1aaffd700 1 -- 172.21.15.81:0/732003767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565353530720 msgr2=0x565353524d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/732003767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565353530720 0x565353524d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1aaffd700 1 -- 172.21.15.81:0/732003767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352fe00 msgr2=0x56535352f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1aa7fc700 1 --2- 172.21.15.81:0/732003767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352fe00 0x56535352f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/732003767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352fe00 0x56535352f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1aaffd700 1 -- 172.21.15.81:0/732003767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565353440560 con 0x56535352a890 2024-05-09T00:06:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1aa7fc700 1 --2- 172.21.15.81:0/732003767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352fe00 0x56535352f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/732003767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352a890 0x56535352a350 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x565353546e60 tx=0x7fb1a0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecece311b4c0499 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb191ffb700 1 -- 172.21.15.81:0/732003767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0028070 con 0x56535352a890 2024-05-09T00:06:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb191ffb700 1 -- 172.21.15.81:0/732003767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1a0004440 con 0x56535352a890 2024-05-09T00:06:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.860+0000 7fb191ffb700 1 -- 172.21.15.81:0/732003767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0028860 con 0x56535352a890 2024-05-09T00:06:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.861+0000 7fb1bd98db80 1 -- 172.21.15.81:0/732003767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352a890 msgr2=0x56535352a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.861+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/732003767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352a890 0x56535352a350 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x565353546e60 tx=0x7fb1a0014000 comp rx=0 tx=0).stop 2024-05-09T00:06:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.861+0000 7fb1bd98db80 1 -- 172.21.15.81:0/732003767 shutdown_connections 2024-05-09T00:06:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.861+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/732003767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565353530720 0x565353524d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.861+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/732003767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56535352a890 0x56535352a350 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.861+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/732003767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352fe00 0x56535352f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.861+0000 7fb1bd98db80 1 -- 172.21.15.81:0/732003767 >> 172.21.15.81:0/732003767 conn(0x565353488210 msgr2=0x56535352eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.861+0000 7fb1bd98db80 1 -- 172.21.15.81:0/732003767 shutdown_connections 2024-05-09T00:06:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.861+0000 7fb1bd98db80 1 -- 172.21.15.81:0/732003767 wait complete. 2024-05-09T00:06:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.861+0000 7fb1bd98db80 1 -- start start 2024-05-09T00:06:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.861+0000 7fb1bd98db80 1 Processor -- start 2024-05-09T00:06:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.861+0000 7fb1bd98db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352a890 0x56535353b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.861+0000 7fb1bd98db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56535352fe00 0x56535353b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.861+0000 7fb1bd98db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565353530720 0x56535352bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1bd98db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535352c4e0 con 0x565353530720 2024-05-09T00:06:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1bd98db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535352c650 con 0x56535352a890 2024-05-09T00:06:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1bd98db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56535352c810 con 0x56535352fe00 2024-05-09T00:06:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1bd98db80 10 client.0 _ll_register_callbacks cb 0x56535341fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565353530720 0x56535352bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1ab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565353530720 0x56535352bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39966/0 (socket says 172.21.15.81:39966) 2024-05-09T00:06:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1ab7fe700 1 -- 172.21.15.81:0/3556146618 learned_addr learned my addr 172.21.15.81:0/3556146618 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1aa7fc700 1 --2- 172.21.15.81:0/3556146618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56535352fe00 0x56535353b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/3556146618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352a890 0x56535353b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1ab7fe700 1 -- 172.21.15.81:0/3556146618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56535352fe00 msgr2=0x56535353b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1ab7fe700 1 --2- 172.21.15.81:0/3556146618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56535352fe00 0x56535353b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1ab7fe700 1 -- 172.21.15.81:0/3556146618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352a890 msgr2=0x56535353b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1ab7fe700 1 --2- 172.21.15.81:0/3556146618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352a890 0x56535353b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1ab7fe700 1 -- 172.21.15.81:0/3556146618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a0028b00 con 0x565353530720 2024-05-09T00:06:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1ab7fe700 1 --2- 172.21.15.81:0/3556146618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565353530720 0x56535352bdd0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400dfd0 tx=0x7fb1a4099050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c53f9f84930da74 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb18eff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb18eff5700 1 -- 172.21.15.81:0/3556146618 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a409d450 con 0x565353530720 2024-05-09T00:06:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb18eff5700 1 -- 172.21.15.81:0/3556146618 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb1a400dbd0 con 0x565353530720 2024-05-09T00:06:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1bd98db80 1 -- 172.21.15.81:0/3556146618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1a4099620 con 0x565353530720 2024-05-09T00:06:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb18eff5700 1 -- 172.21.15.81:0/3556146618 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1a400dd90 con 0x565353530720 2024-05-09T00:06:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1bd98db80 10 client.16437 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb1bd98db80 1 -- 172.21.15.81:0/3556146618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5653532ffcd0 con 0x565353530720 2024-05-09T00:06:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.862+0000 7fb18eff5700 1 -- 172.21.15.81:0/3556146618 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1a4099620 con 0x565353530720 2024-05-09T00:06:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.863+0000 7fb18eff5700 1 -- 172.21.15.81:0/3556146618 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb1a4098b10 con 0x565353530720 2024-05-09T00:06:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.863+0000 7fb1bd98db80 10 client.16437 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.863+0000 7fb1bd98db80 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.863+0000 7fb1bd98db80 20 client.16437 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.863+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/3556146618 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56535359b4c0 0x56535359d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.863+0000 7fb1bd98db80 4 client.16437 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:06:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.863+0000 7fb1bd98db80 1 -- 172.21.15.81:0/3556146618 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x565353472ec0 con 0x56535359b4c0 2024-05-09T00:06:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.863+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/3556146618 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56535359b4c0 0x56535359d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.863+0000 7fb18eff5700 10 client.16437 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.863+0000 7fb1aaffd700 1 --2- 172.21.15.81:0/3556146618 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56535359b4c0 0x56535359d8e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81d83df3b037d39e server_cookie=b6afe684d1d17a07 in_seq=0 out_seq=0 2024-05-09T00:06:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb18eff5700 1 -- 172.21.15.81:0/3556146618 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x565353472ec0 con 0x56535359b4c0 2024-05-09T00:06:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb18eff5700 10 client.16437 handle_command_reply: tid=0 2024-05-09T00:06:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1bd98db80 1 client.16437 shutdown 2024-05-09T00:06:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1bd98db80 1 -- 172.21.15.81:0/3556146618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565353530720 msgr2=0x56535352bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/3556146618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565353530720 0x56535352bdd0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400dfd0 tx=0x7fb1a4099050 comp rx=0 tx=0).stop 2024-05-09T00:06:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1bd98db80 1 -- 172.21.15.81:0/3556146618 shutdown_connections 2024-05-09T00:06:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/3556146618 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56535359b4c0 0x56535359d8e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/3556146618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56535352a890 0x56535353b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/3556146618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565353530720 0x56535352bdd0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1bd98db80 1 --2- 172.21.15.81:0/3556146618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56535352fe00 0x56535353b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb18eff5700 0 client.16437 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1bd98db80 1 -- 172.21.15.81:0/3556146618 >> 172.21.15.81:0/3556146618 conn(0x565353488210 msgr2=0x56535352eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1bd98db80 1 -- 172.21.15.81:0/3556146618 shutdown_connections 2024-05-09T00:06:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1bd98db80 1 -- 172.21.15.81:0/3556146618 wait complete. 2024-05-09T00:06:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1bd98db80 20 client.16437 trim_cache size 0 max 16384 2024-05-09T00:06:23.866 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:06:23.866 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:06:23.866 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:06:23.866 INFO:teuthology.orchestra.run.smithi081.stdout: "8d297caf-abc0-4b04-a6aa-a61886a4161d": { 2024-05-09T00:06:23.866 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:06:23.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "8d297caf-abc0-4b04-a6aa-a61886a4161d", 2024-05-09T00:06:23.867 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:06:23.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:06:23.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:06:23.867 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:06:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1b17d3700 1 -- 172.21.15.81:0/2949351258 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1940a1290 msgr2=0x7fb1940a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1b17d3700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1940a1290 0x7fb1940a3750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009cb0 tx=0x7fb1a0009260 comp rx=0 tx=0).stop 2024-05-09T00:06:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1b17d3700 1 -- 172.21.15.81:0/2949351258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac19df00 msgr2=0x7fb1ac19e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1b17d3700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac19df00 0x7fb1ac19e380 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4007ee0 tx=0x7fb1a400d3b0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1b17d3700 1 -- 172.21.15.81:0/2949351258 shutdown_connections 2024-05-09T00:06:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1b17d3700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1940a1290 0x7fb1940a3750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1b17d3700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1ac100060 0x7fb1ac199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1b17d3700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1ac19df00 0x7fb1ac19e380 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1b17d3700 1 --2- 172.21.15.81:0/2949351258 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac105160 0x7fb1ac199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1b17d3700 1 -- 172.21.15.81:0/2949351258 >> 172.21.15.81:0/2949351258 conn(0x7fb1ac076f40 msgr2=0x7fb1ac0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:23.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1b17d3700 1 -- 172.21.15.81:0/2949351258 shutdown_connections 2024-05-09T00:06:23.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:23.864+0000 7fb1b17d3700 1 -- 172.21.15.81:0/2949351258 wait complete. 2024-05-09T00:06:23.873 INFO:tasks.cephfs.filesystem:scrub status for tag:8d297caf-abc0-4b04-a6aa-a61886a4161d - {'path': '/', 'tag': '8d297caf-abc0-4b04-a6aa-a61886a4161d', 'options': 'recursive,force'} 2024-05-09T00:06:24.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:24 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:06:24.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:24 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:06:24.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:24 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:06:24.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:24 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:06:24.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:24 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:06:25.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:24 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:06:25.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:24 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:06:25.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:24 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:06:25.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:24 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:06:25.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:24 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:06:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:24 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:06:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:24 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:06:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:24 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:06:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:24 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:06:25.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:24 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:06:25.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:25 smithi081 ceph-mon[42474]: pgmap v107: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 37 KiB/s wr, 18 op/s 2024-05-09T00:06:26.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:25 smithi150 ceph-mon[46187]: pgmap v107: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 37 KiB/s wr, 18 op/s 2024-05-09T00:06:26.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:25 smithi171 ceph-mon[47351]: pgmap v107: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 37 KiB/s wr, 18 op/s 2024-05-09T00:06:27.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:27 smithi150 ceph-mon[46187]: pgmap v108: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-05-09T00:06:27.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:27 smithi171 ceph-mon[47351]: pgmap v108: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-05-09T00:06:27.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:27 smithi081 ceph-mon[42474]: pgmap v108: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-05-09T00:06:29.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:29 smithi150 ceph-mon[46187]: pgmap v109: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-05-09T00:06:29.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:29 smithi171 ceph-mon[47351]: pgmap v109: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-05-09T00:06:29.342 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.345+0000 7f66cdabc700 1 -- 172.21.15.81:0/1008332943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c8100ee0 msgr2=0x7f66c810cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:29.342 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.345+0000 7f66cdabc700 1 --2- 172.21.15.81:0/1008332943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c8100ee0 0x7f66c810cbf0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f66c000b0a0 tx=0x7f66c000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.342 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.345+0000 7f66cdabc700 1 -- 172.21.15.81:0/1008332943 shutdown_connections 2024-05-09T00:06:29.342 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.345+0000 7f66cdabc700 1 --2- 172.21.15.81:0/1008332943 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c8104d80 0x7f66c8105160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.342 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.345+0000 7f66cdabc700 1 --2- 172.21.15.81:0/1008332943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c8100ee0 0x7f66c810cbf0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.342 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.345+0000 7f66cdabc700 1 --2- 172.21.15.81:0/1008332943 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66c8100520 0x7f66c81009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.342 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.345+0000 7f66cdabc700 1 -- 172.21.15.81:0/1008332943 >> 172.21.15.81:0/1008332943 conn(0x7f66c80763a0 msgr2=0x7f66c80fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:29.342 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.345+0000 7f66cdabc700 1 -- 172.21.15.81:0/1008332943 shutdown_connections 2024-05-09T00:06:29.342 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.345+0000 7f66cdabc700 1 -- 172.21.15.81:0/1008332943 wait complete. 2024-05-09T00:06:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.346+0000 7f66cdabc700 1 Processor -- start 2024-05-09T00:06:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.346+0000 7f66cdabc700 1 -- start start 2024-05-09T00:06:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.346+0000 7f66cdabc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66c8100520 0x7f66c81982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.346+0000 7f66cdabc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c8100ee0 0x7f66c8198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.346+0000 7f66cdabc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c8104d80 0x7f66c81a3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.346+0000 7f66cdabc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81990d0 con 0x7f66c8104d80 2024-05-09T00:06:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.346+0000 7f66cdabc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81a3890 con 0x7f66c8100ee0 2024-05-09T00:06:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.346+0000 7f66cdabc700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c81a39d0 con 0x7f66c8100520 2024-05-09T00:06:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.346+0000 7f66c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c8104d80 0x7f66c81a3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.346+0000 7f66c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c8104d80 0x7f66c81a3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37530/0 (socket says 172.21.15.81:37530) 2024-05-09T00:06:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.346+0000 7f66c7fff700 1 -- 172.21.15.81:0/2117727726 learned_addr learned my addr 172.21.15.81:0/2117727726 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.346+0000 7f66c77fe700 1 --2- 172.21.15.81:0/2117727726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66c8100520 0x7f66c81982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.347+0000 7f66c6ffd700 1 --2- 172.21.15.81:0/2117727726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c8100ee0 0x7f66c8198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.347+0000 7f66c7fff700 1 -- 172.21.15.81:0/2117727726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66c8100520 msgr2=0x7f66c81982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:29.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.347+0000 7f66c7fff700 1 --2- 172.21.15.81:0/2117727726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66c8100520 0x7f66c81982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.347+0000 7f66c7fff700 1 -- 172.21.15.81:0/2117727726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c8100ee0 msgr2=0x7f66c8198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:29.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.347+0000 7f66c7fff700 1 --2- 172.21.15.81:0/2117727726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c8100ee0 0x7f66c8198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.347+0000 7f66c7fff700 1 -- 172.21.15.81:0/2117727726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c0009d00 con 0x7f66c8104d80 2024-05-09T00:06:29.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.347+0000 7f66c7fff700 1 --2- 172.21.15.81:0/2117727726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c8104d80 0x7f66c81a3350 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f66c000b070 tx=0x7f66c0004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:29.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.347+0000 7f66c4ff9700 1 -- 172.21.15.81:0/2117727726 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c000e040 con 0x7f66c8104d80 2024-05-09T00:06:29.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.347+0000 7f66c4ff9700 1 -- 172.21.15.81:0/2117727726 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66c0009440 con 0x7f66c8104d80 2024-05-09T00:06:29.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.347+0000 7f66cdabc700 1 -- 172.21.15.81:0/2117727726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c81a3bf0 con 0x7f66c8104d80 2024-05-09T00:06:29.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.347+0000 7f66c4ff9700 1 -- 172.21.15.81:0/2117727726 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c001b450 con 0x7f66c8104d80 2024-05-09T00:06:29.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.347+0000 7f66cdabc700 1 -- 172.21.15.81:0/2117727726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c81a4070 con 0x7f66c8104d80 2024-05-09T00:06:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.349+0000 7f66c4ff9700 1 -- 172.21.15.81:0/2117727726 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f66c001d480 con 0x7f66c8104d80 2024-05-09T00:06:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.350+0000 7f66c4ff9700 1 --2- 172.21.15.81:0/2117727726 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f66b00a1290 0x7f66b00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.350+0000 7f66c77fe700 1 --2- 172.21.15.81:0/2117727726 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f66b00a1290 0x7f66b00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.350+0000 7f66c4ff9700 1 -- 172.21.15.81:0/2117727726 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f66c00ce1f0 con 0x7f66c8104d80 2024-05-09T00:06:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.350+0000 7f66c77fe700 1 --2- 172.21.15.81:0/2117727726 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f66b00a1290 0x7f66b00a3750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f66bc005950 tx=0x7f66bc00b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66d9c76b80 1 Processor -- start 2024-05-09T00:06:29.351 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66d9c76b80 1 -- start start 2024-05-09T00:06:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66d9c76b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d0950 0x555c950d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66d9c76b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d1270 0x555c950caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66d9c76b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950cb480 0x555c950cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66d9c76b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c950220f0 con 0x555c950d0950 2024-05-09T00:06:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66d9c76b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9501fab0 con 0x555c950cb480 2024-05-09T00:06:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66d9c76b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c9501b3a0 con 0x555c950d1270 2024-05-09T00:06:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d0950 0x555c950d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d0950 0x555c950d0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37544/0 (socket says 172.21.15.81:37544) 2024-05-09T00:06:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66c77fe700 1 -- 172.21.15.81:0/1081744570 learned_addr learned my addr 172.21.15.81:0/1081744570 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66c7fff700 1 --2- 172.21.15.81:0/1081744570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950cb480 0x555c950cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66c6ffd700 1 --2- 172.21.15.81:0/1081744570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d1270 0x555c950caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66c77fe700 1 -- 172.21.15.81:0/1081744570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d1270 msgr2=0x555c950caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66c77fe700 1 --2- 172.21.15.81:0/1081744570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d1270 0x555c950caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66c77fe700 1 -- 172.21.15.81:0/1081744570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950cb480 msgr2=0x555c950cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66c77fe700 1 --2- 172.21.15.81:0/1081744570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950cb480 0x555c950cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.351+0000 7f66c77fe700 1 -- 172.21.15.81:0/1081744570 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c94e9c350 con 0x555c950d0950 2024-05-09T00:06:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.352+0000 7f66c77fe700 1 --2- 172.21.15.81:0/1081744570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d0950 0x555c950d0d30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f66bc010fa0 tx=0x7f66bc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186c6ddc8b8ff1f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.352+0000 7f66adffb700 1 -- 172.21.15.81:0/1081744570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc01e620 con 0x555c950d0950 2024-05-09T00:06:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.352+0000 7f66adffb700 1 -- 172.21.15.81:0/1081744570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66bc015070 con 0x555c950d0950 2024-05-09T00:06:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.352+0000 7f66adffb700 1 -- 172.21.15.81:0/1081744570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc01c9e0 con 0x555c950d0950 2024-05-09T00:06:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.352+0000 7f66d9c76b80 1 -- 172.21.15.81:0/1081744570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d0950 msgr2=0x555c950d0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.352+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/1081744570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d0950 0x555c950d0d30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f66bc010fa0 tx=0x7f66bc013000 comp rx=0 tx=0).stop 2024-05-09T00:06:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.352+0000 7f66d9c76b80 1 -- 172.21.15.81:0/1081744570 shutdown_connections 2024-05-09T00:06:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.352+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/1081744570 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950cb480 0x555c950cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.352+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/1081744570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d0950 0x555c950d0d30 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.352+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/1081744570 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d1270 0x555c950caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.352+0000 7f66d9c76b80 1 -- 172.21.15.81:0/1081744570 >> 172.21.15.81:0/1081744570 conn(0x555c950291b0 msgr2=0x555c950c5840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.352+0000 7f66d9c76b80 1 -- 172.21.15.81:0/1081744570 shutdown_connections 2024-05-09T00:06:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.352+0000 7f66d9c76b80 1 -- 172.21.15.81:0/1081744570 wait complete. 2024-05-09T00:06:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.353+0000 7f66d9c76b80 1 -- start start 2024-05-09T00:06:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.353+0000 7f66d9c76b80 1 Processor -- start 2024-05-09T00:06:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.353+0000 7f66d9c76b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950cb480 0x555c950d71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.353+0000 7f66d9c76b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950d0950 0x555c950d44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.353+0000 7f66d9c76b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d1270 0x555c950d4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.353+0000 7f66d9c76b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c94fb7500 con 0x555c950cb480 2024-05-09T00:06:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.353+0000 7f66d9c76b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c94fb71a0 con 0x555c950d0950 2024-05-09T00:06:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.353+0000 7f66d9c76b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c94e9e640 con 0x555c950d1270 2024-05-09T00:06:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.353+0000 7f66d9c76b80 10 client.0 _ll_register_callbacks cb 0x555c94fc0ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.353+0000 7f66c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950cb480 0x555c950d71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.353+0000 7f66c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950cb480 0x555c950d71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37546/0 (socket says 172.21.15.81:37546) 2024-05-09T00:06:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.353+0000 7f66c77fe700 1 -- 172.21.15.81:0/173434449 learned_addr learned my addr 172.21.15.81:0/173434449 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66c7fff700 1 --2- 172.21.15.81:0/173434449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d1270 0x555c950d4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66c6ffd700 1 --2- 172.21.15.81:0/173434449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950d0950 0x555c950d44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66c77fe700 1 -- 172.21.15.81:0/173434449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d1270 msgr2=0x555c950d4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66c77fe700 1 --2- 172.21.15.81:0/173434449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d1270 0x555c950d4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66c77fe700 1 -- 172.21.15.81:0/173434449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950d0950 msgr2=0x555c950d44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66c77fe700 1 --2- 172.21.15.81:0/173434449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950d0950 0x555c950d44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66c77fe700 1 -- 172.21.15.81:0/173434449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66bc010c50 con 0x555c950cb480 2024-05-09T00:06:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66c77fe700 1 --2- 172.21.15.81:0/173434449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950cb480 0x555c950d71b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f66bc01ee70 tx=0x7f66bc005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b753f844f7d923 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66a6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66a6ffd700 1 -- 172.21.15.81:0/173434449 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc02d070 con 0x555c950cb480 2024-05-09T00:06:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66a6ffd700 1 -- 172.21.15.81:0/173434449 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f66bc017070 con 0x555c950cb480 2024-05-09T00:06:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66d9c76b80 1 -- 172.21.15.81:0/173434449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c94f74210 con 0x555c950cb480 2024-05-09T00:06:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66a6ffd700 1 -- 172.21.15.81:0/173434449 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66bc00be60 con 0x555c950cb480 2024-05-09T00:06:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66d9c76b80 10 client.16449 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66d9c76b80 1 -- 172.21.15.81:0/173434449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555c94e48b00 con 0x555c950cb480 2024-05-09T00:06:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.354+0000 7f66a6ffd700 1 -- 172.21.15.81:0/173434449 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66bc03e020 con 0x555c950cb480 2024-05-09T00:06:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.355+0000 7f66a6ffd700 1 -- 172.21.15.81:0/173434449 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f66bc01e720 con 0x555c950cb480 2024-05-09T00:06:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.355+0000 7f66d9c76b80 10 client.16449 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.355+0000 7f66d9c76b80 10 client.16449 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.355+0000 7f66d9c76b80 20 client.16449 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.355+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/173434449 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555c950e4ab0 0x555c950e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.355+0000 7f66d9c76b80 4 client.16449 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.355+0000 7f66d9c76b80 1 -- 172.21.15.81:0/173434449 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c9509a7b0 con 0x555c950e4ab0 2024-05-09T00:06:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.355+0000 7f66c6ffd700 1 --2- 172.21.15.81:0/173434449 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555c950e4ab0 0x555c950e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.355+0000 7f66a6ffd700 10 client.16449 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.355+0000 7f66c6ffd700 1 --2- 172.21.15.81:0/173434449 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555c950e4ab0 0x555c950e6ed0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51234f9a85f26bfc server_cookie=68ac68477b346ec8 in_seq=0 out_seq=0 2024-05-09T00:06:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66a6ffd700 1 -- 172.21.15.81:0/173434449 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555c9509a7b0 con 0x555c950e4ab0 2024-05-09T00:06:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66a6ffd700 10 client.16449 handle_command_reply: tid=0 2024-05-09T00:06:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66d9c76b80 1 client.16449 shutdown 2024-05-09T00:06:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66d9c76b80 1 -- 172.21.15.81:0/173434449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950cb480 msgr2=0x555c950d71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/173434449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950cb480 0x555c950d71b0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f66bc01ee70 tx=0x7f66bc005270 comp rx=0 tx=0).stop 2024-05-09T00:06:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66d9c76b80 1 -- 172.21.15.81:0/173434449 shutdown_connections 2024-05-09T00:06:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/173434449 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555c950e4ab0 0x555c950e6ed0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/173434449 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d1270 0x555c950d4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/173434449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950cb480 0x555c950d71b0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66a6ffd700 0 client.16449 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/173434449 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950d0950 0x555c950d44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66d9c76b80 1 -- 172.21.15.81:0/173434449 >> 172.21.15.81:0/173434449 conn(0x555c950291b0 msgr2=0x555c950c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66d9c76b80 1 -- 172.21.15.81:0/173434449 shutdown_connections 2024-05-09T00:06:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66d9c76b80 1 -- 172.21.15.81:0/173434449 wait complete. 2024-05-09T00:06:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.356+0000 7f66d9c76b80 20 client.16449 trim_cache size 0 max 16384 2024-05-09T00:06:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.371+0000 7f66d9c76b80 1 Processor -- start 2024-05-09T00:06:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.371+0000 7f66d9c76b80 1 -- start start 2024-05-09T00:06:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.371+0000 7f66d9c76b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950cb480 0x555c950c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.371+0000 7f66d9c76b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950d0950 0x555c950d6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.371+0000 7f66d9c76b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d1270 0x555c950dbc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.371+0000 7f66d9c76b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c950d5aa0 con 0x555c950d1270 2024-05-09T00:06:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.371+0000 7f66d9c76b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c950d10c0 con 0x555c950d0950 2024-05-09T00:06:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.371+0000 7f66d9c76b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c950d5100 con 0x555c950cb480 2024-05-09T00:06:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.371+0000 7f66c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d1270 0x555c950dbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.371+0000 7f66c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d1270 0x555c950dbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37552/0 (socket says 172.21.15.81:37552) 2024-05-09T00:06:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.371+0000 7f66c7fff700 1 -- 172.21.15.81:0/2588045109 learned_addr learned my addr 172.21.15.81:0/2588045109 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.372+0000 7f66c6ffd700 1 --2- 172.21.15.81:0/2588045109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950d0950 0x555c950d6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.372+0000 7f66c77fe700 1 --2- 172.21.15.81:0/2588045109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950cb480 0x555c950c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.372+0000 7f66c7fff700 1 -- 172.21.15.81:0/2588045109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950cb480 msgr2=0x555c950c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.372+0000 7f66c7fff700 1 --2- 172.21.15.81:0/2588045109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950cb480 0x555c950c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.372+0000 7f66c7fff700 1 -- 172.21.15.81:0/2588045109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950d0950 msgr2=0x555c950d6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.372+0000 7f66c7fff700 1 --2- 172.21.15.81:0/2588045109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950d0950 0x555c950d6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.372+0000 7f66c7fff700 1 -- 172.21.15.81:0/2588045109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c94fe1500 con 0x555c950d1270 2024-05-09T00:06:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.372+0000 7f66c77fe700 1 --2- 172.21.15.81:0/2588045109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950cb480 0x555c950c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.372+0000 7f66c7fff700 1 --2- 172.21.15.81:0/2588045109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d1270 0x555c950dbc40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f66c00cb9a0 tx=0x7f66c000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689e9dd768a3ae3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.372+0000 7f66ae7fc700 1 -- 172.21.15.81:0/2588045109 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c009acf0 con 0x555c950d1270 2024-05-09T00:06:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.372+0000 7f66ae7fc700 1 -- 172.21.15.81:0/2588045109 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66c009ba90 con 0x555c950d1270 2024-05-09T00:06:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.372+0000 7f66ae7fc700 1 -- 172.21.15.81:0/2588045109 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c001d730 con 0x555c950d1270 2024-05-09T00:06:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 -- 172.21.15.81:0/2588045109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d1270 msgr2=0x555c950dbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/2588045109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d1270 0x555c950dbc40 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f66c00cb9a0 tx=0x7f66c000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 -- 172.21.15.81:0/2588045109 shutdown_connections 2024-05-09T00:06:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/2588045109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d1270 0x555c950dbc40 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/2588045109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950cb480 0x555c950c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/2588045109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950d0950 0x555c950d6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 -- 172.21.15.81:0/2588045109 >> 172.21.15.81:0/2588045109 conn(0x555c950291b0 msgr2=0x555c950d2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 -- 172.21.15.81:0/2588045109 shutdown_connections 2024-05-09T00:06:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 -- 172.21.15.81:0/2588045109 wait complete. 2024-05-09T00:06:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 -- start start 2024-05-09T00:06:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 Processor -- start 2024-05-09T00:06:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950cb480 0x555c950da260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d0950 0x555c950da7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d1270 0x555c95133f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c95134480 con 0x555c950d1270 2024-05-09T00:06:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c951345f0 con 0x555c950cb480 2024-05-09T00:06:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c951347b0 con 0x555c950d0950 2024-05-09T00:06:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.373+0000 7f66d9c76b80 10 client.0 _ll_register_callbacks cb 0x555c94fc0ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d1270 0x555c95133f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d1270 0x555c95133f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37566/0 (socket says 172.21.15.81:37566) 2024-05-09T00:06:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66c7fff700 1 -- 172.21.15.81:0/2998708183 learned_addr learned my addr 172.21.15.81:0/2998708183 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66c77fe700 1 --2- 172.21.15.81:0/2998708183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950cb480 0x555c950da260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66c6ffd700 1 --2- 172.21.15.81:0/2998708183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d0950 0x555c950da7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66c7fff700 1 -- 172.21.15.81:0/2998708183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d0950 msgr2=0x555c950da7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66c7fff700 1 --2- 172.21.15.81:0/2998708183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d0950 0x555c950da7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66c7fff700 1 -- 172.21.15.81:0/2998708183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950cb480 msgr2=0x555c950da260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66c7fff700 1 --2- 172.21.15.81:0/2998708183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950cb480 0x555c950da260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66c7fff700 1 -- 172.21.15.81:0/2998708183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c81a4070 con 0x555c950d1270 2024-05-09T00:06:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66c77fe700 1 --2- 172.21.15.81:0/2998708183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950cb480 0x555c950da260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66c7fff700 1 --2- 172.21.15.81:0/2998708183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d1270 0x555c95133f40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f66c00a3250 tx=0x7f66c009b290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1884635cd555507 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66a6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66a6ffd700 1 -- 172.21.15.81:0/2998708183 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00a3780 con 0x555c950d1270 2024-05-09T00:06:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66a6ffd700 1 -- 172.21.15.81:0/2998708183 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f66c009f1c0 con 0x555c950d1270 2024-05-09T00:06:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66d9c76b80 1 -- 172.21.15.81:0/2998708183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66bc015070 con 0x555c950d1270 2024-05-09T00:06:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66a6ffd700 1 -- 172.21.15.81:0/2998708183 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66c0099730 con 0x555c950d1270 2024-05-09T00:06:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66d9c76b80 10 client.16455 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66d9c76b80 1 -- 172.21.15.81:0/2998708183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555c94ea0c70 con 0x555c950d1270 2024-05-09T00:06:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.374+0000 7f66a6ffd700 1 -- 172.21.15.81:0/2998708183 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66bc015070 con 0x555c950d1270 2024-05-09T00:06:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.375+0000 7f66a6ffd700 1 -- 172.21.15.81:0/2998708183 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f66c009a880 con 0x555c950d1270 2024-05-09T00:06:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.375+0000 7f66d9c76b80 10 client.16455 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.375+0000 7f66d9c76b80 10 client.16455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.375+0000 7f66d9c76b80 20 client.16455 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.375+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/2998708183 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555c9513bb70 0x555c9513df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.375+0000 7f66d9c76b80 4 client.16455 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:06:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.375+0000 7f66d9c76b80 1 -- 172.21.15.81:0/2998708183 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555c95013e60 con 0x555c9513bb70 2024-05-09T00:06:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.375+0000 7f66c77fe700 1 --2- 172.21.15.81:0/2998708183 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555c9513bb70 0x555c9513df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:29.376 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:29 smithi081 ceph-mon[42474]: pgmap v109: 97 pgs: 97 active+clean; 3.6 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 27 KiB/s wr, 13 op/s 2024-05-09T00:06:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.375+0000 7f66a6ffd700 10 client.16455 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.375+0000 7f66c77fe700 1 --2- 172.21.15.81:0/2998708183 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555c9513bb70 0x555c9513df90 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a9a2c275529b954 server_cookie=fc081b05002f331a in_seq=0 out_seq=0 2024-05-09T00:06:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.387+0000 7f66a6ffd700 1 -- 172.21.15.81:0/2998708183 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555c95013e60 con 0x555c9513bb70 2024-05-09T00:06:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.387+0000 7f66a6ffd700 10 client.16455 handle_command_reply: tid=0 2024-05-09T00:06:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.387+0000 7f66d9c76b80 1 client.16455 shutdown 2024-05-09T00:06:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.387+0000 7f66d9c76b80 1 -- 172.21.15.81:0/2998708183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d1270 msgr2=0x555c95133f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.387+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/2998708183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d1270 0x555c95133f40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f66c00a3250 tx=0x7f66c009b290 comp rx=0 tx=0).stop 2024-05-09T00:06:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.387+0000 7f66d9c76b80 1 -- 172.21.15.81:0/2998708183 shutdown_connections 2024-05-09T00:06:29.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.387+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/2998708183 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555c9513bb70 0x555c9513df90 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.387+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/2998708183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555c950cb480 0x555c950da260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.387+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/2998708183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555c950d1270 0x555c95133f40 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.387+0000 7f66d9c76b80 1 --2- 172.21.15.81:0/2998708183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555c950d0950 0x555c950da7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.387+0000 7f66a6ffd700 0 client.16455 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.387+0000 7f66d9c76b80 1 -- 172.21.15.81:0/2998708183 >> 172.21.15.81:0/2998708183 conn(0x555c950291b0 msgr2=0x555c950ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66d9c76b80 1 -- 172.21.15.81:0/2998708183 shutdown_connections 2024-05-09T00:06:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66d9c76b80 1 -- 172.21.15.81:0/2998708183 wait complete. 2024-05-09T00:06:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66d9c76b80 20 client.16455 trim_cache size 0 max 16384 2024-05-09T00:06:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:06:29.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:06:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:06:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:06:29.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66cdabc700 1 -- 172.21.15.81:0/2117727726 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f66b00a1290 msgr2=0x7f66b00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66cdabc700 1 --2- 172.21.15.81:0/2117727726 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f66b00a1290 0x7f66b00a3750 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f66bc005950 tx=0x7f66bc00b410 comp rx=0 tx=0).stop 2024-05-09T00:06:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66cdabc700 1 -- 172.21.15.81:0/2117727726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c8104d80 msgr2=0x7f66c81a3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66cdabc700 1 --2- 172.21.15.81:0/2117727726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c8104d80 0x7f66c81a3350 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f66c000b070 tx=0x7f66c0004d00 comp rx=0 tx=0).stop 2024-05-09T00:06:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66cdabc700 1 -- 172.21.15.81:0/2117727726 shutdown_connections 2024-05-09T00:06:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66cdabc700 1 --2- 172.21.15.81:0/2117727726 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f66b00a1290 0x7f66b00a3750 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66cdabc700 1 --2- 172.21.15.81:0/2117727726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66c8104d80 0x7f66c81a3350 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66cdabc700 1 --2- 172.21.15.81:0/2117727726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f66c8100520 0x7f66c81982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66cdabc700 1 --2- 172.21.15.81:0/2117727726 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f66c8100ee0 0x7f66c8198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66cdabc700 1 -- 172.21.15.81:0/2117727726 >> 172.21.15.81:0/2117727726 conn(0x7f66c80763a0 msgr2=0x7f66c80fba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66cdabc700 1 -- 172.21.15.81:0/2117727726 shutdown_connections 2024-05-09T00:06:29.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:29.388+0000 7f66cdabc700 1 -- 172.21.15.81:0/2117727726 wait complete. 2024-05-09T00:06:31.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:31 smithi150 ceph-mon[46187]: pgmap v110: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 41 KiB/s wr, 20 op/s 2024-05-09T00:06:31.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:31 smithi171 ceph-mon[47351]: pgmap v110: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 41 KiB/s wr, 20 op/s 2024-05-09T00:06:31.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:31 smithi081 ceph-mon[42474]: pgmap v110: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 41 KiB/s wr, 20 op/s 2024-05-09T00:06:33.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:33 smithi150 ceph-mon[46187]: pgmap v111: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-05-09T00:06:33.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:33 smithi171 ceph-mon[47351]: pgmap v111: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-05-09T00:06:33.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:33 smithi081 ceph-mon[42474]: pgmap v111: 97 pgs: 97 active+clean; 3.7 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-05-09T00:06:35.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:35 smithi150 ceph-mon[46187]: pgmap v112: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 18 op/s 2024-05-09T00:06:35.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:35 smithi171 ceph-mon[47351]: pgmap v112: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 18 op/s 2024-05-09T00:06:35.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:35 smithi081 ceph-mon[42474]: pgmap v112: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 18 op/s 2024-05-09T00:06:37.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:37 smithi150 ceph-mon[46187]: pgmap v113: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:37.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:37 smithi171 ceph-mon[47351]: pgmap v113: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:37.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:37 smithi081 ceph-mon[42474]: pgmap v113: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:39.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:39 smithi150 ceph-mon[46187]: pgmap v114: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:39.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:39 smithi171 ceph-mon[47351]: pgmap v114: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:39.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:39 smithi081 ceph-mon[42474]: pgmap v114: 97 pgs: 97 active+clean; 3.8 MiB data, 393 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:41.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:41 smithi150 ceph-mon[46187]: pgmap v115: 97 pgs: 97 active+clean; 4.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 36 KiB/s wr, 16 op/s 2024-05-09T00:06:41.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:41 smithi171 ceph-mon[47351]: pgmap v115: 97 pgs: 97 active+clean; 4.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 36 KiB/s wr, 16 op/s 2024-05-09T00:06:41.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:41 smithi081 ceph-mon[42474]: pgmap v115: 97 pgs: 97 active+clean; 4.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 36 KiB/s wr, 16 op/s 2024-05-09T00:06:42.366 INFO:tasks.workunit.client.0.smithi081.stdout:64/600: open fd = 3 2024-05-09T00:06:42.366 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.366 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.366 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.366 INFO:tasks.workunit.client.0.smithi081.stdout:65/600: open fd = 3 2024-05-09T00:06:42.366 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.366 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:66/600: open fd = 3 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:67/600: open fd = 3 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:68/600: open fd = 3 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:69/600: open fd = 3 2024-05-09T00:06:42.367 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:70/600: open fd = 3 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:71/600: open fd = 3 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:72/600: open fd = 3 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.368 INFO:tasks.workunit.client.0.smithi081.stdout:73/600: open fd = 3 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:74/600: open fd = 3 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:75/600: open fd = 3 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:76/600: open fd = 3 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.369 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:77/600: open fd = 3 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:78/600: open fd = 3 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:79/600: open fd = 3 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:80/600: open fd = 3 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.370 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:81/600: open fd = 3 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:82/600: open fd = 3 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:83/600: open fd = 3 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:84/600: open fd = 3 2024-05-09T00:06:42.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:85/600: open fd = 3 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:86/600: open fd = 3 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:87/600: open fd = 3 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.372 INFO:tasks.workunit.client.0.smithi081.stdout:88/600: open fd = 3 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:89/600: open fd = 3 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:90/600: open fd = 3 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:91/600: open fd = 3 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.373 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.374 INFO:tasks.workunit.client.0.smithi081.stdout:92/600: open fd = 3 2024-05-09T00:06:42.374 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.374 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.374 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.374 INFO:tasks.workunit.client.0.smithi081.stdout:93/600: open fd = 3 2024-05-09T00:06:42.374 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.374 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.374 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.374 INFO:tasks.workunit.client.0.smithi081.stdout:94/600: open fd = 3 2024-05-09T00:06:42.374 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.374 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.374 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.374 INFO:tasks.workunit.client.0.smithi081.stdout:95/600: open fd = 3 2024-05-09T00:06:42.374 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.375 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.375 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.375 INFO:tasks.workunit.client.0.smithi081.stdout:96/600: open fd = 3 2024-05-09T00:06:42.375 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.375 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.375 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.375 INFO:tasks.workunit.client.0.smithi081.stdout:97/600: open fd = 3 2024-05-09T00:06:42.375 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.375 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.375 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.375 INFO:tasks.workunit.client.0.smithi081.stdout:98/600: open fd = 3 2024-05-09T00:06:42.375 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.375 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.375 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:99/600: open fd = 3 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:100/600: open fd = 3 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:101/600: open fd = 3 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:102/600: open fd = 3 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:103/600: open fd = 3 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:104/600: open fd = 3 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:105/600: open fd = 3 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:106/600: open fd = 3 2024-05-09T00:06:42.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:107/600: open fd = 3 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:108/600: open fd = 3 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:109/600: open fd = 3 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.378 INFO:tasks.workunit.client.0.smithi081.stdout:110/600: open fd = 3 2024-05-09T00:06:42.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.379 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.379 INFO:tasks.workunit.client.0.smithi081.stdout:111/600: open fd = 3 2024-05-09T00:06:42.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.379 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.379 INFO:tasks.workunit.client.0.smithi081.stdout:112/600: open fd = 3 2024-05-09T00:06:42.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.379 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.379 INFO:tasks.workunit.client.0.smithi081.stdout:113/600: open fd = 3 2024-05-09T00:06:42.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:114/600: open fd = 3 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:115/600: open fd = 3 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:116/600: open fd = 3 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:117/600: open fd = 3 2024-05-09T00:06:42.380 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.381 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.381 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.381 INFO:tasks.workunit.client.0.smithi081.stdout:118/600: open fd = 3 2024-05-09T00:06:42.381 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.381 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.381 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.381 INFO:tasks.workunit.client.0.smithi081.stdout:119/600: open fd = 3 2024-05-09T00:06:42.381 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.381 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.381 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.381 INFO:tasks.workunit.client.0.smithi081.stdout:120/600: open fd = 3 2024-05-09T00:06:42.381 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.381 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.382 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.382 INFO:tasks.workunit.client.0.smithi081.stdout:121/600: open fd = 3 2024-05-09T00:06:42.382 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.382 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.382 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.382 INFO:tasks.workunit.client.0.smithi081.stdout:122/600: open fd = 3 2024-05-09T00:06:42.382 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.382 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.382 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.382 INFO:tasks.workunit.client.0.smithi081.stdout:123/600: open fd = 3 2024-05-09T00:06:42.382 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.382 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.382 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.382 INFO:tasks.workunit.client.0.smithi081.stdout:124/600: open fd = 3 2024-05-09T00:06:42.383 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.383 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.383 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.383 INFO:tasks.workunit.client.0.smithi081.stdout:125/600: open fd = 3 2024-05-09T00:06:42.383 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.383 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.383 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:06:42.383 INFO:tasks.workunit.client.0.smithi081.stdout:126/600: open fd = 3 2024-05-09T00:06:42.383 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:06:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.506+0000 7f1ca012d700 1 -- 172.21.15.81:0/591724935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c980fffc0 msgr2=0x7f1c981003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.506+0000 7f1ca012d700 1 --2- 172.21.15.81:0/591724935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c980fffc0 0x7f1c981003a0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f1c94009990 tx=0x7f1c94009ca0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.506+0000 7f1ca012d700 1 -- 172.21.15.81:0/591724935 shutdown_connections 2024-05-09T00:06:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.506+0000 7f1ca012d700 1 --2- 172.21.15.81:0/591724935 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c981050e0 0x7f1c9810cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.506+0000 7f1ca012d700 1 --2- 172.21.15.81:0/591724935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c980fffc0 0x7f1c981003a0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.506+0000 7f1ca012d700 1 --2- 172.21.15.81:0/591724935 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c98100970 0x7f1c981049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.506+0000 7f1ca012d700 1 -- 172.21.15.81:0/591724935 >> 172.21.15.81:0/591724935 conn(0x7f1c980fb800 msgr2=0x7f1c980fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.506+0000 7f1ca012d700 1 -- 172.21.15.81:0/591724935 shutdown_connections 2024-05-09T00:06:42.504 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.506+0000 7f1ca012d700 1 -- 172.21.15.81:0/591724935 wait complete. 2024-05-09T00:06:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.507+0000 7f1ca012d700 1 Processor -- start 2024-05-09T00:06:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.507+0000 7f1ca012d700 1 -- start start 2024-05-09T00:06:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.507+0000 7f1ca012d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c980fffc0 0x7f1c98199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.507+0000 7f1ca012d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c981050e0 0x7f1c98199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.507+0000 7f1ca012d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9819ded0 0x7f1c9819e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.507+0000 7f1ca012d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9819e950 con 0x7f1c9819ded0 2024-05-09T00:06:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.507+0000 7f1ca012d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9819eac0 con 0x7f1c981050e0 2024-05-09T00:06:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.507+0000 7f1ca012d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9819ec80 con 0x7f1c980fffc0 2024-05-09T00:06:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.507+0000 7f1c9e6ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9819ded0 0x7f1c9819e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.507+0000 7f1c9e6ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9819ded0 0x7f1c9819e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35710/0 (socket says 172.21.15.81:35710) 2024-05-09T00:06:42.505 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.507+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/1396507436 learned_addr learned my addr 172.21.15.81:0/1396507436 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:42.506 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.507+0000 7f1c9dec9700 1 --2- 172.21.15.81:0/1396507436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c980fffc0 0x7f1c98199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.506 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.508+0000 7f1c9d6c8700 1 --2- 172.21.15.81:0/1396507436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c981050e0 0x7f1c98199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.506 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.508+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/1396507436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c980fffc0 msgr2=0x7f1c98199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:42.506 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.508+0000 7f1c9e6ca700 1 --2- 172.21.15.81:0/1396507436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c980fffc0 0x7f1c98199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.506 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.508+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/1396507436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c981050e0 msgr2=0x7f1c98199b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:42.506 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.508+0000 7f1c9e6ca700 1 --2- 172.21.15.81:0/1396507436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c981050e0 0x7f1c98199b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.506 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.508+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/1396507436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c940095f0 con 0x7f1c9819ded0 2024-05-09T00:06:42.506 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.508+0000 7f1c9e6ca700 1 --2- 172.21.15.81:0/1396507436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9819ded0 0x7f1c9819e350 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1c90007ee0 tx=0x7f1c9000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:42.506 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.508+0000 7f1c8affd700 1 -- 172.21.15.81:0/1396507436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90017070 con 0x7f1c9819ded0 2024-05-09T00:06:42.506 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.508+0000 7f1c8affd700 1 -- 172.21.15.81:0/1396507436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c9000f040 con 0x7f1c9819ded0 2024-05-09T00:06:42.506 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.508+0000 7f1ca012d700 1 -- 172.21.15.81:0/1396507436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c981a61e0 con 0x7f1c9819ded0 2024-05-09T00:06:42.506 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.508+0000 7f1c8affd700 1 -- 172.21.15.81:0/1396507436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90005740 con 0x7f1c9819ded0 2024-05-09T00:06:42.506 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.508+0000 7f1ca012d700 1 -- 172.21.15.81:0/1396507436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c981a66c0 con 0x7f1c9819ded0 2024-05-09T00:06:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.510+0000 7f1c8affd700 1 -- 172.21.15.81:0/1396507436 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f1c9000dc60 con 0x7f1c9819ded0 2024-05-09T00:06:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.511+0000 7f1c8affd700 1 --2- 172.21.15.81:0/1396507436 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1c840a1280 0x7f1c840a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.511+0000 7f1c8affd700 1 -- 172.21.15.81:0/1396507436 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f1c900cc480 con 0x7f1c9819ded0 2024-05-09T00:06:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.511+0000 7f1c9dec9700 1 --2- 172.21.15.81:0/1396507436 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1c840a1280 0x7f1c840a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.511+0000 7f1c9dec9700 1 --2- 172.21.15.81:0/1396507436 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1c840a1280 0x7f1c840a3740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400b5c0 tx=0x7f1c94005fd0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.511+0000 7f1cac2e7b80 1 Processor -- start 2024-05-09T00:06:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1cac2e7b80 1 -- start start 2024-05-09T00:06:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1cac2e7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26905950 0x55ff26905d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1cac2e7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26906270 0x55ff268fff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1cac2e7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26900480 0x55ff269008a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1cac2e7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff268570f0 con 0x55ff26900480 2024-05-09T00:06:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1cac2e7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff26854ab0 con 0x55ff26905950 2024-05-09T00:06:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1cac2e7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff268503a0 con 0x55ff26906270 2024-05-09T00:06:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1c9e6ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26900480 0x55ff269008a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1c9e6ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26900480 0x55ff269008a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35720/0 (socket says 172.21.15.81:35720) 2024-05-09T00:06:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/1534628547 learned_addr learned my addr 172.21.15.81:0/1534628547 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1c9d6c8700 1 --2- 172.21.15.81:0/1534628547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26906270 0x55ff268fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1c9dec9700 1 --2- 172.21.15.81:0/1534628547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26905950 0x55ff26905d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/1534628547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26906270 msgr2=0x55ff268fff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1c9e6ca700 1 --2- 172.21.15.81:0/1534628547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26906270 0x55ff268fff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/1534628547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26905950 msgr2=0x55ff26905d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1c9e6ca700 1 --2- 172.21.15.81:0/1534628547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26905950 0x55ff26905d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/1534628547 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff266d1350 con 0x55ff26900480 2024-05-09T00:06:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1c9d6c8700 1 --2- 172.21.15.81:0/1534628547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26906270 0x55ff268fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.512+0000 7f1c9e6ca700 1 --2- 172.21.15.81:0/1534628547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26900480 0x55ff269008a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1c900a14e0 tx=0x7f1c9000df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8703e2b2044b365 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.513+0000 7f1c83fff700 1 -- 172.21.15.81:0/1534628547 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9009d3c0 con 0x55ff26900480 2024-05-09T00:06:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.513+0000 7f1c83fff700 1 -- 172.21.15.81:0/1534628547 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c900a1a10 con 0x55ff26900480 2024-05-09T00:06:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.513+0000 7f1c83fff700 1 -- 172.21.15.81:0/1534628547 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900058a0 con 0x55ff26900480 2024-05-09T00:06:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.513+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/1534628547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26900480 msgr2=0x55ff269008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.513+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/1534628547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26900480 0x55ff269008a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1c900a14e0 tx=0x7f1c9000df60 comp rx=0 tx=0).stop 2024-05-09T00:06:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.513+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/1534628547 shutdown_connections 2024-05-09T00:06:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.513+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/1534628547 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26905950 0x55ff26905d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.513+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/1534628547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26900480 0x55ff269008a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.513+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/1534628547 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26906270 0x55ff268fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.513+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/1534628547 >> 172.21.15.81:0/1534628547 conn(0x55ff2685e1b0 msgr2=0x55ff268fa840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.513+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/1534628547 shutdown_connections 2024-05-09T00:06:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.513+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/1534628547 wait complete. 2024-05-09T00:06:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.514+0000 7f1cac2e7b80 1 -- start start 2024-05-09T00:06:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.514+0000 7f1cac2e7b80 1 Processor -- start 2024-05-09T00:06:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.514+0000 7f1cac2e7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26900480 0x55ff269096e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.514+0000 7f1cac2e7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26905950 0x55ff26909c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.514+0000 7f1cac2e7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26906270 0x55ff2690a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.514+0000 7f1cac2e7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff267ec500 con 0x55ff26905950 2024-05-09T00:06:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.514+0000 7f1cac2e7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff267ec1a0 con 0x55ff26906270 2024-05-09T00:06:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.514+0000 7f1cac2e7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff266d3640 con 0x55ff26900480 2024-05-09T00:06:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.514+0000 7f1cac2e7b80 10 client.0 _ll_register_callbacks cb 0x55ff267f5ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.514+0000 7f1c9d6c8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26905950 0x55ff26909c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.514+0000 7f1c9d6c8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26905950 0x55ff26909c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35728/0 (socket says 172.21.15.81:35728) 2024-05-09T00:06:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.514+0000 7f1c9d6c8700 1 -- 172.21.15.81:0/3108552880 learned_addr learned my addr 172.21.15.81:0/3108552880 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c9e6ca700 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26906270 0x55ff2690a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c9dec9700 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26900480 0x55ff269096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c9d6c8700 1 -- 172.21.15.81:0/3108552880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26900480 msgr2=0x55ff269096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c9d6c8700 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26900480 0x55ff269096e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c9d6c8700 1 -- 172.21.15.81:0/3108552880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26906270 msgr2=0x55ff2690a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c9d6c8700 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26906270 0x55ff2690a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c9d6c8700 1 -- 172.21.15.81:0/3108552880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c981a66c0 con 0x55ff26905950 2024-05-09T00:06:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c9dec9700 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26900480 0x55ff269096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c9e6ca700 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26906270 0x55ff2690a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c9d6c8700 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26905950 0x55ff26909c20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c007f80 tx=0x7f1c8c00f570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793ecf46303e59a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c817fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c817fa700 1 -- 172.21.15.81:0/3108552880 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c014660 con 0x55ff26905950 2024-05-09T00:06:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c817fa700 1 -- 172.21.15.81:0/3108552880 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f1c8c00fe50 con 0x55ff26905950 2024-05-09T00:06:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/3108552880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff267a9210 con 0x55ff26905950 2024-05-09T00:06:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c817fa700 1 -- 172.21.15.81:0/3108552880 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c8c0147c0 con 0x55ff26905950 2024-05-09T00:06:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1cac2e7b80 10 client.16467 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/3108552880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ff2667db00 con 0x55ff26905950 2024-05-09T00:06:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c817fa700 1 -- 172.21.15.81:0/3108552880 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ff267a9210 con 0x55ff26905950 2024-05-09T00:06:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.515+0000 7f1c817fa700 1 -- 172.21.15.81:0/3108552880 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1c8c013b20 con 0x55ff26905950 2024-05-09T00:06:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.516+0000 7f1cac2e7b80 10 client.16467 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.516+0000 7f1cac2e7b80 10 client.16467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.516+0000 7f1cac2e7b80 20 client.16467 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.516+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff26919e20 0x55ff2691c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.516+0000 7f1cac2e7b80 4 client.16467 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.516+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/3108552880 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff268cf7b0 con 0x55ff26919e20 2024-05-09T00:06:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.516+0000 7f1c9dec9700 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff26919e20 0x55ff2691c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.516+0000 7f1c817fa700 10 client.16467 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.516+0000 7f1c9dec9700 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff26919e20 0x55ff2691c240 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fb0d4bac5fae9de server_cookie=c4baef9b06a8ee17 in_seq=0 out_seq=0 2024-05-09T00:06:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1c817fa700 1 -- 172.21.15.81:0/3108552880 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ff268cf7b0 con 0x55ff26919e20 2024-05-09T00:06:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1c817fa700 10 client.16467 handle_command_reply: tid=0 2024-05-09T00:06:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1cac2e7b80 1 client.16467 shutdown 2024-05-09T00:06:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/3108552880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26905950 msgr2=0x55ff26909c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26905950 0x55ff26909c20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c007f80 tx=0x7f1c8c00f570 comp rx=0 tx=0).stop 2024-05-09T00:06:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/3108552880 shutdown_connections 2024-05-09T00:06:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff26919e20 0x55ff2691c240 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26906270 0x55ff2690a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26900480 0x55ff269096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1c817fa700 0 client.16467 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/3108552880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26905950 0x55ff26909c20 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/3108552880 >> 172.21.15.81:0/3108552880 conn(0x55ff2685e1b0 msgr2=0x55ff269044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/3108552880 shutdown_connections 2024-05-09T00:06:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/3108552880 wait complete. 2024-05-09T00:06:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.517+0000 7f1cac2e7b80 20 client.16467 trim_cache size 0 max 16384 2024-05-09T00:06:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.532+0000 7f1cac2e7b80 1 Processor -- start 2024-05-09T00:06:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.532+0000 7f1cac2e7b80 1 -- start start 2024-05-09T00:06:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.532+0000 7f1cac2e7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26900480 0x55ff268fa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.532+0000 7f1cac2e7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26905950 0x55ff26915690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.532+0000 7f1cac2e7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26906270 0x55ff268fc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.532+0000 7f1cac2e7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff268fc9f0 con 0x55ff26906270 2024-05-09T00:06:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.532+0000 7f1cac2e7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff26907c10 con 0x55ff26905950 2024-05-09T00:06:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.532+0000 7f1cac2e7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff268ff230 con 0x55ff26900480 2024-05-09T00:06:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.532+0000 7f1c9e6ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26906270 0x55ff268fc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.532+0000 7f1c9e6ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26906270 0x55ff268fc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35734/0 (socket says 172.21.15.81:35734) 2024-05-09T00:06:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.532+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/4024865293 learned_addr learned my addr 172.21.15.81:0/4024865293 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.533+0000 7f1c9dec9700 1 --2- 172.21.15.81:0/4024865293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26900480 0x55ff268fa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.533+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/4024865293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26900480 msgr2=0x55ff268fa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.533+0000 7f1c9d6c8700 1 --2- 172.21.15.81:0/4024865293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26905950 0x55ff26915690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.533+0000 7f1c9e6ca700 1 --2- 172.21.15.81:0/4024865293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26900480 0x55ff268fa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.533+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/4024865293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26905950 msgr2=0x55ff26915690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.533+0000 7f1c9e6ca700 1 --2- 172.21.15.81:0/4024865293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26905950 0x55ff26915690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.533+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/4024865293 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff26816500 con 0x55ff26906270 2024-05-09T00:06:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.533+0000 7f1c9dec9700 1 --2- 172.21.15.81:0/4024865293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26900480 0x55ff268fa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.533+0000 7f1c9e6ca700 1 --2- 172.21.15.81:0/4024865293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26906270 0x55ff268fc4b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1c90096000 tx=0x7f1c90004c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa02d7ac99383ee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.533+0000 7f1c88ff9700 1 -- 172.21.15.81:0/4024865293 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9009d3c0 con 0x55ff26906270 2024-05-09T00:06:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.533+0000 7f1c88ff9700 1 -- 172.21.15.81:0/4024865293 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c900b3070 con 0x55ff26906270 2024-05-09T00:06:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.533+0000 7f1c88ff9700 1 -- 172.21.15.81:0/4024865293 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90005ae0 con 0x55ff26906270 2024-05-09T00:06:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.533+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/4024865293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26906270 msgr2=0x55ff268fc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/4024865293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26906270 0x55ff268fc4b0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1c90096000 tx=0x7f1c90004c40 comp rx=0 tx=0).stop 2024-05-09T00:06:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/4024865293 shutdown_connections 2024-05-09T00:06:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/4024865293 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26906270 0x55ff268fc4b0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/4024865293 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26900480 0x55ff268fa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/4024865293 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26905950 0x55ff26915690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/4024865293 >> 172.21.15.81:0/4024865293 conn(0x55ff2685e1b0 msgr2=0x55ff268f6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/4024865293 shutdown_connections 2024-05-09T00:06:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/4024865293 wait complete. 2024-05-09T00:06:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 -- start start 2024-05-09T00:06:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 Processor -- start 2024-05-09T00:06:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26900480 0x55ff26910e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26905950 0x55ff2690cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26906270 0x55ff2690d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2690d6d0 con 0x55ff26906270 2024-05-09T00:06:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2690d840 con 0x55ff26900480 2024-05-09T00:06:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2690da00 con 0x55ff26905950 2024-05-09T00:06:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1cac2e7b80 10 client.0 _ll_register_callbacks cb 0x7f1c8c0079e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.534+0000 7f1c9e6ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26906270 0x55ff2690d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c9e6ca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26906270 0x55ff2690d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35744/0 (socket says 172.21.15.81:35744) 2024-05-09T00:06:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/531054286 learned_addr learned my addr 172.21.15.81:0/531054286 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c9d6c8700 1 --2- 172.21.15.81:0/531054286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26905950 0x55ff2690cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c9dec9700 1 --2- 172.21.15.81:0/531054286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26900480 0x55ff26910e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/531054286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26905950 msgr2=0x55ff2690cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c9e6ca700 1 --2- 172.21.15.81:0/531054286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26905950 0x55ff2690cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/531054286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26900480 msgr2=0x55ff26910e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c9e6ca700 1 --2- 172.21.15.81:0/531054286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26900480 0x55ff26910e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c9e6ca700 1 -- 172.21.15.81:0/531054286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff266d1350 con 0x55ff26906270 2024-05-09T00:06:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c9dec9700 1 --2- 172.21.15.81:0/531054286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26900480 0x55ff26910e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c9e6ca700 1 --2- 172.21.15.81:0/531054286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26906270 0x55ff2690d0f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1c900a14e0 tx=0x7f1c9009d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5efdc77d529ea80 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c817fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c817fa700 1 -- 172.21.15.81:0/531054286 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90005aa0 con 0x55ff26906270 2024-05-09T00:06:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c817fa700 1 -- 172.21.15.81:0/531054286 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f1c900997f0 con 0x55ff26906270 2024-05-09T00:06:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/531054286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c900a1a10 con 0x55ff26906270 2024-05-09T00:06:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c817fa700 1 -- 172.21.15.81:0/531054286 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c900999b0 con 0x55ff26906270 2024-05-09T00:06:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1cac2e7b80 10 client.16473 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/531054286 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ff266d5c70 con 0x55ff26906270 2024-05-09T00:06:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c817fa700 1 -- 172.21.15.81:0/531054286 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c900a1a10 con 0x55ff26906270 2024-05-09T00:06:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.535+0000 7f1c817fa700 1 -- 172.21.15.81:0/531054286 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1c900b7b80 con 0x55ff26906270 2024-05-09T00:06:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.536+0000 7f1cac2e7b80 10 client.16473 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.536+0000 7f1cac2e7b80 10 client.16473 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.536+0000 7f1cac2e7b80 20 client.16473 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.536+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/531054286 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff269703a0 0x55ff26972790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.536+0000 7f1cac2e7b80 4 client.16473 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:06:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.536+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/531054286 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ff26848e60 con 0x55ff269703a0 2024-05-09T00:06:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.536+0000 7f1c9dec9700 1 --2- 172.21.15.81:0/531054286 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff269703a0 0x55ff26972790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.536+0000 7f1c9dec9700 1 --2- 172.21.15.81:0/531054286 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff269703a0 0x55ff26972790 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3af0bcc03a69910 server_cookie=4ea8c8261b36a444 in_seq=0 out_seq=0 2024-05-09T00:06:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.536+0000 7f1c817fa700 10 client.16473 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.550+0000 7f1c817fa700 1 -- 172.21.15.81:0/531054286 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ff26848e60 con 0x55ff269703a0 2024-05-09T00:06:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.550+0000 7f1c817fa700 10 client.16473 handle_command_reply: tid=0 2024-05-09T00:06:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.550+0000 7f1cac2e7b80 1 client.16473 shutdown 2024-05-09T00:06:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.550+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/531054286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26906270 msgr2=0x55ff2690d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.550+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/531054286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26906270 0x55ff2690d0f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f1c900a14e0 tx=0x7f1c9009d520 comp rx=0 tx=0).stop 2024-05-09T00:06:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/531054286 shutdown_connections 2024-05-09T00:06:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/531054286 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff269703a0 0x55ff26972790 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/531054286 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff26900480 0x55ff26910e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1c817fa700 0 client.16473 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/531054286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff26906270 0x55ff2690d0f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1cac2e7b80 1 --2- 172.21.15.81:0/531054286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff26905950 0x55ff2690cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/531054286 >> 172.21.15.81:0/531054286 conn(0x55ff2685e1b0 msgr2=0x55ff268ff6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/531054286 shutdown_connections 2024-05-09T00:06:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1cac2e7b80 1 -- 172.21.15.81:0/531054286 wait complete. 2024-05-09T00:06:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1cac2e7b80 20 client.16473 trim_cache size 0 max 16384 2024-05-09T00:06:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:06:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:06:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:06:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:06:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1ca012d700 1 -- 172.21.15.81:0/1396507436 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1c840a1280 msgr2=0x7f1c840a3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1ca012d700 1 --2- 172.21.15.81:0/1396507436 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1c840a1280 0x7f1c840a3740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400b5c0 tx=0x7f1c94005fd0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1ca012d700 1 -- 172.21.15.81:0/1396507436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9819ded0 msgr2=0x7f1c9819e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1ca012d700 1 --2- 172.21.15.81:0/1396507436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9819ded0 0x7f1c9819e350 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1c90007ee0 tx=0x7f1c9000d3b0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1ca012d700 1 -- 172.21.15.81:0/1396507436 shutdown_connections 2024-05-09T00:06:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1ca012d700 1 --2- 172.21.15.81:0/1396507436 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1c840a1280 0x7f1c840a3740 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1ca012d700 1 --2- 172.21.15.81:0/1396507436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c9819ded0 0x7f1c9819e350 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1ca012d700 1 --2- 172.21.15.81:0/1396507436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c980fffc0 0x7f1c98199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1ca012d700 1 --2- 172.21.15.81:0/1396507436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c981050e0 0x7f1c98199b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1ca012d700 1 -- 172.21.15.81:0/1396507436 >> 172.21.15.81:0/1396507436 conn(0x7f1c980fb800 msgr2=0x7f1c980692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1ca012d700 1 -- 172.21.15.81:0/1396507436 shutdown_connections 2024-05-09T00:06:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:42.551+0000 7f1ca012d700 1 -- 172.21.15.81:0/1396507436 wait complete. 2024-05-09T00:06:43.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:43 smithi150 ceph-mon[46187]: pgmap v116: 97 pgs: 97 active+clean; 4.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-05-09T00:06:43.302 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:43 smithi171 ceph-mon[47351]: pgmap v116: 97 pgs: 97 active+clean; 4.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-05-09T00:06:43.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:43 smithi081 ceph-mon[42474]: pgmap v116: 97 pgs: 97 active+clean; 4.0 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-05-09T00:06:45.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:45 smithi150 ceph-mon[46187]: pgmap v117: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 17 op/s 2024-05-09T00:06:45.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:45 smithi171 ceph-mon[47351]: pgmap v117: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 17 op/s 2024-05-09T00:06:45.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:45 smithi081 ceph-mon[42474]: pgmap v117: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 17 op/s 2024-05-09T00:06:47.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:47 smithi150 ceph-mon[46187]: pgmap v118: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:47.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:47 smithi171 ceph-mon[47351]: pgmap v118: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:47.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:47 smithi081 ceph-mon[42474]: pgmap v118: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:49.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:49 smithi150 ceph-mon[46187]: pgmap v119: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:49.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:49 smithi171 ceph-mon[47351]: pgmap v119: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:49.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:49 smithi081 ceph-mon[42474]: pgmap v119: 97 pgs: 97 active+clean; 4.1 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 KiB/s wr, 12 op/s 2024-05-09T00:06:51.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:51 smithi150 ceph-mon[46187]: pgmap v120: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-05-09T00:06:51.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:51 smithi171 ceph-mon[47351]: pgmap v120: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-05-09T00:06:51.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:51 smithi081 ceph-mon[42474]: pgmap v120: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 17 op/s 2024-05-09T00:06:53.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:53 smithi150 ceph-mon[46187]: pgmap v121: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-05-09T00:06:53.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:53 smithi171 ceph-mon[47351]: pgmap v121: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-05-09T00:06:53.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:53 smithi081 ceph-mon[42474]: pgmap v121: 97 pgs: 97 active+clean; 4.2 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 26 KiB/s wr, 12 op/s 2024-05-09T00:06:53.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:06:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.017+0000 7f5d14520700 1 -- 172.21.15.81:0/2567001000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d0c100ab0 msgr2=0x7f5d0c10ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.017+0000 7f5d14520700 1 --2- 172.21.15.81:0/2567001000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d0c100ab0 0x7f5d0c10ccc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400b0d0 tx=0x7f5d0400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.017+0000 7f5d14520700 1 -- 172.21.15.81:0/2567001000 shutdown_connections 2024-05-09T00:06:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.017+0000 7f5d14520700 1 --2- 172.21.15.81:0/2567001000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d0c100ab0 0x7f5d0c10ccc0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.017+0000 7f5d14520700 1 --2- 172.21.15.81:0/2567001000 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d0c105f90 0x7f5d0c106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.017+0000 7f5d14520700 1 --2- 172.21.15.81:0/2567001000 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d0c1000f0 0x7f5d0c100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.017+0000 7f5d14520700 1 -- 172.21.15.81:0/2567001000 >> 172.21.15.81:0/2567001000 conn(0x7f5d0c076ba0 msgr2=0x7f5d0c076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.017+0000 7f5d14520700 1 -- 172.21.15.81:0/2567001000 shutdown_connections 2024-05-09T00:06:54.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.017+0000 7f5d14520700 1 -- 172.21.15.81:0/2567001000 wait complete. 2024-05-09T00:06:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d14520700 1 Processor -- start 2024-05-09T00:06:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d14520700 1 -- start start 2024-05-09T00:06:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d14520700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d0c1000f0 0x7f5d0c1975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d14520700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d0c100ab0 0x7f5d0c197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d14520700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d0c105f90 0x7f5d0c19bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d14520700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c19c3f0 con 0x7f5d0c100ab0 2024-05-09T00:06:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d14520700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c19c560 con 0x7f5d0c105f90 2024-05-09T00:06:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d14520700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c19c720 con 0x7f5d0c1000f0 2024-05-09T00:06:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d11abb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d0c100ab0 0x7f5d0c197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d11abb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d0c100ab0 0x7f5d0c197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33646/0 (socket says 172.21.15.81:33646) 2024-05-09T00:06:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d11abb700 1 -- 172.21.15.81:0/2890282484 learned_addr learned my addr 172.21.15.81:0/2890282484 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d122bc700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d0c1000f0 0x7f5d0c1975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d12abd700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d0c105f90 0x7f5d0c19bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d11abb700 1 -- 172.21.15.81:0/2890282484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d0c1000f0 msgr2=0x7f5d0c1975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d11abb700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d0c1000f0 0x7f5d0c1975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d11abb700 1 -- 172.21.15.81:0/2890282484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d0c105f90 msgr2=0x7f5d0c19bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d11abb700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d0c105f90 0x7f5d0c19bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d11abb700 1 -- 172.21.15.81:0/2890282484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d04009d00 con 0x7f5d0c100ab0 2024-05-09T00:06:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.018+0000 7f5d12abd700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d0c105f90 0x7f5d0c19bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:54.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.019+0000 7f5d11abb700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d0c100ab0 0x7f5d0c197b00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800d950 tx=0x7f5d0800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.019+0000 7f5d037fe700 1 -- 172.21.15.81:0/2890282484 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d08009940 con 0x7f5d0c100ab0 2024-05-09T00:06:54.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.019+0000 7f5d037fe700 1 -- 172.21.15.81:0/2890282484 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d08010460 con 0x7f5d0c100ab0 2024-05-09T00:06:54.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.019+0000 7f5d14520700 1 -- 172.21.15.81:0/2890282484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0c19ca00 con 0x7f5d0c100ab0 2024-05-09T00:06:54.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.019+0000 7f5d037fe700 1 -- 172.21.15.81:0/2890282484 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0800f620 con 0x7f5d0c100ab0 2024-05-09T00:06:54.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.019+0000 7f5d14520700 1 -- 172.21.15.81:0/2890282484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0c1a4240 con 0x7f5d0c100ab0 2024-05-09T00:06:54.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.022+0000 7f5d037fe700 1 -- 172.21.15.81:0/2890282484 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f5d080108d0 con 0x7f5d0c100ab0 2024-05-09T00:06:54.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.022+0000 7f5d037fe700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5cf80a1310 0x7f5cf80a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.022+0000 7f5d037fe700 1 -- 172.21.15.81:0/2890282484 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f5d080ccaf0 con 0x7f5d0c100ab0 2024-05-09T00:06:54.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.022+0000 7f5d122bc700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5cf80a1310 0x7f5cf80a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.023+0000 7f5d206dab80 1 Processor -- start 2024-05-09T00:06:54.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.023+0000 7f5d122bc700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5cf80a1310 0x7f5cf80a37d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c067bb0 tx=0x7f5cfc009190 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.023+0000 7f5d206dab80 1 -- start start 2024-05-09T00:06:54.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.023+0000 7f5d206dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x5628599251e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.023+0000 7f5d206dab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 0x56285991f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.023+0000 7f5d206dab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x56285991fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.023+0000 7f5d206dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562859876150 con 0x562859924e00 2024-05-09T00:06:54.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.023+0000 7f5d206dab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562859873b10 con 0x56285991f890 2024-05-09T00:06:54.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.023+0000 7f5d206dab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285986f400 con 0x562859925720 2024-05-09T00:06:54.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.023+0000 7f5d11abb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 0x56285991f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.023+0000 7f5d122bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x5628599251e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.023+0000 7f5d12abd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x56285991fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.023+0000 7f5d11abb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 0x56285991f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:51672/0 (socket says 172.21.15.81:51672) 2024-05-09T00:06:54.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.023+0000 7f5d11abb700 1 -- 172.21.15.81:0/2882890284 learned_addr learned my addr 172.21.15.81:0/2882890284 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.024+0000 7f5d122bc700 1 -- 172.21.15.81:0/2882890284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 msgr2=0x56285991f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.024+0000 7f5d122bc700 1 --2- 172.21.15.81:0/2882890284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 0x56285991f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.024+0000 7f5d122bc700 1 -- 172.21.15.81:0/2882890284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 msgr2=0x56285991fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.024+0000 7f5d122bc700 1 --2- 172.21.15.81:0/2882890284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x56285991fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.024+0000 7f5d122bc700 1 -- 172.21.15.81:0/2882890284 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628596f03b0 con 0x562859924e00 2024-05-09T00:06:54.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.024+0000 7f5d122bc700 1 --2- 172.21.15.81:0/2882890284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x5628599251e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00e9e0 tx=0x7f5cfc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede3944038a960a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.024+0000 7f5d00ff9700 1 -- 172.21.15.81:0/2882890284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc009660 con 0x562859924e00 2024-05-09T00:06:54.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.024+0000 7f5d00ff9700 1 -- 172.21.15.81:0/2882890284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5cfc015940 con 0x562859924e00 2024-05-09T00:06:54.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.024+0000 7f5d00ff9700 1 -- 172.21.15.81:0/2882890284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0138f0 con 0x562859924e00 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 -- 172.21.15.81:0/2882890284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 msgr2=0x5628599251e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 --2- 172.21.15.81:0/2882890284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x5628599251e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00e9e0 tx=0x7f5cfc011000 comp rx=0 tx=0).stop 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 -- 172.21.15.81:0/2882890284 shutdown_connections 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 --2- 172.21.15.81:0/2882890284 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x56285991fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 --2- 172.21.15.81:0/2882890284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x5628599251e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 --2- 172.21.15.81:0/2882890284 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 0x56285991f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 -- 172.21.15.81:0/2882890284 >> 172.21.15.81:0/2882890284 conn(0x56285987d210 msgr2=0x562859919df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 -- 172.21.15.81:0/2882890284 shutdown_connections 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 -- 172.21.15.81:0/2882890284 wait complete. 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 -- start start 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 Processor -- start 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x562859928a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x562859928fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 0x5628599294f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285980b560 con 0x562859924e00 2024-05-09T00:06:54.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285980b200 con 0x56285991f890 2024-05-09T00:06:54.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.025+0000 7f5d206dab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628596f26a0 con 0x562859925720 2024-05-09T00:06:54.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d206dab80 10 client.0 _ll_register_callbacks cb 0x562859814b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:54.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d11abb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x562859928fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d11abb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x562859928fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33658/0 (socket says 172.21.15.81:33658) 2024-05-09T00:06:54.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d11abb700 1 -- 172.21.15.81:0/1092262454 learned_addr learned my addr 172.21.15.81:0/1092262454 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d12abd700 1 --2- 172.21.15.81:0/1092262454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 0x5628599294f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d122bc700 1 --2- 172.21.15.81:0/1092262454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x562859928a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d11abb700 1 -- 172.21.15.81:0/1092262454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 msgr2=0x5628599294f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d11abb700 1 --2- 172.21.15.81:0/1092262454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 0x5628599294f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d11abb700 1 -- 172.21.15.81:0/1092262454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 msgr2=0x562859928a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d11abb700 1 --2- 172.21.15.81:0/1092262454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x562859928a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d11abb700 1 -- 172.21.15.81:0/1092262454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc00e6c0 con 0x562859924e00 2024-05-09T00:06:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d11abb700 1 --2- 172.21.15.81:0/1092262454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x562859928fb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800b2f0 tx=0x7f5d08099d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce77c34bf791bc3e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5cf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5cf5ffb700 1 -- 172.21.15.81:0/1092262454 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0809a060 con 0x562859924e00 2024-05-09T00:06:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5cf5ffb700 1 -- 172.21.15.81:0/1092262454 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f5d080990f0 con 0x562859924e00 2024-05-09T00:06:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d206dab80 1 -- 172.21.15.81:0/1092262454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628597c8270 con 0x562859924e00 2024-05-09T00:06:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5cf5ffb700 1 -- 172.21.15.81:0/1092262454 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d080992b0 con 0x562859924e00 2024-05-09T00:06:54.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d206dab80 10 client.16485 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.026+0000 7f5d206dab80 1 -- 172.21.15.81:0/1092262454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56285969cb60 con 0x562859924e00 2024-05-09T00:06:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.027+0000 7f5cf5ffb700 1 -- 172.21.15.81:0/1092262454 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5628597c8270 con 0x562859924e00 2024-05-09T00:06:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.027+0000 7f5cf5ffb700 1 -- 172.21.15.81:0/1092262454 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5d080adc90 con 0x562859924e00 2024-05-09T00:06:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.027+0000 7f5d206dab80 10 client.16485 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.027+0000 7f5d206dab80 10 client.16485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.027+0000 7f5d206dab80 20 client.16485 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.027+0000 7f5d206dab80 1 --2- 172.21.15.81:0/1092262454 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562859939010 0x56285993b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.027+0000 7f5d206dab80 4 client.16485 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.027+0000 7f5d206dab80 1 -- 172.21.15.81:0/1092262454 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628598ee810 con 0x562859939010 2024-05-09T00:06:54.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.027+0000 7f5d122bc700 1 --2- 172.21.15.81:0/1092262454 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562859939010 0x56285993b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5cf5ffb700 10 client.16485 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:54.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5d122bc700 1 --2- 172.21.15.81:0/1092262454 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562859939010 0x56285993b430 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cef5ecb3ab39ab2a server_cookie=a393ff87848ce8a6 in_seq=0 out_seq=0 2024-05-09T00:06:54.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5cf5ffb700 1 -- 172.21.15.81:0/1092262454 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5628598ee810 con 0x562859939010 2024-05-09T00:06:54.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5cf5ffb700 10 client.16485 handle_command_reply: tid=0 2024-05-09T00:06:54.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5d206dab80 1 client.16485 shutdown 2024-05-09T00:06:54.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5d206dab80 1 -- 172.21.15.81:0/1092262454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 msgr2=0x562859928fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5d206dab80 1 --2- 172.21.15.81:0/1092262454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x562859928fb0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800b2f0 tx=0x7f5d08099d30 comp rx=0 tx=0).stop 2024-05-09T00:06:54.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5d206dab80 1 -- 172.21.15.81:0/1092262454 shutdown_connections 2024-05-09T00:06:54.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5d206dab80 1 --2- 172.21.15.81:0/1092262454 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562859939010 0x56285993b430 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5d206dab80 1 --2- 172.21.15.81:0/1092262454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x562859928a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5d206dab80 1 --2- 172.21.15.81:0/1092262454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 0x5628599294f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5d206dab80 1 --2- 172.21.15.81:0/1092262454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x562859928fb0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5cf5ffb700 0 client.16485 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:54.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5d206dab80 1 -- 172.21.15.81:0/1092262454 >> 172.21.15.81:0/1092262454 conn(0x56285987d210 msgr2=0x5628599195a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5d206dab80 1 -- 172.21.15.81:0/1092262454 shutdown_connections 2024-05-09T00:06:54.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5d206dab80 1 -- 172.21.15.81:0/1092262454 wait complete. 2024-05-09T00:06:54.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.028+0000 7f5d206dab80 20 client.16485 trim_cache size 0 max 16384 2024-05-09T00:06:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.045+0000 7f5d206dab80 1 Processor -- start 2024-05-09T00:06:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.045+0000 7f5d206dab80 1 -- start start 2024-05-09T00:06:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.045+0000 7f5d206dab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x56285991f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.045+0000 7f5d206dab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859924e00 0x562859919d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.045+0000 7f5d206dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859925720 0x562859929310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.045+0000 7f5d206dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285992a070 con 0x562859925720 2024-05-09T00:06:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d206dab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562859916dc0 con 0x56285991f890 2024-05-09T00:06:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d206dab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285991aae0 con 0x562859924e00 2024-05-09T00:06:54.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d12abd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859925720 0x562859929310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d12abd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859925720 0x562859929310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33668/0 (socket says 172.21.15.81:33668) 2024-05-09T00:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d12abd700 1 -- 172.21.15.81:0/2024165972 learned_addr learned my addr 172.21.15.81:0/2024165972 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d11abb700 1 --2- 172.21.15.81:0/2024165972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859924e00 0x562859919d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d122bc700 1 --2- 172.21.15.81:0/2024165972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x56285991f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d12abd700 1 -- 172.21.15.81:0/2024165972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859924e00 msgr2=0x562859919d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d12abd700 1 --2- 172.21.15.81:0/2024165972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859924e00 0x562859919d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d12abd700 1 -- 172.21.15.81:0/2024165972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 msgr2=0x56285991f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d12abd700 1 --2- 172.21.15.81:0/2024165972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x56285991f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d12abd700 1 -- 172.21.15.81:0/2024165972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56285991ff40 con 0x562859925720 2024-05-09T00:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d12abd700 1 --2- 172.21.15.81:0/2024165972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859925720 0x562859929310 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5d04007e10 tx=0x7f5d04007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c33d3f54c787d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d017fa700 1 -- 172.21.15.81:0/2024165972 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0400e050 con 0x562859925720 2024-05-09T00:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d017fa700 1 -- 172.21.15.81:0/2024165972 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d040093d0 con 0x562859925720 2024-05-09T00:06:54.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.046+0000 7f5d017fa700 1 -- 172.21.15.81:0/2024165972 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d040052c0 con 0x562859925720 2024-05-09T00:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 -- 172.21.15.81:0/2024165972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859925720 msgr2=0x562859929310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 --2- 172.21.15.81:0/2024165972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859925720 0x562859929310 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5d04007e10 tx=0x7f5d04007e40 comp rx=0 tx=0).stop 2024-05-09T00:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 -- 172.21.15.81:0/2024165972 shutdown_connections 2024-05-09T00:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 --2- 172.21.15.81:0/2024165972 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x56285991f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 --2- 172.21.15.81:0/2024165972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859925720 0x562859929310 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 --2- 172.21.15.81:0/2024165972 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859924e00 0x562859919d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 -- 172.21.15.81:0/2024165972 >> 172.21.15.81:0/2024165972 conn(0x56285987d210 msgr2=0x562859927340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 -- 172.21.15.81:0/2024165972 shutdown_connections 2024-05-09T00:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 -- 172.21.15.81:0/2024165972 wait complete. 2024-05-09T00:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 -- start start 2024-05-09T00:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 Processor -- start 2024-05-09T00:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x56285992ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x56285992efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 0x56285992f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285998f520 con 0x562859924e00 2024-05-09T00:06:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285998f660 con 0x56285991f890 2024-05-09T00:06:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56285998f7a0 con 0x562859925720 2024-05-09T00:06:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.047+0000 7f5d206dab80 10 client.0 _ll_register_callbacks cb 0x562859814b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d11abb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x56285992efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d11abb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x56285992efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33676/0 (socket says 172.21.15.81:33676) 2024-05-09T00:06:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d11abb700 1 -- 172.21.15.81:0/1089669618 learned_addr learned my addr 172.21.15.81:0/1089669618 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d122bc700 1 --2- 172.21.15.81:0/1089669618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x56285992ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d12abd700 1 --2- 172.21.15.81:0/1089669618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 0x56285992f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d11abb700 1 -- 172.21.15.81:0/1089669618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 msgr2=0x56285992f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d11abb700 1 --2- 172.21.15.81:0/1089669618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 0x56285992f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d11abb700 1 -- 172.21.15.81:0/1089669618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 msgr2=0x56285992ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d11abb700 1 --2- 172.21.15.81:0/1089669618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x56285992ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d11abb700 1 -- 172.21.15.81:0/1089669618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0c10d550 con 0x562859924e00 2024-05-09T00:06:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d12abd700 1 --2- 172.21.15.81:0/1089669618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 0x56285992f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d11abb700 1 --2- 172.21.15.81:0/1089669618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x56285992efd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5d08097f50 tx=0x7f5d080a1e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fed284ab635319 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5cf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5cf5ffb700 1 -- 172.21.15.81:0/1089669618 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d080b2360 con 0x562859924e00 2024-05-09T00:06:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d206dab80 1 -- 172.21.15.81:0/1089669618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5cfc015940 con 0x562859924e00 2024-05-09T00:06:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5cf5ffb700 1 -- 172.21.15.81:0/1089669618 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f5d0809a070 con 0x562859924e00 2024-05-09T00:06:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5cf5ffb700 1 -- 172.21.15.81:0/1089669618 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d080999d0 con 0x562859924e00 2024-05-09T00:06:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d206dab80 10 client.16491 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.048+0000 7f5d206dab80 1 -- 172.21.15.81:0/1089669618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562859835560 con 0x562859924e00 2024-05-09T00:06:54.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.049+0000 7f5cf5ffb700 1 -- 172.21.15.81:0/1089669618 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5cfc015940 con 0x562859924e00 2024-05-09T00:06:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.049+0000 7f5cf5ffb700 1 -- 172.21.15.81:0/1089669618 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5d08098bf0 con 0x562859924e00 2024-05-09T00:06:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.049+0000 7f5d206dab80 10 client.16491 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.049+0000 7f5d206dab80 10 client.16491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.049+0000 7f5d206dab80 20 client.16491 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.049+0000 7f5d206dab80 1 --2- 172.21.15.81:0/1089669618 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562859990a90 0x562859992eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.049+0000 7f5d206dab80 4 client.16491 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:06:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.049+0000 7f5d206dab80 1 -- 172.21.15.81:0/1089669618 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562859867ec0 con 0x562859990a90 2024-05-09T00:06:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.049+0000 7f5d122bc700 1 --2- 172.21.15.81:0/1089669618 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562859990a90 0x562859992eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.049+0000 7f5cf5ffb700 10 client.16491 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.049+0000 7f5d122bc700 1 --2- 172.21.15.81:0/1089669618 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562859990a90 0x562859992eb0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8359ee2d7ce273ee server_cookie=d077915df1f6857f in_seq=0 out_seq=0 2024-05-09T00:06:54.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.049+0000 7f5cf5ffb700 1 -- 172.21.15.81:0/1089669618 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x562859867ec0 con 0x562859990a90 2024-05-09T00:06:54.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.049+0000 7f5cf5ffb700 10 client.16491 handle_command_reply: tid=0 2024-05-09T00:06:54.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.049+0000 7f5d206dab80 1 client.16491 shutdown 2024-05-09T00:06:54.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d206dab80 1 -- 172.21.15.81:0/1089669618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 msgr2=0x56285992efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d206dab80 1 --2- 172.21.15.81:0/1089669618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x56285992efd0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5d08097f50 tx=0x7f5d080a1e20 comp rx=0 tx=0).stop 2024-05-09T00:06:54.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d206dab80 1 -- 172.21.15.81:0/1089669618 shutdown_connections 2024-05-09T00:06:54.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d206dab80 1 --2- 172.21.15.81:0/1089669618 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562859990a90 0x562859992eb0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d206dab80 1 --2- 172.21.15.81:0/1089669618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56285991f890 0x56285992ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d206dab80 1 --2- 172.21.15.81:0/1089669618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562859925720 0x56285992f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5cf5ffb700 0 client.16491 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:54.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d206dab80 1 --2- 172.21.15.81:0/1089669618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562859924e00 0x56285992efd0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d206dab80 1 -- 172.21.15.81:0/1089669618 >> 172.21.15.81:0/1089669618 conn(0x56285987d210 msgr2=0x562859923b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d206dab80 1 -- 172.21.15.81:0/1089669618 shutdown_connections 2024-05-09T00:06:54.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d206dab80 1 -- 172.21.15.81:0/1089669618 wait complete. 2024-05-09T00:06:54.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d206dab80 20 client.16491 trim_cache size 0 max 16384 2024-05-09T00:06:54.055 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:06:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:06:54.055 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:06:54.056 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:06:54.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d14520700 1 -- 172.21.15.81:0/2890282484 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5cf80a1310 msgr2=0x7f5cf80a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d14520700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5cf80a1310 0x7f5cf80a37d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c067bb0 tx=0x7f5cfc009190 comp rx=0 tx=0).stop 2024-05-09T00:06:54.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d14520700 1 -- 172.21.15.81:0/2890282484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d0c100ab0 msgr2=0x7f5d0c197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d14520700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d0c100ab0 0x7f5d0c197b00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800d950 tx=0x7f5d0800dc60 comp rx=0 tx=0).stop 2024-05-09T00:06:54.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d14520700 1 -- 172.21.15.81:0/2890282484 shutdown_connections 2024-05-09T00:06:54.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d14520700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5cf80a1310 0x7f5cf80a37d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d14520700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5d0c105f90 0x7f5d0c19bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d14520700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5d0c1000f0 0x7f5d0c1975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d14520700 1 --2- 172.21.15.81:0/2890282484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d0c100ab0 0x7f5d0c197b00 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d14520700 1 -- 172.21.15.81:0/2890282484 >> 172.21.15.81:0/2890282484 conn(0x7f5d0c076ba0 msgr2=0x7f5d0c1041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d14520700 1 -- 172.21.15.81:0/2890282484 shutdown_connections 2024-05-09T00:06:54.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.050+0000 7f5d14520700 1 -- 172.21.15.81:0/2890282484 wait complete. 2024-05-09T00:06:54.059 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:06:54.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:06:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.187+0000 7fb645d41700 1 -- 172.21.15.81:0/31270630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb640105070 msgr2=0x7fb64010cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.187+0000 7fb645d41700 1 --2- 172.21.15.81:0/31270630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb640105070 0x7fb64010cbf0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb63800b0a0 tx=0x7fb63800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.187+0000 7fb645d41700 1 -- 172.21.15.81:0/31270630 shutdown_connections 2024-05-09T00:06:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.187+0000 7fb645d41700 1 --2- 172.21.15.81:0/31270630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb640105070 0x7fb64010cbf0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.187+0000 7fb645d41700 1 --2- 172.21.15.81:0/31270630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6400fff50 0x7fb640100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.187+0000 7fb645d41700 1 --2- 172.21.15.81:0/31270630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb640100900 0x7fb640104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.187+0000 7fb645d41700 1 -- 172.21.15.81:0/31270630 >> 172.21.15.81:0/31270630 conn(0x7fb6400fb810 msgr2=0x7fb6400fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.187+0000 7fb645d41700 1 -- 172.21.15.81:0/31270630 shutdown_connections 2024-05-09T00:06:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.187+0000 7fb645d41700 1 -- 172.21.15.81:0/31270630 wait complete. 2024-05-09T00:06:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.188+0000 7fb645d41700 1 Processor -- start 2024-05-09T00:06:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.188+0000 7fb645d41700 1 -- start start 2024-05-09T00:06:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.188+0000 7fb645d41700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6400fff50 0x7fb6401019e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.188+0000 7fb645d41700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb640105070 0x7fb640101f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.188+0000 7fb645d41700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6401036a0 0x7fb6401024a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.188+0000 7fb645d41700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6401aa050 con 0x7fb6400fff50 2024-05-09T00:06:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.188+0000 7fb645d41700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6401aa1c0 con 0x7fb640105070 2024-05-09T00:06:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.188+0000 7fb645d41700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6401aa380 con 0x7fb6401036a0 2024-05-09T00:06:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.188+0000 7fb63f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6400fff50 0x7fb6401019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.188+0000 7fb63f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6400fff50 0x7fb6401019e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33700/0 (socket says 172.21.15.81:33700) 2024-05-09T00:06:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.188+0000 7fb63f7fe700 1 -- 172.21.15.81:0/1504927228 learned_addr learned my addr 172.21.15.81:0/1504927228 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb63ffff700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6401036a0 0x7fb6401024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb63effd700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb640105070 0x7fb640101f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb63f7fe700 1 -- 172.21.15.81:0/1504927228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6401036a0 msgr2=0x7fb6401024a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb63f7fe700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6401036a0 0x7fb6401024a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb63f7fe700 1 -- 172.21.15.81:0/1504927228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb640105070 msgr2=0x7fb640101f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb63f7fe700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb640105070 0x7fb640101f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb63f7fe700 1 -- 172.21.15.81:0/1504927228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb630009520 con 0x7fb6400fff50 2024-05-09T00:06:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb63ffff700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6401036a0 0x7fb6401024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb63effd700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb640105070 0x7fb640101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb63f7fe700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6400fff50 0x7fb6401019e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb63000eb30 tx=0x7fb63000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb63cff9700 1 -- 172.21.15.81:0/1504927228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630009880 con 0x7fb6400fff50 2024-05-09T00:06:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb63cff9700 1 -- 172.21.15.81:0/1504927228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6300044e0 con 0x7fb6400fff50 2024-05-09T00:06:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb645d41700 1 -- 172.21.15.81:0/1504927228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb638009d00 con 0x7fb6400fff50 2024-05-09T00:06:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb63cff9700 1 -- 172.21.15.81:0/1504927228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630010430 con 0x7fb6400fff50 2024-05-09T00:06:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.189+0000 7fb645d41700 1 -- 172.21.15.81:0/1504927228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6401aaa30 con 0x7fb6400fff50 2024-05-09T00:06:54.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.190+0000 7fb645d41700 1 -- 172.21.15.81:0/1504927228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb640109350 con 0x7fb6400fff50 2024-05-09T00:06:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.191+0000 7fb63cff9700 1 -- 172.21.15.81:0/1504927228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fb630003ee0 con 0x7fb6400fff50 2024-05-09T00:06:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.192+0000 7fb63cff9700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb62c0a1310 0x7fb62c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.192+0000 7fb63effd700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb62c0a1310 0x7fb62c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.192+0000 7fb63cff9700 1 -- 172.21.15.81:0/1504927228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb630014070 con 0x7fb6400fff50 2024-05-09T00:06:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.192+0000 7fb63effd700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb62c0a1310 0x7fb62c0a37d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb640103110 tx=0x7fb628009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.195+0000 7fb63cff9700 1 -- 172.21.15.81:0/1504927228 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb630096700 con 0x7fb6400fff50 2024-05-09T00:06:54.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.439+0000 7fb645d41700 1 -- 172.21.15.81:0/1504927228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb640101420 con 0x7fb6400fff50 2024-05-09T00:06:54.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.440+0000 7fb63cff9700 1 -- 172.21.15.81:0/1504927228 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7fb630004190 con 0x7fb6400fff50 2024-05-09T00:06:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:06:54.435 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:06:54.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.442+0000 7fb645d41700 1 -- 172.21.15.81:0/1504927228 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb62c0a1310 msgr2=0x7fb62c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.442+0000 7fb645d41700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb62c0a1310 0x7fb62c0a37d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb640103110 tx=0x7fb628009260 comp rx=0 tx=0).stop 2024-05-09T00:06:54.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.442+0000 7fb645d41700 1 -- 172.21.15.81:0/1504927228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6400fff50 msgr2=0x7fb6401019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.442+0000 7fb645d41700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6400fff50 0x7fb6401019e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb63000eb30 tx=0x7fb63000eef0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.442+0000 7fb645d41700 1 -- 172.21.15.81:0/1504927228 shutdown_connections 2024-05-09T00:06:54.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.442+0000 7fb645d41700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb62c0a1310 0x7fb62c0a37d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.442+0000 7fb645d41700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb6401036a0 0x7fb6401024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.442+0000 7fb645d41700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6400fff50 0x7fb6401019e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.442+0000 7fb645d41700 1 --2- 172.21.15.81:0/1504927228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb640105070 0x7fb640101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.442+0000 7fb645d41700 1 -- 172.21.15.81:0/1504927228 >> 172.21.15.81:0/1504927228 conn(0x7fb6400fb810 msgr2=0x7fb640069600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.442+0000 7fb645d41700 1 -- 172.21.15.81:0/1504927228 shutdown_connections 2024-05-09T00:06:54.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.442+0000 7fb645d41700 1 -- 172.21.15.81:0/1504927228 wait complete. 2024-05-09T00:06:54.438 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:06:54.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:06:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.578+0000 7f2730391700 1 -- 172.21.15.81:0/4070226775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2728100a10 msgr2=0x7f2728104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.578+0000 7f2730391700 1 --2- 172.21.15.81:0/4070226775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2728100a10 0x7f2728104a50 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2724009990 tx=0x7f2724009ca0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.578+0000 7f2730391700 1 -- 172.21.15.81:0/4070226775 shutdown_connections 2024-05-09T00:06:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.578+0000 7f2730391700 1 --2- 172.21.15.81:0/4070226775 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2728100060 0x7f2728100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.578+0000 7f2730391700 1 --2- 172.21.15.81:0/4070226775 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2728105180 0x7f272810cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.578+0000 7f2730391700 1 --2- 172.21.15.81:0/4070226775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2728100a10 0x7f2728104a50 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.578+0000 7f2730391700 1 -- 172.21.15.81:0/4070226775 >> 172.21.15.81:0/4070226775 conn(0x7f2728076f70 msgr2=0x7f2728077380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.578+0000 7f2730391700 1 -- 172.21.15.81:0/4070226775 shutdown_connections 2024-05-09T00:06:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.579+0000 7f2730391700 1 -- 172.21.15.81:0/4070226775 wait complete. 2024-05-09T00:06:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.579+0000 7f2730391700 1 Processor -- start 2024-05-09T00:06:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.579+0000 7f2730391700 1 -- start start 2024-05-09T00:06:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.579+0000 7f2730391700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2728100060 0x7f2728196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.579+0000 7f2730391700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2728105180 0x7f2728196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.579+0000 7f2730391700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f272819abf0 0x7f272819b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.579+0000 7f2730391700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272819b670 con 0x7f2728100060 2024-05-09T00:06:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.579+0000 7f2730391700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272819b7e0 con 0x7f272819abf0 2024-05-09T00:06:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.579+0000 7f2730391700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272819b9a0 con 0x7f2728105180 2024-05-09T00:06:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.579+0000 7f272e12d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2728100060 0x7f2728196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.579+0000 7f272e12d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2728100060 0x7f2728196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33716/0 (socket says 172.21.15.81:33716) 2024-05-09T00:06:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.579+0000 7f272e12d700 1 -- 172.21.15.81:0/1376624762 learned_addr learned my addr 172.21.15.81:0/1376624762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f272e92e700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f272819abf0 0x7f272819b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f272d92c700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2728105180 0x7f2728196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f272e12d700 1 -- 172.21.15.81:0/1376624762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2728105180 msgr2=0x7f2728196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f272e12d700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2728105180 0x7f2728196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f272e12d700 1 -- 172.21.15.81:0/1376624762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f272819abf0 msgr2=0x7f272819b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f272e12d700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f272819abf0 0x7f272819b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f272e12d700 1 -- 172.21.15.81:0/1376624762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27240095f0 con 0x7f2728100060 2024-05-09T00:06:54.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f272d92c700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2728105180 0x7f2728196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:54.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f272e92e700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f272819abf0 0x7f272819b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:54.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f272e12d700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2728100060 0x7f2728196310 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2718009970 tx=0x7f2718009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f271f7fe700 1 -- 172.21.15.81:0/1376624762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718012070 con 0x7f2728100060 2024-05-09T00:06:54.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f271f7fe700 1 -- 172.21.15.81:0/1376624762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f271800d260 con 0x7f2728100060 2024-05-09T00:06:54.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f271f7fe700 1 -- 172.21.15.81:0/1376624762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718017a60 con 0x7f2728100060 2024-05-09T00:06:54.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f2730391700 1 -- 172.21.15.81:0/1376624762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27280694b0 con 0x7f2728100060 2024-05-09T00:06:54.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.580+0000 7f2730391700 1 -- 172.21.15.81:0/1376624762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2728069970 con 0x7f2728100060 2024-05-09T00:06:54.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.582+0000 7f271f7fe700 1 -- 172.21.15.81:0/1376624762 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f27180076b0 con 0x7f2728100060 2024-05-09T00:06:54.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.582+0000 7f271f7fe700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27140a1290 0x7f27140a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.583+0000 7f271f7fe700 1 -- 172.21.15.81:0/1376624762 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f27180ce0d0 con 0x7f2728100060 2024-05-09T00:06:54.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.583+0000 7f272d92c700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27140a1290 0x7f27140a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.583+0000 7f272d92c700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27140a1290 0x7f27140a3750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2724000c00 tx=0x7f2724005fb0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.583+0000 7f273c54bb80 1 Processor -- start 2024-05-09T00:06:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f273c54bb80 1 -- start start 2024-05-09T00:06:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f273c54bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e8e00 0x5589ed8e91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f273c54bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e9720 0x5589ed8e3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f273c54bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e3890 0x5589ed8e3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f273c54bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ed83a150 con 0x5589ed8e3890 2024-05-09T00:06:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f273c54bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ed837b10 con 0x5589ed8e8e00 2024-05-09T00:06:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f273c54bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ed833400 con 0x5589ed8e9720 2024-05-09T00:06:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f272e92e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e3890 0x5589ed8e3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f272e92e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e3890 0x5589ed8e3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33718/0 (socket says 172.21.15.81:33718) 2024-05-09T00:06:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f272e92e700 1 -- 172.21.15.81:0/469395321 learned_addr learned my addr 172.21.15.81:0/469395321 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f272e12d700 1 --2- 172.21.15.81:0/469395321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e8e00 0x5589ed8e91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f272d92c700 1 --2- 172.21.15.81:0/469395321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e9720 0x5589ed8e3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f272e92e700 1 -- 172.21.15.81:0/469395321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e9720 msgr2=0x5589ed8e3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f272e92e700 1 --2- 172.21.15.81:0/469395321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e9720 0x5589ed8e3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f272e92e700 1 -- 172.21.15.81:0/469395321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e8e00 msgr2=0x5589ed8e91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f272e92e700 1 --2- 172.21.15.81:0/469395321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e8e00 0x5589ed8e91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f272e92e700 1 -- 172.21.15.81:0/469395321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589ed6b43b0 con 0x5589ed8e3890 2024-05-09T00:06:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f272d92c700 1 --2- 172.21.15.81:0/469395321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e9720 0x5589ed8e3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.584+0000 7f272e92e700 1 --2- 172.21.15.81:0/469395321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e3890 0x5589ed8e3cd0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f27200085a0 tx=0x7f27200088b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d961f54bf907bc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.585+0000 7f271cda4700 1 -- 172.21.15.81:0/469395321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720003c00 con 0x5589ed8e3890 2024-05-09T00:06:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.585+0000 7f271cda4700 1 -- 172.21.15.81:0/469395321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2720010040 con 0x5589ed8e3890 2024-05-09T00:06:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.585+0000 7f271cda4700 1 -- 172.21.15.81:0/469395321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720012760 con 0x5589ed8e3890 2024-05-09T00:06:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.585+0000 7f273c54bb80 1 -- 172.21.15.81:0/469395321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e3890 msgr2=0x5589ed8e3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.585+0000 7f273c54bb80 1 --2- 172.21.15.81:0/469395321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e3890 0x5589ed8e3cd0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f27200085a0 tx=0x7f27200088b0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.585+0000 7f273c54bb80 1 -- 172.21.15.81:0/469395321 shutdown_connections 2024-05-09T00:06:54.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.585+0000 7f273c54bb80 1 --2- 172.21.15.81:0/469395321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e8e00 0x5589ed8e91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.585+0000 7f273c54bb80 1 --2- 172.21.15.81:0/469395321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e3890 0x5589ed8e3cd0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.585+0000 7f273c54bb80 1 --2- 172.21.15.81:0/469395321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e9720 0x5589ed8e3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.585+0000 7f273c54bb80 1 -- 172.21.15.81:0/469395321 >> 172.21.15.81:0/469395321 conn(0x5589ed841210 msgr2=0x5589ed8dddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.585+0000 7f273c54bb80 1 -- 172.21.15.81:0/469395321 shutdown_connections 2024-05-09T00:06:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.585+0000 7f273c54bb80 1 -- 172.21.15.81:0/469395321 wait complete. 2024-05-09T00:06:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.586+0000 7f273c54bb80 1 -- start start 2024-05-09T00:06:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.586+0000 7f273c54bb80 1 Processor -- start 2024-05-09T00:06:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.586+0000 7f273c54bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e3890 0x5589ed8ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.586+0000 7f273c54bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e8e00 0x5589ed8eca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.586+0000 7f273c54bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e9720 0x5589ed8ed170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.586+0000 7f273c54bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ed7cf560 con 0x5589ed8e8e00 2024-05-09T00:06:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.586+0000 7f273c54bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ed7cf200 con 0x5589ed8e9720 2024-05-09T00:06:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.586+0000 7f273c54bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ed6b66a0 con 0x5589ed8e3890 2024-05-09T00:06:54.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.586+0000 7f273c54bb80 10 client.0 _ll_register_callbacks cb 0x5589ed7d8b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.586+0000 7f272d92c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e8e00 0x5589ed8eca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.586+0000 7f272d92c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e8e00 0x5589ed8eca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33728/0 (socket says 172.21.15.81:33728) 2024-05-09T00:06:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.586+0000 7f272d92c700 1 -- 172.21.15.81:0/4210352461 learned_addr learned my addr 172.21.15.81:0/4210352461 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f272e92e700 1 --2- 172.21.15.81:0/4210352461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e9720 0x5589ed8ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f272e12d700 1 --2- 172.21.15.81:0/4210352461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e3890 0x5589ed8ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f272d92c700 1 -- 172.21.15.81:0/4210352461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e3890 msgr2=0x5589ed8ef7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f272d92c700 1 --2- 172.21.15.81:0/4210352461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e3890 0x5589ed8ef7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f272d92c700 1 -- 172.21.15.81:0/4210352461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e9720 msgr2=0x5589ed8ed170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f272d92c700 1 --2- 172.21.15.81:0/4210352461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e9720 0x5589ed8ed170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f272d92c700 1 -- 172.21.15.81:0/4210352461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2720007dd0 con 0x5589ed8e8e00 2024-05-09T00:06:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f272e92e700 1 --2- 172.21.15.81:0/4210352461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e9720 0x5589ed8ed170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f272d92c700 1 --2- 172.21.15.81:0/4210352461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e8e00 0x5589ed8eca30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2724009990 tx=0x7f2724009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d88fbc7a2a69ba server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f2711ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:54.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f2711ffb700 1 -- 172.21.15.81:0/4210352461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724005460 con 0x5589ed8e8e00 2024-05-09T00:06:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f273c54bb80 1 -- 172.21.15.81:0/4210352461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589ed78c270 con 0x5589ed8e8e00 2024-05-09T00:06:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f2711ffb700 1 -- 172.21.15.81:0/4210352461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f272400f840 con 0x5589ed8e8e00 2024-05-09T00:06:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f2711ffb700 1 -- 172.21.15.81:0/4210352461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f272400fa00 con 0x5589ed8e8e00 2024-05-09T00:06:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f273c54bb80 10 client.16509 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f273c54bb80 1 -- 172.21.15.81:0/4210352461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5589ed660b60 con 0x5589ed8e8e00 2024-05-09T00:06:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f2711ffb700 1 -- 172.21.15.81:0/4210352461 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f272403c080 con 0x5589ed8e8e00 2024-05-09T00:06:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f2711ffb700 1 -- 172.21.15.81:0/4210352461 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2724036030 con 0x5589ed8e8e00 2024-05-09T00:06:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f273c54bb80 10 client.16509 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f273c54bb80 10 client.16509 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:06:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f273c54bb80 20 client.16509 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f273c54bb80 1 --2- 172.21.15.81:0/4210352461 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5589ed8fd1c0 0x5589ed8ff5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f273c54bb80 4 client.16509 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.587+0000 7f273c54bb80 1 -- 172.21.15.81:0/4210352461 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589ed8b2810 con 0x5589ed8fd1c0 2024-05-09T00:06:54.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.588+0000 7f272e12d700 1 --2- 172.21.15.81:0/4210352461 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5589ed8fd1c0 0x5589ed8ff5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.588+0000 7f2711ffb700 10 client.16509 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:06:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.588+0000 7f272e12d700 1 --2- 172.21.15.81:0/4210352461 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5589ed8fd1c0 0x5589ed8ff5e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d3141f074fb537ac server_cookie=ef20683334b3ff29 in_seq=0 out_seq=0 2024-05-09T00:06:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f2711ffb700 1 -- 172.21.15.81:0/4210352461 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5589ed8b2810 con 0x5589ed8fd1c0 2024-05-09T00:06:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f2711ffb700 10 client.16509 handle_command_reply: tid=0 2024-05-09T00:06:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f273c54bb80 1 client.16509 shutdown 2024-05-09T00:06:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f273c54bb80 1 -- 172.21.15.81:0/4210352461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e8e00 msgr2=0x5589ed8eca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f273c54bb80 1 --2- 172.21.15.81:0/4210352461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e8e00 0x5589ed8eca30 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2724009990 tx=0x7f2724009ca0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f273c54bb80 1 -- 172.21.15.81:0/4210352461 shutdown_connections 2024-05-09T00:06:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f273c54bb80 1 --2- 172.21.15.81:0/4210352461 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5589ed8fd1c0 0x5589ed8ff5e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f273c54bb80 1 --2- 172.21.15.81:0/4210352461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e9720 0x5589ed8ed170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f273c54bb80 1 --2- 172.21.15.81:0/4210352461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e3890 0x5589ed8ef7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f2711ffb700 0 client.16509 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:06:54.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f273c54bb80 1 --2- 172.21.15.81:0/4210352461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e8e00 0x5589ed8eca30 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f273c54bb80 1 -- 172.21.15.81:0/4210352461 >> 172.21.15.81:0/4210352461 conn(0x5589ed841210 msgr2=0x5589ed8dd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f273c54bb80 1 -- 172.21.15.81:0/4210352461 shutdown_connections 2024-05-09T00:06:54.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f273c54bb80 1 -- 172.21.15.81:0/4210352461 wait complete. 2024-05-09T00:06:54.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.589+0000 7f273c54bb80 20 client.16509 trim_cache size 0 max 16384 2024-05-09T00:06:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.602+0000 7f273c54bb80 1 Processor -- start 2024-05-09T00:06:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.602+0000 7f273c54bb80 1 -- start start 2024-05-09T00:06:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f273c54bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e3890 0x5589ed8ed110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f273c54bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e8e00 0x5589ed8f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f273c54bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e9720 0x5589ed8df640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f273c54bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ed8eaf80 con 0x5589ed8e9720 2024-05-09T00:06:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f273c54bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ed8e4230 con 0x5589ed8e3890 2024-05-09T00:06:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f273c54bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ed8d6040 con 0x5589ed8e8e00 2024-05-09T00:06:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f272e92e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e9720 0x5589ed8df640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f272e92e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e9720 0x5589ed8df640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33740/0 (socket says 172.21.15.81:33740) 2024-05-09T00:06:54.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f272e92e700 1 -- 172.21.15.81:0/3396761022 learned_addr learned my addr 172.21.15.81:0/3396761022 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f272e92e700 1 -- 172.21.15.81:0/3396761022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e8e00 msgr2=0x5589ed8f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f272e92e700 1 --2- 172.21.15.81:0/3396761022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e8e00 0x5589ed8f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f272e92e700 1 -- 172.21.15.81:0/3396761022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e3890 msgr2=0x5589ed8ed110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f272e12d700 1 --2- 172.21.15.81:0/3396761022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e3890 0x5589ed8ed110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f272e92e700 1 --2- 172.21.15.81:0/3396761022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e3890 0x5589ed8ed110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f272e92e700 1 -- 172.21.15.81:0/3396761022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589ed7f9560 con 0x5589ed8e9720 2024-05-09T00:06:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f272e92e700 1 --2- 172.21.15.81:0/3396761022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e9720 0x5589ed8df640 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2720008f90 tx=0x7f2720007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0c08a421ea2255 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f271d5a5700 1 -- 172.21.15.81:0/3396761022 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2720012700 con 0x5589ed8e9720 2024-05-09T00:06:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f271d5a5700 1 -- 172.21.15.81:0/3396761022 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2720012d20 con 0x5589ed8e9720 2024-05-09T00:06:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.603+0000 7f271d5a5700 1 -- 172.21.15.81:0/3396761022 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272001ed00 con 0x5589ed8e9720 2024-05-09T00:06:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.604+0000 7f273c54bb80 1 -- 172.21.15.81:0/3396761022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e9720 msgr2=0x5589ed8df640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.604+0000 7f273c54bb80 1 --2- 172.21.15.81:0/3396761022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e9720 0x5589ed8df640 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2720008f90 tx=0x7f2720007770 comp rx=0 tx=0).stop 2024-05-09T00:06:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.604+0000 7f273c54bb80 1 -- 172.21.15.81:0/3396761022 shutdown_connections 2024-05-09T00:06:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.604+0000 7f273c54bb80 1 --2- 172.21.15.81:0/3396761022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e3890 0x5589ed8ed110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.604+0000 7f273c54bb80 1 --2- 172.21.15.81:0/3396761022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e9720 0x5589ed8df640 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.604+0000 7f273c54bb80 1 --2- 172.21.15.81:0/3396761022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e8e00 0x5589ed8f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.604+0000 7f273c54bb80 1 -- 172.21.15.81:0/3396761022 >> 172.21.15.81:0/3396761022 conn(0x5589ed841210 msgr2=0x5589ed8da210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.604+0000 7f273c54bb80 1 -- 172.21.15.81:0/3396761022 shutdown_connections 2024-05-09T00:06:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.604+0000 7f273c54bb80 1 -- 172.21.15.81:0/3396761022 wait complete. 2024-05-09T00:06:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.604+0000 7f273c54bb80 1 -- start start 2024-05-09T00:06:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.604+0000 7f273c54bb80 1 Processor -- start 2024-05-09T00:06:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.604+0000 7f273c54bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e3890 0x5589ed8f4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.604+0000 7f273c54bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e8e00 0x5589ed8f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f273c54bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e9720 0x5589ed8e49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f273c54bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ed8e4ee0 con 0x5589ed8e8e00 2024-05-09T00:06:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f273c54bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ed8e5050 con 0x5589ed8e3890 2024-05-09T00:06:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f273c54bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589ed8e5210 con 0x5589ed8e9720 2024-05-09T00:06:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f273c54bb80 10 client.0 _ll_register_callbacks cb 0x5589ed7d8b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f272d92c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e8e00 0x5589ed8f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f272d92c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e8e00 0x5589ed8f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33744/0 (socket says 172.21.15.81:33744) 2024-05-09T00:06:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f272d92c700 1 -- 172.21.15.81:0/769132423 learned_addr learned my addr 172.21.15.81:0/769132423 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f272e12d700 1 --2- 172.21.15.81:0/769132423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e3890 0x5589ed8f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f272e92e700 1 --2- 172.21.15.81:0/769132423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e9720 0x5589ed8e49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f272d92c700 1 -- 172.21.15.81:0/769132423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e9720 msgr2=0x5589ed8e49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f272d92c700 1 --2- 172.21.15.81:0/769132423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e9720 0x5589ed8e49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f272d92c700 1 -- 172.21.15.81:0/769132423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e3890 msgr2=0x5589ed8f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f272d92c700 1 --2- 172.21.15.81:0/769132423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e3890 0x5589ed8f4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f272d92c700 1 -- 172.21.15.81:0/769132423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5589ed6b43b0 con 0x5589ed8e8e00 2024-05-09T00:06:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f272e92e700 1 --2- 172.21.15.81:0/769132423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e9720 0x5589ed8e49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f272d92c700 1 --2- 172.21.15.81:0/769132423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e8e00 0x5589ed8f46b0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2724030440 tx=0x7f2724030660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7978ede37eb1f31b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f2711ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f2711ffb700 1 -- 172.21.15.81:0/769132423 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724030a90 con 0x5589ed8e8e00 2024-05-09T00:06:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f273c54bb80 1 -- 172.21.15.81:0/769132423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2720010040 con 0x5589ed8e8e00 2024-05-09T00:06:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f2711ffb700 1 -- 172.21.15.81:0/769132423 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2724030bf0 con 0x5589ed8e8e00 2024-05-09T00:06:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f2711ffb700 1 -- 172.21.15.81:0/769132423 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2724030db0 con 0x5589ed8e8e00 2024-05-09T00:06:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f273c54bb80 10 client.16515 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.605+0000 7f273c54bb80 1 -- 172.21.15.81:0/769132423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5589ed6b8cd0 con 0x5589ed8e8e00 2024-05-09T00:06:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.606+0000 7f2711ffb700 1 -- 172.21.15.81:0/769132423 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2724047020 con 0x5589ed8e8e00 2024-05-09T00:06:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.606+0000 7f2711ffb700 1 -- 172.21.15.81:0/769132423 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f27240049c0 con 0x5589ed8e8e00 2024-05-09T00:06:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.606+0000 7f273c54bb80 10 client.16515 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:54.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.606+0000 7f273c54bb80 10 client.16515 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:06:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.606+0000 7f273c54bb80 20 client.16515 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.606+0000 7f273c54bb80 1 --2- 172.21.15.81:0/769132423 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5589ed9542b0 0x5589ed9566d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.606+0000 7f273c54bb80 4 client.16515 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:06:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.606+0000 7f273c54bb80 1 -- 172.21.15.81:0/769132423 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5589ed82bec0 con 0x5589ed9542b0 2024-05-09T00:06:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.606+0000 7f272e12d700 1 --2- 172.21.15.81:0/769132423 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5589ed9542b0 0x5589ed9566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.606+0000 7f2711ffb700 10 client.16515 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:06:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.606+0000 7f272e12d700 1 --2- 172.21.15.81:0/769132423 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5589ed9542b0 0x5589ed9566d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10ab9b4822110d90 server_cookie=cd2be8c4c6d1393e in_seq=0 out_seq=0 2024-05-09T00:06:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2711ffb700 1 -- 172.21.15.81:0/769132423 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5589ed82bec0 con 0x5589ed9542b0 2024-05-09T00:06:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2711ffb700 10 client.16515 handle_command_reply: tid=0 2024-05-09T00:06:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f273c54bb80 1 client.16515 shutdown 2024-05-09T00:06:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f273c54bb80 1 -- 172.21.15.81:0/769132423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e8e00 msgr2=0x5589ed8f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f273c54bb80 1 --2- 172.21.15.81:0/769132423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e8e00 0x5589ed8f46b0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2724030440 tx=0x7f2724030660 comp rx=0 tx=0).stop 2024-05-09T00:06:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f273c54bb80 1 -- 172.21.15.81:0/769132423 shutdown_connections 2024-05-09T00:06:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f273c54bb80 1 --2- 172.21.15.81:0/769132423 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5589ed9542b0 0x5589ed9566d0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f273c54bb80 1 --2- 172.21.15.81:0/769132423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5589ed8e3890 0x5589ed8f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2711ffb700 0 client.16515 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:06:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f273c54bb80 1 --2- 172.21.15.81:0/769132423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5589ed8e9720 0x5589ed8e49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f273c54bb80 1 --2- 172.21.15.81:0/769132423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5589ed8e8e00 0x5589ed8f46b0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f273c54bb80 1 -- 172.21.15.81:0/769132423 >> 172.21.15.81:0/769132423 conn(0x5589ed841210 msgr2=0x5589ed8eb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f273c54bb80 1 -- 172.21.15.81:0/769132423 shutdown_connections 2024-05-09T00:06:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f273c54bb80 1 -- 172.21.15.81:0/769132423 wait complete. 2024-05-09T00:06:54.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f273c54bb80 20 client.16515 trim_cache size 0 max 16384 2024-05-09T00:06:54.609 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:06:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2730391700 1 -- 172.21.15.81:0/1376624762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27140a1290 msgr2=0x7f27140a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2730391700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27140a1290 0x7f27140a3750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2724000c00 tx=0x7f2724005fb0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2730391700 1 -- 172.21.15.81:0/1376624762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2728100060 msgr2=0x7f2728196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2730391700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2728100060 0x7f2728196310 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2718009970 tx=0x7f2718009d30 comp rx=0 tx=0).stop 2024-05-09T00:06:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2730391700 1 -- 172.21.15.81:0/1376624762 shutdown_connections 2024-05-09T00:06:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2730391700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27140a1290 0x7f27140a3750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2730391700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f272819abf0 0x7f272819b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2730391700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2728100060 0x7f2728196310 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2730391700 1 --2- 172.21.15.81:0/1376624762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2728105180 0x7f2728196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2730391700 1 -- 172.21.15.81:0/1376624762 >> 172.21.15.81:0/1376624762 conn(0x7f2728076f70 msgr2=0x7f2728106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2730391700 1 -- 172.21.15.81:0/1376624762 shutdown_connections 2024-05-09T00:06:54.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.607+0000 7f2730391700 1 -- 172.21.15.81:0/1376624762 wait complete. 2024-05-09T00:06:54.614 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:06:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.743+0000 7fa60c20d700 1 -- 172.21.15.81:0/3364597528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6040ffdd0 msgr2=0x7fa60410dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.743+0000 7fa60c20d700 1 --2- 172.21.15.81:0/3364597528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6040ffdd0 0x7fa60410dda0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00b0a0 tx=0x7fa5fc00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.743+0000 7fa60c20d700 1 -- 172.21.15.81:0/3364597528 shutdown_connections 2024-05-09T00:06:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.743+0000 7fa60c20d700 1 --2- 172.21.15.81:0/3364597528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6040ffdd0 0x7fa60410dda0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.743+0000 7fa60c20d700 1 --2- 172.21.15.81:0/3364597528 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa604105ef0 0x7fa6041062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.743+0000 7fa60c20d700 1 --2- 172.21.15.81:0/3364597528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6040ff410 0x7fa6040ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.743+0000 7fa60c20d700 1 -- 172.21.15.81:0/3364597528 >> 172.21.15.81:0/3364597528 conn(0x7fa6040763a0 msgr2=0x7fa6040fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.743+0000 7fa60c20d700 1 -- 172.21.15.81:0/3364597528 shutdown_connections 2024-05-09T00:06:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.743+0000 7fa60c20d700 1 -- 172.21.15.81:0/3364597528 wait complete. 2024-05-09T00:06:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa60c20d700 1 Processor -- start 2024-05-09T00:06:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa60c20d700 1 -- start start 2024-05-09T00:06:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa60c20d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6040ff410 0x7fa604197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa60c20d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6040ffdd0 0x7fa604197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa60c20d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa604105ef0 0x7fa60419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa60c20d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60419c450 con 0x7fa6040ffdd0 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa60c20d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60419c5c0 con 0x7fa6040ff410 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa60c20d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60419c780 con 0x7fa604105ef0 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa6097a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6040ffdd0 0x7fa604197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa6097a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6040ffdd0 0x7fa604197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33758/0 (socket says 172.21.15.81:33758) 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa6097a8700 1 -- 172.21.15.81:0/4087687803 learned_addr learned my addr 172.21.15.81:0/4087687803 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa60a7aa700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa604105ef0 0x7fa60419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa609fa9700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6040ff410 0x7fa604197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa6097a8700 1 -- 172.21.15.81:0/4087687803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa604105ef0 msgr2=0x7fa60419be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa6097a8700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa604105ef0 0x7fa60419be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa6097a8700 1 -- 172.21.15.81:0/4087687803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6040ff410 msgr2=0x7fa604197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa6097a8700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6040ff410 0x7fa604197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa6097a8700 1 -- 172.21.15.81:0/4087687803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc009d00 con 0x7fa6040ffdd0 2024-05-09T00:06:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa60a7aa700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa604105ef0 0x7fa60419be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.744+0000 7fa6097a8700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6040ffdd0 0x7fa604197a70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa60000d980 tx=0x7fa60000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.745+0000 7fa5faffd700 1 -- 172.21.15.81:0/4087687803 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60000bb60 con 0x7fa6040ffdd0 2024-05-09T00:06:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.745+0000 7fa60c20d700 1 -- 172.21.15.81:0/4087687803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60419ca60 con 0x7fa6040ffdd0 2024-05-09T00:06:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.745+0000 7fa5faffd700 1 -- 172.21.15.81:0/4087687803 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa600007640 con 0x7fa6040ffdd0 2024-05-09T00:06:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.745+0000 7fa5faffd700 1 -- 172.21.15.81:0/4087687803 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa600004e90 con 0x7fa6040ffdd0 2024-05-09T00:06:54.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.745+0000 7fa60c20d700 1 -- 172.21.15.81:0/4087687803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6041a42a0 con 0x7fa6040ffdd0 2024-05-09T00:06:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.747+0000 7fa5faffd700 1 -- 172.21.15.81:0/4087687803 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa60000bcc0 con 0x7fa6040ffdd0 2024-05-09T00:06:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.748+0000 7fa5faffd700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa5f00a1290 0x7fa5f00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.748+0000 7fa5faffd700 1 -- 172.21.15.81:0/4087687803 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa6000ccc60 con 0x7fa6040ffdd0 2024-05-09T00:06:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.748+0000 7fa609fa9700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa5f00a1290 0x7fa5f00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6183c7b80 1 Processor -- start 2024-05-09T00:06:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa609fa9700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa5f00a1290 0x7fa5f00a3750 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4005950 tx=0x7fa5f40058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6183c7b80 1 -- start start 2024-05-09T00:06:54.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6183c7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6183c7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe2720 0x55b8a6fdc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6183c7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fdc890 0x55b8a6fdccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6183c7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6f33150 con 0x55b8a6fe2720 2024-05-09T00:06:54.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6183c7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6f30b10 con 0x55b8a6fdc890 2024-05-09T00:06:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6183c7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6f2c400 con 0x55b8a6fe1e00 2024-05-09T00:06:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6097a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe2720 0x55b8a6fdc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6097a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe2720 0x55b8a6fdc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33764/0 (socket says 172.21.15.81:33764) 2024-05-09T00:06:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6097a8700 1 -- 172.21.15.81:0/526326746 learned_addr learned my addr 172.21.15.81:0/526326746 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6097a8700 1 -- 172.21.15.81:0/526326746 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fe1e00 msgr2=0x55b8a6fe21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6097a8700 1 --2- 172.21.15.81:0/526326746 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6097a8700 1 -- 172.21.15.81:0/526326746 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fdc890 msgr2=0x55b8a6fdccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6097a8700 1 --2- 172.21.15.81:0/526326746 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fdc890 0x55b8a6fdccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.749+0000 7fa6097a8700 1 -- 172.21.15.81:0/526326746 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8a6dad3b0 con 0x55b8a6fe2720 2024-05-09T00:06:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.750+0000 7fa6097a8700 1 --2- 172.21.15.81:0/526326746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe2720 0x55b8a6fdc350 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa6000967a0 tx=0x7fa600004870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae37f0d5fc6bdfc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.750+0000 7fa5effff700 1 -- 172.21.15.81:0/526326746 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60009db60 con 0x55b8a6fe2720 2024-05-09T00:06:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.750+0000 7fa5effff700 1 -- 172.21.15.81:0/526326746 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6000a21b0 con 0x55b8a6fe2720 2024-05-09T00:06:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.750+0000 7fa5effff700 1 -- 172.21.15.81:0/526326746 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000a1d20 con 0x55b8a6fe2720 2024-05-09T00:06:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.750+0000 7fa6183c7b80 1 -- 172.21.15.81:0/526326746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe2720 msgr2=0x55b8a6fdc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.750+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/526326746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe2720 0x55b8a6fdc350 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa6000967a0 tx=0x7fa600004870 comp rx=0 tx=0).stop 2024-05-09T00:06:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.750+0000 7fa6183c7b80 1 -- 172.21.15.81:0/526326746 shutdown_connections 2024-05-09T00:06:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.750+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/526326746 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fdc890 0x55b8a6fdccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.750+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/526326746 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.750+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/526326746 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe2720 0x55b8a6fdc350 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.750+0000 7fa6183c7b80 1 -- 172.21.15.81:0/526326746 >> 172.21.15.81:0/526326746 conn(0x55b8a6f3a210 msgr2=0x55b8a6fd6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.751+0000 7fa6183c7b80 1 -- 172.21.15.81:0/526326746 shutdown_connections 2024-05-09T00:06:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.751+0000 7fa6183c7b80 1 -- 172.21.15.81:0/526326746 wait complete. 2024-05-09T00:06:54.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.751+0000 7fa6183c7b80 1 -- start start 2024-05-09T00:06:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.751+0000 7fa6183c7b80 1 Processor -- start 2024-05-09T00:06:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.751+0000 7fa6183c7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fdc890 0x55b8a6fe5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.751+0000 7fa6183c7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.751+0000 7fa6183c7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fe2720 0x55b8a6fe6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.751+0000 7fa6183c7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6ec8560 con 0x55b8a6fe1e00 2024-05-09T00:06:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.751+0000 7fa6183c7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6ec8200 con 0x55b8a6fdc890 2024-05-09T00:06:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.751+0000 7fa6183c7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6daf6a0 con 0x55b8a6fe2720 2024-05-09T00:06:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.751+0000 7fa6183c7b80 10 client.0 _ll_register_callbacks cb 0x55b8a6ed1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.751+0000 7fa6097a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa6097a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33770/0 (socket says 172.21.15.81:33770) 2024-05-09T00:06:54.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa6097a8700 1 -- 172.21.15.81:0/4203831288 learned_addr learned my addr 172.21.15.81:0/4203831288 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa60a7aa700 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fe2720 0x55b8a6fe6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa609fa9700 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fdc890 0x55b8a6fe5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa6097a8700 1 -- 172.21.15.81:0/4203831288 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fe2720 msgr2=0x55b8a6fe6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa6097a8700 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fe2720 0x55b8a6fe6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa6097a8700 1 -- 172.21.15.81:0/4203831288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fdc890 msgr2=0x55b8a6fe5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa6097a8700 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fdc890 0x55b8a6fe5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa6097a8700 1 -- 172.21.15.81:0/4203831288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6041a42a0 con 0x55b8a6fe1e00 2024-05-09T00:06:54.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa609fa9700 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fdc890 0x55b8a6fe5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:54.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa60a7aa700 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fe2720 0x55b8a6fe6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:54.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa6097a8700 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe6040 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa600099cc0 tx=0x7fa60009dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83ff5c87d456fa4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa5ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:54.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa5ed7fa700 1 -- 172.21.15.81:0/4203831288 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60009a260 con 0x55b8a6fe1e00 2024-05-09T00:06:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa5ed7fa700 1 -- 172.21.15.81:0/4203831288 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa600099220 con 0x55b8a6fe1e00 2024-05-09T00:06:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa6183c7b80 1 -- 172.21.15.81:0/4203831288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8a6e85270 con 0x55b8a6fe1e00 2024-05-09T00:06:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa5ed7fa700 1 -- 172.21.15.81:0/4203831288 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa600099420 con 0x55b8a6fe1e00 2024-05-09T00:06:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa6183c7b80 10 client.16527 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa6183c7b80 1 -- 172.21.15.81:0/4203831288 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b8a6d59b60 con 0x55b8a6fe1e00 2024-05-09T00:06:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa5ed7fa700 1 -- 172.21.15.81:0/4203831288 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa60007c070 con 0x55b8a6fe1e00 2024-05-09T00:06:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.752+0000 7fa5ed7fa700 1 -- 172.21.15.81:0/4203831288 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa600065030 con 0x55b8a6fe1e00 2024-05-09T00:06:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.753+0000 7fa6183c7b80 10 client.16527 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.753+0000 7fa6183c7b80 10 client.16527 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:06:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.753+0000 7fa6183c7b80 20 client.16527 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:54.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.753+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b8a6ff5c50 0x55b8a6ff8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.753+0000 7fa6183c7b80 4 client.16527 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:54.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.753+0000 7fa6183c7b80 1 -- 172.21.15.81:0/4203831288 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8a6fab810 con 0x55b8a6ff5c50 2024-05-09T00:06:54.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.753+0000 7fa609fa9700 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b8a6ff5c50 0x55b8a6ff8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.753+0000 7fa5ed7fa700 10 client.16527 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:06:54.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.753+0000 7fa609fa9700 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b8a6ff5c50 0x55b8a6ff8040 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=76e30f080e553281 server_cookie=9493763be823454a in_seq=0 out_seq=0 2024-05-09T00:06:54.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa5ed7fa700 1 -- 172.21.15.81:0/4203831288 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b8a6fab810 con 0x55b8a6ff5c50 2024-05-09T00:06:54.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa5ed7fa700 10 client.16527 handle_command_reply: tid=0 2024-05-09T00:06:54.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa6183c7b80 1 client.16527 shutdown 2024-05-09T00:06:54.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa6183c7b80 1 -- 172.21.15.81:0/4203831288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 msgr2=0x55b8a6fe6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe6040 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa600099cc0 tx=0x7fa60009dc10 comp rx=0 tx=0).stop 2024-05-09T00:06:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa6183c7b80 1 -- 172.21.15.81:0/4203831288 shutdown_connections 2024-05-09T00:06:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b8a6ff5c50 0x55b8a6ff8040 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fdc890 0x55b8a6fe5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa5ed7fa700 0 client.16527 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:06:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fe2720 0x55b8a6fe6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/4203831288 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe6040 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa6183c7b80 1 -- 172.21.15.81:0/4203831288 >> 172.21.15.81:0/4203831288 conn(0x55b8a6f3a210 msgr2=0x55b8a6fd65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa6183c7b80 1 -- 172.21.15.81:0/4203831288 shutdown_connections 2024-05-09T00:06:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa6183c7b80 1 -- 172.21.15.81:0/4203831288 wait complete. 2024-05-09T00:06:54.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.754+0000 7fa6183c7b80 20 client.16527 trim_cache size 0 max 16384 2024-05-09T00:06:54.767 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:54 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1504927228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:06:54.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.767+0000 7fa6183c7b80 1 Processor -- start 2024-05-09T00:06:54.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.767+0000 7fa6183c7b80 1 -- start start 2024-05-09T00:06:54.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6183c7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fdc890 0x55b8a6fd6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6183c7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6183c7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fe2720 0x55b8a6fe1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6183c7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6fd3e10 con 0x55b8a6fe1e00 2024-05-09T00:06:54.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6183c7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6fdc700 con 0x55b8a6fe2720 2024-05-09T00:06:54.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6183c7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a6fcf070 con 0x55b8a6fdc890 2024-05-09T00:06:54.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6097a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6097a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33776/0 (socket says 172.21.15.81:33776) 2024-05-09T00:06:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6097a8700 1 -- 172.21.15.81:0/1574355409 learned_addr learned my addr 172.21.15.81:0/1574355409 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa60a7aa700 1 --2- 172.21.15.81:0/1574355409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fe2720 0x55b8a6fe1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6097a8700 1 -- 172.21.15.81:0/1574355409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fdc890 msgr2=0x55b8a6fd6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6097a8700 1 --2- 172.21.15.81:0/1574355409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fdc890 0x55b8a6fd6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6097a8700 1 -- 172.21.15.81:0/1574355409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fe2720 msgr2=0x55b8a6fe1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6097a8700 1 --2- 172.21.15.81:0/1574355409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fe2720 0x55b8a6fe1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6097a8700 1 -- 172.21.15.81:0/1574355409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8a6ef2560 con 0x55b8a6fe1e00 2024-05-09T00:06:54.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa6097a8700 1 --2- 172.21.15.81:0/1574355409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe0bf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa600099a30 tx=0x7fa600099920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326b0873d844848c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa5f8ff9700 1 -- 172.21.15.81:0/1574355409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60009a260 con 0x55b8a6fe1e00 2024-05-09T00:06:54.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa5f8ff9700 1 -- 172.21.15.81:0/1574355409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa60007c070 con 0x55b8a6fe1e00 2024-05-09T00:06:54.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.768+0000 7fa5f8ff9700 1 -- 172.21.15.81:0/1574355409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000b2480 con 0x55b8a6fe1e00 2024-05-09T00:06:54.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.769+0000 7fa6183c7b80 1 -- 172.21.15.81:0/1574355409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 msgr2=0x55b8a6fe0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.769+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/1574355409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe0bf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa600099a30 tx=0x7fa600099920 comp rx=0 tx=0).stop 2024-05-09T00:06:54.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.769+0000 7fa6183c7b80 1 -- 172.21.15.81:0/1574355409 shutdown_connections 2024-05-09T00:06:54.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.769+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/1574355409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fe2720 0x55b8a6fe1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.769+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/1574355409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fdc890 0x55b8a6fd6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.769+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/1574355409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6fe0bf0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.769+0000 7fa6183c7b80 1 -- 172.21.15.81:0/1574355409 >> 172.21.15.81:0/1574355409 conn(0x55b8a6f3a210 msgr2=0x55b8a6fdfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.769+0000 7fa6183c7b80 1 -- 172.21.15.81:0/1574355409 shutdown_connections 2024-05-09T00:06:54.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.769+0000 7fa6183c7b80 1 -- 172.21.15.81:0/1574355409 wait complete. 2024-05-09T00:06:54.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.769+0000 7fa6183c7b80 1 -- start start 2024-05-09T00:06:54.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.769+0000 7fa6183c7b80 1 Processor -- start 2024-05-09T00:06:54.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6183c7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fdc890 0x55b8a6fead20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6183c7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6feb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6183c7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fe2720 0x55b8a6feb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6183c7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a704b180 con 0x55b8a6fe1e00 2024-05-09T00:06:54.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6183c7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a704b2c0 con 0x55b8a6fe2720 2024-05-09T00:06:54.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6183c7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8a704b480 con 0x55b8a6fdc890 2024-05-09T00:06:54.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6183c7b80 10 client.0 _ll_register_callbacks cb 0x55b8a6ed1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:54.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6097a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6feb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6097a8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6feb260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33780/0 (socket says 172.21.15.81:33780) 2024-05-09T00:06:54.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6097a8700 1 -- 172.21.15.81:0/3817583959 learned_addr learned my addr 172.21.15.81:0/3817583959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa60a7aa700 1 --2- 172.21.15.81:0/3817583959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fe2720 0x55b8a6feb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6097a8700 1 -- 172.21.15.81:0/3817583959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fdc890 msgr2=0x55b8a6fead20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa609fa9700 1 --2- 172.21.15.81:0/3817583959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fdc890 0x55b8a6fead20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6097a8700 1 --2- 172.21.15.81:0/3817583959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fdc890 0x55b8a6fead20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6097a8700 1 -- 172.21.15.81:0/3817583959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fe2720 msgr2=0x55b8a6feb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6097a8700 1 --2- 172.21.15.81:0/3817583959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fe2720 0x55b8a6feb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6097a8700 1 -- 172.21.15.81:0/3817583959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b8a6d59b60 con 0x55b8a6fe1e00 2024-05-09T00:06:54.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6097a8700 1 --2- 172.21.15.81:0/3817583959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6feb260 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa60000b540 tx=0x7fa60009dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29a5a6c5ce71161 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa5ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:54.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa5ed7fa700 1 -- 172.21.15.81:0/3817583959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000cacd0 con 0x55b8a6fe1e00 2024-05-09T00:06:54.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa5ed7fa700 1 -- 172.21.15.81:0/3817583959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa6000a1d20 con 0x55b8a6fe1e00 2024-05-09T00:06:54.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.770+0000 7fa6183c7b80 1 -- 172.21.15.81:0/3817583959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa6000a21b0 con 0x55b8a6fe1e00 2024-05-09T00:06:54.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.771+0000 7fa5ed7fa700 1 -- 172.21.15.81:0/3817583959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6000a1ee0 con 0x55b8a6fe1e00 2024-05-09T00:06:54.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.771+0000 7fa6183c7b80 10 client.16533 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:54.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.771+0000 7fa6183c7b80 1 -- 172.21.15.81:0/3817583959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b8a6db1cd0 con 0x55b8a6fe1e00 2024-05-09T00:06:54.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.771+0000 7fa5ed7fa700 1 -- 172.21.15.81:0/3817583959 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6000a21b0 con 0x55b8a6fe1e00 2024-05-09T00:06:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.771+0000 7fa5ed7fa700 1 -- 172.21.15.81:0/3817583959 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa6000992b0 con 0x55b8a6fe1e00 2024-05-09T00:06:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.771+0000 7fa6183c7b80 10 client.16533 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.771+0000 7fa6183c7b80 10 client.16533 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:06:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.771+0000 7fa6183c7b80 20 client.16533 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.771+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/3817583959 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b8a704c730 0x55b8a704eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.771+0000 7fa6183c7b80 4 client.16533 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:06:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.771+0000 7fa6183c7b80 1 -- 172.21.15.81:0/3817583959 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b8a6f24ec0 con 0x55b8a704c730 2024-05-09T00:06:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.771+0000 7fa609fa9700 1 --2- 172.21.15.81:0/3817583959 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b8a704c730 0x55b8a704eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa609fa9700 1 --2- 172.21.15.81:0/3817583959 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b8a704c730 0x55b8a704eb20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dee93252442c387d server_cookie=cc1a31f26724e972 in_seq=0 out_seq=0 2024-05-09T00:06:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa5ed7fa700 10 client.16533 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:06:54.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa5ed7fa700 1 -- 172.21.15.81:0/3817583959 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b8a6f24ec0 con 0x55b8a704c730 2024-05-09T00:06:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa5ed7fa700 10 client.16533 handle_command_reply: tid=0 2024-05-09T00:06:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa6183c7b80 1 client.16533 shutdown 2024-05-09T00:06:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa6183c7b80 1 -- 172.21.15.81:0/3817583959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 msgr2=0x55b8a6feb260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/3817583959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6feb260 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa60000b540 tx=0x7fa60009dc10 comp rx=0 tx=0).stop 2024-05-09T00:06:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa6183c7b80 1 -- 172.21.15.81:0/3817583959 shutdown_connections 2024-05-09T00:06:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/3817583959 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b8a704c730 0x55b8a704eb20 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/3817583959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b8a6fe2720 0x55b8a6feb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/3817583959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b8a6fdc890 0x55b8a6fead20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa6183c7b80 1 --2- 172.21.15.81:0/3817583959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b8a6fe1e00 0x55b8a6feb260 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa5ed7fa700 0 client.16533 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:06:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa6183c7b80 1 -- 172.21.15.81:0/3817583959 >> 172.21.15.81:0/3817583959 conn(0x55b8a6f3a210 msgr2=0x55b8a6fe0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa6183c7b80 1 -- 172.21.15.81:0/3817583959 shutdown_connections 2024-05-09T00:06:54.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa6183c7b80 1 -- 172.21.15.81:0/3817583959 wait complete. 2024-05-09T00:06:54.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.772+0000 7fa6183c7b80 20 client.16533 trim_cache size 0 max 16384 2024-05-09T00:06:54.784 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:06:54.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.773+0000 7fa60c20d700 1 -- 172.21.15.81:0/4087687803 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa5f00a1290 msgr2=0x7fa5f00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.773+0000 7fa60c20d700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa5f00a1290 0x7fa5f00a3750 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa5f4005950 tx=0x7fa5f40058e0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.773+0000 7fa60c20d700 1 -- 172.21.15.81:0/4087687803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6040ffdd0 msgr2=0x7fa604197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.773+0000 7fa60c20d700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6040ffdd0 0x7fa604197a70 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fa60000d980 tx=0x7fa60000dd40 comp rx=0 tx=0).stop 2024-05-09T00:06:54.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.773+0000 7fa60c20d700 1 -- 172.21.15.81:0/4087687803 shutdown_connections 2024-05-09T00:06:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.773+0000 7fa60c20d700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa5f00a1290 0x7fa5f00a3750 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.773+0000 7fa60c20d700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa6040ff410 0x7fa604197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.773+0000 7fa60c20d700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa604105ef0 0x7fa60419be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.773+0000 7fa60c20d700 1 --2- 172.21.15.81:0/4087687803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6040ffdd0 0x7fa604197a70 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.773+0000 7fa60c20d700 1 -- 172.21.15.81:0/4087687803 >> 172.21.15.81:0/4087687803 conn(0x7fa6040763a0 msgr2=0x7fa604103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.773+0000 7fa60c20d700 1 -- 172.21.15.81:0/4087687803 shutdown_connections 2024-05-09T00:06:54.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.773+0000 7fa60c20d700 1 -- 172.21.15.81:0/4087687803 wait complete. 2024-05-09T00:06:54.786 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:54 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1504927228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:06:54.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:06:54.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:54 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1504927228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:06:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.918+0000 7f43d4515700 1 -- 172.21.15.81:0/235062735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc106290 msgr2=0x7f43cc10de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.918+0000 7f43d4515700 1 --2- 172.21.15.81:0/235062735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc106290 0x7f43cc10de10 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f43c400b0d0 tx=0x7f43c400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.918+0000 7f43d4515700 1 -- 172.21.15.81:0/235062735 shutdown_connections 2024-05-09T00:06:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.918+0000 7f43d4515700 1 --2- 172.21.15.81:0/235062735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc106290 0x7f43cc10de10 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.918+0000 7f43d4515700 1 --2- 172.21.15.81:0/235062735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43cc0682e0 0x7f43cc0686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.918+0000 7f43d4515700 1 --2- 172.21.15.81:0/235062735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43cc068c90 0x7f43cc105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.918+0000 7f43d4515700 1 -- 172.21.15.81:0/235062735 >> 172.21.15.81:0/235062735 conn(0x7f43cc076f40 msgr2=0x7f43cc077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.918+0000 7f43d4515700 1 -- 172.21.15.81:0/235062735 shutdown_connections 2024-05-09T00:06:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.918+0000 7f43d4515700 1 -- 172.21.15.81:0/235062735 wait complete. 2024-05-09T00:06:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.918+0000 7f43d4515700 1 Processor -- start 2024-05-09T00:06:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.918+0000 7f43d4515700 1 -- start start 2024-05-09T00:06:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d4515700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43cc0682e0 0x7f43cc1975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d4515700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc106290 0x7f43cc197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d4515700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43cc19be90 0x7f43cc19c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d4515700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc19c910 con 0x7f43cc106290 2024-05-09T00:06:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d4515700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc19ca80 con 0x7f43cc0682e0 2024-05-09T00:06:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d4515700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43cc19cc40 con 0x7f43cc19be90 2024-05-09T00:06:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d1ab0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc106290 0x7f43cc197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d1ab0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc106290 0x7f43cc197af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33796/0 (socket says 172.21.15.81:33796) 2024-05-09T00:06:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d1ab0700 1 -- 172.21.15.81:0/2371917326 learned_addr learned my addr 172.21.15.81:0/2371917326 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d22b1700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43cc0682e0 0x7f43cc1975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d2ab2700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43cc19be90 0x7f43cc19c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d1ab0700 1 -- 172.21.15.81:0/2371917326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43cc19be90 msgr2=0x7f43cc19c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d1ab0700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43cc19be90 0x7f43cc19c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d1ab0700 1 -- 172.21.15.81:0/2371917326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43cc0682e0 msgr2=0x7f43cc1975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d1ab0700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43cc0682e0 0x7f43cc1975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d1ab0700 1 -- 172.21.15.81:0/2371917326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4009d00 con 0x7f43cc106290 2024-05-09T00:06:54.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d2ab2700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43cc19be90 0x7f43cc19c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:54.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d1ab0700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc106290 0x7f43cc197af0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f43c800e970 tx=0x7f43c800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43c37fe700 1 -- 172.21.15.81:0/2371917326 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8009790 con 0x7f43cc106290 2024-05-09T00:06:54.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43c37fe700 1 -- 172.21.15.81:0/2371917326 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43c800eec0 con 0x7f43cc106290 2024-05-09T00:06:54.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d4515700 1 -- 172.21.15.81:0/2371917326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43cc1a41a0 con 0x7f43cc106290 2024-05-09T00:06:54.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43c37fe700 1 -- 172.21.15.81:0/2371917326 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8005590 con 0x7f43cc106290 2024-05-09T00:06:54.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.919+0000 7f43d4515700 1 -- 172.21.15.81:0/2371917326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc1a46d0 con 0x7f43cc106290 2024-05-09T00:06:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.922+0000 7f43c37fe700 1 -- 172.21.15.81:0/2371917326 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f43c800cbd0 con 0x7f43cc106290 2024-05-09T00:06:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.922+0000 7f43c37fe700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f43b80a1310 0x7f43b80a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.922+0000 7f43c37fe700 1 -- 172.21.15.81:0/2371917326 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f43c8014070 con 0x7f43cc106290 2024-05-09T00:06:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.922+0000 7f43d22b1700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f43b80a1310 0x7f43b80a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.923+0000 7f43d22b1700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f43b80a1310 0x7f43b80a37d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009a10 tx=0x7f43bc009190 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.923+0000 7f43e06cfb80 1 Processor -- start 2024-05-09T00:06:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.923+0000 7f43e06cfb80 1 -- start start 2024-05-09T00:06:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.923+0000 7f43e06cfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9ce00 0x563c81e9d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.923+0000 7f43e06cfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e9d720 0x563c81e97350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43e06cfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e97890 0x563c81e97cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43e06cfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81dee150 con 0x563c81e97890 2024-05-09T00:06:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43e06cfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81debb10 con 0x563c81e9d720 2024-05-09T00:06:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43e06cfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81de7400 con 0x563c81e9ce00 2024-05-09T00:06:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43d2ab2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e97890 0x563c81e97cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43d2ab2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e97890 0x563c81e97cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33810/0 (socket says 172.21.15.81:33810) 2024-05-09T00:06:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43d2ab2700 1 -- 172.21.15.81:0/1571500981 learned_addr learned my addr 172.21.15.81:0/1571500981 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43d2ab2700 1 -- 172.21.15.81:0/1571500981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9ce00 msgr2=0x563c81e9d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43d22b1700 1 --2- 172.21.15.81:0/1571500981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9ce00 0x563c81e9d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43d1ab0700 1 --2- 172.21.15.81:0/1571500981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e9d720 0x563c81e97350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43d2ab2700 1 --2- 172.21.15.81:0/1571500981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9ce00 0x563c81e9d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43d2ab2700 1 -- 172.21.15.81:0/1571500981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e9d720 msgr2=0x563c81e97350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43d2ab2700 1 --2- 172.21.15.81:0/1571500981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e9d720 0x563c81e97350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43d2ab2700 1 -- 172.21.15.81:0/1571500981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c81c683b0 con 0x563c81e97890 2024-05-09T00:06:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43d1ab0700 1 --2- 172.21.15.81:0/1571500981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e9d720 0x563c81e97350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43d2ab2700 1 --2- 172.21.15.81:0/1571500981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e97890 0x563c81e97cd0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009cb0 tx=0x7f43c40092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2785604aacfef0e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43c0ff9700 1 -- 172.21.15.81:0/1571500981 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c400e030 con 0x563c81e97890 2024-05-09T00:06:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43c0ff9700 1 -- 172.21.15.81:0/1571500981 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43c4007d00 con 0x563c81e97890 2024-05-09T00:06:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.924+0000 7f43c0ff9700 1 -- 172.21.15.81:0/1571500981 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4007790 con 0x563c81e97890 2024-05-09T00:06:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.925+0000 7f43e06cfb80 1 -- 172.21.15.81:0/1571500981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e97890 msgr2=0x563c81e97cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.925+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/1571500981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e97890 0x563c81e97cd0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009cb0 tx=0x7f43c40092e0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.925+0000 7f43e06cfb80 1 -- 172.21.15.81:0/1571500981 shutdown_connections 2024-05-09T00:06:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.925+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/1571500981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e97890 0x563c81e97cd0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.925+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/1571500981 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9ce00 0x563c81e9d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.925+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/1571500981 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e9d720 0x563c81e97350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.925+0000 7f43e06cfb80 1 -- 172.21.15.81:0/1571500981 >> 172.21.15.81:0/1571500981 conn(0x563c81df5210 msgr2=0x563c81e91df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.925+0000 7f43e06cfb80 1 -- 172.21.15.81:0/1571500981 shutdown_connections 2024-05-09T00:06:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.925+0000 7f43e06cfb80 1 -- 172.21.15.81:0/1571500981 wait complete. 2024-05-09T00:06:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.925+0000 7f43e06cfb80 1 -- start start 2024-05-09T00:06:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.925+0000 7f43e06cfb80 1 Processor -- start 2024-05-09T00:06:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43e06cfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e97890 0x563c81ea0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43e06cfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e9ce00 0x563c81ea1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43e06cfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 0x563c81ea1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43e06cfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81d83560 con 0x563c81e9ce00 2024-05-09T00:06:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43e06cfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81d83200 con 0x563c81e97890 2024-05-09T00:06:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43e06cfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81c6a6a0 con 0x563c81e9d720 2024-05-09T00:06:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43e06cfb80 10 client.0 _ll_register_callbacks cb 0x563c81d8cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43d1ab0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e9ce00 0x563c81ea1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43d1ab0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e9ce00 0x563c81ea1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33812/0 (socket says 172.21.15.81:33812) 2024-05-09T00:06:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43d1ab0700 1 -- 172.21.15.81:0/3820679456 learned_addr learned my addr 172.21.15.81:0/3820679456 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43d2ab2700 1 --2- 172.21.15.81:0/3820679456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 0x563c81ea1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43d22b1700 1 --2- 172.21.15.81:0/3820679456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e97890 0x563c81ea0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43d1ab0700 1 -- 172.21.15.81:0/3820679456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 msgr2=0x563c81ea1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43d1ab0700 1 --2- 172.21.15.81:0/3820679456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 0x563c81ea1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43d1ab0700 1 -- 172.21.15.81:0/3820679456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e97890 msgr2=0x563c81ea0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43d1ab0700 1 --2- 172.21.15.81:0/3820679456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e97890 0x563c81ea0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43d1ab0700 1 -- 172.21.15.81:0/3820679456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43cc10e650 con 0x563c81e9ce00 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43d22b1700 1 --2- 172.21.15.81:0/3820679456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e97890 0x563c81ea0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43d1ab0700 1 --2- 172.21.15.81:0/3820679456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e9ce00 0x563c81ea1010 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f43c8099cc0 tx=0x7f43c809a800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d2f83c2c0582ca server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43b5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43b5ffb700 1 -- 172.21.15.81:0/3820679456 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c809a420 con 0x563c81e9ce00 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43b5ffb700 1 -- 172.21.15.81:0/3820679456 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f43c80994b0 con 0x563c81e9ce00 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.926+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3820679456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c81d40270 con 0x563c81e9ce00 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.927+0000 7f43b5ffb700 1 -- 172.21.15.81:0/3820679456 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43c80b8300 con 0x563c81e9ce00 2024-05-09T00:06:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.927+0000 7f43e06cfb80 10 client.16545 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.927+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3820679456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563c81c14b60 con 0x563c81e9ce00 2024-05-09T00:06:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.927+0000 7f43b5ffb700 1 -- 172.21.15.81:0/3820679456 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563c81d40270 con 0x563c81e9ce00 2024-05-09T00:06:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.927+0000 7f43b5ffb700 1 -- 172.21.15.81:0/3820679456 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f43c80b8020 con 0x563c81e9ce00 2024-05-09T00:06:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.927+0000 7f43e06cfb80 10 client.16545 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.927+0000 7f43e06cfb80 10 client.16545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.927+0000 7f43e06cfb80 20 client.16545 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.927+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/3820679456 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563c81eb1110 0x563c81eb3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.927+0000 7f43e06cfb80 4 client.16545 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.927+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3820679456 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c81e66810 con 0x563c81eb1110 2024-05-09T00:06:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.927+0000 7f43d22b1700 1 --2- 172.21.15.81:0/3820679456 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563c81eb1110 0x563c81eb3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.928+0000 7f43b5ffb700 10 client.16545 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.928+0000 7f43d22b1700 1 --2- 172.21.15.81:0/3820679456 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563c81eb1110 0x563c81eb3530 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=659812132f36a2f2 server_cookie=f6529262f4cac86b in_seq=0 out_seq=0 2024-05-09T00:06:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.928+0000 7f43b5ffb700 1 -- 172.21.15.81:0/3820679456 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563c81e66810 con 0x563c81eb1110 2024-05-09T00:06:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.928+0000 7f43b5ffb700 10 client.16545 handle_command_reply: tid=0 2024-05-09T00:06:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.928+0000 7f43e06cfb80 1 client.16545 shutdown 2024-05-09T00:06:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.928+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3820679456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e9ce00 msgr2=0x563c81ea1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.928+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/3820679456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e9ce00 0x563c81ea1010 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f43c8099cc0 tx=0x7f43c809a800 comp rx=0 tx=0).stop 2024-05-09T00:06:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.929+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3820679456 shutdown_connections 2024-05-09T00:06:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.929+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/3820679456 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563c81eb1110 0x563c81eb3530 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.929+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/3820679456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e97890 0x563c81ea0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.929+0000 7f43b5ffb700 0 client.16545 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.929+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/3820679456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 0x563c81ea1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.929+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/3820679456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e9ce00 0x563c81ea1010 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.929+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3820679456 >> 172.21.15.81:0/3820679456 conn(0x563c81df5210 msgr2=0x563c81e915a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.929+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3820679456 shutdown_connections 2024-05-09T00:06:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.929+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3820679456 wait complete. 2024-05-09T00:06:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.929+0000 7f43e06cfb80 20 client.16545 trim_cache size 0 max 16384 2024-05-09T00:06:54.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43e06cfb80 1 Processor -- start 2024-05-09T00:06:54.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43e06cfb80 1 -- start start 2024-05-09T00:06:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43e06cfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e97890 0x563c81e97350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43e06cfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e9ce00 0x563c81e91d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43e06cfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 0x563c81ea1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43e06cfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81e9d580 con 0x563c81e97890 2024-05-09T00:06:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43e06cfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81eb8760 con 0x563c81e9ce00 2024-05-09T00:06:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43e06cfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81eb0ef0 con 0x563c81e9d720 2024-05-09T00:06:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43d22b1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e97890 0x563c81e97350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43d22b1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e97890 0x563c81e97350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33826/0 (socket says 172.21.15.81:33826) 2024-05-09T00:06:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43d22b1700 1 -- 172.21.15.81:0/2192032002 learned_addr learned my addr 172.21.15.81:0/2192032002 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43d2ab2700 1 --2- 172.21.15.81:0/2192032002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 0x563c81ea1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43d1ab0700 1 --2- 172.21.15.81:0/2192032002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e9ce00 0x563c81e91d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43d22b1700 1 -- 172.21.15.81:0/2192032002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 msgr2=0x563c81ea1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43d22b1700 1 --2- 172.21.15.81:0/2192032002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 0x563c81ea1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43d22b1700 1 -- 172.21.15.81:0/2192032002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e9ce00 msgr2=0x563c81e91d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43d22b1700 1 --2- 172.21.15.81:0/2192032002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e9ce00 0x563c81e91d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.942+0000 7f43d22b1700 1 -- 172.21.15.81:0/2192032002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c81dad560 con 0x563c81e97890 2024-05-09T00:06:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.943+0000 7f43d22b1700 1 --2- 172.21.15.81:0/2192032002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e97890 0x563c81e97350 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x563c81eb3e00 tx=0x7f43bc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf4247ff943e08d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.943+0000 7f43c17fa700 1 -- 172.21.15.81:0/2192032002 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc026070 con 0x563c81e97890 2024-05-09T00:06:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.943+0000 7f43c17fa700 1 -- 172.21.15.81:0/2192032002 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43bc00ede0 con 0x563c81e97890 2024-05-09T00:06:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.943+0000 7f43c17fa700 1 -- 172.21.15.81:0/2192032002 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc021530 con 0x563c81e97890 2024-05-09T00:06:54.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.943+0000 7f43e06cfb80 1 -- 172.21.15.81:0/2192032002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e97890 msgr2=0x563c81e97350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.943+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/2192032002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e97890 0x563c81e97350 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x563c81eb3e00 tx=0x7f43bc011000 comp rx=0 tx=0).stop 2024-05-09T00:06:54.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.943+0000 7f43e06cfb80 1 -- 172.21.15.81:0/2192032002 shutdown_connections 2024-05-09T00:06:54.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.943+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/2192032002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 0x563c81ea1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.943+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/2192032002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e97890 0x563c81e97350 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.943+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/2192032002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e9ce00 0x563c81e91d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.943+0000 7f43e06cfb80 1 -- 172.21.15.81:0/2192032002 >> 172.21.15.81:0/2192032002 conn(0x563c81df5210 msgr2=0x563c81e97c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.943+0000 7f43e06cfb80 1 -- 172.21.15.81:0/2192032002 shutdown_connections 2024-05-09T00:06:54.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.943+0000 7f43e06cfb80 1 -- 172.21.15.81:0/2192032002 wait complete. 2024-05-09T00:06:54.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43e06cfb80 1 -- start start 2024-05-09T00:06:54.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43e06cfb80 1 Processor -- start 2024-05-09T00:06:54.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43e06cfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e97890 0x563c81ea8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43e06cfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e9ce00 0x563c81e99e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43e06cfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 0x563c81e989a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43e06cfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81e9a6f0 con 0x563c81e9ce00 2024-05-09T00:06:54.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43e06cfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81e98ee0 con 0x563c81e97890 2024-05-09T00:06:54.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43e06cfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c81e990a0 con 0x563c81e9d720 2024-05-09T00:06:54.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43e06cfb80 10 client.0 _ll_register_callbacks cb 0x563c81d8cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:54.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43d1ab0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e9ce00 0x563c81e99e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43d1ab0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e9ce00 0x563c81e99e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33842/0 (socket says 172.21.15.81:33842) 2024-05-09T00:06:54.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43d1ab0700 1 -- 172.21.15.81:0/3482838546 learned_addr learned my addr 172.21.15.81:0/3482838546 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:54.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43d2ab2700 1 --2- 172.21.15.81:0/3482838546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 0x563c81e989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43d22b1700 1 --2- 172.21.15.81:0/3482838546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e97890 0x563c81ea8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43d1ab0700 1 -- 172.21.15.81:0/3482838546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 msgr2=0x563c81e989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43d1ab0700 1 --2- 172.21.15.81:0/3482838546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 0x563c81e989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43d1ab0700 1 -- 172.21.15.81:0/3482838546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e97890 msgr2=0x563c81ea8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:54.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43d1ab0700 1 --2- 172.21.15.81:0/3482838546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e97890 0x563c81ea8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.944+0000 7f43d1ab0700 1 -- 172.21.15.81:0/3482838546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc01a040 con 0x563c81e9ce00 2024-05-09T00:06:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43d22b1700 1 --2- 172.21.15.81:0/3482838546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e97890 0x563c81ea8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43d1ab0700 1 --2- 172.21.15.81:0/3482838546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e9ce00 0x563c81e99e10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f43c800c5b0 tx=0x7f43c80cab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3aca00c45cf6e9b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43b5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43b5ffb700 1 -- 172.21.15.81:0/3482838546 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c8096300 con 0x563c81e9ce00 2024-05-09T00:06:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43b5ffb700 1 -- 172.21.15.81:0/3482838546 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f43c807c050 con 0x563c81e9ce00 2024-05-09T00:06:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3482838546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f43c4007d00 con 0x563c81e9ce00 2024-05-09T00:06:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43b5ffb700 1 -- 172.21.15.81:0/3482838546 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43c809a220 con 0x563c81e9ce00 2024-05-09T00:06:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43e06cfb80 10 client.16551 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3482838546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563c81c6ccd0 con 0x563c81e9ce00 2024-05-09T00:06:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43b5ffb700 1 -- 172.21.15.81:0/3482838546 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43c4007d00 con 0x563c81e9ce00 2024-05-09T00:06:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43b5ffb700 1 -- 172.21.15.81:0/3482838546 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f43c80a8050 con 0x563c81e9ce00 2024-05-09T00:06:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43e06cfb80 10 client.16551 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:54.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43e06cfb80 10 client.16551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:54.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43e06cfb80 20 client.16551 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:54.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/3482838546 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563c81f07f40 0x563c81f0a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:54.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43e06cfb80 4 client.16551 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:06:54.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.945+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3482838546 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563c81ddfec0 con 0x563c81f07f40 2024-05-09T00:06:54.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.946+0000 7f43d22b1700 1 --2- 172.21.15.81:0/3482838546 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563c81f07f40 0x563c81f0a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:54.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.946+0000 7f43d22b1700 1 --2- 172.21.15.81:0/3482838546 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563c81f07f40 0x563c81f0a360 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a8a5e799a593126 server_cookie=992f350d6fcda713 in_seq=0 out_seq=0 2024-05-09T00:06:54.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.946+0000 7f43b5ffb700 10 client.16551 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:54.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.946+0000 7f43b5ffb700 1 -- 172.21.15.81:0/3482838546 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563c81ddfec0 con 0x563c81f07f40 2024-05-09T00:06:54.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.946+0000 7f43b5ffb700 10 client.16551 handle_command_reply: tid=0 2024-05-09T00:06:54.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.946+0000 7f43e06cfb80 1 client.16551 shutdown 2024-05-09T00:06:54.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.946+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3482838546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e9ce00 msgr2=0x563c81e99e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.946+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/3482838546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e9ce00 0x563c81e99e10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f43c800c5b0 tx=0x7f43c80cab90 comp rx=0 tx=0).stop 2024-05-09T00:06:54.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3482838546 shutdown_connections 2024-05-09T00:06:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/3482838546 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563c81f07f40 0x563c81f0a360 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/3482838546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563c81e97890 0x563c81ea8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/3482838546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563c81e9d720 0x563c81e989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43b5ffb700 0 client.16551 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43e06cfb80 1 --2- 172.21.15.81:0/3482838546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563c81e9ce00 0x563c81e99e10 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3482838546 >> 172.21.15.81:0/3482838546 conn(0x563c81df5210 msgr2=0x563c81e9f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3482838546 shutdown_connections 2024-05-09T00:06:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43e06cfb80 1 -- 172.21.15.81:0/3482838546 wait complete. 2024-05-09T00:06:54.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43e06cfb80 20 client.16551 trim_cache size 0 max 16384 2024-05-09T00:06:54.948 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:06:54.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43d4515700 1 -- 172.21.15.81:0/2371917326 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f43b80a1310 msgr2=0x7f43b80a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43d4515700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f43b80a1310 0x7f43b80a37d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009a10 tx=0x7f43bc009190 comp rx=0 tx=0).stop 2024-05-09T00:06:54.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43d4515700 1 -- 172.21.15.81:0/2371917326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc106290 msgr2=0x7f43cc197af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:54.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43d4515700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc106290 0x7f43cc197af0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f43c800e970 tx=0x7f43c800ec80 comp rx=0 tx=0).stop 2024-05-09T00:06:54.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43d4515700 1 -- 172.21.15.81:0/2371917326 shutdown_connections 2024-05-09T00:06:54.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43d4515700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f43b80a1310 0x7f43b80a37d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43d4515700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f43cc0682e0 0x7f43cc1975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43d4515700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f43cc19be90 0x7f43cc19c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43d4515700 1 --2- 172.21.15.81:0/2371917326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43cc106290 0x7f43cc197af0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43d4515700 1 -- 172.21.15.81:0/2371917326 >> 172.21.15.81:0/2371917326 conn(0x7f43cc076f40 msgr2=0x7f43cc0fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43d4515700 1 -- 172.21.15.81:0/2371917326 shutdown_connections 2024-05-09T00:06:54.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:54.947+0000 7f43d4515700 1 -- 172.21.15.81:0/2371917326 wait complete. 2024-05-09T00:06:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.659+0000 7f05b6da8700 1 -- 172.21.15.81:0/3577328406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05b0105e60 msgr2=0x7f05b0106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.659+0000 7f05b6da8700 1 --2- 172.21.15.81:0/3577328406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05b0105e60 0x7f05b0106240 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f05a4009990 tx=0x7f05a4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.659+0000 7f05b6da8700 1 -- 172.21.15.81:0/3577328406 shutdown_connections 2024-05-09T00:06:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.659+0000 7f05b6da8700 1 --2- 172.21.15.81:0/3577328406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b0100760 0x7f05b010cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.659+0000 7f05b6da8700 1 --2- 172.21.15.81:0/3577328406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05b0105e60 0x7f05b0106240 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.659+0000 7f05b6da8700 1 --2- 172.21.15.81:0/3577328406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05b00ffda0 0x7f05b0100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.659+0000 7f05b6da8700 1 -- 172.21.15.81:0/3577328406 >> 172.21.15.81:0/3577328406 conn(0x7f05b0076f10 msgr2=0x7f05b0077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.659+0000 7f05b6da8700 1 -- 172.21.15.81:0/3577328406 shutdown_connections 2024-05-09T00:06:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.659+0000 7f05b6da8700 1 -- 172.21.15.81:0/3577328406 wait complete. 2024-05-09T00:06:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.660+0000 7f05b6da8700 1 Processor -- start 2024-05-09T00:06:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.660+0000 7f05b6da8700 1 -- start start 2024-05-09T00:06:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.660+0000 7f05b6da8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b00ffda0 0x7f05b01962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.660+0000 7f05b6da8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05b0100760 0x7f05b0196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.660+0000 7f05b6da8700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05b0105e60 0x7f05b019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.660+0000 7f05b6da8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b019b200 con 0x7f05b0100760 2024-05-09T00:06:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.660+0000 7f05b6da8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b019b370 con 0x7f05b00ffda0 2024-05-09T00:06:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.660+0000 7f05b6da8700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b019b530 con 0x7f05b0105e60 2024-05-09T00:06:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.660+0000 7f05affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05b0100760 0x7f05b0196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.660+0000 7f05affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05b0100760 0x7f05b0196820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33870/0 (socket says 172.21.15.81:33870) 2024-05-09T00:06:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.660+0000 7f05affff700 1 -- 172.21.15.81:0/687751550 learned_addr learned my addr 172.21.15.81:0/687751550 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.660+0000 7f05b4b44700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b00ffda0 0x7f05b01962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.661+0000 7f05b5345700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05b0105e60 0x7f05b019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.661+0000 7f05affff700 1 -- 172.21.15.81:0/687751550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05b0105e60 msgr2=0x7f05b019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.661+0000 7f05affff700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05b0105e60 0x7f05b019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.661+0000 7f05affff700 1 -- 172.21.15.81:0/687751550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b00ffda0 msgr2=0x7f05b01962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.661+0000 7f05affff700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b00ffda0 0x7f05b01962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.661+0000 7f05affff700 1 -- 172.21.15.81:0/687751550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a40095f0 con 0x7f05b0100760 2024-05-09T00:06:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.661+0000 7f05b5345700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05b0105e60 0x7f05b019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.661+0000 7f05affff700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05b0100760 0x7f05b0196820 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f059c00b530 tx=0x7f059c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.661+0000 7f05adffb700 1 -- 172.21.15.81:0/687751550 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c011830 con 0x7f05b0100760 2024-05-09T00:06:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.661+0000 7f05b6da8700 1 -- 172.21.15.81:0/687751550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b019b810 con 0x7f05b0100760 2024-05-09T00:06:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.661+0000 7f05adffb700 1 -- 172.21.15.81:0/687751550 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f059c011e50 con 0x7f05b0100760 2024-05-09T00:06:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.661+0000 7f05adffb700 1 -- 172.21.15.81:0/687751550 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0193b0 con 0x7f05b0100760 2024-05-09T00:06:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.661+0000 7f05b6da8700 1 -- 172.21.15.81:0/687751550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b01a3050 con 0x7f05b0100760 2024-05-09T00:06:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.663+0000 7f05adffb700 1 -- 172.21.15.81:0/687751550 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f059c01a670 con 0x7f05b0100760 2024-05-09T00:06:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.664+0000 7f05adffb700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f05a00a1310 0x7f05a00a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.664+0000 7f05b4b44700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f05a00a1310 0x7f05a00a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.664+0000 7f05adffb700 1 -- 172.21.15.81:0/687751550 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f059c0cc780 con 0x7f05b0100760 2024-05-09T00:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.664+0000 7f05b4b44700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f05a00a1310 0x7f05a00a37d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f05a400b5c0 tx=0x7f05a4005fd0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05c2f62b80 1 Processor -- start 2024-05-09T00:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05c2f62b80 1 -- start start 2024-05-09T00:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05c2f62b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f78950 0x558400f76f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05c2f62b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400f77480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05c2f62b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f779c0 0x558400f875d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05c2f62b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558400ece0f0 con 0x558400f78d30 2024-05-09T00:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05c2f62b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x558400ecbab0 con 0x558400f779c0 2024-05-09T00:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05c2f62b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x558400ec73a0 con 0x558400f78950 2024-05-09T00:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400f77480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400f77480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33882/0 (socket says 172.21.15.81:33882) 2024-05-09T00:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05affff700 1 -- 172.21.15.81:0/3366703228 learned_addr learned my addr 172.21.15.81:0/3366703228 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05b4b44700 1 --2- 172.21.15.81:0/3366703228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f78950 0x558400f76f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05b5345700 1 --2- 172.21.15.81:0/3366703228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f779c0 0x558400f875d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05affff700 1 -- 172.21.15.81:0/3366703228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f78950 msgr2=0x558400f76f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05affff700 1 --2- 172.21.15.81:0/3366703228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f78950 0x558400f76f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05affff700 1 -- 172.21.15.81:0/3366703228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f779c0 msgr2=0x558400f875d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05affff700 1 --2- 172.21.15.81:0/3366703228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f779c0 0x558400f875d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05affff700 1 -- 172.21.15.81:0/3366703228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558400d48350 con 0x558400f78d30 2024-05-09T00:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05b4b44700 1 --2- 172.21.15.81:0/3366703228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f78950 0x558400f76f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f05affff700 1 --2- 172.21.15.81:0/3366703228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400f77480 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f059c0998f0 tx=0x7f059c01aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c34098dc81607e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.665+0000 7f059affd700 1 -- 172.21.15.81:0/3366703228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c099960 con 0x558400f78d30 2024-05-09T00:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.666+0000 7f059affd700 1 -- 172.21.15.81:0/3366703228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f059c09d790 con 0x558400f78d30 2024-05-09T00:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.666+0000 7f059affd700 1 -- 172.21.15.81:0/3366703228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0a1950 con 0x558400f78d30 2024-05-09T00:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.666+0000 7f05c2f62b80 1 -- 172.21.15.81:0/3366703228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 msgr2=0x558400f77480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.666+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/3366703228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400f77480 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f059c0998f0 tx=0x7f059c01aa10 comp rx=0 tx=0).stop 2024-05-09T00:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.666+0000 7f05c2f62b80 1 -- 172.21.15.81:0/3366703228 shutdown_connections 2024-05-09T00:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.666+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/3366703228 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f779c0 0x558400f875d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.666+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/3366703228 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f78950 0x558400f76f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.666+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/3366703228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400f77480 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.666+0000 7f05c2f62b80 1 -- 172.21.15.81:0/3366703228 >> 172.21.15.81:0/3366703228 conn(0x558400ed51b0 msgr2=0x558400f71840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.666+0000 7f05c2f62b80 1 -- 172.21.15.81:0/3366703228 shutdown_connections 2024-05-09T00:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.666+0000 7f05c2f62b80 1 -- 172.21.15.81:0/3366703228 wait complete. 2024-05-09T00:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.667+0000 7f05c2f62b80 1 -- start start 2024-05-09T00:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.667+0000 7f05c2f62b80 1 Processor -- start 2024-05-09T00:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.667+0000 7f05c2f62b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f779c0 0x558400f84a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.667+0000 7f05c2f62b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f78950 0x558400f84f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.667+0000 7f05c2f62b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400f854a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.667+0000 7f05c2f62b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558400e63500 con 0x558400f78d30 2024-05-09T00:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.667+0000 7f05c2f62b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x558400e631a0 con 0x558400f779c0 2024-05-09T00:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.667+0000 7f05c2f62b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x558400d4a640 con 0x558400f78950 2024-05-09T00:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.667+0000 7f05c2f62b80 10 client.0 _ll_register_callbacks cb 0x558400e6cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.667+0000 7f05b5345700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400f854a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.667+0000 7f05b5345700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400f854a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33890/0 (socket says 172.21.15.81:33890) 2024-05-09T00:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.667+0000 7f05b5345700 1 -- 172.21.15.81:0/512865961 learned_addr learned my addr 172.21.15.81:0/512865961 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.667+0000 7f05affff700 1 --2- 172.21.15.81:0/512865961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f78950 0x558400f84f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.667+0000 7f05b4b44700 1 --2- 172.21.15.81:0/512865961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f779c0 0x558400f84a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f05b5345700 1 -- 172.21.15.81:0/512865961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f78950 msgr2=0x558400f84f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f05b5345700 1 --2- 172.21.15.81:0/512865961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f78950 0x558400f84f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f05b5345700 1 -- 172.21.15.81:0/512865961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f779c0 msgr2=0x558400f84a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f05b5345700 1 --2- 172.21.15.81:0/512865961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f779c0 0x558400f84a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f05b5345700 1 -- 172.21.15.81:0/512865961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b01a3050 con 0x558400f78d30 2024-05-09T00:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f05b5345700 1 --2- 172.21.15.81:0/512865961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400f854a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f05a800ea90 tx=0x7f05a800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9d4374b4fd2c75 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f058ffff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f058ffff700 1 -- 172.21.15.81:0/512865961 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800cbc0 con 0x558400f78d30 2024-05-09T00:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f058ffff700 1 -- 172.21.15.81:0/512865961 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f05a8006e40 con 0x558400f78d30 2024-05-09T00:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f05c2f62b80 1 -- 172.21.15.81:0/512865961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558400e20210 con 0x558400f78d30 2024-05-09T00:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f058ffff700 1 -- 172.21.15.81:0/512865961 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05a800cd20 con 0x558400f78d30 2024-05-09T00:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f05c2f62b80 10 client.16563 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f05c2f62b80 1 -- 172.21.15.81:0/512865961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558400cf4b00 con 0x558400f78d30 2024-05-09T00:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f058ffff700 1 -- 172.21.15.81:0/512865961 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558400e20210 con 0x558400f78d30 2024-05-09T00:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f058ffff700 1 -- 172.21.15.81:0/512865961 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f05a801a410 con 0x558400f78d30 2024-05-09T00:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f05c2f62b80 10 client.16563 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f05c2f62b80 10 client.16563 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f05c2f62b80 20 client.16563 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/512865961 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x558400f950f0 0x558400f97510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.668+0000 7f05c2f62b80 4 client.16563 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.669+0000 7f05c2f62b80 1 -- 172.21.15.81:0/512865961 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558400f467b0 con 0x558400f950f0 2024-05-09T00:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.669+0000 7f05b4b44700 1 --2- 172.21.15.81:0/512865961 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x558400f950f0 0x558400f97510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.669+0000 7f058ffff700 10 client.16563 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.669+0000 7f05b4b44700 1 --2- 172.21.15.81:0/512865961 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x558400f950f0 0x558400f97510 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77c235daffb5adb server_cookie=d3919f892cbea21b in_seq=0 out_seq=0 2024-05-09T00:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.670+0000 7f058ffff700 1 -- 172.21.15.81:0/512865961 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558400f467b0 con 0x558400f950f0 2024-05-09T00:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.670+0000 7f058ffff700 10 client.16563 handle_command_reply: tid=0 2024-05-09T00:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.670+0000 7f05c2f62b80 1 client.16563 shutdown 2024-05-09T00:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.670+0000 7f05c2f62b80 1 -- 172.21.15.81:0/512865961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 msgr2=0x558400f854a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.670+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/512865961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400f854a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f05a800ea90 tx=0x7f05a800eda0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.670+0000 7f05c2f62b80 1 -- 172.21.15.81:0/512865961 shutdown_connections 2024-05-09T00:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.670+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/512865961 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x558400f950f0 0x558400f97510 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.670+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/512865961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f779c0 0x558400f84a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.670+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/512865961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400f854a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.670+0000 7f058ffff700 0 client.16563 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.670+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/512865961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f78950 0x558400f84f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.670+0000 7f05c2f62b80 1 -- 172.21.15.81:0/512865961 >> 172.21.15.81:0/512865961 conn(0x558400ed51b0 msgr2=0x558400f75f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.670+0000 7f05c2f62b80 1 -- 172.21.15.81:0/512865961 shutdown_connections 2024-05-09T00:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.670+0000 7f05c2f62b80 1 -- 172.21.15.81:0/512865961 wait complete. 2024-05-09T00:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.671+0000 7f05c2f62b80 20 client.16563 trim_cache size 0 max 16384 2024-05-09T00:06:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.685+0000 7f05c2f62b80 1 Processor -- start 2024-05-09T00:06:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.685+0000 7f05c2f62b80 1 -- start start 2024-05-09T00:06:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.685+0000 7f05c2f62b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f779c0 0x558400f76f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.685+0000 7f05c2f62b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78950 0x558400f8bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.685+0000 7f05c2f62b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f78d30 0x558400f8c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.685+0000 7f05c2f62b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558400f9c6e0 con 0x558400f78950 2024-05-09T00:06:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.685+0000 7f05c2f62b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x558400f85f30 con 0x558400f78d30 2024-05-09T00:06:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.685+0000 7f05c2f62b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x558400f97b70 con 0x558400f779c0 2024-05-09T00:06:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.685+0000 7f05affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78950 0x558400f8bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.685+0000 7f05affff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78950 0x558400f8bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33906/0 (socket says 172.21.15.81:33906) 2024-05-09T00:06:55.686 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.685+0000 7f05affff700 1 -- 172.21.15.81:0/1940943933 learned_addr learned my addr 172.21.15.81:0/1940943933 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.686+0000 7f05b4b44700 1 --2- 172.21.15.81:0/1940943933 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f779c0 0x558400f76f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.686+0000 7f05affff700 1 -- 172.21.15.81:0/1940943933 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f779c0 msgr2=0x558400f76f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.686+0000 7f05affff700 1 --2- 172.21.15.81:0/1940943933 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f779c0 0x558400f76f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.686+0000 7f05affff700 1 -- 172.21.15.81:0/1940943933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f78d30 msgr2=0x558400f8c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.686+0000 7f05b5345700 1 --2- 172.21.15.81:0/1940943933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f78d30 0x558400f8c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.686+0000 7f05affff700 1 --2- 172.21.15.81:0/1940943933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f78d30 0x558400f8c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.686+0000 7f05affff700 1 -- 172.21.15.81:0/1940943933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558400e8d500 con 0x558400f78950 2024-05-09T00:06:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.686+0000 7f05b4b44700 1 --2- 172.21.15.81:0/1940943933 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f779c0 0x558400f76f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.686+0000 7f05b5345700 1 --2- 172.21.15.81:0/1940943933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f78d30 0x558400f8c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.686+0000 7f05affff700 1 --2- 172.21.15.81:0/1940943933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78950 0x558400f8bff0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f059c097cb0 tx=0x7f059c099860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37362c842e7167bc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.686+0000 7f059b7fe700 1 -- 172.21.15.81:0/1940943933 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0b2220 con 0x558400f78950 2024-05-09T00:06:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.686+0000 7f059b7fe700 1 -- 172.21.15.81:0/1940943933 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f059c099bc0 con 0x558400f78950 2024-05-09T00:06:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.686+0000 7f059b7fe700 1 -- 172.21.15.81:0/1940943933 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0a1950 con 0x558400f78950 2024-05-09T00:06:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 -- 172.21.15.81:0/1940943933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78950 msgr2=0x558400f8bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/1940943933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78950 0x558400f8bff0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f059c097cb0 tx=0x7f059c099860 comp rx=0 tx=0).stop 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 -- 172.21.15.81:0/1940943933 shutdown_connections 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/1940943933 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f78d30 0x558400f8c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/1940943933 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f779c0 0x558400f76f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/1940943933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78950 0x558400f8bff0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 -- 172.21.15.81:0/1940943933 >> 172.21.15.81:0/1940943933 conn(0x558400ed51b0 msgr2=0x558400f85300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 -- 172.21.15.81:0/1940943933 shutdown_connections 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 -- 172.21.15.81:0/1940943933 wait complete. 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 -- start start 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 Processor -- start 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f779c0 0x558400f8bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f78950 0x558400f8c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400fe2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558400fe3270 con 0x558400f78d30 2024-05-09T00:06:55.688 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x558400fe33e0 con 0x558400f78950 2024-05-09T00:06:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x558400fe35a0 con 0x558400f779c0 2024-05-09T00:06:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.687+0000 7f05c2f62b80 10 client.0 _ll_register_callbacks cb 0x558400e6cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f05b5345700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400fe2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f05b5345700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400fe2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33908/0 (socket says 172.21.15.81:33908) 2024-05-09T00:06:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f05b5345700 1 -- 172.21.15.81:0/1171025929 learned_addr learned my addr 172.21.15.81:0/1171025929 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f05b4b44700 1 --2- 172.21.15.81:0/1171025929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f779c0 0x558400f8bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f05affff700 1 --2- 172.21.15.81:0/1171025929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f78950 0x558400f8c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f05b5345700 1 -- 172.21.15.81:0/1171025929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f779c0 msgr2=0x558400f8bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f05b5345700 1 --2- 172.21.15.81:0/1171025929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f779c0 0x558400f8bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f05b5345700 1 -- 172.21.15.81:0/1171025929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f78950 msgr2=0x558400f8c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f05b5345700 1 --2- 172.21.15.81:0/1171025929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f78950 0x558400f8c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f05b5345700 1 -- 172.21.15.81:0/1171025929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558400d48350 con 0x558400f78d30 2024-05-09T00:06:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f05b5345700 1 --2- 172.21.15.81:0/1171025929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400fe2cc0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f05a800ea60 tx=0x7f05a8006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83c33518fac543a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:55.689 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f058ffff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f058ffff700 1 -- 172.21.15.81:0/1171025929 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800c9c0 con 0x558400f78d30 2024-05-09T00:06:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f058ffff700 1 -- 172.21.15.81:0/1171025929 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f05a800cb20 con 0x558400f78d30 2024-05-09T00:06:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f05c2f62b80 1 -- 172.21.15.81:0/1171025929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f059c09d790 con 0x558400f78d30 2024-05-09T00:06:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f058ffff700 1 -- 172.21.15.81:0/1171025929 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05a800cce0 con 0x558400f78d30 2024-05-09T00:06:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f05c2f62b80 10 client.16569 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.688+0000 7f05c2f62b80 1 -- 172.21.15.81:0/1171025929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558400d4cc70 con 0x558400f78d30 2024-05-09T00:06:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.689+0000 7f058ffff700 1 -- 172.21.15.81:0/1171025929 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05a8038020 con 0x558400f78d30 2024-05-09T00:06:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.689+0000 7f058ffff700 1 -- 172.21.15.81:0/1171025929 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f05a8033070 con 0x558400f78d30 2024-05-09T00:06:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.689+0000 7f05c2f62b80 10 client.16569 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.689+0000 7f05c2f62b80 10 client.16569 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.689+0000 7f05c2f62b80 20 client.16569 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.689+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/1171025929 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x558400febf80 0x558400fee3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.689+0000 7f05c2f62b80 4 client.16569 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:06:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.689+0000 7f05c2f62b80 1 -- 172.21.15.81:0/1171025929 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558400ebfe60 con 0x558400febf80 2024-05-09T00:06:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.689+0000 7f05b4b44700 1 --2- 172.21.15.81:0/1171025929 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x558400febf80 0x558400fee3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.689+0000 7f058ffff700 10 client.16569 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:55.691 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.689+0000 7f05b4b44700 1 --2- 172.21.15.81:0/1171025929 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x558400febf80 0x558400fee3a0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cf13bc7ef535136 server_cookie=1c0276ed5b924789 in_seq=0 out_seq=0 2024-05-09T00:06:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f058ffff700 1 -- 172.21.15.81:0/1171025929 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558400ebfe60 con 0x558400febf80 2024-05-09T00:06:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f058ffff700 10 client.16569 handle_command_reply: tid=0 2024-05-09T00:06:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f05c2f62b80 1 client.16569 shutdown 2024-05-09T00:06:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f05c2f62b80 1 -- 172.21.15.81:0/1171025929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 msgr2=0x558400fe2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/1171025929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400fe2cc0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f05a800ea60 tx=0x7f05a8006ee0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f05c2f62b80 1 -- 172.21.15.81:0/1171025929 shutdown_connections 2024-05-09T00:06:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/1171025929 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x558400febf80 0x558400fee3a0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/1171025929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558400f78d30 0x558400fe2cc0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/1171025929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558400f779c0 0x558400f8bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f058ffff700 0 client.16569 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f05c2f62b80 1 --2- 172.21.15.81:0/1171025929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558400f78950 0x558400f8c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f05c2f62b80 1 -- 172.21.15.81:0/1171025929 >> 172.21.15.81:0/1171025929 conn(0x558400ed51b0 msgr2=0x558400f861b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f05c2f62b80 1 -- 172.21.15.81:0/1171025929 shutdown_connections 2024-05-09T00:06:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f05c2f62b80 1 -- 172.21.15.81:0/1171025929 wait complete. 2024-05-09T00:06:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.705+0000 7f05c2f62b80 20 client.16569 trim_cache size 0 max 16384 2024-05-09T00:06:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:06:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:06:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:06:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:06:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.706+0000 7f05b6da8700 1 -- 172.21.15.81:0/687751550 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f05a00a1310 msgr2=0x7f05a00a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.706+0000 7f05b6da8700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f05a00a1310 0x7f05a00a37d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f05a400b5c0 tx=0x7f05a4005fd0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.706+0000 7f05b6da8700 1 -- 172.21.15.81:0/687751550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05b0100760 msgr2=0x7f05b0196820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.706+0000 7f05b6da8700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05b0100760 0x7f05b0196820 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f059c00b530 tx=0x7f059c00b840 comp rx=0 tx=0).stop 2024-05-09T00:06:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.706+0000 7f05b6da8700 1 -- 172.21.15.81:0/687751550 shutdown_connections 2024-05-09T00:06:55.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.706+0000 7f05b6da8700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f05a00a1310 0x7f05a00a37d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.706+0000 7f05b6da8700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05b00ffda0 0x7f05b01962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.706+0000 7f05b6da8700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05b0105e60 0x7f05b019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.706+0000 7f05b6da8700 1 --2- 172.21.15.81:0/687751550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05b0100760 0x7f05b0196820 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.706+0000 7f05b6da8700 1 -- 172.21.15.81:0/687751550 >> 172.21.15.81:0/687751550 conn(0x7f05b0076f10 msgr2=0x7f05b00feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.706+0000 7f05b6da8700 1 -- 172.21.15.81:0/687751550 shutdown_connections 2024-05-09T00:06:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:06:55.706+0000 7f05b6da8700 1 -- 172.21.15.81:0/687751550 wait complete. 2024-05-09T00:06:55.764 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:55 smithi150 ceph-mon[46187]: pgmap v122: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 17 op/s 2024-05-09T00:06:55.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:55 smithi171 ceph-mon[47351]: pgmap v122: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 17 op/s 2024-05-09T00:06:55.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:55 smithi081 ceph-mon[42474]: pgmap v122: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 17 op/s 2024-05-09T00:06:55.954 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:06:55.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:06:56.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.086+0000 7f42dab6c700 1 -- 172.21.15.81:0/2463256407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40ff410 msgr2=0x7f42d40ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.086+0000 7f42dab6c700 1 --2- 172.21.15.81:0/2463256407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40ff410 0x7f42d40ff890 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f42c0009990 tx=0x7f42c0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.086+0000 7f42dab6c700 1 -- 172.21.15.81:0/2463256407 shutdown_connections 2024-05-09T00:06:56.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.086+0000 7f42dab6c700 1 --2- 172.21.15.81:0/2463256407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d4105ef0 0x7f42d41062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.086+0000 7f42dab6c700 1 --2- 172.21.15.81:0/2463256407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d40ffdd0 0x7f42d410dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.086+0000 7f42dab6c700 1 --2- 172.21.15.81:0/2463256407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40ff410 0x7f42d40ff890 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.086+0000 7f42dab6c700 1 -- 172.21.15.81:0/2463256407 >> 172.21.15.81:0/2463256407 conn(0x7f42d40763a0 msgr2=0x7f42d40fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:56.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.086+0000 7f42dab6c700 1 -- 172.21.15.81:0/2463256407 shutdown_connections 2024-05-09T00:06:56.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.086+0000 7f42dab6c700 1 -- 172.21.15.81:0/2463256407 wait complete. 2024-05-09T00:06:56.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.086+0000 7f42dab6c700 1 Processor -- start 2024-05-09T00:06:56.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.086+0000 7f42dab6c700 1 -- start start 2024-05-09T00:06:56.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.086+0000 7f42dab6c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40ff410 0x7f42d41973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.086+0000 7f42dab6c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40ffdd0 0x7f42d41978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42dab6c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d4105ef0 0x7f42d419bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42dab6c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d419c2d0 con 0x7f42d40ff410 2024-05-09T00:06:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42dab6c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d419c440 con 0x7f42d40ffdd0 2024-05-09T00:06:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42dab6c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d419c600 con 0x7f42d4105ef0 2024-05-09T00:06:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d8908700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40ff410 0x7f42d41973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d8908700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40ff410 0x7f42d41973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33922/0 (socket says 172.21.15.81:33922) 2024-05-09T00:06:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d8908700 1 -- 172.21.15.81:0/3706846846 learned_addr learned my addr 172.21.15.81:0/3706846846 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d3fff700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40ffdd0 0x7f42d41978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d9109700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d4105ef0 0x7f42d419bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d8908700 1 -- 172.21.15.81:0/3706846846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d4105ef0 msgr2=0x7f42d419bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d8908700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d4105ef0 0x7f42d419bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d8908700 1 -- 172.21.15.81:0/3706846846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40ffdd0 msgr2=0x7f42d41978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d8908700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40ffdd0 0x7f42d41978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d8908700 1 -- 172.21.15.81:0/3706846846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c00095f0 con 0x7f42d40ff410 2024-05-09T00:06:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d9109700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d4105ef0 0x7f42d419bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:56.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d3fff700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40ffdd0 0x7f42d41978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:56.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d8908700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40ff410 0x7f42d41973b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c9b0 tx=0x7f42c800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:56.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d1ffb700 1 -- 172.21.15.81:0/3706846846 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8007b00 con 0x7f42d40ff410 2024-05-09T00:06:56.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42dab6c700 1 -- 172.21.15.81:0/3706846846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d419c8e0 con 0x7f42d40ff410 2024-05-09T00:06:56.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d1ffb700 1 -- 172.21.15.81:0/3706846846 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42c8007c60 con 0x7f42d40ff410 2024-05-09T00:06:56.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42d1ffb700 1 -- 172.21.15.81:0/3706846846 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8018660 con 0x7f42d40ff410 2024-05-09T00:06:56.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.087+0000 7f42dab6c700 1 -- 172.21.15.81:0/3706846846 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d41a4120 con 0x7f42d40ff410 2024-05-09T00:06:56.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.089+0000 7f42d1ffb700 1 -- 172.21.15.81:0/3706846846 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f42c8018880 con 0x7f42d40ff410 2024-05-09T00:06:56.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.090+0000 7f42d1ffb700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f42c40a1290 0x7f42c40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.090+0000 7f42d3fff700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f42c40a1290 0x7f42c40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.090+0000 7f42d1ffb700 1 -- 172.21.15.81:0/3706846846 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f42c80ccd60 con 0x7f42d40ff410 2024-05-09T00:06:56.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.091+0000 7f42d3fff700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f42c40a1290 0x7f42c40a3750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f42c0006010 tx=0x7f42c001a040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:56.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.091+0000 7f42e6d26b80 1 Processor -- start 2024-05-09T00:06:56.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.091+0000 7f42e6d26b80 1 -- start start 2024-05-09T00:06:56.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42e6d26b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c8e80 0x55f13c9c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42e6d26b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 0x55f13c9c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42e6d26b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c3910 0x55f13c9c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42e6d26b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c91a1d0 con 0x55f13c9c3910 2024-05-09T00:06:56.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42e6d26b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c917b90 con 0x55f13c9c97a0 2024-05-09T00:06:56.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42e6d26b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c913480 con 0x55f13c9c8e80 2024-05-09T00:06:56.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42d9109700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c3910 0x55f13c9c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42d9109700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c3910 0x55f13c9c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33926/0 (socket says 172.21.15.81:33926) 2024-05-09T00:06:56.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42d9109700 1 -- 172.21.15.81:0/4277479440 learned_addr learned my addr 172.21.15.81:0/4277479440 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:56.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42d3fff700 1 --2- 172.21.15.81:0/4277479440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 0x55f13c9c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42d8908700 1 --2- 172.21.15.81:0/4277479440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c8e80 0x55f13c9c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42d9109700 1 -- 172.21.15.81:0/4277479440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c8e80 msgr2=0x55f13c9c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42d9109700 1 --2- 172.21.15.81:0/4277479440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c8e80 0x55f13c9c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42d9109700 1 -- 172.21.15.81:0/4277479440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 msgr2=0x55f13c9c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42d9109700 1 --2- 172.21.15.81:0/4277479440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 0x55f13c9c33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42d9109700 1 -- 172.21.15.81:0/4277479440 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f13c794430 con 0x55f13c9c3910 2024-05-09T00:06:56.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42d8908700 1 --2- 172.21.15.81:0/4277479440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c8e80 0x55f13c9c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42d9109700 1 --2- 172.21.15.81:0/4277479440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c3910 0x55f13c9c3d50 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0087c0 tx=0x7f42cc008ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900707c33b0366a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42beffd700 1 -- 172.21.15.81:0/4277479440 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc003c00 con 0x55f13c9c3910 2024-05-09T00:06:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42beffd700 1 -- 172.21.15.81:0/4277479440 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42cc010040 con 0x55f13c9c3910 2024-05-09T00:06:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.092+0000 7f42beffd700 1 -- 172.21.15.81:0/4277479440 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc012760 con 0x55f13c9c3910 2024-05-09T00:06:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.093+0000 7f42e6d26b80 1 -- 172.21.15.81:0/4277479440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c3910 msgr2=0x55f13c9c3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.093+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/4277479440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c3910 0x55f13c9c3d50 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0087c0 tx=0x7f42cc008ad0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.093+0000 7f42e6d26b80 1 -- 172.21.15.81:0/4277479440 shutdown_connections 2024-05-09T00:06:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.093+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/4277479440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c3910 0x55f13c9c3d50 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.093+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/4277479440 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c8e80 0x55f13c9c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.093+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/4277479440 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 0x55f13c9c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.093+0000 7f42e6d26b80 1 -- 172.21.15.81:0/4277479440 >> 172.21.15.81:0/4277479440 conn(0x55f13c921290 msgr2=0x55f13c9bde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.093+0000 7f42e6d26b80 1 -- 172.21.15.81:0/4277479440 shutdown_connections 2024-05-09T00:06:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.093+0000 7f42e6d26b80 1 -- 172.21.15.81:0/4277479440 wait complete. 2024-05-09T00:06:56.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.093+0000 7f42e6d26b80 1 -- start start 2024-05-09T00:06:56.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.093+0000 7f42e6d26b80 1 Processor -- start 2024-05-09T00:06:56.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42e6d26b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c3910 0x55f13c9ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42e6d26b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c8e80 0x55f13c9cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42e6d26b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c97a0 0x55f13c9cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42e6d26b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c8af5e0 con 0x55f13c9c97a0 2024-05-09T00:06:56.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42e6d26b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c8af280 con 0x55f13c9c8e80 2024-05-09T00:06:56.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42e6d26b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c796720 con 0x55f13c9c3910 2024-05-09T00:06:56.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42e6d26b80 10 client.0 _ll_register_callbacks cb 0x55f13c8b8bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:56.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42d9109700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c97a0 0x55f13c9cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42d9109700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c97a0 0x55f13c9cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33942/0 (socket says 172.21.15.81:33942) 2024-05-09T00:06:56.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42d9109700 1 -- 172.21.15.81:0/760520908 learned_addr learned my addr 172.21.15.81:0/760520908 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:56.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42d3fff700 1 --2- 172.21.15.81:0/760520908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c8e80 0x55f13c9cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42d8908700 1 --2- 172.21.15.81:0/760520908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c3910 0x55f13c9ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42d9109700 1 -- 172.21.15.81:0/760520908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c3910 msgr2=0x55f13c9ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42d9109700 1 --2- 172.21.15.81:0/760520908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c3910 0x55f13c9ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42d9109700 1 -- 172.21.15.81:0/760520908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c8e80 msgr2=0x55f13c9cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42d9109700 1 --2- 172.21.15.81:0/760520908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c8e80 0x55f13c9cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42d9109700 1 -- 172.21.15.81:0/760520908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42cc0083f0 con 0x55f13c9c97a0 2024-05-09T00:06:56.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42d9109700 1 --2- 172.21.15.81:0/760520908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c97a0 0x55f13c9cd5d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f42cc008e20 tx=0x7f42cc012cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64d5c4268960e9f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:56.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.094+0000 7f42b3fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:56.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42b3fff700 1 -- 172.21.15.81:0/760520908 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0048e0 con 0x55f13c9c97a0 2024-05-09T00:06:56.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42b3fff700 1 -- 172.21.15.81:0/760520908 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f42cc007770 con 0x55f13c9c97a0 2024-05-09T00:06:56.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42e6d26b80 1 -- 172.21.15.81:0/760520908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f13c86c2f0 con 0x55f13c9c97a0 2024-05-09T00:06:56.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42b3fff700 1 -- 172.21.15.81:0/760520908 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42cc007d20 con 0x55f13c9c97a0 2024-05-09T00:06:56.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42e6d26b80 10 client.16581 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:56.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42e6d26b80 1 -- 172.21.15.81:0/760520908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f13c740be0 con 0x55f13c9c97a0 2024-05-09T00:06:56.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42b3fff700 1 -- 172.21.15.81:0/760520908 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f13c86c2f0 con 0x55f13c9c97a0 2024-05-09T00:06:56.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42b3fff700 1 -- 172.21.15.81:0/760520908 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f42cc01c070 con 0x55f13c9c97a0 2024-05-09T00:06:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42e6d26b80 10 client.16581 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42e6d26b80 10 client.16581 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42e6d26b80 20 client.16581 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/760520908 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f13c9dd170 0x55f13c9df560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42e6d26b80 4 client.16581 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42e6d26b80 1 -- 172.21.15.81:0/760520908 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f13c992890 con 0x55f13c9dd170 2024-05-09T00:06:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.095+0000 7f42d8908700 1 --2- 172.21.15.81:0/760520908 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f13c9dd170 0x55f13c9df560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.096+0000 7f42b3fff700 10 client.16581 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.096+0000 7f42d8908700 1 --2- 172.21.15.81:0/760520908 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f13c9dd170 0x55f13c9df560 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b2c853b630ec2f server_cookie=6beb7238ad86355 in_seq=0 out_seq=0 2024-05-09T00:06:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.096+0000 7f42b3fff700 1 -- 172.21.15.81:0/760520908 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f13c992890 con 0x55f13c9dd170 2024-05-09T00:06:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.096+0000 7f42b3fff700 10 client.16581 handle_command_reply: tid=0 2024-05-09T00:06:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.096+0000 7f42e6d26b80 1 client.16581 shutdown 2024-05-09T00:06:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.097+0000 7f42e6d26b80 1 -- 172.21.15.81:0/760520908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c97a0 msgr2=0x55f13c9cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.097+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/760520908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c97a0 0x55f13c9cd5d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f42cc008e20 tx=0x7f42cc012cc0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.097+0000 7f42e6d26b80 1 -- 172.21.15.81:0/760520908 shutdown_connections 2024-05-09T00:06:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.097+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/760520908 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f13c9dd170 0x55f13c9df560 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.097+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/760520908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c97a0 0x55f13c9cd5d0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.097+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/760520908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c3910 0x55f13c9ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.097+0000 7f42b3fff700 0 client.16581 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.097+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/760520908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c8e80 0x55f13c9cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.097+0000 7f42e6d26b80 1 -- 172.21.15.81:0/760520908 >> 172.21.15.81:0/760520908 conn(0x55f13c921290 msgr2=0x55f13c9bd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.097+0000 7f42e6d26b80 1 -- 172.21.15.81:0/760520908 shutdown_connections 2024-05-09T00:06:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.097+0000 7f42e6d26b80 1 -- 172.21.15.81:0/760520908 wait complete. 2024-05-09T00:06:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.097+0000 7f42e6d26b80 20 client.16581 trim_cache size 0 max 16384 2024-05-09T00:06:56.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.114+0000 7f42e6d26b80 1 Processor -- start 2024-05-09T00:06:56.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.114+0000 7f42e6d26b80 1 -- start start 2024-05-09T00:06:56.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.114+0000 7f42e6d26b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c3910 0x55f13c9c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.114+0000 7f42e6d26b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c8e80 0x55f13c9c8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.114+0000 7f42e6d26b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 0x55f13c9bdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.114+0000 7f42e6d26b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c992890 con 0x55f13c9c8e80 2024-05-09T00:06:56.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.114+0000 7f42e6d26b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c9dcfa0 con 0x55f13c9c97a0 2024-05-09T00:06:56.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.114+0000 7f42e6d26b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13c9cfed0 con 0x55f13c9c3910 2024-05-09T00:06:56.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.114+0000 7f42d3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c8e80 0x55f13c9c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.114+0000 7f42d3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c8e80 0x55f13c9c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33948/0 (socket says 172.21.15.81:33948) 2024-05-09T00:06:56.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.114+0000 7f42d3fff700 1 -- 172.21.15.81:0/2607450123 learned_addr learned my addr 172.21.15.81:0/2607450123 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:56.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.114+0000 7f42d8908700 1 --2- 172.21.15.81:0/2607450123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c3910 0x55f13c9c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42d3fff700 1 -- 172.21.15.81:0/2607450123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c3910 msgr2=0x55f13c9c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42d3fff700 1 --2- 172.21.15.81:0/2607450123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c3910 0x55f13c9c33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42d3fff700 1 -- 172.21.15.81:0/2607450123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 msgr2=0x55f13c9bdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42d9109700 1 --2- 172.21.15.81:0/2607450123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 0x55f13c9bdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42d3fff700 1 --2- 172.21.15.81:0/2607450123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 0x55f13c9bdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42d3fff700 1 -- 172.21.15.81:0/2607450123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f13c9ba560 con 0x55f13c9c8e80 2024-05-09T00:06:56.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42d3fff700 1 --2- 172.21.15.81:0/2607450123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c8e80 0x55f13c9c8370 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f42c0015000 tx=0x7f42c001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7a99bb021ef732 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:56.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42bf7fe700 1 -- 172.21.15.81:0/2607450123 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c002a040 con 0x55f13c9c8e80 2024-05-09T00:06:56.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42bf7fe700 1 -- 172.21.15.81:0/2607450123 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42c0003e50 con 0x55f13c9c8e80 2024-05-09T00:06:56.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42bf7fe700 1 -- 172.21.15.81:0/2607450123 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c001d040 con 0x55f13c9c8e80 2024-05-09T00:06:56.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42e6d26b80 1 -- 172.21.15.81:0/2607450123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c8e80 msgr2=0x55f13c9c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/2607450123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c8e80 0x55f13c9c8370 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f42c0015000 tx=0x7f42c001e000 comp rx=0 tx=0).stop 2024-05-09T00:06:56.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42e6d26b80 1 -- 172.21.15.81:0/2607450123 shutdown_connections 2024-05-09T00:06:56.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/2607450123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 0x55f13c9bdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/2607450123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c3910 0x55f13c9c33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.115+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/2607450123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c8e80 0x55f13c9c8370 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.116+0000 7f42e6d26b80 1 -- 172.21.15.81:0/2607450123 >> 172.21.15.81:0/2607450123 conn(0x55f13c921290 msgr2=0x55f13c9c7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.116+0000 7f42e6d26b80 1 -- 172.21.15.81:0/2607450123 shutdown_connections 2024-05-09T00:06:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.116+0000 7f42e6d26b80 1 -- 172.21.15.81:0/2607450123 wait complete. 2024-05-09T00:06:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.116+0000 7f42e6d26b80 1 -- start start 2024-05-09T00:06:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.116+0000 7f42e6d26b80 1 Processor -- start 2024-05-09T00:06:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.116+0000 7f42e6d26b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c3910 0x55f13c9d2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.116+0000 7f42e6d26b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c8e80 0x55f13c9d32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.116+0000 7f42e6d26b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 0x55f13c9d37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.116+0000 7f42e6d26b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13ca33650 con 0x55f13c9c3910 2024-05-09T00:06:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.116+0000 7f42e6d26b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13ca33790 con 0x55f13c9c97a0 2024-05-09T00:06:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42e6d26b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f13ca33950 con 0x55f13c9c8e80 2024-05-09T00:06:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42e6d26b80 10 client.0 _ll_register_callbacks cb 0x55f13c8b8bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42d8908700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c3910 0x55f13c9d2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42d8908700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c3910 0x55f13c9d2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33952/0 (socket says 172.21.15.81:33952) 2024-05-09T00:06:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42d8908700 1 -- 172.21.15.81:0/3786576508 learned_addr learned my addr 172.21.15.81:0/3786576508 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42d3fff700 1 --2- 172.21.15.81:0/3786576508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c8e80 0x55f13c9d32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42d9109700 1 --2- 172.21.15.81:0/3786576508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 0x55f13c9d37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42d8908700 1 -- 172.21.15.81:0/3786576508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c8e80 msgr2=0x55f13c9d32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42d8908700 1 --2- 172.21.15.81:0/3786576508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c8e80 0x55f13c9d32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42d8908700 1 -- 172.21.15.81:0/3786576508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 msgr2=0x55f13c9d37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42d8908700 1 --2- 172.21.15.81:0/3786576508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 0x55f13c9d37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42d8908700 1 -- 172.21.15.81:0/3786576508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d410e750 con 0x55f13c9c3910 2024-05-09T00:06:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42d9109700 1 --2- 172.21.15.81:0/3786576508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 0x55f13c9d37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42d8908700 1 --2- 172.21.15.81:0/3786576508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c3910 0x55f13c9d2d60 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f42c80ca510 tx=0x7f42c80961b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccb9c6403e2c018 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42b3fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42b3fff700 1 -- 172.21.15.81:0/3786576508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c80b8210 con 0x55f13c9c3910 2024-05-09T00:06:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42b3fff700 1 -- 172.21.15.81:0/3786576508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f42c809dca0 con 0x55f13c9c3910 2024-05-09T00:06:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42e6d26b80 1 -- 172.21.15.81:0/3786576508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f42cc010040 con 0x55f13c9c3910 2024-05-09T00:06:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42b3fff700 1 -- 172.21.15.81:0/3786576508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42c80a22f0 con 0x55f13c9c3910 2024-05-09T00:06:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42e6d26b80 10 client.16587 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42e6d26b80 1 -- 172.21.15.81:0/3786576508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f13c8d95e0 con 0x55f13c9c3910 2024-05-09T00:06:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.117+0000 7f42b3fff700 1 -- 172.21.15.81:0/3786576508 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42cc010040 con 0x55f13c9c3910 2024-05-09T00:06:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.118+0000 7f42b3fff700 1 -- 172.21.15.81:0/3786576508 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f42c8065020 con 0x55f13c9c3910 2024-05-09T00:06:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.118+0000 7f42e6d26b80 10 client.16587 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.118+0000 7f42e6d26b80 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.118+0000 7f42e6d26b80 20 client.16587 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.118+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/3786576508 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f13ca35070 0x55f13ca37490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.118+0000 7f42e6d26b80 4 client.16587 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:06:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.118+0000 7f42e6d26b80 1 -- 172.21.15.81:0/3786576508 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f13c90bf40 con 0x55f13ca35070 2024-05-09T00:06:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.118+0000 7f42d3fff700 1 --2- 172.21.15.81:0/3786576508 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f13ca35070 0x55f13ca37490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.118+0000 7f42b3fff700 10 client.16587 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:56.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.118+0000 7f42d3fff700 1 --2- 172.21.15.81:0/3786576508 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f13ca35070 0x55f13ca37490 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ceb9700025edc489 server_cookie=ca8a249e3caecfea in_seq=0 out_seq=0 2024-05-09T00:06:56.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42b3fff700 1 -- 172.21.15.81:0/3786576508 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f13c90bf40 con 0x55f13ca35070 2024-05-09T00:06:56.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42b3fff700 10 client.16587 handle_command_reply: tid=0 2024-05-09T00:06:56.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42e6d26b80 1 client.16587 shutdown 2024-05-09T00:06:56.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42e6d26b80 1 -- 172.21.15.81:0/3786576508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c3910 msgr2=0x55f13c9d2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/3786576508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c3910 0x55f13c9d2d60 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f42c80ca510 tx=0x7f42c80961b0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42e6d26b80 1 -- 172.21.15.81:0/3786576508 shutdown_connections 2024-05-09T00:06:56.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/3786576508 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f13ca35070 0x55f13ca37490 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/3786576508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f13c9c97a0 0x55f13c9d37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/3786576508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f13c9c3910 0x55f13c9d2d60 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42e6d26b80 1 --2- 172.21.15.81:0/3786576508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f13c9c8e80 0x55f13c9d32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42e6d26b80 1 -- 172.21.15.81:0/3786576508 >> 172.21.15.81:0/3786576508 conn(0x55f13c921290 msgr2=0x55f13c9cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:56.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42b3fff700 0 client.16587 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:56.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42e6d26b80 1 -- 172.21.15.81:0/3786576508 shutdown_connections 2024-05-09T00:06:56.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42e6d26b80 1 -- 172.21.15.81:0/3786576508 wait complete. 2024-05-09T00:06:56.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.120+0000 7f42e6d26b80 20 client.16587 trim_cache size 0 max 16384 2024-05-09T00:06:56.122 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:06:56.122 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:06:56.122 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "551a5374-5ea1-4033-8b54-b4a3cb45349f", 2024-05-09T00:06:56.122 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:06:56.122 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:06:56.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.121+0000 7f42dab6c700 1 -- 172.21.15.81:0/3706846846 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f42c40a1290 msgr2=0x7f42c40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.121+0000 7f42dab6c700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f42c40a1290 0x7f42c40a3750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f42c0006010 tx=0x7f42c001a040 comp rx=0 tx=0).stop 2024-05-09T00:06:56.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.121+0000 7f42dab6c700 1 -- 172.21.15.81:0/3706846846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40ff410 msgr2=0x7f42d41973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.121+0000 7f42dab6c700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40ff410 0x7f42d41973b0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c9b0 tx=0x7f42c800cd70 comp rx=0 tx=0).stop 2024-05-09T00:06:56.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.121+0000 7f42dab6c700 1 -- 172.21.15.81:0/3706846846 shutdown_connections 2024-05-09T00:06:56.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.121+0000 7f42dab6c700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f42c40a1290 0x7f42c40a3750 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.121+0000 7f42dab6c700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f42d4105ef0 0x7f42d419bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.121+0000 7f42dab6c700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42d40ff410 0x7f42d41973b0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.121+0000 7f42dab6c700 1 --2- 172.21.15.81:0/3706846846 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f42d40ffdd0 0x7f42d41978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.121+0000 7f42dab6c700 1 -- 172.21.15.81:0/3706846846 >> 172.21.15.81:0/3706846846 conn(0x7f42d40763a0 msgr2=0x7f42d4103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:56.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.121+0000 7f42dab6c700 1 -- 172.21.15.81:0/3706846846 shutdown_connections 2024-05-09T00:06:56.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.121+0000 7f42dab6c700 1 -- 172.21.15.81:0/3706846846 wait complete. 2024-05-09T00:06:56.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:06:56.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.257+0000 7f9443280700 1 -- 172.21.15.81:0/3584300173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c069770 msgr2=0x7f943c069b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.257+0000 7f9443280700 1 --2- 172.21.15.81:0/3584300173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c069770 0x7f943c069b50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f9438009990 tx=0x7f9438009ca0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.257+0000 7f9443280700 1 -- 172.21.15.81:0/3584300173 shutdown_connections 2024-05-09T00:06:56.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.257+0000 7f9443280700 1 --2- 172.21.15.81:0/3584300173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f943c106280 0x7f943c10de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.257+0000 7f9443280700 1 --2- 172.21.15.81:0/3584300173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c069770 0x7f943c069b50 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.257+0000 7f9443280700 1 --2- 172.21.15.81:0/3584300173 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f943c06a120 0x7f943c105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.257+0000 7f9443280700 1 -- 172.21.15.81:0/3584300173 >> 172.21.15.81:0/3584300173 conn(0x7f943c076fa0 msgr2=0x7f943c0773b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:56.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.257+0000 7f9443280700 1 -- 172.21.15.81:0/3584300173 shutdown_connections 2024-05-09T00:06:56.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.257+0000 7f9443280700 1 -- 172.21.15.81:0/3584300173 wait complete. 2024-05-09T00:06:56.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.257+0000 7f9443280700 1 Processor -- start 2024-05-09T00:06:56.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.257+0000 7f9443280700 1 -- start start 2024-05-09T00:06:56.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f9443280700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f943c069770 0x7f943c1973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f9443280700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c106280 0x7f943c1978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f9443280700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f943c19bc30 0x7f943c19c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f9443280700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c19c6b0 con 0x7f943c106280 2024-05-09T00:06:56.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f9443280700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c19c820 con 0x7f943c19bc30 2024-05-09T00:06:56.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f9443280700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c19c9e0 con 0x7f943c069770 2024-05-09T00:06:56.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f944081b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c106280 0x7f943c1978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f944081b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c106280 0x7f943c1978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33980/0 (socket says 172.21.15.81:33980) 2024-05-09T00:06:56.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f944081b700 1 -- 172.21.15.81:0/1566156623 learned_addr learned my addr 172.21.15.81:0/1566156623 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:56.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f944081b700 1 -- 172.21.15.81:0/1566156623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f943c069770 msgr2=0x7f943c1973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f944181d700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f943c19bc30 0x7f943c19c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f944101c700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f943c069770 0x7f943c1973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f944081b700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f943c069770 0x7f943c1973a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f944081b700 1 -- 172.21.15.81:0/1566156623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f943c19bc30 msgr2=0x7f943c19c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f944081b700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f943c19bc30 0x7f943c19c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f944081b700 1 -- 172.21.15.81:0/1566156623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94380095f0 con 0x7f943c106280 2024-05-09T00:06:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f944101c700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f943c069770 0x7f943c1973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f944181d700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f943c19bc30 0x7f943c19c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f944081b700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c106280 0x7f943c1978e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f942c00d950 tx=0x7f942c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f94327fc700 1 -- 172.21.15.81:0/1566156623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c00bb60 con 0x7f943c106280 2024-05-09T00:06:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f94327fc700 1 -- 172.21.15.81:0/1566156623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f942c007620 con 0x7f943c106280 2024-05-09T00:06:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f9443280700 1 -- 172.21.15.81:0/1566156623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c1a3f40 con 0x7f943c106280 2024-05-09T00:06:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f94327fc700 1 -- 172.21.15.81:0/1566156623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c005560 con 0x7f943c106280 2024-05-09T00:06:56.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.258+0000 7f9443280700 1 -- 172.21.15.81:0/1566156623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c1a43c0 con 0x7f943c106280 2024-05-09T00:06:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.260+0000 7f94327fc700 1 -- 172.21.15.81:0/1566156623 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f942c004750 con 0x7f943c106280 2024-05-09T00:06:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.261+0000 7f94327fc700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f94280a1290 0x7f94280a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.261+0000 7f94327fc700 1 -- 172.21.15.81:0/1566156623 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f942c0cc990 con 0x7f943c106280 2024-05-09T00:06:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.261+0000 7f944101c700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f94280a1290 0x7f94280a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.262+0000 7f944101c700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f94280a1290 0x7f94280a3750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9438000c00 tx=0x7f9438005fd0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.262+0000 7f944f43ab80 1 Processor -- start 2024-05-09T00:06:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.262+0000 7f944f43ab80 1 -- start start 2024-05-09T00:06:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.262+0000 7f944f43ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e249a210 0x5628e249a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.262+0000 7f944f43ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249ab30 0x5628e2494760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.262+0000 7f944f43ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e2494ca0 0x5628e24950e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.262+0000 7f944f43ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628e23e7150 con 0x5628e249ab30 2024-05-09T00:06:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.262+0000 7f944f43ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628e23e4b10 con 0x5628e249a210 2024-05-09T00:06:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.262+0000 7f944f43ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628e23e0400 con 0x5628e2494ca0 2024-05-09T00:06:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.262+0000 7f944081b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249ab30 0x5628e2494760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.262+0000 7f944081b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249ab30 0x5628e2494760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33984/0 (socket says 172.21.15.81:33984) 2024-05-09T00:06:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.262+0000 7f944081b700 1 -- 172.21.15.81:0/888428357 learned_addr learned my addr 172.21.15.81:0/888428357 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.263+0000 7f944101c700 1 --2- 172.21.15.81:0/888428357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e249a210 0x5628e249a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.263+0000 7f944081b700 1 -- 172.21.15.81:0/888428357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e2494ca0 msgr2=0x5628e24950e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.263+0000 7f944181d700 1 --2- 172.21.15.81:0/888428357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e2494ca0 0x5628e24950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.263+0000 7f944081b700 1 --2- 172.21.15.81:0/888428357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e2494ca0 0x5628e24950e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.263+0000 7f944081b700 1 -- 172.21.15.81:0/888428357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e249a210 msgr2=0x5628e249a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.263+0000 7f944081b700 1 --2- 172.21.15.81:0/888428357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e249a210 0x5628e249a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.263+0000 7f944081b700 1 -- 172.21.15.81:0/888428357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628e22613b0 con 0x5628e249ab30 2024-05-09T00:06:56.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.263+0000 7f944101c700 1 --2- 172.21.15.81:0/888428357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e249a210 0x5628e249a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:06:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.263+0000 7f944181d700 1 --2- 172.21.15.81:0/888428357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e2494ca0 0x5628e24950e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:06:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.263+0000 7f944081b700 1 --2- 172.21.15.81:0/888428357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249ab30 0x5628e2494760 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f942c0a19f0 tx=0x7f942c0994f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0917e0e3d930079 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.263+0000 7f94277fe700 1 -- 172.21.15.81:0/888428357 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c09d8d0 con 0x5628e249ab30 2024-05-09T00:06:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.263+0000 7f94277fe700 1 -- 172.21.15.81:0/888428357 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f942c0a1f20 con 0x5628e249ab30 2024-05-09T00:06:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.263+0000 7f94277fe700 1 -- 172.21.15.81:0/888428357 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0b2210 con 0x5628e249ab30 2024-05-09T00:06:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.264+0000 7f944f43ab80 1 -- 172.21.15.81:0/888428357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249ab30 msgr2=0x5628e2494760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.264+0000 7f944f43ab80 1 --2- 172.21.15.81:0/888428357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249ab30 0x5628e2494760 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f942c0a19f0 tx=0x7f942c0994f0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.264+0000 7f944f43ab80 1 -- 172.21.15.81:0/888428357 shutdown_connections 2024-05-09T00:06:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.264+0000 7f944f43ab80 1 --2- 172.21.15.81:0/888428357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e249a210 0x5628e249a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.264+0000 7f944f43ab80 1 --2- 172.21.15.81:0/888428357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e2494ca0 0x5628e24950e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.264+0000 7f944f43ab80 1 --2- 172.21.15.81:0/888428357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249ab30 0x5628e2494760 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.264+0000 7f944f43ab80 1 -- 172.21.15.81:0/888428357 >> 172.21.15.81:0/888428357 conn(0x5628e23ee210 msgr2=0x5628e248adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.264+0000 7f944f43ab80 1 -- 172.21.15.81:0/888428357 shutdown_connections 2024-05-09T00:06:56.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.264+0000 7f944f43ab80 1 -- 172.21.15.81:0/888428357 wait complete. 2024-05-09T00:06:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.264+0000 7f944f43ab80 1 -- start start 2024-05-09T00:06:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.264+0000 7f944f43ab80 1 Processor -- start 2024-05-09T00:06:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944f43ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e2494ca0 0x5628e24a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944f43ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249a210 0x5628e249df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944f43ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e249ab30 0x5628e249e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944f43ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628e237c560 con 0x5628e249a210 2024-05-09T00:06:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944f43ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628e237c200 con 0x5628e2494ca0 2024-05-09T00:06:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944f43ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628e22636a0 con 0x5628e249ab30 2024-05-09T00:06:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944f43ab80 10 client.0 _ll_register_callbacks cb 0x5628e2385b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944081b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249a210 0x5628e249df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944081b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249a210 0x5628e249df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33988/0 (socket says 172.21.15.81:33988) 2024-05-09T00:06:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944081b700 1 -- 172.21.15.81:0/916929057 learned_addr learned my addr 172.21.15.81:0/916929057 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944181d700 1 --2- 172.21.15.81:0/916929057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e249ab30 0x5628e249e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944101c700 1 --2- 172.21.15.81:0/916929057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e2494ca0 0x5628e24a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944081b700 1 -- 172.21.15.81:0/916929057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e249ab30 msgr2=0x5628e249e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944081b700 1 --2- 172.21.15.81:0/916929057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e249ab30 0x5628e249e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944081b700 1 -- 172.21.15.81:0/916929057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e2494ca0 msgr2=0x5628e24a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944081b700 1 --2- 172.21.15.81:0/916929057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e2494ca0 0x5628e24a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944081b700 1 -- 172.21.15.81:0/916929057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c1a43c0 con 0x5628e249a210 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944081b700 1 --2- 172.21.15.81:0/916929057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249a210 0x5628e249df00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f942c012040 tx=0x7f942c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845fb71f3e621f49 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f9424ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f9424ff9700 1 -- 172.21.15.81:0/916929057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c004c00 con 0x5628e249a210 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f9424ff9700 1 -- 172.21.15.81:0/916929057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f942c09d8d0 con 0x5628e249a210 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944f43ab80 1 -- 172.21.15.81:0/916929057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628e2339270 con 0x5628e249a210 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f9424ff9700 1 -- 172.21.15.81:0/916929057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f942c0b2210 con 0x5628e249a210 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944f43ab80 10 client.16599 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.265+0000 7f944f43ab80 1 -- 172.21.15.81:0/916929057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5628e220db60 con 0x5628e249a210 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.266+0000 7f9424ff9700 1 -- 172.21.15.81:0/916929057 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5628e2339270 con 0x5628e249a210 2024-05-09T00:06:56.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.266+0000 7f9424ff9700 1 -- 172.21.15.81:0/916929057 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f942c099e50 con 0x5628e249a210 2024-05-09T00:06:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.266+0000 7f944f43ab80 10 client.16599 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.266+0000 7f944f43ab80 10 client.16599 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.266+0000 7f944f43ab80 20 client.16599 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.266+0000 7f944f43ab80 1 --2- 172.21.15.81:0/916929057 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5628e24adf20 0x5628e24b0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.266+0000 7f944f43ab80 4 client.16599 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:06:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.266+0000 7f944f43ab80 1 -- 172.21.15.81:0/916929057 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628e245f810 con 0x5628e24adf20 2024-05-09T00:06:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.266+0000 7f944101c700 1 --2- 172.21.15.81:0/916929057 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5628e24adf20 0x5628e24b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.266+0000 7f9424ff9700 10 client.16599 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.266+0000 7f944101c700 1 --2- 172.21.15.81:0/916929057 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5628e24adf20 0x5628e24b0310 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c53fe0e5b48fcda8 server_cookie=a945d0a2a7f4314b in_seq=0 out_seq=0 2024-05-09T00:06:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.267+0000 7f9424ff9700 1 -- 172.21.15.81:0/916929057 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5628e245f810 con 0x5628e24adf20 2024-05-09T00:06:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.267+0000 7f9424ff9700 10 client.16599 handle_command_reply: tid=0 2024-05-09T00:06:56.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.267+0000 7f944f43ab80 1 client.16599 shutdown 2024-05-09T00:06:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.267+0000 7f944f43ab80 1 -- 172.21.15.81:0/916929057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249a210 msgr2=0x5628e249df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.267+0000 7f944f43ab80 1 --2- 172.21.15.81:0/916929057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249a210 0x5628e249df00 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f942c012040 tx=0x7f942c00bd70 comp rx=0 tx=0).stop 2024-05-09T00:06:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.267+0000 7f944f43ab80 1 -- 172.21.15.81:0/916929057 shutdown_connections 2024-05-09T00:06:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.267+0000 7f944f43ab80 1 --2- 172.21.15.81:0/916929057 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5628e24adf20 0x5628e24b0310 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.267+0000 7f944f43ab80 1 --2- 172.21.15.81:0/916929057 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e2494ca0 0x5628e24a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.267+0000 7f9424ff9700 0 client.16599 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.267+0000 7f944f43ab80 1 --2- 172.21.15.81:0/916929057 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e249ab30 0x5628e249e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.267+0000 7f944f43ab80 1 --2- 172.21.15.81:0/916929057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249a210 0x5628e249df00 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.267+0000 7f944f43ab80 1 -- 172.21.15.81:0/916929057 >> 172.21.15.81:0/916929057 conn(0x5628e23ee210 msgr2=0x5628e248a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:56.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.267+0000 7f944f43ab80 1 -- 172.21.15.81:0/916929057 shutdown_connections 2024-05-09T00:06:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.267+0000 7f944f43ab80 1 -- 172.21.15.81:0/916929057 wait complete. 2024-05-09T00:06:56.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.268+0000 7f944f43ab80 20 client.16599 trim_cache size 0 max 16384 2024-05-09T00:06:56.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944f43ab80 1 Processor -- start 2024-05-09T00:06:56.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944f43ab80 1 -- start start 2024-05-09T00:06:56.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944f43ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e2494ca0 0x5628e248ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944f43ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249a210 0x5628e24a5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944f43ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e249ab30 0x5628e24a5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944f43ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628e24a1000 con 0x5628e249a210 2024-05-09T00:06:56.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944f43ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628e2485800 con 0x5628e249ab30 2024-05-09T00:06:56.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944f43ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628e248bf80 con 0x5628e2494ca0 2024-05-09T00:06:56.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944081b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249a210 0x5628e24a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944081b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249a210 0x5628e24a5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34002/0 (socket says 172.21.15.81:34002) 2024-05-09T00:06:56.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944081b700 1 -- 172.21.15.81:0/1549632372 learned_addr learned my addr 172.21.15.81:0/1549632372 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:56.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944181d700 1 --2- 172.21.15.81:0/1549632372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e249ab30 0x5628e24a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944101c700 1 --2- 172.21.15.81:0/1549632372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e2494ca0 0x5628e248ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944081b700 1 -- 172.21.15.81:0/1549632372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e2494ca0 msgr2=0x5628e248ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944081b700 1 --2- 172.21.15.81:0/1549632372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e2494ca0 0x5628e248ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944081b700 1 -- 172.21.15.81:0/1549632372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e249ab30 msgr2=0x5628e24a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944081b700 1 --2- 172.21.15.81:0/1549632372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e249ab30 0x5628e24a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.285+0000 7f944081b700 1 -- 172.21.15.81:0/1549632372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628e2495350 con 0x5628e249a210 2024-05-09T00:06:56.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.286+0000 7f944081b700 1 --2- 172.21.15.81:0/1549632372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249a210 0x5628e24a5450 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f942c097df0 tx=0x7f942c098050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a857abd7866dd52 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:56.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.286+0000 7f9427fff700 1 -- 172.21.15.81:0/1549632372 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c099400 con 0x5628e249a210 2024-05-09T00:06:56.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.286+0000 7f9427fff700 1 -- 172.21.15.81:0/1549632372 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f942c09d8d0 con 0x5628e249a210 2024-05-09T00:06:56.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.286+0000 7f9427fff700 1 -- 172.21.15.81:0/1549632372 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0652b0 con 0x5628e249a210 2024-05-09T00:06:56.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.286+0000 7f944f43ab80 1 -- 172.21.15.81:0/1549632372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249a210 msgr2=0x5628e24a5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.286+0000 7f944f43ab80 1 --2- 172.21.15.81:0/1549632372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249a210 0x5628e24a5450 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f942c097df0 tx=0x7f942c098050 comp rx=0 tx=0).stop 2024-05-09T00:06:56.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.286+0000 7f944f43ab80 1 -- 172.21.15.81:0/1549632372 shutdown_connections 2024-05-09T00:06:56.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.286+0000 7f944f43ab80 1 --2- 172.21.15.81:0/1549632372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e249ab30 0x5628e24a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.286+0000 7f944f43ab80 1 --2- 172.21.15.81:0/1549632372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e2494ca0 0x5628e248ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.286+0000 7f944f43ab80 1 --2- 172.21.15.81:0/1549632372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249a210 0x5628e24a5450 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.286+0000 7f944f43ab80 1 -- 172.21.15.81:0/1549632372 >> 172.21.15.81:0/1549632372 conn(0x5628e23ee210 msgr2=0x5628e24980d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.286+0000 7f944f43ab80 1 -- 172.21.15.81:0/1549632372 shutdown_connections 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.286+0000 7f944f43ab80 1 -- 172.21.15.81:0/1549632372 wait complete. 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.287+0000 7f944f43ab80 1 -- start start 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.287+0000 7f944f43ab80 1 Processor -- start 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.287+0000 7f944f43ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e2494ca0 0x5628e24a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.287+0000 7f944f43ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e249a210 0x5628e24a3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.287+0000 7f944f43ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249ab30 0x5628e24fd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.287+0000 7f944f43ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628e24fd940 con 0x5628e249ab30 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.287+0000 7f944f43ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628e24fdab0 con 0x5628e2494ca0 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.287+0000 7f944f43ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628e24fdc70 con 0x5628e249a210 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.287+0000 7f944f43ab80 10 client.0 _ll_register_callbacks cb 0x5628e2385b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.287+0000 7f944181d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249ab30 0x5628e24fd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.287+0000 7f944181d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249ab30 0x5628e24fd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34004/0 (socket says 172.21.15.81:34004) 2024-05-09T00:06:56.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.287+0000 7f944181d700 1 -- 172.21.15.81:0/847899032 learned_addr learned my addr 172.21.15.81:0/847899032 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:06:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.287+0000 7f944101c700 1 --2- 172.21.15.81:0/847899032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e2494ca0 0x5628e24a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.287+0000 7f944081b700 1 --2- 172.21.15.81:0/847899032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e249a210 0x5628e24a3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944181d700 1 -- 172.21.15.81:0/847899032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e249a210 msgr2=0x5628e24a3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944181d700 1 --2- 172.21.15.81:0/847899032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e249a210 0x5628e24a3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944181d700 1 -- 172.21.15.81:0/847899032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e2494ca0 msgr2=0x5628e24a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:06:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944181d700 1 --2- 172.21.15.81:0/847899032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e2494ca0 0x5628e24a3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944181d700 1 -- 172.21.15.81:0/847899032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628e220db60 con 0x5628e249ab30 2024-05-09T00:06:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944181d700 1 --2- 172.21.15.81:0/847899032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249ab30 0x5628e24fd3c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9434012a30 tx=0x7f9434012d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c190f2ab2032af8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:06:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f9424ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:06:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f9424ff9700 1 -- 172.21.15.81:0/847899032 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9434010b40 con 0x5628e249ab30 2024-05-09T00:06:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f9424ff9700 1 -- 172.21.15.81:0/847899032 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f943400c050 con 0x5628e249ab30 2024-05-09T00:06:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944f43ab80 1 -- 172.21.15.81:0/847899032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f942c0a1f20 con 0x5628e249ab30 2024-05-09T00:06:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f9424ff9700 1 -- 172.21.15.81:0/847899032 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9434012ed0 con 0x5628e249ab30 2024-05-09T00:06:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944f43ab80 10 client.16605 fetch_fsmap learned FSMap version 26 2024-05-09T00:06:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944f43ab80 1 -- 172.21.15.81:0/847899032 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5628e23a6560 con 0x5628e249ab30 2024-05-09T00:06:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f9424ff9700 1 -- 172.21.15.81:0/847899032 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f942c0a1f20 con 0x5628e249ab30 2024-05-09T00:06:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f9424ff9700 1 -- 172.21.15.81:0/847899032 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f943401f3b0 con 0x5628e249ab30 2024-05-09T00:06:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944f43ab80 10 client.16605 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:06:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944f43ab80 10 client.16605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:06:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944f43ab80 20 client.16605 populate_metadata read hostname 'smithi081' 2024-05-09T00:06:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944f43ab80 1 --2- 172.21.15.81:0/847899032 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5628e25055d0 0x5628e25079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:06:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944f43ab80 4 client.16605 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:06:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.288+0000 7f944f43ab80 1 -- 172.21.15.81:0/847899032 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5628e23d8ec0 con 0x5628e25055d0 2024-05-09T00:06:56.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f944101c700 1 --2- 172.21.15.81:0/847899032 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5628e25055d0 0x5628e25079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:06:56.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f9424ff9700 10 client.16605 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:56.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f944101c700 1 --2- 172.21.15.81:0/847899032 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5628e25055d0 0x5628e25079f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=561ef1883a8c09e5 server_cookie=7b4a7e01c205394a in_seq=0 out_seq=0 2024-05-09T00:06:56.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f9424ff9700 1 -- 172.21.15.81:0/847899032 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5628e23d8ec0 con 0x5628e25055d0 2024-05-09T00:06:56.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f9424ff9700 10 client.16605 handle_command_reply: tid=0 2024-05-09T00:06:56.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f944f43ab80 1 client.16605 shutdown 2024-05-09T00:06:56.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f944f43ab80 1 -- 172.21.15.81:0/847899032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249ab30 msgr2=0x5628e24fd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f944f43ab80 1 --2- 172.21.15.81:0/847899032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249ab30 0x5628e24fd3c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f9434012a30 tx=0x7f9434012d40 comp rx=0 tx=0).stop 2024-05-09T00:06:56.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f944f43ab80 1 -- 172.21.15.81:0/847899032 shutdown_connections 2024-05-09T00:06:56.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f944f43ab80 1 --2- 172.21.15.81:0/847899032 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5628e25055d0 0x5628e25079f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f944f43ab80 1 --2- 172.21.15.81:0/847899032 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5628e2494ca0 0x5628e24a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f9424ff9700 0 client.16605 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:06:56.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f944f43ab80 1 --2- 172.21.15.81:0/847899032 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5628e249ab30 0x5628e24fd3c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f944f43ab80 1 --2- 172.21.15.81:0/847899032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5628e249a210 0x5628e24a3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f944f43ab80 1 -- 172.21.15.81:0/847899032 >> 172.21.15.81:0/847899032 conn(0x5628e23ee210 msgr2=0x5628e249c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:56.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f944f43ab80 1 -- 172.21.15.81:0/847899032 shutdown_connections 2024-05-09T00:06:56.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f944f43ab80 1 -- 172.21.15.81:0/847899032 wait complete. 2024-05-09T00:06:56.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.289+0000 7f944f43ab80 20 client.16605 trim_cache size 0 max 16384 2024-05-09T00:06:56.299 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:06:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:06:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:06:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: "551a5374-5ea1-4033-8b54-b4a3cb45349f": { 2024-05-09T00:06:56.299 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:06:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "551a5374-5ea1-4033-8b54-b4a3cb45349f", 2024-05-09T00:06:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:06:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:06:56.300 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:06:56.300 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:06:56.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.290+0000 7f9443280700 1 -- 172.21.15.81:0/1566156623 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f94280a1290 msgr2=0x7f94280a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.290+0000 7f9443280700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f94280a1290 0x7f94280a3750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9438000c00 tx=0x7f9438005fd0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.290+0000 7f9443280700 1 -- 172.21.15.81:0/1566156623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c106280 msgr2=0x7f943c1978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:06:56.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.290+0000 7f9443280700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c106280 0x7f943c1978e0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f942c00d950 tx=0x7f942c00dd10 comp rx=0 tx=0).stop 2024-05-09T00:06:56.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.290+0000 7f9443280700 1 -- 172.21.15.81:0/1566156623 shutdown_connections 2024-05-09T00:06:56.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.290+0000 7f9443280700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f94280a1290 0x7f94280a3750 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.290+0000 7f9443280700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f943c19bc30 0x7f943c19c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.290+0000 7f9443280700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f943c069770 0x7f943c1973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.290+0000 7f9443280700 1 --2- 172.21.15.81:0/1566156623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f943c106280 0x7f943c1978e0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:06:56.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.290+0000 7f9443280700 1 -- 172.21.15.81:0/1566156623 >> 172.21.15.81:0/1566156623 conn(0x7f943c076fa0 msgr2=0x7f943c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:06:56.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.290+0000 7f9443280700 1 -- 172.21.15.81:0/1566156623 shutdown_connections 2024-05-09T00:06:56.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:06:56.290+0000 7f9443280700 1 -- 172.21.15.81:0/1566156623 wait complete. 2024-05-09T00:06:56.304 INFO:tasks.cephfs.filesystem:scrub status for tag:551a5374-5ea1-4033-8b54-b4a3cb45349f - {'path': '/', 'tag': '551a5374-5ea1-4033-8b54-b4a3cb45349f', 'options': 'recursive,force'} 2024-05-09T00:06:56.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:56 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:06:56.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:56 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:06:56.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:56 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:06:56.871 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:56 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:06:57.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:56 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:06:57.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:56 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:06:57.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:56 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:06:57.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:56 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:06:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:56 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:06:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:56 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:06:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:56 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:06:57.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:56 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:06:57.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:57 smithi081 ceph-mon[42474]: pgmap v123: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-05-09T00:06:58.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:57 smithi150 ceph-mon[46187]: pgmap v123: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-05-09T00:06:58.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:57 smithi171 ceph-mon[47351]: pgmap v123: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-05-09T00:06:59.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:06:59 smithi150 ceph-mon[46187]: pgmap v124: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-05-09T00:06:59.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:06:59 smithi171 ceph-mon[47351]: pgmap v124: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-05-09T00:06:59.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:06:59 smithi081 ceph-mon[42474]: pgmap v124: 97 pgs: 97 active+clean; 4.3 MiB data, 394 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 22 KiB/s wr, 9 op/s 2024-05-09T00:07:00.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:00 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:07:00.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:00 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:07:00.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:00 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:07:01.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:01 smithi150 ceph-mon[46187]: pgmap v125: 97 pgs: 97 active+clean; 4.5 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 18 op/s 2024-05-09T00:07:01.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:01 smithi171 ceph-mon[47351]: pgmap v125: 97 pgs: 97 active+clean; 4.5 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 18 op/s 2024-05-09T00:07:01.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:01 smithi081 ceph-mon[42474]: pgmap v125: 97 pgs: 97 active+clean; 4.5 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 KiB/s wr, 18 op/s 2024-05-09T00:07:03.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:03 smithi150 ceph-mon[46187]: pgmap v126: 97 pgs: 97 active+clean; 4.5 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-05-09T00:07:03.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:03 smithi171 ceph-mon[47351]: pgmap v126: 97 pgs: 97 active+clean; 4.5 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-05-09T00:07:03.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:03 smithi081 ceph-mon[42474]: pgmap v126: 97 pgs: 97 active+clean; 4.5 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-05-09T00:07:04.803 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:04 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:07:04.870 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:04 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:07:05.014 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:04 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:07:06.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:05 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:06.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:05 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:06.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:05 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:06.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:05 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:06.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:05 smithi081 ceph-mon[42474]: pgmap v127: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 60 KiB/s wr, 33 op/s 2024-05-09T00:07:06.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:05 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:07:06.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:05 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:07:06.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:05 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:06.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:05 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:06.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:05 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:06.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:05 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:06.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:05 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:06.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:05 smithi150 ceph-mon[46187]: pgmap v127: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 60 KiB/s wr, 33 op/s 2024-05-09T00:07:06.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:05 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:07:06.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:05 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:07:06.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:05 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:06.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:05 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:06.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:05 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:06.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:05 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:06.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:05 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:06.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:05 smithi171 ceph-mon[47351]: pgmap v127: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 60 KiB/s wr, 33 op/s 2024-05-09T00:07:06.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:05 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:07:06.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:05 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:07:06.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:05 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:07:07.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:07 smithi150 ceph-mon[46187]: pgmap v128: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-05-09T00:07:07.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:07 smithi171 ceph-mon[47351]: pgmap v128: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-05-09T00:07:07.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:07 smithi081 ceph-mon[42474]: pgmap v128: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-05-09T00:07:08.820 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.825+0000 7f7c395a6700 1 -- 172.21.15.81:0/1933630116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c34105100 msgr2=0x7f7c3410cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:08.820 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.825+0000 7f7c395a6700 1 --2- 172.21.15.81:0/1933630116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c34105100 0x7f7c3410cc80 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00b0a0 tx=0x7f7c2c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.820 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.825+0000 7f7c395a6700 1 -- 172.21.15.81:0/1933630116 shutdown_connections 2024-05-09T00:07:08.820 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.825+0000 7f7c395a6700 1 --2- 172.21.15.81:0/1933630116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c34105100 0x7f7c3410cc80 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.820 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.825+0000 7f7c395a6700 1 --2- 172.21.15.81:0/1933630116 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c34100000 0x7f7c341003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.820 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.825+0000 7f7c395a6700 1 --2- 172.21.15.81:0/1933630116 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c341009b0 0x7f7c341049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.820 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.825+0000 7f7c395a6700 1 -- 172.21.15.81:0/1933630116 >> 172.21.15.81:0/1933630116 conn(0x7f7c34076f40 msgr2=0x7f7c34077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:08.821 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.825+0000 7f7c395a6700 1 -- 172.21.15.81:0/1933630116 shutdown_connections 2024-05-09T00:07:08.821 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.825+0000 7f7c395a6700 1 -- 172.21.15.81:0/1933630116 wait complete. 2024-05-09T00:07:08.821 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.825+0000 7f7c395a6700 1 Processor -- start 2024-05-09T00:07:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c395a6700 1 -- start start 2024-05-09T00:07:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c395a6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c34100000 0x7f7c34197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c395a6700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c34105100 0x7f7c34197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c395a6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c3419bd10 0x7f7c3419c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c395a6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3419c790 con 0x7f7c34100000 2024-05-09T00:07:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c395a6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3419c900 con 0x7f7c3419bd10 2024-05-09T00:07:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c395a6700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3419cac0 con 0x7f7c34105100 2024-05-09T00:07:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c32ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c34100000 0x7f7c34197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c32ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c34100000 0x7f7c34197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56970/0 (socket says 172.21.15.81:56970) 2024-05-09T00:07:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c32ffd700 1 -- 172.21.15.81:0/537184986 learned_addr learned my addr 172.21.15.81:0/537184986 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:08.823 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c327fc700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c34105100 0x7f7c34197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c337fe700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c3419bd10 0x7f7c3419c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c32ffd700 1 -- 172.21.15.81:0/537184986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c34105100 msgr2=0x7f7c34197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c32ffd700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c34105100 0x7f7c34197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c32ffd700 1 -- 172.21.15.81:0/537184986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c3419bd10 msgr2=0x7f7c3419c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c32ffd700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c3419bd10 0x7f7c3419c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c32ffd700 1 -- 172.21.15.81:0/537184986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c009d00 con 0x7f7c34100000 2024-05-09T00:07:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.826+0000 7f7c337fe700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c3419bd10 0x7f7c3419c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:07:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.827+0000 7f7c32ffd700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c34100000 0x7f7c34197430 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800d950 tx=0x7f7c2800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.827+0000 7f7c1bfff700 1 -- 172.21.15.81:0/537184986 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28009940 con 0x7f7c34100000 2024-05-09T00:07:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.827+0000 7f7c395a6700 1 -- 172.21.15.81:0/537184986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c341a3fc0 con 0x7f7c34100000 2024-05-09T00:07:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.827+0000 7f7c1bfff700 1 -- 172.21.15.81:0/537184986 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c28010460 con 0x7f7c34100000 2024-05-09T00:07:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.827+0000 7f7c1bfff700 1 -- 172.21.15.81:0/537184986 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800f620 con 0x7f7c34100000 2024-05-09T00:07:08.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.827+0000 7f7c395a6700 1 -- 172.21.15.81:0/537184986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c341a44a0 con 0x7f7c34100000 2024-05-09T00:07:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.829+0000 7f7c1bfff700 1 -- 172.21.15.81:0/537184986 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f7c280108d0 con 0x7f7c34100000 2024-05-09T00:07:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.829+0000 7f7c1bfff700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7c1c0a1290 0x7f7c1c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.830+0000 7f7c327fc700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7c1c0a1290 0x7f7c1c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.830+0000 7f7c1bfff700 1 -- 172.21.15.81:0/537184986 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f7c280ccb80 con 0x7f7c34100000 2024-05-09T00:07:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.830+0000 7f7c327fc700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7c1c0a1290 0x7f7c1c0a3750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7c34198980 tx=0x7f7c24009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.830+0000 7f7c45760b80 1 Processor -- start 2024-05-09T00:07:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.830+0000 7f7c45760b80 1 -- start start 2024-05-09T00:07:08.831 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.830+0000 7f7c45760b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005119950 0x556005119d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.830+0000 7f7c45760b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x556005113f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.830+0000 7f7c45760b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005114480 0x5560051148a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.830+0000 7f7c45760b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55600506b0f0 con 0x556005119950 2024-05-09T00:07:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c45760b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556005068ab0 con 0x55600511a270 2024-05-09T00:07:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c45760b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560050643a0 con 0x556005114480 2024-05-09T00:07:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c32ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005119950 0x556005119d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c32ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005119950 0x556005119d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56972/0 (socket says 172.21.15.81:56972) 2024-05-09T00:07:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c32ffd700 1 -- 172.21.15.81:0/2028388909 learned_addr learned my addr 172.21.15.81:0/2028388909 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c337fe700 1 --2- 172.21.15.81:0/2028388909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005114480 0x5560051148a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c32ffd700 1 -- 172.21.15.81:0/2028388909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005114480 msgr2=0x5560051148a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c327fc700 1 --2- 172.21.15.81:0/2028388909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x556005113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c32ffd700 1 --2- 172.21.15.81:0/2028388909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005114480 0x5560051148a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.832 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c32ffd700 1 -- 172.21.15.81:0/2028388909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 msgr2=0x556005113f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c32ffd700 1 --2- 172.21.15.81:0/2028388909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x556005113f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c32ffd700 1 -- 172.21.15.81:0/2028388909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556004ee5350 con 0x556005119950 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c327fc700 1 --2- 172.21.15.81:0/2028388909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x556005113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c32ffd700 1 --2- 172.21.15.81:0/2028388909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005119950 0x556005119d30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7c280966c0 tx=0x7f7c2809a350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf154b7721c8c83d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c197fa700 1 -- 172.21.15.81:0/2028388909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280a20d0 con 0x556005119950 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c197fa700 1 -- 172.21.15.81:0/2028388909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c28096360 con 0x556005119950 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.831+0000 7f7c197fa700 1 -- 172.21.15.81:0/2028388909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280a1c40 con 0x556005119950 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.832+0000 7f7c45760b80 1 -- 172.21.15.81:0/2028388909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005119950 msgr2=0x556005119d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.832+0000 7f7c45760b80 1 --2- 172.21.15.81:0/2028388909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005119950 0x556005119d30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f7c280966c0 tx=0x7f7c2809a350 comp rx=0 tx=0).stop 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.832+0000 7f7c45760b80 1 -- 172.21.15.81:0/2028388909 shutdown_connections 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.832+0000 7f7c45760b80 1 --2- 172.21.15.81:0/2028388909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005114480 0x5560051148a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.832+0000 7f7c45760b80 1 --2- 172.21.15.81:0/2028388909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005119950 0x556005119d30 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.832+0000 7f7c45760b80 1 --2- 172.21.15.81:0/2028388909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x556005113f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.832+0000 7f7c45760b80 1 -- 172.21.15.81:0/2028388909 >> 172.21.15.81:0/2028388909 conn(0x5560050721b0 msgr2=0x55600510e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:08.833 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.832+0000 7f7c45760b80 1 -- 172.21.15.81:0/2028388909 shutdown_connections 2024-05-09T00:07:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.832+0000 7f7c45760b80 1 -- 172.21.15.81:0/2028388909 wait complete. 2024-05-09T00:07:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.832+0000 7f7c45760b80 1 -- start start 2024-05-09T00:07:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.832+0000 7f7c45760b80 1 Processor -- start 2024-05-09T00:07:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c45760b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005114480 0x55600511d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c45760b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005119950 0x55600511db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c45760b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x55600511e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c45760b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556005000500 con 0x556005119950 2024-05-09T00:07:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c45760b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560050001a0 con 0x55600511a270 2024-05-09T00:07:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c45760b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556004ee7640 con 0x556005114480 2024-05-09T00:07:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c45760b80 10 client.0 _ll_register_callbacks cb 0x556005009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c327fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005119950 0x55600511db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c327fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005119950 0x55600511db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56988/0 (socket says 172.21.15.81:56988) 2024-05-09T00:07:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c327fc700 1 -- 172.21.15.81:0/1787865349 learned_addr learned my addr 172.21.15.81:0/1787865349 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c32ffd700 1 --2- 172.21.15.81:0/1787865349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005114480 0x55600511d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c337fe700 1 --2- 172.21.15.81:0/1787865349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x55600511e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c327fc700 1 -- 172.21.15.81:0/1787865349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005114480 msgr2=0x55600511d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c327fc700 1 --2- 172.21.15.81:0/1787865349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005114480 0x55600511d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c327fc700 1 -- 172.21.15.81:0/1787865349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 msgr2=0x55600511e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c327fc700 1 --2- 172.21.15.81:0/1787865349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x55600511e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c327fc700 1 -- 172.21.15.81:0/1787865349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c341a44a0 con 0x556005119950 2024-05-09T00:07:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c337fe700 1 --2- 172.21.15.81:0/1787865349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x55600511e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c327fc700 1 --2- 172.21.15.81:0/1787865349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005119950 0x55600511db30 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7c24005950 tx=0x7f7c240047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3de2a1fedcb810 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c16ff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c16ff5700 1 -- 172.21.15.81:0/1787865349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24004020 con 0x556005119950 2024-05-09T00:07:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.833+0000 7f7c16ff5700 1 -- 172.21.15.81:0/1787865349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f7c24004180 con 0x556005119950 2024-05-09T00:07:08.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.834+0000 7f7c45760b80 1 -- 172.21.15.81:0/1787865349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556004fbd210 con 0x556005119950 2024-05-09T00:07:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.834+0000 7f7c16ff5700 1 -- 172.21.15.81:0/1787865349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c24004340 con 0x556005119950 2024-05-09T00:07:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.834+0000 7f7c45760b80 10 client.16617 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.834+0000 7f7c45760b80 1 -- 172.21.15.81:0/1787865349 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556004e91b00 con 0x556005119950 2024-05-09T00:07:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.834+0000 7f7c16ff5700 1 -- 172.21.15.81:0/1787865349 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556004fbd210 con 0x556005119950 2024-05-09T00:07:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.834+0000 7f7c16ff5700 1 -- 172.21.15.81:0/1787865349 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7c2402c070 con 0x556005119950 2024-05-09T00:07:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.834+0000 7f7c45760b80 10 client.16617 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.834+0000 7f7c45760b80 10 client.16617 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.834+0000 7f7c45760b80 20 client.16617 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.834+0000 7f7c45760b80 1 --2- 172.21.15.81:0/1787865349 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55600512dc80 0x5560051300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.834+0000 7f7c45760b80 4 client.16617 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:07:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.834+0000 7f7c45760b80 1 -- 172.21.15.81:0/1787865349 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5560050e37b0 con 0x55600512dc80 2024-05-09T00:07:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.834+0000 7f7c32ffd700 1 --2- 172.21.15.81:0/1787865349 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55600512dc80 0x5560051300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.835+0000 7f7c16ff5700 10 client.16617 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.835+0000 7f7c32ffd700 1 --2- 172.21.15.81:0/1787865349 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55600512dc80 0x5560051300a0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dba60792f3e1db49 server_cookie=b130214c58f6888e in_seq=0 out_seq=0 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.835+0000 7f7c16ff5700 1 -- 172.21.15.81:0/1787865349 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5560050e37b0 con 0x55600512dc80 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.835+0000 7f7c16ff5700 10 client.16617 handle_command_reply: tid=0 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.835+0000 7f7c45760b80 1 client.16617 shutdown 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.836+0000 7f7c45760b80 1 -- 172.21.15.81:0/1787865349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005119950 msgr2=0x55600511db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.836+0000 7f7c45760b80 1 --2- 172.21.15.81:0/1787865349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005119950 0x55600511db30 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7c24005950 tx=0x7f7c240047c0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.836+0000 7f7c45760b80 1 -- 172.21.15.81:0/1787865349 shutdown_connections 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.836+0000 7f7c45760b80 1 --2- 172.21.15.81:0/1787865349 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55600512dc80 0x5560051300a0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.836+0000 7f7c45760b80 1 --2- 172.21.15.81:0/1787865349 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x55600511e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.836+0000 7f7c45760b80 1 --2- 172.21.15.81:0/1787865349 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005114480 0x55600511d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.836+0000 7f7c45760b80 1 --2- 172.21.15.81:0/1787865349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005119950 0x55600511db30 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.836+0000 7f7c16ff5700 0 client.16617 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.836+0000 7f7c45760b80 1 -- 172.21.15.81:0/1787865349 >> 172.21.15.81:0/1787865349 conn(0x5560050721b0 msgr2=0x556005112f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.836+0000 7f7c45760b80 1 -- 172.21.15.81:0/1787865349 shutdown_connections 2024-05-09T00:07:08.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.836+0000 7f7c45760b80 1 -- 172.21.15.81:0/1787865349 wait complete. 2024-05-09T00:07:08.838 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.836+0000 7f7c45760b80 20 client.16617 trim_cache size 0 max 16384 2024-05-09T00:07:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.850+0000 7f7c45760b80 1 Processor -- start 2024-05-09T00:07:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.850+0000 7f7c45760b80 1 -- start start 2024-05-09T00:07:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c45760b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556005114480 0x55600510e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c45760b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005119950 0x556005114860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c45760b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600511a270 0x55600511de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c45760b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55600510f770 con 0x55600511a270 2024-05-09T00:07:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c45760b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55600511eba0 con 0x556005114480 2024-05-09T00:07:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c45760b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55600511a0e0 con 0x556005119950 2024-05-09T00:07:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c337fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600511a270 0x55600511de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c337fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600511a270 0x55600511de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56992/0 (socket says 172.21.15.81:56992) 2024-05-09T00:07:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c337fe700 1 -- 172.21.15.81:0/1157168556 learned_addr learned my addr 172.21.15.81:0/1157168556 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:08.849 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c32ffd700 1 --2- 172.21.15.81:0/1157168556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556005114480 0x55600510e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c337fe700 1 -- 172.21.15.81:0/1157168556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005119950 msgr2=0x556005114860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c337fe700 1 --2- 172.21.15.81:0/1157168556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005119950 0x556005114860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c337fe700 1 -- 172.21.15.81:0/1157168556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556005114480 msgr2=0x55600510e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c337fe700 1 --2- 172.21.15.81:0/1157168556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556005114480 0x55600510e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c337fe700 1 -- 172.21.15.81:0/1157168556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55600502a500 con 0x55600511a270 2024-05-09T00:07:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c337fe700 1 --2- 172.21.15.81:0/1157168556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600511a270 0x55600511de90 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009be0 tx=0x7f7c2c009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a53707f66afde5c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c19ffb700 1 -- 172.21.15.81:0/1157168556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00e040 con 0x55600511a270 2024-05-09T00:07:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c19ffb700 1 -- 172.21.15.81:0/1157168556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c2c0094c0 con 0x55600511a270 2024-05-09T00:07:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.851+0000 7f7c19ffb700 1 -- 172.21.15.81:0/1157168556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c004d40 con 0x55600511a270 2024-05-09T00:07:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 -- 172.21.15.81:0/1157168556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600511a270 msgr2=0x55600511de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 --2- 172.21.15.81:0/1157168556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600511a270 0x55600511de90 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c009be0 tx=0x7f7c2c009c10 comp rx=0 tx=0).stop 2024-05-09T00:07:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 -- 172.21.15.81:0/1157168556 shutdown_connections 2024-05-09T00:07:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 --2- 172.21.15.81:0/1157168556 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556005114480 0x55600510e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.850 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 --2- 172.21.15.81:0/1157168556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55600511a270 0x55600511de90 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 --2- 172.21.15.81:0/1157168556 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005119950 0x556005114860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 -- 172.21.15.81:0/1157168556 >> 172.21.15.81:0/1157168556 conn(0x5560050721b0 msgr2=0x55600511bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 -- 172.21.15.81:0/1157168556 shutdown_connections 2024-05-09T00:07:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 -- 172.21.15.81:0/1157168556 wait complete. 2024-05-09T00:07:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 -- start start 2024-05-09T00:07:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 Processor -- start 2024-05-09T00:07:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005114480 0x556005123d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005119950 0x5560051242a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x5560051247e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556005125500 con 0x556005114480 2024-05-09T00:07:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560051831b0 con 0x55600511a270 2024-05-09T00:07:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.852+0000 7f7c45760b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556005183370 con 0x556005119950 2024-05-09T00:07:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c45760b80 10 client.0 _ll_register_callbacks cb 0x556005009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:08.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c32ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005114480 0x556005123d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c32ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005114480 0x556005123d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57002/0 (socket says 172.21.15.81:57002) 2024-05-09T00:07:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c32ffd700 1 -- 172.21.15.81:0/3795617569 learned_addr learned my addr 172.21.15.81:0/3795617569 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c32ffd700 1 -- 172.21.15.81:0/3795617569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005119950 msgr2=0x5560051242a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c32ffd700 1 --2- 172.21.15.81:0/3795617569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005119950 0x5560051242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c337fe700 1 --2- 172.21.15.81:0/3795617569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x5560051247e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c32ffd700 1 -- 172.21.15.81:0/3795617569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 msgr2=0x5560051247e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c32ffd700 1 --2- 172.21.15.81:0/3795617569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x5560051247e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c32ffd700 1 -- 172.21.15.81:0/3795617569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3410d4f0 con 0x556005114480 2024-05-09T00:07:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c337fe700 1 --2- 172.21.15.81:0/3795617569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x5560051247e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c32ffd700 1 --2- 172.21.15.81:0/3795617569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005114480 0x556005123d60 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7c28099950 tx=0x7f7c28005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d5739e71de45f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c16ff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c16ff5700 1 -- 172.21.15.81:0/3795617569 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280a20d0 con 0x556005114480 2024-05-09T00:07:08.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c16ff5700 1 -- 172.21.15.81:0/3795617569 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f7c28099350 con 0x556005114480 2024-05-09T00:07:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c45760b80 1 -- 172.21.15.81:0/3795617569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55600505ce60 con 0x556005114480 2024-05-09T00:07:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c16ff5700 1 -- 172.21.15.81:0/3795617569 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c28099eb0 con 0x556005114480 2024-05-09T00:07:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c45760b80 10 client.16623 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c45760b80 1 -- 172.21.15.81:0/3795617569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556004ee9c70 con 0x556005114480 2024-05-09T00:07:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.853+0000 7f7c16ff5700 1 -- 172.21.15.81:0/3795617569 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c2807c020 con 0x556005114480 2024-05-09T00:07:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.854+0000 7f7c16ff5700 1 -- 172.21.15.81:0/3795617569 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7c280adb20 con 0x556005114480 2024-05-09T00:07:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.854+0000 7f7c45760b80 10 client.16623 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.854+0000 7f7c45760b80 10 client.16623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.854+0000 7f7c45760b80 20 client.16623 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.854+0000 7f7c45760b80 1 --2- 172.21.15.81:0/3795617569 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556005184770 0x556005186b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.854+0000 7f7c45760b80 4 client.16623 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:07:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.854+0000 7f7c45760b80 1 -- 172.21.15.81:0/3795617569 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556004eb2c90 con 0x556005184770 2024-05-09T00:07:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.854+0000 7f7c327fc700 1 --2- 172.21.15.81:0/3795617569 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556005184770 0x556005186b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:08.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.854+0000 7f7c16ff5700 10 client.16623 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:08.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.854+0000 7f7c327fc700 1 --2- 172.21.15.81:0/3795617569 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556005184770 0x556005186b90 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89e5340fa5e753f8 server_cookie=ce9c2e4824d79d3b in_seq=0 out_seq=0 2024-05-09T00:07:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c16ff5700 1 -- 172.21.15.81:0/3795617569 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556004eb2c90 con 0x556005184770 2024-05-09T00:07:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c16ff5700 10 client.16623 handle_command_reply: tid=0 2024-05-09T00:07:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c45760b80 1 client.16623 shutdown 2024-05-09T00:07:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c45760b80 1 -- 172.21.15.81:0/3795617569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005114480 msgr2=0x556005123d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:08.864 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c45760b80 1 --2- 172.21.15.81:0/3795617569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005114480 0x556005123d60 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f7c28099950 tx=0x7f7c28005dc0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c45760b80 1 -- 172.21.15.81:0/3795617569 shutdown_connections 2024-05-09T00:07:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c45760b80 1 --2- 172.21.15.81:0/3795617569 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556005184770 0x556005186b90 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c45760b80 1 --2- 172.21.15.81:0/3795617569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55600511a270 0x5560051247e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c16ff5700 0 client.16623 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c45760b80 1 --2- 172.21.15.81:0/3795617569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556005114480 0x556005123d60 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c45760b80 1 --2- 172.21.15.81:0/3795617569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556005119950 0x5560051242a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c45760b80 1 -- 172.21.15.81:0/3795617569 >> 172.21.15.81:0/3795617569 conn(0x5560050721b0 msgr2=0x5560051173f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c45760b80 1 -- 172.21.15.81:0/3795617569 shutdown_connections 2024-05-09T00:07:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c45760b80 1 -- 172.21.15.81:0/3795617569 wait complete. 2024-05-09T00:07:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c45760b80 20 client.16623 trim_cache size 0 max 16384 2024-05-09T00:07:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:07:08.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:07:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:07:08.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c395a6700 1 -- 172.21.15.81:0/537184986 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7c1c0a1290 msgr2=0x7f7c1c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c395a6700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7c1c0a1290 0x7f7c1c0a3750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7c34198980 tx=0x7f7c24009260 comp rx=0 tx=0).stop 2024-05-09T00:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c395a6700 1 -- 172.21.15.81:0/537184986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c34100000 msgr2=0x7f7c34197430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.869+0000 7f7c395a6700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c34100000 0x7f7c34197430 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f7c2800d950 tx=0x7f7c2800dc60 comp rx=0 tx=0).stop 2024-05-09T00:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.870+0000 7f7c395a6700 1 -- 172.21.15.81:0/537184986 shutdown_connections 2024-05-09T00:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.870+0000 7f7c395a6700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7c1c0a1290 0x7f7c1c0a3750 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.870+0000 7f7c395a6700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7c3419bd10 0x7f7c3419c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.870+0000 7f7c395a6700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c34100000 0x7f7c34197430 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.870+0000 7f7c395a6700 1 --2- 172.21.15.81:0/537184986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c34105100 0x7f7c34197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.870+0000 7f7c395a6700 1 -- 172.21.15.81:0/537184986 >> 172.21.15.81:0/537184986 conn(0x7f7c34076f40 msgr2=0x7f7c340699d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.870+0000 7f7c395a6700 1 -- 172.21.15.81:0/537184986 shutdown_connections 2024-05-09T00:07:08.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:08.870+0000 7f7c395a6700 1 -- 172.21.15.81:0/537184986 wait complete. 2024-05-09T00:07:09.264 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:09 smithi150 ceph-mon[46187]: pgmap v129: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-05-09T00:07:09.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:09 smithi171 ceph-mon[47351]: pgmap v129: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-05-09T00:07:09.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:09 smithi081 ceph-mon[42474]: pgmap v129: 97 pgs: 97 active+clean; 4.6 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 50 KiB/s wr, 28 op/s 2024-05-09T00:07:11.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:11 smithi150 ceph-mon[46187]: pgmap v130: 97 pgs: 97 active+clean; 4.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 68 KiB/s wr, 36 op/s 2024-05-09T00:07:11.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:11 smithi171 ceph-mon[47351]: pgmap v130: 97 pgs: 97 active+clean; 4.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 68 KiB/s wr, 36 op/s 2024-05-09T00:07:11.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:11 smithi081 ceph-mon[42474]: pgmap v130: 97 pgs: 97 active+clean; 4.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 68 KiB/s wr, 36 op/s 2024-05-09T00:07:13.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:13 smithi150 ceph-mon[46187]: pgmap v131: 97 pgs: 97 active+clean; 4.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 52 KiB/s wr, 27 op/s 2024-05-09T00:07:13.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:13 smithi171 ceph-mon[47351]: pgmap v131: 97 pgs: 97 active+clean; 4.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 52 KiB/s wr, 27 op/s 2024-05-09T00:07:13.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:13 smithi081 ceph-mon[42474]: pgmap v131: 97 pgs: 97 active+clean; 4.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 52 KiB/s wr, 27 op/s 2024-05-09T00:07:15.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:15 smithi150 ceph-mon[46187]: pgmap v132: 97 pgs: 97 active+clean; 4.9 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-05-09T00:07:15.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:15 smithi171 ceph-mon[47351]: pgmap v132: 97 pgs: 97 active+clean; 4.9 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-05-09T00:07:15.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:15 smithi081 ceph-mon[42474]: pgmap v132: 97 pgs: 97 active+clean; 4.9 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 65 KiB/s wr, 32 op/s 2024-05-09T00:07:17.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:17 smithi150 ceph-mon[46187]: pgmap v133: 97 pgs: 97 active+clean; 4.9 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-05-09T00:07:17.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:17 smithi171 ceph-mon[47351]: pgmap v133: 97 pgs: 97 active+clean; 4.9 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-05-09T00:07:17.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:17 smithi081 ceph-mon[42474]: pgmap v133: 97 pgs: 97 active+clean; 4.9 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-05-09T00:07:19.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:19 smithi150 ceph-mon[46187]: pgmap v134: 97 pgs: 97 active+clean; 4.9 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-05-09T00:07:19.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:19 smithi171 ceph-mon[47351]: pgmap v134: 97 pgs: 97 active+clean; 4.9 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-05-09T00:07:19.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:19 smithi081 ceph-mon[42474]: pgmap v134: 97 pgs: 97 active+clean; 4.9 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-05-09T00:07:21.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:21 smithi150 ceph-mon[46187]: pgmap v135: 97 pgs: 97 active+clean; 5.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-05-09T00:07:21.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:21 smithi171 ceph-mon[47351]: pgmap v135: 97 pgs: 97 active+clean; 5.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-05-09T00:07:21.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:21 smithi081 ceph-mon[42474]: pgmap v135: 97 pgs: 97 active+clean; 5.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-05-09T00:07:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.988+0000 7fb1467dc700 1 -- 172.21.15.81:0/2472762767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb140104d80 msgr2=0x7fb140105160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.988+0000 7fb1467dc700 1 --2- 172.21.15.81:0/2472762767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb140104d80 0x7fb140105160 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb130009990 tx=0x7fb130009ca0 comp rx=0 tx=0).stop 2024-05-09T00:07:21.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.989+0000 7fb1467dc700 1 -- 172.21.15.81:0/2472762767 shutdown_connections 2024-05-09T00:07:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.989+0000 7fb1467dc700 1 --2- 172.21.15.81:0/2472762767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb140100ee0 0x7fb14010cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.989+0000 7fb1467dc700 1 --2- 172.21.15.81:0/2472762767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb140104d80 0x7fb140105160 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.989+0000 7fb1467dc700 1 --2- 172.21.15.81:0/2472762767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb140100520 0x7fb1401009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.989+0000 7fb1467dc700 1 -- 172.21.15.81:0/2472762767 >> 172.21.15.81:0/2472762767 conn(0x7fb1400763a0 msgr2=0x7fb1400fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.989+0000 7fb1467dc700 1 -- 172.21.15.81:0/2472762767 shutdown_connections 2024-05-09T00:07:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.989+0000 7fb1467dc700 1 -- 172.21.15.81:0/2472762767 wait complete. 2024-05-09T00:07:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.989+0000 7fb1467dc700 1 Processor -- start 2024-05-09T00:07:21.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.989+0000 7fb1467dc700 1 -- start start 2024-05-09T00:07:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb1467dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb140100520 0x7fb140198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb1467dc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb140100ee0 0x7fb140198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb1467dc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb140104d80 0x7fb1401a32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb1467dc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb140198fb0 con 0x7fb140100520 2024-05-09T00:07:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb1467dc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1401a3800 con 0x7fb140100ee0 2024-05-09T00:07:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb1467dc700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1401a3940 con 0x7fb140104d80 2024-05-09T00:07:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb13ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb140100520 0x7fb140198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb13ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb140100520 0x7fb140198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43126/0 (socket says 172.21.15.81:43126) 2024-05-09T00:07:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb13ffff700 1 -- 172.21.15.81:0/1487008659 learned_addr learned my addr 172.21.15.81:0/1487008659 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb13f7fe700 1 --2- 172.21.15.81:0/1487008659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb140100ee0 0x7fb140198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb144d79700 1 --2- 172.21.15.81:0/1487008659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb140104d80 0x7fb1401a32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb13ffff700 1 -- 172.21.15.81:0/1487008659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb140104d80 msgr2=0x7fb1401a32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb13ffff700 1 --2- 172.21.15.81:0/1487008659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb140104d80 0x7fb1401a32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb13ffff700 1 -- 172.21.15.81:0/1487008659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb140100ee0 msgr2=0x7fb140198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb13ffff700 1 --2- 172.21.15.81:0/1487008659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb140100ee0 0x7fb140198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb13ffff700 1 -- 172.21.15.81:0/1487008659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1300095f0 con 0x7fb140100520 2024-05-09T00:07:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb13ffff700 1 --2- 172.21.15.81:0/1487008659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb140100520 0x7fb140198240 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb130005910 tx=0x7fb130009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb13d7fa700 1 -- 172.21.15.81:0/1487008659 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13001d070 con 0x7fb140100520 2024-05-09T00:07:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb13d7fa700 1 -- 172.21.15.81:0/1487008659 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb130022470 con 0x7fb140100520 2024-05-09T00:07:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb1467dc700 1 -- 172.21.15.81:0/1487008659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1401a3b40 con 0x7fb140100520 2024-05-09T00:07:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb13d7fa700 1 -- 172.21.15.81:0/1487008659 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb130017650 con 0x7fb140100520 2024-05-09T00:07:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.990+0000 7fb1467dc700 1 -- 172.21.15.81:0/1487008659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1401a3f60 con 0x7fb140100520 2024-05-09T00:07:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.992+0000 7fb13d7fa700 1 -- 172.21.15.81:0/1487008659 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fb1300225e0 con 0x7fb140100520 2024-05-09T00:07:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.993+0000 7fb13d7fa700 1 --2- 172.21.15.81:0/1487008659 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1280a1290 0x7fb1280a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.993+0000 7fb13f7fe700 1 --2- 172.21.15.81:0/1487008659 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1280a1290 0x7fb1280a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.993+0000 7fb13d7fa700 1 -- 172.21.15.81:0/1487008659 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb1300ce180 con 0x7fb140100520 2024-05-09T00:07:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.994+0000 7fb13f7fe700 1 --2- 172.21.15.81:0/1487008659 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1280a1290 0x7fb1280a3750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb134005950 tx=0x7fb1340058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.994+0000 7fb152996b80 1 Processor -- start 2024-05-09T00:07:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.994+0000 7fb152996b80 1 -- start start 2024-05-09T00:07:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.994+0000 7fb152996b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc39950 0x55d14dc39d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.994+0000 7fb152996b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc33f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.994+0000 7fb152996b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc34480 0x55d14dc348a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.994+0000 7fb152996b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14db8b0f0 con 0x55d14dc34480 2024-05-09T00:07:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.994+0000 7fb152996b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14db88ab0 con 0x55d14dc3a270 2024-05-09T00:07:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.994+0000 7fb152996b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14db843a0 con 0x55d14dc39950 2024-05-09T00:07:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.994+0000 7fb144d79700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc34480 0x55d14dc348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.994+0000 7fb144d79700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc34480 0x55d14dc348a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43130/0 (socket says 172.21.15.81:43130) 2024-05-09T00:07:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.994+0000 7fb144d79700 1 -- 172.21.15.81:0/3234379022 learned_addr learned my addr 172.21.15.81:0/3234379022 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.994+0000 7fb13ffff700 1 --2- 172.21.15.81:0/3234379022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc39950 0x55d14dc39d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.995+0000 7fb13f7fe700 1 --2- 172.21.15.81:0/3234379022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc33f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.995+0000 7fb144d79700 1 -- 172.21.15.81:0/3234379022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc39950 msgr2=0x55d14dc39d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.995+0000 7fb144d79700 1 --2- 172.21.15.81:0/3234379022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc39950 0x55d14dc39d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.995+0000 7fb144d79700 1 -- 172.21.15.81:0/3234379022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 msgr2=0x55d14dc33f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.995+0000 7fb144d79700 1 --2- 172.21.15.81:0/3234379022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc33f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.995+0000 7fb144d79700 1 -- 172.21.15.81:0/3234379022 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d14da05350 con 0x55d14dc34480 2024-05-09T00:07:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.995+0000 7fb13f7fe700 1 --2- 172.21.15.81:0/3234379022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc33f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.995+0000 7fb144d79700 1 --2- 172.21.15.81:0/3234379022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc34480 0x55d14dc348a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb1380093e0 tx=0x7fb138009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbe203357720860 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.995+0000 7fb1267fc700 1 -- 172.21.15.81:0/3234379022 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800e070 con 0x55d14dc34480 2024-05-09T00:07:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.995+0000 7fb1267fc700 1 -- 172.21.15.81:0/3234379022 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb13800f040 con 0x55d14dc34480 2024-05-09T00:07:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.995+0000 7fb1267fc700 1 -- 172.21.15.81:0/3234379022 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1380147c0 con 0x55d14dc34480 2024-05-09T00:07:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.996+0000 7fb152996b80 1 -- 172.21.15.81:0/3234379022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc34480 msgr2=0x55d14dc348a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.996+0000 7fb152996b80 1 --2- 172.21.15.81:0/3234379022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc34480 0x55d14dc348a0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb1380093e0 tx=0x7fb138009920 comp rx=0 tx=0).stop 2024-05-09T00:07:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.996+0000 7fb152996b80 1 -- 172.21.15.81:0/3234379022 shutdown_connections 2024-05-09T00:07:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.996+0000 7fb152996b80 1 --2- 172.21.15.81:0/3234379022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc34480 0x55d14dc348a0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.996+0000 7fb152996b80 1 --2- 172.21.15.81:0/3234379022 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc39950 0x55d14dc39d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.996+0000 7fb152996b80 1 --2- 172.21.15.81:0/3234379022 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc33f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.996+0000 7fb152996b80 1 -- 172.21.15.81:0/3234379022 >> 172.21.15.81:0/3234379022 conn(0x55d14db921b0 msgr2=0x55d14dc2e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.996+0000 7fb152996b80 1 -- 172.21.15.81:0/3234379022 shutdown_connections 2024-05-09T00:07:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.996+0000 7fb152996b80 1 -- 172.21.15.81:0/3234379022 wait complete. 2024-05-09T00:07:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.996+0000 7fb152996b80 1 -- start start 2024-05-09T00:07:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.996+0000 7fb152996b80 1 Processor -- start 2024-05-09T00:07:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb152996b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc34480 0x55d14dc3d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb152996b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc39950 0x55d14dc3daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb152996b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc3e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb152996b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14db20500 con 0x55d14dc39950 2024-05-09T00:07:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb152996b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14db201a0 con 0x55d14dc3a270 2024-05-09T00:07:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb152996b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14da07640 con 0x55d14dc34480 2024-05-09T00:07:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb152996b80 10 client.0 _ll_register_callbacks cb 0x55d14db29ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb13f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc39950 0x55d14dc3daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb13f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc39950 0x55d14dc3daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43144/0 (socket says 172.21.15.81:43144) 2024-05-09T00:07:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb13f7fe700 1 -- 172.21.15.81:0/1471212337 learned_addr learned my addr 172.21.15.81:0/1471212337 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb13f7fe700 1 -- 172.21.15.81:0/1471212337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc34480 msgr2=0x55d14dc3d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb13ffff700 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc34480 0x55d14dc3d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb13f7fe700 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc34480 0x55d14dc3d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb144d79700 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc3e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb13f7fe700 1 -- 172.21.15.81:0/1471212337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 msgr2=0x55d14dc3e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb13f7fe700 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc3e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb13f7fe700 1 -- 172.21.15.81:0/1471212337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb138009090 con 0x55d14dc39950 2024-05-09T00:07:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb13ffff700 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc34480 0x55d14dc3d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb144d79700 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc3e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb13f7fe700 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc39950 0x55d14dc3daf0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb13400fe80 tx=0x7fb134004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d450f02a4a4e960f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb11f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb11f7fe700 1 -- 172.21.15.81:0/1471212337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13401e620 con 0x55d14dc39950 2024-05-09T00:07:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb11f7fe700 1 -- 172.21.15.81:0/1471212337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb13401e780 con 0x55d14dc39950 2024-05-09T00:07:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.997+0000 7fb152996b80 1 -- 172.21.15.81:0/1471212337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d14dadd210 con 0x55d14dc39950 2024-05-09T00:07:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.998+0000 7fb11f7fe700 1 -- 172.21.15.81:0/1471212337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb134011e70 con 0x55d14dc39950 2024-05-09T00:07:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.998+0000 7fb152996b80 10 client.16635 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.998+0000 7fb152996b80 1 -- 172.21.15.81:0/1471212337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d14d9b1b00 con 0x55d14dc39950 2024-05-09T00:07:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.998+0000 7fb11f7fe700 1 -- 172.21.15.81:0/1471212337 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d14dadd210 con 0x55d14dc39950 2024-05-09T00:07:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.998+0000 7fb11f7fe700 1 -- 172.21.15.81:0/1471212337 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb134024020 con 0x55d14dc39950 2024-05-09T00:07:22.001 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.998+0000 7fb152996b80 10 client.16635 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.998+0000 7fb152996b80 10 client.16635 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.998+0000 7fb152996b80 20 client.16635 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.998+0000 7fb152996b80 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d14dc4dc00 0x55d14dc50020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.998+0000 7fb152996b80 4 client.16635 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:07:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.998+0000 7fb152996b80 1 -- 172.21.15.81:0/1471212337 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d14dc037b0 con 0x55d14dc4dc00 2024-05-09T00:07:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.998+0000 7fb13ffff700 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d14dc4dc00 0x55d14dc50020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.999+0000 7fb11f7fe700 10 client.16635 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.999+0000 7fb13ffff700 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d14dc4dc00 0x55d14dc50020 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21c2547cb368c76a server_cookie=26a79848ef600b0d in_seq=0 out_seq=0 2024-05-09T00:07:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.999+0000 7fb11f7fe700 1 -- 172.21.15.81:0/1471212337 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d14dc037b0 con 0x55d14dc4dc00 2024-05-09T00:07:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.999+0000 7fb11f7fe700 10 client.16635 handle_command_reply: tid=0 2024-05-09T00:07:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.999+0000 7fb152996b80 1 client.16635 shutdown 2024-05-09T00:07:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.999+0000 7fb152996b80 1 -- 172.21.15.81:0/1471212337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc39950 msgr2=0x55d14dc3daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:22.002 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.999+0000 7fb152996b80 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc39950 0x55d14dc3daf0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb13400fe80 tx=0x7fb134004750 comp rx=0 tx=0).stop 2024-05-09T00:07:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.999+0000 7fb152996b80 1 -- 172.21.15.81:0/1471212337 shutdown_connections 2024-05-09T00:07:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.999+0000 7fb152996b80 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d14dc4dc00 0x55d14dc50020 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.000+0000 7fb11f7fe700 0 client.16635 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:21.999+0000 7fb152996b80 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc3e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.000+0000 7fb152996b80 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc34480 0x55d14dc3d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.000+0000 7fb152996b80 1 --2- 172.21.15.81:0/1471212337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc39950 0x55d14dc3daf0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.000+0000 7fb152996b80 1 -- 172.21.15.81:0/1471212337 >> 172.21.15.81:0/1471212337 conn(0x55d14db921b0 msgr2=0x55d14dc37460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.000+0000 7fb152996b80 1 -- 172.21.15.81:0/1471212337 shutdown_connections 2024-05-09T00:07:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.000+0000 7fb152996b80 1 -- 172.21.15.81:0/1471212337 wait complete. 2024-05-09T00:07:22.003 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.000+0000 7fb152996b80 20 client.16635 trim_cache size 0 max 16384 2024-05-09T00:07:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb152996b80 1 Processor -- start 2024-05-09T00:07:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb152996b80 1 -- start start 2024-05-09T00:07:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb152996b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc34480 0x55d14dc496f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb152996b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc39950 0x55d14dc2e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb152996b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc37b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb152996b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14dc4b2d0 con 0x55d14dc39950 2024-05-09T00:07:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb152996b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14dc300f0 con 0x55d14dc3a270 2024-05-09T00:07:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb152996b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14dc55230 con 0x55d14dc34480 2024-05-09T00:07:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb13f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc39950 0x55d14dc2e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb13f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc39950 0x55d14dc2e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43152/0 (socket says 172.21.15.81:43152) 2024-05-09T00:07:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb13f7fe700 1 -- 172.21.15.81:0/3542009797 learned_addr learned my addr 172.21.15.81:0/3542009797 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb13ffff700 1 --2- 172.21.15.81:0/3542009797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc34480 0x55d14dc496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb13f7fe700 1 -- 172.21.15.81:0/3542009797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc34480 msgr2=0x55d14dc496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb13f7fe700 1 --2- 172.21.15.81:0/3542009797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc34480 0x55d14dc496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb13f7fe700 1 -- 172.21.15.81:0/3542009797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 msgr2=0x55d14dc37b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb144d79700 1 --2- 172.21.15.81:0/3542009797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc37b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb13f7fe700 1 --2- 172.21.15.81:0/3542009797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc37b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb13f7fe700 1 -- 172.21.15.81:0/3542009797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d14db4a500 con 0x55d14dc39950 2024-05-09T00:07:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb13f7fe700 1 --2- 172.21.15.81:0/3542009797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc39950 0x55d14dc2e910 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb134014040 tx=0x7fb13400f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05fc55dddb09738 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.015+0000 7fb126ffd700 1 -- 172.21.15.81:0/3542009797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13402f480 con 0x55d14dc39950 2024-05-09T00:07:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.016+0000 7fb126ffd700 1 -- 172.21.15.81:0/3542009797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb134026480 con 0x55d14dc39950 2024-05-09T00:07:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.016+0000 7fb126ffd700 1 -- 172.21.15.81:0/3542009797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13401e680 con 0x55d14dc39950 2024-05-09T00:07:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.016+0000 7fb152996b80 1 -- 172.21.15.81:0/3542009797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc39950 msgr2=0x55d14dc2e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.016+0000 7fb152996b80 1 --2- 172.21.15.81:0/3542009797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc39950 0x55d14dc2e910 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fb134014040 tx=0x7fb13400f7f0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.016+0000 7fb152996b80 1 -- 172.21.15.81:0/3542009797 shutdown_connections 2024-05-09T00:07:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.016+0000 7fb152996b80 1 --2- 172.21.15.81:0/3542009797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc37b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.016+0000 7fb152996b80 1 --2- 172.21.15.81:0/3542009797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc34480 0x55d14dc496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.016+0000 7fb152996b80 1 --2- 172.21.15.81:0/3542009797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc39950 0x55d14dc2e910 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.016+0000 7fb152996b80 1 -- 172.21.15.81:0/3542009797 >> 172.21.15.81:0/3542009797 conn(0x55d14db921b0 msgr2=0x55d14dc373f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.016+0000 7fb152996b80 1 -- 172.21.15.81:0/3542009797 shutdown_connections 2024-05-09T00:07:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.016+0000 7fb152996b80 1 -- 172.21.15.81:0/3542009797 wait complete. 2024-05-09T00:07:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.016+0000 7fb152996b80 1 -- start start 2024-05-09T00:07:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb152996b80 1 Processor -- start 2024-05-09T00:07:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb152996b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc34480 0x55d14dc44ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb152996b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc39950 0x55d14dc2e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb152996b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc2e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb152996b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14dc3ce90 con 0x55d14dc34480 2024-05-09T00:07:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb152996b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14dc3d000 con 0x55d14dc3a270 2024-05-09T00:07:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb152996b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14dc3d1c0 con 0x55d14dc39950 2024-05-09T00:07:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb152996b80 10 client.0 _ll_register_callbacks cb 0x55d14db29ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb13ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc34480 0x55d14dc44ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:22.017 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb13ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc34480 0x55d14dc44ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43154/0 (socket says 172.21.15.81:43154) 2024-05-09T00:07:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb13ffff700 1 -- 172.21.15.81:0/1232846097 learned_addr learned my addr 172.21.15.81:0/1232846097 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb13f7fe700 1 --2- 172.21.15.81:0/1232846097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc39950 0x55d14dc2e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb144d79700 1 --2- 172.21.15.81:0/1232846097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc2e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb13ffff700 1 -- 172.21.15.81:0/1232846097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc39950 msgr2=0x55d14dc2e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb13ffff700 1 --2- 172.21.15.81:0/1232846097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc39950 0x55d14dc2e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb13ffff700 1 -- 172.21.15.81:0/1232846097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 msgr2=0x55d14dc2e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb13ffff700 1 --2- 172.21.15.81:0/1232846097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc2e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb13ffff700 1 -- 172.21.15.81:0/1232846097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d14d9b1b00 con 0x55d14dc34480 2024-05-09T00:07:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.017+0000 7fb144d79700 1 --2- 172.21.15.81:0/1232846097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc2e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:07:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb13ffff700 1 --2- 172.21.15.81:0/1232846097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc34480 0x55d14dc44ec0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb130097eb0 tx=0x7fb130009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981a32525f552ae9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb11f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb11f7fe700 1 -- 172.21.15.81:0/1232846097 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1300b7070 con 0x55d14dc34480 2024-05-09T00:07:22.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb11f7fe700 1 -- 172.21.15.81:0/1232846097 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb1300a1040 con 0x55d14dc34480 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb152996b80 1 -- 172.21.15.81:0/1232846097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb13800f040 con 0x55d14dc34480 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb11f7fe700 1 -- 172.21.15.81:0/1232846097 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb13009f270 con 0x55d14dc34480 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb152996b80 10 client.16641 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb152996b80 1 -- 172.21.15.81:0/1232846097 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d14da09c70 con 0x55d14dc34480 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb11f7fe700 1 -- 172.21.15.81:0/1232846097 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb13800f040 con 0x55d14dc34480 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb11f7fe700 1 -- 172.21.15.81:0/1232846097 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb13009a930 con 0x55d14dc34480 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb152996b80 10 client.16641 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb152996b80 10 client.16641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb152996b80 20 client.16641 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb152996b80 1 --2- 172.21.15.81:0/1232846097 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d14dc4dc00 0x55d14dca6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb152996b80 4 client.16641 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb152996b80 1 -- 172.21.15.81:0/1232846097 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d14db7ce60 con 0x55d14dc4dc00 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.018+0000 7fb13f7fe700 1 --2- 172.21.15.81:0/1232846097 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d14dc4dc00 0x55d14dca6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.019+0000 7fb11f7fe700 10 client.16641 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:22.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.019+0000 7fb13f7fe700 1 --2- 172.21.15.81:0/1232846097 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d14dc4dc00 0x55d14dca6860 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c64dc4ee1e4412b2 server_cookie=587cf8bd876a40a4 in_seq=0 out_seq=0 2024-05-09T00:07:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.032+0000 7fb11f7fe700 1 -- 172.21.15.81:0/1232846097 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d14db7ce60 con 0x55d14dc4dc00 2024-05-09T00:07:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.032+0000 7fb11f7fe700 10 client.16641 handle_command_reply: tid=0 2024-05-09T00:07:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.032+0000 7fb152996b80 1 client.16641 shutdown 2024-05-09T00:07:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb152996b80 1 -- 172.21.15.81:0/1232846097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc34480 msgr2=0x55d14dc44ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb152996b80 1 --2- 172.21.15.81:0/1232846097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc34480 0x55d14dc44ec0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb130097eb0 tx=0x7fb130009310 comp rx=0 tx=0).stop 2024-05-09T00:07:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb152996b80 1 -- 172.21.15.81:0/1232846097 shutdown_connections 2024-05-09T00:07:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb152996b80 1 --2- 172.21.15.81:0/1232846097 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d14dc4dc00 0x55d14dca6860 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb152996b80 1 --2- 172.21.15.81:0/1232846097 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d14dc3a270 0x55d14dc2e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb11f7fe700 0 client.16641 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb152996b80 1 --2- 172.21.15.81:0/1232846097 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d14dc34480 0x55d14dc44ec0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb152996b80 1 --2- 172.21.15.81:0/1232846097 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d14dc39950 0x55d14dc2e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb152996b80 1 -- 172.21.15.81:0/1232846097 >> 172.21.15.81:0/1232846097 conn(0x55d14db921b0 msgr2=0x55d14dc335f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb152996b80 1 -- 172.21.15.81:0/1232846097 shutdown_connections 2024-05-09T00:07:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb152996b80 1 -- 172.21.15.81:0/1232846097 wait complete. 2024-05-09T00:07:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb152996b80 20 client.16641 trim_cache size 0 max 16384 2024-05-09T00:07:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:07:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:07:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:07:22.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:07:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb1467dc700 1 -- 172.21.15.81:0/1487008659 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1280a1290 msgr2=0x7fb1280a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb1467dc700 1 --2- 172.21.15.81:0/1487008659 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1280a1290 0x7fb1280a3750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb134005950 tx=0x7fb1340058e0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb1467dc700 1 -- 172.21.15.81:0/1487008659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb140100520 msgr2=0x7fb140198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb1467dc700 1 --2- 172.21.15.81:0/1487008659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb140100520 0x7fb140198240 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb130005910 tx=0x7fb130009570 comp rx=0 tx=0).stop 2024-05-09T00:07:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb1467dc700 1 -- 172.21.15.81:0/1487008659 shutdown_connections 2024-05-09T00:07:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb1467dc700 1 --2- 172.21.15.81:0/1487008659 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1280a1290 0x7fb1280a3750 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb1467dc700 1 --2- 172.21.15.81:0/1487008659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb140104d80 0x7fb1401a32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb1467dc700 1 --2- 172.21.15.81:0/1487008659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb140100520 0x7fb140198240 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb1467dc700 1 --2- 172.21.15.81:0/1487008659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb140100ee0 0x7fb140198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb1467dc700 1 -- 172.21.15.81:0/1487008659 >> 172.21.15.81:0/1487008659 conn(0x7fb1400763a0 msgr2=0x7fb140102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.033+0000 7fb1467dc700 1 -- 172.21.15.81:0/1487008659 shutdown_connections 2024-05-09T00:07:22.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:22.034+0000 7fb1467dc700 1 -- 172.21.15.81:0/1487008659 wait complete. 2024-05-09T00:07:23.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:23 smithi150 ceph-mon[46187]: pgmap v136: 97 pgs: 97 active+clean; 5.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-05-09T00:07:23.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:23 smithi171 ceph-mon[47351]: pgmap v136: 97 pgs: 97 active+clean; 5.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-05-09T00:07:23.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:23 smithi081 ceph-mon[42474]: pgmap v136: 97 pgs: 97 active+clean; 5.1 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-05-09T00:07:25.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:25 smithi150 ceph-mon[46187]: pgmap v137: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-05-09T00:07:25.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:25 smithi171 ceph-mon[47351]: pgmap v137: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-05-09T00:07:25.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:25 smithi081 ceph-mon[42474]: pgmap v137: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-05-09T00:07:26.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:07:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.450+0000 7f356a788700 1 -- 172.21.15.81:0/130070857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564105160 msgr2=0x7f356410cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.450+0000 7f356a788700 1 --2- 172.21.15.81:0/130070857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564105160 0x7f356410cce0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f355c00b0a0 tx=0x7f355c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.450+0000 7f356a788700 1 -- 172.21.15.81:0/130070857 shutdown_connections 2024-05-09T00:07:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.450+0000 7f356a788700 1 --2- 172.21.15.81:0/130070857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3564100060 0x7f3564100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.450+0000 7f356a788700 1 --2- 172.21.15.81:0/130070857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3564105160 0x7f356410cce0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.450+0000 7f356a788700 1 --2- 172.21.15.81:0/130070857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3564100a10 0x7f3564104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.450+0000 7f356a788700 1 -- 172.21.15.81:0/130070857 >> 172.21.15.81:0/130070857 conn(0x7f3564076f40 msgr2=0x7f3564077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.450+0000 7f356a788700 1 -- 172.21.15.81:0/130070857 shutdown_connections 2024-05-09T00:07:26.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.450+0000 7f356a788700 1 -- 172.21.15.81:0/130070857 wait complete. 2024-05-09T00:07:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.451+0000 7f356a788700 1 Processor -- start 2024-05-09T00:07:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.451+0000 7f356a788700 1 -- start start 2024-05-09T00:07:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f356a788700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3564100060 0x7f3564199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f356a788700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3564105160 0x7f3564199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f356a788700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f356419df40 0x7f356419e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f356a788700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356419e9c0 con 0x7f356419df40 2024-05-09T00:07:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f356a788700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356419eb30 con 0x7f3564100060 2024-05-09T00:07:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f356a788700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356419ecf0 con 0x7f3564105160 2024-05-09T00:07:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f3568d25700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f356419df40 0x7f356419e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f3568d25700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f356419df40 0x7f356419e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43170/0 (socket says 172.21.15.81:43170) 2024-05-09T00:07:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f3568d25700 1 -- 172.21.15.81:0/2171580978 learned_addr learned my addr 172.21.15.81:0/2171580978 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f35637fe700 1 --2- 172.21.15.81:0/2171580978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3564105160 0x7f3564199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f3563fff700 1 --2- 172.21.15.81:0/2171580978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3564100060 0x7f3564199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f3568d25700 1 -- 172.21.15.81:0/2171580978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3564105160 msgr2=0x7f3564199ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f3568d25700 1 --2- 172.21.15.81:0/2171580978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3564105160 0x7f3564199ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f3568d25700 1 -- 172.21.15.81:0/2171580978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3564100060 msgr2=0x7f3564199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f3568d25700 1 --2- 172.21.15.81:0/2171580978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3564100060 0x7f3564199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f3568d25700 1 -- 172.21.15.81:0/2171580978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c009d00 con 0x7f356419df40 2024-05-09T00:07:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f3568d25700 1 --2- 172.21.15.81:0/2171580978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f356419df40 0x7f356419e3c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f355c006130 tx=0x7f355c0093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:26.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f35617fa700 1 -- 172.21.15.81:0/2171580978 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c00e040 con 0x7f356419df40 2024-05-09T00:07:26.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f356a788700 1 -- 172.21.15.81:0/2171580978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35641a61f0 con 0x7f356419df40 2024-05-09T00:07:26.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f35617fa700 1 -- 172.21.15.81:0/2171580978 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f355c004e40 con 0x7f356419df40 2024-05-09T00:07:26.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.452+0000 7f35617fa700 1 -- 172.21.15.81:0/2171580978 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c01b7d0 con 0x7f356419df40 2024-05-09T00:07:26.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.453+0000 7f356a788700 1 -- 172.21.15.81:0/2171580978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35641a66c0 con 0x7f356419df40 2024-05-09T00:07:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.455+0000 7f35617fa700 1 -- 172.21.15.81:0/2171580978 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f355c01da40 con 0x7f356419df40 2024-05-09T00:07:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.455+0000 7f35617fa700 1 --2- 172.21.15.81:0/2171580978 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f354c0a1290 0x7f354c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.455+0000 7f3563fff700 1 --2- 172.21.15.81:0/2171580978 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f354c0a1290 0x7f354c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.455+0000 7f35617fa700 1 -- 172.21.15.81:0/2171580978 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f355c0ce5f0 con 0x7f356419df40 2024-05-09T00:07:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f3563fff700 1 --2- 172.21.15.81:0/2171580978 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f354c0a1290 0x7f354c0a3750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3554005fd0 tx=0x7f3554005f60 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f3576942b80 1 Processor -- start 2024-05-09T00:07:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f3576942b80 1 -- start start 2024-05-09T00:07:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f3576942b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f711ce00 0x5563f711d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f3576942b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711d720 0x5563f7117350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f3576942b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f7117890 0x5563f7117cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f3576942b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f706e150 con 0x5563f711d720 2024-05-09T00:07:26.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f3576942b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f706bb10 con 0x5563f711ce00 2024-05-09T00:07:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f3576942b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f7067400 con 0x5563f7117890 2024-05-09T00:07:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f35637fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711d720 0x5563f7117350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f35637fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711d720 0x5563f7117350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43178/0 (socket says 172.21.15.81:43178) 2024-05-09T00:07:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f35637fe700 1 -- 172.21.15.81:0/789196400 learned_addr learned my addr 172.21.15.81:0/789196400 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f3563fff700 1 --2- 172.21.15.81:0/789196400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f711ce00 0x5563f711d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f35637fe700 1 -- 172.21.15.81:0/789196400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f7117890 msgr2=0x5563f7117cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f3568d25700 1 --2- 172.21.15.81:0/789196400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f7117890 0x5563f7117cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f35637fe700 1 --2- 172.21.15.81:0/789196400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f7117890 0x5563f7117cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.456+0000 7f35637fe700 1 -- 172.21.15.81:0/789196400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f711ce00 msgr2=0x5563f711d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.457+0000 7f35637fe700 1 --2- 172.21.15.81:0/789196400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f711ce00 0x5563f711d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.457+0000 7f35637fe700 1 -- 172.21.15.81:0/789196400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563f6ee83b0 con 0x5563f711d720 2024-05-09T00:07:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.457+0000 7f3563fff700 1 --2- 172.21.15.81:0/789196400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f711ce00 0x5563f711d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:07:26.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.457+0000 7f35637fe700 1 --2- 172.21.15.81:0/789196400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711d720 0x5563f7117350 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3558008b80 tx=0x7f3558008e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38db28fa9552c587 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.457+0000 7f354a7fc700 1 -- 172.21.15.81:0/789196400 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355800ed70 con 0x5563f711d720 2024-05-09T00:07:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.457+0000 7f354a7fc700 1 -- 172.21.15.81:0/789196400 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f355800eed0 con 0x5563f711d720 2024-05-09T00:07:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.457+0000 7f354a7fc700 1 -- 172.21.15.81:0/789196400 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3558005280 con 0x5563f711d720 2024-05-09T00:07:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.457+0000 7f3576942b80 1 -- 172.21.15.81:0/789196400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711d720 msgr2=0x5563f7117350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.457+0000 7f3576942b80 1 --2- 172.21.15.81:0/789196400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711d720 0x5563f7117350 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3558008b80 tx=0x7f3558008e90 comp rx=0 tx=0).stop 2024-05-09T00:07:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.457+0000 7f3576942b80 1 -- 172.21.15.81:0/789196400 shutdown_connections 2024-05-09T00:07:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.457+0000 7f3576942b80 1 --2- 172.21.15.81:0/789196400 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f711ce00 0x5563f711d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.457+0000 7f3576942b80 1 --2- 172.21.15.81:0/789196400 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f7117890 0x5563f7117cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.457+0000 7f3576942b80 1 --2- 172.21.15.81:0/789196400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711d720 0x5563f7117350 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.458+0000 7f3576942b80 1 -- 172.21.15.81:0/789196400 >> 172.21.15.81:0/789196400 conn(0x5563f7075210 msgr2=0x5563f7111df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.458+0000 7f3576942b80 1 -- 172.21.15.81:0/789196400 shutdown_connections 2024-05-09T00:07:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.458+0000 7f3576942b80 1 -- 172.21.15.81:0/789196400 wait complete. 2024-05-09T00:07:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.458+0000 7f3576942b80 1 -- start start 2024-05-09T00:07:26.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.458+0000 7f3576942b80 1 Processor -- start 2024-05-09T00:07:26.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.458+0000 7f3576942b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f7117890 0x5563f7120b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.458+0000 7f3576942b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711ce00 0x5563f71210b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.458+0000 7f3576942b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711d720 0x5563f71215f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.458+0000 7f3576942b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f7003560 con 0x5563f711ce00 2024-05-09T00:07:26.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.458+0000 7f3576942b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f7003200 con 0x5563f7117890 2024-05-09T00:07:26.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.458+0000 7f3576942b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f6eea6a0 con 0x5563f711d720 2024-05-09T00:07:26.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.458+0000 7f3576942b80 10 client.0 _ll_register_callbacks cb 0x5563f700cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:26.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f35637fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711ce00 0x5563f71210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f35637fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711ce00 0x5563f71210b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43180/0 (socket says 172.21.15.81:43180) 2024-05-09T00:07:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f35637fe700 1 -- 172.21.15.81:0/1113869306 learned_addr learned my addr 172.21.15.81:0/1113869306 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f3563fff700 1 --2- 172.21.15.81:0/1113869306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f7117890 0x5563f7120b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f3568d25700 1 --2- 172.21.15.81:0/1113869306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711d720 0x5563f71215f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f35637fe700 1 -- 172.21.15.81:0/1113869306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711d720 msgr2=0x5563f71215f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f35637fe700 1 --2- 172.21.15.81:0/1113869306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711d720 0x5563f71215f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f35637fe700 1 -- 172.21.15.81:0/1113869306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f7117890 msgr2=0x5563f7120b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f35637fe700 1 --2- 172.21.15.81:0/1113869306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f7117890 0x5563f7120b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f35637fe700 1 -- 172.21.15.81:0/1113869306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35580087b0 con 0x5563f711ce00 2024-05-09T00:07:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f35637fe700 1 --2- 172.21.15.81:0/1113869306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711ce00 0x5563f71210b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f3558004d60 tx=0x7f355800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50762be4ba9ff6ae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f35437fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f35437fe700 1 -- 172.21.15.81:0/1113869306 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355801f070 con 0x5563f711ce00 2024-05-09T00:07:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f35437fe700 1 -- 172.21.15.81:0/1113869306 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f3558005050 con 0x5563f711ce00 2024-05-09T00:07:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f3576942b80 1 -- 172.21.15.81:0/1113869306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563f6fc0270 con 0x5563f711ce00 2024-05-09T00:07:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f35437fe700 1 -- 172.21.15.81:0/1113869306 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3558005210 con 0x5563f711ce00 2024-05-09T00:07:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f3576942b80 10 client.16653 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.459+0000 7f3576942b80 1 -- 172.21.15.81:0/1113869306 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5563f6e94b60 con 0x5563f711ce00 2024-05-09T00:07:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.460+0000 7f35437fe700 1 -- 172.21.15.81:0/1113869306 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3558030020 con 0x5563f711ce00 2024-05-09T00:07:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.460+0000 7f35437fe700 1 -- 172.21.15.81:0/1113869306 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3558016030 con 0x5563f711ce00 2024-05-09T00:07:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.460+0000 7f3576942b80 10 client.16653 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.460+0000 7f3576942b80 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.460+0000 7f3576942b80 20 client.16653 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.460+0000 7f3576942b80 1 --2- 172.21.15.81:0/1113869306 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5563f7131180 0x5563f71335a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.460+0000 7f3576942b80 4 client.16653 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:07:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.460+0000 7f3576942b80 1 -- 172.21.15.81:0/1113869306 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563f70e6810 con 0x5563f7131180 2024-05-09T00:07:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.460+0000 7f3563fff700 1 --2- 172.21.15.81:0/1113869306 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5563f7131180 0x5563f71335a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.460+0000 7f35437fe700 10 client.16653 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.460+0000 7f3563fff700 1 --2- 172.21.15.81:0/1113869306 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5563f7131180 0x5563f71335a0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9010fda9d6b9b076 server_cookie=5cd0b90a23074257 in_seq=0 out_seq=0 2024-05-09T00:07:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f35437fe700 1 -- 172.21.15.81:0/1113869306 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5563f70e6810 con 0x5563f7131180 2024-05-09T00:07:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f35437fe700 10 client.16653 handle_command_reply: tid=0 2024-05-09T00:07:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f3576942b80 1 client.16653 shutdown 2024-05-09T00:07:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f3576942b80 1 -- 172.21.15.81:0/1113869306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711ce00 msgr2=0x5563f71210b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f3576942b80 1 --2- 172.21.15.81:0/1113869306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711ce00 0x5563f71210b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f3558004d60 tx=0x7f355800eda0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f3576942b80 1 -- 172.21.15.81:0/1113869306 shutdown_connections 2024-05-09T00:07:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f3576942b80 1 --2- 172.21.15.81:0/1113869306 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5563f7131180 0x5563f71335a0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f3576942b80 1 --2- 172.21.15.81:0/1113869306 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f7117890 0x5563f7120b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f3576942b80 1 --2- 172.21.15.81:0/1113869306 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711d720 0x5563f71215f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f35437fe700 0 client.16653 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f3576942b80 1 --2- 172.21.15.81:0/1113869306 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711ce00 0x5563f71210b0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f3576942b80 1 -- 172.21.15.81:0/1113869306 >> 172.21.15.81:0/1113869306 conn(0x5563f7075210 msgr2=0x5563f71115a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f3576942b80 1 -- 172.21.15.81:0/1113869306 shutdown_connections 2024-05-09T00:07:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f3576942b80 1 -- 172.21.15.81:0/1113869306 wait complete. 2024-05-09T00:07:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.461+0000 7f3576942b80 20 client.16653 trim_cache size 0 max 16384 2024-05-09T00:07:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.479+0000 7f3576942b80 1 Processor -- start 2024-05-09T00:07:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.479+0000 7f3576942b80 1 -- start start 2024-05-09T00:07:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.479+0000 7f3576942b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f7117890 0x5563f712cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.479+0000 7f3576942b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711ce00 0x5563f71139a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.479+0000 7f3576942b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f711d720 0x5563f7111d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.479+0000 7f3576942b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f7123620 con 0x5563f7117890 2024-05-09T00:07:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.479+0000 7f3576942b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f710edc0 con 0x5563f711d720 2024-05-09T00:07:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.479+0000 7f3576942b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f7113790 con 0x5563f711ce00 2024-05-09T00:07:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.479+0000 7f3563fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f7117890 0x5563f712cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.479+0000 7f3563fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f7117890 0x5563f712cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43184/0 (socket says 172.21.15.81:43184) 2024-05-09T00:07:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.479+0000 7f3563fff700 1 -- 172.21.15.81:0/1141665688 learned_addr learned my addr 172.21.15.81:0/1141665688 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.479+0000 7f3568d25700 1 --2- 172.21.15.81:0/1141665688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f711d720 0x5563f7111d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.479+0000 7f3563fff700 1 -- 172.21.15.81:0/1141665688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711ce00 msgr2=0x5563f71139a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.480+0000 7f35637fe700 1 --2- 172.21.15.81:0/1141665688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711ce00 0x5563f71139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.480+0000 7f3563fff700 1 --2- 172.21.15.81:0/1141665688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711ce00 0x5563f71139a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.480+0000 7f3563fff700 1 -- 172.21.15.81:0/1141665688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f711d720 msgr2=0x5563f7111d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.480+0000 7f3563fff700 1 --2- 172.21.15.81:0/1141665688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f711d720 0x5563f7111d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.480+0000 7f3563fff700 1 -- 172.21.15.81:0/1141665688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563f702d560 con 0x5563f7117890 2024-05-09T00:07:26.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.480+0000 7f3568d25700 1 --2- 172.21.15.81:0/1141665688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f711d720 0x5563f7111d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.480+0000 7f3563fff700 1 --2- 172.21.15.81:0/1141665688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f7117890 0x5563f712cc20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f355400b7c0 tx=0x7f3554015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20c77fba1007beb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.480+0000 7f354affd700 1 -- 172.21.15.81:0/1141665688 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554025040 con 0x5563f7117890 2024-05-09T00:07:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.480+0000 7f354affd700 1 -- 172.21.15.81:0/1141665688 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3554027770 con 0x5563f7117890 2024-05-09T00:07:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.480+0000 7f354affd700 1 -- 172.21.15.81:0/1141665688 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355401f430 con 0x5563f7117890 2024-05-09T00:07:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.480+0000 7f3576942b80 1 -- 172.21.15.81:0/1141665688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f7117890 msgr2=0x5563f712cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.480+0000 7f3576942b80 1 --2- 172.21.15.81:0/1141665688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f7117890 0x5563f712cc20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f355400b7c0 tx=0x7f3554015000 comp rx=0 tx=0).stop 2024-05-09T00:07:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 -- 172.21.15.81:0/1141665688 shutdown_connections 2024-05-09T00:07:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 --2- 172.21.15.81:0/1141665688 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f711d720 0x5563f7111d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 --2- 172.21.15.81:0/1141665688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f7117890 0x5563f712cc20 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 --2- 172.21.15.81:0/1141665688 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711ce00 0x5563f71139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 -- 172.21.15.81:0/1141665688 >> 172.21.15.81:0/1141665688 conn(0x5563f7075210 msgr2=0x5563f711f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 -- 172.21.15.81:0/1141665688 shutdown_connections 2024-05-09T00:07:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 -- 172.21.15.81:0/1141665688 wait complete. 2024-05-09T00:07:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 -- start start 2024-05-09T00:07:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 Processor -- start 2024-05-09T00:07:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f7117890 0x5563f7126150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711ce00 0x5563f7126690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711d720 0x5563f7186680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f7126fa0 con 0x5563f711ce00 2024-05-09T00:07:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f7186bc0 con 0x5563f7117890 2024-05-09T00:07:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563f7186d00 con 0x5563f711d720 2024-05-09T00:07:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f3576942b80 10 client.0 _ll_register_callbacks cb 0x5563f700cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.481+0000 7f35637fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711ce00 0x5563f7126690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f35637fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711ce00 0x5563f7126690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43190/0 (socket says 172.21.15.81:43190) 2024-05-09T00:07:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f35637fe700 1 -- 172.21.15.81:0/3240646536 learned_addr learned my addr 172.21.15.81:0/3240646536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f3563fff700 1 --2- 172.21.15.81:0/3240646536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f7117890 0x5563f7126150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f3568d25700 1 --2- 172.21.15.81:0/3240646536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711d720 0x5563f7186680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f35637fe700 1 -- 172.21.15.81:0/3240646536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711d720 msgr2=0x5563f7186680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f35637fe700 1 --2- 172.21.15.81:0/3240646536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711d720 0x5563f7186680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f35637fe700 1 -- 172.21.15.81:0/3240646536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f7117890 msgr2=0x5563f7126150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f35637fe700 1 --2- 172.21.15.81:0/3240646536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f7117890 0x5563f7126150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f35637fe700 1 -- 172.21.15.81:0/3240646536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355400f970 con 0x5563f711ce00 2024-05-09T00:07:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f35637fe700 1 --2- 172.21.15.81:0/3240646536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711ce00 0x5563f7126690 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3558010d10 tx=0x7f3558010a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb9bdbb39c9e4f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f35437fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f35437fe700 1 -- 172.21.15.81:0/3240646536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355801f070 con 0x5563f711ce00 2024-05-09T00:07:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f3576942b80 1 -- 172.21.15.81:0/3240646536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f355800eed0 con 0x5563f711ce00 2024-05-09T00:07:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f35437fe700 1 -- 172.21.15.81:0/3240646536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f3558000e40 con 0x5563f711ce00 2024-05-09T00:07:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f35437fe700 1 -- 172.21.15.81:0/3240646536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3558023410 con 0x5563f711ce00 2024-05-09T00:07:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f3576942b80 10 client.16659 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f3576942b80 1 -- 172.21.15.81:0/3240646536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5563f6eeccd0 con 0x5563f711ce00 2024-05-09T00:07:26.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.482+0000 7f35437fe700 1 -- 172.21.15.81:0/3240646536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f355800eed0 con 0x5563f711ce00 2024-05-09T00:07:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.483+0000 7f35437fe700 1 -- 172.21.15.81:0/3240646536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f355800e350 con 0x5563f711ce00 2024-05-09T00:07:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.483+0000 7f3576942b80 10 client.16659 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.483+0000 7f3576942b80 10 client.16659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.483+0000 7f3576942b80 20 client.16659 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.483+0000 7f3576942b80 1 --2- 172.21.15.81:0/3240646536 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5563f7188270 0x5563f718a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.483+0000 7f3576942b80 4 client.16659 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:07:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.483+0000 7f3576942b80 1 -- 172.21.15.81:0/3240646536 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5563f705fec0 con 0x5563f7188270 2024-05-09T00:07:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.483+0000 7f3563fff700 1 --2- 172.21.15.81:0/3240646536 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5563f7188270 0x5563f718a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.483+0000 7f35437fe700 10 client.16659 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.483+0000 7f3563fff700 1 --2- 172.21.15.81:0/3240646536 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5563f7188270 0x5563f718a690 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8306d6285fcd6b0 server_cookie=e7527c19935cab49 in_seq=0 out_seq=0 2024-05-09T00:07:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.483+0000 7f35437fe700 1 -- 172.21.15.81:0/3240646536 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5563f705fec0 con 0x5563f7188270 2024-05-09T00:07:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.483+0000 7f35437fe700 10 client.16659 handle_command_reply: tid=0 2024-05-09T00:07:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.483+0000 7f3576942b80 1 client.16659 shutdown 2024-05-09T00:07:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f3576942b80 1 -- 172.21.15.81:0/3240646536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711ce00 msgr2=0x5563f7126690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f3576942b80 1 --2- 172.21.15.81:0/3240646536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711ce00 0x5563f7126690 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f3558010d10 tx=0x7f3558010a40 comp rx=0 tx=0).stop 2024-05-09T00:07:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f3576942b80 1 -- 172.21.15.81:0/3240646536 shutdown_connections 2024-05-09T00:07:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f3576942b80 1 --2- 172.21.15.81:0/3240646536 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5563f7188270 0x5563f718a690 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f3576942b80 1 --2- 172.21.15.81:0/3240646536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5563f7117890 0x5563f7126150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f3576942b80 1 --2- 172.21.15.81:0/3240646536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5563f711d720 0x5563f7186680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f3576942b80 1 --2- 172.21.15.81:0/3240646536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5563f711ce00 0x5563f7126690 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f35437fe700 0 client.16659 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f3576942b80 1 -- 172.21.15.81:0/3240646536 >> 172.21.15.81:0/3240646536 conn(0x5563f7075210 msgr2=0x5563f711bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f3576942b80 1 -- 172.21.15.81:0/3240646536 shutdown_connections 2024-05-09T00:07:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f3576942b80 1 -- 172.21.15.81:0/3240646536 wait complete. 2024-05-09T00:07:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f3576942b80 20 client.16659 trim_cache size 0 max 16384 2024-05-09T00:07:26.486 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:07:26.486 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:07:26.486 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:07:26.486 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:07:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f356a788700 1 -- 172.21.15.81:0/2171580978 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f354c0a1290 msgr2=0x7f354c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f356a788700 1 --2- 172.21.15.81:0/2171580978 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f354c0a1290 0x7f354c0a3750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3554005fd0 tx=0x7f3554005f60 comp rx=0 tx=0).stop 2024-05-09T00:07:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f356a788700 1 -- 172.21.15.81:0/2171580978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f356419df40 msgr2=0x7f356419e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f356a788700 1 --2- 172.21.15.81:0/2171580978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f356419df40 0x7f356419e3c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f355c006130 tx=0x7f355c0093b0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f356a788700 1 -- 172.21.15.81:0/2171580978 shutdown_connections 2024-05-09T00:07:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f356a788700 1 --2- 172.21.15.81:0/2171580978 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f354c0a1290 0x7f354c0a3750 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f356a788700 1 --2- 172.21.15.81:0/2171580978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3564100060 0x7f3564199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f356a788700 1 --2- 172.21.15.81:0/2171580978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f356419df40 0x7f356419e3c0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f356a788700 1 --2- 172.21.15.81:0/2171580978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3564105160 0x7f3564199ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f356a788700 1 -- 172.21.15.81:0/2171580978 >> 172.21.15.81:0/2171580978 conn(0x7f3564076f40 msgr2=0x7f3564068530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f356a788700 1 -- 172.21.15.81:0/2171580978 shutdown_connections 2024-05-09T00:07:26.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.484+0000 7f356a788700 1 -- 172.21.15.81:0/2171580978 wait complete. 2024-05-09T00:07:26.491 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:07:26.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:07:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.618+0000 7f46e8c9b700 1 -- 172.21.15.81:0/2586545836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e4100910 msgr2=0x7f46e4104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.618+0000 7f46e8c9b700 1 --2- 172.21.15.81:0/2586545836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e4100910 0x7f46e4104950 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009990 tx=0x7f46d8009ca0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.619+0000 7f46e8c9b700 1 -- 172.21.15.81:0/2586545836 shutdown_connections 2024-05-09T00:07:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.619+0000 7f46e8c9b700 1 --2- 172.21.15.81:0/2586545836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46e4105080 0x7f46e410cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.619+0000 7f46e8c9b700 1 --2- 172.21.15.81:0/2586545836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e40fff60 0x7f46e4100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.619+0000 7f46e8c9b700 1 --2- 172.21.15.81:0/2586545836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e4100910 0x7f46e4104950 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.619+0000 7f46e8c9b700 1 -- 172.21.15.81:0/2586545836 >> 172.21.15.81:0/2586545836 conn(0x7f46e40fb820 msgr2=0x7f46e40fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:26.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.619+0000 7f46e8c9b700 1 -- 172.21.15.81:0/2586545836 shutdown_connections 2024-05-09T00:07:26.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.619+0000 7f46e8c9b700 1 -- 172.21.15.81:0/2586545836 wait complete. 2024-05-09T00:07:26.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.619+0000 7f46e8c9b700 1 Processor -- start 2024-05-09T00:07:26.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.619+0000 7f46e8c9b700 1 -- start start 2024-05-09T00:07:26.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e8c9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e40fff60 0x7f46e4197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e8c9b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46e4105080 0x7f46e41977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e8c9b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e419bb60 0x7f46e419bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e8c9b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e419c5e0 con 0x7f46e40fff60 2024-05-09T00:07:26.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e8c9b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e419c750 con 0x7f46e4105080 2024-05-09T00:07:26.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e8c9b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e419c910 con 0x7f46e419bb60 2024-05-09T00:07:26.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e40fff60 0x7f46e4197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e40fff60 0x7f46e4197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43198/0 (socket says 172.21.15.81:43198) 2024-05-09T00:07:26.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e259c700 1 -- 172.21.15.81:0/583666582 learned_addr learned my addr 172.21.15.81:0/583666582 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:26.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e2d9d700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e419bb60 0x7f46e419bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e1d9b700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46e4105080 0x7f46e41977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e259c700 1 -- 172.21.15.81:0/583666582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e419bb60 msgr2=0x7f46e419bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e259c700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e419bb60 0x7f46e419bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e259c700 1 -- 172.21.15.81:0/583666582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46e4105080 msgr2=0x7f46e41977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e259c700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46e4105080 0x7f46e41977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e259c700 1 -- 172.21.15.81:0/583666582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d80095f0 con 0x7f46e40fff60 2024-05-09T00:07:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e2d9d700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e419bb60 0x7f46e419bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:07:26.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e1d9b700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46e4105080 0x7f46e41977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:26.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e259c700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e40fff60 0x7f46e4197280 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f46d400d950 tx=0x7f46d400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:26.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46d37fe700 1 -- 172.21.15.81:0/583666582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d4009b40 con 0x7f46e40fff60 2024-05-09T00:07:26.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46d37fe700 1 -- 172.21.15.81:0/583666582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46d4009ca0 con 0x7f46e40fff60 2024-05-09T00:07:26.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e8c9b700 1 -- 172.21.15.81:0/583666582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e41a3e70 con 0x7f46e40fff60 2024-05-09T00:07:26.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46d37fe700 1 -- 172.21.15.81:0/583666582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d400f620 con 0x7f46e40fff60 2024-05-09T00:07:26.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.620+0000 7f46e8c9b700 1 -- 172.21.15.81:0/583666582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e41a4340 con 0x7f46e40fff60 2024-05-09T00:07:26.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.621+0000 7f46e8c9b700 1 -- 172.21.15.81:0/583666582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e4109360 con 0x7f46e40fff60 2024-05-09T00:07:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.622+0000 7f46d37fe700 1 -- 172.21.15.81:0/583666582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f46d4010460 con 0x7f46e40fff60 2024-05-09T00:07:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.623+0000 7f46d37fe700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f46cc0a1310 0x7f46cc0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.623+0000 7f46e1d9b700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f46cc0a1310 0x7f46cc0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.623+0000 7f46d37fe700 1 -- 172.21.15.81:0/583666582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f46d40cd000 con 0x7f46e40fff60 2024-05-09T00:07:26.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.623+0000 7f46e1d9b700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f46cc0a1310 0x7f46cc0a37d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f46d8000c00 tx=0x7f46d8005fb0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:26.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.627+0000 7f46d37fe700 1 -- 172.21.15.81:0/583666582 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f46d4100d60 con 0x7f46e40fff60 2024-05-09T00:07:26.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.870+0000 7f46e8c9b700 1 -- 172.21.15.81:0/583666582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46e4198580 con 0x7f46e40fff60 2024-05-09T00:07:26.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.871+0000 7f46d37fe700 1 -- 172.21.15.81:0/583666582 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7f46d4020090 con 0x7f46e40fff60 2024-05-09T00:07:26.866 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:07:26.866 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:07:26.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.873+0000 7f46e8c9b700 1 -- 172.21.15.81:0/583666582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f46cc0a1310 msgr2=0x7f46cc0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.873+0000 7f46e8c9b700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f46cc0a1310 0x7f46cc0a37d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f46d8000c00 tx=0x7f46d8005fb0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.873+0000 7f46e8c9b700 1 -- 172.21.15.81:0/583666582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e40fff60 msgr2=0x7f46e4197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.873+0000 7f46e8c9b700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e40fff60 0x7f46e4197280 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f46d400d950 tx=0x7f46d400dd10 comp rx=0 tx=0).stop 2024-05-09T00:07:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.873+0000 7f46e8c9b700 1 -- 172.21.15.81:0/583666582 shutdown_connections 2024-05-09T00:07:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.873+0000 7f46e8c9b700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f46cc0a1310 0x7f46cc0a37d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.873+0000 7f46e8c9b700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e419bb60 0x7f46e419bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.873+0000 7f46e8c9b700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46e40fff60 0x7f46e4197280 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.873+0000 7f46e8c9b700 1 --2- 172.21.15.81:0/583666582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46e4105080 0x7f46e41977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.873+0000 7f46e8c9b700 1 -- 172.21.15.81:0/583666582 >> 172.21.15.81:0/583666582 conn(0x7f46e40fb820 msgr2=0x7f46e40695f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.873+0000 7f46e8c9b700 1 -- 172.21.15.81:0/583666582 shutdown_connections 2024-05-09T00:07:26.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:26.873+0000 7f46e8c9b700 1 -- 172.21.15.81:0/583666582 wait complete. 2024-05-09T00:07:26.870 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:07:26.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:07:27.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.010+0000 7f5cf7740700 1 -- 172.21.15.81:0/3486325425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf0100060 msgr2=0x7f5cf0100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.010+0000 7f5cf7740700 1 --2- 172.21.15.81:0/3486325425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf0100060 0x7f5cf0100440 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0009990 tx=0x7f5ce0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.010+0000 7f5cf7740700 1 -- 172.21.15.81:0/3486325425 shutdown_connections 2024-05-09T00:07:27.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.010+0000 7f5cf7740700 1 --2- 172.21.15.81:0/3486325425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf0105180 0x7f5cf010cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.010+0000 7f5cf7740700 1 --2- 172.21.15.81:0/3486325425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf0100060 0x7f5cf0100440 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.010+0000 7f5cf7740700 1 --2- 172.21.15.81:0/3486325425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cf0100a10 0x7f5cf0104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.010+0000 7f5cf7740700 1 -- 172.21.15.81:0/3486325425 >> 172.21.15.81:0/3486325425 conn(0x7f5cf0076f70 msgr2=0x7f5cf0077380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.010+0000 7f5cf7740700 1 -- 172.21.15.81:0/3486325425 shutdown_connections 2024-05-09T00:07:27.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.010+0000 7f5cf7740700 1 -- 172.21.15.81:0/3486325425 wait complete. 2024-05-09T00:07:27.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf7740700 1 Processor -- start 2024-05-09T00:07:27.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf7740700 1 -- start start 2024-05-09T00:07:27.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf7740700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf0100060 0x7f5cf0198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf7740700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf0105180 0x7f5cf0198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf7740700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cf0198ce0 0x7f5cf01a3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf7740700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01a39d0 con 0x7f5cf0100060 2024-05-09T00:07:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf7740700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01a3b40 con 0x7f5cf0198ce0 2024-05-09T00:07:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf7740700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01a3d00 con 0x7f5cf0105180 2024-05-09T00:07:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf54dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf0100060 0x7f5cf0198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf54dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf0100060 0x7f5cf0198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43220/0 (socket says 172.21.15.81:43220) 2024-05-09T00:07:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf54dc700 1 -- 172.21.15.81:0/8267626 learned_addr learned my addr 172.21.15.81:0/8267626 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf5cdd700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cf0198ce0 0x7f5cf01a3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf4cdb700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf0105180 0x7f5cf0198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf54dc700 1 -- 172.21.15.81:0/8267626 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf0105180 msgr2=0x7f5cf0198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf54dc700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf0105180 0x7f5cf0198750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf54dc700 1 -- 172.21.15.81:0/8267626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cf0198ce0 msgr2=0x7f5cf01a3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf54dc700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cf0198ce0 0x7f5cf01a3290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf54dc700 1 -- 172.21.15.81:0/8267626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce00095f0 con 0x7f5cf0100060 2024-05-09T00:07:27.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf5cdd700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cf0198ce0 0x7f5cf01a3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:27.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.011+0000 7f5cf54dc700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf0100060 0x7f5cf0198210 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0005770 tx=0x7f5ce00057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.012+0000 7f5ce67fc700 1 -- 172.21.15.81:0/8267626 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce001d070 con 0x7f5cf0100060 2024-05-09T00:07:27.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.012+0000 7f5ce67fc700 1 -- 172.21.15.81:0/8267626 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ce000fdd0 con 0x7f5cf0100060 2024-05-09T00:07:27.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.012+0000 7f5cf7740700 1 -- 172.21.15.81:0/8267626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf01a3f80 con 0x7f5cf0100060 2024-05-09T00:07:27.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.012+0000 7f5ce67fc700 1 -- 172.21.15.81:0/8267626 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce0022ea0 con 0x7f5cf0100060 2024-05-09T00:07:27.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.012+0000 7f5cf7740700 1 -- 172.21.15.81:0/8267626 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf01a4340 con 0x7f5cf0100060 2024-05-09T00:07:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.014+0000 7f5ce67fc700 1 -- 172.21.15.81:0/8267626 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f5ce000f910 con 0x7f5cf0100060 2024-05-09T00:07:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.014+0000 7f5ce67fc700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5cdc0a1290 0x7f5cdc0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.014+0000 7f5ce67fc700 1 -- 172.21.15.81:0/8267626 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f5ce00cdf60 con 0x7f5cf0100060 2024-05-09T00:07:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.014+0000 7f5cf4cdb700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5cdc0a1290 0x7f5cdc0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.015+0000 7f5cf4cdb700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5cdc0a1290 0x7f5cdc0a3750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5cec006fd0 tx=0x7f5cec008040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.015+0000 7f5d038fab80 1 Processor -- start 2024-05-09T00:07:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.015+0000 7f5d038fab80 1 -- start start 2024-05-09T00:07:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.015+0000 7f5d038fab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39194e00 0x55ed391951e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.015+0000 7f5d038fab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed39195720 0x55ed3918f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5d038fab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed3918f890 0x55ed3918fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5d038fab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed390e6150 con 0x55ed39194e00 2024-05-09T00:07:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5d038fab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed390e3b10 con 0x55ed39195720 2024-05-09T00:07:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5d038fab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed390df400 con 0x55ed3918f890 2024-05-09T00:07:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5cf54dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39194e00 0x55ed391951e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5cf54dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39194e00 0x55ed391951e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43222/0 (socket says 172.21.15.81:43222) 2024-05-09T00:07:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5cf54dc700 1 -- 172.21.15.81:0/3723003872 learned_addr learned my addr 172.21.15.81:0/3723003872 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5cf5cdd700 1 --2- 172.21.15.81:0/3723003872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed3918f890 0x55ed3918fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5cf54dc700 1 -- 172.21.15.81:0/3723003872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed3918f890 msgr2=0x55ed3918fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5cf54dc700 1 --2- 172.21.15.81:0/3723003872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed3918f890 0x55ed3918fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5cf54dc700 1 -- 172.21.15.81:0/3723003872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed39195720 msgr2=0x55ed3918f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5cf54dc700 1 --2- 172.21.15.81:0/3723003872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed39195720 0x55ed3918f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5cf54dc700 1 -- 172.21.15.81:0/3723003872 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed38f603b0 con 0x55ed39194e00 2024-05-09T00:07:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5cf5cdd700 1 --2- 172.21.15.81:0/3723003872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed3918f890 0x55ed3918fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5cf54dc700 1 --2- 172.21.15.81:0/3723003872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39194e00 0x55ed391951e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0097720 tx=0x7f5ce000ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a5c43beb56db2e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5cdb7fe700 1 -- 172.21.15.81:0/3723003872 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce009f050 con 0x55ed39194e00 2024-05-09T00:07:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5cdb7fe700 1 -- 172.21.15.81:0/3723003872 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ce00a3610 con 0x55ed39194e00 2024-05-09T00:07:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.016+0000 7f5cdb7fe700 1 -- 172.21.15.81:0/3723003872 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce009b6e0 con 0x55ed39194e00 2024-05-09T00:07:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.017+0000 7f5d038fab80 1 -- 172.21.15.81:0/3723003872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39194e00 msgr2=0x55ed391951e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.017+0000 7f5d038fab80 1 --2- 172.21.15.81:0/3723003872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39194e00 0x55ed391951e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0097720 tx=0x7f5ce000ff40 comp rx=0 tx=0).stop 2024-05-09T00:07:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.017+0000 7f5d038fab80 1 -- 172.21.15.81:0/3723003872 shutdown_connections 2024-05-09T00:07:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.017+0000 7f5d038fab80 1 --2- 172.21.15.81:0/3723003872 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed3918f890 0x55ed3918fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.017+0000 7f5d038fab80 1 --2- 172.21.15.81:0/3723003872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39194e00 0x55ed391951e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.017+0000 7f5d038fab80 1 --2- 172.21.15.81:0/3723003872 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed39195720 0x55ed3918f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.017+0000 7f5d038fab80 1 -- 172.21.15.81:0/3723003872 >> 172.21.15.81:0/3723003872 conn(0x55ed390ed210 msgr2=0x55ed39189df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.017+0000 7f5d038fab80 1 -- 172.21.15.81:0/3723003872 shutdown_connections 2024-05-09T00:07:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.017+0000 7f5d038fab80 1 -- 172.21.15.81:0/3723003872 wait complete. 2024-05-09T00:07:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.017+0000 7f5d038fab80 1 -- start start 2024-05-09T00:07:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.018+0000 7f5d038fab80 1 Processor -- start 2024-05-09T00:07:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.018+0000 7f5d038fab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed3918f890 0x55ed39198c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.018+0000 7f5d038fab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed39194e00 0x55ed39199160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.018+0000 7f5d038fab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed39195720 0x55ed391996a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.018+0000 7f5d038fab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed3907b560 con 0x55ed3918f890 2024-05-09T00:07:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.018+0000 7f5d038fab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed3907b200 con 0x55ed39195720 2024-05-09T00:07:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.018+0000 7f5d038fab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed38f626a0 con 0x55ed39194e00 2024-05-09T00:07:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.018+0000 7f5d038fab80 10 client.0 _ll_register_callbacks cb 0x55ed39084b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.018+0000 7f5cf54dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed3918f890 0x55ed39198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.018+0000 7f5cf54dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed3918f890 0x55ed39198c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43232/0 (socket says 172.21.15.81:43232) 2024-05-09T00:07:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.018+0000 7f5cf54dc700 1 -- 172.21.15.81:0/3798341759 learned_addr learned my addr 172.21.15.81:0/3798341759 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.018+0000 7f5cf54dc700 1 -- 172.21.15.81:0/3798341759 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed39194e00 msgr2=0x55ed39199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.018+0000 7f5cf4cdb700 1 --2- 172.21.15.81:0/3798341759 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed39194e00 0x55ed39199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5cf54dc700 1 --2- 172.21.15.81:0/3798341759 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed39194e00 0x55ed39199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5cf54dc700 1 -- 172.21.15.81:0/3798341759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed39195720 msgr2=0x55ed391996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5cf5cdd700 1 --2- 172.21.15.81:0/3798341759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed39195720 0x55ed391996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5cf54dc700 1 --2- 172.21.15.81:0/3798341759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed39195720 0x55ed391996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5cf54dc700 1 -- 172.21.15.81:0/3798341759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf01a4340 con 0x55ed3918f890 2024-05-09T00:07:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5cf54dc700 1 --2- 172.21.15.81:0/3798341759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed3918f890 0x55ed39198c20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5ce009af20 tx=0x7f5ce00997d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421bc32850e52bf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5cd8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5cd8ff9700 1 -- 172.21.15.81:0/3798341759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce009f050 con 0x55ed3918f890 2024-05-09T00:07:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5cd8ff9700 1 -- 172.21.15.81:0/3798341759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f5ce00a10b0 con 0x55ed3918f890 2024-05-09T00:07:27.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5d038fab80 1 -- 172.21.15.81:0/3798341759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed39038270 con 0x55ed3918f890 2024-05-09T00:07:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5cd8ff9700 1 -- 172.21.15.81:0/3798341759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ce00a1270 con 0x55ed3918f890 2024-05-09T00:07:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5d038fab80 10 client.16677 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5d038fab80 1 -- 172.21.15.81:0/3798341759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ed38f0cb60 con 0x55ed3918f890 2024-05-09T00:07:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5cd8ff9700 1 -- 172.21.15.81:0/3798341759 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ed39038270 con 0x55ed3918f890 2024-05-09T00:07:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5cd8ff9700 1 -- 172.21.15.81:0/3798341759 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5ce00a3180 con 0x55ed3918f890 2024-05-09T00:07:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5d038fab80 10 client.16677 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5d038fab80 10 client.16677 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:07:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5d038fab80 20 client.16677 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5d038fab80 1 --2- 172.21.15.81:0/3798341759 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ed391a8b30 0x55ed391aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5d038fab80 4 client.16677 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:07:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.019+0000 7f5d038fab80 1 -- 172.21.15.81:0/3798341759 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed3915e810 con 0x55ed391a8b30 2024-05-09T00:07:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.020+0000 7f5cf4cdb700 1 --2- 172.21.15.81:0/3798341759 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ed391a8b30 0x55ed391aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.020+0000 7f5cd8ff9700 10 client.16677 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:07:27.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.020+0000 7f5cf4cdb700 1 --2- 172.21.15.81:0/3798341759 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ed391a8b30 0x55ed391aaf50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8b2aee3732542d6 server_cookie=bdb18d35b0984361 in_seq=0 out_seq=0 2024-05-09T00:07:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5cd8ff9700 1 -- 172.21.15.81:0/3798341759 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ed3915e810 con 0x55ed391a8b30 2024-05-09T00:07:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5cd8ff9700 10 client.16677 handle_command_reply: tid=0 2024-05-09T00:07:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5d038fab80 1 client.16677 shutdown 2024-05-09T00:07:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5d038fab80 1 -- 172.21.15.81:0/3798341759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed3918f890 msgr2=0x55ed39198c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5d038fab80 1 --2- 172.21.15.81:0/3798341759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed3918f890 0x55ed39198c20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f5ce009af20 tx=0x7f5ce00997d0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5d038fab80 1 -- 172.21.15.81:0/3798341759 shutdown_connections 2024-05-09T00:07:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5d038fab80 1 --2- 172.21.15.81:0/3798341759 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ed391a8b30 0x55ed391aaf50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5d038fab80 1 --2- 172.21.15.81:0/3798341759 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed39195720 0x55ed391996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5d038fab80 1 --2- 172.21.15.81:0/3798341759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed3918f890 0x55ed39198c20 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5d038fab80 1 --2- 172.21.15.81:0/3798341759 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed39194e00 0x55ed39199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5cd8ff9700 0 client.16677 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:07:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5d038fab80 1 -- 172.21.15.81:0/3798341759 >> 172.21.15.81:0/3798341759 conn(0x55ed390ed210 msgr2=0x55ed391895a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5d038fab80 1 -- 172.21.15.81:0/3798341759 shutdown_connections 2024-05-09T00:07:27.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5d038fab80 1 -- 172.21.15.81:0/3798341759 wait complete. 2024-05-09T00:07:27.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.021+0000 7f5d038fab80 20 client.16677 trim_cache size 0 max 16384 2024-05-09T00:07:27.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5d038fab80 1 Processor -- start 2024-05-09T00:07:27.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5d038fab80 1 -- start start 2024-05-09T00:07:27.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5d038fab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed3918f890 0x55ed391a5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5d038fab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed39194e00 0x55ed391a4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5d038fab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39195720 0x55ed39189d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5d038fab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed391a5b50 con 0x55ed39195720 2024-05-09T00:07:27.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5d038fab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed391b0160 con 0x55ed39194e00 2024-05-09T00:07:27.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5d038fab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed3918ac70 con 0x55ed3918f890 2024-05-09T00:07:27.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5cf5cdd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39195720 0x55ed39189d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5cf5cdd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39195720 0x55ed39189d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43244/0 (socket says 172.21.15.81:43244) 2024-05-09T00:07:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5cf5cdd700 1 -- 172.21.15.81:0/2752997623 learned_addr learned my addr 172.21.15.81:0/2752997623 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5cf54dc700 1 --2- 172.21.15.81:0/2752997623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed3918f890 0x55ed391a5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5cf4cdb700 1 --2- 172.21.15.81:0/2752997623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed39194e00 0x55ed391a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5cf5cdd700 1 -- 172.21.15.81:0/2752997623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed3918f890 msgr2=0x55ed391a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5cf5cdd700 1 --2- 172.21.15.81:0/2752997623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed3918f890 0x55ed391a5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5cf5cdd700 1 -- 172.21.15.81:0/2752997623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed39194e00 msgr2=0x55ed391a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5cf5cdd700 1 --2- 172.21.15.81:0/2752997623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed39194e00 0x55ed391a4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5cf5cdd700 1 -- 172.21.15.81:0/2752997623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed390a5560 con 0x55ed39195720 2024-05-09T00:07:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.035+0000 7f5cf5cdd700 1 --2- 172.21.15.81:0/2752997623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39195720 0x55ed39189d20 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8007fd0 tx=0x7f5ce800f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e259530523541af server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.036+0000 7f5cdbfff700 1 -- 172.21.15.81:0/2752997623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8013630 con 0x55ed39195720 2024-05-09T00:07:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.036+0000 7f5cdbfff700 1 -- 172.21.15.81:0/2752997623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ce800fe50 con 0x55ed39195720 2024-05-09T00:07:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.036+0000 7f5cdbfff700 1 -- 172.21.15.81:0/2752997623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8012af0 con 0x55ed39195720 2024-05-09T00:07:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.036+0000 7f5d038fab80 1 -- 172.21.15.81:0/2752997623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39195720 msgr2=0x55ed39189d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.036+0000 7f5d038fab80 1 --2- 172.21.15.81:0/2752997623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39195720 0x55ed39189d20 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8007fd0 tx=0x7f5ce800f510 comp rx=0 tx=0).stop 2024-05-09T00:07:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.036+0000 7f5d038fab80 1 -- 172.21.15.81:0/2752997623 shutdown_connections 2024-05-09T00:07:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.036+0000 7f5d038fab80 1 --2- 172.21.15.81:0/2752997623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39195720 0x55ed39189d20 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.036+0000 7f5d038fab80 1 --2- 172.21.15.81:0/2752997623 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed3918f890 0x55ed391a5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.036+0000 7f5d038fab80 1 --2- 172.21.15.81:0/2752997623 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed39194e00 0x55ed391a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.036+0000 7f5d038fab80 1 -- 172.21.15.81:0/2752997623 >> 172.21.15.81:0/2752997623 conn(0x55ed390ed210 msgr2=0x55ed391974f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.036+0000 7f5d038fab80 1 -- 172.21.15.81:0/2752997623 shutdown_connections 2024-05-09T00:07:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.036+0000 7f5d038fab80 1 -- 172.21.15.81:0/2752997623 wait complete. 2024-05-09T00:07:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5d038fab80 1 -- start start 2024-05-09T00:07:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5d038fab80 1 Processor -- start 2024-05-09T00:07:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5d038fab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed3918f890 0x55ed3919de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5d038fab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39194e00 0x55ed3919e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5d038fab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed39195720 0x55ed3919e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5d038fab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed391fe1b0 con 0x55ed39194e00 2024-05-09T00:07:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5d038fab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed391fe320 con 0x55ed3918f890 2024-05-09T00:07:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5d038fab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed391fe4e0 con 0x55ed39195720 2024-05-09T00:07:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5d038fab80 10 client.0 _ll_register_callbacks cb 0x55ed39084b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5cf4cdb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39194e00 0x55ed3919e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5cf4cdb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39194e00 0x55ed3919e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43256/0 (socket says 172.21.15.81:43256) 2024-05-09T00:07:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5cf4cdb700 1 -- 172.21.15.81:0/1422191772 learned_addr learned my addr 172.21.15.81:0/1422191772 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5cf5cdd700 1 --2- 172.21.15.81:0/1422191772 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed39195720 0x55ed3919e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5cf54dc700 1 --2- 172.21.15.81:0/1422191772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed3918f890 0x55ed3919de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5cf4cdb700 1 -- 172.21.15.81:0/1422191772 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed39195720 msgr2=0x55ed3919e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5cf4cdb700 1 --2- 172.21.15.81:0/1422191772 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed39195720 0x55ed3919e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5cf4cdb700 1 -- 172.21.15.81:0/1422191772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed3918f890 msgr2=0x55ed3919de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5cf4cdb700 1 --2- 172.21.15.81:0/1422191772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed3918f890 0x55ed3919de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.037+0000 7f5cf4cdb700 1 -- 172.21.15.81:0/1422191772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce8007bd0 con 0x55ed39194e00 2024-05-09T00:07:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5cf4cdb700 1 --2- 172.21.15.81:0/1422191772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39194e00 0x55ed3919e3a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0069c60 tx=0x7f5cec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c746150df70b9cf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5cd8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5cd8ff9700 1 -- 172.21.15.81:0/1422191772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cec018040 con 0x55ed39194e00 2024-05-09T00:07:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5cd8ff9700 1 -- 172.21.15.81:0/1422191772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f5cec02b410 con 0x55ed39194e00 2024-05-09T00:07:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5d038fab80 1 -- 172.21.15.81:0/1422191772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ce00a3610 con 0x55ed39194e00 2024-05-09T00:07:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5cd8ff9700 1 -- 172.21.15.81:0/1422191772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5cec013e90 con 0x55ed39194e00 2024-05-09T00:07:27.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5d038fab80 10 client.16683 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5d038fab80 1 -- 172.21.15.81:0/1422191772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ed38f64cd0 con 0x55ed39194e00 2024-05-09T00:07:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5cd8ff9700 1 -- 172.21.15.81:0/1422191772 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5cec038020 con 0x55ed39194e00 2024-05-09T00:07:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5cd8ff9700 1 -- 172.21.15.81:0/1422191772 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5cec01e410 con 0x55ed39194e00 2024-05-09T00:07:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5d038fab80 10 client.16683 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5d038fab80 10 client.16683 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:07:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5d038fab80 20 client.16683 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5d038fab80 1 --2- 172.21.15.81:0/1422191772 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ed391ffcf0 0x55ed39202110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5d038fab80 4 client.16683 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:07:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.038+0000 7f5d038fab80 1 -- 172.21.15.81:0/1422191772 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ed390d7ec0 con 0x55ed391ffcf0 2024-05-09T00:07:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.039+0000 7f5cf54dc700 1 --2- 172.21.15.81:0/1422191772 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ed391ffcf0 0x55ed39202110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.039+0000 7f5cd8ff9700 10 client.16683 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:07:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.039+0000 7f5cf54dc700 1 --2- 172.21.15.81:0/1422191772 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ed391ffcf0 0x55ed39202110 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4357d9caebd8dfb5 server_cookie=5a2f0c13a4c91ce3 in_seq=0 out_seq=0 2024-05-09T00:07:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.039+0000 7f5cd8ff9700 1 -- 172.21.15.81:0/1422191772 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ed390d7ec0 con 0x55ed391ffcf0 2024-05-09T00:07:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.039+0000 7f5cd8ff9700 10 client.16683 handle_command_reply: tid=0 2024-05-09T00:07:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.039+0000 7f5d038fab80 1 client.16683 shutdown 2024-05-09T00:07:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5d038fab80 1 -- 172.21.15.81:0/1422191772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39194e00 msgr2=0x55ed3919e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5d038fab80 1 --2- 172.21.15.81:0/1422191772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39194e00 0x55ed3919e3a0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5cf0069c60 tx=0x7f5cec004750 comp rx=0 tx=0).stop 2024-05-09T00:07:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5d038fab80 1 -- 172.21.15.81:0/1422191772 shutdown_connections 2024-05-09T00:07:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5d038fab80 1 --2- 172.21.15.81:0/1422191772 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ed391ffcf0 0x55ed39202110 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5d038fab80 1 --2- 172.21.15.81:0/1422191772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ed3918f890 0x55ed3919de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5cd8ff9700 0 client.16683 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:07:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5d038fab80 1 --2- 172.21.15.81:0/1422191772 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ed39195720 0x55ed3919e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5d038fab80 1 --2- 172.21.15.81:0/1422191772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ed39194e00 0x55ed3919e3a0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5d038fab80 1 -- 172.21.15.81:0/1422191772 >> 172.21.15.81:0/1422191772 conn(0x55ed390ed210 msgr2=0x55ed39193d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5d038fab80 1 -- 172.21.15.81:0/1422191772 shutdown_connections 2024-05-09T00:07:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5d038fab80 1 -- 172.21.15.81:0/1422191772 wait complete. 2024-05-09T00:07:27.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5d038fab80 20 client.16683 trim_cache size 0 max 16384 2024-05-09T00:07:27.042 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:07:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5cf7740700 1 -- 172.21.15.81:0/8267626 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5cdc0a1290 msgr2=0x7f5cdc0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5cf7740700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5cdc0a1290 0x7f5cdc0a3750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5cec006fd0 tx=0x7f5cec008040 comp rx=0 tx=0).stop 2024-05-09T00:07:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5cf7740700 1 -- 172.21.15.81:0/8267626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf0100060 msgr2=0x7f5cf0198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5cf7740700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf0100060 0x7f5cf0198210 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f5ce0005770 tx=0x7f5ce00057a0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5cf7740700 1 -- 172.21.15.81:0/8267626 shutdown_connections 2024-05-09T00:07:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5cf7740700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f5cdc0a1290 0x7f5cdc0a3750 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5cf7740700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5cf0198ce0 0x7f5cf01a3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5cf7740700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf0100060 0x7f5cf0198210 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5cf7740700 1 --2- 172.21.15.81:0/8267626 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5cf0105180 0x7f5cf0198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5cf7740700 1 -- 172.21.15.81:0/8267626 >> 172.21.15.81:0/8267626 conn(0x7f5cf0076f70 msgr2=0x7f5cf00ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5cf7740700 1 -- 172.21.15.81:0/8267626 shutdown_connections 2024-05-09T00:07:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.040+0000 7f5cf7740700 1 -- 172.21.15.81:0/8267626 wait complete. 2024-05-09T00:07:27.047 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:07:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.177+0000 7f56a1ab3700 1 -- 172.21.15.81:0/2848392187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c100a10 msgr2=0x7f569c104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.177+0000 7f56a1ab3700 1 --2- 172.21.15.81:0/2848392187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c100a10 0x7f569c104a30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f5684009990 tx=0x7f5684009ca0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.177+0000 7f56a1ab3700 1 -- 172.21.15.81:0/2848392187 shutdown_connections 2024-05-09T00:07:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.177+0000 7f56a1ab3700 1 --2- 172.21.15.81:0/2848392187 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f569c100060 0x7f569c100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.177+0000 7f56a1ab3700 1 --2- 172.21.15.81:0/2848392187 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f569c105160 0x7f569c10cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.177+0000 7f56a1ab3700 1 --2- 172.21.15.81:0/2848392187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c100a10 0x7f569c104a30 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.177+0000 7f56a1ab3700 1 -- 172.21.15.81:0/2848392187 >> 172.21.15.81:0/2848392187 conn(0x7f569c076f40 msgr2=0x7f569c077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.177+0000 7f56a1ab3700 1 -- 172.21.15.81:0/2848392187 shutdown_connections 2024-05-09T00:07:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.177+0000 7f56a1ab3700 1 -- 172.21.15.81:0/2848392187 wait complete. 2024-05-09T00:07:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f56a1ab3700 1 Processor -- start 2024-05-09T00:07:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f56a1ab3700 1 -- start start 2024-05-09T00:07:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f56a1ab3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c100060 0x7f569c198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f56a1ab3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f569c105160 0x7f569c198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f56a1ab3700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f569c198cb0 0x7f569c1a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f56a1ab3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1a3950 con 0x7f569c100060 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f56a1ab3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1a3ac0 con 0x7f569c105160 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f56a1ab3700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1a3c80 con 0x7f569c198cb0 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f569b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c100060 0x7f569c198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f569b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c100060 0x7f569c198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43272/0 (socket says 172.21.15.81:43272) 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f569b7fe700 1 -- 172.21.15.81:0/3617950941 learned_addr learned my addr 172.21.15.81:0/3617950941 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f569b7fe700 1 -- 172.21.15.81:0/3617950941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f569c198cb0 msgr2=0x7f569c1a32b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f569b7fe700 1 --2- 172.21.15.81:0/3617950941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f569c198cb0 0x7f569c1a32b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f569b7fe700 1 -- 172.21.15.81:0/3617950941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f569c105160 msgr2=0x7f569c198770 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.178+0000 7f569b7fe700 1 --2- 172.21.15.81:0/3617950941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f569c105160 0x7f569c198770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.179+0000 7f569b7fe700 1 -- 172.21.15.81:0/3617950941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56840095f0 con 0x7f569c100060 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.179+0000 7f569b7fe700 1 --2- 172.21.15.81:0/3617950941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c100060 0x7f569c198230 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f568c00d980 tx=0x7f568c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.179+0000 7f5698ff9700 1 -- 172.21.15.81:0/3617950941 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c00bb60 con 0x7f569c100060 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.179+0000 7f5698ff9700 1 -- 172.21.15.81:0/3617950941 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f568c007640 con 0x7f569c100060 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.179+0000 7f5698ff9700 1 -- 172.21.15.81:0/3617950941 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c004e90 con 0x7f569c100060 2024-05-09T00:07:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.179+0000 7f56a1ab3700 1 -- 172.21.15.81:0/3617950941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c1a3f60 con 0x7f569c100060 2024-05-09T00:07:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.179+0000 7f56a1ab3700 1 -- 172.21.15.81:0/3617950941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c1a4390 con 0x7f569c100060 2024-05-09T00:07:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.181+0000 7f5698ff9700 1 -- 172.21.15.81:0/3617950941 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f568c00bcc0 con 0x7f569c100060 2024-05-09T00:07:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.182+0000 7f5698ff9700 1 --2- 172.21.15.81:0/3617950941 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f56880a1310 0x7f56880a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.182+0000 7f569affd700 1 --2- 172.21.15.81:0/3617950941 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f56880a1310 0x7f56880a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.182+0000 7f5698ff9700 1 -- 172.21.15.81:0/3617950941 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f568c0ccbd0 con 0x7f569c100060 2024-05-09T00:07:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.182+0000 7f569affd700 1 --2- 172.21.15.81:0/3617950941 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f56880a1310 0x7f56880a37d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5684006010 tx=0x7f5684005ad0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.182+0000 7f56adc6db80 1 Processor -- start 2024-05-09T00:07:27.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.182+0000 7f56adc6db80 1 -- start start 2024-05-09T00:07:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f56adc6db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c8e210 0x55d130c8e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f56adc6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8eb30 0x55d130c88760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f56adc6db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c88ca0 0x55d130c890e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f56adc6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d130bdb150 con 0x55d130c8eb30 2024-05-09T00:07:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f56adc6db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d130bd8b10 con 0x55d130c88ca0 2024-05-09T00:07:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f56adc6db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d130bd4400 con 0x55d130c8e210 2024-05-09T00:07:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f569affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8eb30 0x55d130c88760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f569affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8eb30 0x55d130c88760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43284/0 (socket says 172.21.15.81:43284) 2024-05-09T00:07:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f569affd700 1 -- 172.21.15.81:0/2290378461 learned_addr learned my addr 172.21.15.81:0/2290378461 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f569affd700 1 -- 172.21.15.81:0/2290378461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c8e210 msgr2=0x55d130c8e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f569affd700 1 --2- 172.21.15.81:0/2290378461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c8e210 0x55d130c8e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f569affd700 1 -- 172.21.15.81:0/2290378461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c88ca0 msgr2=0x55d130c890e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f569affd700 1 --2- 172.21.15.81:0/2290378461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c88ca0 0x55d130c890e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f569affd700 1 -- 172.21.15.81:0/2290378461 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d130a553b0 con 0x55d130c8eb30 2024-05-09T00:07:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f569affd700 1 --2- 172.21.15.81:0/2290378461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8eb30 0x55d130c88760 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f56840059d0 tx=0x7f568401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bbfe69658a3f37 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f5691ffb700 1 -- 172.21.15.81:0/2290378461 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684029070 con 0x55d130c8eb30 2024-05-09T00:07:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f5691ffb700 1 -- 172.21.15.81:0/2290378461 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5684005600 con 0x55d130c8eb30 2024-05-09T00:07:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.183+0000 7f5691ffb700 1 -- 172.21.15.81:0/2290378461 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568401d070 con 0x55d130c8eb30 2024-05-09T00:07:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.184+0000 7f56adc6db80 1 -- 172.21.15.81:0/2290378461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8eb30 msgr2=0x55d130c88760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.184+0000 7f56adc6db80 1 --2- 172.21.15.81:0/2290378461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8eb30 0x55d130c88760 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f56840059d0 tx=0x7f568401d000 comp rx=0 tx=0).stop 2024-05-09T00:07:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.184+0000 7f56adc6db80 1 -- 172.21.15.81:0/2290378461 shutdown_connections 2024-05-09T00:07:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.184+0000 7f56adc6db80 1 --2- 172.21.15.81:0/2290378461 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c88ca0 0x55d130c890e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.184+0000 7f56adc6db80 1 --2- 172.21.15.81:0/2290378461 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c8e210 0x55d130c8e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.184+0000 7f56adc6db80 1 --2- 172.21.15.81:0/2290378461 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8eb30 0x55d130c88760 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.184+0000 7f56adc6db80 1 -- 172.21.15.81:0/2290378461 >> 172.21.15.81:0/2290378461 conn(0x55d130be2210 msgr2=0x55d130c7edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.184+0000 7f56adc6db80 1 -- 172.21.15.81:0/2290378461 shutdown_connections 2024-05-09T00:07:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.184+0000 7f56adc6db80 1 -- 172.21.15.81:0/2290378461 wait complete. 2024-05-09T00:07:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.184+0000 7f56adc6db80 1 -- start start 2024-05-09T00:07:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f56adc6db80 1 Processor -- start 2024-05-09T00:07:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f56adc6db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c88ca0 0x55d130c91f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f56adc6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8e210 0x55d130c924d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f56adc6db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c8eb30 0x55d130c92a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f56adc6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d130b70560 con 0x55d130c8e210 2024-05-09T00:07:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f56adc6db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d130b70200 con 0x55d130c8eb30 2024-05-09T00:07:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f56adc6db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d130a576a0 con 0x55d130c88ca0 2024-05-09T00:07:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f56adc6db80 10 client.0 _ll_register_callbacks cb 0x55d130b79b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f569affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8e210 0x55d130c924d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f569affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8e210 0x55d130c924d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43288/0 (socket says 172.21.15.81:43288) 2024-05-09T00:07:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f569affd700 1 -- 172.21.15.81:0/2100241456 learned_addr learned my addr 172.21.15.81:0/2100241456 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f569affd700 1 -- 172.21.15.81:0/2100241456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c88ca0 msgr2=0x55d130c91f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:07:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f569affd700 1 --2- 172.21.15.81:0/2100241456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c88ca0 0x55d130c91f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f569affd700 1 -- 172.21.15.81:0/2100241456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c8eb30 msgr2=0x55d130c92a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:07:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f569affd700 1 --2- 172.21.15.81:0/2100241456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c8eb30 0x55d130c92a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f569affd700 1 -- 172.21.15.81:0/2100241456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c10d550 con 0x55d130c8e210 2024-05-09T00:07:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f569affd700 1 --2- 172.21.15.81:0/2100241456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8e210 0x55d130c924d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5684005b40 tx=0x7f568400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9b11f95309a582 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.185+0000 7f567affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:27.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f567affd700 1 -- 172.21.15.81:0/2100241456 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684029040 con 0x55d130c8e210 2024-05-09T00:07:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f567affd700 1 -- 172.21.15.81:0/2100241456 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f568402e460 con 0x55d130c8e210 2024-05-09T00:07:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f56adc6db80 1 -- 172.21.15.81:0/2100241456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d130b2d270 con 0x55d130c8e210 2024-05-09T00:07:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f567affd700 1 -- 172.21.15.81:0/2100241456 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f568402e620 con 0x55d130c8e210 2024-05-09T00:07:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f56adc6db80 10 client.16695 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f56adc6db80 1 -- 172.21.15.81:0/2100241456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d130a01b60 con 0x55d130c8e210 2024-05-09T00:07:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f567affd700 1 -- 172.21.15.81:0/2100241456 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d130b2d270 con 0x55d130c8e210 2024-05-09T00:07:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f567affd700 1 -- 172.21.15.81:0/2100241456 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f568400f7d0 con 0x55d130c8e210 2024-05-09T00:07:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f56adc6db80 10 client.16695 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f56adc6db80 10 client.16695 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:07:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f56adc6db80 20 client.16695 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f56adc6db80 1 --2- 172.21.15.81:0/2100241456 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55d130ca2190 0x55d130ca4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f56adc6db80 4 client.16695 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:07:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f56adc6db80 1 -- 172.21.15.81:0/2100241456 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d130c53810 con 0x55d130ca2190 2024-05-09T00:07:27.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.186+0000 7f569b7fe700 1 --2- 172.21.15.81:0/2100241456 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55d130ca2190 0x55d130ca4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.187+0000 7f567affd700 10 client.16695 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.187+0000 7f569b7fe700 1 --2- 172.21.15.81:0/2100241456 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55d130ca2190 0x55d130ca4580 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f8705e5850c6600e server_cookie=fdebab4f7ecd0a13 in_seq=0 out_seq=0 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.187+0000 7f567affd700 1 -- 172.21.15.81:0/2100241456 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d130c53810 con 0x55d130ca2190 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.187+0000 7f567affd700 10 client.16695 handle_command_reply: tid=0 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.187+0000 7f56adc6db80 1 client.16695 shutdown 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.188+0000 7f56adc6db80 1 -- 172.21.15.81:0/2100241456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8e210 msgr2=0x55d130c924d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.188+0000 7f56adc6db80 1 --2- 172.21.15.81:0/2100241456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8e210 0x55d130c924d0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f5684005b40 tx=0x7f568400be30 comp rx=0 tx=0).stop 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.188+0000 7f56adc6db80 1 -- 172.21.15.81:0/2100241456 shutdown_connections 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.188+0000 7f56adc6db80 1 --2- 172.21.15.81:0/2100241456 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55d130ca2190 0x55d130ca4580 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.188+0000 7f56adc6db80 1 --2- 172.21.15.81:0/2100241456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c8eb30 0x55d130c92a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.188+0000 7f56adc6db80 1 --2- 172.21.15.81:0/2100241456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c88ca0 0x55d130c91f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.188+0000 7f567affd700 0 client.16695 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.188+0000 7f56adc6db80 1 --2- 172.21.15.81:0/2100241456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8e210 0x55d130c924d0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.188+0000 7f56adc6db80 1 -- 172.21.15.81:0/2100241456 >> 172.21.15.81:0/2100241456 conn(0x55d130be2210 msgr2=0x55d130c7e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.188+0000 7f56adc6db80 1 -- 172.21.15.81:0/2100241456 shutdown_connections 2024-05-09T00:07:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.188+0000 7f56adc6db80 1 -- 172.21.15.81:0/2100241456 wait complete. 2024-05-09T00:07:27.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.188+0000 7f56adc6db80 20 client.16695 trim_cache size 0 max 16384 2024-05-09T00:07:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f56adc6db80 1 Processor -- start 2024-05-09T00:07:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f56adc6db80 1 -- start start 2024-05-09T00:07:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f56adc6db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c88ca0 0x55d130ca4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f56adc6db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c8e210 0x55d130c9dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f56adc6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8eb30 0x55d130c89080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f56adc6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d130c93600 con 0x55d130c8eb30 2024-05-09T00:07:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f56adc6db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d130c7bdc0 con 0x55d130c88ca0 2024-05-09T00:07:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f56adc6db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d130c94fb0 con 0x55d130c8e210 2024-05-09T00:07:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f569bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8eb30 0x55d130c89080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f569bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8eb30 0x55d130c89080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43296/0 (socket says 172.21.15.81:43296) 2024-05-09T00:07:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f569bfff700 1 -- 172.21.15.81:0/3204458955 learned_addr learned my addr 172.21.15.81:0/3204458955 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f569bfff700 1 -- 172.21.15.81:0/3204458955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c8e210 msgr2=0x55d130c9dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f569bfff700 1 --2- 172.21.15.81:0/3204458955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c8e210 0x55d130c9dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f569bfff700 1 -- 172.21.15.81:0/3204458955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c88ca0 msgr2=0x55d130ca4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f569bfff700 1 --2- 172.21.15.81:0/3204458955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c88ca0 0x55d130ca4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f569bfff700 1 -- 172.21.15.81:0/3204458955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d130b9a560 con 0x55d130c8eb30 2024-05-09T00:07:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.201+0000 7f569bfff700 1 --2- 172.21.15.81:0/3204458955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8eb30 0x55d130c89080 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5694009ef0 tx=0x7f56940076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b32451fd5e81b45 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.202+0000 7f56927fc700 1 -- 172.21.15.81:0/3204458955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694007ea0 con 0x55d130c8eb30 2024-05-09T00:07:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.202+0000 7f56927fc700 1 -- 172.21.15.81:0/3204458955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f569400f040 con 0x55d130c8eb30 2024-05-09T00:07:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.202+0000 7f56927fc700 1 -- 172.21.15.81:0/3204458955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694012940 con 0x55d130c8eb30 2024-05-09T00:07:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.202+0000 7f56adc6db80 1 -- 172.21.15.81:0/3204458955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8eb30 msgr2=0x55d130c89080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.202+0000 7f56adc6db80 1 --2- 172.21.15.81:0/3204458955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8eb30 0x55d130c89080 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f5694009ef0 tx=0x7f56940076c0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.202+0000 7f56adc6db80 1 -- 172.21.15.81:0/3204458955 shutdown_connections 2024-05-09T00:07:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.202+0000 7f56adc6db80 1 --2- 172.21.15.81:0/3204458955 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c88ca0 0x55d130ca4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.202+0000 7f56adc6db80 1 --2- 172.21.15.81:0/3204458955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8eb30 0x55d130c89080 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.202+0000 7f56adc6db80 1 --2- 172.21.15.81:0/3204458955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c8e210 0x55d130c9dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.202+0000 7f56adc6db80 1 -- 172.21.15.81:0/3204458955 >> 172.21.15.81:0/3204458955 conn(0x55d130be2210 msgr2=0x55d130c7b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.202+0000 7f56adc6db80 1 -- 172.21.15.81:0/3204458955 shutdown_connections 2024-05-09T00:07:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.202+0000 7f56adc6db80 1 -- 172.21.15.81:0/3204458955 wait complete. 2024-05-09T00:07:27.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.202+0000 7f56adc6db80 1 -- start start 2024-05-09T00:07:27.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f56adc6db80 1 Processor -- start 2024-05-09T00:07:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f56adc6db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c88ca0 0x55d130c99890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f56adc6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8e210 0x55d130c97520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f56adc6db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c8eb30 0x55d130c97a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f56adc6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d130c98150 con 0x55d130c8e210 2024-05-09T00:07:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f56adc6db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d130c982c0 con 0x55d130c88ca0 2024-05-09T00:07:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f56adc6db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d130cf7660 con 0x55d130c8eb30 2024-05-09T00:07:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f56adc6db80 10 client.0 _ll_register_callbacks cb 0x55d130b79b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f569affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8e210 0x55d130c97520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f569affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8e210 0x55d130c97520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43306/0 (socket says 172.21.15.81:43306) 2024-05-09T00:07:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f569affd700 1 -- 172.21.15.81:0/3422871584 learned_addr learned my addr 172.21.15.81:0/3422871584 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f569b7fe700 1 --2- 172.21.15.81:0/3422871584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c88ca0 0x55d130c99890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f569bfff700 1 --2- 172.21.15.81:0/3422871584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c8eb30 0x55d130c97a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f569affd700 1 -- 172.21.15.81:0/3422871584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c8eb30 msgr2=0x55d130c97a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f569affd700 1 --2- 172.21.15.81:0/3422871584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c8eb30 0x55d130c97a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f569affd700 1 -- 172.21.15.81:0/3422871584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c88ca0 msgr2=0x55d130c99890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f569affd700 1 --2- 172.21.15.81:0/3422871584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c88ca0 0x55d130c99890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.203+0000 7f569affd700 1 -- 172.21.15.81:0/3422871584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5694009ba0 con 0x55d130c8e210 2024-05-09T00:07:27.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f569affd700 1 --2- 172.21.15.81:0/3422871584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8e210 0x55d130c97520 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f5684009990 tx=0x7f56840050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab1e83a8146e3b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f567affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f567affd700 1 -- 172.21.15.81:0/3422871584 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684029030 con 0x55d130c8e210 2024-05-09T00:07:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f567affd700 1 -- 172.21.15.81:0/3422871584 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f5684004910 con 0x55d130c8e210 2024-05-09T00:07:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f56adc6db80 1 -- 172.21.15.81:0/3422871584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5684005600 con 0x55d130c8e210 2024-05-09T00:07:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f567affd700 1 -- 172.21.15.81:0/3422871584 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f568401d070 con 0x55d130c8e210 2024-05-09T00:07:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f56adc6db80 10 client.16701 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f56adc6db80 1 -- 172.21.15.81:0/3422871584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d130a59cd0 con 0x55d130c8e210 2024-05-09T00:07:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f567affd700 1 -- 172.21.15.81:0/3422871584 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5684050080 con 0x55d130c8e210 2024-05-09T00:07:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f567affd700 1 -- 172.21.15.81:0/3422871584 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f568404a030 con 0x55d130c8e210 2024-05-09T00:07:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f56adc6db80 10 client.16701 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f56adc6db80 10 client.16701 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:07:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f56adc6db80 20 client.16701 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f56adc6db80 1 --2- 172.21.15.81:0/3422871584 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55d130cf8900 0x55d130cfacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f56adc6db80 4 client.16701 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:07:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.204+0000 7f56adc6db80 1 -- 172.21.15.81:0/3422871584 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d130bccec0 con 0x55d130cf8900 2024-05-09T00:07:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.205+0000 7f569b7fe700 1 --2- 172.21.15.81:0/3422871584 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55d130cf8900 0x55d130cfacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.206+0000 7f567affd700 10 client.16701 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:07:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.206+0000 7f569b7fe700 1 --2- 172.21.15.81:0/3422871584 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55d130cf8900 0x55d130cfacf0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=42c8584fd31ed61 server_cookie=ad81755ae67c3c78 in_seq=0 out_seq=0 2024-05-09T00:07:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.206+0000 7f567affd700 1 -- 172.21.15.81:0/3422871584 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d130bccec0 con 0x55d130cf8900 2024-05-09T00:07:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.206+0000 7f567affd700 10 client.16701 handle_command_reply: tid=0 2024-05-09T00:07:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.206+0000 7f56adc6db80 1 client.16701 shutdown 2024-05-09T00:07:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.206+0000 7f56adc6db80 1 -- 172.21.15.81:0/3422871584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8e210 msgr2=0x55d130c97520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.206+0000 7f56adc6db80 1 --2- 172.21.15.81:0/3422871584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8e210 0x55d130c97520 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f5684009990 tx=0x7f56840050e0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56adc6db80 1 -- 172.21.15.81:0/3422871584 shutdown_connections 2024-05-09T00:07:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56adc6db80 1 --2- 172.21.15.81:0/3422871584 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55d130cf8900 0x55d130cfacf0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56adc6db80 1 --2- 172.21.15.81:0/3422871584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d130c88ca0 0x55d130c99890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f567affd700 0 client.16701 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:07:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56adc6db80 1 --2- 172.21.15.81:0/3422871584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d130c8eb30 0x55d130c97a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56adc6db80 1 --2- 172.21.15.81:0/3422871584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d130c8e210 0x55d130c97520 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56adc6db80 1 -- 172.21.15.81:0/3422871584 >> 172.21.15.81:0/3422871584 conn(0x55d130be2210 msgr2=0x55d130c89080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56adc6db80 1 -- 172.21.15.81:0/3422871584 shutdown_connections 2024-05-09T00:07:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56adc6db80 1 -- 172.21.15.81:0/3422871584 wait complete. 2024-05-09T00:07:27.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56adc6db80 20 client.16701 trim_cache size 0 max 16384 2024-05-09T00:07:27.207 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:07:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56a1ab3700 1 -- 172.21.15.81:0/3617950941 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f56880a1310 msgr2=0x7f56880a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56a1ab3700 1 --2- 172.21.15.81:0/3617950941 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f56880a1310 0x7f56880a37d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5684006010 tx=0x7f5684005ad0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56a1ab3700 1 -- 172.21.15.81:0/3617950941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c100060 msgr2=0x7f569c198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56a1ab3700 1 --2- 172.21.15.81:0/3617950941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c100060 0x7f569c198230 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f568c00d980 tx=0x7f568c00dd40 comp rx=0 tx=0).stop 2024-05-09T00:07:27.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56a1ab3700 1 -- 172.21.15.81:0/3617950941 shutdown_connections 2024-05-09T00:07:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56a1ab3700 1 --2- 172.21.15.81:0/3617950941 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f56880a1310 0x7f56880a37d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56a1ab3700 1 --2- 172.21.15.81:0/3617950941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f569c198cb0 0x7f569c1a32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56a1ab3700 1 --2- 172.21.15.81:0/3617950941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f569c100060 0x7f569c198230 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56a1ab3700 1 --2- 172.21.15.81:0/3617950941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f569c105160 0x7f569c198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56a1ab3700 1 -- 172.21.15.81:0/3617950941 >> 172.21.15.81:0/3617950941 conn(0x7f569c076f40 msgr2=0x7f569c0fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56a1ab3700 1 -- 172.21.15.81:0/3617950941 shutdown_connections 2024-05-09T00:07:27.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.207+0000 7f56a1ab3700 1 -- 172.21.15.81:0/3617950941 wait complete. 2024-05-09T00:07:27.213 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:26 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/583666582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:07:27.214 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:07:27.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:26 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/583666582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:07:27.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:26 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/583666582' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:07:27.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.343+0000 7f2fc8c68700 1 -- 172.21.15.81:0/1703751357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4100060 msgr2=0x7f2fc4100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.343+0000 7f2fc8c68700 1 --2- 172.21.15.81:0/1703751357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4100060 0x7f2fc4100440 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009990 tx=0x7f2fac009ca0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.343+0000 7f2fc8c68700 1 -- 172.21.15.81:0/1703751357 shutdown_connections 2024-05-09T00:07:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.343+0000 7f2fc8c68700 1 --2- 172.21.15.81:0/1703751357 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc4105160 0x7f2fc410cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.343+0000 7f2fc8c68700 1 --2- 172.21.15.81:0/1703751357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4100060 0x7f2fc4100440 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.343+0000 7f2fc8c68700 1 --2- 172.21.15.81:0/1703751357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fc4100a10 0x7f2fc4104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.343+0000 7f2fc8c68700 1 -- 172.21.15.81:0/1703751357 >> 172.21.15.81:0/1703751357 conn(0x7f2fc4076f40 msgr2=0x7f2fc4077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.343+0000 7f2fc8c68700 1 -- 172.21.15.81:0/1703751357 shutdown_connections 2024-05-09T00:07:27.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.343+0000 7f2fc8c68700 1 -- 172.21.15.81:0/1703751357 wait complete. 2024-05-09T00:07:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.344+0000 7f2fc8c68700 1 Processor -- start 2024-05-09T00:07:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.344+0000 7f2fc8c68700 1 -- start start 2024-05-09T00:07:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.344+0000 7f2fc8c68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4100060 0x7f2fc4196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.344+0000 7f2fc8c68700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fc4105160 0x7f2fc41968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.344+0000 7f2fc8c68700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc419ac70 0x7f2fc419b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.344+0000 7f2fc8c68700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc419b6f0 con 0x7f2fc4100060 2024-05-09T00:07:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.344+0000 7f2fc8c68700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc419b860 con 0x7f2fc419ac70 2024-05-09T00:07:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.344+0000 7f2fc8c68700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc419ba20 con 0x7f2fc4105160 2024-05-09T00:07:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fc259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4100060 0x7f2fc4196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fc259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4100060 0x7f2fc4196390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45512/0 (socket says 172.21.15.81:45512) 2024-05-09T00:07:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fc259c700 1 -- 172.21.15.81:0/3682109654 learned_addr learned my addr 172.21.15.81:0/3682109654 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fc1d9b700 1 --2- 172.21.15.81:0/3682109654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fc4105160 0x7f2fc41968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fc259c700 1 -- 172.21.15.81:0/3682109654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fc4105160 msgr2=0x7f2fc41968d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fc259c700 1 --2- 172.21.15.81:0/3682109654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fc4105160 0x7f2fc41968d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fc259c700 1 -- 172.21.15.81:0/3682109654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc419ac70 msgr2=0x7f2fc419b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fc259c700 1 --2- 172.21.15.81:0/3682109654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc419ac70 0x7f2fc419b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fc259c700 1 -- 172.21.15.81:0/3682109654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac0095f0 con 0x7f2fc4100060 2024-05-09T00:07:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fc1d9b700 1 --2- 172.21.15.81:0/3682109654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fc4105160 0x7f2fc41968d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fc259c700 1 --2- 172.21.15.81:0/3682109654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4100060 0x7f2fc4196390 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2fac005740 tx=0x7f2fac005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fbb7fe700 1 -- 172.21.15.81:0/3682109654 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac01d070 con 0x7f2fc4100060 2024-05-09T00:07:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fc8c68700 1 -- 172.21.15.81:0/3682109654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc41a2f20 con 0x7f2fc4100060 2024-05-09T00:07:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fbb7fe700 1 -- 172.21.15.81:0/3682109654 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2fac005940 con 0x7f2fc4100060 2024-05-09T00:07:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fbb7fe700 1 -- 172.21.15.81:0/3682109654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac022d40 con 0x7f2fc4100060 2024-05-09T00:07:27.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.345+0000 7f2fc8c68700 1 -- 172.21.15.81:0/3682109654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc41a32e0 con 0x7f2fc4100060 2024-05-09T00:07:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.348+0000 7f2fbb7fe700 1 -- 172.21.15.81:0/3682109654 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f2fac00f770 con 0x7f2fc4100060 2024-05-09T00:07:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.348+0000 7f2fbb7fe700 1 --2- 172.21.15.81:0/3682109654 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2fb00a1290 0x7f2fb00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.349+0000 7f2fc1d9b700 1 --2- 172.21.15.81:0/3682109654 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2fb00a1290 0x7f2fb00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.349+0000 7f2fbb7fe700 1 -- 172.21.15.81:0/3682109654 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2fac0ce210 con 0x7f2fc4100060 2024-05-09T00:07:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.349+0000 7f2fc1d9b700 1 --2- 172.21.15.81:0/3682109654 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2fb00a1290 0x7f2fb00a3750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4006fd0 tx=0x7f2fb4008040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.349+0000 7f2fd4e22b80 1 Processor -- start 2024-05-09T00:07:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fd4e22b80 1 -- start start 2024-05-09T00:07:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fd4e22b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6fe00 0x560917d701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fd4e22b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d70720 0x560917d6a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fd4e22b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6a890 0x560917d6acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fd4e22b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917cc1150 con 0x560917d6fe00 2024-05-09T00:07:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fd4e22b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917cbeb10 con 0x560917d6a890 2024-05-09T00:07:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fd4e22b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917cba400 con 0x560917d70720 2024-05-09T00:07:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fc259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6fe00 0x560917d701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fc259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6fe00 0x560917d701e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45524/0 (socket says 172.21.15.81:45524) 2024-05-09T00:07:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fc259c700 1 -- 172.21.15.81:0/883581137 learned_addr learned my addr 172.21.15.81:0/883581137 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fc2d9d700 1 --2- 172.21.15.81:0/883581137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6a890 0x560917d6acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fc259c700 1 -- 172.21.15.81:0/883581137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d70720 msgr2=0x560917d6a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fc259c700 1 --2- 172.21.15.81:0/883581137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d70720 0x560917d6a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fc259c700 1 -- 172.21.15.81:0/883581137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6a890 msgr2=0x560917d6acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fc259c700 1 --2- 172.21.15.81:0/883581137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6a890 0x560917d6acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fc259c700 1 -- 172.21.15.81:0/883581137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560917b3b3b0 con 0x560917d6fe00 2024-05-09T00:07:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fc259c700 1 --2- 172.21.15.81:0/883581137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6fe00 0x560917d701e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2fac097de0 tx=0x7f2fac022760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6792ca5b8dfd036f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fb8ff9700 1 -- 172.21.15.81:0/883581137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac022ea0 con 0x560917d6fe00 2024-05-09T00:07:27.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fb8ff9700 1 -- 172.21.15.81:0/883581137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2fac09b370 con 0x560917d6fe00 2024-05-09T00:07:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.350+0000 7f2fb8ff9700 1 -- 172.21.15.81:0/883581137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac09aac0 con 0x560917d6fe00 2024-05-09T00:07:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.351+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/883581137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6fe00 msgr2=0x560917d701e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.351+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/883581137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6fe00 0x560917d701e0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2fac097de0 tx=0x7f2fac022760 comp rx=0 tx=0).stop 2024-05-09T00:07:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.351+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/883581137 shutdown_connections 2024-05-09T00:07:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.351+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/883581137 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6a890 0x560917d6acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.351+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/883581137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6fe00 0x560917d701e0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.351+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/883581137 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d70720 0x560917d6a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.351+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/883581137 >> 172.21.15.81:0/883581137 conn(0x560917cc8210 msgr2=0x560917d64df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.351+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/883581137 shutdown_connections 2024-05-09T00:07:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.351+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/883581137 wait complete. 2024-05-09T00:07:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fd4e22b80 1 -- start start 2024-05-09T00:07:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fd4e22b80 1 Processor -- start 2024-05-09T00:07:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fd4e22b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6a890 0x560917d73b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fd4e22b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6fe00 0x560917d74040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fd4e22b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d70720 0x560917d74580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fd4e22b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917c56560 con 0x560917d6fe00 2024-05-09T00:07:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fd4e22b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917c56200 con 0x560917d6a890 2024-05-09T00:07:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fd4e22b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917b3d6a0 con 0x560917d70720 2024-05-09T00:07:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fd4e22b80 10 client.0 _ll_register_callbacks cb 0x560917c5fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fc1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6fe00 0x560917d74040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fc1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6fe00 0x560917d74040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45540/0 (socket says 172.21.15.81:45540) 2024-05-09T00:07:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fc1d9b700 1 -- 172.21.15.81:0/423329480 learned_addr learned my addr 172.21.15.81:0/423329480 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fc259c700 1 --2- 172.21.15.81:0/423329480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6a890 0x560917d73b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fc2d9d700 1 --2- 172.21.15.81:0/423329480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d70720 0x560917d74580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fc1d9b700 1 -- 172.21.15.81:0/423329480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d70720 msgr2=0x560917d74580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fc1d9b700 1 --2- 172.21.15.81:0/423329480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d70720 0x560917d74580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fc1d9b700 1 -- 172.21.15.81:0/423329480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6a890 msgr2=0x560917d73b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fc1d9b700 1 --2- 172.21.15.81:0/423329480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6a890 0x560917d73b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fc1d9b700 1 -- 172.21.15.81:0/423329480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc41a32e0 con 0x560917d6fe00 2024-05-09T00:07:27.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fc259c700 1 --2- 172.21.15.81:0/423329480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6a890 0x560917d73b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:07:27.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fc1d9b700 1 --2- 172.21.15.81:0/423329480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6fe00 0x560917d74040 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400cd10 tx=0x7f2fb40136e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca909a248ce634e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.352+0000 7f2fa9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.353+0000 7f2fa9ffb700 1 -- 172.21.15.81:0/423329480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4013d90 con 0x560917d6fe00 2024-05-09T00:07:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.353+0000 7f2fa9ffb700 1 -- 172.21.15.81:0/423329480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2fb401d3f0 con 0x560917d6fe00 2024-05-09T00:07:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.353+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/423329480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560917c13270 con 0x560917d6fe00 2024-05-09T00:07:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.353+0000 7f2fa9ffb700 1 -- 172.21.15.81:0/423329480 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fb401d5b0 con 0x560917d6fe00 2024-05-09T00:07:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.353+0000 7f2fd4e22b80 10 client.16713 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.353+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/423329480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560917ae7b60 con 0x560917d6fe00 2024-05-09T00:07:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.353+0000 7f2fa9ffb700 1 -- 172.21.15.81:0/423329480 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560917c13270 con 0x560917d6fe00 2024-05-09T00:07:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.353+0000 7f2fa9ffb700 1 -- 172.21.15.81:0/423329480 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2fb401c070 con 0x560917d6fe00 2024-05-09T00:07:27.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.353+0000 7f2fd4e22b80 10 client.16713 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:27.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.353+0000 7f2fd4e22b80 10 client.16713 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:27.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.353+0000 7f2fd4e22b80 20 client.16713 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:27.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.353+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/423329480 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x560917d84000 0x560917d86420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.353+0000 7f2fd4e22b80 4 client.16713 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:07:27.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.353+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/423329480 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560917d39810 con 0x560917d84000 2024-05-09T00:07:27.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.354+0000 7f2fc259c700 1 --2- 172.21.15.81:0/423329480 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x560917d84000 0x560917d86420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.357+0000 7f2fc259c700 1 --2- 172.21.15.81:0/423329480 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x560917d84000 0x560917d86420 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2d9692a53ab985f server_cookie=942d7ab61af653a in_seq=0 out_seq=0 2024-05-09T00:07:27.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.357+0000 7f2fa9ffb700 10 client.16713 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:27.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.358+0000 7f2fa9ffb700 1 -- 172.21.15.81:0/423329480 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560917d39810 con 0x560917d84000 2024-05-09T00:07:27.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.358+0000 7f2fa9ffb700 10 client.16713 handle_command_reply: tid=0 2024-05-09T00:07:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.358+0000 7f2fd4e22b80 1 client.16713 shutdown 2024-05-09T00:07:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.358+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/423329480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6fe00 msgr2=0x560917d74040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.358+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/423329480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6fe00 0x560917d74040 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400cd10 tx=0x7f2fb40136e0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.358+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/423329480 shutdown_connections 2024-05-09T00:07:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.358+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/423329480 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x560917d84000 0x560917d86420 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.358+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/423329480 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6a890 0x560917d73b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.358+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/423329480 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d70720 0x560917d74580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.358+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/423329480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6fe00 0x560917d74040 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.358+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/423329480 >> 172.21.15.81:0/423329480 conn(0x560917cc8210 msgr2=0x560917d645a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.358+0000 7f2fa9ffb700 0 client.16713 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:27.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.358+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/423329480 shutdown_connections 2024-05-09T00:07:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.358+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/423329480 wait complete. 2024-05-09T00:07:27.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.359+0000 7f2fd4e22b80 20 client.16713 trim_cache size 0 max 16384 2024-05-09T00:07:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fd4e22b80 1 Processor -- start 2024-05-09T00:07:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fd4e22b80 1 -- start start 2024-05-09T00:07:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fd4e22b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6a890 0x560917d6a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fd4e22b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6fe00 0x560917d64d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fd4e22b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d70720 0x560917d7aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fd4e22b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917d76670 con 0x560917d6a890 2024-05-09T00:07:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fd4e22b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917d66070 con 0x560917d6fe00 2024-05-09T00:07:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fd4e22b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917d61dc0 con 0x560917d70720 2024-05-09T00:07:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fc259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6a890 0x560917d6a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fc259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6a890 0x560917d6a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45544/0 (socket says 172.21.15.81:45544) 2024-05-09T00:07:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fc259c700 1 -- 172.21.15.81:0/90114665 learned_addr learned my addr 172.21.15.81:0/90114665 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fc1d9b700 1 --2- 172.21.15.81:0/90114665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6fe00 0x560917d64d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fc2d9d700 1 --2- 172.21.15.81:0/90114665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d70720 0x560917d7aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fc259c700 1 -- 172.21.15.81:0/90114665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d70720 msgr2=0x560917d7aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fc259c700 1 --2- 172.21.15.81:0/90114665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d70720 0x560917d7aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fc259c700 1 -- 172.21.15.81:0/90114665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6fe00 msgr2=0x560917d64d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fc259c700 1 --2- 172.21.15.81:0/90114665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6fe00 0x560917d64d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fc259c700 1 -- 172.21.15.81:0/90114665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560917d6af40 con 0x560917d6a890 2024-05-09T00:07:27.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fc259c700 1 --2- 172.21.15.81:0/90114665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6a890 0x560917d6a350 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2fac097010 tx=0x7f2fac09b1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40279f79d2108e06 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.372+0000 7f2fb97fa700 1 -- 172.21.15.81:0/90114665 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0b9040 con 0x560917d6a890 2024-05-09T00:07:27.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.373+0000 7f2fb97fa700 1 -- 172.21.15.81:0/90114665 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2fac0b3e90 con 0x560917d6a890 2024-05-09T00:07:27.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.373+0000 7f2fb97fa700 1 -- 172.21.15.81:0/90114665 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac022ea0 con 0x560917d6a890 2024-05-09T00:07:27.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.373+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/90114665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6a890 msgr2=0x560917d6a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.373+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/90114665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6a890 0x560917d6a350 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2fac097010 tx=0x7f2fac09b1c0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.373+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/90114665 shutdown_connections 2024-05-09T00:07:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.373+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/90114665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d70720 0x560917d7aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.373+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/90114665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6a890 0x560917d6a350 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.373+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/90114665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d6fe00 0x560917d64d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.373+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/90114665 >> 172.21.15.81:0/90114665 conn(0x560917cc8210 msgr2=0x560917d6dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.373+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/90114665 shutdown_connections 2024-05-09T00:07:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.373+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/90114665 wait complete. 2024-05-09T00:07:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.373+0000 7f2fd4e22b80 1 -- start start 2024-05-09T00:07:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.373+0000 7f2fd4e22b80 1 Processor -- start 2024-05-09T00:07:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fd4e22b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6a890 0x560917d7aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fd4e22b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d6fe00 0x560917d7b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fd4e22b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d70720 0x560917d6b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fd4e22b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917d6c0b0 con 0x560917d6a890 2024-05-09T00:07:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fd4e22b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917d6c220 con 0x560917d70720 2024-05-09T00:07:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fd4e22b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x560917d6c3e0 con 0x560917d6fe00 2024-05-09T00:07:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fd4e22b80 10 client.0 _ll_register_callbacks cb 0x7f2fb400c650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fc259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6a890 0x560917d7aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fc259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6a890 0x560917d7aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45548/0 (socket says 172.21.15.81:45548) 2024-05-09T00:07:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fc259c700 1 -- 172.21.15.81:0/4087408654 learned_addr learned my addr 172.21.15.81:0/4087408654 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fc2d9d700 1 --2- 172.21.15.81:0/4087408654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d70720 0x560917d6b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fc1d9b700 1 --2- 172.21.15.81:0/4087408654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d6fe00 0x560917d7b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fc259c700 1 -- 172.21.15.81:0/4087408654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d6fe00 msgr2=0x560917d7b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fc259c700 1 --2- 172.21.15.81:0/4087408654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d6fe00 0x560917d7b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fc259c700 1 -- 172.21.15.81:0/4087408654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d70720 msgr2=0x560917d6b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fc259c700 1 --2- 172.21.15.81:0/4087408654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d70720 0x560917d6b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fc259c700 1 -- 172.21.15.81:0/4087408654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560917b3b3b0 con 0x560917d6a890 2024-05-09T00:07:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fc2d9d700 1 --2- 172.21.15.81:0/4087408654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d70720 0x560917d6b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:07:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fc259c700 1 --2- 172.21.15.81:0/4087408654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6a890 0x560917d7aee0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2fac097de0 tx=0x7f2fac09f0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b4dddd1bd2f426 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fa9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fa9ffb700 1 -- 172.21.15.81:0/4087408654 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0b9040 con 0x560917d6a890 2024-05-09T00:07:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fa9ffb700 1 -- 172.21.15.81:0/4087408654 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2fac09a860 con 0x560917d6a890 2024-05-09T00:07:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.374+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/4087408654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2fac09b370 con 0x560917d6a890 2024-05-09T00:07:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.375+0000 7f2fa9ffb700 1 -- 172.21.15.81:0/4087408654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fac09b5d0 con 0x560917d6a890 2024-05-09T00:07:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.375+0000 7f2fd4e22b80 10 client.16719 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:27.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.375+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/4087408654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560917d614e0 con 0x560917d6a890 2024-05-09T00:07:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.375+0000 7f2fa9ffb700 1 -- 172.21.15.81:0/4087408654 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2fac0a9080 con 0x560917d6a890 2024-05-09T00:07:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.375+0000 7f2fa9ffb700 1 -- 172.21.15.81:0/4087408654 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2fac0b2070 con 0x560917d6a890 2024-05-09T00:07:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.375+0000 7f2fd4e22b80 10 client.16719 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.375+0000 7f2fd4e22b80 10 client.16719 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.375+0000 7f2fd4e22b80 20 client.16719 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.375+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/4087408654 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x560917dda4c0 0x560917ddc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.375+0000 7f2fd4e22b80 4 client.16719 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:07:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.375+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/4087408654 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560917cb2ec0 con 0x560917dda4c0 2024-05-09T00:07:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.375+0000 7f2fc1d9b700 1 --2- 172.21.15.81:0/4087408654 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x560917dda4c0 0x560917ddc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.375+0000 7f2fa9ffb700 10 client.16719 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.375+0000 7f2fc1d9b700 1 --2- 172.21.15.81:0/4087408654 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x560917dda4c0 0x560917ddc8b0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb3da3d7aaacb849 server_cookie=f583cc9769ce7844 in_seq=0 out_seq=0 2024-05-09T00:07:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fa9ffb700 1 -- 172.21.15.81:0/4087408654 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560917cb2ec0 con 0x560917dda4c0 2024-05-09T00:07:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fa9ffb700 10 client.16719 handle_command_reply: tid=0 2024-05-09T00:07:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fd4e22b80 1 client.16719 shutdown 2024-05-09T00:07:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/4087408654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6a890 msgr2=0x560917d7aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/4087408654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6a890 0x560917d7aee0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f2fac097de0 tx=0x7f2fac09f0d0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/4087408654 shutdown_connections 2024-05-09T00:07:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/4087408654 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x560917dda4c0 0x560917ddc8b0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/4087408654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x560917d70720 0x560917d6b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/4087408654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x560917d6a890 0x560917d7aee0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fa9ffb700 0 client.16719 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fd4e22b80 1 --2- 172.21.15.81:0/4087408654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x560917d6fe00 0x560917d7b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/4087408654 >> 172.21.15.81:0/4087408654 conn(0x560917cc8210 msgr2=0x560917d72390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/4087408654 shutdown_connections 2024-05-09T00:07:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fd4e22b80 1 -- 172.21.15.81:0/4087408654 wait complete. 2024-05-09T00:07:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fd4e22b80 20 client.16719 trim_cache size 0 max 16384 2024-05-09T00:07:27.390 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:07:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fc8c68700 1 -- 172.21.15.81:0/3682109654 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2fb00a1290 msgr2=0x7f2fb00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fc8c68700 1 --2- 172.21.15.81:0/3682109654 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2fb00a1290 0x7f2fb00a3750 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4006fd0 tx=0x7f2fb4008040 comp rx=0 tx=0).stop 2024-05-09T00:07:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fc8c68700 1 -- 172.21.15.81:0/3682109654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4100060 msgr2=0x7f2fc4196390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fc8c68700 1 --2- 172.21.15.81:0/3682109654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4100060 0x7f2fc4196390 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2fac005740 tx=0x7f2fac005da0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fc8c68700 1 -- 172.21.15.81:0/3682109654 shutdown_connections 2024-05-09T00:07:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fc8c68700 1 --2- 172.21.15.81:0/3682109654 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2fb00a1290 0x7f2fb00a3750 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fc8c68700 1 --2- 172.21.15.81:0/3682109654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2fc419ac70 0x7f2fc419b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fc8c68700 1 --2- 172.21.15.81:0/3682109654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2fc4100060 0x7f2fc4196390 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fc8c68700 1 --2- 172.21.15.81:0/3682109654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2fc4105160 0x7f2fc41968d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fc8c68700 1 -- 172.21.15.81:0/3682109654 >> 172.21.15.81:0/3682109654 conn(0x7f2fc4076f40 msgr2=0x7f2fc40fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fc8c68700 1 -- 172.21.15.81:0/3682109654 shutdown_connections 2024-05-09T00:07:27.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:27.376+0000 7f2fc8c68700 1 -- 172.21.15.81:0/3682109654 wait complete. 2024-05-09T00:07:28.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:27 smithi150 ceph-mon[46187]: pgmap v138: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:28.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:27 smithi171 ceph-mon[47351]: pgmap v138: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:28.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:27 smithi081 ceph-mon[42474]: pgmap v138: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:28.394 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:07:28.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:07:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.543+0000 7f149dc9c700 1 -- 172.21.15.81:0/1235419406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1498105ef0 msgr2=0x7f14981062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.543+0000 7f149dc9c700 1 --2- 172.21.15.81:0/1235419406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1498105ef0 0x7f14981062d0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1488009990 tx=0x7f1488009ca0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.543+0000 7f149dc9c700 1 -- 172.21.15.81:0/1235419406 shutdown_connections 2024-05-09T00:07:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.543+0000 7f149dc9c700 1 --2- 172.21.15.81:0/1235419406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14980ffdd0 0x7f149810dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.543+0000 7f149dc9c700 1 --2- 172.21.15.81:0/1235419406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1498105ef0 0x7f14981062d0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.543+0000 7f149dc9c700 1 --2- 172.21.15.81:0/1235419406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f14980ff410 0x7f14980ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.543+0000 7f149dc9c700 1 -- 172.21.15.81:0/1235419406 >> 172.21.15.81:0/1235419406 conn(0x7f14980763a0 msgr2=0x7f14980fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.543+0000 7f149dc9c700 1 -- 172.21.15.81:0/1235419406 shutdown_connections 2024-05-09T00:07:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.543+0000 7f149dc9c700 1 -- 172.21.15.81:0/1235419406 wait complete. 2024-05-09T00:07:28.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.544+0000 7f149dc9c700 1 Processor -- start 2024-05-09T00:07:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.544+0000 7f149dc9c700 1 -- start start 2024-05-09T00:07:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.544+0000 7f149dc9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14980ff410 0x7f1498197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.544+0000 7f149dc9c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14980ffdd0 0x7f14981979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.544+0000 7f149dc9c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1498105ef0 0x7f149819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.544+0000 7f149dc9c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149819c380 con 0x7f14980ff410 2024-05-09T00:07:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.544+0000 7f149dc9c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149819c4f0 con 0x7f1498105ef0 2024-05-09T00:07:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.544+0000 7f149dc9c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149819c6b0 con 0x7f14980ffdd0 2024-05-09T00:07:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f14977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14980ff410 0x7f1498197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f14977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14980ff410 0x7f1498197460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45568/0 (socket says 172.21.15.81:45568) 2024-05-09T00:07:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f14977fe700 1 -- 172.21.15.81:0/3780802472 learned_addr learned my addr 172.21.15.81:0/3780802472 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f1496ffd700 1 --2- 172.21.15.81:0/3780802472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14980ffdd0 0x7f14981979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f1497fff700 1 --2- 172.21.15.81:0/3780802472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1498105ef0 0x7f149819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f14977fe700 1 -- 172.21.15.81:0/3780802472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14980ffdd0 msgr2=0x7f14981979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f14977fe700 1 --2- 172.21.15.81:0/3780802472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14980ffdd0 0x7f14981979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f14977fe700 1 -- 172.21.15.81:0/3780802472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1498105ef0 msgr2=0x7f149819bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f14977fe700 1 --2- 172.21.15.81:0/3780802472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1498105ef0 0x7f149819bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f14977fe700 1 -- 172.21.15.81:0/3780802472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14880095f0 con 0x7f14980ff410 2024-05-09T00:07:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f14977fe700 1 --2- 172.21.15.81:0/3780802472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14980ff410 0x7f1498197460 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f14880095c0 tx=0x7f148800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f1494ff9700 1 -- 172.21.15.81:0/3780802472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148801d070 con 0x7f14980ff410 2024-05-09T00:07:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f1494ff9700 1 -- 172.21.15.81:0/3780802472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1488005030 con 0x7f14980ff410 2024-05-09T00:07:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f149dc9c700 1 -- 172.21.15.81:0/3780802472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149819c930 con 0x7f14980ff410 2024-05-09T00:07:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f1494ff9700 1 -- 172.21.15.81:0/3780802472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488004a90 con 0x7f14980ff410 2024-05-09T00:07:28.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.545+0000 7f149dc9c700 1 -- 172.21.15.81:0/3780802472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14981a41d0 con 0x7f14980ff410 2024-05-09T00:07:28.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.548+0000 7f1494ff9700 1 -- 172.21.15.81:0/3780802472 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f1488005410 con 0x7f14980ff410 2024-05-09T00:07:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.549+0000 7f1494ff9700 1 --2- 172.21.15.81:0/3780802472 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14840a1290 0x7f14840a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.549+0000 7f1494ff9700 1 -- 172.21.15.81:0/3780802472 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f14880cda80 con 0x7f14980ff410 2024-05-09T00:07:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.549+0000 7f1496ffd700 1 --2- 172.21.15.81:0/3780802472 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14840a1290 0x7f14840a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.549+0000 7f1496ffd700 1 --2- 172.21.15.81:0/3780802472 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14840a1290 0x7f14840a3750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f14981989b0 tx=0x7f148000b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.549+0000 7f14a9e56b80 1 Processor -- start 2024-05-09T00:07:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.549+0000 7f14a9e56b80 1 -- start start 2024-05-09T00:07:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.549+0000 7f14a9e56b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f06e80 0x55d3e8f07260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.549+0000 7f14a9e56b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f077a0 0x55d3e8f013d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f14a9e56b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f01910 0x55d3e8f01d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f14a9e56b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3e8e581d0 con 0x55d3e8f06e80 2024-05-09T00:07:28.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f14a9e56b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3e8e55b90 con 0x55d3e8f077a0 2024-05-09T00:07:28.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f14a9e56b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3e8e51480 con 0x55d3e8f01910 2024-05-09T00:07:28.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f14977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f06e80 0x55d3e8f07260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f14977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f06e80 0x55d3e8f07260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45572/0 (socket says 172.21.15.81:45572) 2024-05-09T00:07:28.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f14977fe700 1 -- 172.21.15.81:0/2091440221 learned_addr learned my addr 172.21.15.81:0/2091440221 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:28.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f1496ffd700 1 --2- 172.21.15.81:0/2091440221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f077a0 0x55d3e8f013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f14977fe700 1 -- 172.21.15.81:0/2091440221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f01910 msgr2=0x55d3e8f01d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f14977fe700 1 --2- 172.21.15.81:0/2091440221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f01910 0x55d3e8f01d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f14977fe700 1 -- 172.21.15.81:0/2091440221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f077a0 msgr2=0x55d3e8f013d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f14977fe700 1 --2- 172.21.15.81:0/2091440221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f077a0 0x55d3e8f013d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f14977fe700 1 -- 172.21.15.81:0/2091440221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3e8cd2430 con 0x55d3e8f06e80 2024-05-09T00:07:28.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f14977fe700 1 --2- 172.21.15.81:0/2091440221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f06e80 0x55d3e8f07260 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f14880a2aa0 tx=0x7f148809b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf539867152c24c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:28.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f148dffb700 1 -- 172.21.15.81:0/2091440221 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14880a2fd0 con 0x55d3e8f06e80 2024-05-09T00:07:28.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f148dffb700 1 -- 172.21.15.81:0/2091440221 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14880ba040 con 0x55d3e8f06e80 2024-05-09T00:07:28.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.550+0000 7f148dffb700 1 -- 172.21.15.81:0/2091440221 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148809a0d0 con 0x55d3e8f06e80 2024-05-09T00:07:28.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.551+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2091440221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f06e80 msgr2=0x55d3e8f07260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.551+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/2091440221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f06e80 0x55d3e8f07260 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f14880a2aa0 tx=0x7f148809b2e0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.551+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2091440221 shutdown_connections 2024-05-09T00:07:28.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.551+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/2091440221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f01910 0x55d3e8f01d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.551+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/2091440221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f06e80 0x55d3e8f07260 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.551+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/2091440221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f077a0 0x55d3e8f013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.551+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2091440221 >> 172.21.15.81:0/2091440221 conn(0x55d3e8e5f290 msgr2=0x55d3e8efbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:28.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.551+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2091440221 shutdown_connections 2024-05-09T00:07:28.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.551+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2091440221 wait complete. 2024-05-09T00:07:28.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.551+0000 7f14a9e56b80 1 -- start start 2024-05-09T00:07:28.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14a9e56b80 1 Processor -- start 2024-05-09T00:07:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14a9e56b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f0abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14a9e56b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f06e80 0x55d3e8f0b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14a9e56b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f077a0 0x55d3e8f0b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14a9e56b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3e8ded5e0 con 0x55d3e8f01910 2024-05-09T00:07:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14a9e56b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3e8ded280 con 0x55d3e8f077a0 2024-05-09T00:07:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14a9e56b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3e8cd4720 con 0x55d3e8f06e80 2024-05-09T00:07:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14a9e56b80 10 client.0 _ll_register_callbacks cb 0x55d3e8df6bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f0abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f0abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45580/0 (socket says 172.21.15.81:45580) 2024-05-09T00:07:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14977fe700 1 -- 172.21.15.81:0/3808649292 learned_addr learned my addr 172.21.15.81:0/3808649292 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f1497fff700 1 --2- 172.21.15.81:0/3808649292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f077a0 0x55d3e8f0b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f1496ffd700 1 --2- 172.21.15.81:0/3808649292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f06e80 0x55d3e8f0b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14977fe700 1 -- 172.21.15.81:0/3808649292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f06e80 msgr2=0x55d3e8f0b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14977fe700 1 --2- 172.21.15.81:0/3808649292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f06e80 0x55d3e8f0b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14977fe700 1 -- 172.21.15.81:0/3808649292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f077a0 msgr2=0x55d3e8f0b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14977fe700 1 --2- 172.21.15.81:0/3808649292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f077a0 0x55d3e8f0b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14977fe700 1 -- 172.21.15.81:0/3808649292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14981a41d0 con 0x55d3e8f01910 2024-05-09T00:07:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f1497fff700 1 --2- 172.21.15.81:0/3808649292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f077a0 0x55d3e8f0b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:07:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14977fe700 1 --2- 172.21.15.81:0/3808649292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f0abc0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1488005760 tx=0x7f1488009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a2ffc24a01f1d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f1476ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f1476ffd700 1 -- 172.21.15.81:0/3808649292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148809a2d0 con 0x55d3e8f01910 2024-05-09T00:07:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f1476ffd700 1 -- 172.21.15.81:0/3808649292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f148809ae40 con 0x55d3e8f01910 2024-05-09T00:07:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.552+0000 7f14a9e56b80 1 -- 172.21.15.81:0/3808649292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d3e8daa2f0 con 0x55d3e8f01910 2024-05-09T00:07:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.553+0000 7f1476ffd700 1 -- 172.21.15.81:0/3808649292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f148809b000 con 0x55d3e8f01910 2024-05-09T00:07:28.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.553+0000 7f14a9e56b80 10 client.16731 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.553+0000 7f14a9e56b80 1 -- 172.21.15.81:0/3808649292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d3e8c7ebe0 con 0x55d3e8f01910 2024-05-09T00:07:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.553+0000 7f1476ffd700 1 -- 172.21.15.81:0/3808649292 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f148807d080 con 0x55d3e8f01910 2024-05-09T00:07:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.553+0000 7f1476ffd700 1 -- 172.21.15.81:0/3808649292 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1488004bf0 con 0x55d3e8f01910 2024-05-09T00:07:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.553+0000 7f14a9e56b80 10 client.16731 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.553+0000 7f14a9e56b80 10 client.16731 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.553+0000 7f14a9e56b80 20 client.16731 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.553+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/3808649292 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d3e8f1ab00 0x55d3e8f1cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.553+0000 7f14a9e56b80 4 client.16731 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:07:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.553+0000 7f14a9e56b80 1 -- 172.21.15.81:0/3808649292 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d3e8ed0890 con 0x55d3e8f1ab00 2024-05-09T00:07:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.553+0000 7f1496ffd700 1 --2- 172.21.15.81:0/3808649292 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d3e8f1ab00 0x55d3e8f1cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f1496ffd700 1 --2- 172.21.15.81:0/3808649292 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d3e8f1ab00 0x55d3e8f1cf20 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f281a670f1a9ba8d server_cookie=850c83da5d18ff08 in_seq=0 out_seq=0 2024-05-09T00:07:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f1476ffd700 10 client.16731 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:28.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f1476ffd700 1 -- 172.21.15.81:0/3808649292 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d3e8ed0890 con 0x55d3e8f1ab00 2024-05-09T00:07:28.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f1476ffd700 10 client.16731 handle_command_reply: tid=0 2024-05-09T00:07:28.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f14a9e56b80 1 client.16731 shutdown 2024-05-09T00:07:28.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f14a9e56b80 1 -- 172.21.15.81:0/3808649292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 msgr2=0x55d3e8f0abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/3808649292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f0abc0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1488005760 tx=0x7f1488009310 comp rx=0 tx=0).stop 2024-05-09T00:07:28.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f14a9e56b80 1 -- 172.21.15.81:0/3808649292 shutdown_connections 2024-05-09T00:07:28.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/3808649292 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d3e8f1ab00 0x55d3e8f1cf20 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/3808649292 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f077a0 0x55d3e8f0b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/3808649292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f0abc0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f1476ffd700 0 client.16731 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:28.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/3808649292 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f06e80 0x55d3e8f0b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f14a9e56b80 1 -- 172.21.15.81:0/3808649292 >> 172.21.15.81:0/3808649292 conn(0x55d3e8e5f290 msgr2=0x55d3e8efb620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:28.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f14a9e56b80 1 -- 172.21.15.81:0/3808649292 shutdown_connections 2024-05-09T00:07:28.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.554+0000 7f14a9e56b80 1 -- 172.21.15.81:0/3808649292 wait complete. 2024-05-09T00:07:28.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.555+0000 7f14a9e56b80 20 client.16731 trim_cache size 0 max 16384 2024-05-09T00:07:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14a9e56b80 1 Processor -- start 2024-05-09T00:07:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14a9e56b80 1 -- start start 2024-05-09T00:07:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14a9e56b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f063b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14a9e56b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f06e80 0x55d3e8efbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14a9e56b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f077a0 0x55d3e8f0b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14a9e56b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3e8efd910 con 0x55d3e8f01910 2024-05-09T00:07:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14a9e56b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3e8efc960 con 0x55d3e8f06e80 2024-05-09T00:07:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14a9e56b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3e8ef8e40 con 0x55d3e8f077a0 2024-05-09T00:07:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45588/0 (socket says 172.21.15.81:45588) 2024-05-09T00:07:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14977fe700 1 -- 172.21.15.81:0/2978825890 learned_addr learned my addr 172.21.15.81:0/2978825890 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14977fe700 1 -- 172.21.15.81:0/2978825890 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f077a0 msgr2=0x55d3e8f0b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f1497fff700 1 --2- 172.21.15.81:0/2978825890 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f077a0 0x55d3e8f0b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14977fe700 1 --2- 172.21.15.81:0/2978825890 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f077a0 0x55d3e8f0b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14977fe700 1 -- 172.21.15.81:0/2978825890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f06e80 msgr2=0x55d3e8efbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14977fe700 1 --2- 172.21.15.81:0/2978825890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f06e80 0x55d3e8efbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.572+0000 7f14977fe700 1 -- 172.21.15.81:0/2978825890 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3e8ef8560 con 0x55d3e8f01910 2024-05-09T00:07:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.573+0000 7f14977fe700 1 --2- 172.21.15.81:0/2978825890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f063b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1488097650 tx=0x7f1488099190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2381caae2e3c4804 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.573+0000 7f148e7fc700 1 -- 172.21.15.81:0/2978825890 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14880b3460 con 0x55d3e8f01910 2024-05-09T00:07:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.573+0000 7f148e7fc700 1 -- 172.21.15.81:0/2978825890 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d3e8daa2f0 con 0x55d3e8f01910 2024-05-09T00:07:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.573+0000 7f148e7fc700 1 -- 172.21.15.81:0/2978825890 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148809b0a0 con 0x55d3e8f01910 2024-05-09T00:07:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.573+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2978825890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 msgr2=0x55d3e8f063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.573+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/2978825890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f063b0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1488097650 tx=0x7f1488099190 comp rx=0 tx=0).stop 2024-05-09T00:07:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.573+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2978825890 shutdown_connections 2024-05-09T00:07:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.573+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/2978825890 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f077a0 0x55d3e8f0b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.573+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/2978825890 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f063b0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.573+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/2978825890 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f06e80 0x55d3e8efbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.573+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2978825890 >> 172.21.15.81:0/2978825890 conn(0x55d3e8e5f290 msgr2=0x55d3e8f05ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:28.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.573+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2978825890 shutdown_connections 2024-05-09T00:07:28.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.573+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2978825890 wait complete. 2024-05-09T00:07:28.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.574+0000 7f14a9e56b80 1 -- start start 2024-05-09T00:07:28.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.574+0000 7f14a9e56b80 1 Processor -- start 2024-05-09T00:07:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.574+0000 7f14a9e56b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f10cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.574+0000 7f14a9e56b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f06e80 0x55d3e8f11200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.574+0000 7f14a9e56b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f077a0 0x55d3e8f11740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.574+0000 7f14a9e56b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3e8f71140 con 0x55d3e8f01910 2024-05-09T00:07:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.574+0000 7f14a9e56b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3e8f712b0 con 0x55d3e8f06e80 2024-05-09T00:07:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.574+0000 7f14a9e56b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3e8f71470 con 0x55d3e8f077a0 2024-05-09T00:07:28.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.574+0000 7f14a9e56b80 10 client.0 _ll_register_callbacks cb 0x55d3e8df6bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.574+0000 7f14977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f10cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.574+0000 7f14977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f10cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45604/0 (socket says 172.21.15.81:45604) 2024-05-09T00:07:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.574+0000 7f14977fe700 1 -- 172.21.15.81:0/2382720390 learned_addr learned my addr 172.21.15.81:0/2382720390 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.574+0000 7f1497fff700 1 --2- 172.21.15.81:0/2382720390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f077a0 0x55d3e8f11740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f1496ffd700 1 --2- 172.21.15.81:0/2382720390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f06e80 0x55d3e8f11200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14977fe700 1 -- 172.21.15.81:0/2382720390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f077a0 msgr2=0x55d3e8f11740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14977fe700 1 --2- 172.21.15.81:0/2382720390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f077a0 0x55d3e8f11740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14977fe700 1 -- 172.21.15.81:0/2382720390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f06e80 msgr2=0x55d3e8f11200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14977fe700 1 --2- 172.21.15.81:0/2382720390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f06e80 0x55d3e8f11200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14977fe700 1 -- 172.21.15.81:0/2382720390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d3e8c7ebe0 con 0x55d3e8f01910 2024-05-09T00:07:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f1496ffd700 1 --2- 172.21.15.81:0/2382720390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f06e80 0x55d3e8f11200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14977fe700 1 --2- 172.21.15.81:0/2382720390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f10cc0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f14880cbfb0 tx=0x7f148809a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b8cfdc85c9fb5d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:28.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f1476ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f1476ffd700 1 -- 172.21.15.81:0/2382720390 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148809b040 con 0x55d3e8f01910 2024-05-09T00:07:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f1476ffd700 1 -- 172.21.15.81:0/2382720390 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f148807e060 con 0x55d3e8f01910 2024-05-09T00:07:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2382720390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f14880ba040 con 0x55d3e8f01910 2024-05-09T00:07:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f1476ffd700 1 -- 172.21.15.81:0/2382720390 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1488004e00 con 0x55d3e8f01910 2024-05-09T00:07:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14a9e56b80 10 client.16737 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2382720390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d3e8e175e0 con 0x55d3e8f01910 2024-05-09T00:07:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f1476ffd700 1 -- 172.21.15.81:0/2382720390 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14880ba040 con 0x55d3e8f01910 2024-05-09T00:07:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f1476ffd700 1 -- 172.21.15.81:0/2382720390 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1488060bb0 con 0x55d3e8f01910 2024-05-09T00:07:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14a9e56b80 10 client.16737 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14a9e56b80 10 client.16737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14a9e56b80 20 client.16737 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/2382720390 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d3e8f72740 0x55d3e8f74b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14a9e56b80 4 client.16737 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:07:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.575+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2382720390 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55d3e8e49f40 con 0x55d3e8f72740 2024-05-09T00:07:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.576+0000 7f1496ffd700 1 --2- 172.21.15.81:0/2382720390 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d3e8f72740 0x55d3e8f74b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.576+0000 7f1476ffd700 10 client.16737 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.576+0000 7f1496ffd700 1 --2- 172.21.15.81:0/2382720390 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d3e8f72740 0x55d3e8f74b30 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91b0721d67687603 server_cookie=5ce6208f9d307f84 in_seq=0 out_seq=0 2024-05-09T00:07:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.577+0000 7f1476ffd700 1 -- 172.21.15.81:0/2382720390 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d3e8e49f40 con 0x55d3e8f72740 2024-05-09T00:07:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.577+0000 7f1476ffd700 10 client.16737 handle_command_reply: tid=0 2024-05-09T00:07:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.577+0000 7f14a9e56b80 1 client.16737 shutdown 2024-05-09T00:07:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.577+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2382720390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 msgr2=0x55d3e8f10cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.577+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/2382720390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f10cc0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f14880cbfb0 tx=0x7f148809a480 comp rx=0 tx=0).stop 2024-05-09T00:07:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.577+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2382720390 shutdown_connections 2024-05-09T00:07:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.577+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/2382720390 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d3e8f72740 0x55d3e8f74b30 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.577+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/2382720390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d3e8f077a0 0x55d3e8f11740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.577+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/2382720390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d3e8f01910 0x55d3e8f10cc0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.577+0000 7f14a9e56b80 1 --2- 172.21.15.81:0/2382720390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d3e8f06e80 0x55d3e8f11200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.577+0000 7f1476ffd700 0 client.16737 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:28.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.577+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2382720390 >> 172.21.15.81:0/2382720390 conn(0x55d3e8e5f290 msgr2=0x55d3e8f07c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:28.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2382720390 shutdown_connections 2024-05-09T00:07:28.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f14a9e56b80 1 -- 172.21.15.81:0/2382720390 wait complete. 2024-05-09T00:07:28.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f14a9e56b80 20 client.16737 trim_cache size 0 max 16384 2024-05-09T00:07:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:07:28.579 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:07:28.579 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "9919bf8f-4f5e-477b-928b-97ab85c1365d", 2024-05-09T00:07:28.579 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:07:28.579 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:07:28.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f149dc9c700 1 -- 172.21.15.81:0/3780802472 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14840a1290 msgr2=0x7f14840a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f149dc9c700 1 --2- 172.21.15.81:0/3780802472 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14840a1290 0x7f14840a3750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f14981989b0 tx=0x7f148000b410 comp rx=0 tx=0).stop 2024-05-09T00:07:28.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f149dc9c700 1 -- 172.21.15.81:0/3780802472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14980ff410 msgr2=0x7f1498197460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f149dc9c700 1 --2- 172.21.15.81:0/3780802472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14980ff410 0x7f1498197460 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f14880095c0 tx=0x7f148800f690 comp rx=0 tx=0).stop 2024-05-09T00:07:28.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f149dc9c700 1 -- 172.21.15.81:0/3780802472 shutdown_connections 2024-05-09T00:07:28.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f149dc9c700 1 --2- 172.21.15.81:0/3780802472 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14840a1290 0x7f14840a3750 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f149dc9c700 1 --2- 172.21.15.81:0/3780802472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1498105ef0 0x7f149819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f149dc9c700 1 --2- 172.21.15.81:0/3780802472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14980ff410 0x7f1498197460 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f149dc9c700 1 --2- 172.21.15.81:0/3780802472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14980ffdd0 0x7f14981979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f149dc9c700 1 -- 172.21.15.81:0/3780802472 >> 172.21.15.81:0/3780802472 conn(0x7f14980763a0 msgr2=0x7f1498104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:28.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f149dc9c700 1 -- 172.21.15.81:0/3780802472 shutdown_connections 2024-05-09T00:07:28.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.578+0000 7f149dc9c700 1 -- 172.21.15.81:0/3780802472 wait complete. 2024-05-09T00:07:28.585 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:07:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.715+0000 7f2ea32d6700 1 -- 172.21.15.81:0/3593538241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c100bc0 msgr2=0x7f2e9c100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.715+0000 7f2ea32d6700 1 --2- 172.21.15.81:0/3593538241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c100bc0 0x7f2e9c100fa0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009990 tx=0x7f2e98009ca0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 -- 172.21.15.81:0/3593538241 shutdown_connections 2024-05-09T00:07:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 --2- 172.21.15.81:0/3593538241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e9c1051d0 0x7f2e9c10cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 --2- 172.21.15.81:0/3593538241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c100bc0 0x7f2e9c100fa0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 --2- 172.21.15.81:0/3593538241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c101570 0x7f2e9c104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 -- 172.21.15.81:0/3593538241 >> 172.21.15.81:0/3593538241 conn(0x7f2e9c075120 msgr2=0x7f2e9c075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 -- 172.21.15.81:0/3593538241 shutdown_connections 2024-05-09T00:07:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 -- 172.21.15.81:0/3593538241 wait complete. 2024-05-09T00:07:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 Processor -- start 2024-05-09T00:07:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 -- start start 2024-05-09T00:07:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c100bc0 0x7f2e9c1973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c1051d0 0x7f2e9c197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e9c19bcb0 0x7f2e9c19c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c19c730 con 0x7f2e9c100bc0 2024-05-09T00:07:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c19c8a0 con 0x7f2e9c19bcb0 2024-05-09T00:07:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.716+0000 7f2ea32d6700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c19ca60 con 0x7f2e9c1051d0 2024-05-09T00:07:28.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2ea1072700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c100bc0 0x7f2e9c1973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2ea1072700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c100bc0 0x7f2e9c1973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45618/0 (socket says 172.21.15.81:45618) 2024-05-09T00:07:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2ea1072700 1 -- 172.21.15.81:0/1716589186 learned_addr learned my addr 172.21.15.81:0/1716589186 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2ea1873700 1 --2- 172.21.15.81:0/1716589186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e9c19bcb0 0x7f2e9c19c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2ea1072700 1 -- 172.21.15.81:0/1716589186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c1051d0 msgr2=0x7f2e9c197910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:07:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2ea1072700 1 --2- 172.21.15.81:0/1716589186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c1051d0 0x7f2e9c197910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2ea1072700 1 -- 172.21.15.81:0/1716589186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e9c19bcb0 msgr2=0x7f2e9c19c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2ea1072700 1 --2- 172.21.15.81:0/1716589186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e9c19bcb0 0x7f2e9c19c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2ea1072700 1 -- 172.21.15.81:0/1716589186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e980095f0 con 0x7f2e9c100bc0 2024-05-09T00:07:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2ea1072700 1 --2- 172.21.15.81:0/1716589186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c100bc0 0x7f2e9c1973d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2e98000c00 tx=0x7f2e98009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2e927fc700 1 -- 172.21.15.81:0/1716589186 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9801d070 con 0x7f2e9c100bc0 2024-05-09T00:07:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2e927fc700 1 -- 172.21.15.81:0/1716589186 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e9800fb30 con 0x7f2e9c100bc0 2024-05-09T00:07:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2ea32d6700 1 -- 172.21.15.81:0/1716589186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c1a3f60 con 0x7f2e9c100bc0 2024-05-09T00:07:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2e927fc700 1 -- 172.21.15.81:0/1716589186 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98022c20 con 0x7f2e9c100bc0 2024-05-09T00:07:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.717+0000 7f2ea32d6700 1 -- 172.21.15.81:0/1716589186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c1a4320 con 0x7f2e9c100bc0 2024-05-09T00:07:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.719+0000 7f2e927fc700 1 -- 172.21.15.81:0/1716589186 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f2e9800fca0 con 0x7f2e9c100bc0 2024-05-09T00:07:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.720+0000 7f2e927fc700 1 --2- 172.21.15.81:0/1716589186 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2e880a1290 0x7f2e880a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.720+0000 7f2ea0871700 1 --2- 172.21.15.81:0/1716589186 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2e880a1290 0x7f2e880a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.720+0000 7f2e927fc700 1 -- 172.21.15.81:0/1716589186 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2e980ce230 con 0x7f2e9c100bc0 2024-05-09T00:07:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.720+0000 7f2ea0871700 1 --2- 172.21.15.81:0/1716589186 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2e880a1290 0x7f2e880a3750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c198920 tx=0x7f2e8c005c90 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.721+0000 7f2eaf490b80 1 Processor -- start 2024-05-09T00:07:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.721+0000 7f2eaf490b80 1 -- start start 2024-05-09T00:07:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.721+0000 7f2eaf490b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f351e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.721+0000 7f2eaf490b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 0x557a88f2f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.721+0000 7f2eaf490b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 0x557a88f2fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.721+0000 7f2eaf490b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a88e86150 con 0x557a88f34e00 2024-05-09T00:07:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.721+0000 7f2eaf490b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a88e83b10 con 0x557a88f35720 2024-05-09T00:07:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.721+0000 7f2eaf490b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a88e7f400 con 0x557a88f2f890 2024-05-09T00:07:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.721+0000 7f2ea1072700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.721+0000 7f2ea1072700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f351e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45622/0 (socket says 172.21.15.81:45622) 2024-05-09T00:07:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.721+0000 7f2ea1072700 1 -- 172.21.15.81:0/4044896289 learned_addr learned my addr 172.21.15.81:0/4044896289 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.721+0000 7f2ea1873700 1 --2- 172.21.15.81:0/4044896289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 0x557a88f2fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.721+0000 7f2ea1072700 1 -- 172.21.15.81:0/4044896289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 msgr2=0x557a88f2fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.722+0000 7f2ea0871700 1 --2- 172.21.15.81:0/4044896289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 0x557a88f2f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.722+0000 7f2ea1072700 1 --2- 172.21.15.81:0/4044896289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 0x557a88f2fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.722+0000 7f2ea1072700 1 -- 172.21.15.81:0/4044896289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 msgr2=0x557a88f2f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.722+0000 7f2ea1072700 1 --2- 172.21.15.81:0/4044896289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 0x557a88f2f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.722+0000 7f2ea1072700 1 -- 172.21.15.81:0/4044896289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a88d003b0 con 0x557a88f34e00 2024-05-09T00:07:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.722+0000 7f2ea1873700 1 --2- 172.21.15.81:0/4044896289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 0x557a88f2fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.722+0000 7f2ea0871700 1 --2- 172.21.15.81:0/4044896289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 0x557a88f2f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.722+0000 7f2ea1072700 1 --2- 172.21.15.81:0/4044896289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f351e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2e98097e40 tx=0x7f2e98005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656b5c7f415f69fc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.722+0000 7f2e877fe700 1 -- 172.21.15.81:0/4044896289 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9809f200 con 0x557a88f34e00 2024-05-09T00:07:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.722+0000 7f2e877fe700 1 -- 172.21.15.81:0/4044896289 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e980a37c0 con 0x557a88f34e00 2024-05-09T00:07:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.722+0000 7f2e877fe700 1 -- 172.21.15.81:0/4044896289 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9809ab00 con 0x557a88f34e00 2024-05-09T00:07:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.722+0000 7f2eaf490b80 1 -- 172.21.15.81:0/4044896289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 msgr2=0x557a88f351e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.722+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/4044896289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f351e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f2e98097e40 tx=0x7f2e98005a00 comp rx=0 tx=0).stop 2024-05-09T00:07:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 -- 172.21.15.81:0/4044896289 shutdown_connections 2024-05-09T00:07:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/4044896289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 0x557a88f2fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/4044896289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f351e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/4044896289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 0x557a88f2f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 -- 172.21.15.81:0/4044896289 >> 172.21.15.81:0/4044896289 conn(0x557a88e8d210 msgr2=0x557a88f29df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 -- 172.21.15.81:0/4044896289 shutdown_connections 2024-05-09T00:07:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 -- 172.21.15.81:0/4044896289 wait complete. 2024-05-09T00:07:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 -- start start 2024-05-09T00:07:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 Processor -- start 2024-05-09T00:07:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 0x557a88f3b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f38a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 0x557a88f39170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a88e1b560 con 0x557a88f34e00 2024-05-09T00:07:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a88e1b200 con 0x557a88f35720 2024-05-09T00:07:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a88d026a0 con 0x557a88f2f890 2024-05-09T00:07:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.723+0000 7f2eaf490b80 10 client.0 _ll_register_callbacks cb 0x557a88e24b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2ea0871700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f38a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2ea0871700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f38a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45636/0 (socket says 172.21.15.81:45636) 2024-05-09T00:07:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2ea0871700 1 -- 172.21.15.81:0/3067730362 learned_addr learned my addr 172.21.15.81:0/3067730362 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2ea1072700 1 --2- 172.21.15.81:0/3067730362 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 0x557a88f3b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2ea1873700 1 --2- 172.21.15.81:0/3067730362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 0x557a88f39170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2ea0871700 1 -- 172.21.15.81:0/3067730362 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 msgr2=0x557a88f3b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2ea0871700 1 --2- 172.21.15.81:0/3067730362 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 0x557a88f3b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2ea0871700 1 -- 172.21.15.81:0/3067730362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 msgr2=0x557a88f39170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2ea0871700 1 --2- 172.21.15.81:0/3067730362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 0x557a88f39170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2ea0871700 1 -- 172.21.15.81:0/3067730362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c1a4320 con 0x557a88f34e00 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2ea0871700 1 --2- 172.21.15.81:0/3067730362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f38a30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00f6d0 tx=0x7f2e8c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71980a1da35925e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2e84ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2e84ff9700 1 -- 172.21.15.81:0/3067730362 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c01c820 con 0x557a88f34e00 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2e84ff9700 1 -- 172.21.15.81:0/3067730362 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2e8c01c980 con 0x557a88f34e00 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2eaf490b80 1 -- 172.21.15.81:0/3067730362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a88dd8270 con 0x557a88f34e00 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2e84ff9700 1 -- 172.21.15.81:0/3067730362 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e8c00fe70 con 0x557a88f34e00 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2eaf490b80 10 client.16749 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.724+0000 7f2eaf490b80 1 -- 172.21.15.81:0/3067730362 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557a88cacb60 con 0x557a88f34e00 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.725+0000 7f2e84ff9700 1 -- 172.21.15.81:0/3067730362 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557a88dd8270 con 0x557a88f34e00 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.725+0000 7f2e84ff9700 1 -- 172.21.15.81:0/3067730362 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2e8c024bf0 con 0x557a88f34e00 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.725+0000 7f2eaf490b80 10 client.16749 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.725+0000 7f2eaf490b80 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.725+0000 7f2eaf490b80 20 client.16749 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.725+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/3067730362 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557a88f48ec0 0x557a88f4b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.725+0000 7f2eaf490b80 4 client.16749 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:07:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.725+0000 7f2eaf490b80 1 -- 172.21.15.81:0/3067730362 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a88efe810 con 0x557a88f48ec0 2024-05-09T00:07:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.725+0000 7f2ea1072700 1 --2- 172.21.15.81:0/3067730362 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557a88f48ec0 0x557a88f4b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.725+0000 7f2e84ff9700 10 client.16749 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.725+0000 7f2ea1072700 1 --2- 172.21.15.81:0/3067730362 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557a88f48ec0 0x557a88f4b2e0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53e476c7a8d3c8d1 server_cookie=63953eb6a83d32a5 in_seq=0 out_seq=0 2024-05-09T00:07:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2e84ff9700 1 -- 172.21.15.81:0/3067730362 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557a88efe810 con 0x557a88f48ec0 2024-05-09T00:07:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2e84ff9700 10 client.16749 handle_command_reply: tid=0 2024-05-09T00:07:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2eaf490b80 1 client.16749 shutdown 2024-05-09T00:07:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2eaf490b80 1 -- 172.21.15.81:0/3067730362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 msgr2=0x557a88f38a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/3067730362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f38a30 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00f6d0 tx=0x7f2e8c0047c0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2eaf490b80 1 -- 172.21.15.81:0/3067730362 shutdown_connections 2024-05-09T00:07:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/3067730362 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557a88f48ec0 0x557a88f4b2e0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/3067730362 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 0x557a88f39170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/3067730362 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 0x557a88f3b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2e84ff9700 0 client.16749 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/3067730362 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f38a30 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2eaf490b80 1 -- 172.21.15.81:0/3067730362 >> 172.21.15.81:0/3067730362 conn(0x557a88e8d210 msgr2=0x557a88f295a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2eaf490b80 1 -- 172.21.15.81:0/3067730362 shutdown_connections 2024-05-09T00:07:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2eaf490b80 1 -- 172.21.15.81:0/3067730362 wait complete. 2024-05-09T00:07:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.726+0000 7f2eaf490b80 20 client.16749 trim_cache size 0 max 16384 2024-05-09T00:07:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.743+0000 7f2eaf490b80 1 Processor -- start 2024-05-09T00:07:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.743+0000 7f2eaf490b80 1 -- start start 2024-05-09T00:07:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.743+0000 7f2eaf490b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 0x557a88f2ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.743+0000 7f2eaf490b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f29d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.743+0000 7f2eaf490b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 0x557a88f3fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2eaf490b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a88efe810 con 0x557a88f34e00 2024-05-09T00:07:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2eaf490b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a88f2a8e0 con 0x557a88f35720 2024-05-09T00:07:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2eaf490b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a88f45a00 con 0x557a88f2f890 2024-05-09T00:07:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2ea0871700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f29d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2ea0871700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f29d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45648/0 (socket says 172.21.15.81:45648) 2024-05-09T00:07:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2ea0871700 1 -- 172.21.15.81:0/1211341052 learned_addr learned my addr 172.21.15.81:0/1211341052 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2ea1072700 1 --2- 172.21.15.81:0/1211341052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 0x557a88f2ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2ea1873700 1 --2- 172.21.15.81:0/1211341052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 0x557a88f3fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2ea0871700 1 -- 172.21.15.81:0/1211341052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 msgr2=0x557a88f2ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2ea0871700 1 --2- 172.21.15.81:0/1211341052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 0x557a88f2ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2ea0871700 1 -- 172.21.15.81:0/1211341052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 msgr2=0x557a88f3fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2ea0871700 1 --2- 172.21.15.81:0/1211341052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 0x557a88f3fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2ea0871700 1 -- 172.21.15.81:0/1211341052 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a88e45560 con 0x557a88f34e00 2024-05-09T00:07:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2ea1873700 1 --2- 172.21.15.81:0/1211341052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 0x557a88f3fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2ea0871700 1 --2- 172.21.15.81:0/1211341052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f29d20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c000c00 tx=0x7f2e8c005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfeaccbbe0c2074 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2e87fff700 1 -- 172.21.15.81:0/1211341052 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00e670 con 0x557a88f34e00 2024-05-09T00:07:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2e87fff700 1 -- 172.21.15.81:0/1211341052 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e8c00ecf0 con 0x557a88f34e00 2024-05-09T00:07:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.744+0000 7f2e87fff700 1 -- 172.21.15.81:0/1211341052 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c01cc40 con 0x557a88f34e00 2024-05-09T00:07:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.745+0000 7f2eaf490b80 1 -- 172.21.15.81:0/1211341052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 msgr2=0x557a88f29d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.745+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/1211341052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f29d20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c000c00 tx=0x7f2e8c005ec0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.745+0000 7f2eaf490b80 1 -- 172.21.15.81:0/1211341052 shutdown_connections 2024-05-09T00:07:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.745+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/1211341052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f35720 0x557a88f3fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.745+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/1211341052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f2f890 0x557a88f2ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.745+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/1211341052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f34e00 0x557a88f29d20 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.745+0000 7f2eaf490b80 1 -- 172.21.15.81:0/1211341052 >> 172.21.15.81:0/1211341052 conn(0x557a88e8d210 msgr2=0x557a88f32bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.745+0000 7f2eaf490b80 1 -- 172.21.15.81:0/1211341052 shutdown_connections 2024-05-09T00:07:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.745+0000 7f2eaf490b80 1 -- 172.21.15.81:0/1211341052 wait complete. 2024-05-09T00:07:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.745+0000 7f2eaf490b80 1 -- start start 2024-05-09T00:07:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.745+0000 7f2eaf490b80 1 Processor -- start 2024-05-09T00:07:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2eaf490b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f2f890 0x557a88f3e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2eaf490b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f34e00 0x557a88f3e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2eaf490b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f35720 0x557a88f9e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2eaf490b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a88f9e900 con 0x557a88f35720 2024-05-09T00:07:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2eaf490b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a88f9ea40 con 0x557a88f2f890 2024-05-09T00:07:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2eaf490b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a88f9ec00 con 0x557a88f34e00 2024-05-09T00:07:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2eaf490b80 10 client.0 _ll_register_callbacks cb 0x557a88e24b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2ea1873700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f35720 0x557a88f9e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2ea1873700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f35720 0x557a88f9e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45656/0 (socket says 172.21.15.81:45656) 2024-05-09T00:07:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2ea1873700 1 -- 172.21.15.81:0/2279900304 learned_addr learned my addr 172.21.15.81:0/2279900304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2ea0871700 1 --2- 172.21.15.81:0/2279900304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f34e00 0x557a88f3e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2ea1072700 1 --2- 172.21.15.81:0/2279900304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f2f890 0x557a88f3e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2ea1873700 1 -- 172.21.15.81:0/2279900304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f34e00 msgr2=0x557a88f3e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2ea1873700 1 --2- 172.21.15.81:0/2279900304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f34e00 0x557a88f3e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2ea1873700 1 -- 172.21.15.81:0/2279900304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f2f890 msgr2=0x557a88f3e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2ea1873700 1 --2- 172.21.15.81:0/2279900304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f2f890 0x557a88f3e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2ea1873700 1 -- 172.21.15.81:0/2279900304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a88cacb60 con 0x557a88f35720 2024-05-09T00:07:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2ea1072700 1 --2- 172.21.15.81:0/2279900304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f2f890 0x557a88f3e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:07:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2ea1873700 1 --2- 172.21.15.81:0/2279900304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f35720 0x557a88f9e3c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2e94007a80 tx=0x7f2e94007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=163080d6bbf39b90 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2e84ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2e84ff9700 1 -- 172.21.15.81:0/2279900304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e94010b50 con 0x557a88f35720 2024-05-09T00:07:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2e84ff9700 1 -- 172.21.15.81:0/2279900304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2e94010cb0 con 0x557a88f35720 2024-05-09T00:07:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.746+0000 7f2eaf490b80 1 -- 172.21.15.81:0/2279900304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e980a37c0 con 0x557a88f35720 2024-05-09T00:07:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.747+0000 7f2e84ff9700 1 -- 172.21.15.81:0/2279900304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e94010e70 con 0x557a88f35720 2024-05-09T00:07:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.747+0000 7f2eaf490b80 10 client.16755 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.747+0000 7f2eaf490b80 1 -- 172.21.15.81:0/2279900304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557a88d04cd0 con 0x557a88f35720 2024-05-09T00:07:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.747+0000 7f2e84ff9700 1 -- 172.21.15.81:0/2279900304 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e980a37c0 con 0x557a88f35720 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.747+0000 7f2e84ff9700 1 -- 172.21.15.81:0/2279900304 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2e94026610 con 0x557a88f35720 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.747+0000 7f2eaf490b80 10 client.16755 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.747+0000 7f2eaf490b80 10 client.16755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.747+0000 7f2eaf490b80 20 client.16755 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.747+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/2279900304 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557a88fa03b0 0x557a88fa27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.747+0000 7f2eaf490b80 4 client.16755 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.747+0000 7f2eaf490b80 1 -- 172.21.15.81:0/2279900304 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557a88e77ec0 con 0x557a88fa03b0 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.747+0000 7f2ea1072700 1 --2- 172.21.15.81:0/2279900304 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557a88fa03b0 0x557a88fa27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.747+0000 7f2e84ff9700 10 client.16755 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.747+0000 7f2ea1072700 1 --2- 172.21.15.81:0/2279900304 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557a88fa03b0 0x557a88fa27d0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5e64dc92e6404a5 server_cookie=b1244bafc73bb3c5 in_seq=0 out_seq=0 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2e84ff9700 1 -- 172.21.15.81:0/2279900304 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557a88e77ec0 con 0x557a88fa03b0 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2e84ff9700 10 client.16755 handle_command_reply: tid=0 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2eaf490b80 1 client.16755 shutdown 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2eaf490b80 1 -- 172.21.15.81:0/2279900304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f35720 msgr2=0x557a88f9e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/2279900304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f35720 0x557a88f9e3c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2e94007a80 tx=0x7f2e94007d90 comp rx=0 tx=0).stop 2024-05-09T00:07:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2eaf490b80 1 -- 172.21.15.81:0/2279900304 shutdown_connections 2024-05-09T00:07:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/2279900304 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557a88fa03b0 0x557a88fa27d0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/2279900304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557a88f2f890 0x557a88f3e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/2279900304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557a88f35720 0x557a88f9e3c0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2eaf490b80 1 --2- 172.21.15.81:0/2279900304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557a88f34e00 0x557a88f3e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2eaf490b80 1 -- 172.21.15.81:0/2279900304 >> 172.21.15.81:0/2279900304 conn(0x557a88e8d210 msgr2=0x557a88f37190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2e84ff9700 0 client.16755 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2eaf490b80 1 -- 172.21.15.81:0/2279900304 shutdown_connections 2024-05-09T00:07:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2eaf490b80 1 -- 172.21.15.81:0/2279900304 wait complete. 2024-05-09T00:07:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2eaf490b80 20 client.16755 trim_cache size 0 max 16384 2024-05-09T00:07:28.750 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:07:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:07:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:07:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "9919bf8f-4f5e-477b-928b-97ab85c1365d": { 2024-05-09T00:07:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:07:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "9919bf8f-4f5e-477b-928b-97ab85c1365d", 2024-05-09T00:07:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:07:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:07:28.751 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:07:28.751 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:07:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2ea32d6700 1 -- 172.21.15.81:0/1716589186 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2e880a1290 msgr2=0x7f2e880a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2ea32d6700 1 --2- 172.21.15.81:0/1716589186 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2e880a1290 0x7f2e880a3750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c198920 tx=0x7f2e8c005c90 comp rx=0 tx=0).stop 2024-05-09T00:07:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2ea32d6700 1 -- 172.21.15.81:0/1716589186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c100bc0 msgr2=0x7f2e9c1973d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2ea32d6700 1 --2- 172.21.15.81:0/1716589186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c100bc0 0x7f2e9c1973d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f2e98000c00 tx=0x7f2e98009580 comp rx=0 tx=0).stop 2024-05-09T00:07:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2ea32d6700 1 -- 172.21.15.81:0/1716589186 shutdown_connections 2024-05-09T00:07:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2ea32d6700 1 --2- 172.21.15.81:0/1716589186 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2e880a1290 0x7f2e880a3750 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2ea32d6700 1 --2- 172.21.15.81:0/1716589186 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2e9c19bcb0 0x7f2e9c19c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2ea32d6700 1 --2- 172.21.15.81:0/1716589186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e9c100bc0 0x7f2e9c1973d0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.748+0000 7f2ea32d6700 1 --2- 172.21.15.81:0/1716589186 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2e9c1051d0 0x7f2e9c197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.749+0000 7f2ea32d6700 1 -- 172.21.15.81:0/1716589186 >> 172.21.15.81:0/1716589186 conn(0x7f2e9c075120 msgr2=0x7f2e9c103c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.749+0000 7f2ea32d6700 1 -- 172.21.15.81:0/1716589186 shutdown_connections 2024-05-09T00:07:28.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:28.749+0000 7f2ea32d6700 1 -- 172.21.15.81:0/1716589186 wait complete. 2024-05-09T00:07:28.755 INFO:tasks.cephfs.filesystem:scrub status for tag:9919bf8f-4f5e-477b-928b-97ab85c1365d - {'path': '/', 'tag': '9919bf8f-4f5e-477b-928b-97ab85c1365d', 'options': 'recursive,force'} 2024-05-09T00:07:29.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:29 smithi150 ceph-mon[46187]: pgmap v139: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:29.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:29 smithi171 ceph-mon[47351]: pgmap v139: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:29.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:29 smithi081 ceph-mon[42474]: pgmap v139: 97 pgs: 97 active+clean; 5.2 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:30.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:30 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:07:30.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:30 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:07:30.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:30 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:07:30.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:30 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:07:30.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:30 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:07:30.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:30 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:07:30.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:30 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:07:30.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:30 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:07:30.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:30 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:07:30.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:30 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:07:30.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:30 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:07:30.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:30 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:07:30.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:30 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:07:30.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:30 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:07:30.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:30 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:07:31.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:31 smithi171 ceph-mon[47351]: pgmap v140: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-05-09T00:07:31.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:31 smithi081 ceph-mon[42474]: pgmap v140: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-05-09T00:07:31.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:31 smithi150 ceph-mon[46187]: pgmap v140: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-05-09T00:07:33.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:33 smithi150 ceph-mon[46187]: pgmap v141: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-05-09T00:07:33.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:33 smithi171 ceph-mon[47351]: pgmap v141: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-05-09T00:07:33.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:33 smithi081 ceph-mon[42474]: pgmap v141: 97 pgs: 97 active+clean; 5.4 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 32 KiB/s wr, 14 op/s 2024-05-09T00:07:35.147 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.149+0000 7f4236460700 1 -- 172.21.15.81:0/42327312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4230101ac0 msgr2=0x7f4230105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.149+0000 7f4236460700 1 --2- 172.21.15.81:0/42327312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4230101ac0 0x7f4230105b00 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f4224009990 tx=0x7f4224009ca0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.150+0000 7f4236460700 1 -- 172.21.15.81:0/42327312 shutdown_connections 2024-05-09T00:07:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.150+0000 7f4236460700 1 --2- 172.21.15.81:0/42327312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4230106230 0x7f423010ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.150+0000 7f4236460700 1 --2- 172.21.15.81:0/42327312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4230101110 0x7f42301014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.150+0000 7f4236460700 1 --2- 172.21.15.81:0/42327312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4230101ac0 0x7f4230105b00 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.150+0000 7f4236460700 1 -- 172.21.15.81:0/42327312 >> 172.21.15.81:0/42327312 conn(0x7f42300fc9b0 msgr2=0x7f42300fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.150+0000 7f4236460700 1 -- 172.21.15.81:0/42327312 shutdown_connections 2024-05-09T00:07:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.150+0000 7f4236460700 1 -- 172.21.15.81:0/42327312 wait complete. 2024-05-09T00:07:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.150+0000 7f4236460700 1 Processor -- start 2024-05-09T00:07:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.150+0000 7f4236460700 1 -- start start 2024-05-09T00:07:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f4236460700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4230101110 0x7f4230197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f4236460700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4230106230 0x7f4230197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f4236460700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f423019bbd0 0x7f423019c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f4236460700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423019c650 con 0x7f4230101110 2024-05-09T00:07:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f4236460700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423019c7c0 con 0x7f423019bbd0 2024-05-09T00:07:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f4236460700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423019c980 con 0x7f4230106230 2024-05-09T00:07:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f422ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4230101110 0x7f4230197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f422ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4230101110 0x7f4230197340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45674/0 (socket says 172.21.15.81:45674) 2024-05-09T00:07:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f422ffff700 1 -- 172.21.15.81:0/615077604 learned_addr learned my addr 172.21.15.81:0/615077604 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f42349fd700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f423019bbd0 0x7f423019c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f422ffff700 1 -- 172.21.15.81:0/615077604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4230106230 msgr2=0x7f4230197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f422f7fe700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4230106230 0x7f4230197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f422ffff700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4230106230 0x7f4230197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f422ffff700 1 -- 172.21.15.81:0/615077604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f423019bbd0 msgr2=0x7f423019c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f422ffff700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f423019bbd0 0x7f423019c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f422ffff700 1 -- 172.21.15.81:0/615077604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42240095f0 con 0x7f4230101110 2024-05-09T00:07:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f42349fd700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f423019bbd0 0x7f423019c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f422ffff700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4230101110 0x7f4230197340 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f422000c9b0 tx=0x7f422000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f422d7fa700 1 -- 172.21.15.81:0/615077604 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220007b00 con 0x7f4230101110 2024-05-09T00:07:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f422d7fa700 1 -- 172.21.15.81:0/615077604 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4220007c60 con 0x7f4230101110 2024-05-09T00:07:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f4236460700 1 -- 172.21.15.81:0/615077604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42301a3ee0 con 0x7f4230101110 2024-05-09T00:07:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f422d7fa700 1 -- 172.21.15.81:0/615077604 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220018660 con 0x7f4230101110 2024-05-09T00:07:35.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.151+0000 7f4236460700 1 -- 172.21.15.81:0/615077604 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42301a4360 con 0x7f4230101110 2024-05-09T00:07:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.154+0000 7f422d7fa700 1 -- 172.21.15.81:0/615077604 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4220018880 con 0x7f4230101110 2024-05-09T00:07:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.154+0000 7f422d7fa700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f42180a1290 0x7f42180a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.155+0000 7f422f7fe700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f42180a1290 0x7f42180a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.155+0000 7f422d7fa700 1 -- 172.21.15.81:0/615077604 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f42200ccd80 con 0x7f4230101110 2024-05-09T00:07:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.155+0000 7f422f7fe700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f42180a1290 0x7f42180a3750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4224000c00 tx=0x7f4224005fb0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.155+0000 7f424261ab80 1 Processor -- start 2024-05-09T00:07:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.155+0000 7f424261ab80 1 -- start start 2024-05-09T00:07:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f424261ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee6950 0x55bd2cee6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f424261ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2cee0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f424261ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee1480 0x55bd2cee18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f424261ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd2ce380f0 con 0x55bd2cee7270 2024-05-09T00:07:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f424261ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd2ce35ab0 con 0x55bd2cee1480 2024-05-09T00:07:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f424261ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd2ce313a0 con 0x55bd2cee6950 2024-05-09T00:07:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f422f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2cee0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f422f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2cee0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45684/0 (socket says 172.21.15.81:45684) 2024-05-09T00:07:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f422f7fe700 1 -- 172.21.15.81:0/1378187434 learned_addr learned my addr 172.21.15.81:0/1378187434 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f42349fd700 1 --2- 172.21.15.81:0/1378187434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee1480 0x55bd2cee18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f422ffff700 1 --2- 172.21.15.81:0/1378187434 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee6950 0x55bd2cee6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f422f7fe700 1 -- 172.21.15.81:0/1378187434 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee6950 msgr2=0x55bd2cee6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f422f7fe700 1 --2- 172.21.15.81:0/1378187434 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee6950 0x55bd2cee6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f422f7fe700 1 -- 172.21.15.81:0/1378187434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee1480 msgr2=0x55bd2cee18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f422f7fe700 1 --2- 172.21.15.81:0/1378187434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee1480 0x55bd2cee18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f422f7fe700 1 -- 172.21.15.81:0/1378187434 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd2ccb2350 con 0x55bd2cee7270 2024-05-09T00:07:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f42349fd700 1 --2- 172.21.15.81:0/1378187434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee1480 0x55bd2cee18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:07:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f422f7fe700 1 --2- 172.21.15.81:0/1378187434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2cee0f40 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4224015000 tx=0x7f422401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686debabef60d715 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.156+0000 7f42167fc700 1 -- 172.21.15.81:0/1378187434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422401e070 con 0x55bd2cee7270 2024-05-09T00:07:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.157+0000 7f42167fc700 1 -- 172.21.15.81:0/1378187434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4224005670 con 0x55bd2cee7270 2024-05-09T00:07:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.157+0000 7f42167fc700 1 -- 172.21.15.81:0/1378187434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400f7e0 con 0x55bd2cee7270 2024-05-09T00:07:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.157+0000 7f424261ab80 1 -- 172.21.15.81:0/1378187434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 msgr2=0x55bd2cee0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.157+0000 7f424261ab80 1 --2- 172.21.15.81:0/1378187434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2cee0f40 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f4224015000 tx=0x7f422401e000 comp rx=0 tx=0).stop 2024-05-09T00:07:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.157+0000 7f424261ab80 1 -- 172.21.15.81:0/1378187434 shutdown_connections 2024-05-09T00:07:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.157+0000 7f424261ab80 1 --2- 172.21.15.81:0/1378187434 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee1480 0x55bd2cee18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.157+0000 7f424261ab80 1 --2- 172.21.15.81:0/1378187434 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee6950 0x55bd2cee6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.157+0000 7f424261ab80 1 --2- 172.21.15.81:0/1378187434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2cee0f40 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.157+0000 7f424261ab80 1 -- 172.21.15.81:0/1378187434 >> 172.21.15.81:0/1378187434 conn(0x55bd2ce3f1b0 msgr2=0x55bd2cedb840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.157+0000 7f424261ab80 1 -- 172.21.15.81:0/1378187434 shutdown_connections 2024-05-09T00:07:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.157+0000 7f424261ab80 1 -- 172.21.15.81:0/1378187434 wait complete. 2024-05-09T00:07:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f424261ab80 1 -- start start 2024-05-09T00:07:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f424261ab80 1 Processor -- start 2024-05-09T00:07:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f424261ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee1480 0x55bd2ceed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.163 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f424261ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee6950 0x55bd2ceea5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f424261ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2ceeacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f424261ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd2cdcd500 con 0x55bd2cee7270 2024-05-09T00:07:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f424261ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd2cdcd1a0 con 0x55bd2cee6950 2024-05-09T00:07:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f424261ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd2ccb4640 con 0x55bd2cee1480 2024-05-09T00:07:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f424261ab80 10 client.0 _ll_register_callbacks cb 0x55bd2cdd6ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f42349fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2ceeacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f42349fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2ceeacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45688/0 (socket says 172.21.15.81:45688) 2024-05-09T00:07:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f42349fd700 1 -- 172.21.15.81:0/2818074496 learned_addr learned my addr 172.21.15.81:0/2818074496 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f422ffff700 1 --2- 172.21.15.81:0/2818074496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee1480 0x55bd2ceed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f422f7fe700 1 --2- 172.21.15.81:0/2818074496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee6950 0x55bd2ceea5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f42349fd700 1 -- 172.21.15.81:0/2818074496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee1480 msgr2=0x55bd2ceed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f42349fd700 1 --2- 172.21.15.81:0/2818074496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee1480 0x55bd2ceed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.158+0000 7f42349fd700 1 -- 172.21.15.81:0/2818074496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee6950 msgr2=0x55bd2ceea5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f42349fd700 1 --2- 172.21.15.81:0/2818074496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee6950 0x55bd2ceea5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f42349fd700 1 -- 172.21.15.81:0/2818074496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423010e620 con 0x55bd2cee7270 2024-05-09T00:07:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f42349fd700 1 --2- 172.21.15.81:0/2818074496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2ceeacf0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4228007b00 tx=0x7f4228007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f031a9ced843cb5a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f420f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f420f7fe700 1 -- 172.21.15.81:0/2818074496 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42280119f0 con 0x55bd2cee7270 2024-05-09T00:07:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f420f7fe700 1 -- 172.21.15.81:0/2818074496 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f4228011b50 con 0x55bd2cee7270 2024-05-09T00:07:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f424261ab80 1 -- 172.21.15.81:0/2818074496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bd2cd8a210 con 0x55bd2cee7270 2024-05-09T00:07:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f420f7fe700 1 -- 172.21.15.81:0/2818074496 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4228011d10 con 0x55bd2cee7270 2024-05-09T00:07:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f424261ab80 10 client.16767 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f424261ab80 1 -- 172.21.15.81:0/2818074496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bd2cc5eb00 con 0x55bd2cee7270 2024-05-09T00:07:35.165 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f420f7fe700 1 -- 172.21.15.81:0/2818074496 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bd2cd8a210 con 0x55bd2cee7270 2024-05-09T00:07:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f420f7fe700 1 -- 172.21.15.81:0/2818074496 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4228016070 con 0x55bd2cee7270 2024-05-09T00:07:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f424261ab80 10 client.16767 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f424261ab80 10 client.16767 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f424261ab80 20 client.16767 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f424261ab80 1 --2- 172.21.15.81:0/2818074496 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bd2ceface0 0x55bd2cefd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f424261ab80 4 client.16767 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:07:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.159+0000 7f424261ab80 1 -- 172.21.15.81:0/2818074496 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bd2ceb07b0 con 0x55bd2ceface0 2024-05-09T00:07:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.160+0000 7f422ffff700 1 --2- 172.21.15.81:0/2818074496 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bd2ceface0 0x55bd2cefd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.160+0000 7f420f7fe700 10 client.16767 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.160+0000 7f422ffff700 1 --2- 172.21.15.81:0/2818074496 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bd2ceface0 0x55bd2cefd100 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56241d05e14bd4b1 server_cookie=ae2685700d6da233 in_seq=0 out_seq=0 2024-05-09T00:07:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f420f7fe700 1 -- 172.21.15.81:0/2818074496 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bd2ceb07b0 con 0x55bd2ceface0 2024-05-09T00:07:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f420f7fe700 10 client.16767 handle_command_reply: tid=0 2024-05-09T00:07:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f424261ab80 1 client.16767 shutdown 2024-05-09T00:07:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f424261ab80 1 -- 172.21.15.81:0/2818074496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 msgr2=0x55bd2ceeacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f424261ab80 1 --2- 172.21.15.81:0/2818074496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2ceeacf0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f4228007b00 tx=0x7f4228007ec0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f424261ab80 1 -- 172.21.15.81:0/2818074496 shutdown_connections 2024-05-09T00:07:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f424261ab80 1 --2- 172.21.15.81:0/2818074496 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bd2ceface0 0x55bd2cefd100 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f424261ab80 1 --2- 172.21.15.81:0/2818074496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2ceeacf0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f420f7fe700 0 client.16767 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f424261ab80 1 --2- 172.21.15.81:0/2818074496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee1480 0x55bd2ceed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f424261ab80 1 --2- 172.21.15.81:0/2818074496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee6950 0x55bd2ceea5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f424261ab80 1 -- 172.21.15.81:0/2818074496 >> 172.21.15.81:0/2818074496 conn(0x55bd2ce3f1b0 msgr2=0x55bd2cee4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f424261ab80 1 -- 172.21.15.81:0/2818074496 shutdown_connections 2024-05-09T00:07:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f424261ab80 1 -- 172.21.15.81:0/2818074496 wait complete. 2024-05-09T00:07:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.161+0000 7f424261ab80 20 client.16767 trim_cache size 0 max 16384 2024-05-09T00:07:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.176+0000 7f424261ab80 1 Processor -- start 2024-05-09T00:07:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.176+0000 7f424261ab80 1 -- start start 2024-05-09T00:07:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.176+0000 7f424261ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee1480 0x55bd2cefd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.176+0000 7f424261ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee6950 0x55bd2cedb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.176+0000 7f424261ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2ceecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.176+0000 7f424261ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd2cf02310 con 0x55bd2cee7270 2024-05-09T00:07:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.176+0000 7f424261ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd2cedc330 con 0x55bd2cee1480 2024-05-09T00:07:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.176+0000 7f424261ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd2cee0200 con 0x55bd2cee6950 2024-05-09T00:07:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.176+0000 7f42349fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2ceecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.177+0000 7f42349fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2ceecdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45692/0 (socket says 172.21.15.81:45692) 2024-05-09T00:07:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.177+0000 7f42349fd700 1 -- 172.21.15.81:0/398585942 learned_addr learned my addr 172.21.15.81:0/398585942 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.177+0000 7f422f7fe700 1 --2- 172.21.15.81:0/398585942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee6950 0x55bd2cedb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.177+0000 7f42349fd700 1 -- 172.21.15.81:0/398585942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee6950 msgr2=0x55bd2cedb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.177+0000 7f42349fd700 1 --2- 172.21.15.81:0/398585942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee6950 0x55bd2cedb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.177+0000 7f42349fd700 1 -- 172.21.15.81:0/398585942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee1480 msgr2=0x55bd2cefd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.177+0000 7f42349fd700 1 --2- 172.21.15.81:0/398585942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee1480 0x55bd2cefd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.177+0000 7f42349fd700 1 -- 172.21.15.81:0/398585942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bd2cdf7500 con 0x55bd2cee7270 2024-05-09T00:07:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.177+0000 7f422f7fe700 1 --2- 172.21.15.81:0/398585942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee6950 0x55bd2cedb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.177+0000 7f42349fd700 1 --2- 172.21.15.81:0/398585942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2ceecdf0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4228000f80 tx=0x7f42280090b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4164a30ae686ca35 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.177+0000 7f4216ffd700 1 -- 172.21.15.81:0/398585942 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228005b00 con 0x55bd2cee7270 2024-05-09T00:07:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.177+0000 7f4216ffd700 1 -- 172.21.15.81:0/398585942 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4228013040 con 0x55bd2cee7270 2024-05-09T00:07:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.177+0000 7f4216ffd700 1 -- 172.21.15.81:0/398585942 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228011e90 con 0x55bd2cee7270 2024-05-09T00:07:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.178+0000 7f424261ab80 1 -- 172.21.15.81:0/398585942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 msgr2=0x55bd2ceecdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.178+0000 7f424261ab80 1 --2- 172.21.15.81:0/398585942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2ceecdf0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f4228000f80 tx=0x7f42280090b0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.178+0000 7f424261ab80 1 -- 172.21.15.81:0/398585942 shutdown_connections 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.178+0000 7f424261ab80 1 --2- 172.21.15.81:0/398585942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee1480 0x55bd2cefd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.178+0000 7f424261ab80 1 --2- 172.21.15.81:0/398585942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee7270 0x55bd2ceecdf0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.178+0000 7f424261ab80 1 --2- 172.21.15.81:0/398585942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee6950 0x55bd2cedb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.178+0000 7f424261ab80 1 -- 172.21.15.81:0/398585942 >> 172.21.15.81:0/398585942 conn(0x55bd2ce3f1b0 msgr2=0x55bd2ced7e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.178+0000 7f424261ab80 1 -- 172.21.15.81:0/398585942 shutdown_connections 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.178+0000 7f424261ab80 1 -- 172.21.15.81:0/398585942 wait complete. 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.178+0000 7f424261ab80 1 -- start start 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.178+0000 7f424261ab80 1 Processor -- start 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f424261ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee1480 0x55bd2ceefbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f424261ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee6950 0x55bd2cef0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f424261ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee7270 0x55bd2cef0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f424261ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd2cf54660 con 0x55bd2cee1480 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f424261ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd2cf547d0 con 0x55bd2cee6950 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f424261ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bd2cf54990 con 0x55bd2cee7270 2024-05-09T00:07:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f424261ab80 10 client.0 _ll_register_callbacks cb 0x55bd2cdd6ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f422ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee1480 0x55bd2ceefbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f422ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee1480 0x55bd2ceefbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45704/0 (socket says 172.21.15.81:45704) 2024-05-09T00:07:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f422ffff700 1 -- 172.21.15.81:0/798252969 learned_addr learned my addr 172.21.15.81:0/798252969 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f422f7fe700 1 --2- 172.21.15.81:0/798252969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee6950 0x55bd2cef0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f422ffff700 1 -- 172.21.15.81:0/798252969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee7270 msgr2=0x55bd2cef0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f422ffff700 1 --2- 172.21.15.81:0/798252969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee7270 0x55bd2cef0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f422ffff700 1 -- 172.21.15.81:0/798252969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee6950 msgr2=0x55bd2cef0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f422ffff700 1 --2- 172.21.15.81:0/798252969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee6950 0x55bd2cef0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f422ffff700 1 -- 172.21.15.81:0/798252969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bd2cc5eb00 con 0x55bd2cee1480 2024-05-09T00:07:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f422f7fe700 1 --2- 172.21.15.81:0/798252969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee6950 0x55bd2cef0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:07:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f422ffff700 1 --2- 172.21.15.81:0/798252969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee1480 0x55bd2ceefbc0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4220096900 tx=0x7f422009dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfc01803fa0b53f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f420f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f420f7fe700 1 -- 172.21.15.81:0/798252969 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422009aea0 con 0x55bd2cee1480 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f420f7fe700 1 -- 172.21.15.81:0/798252969 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f42200982f0 con 0x55bd2cee1480 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f424261ab80 1 -- 172.21.15.81:0/798252969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4224005670 con 0x55bd2cee1480 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f420f7fe700 1 -- 172.21.15.81:0/798252969 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f422009a0f0 con 0x55bd2cee1480 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f424261ab80 10 client.16773 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.179+0000 7f424261ab80 1 -- 172.21.15.81:0/798252969 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bd2ccb6c70 con 0x55bd2cee1480 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.180+0000 7f420f7fe700 1 -- 172.21.15.81:0/798252969 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4224005670 con 0x55bd2cee1480 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.180+0000 7f420f7fe700 1 -- 172.21.15.81:0/798252969 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f42200a1f10 con 0x55bd2cee1480 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.180+0000 7f424261ab80 10 client.16773 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.180+0000 7f424261ab80 10 client.16773 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.180+0000 7f424261ab80 20 client.16773 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.180+0000 7f424261ab80 1 --2- 172.21.15.81:0/798252969 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bd2cf55f50 0x55bd2cf58370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.180+0000 7f424261ab80 4 client.16773 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.180+0000 7f424261ab80 1 -- 172.21.15.81:0/798252969 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bd2ce29e60 con 0x55bd2cf55f50 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.180+0000 7f422f7fe700 1 --2- 172.21.15.81:0/798252969 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bd2cf55f50 0x55bd2cf58370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.180+0000 7f420f7fe700 10 client.16773 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.180+0000 7f422f7fe700 1 --2- 172.21.15.81:0/798252969 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bd2cf55f50 0x55bd2cf58370 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d82bcfd2e8067a38 server_cookie=69d3d9a67f9ed26d in_seq=0 out_seq=0 2024-05-09T00:07:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.198+0000 7f420f7fe700 1 -- 172.21.15.81:0/798252969 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bd2ce29e60 con 0x55bd2cf55f50 2024-05-09T00:07:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.198+0000 7f420f7fe700 10 client.16773 handle_command_reply: tid=0 2024-05-09T00:07:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.198+0000 7f424261ab80 1 client.16773 shutdown 2024-05-09T00:07:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f424261ab80 1 -- 172.21.15.81:0/798252969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee1480 msgr2=0x55bd2ceefbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f424261ab80 1 --2- 172.21.15.81:0/798252969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee1480 0x55bd2ceefbc0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f4220096900 tx=0x7f422009dcc0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f424261ab80 1 -- 172.21.15.81:0/798252969 shutdown_connections 2024-05-09T00:07:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f424261ab80 1 --2- 172.21.15.81:0/798252969 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bd2cf55f50 0x55bd2cf58370 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f424261ab80 1 --2- 172.21.15.81:0/798252969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bd2cee7270 0x55bd2cef0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f424261ab80 1 --2- 172.21.15.81:0/798252969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bd2cee1480 0x55bd2ceefbc0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f424261ab80 1 --2- 172.21.15.81:0/798252969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bd2cee6950 0x55bd2cef0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f420f7fe700 0 client.16773 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f424261ab80 1 -- 172.21.15.81:0/798252969 >> 172.21.15.81:0/798252969 conn(0x55bd2ce3f1b0 msgr2=0x55bd2cee0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f424261ab80 1 -- 172.21.15.81:0/798252969 shutdown_connections 2024-05-09T00:07:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f424261ab80 1 -- 172.21.15.81:0/798252969 wait complete. 2024-05-09T00:07:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f424261ab80 20 client.16773 trim_cache size 0 max 16384 2024-05-09T00:07:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:07:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:07:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:07:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:07:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f4236460700 1 -- 172.21.15.81:0/615077604 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f42180a1290 msgr2=0x7f42180a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f4236460700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f42180a1290 0x7f42180a3750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4224000c00 tx=0x7f4224005fb0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f4236460700 1 -- 172.21.15.81:0/615077604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4230101110 msgr2=0x7f4230197340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f4236460700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4230101110 0x7f4230197340 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f422000c9b0 tx=0x7f422000cd70 comp rx=0 tx=0).stop 2024-05-09T00:07:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f4236460700 1 -- 172.21.15.81:0/615077604 shutdown_connections 2024-05-09T00:07:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f4236460700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f42180a1290 0x7f42180a3750 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f4236460700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f423019bbd0 0x7f423019c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f4236460700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4230101110 0x7f4230197340 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f4236460700 1 --2- 172.21.15.81:0/615077604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4230106230 0x7f4230197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.199+0000 7f4236460700 1 -- 172.21.15.81:0/615077604 >> 172.21.15.81:0/615077604 conn(0x7f42300fc9b0 msgr2=0x7f42300fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.200+0000 7f4236460700 1 -- 172.21.15.81:0/615077604 shutdown_connections 2024-05-09T00:07:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:35.200+0000 7f4236460700 1 -- 172.21.15.81:0/615077604 wait complete. 2024-05-09T00:07:35.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:35 smithi150 ceph-mon[46187]: pgmap v142: 97 pgs: 97 active+clean; 5.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-05-09T00:07:35.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:35 smithi171 ceph-mon[47351]: pgmap v142: 97 pgs: 97 active+clean; 5.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-05-09T00:07:35.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:35 smithi081 ceph-mon[42474]: pgmap v142: 97 pgs: 97 active+clean; 5.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-05-09T00:07:37.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:37 smithi150 ceph-mon[46187]: pgmap v143: 97 pgs: 97 active+clean; 5.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-05-09T00:07:37.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:37 smithi171 ceph-mon[47351]: pgmap v143: 97 pgs: 97 active+clean; 5.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-05-09T00:07:37.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:37 smithi081 ceph-mon[42474]: pgmap v143: 97 pgs: 97 active+clean; 5.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-05-09T00:07:39.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:39 smithi150 ceph-mon[46187]: pgmap v144: 97 pgs: 97 active+clean; 5.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-05-09T00:07:39.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:39 smithi171 ceph-mon[47351]: pgmap v144: 97 pgs: 97 active+clean; 5.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-05-09T00:07:39.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:39 smithi081 ceph-mon[42474]: pgmap v144: 97 pgs: 97 active+clean; 5.5 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-05-09T00:07:41.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:41 smithi150 ceph-mon[46187]: pgmap v145: 97 pgs: 97 active+clean; 1.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-05-09T00:07:41.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:41 smithi171 ceph-mon[47351]: pgmap v145: 97 pgs: 97 active+clean; 1.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-05-09T00:07:41.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:41 smithi081 ceph-mon[42474]: pgmap v145: 97 pgs: 97 active+clean; 1.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-05-09T00:07:43.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:43 smithi150 ceph-mon[46187]: pgmap v146: 97 pgs: 97 active+clean; 1.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:43.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:43 smithi171 ceph-mon[47351]: pgmap v146: 97 pgs: 97 active+clean; 1.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:43.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:43 smithi081 ceph-mon[42474]: pgmap v146: 97 pgs: 97 active+clean; 1.7 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:44.875 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.875 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.875 INFO:tasks.workunit.client.0.smithi081.stdout:127/600: open fd = 3 2024-05-09T00:07:44.875 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.875 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.875 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.875 INFO:tasks.workunit.client.0.smithi081.stdout:128/600: open fd = 3 2024-05-09T00:07:44.875 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.875 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.875 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi081.stdout:129/600: open fd = 3 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi081.stdout:130/600: open fd = 3 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi081.stdout:131/600: open fd = 3 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi081.stdout:132/600: open fd = 3 2024-05-09T00:07:44.876 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi081.stdout:133/600: open fd = 3 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi081.stdout:134/600: open fd = 3 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi081.stdout:135/600: open fd = 3 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.877 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:136/600: open fd = 3 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:137/600: open fd = 3 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:138/600: open fd = 3 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:139/600: open fd = 3 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.878 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.879 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.879 INFO:tasks.workunit.client.0.smithi081.stdout:140/600: open fd = 3 2024-05-09T00:07:44.879 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.879 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.879 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.879 INFO:tasks.workunit.client.0.smithi081.stdout:141/600: open fd = 3 2024-05-09T00:07:44.879 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.879 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.879 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.879 INFO:tasks.workunit.client.0.smithi081.stdout:142/600: open fd = 3 2024-05-09T00:07:44.879 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.879 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.879 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:143/600: open fd = 3 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:144/600: open fd = 3 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:145/600: open fd = 3 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:146/600: open fd = 3 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.880 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi081.stdout:147/600: open fd = 3 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi081.stdout:148/600: open fd = 3 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi081.stdout:149/600: open fd = 3 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.881 INFO:tasks.workunit.client.0.smithi081.stdout:150/600: open fd = 3 2024-05-09T00:07:44.882 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.882 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.882 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.882 INFO:tasks.workunit.client.0.smithi081.stdout:151/600: open fd = 3 2024-05-09T00:07:44.882 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.882 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.882 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.882 INFO:tasks.workunit.client.0.smithi081.stdout:152/600: open fd = 3 2024-05-09T00:07:44.882 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.882 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.882 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.882 INFO:tasks.workunit.client.0.smithi081.stdout:153/600: open fd = 3 2024-05-09T00:07:44.882 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.883 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.883 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.883 INFO:tasks.workunit.client.0.smithi081.stdout:154/600: open fd = 3 2024-05-09T00:07:44.883 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.883 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.883 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.883 INFO:tasks.workunit.client.0.smithi081.stdout:155/600: open fd = 3 2024-05-09T00:07:44.883 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.883 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.884 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.884 INFO:tasks.workunit.client.0.smithi081.stdout:156/600: open fd = 3 2024-05-09T00:07:44.884 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.884 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.884 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.884 INFO:tasks.workunit.client.0.smithi081.stdout:157/600: open fd = 3 2024-05-09T00:07:44.884 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.884 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.884 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.884 INFO:tasks.workunit.client.0.smithi081.stdout:158/600: open fd = 3 2024-05-09T00:07:44.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.885 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.885 INFO:tasks.workunit.client.0.smithi081.stdout:159/600: open fd = 3 2024-05-09T00:07:44.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.885 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.885 INFO:tasks.workunit.client.0.smithi081.stdout:160/600: open fd = 3 2024-05-09T00:07:44.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.885 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.885 INFO:tasks.workunit.client.0.smithi081.stdout:161/600: open fd = 3 2024-05-09T00:07:44.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.885 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.886 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.886 INFO:tasks.workunit.client.0.smithi081.stdout:162/600: open fd = 3 2024-05-09T00:07:44.886 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.886 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.886 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.886 INFO:tasks.workunit.client.0.smithi081.stdout:163/600: open fd = 3 2024-05-09T00:07:44.886 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.886 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.886 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.886 INFO:tasks.workunit.client.0.smithi081.stdout:164/600: open fd = 3 2024-05-09T00:07:44.886 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.886 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.886 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.886 INFO:tasks.workunit.client.0.smithi081.stdout:165/600: open fd = 3 2024-05-09T00:07:44.887 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.887 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.887 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.887 INFO:tasks.workunit.client.0.smithi081.stdout:166/600: open fd = 3 2024-05-09T00:07:44.887 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.887 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.887 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.887 INFO:tasks.workunit.client.0.smithi081.stdout:167/600: open fd = 3 2024-05-09T00:07:44.887 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.887 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.887 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.887 INFO:tasks.workunit.client.0.smithi081.stdout:168/600: open fd = 3 2024-05-09T00:07:44.887 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.887 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi081.stdout:169/600: open fd = 3 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi081.stdout:170/600: open fd = 3 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi081.stdout:171/600: open fd = 3 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.888 INFO:tasks.workunit.client.0.smithi081.stdout:172/600: open fd = 3 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:173/600: open fd = 3 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:174/600: open fd = 3 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:175/600: open fd = 3 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.889 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi081.stdout:176/600: open fd = 3 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi081.stdout:177/600: open fd = 3 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi081.stdout:178/600: open fd = 3 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi081.stdout:179/600: open fd = 3 2024-05-09T00:07:44.890 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:180/600: open fd = 3 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:181/600: open fd = 3 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:182/600: open fd = 3 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.891 INFO:tasks.workunit.client.0.smithi081.stdout:183/600: open fd = 3 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi081.stdout:184/600: open fd = 3 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi081.stdout:185/600: open fd = 3 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi081.stdout:186/600: open fd = 3 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.892 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.893 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.893 INFO:tasks.workunit.client.0.smithi081.stdout:187/600: open fd = 3 2024-05-09T00:07:44.893 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.893 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.893 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:07:44.893 INFO:tasks.workunit.client.0.smithi081.stdout:188/600: open fd = 3 2024-05-09T00:07:44.893 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:44.893 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:07:45.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:45 smithi150 ceph-mon[46187]: pgmap v147: 97 pgs: 97 active+clean; 1.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 44 KiB/s wr, 17 op/s 2024-05-09T00:07:45.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:45 smithi171 ceph-mon[47351]: pgmap v147: 97 pgs: 97 active+clean; 1.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 44 KiB/s wr, 17 op/s 2024-05-09T00:07:45.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:45 smithi081 ceph-mon[42474]: pgmap v147: 97 pgs: 97 active+clean; 1.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 44 KiB/s wr, 17 op/s 2024-05-09T00:07:47.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:47 smithi150 ceph-mon[46187]: pgmap v148: 97 pgs: 97 active+clean; 1.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-05-09T00:07:47.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:47 smithi171 ceph-mon[47351]: pgmap v148: 97 pgs: 97 active+clean; 1.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-05-09T00:07:47.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:47 smithi081 ceph-mon[42474]: pgmap v148: 97 pgs: 97 active+clean; 1.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-05-09T00:07:48.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.316+0000 7f27e76cc700 1 -- 172.21.15.81:0/3242248920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e01002a0 msgr2=0x7f27e0100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:48.313 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.316+0000 7f27e76cc700 1 --2- 172.21.15.81:0/3242248920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e01002a0 0x7f27e0100720 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009990 tx=0x7f27dc009ca0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.313 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.316+0000 7f27e76cc700 1 -- 172.21.15.81:0/3242248920 shutdown_connections 2024-05-09T00:07:48.313 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.316+0000 7f27e76cc700 1 --2- 172.21.15.81:0/3242248920 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27e0105f40 0x7f27e0106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.313 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.316+0000 7f27e76cc700 1 --2- 172.21.15.81:0/3242248920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27e0100c60 0x7f27e010cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.313 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.316+0000 7f27e76cc700 1 --2- 172.21.15.81:0/3242248920 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e01002a0 0x7f27e0100720 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.313 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.316+0000 7f27e76cc700 1 -- 172.21.15.81:0/3242248920 >> 172.21.15.81:0/3242248920 conn(0x7f27e0076c10 msgr2=0x7f27e0077020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:48.313 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.316+0000 7f27e76cc700 1 -- 172.21.15.81:0/3242248920 shutdown_connections 2024-05-09T00:07:48.313 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.316+0000 7f27e76cc700 1 -- 172.21.15.81:0/3242248920 wait complete. 2024-05-09T00:07:48.315 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.317+0000 7f27e76cc700 1 Processor -- start 2024-05-09T00:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.317+0000 7f27e76cc700 1 -- start start 2024-05-09T00:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.317+0000 7f27e76cc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27e01002a0 0x7f27e01962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.317+0000 7f27e76cc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e0100c60 0x7f27e0196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.317+0000 7f27e76cc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27e0105f40 0x7f27e019abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.317+0000 7f27e76cc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e019b1f0 con 0x7f27e0100c60 2024-05-09T00:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.317+0000 7f27e76cc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e019b360 con 0x7f27e01002a0 2024-05-09T00:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.317+0000 7f27e76cc700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e019b520 con 0x7f27e0105f40 2024-05-09T00:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.317+0000 7f27e4c67700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e0100c60 0x7f27e0196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.317+0000 7f27e4c67700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e0100c60 0x7f27e0196810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34248/0 (socket says 172.21.15.81:34248) 2024-05-09T00:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.317+0000 7f27e4c67700 1 -- 172.21.15.81:0/1216082511 learned_addr learned my addr 172.21.15.81:0/1216082511 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.318+0000 7f27e5c69700 1 --2- 172.21.15.81:0/1216082511 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27e0105f40 0x7f27e019abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.318+0000 7f27e5468700 1 --2- 172.21.15.81:0/1216082511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27e01002a0 0x7f27e01962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.318+0000 7f27e4c67700 1 -- 172.21.15.81:0/1216082511 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27e0105f40 msgr2=0x7f27e019abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:48.316 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.318+0000 7f27e4c67700 1 --2- 172.21.15.81:0/1216082511 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27e0105f40 0x7f27e019abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.317 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.318+0000 7f27e4c67700 1 -- 172.21.15.81:0/1216082511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27e01002a0 msgr2=0x7f27e01962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:48.317 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.318+0000 7f27e4c67700 1 --2- 172.21.15.81:0/1216082511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27e01002a0 0x7f27e01962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.317 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.318+0000 7f27e4c67700 1 -- 172.21.15.81:0/1216082511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc0095f0 con 0x7f27e0100c60 2024-05-09T00:07:48.317 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.318+0000 7f27e4c67700 1 --2- 172.21.15.81:0/1216082511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e0100c60 0x7f27e0196810 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f27dc004760 tx=0x7f27dc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:48.317 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.318+0000 7f27d67fc700 1 -- 172.21.15.81:0/1216082511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc01f070 con 0x7f27e0100c60 2024-05-09T00:07:48.317 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.318+0000 7f27d67fc700 1 -- 172.21.15.81:0/1216082511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27dc00f460 con 0x7f27e0100c60 2024-05-09T00:07:48.317 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.318+0000 7f27e76cc700 1 -- 172.21.15.81:0/1216082511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e019b7a0 con 0x7f27e0100c60 2024-05-09T00:07:48.317 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.318+0000 7f27d67fc700 1 -- 172.21.15.81:0/1216082511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc025680 con 0x7f27e0100c60 2024-05-09T00:07:48.317 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.318+0000 7f27e76cc700 1 -- 172.21.15.81:0/1216082511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e00693f0 con 0x7f27e0100c60 2024-05-09T00:07:48.320 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.320+0000 7f27d67fc700 1 -- 172.21.15.81:0/1216082511 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f27dc023070 con 0x7f27e0100c60 2024-05-09T00:07:48.320 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.321+0000 7f27d67fc700 1 --2- 172.21.15.81:0/1216082511 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27cc0a1290 0x7f27cc0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.320 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.321+0000 7f27e5468700 1 --2- 172.21.15.81:0/1216082511 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27cc0a1290 0x7f27cc0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.320 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.321+0000 7f27d67fc700 1 -- 172.21.15.81:0/1216082511 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f27dc0d0050 con 0x7f27e0100c60 2024-05-09T00:07:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.321+0000 7f27e5468700 1 --2- 172.21.15.81:0/1216082511 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27cc0a1290 0x7f27cc0a3750 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f27d0006fd0 tx=0x7f27d0008040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.322+0000 7f27f3886b80 1 Processor -- start 2024-05-09T00:07:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.322+0000 7f27f3886b80 1 -- start start 2024-05-09T00:07:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.322+0000 7f27f3886b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 0x556c41c24d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.322+0000 7f27f3886b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c25270 0x556c41c1ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.322+0000 7f27f3886b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c1f480 0x556c41c1f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.322+0000 7f27f3886b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c41b760f0 con 0x556c41c25270 2024-05-09T00:07:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.322+0000 7f27f3886b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c41b73ab0 con 0x556c41c1f480 2024-05-09T00:07:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.322+0000 7f27f3886b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c41b6f3a0 con 0x556c41c24950 2024-05-09T00:07:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.322+0000 7f27e4c67700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c25270 0x556c41c1ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.323+0000 7f27e4c67700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c25270 0x556c41c1ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34260/0 (socket says 172.21.15.81:34260) 2024-05-09T00:07:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.323+0000 7f27e4c67700 1 -- 172.21.15.81:0/897576531 learned_addr learned my addr 172.21.15.81:0/897576531 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.323+0000 7f27e5468700 1 --2- 172.21.15.81:0/897576531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 0x556c41c24d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.321 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.323+0000 7f27e4c67700 1 -- 172.21.15.81:0/897576531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 msgr2=0x556c41c24d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.323+0000 7f27e4c67700 1 --2- 172.21.15.81:0/897576531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 0x556c41c24d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.323+0000 7f27e4c67700 1 -- 172.21.15.81:0/897576531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c1f480 msgr2=0x556c41c1f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.323+0000 7f27e5c69700 1 --2- 172.21.15.81:0/897576531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c1f480 0x556c41c1f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.323+0000 7f27e4c67700 1 --2- 172.21.15.81:0/897576531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c1f480 0x556c41c1f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.323+0000 7f27e4c67700 1 -- 172.21.15.81:0/897576531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c419f0350 con 0x556c41c25270 2024-05-09T00:07:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.323+0000 7f27e4c67700 1 --2- 172.21.15.81:0/897576531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c25270 0x556c41c1ef40 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f27dc099d80 tx=0x7f27dc09ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894600e200b23fae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.323+0000 7f27cb7fe700 1 -- 172.21.15.81:0/897576531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc09d310 con 0x556c41c25270 2024-05-09T00:07:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.323+0000 7f27cb7fe700 1 -- 172.21.15.81:0/897576531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27dc0a1140 con 0x556c41c25270 2024-05-09T00:07:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.323+0000 7f27cb7fe700 1 -- 172.21.15.81:0/897576531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc09d7b0 con 0x556c41c25270 2024-05-09T00:07:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.324+0000 7f27f3886b80 1 -- 172.21.15.81:0/897576531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c25270 msgr2=0x556c41c1ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.324+0000 7f27f3886b80 1 --2- 172.21.15.81:0/897576531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c25270 0x556c41c1ef40 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f27dc099d80 tx=0x7f27dc09ced0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.324+0000 7f27f3886b80 1 -- 172.21.15.81:0/897576531 shutdown_connections 2024-05-09T00:07:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.324+0000 7f27f3886b80 1 --2- 172.21.15.81:0/897576531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c1f480 0x556c41c1f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.322 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.324+0000 7f27f3886b80 1 --2- 172.21.15.81:0/897576531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 0x556c41c24d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.324+0000 7f27f3886b80 1 --2- 172.21.15.81:0/897576531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c25270 0x556c41c1ef40 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.324+0000 7f27f3886b80 1 -- 172.21.15.81:0/897576531 >> 172.21.15.81:0/897576531 conn(0x556c41b7d1b0 msgr2=0x556c41c19840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:48.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.324+0000 7f27f3886b80 1 -- 172.21.15.81:0/897576531 shutdown_connections 2024-05-09T00:07:48.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.324+0000 7f27f3886b80 1 -- 172.21.15.81:0/897576531 wait complete. 2024-05-09T00:07:48.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.324+0000 7f27f3886b80 1 -- start start 2024-05-09T00:07:48.323 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.324+0000 7f27f3886b80 1 Processor -- start 2024-05-09T00:07:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27f3886b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c2b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27f3886b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 0x556c41c28590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27f3886b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c25270 0x556c41c28c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.326 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27f3886b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c41b0b500 con 0x556c41c1f480 2024-05-09T00:07:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27f3886b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c41b0b1a0 con 0x556c41c25270 2024-05-09T00:07:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27f3886b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c419f2640 con 0x556c41c24950 2024-05-09T00:07:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27f3886b80 10 client.0 _ll_register_callbacks cb 0x556c41b14ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27e5468700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c2b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27e5468700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c2b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34274/0 (socket says 172.21.15.81:34274) 2024-05-09T00:07:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27e5468700 1 -- 172.21.15.81:0/1265504997 learned_addr learned my addr 172.21.15.81:0/1265504997 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27e5c69700 1 --2- 172.21.15.81:0/1265504997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c25270 0x556c41c28c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27e4c67700 1 --2- 172.21.15.81:0/1265504997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 0x556c41c28590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27e5468700 1 -- 172.21.15.81:0/1265504997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 msgr2=0x556c41c28590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27e5468700 1 --2- 172.21.15.81:0/1265504997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 0x556c41c28590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27e5468700 1 -- 172.21.15.81:0/1265504997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c25270 msgr2=0x556c41c28c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27e5468700 1 --2- 172.21.15.81:0/1265504997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c25270 0x556c41c28c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27e5468700 1 -- 172.21.15.81:0/1265504997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e00693f0 con 0x556c41c1f480 2024-05-09T00:07:48.327 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27e5468700 1 --2- 172.21.15.81:0/1265504997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c2b200 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f27d000dd40 tx=0x7f27d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74217147aea41488 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.325+0000 7f27c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27c8ff9700 1 -- 172.21.15.81:0/1265504997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0014ba0 con 0x556c41c1f480 2024-05-09T00:07:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27c8ff9700 1 -- 172.21.15.81:0/1265504997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f27d0014d00 con 0x556c41c1f480 2024-05-09T00:07:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27f3886b80 1 -- 172.21.15.81:0/1265504997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c41ac8210 con 0x556c41c1f480 2024-05-09T00:07:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27c8ff9700 1 -- 172.21.15.81:0/1265504997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27d0020420 con 0x556c41c1f480 2024-05-09T00:07:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27f3886b80 10 client.16785 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27f3886b80 1 -- 172.21.15.81:0/1265504997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556c4199cb00 con 0x556c41c1f480 2024-05-09T00:07:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27c8ff9700 1 -- 172.21.15.81:0/1265504997 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556c41ac8210 con 0x556c41c1f480 2024-05-09T00:07:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27c8ff9700 1 -- 172.21.15.81:0/1265504997 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f27d0012580 con 0x556c41c1f480 2024-05-09T00:07:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27f3886b80 10 client.16785 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27f3886b80 10 client.16785 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27f3886b80 20 client.16785 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27f3886b80 1 --2- 172.21.15.81:0/1265504997 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c41c38880 0x556c41c3aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.328 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27f3886b80 4 client.16785 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:07:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27f3886b80 1 -- 172.21.15.81:0/1265504997 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c41bee7b0 con 0x556c41c38880 2024-05-09T00:07:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.326+0000 7f27e4c67700 1 --2- 172.21.15.81:0/1265504997 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c41c38880 0x556c41c3aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.327+0000 7f27e4c67700 1 --2- 172.21.15.81:0/1265504997 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c41c38880 0x556c41c3aca0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8e3cc61437267a6 server_cookie=d296cb43099d72de in_seq=0 out_seq=0 2024-05-09T00:07:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.327+0000 7f27c8ff9700 10 client.16785 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.327+0000 7f27c8ff9700 1 -- 172.21.15.81:0/1265504997 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556c41bee7b0 con 0x556c41c38880 2024-05-09T00:07:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.327+0000 7f27c8ff9700 10 client.16785 handle_command_reply: tid=0 2024-05-09T00:07:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.328+0000 7f27f3886b80 1 client.16785 shutdown 2024-05-09T00:07:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.328+0000 7f27f3886b80 1 -- 172.21.15.81:0/1265504997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 msgr2=0x556c41c2b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.328+0000 7f27f3886b80 1 --2- 172.21.15.81:0/1265504997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c2b200 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f27d000dd40 tx=0x7f27d0004750 comp rx=0 tx=0).stop 2024-05-09T00:07:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.328+0000 7f27f3886b80 1 -- 172.21.15.81:0/1265504997 shutdown_connections 2024-05-09T00:07:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.328+0000 7f27f3886b80 1 --2- 172.21.15.81:0/1265504997 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c41c38880 0x556c41c3aca0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.328+0000 7f27f3886b80 1 --2- 172.21.15.81:0/1265504997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c25270 0x556c41c28c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.329 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.328+0000 7f27f3886b80 1 --2- 172.21.15.81:0/1265504997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c2b200 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.328+0000 7f27c8ff9700 0 client.16785 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.328+0000 7f27f3886b80 1 --2- 172.21.15.81:0/1265504997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 0x556c41c28590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.328+0000 7f27f3886b80 1 -- 172.21.15.81:0/1265504997 >> 172.21.15.81:0/1265504997 conn(0x556c41b7d1b0 msgr2=0x556c41c234a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.328+0000 7f27f3886b80 1 -- 172.21.15.81:0/1265504997 shutdown_connections 2024-05-09T00:07:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.328+0000 7f27f3886b80 1 -- 172.21.15.81:0/1265504997 wait complete. 2024-05-09T00:07:48.330 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.328+0000 7f27f3886b80 20 client.16785 trim_cache size 0 max 16384 2024-05-09T00:07:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.343+0000 7f27f3886b80 1 Processor -- start 2024-05-09T00:07:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.343+0000 7f27f3886b80 1 -- start start 2024-05-09T00:07:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.343+0000 7f27f3886b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c1b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.343+0000 7f27f3886b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 0x556c41c19910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.343+0000 7f27f3886b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c25270 0x556c41c2ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.343+0000 7f27f3886b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c41c1b0f0 con 0x556c41c1f480 2024-05-09T00:07:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.343+0000 7f27f3886b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c41c3feb0 con 0x556c41c25270 2024-05-09T00:07:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.343+0000 7f27f3886b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c41c29260 con 0x556c41c24950 2024-05-09T00:07:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.343+0000 7f27e5468700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c1b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.343+0000 7f27e5468700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c1b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34282/0 (socket says 172.21.15.81:34282) 2024-05-09T00:07:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.343+0000 7f27e5468700 1 -- 172.21.15.81:0/1044533723 learned_addr learned my addr 172.21.15.81:0/1044533723 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.343+0000 7f27e5c69700 1 --2- 172.21.15.81:0/1044533723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c25270 0x556c41c2ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.343+0000 7f27e4c67700 1 --2- 172.21.15.81:0/1044533723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 0x556c41c19910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27e5468700 1 -- 172.21.15.81:0/1044533723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 msgr2=0x556c41c19910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27e5468700 1 --2- 172.21.15.81:0/1044533723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 0x556c41c19910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27e5468700 1 -- 172.21.15.81:0/1044533723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c25270 msgr2=0x556c41c2ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27e5468700 1 --2- 172.21.15.81:0/1044533723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c25270 0x556c41c2ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27e5468700 1 -- 172.21.15.81:0/1044533723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c41b35500 con 0x556c41c1f480 2024-05-09T00:07:48.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27e4c67700 1 --2- 172.21.15.81:0/1044533723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 0x556c41c19910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27e5468700 1 --2- 172.21.15.81:0/1044533723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c1b320 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f27d00128e0 tx=0x7f27d0009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2832466ed89393f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27cbfff700 1 -- 172.21.15.81:0/1044533723 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0012b00 con 0x556c41c1f480 2024-05-09T00:07:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27cbfff700 1 -- 172.21.15.81:0/1044533723 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27d0012c60 con 0x556c41c1f480 2024-05-09T00:07:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27cbfff700 1 -- 172.21.15.81:0/1044533723 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d0032650 con 0x556c41c1f480 2024-05-09T00:07:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27f3886b80 1 -- 172.21.15.81:0/1044533723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 msgr2=0x556c41c1b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27f3886b80 1 --2- 172.21.15.81:0/1044533723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c1b320 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f27d00128e0 tx=0x7f27d0009f30 comp rx=0 tx=0).stop 2024-05-09T00:07:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27f3886b80 1 -- 172.21.15.81:0/1044533723 shutdown_connections 2024-05-09T00:07:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27f3886b80 1 --2- 172.21.15.81:0/1044533723 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c25270 0x556c41c2ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27f3886b80 1 --2- 172.21.15.81:0/1044533723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c1b320 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27f3886b80 1 --2- 172.21.15.81:0/1044533723 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c24950 0x556c41c19910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.344+0000 7f27f3886b80 1 -- 172.21.15.81:0/1044533723 >> 172.21.15.81:0/1044533723 conn(0x556c41b7d1b0 msgr2=0x556c41c1d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.345+0000 7f27f3886b80 1 -- 172.21.15.81:0/1044533723 shutdown_connections 2024-05-09T00:07:48.346 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.345+0000 7f27f3886b80 1 -- 172.21.15.81:0/1044533723 wait complete. 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.345+0000 7f27f3886b80 1 -- start start 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.345+0000 7f27f3886b80 1 Processor -- start 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.345+0000 7f27f3886b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c2d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.345+0000 7f27f3886b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c24950 0x556c41c2de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.345+0000 7f27f3886b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c25270 0x556c41c2e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27f3886b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c41c8dd80 con 0x556c41c1f480 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27f3886b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c41c8dec0 con 0x556c41c24950 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27f3886b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c41c8e000 con 0x556c41c25270 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27f3886b80 10 client.0 _ll_register_callbacks cb 0x556c41b14ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27e5468700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c2d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27e5468700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c2d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34284/0 (socket says 172.21.15.81:34284) 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27e5468700 1 -- 172.21.15.81:0/2146053534 learned_addr learned my addr 172.21.15.81:0/2146053534 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27e4c67700 1 --2- 172.21.15.81:0/2146053534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c24950 0x556c41c2de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27e5468700 1 -- 172.21.15.81:0/2146053534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c25270 msgr2=0x556c41c2e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:48.347 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27e5468700 1 --2- 172.21.15.81:0/2146053534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c25270 0x556c41c2e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27e5468700 1 -- 172.21.15.81:0/2146053534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c24950 msgr2=0x556c41c2de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27e5468700 1 --2- 172.21.15.81:0/2146053534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c24950 0x556c41c2de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27e5468700 1 -- 172.21.15.81:0/2146053534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c4199cb00 con 0x556c41c1f480 2024-05-09T00:07:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27e4c67700 1 --2- 172.21.15.81:0/2146053534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c24950 0x556c41c2de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27e5468700 1 --2- 172.21.15.81:0/2146053534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c2d930 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f27d0012f50 tx=0x7f27d00126c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18ac2093366d4019 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27c8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27c8ff9700 1 -- 172.21.15.81:0/2146053534 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d00324d0 con 0x556c41c1f480 2024-05-09T00:07:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27c8ff9700 1 -- 172.21.15.81:0/2146053534 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f27d0032630 con 0x556c41c1f480 2024-05-09T00:07:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27f3886b80 1 -- 172.21.15.81:0/2146053534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27dc0a1140 con 0x556c41c1f480 2024-05-09T00:07:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27c8ff9700 1 -- 172.21.15.81:0/2146053534 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27d00327f0 con 0x556c41c1f480 2024-05-09T00:07:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27f3886b80 10 client.16791 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27f3886b80 1 -- 172.21.15.81:0/2146053534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556c419f4c70 con 0x556c41c1f480 2024-05-09T00:07:48.348 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.346+0000 7f27c8ff9700 1 -- 172.21.15.81:0/2146053534 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27d004a020 con 0x556c41c1f480 2024-05-09T00:07:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.347+0000 7f27c8ff9700 1 -- 172.21.15.81:0/2146053534 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f27d003bb60 con 0x556c41c1f480 2024-05-09T00:07:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.347+0000 7f27f3886b80 10 client.16791 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.347+0000 7f27f3886b80 10 client.16791 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.347+0000 7f27f3886b80 20 client.16791 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.347+0000 7f27f3886b80 1 --2- 172.21.15.81:0/2146053534 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c41c8f190 0x556c41c91580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.347+0000 7f27f3886b80 4 client.16791 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:07:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.347+0000 7f27f3886b80 1 -- 172.21.15.81:0/2146053534 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556c41b67e60 con 0x556c41c8f190 2024-05-09T00:07:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.347+0000 7f27e4c67700 1 --2- 172.21.15.81:0/2146053534 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c41c8f190 0x556c41c91580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.347+0000 7f27c8ff9700 10 client.16791 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:48.349 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.347+0000 7f27e4c67700 1 --2- 172.21.15.81:0/2146053534 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c41c8f190 0x556c41c91580 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d794b4b9e97ad963 server_cookie=34dd9a30adf65eb1 in_seq=0 out_seq=0 2024-05-09T00:07:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27c8ff9700 1 -- 172.21.15.81:0/2146053534 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556c41b67e60 con 0x556c41c8f190 2024-05-09T00:07:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27c8ff9700 10 client.16791 handle_command_reply: tid=0 2024-05-09T00:07:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27f3886b80 1 client.16791 shutdown 2024-05-09T00:07:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27f3886b80 1 -- 172.21.15.81:0/2146053534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 msgr2=0x556c41c2d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27f3886b80 1 --2- 172.21.15.81:0/2146053534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c2d930 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f27d0012f50 tx=0x7f27d00126c0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27f3886b80 1 -- 172.21.15.81:0/2146053534 shutdown_connections 2024-05-09T00:07:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27f3886b80 1 --2- 172.21.15.81:0/2146053534 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556c41c8f190 0x556c41c91580 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27f3886b80 1 --2- 172.21.15.81:0/2146053534 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556c41c25270 0x556c41c2e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27f3886b80 1 --2- 172.21.15.81:0/2146053534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556c41c1f480 0x556c41c2d930 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27f3886b80 1 --2- 172.21.15.81:0/2146053534 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556c41c24950 0x556c41c2de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27c8ff9700 0 client.16791 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27f3886b80 1 -- 172.21.15.81:0/2146053534 >> 172.21.15.81:0/2146053534 conn(0x556c41b7d1b0 msgr2=0x556c41c34400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27f3886b80 1 -- 172.21.15.81:0/2146053534 shutdown_connections 2024-05-09T00:07:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27f3886b80 1 -- 172.21.15.81:0/2146053534 wait complete. 2024-05-09T00:07:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27f3886b80 20 client.16791 trim_cache size 0 max 16384 2024-05-09T00:07:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:07:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:07:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:07:48.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:07:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27e76cc700 1 -- 172.21.15.81:0/1216082511 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27cc0a1290 msgr2=0x7f27cc0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27e76cc700 1 --2- 172.21.15.81:0/1216082511 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27cc0a1290 0x7f27cc0a3750 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f27d0006fd0 tx=0x7f27d0008040 comp rx=0 tx=0).stop 2024-05-09T00:07:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27e76cc700 1 -- 172.21.15.81:0/1216082511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e0100c60 msgr2=0x7f27e0196810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27e76cc700 1 --2- 172.21.15.81:0/1216082511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e0100c60 0x7f27e0196810 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f27dc004760 tx=0x7f27dc009f90 comp rx=0 tx=0).stop 2024-05-09T00:07:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27e76cc700 1 -- 172.21.15.81:0/1216082511 shutdown_connections 2024-05-09T00:07:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27e76cc700 1 --2- 172.21.15.81:0/1216082511 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27cc0a1290 0x7f27cc0a3750 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27e76cc700 1 --2- 172.21.15.81:0/1216082511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27e01002a0 0x7f27e01962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.360 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27e76cc700 1 --2- 172.21.15.81:0/1216082511 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27e0105f40 0x7f27e019abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27e76cc700 1 --2- 172.21.15.81:0/1216082511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27e0100c60 0x7f27e0196810 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27e76cc700 1 -- 172.21.15.81:0/1216082511 >> 172.21.15.81:0/1216082511 conn(0x7f27e0076c10 msgr2=0x7f27e00ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27e76cc700 1 -- 172.21.15.81:0/1216082511 shutdown_connections 2024-05-09T00:07:48.361 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:07:48.362+0000 7f27e76cc700 1 -- 172.21.15.81:0/1216082511 wait complete. 2024-05-09T00:07:49.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:49 smithi150 ceph-mon[46187]: pgmap v149: 97 pgs: 97 active+clean; 1.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-05-09T00:07:49.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:49 smithi171 ceph-mon[47351]: pgmap v149: 97 pgs: 97 active+clean; 1.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-05-09T00:07:49.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:49 smithi081 ceph-mon[42474]: pgmap v149: 97 pgs: 97 active+clean; 1.8 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 KiB/s wr, 12 op/s 2024-05-09T00:07:51.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:51 smithi150 ceph-mon[46187]: pgmap v150: 97 pgs: 97 active+clean; 2.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-05-09T00:07:51.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:51 smithi171 ceph-mon[47351]: pgmap v150: 97 pgs: 97 active+clean; 2.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-05-09T00:07:51.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:51 smithi081 ceph-mon[42474]: pgmap v150: 97 pgs: 97 active+clean; 2.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-05-09T00:07:53.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:53 smithi150 ceph-mon[46187]: pgmap v151: 97 pgs: 97 active+clean; 2.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-05-09T00:07:53.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:53 smithi171 ceph-mon[47351]: pgmap v151: 97 pgs: 97 active+clean; 2.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-05-09T00:07:53.370 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:53 smithi081 ceph-mon[42474]: pgmap v151: 97 pgs: 97 active+clean; 2.0 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 29 KiB/s wr, 12 op/s 2024-05-09T00:07:55.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:55 smithi150 ceph-mon[46187]: pgmap v152: 97 pgs: 97 active+clean; 2.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-05-09T00:07:55.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:55 smithi171 ceph-mon[47351]: pgmap v152: 97 pgs: 97 active+clean; 2.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-05-09T00:07:55.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:55 smithi081 ceph-mon[42474]: pgmap v152: 97 pgs: 97 active+clean; 2.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 43 KiB/s wr, 17 op/s 2024-05-09T00:07:57.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:57 smithi150 ceph-mon[46187]: pgmap v153: 97 pgs: 97 active+clean; 2.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:57.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:57 smithi171 ceph-mon[47351]: pgmap v153: 97 pgs: 97 active+clean; 2.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:57.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:57 smithi081 ceph-mon[42474]: pgmap v153: 97 pgs: 97 active+clean; 2.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:58.756 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:07:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.898+0000 7f64e1ebb700 1 -- 172.21.15.81:0/822969494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc106290 msgr2=0x7f64dc10de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.898+0000 7f64e1ebb700 1 --2- 172.21.15.81:0/822969494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc106290 0x7f64dc10de10 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f64d400b0d0 tx=0x7f64d400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.898+0000 7f64e1ebb700 1 -- 172.21.15.81:0/822969494 shutdown_connections 2024-05-09T00:07:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.898+0000 7f64e1ebb700 1 --2- 172.21.15.81:0/822969494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64dc0694e0 0x7f64dc0698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.898+0000 7f64e1ebb700 1 --2- 172.21.15.81:0/822969494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc106290 0x7f64dc10de10 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.898+0000 7f64e1ebb700 1 --2- 172.21.15.81:0/822969494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64dc069e90 0x7f64dc105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.898+0000 7f64e1ebb700 1 -- 172.21.15.81:0/822969494 >> 172.21.15.81:0/822969494 conn(0x7f64dc076f30 msgr2=0x7f64dc077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.898+0000 7f64e1ebb700 1 -- 172.21.15.81:0/822969494 shutdown_connections 2024-05-09T00:07:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.898+0000 7f64e1ebb700 1 -- 172.21.15.81:0/822969494 wait complete. 2024-05-09T00:07:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.899+0000 7f64e1ebb700 1 Processor -- start 2024-05-09T00:07:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.899+0000 7f64e1ebb700 1 -- start start 2024-05-09T00:07:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.899+0000 7f64e1ebb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc0694e0 0x7f64dc197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.899+0000 7f64e1ebb700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64dc106290 0x7f64dc197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.899+0000 7f64e1ebb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64dc19be30 0x7f64dc19c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.899+0000 7f64e1ebb700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc19c8b0 con 0x7f64dc0694e0 2024-05-09T00:07:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.899+0000 7f64e1ebb700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc19ca20 con 0x7f64dc106290 2024-05-09T00:07:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.899+0000 7f64e1ebb700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc19cbe0 con 0x7f64dc19be30 2024-05-09T00:07:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64db7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc0694e0 0x7f64dc197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64db7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc0694e0 0x7f64dc197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43796/0 (socket says 172.21.15.81:43796) 2024-05-09T00:07:58.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64db7fe700 1 -- 172.21.15.81:0/1720912251 learned_addr learned my addr 172.21.15.81:0/1720912251 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:58.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64daffd700 1 --2- 172.21.15.81:0/1720912251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64dc106290 0x7f64dc197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64db7fe700 1 -- 172.21.15.81:0/1720912251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64dc19be30 msgr2=0x7f64dc19c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:58.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64db7fe700 1 --2- 172.21.15.81:0/1720912251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64dc19be30 0x7f64dc19c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64db7fe700 1 -- 172.21.15.81:0/1720912251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64dc106290 msgr2=0x7f64dc197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:58.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64db7fe700 1 --2- 172.21.15.81:0/1720912251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64dc106290 0x7f64dc197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64db7fe700 1 -- 172.21.15.81:0/1720912251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d4009d00 con 0x7f64dc0694e0 2024-05-09T00:07:58.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64daffd700 1 --2- 172.21.15.81:0/1720912251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64dc106290 0x7f64dc197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:58.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64db7fe700 1 --2- 172.21.15.81:0/1720912251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc0694e0 0x7f64dc197550 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f64d000d950 tx=0x7f64d000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:58.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64d8ff9700 1 -- 172.21.15.81:0/1720912251 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0009b40 con 0x7f64dc0694e0 2024-05-09T00:07:58.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64d8ff9700 1 -- 172.21.15.81:0/1720912251 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64d0009ca0 con 0x7f64dc0694e0 2024-05-09T00:07:58.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64d8ff9700 1 -- 172.21.15.81:0/1720912251 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000f620 con 0x7f64dc0694e0 2024-05-09T00:07:58.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64e1ebb700 1 -- 172.21.15.81:0/1720912251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64dc1a4140 con 0x7f64dc0694e0 2024-05-09T00:07:58.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.900+0000 7f64e1ebb700 1 -- 172.21.15.81:0/1720912251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc1a4620 con 0x7f64dc0694e0 2024-05-09T00:07:58.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.902+0000 7f64d8ff9700 1 -- 172.21.15.81:0/1720912251 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f64d0010460 con 0x7f64dc0694e0 2024-05-09T00:07:58.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.903+0000 7f64d8ff9700 1 --2- 172.21.15.81:0/1720912251 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f64c40a1310 0x7f64c40a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.903+0000 7f64daffd700 1 --2- 172.21.15.81:0/1720912251 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f64c40a1310 0x7f64c40a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.903+0000 7f64d8ff9700 1 -- 172.21.15.81:0/1720912251 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f64d00cd000 con 0x7f64dc0694e0 2024-05-09T00:07:58.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.903+0000 7f64daffd700 1 --2- 172.21.15.81:0/1720912251 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f64c40a1310 0x7f64c40a37d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f64cc005e90 tx=0x7f64cc005d20 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:58.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64ee075b80 1 Processor -- start 2024-05-09T00:07:58.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64ee075b80 1 -- start start 2024-05-09T00:07:58.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64ee075b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0354e00 0x5648f03551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64ee075b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f0355720 0x5648f034f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64ee075b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f034f890 0x5648f034fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64ee075b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f02a6150 con 0x5648f034f890 2024-05-09T00:07:58.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64ee075b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f02a3b10 con 0x5648f0355720 2024-05-09T00:07:58.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64ee075b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f029f400 con 0x5648f0354e00 2024-05-09T00:07:58.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f034f890 0x5648f034fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f034f890 0x5648f034fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43808/0 (socket says 172.21.15.81:43808) 2024-05-09T00:07:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64dbfff700 1 -- 172.21.15.81:0/3985893099 learned_addr learned my addr 172.21.15.81:0/3985893099 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64db7fe700 1 --2- 172.21.15.81:0/3985893099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0354e00 0x5648f03551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64daffd700 1 --2- 172.21.15.81:0/3985893099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f0355720 0x5648f034f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64dbfff700 1 -- 172.21.15.81:0/3985893099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0354e00 msgr2=0x5648f03551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64dbfff700 1 --2- 172.21.15.81:0/3985893099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0354e00 0x5648f03551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64dbfff700 1 -- 172.21.15.81:0/3985893099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f0355720 msgr2=0x5648f034f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64dbfff700 1 --2- 172.21.15.81:0/3985893099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f0355720 0x5648f034f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64dbfff700 1 -- 172.21.15.81:0/3985893099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648f01203b0 con 0x5648f034f890 2024-05-09T00:07:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64db7fe700 1 --2- 172.21.15.81:0/3985893099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0354e00 0x5648f03551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.904+0000 7f64daffd700 1 --2- 172.21.15.81:0/3985893099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f0355720 0x5648f034f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.905+0000 7f64dbfff700 1 --2- 172.21.15.81:0/3985893099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f034f890 0x5648f034fcd0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009c60 tx=0x7f64d4009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeab21030f5ed439 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.905+0000 7f64c1ffb700 1 -- 172.21.15.81:0/3985893099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400e040 con 0x5648f034f890 2024-05-09T00:07:58.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.905+0000 7f64c1ffb700 1 -- 172.21.15.81:0/3985893099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64d4007b70 con 0x5648f034f890 2024-05-09T00:07:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.905+0000 7f64c1ffb700 1 -- 172.21.15.81:0/3985893099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4007740 con 0x5648f034f890 2024-05-09T00:07:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.905+0000 7f64ee075b80 1 -- 172.21.15.81:0/3985893099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f034f890 msgr2=0x5648f034fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.905+0000 7f64ee075b80 1 --2- 172.21.15.81:0/3985893099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f034f890 0x5648f034fcd0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009c60 tx=0x7f64d4009c90 comp rx=0 tx=0).stop 2024-05-09T00:07:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 -- 172.21.15.81:0/3985893099 shutdown_connections 2024-05-09T00:07:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 --2- 172.21.15.81:0/3985893099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f034f890 0x5648f034fcd0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 --2- 172.21.15.81:0/3985893099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0354e00 0x5648f03551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 --2- 172.21.15.81:0/3985893099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f0355720 0x5648f034f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 -- 172.21.15.81:0/3985893099 >> 172.21.15.81:0/3985893099 conn(0x5648f02ad210 msgr2=0x5648f0349df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 -- 172.21.15.81:0/3985893099 shutdown_connections 2024-05-09T00:07:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 -- 172.21.15.81:0/3985893099 wait complete. 2024-05-09T00:07:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 -- start start 2024-05-09T00:07:58.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 Processor -- start 2024-05-09T00:07:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f034f890 0x5648f0358a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0354e00 0x5648f0358f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0355720 0x5648f03594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f023b560 con 0x5648f0355720 2024-05-09T00:07:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f023b200 con 0x5648f034f890 2024-05-09T00:07:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.906+0000 7f64ee075b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f01226a0 con 0x5648f0354e00 2024-05-09T00:07:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64ee075b80 10 client.0 _ll_register_callbacks cb 0x5648f0244b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0355720 0x5648f03594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0355720 0x5648f03594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43816/0 (socket says 172.21.15.81:43816) 2024-05-09T00:07:58.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64dbfff700 1 -- 172.21.15.81:0/2609556248 learned_addr learned my addr 172.21.15.81:0/2609556248 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64daffd700 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0354e00 0x5648f0358f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64db7fe700 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f034f890 0x5648f0358a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64dbfff700 1 -- 172.21.15.81:0/2609556248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0354e00 msgr2=0x5648f0358f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64dbfff700 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0354e00 0x5648f0358f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64dbfff700 1 -- 172.21.15.81:0/2609556248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f034f890 msgr2=0x5648f0358a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64dbfff700 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f034f890 0x5648f0358a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64dbfff700 1 -- 172.21.15.81:0/2609556248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc10e650 con 0x5648f0355720 2024-05-09T00:07:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64daffd700 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0354e00 0x5648f0358f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:07:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64db7fe700 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f034f890 0x5648f0358a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64dbfff700 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0355720 0x5648f03594c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009a20 tx=0x7f64d4003bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603a8d40c7368118 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64baffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:58.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64baffd700 1 -- 172.21.15.81:0/2609556248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400e070 con 0x5648f0355720 2024-05-09T00:07:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64baffd700 1 -- 172.21.15.81:0/2609556248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f64d40078b0 con 0x5648f0355720 2024-05-09T00:07:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64ee075b80 1 -- 172.21.15.81:0/2609556248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648f01f8270 con 0x5648f0355720 2024-05-09T00:07:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64baffd700 1 -- 172.21.15.81:0/2609556248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64d40050b0 con 0x5648f0355720 2024-05-09T00:07:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64ee075b80 10 client.16803 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.907+0000 7f64ee075b80 1 -- 172.21.15.81:0/2609556248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5648f00ccb60 con 0x5648f0355720 2024-05-09T00:07:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.908+0000 7f64baffd700 1 -- 172.21.15.81:0/2609556248 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5648f01f8270 con 0x5648f0355720 2024-05-09T00:07:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.908+0000 7f64baffd700 1 -- 172.21.15.81:0/2609556248 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f64d4024030 con 0x5648f0355720 2024-05-09T00:07:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.908+0000 7f64ee075b80 10 client.16803 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.908+0000 7f64ee075b80 10 client.16803 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.908+0000 7f64ee075b80 20 client.16803 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.908+0000 7f64ee075b80 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5648f0368d20 0x5648f036b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.908+0000 7f64ee075b80 4 client.16803 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:07:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.908+0000 7f64ee075b80 1 -- 172.21.15.81:0/2609556248 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648f031e810 con 0x5648f0368d20 2024-05-09T00:07:58.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.908+0000 7f64db7fe700 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5648f0368d20 0x5648f036b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.908+0000 7f64baffd700 10 client.16803 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:58.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.908+0000 7f64db7fe700 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5648f0368d20 0x5648f036b110 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=556099cd9ca1fc13 server_cookie=15215c3cadd837f6 in_seq=0 out_seq=0 2024-05-09T00:07:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.909+0000 7f64baffd700 1 -- 172.21.15.81:0/2609556248 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5648f031e810 con 0x5648f0368d20 2024-05-09T00:07:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.909+0000 7f64baffd700 10 client.16803 handle_command_reply: tid=0 2024-05-09T00:07:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.909+0000 7f64ee075b80 1 client.16803 shutdown 2024-05-09T00:07:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.909+0000 7f64ee075b80 1 -- 172.21.15.81:0/2609556248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0355720 msgr2=0x5648f03594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.909+0000 7f64ee075b80 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0355720 0x5648f03594c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009a20 tx=0x7f64d4003bc0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.909+0000 7f64ee075b80 1 -- 172.21.15.81:0/2609556248 shutdown_connections 2024-05-09T00:07:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.909+0000 7f64ee075b80 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5648f0368d20 0x5648f036b110 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.909+0000 7f64ee075b80 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f034f890 0x5648f0358a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.909+0000 7f64baffd700 0 client.16803 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.909+0000 7f64ee075b80 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0355720 0x5648f03594c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.909+0000 7f64ee075b80 1 --2- 172.21.15.81:0/2609556248 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0354e00 0x5648f0358f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.909+0000 7f64ee075b80 1 -- 172.21.15.81:0/2609556248 >> 172.21.15.81:0/2609556248 conn(0x5648f02ad210 msgr2=0x5648f03495a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:58.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.909+0000 7f64ee075b80 1 -- 172.21.15.81:0/2609556248 shutdown_connections 2024-05-09T00:07:58.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.909+0000 7f64ee075b80 1 -- 172.21.15.81:0/2609556248 wait complete. 2024-05-09T00:07:58.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.910+0000 7f64ee075b80 20 client.16803 trim_cache size 0 max 16384 2024-05-09T00:07:58.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64ee075b80 1 Processor -- start 2024-05-09T00:07:58.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64ee075b80 1 -- start start 2024-05-09T00:07:58.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64ee075b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f034f890 0x5648f034f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64ee075b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0354e00 0x5648f0349d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64ee075b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0355720 0x5648f03592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64ee075b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f0344800 con 0x5648f0354e00 2024-05-09T00:07:58.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64ee075b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f0342040 con 0x5648f034f890 2024-05-09T00:07:58.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64ee075b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f034aa60 con 0x5648f0355720 2024-05-09T00:07:58.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64daffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0354e00 0x5648f0349d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64daffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0354e00 0x5648f0349d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43820/0 (socket says 172.21.15.81:43820) 2024-05-09T00:07:58.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64daffd700 1 -- 172.21.15.81:0/524938396 learned_addr learned my addr 172.21.15.81:0/524938396 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:58.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64dbfff700 1 --2- 172.21.15.81:0/524938396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0355720 0x5648f03592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64db7fe700 1 --2- 172.21.15.81:0/524938396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f034f890 0x5648f034f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64daffd700 1 -- 172.21.15.81:0/524938396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0355720 msgr2=0x5648f03592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:58.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64daffd700 1 --2- 172.21.15.81:0/524938396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0355720 0x5648f03592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64daffd700 1 -- 172.21.15.81:0/524938396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f034f890 msgr2=0x5648f034f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:58.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64daffd700 1 --2- 172.21.15.81:0/524938396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f034f890 0x5648f034f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64daffd700 1 -- 172.21.15.81:0/524938396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648f0265560 con 0x5648f0354e00 2024-05-09T00:07:58.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64db7fe700 1 --2- 172.21.15.81:0/524938396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f034f890 0x5648f034f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:58.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.927+0000 7f64daffd700 1 --2- 172.21.15.81:0/524938396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0354e00 0x5648f0349d20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f64dc198aa0 tx=0x7f64cc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66f1424b36ddc15 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.928+0000 7f64c27fc700 1 -- 172.21.15.81:0/524938396 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc011c60 con 0x5648f0354e00 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.928+0000 7f64c27fc700 1 -- 172.21.15.81:0/524938396 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64cc011dc0 con 0x5648f0354e00 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.928+0000 7f64c27fc700 1 -- 172.21.15.81:0/524938396 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc0106c0 con 0x5648f0354e00 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.928+0000 7f64ee075b80 1 -- 172.21.15.81:0/524938396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0354e00 msgr2=0x5648f0349d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.928+0000 7f64ee075b80 1 --2- 172.21.15.81:0/524938396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0354e00 0x5648f0349d20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f64dc198aa0 tx=0x7f64cc011000 comp rx=0 tx=0).stop 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.928+0000 7f64ee075b80 1 -- 172.21.15.81:0/524938396 shutdown_connections 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.928+0000 7f64ee075b80 1 --2- 172.21.15.81:0/524938396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f034f890 0x5648f034f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.928+0000 7f64ee075b80 1 --2- 172.21.15.81:0/524938396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f0355720 0x5648f03592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.928+0000 7f64ee075b80 1 --2- 172.21.15.81:0/524938396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0354e00 0x5648f0349d20 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.928+0000 7f64ee075b80 1 -- 172.21.15.81:0/524938396 >> 172.21.15.81:0/524938396 conn(0x5648f02ad210 msgr2=0x5648f0353b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.928+0000 7f64ee075b80 1 -- 172.21.15.81:0/524938396 shutdown_connections 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.928+0000 7f64ee075b80 1 -- 172.21.15.81:0/524938396 wait complete. 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.929+0000 7f64ee075b80 1 -- start start 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.929+0000 7f64ee075b80 1 Processor -- start 2024-05-09T00:07:58.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.929+0000 7f64ee075b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f034f890 0x5648f035c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.929+0000 7f64ee075b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f0354e00 0x5648f035c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.929+0000 7f64ee075b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0355720 0x5648f03be1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.929+0000 7f64ee075b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f035cf00 con 0x5648f0355720 2024-05-09T00:07:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.929+0000 7f64ee075b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f03be700 con 0x5648f0354e00 2024-05-09T00:07:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.929+0000 7f64ee075b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648f03be840 con 0x5648f034f890 2024-05-09T00:07:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.929+0000 7f64ee075b80 10 client.0 _ll_register_callbacks cb 0x5648f0244b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.929+0000 7f64dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0355720 0x5648f03be1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.929+0000 7f64dbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0355720 0x5648f03be1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43826/0 (socket says 172.21.15.81:43826) 2024-05-09T00:07:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.929+0000 7f64dbfff700 1 -- 172.21.15.81:0/710630901 learned_addr learned my addr 172.21.15.81:0/710630901 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64daffd700 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f0354e00 0x5648f035c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64db7fe700 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f034f890 0x5648f035c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64dbfff700 1 -- 172.21.15.81:0/710630901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f034f890 msgr2=0x5648f035c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64dbfff700 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f034f890 0x5648f035c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64dbfff700 1 -- 172.21.15.81:0/710630901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f0354e00 msgr2=0x5648f035c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:58.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64dbfff700 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f0354e00 0x5648f035c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64dbfff700 1 -- 172.21.15.81:0/710630901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64cc00e9f0 con 0x5648f0355720 2024-05-09T00:07:58.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64daffd700 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f0354e00 0x5648f035c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:58.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64db7fe700 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f034f890 0x5648f035c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:58.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64dbfff700 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0355720 0x5648f03be1c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009fd0 tx=0x7f64d4009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad6076fe7b0bcc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:58.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64baffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:58.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64baffd700 1 -- 172.21.15.81:0/710630901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400e070 con 0x5648f0355720 2024-05-09T00:07:58.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64baffd700 1 -- 172.21.15.81:0/710630901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f64d400b7e0 con 0x5648f0355720 2024-05-09T00:07:58.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64ee075b80 1 -- 172.21.15.81:0/710630901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f64d4007b70 con 0x5648f0355720 2024-05-09T00:07:58.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64baffd700 1 -- 172.21.15.81:0/710630901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64d40050c0 con 0x5648f0355720 2024-05-09T00:07:58.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64ee075b80 10 client.16809 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:58.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64ee075b80 1 -- 172.21.15.81:0/710630901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5648f0124cd0 con 0x5648f0355720 2024-05-09T00:07:58.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64baffd700 1 -- 172.21.15.81:0/710630901 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f64d4007b70 con 0x5648f0355720 2024-05-09T00:07:58.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64baffd700 1 -- 172.21.15.81:0/710630901 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f64d4024070 con 0x5648f0355720 2024-05-09T00:07:58.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64ee075b80 10 client.16809 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:58.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64ee075b80 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:58.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64ee075b80 20 client.16809 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64ee075b80 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5648f03bfb30 0x5648f03c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64ee075b80 4 client.16809 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:07:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.930+0000 7f64ee075b80 1 -- 172.21.15.81:0/710630901 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5648f0297ec0 con 0x5648f03bfb30 2024-05-09T00:07:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64db7fe700 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5648f03bfb30 0x5648f03c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64db7fe700 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5648f03bfb30 0x5648f03c1f50 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a1141a3bd94f655 server_cookie=e32e59836337a408 in_seq=0 out_seq=0 2024-05-09T00:07:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64baffd700 10 client.16809 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64baffd700 1 -- 172.21.15.81:0/710630901 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5648f0297ec0 con 0x5648f03bfb30 2024-05-09T00:07:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64baffd700 10 client.16809 handle_command_reply: tid=0 2024-05-09T00:07:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64ee075b80 1 client.16809 shutdown 2024-05-09T00:07:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64ee075b80 1 -- 172.21.15.81:0/710630901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0355720 msgr2=0x5648f03be1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64ee075b80 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0355720 0x5648f03be1c0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f64d4009fd0 tx=0x7f64d4009540 comp rx=0 tx=0).stop 2024-05-09T00:07:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64ee075b80 1 -- 172.21.15.81:0/710630901 shutdown_connections 2024-05-09T00:07:58.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64ee075b80 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5648f03bfb30 0x5648f03c1f50 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64ee075b80 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5648f0355720 0x5648f03be1c0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64ee075b80 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5648f034f890 0x5648f035c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64baffd700 0 client.16809 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:58.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64ee075b80 1 --2- 172.21.15.81:0/710630901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5648f0354e00 0x5648f035c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.931+0000 7f64ee075b80 1 -- 172.21.15.81:0/710630901 >> 172.21.15.81:0/710630901 conn(0x5648f02ad210 msgr2=0x5648f03543c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:58.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64ee075b80 1 -- 172.21.15.81:0/710630901 shutdown_connections 2024-05-09T00:07:58.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64ee075b80 1 -- 172.21.15.81:0/710630901 wait complete. 2024-05-09T00:07:58.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64ee075b80 20 client.16809 trim_cache size 0 max 16384 2024-05-09T00:07:58.936 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:07:58.936 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:07:58.937 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:07:58.937 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:07:58.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64e1ebb700 1 -- 172.21.15.81:0/1720912251 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f64c40a1310 msgr2=0x7f64c40a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:58.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64e1ebb700 1 --2- 172.21.15.81:0/1720912251 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f64c40a1310 0x7f64c40a37d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f64cc005e90 tx=0x7f64cc005d20 comp rx=0 tx=0).stop 2024-05-09T00:07:58.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64e1ebb700 1 -- 172.21.15.81:0/1720912251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc0694e0 msgr2=0x7f64dc197550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64e1ebb700 1 --2- 172.21.15.81:0/1720912251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc0694e0 0x7f64dc197550 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f64d000d950 tx=0x7f64d000dd10 comp rx=0 tx=0).stop 2024-05-09T00:07:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64e1ebb700 1 -- 172.21.15.81:0/1720912251 shutdown_connections 2024-05-09T00:07:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64e1ebb700 1 --2- 172.21.15.81:0/1720912251 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f64c40a1310 0x7f64c40a37d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64e1ebb700 1 --2- 172.21.15.81:0/1720912251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f64dc19be30 0x7f64dc19c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64e1ebb700 1 --2- 172.21.15.81:0/1720912251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64dc0694e0 0x7f64dc197550 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64e1ebb700 1 --2- 172.21.15.81:0/1720912251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f64dc106290 0x7f64dc197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64e1ebb700 1 -- 172.21.15.81:0/1720912251 >> 172.21.15.81:0/1720912251 conn(0x7f64dc076f30 msgr2=0x7f64dc0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64e1ebb700 1 -- 172.21.15.81:0/1720912251 shutdown_connections 2024-05-09T00:07:58.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:58.932+0000 7f64e1ebb700 1 -- 172.21.15.81:0/1720912251 wait complete. 2024-05-09T00:07:58.940 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:07:58.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:07:59.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.069+0000 7f6b846f3700 1 -- 172.21.15.81:0/4224589661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c10b3c0 msgr2=0x7f6b7c10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.069+0000 7f6b846f3700 1 --2- 172.21.15.81:0/4224589661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c10b3c0 0x7f6b7c10d880 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400b0a0 tx=0x7f6b7400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.069+0000 7f6b846f3700 1 -- 172.21.15.81:0/4224589661 shutdown_connections 2024-05-09T00:07:59.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.069+0000 7f6b846f3700 1 --2- 172.21.15.81:0/4224589661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b7c101fa0 0x7f6b7c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.069+0000 7f6b846f3700 1 --2- 172.21.15.81:0/4224589661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c10b3c0 0x7f6b7c10d880 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.069+0000 7f6b846f3700 1 --2- 172.21.15.81:0/4224589661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b7c1028c0 0x7f6b7c10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.069+0000 7f6b846f3700 1 -- 172.21.15.81:0/4224589661 >> 172.21.15.81:0/4224589661 conn(0x7f6b7c0fb7e0 msgr2=0x7f6b7c0fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.069+0000 7f6b846f3700 1 -- 172.21.15.81:0/4224589661 shutdown_connections 2024-05-09T00:07:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.069+0000 7f6b846f3700 1 -- 172.21.15.81:0/4224589661 wait complete. 2024-05-09T00:07:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.069+0000 7f6b846f3700 1 Processor -- start 2024-05-09T00:07:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.069+0000 7f6b846f3700 1 -- start start 2024-05-09T00:07:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b846f3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b7c101fa0 0x7f6b7c0ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b846f3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c1028c0 0x7f6b7c100130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b846f3700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b7c10b3c0 0x7f6b7c100670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b846f3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c1a57d0 con 0x7f6b7c1028c0 2024-05-09T00:07:59.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b846f3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c1a5940 con 0x7f6b7c101fa0 2024-05-09T00:07:59.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b846f3700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c1a5b00 con 0x7f6b7c10b3c0 2024-05-09T00:07:59.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b81c8e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c1028c0 0x7f6b7c100130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b81c8e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c1028c0 0x7f6b7c100130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43840/0 (socket says 172.21.15.81:43840) 2024-05-09T00:07:59.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b81c8e700 1 -- 172.21.15.81:0/1353027784 learned_addr learned my addr 172.21.15.81:0/1353027784 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b82c90700 1 --2- 172.21.15.81:0/1353027784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b7c10b3c0 0x7f6b7c100670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b81c8e700 1 -- 172.21.15.81:0/1353027784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b7c10b3c0 msgr2=0x7f6b7c100670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b8248f700 1 --2- 172.21.15.81:0/1353027784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b7c101fa0 0x7f6b7c0ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b81c8e700 1 --2- 172.21.15.81:0/1353027784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b7c10b3c0 0x7f6b7c100670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b81c8e700 1 -- 172.21.15.81:0/1353027784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b7c101fa0 msgr2=0x7f6b7c0ffbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b81c8e700 1 --2- 172.21.15.81:0/1353027784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b7c101fa0 0x7f6b7c0ffbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b81c8e700 1 -- 172.21.15.81:0/1353027784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b74009d00 con 0x7f6b7c1028c0 2024-05-09T00:07:59.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b81c8e700 1 --2- 172.21.15.81:0/1353027784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c1028c0 0x7f6b7c100130 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00d950 tx=0x7f6b6c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b737fe700 1 -- 172.21.15.81:0/1353027784 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c009930 con 0x7f6b7c1028c0 2024-05-09T00:07:59.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b846f3700 1 -- 172.21.15.81:0/1353027784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7c1a5de0 con 0x7f6b7c1028c0 2024-05-09T00:07:59.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b737fe700 1 -- 172.21.15.81:0/1353027784 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b6c010460 con 0x7f6b7c1028c0 2024-05-09T00:07:59.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b737fe700 1 -- 172.21.15.81:0/1353027784 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c00f620 con 0x7f6b7c1028c0 2024-05-09T00:07:59.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.070+0000 7f6b846f3700 1 -- 172.21.15.81:0/1353027784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7c1a6270 con 0x7f6b7c1028c0 2024-05-09T00:07:59.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.071+0000 7f6b846f3700 1 -- 172.21.15.81:0/1353027784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7c1064a0 con 0x7f6b7c1028c0 2024-05-09T00:07:59.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.072+0000 7f6b737fe700 1 -- 172.21.15.81:0/1353027784 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6b6c010860 con 0x7f6b7c1028c0 2024-05-09T00:07:59.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.073+0000 7f6b737fe700 1 --2- 172.21.15.81:0/1353027784 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6b680a1290 0x7f6b680a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.073+0000 7f6b8248f700 1 --2- 172.21.15.81:0/1353027784 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6b680a1290 0x7f6b680a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.073+0000 7f6b737fe700 1 -- 172.21.15.81:0/1353027784 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f6b6c0ccb70 con 0x7f6b7c1028c0 2024-05-09T00:07:59.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.074+0000 7f6b8248f700 1 --2- 172.21.15.81:0/1353027784 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6b680a1290 0x7f6b680a3750 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6b78005950 tx=0x7f6b78005cf0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.078+0000 7f6b737fe700 1 -- 172.21.15.81:0/1353027784 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6b6c095f80 con 0x7f6b7c1028c0 2024-05-09T00:07:59.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:07:59 smithi081 ceph-mon[42474]: pgmap v154: 97 pgs: 97 active+clean; 2.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:59.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:07:59 smithi150 ceph-mon[46187]: pgmap v154: 97 pgs: 97 active+clean; 2.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:59.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:07:59 smithi171 ceph-mon[47351]: pgmap v154: 97 pgs: 97 active+clean; 2.2 MiB data, 397 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 30 KiB/s wr, 12 op/s 2024-05-09T00:07:59.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.321+0000 7f6b846f3700 1 -- 172.21.15.81:0/1353027784 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b7c0688d0 con 0x7f6b7c1028c0 2024-05-09T00:07:59.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.322+0000 7f6b737fe700 1 -- 172.21.15.81:0/1353027784 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7f6b6c016090 con 0x7f6b7c1028c0 2024-05-09T00:07:59.319 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:07:59.319 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:07:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.325+0000 7f6b846f3700 1 -- 172.21.15.81:0/1353027784 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6b680a1290 msgr2=0x7f6b680a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.325+0000 7f6b846f3700 1 --2- 172.21.15.81:0/1353027784 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6b680a1290 0x7f6b680a3750 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6b78005950 tx=0x7f6b78005cf0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.325+0000 7f6b846f3700 1 -- 172.21.15.81:0/1353027784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c1028c0 msgr2=0x7f6b7c100130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.325+0000 7f6b846f3700 1 --2- 172.21.15.81:0/1353027784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c1028c0 0x7f6b7c100130 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00d950 tx=0x7f6b6c00dd10 comp rx=0 tx=0).stop 2024-05-09T00:07:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.325+0000 7f6b846f3700 1 -- 172.21.15.81:0/1353027784 shutdown_connections 2024-05-09T00:07:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.325+0000 7f6b846f3700 1 --2- 172.21.15.81:0/1353027784 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6b680a1290 0x7f6b680a3750 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.325+0000 7f6b846f3700 1 --2- 172.21.15.81:0/1353027784 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6b7c101fa0 0x7f6b7c0ffbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.325+0000 7f6b846f3700 1 --2- 172.21.15.81:0/1353027784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6b7c10b3c0 0x7f6b7c100670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.325+0000 7f6b846f3700 1 --2- 172.21.15.81:0/1353027784 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b7c1028c0 0x7f6b7c100130 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.325+0000 7f6b846f3700 1 -- 172.21.15.81:0/1353027784 >> 172.21.15.81:0/1353027784 conn(0x7f6b7c0fb7e0 msgr2=0x7f6b7c0fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.325+0000 7f6b846f3700 1 -- 172.21.15.81:0/1353027784 shutdown_connections 2024-05-09T00:07:59.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.325+0000 7f6b846f3700 1 -- 172.21.15.81:0/1353027784 wait complete. 2024-05-09T00:07:59.322 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:07:59.336 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:07:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.462+0000 7fb5a1711700 1 -- 172.21.15.81:0/1812967138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb59c100a10 msgr2=0x7fb59c104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.462+0000 7fb5a1711700 1 --2- 172.21.15.81:0/1812967138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb59c100a10 0x7fb59c104a40 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb590009990 tx=0x7fb590009ca0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.462+0000 7fb5a1711700 1 -- 172.21.15.81:0/1812967138 shutdown_connections 2024-05-09T00:07:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.462+0000 7fb5a1711700 1 --2- 172.21.15.81:0/1812967138 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c100060 0x7fb59c100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.462+0000 7fb5a1711700 1 --2- 172.21.15.81:0/1812967138 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb59c105170 0x7fb59c10ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.462+0000 7fb5a1711700 1 --2- 172.21.15.81:0/1812967138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb59c100a10 0x7fb59c104a40 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.462+0000 7fb5a1711700 1 -- 172.21.15.81:0/1812967138 >> 172.21.15.81:0/1812967138 conn(0x7fb59c076fa0 msgr2=0x7fb59c0773b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.462+0000 7fb5a1711700 1 -- 172.21.15.81:0/1812967138 shutdown_connections 2024-05-09T00:07:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.462+0000 7fb5a1711700 1 -- 172.21.15.81:0/1812967138 wait complete. 2024-05-09T00:07:59.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.463+0000 7fb5a1711700 1 Processor -- start 2024-05-09T00:07:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.463+0000 7fb5a1711700 1 -- start start 2024-05-09T00:07:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.463+0000 7fb5a1711700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c100060 0x7fb59c101ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.463+0000 7fb5a1711700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb59c105170 0x7fb59c102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.463+0000 7fb5a1711700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb59c102560 0x7fb59c1a5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.463+0000 7fb5a1711700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c1a5bf0 con 0x7fb59c102560 2024-05-09T00:07:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.463+0000 7fb5a1711700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c1a5d30 con 0x7fb59c100060 2024-05-09T00:07:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.463+0000 7fb5a1711700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c1a5ef0 con 0x7fb59c105170 2024-05-09T00:07:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.463+0000 7fb59b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb59c102560 0x7fb59c1a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.463+0000 7fb59b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb59c102560 0x7fb59c1a5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43866/0 (socket says 172.21.15.81:43866) 2024-05-09T00:07:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.463+0000 7fb59b7fe700 1 -- 172.21.15.81:0/366535316 learned_addr learned my addr 172.21.15.81:0/366535316 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb59affd700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c100060 0x7fb59c101ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb59a7fc700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb59c105170 0x7fb59c102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb59b7fe700 1 -- 172.21.15.81:0/366535316 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb59c105170 msgr2=0x7fb59c102020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb59b7fe700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb59c105170 0x7fb59c102020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb59b7fe700 1 -- 172.21.15.81:0/366535316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c100060 msgr2=0x7fb59c101ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb59b7fe700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c100060 0x7fb59c101ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb59b7fe700 1 -- 172.21.15.81:0/366535316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5900095f0 con 0x7fb59c102560 2024-05-09T00:07:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb59a7fc700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb59c105170 0x7fb59c102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb59affd700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c100060 0x7fb59c101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb59b7fe700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb59c102560 0x7fb59c1a5620 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb59400b9e0 tx=0x7fb59400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb583fff700 1 -- 172.21.15.81:0/366535316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59400c950 con 0x7fb59c102560 2024-05-09T00:07:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb583fff700 1 -- 172.21.15.81:0/366535316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb594014440 con 0x7fb59c102560 2024-05-09T00:07:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb5a1711700 1 -- 172.21.15.81:0/366535316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59c1a61d0 con 0x7fb59c102560 2024-05-09T00:07:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb583fff700 1 -- 172.21.15.81:0/366535316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5940075d0 con 0x7fb59c102560 2024-05-09T00:07:59.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.464+0000 7fb5a1711700 1 -- 172.21.15.81:0/366535316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59c1a6690 con 0x7fb59c102560 2024-05-09T00:07:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.466+0000 7fb583fff700 1 -- 172.21.15.81:0/366535316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fb5940145b0 con 0x7fb59c102560 2024-05-09T00:07:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.467+0000 7fb583fff700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb5840a1290 0x7fb5840a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.467+0000 7fb583fff700 1 -- 172.21.15.81:0/366535316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb594006e40 con 0x7fb59c102560 2024-05-09T00:07:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.467+0000 7fb59affd700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb5840a1290 0x7fb5840a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.467+0000 7fb59affd700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb5840a1290 0x7fb5840a3750 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb58c005fd0 tx=0x7fb58c005ee0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb5ad8cbb80 1 Processor -- start 2024-05-09T00:07:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb5ad8cbb80 1 -- start start 2024-05-09T00:07:59.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb5ad8cbb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d05ee00 0x55fb9d05f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb5ad8cbb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05f720 0x55fb9d059350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb5ad8cbb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d059890 0x55fb9d059cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb5ad8cbb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9cfb0150 con 0x55fb9d05f720 2024-05-09T00:07:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb5ad8cbb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9cfadb10 con 0x55fb9d05ee00 2024-05-09T00:07:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb5ad8cbb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9cfa9400 con 0x55fb9d059890 2024-05-09T00:07:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb59a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05f720 0x55fb9d059350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb59a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05f720 0x55fb9d059350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43878/0 (socket says 172.21.15.81:43878) 2024-05-09T00:07:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb59a7fc700 1 -- 172.21.15.81:0/3654294019 learned_addr learned my addr 172.21.15.81:0/3654294019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb59a7fc700 1 -- 172.21.15.81:0/3654294019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d059890 msgr2=0x55fb9d059cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:07:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb59a7fc700 1 --2- 172.21.15.81:0/3654294019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d059890 0x55fb9d059cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb59a7fc700 1 -- 172.21.15.81:0/3654294019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d05ee00 msgr2=0x55fb9d05f1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:07:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb59a7fc700 1 --2- 172.21.15.81:0/3654294019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d05ee00 0x55fb9d05f1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb59a7fc700 1 -- 172.21.15.81:0/3654294019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb9ce2a3b0 con 0x55fb9d05f720 2024-05-09T00:07:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb59a7fc700 1 --2- 172.21.15.81:0/3654294019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05f720 0x55fb9d059350 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb590009510 tx=0x7fb590009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1679b457c6778225 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.468+0000 7fb5817fa700 1 -- 172.21.15.81:0/3654294019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590005230 con 0x55fb9d05f720 2024-05-09T00:07:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.469+0000 7fb5817fa700 1 -- 172.21.15.81:0/3654294019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb59001d040 con 0x55fb9d05f720 2024-05-09T00:07:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.469+0000 7fb5817fa700 1 -- 172.21.15.81:0/3654294019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590004760 con 0x55fb9d05f720 2024-05-09T00:07:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.469+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/3654294019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05f720 msgr2=0x55fb9d059350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.469+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/3654294019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05f720 0x55fb9d059350 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb590009510 tx=0x7fb590009540 comp rx=0 tx=0).stop 2024-05-09T00:07:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.469+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/3654294019 shutdown_connections 2024-05-09T00:07:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.469+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/3654294019 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d05ee00 0x55fb9d05f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.469+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/3654294019 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d059890 0x55fb9d059cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.469+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/3654294019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05f720 0x55fb9d059350 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.469+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/3654294019 >> 172.21.15.81:0/3654294019 conn(0x55fb9cfb7210 msgr2=0x55fb9d053df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.469+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/3654294019 shutdown_connections 2024-05-09T00:07:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.469+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/3654294019 wait complete. 2024-05-09T00:07:59.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb5ad8cbb80 1 -- start start 2024-05-09T00:07:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb5ad8cbb80 1 Processor -- start 2024-05-09T00:07:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb5ad8cbb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d059890 0x55fb9d062bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb5ad8cbb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d0630f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb5ad8cbb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d05f720 0x55fb9d063630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb5ad8cbb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9cf45560 con 0x55fb9d05ee00 2024-05-09T00:07:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb5ad8cbb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9cf45200 con 0x55fb9d059890 2024-05-09T00:07:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb5ad8cbb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9ce2c6a0 con 0x55fb9d05f720 2024-05-09T00:07:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb5ad8cbb80 10 client.0 _ll_register_callbacks cb 0x55fb9cf4eb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb59a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d0630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb59a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d0630f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43892/0 (socket says 172.21.15.81:43892) 2024-05-09T00:07:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb59a7fc700 1 -- 172.21.15.81:0/666190948 learned_addr learned my addr 172.21.15.81:0/666190948 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb59a7fc700 1 -- 172.21.15.81:0/666190948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d05f720 msgr2=0x55fb9d063630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb59a7fc700 1 --2- 172.21.15.81:0/666190948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d05f720 0x55fb9d063630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb59a7fc700 1 -- 172.21.15.81:0/666190948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d059890 msgr2=0x55fb9d062bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb59a7fc700 1 --2- 172.21.15.81:0/666190948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d059890 0x55fb9d062bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.470+0000 7fb59a7fc700 1 -- 172.21.15.81:0/666190948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59c10d560 con 0x55fb9d05ee00 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb59a7fc700 1 --2- 172.21.15.81:0/666190948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d0630f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb590009ce0 tx=0x7fb59000bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718488f52266b281 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb57eff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb57eff5700 1 -- 172.21.15.81:0/666190948 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590005600 con 0x55fb9d05ee00 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb57eff5700 1 -- 172.21.15.81:0/666190948 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb590004500 con 0x55fb9d05ee00 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/666190948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb9cf02270 con 0x55fb9d05ee00 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb57eff5700 1 -- 172.21.15.81:0/666190948 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5900046c0 con 0x55fb9d05ee00 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb5ad8cbb80 10 client.16827 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/666190948 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fb9cdd6b60 con 0x55fb9d05ee00 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb57eff5700 1 -- 172.21.15.81:0/666190948 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fb9cf02270 con 0x55fb9d05ee00 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb57eff5700 1 -- 172.21.15.81:0/666190948 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb590020070 con 0x55fb9d05ee00 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb5ad8cbb80 10 client.16827 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:59.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb5ad8cbb80 10 client.16827 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:07:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb5ad8cbb80 20 client.16827 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/666190948 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55fb9d072e50 0x55fb9d075270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb5ad8cbb80 4 client.16827 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:07:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.471+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/666190948 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb9d028810 con 0x55fb9d072e50 2024-05-09T00:07:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.472+0000 7fb59affd700 1 --2- 172.21.15.81:0/666190948 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55fb9d072e50 0x55fb9d075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.473+0000 7fb59affd700 1 --2- 172.21.15.81:0/666190948 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55fb9d072e50 0x55fb9d075270 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=50cf580ff600fe1d server_cookie=75deb8bf0aece55c in_seq=0 out_seq=0 2024-05-09T00:07:59.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.473+0000 7fb57eff5700 10 client.16827 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:07:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb57eff5700 1 -- 172.21.15.81:0/666190948 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fb9d028810 con 0x55fb9d072e50 2024-05-09T00:07:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb57eff5700 10 client.16827 handle_command_reply: tid=0 2024-05-09T00:07:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb5ad8cbb80 1 client.16827 shutdown 2024-05-09T00:07:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/666190948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 msgr2=0x55fb9d0630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/666190948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d0630f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb590009ce0 tx=0x7fb59000bfa0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/666190948 shutdown_connections 2024-05-09T00:07:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/666190948 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55fb9d072e50 0x55fb9d075270 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/666190948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d059890 0x55fb9d062bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb57eff5700 0 client.16827 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:07:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/666190948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d05f720 0x55fb9d063630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/666190948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d0630f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/666190948 >> 172.21.15.81:0/666190948 conn(0x55fb9cfb7210 msgr2=0x55fb9d0535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/666190948 shutdown_connections 2024-05-09T00:07:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/666190948 wait complete. 2024-05-09T00:07:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.475+0000 7fb5ad8cbb80 20 client.16827 trim_cache size 0 max 16384 2024-05-09T00:07:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.487+0000 7fb5ad8cbb80 1 Processor -- start 2024-05-09T00:07:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.487+0000 7fb5ad8cbb80 1 -- start start 2024-05-09T00:07:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.487+0000 7fb5ad8cbb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d059890 0x55fb9d05f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.487+0000 7fb5ad8cbb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d06ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.487+0000 7fb5ad8cbb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d05f720 0x55fb9d053d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.487+0000 7fb5ad8cbb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9d0596f0 con 0x55fb9d05ee00 2024-05-09T00:07:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.487+0000 7fb5ad8cbb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9d054e80 con 0x55fb9d05f720 2024-05-09T00:07:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.487+0000 7fb5ad8cbb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9d055070 con 0x55fb9d059890 2024-05-09T00:07:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.487+0000 7fb59a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d06ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.487+0000 7fb59a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d06ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43896/0 (socket says 172.21.15.81:43896) 2024-05-09T00:07:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.487+0000 7fb59a7fc700 1 -- 172.21.15.81:0/1278388612 learned_addr learned my addr 172.21.15.81:0/1278388612 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.488+0000 7fb59b7fe700 1 --2- 172.21.15.81:0/1278388612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d05f720 0x55fb9d053d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.488+0000 7fb59affd700 1 --2- 172.21.15.81:0/1278388612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d059890 0x55fb9d05f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.488+0000 7fb59a7fc700 1 -- 172.21.15.81:0/1278388612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d059890 msgr2=0x55fb9d05f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.488+0000 7fb59a7fc700 1 --2- 172.21.15.81:0/1278388612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d059890 0x55fb9d05f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.488+0000 7fb59a7fc700 1 -- 172.21.15.81:0/1278388612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d05f720 msgr2=0x55fb9d053d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.488+0000 7fb59a7fc700 1 --2- 172.21.15.81:0/1278388612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d05f720 0x55fb9d053d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.488+0000 7fb59a7fc700 1 -- 172.21.15.81:0/1278388612 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb9cf6f560 con 0x55fb9d05ee00 2024-05-09T00:07:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.488+0000 7fb59a7fc700 1 --2- 172.21.15.81:0/1278388612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d06ebc0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb590009990 tx=0x7fb590005170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd5d68c629ba1ff server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.488+0000 7fb581ffb700 1 -- 172.21.15.81:0/1278388612 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59000fc90 con 0x55fb9d05ee00 2024-05-09T00:07:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.488+0000 7fb581ffb700 1 -- 172.21.15.81:0/1278388612 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb590003790 con 0x55fb9d05ee00 2024-05-09T00:07:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.488+0000 7fb581ffb700 1 -- 172.21.15.81:0/1278388612 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590003e30 con 0x55fb9d05ee00 2024-05-09T00:07:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.488+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/1278388612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 msgr2=0x55fb9d06ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.488+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/1278388612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d06ebc0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb590009990 tx=0x7fb590005170 comp rx=0 tx=0).stop 2024-05-09T00:07:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/1278388612 shutdown_connections 2024-05-09T00:07:59.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/1278388612 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d05f720 0x55fb9d053d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/1278388612 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d059890 0x55fb9d05f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/1278388612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d06ebc0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/1278388612 >> 172.21.15.81:0/1278388612 conn(0x55fb9cfb7210 msgr2=0x55fb9d05cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/1278388612 shutdown_connections 2024-05-09T00:07:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/1278388612 wait complete. 2024-05-09T00:07:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 -- start start 2024-05-09T00:07:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 Processor -- start 2024-05-09T00:07:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d059890 0x55fb9d06a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d06a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d05f720 0x55fb9d0680f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9d068630 con 0x55fb9d05ee00 2024-05-09T00:07:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9d068770 con 0x55fb9d059890 2024-05-09T00:07:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9d068930 con 0x55fb9d05f720 2024-05-09T00:07:59.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb5ad8cbb80 10 client.0 _ll_register_callbacks cb 0x55fb9cf4eb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb59a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d06a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb59a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d06a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43912/0 (socket says 172.21.15.81:43912) 2024-05-09T00:07:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb59a7fc700 1 -- 172.21.15.81:0/3231250139 learned_addr learned my addr 172.21.15.81:0/3231250139 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb59b7fe700 1 --2- 172.21.15.81:0/3231250139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d05f720 0x55fb9d0680f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb59a7fc700 1 -- 172.21.15.81:0/3231250139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d05f720 msgr2=0x55fb9d0680f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb59a7fc700 1 --2- 172.21.15.81:0/3231250139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d05f720 0x55fb9d0680f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb59a7fc700 1 -- 172.21.15.81:0/3231250139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d059890 msgr2=0x55fb9d06a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb59affd700 1 --2- 172.21.15.81:0/3231250139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d059890 0x55fb9d06a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.489+0000 7fb59a7fc700 1 --2- 172.21.15.81:0/3231250139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d059890 0x55fb9d06a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb59a7fc700 1 -- 172.21.15.81:0/3231250139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb9cdd6b60 con 0x55fb9d05ee00 2024-05-09T00:07:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb59affd700 1 --2- 172.21.15.81:0/3231250139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d059890 0x55fb9d06a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb59a7fc700 1 --2- 172.21.15.81:0/3231250139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d06a650 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb590000c00 tx=0x7fb590010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f400ac76e4324c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb57eff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:59.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb57eff5700 1 -- 172.21.15.81:0/3231250139 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb590003900 con 0x55fb9d05ee00 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb57eff5700 1 -- 172.21.15.81:0/3231250139 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb590000e40 con 0x55fb9d05ee00 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/3231250139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb59001d040 con 0x55fb9d05ee00 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb57eff5700 1 -- 172.21.15.81:0/3231250139 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb590003a60 con 0x55fb9d05ee00 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb5ad8cbb80 10 client.16833 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/3231250139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fb9ce2ecd0 con 0x55fb9d05ee00 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb57eff5700 1 -- 172.21.15.81:0/3231250139 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb59001d040 con 0x55fb9d05ee00 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb57eff5700 1 -- 172.21.15.81:0/3231250139 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb590020070 con 0x55fb9d05ee00 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb5ad8cbb80 10 client.16833 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb5ad8cbb80 10 client.16833 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb5ad8cbb80 20 client.16833 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/3231250139 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55fb9d0c8ed0 0x55fb9d0cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb5ad8cbb80 4 client.16833 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.490+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/3231250139 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fb9cfa1ec0 con 0x55fb9d0c8ed0 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb59affd700 1 --2- 172.21.15.81:0/3231250139 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55fb9d0c8ed0 0x55fb9d0cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb59affd700 1 --2- 172.21.15.81:0/3231250139 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55fb9d0c8ed0 0x55fb9d0cb2c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=40db36dd6c723c01 server_cookie=94f4c2e44e7da7f in_seq=0 out_seq=0 2024-05-09T00:07:59.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb57eff5700 10 client.16833 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:07:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb57eff5700 1 -- 172.21.15.81:0/3231250139 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fb9cfa1ec0 con 0x55fb9d0c8ed0 2024-05-09T00:07:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb57eff5700 10 client.16833 handle_command_reply: tid=0 2024-05-09T00:07:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb5ad8cbb80 1 client.16833 shutdown 2024-05-09T00:07:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/3231250139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 msgr2=0x55fb9d06a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/3231250139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d06a650 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fb590000c00 tx=0x7fb590010f60 comp rx=0 tx=0).stop 2024-05-09T00:07:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/3231250139 shutdown_connections 2024-05-09T00:07:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/3231250139 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55fb9d0c8ed0 0x55fb9d0cb2c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/3231250139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fb9d059890 0x55fb9d06a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb57eff5700 0 client.16833 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:07:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/3231250139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fb9d05f720 0x55fb9d0680f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb5ad8cbb80 1 --2- 172.21.15.81:0/3231250139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fb9d05ee00 0x55fb9d06a650 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/3231250139 >> 172.21.15.81:0/3231250139 conn(0x55fb9cfb7210 msgr2=0x55fb9d061440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/3231250139 shutdown_connections 2024-05-09T00:07:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb5ad8cbb80 1 -- 172.21.15.81:0/3231250139 wait complete. 2024-05-09T00:07:59.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.491+0000 7fb5ad8cbb80 20 client.16833 trim_cache size 0 max 16384 2024-05-09T00:07:59.495 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:07:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.492+0000 7fb5a1711700 1 -- 172.21.15.81:0/366535316 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb5840a1290 msgr2=0x7fb5840a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.492+0000 7fb5a1711700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb5840a1290 0x7fb5840a3750 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb58c005fd0 tx=0x7fb58c005ee0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.492+0000 7fb5a1711700 1 -- 172.21.15.81:0/366535316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb59c102560 msgr2=0x7fb59c1a5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.492+0000 7fb5a1711700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb59c102560 0x7fb59c1a5620 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb59400b9e0 tx=0x7fb59400bda0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.492+0000 7fb5a1711700 1 -- 172.21.15.81:0/366535316 shutdown_connections 2024-05-09T00:07:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.492+0000 7fb5a1711700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb5840a1290 0x7fb5840a3750 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.492+0000 7fb5a1711700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb59c100060 0x7fb59c101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.492+0000 7fb5a1711700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb59c102560 0x7fb59c1a5620 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.492+0000 7fb5a1711700 1 --2- 172.21.15.81:0/366535316 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb59c105170 0x7fb59c102020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.492+0000 7fb5a1711700 1 -- 172.21.15.81:0/366535316 >> 172.21.15.81:0/366535316 conn(0x7fb59c076fa0 msgr2=0x7fb59c0699f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.492+0000 7fb5a1711700 1 -- 172.21.15.81:0/366535316 shutdown_connections 2024-05-09T00:07:59.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.492+0000 7fb5a1711700 1 -- 172.21.15.81:0/366535316 wait complete. 2024-05-09T00:07:59.500 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:07:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.628+0000 7f07e35e7700 1 -- 172.21.15.81:0/2809377870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07dc100060 msgr2=0x7f07dc100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.629+0000 7f07e35e7700 1 --2- 172.21.15.81:0/2809377870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07dc100060 0x7f07dc100440 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009990 tx=0x7f07d8009ca0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.629+0000 7f07e35e7700 1 -- 172.21.15.81:0/2809377870 shutdown_connections 2024-05-09T00:07:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.629+0000 7f07e35e7700 1 --2- 172.21.15.81:0/2809377870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07dc105170 0x7f07dc10ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.629+0000 7f07e35e7700 1 --2- 172.21.15.81:0/2809377870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07dc100060 0x7f07dc100440 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.629+0000 7f07e35e7700 1 --2- 172.21.15.81:0/2809377870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07dc100a10 0x7f07dc104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.629+0000 7f07e35e7700 1 -- 172.21.15.81:0/2809377870 >> 172.21.15.81:0/2809377870 conn(0x7f07dc076f30 msgr2=0x7f07dc077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.629+0000 7f07e35e7700 1 -- 172.21.15.81:0/2809377870 shutdown_connections 2024-05-09T00:07:59.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.629+0000 7f07e35e7700 1 -- 172.21.15.81:0/2809377870 wait complete. 2024-05-09T00:07:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.629+0000 7f07e35e7700 1 Processor -- start 2024-05-09T00:07:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.629+0000 7f07e35e7700 1 -- start start 2024-05-09T00:07:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.629+0000 7f07e35e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07dc100060 0x7f07dc198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.629+0000 7f07e35e7700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07dc105170 0x7f07dc198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.629+0000 7f07e35e7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07dc198da0 0x7f07dc1a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e35e7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc1a3a80 con 0x7f07dc100060 2024-05-09T00:07:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e35e7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc1a3bf0 con 0x7f07dc198da0 2024-05-09T00:07:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e35e7700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc1a3db0 con 0x7f07dc105170 2024-05-09T00:07:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e1383700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07dc100060 0x7f07dc198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e1383700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07dc100060 0x7f07dc198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43934/0 (socket says 172.21.15.81:43934) 2024-05-09T00:07:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e1383700 1 -- 172.21.15.81:0/2780704304 learned_addr learned my addr 172.21.15.81:0/2780704304 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e1b84700 1 --2- 172.21.15.81:0/2780704304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07dc198da0 0x7f07dc1a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e1383700 1 -- 172.21.15.81:0/2780704304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07dc105170 msgr2=0x7f07dc198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e1383700 1 --2- 172.21.15.81:0/2780704304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07dc105170 0x7f07dc198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e1383700 1 -- 172.21.15.81:0/2780704304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07dc198da0 msgr2=0x7f07dc1a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e1383700 1 --2- 172.21.15.81:0/2780704304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07dc198da0 0x7f07dc1a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e1383700 1 -- 172.21.15.81:0/2780704304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d80095f0 con 0x7f07dc100060 2024-05-09T00:07:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e1b84700 1 --2- 172.21.15.81:0/2780704304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07dc198da0 0x7f07dc1a33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e1383700 1 --2- 172.21.15.81:0/2780704304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07dc100060 0x7f07dc198320 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f07d8005740 tx=0x7f07d8005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07d27fc700 1 -- 172.21.15.81:0/2780704304 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d801d070 con 0x7f07dc100060 2024-05-09T00:07:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07d27fc700 1 -- 172.21.15.81:0/2780704304 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07d8005940 con 0x7f07dc100060 2024-05-09T00:07:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e35e7700 1 -- 172.21.15.81:0/2780704304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07dc1a4030 con 0x7f07dc100060 2024-05-09T00:07:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07d27fc700 1 -- 172.21.15.81:0/2780704304 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8022d40 con 0x7f07dc100060 2024-05-09T00:07:59.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.630+0000 7f07e35e7700 1 -- 172.21.15.81:0/2780704304 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07dc1a4450 con 0x7f07dc100060 2024-05-09T00:07:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.632+0000 7f07d27fc700 1 -- 172.21.15.81:0/2780704304 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f07d800f770 con 0x7f07dc100060 2024-05-09T00:07:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.633+0000 7f07d27fc700 1 --2- 172.21.15.81:0/2780704304 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f07c80a1290 0x7f07c80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.633+0000 7f07e0b82700 1 --2- 172.21.15.81:0/2780704304 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f07c80a1290 0x7f07c80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.633+0000 7f07d27fc700 1 -- 172.21.15.81:0/2780704304 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f07d80ce220 con 0x7f07dc100060 2024-05-09T00:07:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.633+0000 7f07e0b82700 1 --2- 172.21.15.81:0/2780704304 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f07c80a1290 0x7f07c80a3750 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f07dc069a00 tx=0x7f07cc006cd0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07ef7a1b80 1 Processor -- start 2024-05-09T00:07:59.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07ef7a1b80 1 -- start start 2024-05-09T00:07:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07ef7a1b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d1f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07ef7a1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1f720 0x55b6c9d19350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07ef7a1b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d19890 0x55b6c9d19cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07ef7a1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c9c70150 con 0x55b6c9d1f720 2024-05-09T00:07:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07ef7a1b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c9c6db10 con 0x55b6c9d19890 2024-05-09T00:07:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07ef7a1b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c9c69400 con 0x55b6c9d1ee00 2024-05-09T00:07:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07e0b82700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1f720 0x55b6c9d19350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07e0b82700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1f720 0x55b6c9d19350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43942/0 (socket says 172.21.15.81:43942) 2024-05-09T00:07:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07e0b82700 1 -- 172.21.15.81:0/3601460750 learned_addr learned my addr 172.21.15.81:0/3601460750 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07e1383700 1 --2- 172.21.15.81:0/3601460750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d1f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07e1b84700 1 --2- 172.21.15.81:0/3601460750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d19890 0x55b6c9d19cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07e0b82700 1 -- 172.21.15.81:0/3601460750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1ee00 msgr2=0x55b6c9d1f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07e0b82700 1 --2- 172.21.15.81:0/3601460750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d1f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07e0b82700 1 -- 172.21.15.81:0/3601460750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d19890 msgr2=0x55b6c9d19cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.634+0000 7f07e0b82700 1 --2- 172.21.15.81:0/3601460750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d19890 0x55b6c9d19cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.635+0000 7f07e0b82700 1 -- 172.21.15.81:0/3601460750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6c9aea3b0 con 0x55b6c9d1f720 2024-05-09T00:07:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.635+0000 7f07e0b82700 1 --2- 172.21.15.81:0/3601460750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1f720 0x55b6c9d19350 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f07cc015920 tx=0x7f07cc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c780ea36a320f462 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.635+0000 7f07c77fe700 1 -- 172.21.15.81:0/3601460750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc01a070 con 0x55b6c9d1f720 2024-05-09T00:07:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.635+0000 7f07c77fe700 1 -- 172.21.15.81:0/3601460750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07cc012a00 con 0x55b6c9d1f720 2024-05-09T00:07:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.635+0000 7f07c77fe700 1 -- 172.21.15.81:0/3601460750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc013970 con 0x55b6c9d1f720 2024-05-09T00:07:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.635+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/3601460750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1f720 msgr2=0x55b6c9d19350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.635+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/3601460750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1f720 0x55b6c9d19350 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f07cc015920 tx=0x7f07cc009f90 comp rx=0 tx=0).stop 2024-05-09T00:07:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/3601460750 shutdown_connections 2024-05-09T00:07:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/3601460750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d19890 0x55b6c9d19cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/3601460750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d1f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/3601460750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1f720 0x55b6c9d19350 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/3601460750 >> 172.21.15.81:0/3601460750 conn(0x55b6c9c77210 msgr2=0x55b6c9d13df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/3601460750 shutdown_connections 2024-05-09T00:07:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/3601460750 wait complete. 2024-05-09T00:07:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 -- start start 2024-05-09T00:07:59.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 Processor -- start 2024-05-09T00:07:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d19890 0x55b6c9d22a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d22f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1f720 0x55b6c9d234d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c9c05560 con 0x55b6c9d19890 2024-05-09T00:07:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c9c05200 con 0x55b6c9d1ee00 2024-05-09T00:07:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.636+0000 7f07ef7a1b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c9aec6a0 con 0x55b6c9d1f720 2024-05-09T00:07:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07ef7a1b80 10 client.0 _ll_register_callbacks cb 0x55b6c9c0eb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07e1383700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d19890 0x55b6c9d22a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07e1383700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d19890 0x55b6c9d22a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43950/0 (socket says 172.21.15.81:43950) 2024-05-09T00:07:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07e1383700 1 -- 172.21.15.81:0/91131011 learned_addr learned my addr 172.21.15.81:0/91131011 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07e0b82700 1 --2- 172.21.15.81:0/91131011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d22f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07e1b84700 1 --2- 172.21.15.81:0/91131011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1f720 0x55b6c9d234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07e1383700 1 -- 172.21.15.81:0/91131011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1f720 msgr2=0x55b6c9d234d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07e1383700 1 --2- 172.21.15.81:0/91131011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1f720 0x55b6c9d234d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07e1383700 1 -- 172.21.15.81:0/91131011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d1ee00 msgr2=0x55b6c9d22f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07e1383700 1 --2- 172.21.15.81:0/91131011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d22f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07e1383700 1 -- 172.21.15.81:0/91131011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07cc0155d0 con 0x55b6c9d19890 2024-05-09T00:07:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07e0b82700 1 --2- 172.21.15.81:0/91131011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d22f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:07:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07e1383700 1 --2- 172.21.15.81:0/91131011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d19890 0x55b6c9d22a50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f07d8005ec0 tx=0x7f07d809b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a29b14985fb9f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07c4ff9700 1 -- 172.21.15.81:0/91131011 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8022ea0 con 0x55b6c9d19890 2024-05-09T00:07:59.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07c4ff9700 1 -- 172.21.15.81:0/91131011 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f07d809b4a0 con 0x55b6c9d19890 2024-05-09T00:07:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/91131011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6c9bc2270 con 0x55b6c9d19890 2024-05-09T00:07:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07c4ff9700 1 -- 172.21.15.81:0/91131011 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07d809f2d0 con 0x55b6c9d19890 2024-05-09T00:07:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07ef7a1b80 10 client.16845 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/91131011 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b6c9a96b60 con 0x55b6c9d19890 2024-05-09T00:07:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.637+0000 7f07c4ff9700 1 -- 172.21.15.81:0/91131011 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b6c9bc2270 con 0x55b6c9d19890 2024-05-09T00:07:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.638+0000 7f07c4ff9700 1 -- 172.21.15.81:0/91131011 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f07d80a1360 con 0x55b6c9d19890 2024-05-09T00:07:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.638+0000 7f07ef7a1b80 10 client.16845 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.638+0000 7f07ef7a1b80 10 client.16845 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:07:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.638+0000 7f07ef7a1b80 20 client.16845 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.638+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/91131011 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b6c9d32de0 0x55b6c9d351d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.638+0000 7f07ef7a1b80 4 client.16845 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:07:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.638+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/91131011 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6c9ce8810 con 0x55b6c9d32de0 2024-05-09T00:07:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.638+0000 7f07e0b82700 1 --2- 172.21.15.81:0/91131011 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b6c9d32de0 0x55b6c9d351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.639+0000 7f07c4ff9700 10 client.16845 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:07:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.639+0000 7f07e0b82700 1 --2- 172.21.15.81:0/91131011 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b6c9d32de0 0x55b6c9d351d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=90edfdcf2daeab0a server_cookie=579b62ee568c04e7 in_seq=0 out_seq=0 2024-05-09T00:07:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07c4ff9700 1 -- 172.21.15.81:0/91131011 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b6c9ce8810 con 0x55b6c9d32de0 2024-05-09T00:07:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07c4ff9700 10 client.16845 handle_command_reply: tid=0 2024-05-09T00:07:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07ef7a1b80 1 client.16845 shutdown 2024-05-09T00:07:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/91131011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d19890 msgr2=0x55b6c9d22a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/91131011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d19890 0x55b6c9d22a50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f07d8005ec0 tx=0x7f07d809b3a0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/91131011 shutdown_connections 2024-05-09T00:07:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/91131011 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b6c9d32de0 0x55b6c9d351d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/91131011 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1f720 0x55b6c9d234d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07c4ff9700 0 client.16845 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:07:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/91131011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d19890 0x55b6c9d22a50 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/91131011 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d22f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/91131011 >> 172.21.15.81:0/91131011 conn(0x55b6c9c77210 msgr2=0x55b6c9d135a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/91131011 shutdown_connections 2024-05-09T00:07:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/91131011 wait complete. 2024-05-09T00:07:59.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.640+0000 7f07ef7a1b80 20 client.16845 trim_cache size 0 max 16384 2024-05-09T00:07:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.653+0000 7f07ef7a1b80 1 Processor -- start 2024-05-09T00:07:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.653+0000 7f07ef7a1b80 1 -- start start 2024-05-09T00:07:59.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07ef7a1b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d19890 0x55b6c9d19350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07ef7a1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d351d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07ef7a1b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d1f720 0x55b6c9d13d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07ef7a1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c9d255f0 con 0x55b6c9d1ee00 2024-05-09T00:07:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07ef7a1b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c9d0c0d0 con 0x55b6c9d1f720 2024-05-09T00:07:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07ef7a1b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c9d10df0 con 0x55b6c9d19890 2024-05-09T00:07:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07e0b82700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07e0b82700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d351d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43960/0 (socket says 172.21.15.81:43960) 2024-05-09T00:07:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07e0b82700 1 -- 172.21.15.81:0/275234865 learned_addr learned my addr 172.21.15.81:0/275234865 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07e1383700 1 --2- 172.21.15.81:0/275234865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d19890 0x55b6c9d19350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07e0b82700 1 -- 172.21.15.81:0/275234865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d19890 msgr2=0x55b6c9d19350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07e0b82700 1 --2- 172.21.15.81:0/275234865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d19890 0x55b6c9d19350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07e1b84700 1 --2- 172.21.15.81:0/275234865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d1f720 0x55b6c9d13d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07e0b82700 1 -- 172.21.15.81:0/275234865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d1f720 msgr2=0x55b6c9d13d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07e0b82700 1 --2- 172.21.15.81:0/275234865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d1f720 0x55b6c9d13d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07e0b82700 1 -- 172.21.15.81:0/275234865 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6c9c2f560 con 0x55b6c9d1ee00 2024-05-09T00:07:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07e1383700 1 --2- 172.21.15.81:0/275234865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d19890 0x55b6c9d19350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07e1b84700 1 --2- 172.21.15.81:0/275234865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d1f720 0x55b6c9d13d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07e0b82700 1 --2- 172.21.15.81:0/275234865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d351d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f07cc021040 tx=0x7f07cc006ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbe5fd87a143fb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07c7fff700 1 -- 172.21.15.81:0/275234865 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc01a040 con 0x55b6c9d1ee00 2024-05-09T00:07:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07c7fff700 1 -- 172.21.15.81:0/275234865 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07cc004020 con 0x55b6c9d1ee00 2024-05-09T00:07:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.654+0000 7f07c7fff700 1 -- 172.21.15.81:0/275234865 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc003980 con 0x55b6c9d1ee00 2024-05-09T00:07:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.655+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/275234865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1ee00 msgr2=0x55b6c9d351d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.655+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/275234865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d351d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f07cc021040 tx=0x7f07cc006ae0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.655+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/275234865 shutdown_connections 2024-05-09T00:07:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.655+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/275234865 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d1f720 0x55b6c9d13d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.655+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/275234865 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d19890 0x55b6c9d19350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.655+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/275234865 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d351d0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.655+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/275234865 >> 172.21.15.81:0/275234865 conn(0x55b6c9c77210 msgr2=0x55b6c9d19c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.655+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/275234865 shutdown_connections 2024-05-09T00:07:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.655+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/275234865 wait complete. 2024-05-09T00:07:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.655+0000 7f07ef7a1b80 1 -- start start 2024-05-09T00:07:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.655+0000 7f07ef7a1b80 1 Processor -- start 2024-05-09T00:07:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07ef7a1b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d19890 0x55b6c9d26140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07ef7a1b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d26680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07ef7a1b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1f720 0x55b6c9d26bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07ef7a1b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c9d88260 con 0x55b6c9d1ee00 2024-05-09T00:07:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07ef7a1b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c9d883a0 con 0x55b6c9d19890 2024-05-09T00:07:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07ef7a1b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c9d884e0 con 0x55b6c9d1f720 2024-05-09T00:07:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07ef7a1b80 10 client.0 _ll_register_callbacks cb 0x55b6c9c0eb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07e0b82700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d26680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07e0b82700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d26680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43962/0 (socket says 172.21.15.81:43962) 2024-05-09T00:07:59.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07e0b82700 1 -- 172.21.15.81:0/2248809603 learned_addr learned my addr 172.21.15.81:0/2248809603 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07e1383700 1 --2- 172.21.15.81:0/2248809603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d19890 0x55b6c9d26140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07e1b84700 1 --2- 172.21.15.81:0/2248809603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1f720 0x55b6c9d26bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07e0b82700 1 -- 172.21.15.81:0/2248809603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1f720 msgr2=0x55b6c9d26bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07e0b82700 1 --2- 172.21.15.81:0/2248809603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1f720 0x55b6c9d26bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07e0b82700 1 -- 172.21.15.81:0/2248809603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d19890 msgr2=0x55b6c9d26140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07e0b82700 1 --2- 172.21.15.81:0/2248809603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d19890 0x55b6c9d26140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07e0b82700 1 -- 172.21.15.81:0/2248809603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6c9aea3b0 con 0x55b6c9d1ee00 2024-05-09T00:07:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07e1383700 1 --2- 172.21.15.81:0/2248809603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d19890 0x55b6c9d26140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07e0b82700 1 --2- 172.21.15.81:0/2248809603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d26680 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f07cc013460 tx=0x7f07cc012f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8bffe9c06cd2df9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07c4ff9700 1 -- 172.21.15.81:0/2248809603 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07cc01a040 con 0x55b6c9d1ee00 2024-05-09T00:07:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07c4ff9700 1 -- 172.21.15.81:0/2248809603 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f07cc004390 con 0x55b6c9d1ee00 2024-05-09T00:07:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.656+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/2248809603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f07cc012a00 con 0x55b6c9d1ee00 2024-05-09T00:07:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.657+0000 7f07c4ff9700 1 -- 172.21.15.81:0/2248809603 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07cc004550 con 0x55b6c9d1ee00 2024-05-09T00:07:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.657+0000 7f07ef7a1b80 10 client.16851 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.657+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/2248809603 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b6c9aeecd0 con 0x55b6c9d1ee00 2024-05-09T00:07:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.657+0000 7f07c4ff9700 1 -- 172.21.15.81:0/2248809603 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f07cc044080 con 0x55b6c9d1ee00 2024-05-09T00:07:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.657+0000 7f07c4ff9700 1 -- 172.21.15.81:0/2248809603 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f07cc02d4f0 con 0x55b6c9d1ee00 2024-05-09T00:07:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.657+0000 7f07ef7a1b80 10 client.16851 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.657+0000 7f07ef7a1b80 10 client.16851 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:07:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.657+0000 7f07ef7a1b80 20 client.16851 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.657+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/2248809603 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b6c9d89670 0x55b6c9d8ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.657+0000 7f07ef7a1b80 4 client.16851 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:07:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.657+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/2248809603 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b6c9c61ec0 con 0x55b6c9d89670 2024-05-09T00:07:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.657+0000 7f07e1383700 1 --2- 172.21.15.81:0/2248809603 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b6c9d89670 0x55b6c9d8ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07c4ff9700 10 client.16851 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:07:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07e1383700 1 --2- 172.21.15.81:0/2248809603 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b6c9d89670 0x55b6c9d8ba60 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=95a3472e4ea1c3fa server_cookie=11573d45a7929a07 in_seq=0 out_seq=0 2024-05-09T00:07:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07c4ff9700 1 -- 172.21.15.81:0/2248809603 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b6c9c61ec0 con 0x55b6c9d89670 2024-05-09T00:07:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07c4ff9700 10 client.16851 handle_command_reply: tid=0 2024-05-09T00:07:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07ef7a1b80 1 client.16851 shutdown 2024-05-09T00:07:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/2248809603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1ee00 msgr2=0x55b6c9d26680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/2248809603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d26680 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f07cc013460 tx=0x7f07cc012f00 comp rx=0 tx=0).stop 2024-05-09T00:07:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/2248809603 shutdown_connections 2024-05-09T00:07:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/2248809603 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b6c9d89670 0x55b6c9d8ba60 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/2248809603 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b6c9d19890 0x55b6c9d26140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07c4ff9700 0 client.16851 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:07:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/2248809603 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b6c9d1f720 0x55b6c9d26bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07ef7a1b80 1 --2- 172.21.15.81:0/2248809603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b6c9d1ee00 0x55b6c9d26680 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/2248809603 >> 172.21.15.81:0/2248809603 conn(0x55b6c9c77210 msgr2=0x55b6c9d20f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/2248809603 shutdown_connections 2024-05-09T00:07:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07ef7a1b80 1 -- 172.21.15.81:0/2248809603 wait complete. 2024-05-09T00:07:59.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.658+0000 7f07ef7a1b80 20 client.16851 trim_cache size 0 max 16384 2024-05-09T00:07:59.662 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:07:59.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.659+0000 7f07e35e7700 1 -- 172.21.15.81:0/2780704304 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f07c80a1290 msgr2=0x7f07c80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.659+0000 7f07e35e7700 1 --2- 172.21.15.81:0/2780704304 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f07c80a1290 0x7f07c80a3750 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f07dc069a00 tx=0x7f07cc006cd0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.659+0000 7f07e35e7700 1 -- 172.21.15.81:0/2780704304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07dc100060 msgr2=0x7f07dc198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.659+0000 7f07e35e7700 1 --2- 172.21.15.81:0/2780704304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07dc100060 0x7f07dc198320 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f07d8005740 tx=0x7f07d8005da0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.659+0000 7f07e35e7700 1 -- 172.21.15.81:0/2780704304 shutdown_connections 2024-05-09T00:07:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.659+0000 7f07e35e7700 1 --2- 172.21.15.81:0/2780704304 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f07c80a1290 0x7f07c80a3750 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.659+0000 7f07e35e7700 1 --2- 172.21.15.81:0/2780704304 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f07dc198da0 0x7f07dc1a33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.659+0000 7f07e35e7700 1 --2- 172.21.15.81:0/2780704304 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07dc100060 0x7f07dc198320 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.659+0000 7f07e35e7700 1 --2- 172.21.15.81:0/2780704304 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f07dc105170 0x7f07dc198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.659+0000 7f07e35e7700 1 -- 172.21.15.81:0/2780704304 >> 172.21.15.81:0/2780704304 conn(0x7f07dc076f30 msgr2=0x7f07dc0fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.659+0000 7f07e35e7700 1 -- 172.21.15.81:0/2780704304 shutdown_connections 2024-05-09T00:07:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.659+0000 7f07e35e7700 1 -- 172.21.15.81:0/2780704304 wait complete. 2024-05-09T00:07:59.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:07:59.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.794+0000 7fb483bb4700 1 -- 172.21.15.81:0/3366538130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c1062a0 msgr2=0x7fb47c10de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.794+0000 7fb483bb4700 1 --2- 172.21.15.81:0/3366538130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c1062a0 0x7fb47c10de20 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fb47400b0d0 tx=0x7fb47400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.794+0000 7fb483bb4700 1 -- 172.21.15.81:0/3366538130 shutdown_connections 2024-05-09T00:07:59.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.794+0000 7fb483bb4700 1 --2- 172.21.15.81:0/3366538130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c0697a0 0x7fb47c069b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.794+0000 7fb483bb4700 1 --2- 172.21.15.81:0/3366538130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c1062a0 0x7fb47c10de20 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.794+0000 7fb483bb4700 1 --2- 172.21.15.81:0/3366538130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb47c06a150 0x7fb47c105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.794+0000 7fb483bb4700 1 -- 172.21.15.81:0/3366538130 >> 172.21.15.81:0/3366538130 conn(0x7fb47c076fa0 msgr2=0x7fb47c0773b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.794+0000 7fb483bb4700 1 -- 172.21.15.81:0/3366538130 shutdown_connections 2024-05-09T00:07:59.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.794+0000 7fb483bb4700 1 -- 172.21.15.81:0/3366538130 wait complete. 2024-05-09T00:07:59.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb483bb4700 1 Processor -- start 2024-05-09T00:07:59.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb483bb4700 1 -- start start 2024-05-09T00:07:59.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb483bb4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c0697a0 0x7fb47c1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb483bb4700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb47c1062a0 0x7fb47c197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb483bb4700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c19bd60 0x7fb47c19c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb483bb4700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c19c7e0 con 0x7fb47c0697a0 2024-05-09T00:07:59.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb483bb4700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c19c950 con 0x7fb47c19bd60 2024-05-09T00:07:59.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb483bb4700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c19cb10 con 0x7fb47c1062a0 2024-05-09T00:07:59.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb481950700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c0697a0 0x7fb47c1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb481950700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c0697a0 0x7fb47c1974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43986/0 (socket says 172.21.15.81:43986) 2024-05-09T00:07:59.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb481950700 1 -- 172.21.15.81:0/2386450055 learned_addr learned my addr 172.21.15.81:0/2386450055 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb482151700 1 --2- 172.21.15.81:0/2386450055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c19bd60 0x7fb47c19c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb48114f700 1 --2- 172.21.15.81:0/2386450055 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb47c1062a0 0x7fb47c197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb481950700 1 -- 172.21.15.81:0/2386450055 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb47c1062a0 msgr2=0x7fb47c197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb481950700 1 --2- 172.21.15.81:0/2386450055 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb47c1062a0 0x7fb47c197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb481950700 1 -- 172.21.15.81:0/2386450055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c19bd60 msgr2=0x7fb47c19c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb481950700 1 --2- 172.21.15.81:0/2386450055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c19bd60 0x7fb47c19c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.795+0000 7fb481950700 1 -- 172.21.15.81:0/2386450055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb474009d00 con 0x7fb47c0697a0 2024-05-09T00:07:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.796+0000 7fb481950700 1 --2- 172.21.15.81:0/2386450055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c0697a0 0x7fb47c1974d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00d950 tx=0x7fb46c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.796+0000 7fb472ffd700 1 -- 172.21.15.81:0/2386450055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c009b40 con 0x7fb47c0697a0 2024-05-09T00:07:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.796+0000 7fb483bb4700 1 -- 172.21.15.81:0/2386450055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb47c1a4070 con 0x7fb47c0697a0 2024-05-09T00:07:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.796+0000 7fb472ffd700 1 -- 172.21.15.81:0/2386450055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb46c009ca0 con 0x7fb47c0697a0 2024-05-09T00:07:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.796+0000 7fb472ffd700 1 -- 172.21.15.81:0/2386450055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46c00f620 con 0x7fb47c0697a0 2024-05-09T00:07:59.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.796+0000 7fb483bb4700 1 -- 172.21.15.81:0/2386450055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47c1a4550 con 0x7fb47c0697a0 2024-05-09T00:07:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.798+0000 7fb472ffd700 1 -- 172.21.15.81:0/2386450055 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fb46c010460 con 0x7fb47c0697a0 2024-05-09T00:07:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.799+0000 7fb472ffd700 1 --2- 172.21.15.81:0/2386450055 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb4680a1290 0x7fb4680a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.799+0000 7fb48114f700 1 --2- 172.21.15.81:0/2386450055 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb4680a1290 0x7fb4680a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.799+0000 7fb472ffd700 1 -- 172.21.15.81:0/2386450055 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb46c0cd070 con 0x7fb47c0697a0 2024-05-09T00:07:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.799+0000 7fb48114f700 1 --2- 172.21.15.81:0/2386450055 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb4680a1290 0x7fb4680a3750 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb47c1989d0 tx=0x7fb478009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.799+0000 7fb48fd6eb80 1 Processor -- start 2024-05-09T00:07:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48fd6eb80 1 -- start start 2024-05-09T00:07:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48fd6eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507df4e00 0x557507df51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48fd6eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df5720 0x557507def350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48fd6eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507def890 0x557507defcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48fd6eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557507d46150 con 0x557507df5720 2024-05-09T00:07:59.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48fd6eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557507d43b10 con 0x557507def890 2024-05-09T00:07:59.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48fd6eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557507d3f400 con 0x557507df4e00 2024-05-09T00:07:59.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48114f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df5720 0x557507def350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48114f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df5720 0x557507def350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43992/0 (socket says 172.21.15.81:43992) 2024-05-09T00:07:59.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48114f700 1 -- 172.21.15.81:0/3494437664 learned_addr learned my addr 172.21.15.81:0/3494437664 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb481950700 1 --2- 172.21.15.81:0/3494437664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507df4e00 0x557507df51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb482151700 1 --2- 172.21.15.81:0/3494437664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507def890 0x557507defcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48114f700 1 -- 172.21.15.81:0/3494437664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507df4e00 msgr2=0x557507df51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48114f700 1 --2- 172.21.15.81:0/3494437664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507df4e00 0x557507df51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48114f700 1 -- 172.21.15.81:0/3494437664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507def890 msgr2=0x557507defcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48114f700 1 --2- 172.21.15.81:0/3494437664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507def890 0x557507defcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48114f700 1 -- 172.21.15.81:0/3494437664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557507bc03b0 con 0x557507df5720 2024-05-09T00:07:59.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.800+0000 7fb48114f700 1 --2- 172.21.15.81:0/3494437664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df5720 0x557507def350 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fb47800fbb0 tx=0x7fb478012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3e840c1ba6aceb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.801+0000 7fb467fff700 1 -- 172.21.15.81:0/3494437664 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478011ad0 con 0x557507df5720 2024-05-09T00:07:59.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.801+0000 7fb467fff700 1 -- 172.21.15.81:0/3494437664 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb478009760 con 0x557507df5720 2024-05-09T00:07:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.801+0000 7fb467fff700 1 -- 172.21.15.81:0/3494437664 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47801d610 con 0x557507df5720 2024-05-09T00:07:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.801+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/3494437664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df5720 msgr2=0x557507def350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.801+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/3494437664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df5720 0x557507def350 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fb47800fbb0 tx=0x7fb478012000 comp rx=0 tx=0).stop 2024-05-09T00:07:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.801+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/3494437664 shutdown_connections 2024-05-09T00:07:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.801+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/3494437664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507def890 0x557507defcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.801+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/3494437664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507df4e00 0x557507df51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.801+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/3494437664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df5720 0x557507def350 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.801+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/3494437664 >> 172.21.15.81:0/3494437664 conn(0x557507d4d210 msgr2=0x557507de9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.801+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/3494437664 shutdown_connections 2024-05-09T00:07:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.801+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/3494437664 wait complete. 2024-05-09T00:07:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.802+0000 7fb48fd6eb80 1 -- start start 2024-05-09T00:07:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.802+0000 7fb48fd6eb80 1 Processor -- start 2024-05-09T00:07:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.802+0000 7fb48fd6eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507def890 0x557507df8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.802+0000 7fb48fd6eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df4e00 0x557507df9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.802+0000 7fb48fd6eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df5720 0x557507df9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.802+0000 7fb48fd6eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557507cdb560 con 0x557507df5720 2024-05-09T00:07:59.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.802+0000 7fb48fd6eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557507cdb200 con 0x557507df4e00 2024-05-09T00:07:59.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.802+0000 7fb48fd6eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557507bc26a0 con 0x557507def890 2024-05-09T00:07:59.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.802+0000 7fb48fd6eb80 10 client.0 _ll_register_callbacks cb 0x557507ce4b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:59.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.802+0000 7fb482151700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df5720 0x557507df9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.802+0000 7fb482151700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df5720 0x557507df9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44004/0 (socket says 172.21.15.81:44004) 2024-05-09T00:07:59.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.802+0000 7fb482151700 1 -- 172.21.15.81:0/1996978117 learned_addr learned my addr 172.21.15.81:0/1996978117 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb48114f700 1 --2- 172.21.15.81:0/1996978117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df4e00 0x557507df9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb482151700 1 -- 172.21.15.81:0/1996978117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507def890 msgr2=0x557507df8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb482151700 1 --2- 172.21.15.81:0/1996978117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507def890 0x557507df8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb482151700 1 -- 172.21.15.81:0/1996978117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df4e00 msgr2=0x557507df9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb482151700 1 --2- 172.21.15.81:0/1996978117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df4e00 0x557507df9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb482151700 1 -- 172.21.15.81:0/1996978117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47800f860 con 0x557507df5720 2024-05-09T00:07:59.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb48114f700 1 --2- 172.21.15.81:0/1996978117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df4e00 0x557507df9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:07:59.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb482151700 1 --2- 172.21.15.81:0/1996978117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df5720 0x557507df9550 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fb474007fb0 tx=0x7fb47400bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9eb8a5245e205d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb4657fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:59.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb4657fa700 1 -- 172.21.15.81:0/1996978117 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47400e040 con 0x557507df5720 2024-05-09T00:07:59.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb4657fa700 1 -- 172.21.15.81:0/1996978117 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb47400be20 con 0x557507df5720 2024-05-09T00:07:59.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/1996978117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557507c98270 con 0x557507df5720 2024-05-09T00:07:59.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb4657fa700 1 -- 172.21.15.81:0/1996978117 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb474004e60 con 0x557507df5720 2024-05-09T00:07:59.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb48fd6eb80 10 client.16863 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:59.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/1996978117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557507b6cb60 con 0x557507df5720 2024-05-09T00:07:59.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.803+0000 7fb4657fa700 1 -- 172.21.15.81:0/1996978117 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557507c98270 con 0x557507df5720 2024-05-09T00:07:59.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.804+0000 7fb4657fa700 1 -- 172.21.15.81:0/1996978117 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb47400b100 con 0x557507df5720 2024-05-09T00:07:59.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.804+0000 7fb48fd6eb80 10 client.16863 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:59.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.804+0000 7fb48fd6eb80 10 client.16863 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:59.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.804+0000 7fb48fd6eb80 20 client.16863 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:59.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.804+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/1996978117 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557507e091d0 0x557507e0b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.804+0000 7fb48fd6eb80 4 client.16863 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:07:59.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.804+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/1996978117 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557507dbe810 con 0x557507e091d0 2024-05-09T00:07:59.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.804+0000 7fb481950700 1 --2- 172.21.15.81:0/1996978117 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557507e091d0 0x557507e0b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.804+0000 7fb481950700 1 --2- 172.21.15.81:0/1996978117 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557507e091d0 0x557507e0b5f0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46d2b2554a2a5ad0 server_cookie=92addce2de4c649e in_seq=0 out_seq=0 2024-05-09T00:07:59.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.804+0000 7fb4657fa700 10 client.16863 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:59.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb4657fa700 1 -- 172.21.15.81:0/1996978117 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557507dbe810 con 0x557507e091d0 2024-05-09T00:07:59.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb4657fa700 10 client.16863 handle_command_reply: tid=0 2024-05-09T00:07:59.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb48fd6eb80 1 client.16863 shutdown 2024-05-09T00:07:59.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/1996978117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df5720 msgr2=0x557507df9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/1996978117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df5720 0x557507df9550 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fb474007fb0 tx=0x7fb47400bb50 comp rx=0 tx=0).stop 2024-05-09T00:07:59.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/1996978117 shutdown_connections 2024-05-09T00:07:59.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/1996978117 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557507e091d0 0x557507e0b5f0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/1996978117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df5720 0x557507df9550 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/1996978117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507def890 0x557507df8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/1996978117 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df4e00 0x557507df9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb4657fa700 0 client.16863 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:59.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/1996978117 >> 172.21.15.81:0/1996978117 conn(0x557507d4d210 msgr2=0x557507de95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/1996978117 shutdown_connections 2024-05-09T00:07:59.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/1996978117 wait complete. 2024-05-09T00:07:59.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.805+0000 7fb48fd6eb80 20 client.16863 trim_cache size 0 max 16384 2024-05-09T00:07:59.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.818+0000 7fb48fd6eb80 1 Processor -- start 2024-05-09T00:07:59.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.818+0000 7fb48fd6eb80 1 -- start start 2024-05-09T00:07:59.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48fd6eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507def890 0x557507def350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48fd6eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df4e00 0x557507e0b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48fd6eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df5720 0x557507de9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48fd6eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557507df5560 con 0x557507df4e00 2024-05-09T00:07:59.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48fd6eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557507e10800 con 0x557507df5720 2024-05-09T00:07:59.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48fd6eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557507deba00 con 0x557507def890 2024-05-09T00:07:59.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48114f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df4e00 0x557507e0b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48114f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df4e00 0x557507e0b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44010/0 (socket says 172.21.15.81:44010) 2024-05-09T00:07:59.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48114f700 1 -- 172.21.15.81:0/2053343431 learned_addr learned my addr 172.21.15.81:0/2053343431 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48114f700 1 -- 172.21.15.81:0/2053343431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507def890 msgr2=0x557507def350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48114f700 1 --2- 172.21.15.81:0/2053343431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507def890 0x557507def350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48114f700 1 -- 172.21.15.81:0/2053343431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df5720 msgr2=0x557507de9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48114f700 1 --2- 172.21.15.81:0/2053343431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df5720 0x557507de9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48114f700 1 -- 172.21.15.81:0/2053343431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557507d05560 con 0x557507df4e00 2024-05-09T00:07:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb48114f700 1 --2- 172.21.15.81:0/2053343431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df4e00 0x557507e0b5c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fb478024000 tx=0x7fb478009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ceaa0a38c29ab6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb470da4700 1 -- 172.21.15.81:0/2053343431 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47802e070 con 0x557507df4e00 2024-05-09T00:07:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb470da4700 1 -- 172.21.15.81:0/2053343431 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb478011d90 con 0x557507df4e00 2024-05-09T00:07:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.819+0000 7fb470da4700 1 -- 172.21.15.81:0/2053343431 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478004950 con 0x557507df4e00 2024-05-09T00:07:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.820+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/2053343431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df4e00 msgr2=0x557507e0b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.820+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/2053343431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df4e00 0x557507e0b5c0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fb478024000 tx=0x7fb478009920 comp rx=0 tx=0).stop 2024-05-09T00:07:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.820+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/2053343431 shutdown_connections 2024-05-09T00:07:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.820+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/2053343431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df5720 0x557507de9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.820+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/2053343431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507def890 0x557507def350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.820+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/2053343431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df4e00 0x557507e0b5c0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.820+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/2053343431 >> 172.21.15.81:0/2053343431 conn(0x557507d4d210 msgr2=0x557507defc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.820+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/2053343431 shutdown_connections 2024-05-09T00:07:59.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.820+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/2053343431 wait complete. 2024-05-09T00:07:59.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.820+0000 7fb48fd6eb80 1 -- start start 2024-05-09T00:07:59.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.820+0000 7fb48fd6eb80 1 Processor -- start 2024-05-09T00:07:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48fd6eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507def890 0x557507dfe150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48fd6eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df4e00 0x557507dfe690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48fd6eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df5720 0x557507dfebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48fd6eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557507e5e7e0 con 0x557507df4e00 2024-05-09T00:07:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48fd6eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557507e5e950 con 0x557507df5720 2024-05-09T00:07:59.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48fd6eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557507e5eb10 con 0x557507def890 2024-05-09T00:07:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48fd6eb80 10 client.0 _ll_register_callbacks cb 0x557507ce4b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:07:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48114f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df4e00 0x557507dfe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48114f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df4e00 0x557507dfe690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44020/0 (socket says 172.21.15.81:44020) 2024-05-09T00:07:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48114f700 1 -- 172.21.15.81:0/3057437214 learned_addr learned my addr 172.21.15.81:0/3057437214 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:07:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb482151700 1 --2- 172.21.15.81:0/3057437214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df5720 0x557507dfebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48114f700 1 -- 172.21.15.81:0/3057437214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507def890 msgr2=0x557507dfe150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48114f700 1 --2- 172.21.15.81:0/3057437214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507def890 0x557507dfe150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48114f700 1 -- 172.21.15.81:0/3057437214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df5720 msgr2=0x557507dfebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:07:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48114f700 1 --2- 172.21.15.81:0/3057437214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df5720 0x557507dfebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48114f700 1 -- 172.21.15.81:0/3057437214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557507bc03b0 con 0x557507df4e00 2024-05-09T00:07:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48114f700 1 --2- 172.21.15.81:0/3057437214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df4e00 0x557507dfe690 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb47800fbb0 tx=0x7fb478005100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a219c6d48c34ea64 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:07:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb4657fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:07:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb4657fa700 1 -- 172.21.15.81:0/3057437214 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47802e040 con 0x557507df4e00 2024-05-09T00:07:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb4657fa700 1 -- 172.21.15.81:0/3057437214 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb4780046f0 con 0x557507df4e00 2024-05-09T00:07:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.821+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/3057437214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb478009760 con 0x557507df4e00 2024-05-09T00:07:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.822+0000 7fb4657fa700 1 -- 172.21.15.81:0/3057437214 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb478011be0 con 0x557507df4e00 2024-05-09T00:07:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.822+0000 7fb48fd6eb80 10 client.16869 fetch_fsmap learned FSMap version 26 2024-05-09T00:07:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.822+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/3057437214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557507bc4cd0 con 0x557507df4e00 2024-05-09T00:07:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.822+0000 7fb4657fa700 1 -- 172.21.15.81:0/3057437214 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb478047080 con 0x557507df4e00 2024-05-09T00:07:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.822+0000 7fb4657fa700 1 -- 172.21.15.81:0/3057437214 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb47801ea50 con 0x557507df4e00 2024-05-09T00:07:59.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.822+0000 7fb48fd6eb80 10 client.16869 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:07:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.822+0000 7fb48fd6eb80 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:07:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.822+0000 7fb48fd6eb80 20 client.16869 populate_metadata read hostname 'smithi081' 2024-05-09T00:07:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.822+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/3057437214 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557507e5fe20 0x557507e62240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:07:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.822+0000 7fb48fd6eb80 4 client.16869 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:07:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.822+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/3057437214 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557507d37ec0 con 0x557507e5fe20 2024-05-09T00:07:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.822+0000 7fb481950700 1 --2- 172.21.15.81:0/3057437214 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557507e5fe20 0x557507e62240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:07:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.822+0000 7fb4657fa700 10 client.16869 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.822+0000 7fb481950700 1 --2- 172.21.15.81:0/3057437214 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557507e5fe20 0x557507e62240 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8dd32162095cf6a server_cookie=ad657daf0ea9a0a3 in_seq=0 out_seq=0 2024-05-09T00:07:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb4657fa700 1 -- 172.21.15.81:0/3057437214 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557507d37ec0 con 0x557507e5fe20 2024-05-09T00:07:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb4657fa700 10 client.16869 handle_command_reply: tid=0 2024-05-09T00:07:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb48fd6eb80 1 client.16869 shutdown 2024-05-09T00:07:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/3057437214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df4e00 msgr2=0x557507dfe690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/3057437214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df4e00 0x557507dfe690 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fb47800fbb0 tx=0x7fb478005100 comp rx=0 tx=0).stop 2024-05-09T00:07:59.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/3057437214 shutdown_connections 2024-05-09T00:07:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/3057437214 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557507e5fe20 0x557507e62240 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/3057437214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557507df5720 0x557507dfebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/3057437214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557507def890 0x557507dfe150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb4657fa700 0 client.16869 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:07:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb48fd6eb80 1 --2- 172.21.15.81:0/3057437214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557507df4e00 0x557507dfe690 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/3057437214 >> 172.21.15.81:0/3057437214 conn(0x557507d4d210 msgr2=0x557507df72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/3057437214 shutdown_connections 2024-05-09T00:07:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb48fd6eb80 1 -- 172.21.15.81:0/3057437214 wait complete. 2024-05-09T00:07:59.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb48fd6eb80 20 client.16869 trim_cache size 0 max 16384 2024-05-09T00:07:59.829 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:07:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb483bb4700 1 -- 172.21.15.81:0/2386450055 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb4680a1290 msgr2=0x7fb4680a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb483bb4700 1 --2- 172.21.15.81:0/2386450055 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb4680a1290 0x7fb4680a3750 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb47c1989d0 tx=0x7fb478009260 comp rx=0 tx=0).stop 2024-05-09T00:07:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb483bb4700 1 -- 172.21.15.81:0/2386450055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c0697a0 msgr2=0x7fb47c1974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:07:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.823+0000 7fb483bb4700 1 --2- 172.21.15.81:0/2386450055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c0697a0 0x7fb47c1974d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00d950 tx=0x7fb46c00dd10 comp rx=0 tx=0).stop 2024-05-09T00:07:59.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.824+0000 7fb483bb4700 1 -- 172.21.15.81:0/2386450055 shutdown_connections 2024-05-09T00:07:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.824+0000 7fb483bb4700 1 --2- 172.21.15.81:0/2386450055 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb4680a1290 0x7fb4680a3750 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.824+0000 7fb483bb4700 1 --2- 172.21.15.81:0/2386450055 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb47c19bd60 0x7fb47c19c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.824+0000 7fb483bb4700 1 --2- 172.21.15.81:0/2386450055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb47c0697a0 0x7fb47c1974d0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.824+0000 7fb483bb4700 1 --2- 172.21.15.81:0/2386450055 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb47c1062a0 0x7fb47c197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:07:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.824+0000 7fb483bb4700 1 -- 172.21.15.81:0/2386450055 >> 172.21.15.81:0/2386450055 conn(0x7fb47c076fa0 msgr2=0x7fb47c0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:07:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.824+0000 7fb483bb4700 1 -- 172.21.15.81:0/2386450055 shutdown_connections 2024-05-09T00:07:59.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:07:59.824+0000 7fb483bb4700 1 -- 172.21.15.81:0/2386450055 wait complete. 2024-05-09T00:08:00.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:00 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1353027784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:08:00.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:00 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1353027784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:08:00.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:00 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1353027784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:08:00.833 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:08:00.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:08:00.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.969+0000 7fe976aca700 1 -- 172.21.15.81:0/3895300860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe970105160 msgr2=0x7fe97010cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:00.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.969+0000 7fe976aca700 1 --2- 172.21.15.81:0/3895300860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe970105160 0x7fe97010cce0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe96800b0a0 tx=0x7fe96800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.969+0000 7fe976aca700 1 -- 172.21.15.81:0/3895300860 shutdown_connections 2024-05-09T00:08:00.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.969+0000 7fe976aca700 1 --2- 172.21.15.81:0/3895300860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe970105160 0x7fe97010cce0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.969+0000 7fe976aca700 1 --2- 172.21.15.81:0/3895300860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe970100060 0x7fe970100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.969+0000 7fe976aca700 1 --2- 172.21.15.81:0/3895300860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe970100a10 0x7fe970104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.969+0000 7fe976aca700 1 -- 172.21.15.81:0/3895300860 >> 172.21.15.81:0/3895300860 conn(0x7fe970076f40 msgr2=0x7fe970077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.969+0000 7fe976aca700 1 -- 172.21.15.81:0/3895300860 shutdown_connections 2024-05-09T00:08:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.969+0000 7fe976aca700 1 -- 172.21.15.81:0/3895300860 wait complete. 2024-05-09T00:08:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.969+0000 7fe976aca700 1 Processor -- start 2024-05-09T00:08:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.969+0000 7fe976aca700 1 -- start start 2024-05-09T00:08:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe976aca700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe970100060 0x7fe970101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe976aca700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe970105160 0x7fe970102010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe976aca700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe970102550 0x7fe9701a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe976aca700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9701a5d60 con 0x7fe970100060 2024-05-09T00:08:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe976aca700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9701a5ed0 con 0x7fe970102550 2024-05-09T00:08:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe976aca700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9701a6090 con 0x7fe970105160 2024-05-09T00:08:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe974866700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe970100060 0x7fe970101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe974866700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe970100060 0x7fe970101ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44040/0 (socket says 172.21.15.81:44040) 2024-05-09T00:08:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe974866700 1 -- 172.21.15.81:0/1016071647 learned_addr learned my addr 172.21.15.81:0/1016071647 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe96ffff700 1 --2- 172.21.15.81:0/1016071647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe970105160 0x7fe970102010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe975067700 1 --2- 172.21.15.81:0/1016071647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe970102550 0x7fe9701a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe974866700 1 -- 172.21.15.81:0/1016071647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe970105160 msgr2=0x7fe970102010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe974866700 1 --2- 172.21.15.81:0/1016071647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe970105160 0x7fe970102010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe974866700 1 -- 172.21.15.81:0/1016071647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe970102550 msgr2=0x7fe9701a5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe974866700 1 --2- 172.21.15.81:0/1016071647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe970102550 0x7fe9701a5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe974866700 1 -- 172.21.15.81:0/1016071647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe968009d00 con 0x7fe970100060 2024-05-09T00:08:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe974866700 1 --2- 172.21.15.81:0/1016071647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe970100060 0x7fe970101ad0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe96400b530 tx=0x7fe96400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe96dffb700 1 -- 172.21.15.81:0/1016071647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964011830 con 0x7fe970100060 2024-05-09T00:08:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe96dffb700 1 -- 172.21.15.81:0/1016071647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe964011e50 con 0x7fe970100060 2024-05-09T00:08:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe976aca700 1 -- 172.21.15.81:0/1016071647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9701a6370 con 0x7fe970100060 2024-05-09T00:08:00.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.970+0000 7fe96dffb700 1 -- 172.21.15.81:0/1016071647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400f2e0 con 0x7fe970100060 2024-05-09T00:08:00.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.971+0000 7fe976aca700 1 -- 172.21.15.81:0/1016071647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9701a68d0 con 0x7fe970100060 2024-05-09T00:08:00.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.972+0000 7fe96dffb700 1 -- 172.21.15.81:0/1016071647 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe9640105a0 con 0x7fe970100060 2024-05-09T00:08:00.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.973+0000 7fe96dffb700 1 --2- 172.21.15.81:0/1016071647 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe9600a1310 0x7fe9600a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:00.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.973+0000 7fe96ffff700 1 --2- 172.21.15.81:0/1016071647 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe9600a1310 0x7fe9600a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.973+0000 7fe96dffb700 1 -- 172.21.15.81:0/1016071647 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fe9640cc550 con 0x7fe970100060 2024-05-09T00:08:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.973+0000 7fe96ffff700 1 --2- 172.21.15.81:0/1016071647 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe9600a1310 0x7fe9600a37d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe970103200 tx=0x7fe95c00b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.974+0000 7fe982c84b80 1 Processor -- start 2024-05-09T00:08:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.974+0000 7fe982c84b80 1 -- start start 2024-05-09T00:08:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.974+0000 7fe982c84b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a0e80 0x555e003a1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.974+0000 7fe982c84b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a17a0 0x555e0039b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.974+0000 7fe982c84b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e0039b910 0x555e0039bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.974+0000 7fe982c84b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e002f21d0 con 0x555e003a0e80 2024-05-09T00:08:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.974+0000 7fe982c84b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e002efb90 con 0x555e003a17a0 2024-05-09T00:08:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.974+0000 7fe982c84b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e002eb480 con 0x555e0039b910 2024-05-09T00:08:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.974+0000 7fe974866700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a0e80 0x555e003a1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.974+0000 7fe974866700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a0e80 0x555e003a1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44056/0 (socket says 172.21.15.81:44056) 2024-05-09T00:08:00.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.974+0000 7fe974866700 1 -- 172.21.15.81:0/4089037714 learned_addr learned my addr 172.21.15.81:0/4089037714 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.975+0000 7fe96ffff700 1 --2- 172.21.15.81:0/4089037714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a17a0 0x555e0039b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.975+0000 7fe974866700 1 -- 172.21.15.81:0/4089037714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e0039b910 msgr2=0x555e0039bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.975+0000 7fe974866700 1 --2- 172.21.15.81:0/4089037714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e0039b910 0x555e0039bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.975+0000 7fe974866700 1 -- 172.21.15.81:0/4089037714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a17a0 msgr2=0x555e0039b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.975+0000 7fe974866700 1 --2- 172.21.15.81:0/4089037714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a17a0 0x555e0039b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.975+0000 7fe974866700 1 -- 172.21.15.81:0/4089037714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e0016c430 con 0x555e003a0e80 2024-05-09T00:08:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.975+0000 7fe96ffff700 1 --2- 172.21.15.81:0/4089037714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a17a0 0x555e0039b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.975+0000 7fe974866700 1 --2- 172.21.15.81:0/4089037714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a0e80 0x555e003a1260 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fe96400bb90 tx=0x7fe964099610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958b0105dbb6c2ac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.975+0000 7fe95affd700 1 -- 172.21.15.81:0/4089037714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe964099770 con 0x555e003a0e80 2024-05-09T00:08:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.975+0000 7fe95affd700 1 -- 172.21.15.81:0/4089037714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe96409d5a0 con 0x555e003a0e80 2024-05-09T00:08:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.975+0000 7fe95affd700 1 -- 172.21.15.81:0/4089037714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9640b9250 con 0x555e003a0e80 2024-05-09T00:08:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.975+0000 7fe982c84b80 1 -- 172.21.15.81:0/4089037714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a0e80 msgr2=0x555e003a1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:00.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.975+0000 7fe982c84b80 1 --2- 172.21.15.81:0/4089037714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a0e80 0x555e003a1260 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fe96400bb90 tx=0x7fe964099610 comp rx=0 tx=0).stop 2024-05-09T00:08:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 -- 172.21.15.81:0/4089037714 shutdown_connections 2024-05-09T00:08:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 --2- 172.21.15.81:0/4089037714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e0039b910 0x555e0039bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 --2- 172.21.15.81:0/4089037714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a0e80 0x555e003a1260 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 --2- 172.21.15.81:0/4089037714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a17a0 0x555e0039b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 -- 172.21.15.81:0/4089037714 >> 172.21.15.81:0/4089037714 conn(0x555e002f9290 msgr2=0x555e00395e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 -- 172.21.15.81:0/4089037714 shutdown_connections 2024-05-09T00:08:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 -- 172.21.15.81:0/4089037714 wait complete. 2024-05-09T00:08:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 -- start start 2024-05-09T00:08:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 Processor -- start 2024-05-09T00:08:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e0039b910 0x555e003a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a0e80 0x555e003a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e003a17a0 0x555e003a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:00.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e002875e0 con 0x555e003a0e80 2024-05-09T00:08:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e00287280 con 0x555e0039b910 2024-05-09T00:08:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.976+0000 7fe982c84b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0016e720 con 0x555e003a17a0 2024-05-09T00:08:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe982c84b80 10 client.0 _ll_register_callbacks cb 0x555e00290bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe96ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a0e80 0x555e003a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe96ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a0e80 0x555e003a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44072/0 (socket says 172.21.15.81:44072) 2024-05-09T00:08:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe96ffff700 1 -- 172.21.15.81:0/2287875134 learned_addr learned my addr 172.21.15.81:0/2287875134 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe974866700 1 --2- 172.21.15.81:0/2287875134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e0039b910 0x555e003a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe96ffff700 1 -- 172.21.15.81:0/2287875134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e003a17a0 msgr2=0x555e003a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe975067700 1 --2- 172.21.15.81:0/2287875134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e003a17a0 0x555e003a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe96ffff700 1 --2- 172.21.15.81:0/2287875134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e003a17a0 0x555e003a56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe96ffff700 1 -- 172.21.15.81:0/2287875134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e0039b910 msgr2=0x555e003a4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe96ffff700 1 --2- 172.21.15.81:0/2287875134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e0039b910 0x555e003a4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe96ffff700 1 -- 172.21.15.81:0/2287875134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9701a68d0 con 0x555e003a0e80 2024-05-09T00:08:00.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe96ffff700 1 --2- 172.21.15.81:0/2287875134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a0e80 0x555e003a51b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00ba80 tx=0x7fe95c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0218d6795119846 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe94ffff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe94ffff700 1 -- 172.21.15.81:0/2287875134 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c027670 con 0x555e003a0e80 2024-05-09T00:08:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe94ffff700 1 -- 172.21.15.81:0/2287875134 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fe95c017070 con 0x555e003a0e80 2024-05-09T00:08:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe982c84b80 1 -- 172.21.15.81:0/2287875134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e002442f0 con 0x555e003a0e80 2024-05-09T00:08:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe94ffff700 1 -- 172.21.15.81:0/2287875134 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe95c011e40 con 0x555e003a0e80 2024-05-09T00:08:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe982c84b80 10 client.16881 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.977+0000 7fe982c84b80 1 -- 172.21.15.81:0/2287875134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555e00118be0 con 0x555e003a0e80 2024-05-09T00:08:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.978+0000 7fe94ffff700 1 -- 172.21.15.81:0/2287875134 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555e002442f0 con 0x555e003a0e80 2024-05-09T00:08:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.978+0000 7fe94ffff700 1 -- 172.21.15.81:0/2287875134 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe95c01e5c0 con 0x555e003a0e80 2024-05-09T00:08:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.978+0000 7fe982c84b80 10 client.16881 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.978+0000 7fe982c84b80 10 client.16881 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.978+0000 7fe982c84b80 20 client.16881 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.978+0000 7fe982c84b80 1 --2- 172.21.15.81:0/2287875134 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555e003b52a0 0x555e003b76c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.978+0000 7fe982c84b80 4 client.16881 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:08:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.978+0000 7fe982c84b80 1 -- 172.21.15.81:0/2287875134 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e0036a890 con 0x555e003b52a0 2024-05-09T00:08:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.978+0000 7fe974866700 1 --2- 172.21.15.81:0/2287875134 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555e003b52a0 0x555e003b76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.978+0000 7fe94ffff700 10 client.16881 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.978+0000 7fe974866700 1 --2- 172.21.15.81:0/2287875134 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555e003b52a0 0x555e003b76c0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=647250c188600bb6 server_cookie=6975c03f3d6b83a1 in_seq=0 out_seq=0 2024-05-09T00:08:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.979+0000 7fe94ffff700 1 -- 172.21.15.81:0/2287875134 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555e0036a890 con 0x555e003b52a0 2024-05-09T00:08:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.979+0000 7fe94ffff700 10 client.16881 handle_command_reply: tid=0 2024-05-09T00:08:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.979+0000 7fe982c84b80 1 client.16881 shutdown 2024-05-09T00:08:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.979+0000 7fe982c84b80 1 -- 172.21.15.81:0/2287875134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a0e80 msgr2=0x555e003a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.979+0000 7fe982c84b80 1 --2- 172.21.15.81:0/2287875134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a0e80 0x555e003a51b0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00ba80 tx=0x7fe95c0047c0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.979+0000 7fe982c84b80 1 -- 172.21.15.81:0/2287875134 shutdown_connections 2024-05-09T00:08:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.979+0000 7fe982c84b80 1 --2- 172.21.15.81:0/2287875134 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555e003b52a0 0x555e003b76c0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.979+0000 7fe982c84b80 1 --2- 172.21.15.81:0/2287875134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e0039b910 0x555e003a4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.979+0000 7fe94ffff700 0 client.16881 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.979+0000 7fe982c84b80 1 --2- 172.21.15.81:0/2287875134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e003a17a0 0x555e003a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.979+0000 7fe982c84b80 1 --2- 172.21.15.81:0/2287875134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a0e80 0x555e003a51b0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.979+0000 7fe982c84b80 1 -- 172.21.15.81:0/2287875134 >> 172.21.15.81:0/2287875134 conn(0x555e002f9290 msgr2=0x555e00395620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.979+0000 7fe982c84b80 1 -- 172.21.15.81:0/2287875134 shutdown_connections 2024-05-09T00:08:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.980+0000 7fe982c84b80 1 -- 172.21.15.81:0/2287875134 wait complete. 2024-05-09T00:08:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.980+0000 7fe982c84b80 20 client.16881 trim_cache size 0 max 16384 2024-05-09T00:08:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe982c84b80 1 Processor -- start 2024-05-09T00:08:00.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe982c84b80 1 -- start start 2024-05-09T00:08:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe982c84b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e0039b910 0x555e0039b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe982c84b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a0e80 0x555e003a0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe982c84b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a17a0 0x555e00395da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe982c84b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e003a7810 con 0x555e003a17a0 2024-05-09T00:08:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe982c84b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e003b1ef0 con 0x555e003a0e80 2024-05-09T00:08:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe982c84b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0038e0f0 con 0x555e0039b910 2024-05-09T00:08:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe975067700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a17a0 0x555e00395da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe975067700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a17a0 0x555e00395da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44076/0 (socket says 172.21.15.81:44076) 2024-05-09T00:08:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe975067700 1 -- 172.21.15.81:0/407163566 learned_addr learned my addr 172.21.15.81:0/407163566 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe96ffff700 1 --2- 172.21.15.81:0/407163566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a0e80 0x555e003a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe974866700 1 --2- 172.21.15.81:0/407163566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e0039b910 0x555e0039b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe975067700 1 -- 172.21.15.81:0/407163566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e0039b910 msgr2=0x555e0039b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe975067700 1 --2- 172.21.15.81:0/407163566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e0039b910 0x555e0039b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe975067700 1 -- 172.21.15.81:0/407163566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a0e80 msgr2=0x555e003a0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe975067700 1 --2- 172.21.15.81:0/407163566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a0e80 0x555e003a0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe975067700 1 -- 172.21.15.81:0/407163566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e00392560 con 0x555e003a17a0 2024-05-09T00:08:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.997+0000 7fe975067700 1 --2- 172.21.15.81:0/407163566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a17a0 0x555e00395da0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe968009a20 tx=0x7fe968007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac70627edae633c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.998+0000 7fe95b7fe700 1 -- 172.21.15.81:0/407163566 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96800e070 con 0x555e003a17a0 2024-05-09T00:08:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.998+0000 7fe95b7fe700 1 -- 172.21.15.81:0/407163566 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe968007e30 con 0x555e003a17a0 2024-05-09T00:08:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.998+0000 7fe95b7fe700 1 -- 172.21.15.81:0/407163566 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9680256c0 con 0x555e003a17a0 2024-05-09T00:08:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.998+0000 7fe982c84b80 1 -- 172.21.15.81:0/407163566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a17a0 msgr2=0x555e00395da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.998+0000 7fe982c84b80 1 --2- 172.21.15.81:0/407163566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a17a0 0x555e00395da0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fe968009a20 tx=0x7fe968007cc0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.998+0000 7fe982c84b80 1 -- 172.21.15.81:0/407163566 shutdown_connections 2024-05-09T00:08:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.998+0000 7fe982c84b80 1 --2- 172.21.15.81:0/407163566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e003a17a0 0x555e00395da0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.998+0000 7fe982c84b80 1 --2- 172.21.15.81:0/407163566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e0039b910 0x555e0039b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:00.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.998+0000 7fe982c84b80 1 --2- 172.21.15.81:0/407163566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a0e80 0x555e003a0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.998+0000 7fe982c84b80 1 -- 172.21.15.81:0/407163566 >> 172.21.15.81:0/407163566 conn(0x555e002f9290 msgr2=0x555e0039fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.998+0000 7fe982c84b80 1 -- 172.21.15.81:0/407163566 shutdown_connections 2024-05-09T00:08:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.998+0000 7fe982c84b80 1 -- 172.21.15.81:0/407163566 wait complete. 2024-05-09T00:08:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe982c84b80 1 -- start start 2024-05-09T00:08:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe982c84b80 1 Processor -- start 2024-05-09T00:08:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe982c84b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e0039b910 0x555e003aac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe982c84b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e003a0e80 0x555e003ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe982c84b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a17a0 0x555e003ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe982c84b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0040b7b0 con 0x555e0039b910 2024-05-09T00:08:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe982c84b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0040b8f0 con 0x555e003a17a0 2024-05-09T00:08:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe982c84b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e0040ba30 con 0x555e003a0e80 2024-05-09T00:08:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe982c84b80 10 client.0 _ll_register_callbacks cb 0x555e00290bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe974866700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e0039b910 0x555e003aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe974866700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e0039b910 0x555e003aac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44084/0 (socket says 172.21.15.81:44084) 2024-05-09T00:08:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe974866700 1 -- 172.21.15.81:0/1493536369 learned_addr learned my addr 172.21.15.81:0/1493536369 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe96ffff700 1 --2- 172.21.15.81:0/1493536369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e003a0e80 0x555e003ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe975067700 1 --2- 172.21.15.81:0/1493536369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a17a0 0x555e003ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe974866700 1 -- 172.21.15.81:0/1493536369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e003a0e80 msgr2=0x555e003ab170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe974866700 1 --2- 172.21.15.81:0/1493536369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e003a0e80 0x555e003ab170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe974866700 1 -- 172.21.15.81:0/1493536369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a17a0 msgr2=0x555e003ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe974866700 1 --2- 172.21.15.81:0/1493536369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a17a0 0x555e003ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe974866700 1 -- 172.21.15.81:0/1493536369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97010d550 con 0x555e0039b910 2024-05-09T00:08:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:00.999+0000 7fe975067700 1 --2- 172.21.15.81:0/1493536369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a17a0 0x555e003ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe974866700 1 --2- 172.21.15.81:0/1493536369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e0039b910 0x555e003aac30 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe964099470 tx=0x7fe964000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c7911372ef4302 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe94ffff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe94ffff700 1 -- 172.21.15.81:0/1493536369 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9640b2130 con 0x555e0039b910 2024-05-09T00:08:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe982c84b80 1 -- 172.21.15.81:0/1493536369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe96409d5a0 con 0x555e0039b910 2024-05-09T00:08:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe94ffff700 1 -- 172.21.15.81:0/1493536369 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fe9640a1e40 con 0x555e0039b910 2024-05-09T00:08:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe94ffff700 1 -- 172.21.15.81:0/1493536369 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe964099770 con 0x555e0039b910 2024-05-09T00:08:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe982c84b80 10 client.16887 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe982c84b80 1 -- 172.21.15.81:0/1493536369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555e002b15e0 con 0x555e0039b910 2024-05-09T00:08:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe94ffff700 1 -- 172.21.15.81:0/1493536369 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe96409d5a0 con 0x555e0039b910 2024-05-09T00:08:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe94ffff700 1 -- 172.21.15.81:0/1493536369 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe964099a60 con 0x555e0039b910 2024-05-09T00:08:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe982c84b80 10 client.16887 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe982c84b80 10 client.16887 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe982c84b80 20 client.16887 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe982c84b80 1 --2- 172.21.15.81:0/1493536369 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555e0040cf10 0x555e0040f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe982c84b80 4 client.16887 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:08:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe982c84b80 1 -- 172.21.15.81:0/1493536369 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555e002e3f40 con 0x555e0040cf10 2024-05-09T00:08:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.000+0000 7fe96ffff700 1 --2- 172.21.15.81:0/1493536369 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555e0040cf10 0x555e0040f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.001+0000 7fe96ffff700 1 --2- 172.21.15.81:0/1493536369 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555e0040cf10 0x555e0040f330 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=136e6b621ede85e9 server_cookie=507e1e764e0ccaeb in_seq=0 out_seq=0 2024-05-09T00:08:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.001+0000 7fe94ffff700 10 client.16887 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe94ffff700 1 -- 172.21.15.81:0/1493536369 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555e002e3f40 con 0x555e0040cf10 2024-05-09T00:08:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe94ffff700 10 client.16887 handle_command_reply: tid=0 2024-05-09T00:08:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe982c84b80 1 client.16887 shutdown 2024-05-09T00:08:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe982c84b80 1 -- 172.21.15.81:0/1493536369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e0039b910 msgr2=0x555e003aac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe982c84b80 1 --2- 172.21.15.81:0/1493536369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e0039b910 0x555e003aac30 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe964099470 tx=0x7fe964000bc0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe982c84b80 1 -- 172.21.15.81:0/1493536369 shutdown_connections 2024-05-09T00:08:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe982c84b80 1 --2- 172.21.15.81:0/1493536369 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555e0040cf10 0x555e0040f330 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe982c84b80 1 --2- 172.21.15.81:0/1493536369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555e003a17a0 0x555e003ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe982c84b80 1 --2- 172.21.15.81:0/1493536369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555e0039b910 0x555e003aac30 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe94ffff700 0 client.16887 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe982c84b80 1 --2- 172.21.15.81:0/1493536369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555e003a0e80 0x555e003ab170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe982c84b80 1 -- 172.21.15.81:0/1493536369 >> 172.21.15.81:0/1493536369 conn(0x555e002f9290 msgr2=0x555e003a6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe982c84b80 1 -- 172.21.15.81:0/1493536369 shutdown_connections 2024-05-09T00:08:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe982c84b80 1 -- 172.21.15.81:0/1493536369 wait complete. 2024-05-09T00:08:01.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.002+0000 7fe982c84b80 20 client.16887 trim_cache size 0 max 16384 2024-05-09T00:08:01.004 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:08:01.004 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:08:01.004 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "2ecdd55d-d59a-497a-aca3-04528e0fafba", 2024-05-09T00:08:01.004 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:08:01.004 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:08:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.003+0000 7fe976aca700 1 -- 172.21.15.81:0/1016071647 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe9600a1310 msgr2=0x7fe9600a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.003+0000 7fe976aca700 1 --2- 172.21.15.81:0/1016071647 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe9600a1310 0x7fe9600a37d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe970103200 tx=0x7fe95c00b410 comp rx=0 tx=0).stop 2024-05-09T00:08:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.003+0000 7fe976aca700 1 -- 172.21.15.81:0/1016071647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe970100060 msgr2=0x7fe970101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.003+0000 7fe976aca700 1 --2- 172.21.15.81:0/1016071647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe970100060 0x7fe970101ad0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fe96400b530 tx=0x7fe96400b840 comp rx=0 tx=0).stop 2024-05-09T00:08:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.003+0000 7fe976aca700 1 -- 172.21.15.81:0/1016071647 shutdown_connections 2024-05-09T00:08:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.003+0000 7fe976aca700 1 --2- 172.21.15.81:0/1016071647 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe9600a1310 0x7fe9600a37d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.003+0000 7fe976aca700 1 --2- 172.21.15.81:0/1016071647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe970102550 0x7fe9701a5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.003+0000 7fe976aca700 1 --2- 172.21.15.81:0/1016071647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe970100060 0x7fe970101ad0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.003+0000 7fe976aca700 1 --2- 172.21.15.81:0/1016071647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe970105160 0x7fe970102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.003+0000 7fe976aca700 1 -- 172.21.15.81:0/1016071647 >> 172.21.15.81:0/1016071647 conn(0x7fe970076f40 msgr2=0x7fe970068350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.003+0000 7fe976aca700 1 -- 172.21.15.81:0/1016071647 shutdown_connections 2024-05-09T00:08:01.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.003+0000 7fe976aca700 1 -- 172.21.15.81:0/1016071647 wait complete. 2024-05-09T00:08:01.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:08:01.120 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:01 smithi081 ceph-mon[42474]: pgmap v155: 97 pgs: 97 active+clean; 2.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-05-09T00:08:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.142+0000 7fb01cf7f700 1 -- 172.21.15.81:0/1777535878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180694e0 msgr2=0x7fb0180698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.142+0000 7fb01cf7f700 1 --2- 172.21.15.81:0/1777535878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180694e0 0x7fb0180698c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fb00c0099c0 tx=0x7fb00c009cd0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.142+0000 7fb01cf7f700 1 -- 172.21.15.81:0/1777535878 shutdown_connections 2024-05-09T00:08:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.142+0000 7fb01cf7f700 1 --2- 172.21.15.81:0/1777535878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb018106290 0x7fb01810de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.142+0000 7fb01cf7f700 1 --2- 172.21.15.81:0/1777535878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180694e0 0x7fb0180698c0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.142+0000 7fb01cf7f700 1 --2- 172.21.15.81:0/1777535878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb018069e90 0x7fb018105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.142+0000 7fb01cf7f700 1 -- 172.21.15.81:0/1777535878 >> 172.21.15.81:0/1777535878 conn(0x7fb018076f30 msgr2=0x7fb018077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.142+0000 7fb01cf7f700 1 -- 172.21.15.81:0/1777535878 shutdown_connections 2024-05-09T00:08:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.142+0000 7fb01cf7f700 1 -- 172.21.15.81:0/1777535878 wait complete. 2024-05-09T00:08:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01cf7f700 1 Processor -- start 2024-05-09T00:08:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01cf7f700 1 -- start start 2024-05-09T00:08:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01cf7f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180694e0 0x7fb018199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01cf7f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb018106290 0x7fb018199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01cf7f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb01819dea0 0x7fb01819e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01cf7f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01819e920 con 0x7fb0180694e0 2024-05-09T00:08:01.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01cf7f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01819ea90 con 0x7fb018106290 2024-05-09T00:08:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01cf7f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01819ec50 con 0x7fb01819dea0 2024-05-09T00:08:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180694e0 0x7fb018199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180694e0 0x7fb018199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44094/0 (socket says 172.21.15.81:44094) 2024-05-09T00:08:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01659c700 1 -- 172.21.15.81:0/3168271627 learned_addr learned my addr 172.21.15.81:0/3168271627 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb016d9d700 1 --2- 172.21.15.81:0/3168271627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb01819dea0 0x7fb01819e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb015d9b700 1 --2- 172.21.15.81:0/3168271627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb018106290 0x7fb018199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01659c700 1 -- 172.21.15.81:0/3168271627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb01819dea0 msgr2=0x7fb01819e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01659c700 1 --2- 172.21.15.81:0/3168271627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb01819dea0 0x7fb01819e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01659c700 1 -- 172.21.15.81:0/3168271627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb018106290 msgr2=0x7fb018199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01659c700 1 --2- 172.21.15.81:0/3168271627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb018106290 0x7fb018199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01659c700 1 -- 172.21.15.81:0/3168271627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c0095f0 con 0x7fb0180694e0 2024-05-09T00:08:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.143+0000 7fb01659c700 1 --2- 172.21.15.81:0/3168271627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180694e0 0x7fb018199610 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00c010 tx=0x7fb00c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.144+0000 7fb0077fe700 1 -- 172.21.15.81:0/3168271627 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c01c070 con 0x7fb0180694e0 2024-05-09T00:08:01.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.144+0000 7fb0077fe700 1 -- 172.21.15.81:0/3168271627 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb00c00fdb0 con 0x7fb0180694e0 2024-05-09T00:08:01.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.144+0000 7fb01cf7f700 1 -- 172.21.15.81:0/3168271627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0181a6150 con 0x7fb0180694e0 2024-05-09T00:08:01.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.144+0000 7fb0077fe700 1 -- 172.21.15.81:0/3168271627 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c022cd0 con 0x7fb0180694e0 2024-05-09T00:08:01.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.144+0000 7fb01cf7f700 1 -- 172.21.15.81:0/3168271627 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0181a65d0 con 0x7fb0180694e0 2024-05-09T00:08:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.146+0000 7fb0077fe700 1 -- 172.21.15.81:0/3168271627 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fb00c020070 con 0x7fb0180694e0 2024-05-09T00:08:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.146+0000 7fb0077fe700 1 --2- 172.21.15.81:0/3168271627 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb0000a1310 0x7fb0000a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.146+0000 7fb0077fe700 1 -- 172.21.15.81:0/3168271627 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb00c0cd990 con 0x7fb0180694e0 2024-05-09T00:08:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.146+0000 7fb015d9b700 1 --2- 172.21.15.81:0/3168271627 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb0000a1310 0x7fb0000a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.147+0000 7fb015d9b700 1 --2- 172.21.15.81:0/3168271627 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb0000a1310 0x7fb0000a37d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb01819ab10 tx=0x7fb008009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.147+0000 7fb029139b80 1 Processor -- start 2024-05-09T00:08:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.147+0000 7fb029139b80 1 -- start start 2024-05-09T00:08:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.147+0000 7fb029139b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818715e00 0x5628187161e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb029139b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818716720 0x562818710350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb029139b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x562818710cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb029139b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562818667150 con 0x562818716720 2024-05-09T00:08:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb029139b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562818664b10 con 0x562818715e00 2024-05-09T00:08:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb029139b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x562818660400 con 0x562818710890 2024-05-09T00:08:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb015d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818716720 0x562818710350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb015d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818716720 0x562818710350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44108/0 (socket says 172.21.15.81:44108) 2024-05-09T00:08:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb015d9b700 1 -- 172.21.15.81:0/1483690942 learned_addr learned my addr 172.21.15.81:0/1483690942 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb01659c700 1 --2- 172.21.15.81:0/1483690942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818715e00 0x5628187161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb015d9b700 1 -- 172.21.15.81:0/1483690942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 msgr2=0x562818710cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb015d9b700 1 --2- 172.21.15.81:0/1483690942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x562818710cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb015d9b700 1 -- 172.21.15.81:0/1483690942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818715e00 msgr2=0x5628187161e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb015d9b700 1 --2- 172.21.15.81:0/1483690942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818715e00 0x5628187161e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb015d9b700 1 -- 172.21.15.81:0/1483690942 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628184e13b0 con 0x562818716720 2024-05-09T00:08:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb01659c700 1 --2- 172.21.15.81:0/1483690942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818715e00 0x5628187161e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb015d9b700 1 --2- 172.21.15.81:0/1483690942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818716720 0x562818710350 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb008011d20 tx=0x7fb008014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd91de733102dba7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb004ff9700 1 -- 172.21.15.81:0/1483690942 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00800ebd0 con 0x562818716720 2024-05-09T00:08:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb004ff9700 1 -- 172.21.15.81:0/1483690942 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb008021070 con 0x562818716720 2024-05-09T00:08:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.148+0000 7fb004ff9700 1 -- 172.21.15.81:0/1483690942 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00801d670 con 0x562818716720 2024-05-09T00:08:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.149+0000 7fb029139b80 1 -- 172.21.15.81:0/1483690942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818716720 msgr2=0x562818710350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.149+0000 7fb029139b80 1 --2- 172.21.15.81:0/1483690942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818716720 0x562818710350 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fb008011d20 tx=0x7fb008014000 comp rx=0 tx=0).stop 2024-05-09T00:08:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.149+0000 7fb029139b80 1 -- 172.21.15.81:0/1483690942 shutdown_connections 2024-05-09T00:08:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.149+0000 7fb029139b80 1 --2- 172.21.15.81:0/1483690942 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818715e00 0x5628187161e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.149+0000 7fb029139b80 1 --2- 172.21.15.81:0/1483690942 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x562818710cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.149+0000 7fb029139b80 1 --2- 172.21.15.81:0/1483690942 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818716720 0x562818710350 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.149+0000 7fb029139b80 1 -- 172.21.15.81:0/1483690942 >> 172.21.15.81:0/1483690942 conn(0x56281866e210 msgr2=0x56281870adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.149+0000 7fb029139b80 1 -- 172.21.15.81:0/1483690942 shutdown_connections 2024-05-09T00:08:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.149+0000 7fb029139b80 1 -- 172.21.15.81:0/1483690942 wait complete. 2024-05-09T00:08:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.149+0000 7fb029139b80 1 -- start start 2024-05-09T00:08:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb029139b80 1 Processor -- start 2024-05-09T00:08:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb029139b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x562818719b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb029139b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818715e00 0x56281871a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb029139b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818716720 0x56281871a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb029139b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628185fc560 con 0x562818715e00 2024-05-09T00:08:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb029139b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628185fc200 con 0x562818716720 2024-05-09T00:08:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb029139b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628184e36a0 con 0x562818710890 2024-05-09T00:08:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb029139b80 10 client.0 _ll_register_callbacks cb 0x562818605b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb015d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818715e00 0x56281871a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb015d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818715e00 0x56281871a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44114/0 (socket says 172.21.15.81:44114) 2024-05-09T00:08:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb015d9b700 1 -- 172.21.15.81:0/1528383731 learned_addr learned my addr 172.21.15.81:0/1528383731 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb01659c700 1 --2- 172.21.15.81:0/1528383731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x562818719b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb016d9d700 1 --2- 172.21.15.81:0/1528383731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818716720 0x56281871a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb015d9b700 1 -- 172.21.15.81:0/1528383731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 msgr2=0x562818719b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb015d9b700 1 --2- 172.21.15.81:0/1528383731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x562818719b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb015d9b700 1 -- 172.21.15.81:0/1528383731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818716720 msgr2=0x56281871a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb015d9b700 1 --2- 172.21.15.81:0/1528383731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818716720 0x56281871a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb015d9b700 1 -- 172.21.15.81:0/1528383731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb008017070 con 0x562818715e00 2024-05-09T00:08:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb016d9d700 1 --2- 172.21.15.81:0/1528383731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818716720 0x56281871a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7fb015d9b700 1 --2- 172.21.15.81:0/1528383731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818715e00 0x56281871a0a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb00801cfc0 tx=0x7fb00800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bf315889863eb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7faffdffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.150+0000 7faffdffb700 1 -- 172.21.15.81:0/1528383731 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb008005250 con 0x562818715e00 2024-05-09T00:08:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.151+0000 7faffdffb700 1 -- 172.21.15.81:0/1528383731 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb0080053b0 con 0x562818715e00 2024-05-09T00:08:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.151+0000 7fb029139b80 1 -- 172.21.15.81:0/1528383731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628185b9270 con 0x562818715e00 2024-05-09T00:08:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.151+0000 7faffdffb700 1 -- 172.21.15.81:0/1528383731 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb008005570 con 0x562818715e00 2024-05-09T00:08:01.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.151+0000 7fb029139b80 10 client.16899 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:01.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.151+0000 7fb029139b80 1 -- 172.21.15.81:0/1528383731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56281848db60 con 0x562818715e00 2024-05-09T00:08:01.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.151+0000 7faffdffb700 1 -- 172.21.15.81:0/1528383731 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb00803b020 con 0x562818715e00 2024-05-09T00:08:01.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.151+0000 7faffdffb700 1 -- 172.21.15.81:0/1528383731 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb008003a20 con 0x562818715e00 2024-05-09T00:08:01.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.151+0000 7fb029139b80 10 client.16899 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:01.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.151+0000 7fb029139b80 10 client.16899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:01.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.151+0000 7fb029139b80 20 client.16899 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:01.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.151+0000 7fb029139b80 1 --2- 172.21.15.81:0/1528383731 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56281872a160 0x56281872c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.151+0000 7fb029139b80 4 client.16899 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:08:01.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.151+0000 7fb029139b80 1 -- 172.21.15.81:0/1528383731 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628186df810 con 0x56281872a160 2024-05-09T00:08:01.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.151+0000 7fb01659c700 1 --2- 172.21.15.81:0/1528383731 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56281872a160 0x56281872c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.152+0000 7faffdffb700 10 client.16899 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:01.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.152+0000 7fb01659c700 1 --2- 172.21.15.81:0/1528383731 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56281872a160 0x56281872c580 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1948c6480c808466 server_cookie=ac5661fb851ec32a in_seq=0 out_seq=0 2024-05-09T00:08:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.152+0000 7faffdffb700 1 -- 172.21.15.81:0/1528383731 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5628186df810 con 0x56281872a160 2024-05-09T00:08:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.152+0000 7faffdffb700 10 client.16899 handle_command_reply: tid=0 2024-05-09T00:08:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.152+0000 7fb029139b80 1 client.16899 shutdown 2024-05-09T00:08:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.152+0000 7fb029139b80 1 -- 172.21.15.81:0/1528383731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818715e00 msgr2=0x56281871a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.152+0000 7fb029139b80 1 --2- 172.21.15.81:0/1528383731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818715e00 0x56281871a0a0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fb00801cfc0 tx=0x7fb00800ebd0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.152+0000 7fb029139b80 1 -- 172.21.15.81:0/1528383731 shutdown_connections 2024-05-09T00:08:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.152+0000 7fb029139b80 1 --2- 172.21.15.81:0/1528383731 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56281872a160 0x56281872c580 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.152+0000 7fb029139b80 1 --2- 172.21.15.81:0/1528383731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818716720 0x56281871a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.152+0000 7faffdffb700 0 client.16899 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.152+0000 7fb029139b80 1 --2- 172.21.15.81:0/1528383731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x562818719b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.152+0000 7fb029139b80 1 --2- 172.21.15.81:0/1528383731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818715e00 0x56281871a0a0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.152+0000 7fb029139b80 1 -- 172.21.15.81:0/1528383731 >> 172.21.15.81:0/1528383731 conn(0x56281866e210 msgr2=0x56281870a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.153+0000 7fb029139b80 1 -- 172.21.15.81:0/1528383731 shutdown_connections 2024-05-09T00:08:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.153+0000 7fb029139b80 1 -- 172.21.15.81:0/1528383731 wait complete. 2024-05-09T00:08:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.153+0000 7fb029139b80 20 client.16899 trim_cache size 0 max 16384 2024-05-09T00:08:01.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.169+0000 7fb029139b80 1 Processor -- start 2024-05-09T00:08:01.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.169+0000 7fb029139b80 1 -- start start 2024-05-09T00:08:01.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb029139b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x56281870ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb029139b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818715e00 0x562818721170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb029139b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818716720 0x5628187216b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb029139b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628187106d0 con 0x562818716720 2024-05-09T00:08:01.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb029139b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56281871cc20 con 0x562818715e00 2024-05-09T00:08:01.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb029139b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x562818731770 con 0x562818710890 2024-05-09T00:08:01.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb016d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818716720 0x5628187216b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb016d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818716720 0x5628187216b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44130/0 (socket says 172.21.15.81:44130) 2024-05-09T00:08:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb016d9d700 1 -- 172.21.15.81:0/2648032085 learned_addr learned my addr 172.21.15.81:0/2648032085 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb015d9b700 1 --2- 172.21.15.81:0/2648032085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818715e00 0x562818721170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb01659c700 1 --2- 172.21.15.81:0/2648032085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x56281870ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb016d9d700 1 -- 172.21.15.81:0/2648032085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 msgr2=0x56281870ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb016d9d700 1 --2- 172.21.15.81:0/2648032085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x56281870ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb016d9d700 1 -- 172.21.15.81:0/2648032085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818715e00 msgr2=0x562818721170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb016d9d700 1 --2- 172.21.15.81:0/2648032085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818715e00 0x562818721170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb016d9d700 1 -- 172.21.15.81:0/2648032085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562818626560 con 0x562818716720 2024-05-09T00:08:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb015d9b700 1 --2- 172.21.15.81:0/2648032085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818715e00 0x562818721170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb01659c700 1 --2- 172.21.15.81:0/2648032085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x56281870ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb016d9d700 1 --2- 172.21.15.81:0/2648032085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818716720 0x5628187216b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb010003fb0 tx=0x7fb010009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782ccaeb28caee17 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb0057fa700 1 -- 172.21.15.81:0/2648032085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100046d0 con 0x562818716720 2024-05-09T00:08:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb0057fa700 1 -- 172.21.15.81:0/2648032085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb01000f040 con 0x562818716720 2024-05-09T00:08:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.170+0000 7fb0057fa700 1 -- 172.21.15.81:0/2648032085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010016750 con 0x562818716720 2024-05-09T00:08:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.171+0000 7fb029139b80 1 -- 172.21.15.81:0/2648032085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818716720 msgr2=0x5628187216b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.171+0000 7fb029139b80 1 --2- 172.21.15.81:0/2648032085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818716720 0x5628187216b0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fb010003fb0 tx=0x7fb010009ba0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.171+0000 7fb029139b80 1 -- 172.21.15.81:0/2648032085 shutdown_connections 2024-05-09T00:08:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.171+0000 7fb029139b80 1 --2- 172.21.15.81:0/2648032085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818716720 0x5628187216b0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.171+0000 7fb029139b80 1 --2- 172.21.15.81:0/2648032085 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x56281870ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.171+0000 7fb029139b80 1 --2- 172.21.15.81:0/2648032085 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818715e00 0x562818721170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.171+0000 7fb029139b80 1 -- 172.21.15.81:0/2648032085 >> 172.21.15.81:0/2648032085 conn(0x56281866e210 msgr2=0x562818713cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.171+0000 7fb029139b80 1 -- 172.21.15.81:0/2648032085 shutdown_connections 2024-05-09T00:08:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.171+0000 7fb029139b80 1 -- 172.21.15.81:0/2648032085 wait complete. 2024-05-09T00:08:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.171+0000 7fb029139b80 1 -- start start 2024-05-09T00:08:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.171+0000 7fb029139b80 1 Processor -- start 2024-05-09T00:08:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb029139b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x562818778a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb029139b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818715e00 0x562818778f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb029139b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818716720 0x5628187745f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb029139b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562818774cd0 con 0x562818715e00 2024-05-09T00:08:01.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb029139b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562818774e40 con 0x562818716720 2024-05-09T00:08:01.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb029139b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x562818775000 con 0x562818710890 2024-05-09T00:08:01.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb029139b80 10 client.0 _ll_register_callbacks cb 0x562818605b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:01.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb015d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818715e00 0x562818778f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb015d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818715e00 0x562818778f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44134/0 (socket says 172.21.15.81:44134) 2024-05-09T00:08:01.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb015d9b700 1 -- 172.21.15.81:0/1030734952 learned_addr learned my addr 172.21.15.81:0/1030734952 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:01.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb016d9d700 1 --2- 172.21.15.81:0/1030734952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818716720 0x5628187745f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb015d9b700 1 -- 172.21.15.81:0/1030734952 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 msgr2=0x562818778a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb015d9b700 1 --2- 172.21.15.81:0/1030734952 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x562818778a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb015d9b700 1 -- 172.21.15.81:0/1030734952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818716720 msgr2=0x5628187745f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb015d9b700 1 --2- 172.21.15.81:0/1030734952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818716720 0x5628187745f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb015d9b700 1 -- 172.21.15.81:0/1030734952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb010003c60 con 0x562818715e00 2024-05-09T00:08:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb015d9b700 1 --2- 172.21.15.81:0/1030734952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818715e00 0x562818778f80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x56281871b0a0 tx=0x7fb008003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8076072187f949f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7faffdffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7faffdffb700 1 -- 172.21.15.81:0/1030734952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00802e450 con 0x562818715e00 2024-05-09T00:08:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7faffdffb700 1 -- 172.21.15.81:0/1030734952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fb00803c080 con 0x562818715e00 2024-05-09T00:08:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb029139b80 1 -- 172.21.15.81:0/1030734952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb008021070 con 0x562818715e00 2024-05-09T00:08:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7faffdffb700 1 -- 172.21.15.81:0/1030734952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0080092d0 con 0x562818715e00 2024-05-09T00:08:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb029139b80 10 client.16905 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7fb029139b80 1 -- 172.21.15.81:0/1030734952 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5628184e5cd0 con 0x562818715e00 2024-05-09T00:08:01.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.172+0000 7faffdffb700 1 -- 172.21.15.81:0/1030734952 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb008021070 con 0x562818715e00 2024-05-09T00:08:01.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.173+0000 7faffdffb700 1 -- 172.21.15.81:0/1030734952 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb00802e6e0 con 0x562818715e00 2024-05-09T00:08:01.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.173+0000 7fb029139b80 10 client.16905 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:01.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.173+0000 7fb029139b80 10 client.16905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:01.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.173+0000 7fb029139b80 20 client.16905 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:01.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.173+0000 7fb029139b80 1 --2- 172.21.15.81:0/1030734952 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562818781630 0x562818783a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.173+0000 7fb029139b80 4 client.16905 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:08:01.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.173+0000 7fb029139b80 1 -- 172.21.15.81:0/1030734952 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562818658ec0 con 0x562818781630 2024-05-09T00:08:01.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.173+0000 7fb01659c700 1 --2- 172.21.15.81:0/1030734952 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562818781630 0x562818783a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.173+0000 7fb01659c700 1 --2- 172.21.15.81:0/1030734952 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562818781630 0x562818783a50 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54d726589ed1bcb4 server_cookie=3eed514aa133a487 in_seq=0 out_seq=0 2024-05-09T00:08:01.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.173+0000 7faffdffb700 10 client.16905 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:01.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.173+0000 7faffdffb700 1 -- 172.21.15.81:0/1030734952 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562818658ec0 con 0x562818781630 2024-05-09T00:08:01.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.173+0000 7faffdffb700 10 client.16905 handle_command_reply: tid=0 2024-05-09T00:08:01.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.173+0000 7fb029139b80 1 client.16905 shutdown 2024-05-09T00:08:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb029139b80 1 -- 172.21.15.81:0/1030734952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818715e00 msgr2=0x562818778f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb029139b80 1 --2- 172.21.15.81:0/1030734952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818715e00 0x562818778f80 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x56281871b0a0 tx=0x7fb008003960 comp rx=0 tx=0).stop 2024-05-09T00:08:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb029139b80 1 -- 172.21.15.81:0/1030734952 shutdown_connections 2024-05-09T00:08:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb029139b80 1 --2- 172.21.15.81:0/1030734952 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562818781630 0x562818783a50 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb029139b80 1 --2- 172.21.15.81:0/1030734952 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562818716720 0x5628187745f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb029139b80 1 --2- 172.21.15.81:0/1030734952 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562818710890 0x562818778a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb029139b80 1 --2- 172.21.15.81:0/1030734952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562818715e00 0x562818778f80 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7faffdffb700 0 client.16905 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb029139b80 1 -- 172.21.15.81:0/1030734952 >> 172.21.15.81:0/1030734952 conn(0x56281866e210 msgr2=0x562818714c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb029139b80 1 -- 172.21.15.81:0/1030734952 shutdown_connections 2024-05-09T00:08:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb029139b80 1 -- 172.21.15.81:0/1030734952 wait complete. 2024-05-09T00:08:01.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb029139b80 20 client.16905 trim_cache size 0 max 16384 2024-05-09T00:08:01.178 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:08:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:08:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:08:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "2ecdd55d-d59a-497a-aca3-04528e0fafba": { 2024-05-09T00:08:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:08:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "2ecdd55d-d59a-497a-aca3-04528e0fafba", 2024-05-09T00:08:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:08:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:08:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:08:01.178 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:08:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb01cf7f700 1 -- 172.21.15.81:0/3168271627 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb0000a1310 msgr2=0x7fb0000a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb01cf7f700 1 --2- 172.21.15.81:0/3168271627 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb0000a1310 0x7fb0000a37d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb01819ab10 tx=0x7fb008009260 comp rx=0 tx=0).stop 2024-05-09T00:08:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb01cf7f700 1 -- 172.21.15.81:0/3168271627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180694e0 msgr2=0x7fb018199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb01cf7f700 1 --2- 172.21.15.81:0/3168271627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180694e0 0x7fb018199610 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00c010 tx=0x7fb00c00f690 comp rx=0 tx=0).stop 2024-05-09T00:08:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb01cf7f700 1 -- 172.21.15.81:0/3168271627 shutdown_connections 2024-05-09T00:08:01.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb01cf7f700 1 --2- 172.21.15.81:0/3168271627 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb0000a1310 0x7fb0000a37d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb01cf7f700 1 --2- 172.21.15.81:0/3168271627 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb01819dea0 0x7fb01819e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb01cf7f700 1 --2- 172.21.15.81:0/3168271627 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0180694e0 0x7fb018199610 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb01cf7f700 1 --2- 172.21.15.81:0/3168271627 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb018106290 0x7fb018199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb01cf7f700 1 -- 172.21.15.81:0/3168271627 >> 172.21.15.81:0/3168271627 conn(0x7fb018076f30 msgr2=0x7fb01810c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb01cf7f700 1 -- 172.21.15.81:0/3168271627 shutdown_connections 2024-05-09T00:08:01.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:01.174+0000 7fb01cf7f700 1 -- 172.21.15.81:0/3168271627 wait complete. 2024-05-09T00:08:01.181 INFO:tasks.cephfs.filesystem:scrub status for tag:2ecdd55d-d59a-497a-aca3-04528e0fafba - {'path': '/', 'tag': '2ecdd55d-d59a-497a-aca3-04528e0fafba', 'options': 'recursive,force'} 2024-05-09T00:08:01.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:01 smithi171 ceph-mon[47351]: pgmap v155: 97 pgs: 97 active+clean; 2.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-05-09T00:08:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.470+0000 7f297826d700 1 -- 172.21.15.81:0/1957535311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2970105130 msgr2=0x7f297010ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.468 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.470+0000 7f297826d700 1 --2- 172.21.15.81:0/1957535311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2970105130 0x7f297010ccb0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f296800b0a0 tx=0x7f296800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 -- 172.21.15.81:0/1957535311 shutdown_connections 2024-05-09T00:08:01.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 --2- 172.21.15.81:0/1957535311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2970100010 0x7f29701003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 --2- 172.21.15.81:0/1957535311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2970105130 0x7f297010ccb0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 --2- 172.21.15.81:0/1957535311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f29701009c0 0x7f2970104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 -- 172.21.15.81:0/1957535311 >> 172.21.15.81:0/1957535311 conn(0x7f29700fb870 msgr2=0x7f29700fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 -- 172.21.15.81:0/1957535311 shutdown_connections 2024-05-09T00:08:01.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 -- 172.21.15.81:0/1957535311 wait complete. 2024-05-09T00:08:01.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 Processor -- start 2024-05-09T00:08:01.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 -- start start 2024-05-09T00:08:01.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2970100010 0x7f2970196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2970105130 0x7f29701965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.469 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2970196b10 0x7f29701a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29701a5c50 con 0x7f2970105130 2024-05-09T00:08:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29701a5d90 con 0x7f2970196b10 2024-05-09T00:08:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.471+0000 7f297826d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29701a5ed0 con 0x7f2970100010 2024-05-09T00:08:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f2975808700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2970105130 0x7f29701965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f2975808700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2970105130 0x7f29701965d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44158/0 (socket says 172.21.15.81:44158) 2024-05-09T00:08:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f2975808700 1 -- 172.21.15.81:0/2252433002 learned_addr learned my addr 172.21.15.81:0/2252433002 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f2976009700 1 --2- 172.21.15.81:0/2252433002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2970100010 0x7f2970196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f297680a700 1 --2- 172.21.15.81:0/2252433002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2970196b10 0x7f29701a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f2975808700 1 -- 172.21.15.81:0/2252433002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2970100010 msgr2=0x7f2970196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f2975808700 1 --2- 172.21.15.81:0/2252433002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2970100010 0x7f2970196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f2975808700 1 -- 172.21.15.81:0/2252433002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2970196b10 msgr2=0x7f29701a5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f2975808700 1 --2- 172.21.15.81:0/2252433002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2970196b10 0x7f29701a5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.470 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f2975808700 1 -- 172.21.15.81:0/2252433002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2968009d00 con 0x7f2970105130 2024-05-09T00:08:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f2975808700 1 --2- 172.21.15.81:0/2252433002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2970105130 0x7f29701965d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f296000c9e0 tx=0x7f296000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f29677fe700 1 -- 172.21.15.81:0/2252433002 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960007aa0 con 0x7f2970105130 2024-05-09T00:08:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f29677fe700 1 -- 172.21.15.81:0/2252433002 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2960007c00 con 0x7f2970105130 2024-05-09T00:08:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f297826d700 1 -- 172.21.15.81:0/2252433002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29701a61b0 con 0x7f2970105130 2024-05-09T00:08:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f29677fe700 1 -- 172.21.15.81:0/2252433002 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960018660 con 0x7f2970105130 2024-05-09T00:08:01.471 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.472+0000 7f297826d700 1 -- 172.21.15.81:0/2252433002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29701a66c0 con 0x7f2970105130 2024-05-09T00:08:01.479 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.474+0000 7f29677fe700 1 -- 172.21.15.81:0/2252433002 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f296000f450 con 0x7f2970105130 2024-05-09T00:08:01.479 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.475+0000 7f29677fe700 1 --2- 172.21.15.81:0/2252433002 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f295c0a1290 0x7f295c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.479 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.475+0000 7f29677fe700 1 -- 172.21.15.81:0/2252433002 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f29600ccc10 con 0x7f2970105130 2024-05-09T00:08:01.479 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.475+0000 7f2976009700 1 --2- 172.21.15.81:0/2252433002 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f295c0a1290 0x7f295c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.475+0000 7f2976009700 1 --2- 172.21.15.81:0/2252433002 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f295c0a1290 0x7f295c0a3750 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f296c009c60 tx=0x7f296c009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2984427b80 1 Processor -- start 2024-05-09T00:08:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2984427b80 1 -- start start 2024-05-09T00:08:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2984427b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5ef950 0x55a14a5efd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2984427b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5f0270 0x55a14a5e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2984427b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 0x55a14a5ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2984427b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a5410f0 con 0x55a14a5f0270 2024-05-09T00:08:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2984427b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a53eab0 con 0x55a14a5ef950 2024-05-09T00:08:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2984427b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a53a3a0 con 0x55a14a5ea480 2024-05-09T00:08:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2975808700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5f0270 0x55a14a5e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.480 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2975808700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5f0270 0x55a14a5e9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44166/0 (socket says 172.21.15.81:44166) 2024-05-09T00:08:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2975808700 1 -- 172.21.15.81:0/3128877502 learned_addr learned my addr 172.21.15.81:0/3128877502 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2976009700 1 --2- 172.21.15.81:0/3128877502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5ef950 0x55a14a5efd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f297680a700 1 --2- 172.21.15.81:0/3128877502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 0x55a14a5ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2975808700 1 -- 172.21.15.81:0/3128877502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 msgr2=0x55a14a5ea8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2975808700 1 --2- 172.21.15.81:0/3128877502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 0x55a14a5ea8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2975808700 1 -- 172.21.15.81:0/3128877502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5ef950 msgr2=0x55a14a5efd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2975808700 1 --2- 172.21.15.81:0/3128877502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5ef950 0x55a14a5efd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.476+0000 7f2975808700 1 -- 172.21.15.81:0/3128877502 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a14a3bb350 con 0x55a14a5f0270 2024-05-09T00:08:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.477+0000 7f297680a700 1 --2- 172.21.15.81:0/3128877502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 0x55a14a5ea8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.477+0000 7f2976009700 1 --2- 172.21.15.81:0/3128877502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5ef950 0x55a14a5efd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.477+0000 7f2975808700 1 --2- 172.21.15.81:0/3128877502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5f0270 0x55a14a5e9f40 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2960096790 tx=0x7f2960099700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2034453a0f70a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.477+0000 7f2964da4700 1 -- 172.21.15.81:0/3128877502 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960099d20 con 0x55a14a5f0270 2024-05-09T00:08:01.481 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.477+0000 7f2964da4700 1 -- 172.21.15.81:0/3128877502 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f296009db50 con 0x55a14a5f0270 2024-05-09T00:08:01.482 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.477+0000 7f2964da4700 1 -- 172.21.15.81:0/3128877502 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296000f9a0 con 0x55a14a5f0270 2024-05-09T00:08:01.482 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.477+0000 7f2984427b80 1 -- 172.21.15.81:0/3128877502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5f0270 msgr2=0x55a14a5e9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.482 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.477+0000 7f2984427b80 1 --2- 172.21.15.81:0/3128877502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5f0270 0x55a14a5e9f40 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f2960096790 tx=0x7f2960099700 comp rx=0 tx=0).stop 2024-05-09T00:08:01.482 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.477+0000 7f2984427b80 1 -- 172.21.15.81:0/3128877502 shutdown_connections 2024-05-09T00:08:01.482 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.477+0000 7f2984427b80 1 --2- 172.21.15.81:0/3128877502 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5ef950 0x55a14a5efd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.482 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.477+0000 7f2984427b80 1 --2- 172.21.15.81:0/3128877502 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 0x55a14a5ea8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.482 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.477+0000 7f2984427b80 1 --2- 172.21.15.81:0/3128877502 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5f0270 0x55a14a5e9f40 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.482 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.477+0000 7f2984427b80 1 -- 172.21.15.81:0/3128877502 >> 172.21.15.81:0/3128877502 conn(0x55a14a5481b0 msgr2=0x55a14a5e4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.482 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.478+0000 7f2984427b80 1 -- 172.21.15.81:0/3128877502 shutdown_connections 2024-05-09T00:08:01.482 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.478+0000 7f2984427b80 1 -- 172.21.15.81:0/3128877502 wait complete. 2024-05-09T00:08:01.482 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.478+0000 7f2984427b80 1 -- start start 2024-05-09T00:08:01.482 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.478+0000 7f2984427b80 1 Processor -- start 2024-05-09T00:08:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.478+0000 7f2984427b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5ea480 0x55a14a5f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.478+0000 7f2984427b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ef950 0x55a14a5f3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.478+0000 7f2984427b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5f0270 0x55a14a5f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.478+0000 7f2984427b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a4d6500 con 0x55a14a5ea480 2024-05-09T00:08:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.478+0000 7f2984427b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a4d61a0 con 0x55a14a5f0270 2024-05-09T00:08:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.478+0000 7f2984427b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a3bd640 con 0x55a14a5ef950 2024-05-09T00:08:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.478+0000 7f2984427b80 10 client.0 _ll_register_callbacks cb 0x55a14a4dfad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.478+0000 7f2976009700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5ea480 0x55a14a5f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.478+0000 7f2976009700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5ea480 0x55a14a5f61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44182/0 (socket says 172.21.15.81:44182) 2024-05-09T00:08:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.478+0000 7f2976009700 1 -- 172.21.15.81:0/1065774833 learned_addr learned my addr 172.21.15.81:0/1065774833 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2975808700 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ef950 0x55a14a5f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f297680a700 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5f0270 0x55a14a5f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.483 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2976009700 1 -- 172.21.15.81:0/1065774833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ef950 msgr2=0x55a14a5f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2976009700 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ef950 0x55a14a5f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2976009700 1 -- 172.21.15.81:0/1065774833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5f0270 msgr2=0x55a14a5f3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2976009700 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5f0270 0x55a14a5f3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2976009700 1 -- 172.21.15.81:0/1065774833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29701a66c0 con 0x55a14a5ea480 2024-05-09T00:08:01.484 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2975808700 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ef950 0x55a14a5f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f297680a700 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5f0270 0x55a14a5f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2976009700 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5ea480 0x55a14a5f61e0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f296c01dbf0 tx=0x7f296c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e27dbbe1cfe88c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2959ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2959ffb700 1 -- 172.21.15.81:0/1065774833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c00ec50 con 0x55a14a5ea480 2024-05-09T00:08:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2959ffb700 1 -- 172.21.15.81:0/1065774833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f296c00edb0 con 0x55a14a5ea480 2024-05-09T00:08:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2984427b80 1 -- 172.21.15.81:0/1065774833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a14a493210 con 0x55a14a5ea480 2024-05-09T00:08:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2959ffb700 1 -- 172.21.15.81:0/1065774833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f296c027400 con 0x55a14a5ea480 2024-05-09T00:08:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2984427b80 10 client.16917 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:01.485 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2984427b80 1 -- 172.21.15.81:0/1065774833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a14a367b00 con 0x55a14a5ea480 2024-05-09T00:08:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2959ffb700 1 -- 172.21.15.81:0/1065774833 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f296c033080 con 0x55a14a5ea480 2024-05-09T00:08:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2959ffb700 1 -- 172.21.15.81:0/1065774833 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f296c02d030 con 0x55a14a5ea480 2024-05-09T00:08:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2984427b80 10 client.16917 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2984427b80 10 client.16917 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2984427b80 20 client.16917 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2984427b80 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a14a603bf0 0x55a14a606010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2984427b80 4 client.16917 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:08:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.479+0000 7f2984427b80 1 -- 172.21.15.81:0/1065774833 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a14a5b97b0 con 0x55a14a603bf0 2024-05-09T00:08:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.480+0000 7f2975808700 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a14a603bf0 0x55a14a606010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.480+0000 7f2975808700 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a14a603bf0 0x55a14a606010 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a383ea3bc500dc9d server_cookie=3ab320d72196844e in_seq=0 out_seq=0 2024-05-09T00:08:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.480+0000 7f2959ffb700 10 client.16917 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2959ffb700 1 -- 172.21.15.81:0/1065774833 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a14a5b97b0 con 0x55a14a603bf0 2024-05-09T00:08:01.486 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2959ffb700 10 client.16917 handle_command_reply: tid=0 2024-05-09T00:08:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2984427b80 1 client.16917 shutdown 2024-05-09T00:08:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2984427b80 1 -- 172.21.15.81:0/1065774833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5ea480 msgr2=0x55a14a5f61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2984427b80 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5ea480 0x55a14a5f61e0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f296c01dbf0 tx=0x7f296c0047c0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2984427b80 1 -- 172.21.15.81:0/1065774833 shutdown_connections 2024-05-09T00:08:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2984427b80 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a14a603bf0 0x55a14a606010 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2984427b80 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5f0270 0x55a14a5f3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2959ffb700 0 client.16917 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2984427b80 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5ea480 0x55a14a5f61e0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2984427b80 1 --2- 172.21.15.81:0/1065774833 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ef950 0x55a14a5f3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2984427b80 1 -- 172.21.15.81:0/1065774833 >> 172.21.15.81:0/1065774833 conn(0x55a14a5481b0 msgr2=0x55a14a5ed460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2984427b80 1 -- 172.21.15.81:0/1065774833 shutdown_connections 2024-05-09T00:08:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2984427b80 1 -- 172.21.15.81:0/1065774833 wait complete. 2024-05-09T00:08:01.487 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.481+0000 7f2984427b80 20 client.16917 trim_cache size 0 max 16384 2024-05-09T00:08:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f2984427b80 1 Processor -- start 2024-05-09T00:08:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f2984427b80 1 -- start start 2024-05-09T00:08:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f2984427b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 0x55a14a5ef1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f2984427b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5ef950 0x55a14a5f3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.495 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f2984427b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5f0270 0x55a14a5e4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f2984427b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a5f4aa0 con 0x55a14a5f0270 2024-05-09T00:08:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f2984427b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a5f43f0 con 0x55a14a5ef950 2024-05-09T00:08:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f2984427b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a5ea860 con 0x55a14a5ea480 2024-05-09T00:08:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f297680a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5f0270 0x55a14a5e4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f297680a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5f0270 0x55a14a5e4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44188/0 (socket says 172.21.15.81:44188) 2024-05-09T00:08:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f297680a700 1 -- 172.21.15.81:0/1117270269 learned_addr learned my addr 172.21.15.81:0/1117270269 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f2975808700 1 --2- 172.21.15.81:0/1117270269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5ef950 0x55a14a5f3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f2976009700 1 --2- 172.21.15.81:0/1117270269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 0x55a14a5ef1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f297680a700 1 -- 172.21.15.81:0/1117270269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 msgr2=0x55a14a5ef1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f297680a700 1 --2- 172.21.15.81:0/1117270269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 0x55a14a5ef1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f297680a700 1 -- 172.21.15.81:0/1117270269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5ef950 msgr2=0x55a14a5f3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f297680a700 1 --2- 172.21.15.81:0/1117270269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5ef950 0x55a14a5f3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f297680a700 1 -- 172.21.15.81:0/1117270269 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a14a500500 con 0x55a14a5f0270 2024-05-09T00:08:01.496 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.496+0000 7f297680a700 1 --2- 172.21.15.81:0/1117270269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5f0270 0x55a14a5e4910 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f29680061b0 tx=0x7f29680061e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5c004f66c27ce0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:01.497 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.497+0000 7f29655a5700 1 -- 172.21.15.81:0/1117270269 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296800e040 con 0x55a14a5f0270 2024-05-09T00:08:01.497 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.497+0000 7f29655a5700 1 -- 172.21.15.81:0/1117270269 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f29680094a0 con 0x55a14a5f0270 2024-05-09T00:08:01.497 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.497+0000 7f29655a5700 1 -- 172.21.15.81:0/1117270269 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2968004cb0 con 0x55a14a5f0270 2024-05-09T00:08:01.497 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.497+0000 7f2984427b80 1 -- 172.21.15.81:0/1117270269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5f0270 msgr2=0x55a14a5e4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.497 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.497+0000 7f2984427b80 1 --2- 172.21.15.81:0/1117270269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5f0270 0x55a14a5e4910 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f29680061b0 tx=0x7f29680061e0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.497 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.497+0000 7f2984427b80 1 -- 172.21.15.81:0/1117270269 shutdown_connections 2024-05-09T00:08:01.497 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.497+0000 7f2984427b80 1 --2- 172.21.15.81:0/1117270269 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5f0270 0x55a14a5e4910 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.497 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.497+0000 7f2984427b80 1 --2- 172.21.15.81:0/1117270269 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 0x55a14a5ef1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.497 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.497+0000 7f2984427b80 1 --2- 172.21.15.81:0/1117270269 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5ef950 0x55a14a5f3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.497 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.497+0000 7f2984427b80 1 -- 172.21.15.81:0/1117270269 >> 172.21.15.81:0/1117270269 conn(0x55a14a5481b0 msgr2=0x55a14a5e60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.497 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.497+0000 7f2984427b80 1 -- 172.21.15.81:0/1117270269 shutdown_connections 2024-05-09T00:08:01.497 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.497+0000 7f2984427b80 1 -- 172.21.15.81:0/1117270269 wait complete. 2024-05-09T00:08:01.497 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.497+0000 7f2984427b80 1 -- start start 2024-05-09T00:08:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2984427b80 1 Processor -- start 2024-05-09T00:08:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2984427b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 0x55a14a5f6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2984427b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5ef950 0x55a14a5f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2984427b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5f0270 0x55a14a5f7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2984427b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a6590a0 con 0x55a14a5ef950 2024-05-09T00:08:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2984427b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a6591e0 con 0x55a14a5f0270 2024-05-09T00:08:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2984427b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a659320 con 0x55a14a5ea480 2024-05-09T00:08:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2984427b80 10 client.0 _ll_register_callbacks cb 0x55a14a4dfad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2975808700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5ef950 0x55a14a5f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2975808700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5ef950 0x55a14a5f70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44204/0 (socket says 172.21.15.81:44204) 2024-05-09T00:08:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2975808700 1 -- 172.21.15.81:0/2261395869 learned_addr learned my addr 172.21.15.81:0/2261395869 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f297680a700 1 --2- 172.21.15.81:0/2261395869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5f0270 0x55a14a5f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.498 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2976009700 1 --2- 172.21.15.81:0/2261395869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 0x55a14a5f6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2975808700 1 -- 172.21.15.81:0/2261395869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 msgr2=0x55a14a5f6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2975808700 1 --2- 172.21.15.81:0/2261395869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 0x55a14a5f6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2975808700 1 -- 172.21.15.81:0/2261395869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5f0270 msgr2=0x55a14a5f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2975808700 1 --2- 172.21.15.81:0/2261395869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5f0270 0x55a14a5f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2975808700 1 -- 172.21.15.81:0/2261395869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297010d520 con 0x55a14a5ef950 2024-05-09T00:08:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2975808700 1 --2- 172.21.15.81:0/2261395869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5ef950 0x55a14a5f70c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f296000c9b0 tx=0x7f2960000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e1c149d12e3594 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2959ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.498+0000 7f2959ffb700 1 -- 172.21.15.81:0/2261395869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2960099d20 con 0x55a14a5ef950 2024-05-09T00:08:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.499+0000 7f2959ffb700 1 -- 172.21.15.81:0/2261395869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f29600a21a0 con 0x55a14a5ef950 2024-05-09T00:08:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.499+0000 7f2984427b80 1 -- 172.21.15.81:0/2261395869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f296009db50 con 0x55a14a5ef950 2024-05-09T00:08:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.499+0000 7f2959ffb700 1 -- 172.21.15.81:0/2261395869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2960099210 con 0x55a14a5ef950 2024-05-09T00:08:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.499+0000 7f2984427b80 10 client.16923 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.499+0000 7f2984427b80 1 -- 172.21.15.81:0/2261395869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a14a3bfc70 con 0x55a14a5ef950 2024-05-09T00:08:01.499 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.499+0000 7f2959ffb700 1 -- 172.21.15.81:0/2261395869 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f296009db50 con 0x55a14a5ef950 2024-05-09T00:08:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.499+0000 7f2959ffb700 1 -- 172.21.15.81:0/2261395869 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f296005fc60 con 0x55a14a5ef950 2024-05-09T00:08:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.499+0000 7f2984427b80 10 client.16923 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.499+0000 7f2984427b80 10 client.16923 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.499+0000 7f2984427b80 20 client.16923 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.499+0000 7f2984427b80 1 --2- 172.21.15.81:0/2261395869 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a14a65a5d0 0x55a14a65c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.499+0000 7f2984427b80 4 client.16923 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:08:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.499+0000 7f2984427b80 1 -- 172.21.15.81:0/2261395869 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a14a532e60 con 0x55a14a65a5d0 2024-05-09T00:08:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.499+0000 7f2976009700 1 --2- 172.21.15.81:0/2261395869 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a14a65a5d0 0x55a14a65c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.500+0000 7f2959ffb700 10 client.16923 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:01.500 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.500+0000 7f2976009700 1 --2- 172.21.15.81:0/2261395869 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a14a65a5d0 0x55a14a65c9c0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45c2d9d55fcc44b9 server_cookie=b306617f03bef089 in_seq=0 out_seq=0 2024-05-09T00:08:01.509 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2959ffb700 1 -- 172.21.15.81:0/2261395869 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a14a532e60 con 0x55a14a65a5d0 2024-05-09T00:08:01.509 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2959ffb700 10 client.16923 handle_command_reply: tid=0 2024-05-09T00:08:01.509 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2984427b80 1 client.16923 shutdown 2024-05-09T00:08:01.509 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2984427b80 1 -- 172.21.15.81:0/2261395869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5ef950 msgr2=0x55a14a5f70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2984427b80 1 --2- 172.21.15.81:0/2261395869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5ef950 0x55a14a5f70c0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f296000c9b0 tx=0x7f2960000bc0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2984427b80 1 -- 172.21.15.81:0/2261395869 shutdown_connections 2024-05-09T00:08:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2984427b80 1 --2- 172.21.15.81:0/2261395869 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a14a65a5d0 0x55a14a65c9c0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2984427b80 1 --2- 172.21.15.81:0/2261395869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a14a5f0270 0x55a14a5f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2984427b80 1 --2- 172.21.15.81:0/2261395869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a14a5ea480 0x55a14a5f6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2959ffb700 0 client.16923 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2984427b80 1 --2- 172.21.15.81:0/2261395869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a14a5ef950 0x55a14a5f70c0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2984427b80 1 -- 172.21.15.81:0/2261395869 >> 172.21.15.81:0/2261395869 conn(0x55a14a5481b0 msgr2=0x55a14a5e85d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2984427b80 1 -- 172.21.15.81:0/2261395869 shutdown_connections 2024-05-09T00:08:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2984427b80 1 -- 172.21.15.81:0/2261395869 wait complete. 2024-05-09T00:08:01.510 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.513+0000 7f2984427b80 20 client.16923 trim_cache size 0 max 16384 2024-05-09T00:08:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:08:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:08:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:08:01.511 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:08:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.514+0000 7f297826d700 1 -- 172.21.15.81:0/2252433002 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f295c0a1290 msgr2=0x7f295c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.514+0000 7f297826d700 1 --2- 172.21.15.81:0/2252433002 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f295c0a1290 0x7f295c0a3750 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f296c009c60 tx=0x7f296c009260 comp rx=0 tx=0).stop 2024-05-09T00:08:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.514+0000 7f297826d700 1 -- 172.21.15.81:0/2252433002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2970105130 msgr2=0x7f29701965d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.514+0000 7f297826d700 1 --2- 172.21.15.81:0/2252433002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2970105130 0x7f29701965d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f296000c9e0 tx=0x7f296000ccf0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.514+0000 7f297826d700 1 -- 172.21.15.81:0/2252433002 shutdown_connections 2024-05-09T00:08:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.514+0000 7f297826d700 1 --2- 172.21.15.81:0/2252433002 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f295c0a1290 0x7f295c0a3750 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.514+0000 7f297826d700 1 --2- 172.21.15.81:0/2252433002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2970196b10 0x7f29701a5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.514+0000 7f297826d700 1 --2- 172.21.15.81:0/2252433002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2970100010 0x7f2970196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.514+0000 7f297826d700 1 --2- 172.21.15.81:0/2252433002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2970105130 0x7f29701965d0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.514+0000 7f297826d700 1 -- 172.21.15.81:0/2252433002 >> 172.21.15.81:0/2252433002 conn(0x7f29700fb870 msgr2=0x7f29700fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.514+0000 7f297826d700 1 -- 172.21.15.81:0/2252433002 shutdown_connections 2024-05-09T00:08:01.512 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:01.514+0000 7f297826d700 1 -- 172.21.15.81:0/2252433002 wait complete. 2024-05-09T00:08:01.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:01 smithi150 ceph-mon[46187]: pgmap v155: 97 pgs: 97 active+clean; 2.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 42 KiB/s wr, 17 op/s 2024-05-09T00:08:02.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:02 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:08:02.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:02 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:08:02.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:02 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:08:02.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:02 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:08:02.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:02 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:08:02.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:02 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:08:02.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:02 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:08:02.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:02 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:08:02.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:02 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:08:02.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:02 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:08:02.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:02 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:08:02.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:02 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:08:04.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:03 smithi150 ceph-mon[46187]: pgmap v156: 97 pgs: 97 active+clean; 2.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-05-09T00:08:04.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:03 smithi171 ceph-mon[47351]: pgmap v156: 97 pgs: 97 active+clean; 2.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-05-09T00:08:04.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:03 smithi081 ceph-mon[42474]: pgmap v156: 97 pgs: 97 active+clean; 2.3 MiB data, 401 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 KiB/s wr, 9 op/s 2024-05-09T00:08:05.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:04 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:08:05.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:04 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:08:05.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:04 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:08:06.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:05 smithi150 ceph-mon[46187]: pgmap v157: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 69 KiB/s wr, 33 op/s 2024-05-09T00:08:06.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:05 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:08:06.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:05 smithi171 ceph-mon[47351]: pgmap v157: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 69 KiB/s wr, 33 op/s 2024-05-09T00:08:06.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:05 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:08:06.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:05 smithi081 ceph-mon[42474]: pgmap v157: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 69 KiB/s wr, 33 op/s 2024-05-09T00:08:06.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:05 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:08:07.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:06 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:08:07.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:06 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:08:07.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:06 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:08:07.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:06 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:08:07.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:06 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:08:07.053 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:06 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:08:07.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:06 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:08:07.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:06 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:08:07.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:06 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:08:07.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:06 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:08:07.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:06 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:08:07.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:06 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:08:07.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:06 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:08:07.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:06 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:08:07.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:06 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:08:08.015 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:07 smithi150 ceph-mon[46187]: pgmap v158: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-05-09T00:08:08.054 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:07 smithi171 ceph-mon[47351]: pgmap v158: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-05-09T00:08:08.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:07 smithi081 ceph-mon[42474]: pgmap v158: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-05-09T00:08:09.265 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:09 smithi150 ceph-mon[46187]: pgmap v159: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-05-09T00:08:09.303 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:09 smithi171 ceph-mon[47351]: pgmap v159: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-05-09T00:08:09.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:09 smithi081 ceph-mon[42474]: pgmap v159: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 55 KiB/s wr, 28 op/s 2024-05-09T00:08:11.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:11 smithi171 ceph-mon[47351]: pgmap v160: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 71 KiB/s wr, 33 op/s 2024-05-09T00:08:11.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:11 smithi081 ceph-mon[42474]: pgmap v160: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 71 KiB/s wr, 33 op/s 2024-05-09T00:08:11.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:11 smithi150 ceph-mon[46187]: pgmap v160: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 71 KiB/s wr, 33 op/s 2024-05-09T00:08:13.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:13 smithi171 ceph-mon[47351]: pgmap v161: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-05-09T00:08:13.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:13 smithi081 ceph-mon[42474]: pgmap v161: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-05-09T00:08:13.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:13 smithi150 ceph-mon[46187]: pgmap v161: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-05-09T00:08:14.629 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.631+0000 7fa35e598700 1 -- 172.21.15.81:0/3771705984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358100760 msgr2=0x7fa35810cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.629 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.631+0000 7fa35e598700 1 --2- 172.21.15.81:0/3771705984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358100760 0x7fa35810cc00 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa35000b0a0 tx=0x7fa35000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.629 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.631+0000 7fa35e598700 1 -- 172.21.15.81:0/3771705984 shutdown_connections 2024-05-09T00:08:14.629 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.631+0000 7fa35e598700 1 --2- 172.21.15.81:0/3771705984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358100760 0x7fa35810cc00 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.629 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.631+0000 7fa35e598700 1 --2- 172.21.15.81:0/3771705984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa358105e60 0x7fa358106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.629 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.631+0000 7fa35e598700 1 --2- 172.21.15.81:0/3771705984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3580ffda0 0x7fa358100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.629 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.631+0000 7fa35e598700 1 -- 172.21.15.81:0/3771705984 >> 172.21.15.81:0/3771705984 conn(0x7fa358076f10 msgr2=0x7fa358077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.631+0000 7fa35e598700 1 -- 172.21.15.81:0/3771705984 shutdown_connections 2024-05-09T00:08:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.631+0000 7fa35e598700 1 -- 172.21.15.81:0/3771705984 wait complete. 2024-05-09T00:08:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa35e598700 1 Processor -- start 2024-05-09T00:08:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa35e598700 1 -- start start 2024-05-09T00:08:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa35e598700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3580ffda0 0x7fa358198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa35e598700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358100760 0x7fa358198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa35e598700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa358105e60 0x7fa3581a3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa35e598700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3581990b0 con 0x7fa358100760 2024-05-09T00:08:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa35e598700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3581a38c0 con 0x7fa3580ffda0 2024-05-09T00:08:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa35e598700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3581a3a00 con 0x7fa358105e60 2024-05-09T00:08:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa34ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358100760 0x7fa358198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa34ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358100760 0x7fa358198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35350/0 (socket says 172.21.15.81:35350) 2024-05-09T00:08:14.630 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa34ffff700 1 -- 172.21.15.81:0/353238363 learned_addr learned my addr 172.21.15.81:0/353238363 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa357fff700 1 --2- 172.21.15.81:0/353238363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3580ffda0 0x7fa358198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa35cb35700 1 --2- 172.21.15.81:0/353238363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa358105e60 0x7fa3581a3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa34ffff700 1 -- 172.21.15.81:0/353238363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa358105e60 msgr2=0x7fa3581a3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa34ffff700 1 --2- 172.21.15.81:0/353238363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa358105e60 0x7fa3581a3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa34ffff700 1 -- 172.21.15.81:0/353238363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3580ffda0 msgr2=0x7fa358198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa34ffff700 1 --2- 172.21.15.81:0/353238363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3580ffda0 0x7fa358198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.632+0000 7fa34ffff700 1 -- 172.21.15.81:0/353238363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa350009d00 con 0x7fa358100760 2024-05-09T00:08:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.633+0000 7fa34ffff700 1 --2- 172.21.15.81:0/353238363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358100760 0x7fa358198840 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa34000d950 tx=0x7fa34000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.633+0000 7fa355ffb700 1 -- 172.21.15.81:0/353238363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34000f890 con 0x7fa358100760 2024-05-09T00:08:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.633+0000 7fa355ffb700 1 -- 172.21.15.81:0/353238363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa340010460 con 0x7fa358100760 2024-05-09T00:08:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.633+0000 7fa35e598700 1 -- 172.21.15.81:0/353238363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3581a3c90 con 0x7fa358100760 2024-05-09T00:08:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.633+0000 7fa355ffb700 1 -- 172.21.15.81:0/353238363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34000e610 con 0x7fa358100760 2024-05-09T00:08:14.631 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.633+0000 7fa35e598700 1 -- 172.21.15.81:0/353238363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3581a41a0 con 0x7fa358100760 2024-05-09T00:08:14.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.635+0000 7fa355ffb700 1 -- 172.21.15.81:0/353238363 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa3400108d0 con 0x7fa358100760 2024-05-09T00:08:14.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.635+0000 7fa355ffb700 1 --2- 172.21.15.81:0/353238363 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3440a1290 0x7fa3440a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.635+0000 7fa357fff700 1 --2- 172.21.15.81:0/353238363 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3440a1290 0x7fa3440a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.636+0000 7fa355ffb700 1 -- 172.21.15.81:0/353238363 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa3400ccaa0 con 0x7fa358100760 2024-05-09T00:08:14.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.636+0000 7fa357fff700 1 --2- 172.21.15.81:0/353238363 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3440a1290 0x7fa3440a3750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa348005950 tx=0x7fa34800b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:14.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.636+0000 7fa36a752b80 1 Processor -- start 2024-05-09T00:08:14.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.636+0000 7fa36a752b80 1 -- start start 2024-05-09T00:08:14.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa36a752b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa36a752b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c6270 0x55c9cb7bff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa36a752b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c0480 0x55c9cb7c08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa36a752b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9cb7170f0 con 0x55c9cb7c5950 2024-05-09T00:08:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa36a752b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9cb714ab0 con 0x55c9cb7c6270 2024-05-09T00:08:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa36a752b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9cb7103a0 con 0x55c9cb7c0480 2024-05-09T00:08:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa357fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa357fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35356/0 (socket says 172.21.15.81:35356) 2024-05-09T00:08:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa357fff700 1 -- 172.21.15.81:0/3041236352 learned_addr learned my addr 172.21.15.81:0/3041236352 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa34ffff700 1 --2- 172.21.15.81:0/3041236352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c6270 0x55c9cb7bff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa357fff700 1 -- 172.21.15.81:0/3041236352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c0480 msgr2=0x55c9cb7c08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa357fff700 1 --2- 172.21.15.81:0/3041236352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c0480 0x55c9cb7c08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa357fff700 1 -- 172.21.15.81:0/3041236352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c6270 msgr2=0x55c9cb7bff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa357fff700 1 --2- 172.21.15.81:0/3041236352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c6270 0x55c9cb7bff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa357fff700 1 -- 172.21.15.81:0/3041236352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9cb591350 con 0x55c9cb7c5950 2024-05-09T00:08:14.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa34ffff700 1 --2- 172.21.15.81:0/3041236352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c6270 0x55c9cb7bff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa357fff700 1 --2- 172.21.15.81:0/3041236352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7c5d30 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa348010e60 tx=0x7fa348013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef9851a633dcd0e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa34e7fc700 1 -- 172.21.15.81:0/3041236352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34801e620 con 0x55c9cb7c5950 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa34e7fc700 1 -- 172.21.15.81:0/3041236352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa348015070 con 0x55c9cb7c5950 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.637+0000 7fa34e7fc700 1 -- 172.21.15.81:0/3041236352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34801c9f0 con 0x55c9cb7c5950 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.638+0000 7fa36a752b80 1 -- 172.21.15.81:0/3041236352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 msgr2=0x55c9cb7c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.638+0000 7fa36a752b80 1 --2- 172.21.15.81:0/3041236352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7c5d30 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa348010e60 tx=0x7fa348013000 comp rx=0 tx=0).stop 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.638+0000 7fa36a752b80 1 -- 172.21.15.81:0/3041236352 shutdown_connections 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.638+0000 7fa36a752b80 1 --2- 172.21.15.81:0/3041236352 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c0480 0x55c9cb7c08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.638+0000 7fa36a752b80 1 --2- 172.21.15.81:0/3041236352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7c5d30 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.638+0000 7fa36a752b80 1 --2- 172.21.15.81:0/3041236352 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c6270 0x55c9cb7bff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.638+0000 7fa36a752b80 1 -- 172.21.15.81:0/3041236352 >> 172.21.15.81:0/3041236352 conn(0x55c9cb71e1b0 msgr2=0x55c9cb7ba840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.638+0000 7fa36a752b80 1 -- 172.21.15.81:0/3041236352 shutdown_connections 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.638+0000 7fa36a752b80 1 -- 172.21.15.81:0/3041236352 wait complete. 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.639+0000 7fa36a752b80 1 -- start start 2024-05-09T00:08:14.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.639+0000 7fa36a752b80 1 Processor -- start 2024-05-09T00:08:14.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.639+0000 7fa36a752b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c0480 0x55c9cb7cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.639+0000 7fa36a752b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7c9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.639+0000 7fa36a752b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c6270 0x55c9cb7c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.639+0000 7fa36a752b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9cb6ac500 con 0x55c9cb7c5950 2024-05-09T00:08:14.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.639+0000 7fa36a752b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9cb6ac1a0 con 0x55c9cb7c0480 2024-05-09T00:08:14.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.639+0000 7fa36a752b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9cb593640 con 0x55c9cb7c6270 2024-05-09T00:08:14.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.639+0000 7fa34ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7c9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.639+0000 7fa36a752b80 10 client.0 _ll_register_callbacks cb 0x55c9cb6b5ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:14.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.639+0000 7fa34ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7c9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35366/0 (socket says 172.21.15.81:35366) 2024-05-09T00:08:14.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.639+0000 7fa34ffff700 1 -- 172.21.15.81:0/3391660312 learned_addr learned my addr 172.21.15.81:0/3391660312 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:14.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa357fff700 1 --2- 172.21.15.81:0/3391660312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c0480 0x55c9cb7cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa35cb35700 1 --2- 172.21.15.81:0/3391660312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c6270 0x55c9cb7c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.642 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa34ffff700 1 -- 172.21.15.81:0/3391660312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c6270 msgr2=0x55c9cb7c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:14.643 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa34ffff700 1 --2- 172.21.15.81:0/3391660312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c6270 0x55c9cb7c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.643 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa34ffff700 1 -- 172.21.15.81:0/3391660312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c0480 msgr2=0x55c9cb7cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:14.643 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa34ffff700 1 --2- 172.21.15.81:0/3391660312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c0480 0x55c9cb7cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.643 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa34ffff700 1 -- 172.21.15.81:0/3391660312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa348010b10 con 0x55c9cb7c5950 2024-05-09T00:08:14.643 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa357fff700 1 --2- 172.21.15.81:0/3391660312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c0480 0x55c9cb7cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:14.643 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa34ffff700 1 --2- 172.21.15.81:0/3391660312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7c9470 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa34000b2f0 tx=0x7fa340099c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194e81057cb777b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:14.643 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa3377fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:14.643 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa3377fe700 1 -- 172.21.15.81:0/3391660312 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34009a010 con 0x55c9cb7c5950 2024-05-09T00:08:14.643 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa3377fe700 1 -- 172.21.15.81:0/3391660312 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa3400990a0 con 0x55c9cb7c5950 2024-05-09T00:08:14.643 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa36a752b80 1 -- 172.21.15.81:0/3391660312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c9cb669210 con 0x55c9cb7c5950 2024-05-09T00:08:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa3377fe700 1 -- 172.21.15.81:0/3391660312 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa340099260 con 0x55c9cb7c5950 2024-05-09T00:08:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa36a752b80 10 client.16935 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa36a752b80 1 -- 172.21.15.81:0/3391660312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c9cb53db00 con 0x55c9cb7c5950 2024-05-09T00:08:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa3377fe700 1 -- 172.21.15.81:0/3391660312 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c9cb669210 con 0x55c9cb7c5950 2024-05-09T00:08:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa3377fe700 1 -- 172.21.15.81:0/3391660312 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa3400b23e0 con 0x55c9cb7c5950 2024-05-09T00:08:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa36a752b80 10 client.16935 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa36a752b80 10 client.16935 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa36a752b80 20 client.16935 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.640+0000 7fa36a752b80 1 --2- 172.21.15.81:0/3391660312 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c9cb7d9a90 0x55c9cb7dbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.641+0000 7fa36a752b80 4 client.16935 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:08:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.641+0000 7fa36a752b80 1 -- 172.21.15.81:0/3391660312 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c9cb78f7b0 con 0x55c9cb7d9a90 2024-05-09T00:08:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.641+0000 7fa357fff700 1 --2- 172.21.15.81:0/3391660312 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c9cb7d9a90 0x55c9cb7dbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.641+0000 7fa3377fe700 10 client.16935 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:14.644 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.641+0000 7fa357fff700 1 --2- 172.21.15.81:0/3391660312 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c9cb7d9a90 0x55c9cb7dbeb0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d2e4fe7c24847a7 server_cookie=25d75a0ca355173a in_seq=0 out_seq=0 2024-05-09T00:08:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa3377fe700 1 -- 172.21.15.81:0/3391660312 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c9cb78f7b0 con 0x55c9cb7d9a90 2024-05-09T00:08:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa3377fe700 10 client.16935 handle_command_reply: tid=0 2024-05-09T00:08:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa36a752b80 1 client.16935 shutdown 2024-05-09T00:08:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa36a752b80 1 -- 172.21.15.81:0/3391660312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 msgr2=0x55c9cb7c9470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa36a752b80 1 --2- 172.21.15.81:0/3391660312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7c9470 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa34000b2f0 tx=0x7fa340099c60 comp rx=0 tx=0).stop 2024-05-09T00:08:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa36a752b80 1 -- 172.21.15.81:0/3391660312 shutdown_connections 2024-05-09T00:08:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa36a752b80 1 --2- 172.21.15.81:0/3391660312 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c9cb7d9a90 0x55c9cb7dbeb0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa36a752b80 1 --2- 172.21.15.81:0/3391660312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c0480 0x55c9cb7cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa36a752b80 1 --2- 172.21.15.81:0/3391660312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c6270 0x55c9cb7c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa36a752b80 1 --2- 172.21.15.81:0/3391660312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7c9470 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa3377fe700 0 client.16935 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:14.645 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa36a752b80 1 -- 172.21.15.81:0/3391660312 >> 172.21.15.81:0/3391660312 conn(0x55c9cb71e1b0 msgr2=0x55c9cb7bef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:14.646 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa36a752b80 1 -- 172.21.15.81:0/3391660312 shutdown_connections 2024-05-09T00:08:14.646 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa36a752b80 1 -- 172.21.15.81:0/3391660312 wait complete. 2024-05-09T00:08:14.646 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.642+0000 7fa36a752b80 20 client.16935 trim_cache size 0 max 16384 2024-05-09T00:08:14.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.657+0000 7fa36a752b80 1 Processor -- start 2024-05-09T00:08:14.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.657+0000 7fa36a752b80 1 -- start start 2024-05-09T00:08:14.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.657+0000 7fa36a752b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c0480 0x55c9cb7c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa36a752b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7ba910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa36a752b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c6270 0x55c9cb7d0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa36a752b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9cb7b2ab0 con 0x55c9cb7c5950 2024-05-09T00:08:14.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa36a752b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9cb7caa90 con 0x55c9cb7c0480 2024-05-09T00:08:14.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa36a752b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9cb7e10a0 con 0x55c9cb7c6270 2024-05-09T00:08:14.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa34ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7ba910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa34ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7ba910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35378/0 (socket says 172.21.15.81:35378) 2024-05-09T00:08:14.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa34ffff700 1 -- 172.21.15.81:0/3434258990 learned_addr learned my addr 172.21.15.81:0/3434258990 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:14.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa357fff700 1 --2- 172.21.15.81:0/3434258990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c0480 0x55c9cb7c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.655 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa34ffff700 1 -- 172.21.15.81:0/3434258990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c6270 msgr2=0x55c9cb7d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa34ffff700 1 --2- 172.21.15.81:0/3434258990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c6270 0x55c9cb7d0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa34ffff700 1 -- 172.21.15.81:0/3434258990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c0480 msgr2=0x55c9cb7c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa34ffff700 1 --2- 172.21.15.81:0/3434258990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c0480 0x55c9cb7c7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa34ffff700 1 -- 172.21.15.81:0/3434258990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9cb6d6500 con 0x55c9cb7c5950 2024-05-09T00:08:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa357fff700 1 --2- 172.21.15.81:0/3434258990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c0480 0x55c9cb7c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa34ffff700 1 --2- 172.21.15.81:0/3434258990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7ba910 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa3400960b0 tx=0x7fa340000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e26fd5d4b0317a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa34effd700 1 -- 172.21.15.81:0/3434258990 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3400a1da0 con 0x55c9cb7c5950 2024-05-09T00:08:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa34effd700 1 -- 172.21.15.81:0/3434258990 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa34009d9e0 con 0x55c9cb7c5950 2024-05-09T00:08:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.658+0000 7fa34effd700 1 -- 172.21.15.81:0/3434258990 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3400b2500 con 0x55c9cb7c5950 2024-05-09T00:08:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.659+0000 7fa36a752b80 1 -- 172.21.15.81:0/3434258990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 msgr2=0x55c9cb7ba910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.659+0000 7fa36a752b80 1 --2- 172.21.15.81:0/3434258990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7ba910 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fa3400960b0 tx=0x7fa340000bc0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.659+0000 7fa36a752b80 1 -- 172.21.15.81:0/3434258990 shutdown_connections 2024-05-09T00:08:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.659+0000 7fa36a752b80 1 --2- 172.21.15.81:0/3434258990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c0480 0x55c9cb7c7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.656 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.659+0000 7fa36a752b80 1 --2- 172.21.15.81:0/3434258990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c6270 0x55c9cb7d0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.659+0000 7fa36a752b80 1 --2- 172.21.15.81:0/3434258990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c5950 0x55c9cb7ba910 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.659+0000 7fa36a752b80 1 -- 172.21.15.81:0/3434258990 >> 172.21.15.81:0/3434258990 conn(0x55c9cb71e1b0 msgr2=0x55c9cb7b6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:14.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.659+0000 7fa36a752b80 1 -- 172.21.15.81:0/3434258990 shutdown_connections 2024-05-09T00:08:14.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.659+0000 7fa36a752b80 1 -- 172.21.15.81:0/3434258990 wait complete. 2024-05-09T00:08:14.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.659+0000 7fa36a752b80 1 -- start start 2024-05-09T00:08:14.657 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa36a752b80 1 Processor -- start 2024-05-09T00:08:14.659 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa36a752b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c0480 0x55c9cb7cfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa36a752b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c5950 0x55c9cb7d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa36a752b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c6270 0x55c9cb7d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa36a752b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9cb82ef90 con 0x55c9cb7c6270 2024-05-09T00:08:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa36a752b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9cb82f0d0 con 0x55c9cb7c5950 2024-05-09T00:08:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa36a752b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9cb82f210 con 0x55c9cb7c0480 2024-05-09T00:08:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa36a752b80 10 client.0 _ll_register_callbacks cb 0x55c9cb6b5ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa35cb35700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c6270 0x55c9cb7d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa35cb35700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c6270 0x55c9cb7d08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35384/0 (socket says 172.21.15.81:35384) 2024-05-09T00:08:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa35cb35700 1 -- 172.21.15.81:0/132424338 learned_addr learned my addr 172.21.15.81:0/132424338 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa357fff700 1 --2- 172.21.15.81:0/132424338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c0480 0x55c9cb7cfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa34ffff700 1 --2- 172.21.15.81:0/132424338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c5950 0x55c9cb7d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa35cb35700 1 -- 172.21.15.81:0/132424338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c0480 msgr2=0x55c9cb7cfe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:14.660 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa35cb35700 1 --2- 172.21.15.81:0/132424338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c0480 0x55c9cb7cfe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa35cb35700 1 -- 172.21.15.81:0/132424338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c5950 msgr2=0x55c9cb7d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa35cb35700 1 --2- 172.21.15.81:0/132424338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c5950 0x55c9cb7d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa35cb35700 1 -- 172.21.15.81:0/132424338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c9cb53db00 con 0x55c9cb7c6270 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa35cb35700 1 --2- 172.21.15.81:0/132424338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c6270 0x55c9cb7d08e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fa350015000 tx=0x7fa350009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e5bcd5820b9a78 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.660+0000 7fa3377fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa3377fe700 1 -- 172.21.15.81:0/132424338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35000e040 con 0x55c9cb7c6270 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa3377fe700 1 -- 172.21.15.81:0/132424338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa350022070 con 0x55c9cb7c6270 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa36a752b80 1 -- 172.21.15.81:0/132424338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa348015070 con 0x55c9cb7c6270 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa3377fe700 1 -- 172.21.15.81:0/132424338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa350003c00 con 0x55c9cb7c6270 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa36a752b80 10 client.16941 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa36a752b80 1 -- 172.21.15.81:0/132424338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c9cb595c70 con 0x55c9cb7c6270 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa3377fe700 1 -- 172.21.15.81:0/132424338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa348015070 con 0x55c9cb7c6270 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa3377fe700 1 -- 172.21.15.81:0/132424338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa35000b0d0 con 0x55c9cb7c6270 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa36a752b80 10 client.16941 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:14.661 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa36a752b80 10 client.16941 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:14.662 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa36a752b80 20 client.16941 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:14.662 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa36a752b80 1 --2- 172.21.15.81:0/132424338 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c9cb830a20 0x55c9cb832e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:14.662 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa36a752b80 4 client.16941 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:08:14.662 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa36a752b80 1 -- 172.21.15.81:0/132424338 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c9cb708e60 con 0x55c9cb830a20 2024-05-09T00:08:14.662 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.661+0000 7fa357fff700 1 --2- 172.21.15.81:0/132424338 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c9cb830a20 0x55c9cb832e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:14.662 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.662+0000 7fa3377fe700 10 client.16941 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:14.662 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.662+0000 7fa357fff700 1 --2- 172.21.15.81:0/132424338 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c9cb830a20 0x55c9cb832e40 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9732ff39cd5adb67 server_cookie=504ab7f571bd266c in_seq=0 out_seq=0 2024-05-09T00:08:14.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.676+0000 7fa3377fe700 1 -- 172.21.15.81:0/132424338 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c9cb708e60 con 0x55c9cb830a20 2024-05-09T00:08:14.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.676+0000 7fa3377fe700 10 client.16941 handle_command_reply: tid=0 2024-05-09T00:08:14.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.676+0000 7fa36a752b80 1 client.16941 shutdown 2024-05-09T00:08:14.672 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.676+0000 7fa36a752b80 1 -- 172.21.15.81:0/132424338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c6270 msgr2=0x55c9cb7d08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.676+0000 7fa36a752b80 1 --2- 172.21.15.81:0/132424338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c6270 0x55c9cb7d08e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fa350015000 tx=0x7fa350009300 comp rx=0 tx=0).stop 2024-05-09T00:08:14.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.676+0000 7fa36a752b80 1 -- 172.21.15.81:0/132424338 shutdown_connections 2024-05-09T00:08:14.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.676+0000 7fa36a752b80 1 --2- 172.21.15.81:0/132424338 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c9cb830a20 0x55c9cb832e40 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.676+0000 7fa36a752b80 1 --2- 172.21.15.81:0/132424338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c9cb7c6270 0x55c9cb7d08e0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.676+0000 7fa3377fe700 0 client.16941 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:14.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.676+0000 7fa36a752b80 1 --2- 172.21.15.81:0/132424338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c9cb7c0480 0x55c9cb7cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.676+0000 7fa36a752b80 1 --2- 172.21.15.81:0/132424338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c9cb7c5950 0x55c9cb7d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.676+0000 7fa36a752b80 1 -- 172.21.15.81:0/132424338 >> 172.21.15.81:0/132424338 conn(0x55c9cb71e1b0 msgr2=0x55c9cb7c7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:14.673 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.676+0000 7fa36a752b80 1 -- 172.21.15.81:0/132424338 shutdown_connections 2024-05-09T00:08:14.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.676+0000 7fa36a752b80 1 -- 172.21.15.81:0/132424338 wait complete. 2024-05-09T00:08:14.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.677+0000 7fa36a752b80 20 client.16941 trim_cache size 0 max 16384 2024-05-09T00:08:14.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:08:14.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:08:14.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:08:14.674 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:08:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.677+0000 7fa35e598700 1 -- 172.21.15.81:0/353238363 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3440a1290 msgr2=0x7fa3440a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.677+0000 7fa35e598700 1 --2- 172.21.15.81:0/353238363 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3440a1290 0x7fa3440a3750 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa348005950 tx=0x7fa34800b410 comp rx=0 tx=0).stop 2024-05-09T00:08:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.677+0000 7fa35e598700 1 -- 172.21.15.81:0/353238363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358100760 msgr2=0x7fa358198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.677+0000 7fa35e598700 1 --2- 172.21.15.81:0/353238363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358100760 0x7fa358198840 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fa34000d950 tx=0x7fa34000dc60 comp rx=0 tx=0).stop 2024-05-09T00:08:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.677+0000 7fa35e598700 1 -- 172.21.15.81:0/353238363 shutdown_connections 2024-05-09T00:08:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.677+0000 7fa35e598700 1 --2- 172.21.15.81:0/353238363 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3440a1290 0x7fa3440a3750 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.677+0000 7fa35e598700 1 --2- 172.21.15.81:0/353238363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3580ffda0 0x7fa358198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.677+0000 7fa35e598700 1 --2- 172.21.15.81:0/353238363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa358105e60 0x7fa3581a3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.675 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.677+0000 7fa35e598700 1 --2- 172.21.15.81:0/353238363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa358100760 0x7fa358198840 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.677+0000 7fa35e598700 1 -- 172.21.15.81:0/353238363 >> 172.21.15.81:0/353238363 conn(0x7fa358076f10 msgr2=0x7fa3580fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.677+0000 7fa35e598700 1 -- 172.21.15.81:0/353238363 shutdown_connections 2024-05-09T00:08:14.676 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:14.677+0000 7fa35e598700 1 -- 172.21.15.81:0/353238363 wait complete. 2024-05-09T00:08:15.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:15 smithi171 ceph-mon[47351]: pgmap v162: 97 pgs: 97 active+clean; 2.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 80 KiB/s wr, 36 op/s 2024-05-09T00:08:15.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:15 smithi081 ceph-mon[42474]: pgmap v162: 97 pgs: 97 active+clean; 2.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 80 KiB/s wr, 36 op/s 2024-05-09T00:08:15.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:15 smithi150 ceph-mon[46187]: pgmap v162: 97 pgs: 97 active+clean; 2.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 80 KiB/s wr, 36 op/s 2024-05-09T00:08:17.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:17 smithi171 ceph-mon[47351]: pgmap v163: 97 pgs: 97 active+clean; 2.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-05-09T00:08:17.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:17 smithi081 ceph-mon[42474]: pgmap v163: 97 pgs: 97 active+clean; 2.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-05-09T00:08:17.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:17 smithi150 ceph-mon[46187]: pgmap v163: 97 pgs: 97 active+clean; 2.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-05-09T00:08:19.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:19 smithi171 ceph-mon[47351]: pgmap v164: 97 pgs: 97 active+clean; 2.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-05-09T00:08:19.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:19 smithi081 ceph-mon[42474]: pgmap v164: 97 pgs: 97 active+clean; 2.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-05-09T00:08:19.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:19 smithi150 ceph-mon[46187]: pgmap v164: 97 pgs: 97 active+clean; 2.9 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-05-09T00:08:21.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:21 smithi171 ceph-mon[47351]: pgmap v165: 97 pgs: 97 active+clean; 3.0 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 17 op/s 2024-05-09T00:08:21.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:21 smithi081 ceph-mon[42474]: pgmap v165: 97 pgs: 97 active+clean; 3.0 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 17 op/s 2024-05-09T00:08:21.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:21 smithi150 ceph-mon[46187]: pgmap v165: 97 pgs: 97 active+clean; 3.0 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 17 op/s 2024-05-09T00:08:23.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:23 smithi171 ceph-mon[47351]: pgmap v166: 97 pgs: 97 active+clean; 3.0 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-05-09T00:08:23.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:23 smithi081 ceph-mon[42474]: pgmap v166: 97 pgs: 97 active+clean; 3.0 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-05-09T00:08:23.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:23 smithi150 ceph-mon[46187]: pgmap v166: 97 pgs: 97 active+clean; 3.0 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 KiB/s wr, 12 op/s 2024-05-09T00:08:25.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:25 smithi171 ceph-mon[47351]: pgmap v167: 97 pgs: 97 active+clean; 3.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-05-09T00:08:25.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:25 smithi081 ceph-mon[42474]: pgmap v167: 97 pgs: 97 active+clean; 3.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-05-09T00:08:25.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:25 smithi150 ceph-mon[46187]: pgmap v167: 97 pgs: 97 active+clean; 3.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-05-09T00:08:27.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:27 smithi171 ceph-mon[47351]: pgmap v168: 97 pgs: 97 active+clean; 3.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 9 op/s 2024-05-09T00:08:27.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:27 smithi081 ceph-mon[42474]: pgmap v168: 97 pgs: 97 active+clean; 3.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 9 op/s 2024-05-09T00:08:27.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:27 smithi150 ceph-mon[46187]: pgmap v168: 97 pgs: 97 active+clean; 3.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 9 op/s 2024-05-09T00:08:27.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.794+0000 7f9399065700 1 -- 172.21.15.81:0/2864969030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93941002f0 msgr2=0x7f93941006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.794+0000 7f9399065700 1 --2- 172.21.15.81:0/2864969030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93941002f0 0x7f93941006d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f9384009990 tx=0x7f9384009ca0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.794+0000 7f9399065700 1 -- 172.21.15.81:0/2864969030 shutdown_connections 2024-05-09T00:08:27.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.794+0000 7f9399065700 1 --2- 172.21.15.81:0/2864969030 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9394105130 0x7f939410ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.794+0000 7f9399065700 1 --2- 172.21.15.81:0/2864969030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93941002f0 0x7f93941006d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.794+0000 7f9399065700 1 --2- 172.21.15.81:0/2864969030 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9394100ca0 0x7f9394104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.794+0000 7f9399065700 1 -- 172.21.15.81:0/2864969030 >> 172.21.15.81:0/2864969030 conn(0x7f9394076c00 msgr2=0x7f9394077010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:27.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.794+0000 7f9399065700 1 -- 172.21.15.81:0/2864969030 shutdown_connections 2024-05-09T00:08:27.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.795+0000 7f9399065700 1 -- 172.21.15.81:0/2864969030 wait complete. 2024-05-09T00:08:27.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.795+0000 7f9399065700 1 Processor -- start 2024-05-09T00:08:27.793 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f9399065700 1 -- start start 2024-05-09T00:08:27.793 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f9399065700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93941002f0 0x7f9394199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.793 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f9399065700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9394105130 0x7f9394199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f9399065700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f939419de00 0x7f939419e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f9399065700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939419e880 con 0x7f939419de00 2024-05-09T00:08:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f9399065700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939419e9f0 con 0x7f93941002f0 2024-05-09T00:08:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f9399065700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939419ebb0 con 0x7f9394105130 2024-05-09T00:08:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f939359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f939419de00 0x7f939419e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f939359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f939419de00 0x7f939419e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59420/0 (socket says 172.21.15.81:59420) 2024-05-09T00:08:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f939359e700 1 -- 172.21.15.81:0/984212993 learned_addr learned my addr 172.21.15.81:0/984212993 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f939259c700 1 --2- 172.21.15.81:0/984212993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9394105130 0x7f9394199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f9392d9d700 1 --2- 172.21.15.81:0/984212993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93941002f0 0x7f9394199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f939359e700 1 -- 172.21.15.81:0/984212993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9394105130 msgr2=0x7f9394199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f939359e700 1 --2- 172.21.15.81:0/984212993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9394105130 0x7f9394199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f939359e700 1 -- 172.21.15.81:0/984212993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93941002f0 msgr2=0x7f9394199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.794 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f939359e700 1 --2- 172.21.15.81:0/984212993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93941002f0 0x7f9394199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.795 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f939359e700 1 -- 172.21.15.81:0/984212993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93840095f0 con 0x7f939419de00 2024-05-09T00:08:27.795 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.796+0000 7f939359e700 1 --2- 172.21.15.81:0/984212993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f939419de00 0x7f939419e280 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f938c007ee0 tx=0x7f938c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:27.795 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.797+0000 7f937bfff700 1 -- 172.21.15.81:0/984212993 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c00ddd0 con 0x7f939419de00 2024-05-09T00:08:27.795 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.797+0000 7f9399065700 1 -- 172.21.15.81:0/984212993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93941a6110 con 0x7f939419de00 2024-05-09T00:08:27.795 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.797+0000 7f937bfff700 1 -- 172.21.15.81:0/984212993 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f938c00f040 con 0x7f939419de00 2024-05-09T00:08:27.795 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.797+0000 7f937bfff700 1 -- 172.21.15.81:0/984212993 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c0048e0 con 0x7f939419de00 2024-05-09T00:08:27.795 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.797+0000 7f9399065700 1 -- 172.21.15.81:0/984212993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93941a65f0 con 0x7f939419de00 2024-05-09T00:08:27.798 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.799+0000 7f937bfff700 1 -- 172.21.15.81:0/984212993 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f938c003a00 con 0x7f939419de00 2024-05-09T00:08:27.798 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.800+0000 7f937bfff700 1 --2- 172.21.15.81:0/984212993 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f937c0a1310 0x7f937c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.798 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.800+0000 7f9392d9d700 1 --2- 172.21.15.81:0/984212993 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f937c0a1310 0x7f937c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.798 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.800+0000 7f93a521fb80 1 Processor -- start 2024-05-09T00:08:27.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.800+0000 7f937bfff700 1 -- 172.21.15.81:0/984212993 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f938c0cc650 con 0x7f939419de00 2024-05-09T00:08:27.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.800+0000 7f93a521fb80 1 -- start start 2024-05-09T00:08:27.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f93a521fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 0x561d579a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f93a521fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d5799af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f93a521fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 0x561d5799b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f93a521fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d578f20f0 con 0x561d579a1270 2024-05-09T00:08:27.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f93a521fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d578efab0 con 0x561d579a0950 2024-05-09T00:08:27.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f93a521fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d578eb3a0 con 0x561d5799b480 2024-05-09T00:08:27.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f9392d9d700 1 --2- 172.21.15.81:0/984212993 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f937c0a1310 0x7f937c0a37d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9384005850 tx=0x7f938401a040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:27.799 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f939259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d5799af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f939259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d5799af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59428/0 (socket says 172.21.15.81:59428) 2024-05-09T00:08:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f939259c700 1 -- 172.21.15.81:0/2068418957 learned_addr learned my addr 172.21.15.81:0/2068418957 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f939359e700 1 --2- 172.21.15.81:0/2068418957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 0x561d5799b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f9392d9d700 1 --2- 172.21.15.81:0/2068418957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 0x561d579a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f939259c700 1 -- 172.21.15.81:0/2068418957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 msgr2=0x561d5799b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f939259c700 1 --2- 172.21.15.81:0/2068418957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 0x561d5799b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f939259c700 1 -- 172.21.15.81:0/2068418957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 msgr2=0x561d579a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f939259c700 1 --2- 172.21.15.81:0/2068418957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 0x561d579a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f939259c700 1 -- 172.21.15.81:0/2068418957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d5776c350 con 0x561d579a1270 2024-05-09T00:08:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f939259c700 1 --2- 172.21.15.81:0/2068418957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d5799af40 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f938800bcb0 tx=0x7f93880103d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d95ce8315fd17a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f93797fa700 1 -- 172.21.15.81:0/2068418957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388010dc0 con 0x561d579a1270 2024-05-09T00:08:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f93797fa700 1 -- 172.21.15.81:0/2068418957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9388015070 con 0x561d579a1270 2024-05-09T00:08:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.801+0000 7f93797fa700 1 -- 172.21.15.81:0/2068418957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388005220 con 0x561d579a1270 2024-05-09T00:08:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.802+0000 7f93a521fb80 1 -- 172.21.15.81:0/2068418957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 msgr2=0x561d5799af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.802+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2068418957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d5799af40 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f938800bcb0 tx=0x7f93880103d0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.802+0000 7f93a521fb80 1 -- 172.21.15.81:0/2068418957 shutdown_connections 2024-05-09T00:08:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.802+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2068418957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 0x561d579a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.802+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2068418957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 0x561d5799b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.802+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2068418957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d5799af40 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.802+0000 7f93a521fb80 1 -- 172.21.15.81:0/2068418957 >> 172.21.15.81:0/2068418957 conn(0x561d578f91b0 msgr2=0x561d57995840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.802+0000 7f93a521fb80 1 -- 172.21.15.81:0/2068418957 shutdown_connections 2024-05-09T00:08:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.802+0000 7f93a521fb80 1 -- 172.21.15.81:0/2068418957 wait complete. 2024-05-09T00:08:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.802+0000 7f93a521fb80 1 -- start start 2024-05-09T00:08:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f93a521fb80 1 Processor -- start 2024-05-09T00:08:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f93a521fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 0x561d579a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f93a521fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 0x561d579a44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f93a521fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d579a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f93a521fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d57887500 con 0x561d579a1270 2024-05-09T00:08:27.806 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f93a521fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d578871a0 con 0x561d579a0950 2024-05-09T00:08:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f93a521fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5776e640 con 0x561d5799b480 2024-05-09T00:08:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f93a521fb80 10 client.0 _ll_register_callbacks cb 0x561d57890ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:27.809 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f939359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d579a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f939359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d579a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59440/0 (socket says 172.21.15.81:59440) 2024-05-09T00:08:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f939359e700 1 -- 172.21.15.81:0/2515741914 learned_addr learned my addr 172.21.15.81:0/2515741914 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f9392d9d700 1 --2- 172.21.15.81:0/2515741914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 0x561d579a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f939259c700 1 --2- 172.21.15.81:0/2515741914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 0x561d579a44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f939359e700 1 -- 172.21.15.81:0/2515741914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 msgr2=0x561d579a7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f939359e700 1 --2- 172.21.15.81:0/2515741914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 0x561d579a7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f939359e700 1 -- 172.21.15.81:0/2515741914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 msgr2=0x561d579a44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f939359e700 1 --2- 172.21.15.81:0/2515741914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 0x561d579a44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f939359e700 1 -- 172.21.15.81:0/2515741914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938800b8e0 con 0x561d579a1270 2024-05-09T00:08:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.803+0000 7f939259c700 1 --2- 172.21.15.81:0/2515741914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 0x561d579a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f939359e700 1 --2- 172.21.15.81:0/2515741914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d579a4c10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f938c095c20 tx=0x7f938c0995f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38da99924bfbab7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f9376ff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f9376ff5700 1 -- 172.21.15.81:0/2515741914 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c09d550 con 0x561d579a1270 2024-05-09T00:08:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f9376ff5700 1 -- 172.21.15.81:0/2515741914 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f938c0a1ba0 con 0x561d579a1270 2024-05-09T00:08:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f93a521fb80 1 -- 172.21.15.81:0/2515741914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d57844210 con 0x561d579a1270 2024-05-09T00:08:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f9376ff5700 1 -- 172.21.15.81:0/2515741914 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f938c09d160 con 0x561d579a1270 2024-05-09T00:08:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f93a521fb80 10 client.16953 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f93a521fb80 1 -- 172.21.15.81:0/2515741914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561d57718b00 con 0x561d579a1270 2024-05-09T00:08:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f9376ff5700 1 -- 172.21.15.81:0/2515741914 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561d57844210 con 0x561d579a1270 2024-05-09T00:08:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f9376ff5700 1 -- 172.21.15.81:0/2515741914 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f938c099980 con 0x561d579a1270 2024-05-09T00:08:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f93a521fb80 10 client.16953 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f93a521fb80 10 client.16953 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f93a521fb80 20 client.16953 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2515741914 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561d579b4c10 0x561d579b7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f93a521fb80 4 client.16953 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:08:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.804+0000 7f93a521fb80 1 -- 172.21.15.81:0/2515741914 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d5796a7b0 con 0x561d579b4c10 2024-05-09T00:08:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.805+0000 7f9392d9d700 1 --2- 172.21.15.81:0/2515741914 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561d579b4c10 0x561d579b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.805+0000 7f9392d9d700 1 --2- 172.21.15.81:0/2515741914 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561d579b4c10 0x561d579b7030 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72c840c5a7098792 server_cookie=5187fc02a7457a73 in_seq=0 out_seq=0 2024-05-09T00:08:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.805+0000 7f9376ff5700 10 client.16953 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f9376ff5700 1 -- 172.21.15.81:0/2515741914 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561d5796a7b0 con 0x561d579b4c10 2024-05-09T00:08:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f9376ff5700 10 client.16953 handle_command_reply: tid=0 2024-05-09T00:08:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f93a521fb80 1 client.16953 shutdown 2024-05-09T00:08:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f93a521fb80 1 -- 172.21.15.81:0/2515741914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 msgr2=0x561d579a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2515741914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d579a4c10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f938c095c20 tx=0x7f938c0995f0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f93a521fb80 1 -- 172.21.15.81:0/2515741914 shutdown_connections 2024-05-09T00:08:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2515741914 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561d579b4c10 0x561d579b7030 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2515741914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d579a4c10 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2515741914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 0x561d579a7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2515741914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 0x561d579a44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.812 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f9376ff5700 0 client.16953 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:27.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f93a521fb80 1 -- 172.21.15.81:0/2515741914 >> 172.21.15.81:0/2515741914 conn(0x561d578f91b0 msgr2=0x561d5799f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:27.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f93a521fb80 1 -- 172.21.15.81:0/2515741914 shutdown_connections 2024-05-09T00:08:27.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f93a521fb80 1 -- 172.21.15.81:0/2515741914 wait complete. 2024-05-09T00:08:27.813 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.806+0000 7f93a521fb80 20 client.16953 trim_cache size 0 max 16384 2024-05-09T00:08:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f93a521fb80 1 Processor -- start 2024-05-09T00:08:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f93a521fb80 1 -- start start 2024-05-09T00:08:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f93a521fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d5799b480 0x561d579b7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f93a521fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d579a0950 0x561d579970f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f93a521fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d579b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f93a521fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d579b0fb0 con 0x561d579a1270 2024-05-09T00:08:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f93a521fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5799a130 con 0x561d5799b480 2024-05-09T00:08:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f93a521fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d57999ec0 con 0x561d579a0950 2024-05-09T00:08:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f939359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d579b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f939359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d579b06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59446/0 (socket says 172.21.15.81:59446) 2024-05-09T00:08:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f939359e700 1 -- 172.21.15.81:0/329509334 learned_addr learned my addr 172.21.15.81:0/329509334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f9392d9d700 1 --2- 172.21.15.81:0/329509334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d5799b480 0x561d579b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f939259c700 1 --2- 172.21.15.81:0/329509334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d579a0950 0x561d579970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f939359e700 1 -- 172.21.15.81:0/329509334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d579a0950 msgr2=0x561d579970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f939359e700 1 --2- 172.21.15.81:0/329509334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d579a0950 0x561d579970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f939359e700 1 -- 172.21.15.81:0/329509334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d5799b480 msgr2=0x561d579b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f939359e700 1 --2- 172.21.15.81:0/329509334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d5799b480 0x561d579b7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f939359e700 1 -- 172.21.15.81:0/329509334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d578b1500 con 0x561d579a1270 2024-05-09T00:08:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f9392d9d700 1 --2- 172.21.15.81:0/329509334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d5799b480 0x561d579b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.821+0000 7f939359e700 1 --2- 172.21.15.81:0/329509334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d579b06c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f938c00d7b0 tx=0x7f938c097cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592360c3debfa6b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.822+0000 7f9379ffb700 1 -- 172.21.15.81:0/329509334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c0a1ba0 con 0x561d579a1270 2024-05-09T00:08:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.822+0000 7f9379ffb700 1 -- 172.21.15.81:0/329509334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f938c09a0b0 con 0x561d579a1270 2024-05-09T00:08:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.822+0000 7f9379ffb700 1 -- 172.21.15.81:0/329509334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c0c9fe0 con 0x561d579a1270 2024-05-09T00:08:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.822+0000 7f93a521fb80 1 -- 172.21.15.81:0/329509334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 msgr2=0x561d579b06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.822+0000 7f93a521fb80 1 --2- 172.21.15.81:0/329509334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d579b06c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f938c00d7b0 tx=0x7f938c097cd0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.822+0000 7f93a521fb80 1 -- 172.21.15.81:0/329509334 shutdown_connections 2024-05-09T00:08:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.822+0000 7f93a521fb80 1 --2- 172.21.15.81:0/329509334 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d5799b480 0x561d579b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.822+0000 7f93a521fb80 1 --2- 172.21.15.81:0/329509334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d579b06c0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.822+0000 7f93a521fb80 1 --2- 172.21.15.81:0/329509334 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d579a0950 0x561d579970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.822+0000 7f93a521fb80 1 -- 172.21.15.81:0/329509334 >> 172.21.15.81:0/329509334 conn(0x561d578f91b0 msgr2=0x561d579a2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.822+0000 7f93a521fb80 1 -- 172.21.15.81:0/329509334 shutdown_connections 2024-05-09T00:08:27.826 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.822+0000 7f93a521fb80 1 -- 172.21.15.81:0/329509334 wait complete. 2024-05-09T00:08:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.822+0000 7f93a521fb80 1 -- start start 2024-05-09T00:08:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f93a521fb80 1 Processor -- start 2024-05-09T00:08:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f93a521fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 0x561d579abc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f93a521fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 0x561d579ac150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f93a521fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d5799e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f93a521fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5799eaf0 con 0x561d579a1270 2024-05-09T00:08:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f93a521fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5799ec60 con 0x561d579a0950 2024-05-09T00:08:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f93a521fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d5799ee20 con 0x561d5799b480 2024-05-09T00:08:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f93a521fb80 10 client.0 _ll_register_callbacks cb 0x561d57890ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f939359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d5799e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f939359e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d5799e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59458/0 (socket says 172.21.15.81:59458) 2024-05-09T00:08:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f939359e700 1 -- 172.21.15.81:0/2612467225 learned_addr learned my addr 172.21.15.81:0/2612467225 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f9392d9d700 1 --2- 172.21.15.81:0/2612467225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 0x561d579abc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f939259c700 1 --2- 172.21.15.81:0/2612467225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 0x561d579ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f939359e700 1 -- 172.21.15.81:0/2612467225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 msgr2=0x561d579abc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f939359e700 1 --2- 172.21.15.81:0/2612467225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 0x561d579abc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f939359e700 1 -- 172.21.15.81:0/2612467225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 msgr2=0x561d579ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f939359e700 1 --2- 172.21.15.81:0/2612467225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 0x561d579ac150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f939359e700 1 -- 172.21.15.81:0/2612467225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d57718b00 con 0x561d579a1270 2024-05-09T00:08:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f939359e700 1 --2- 172.21.15.81:0/2612467225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d5799e3e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f938c0a1670 tx=0x7f938c004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9504fd1aa135a93 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f9376ff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f9376ff5700 1 -- 172.21.15.81:0/2612467225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c09a4a0 con 0x561d579a1270 2024-05-09T00:08:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f9376ff5700 1 -- 172.21.15.81:0/2612467225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f938c09d550 con 0x561d579a1270 2024-05-09T00:08:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.823+0000 7f93a521fb80 1 -- 172.21.15.81:0/2612467225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9388015070 con 0x561d579a1270 2024-05-09T00:08:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.824+0000 7f9376ff5700 1 -- 172.21.15.81:0/2612467225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f938c0ca1f0 con 0x561d579a1270 2024-05-09T00:08:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.824+0000 7f93a521fb80 10 client.16959 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.824+0000 7f93a521fb80 1 -- 172.21.15.81:0/2612467225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561d57770c70 con 0x561d579a1270 2024-05-09T00:08:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.824+0000 7f9376ff5700 1 -- 172.21.15.81:0/2612467225 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f938c065020 con 0x561d579a1270 2024-05-09T00:08:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.824+0000 7f9376ff5700 1 -- 172.21.15.81:0/2612467225 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f938c0a1710 con 0x561d579a1270 2024-05-09T00:08:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.824+0000 7f93a521fb80 10 client.16959 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.824+0000 7f93a521fb80 10 client.16959 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.824+0000 7f93a521fb80 20 client.16959 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.824+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2612467225 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561d57a0b110 0x561d57a0d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.824+0000 7f93a521fb80 4 client.16959 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:08:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.824+0000 7f93a521fb80 1 -- 172.21.15.81:0/2612467225 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561d578e3e60 con 0x561d57a0b110 2024-05-09T00:08:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.824+0000 7f9392d9d700 1 --2- 172.21.15.81:0/2612467225 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561d57a0b110 0x561d57a0d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.824+0000 7f9392d9d700 1 --2- 172.21.15.81:0/2612467225 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561d57a0b110 0x561d57a0d500 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dcb3d2b9d0fa01f server_cookie=4e6a2154f9bd789a in_seq=0 out_seq=0 2024-05-09T00:08:27.830 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.824+0000 7f9376ff5700 10 client.16959 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.838+0000 7f9376ff5700 1 -- 172.21.15.81:0/2612467225 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561d578e3e60 con 0x561d57a0b110 2024-05-09T00:08:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.838+0000 7f9376ff5700 10 client.16959 handle_command_reply: tid=0 2024-05-09T00:08:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.838+0000 7f93a521fb80 1 client.16959 shutdown 2024-05-09T00:08:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.838+0000 7f93a521fb80 1 -- 172.21.15.81:0/2612467225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 msgr2=0x561d5799e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.838+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2612467225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d5799e3e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f938c0a1670 tx=0x7f938c004380 comp rx=0 tx=0).stop 2024-05-09T00:08:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.838+0000 7f93a521fb80 1 -- 172.21.15.81:0/2612467225 shutdown_connections 2024-05-09T00:08:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.838+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2612467225 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561d57a0b110 0x561d57a0d500 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.838+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2612467225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561d579a1270 0x561d5799e3e0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.838+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2612467225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561d5799b480 0x561d579abc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.838+0000 7f9376ff5700 0 client.16959 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.838+0000 7f93a521fb80 1 --2- 172.21.15.81:0/2612467225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561d579a0950 0x561d579ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.838+0000 7f93a521fb80 1 -- 172.21.15.81:0/2612467225 >> 172.21.15.81:0/2612467225 conn(0x561d578f91b0 msgr2=0x561d579a3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f93a521fb80 1 -- 172.21.15.81:0/2612467225 shutdown_connections 2024-05-09T00:08:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f93a521fb80 1 -- 172.21.15.81:0/2612467225 wait complete. 2024-05-09T00:08:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f93a521fb80 20 client.16959 trim_cache size 0 max 16384 2024-05-09T00:08:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:08:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:08:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:08:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:08:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f9399065700 1 -- 172.21.15.81:0/984212993 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f937c0a1310 msgr2=0x7f937c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f9399065700 1 --2- 172.21.15.81:0/984212993 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f937c0a1310 0x7f937c0a37d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9384005850 tx=0x7f938401a040 comp rx=0 tx=0).stop 2024-05-09T00:08:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f9399065700 1 -- 172.21.15.81:0/984212993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f939419de00 msgr2=0x7f939419e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f9399065700 1 --2- 172.21.15.81:0/984212993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f939419de00 0x7f939419e280 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f938c007ee0 tx=0x7f938c00d3b0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f9399065700 1 -- 172.21.15.81:0/984212993 shutdown_connections 2024-05-09T00:08:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f9399065700 1 --2- 172.21.15.81:0/984212993 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f937c0a1310 0x7f937c0a37d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f9399065700 1 --2- 172.21.15.81:0/984212993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f93941002f0 0x7f9394199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f9399065700 1 --2- 172.21.15.81:0/984212993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f939419de00 0x7f939419e280 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f9399065700 1 --2- 172.21.15.81:0/984212993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9394105130 0x7f9394199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f9399065700 1 -- 172.21.15.81:0/984212993 >> 172.21.15.81:0/984212993 conn(0x7f9394076c00 msgr2=0x7f93940ff3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f9399065700 1 -- 172.21.15.81:0/984212993 shutdown_connections 2024-05-09T00:08:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:27.839+0000 7f9399065700 1 -- 172.21.15.81:0/984212993 wait complete. 2024-05-09T00:08:29.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:29 smithi171 ceph-mon[47351]: pgmap v169: 97 pgs: 97 active+clean; 3.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 9 op/s 2024-05-09T00:08:29.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:29 smithi081 ceph-mon[42474]: pgmap v169: 97 pgs: 97 active+clean; 3.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 9 op/s 2024-05-09T00:08:29.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:29 smithi150 ceph-mon[46187]: pgmap v169: 97 pgs: 97 active+clean; 3.2 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 31 KiB/s wr, 9 op/s 2024-05-09T00:08:31.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:08:31.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:31 smithi171 ceph-mon[47351]: pgmap v170: 97 pgs: 97 active+clean; 3.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-05-09T00:08:31.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.324+0000 7f514881f700 1 -- 172.21.15.81:0/1474961761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51440ff580 msgr2=0x7f51440ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.324+0000 7f514881f700 1 --2- 172.21.15.81:0/1474961761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51440ff580 0x7f51440ffa00 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f51340099c0 tx=0x7f5134009cd0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.324+0000 7f514881f700 1 -- 172.21.15.81:0/1474961761 shutdown_connections 2024-05-09T00:08:31.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.324+0000 7f514881f700 1 --2- 172.21.15.81:0/1474961761 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5144105640 0x7f5144105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.324+0000 7f514881f700 1 --2- 172.21.15.81:0/1474961761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51440fff40 0x7f514410c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.324+0000 7f514881f700 1 --2- 172.21.15.81:0/1474961761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51440ff580 0x7f51440ffa00 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.324+0000 7f514881f700 1 -- 172.21.15.81:0/1474961761 >> 172.21.15.81:0/1474961761 conn(0x7f51440763a0 msgr2=0x7f51440fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:31.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.324+0000 7f514881f700 1 -- 172.21.15.81:0/1474961761 shutdown_connections 2024-05-09T00:08:31.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.324+0000 7f514881f700 1 -- 172.21.15.81:0/1474961761 wait complete. 2024-05-09T00:08:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.325+0000 7f514881f700 1 Processor -- start 2024-05-09T00:08:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.325+0000 7f514881f700 1 -- start start 2024-05-09T00:08:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.325+0000 7f514881f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51440ff580 0x7f51441961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.325+0000 7f514881f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51440fff40 0x7f5144196720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.325+0000 7f514881f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5144105640 0x7f514419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.325+0000 7f514881f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514419b100 con 0x7f5144105640 2024-05-09T00:08:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.325+0000 7f514881f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514419b270 con 0x7f51440fff40 2024-05-09T00:08:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.325+0000 7f514881f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514419b430 con 0x7f51440ff580 2024-05-09T00:08:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.325+0000 7f5142d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5144105640 0x7f514419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.325+0000 7f5142d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5144105640 0x7f514419aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59474/0 (socket says 172.21.15.81:59474) 2024-05-09T00:08:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.325+0000 7f5142d9d700 1 -- 172.21.15.81:0/2961256753 learned_addr learned my addr 172.21.15.81:0/2961256753 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.325+0000 7f514259c700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51440ff580 0x7f51441961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.326+0000 7f5141d9b700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51440fff40 0x7f5144196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.326+0000 7f5142d9d700 1 -- 172.21.15.81:0/2961256753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51440ff580 msgr2=0x7f51441961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.326+0000 7f5142d9d700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51440ff580 0x7f51441961e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.326+0000 7f5142d9d700 1 -- 172.21.15.81:0/2961256753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51440fff40 msgr2=0x7f5144196720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.326+0000 7f5142d9d700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51440fff40 0x7f5144196720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.326+0000 7f5142d9d700 1 -- 172.21.15.81:0/2961256753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51340095f0 con 0x7f5144105640 2024-05-09T00:08:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.326+0000 7f5141d9b700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51440fff40 0x7f5144196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.326+0000 7f5142d9d700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5144105640 0x7f514419aac0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f513c00b970 tx=0x7f513c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.326+0000 7f513b7fe700 1 -- 172.21.15.81:0/2961256753 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c00c930 con 0x7f5144105640 2024-05-09T00:08:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.326+0000 7f513b7fe700 1 -- 172.21.15.81:0/2961256753 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f513c014440 con 0x7f5144105640 2024-05-09T00:08:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.326+0000 7f514881f700 1 -- 172.21.15.81:0/2961256753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514419b710 con 0x7f5144105640 2024-05-09T00:08:31.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.326+0000 7f513b7fe700 1 -- 172.21.15.81:0/2961256753 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0075d0 con 0x7f5144105640 2024-05-09T00:08:31.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.326+0000 7f514881f700 1 -- 172.21.15.81:0/2961256753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51441a2f50 con 0x7f5144105640 2024-05-09T00:08:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.328+0000 7f513b7fe700 1 -- 172.21.15.81:0/2961256753 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f513c0145b0 con 0x7f5144105640 2024-05-09T00:08:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.329+0000 7f513b7fe700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f51300a1290 0x7f51300a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.329+0000 7f513b7fe700 1 -- 172.21.15.81:0/2961256753 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f513c006e40 con 0x7f5144105640 2024-05-09T00:08:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.329+0000 7f514259c700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f51300a1290 0x7f51300a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.329+0000 7f514259c700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f51300a1290 0x7f51300a3750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f512c00ac50 tx=0x7f512c00a380 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f51549d9b80 1 Processor -- start 2024-05-09T00:08:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f51549d9b80 1 -- start start 2024-05-09T00:08:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f51549d9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d34e00 0x55acc1d351e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f51549d9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 0x55acc1d2f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f51549d9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 0x55acc1d2fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f51549d9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acc1c86150 con 0x55acc1d34e00 2024-05-09T00:08:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f51549d9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acc1c83b10 con 0x55acc1d35720 2024-05-09T00:08:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f51549d9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acc1c7f400 con 0x55acc1d2f890 2024-05-09T00:08:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f514259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d34e00 0x55acc1d351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f514259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d34e00 0x55acc1d351e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59490/0 (socket says 172.21.15.81:59490) 2024-05-09T00:08:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f514259c700 1 -- 172.21.15.81:0/2180256363 learned_addr learned my addr 172.21.15.81:0/2180256363 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f5141d9b700 1 --2- 172.21.15.81:0/2180256363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 0x55acc1d2f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f5142d9d700 1 --2- 172.21.15.81:0/2180256363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 0x55acc1d2fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f514259c700 1 -- 172.21.15.81:0/2180256363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 msgr2=0x55acc1d2fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f514259c700 1 --2- 172.21.15.81:0/2180256363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 0x55acc1d2fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f514259c700 1 -- 172.21.15.81:0/2180256363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 msgr2=0x55acc1d2f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f514259c700 1 --2- 172.21.15.81:0/2180256363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 0x55acc1d2f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f514259c700 1 -- 172.21.15.81:0/2180256363 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acc1b003b0 con 0x55acc1d34e00 2024-05-09T00:08:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f5141d9b700 1 --2- 172.21.15.81:0/2180256363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 0x55acc1d2f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.330+0000 7f5142d9d700 1 --2- 172.21.15.81:0/2180256363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 0x55acc1d2fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.331+0000 7f514259c700 1 --2- 172.21.15.81:0/2180256363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d34e00 0x55acc1d351e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f512c00ff90 tx=0x7f512c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42b458019154c96 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.331+0000 7f5138ff9700 1 -- 172.21.15.81:0/2180256363 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c003b10 con 0x55acc1d34e00 2024-05-09T00:08:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.331+0000 7f5138ff9700 1 -- 172.21.15.81:0/2180256363 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f512c003c70 con 0x55acc1d34e00 2024-05-09T00:08:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.331+0000 7f5138ff9700 1 -- 172.21.15.81:0/2180256363 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c01d660 con 0x55acc1d34e00 2024-05-09T00:08:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.331+0000 7f51549d9b80 1 -- 172.21.15.81:0/2180256363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d34e00 msgr2=0x55acc1d351e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.331+0000 7f51549d9b80 1 --2- 172.21.15.81:0/2180256363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d34e00 0x55acc1d351e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f512c00ff90 tx=0x7f512c012000 comp rx=0 tx=0).stop 2024-05-09T00:08:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.331+0000 7f51549d9b80 1 -- 172.21.15.81:0/2180256363 shutdown_connections 2024-05-09T00:08:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.331+0000 7f51549d9b80 1 --2- 172.21.15.81:0/2180256363 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 0x55acc1d2fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.331+0000 7f51549d9b80 1 --2- 172.21.15.81:0/2180256363 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d34e00 0x55acc1d351e0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.331+0000 7f51549d9b80 1 --2- 172.21.15.81:0/2180256363 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 0x55acc1d2f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.331+0000 7f51549d9b80 1 -- 172.21.15.81:0/2180256363 >> 172.21.15.81:0/2180256363 conn(0x55acc1c8d210 msgr2=0x55acc1d29df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.332+0000 7f51549d9b80 1 -- 172.21.15.81:0/2180256363 shutdown_connections 2024-05-09T00:08:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.332+0000 7f51549d9b80 1 -- 172.21.15.81:0/2180256363 wait complete. 2024-05-09T00:08:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.332+0000 7f51549d9b80 1 -- start start 2024-05-09T00:08:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.332+0000 7f51549d9b80 1 Processor -- start 2024-05-09T00:08:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.332+0000 7f51549d9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 0x55acc1d38ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.332+0000 7f51549d9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d34e00 0x55acc1d38ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.332+0000 7f51549d9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 0x55acc1d39530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.332+0000 7f51549d9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acc1c1b560 con 0x55acc1d34e00 2024-05-09T00:08:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.332+0000 7f51549d9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acc1c1b200 con 0x55acc1d35720 2024-05-09T00:08:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.332+0000 7f51549d9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acc1b026a0 con 0x55acc1d2f890 2024-05-09T00:08:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f51549d9b80 10 client.0 _ll_register_callbacks cb 0x55acc1c24b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f5141d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d34e00 0x55acc1d38ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f5141d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d34e00 0x55acc1d38ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59498/0 (socket says 172.21.15.81:59498) 2024-05-09T00:08:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f5141d9b700 1 -- 172.21.15.81:0/212073438 learned_addr learned my addr 172.21.15.81:0/212073438 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f514259c700 1 --2- 172.21.15.81:0/212073438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 0x55acc1d38ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f5141d9b700 1 -- 172.21.15.81:0/212073438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 msgr2=0x55acc1d38ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f5141d9b700 1 --2- 172.21.15.81:0/212073438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 0x55acc1d38ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f5141d9b700 1 -- 172.21.15.81:0/212073438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 msgr2=0x55acc1d39530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f5141d9b700 1 --2- 172.21.15.81:0/212073438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 0x55acc1d39530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f5141d9b700 1 -- 172.21.15.81:0/212073438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512c00fc40 con 0x55acc1d34e00 2024-05-09T00:08:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f5141d9b700 1 --2- 172.21.15.81:0/212073438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d34e00 0x55acc1d38ff0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f513400b580 tx=0x7f51340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8822765efcc6687 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:31.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f5129ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f5129ffb700 1 -- 172.21.15.81:0/212073438 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513400bd20 con 0x55acc1d34e00 2024-05-09T00:08:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f5129ffb700 1 -- 172.21.15.81:0/212073438 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f513400be80 con 0x55acc1d34e00 2024-05-09T00:08:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f51549d9b80 1 -- 172.21.15.81:0/212073438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55acc1bd8270 con 0x55acc1d34e00 2024-05-09T00:08:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f5129ffb700 1 -- 172.21.15.81:0/212073438 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5134004500 con 0x55acc1d34e00 2024-05-09T00:08:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f51549d9b80 10 client.16971 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.333+0000 7f51549d9b80 1 -- 172.21.15.81:0/212073438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55acc1aacb60 con 0x55acc1d34e00 2024-05-09T00:08:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.334+0000 7f5129ffb700 1 -- 172.21.15.81:0/212073438 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f513402f020 con 0x55acc1d34e00 2024-05-09T00:08:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.334+0000 7f5129ffb700 1 -- 172.21.15.81:0/212073438 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f513400f7f0 con 0x55acc1d34e00 2024-05-09T00:08:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.334+0000 7f51549d9b80 10 client.16971 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.334+0000 7f51549d9b80 10 client.16971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.334+0000 7f51549d9b80 20 client.16971 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.334+0000 7f51549d9b80 1 --2- 172.21.15.81:0/212073438 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55acc1d49180 0x55acc1d4b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.334+0000 7f51549d9b80 4 client.16971 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:08:31.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.334+0000 7f51549d9b80 1 -- 172.21.15.81:0/212073438 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55acc1cfe810 con 0x55acc1d49180 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.334+0000 7f514259c700 1 --2- 172.21.15.81:0/212073438 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55acc1d49180 0x55acc1d4b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.334+0000 7f5129ffb700 10 client.16971 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.334+0000 7f514259c700 1 --2- 172.21.15.81:0/212073438 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55acc1d49180 0x55acc1d4b5a0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28caa4947ccc3d91 server_cookie=1727f5efa46740c8 in_seq=0 out_seq=0 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f5129ffb700 1 -- 172.21.15.81:0/212073438 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55acc1cfe810 con 0x55acc1d49180 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f5129ffb700 10 client.16971 handle_command_reply: tid=0 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f51549d9b80 1 client.16971 shutdown 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f51549d9b80 1 -- 172.21.15.81:0/212073438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d34e00 msgr2=0x55acc1d38ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f51549d9b80 1 --2- 172.21.15.81:0/212073438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d34e00 0x55acc1d38ff0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f513400b580 tx=0x7f51340057f0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f51549d9b80 1 -- 172.21.15.81:0/212073438 shutdown_connections 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f51549d9b80 1 --2- 172.21.15.81:0/212073438 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55acc1d49180 0x55acc1d4b5a0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f51549d9b80 1 --2- 172.21.15.81:0/212073438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 0x55acc1d39530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f5129ffb700 0 client.16971 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f51549d9b80 1 --2- 172.21.15.81:0/212073438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 0x55acc1d38ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f51549d9b80 1 --2- 172.21.15.81:0/212073438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d34e00 0x55acc1d38ff0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f51549d9b80 1 -- 172.21.15.81:0/212073438 >> 172.21.15.81:0/212073438 conn(0x55acc1c8d210 msgr2=0x55acc1d295a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f51549d9b80 1 -- 172.21.15.81:0/212073438 shutdown_connections 2024-05-09T00:08:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f51549d9b80 1 -- 172.21.15.81:0/212073438 wait complete. 2024-05-09T00:08:31.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.335+0000 7f51549d9b80 20 client.16971 trim_cache size 0 max 16384 2024-05-09T00:08:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.352+0000 7f51549d9b80 1 Processor -- start 2024-05-09T00:08:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f51549d9b80 1 -- start start 2024-05-09T00:08:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f51549d9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 0x55acc1d2fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f51549d9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d34e00 0x55acc1d29d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f51549d9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d35720 0x55acc1d33ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f51549d9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acc1d3a0b0 con 0x55acc1d35720 2024-05-09T00:08:31.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f51549d9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acc1d507b0 con 0x55acc1d34e00 2024-05-09T00:08:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f51549d9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acc1d24800 con 0x55acc1d2f890 2024-05-09T00:08:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f5142d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d35720 0x55acc1d33ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f5142d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d35720 0x55acc1d33ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59500/0 (socket says 172.21.15.81:59500) 2024-05-09T00:08:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f5142d9d700 1 -- 172.21.15.81:0/1965734540 learned_addr learned my addr 172.21.15.81:0/1965734540 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f514259c700 1 --2- 172.21.15.81:0/1965734540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 0x55acc1d2fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f5142d9d700 1 -- 172.21.15.81:0/1965734540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 msgr2=0x55acc1d2fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f5142d9d700 1 --2- 172.21.15.81:0/1965734540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 0x55acc1d2fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f5142d9d700 1 -- 172.21.15.81:0/1965734540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d34e00 msgr2=0x55acc1d29d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f5142d9d700 1 --2- 172.21.15.81:0/1965734540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d34e00 0x55acc1d29d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f5142d9d700 1 -- 172.21.15.81:0/1965734540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acc1c45560 con 0x55acc1d35720 2024-05-09T00:08:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f5142d9d700 1 --2- 172.21.15.81:0/1965734540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d35720 0x55acc1d33ba0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f513c099430 tx=0x7f513c098fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db862a649c7d61dd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:31.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f51397fa700 1 -- 172.21.15.81:0/1965734540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0994a0 con 0x55acc1d35720 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f51397fa700 1 -- 172.21.15.81:0/1965734540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f513c09d2d0 con 0x55acc1d35720 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.353+0000 7f51397fa700 1 -- 172.21.15.81:0/1965734540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c099960 con 0x55acc1d35720 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 -- 172.21.15.81:0/1965734540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d35720 msgr2=0x55acc1d33ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 --2- 172.21.15.81:0/1965734540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d35720 0x55acc1d33ba0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f513c099430 tx=0x7f513c098fe0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 -- 172.21.15.81:0/1965734540 shutdown_connections 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 --2- 172.21.15.81:0/1965734540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d35720 0x55acc1d33ba0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 --2- 172.21.15.81:0/1965734540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d2f890 0x55acc1d2fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 --2- 172.21.15.81:0/1965734540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d34e00 0x55acc1d29d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 -- 172.21.15.81:0/1965734540 >> 172.21.15.81:0/1965734540 conn(0x55acc1c8d210 msgr2=0x55acc1d26210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 -- 172.21.15.81:0/1965734540 shutdown_connections 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 -- 172.21.15.81:0/1965734540 wait complete. 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 -- start start 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 Processor -- start 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d2f890 0x55acc1d3e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d34e00 0x55acc1d3e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 0x55acc1d9e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acc1d9ebc0 con 0x55acc1d2f890 2024-05-09T00:08:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acc1d9ed30 con 0x55acc1d35720 2024-05-09T00:08:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.354+0000 7f51549d9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acc1d9eef0 con 0x55acc1d34e00 2024-05-09T00:08:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f51549d9b80 10 client.0 _ll_register_callbacks cb 0x55acc1c24b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f514259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d2f890 0x55acc1d3e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f514259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d2f890 0x55acc1d3e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59514/0 (socket says 172.21.15.81:59514) 2024-05-09T00:08:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f514259c700 1 -- 172.21.15.81:0/241646887 learned_addr learned my addr 172.21.15.81:0/241646887 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f5141d9b700 1 --2- 172.21.15.81:0/241646887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d34e00 0x55acc1d3e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f5142d9d700 1 --2- 172.21.15.81:0/241646887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 0x55acc1d9e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f514259c700 1 -- 172.21.15.81:0/241646887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d34e00 msgr2=0x55acc1d3e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f514259c700 1 --2- 172.21.15.81:0/241646887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d34e00 0x55acc1d3e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f514259c700 1 -- 172.21.15.81:0/241646887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 msgr2=0x55acc1d9e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f514259c700 1 --2- 172.21.15.81:0/241646887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 0x55acc1d9e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f514259c700 1 -- 172.21.15.81:0/241646887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51441a2f50 con 0x55acc1d2f890 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f5141d9b700 1 --2- 172.21.15.81:0/241646887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d34e00 0x55acc1d3e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f514259c700 1 --2- 172.21.15.81:0/241646887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d2f890 0x55acc1d3e460 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f512c010de0 tx=0x7f512c005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ace766ffe49b848c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f5129ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f5129ffb700 1 -- 172.21.15.81:0/241646887 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c010630 con 0x55acc1d2f890 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f5129ffb700 1 -- 172.21.15.81:0/241646887 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f512c010790 con 0x55acc1d2f890 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f51549d9b80 1 -- 172.21.15.81:0/241646887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f512c003c70 con 0x55acc1d2f890 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f5129ffb700 1 -- 172.21.15.81:0/241646887 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f512c0313c0 con 0x55acc1d2f890 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f51549d9b80 10 client.16977 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f51549d9b80 1 -- 172.21.15.81:0/241646887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55acc1b04cd0 con 0x55acc1d2f890 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.355+0000 7f5129ffb700 1 -- 172.21.15.81:0/241646887 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f512c003c70 con 0x55acc1d2f890 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f5129ffb700 1 -- 172.21.15.81:0/241646887 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f512c037020 con 0x55acc1d2f890 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f51549d9b80 10 client.16977 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f51549d9b80 10 client.16977 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f51549d9b80 20 client.16977 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:31.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f51549d9b80 1 --2- 172.21.15.81:0/241646887 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55acc1da05a0 0x55acc1da29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f51549d9b80 4 client.16977 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:08:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f51549d9b80 1 -- 172.21.15.81:0/241646887 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55acc1c77ec0 con 0x55acc1da05a0 2024-05-09T00:08:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f5141d9b700 1 --2- 172.21.15.81:0/241646887 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55acc1da05a0 0x55acc1da29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f5141d9b700 1 --2- 172.21.15.81:0/241646887 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55acc1da05a0 0x55acc1da29c0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a3f0821d7621c67 server_cookie=547888c518d5b530 in_seq=0 out_seq=0 2024-05-09T00:08:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f5129ffb700 10 client.16977 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f5129ffb700 1 -- 172.21.15.81:0/241646887 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55acc1c77ec0 con 0x55acc1da05a0 2024-05-09T00:08:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f5129ffb700 10 client.16977 handle_command_reply: tid=0 2024-05-09T00:08:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f51549d9b80 1 client.16977 shutdown 2024-05-09T00:08:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f51549d9b80 1 -- 172.21.15.81:0/241646887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d2f890 msgr2=0x55acc1d3e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.356+0000 7f51549d9b80 1 --2- 172.21.15.81:0/241646887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d2f890 0x55acc1d3e460 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f512c010de0 tx=0x7f512c005ee0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f51549d9b80 1 -- 172.21.15.81:0/241646887 shutdown_connections 2024-05-09T00:08:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f51549d9b80 1 --2- 172.21.15.81:0/241646887 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55acc1da05a0 0x55acc1da29c0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f51549d9b80 1 --2- 172.21.15.81:0/241646887 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55acc1d35720 0x55acc1d9e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f51549d9b80 1 --2- 172.21.15.81:0/241646887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55acc1d2f890 0x55acc1d3e460 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f5129ffb700 0 client.16977 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f51549d9b80 1 --2- 172.21.15.81:0/241646887 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55acc1d34e00 0x55acc1d3e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f51549d9b80 1 -- 172.21.15.81:0/241646887 >> 172.21.15.81:0/241646887 conn(0x55acc1c8d210 msgr2=0x55acc1d373a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f51549d9b80 1 -- 172.21.15.81:0/241646887 shutdown_connections 2024-05-09T00:08:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f51549d9b80 1 -- 172.21.15.81:0/241646887 wait complete. 2024-05-09T00:08:31.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f51549d9b80 20 client.16977 trim_cache size 0 max 16384 2024-05-09T00:08:31.359 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:08:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:08:31.359 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:08:31.359 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:08:31.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f514881f700 1 -- 172.21.15.81:0/2961256753 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f51300a1290 msgr2=0x7f51300a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f514881f700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f51300a1290 0x7f51300a3750 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f512c00ac50 tx=0x7f512c00a380 comp rx=0 tx=0).stop 2024-05-09T00:08:31.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f514881f700 1 -- 172.21.15.81:0/2961256753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5144105640 msgr2=0x7f514419aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f514881f700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5144105640 0x7f514419aac0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f513c00b970 tx=0x7f513c00bc80 comp rx=0 tx=0).stop 2024-05-09T00:08:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f514881f700 1 -- 172.21.15.81:0/2961256753 shutdown_connections 2024-05-09T00:08:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f514881f700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f51300a1290 0x7f51300a3750 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f514881f700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5144105640 0x7f514419aac0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f514881f700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f51440ff580 0x7f51441961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f514881f700 1 --2- 172.21.15.81:0/2961256753 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f51440fff40 0x7f5144196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f514881f700 1 -- 172.21.15.81:0/2961256753 >> 172.21.15.81:0/2961256753 conn(0x7f51440763a0 msgr2=0x7f5144101120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f514881f700 1 -- 172.21.15.81:0/2961256753 shutdown_connections 2024-05-09T00:08:31.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.357+0000 7f514881f700 1 -- 172.21.15.81:0/2961256753 wait complete. 2024-05-09T00:08:31.363 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:31 smithi081 ceph-mon[42474]: pgmap v170: 97 pgs: 97 active+clean; 3.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-05-09T00:08:31.364 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:08:31.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:08:31.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.490+0000 7f2a6609d700 1 -- 172.21.15.81:0/114792579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a60100930 msgr2=0x7f2a60104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.490+0000 7f2a6609d700 1 --2- 172.21.15.81:0/114792579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a60100930 0x7f2a60104970 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f2a50009990 tx=0x7f2a50009ca0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.490+0000 7f2a6609d700 1 -- 172.21.15.81:0/114792579 shutdown_connections 2024-05-09T00:08:31.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.490+0000 7f2a6609d700 1 --2- 172.21.15.81:0/114792579 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a601050a0 0x7f2a6010cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.490+0000 7f2a6609d700 1 --2- 172.21.15.81:0/114792579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a600fff80 0x7f2a60100360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.490+0000 7f2a6609d700 1 --2- 172.21.15.81:0/114792579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a60100930 0x7f2a60104970 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.490+0000 7f2a6609d700 1 -- 172.21.15.81:0/114792579 >> 172.21.15.81:0/114792579 conn(0x7f2a600fb840 msgr2=0x7f2a600fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:31.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.490+0000 7f2a6609d700 1 -- 172.21.15.81:0/114792579 shutdown_connections 2024-05-09T00:08:31.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.490+0000 7f2a6609d700 1 -- 172.21.15.81:0/114792579 wait complete. 2024-05-09T00:08:31.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.491+0000 7f2a6609d700 1 Processor -- start 2024-05-09T00:08:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.491+0000 7f2a6609d700 1 -- start start 2024-05-09T00:08:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.491+0000 7f2a6609d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a600fff80 0x7f2a60196210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.491+0000 7f2a6609d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a601050a0 0x7f2a60196750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.491+0000 7f2a6609d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6019aaa0 0x7f2a6019af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.491+0000 7f2a6609d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6019b520 con 0x7f2a600fff80 2024-05-09T00:08:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.491+0000 7f2a6609d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6019b690 con 0x7f2a6019aaa0 2024-05-09T00:08:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.491+0000 7f2a6609d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6019b850 con 0x7f2a601050a0 2024-05-09T00:08:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.491+0000 7f2a5f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a600fff80 0x7f2a60196210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a5f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a600fff80 0x7f2a60196210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59544/0 (socket says 172.21.15.81:59544) 2024-05-09T00:08:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a5f7fe700 1 -- 172.21.15.81:0/2329677428 learned_addr learned my addr 172.21.15.81:0/2329677428 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a5ffff700 1 --2- 172.21.15.81:0/2329677428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6019aaa0 0x7f2a6019af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a5effd700 1 --2- 172.21.15.81:0/2329677428 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a601050a0 0x7f2a60196750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a5f7fe700 1 -- 172.21.15.81:0/2329677428 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a601050a0 msgr2=0x7f2a60196750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a5f7fe700 1 --2- 172.21.15.81:0/2329677428 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a601050a0 0x7f2a60196750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a5f7fe700 1 -- 172.21.15.81:0/2329677428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6019aaa0 msgr2=0x7f2a6019af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a5f7fe700 1 --2- 172.21.15.81:0/2329677428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6019aaa0 0x7f2a6019af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a5f7fe700 1 -- 172.21.15.81:0/2329677428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a500095f0 con 0x7f2a600fff80 2024-05-09T00:08:31.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a5f7fe700 1 --2- 172.21.15.81:0/2329677428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a600fff80 0x7f2a60196210 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009970 tx=0x7f2a54009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:31.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a5cff9700 1 -- 172.21.15.81:0/2329677428 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54012070 con 0x7f2a600fff80 2024-05-09T00:08:31.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a5cff9700 1 -- 172.21.15.81:0/2329677428 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a5400d260 con 0x7f2a600fff80 2024-05-09T00:08:31.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a6609d700 1 -- 172.21.15.81:0/2329677428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a60069270 con 0x7f2a600fff80 2024-05-09T00:08:31.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a5cff9700 1 -- 172.21.15.81:0/2329677428 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540179d0 con 0x7f2a600fff80 2024-05-09T00:08:31.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.492+0000 7f2a6609d700 1 -- 172.21.15.81:0/2329677428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a60069780 con 0x7f2a600fff80 2024-05-09T00:08:31.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.493+0000 7f2a6609d700 1 -- 172.21.15.81:0/2329677428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a60101450 con 0x7f2a600fff80 2024-05-09T00:08:31.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.494+0000 7f2a5cff9700 1 -- 172.21.15.81:0/2329677428 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f2a54007c00 con 0x7f2a600fff80 2024-05-09T00:08:31.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.495+0000 7f2a5cff9700 1 --2- 172.21.15.81:0/2329677428 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2a480a1290 0x7f2a480a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.495+0000 7f2a5effd700 1 --2- 172.21.15.81:0/2329677428 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2a480a1290 0x7f2a480a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.495+0000 7f2a5cff9700 1 -- 172.21.15.81:0/2329677428 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2a540ce070 con 0x7f2a600fff80 2024-05-09T00:08:31.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.496+0000 7f2a5effd700 1 --2- 172.21.15.81:0/2329677428 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2a480a1290 0x7f2a480a3750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2a50006010 tx=0x7f2a5000b260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:31.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.499+0000 7f2a5cff9700 1 -- 172.21.15.81:0/2329677428 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2a54097480 con 0x7f2a600fff80 2024-05-09T00:08:31.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:31 smithi150 ceph-mon[46187]: pgmap v170: 97 pgs: 97 active+clean; 3.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-05-09T00:08:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.743+0000 7f2a6609d700 1 -- 172.21.15.81:0/2329677428 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a60067380 con 0x7f2a600fff80 2024-05-09T00:08:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.743+0000 7f2a5cff9700 1 -- 172.21.15.81:0/2329677428 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7f2a5409aaa0 con 0x7f2a600fff80 2024-05-09T00:08:31.739 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:08:31.739 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:08:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.745+0000 7f2a6609d700 1 -- 172.21.15.81:0/2329677428 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2a480a1290 msgr2=0x7f2a480a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.745+0000 7f2a6609d700 1 --2- 172.21.15.81:0/2329677428 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2a480a1290 0x7f2a480a3750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2a50006010 tx=0x7f2a5000b260 comp rx=0 tx=0).stop 2024-05-09T00:08:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.745+0000 7f2a6609d700 1 -- 172.21.15.81:0/2329677428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a600fff80 msgr2=0x7f2a60196210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.745+0000 7f2a6609d700 1 --2- 172.21.15.81:0/2329677428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a600fff80 0x7f2a60196210 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f2a54009970 tx=0x7f2a54009c80 comp rx=0 tx=0).stop 2024-05-09T00:08:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.745+0000 7f2a6609d700 1 -- 172.21.15.81:0/2329677428 shutdown_connections 2024-05-09T00:08:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.745+0000 7f2a6609d700 1 --2- 172.21.15.81:0/2329677428 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2a480a1290 0x7f2a480a3750 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.745+0000 7f2a6609d700 1 --2- 172.21.15.81:0/2329677428 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2a6019aaa0 0x7f2a6019af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.745+0000 7f2a6609d700 1 --2- 172.21.15.81:0/2329677428 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a600fff80 0x7f2a60196210 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.745+0000 7f2a6609d700 1 --2- 172.21.15.81:0/2329677428 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2a601050a0 0x7f2a60196750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.745+0000 7f2a6609d700 1 -- 172.21.15.81:0/2329677428 >> 172.21.15.81:0/2329677428 conn(0x7f2a600fb840 msgr2=0x7f2a600fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.745+0000 7f2a6609d700 1 -- 172.21.15.81:0/2329677428 shutdown_connections 2024-05-09T00:08:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.745+0000 7f2a6609d700 1 -- 172.21.15.81:0/2329677428 wait complete. 2024-05-09T00:08:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:08:31.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:08:31.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.882+0000 7f9c04866700 1 -- 172.21.15.81:0/2848278070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c00105640 msgr2=0x7f9c00105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.882+0000 7f9c04866700 1 --2- 172.21.15.81:0/2848278070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c00105640 0x7f9c00105a20 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40099c0 tx=0x7f9bf4009cd0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.882+0000 7f9c04866700 1 -- 172.21.15.81:0/2848278070 shutdown_connections 2024-05-09T00:08:31.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.882+0000 7f9c04866700 1 --2- 172.21.15.81:0/2848278070 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c00100200 0x7f9c0010c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.882+0000 7f9c04866700 1 --2- 172.21.15.81:0/2848278070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c00105640 0x7f9c00105a20 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.882+0000 7f9c04866700 1 --2- 172.21.15.81:0/2848278070 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c000ff840 0x7f9c000ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.882+0000 7f9c04866700 1 -- 172.21.15.81:0/2848278070 >> 172.21.15.81:0/2848278070 conn(0x7f9c00075120 msgr2=0x7f9c00075530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.882+0000 7f9c04866700 1 -- 172.21.15.81:0/2848278070 shutdown_connections 2024-05-09T00:08:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.882+0000 7f9c04866700 1 -- 172.21.15.81:0/2848278070 wait complete. 2024-05-09T00:08:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.883+0000 7f9c04866700 1 Processor -- start 2024-05-09T00:08:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.883+0000 7f9c04866700 1 -- start start 2024-05-09T00:08:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.883+0000 7f9c04866700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c000ff840 0x7f9c00196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.883+0000 7f9c04866700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c00100200 0x7f9c00196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.883+0000 7f9c04866700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c00105640 0x7f9c0019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.883+0000 7f9c04866700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0019b210 con 0x7f9c000ff840 2024-05-09T00:08:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.883+0000 7f9c04866700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0019b380 con 0x7f9c00105640 2024-05-09T00:08:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.883+0000 7f9c04866700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0019b540 con 0x7f9c00100200 2024-05-09T00:08:31.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.883+0000 7f9bfe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c000ff840 0x7f9c00196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.883+0000 7f9bfe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c000ff840 0x7f9c00196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59560/0 (socket says 172.21.15.81:59560) 2024-05-09T00:08:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.883+0000 7f9bfe59c700 1 -- 172.21.15.81:0/1013051488 learned_addr learned my addr 172.21.15.81:0/1013051488 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.884+0000 7f9bfdd9b700 1 --2- 172.21.15.81:0/1013051488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c00100200 0x7f9c00196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.884+0000 7f9bfed9d700 1 --2- 172.21.15.81:0/1013051488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c00105640 0x7f9c0019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.884+0000 7f9bfe59c700 1 -- 172.21.15.81:0/1013051488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c00100200 msgr2=0x7f9c00196880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.884+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/1013051488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c00100200 0x7f9c00196880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.884+0000 7f9bfe59c700 1 -- 172.21.15.81:0/1013051488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c00105640 msgr2=0x7f9c0019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.884+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/1013051488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c00105640 0x7f9c0019abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.884+0000 7f9bfe59c700 1 -- 172.21.15.81:0/1013051488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40095f0 con 0x7f9c000ff840 2024-05-09T00:08:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.884+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/1013051488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c000ff840 0x7f9c00196340 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009990 tx=0x7f9bf4005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.884+0000 7f9bef7fe700 1 -- 172.21.15.81:0/1013051488 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf401f070 con 0x7f9c000ff840 2024-05-09T00:08:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.884+0000 7f9bef7fe700 1 -- 172.21.15.81:0/1013051488 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9bf4004ca0 con 0x7f9c000ff840 2024-05-09T00:08:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.884+0000 7f9bef7fe700 1 -- 172.21.15.81:0/1013051488 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf401a970 con 0x7f9c000ff840 2024-05-09T00:08:31.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.884+0000 7f9c04866700 1 -- 172.21.15.81:0/1013051488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0019b7c0 con 0x7f9c000ff840 2024-05-09T00:08:31.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.884+0000 7f9c04866700 1 -- 172.21.15.81:0/1013051488 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0010cd70 con 0x7f9c000ff840 2024-05-09T00:08:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.887+0000 7f9bef7fe700 1 -- 172.21.15.81:0/1013051488 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f9bf4023070 con 0x7f9c000ff840 2024-05-09T00:08:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.887+0000 7f9bef7fe700 1 --2- 172.21.15.81:0/1013051488 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f9be80a1290 0x7f9be80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.887+0000 7f9bef7fe700 1 -- 172.21.15.81:0/1013051488 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f9bf40cfbc0 con 0x7f9c000ff840 2024-05-09T00:08:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.887+0000 7f9bfdd9b700 1 --2- 172.21.15.81:0/1013051488 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f9be80a1290 0x7f9be80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.888+0000 7f9bfdd9b700 1 --2- 172.21.15.81:0/1013051488 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f9be80a1290 0x7f9be80a3750 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0005fd0 tx=0x7f9bf000a560 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.888+0000 7f9c10a20b80 1 Processor -- start 2024-05-09T00:08:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.888+0000 7f9c10a20b80 1 -- start start 2024-05-09T00:08:31.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.888+0000 7f9c10a20b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a671e00 0x55ae2a6721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.888+0000 7f9c10a20b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a672720 0x55ae2a66c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.888+0000 7f9c10a20b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a66c890 0x55ae2a66ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.888+0000 7f9c10a20b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae2a5c3150 con 0x55ae2a66c890 2024-05-09T00:08:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.888+0000 7f9c10a20b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae2a5c0b10 con 0x55ae2a671e00 2024-05-09T00:08:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.888+0000 7f9c10a20b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae2a5bc400 con 0x55ae2a672720 2024-05-09T00:08:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.888+0000 7f9bfed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a66c890 0x55ae2a66ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.888+0000 7f9bfed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a66c890 0x55ae2a66ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59576/0 (socket says 172.21.15.81:59576) 2024-05-09T00:08:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.888+0000 7f9bfed9d700 1 -- 172.21.15.81:0/2785693772 learned_addr learned my addr 172.21.15.81:0/2785693772 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.888+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/2785693772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a671e00 0x55ae2a6721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.889+0000 7f9bfdd9b700 1 --2- 172.21.15.81:0/2785693772 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a672720 0x55ae2a66c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.889+0000 7f9bfed9d700 1 -- 172.21.15.81:0/2785693772 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a672720 msgr2=0x55ae2a66c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.889+0000 7f9bfed9d700 1 --2- 172.21.15.81:0/2785693772 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a672720 0x55ae2a66c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.889+0000 7f9bfed9d700 1 -- 172.21.15.81:0/2785693772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a671e00 msgr2=0x55ae2a6721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.889+0000 7f9bfed9d700 1 --2- 172.21.15.81:0/2785693772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a671e00 0x55ae2a6721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.889+0000 7f9bfed9d700 1 -- 172.21.15.81:0/2785693772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae2a43d3b0 con 0x55ae2a66c890 2024-05-09T00:08:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.889+0000 7f9bfed9d700 1 --2- 172.21.15.81:0/2785693772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a66c890 0x55ae2a66ccd0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009c40 tx=0x7f9bf8009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b929cd1a6a0ca448 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.889+0000 7f9becff9700 1 -- 172.21.15.81:0/2785693772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8014400 con 0x55ae2a66c890 2024-05-09T00:08:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.889+0000 7f9becff9700 1 -- 172.21.15.81:0/2785693772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9bf8014a20 con 0x55ae2a66c890 2024-05-09T00:08:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.889+0000 7f9becff9700 1 -- 172.21.15.81:0/2785693772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8013990 con 0x55ae2a66c890 2024-05-09T00:08:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.890+0000 7f9c10a20b80 1 -- 172.21.15.81:0/2785693772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a66c890 msgr2=0x55ae2a66ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.890+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/2785693772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a66c890 0x55ae2a66ccd0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009c40 tx=0x7f9bf8009f50 comp rx=0 tx=0).stop 2024-05-09T00:08:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.890+0000 7f9c10a20b80 1 -- 172.21.15.81:0/2785693772 shutdown_connections 2024-05-09T00:08:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.890+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/2785693772 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a671e00 0x55ae2a6721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.890+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/2785693772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a66c890 0x55ae2a66ccd0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.890+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/2785693772 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a672720 0x55ae2a66c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.890+0000 7f9c10a20b80 1 -- 172.21.15.81:0/2785693772 >> 172.21.15.81:0/2785693772 conn(0x55ae2a5ca210 msgr2=0x55ae2a666df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.890+0000 7f9c10a20b80 1 -- 172.21.15.81:0/2785693772 shutdown_connections 2024-05-09T00:08:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.890+0000 7f9c10a20b80 1 -- 172.21.15.81:0/2785693772 wait complete. 2024-05-09T00:08:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.890+0000 7f9c10a20b80 1 -- start start 2024-05-09T00:08:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.890+0000 7f9c10a20b80 1 Processor -- start 2024-05-09T00:08:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9c10a20b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a66c890 0x55ae2a675bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9c10a20b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a671e00 0x55ae2a6760f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9c10a20b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a672720 0x55ae2a676630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9c10a20b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae2a558560 con 0x55ae2a672720 2024-05-09T00:08:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9c10a20b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae2a558200 con 0x55ae2a66c890 2024-05-09T00:08:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9c10a20b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae2a43f6a0 con 0x55ae2a671e00 2024-05-09T00:08:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9c10a20b80 10 client.0 _ll_register_callbacks cb 0x55ae2a561b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9bfed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a672720 0x55ae2a676630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9bfed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a672720 0x55ae2a676630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59588/0 (socket says 172.21.15.81:59588) 2024-05-09T00:08:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9bfed9d700 1 -- 172.21.15.81:0/1229872928 learned_addr learned my addr 172.21.15.81:0/1229872928 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9bfdd9b700 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a671e00 0x55ae2a6760f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a66c890 0x55ae2a675bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9bfed9d700 1 -- 172.21.15.81:0/1229872928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a671e00 msgr2=0x55ae2a6760f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9bfed9d700 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a671e00 0x55ae2a6760f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9bfed9d700 1 -- 172.21.15.81:0/1229872928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a66c890 msgr2=0x55ae2a675bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9bfed9d700 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a66c890 0x55ae2a675bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9bfed9d700 1 -- 172.21.15.81:0/1229872928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf80098a0 con 0x55ae2a672720 2024-05-09T00:08:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9bfdd9b700 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a671e00 0x55ae2a6760f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a66c890 0x55ae2a675bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9bfed9d700 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a672720 0x55ae2a676630 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8013470 tx=0x7f9bf8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce96481e9e5bd8b6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9be5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9be5ffb700 1 -- 172.21.15.81:0/1229872928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8014600 con 0x55ae2a672720 2024-05-09T00:08:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9be5ffb700 1 -- 172.21.15.81:0/1229872928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f9bf8014760 con 0x55ae2a672720 2024-05-09T00:08:31.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9c10a20b80 1 -- 172.21.15.81:0/1229872928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ae2a515270 con 0x55ae2a672720 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9be5ffb700 1 -- 172.21.15.81:0/1229872928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bf8004e60 con 0x55ae2a672720 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9c10a20b80 10 client.16995 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.891+0000 7f9c10a20b80 1 -- 172.21.15.81:0/1229872928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ae2a3e9b60 con 0x55ae2a672720 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.892+0000 7f9be5ffb700 1 -- 172.21.15.81:0/1229872928 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ae2a515270 con 0x55ae2a672720 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.892+0000 7f9be5ffb700 1 -- 172.21.15.81:0/1229872928 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9bf8005140 con 0x55ae2a672720 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.892+0000 7f9c10a20b80 10 client.16995 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.892+0000 7f9c10a20b80 10 client.16995 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.892+0000 7f9c10a20b80 20 client.16995 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.892+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ae2a686070 0x55ae2a688490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.892+0000 7f9c10a20b80 4 client.16995 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.892+0000 7f9c10a20b80 1 -- 172.21.15.81:0/1229872928 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ae2a63b810 con 0x55ae2a686070 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.892+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ae2a686070 0x55ae2a688490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.892+0000 7f9be5ffb700 10 client.16995 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.892+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ae2a686070 0x55ae2a688490 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35be34865ddcbcce server_cookie=57ad267bf2bff460 in_seq=0 out_seq=0 2024-05-09T00:08:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9be5ffb700 1 -- 172.21.15.81:0/1229872928 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ae2a63b810 con 0x55ae2a686070 2024-05-09T00:08:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9be5ffb700 10 client.16995 handle_command_reply: tid=0 2024-05-09T00:08:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9c10a20b80 1 client.16995 shutdown 2024-05-09T00:08:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9c10a20b80 1 -- 172.21.15.81:0/1229872928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a672720 msgr2=0x55ae2a676630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a672720 0x55ae2a676630 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8013470 tx=0x7f9bf8009120 comp rx=0 tx=0).stop 2024-05-09T00:08:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9c10a20b80 1 -- 172.21.15.81:0/1229872928 shutdown_connections 2024-05-09T00:08:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ae2a686070 0x55ae2a688490 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a66c890 0x55ae2a675bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a672720 0x55ae2a676630 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/1229872928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a671e00 0x55ae2a6760f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9be5ffb700 0 client.16995 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:08:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9c10a20b80 1 -- 172.21.15.81:0/1229872928 >> 172.21.15.81:0/1229872928 conn(0x55ae2a5ca210 msgr2=0x55ae2a6665a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9c10a20b80 1 -- 172.21.15.81:0/1229872928 shutdown_connections 2024-05-09T00:08:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9c10a20b80 1 -- 172.21.15.81:0/1229872928 wait complete. 2024-05-09T00:08:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.893+0000 7f9c10a20b80 20 client.16995 trim_cache size 0 max 16384 2024-05-09T00:08:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.906+0000 7f9c10a20b80 1 Processor -- start 2024-05-09T00:08:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9c10a20b80 1 -- start start 2024-05-09T00:08:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9c10a20b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a66c890 0x55ae2a66c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9c10a20b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a671e00 0x55ae2a666d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9c10a20b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a672720 0x55ae2a676450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9c10a20b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae2a663dc0 con 0x55ae2a672720 2024-05-09T00:08:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9c10a20b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae2a668640 con 0x55ae2a671e00 2024-05-09T00:08:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9c10a20b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae2a68d6a0 con 0x55ae2a66c890 2024-05-09T00:08:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9bfed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a672720 0x55ae2a676450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9bfed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a672720 0x55ae2a676450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59594/0 (socket says 172.21.15.81:59594) 2024-05-09T00:08:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9bfed9d700 1 -- 172.21.15.81:0/2194668756 learned_addr learned my addr 172.21.15.81:0/2194668756 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/2194668756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a66c890 0x55ae2a66c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9bfed9d700 1 -- 172.21.15.81:0/2194668756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a66c890 msgr2=0x55ae2a66c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9bfed9d700 1 --2- 172.21.15.81:0/2194668756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a66c890 0x55ae2a66c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9bfed9d700 1 -- 172.21.15.81:0/2194668756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a671e00 msgr2=0x55ae2a666d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9bfed9d700 1 --2- 172.21.15.81:0/2194668756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a671e00 0x55ae2a666d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9bfed9d700 1 -- 172.21.15.81:0/2194668756 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae2a582560 con 0x55ae2a672720 2024-05-09T00:08:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/2194668756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a66c890 0x55ae2a66c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9bfed9d700 1 --2- 172.21.15.81:0/2194668756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a672720 0x55ae2a676450 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009080 tx=0x7f9bf8006130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee786a968d60ad9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9bed7fa700 1 -- 172.21.15.81:0/2194668756 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80057f0 con 0x55ae2a672720 2024-05-09T00:08:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9bed7fa700 1 -- 172.21.15.81:0/2194668756 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9bf800d070 con 0x55ae2a672720 2024-05-09T00:08:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.907+0000 7f9bed7fa700 1 -- 172.21.15.81:0/2194668756 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8004e60 con 0x55ae2a672720 2024-05-09T00:08:31.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.908+0000 7f9c10a20b80 1 -- 172.21.15.81:0/2194668756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a672720 msgr2=0x55ae2a676450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.908+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/2194668756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a672720 0x55ae2a676450 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009080 tx=0x7f9bf8006130 comp rx=0 tx=0).stop 2024-05-09T00:08:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.908+0000 7f9c10a20b80 1 -- 172.21.15.81:0/2194668756 shutdown_connections 2024-05-09T00:08:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.908+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/2194668756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a672720 0x55ae2a676450 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.908+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/2194668756 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a66c890 0x55ae2a66c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.908+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/2194668756 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a671e00 0x55ae2a666d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.908+0000 7f9c10a20b80 1 -- 172.21.15.81:0/2194668756 >> 172.21.15.81:0/2194668756 conn(0x55ae2a5ca210 msgr2=0x55ae2a674480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.908+0000 7f9c10a20b80 1 -- 172.21.15.81:0/2194668756 shutdown_connections 2024-05-09T00:08:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.908+0000 7f9c10a20b80 1 -- 172.21.15.81:0/2194668756 wait complete. 2024-05-09T00:08:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.908+0000 7f9c10a20b80 1 -- start start 2024-05-09T00:08:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.908+0000 7f9c10a20b80 1 Processor -- start 2024-05-09T00:08:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.908+0000 7f9c10a20b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a66c890 0x55ae2a67ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9c10a20b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a671e00 0x55ae2a67b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9c10a20b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a672720 0x55ae2a67b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9c10a20b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae2a6db570 con 0x55ae2a66c890 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9c10a20b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae2a6db6b0 con 0x55ae2a672720 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9c10a20b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae2a6db7f0 con 0x55ae2a671e00 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9c10a20b80 10 client.0 _ll_register_callbacks cb 0x55ae2a561b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9bfe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a66c890 0x55ae2a67ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9bfe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a66c890 0x55ae2a67ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59604/0 (socket says 172.21.15.81:59604) 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9bfe59c700 1 -- 172.21.15.81:0/4246739371 learned_addr learned my addr 172.21.15.81:0/4246739371 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9bfe59c700 1 -- 172.21.15.81:0/4246739371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a671e00 msgr2=0x55ae2a67b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/4246739371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a671e00 0x55ae2a67b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9bfe59c700 1 -- 172.21.15.81:0/4246739371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a672720 msgr2=0x55ae2a67b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/4246739371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a672720 0x55ae2a67b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9bfe59c700 1 -- 172.21.15.81:0/4246739371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ae2a3e9b60 con 0x55ae2a66c890 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9bfe59c700 1 --2- 172.21.15.81:0/4246739371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a66c890 0x55ae2a67ac00 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f9bf409ca60 tx=0x7f9bf409c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce45e9196680d1f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9be5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9be5ffb700 1 -- 172.21.15.81:0/4246739371 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf409d1c0 con 0x55ae2a66c890 2024-05-09T00:08:31.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9be5ffb700 1 -- 172.21.15.81:0/4246739371 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f9bf40056f0 con 0x55ae2a66c890 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9c10a20b80 1 -- 172.21.15.81:0/4246739371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9bf8014a20 con 0x55ae2a66c890 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9be5ffb700 1 -- 172.21.15.81:0/4246739371 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bf409c250 con 0x55ae2a66c890 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9c10a20b80 10 client.17001 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9c10a20b80 1 -- 172.21.15.81:0/4246739371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ae2a441cd0 con 0x55ae2a66c890 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.909+0000 7f9be5ffb700 1 -- 172.21.15.81:0/4246739371 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9bf40b9080 con 0x55ae2a66c890 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.910+0000 7f9be5ffb700 1 -- 172.21.15.81:0/4246739371 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9bf4068020 con 0x55ae2a66c890 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.910+0000 7f9c10a20b80 10 client.17001 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.910+0000 7f9c10a20b80 10 client.17001 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.910+0000 7f9c10a20b80 20 client.17001 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.910+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/4246739371 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ae2a6dcbf0 0x55ae2a6df000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.910+0000 7f9c10a20b80 4 client.17001 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.910+0000 7f9c10a20b80 1 -- 172.21.15.81:0/4246739371 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ae2a5b4ec0 con 0x55ae2a6dcbf0 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.910+0000 7f9bfdd9b700 1 --2- 172.21.15.81:0/4246739371 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ae2a6dcbf0 0x55ae2a6df000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.910+0000 7f9be5ffb700 10 client.17001 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.910+0000 7f9bfdd9b700 1 --2- 172.21.15.81:0/4246739371 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ae2a6dcbf0 0x55ae2a6df000 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=94f83f7e184238c5 server_cookie=adf3f59a1f358c23 in_seq=0 out_seq=0 2024-05-09T00:08:31.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9be5ffb700 1 -- 172.21.15.81:0/4246739371 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ae2a5b4ec0 con 0x55ae2a6dcbf0 2024-05-09T00:08:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9be5ffb700 10 client.17001 handle_command_reply: tid=0 2024-05-09T00:08:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c10a20b80 1 client.17001 shutdown 2024-05-09T00:08:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c10a20b80 1 -- 172.21.15.81:0/4246739371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a66c890 msgr2=0x55ae2a67ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/4246739371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a66c890 0x55ae2a67ac00 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f9bf409ca60 tx=0x7f9bf409c9c0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c10a20b80 1 -- 172.21.15.81:0/4246739371 shutdown_connections 2024-05-09T00:08:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/4246739371 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x55ae2a6dcbf0 0x55ae2a6df000 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/4246739371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae2a672720 0x55ae2a67b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9be5ffb700 0 client.17001 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:08:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/4246739371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae2a66c890 0x55ae2a67ac00 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c10a20b80 1 --2- 172.21.15.81:0/4246739371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae2a671e00 0x55ae2a67b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c10a20b80 1 -- 172.21.15.81:0/4246739371 >> 172.21.15.81:0/4246739371 conn(0x55ae2a5ca210 msgr2=0x55ae2a6713a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c10a20b80 1 -- 172.21.15.81:0/4246739371 shutdown_connections 2024-05-09T00:08:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c10a20b80 1 -- 172.21.15.81:0/4246739371 wait complete. 2024-05-09T00:08:31.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c10a20b80 20 client.17001 trim_cache size 0 max 16384 2024-05-09T00:08:31.914 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:08:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c04866700 1 -- 172.21.15.81:0/1013051488 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f9be80a1290 msgr2=0x7f9be80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c04866700 1 --2- 172.21.15.81:0/1013051488 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f9be80a1290 0x7f9be80a3750 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0005fd0 tx=0x7f9bf000a560 comp rx=0 tx=0).stop 2024-05-09T00:08:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c04866700 1 -- 172.21.15.81:0/1013051488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c000ff840 msgr2=0x7f9c00196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c04866700 1 --2- 172.21.15.81:0/1013051488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c000ff840 0x7f9c00196340 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009990 tx=0x7f9bf4005e80 comp rx=0 tx=0).stop 2024-05-09T00:08:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c04866700 1 -- 172.21.15.81:0/1013051488 shutdown_connections 2024-05-09T00:08:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c04866700 1 --2- 172.21.15.81:0/1013051488 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f9be80a1290 0x7f9be80a3750 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c04866700 1 --2- 172.21.15.81:0/1013051488 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9c00105640 0x7f9c0019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c04866700 1 --2- 172.21.15.81:0/1013051488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c000ff840 0x7f9c00196340 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c04866700 1 --2- 172.21.15.81:0/1013051488 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9c00100200 0x7f9c00196880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c04866700 1 -- 172.21.15.81:0/1013051488 >> 172.21.15.81:0/1013051488 conn(0x7f9c00075120 msgr2=0x7f9c000fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c04866700 1 -- 172.21.15.81:0/1013051488 shutdown_connections 2024-05-09T00:08:31.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:31.911+0000 7f9c04866700 1 -- 172.21.15.81:0/1013051488 wait complete. 2024-05-09T00:08:31.919 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:08:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.048+0000 7f0a0446c700 1 -- 172.21.15.81:0/1806772969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc105ef0 msgr2=0x7f09fc1062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.048+0000 7f0a0446c700 1 --2- 172.21.15.81:0/1806772969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc105ef0 0x7f09fc1062d0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009990 tx=0x7f09f0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.048+0000 7f0a0446c700 1 -- 172.21.15.81:0/1806772969 shutdown_connections 2024-05-09T00:08:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.048+0000 7f0a0446c700 1 --2- 172.21.15.81:0/1806772969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09fc0ffdd0 0x7f09fc10dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.048+0000 7f0a0446c700 1 --2- 172.21.15.81:0/1806772969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc105ef0 0x7f09fc1062d0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.048+0000 7f0a0446c700 1 --2- 172.21.15.81:0/1806772969 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0ff410 0x7f09fc0ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.048+0000 7f0a0446c700 1 -- 172.21.15.81:0/1806772969 >> 172.21.15.81:0/1806772969 conn(0x7f09fc0763a0 msgr2=0x7f09fc0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.048+0000 7f0a0446c700 1 -- 172.21.15.81:0/1806772969 shutdown_connections 2024-05-09T00:08:32.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.048+0000 7f0a0446c700 1 -- 172.21.15.81:0/1806772969 wait complete. 2024-05-09T00:08:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.048+0000 7f0a0446c700 1 Processor -- start 2024-05-09T00:08:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a0446c700 1 -- start start 2024-05-09T00:08:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a0446c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09fc0ff410 0x7f09fc1973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a0446c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0ffdd0 0x7f09fc197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a0446c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc105ef0 0x7f09fc19bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a0446c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc19c2e0 con 0x7f09fc105ef0 2024-05-09T00:08:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a0446c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc19c450 con 0x7f09fc0ffdd0 2024-05-09T00:08:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a0446c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09fc19c610 con 0x7f09fc0ff410 2024-05-09T00:08:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a02a09700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc105ef0 0x7f09fc19bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a02a09700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc105ef0 0x7f09fc19bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59626/0 (socket says 172.21.15.81:59626) 2024-05-09T00:08:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a02a09700 1 -- 172.21.15.81:0/3953280852 learned_addr learned my addr 172.21.15.81:0/3953280852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a01a07700 1 --2- 172.21.15.81:0/3953280852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0ffdd0 0x7f09fc197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a02208700 1 --2- 172.21.15.81:0/3953280852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09fc0ff410 0x7f09fc1973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a02a09700 1 -- 172.21.15.81:0/3953280852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09fc0ff410 msgr2=0x7f09fc1973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a02a09700 1 --2- 172.21.15.81:0/3953280852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09fc0ff410 0x7f09fc1973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a02a09700 1 -- 172.21.15.81:0/3953280852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0ffdd0 msgr2=0x7f09fc197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a02a09700 1 --2- 172.21.15.81:0/3953280852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0ffdd0 0x7f09fc197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a02a09700 1 -- 172.21.15.81:0/3953280852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f00095f0 con 0x7f09fc105ef0 2024-05-09T00:08:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f0a02a09700 1 --2- 172.21.15.81:0/3953280852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc105ef0 0x7f09fc19bca0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f09f4007ee0 tx=0x7f09f400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.049+0000 7f09ef7fe700 1 -- 172.21.15.81:0/3953280852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4017070 con 0x7f09fc105ef0 2024-05-09T00:08:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.050+0000 7f09ef7fe700 1 -- 172.21.15.81:0/3953280852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09f400f040 con 0x7f09fc105ef0 2024-05-09T00:08:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.050+0000 7f0a0446c700 1 -- 172.21.15.81:0/3953280852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09fc19c8f0 con 0x7f09fc105ef0 2024-05-09T00:08:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.050+0000 7f09ef7fe700 1 -- 172.21.15.81:0/3953280852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4005580 con 0x7f09fc105ef0 2024-05-09T00:08:32.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.050+0000 7f0a0446c700 1 -- 172.21.15.81:0/3953280852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc1a4130 con 0x7f09fc105ef0 2024-05-09T00:08:32.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.052+0000 7f09ef7fe700 1 -- 172.21.15.81:0/3953280852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f09f400db20 con 0x7f09fc105ef0 2024-05-09T00:08:32.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.052+0000 7f09ef7fe700 1 --2- 172.21.15.81:0/3953280852 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f09e80a1290 0x7f09e80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.052+0000 7f0a02208700 1 --2- 172.21.15.81:0/3953280852 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f09e80a1290 0x7f09e80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.052+0000 7f09ef7fe700 1 -- 172.21.15.81:0/3953280852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f09f40cc480 con 0x7f09fc105ef0 2024-05-09T00:08:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.053+0000 7f0a02208700 1 --2- 172.21.15.81:0/3953280852 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f09e80a1290 0x7f09e80a3750 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f09f000b5c0 tx=0x7f09f0005fd0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.053+0000 7f0a10626b80 1 Processor -- start 2024-05-09T00:08:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.053+0000 7f0a10626b80 1 -- start start 2024-05-09T00:08:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.053+0000 7f0a10626b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bce00 0x5637276bd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a10626b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bd720 0x5637276b7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a10626b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276b7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a10626b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56372760e150 con 0x5637276b7890 2024-05-09T00:08:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a10626b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56372760bb10 con 0x5637276bd720 2024-05-09T00:08:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a10626b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563727607400 con 0x5637276bce00 2024-05-09T00:08:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a02a09700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276b7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a02a09700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276b7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59632/0 (socket says 172.21.15.81:59632) 2024-05-09T00:08:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a02a09700 1 -- 172.21.15.81:0/3408229671 learned_addr learned my addr 172.21.15.81:0/3408229671 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a02208700 1 --2- 172.21.15.81:0/3408229671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bce00 0x5637276bd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a01a07700 1 --2- 172.21.15.81:0/3408229671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bd720 0x5637276b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a02a09700 1 -- 172.21.15.81:0/3408229671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bce00 msgr2=0x5637276bd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a02a09700 1 --2- 172.21.15.81:0/3408229671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bce00 0x5637276bd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a02a09700 1 -- 172.21.15.81:0/3408229671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bd720 msgr2=0x5637276b7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a02a09700 1 --2- 172.21.15.81:0/3408229671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bd720 0x5637276b7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a02a09700 1 -- 172.21.15.81:0/3408229671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637274883b0 con 0x5637276b7890 2024-05-09T00:08:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f0a02a09700 1 --2- 172.21.15.81:0/3408229671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276b7cd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f09f4096000 tx=0x7f09f4095950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e67743eba653ea5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f09ecda4700 1 -- 172.21.15.81:0/3408229671 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f40a1a10 con 0x5637276b7890 2024-05-09T00:08:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f09ecda4700 1 -- 172.21.15.81:0/3408229671 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09f409d170 con 0x5637276b7890 2024-05-09T00:08:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.054+0000 7f09ecda4700 1 -- 172.21.15.81:0/3408229671 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4095ca0 con 0x5637276b7890 2024-05-09T00:08:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.055+0000 7f0a10626b80 1 -- 172.21.15.81:0/3408229671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 msgr2=0x5637276b7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.055+0000 7f0a10626b80 1 --2- 172.21.15.81:0/3408229671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276b7cd0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f09f4096000 tx=0x7f09f4095950 comp rx=0 tx=0).stop 2024-05-09T00:08:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.055+0000 7f0a10626b80 1 -- 172.21.15.81:0/3408229671 shutdown_connections 2024-05-09T00:08:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.055+0000 7f0a10626b80 1 --2- 172.21.15.81:0/3408229671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276b7cd0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.055+0000 7f0a10626b80 1 --2- 172.21.15.81:0/3408229671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bce00 0x5637276bd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.055+0000 7f0a10626b80 1 --2- 172.21.15.81:0/3408229671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bd720 0x5637276b7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.055+0000 7f0a10626b80 1 -- 172.21.15.81:0/3408229671 >> 172.21.15.81:0/3408229671 conn(0x563727615210 msgr2=0x5637276b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.055+0000 7f0a10626b80 1 -- 172.21.15.81:0/3408229671 shutdown_connections 2024-05-09T00:08:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.055+0000 7f0a10626b80 1 -- 172.21.15.81:0/3408229671 wait complete. 2024-05-09T00:08:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.055+0000 7f0a10626b80 1 -- start start 2024-05-09T00:08:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a10626b80 1 Processor -- start 2024-05-09T00:08:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a10626b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276b7890 0x5637276c0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a10626b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276bce00 0x5637276c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a10626b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bd720 0x5637276c1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a10626b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637275a3560 con 0x5637276bce00 2024-05-09T00:08:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a10626b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637275a3200 con 0x5637276b7890 2024-05-09T00:08:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a10626b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56372748a6a0 con 0x5637276bd720 2024-05-09T00:08:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a10626b80 10 client.0 _ll_register_callbacks cb 0x5637275acb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a01a07700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276bce00 0x5637276c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a01a07700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276bce00 0x5637276c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59636/0 (socket says 172.21.15.81:59636) 2024-05-09T00:08:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a01a07700 1 -- 172.21.15.81:0/3621848602 learned_addr learned my addr 172.21.15.81:0/3621848602 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a02208700 1 --2- 172.21.15.81:0/3621848602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276b7890 0x5637276c0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a02a09700 1 --2- 172.21.15.81:0/3621848602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bd720 0x5637276c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a01a07700 1 -- 172.21.15.81:0/3621848602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bd720 msgr2=0x5637276c1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a01a07700 1 --2- 172.21.15.81:0/3621848602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bd720 0x5637276c1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a01a07700 1 -- 172.21.15.81:0/3621848602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276b7890 msgr2=0x5637276c0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a01a07700 1 --2- 172.21.15.81:0/3621848602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276b7890 0x5637276c0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a01a07700 1 -- 172.21.15.81:0/3621848602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc1a4130 con 0x5637276bce00 2024-05-09T00:08:32.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f0a01a07700 1 --2- 172.21.15.81:0/3621848602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276bce00 0x5637276c1020 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f09f8012840 tx=0x7f09f8012b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04daf1c3713bab8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.056+0000 7f09e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f09e5ffb700 1 -- 172.21.15.81:0/3621848602 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8004460 con 0x5637276bce00 2024-05-09T00:08:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f0a10626b80 1 -- 172.21.15.81:0/3621848602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563727560270 con 0x5637276bce00 2024-05-09T00:08:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f09e5ffb700 1 -- 172.21.15.81:0/3621848602 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f09f8003680 con 0x5637276bce00 2024-05-09T00:08:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f09e5ffb700 1 -- 172.21.15.81:0/3621848602 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09f8003840 con 0x5637276bce00 2024-05-09T00:08:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f0a10626b80 10 client.17013 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f0a10626b80 1 -- 172.21.15.81:0/3621848602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563727434b60 con 0x5637276bce00 2024-05-09T00:08:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f09e5ffb700 1 -- 172.21.15.81:0/3621848602 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09f8027020 con 0x5637276bce00 2024-05-09T00:08:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f09e5ffb700 1 -- 172.21.15.81:0/3621848602 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f09f8010c40 con 0x5637276bce00 2024-05-09T00:08:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f0a10626b80 10 client.17013 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f0a10626b80 10 client.17013 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:08:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f0a10626b80 20 client.17013 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f0a10626b80 1 --2- 172.21.15.81:0/3621848602 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5637276d12b0 0x5637276d36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f0a10626b80 4 client.17013 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f0a10626b80 1 -- 172.21.15.81:0/3621848602 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563727686810 con 0x5637276d12b0 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.057+0000 7f0a02208700 1 --2- 172.21.15.81:0/3621848602 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5637276d12b0 0x5637276d36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.058+0000 7f09e5ffb700 10 client.17013 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.058+0000 7f0a02208700 1 --2- 172.21.15.81:0/3621848602 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5637276d12b0 0x5637276d36d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=19c2e514ad905326 server_cookie=ea424867a239a6d8 in_seq=0 out_seq=0 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.058+0000 7f09e5ffb700 1 -- 172.21.15.81:0/3621848602 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563727686810 con 0x5637276d12b0 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.058+0000 7f09e5ffb700 10 client.17013 handle_command_reply: tid=0 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.059+0000 7f0a10626b80 1 client.17013 shutdown 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.059+0000 7f0a10626b80 1 -- 172.21.15.81:0/3621848602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276bce00 msgr2=0x5637276c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.059+0000 7f0a10626b80 1 --2- 172.21.15.81:0/3621848602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276bce00 0x5637276c1020 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f09f8012840 tx=0x7f09f8012b50 comp rx=0 tx=0).stop 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.059+0000 7f0a10626b80 1 -- 172.21.15.81:0/3621848602 shutdown_connections 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.059+0000 7f0a10626b80 1 --2- 172.21.15.81:0/3621848602 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5637276d12b0 0x5637276d36d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.059+0000 7f0a10626b80 1 --2- 172.21.15.81:0/3621848602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276b7890 0x5637276c0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.059+0000 7f09e5ffb700 0 client.17013 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.059+0000 7f0a10626b80 1 --2- 172.21.15.81:0/3621848602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bd720 0x5637276c1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.059+0000 7f0a10626b80 1 --2- 172.21.15.81:0/3621848602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276bce00 0x5637276c1020 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.059+0000 7f0a10626b80 1 -- 172.21.15.81:0/3621848602 >> 172.21.15.81:0/3621848602 conn(0x563727615210 msgr2=0x5637276b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:32.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.059+0000 7f0a10626b80 1 -- 172.21.15.81:0/3621848602 shutdown_connections 2024-05-09T00:08:32.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.059+0000 7f0a10626b80 1 -- 172.21.15.81:0/3621848602 wait complete. 2024-05-09T00:08:32.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.059+0000 7f0a10626b80 20 client.17013 trim_cache size 0 max 16384 2024-05-09T00:08:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a10626b80 1 Processor -- start 2024-05-09T00:08:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a10626b80 1 -- start start 2024-05-09T00:08:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a10626b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276b7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a10626b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bce00 0x5637276cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a10626b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bd720 0x5637276ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a10626b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637276c3b20 con 0x5637276b7890 2024-05-09T00:08:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a10626b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637276aedc0 con 0x5637276bce00 2024-05-09T00:08:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a10626b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637276d88e0 con 0x5637276bd720 2024-05-09T00:08:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a02208700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276b7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a02208700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276b7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59650/0 (socket says 172.21.15.81:59650) 2024-05-09T00:08:32.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a02208700 1 -- 172.21.15.81:0/3412404559 learned_addr learned my addr 172.21.15.81:0/3412404559 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a01a07700 1 --2- 172.21.15.81:0/3412404559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bce00 0x5637276cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a02a09700 1 --2- 172.21.15.81:0/3412404559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bd720 0x5637276ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a02208700 1 -- 172.21.15.81:0/3412404559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bd720 msgr2=0x5637276ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a02208700 1 --2- 172.21.15.81:0/3412404559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bd720 0x5637276ccc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a02208700 1 -- 172.21.15.81:0/3412404559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bce00 msgr2=0x5637276cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a02208700 1 --2- 172.21.15.81:0/3412404559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bce00 0x5637276cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a02208700 1 -- 172.21.15.81:0/3412404559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637275cd560 con 0x5637276b7890 2024-05-09T00:08:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a01a07700 1 --2- 172.21.15.81:0/3412404559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bce00 0x5637276cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.072+0000 7f0a02208700 1 --2- 172.21.15.81:0/3412404559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276b7350 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f09f0003730 tx=0x7f09f0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157c4b12d058c42f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.073+0000 7f09ed5a5700 1 -- 172.21.15.81:0/3412404559 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f0003790 con 0x5637276b7890 2024-05-09T00:08:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.073+0000 7f09ed5a5700 1 -- 172.21.15.81:0/3412404559 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09f002a040 con 0x5637276b7890 2024-05-09T00:08:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.073+0000 7f09ed5a5700 1 -- 172.21.15.81:0/3412404559 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f0032800 con 0x5637276b7890 2024-05-09T00:08:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.073+0000 7f0a10626b80 1 -- 172.21.15.81:0/3412404559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 msgr2=0x5637276b7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.073+0000 7f0a10626b80 1 --2- 172.21.15.81:0/3412404559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276b7350 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f09f0003730 tx=0x7f09f0021000 comp rx=0 tx=0).stop 2024-05-09T00:08:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.073+0000 7f0a10626b80 1 -- 172.21.15.81:0/3412404559 shutdown_connections 2024-05-09T00:08:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.073+0000 7f0a10626b80 1 --2- 172.21.15.81:0/3412404559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bd720 0x5637276ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.073+0000 7f0a10626b80 1 --2- 172.21.15.81:0/3412404559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276b7350 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.073+0000 7f0a10626b80 1 --2- 172.21.15.81:0/3412404559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bce00 0x5637276cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.073+0000 7f0a10626b80 1 -- 172.21.15.81:0/3412404559 >> 172.21.15.81:0/3412404559 conn(0x563727615210 msgr2=0x5637276bf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.073+0000 7f0a10626b80 1 -- 172.21.15.81:0/3412404559 shutdown_connections 2024-05-09T00:08:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.073+0000 7f0a10626b80 1 -- 172.21.15.81:0/3412404559 wait complete. 2024-05-09T00:08:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a10626b80 1 -- start start 2024-05-09T00:08:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a10626b80 1 Processor -- start 2024-05-09T00:08:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a10626b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276c4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a10626b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bce00 0x5637276c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a10626b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bd720 0x5637276c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a10626b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563727726950 con 0x5637276b7890 2024-05-09T00:08:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a10626b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563727726ac0 con 0x5637276bd720 2024-05-09T00:08:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a10626b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563727726c80 con 0x5637276bce00 2024-05-09T00:08:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a10626b80 10 client.0 _ll_register_callbacks cb 0x5637275acb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a02208700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a02208700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276c4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59666/0 (socket says 172.21.15.81:59666) 2024-05-09T00:08:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a02208700 1 -- 172.21.15.81:0/1503351651 learned_addr learned my addr 172.21.15.81:0/1503351651 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a01a07700 1 --2- 172.21.15.81:0/1503351651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bce00 0x5637276c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a02a09700 1 --2- 172.21.15.81:0/1503351651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bd720 0x5637276c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a02208700 1 -- 172.21.15.81:0/1503351651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bce00 msgr2=0x5637276c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a02208700 1 --2- 172.21.15.81:0/1503351651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bce00 0x5637276c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a02208700 1 -- 172.21.15.81:0/1503351651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bd720 msgr2=0x5637276c4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a02208700 1 --2- 172.21.15.81:0/1503351651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bd720 0x5637276c4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a02208700 1 -- 172.21.15.81:0/1503351651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09fc10e750 con 0x5637276b7890 2024-05-09T00:08:32.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.074+0000 7f0a01a07700 1 --2- 172.21.15.81:0/1503351651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bce00 0x5637276c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f0a02208700 1 --2- 172.21.15.81:0/1503351651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276c4140 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f09f0035040 tx=0x7f09f000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a329930d70672d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f09e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f09e5ffb700 1 -- 172.21.15.81:0/1503351651 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f0027070 con 0x5637276b7890 2024-05-09T00:08:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f09e5ffb700 1 -- 172.21.15.81:0/1503351651 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f09f0032150 con 0x5637276b7890 2024-05-09T00:08:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f0a10626b80 1 -- 172.21.15.81:0/1503351651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f09f409d170 con 0x5637276b7890 2024-05-09T00:08:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f09e5ffb700 1 -- 172.21.15.81:0/1503351651 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09f0032890 con 0x5637276b7890 2024-05-09T00:08:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f0a10626b80 10 client.17019 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f0a10626b80 1 -- 172.21.15.81:0/1503351651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56372748ccd0 con 0x5637276b7890 2024-05-09T00:08:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f09e5ffb700 1 -- 172.21.15.81:0/1503351651 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09f0049020 con 0x5637276b7890 2024-05-09T00:08:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f09e5ffb700 1 -- 172.21.15.81:0/1503351651 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f09f000f810 con 0x5637276b7890 2024-05-09T00:08:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f0a10626b80 10 client.17019 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f0a10626b80 10 client.17019 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:08:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f0a10626b80 20 client.17019 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:32.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f0a10626b80 1 --2- 172.21.15.81:0/1503351651 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x563727727fd0 0x56372772a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f0a10626b80 4 client.17019 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f0a10626b80 1 -- 172.21.15.81:0/1503351651 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5637275ffec0 con 0x563727727fd0 2024-05-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.075+0000 7f0a01a07700 1 --2- 172.21.15.81:0/1503351651 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x563727727fd0 0x56372772a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f09e5ffb700 10 client.17019 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f0a01a07700 1 --2- 172.21.15.81:0/1503351651 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x563727727fd0 0x56372772a3c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=da098c49698f99e3 server_cookie=31c57dd07278c61f in_seq=0 out_seq=0 2024-05-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f09e5ffb700 1 -- 172.21.15.81:0/1503351651 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5637275ffec0 con 0x563727727fd0 2024-05-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f09e5ffb700 10 client.17019 handle_command_reply: tid=0 2024-05-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f0a10626b80 1 client.17019 shutdown 2024-05-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f0a10626b80 1 -- 172.21.15.81:0/1503351651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 msgr2=0x5637276c4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f0a10626b80 1 --2- 172.21.15.81:0/1503351651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276c4140 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f09f0035040 tx=0x7f09f000ba10 comp rx=0 tx=0).stop 2024-05-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f0a10626b80 1 -- 172.21.15.81:0/1503351651 shutdown_connections 2024-05-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f0a10626b80 1 --2- 172.21.15.81:0/1503351651 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x563727727fd0 0x56372772a3c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f0a10626b80 1 --2- 172.21.15.81:0/1503351651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637276bd720 0x5637276c4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f09e5ffb700 0 client.17019 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:08:32.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f0a10626b80 1 --2- 172.21.15.81:0/1503351651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637276b7890 0x5637276c4140 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f0a10626b80 1 --2- 172.21.15.81:0/1503351651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637276bce00 0x5637276c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f0a10626b80 1 -- 172.21.15.81:0/1503351651 >> 172.21.15.81:0/1503351651 conn(0x563727615210 msgr2=0x5637276bbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:32.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f0a10626b80 1 -- 172.21.15.81:0/1503351651 shutdown_connections 2024-05-09T00:08:32.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f0a10626b80 1 -- 172.21.15.81:0/1503351651 wait complete. 2024-05-09T00:08:32.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.076+0000 7f0a10626b80 20 client.17019 trim_cache size 0 max 16384 2024-05-09T00:08:32.080 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:08:32.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.077+0000 7f0a0446c700 1 -- 172.21.15.81:0/3953280852 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f09e80a1290 msgr2=0x7f09e80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.077+0000 7f0a0446c700 1 --2- 172.21.15.81:0/3953280852 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f09e80a1290 0x7f09e80a3750 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f09f000b5c0 tx=0x7f09f0005fd0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.077+0000 7f0a0446c700 1 -- 172.21.15.81:0/3953280852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc105ef0 msgr2=0x7f09fc19bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.077+0000 7f0a0446c700 1 --2- 172.21.15.81:0/3953280852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc105ef0 0x7f09fc19bca0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f09f4007ee0 tx=0x7f09f400d3b0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.077+0000 7f0a0446c700 1 -- 172.21.15.81:0/3953280852 shutdown_connections 2024-05-09T00:08:32.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.077+0000 7f0a0446c700 1 --2- 172.21.15.81:0/3953280852 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f09e80a1290 0x7f09e80a3750 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.077+0000 7f0a0446c700 1 --2- 172.21.15.81:0/3953280852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09fc105ef0 0x7f09fc19bca0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.077+0000 7f0a0446c700 1 --2- 172.21.15.81:0/3953280852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09fc0ff410 0x7f09fc1973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.077+0000 7f0a0446c700 1 --2- 172.21.15.81:0/3953280852 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09fc0ffdd0 0x7f09fc197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.077+0000 7f0a0446c700 1 -- 172.21.15.81:0/3953280852 >> 172.21.15.81:0/3953280852 conn(0x7f09fc0763a0 msgr2=0x7f09fc103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:32.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.077+0000 7f0a0446c700 1 -- 172.21.15.81:0/3953280852 shutdown_connections 2024-05-09T00:08:32.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.077+0000 7f0a0446c700 1 -- 172.21.15.81:0/3953280852 wait complete. 2024-05-09T00:08:32.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:08:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.213+0000 7fd37d28d700 1 -- 172.21.15.81:0/2822754267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd378101af0 msgr2=0x7fd378105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.213+0000 7fd37d28d700 1 --2- 172.21.15.81:0/2822754267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd378101af0 0x7fd378105b30 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd368009990 tx=0x7fd368009ca0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.213+0000 7fd37d28d700 1 -- 172.21.15.81:0/2822754267 shutdown_connections 2024-05-09T00:08:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.213+0000 7fd37d28d700 1 --2- 172.21.15.81:0/2822754267 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd378106260 0x7fd37810dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.213+0000 7fd37d28d700 1 --2- 172.21.15.81:0/2822754267 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd378101140 0x7fd378101520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.213+0000 7fd37d28d700 1 --2- 172.21.15.81:0/2822754267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd378101af0 0x7fd378105b30 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.213+0000 7fd37d28d700 1 -- 172.21.15.81:0/2822754267 >> 172.21.15.81:0/2822754267 conn(0x7fd3780fc9e0 msgr2=0x7fd3780fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.213+0000 7fd37d28d700 1 -- 172.21.15.81:0/2822754267 shutdown_connections 2024-05-09T00:08:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.213+0000 7fd37d28d700 1 -- 172.21.15.81:0/2822754267 wait complete. 2024-05-09T00:08:32.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd37d28d700 1 Processor -- start 2024-05-09T00:08:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd37d28d700 1 -- start start 2024-05-09T00:08:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd37d28d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd378101140 0x7fd3781974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd37d28d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd378106260 0x7fd378197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd37d28d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd37819bd60 0x7fd37819c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd37d28d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37819c7e0 con 0x7fd378101140 2024-05-09T00:08:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd37d28d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37819c950 con 0x7fd378106260 2024-05-09T00:08:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd37d28d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37819cb10 con 0x7fd37819bd60 2024-05-09T00:08:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd376ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd378101140 0x7fd3781974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd376ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd378101140 0x7fd3781974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59672/0 (socket says 172.21.15.81:59672) 2024-05-09T00:08:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd376ffd700 1 -- 172.21.15.81:0/267793353 learned_addr learned my addr 172.21.15.81:0/267793353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd3767fc700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd378106260 0x7fd378197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd3777fe700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd37819bd60 0x7fd37819c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd376ffd700 1 -- 172.21.15.81:0/267793353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd37819bd60 msgr2=0x7fd37819c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd376ffd700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd37819bd60 0x7fd37819c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd376ffd700 1 -- 172.21.15.81:0/267793353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd378106260 msgr2=0x7fd378197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd376ffd700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd378106260 0x7fd378197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd376ffd700 1 -- 172.21.15.81:0/267793353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3680095f0 con 0x7fd378101140 2024-05-09T00:08:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.214+0000 7fd3767fc700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd378106260 0x7fd378197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.215+0000 7fd376ffd700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd378101140 0x7fd3781974d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00b530 tx=0x7fd36c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.215+0000 7fd35ffff700 1 -- 172.21.15.81:0/267793353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c011830 con 0x7fd378101140 2024-05-09T00:08:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.215+0000 7fd37d28d700 1 -- 172.21.15.81:0/267793353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3781a4070 con 0x7fd378101140 2024-05-09T00:08:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.215+0000 7fd37d28d700 1 -- 172.21.15.81:0/267793353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3781a45a0 con 0x7fd378101140 2024-05-09T00:08:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.215+0000 7fd35ffff700 1 -- 172.21.15.81:0/267793353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd36c011e50 con 0x7fd378101140 2024-05-09T00:08:32.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.215+0000 7fd35ffff700 1 -- 172.21.15.81:0/267793353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0193b0 con 0x7fd378101140 2024-05-09T00:08:32.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.217+0000 7fd35ffff700 1 -- 172.21.15.81:0/267793353 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fd36c011990 con 0x7fd378101140 2024-05-09T00:08:32.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.217+0000 7fd35ffff700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd3600a1310 0x7fd3600a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.218+0000 7fd3767fc700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd3600a1310 0x7fd3600a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.218+0000 7fd35ffff700 1 -- 172.21.15.81:0/267793353 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fd36c0cc650 con 0x7fd378101140 2024-05-09T00:08:32.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.218+0000 7fd3767fc700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd3600a1310 0x7fd3600a37d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd368006010 tx=0x7fd36800b540 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:32.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd389447b80 1 Processor -- start 2024-05-09T00:08:32.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd389447b80 1 -- start start 2024-05-09T00:08:32.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd389447b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c034e00 0x55fc3c0351e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd389447b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c035720 0x55fc3c02f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd389447b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c02f890 0x55fc3c02fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd389447b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bf86150 con 0x55fc3c02f890 2024-05-09T00:08:32.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd389447b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bf83b10 con 0x55fc3c034e00 2024-05-09T00:08:32.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd389447b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bf7f400 con 0x55fc3c035720 2024-05-09T00:08:32.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd3777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c02f890 0x55fc3c02fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd3777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c02f890 0x55fc3c02fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59686/0 (socket says 172.21.15.81:59686) 2024-05-09T00:08:32.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd3777fe700 1 -- 172.21.15.81:0/2361747093 learned_addr learned my addr 172.21.15.81:0/2361747093 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:32.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd3767fc700 1 --2- 172.21.15.81:0/2361747093 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c035720 0x55fc3c02f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd376ffd700 1 --2- 172.21.15.81:0/2361747093 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c034e00 0x55fc3c0351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd3777fe700 1 -- 172.21.15.81:0/2361747093 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c035720 msgr2=0x55fc3c02f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd3777fe700 1 --2- 172.21.15.81:0/2361747093 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c035720 0x55fc3c02f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd3777fe700 1 -- 172.21.15.81:0/2361747093 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c034e00 msgr2=0x55fc3c0351e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd3777fe700 1 --2- 172.21.15.81:0/2361747093 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c034e00 0x55fc3c0351e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.219+0000 7fd3777fe700 1 -- 172.21.15.81:0/2361747093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc3be003b0 con 0x55fc3c02f890 2024-05-09T00:08:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.220+0000 7fd3777fe700 1 --2- 172.21.15.81:0/2361747093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c02f890 0x55fc3c02fcd0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fd370009dc0 tx=0x7fd3700077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe856e15da25a51 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.220+0000 7fd35d7fa700 1 -- 172.21.15.81:0/2361747093 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370014610 con 0x55fc3c02f890 2024-05-09T00:08:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.220+0000 7fd35d7fa700 1 -- 172.21.15.81:0/2361747093 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd37000f050 con 0x55fc3c02f890 2024-05-09T00:08:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.220+0000 7fd35d7fa700 1 -- 172.21.15.81:0/2361747093 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370013960 con 0x55fc3c02f890 2024-05-09T00:08:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.220+0000 7fd389447b80 1 -- 172.21.15.81:0/2361747093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c02f890 msgr2=0x55fc3c02fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.220+0000 7fd389447b80 1 --2- 172.21.15.81:0/2361747093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c02f890 0x55fc3c02fcd0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fd370009dc0 tx=0x7fd3700077e0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.220+0000 7fd389447b80 1 -- 172.21.15.81:0/2361747093 shutdown_connections 2024-05-09T00:08:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.220+0000 7fd389447b80 1 --2- 172.21.15.81:0/2361747093 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c034e00 0x55fc3c0351e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.220+0000 7fd389447b80 1 --2- 172.21.15.81:0/2361747093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c02f890 0x55fc3c02fcd0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.220+0000 7fd389447b80 1 --2- 172.21.15.81:0/2361747093 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c035720 0x55fc3c02f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.220+0000 7fd389447b80 1 -- 172.21.15.81:0/2361747093 >> 172.21.15.81:0/2361747093 conn(0x55fc3bf8d210 msgr2=0x55fc3c029df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.220+0000 7fd389447b80 1 -- 172.21.15.81:0/2361747093 shutdown_connections 2024-05-09T00:08:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.220+0000 7fd389447b80 1 -- 172.21.15.81:0/2361747093 wait complete. 2024-05-09T00:08:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd389447b80 1 -- start start 2024-05-09T00:08:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd389447b80 1 Processor -- start 2024-05-09T00:08:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd389447b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c02f890 0x55fc3c03b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd389447b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c034e00 0x55fc3c038a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd389447b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c035720 0x55fc3c039170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd389447b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bf1b560 con 0x55fc3c02f890 2024-05-09T00:08:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd389447b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bf1b200 con 0x55fc3c034e00 2024-05-09T00:08:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd389447b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3be026a0 con 0x55fc3c035720 2024-05-09T00:08:32.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd389447b80 10 client.0 _ll_register_callbacks cb 0x55fc3bf24b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:32.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd376ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c02f890 0x55fc3c03b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd376ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c02f890 0x55fc3c03b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59700/0 (socket says 172.21.15.81:59700) 2024-05-09T00:08:32.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd376ffd700 1 -- 172.21.15.81:0/4042921735 learned_addr learned my addr 172.21.15.81:0/4042921735 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:32.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd3767fc700 1 --2- 172.21.15.81:0/4042921735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c034e00 0x55fc3c038a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd3777fe700 1 --2- 172.21.15.81:0/4042921735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c035720 0x55fc3c039170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd376ffd700 1 -- 172.21.15.81:0/4042921735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c035720 msgr2=0x55fc3c039170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd376ffd700 1 --2- 172.21.15.81:0/4042921735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c035720 0x55fc3c039170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd376ffd700 1 -- 172.21.15.81:0/4042921735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c034e00 msgr2=0x55fc3c038a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd376ffd700 1 --2- 172.21.15.81:0/4042921735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c034e00 0x55fc3c038a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd376ffd700 1 -- 172.21.15.81:0/4042921735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd370009a20 con 0x55fc3c02f890 2024-05-09T00:08:32.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.221+0000 7fd3777fe700 1 --2- 172.21.15.81:0/4042921735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c035720 0x55fc3c039170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:32.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd376ffd700 1 --2- 172.21.15.81:0/4042921735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c02f890 0x55fc3c03b740 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0997c0 tx=0x7fd36c0999b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0ad208b89ec5da server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:32.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd35aff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:32.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd35aff5700 1 -- 172.21.15.81:0/4042921735 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0b92c0 con 0x55fc3c02f890 2024-05-09T00:08:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd35aff5700 1 -- 172.21.15.81:0/4042921735 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fd36c0a1cb0 con 0x55fc3c02f890 2024-05-09T00:08:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd389447b80 1 -- 172.21.15.81:0/4042921735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc3bed8270 con 0x55fc3c02f890 2024-05-09T00:08:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd35aff5700 1 -- 172.21.15.81:0/4042921735 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd36c0b2200 con 0x55fc3c02f890 2024-05-09T00:08:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd389447b80 10 client.17031 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd389447b80 1 -- 172.21.15.81:0/4042921735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fc3bdacb60 con 0x55fc3c02f890 2024-05-09T00:08:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd35aff5700 1 -- 172.21.15.81:0/4042921735 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd36c063020 con 0x55fc3c02f890 2024-05-09T00:08:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd35aff5700 1 -- 172.21.15.81:0/4042921735 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd36c0a18b0 con 0x55fc3c02f890 2024-05-09T00:08:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd389447b80 10 client.17031 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd389447b80 10 client.17031 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd389447b80 20 client.17031 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd389447b80 1 --2- 172.21.15.81:0/4042921735 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc3c049270 0x55fc3c04b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd389447b80 4 client.17031 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:08:32.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd389447b80 1 -- 172.21.15.81:0/4042921735 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc3bffe810 con 0x55fc3c049270 2024-05-09T00:08:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.222+0000 7fd3767fc700 1 --2- 172.21.15.81:0/4042921735 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc3c049270 0x55fc3c04b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.223+0000 7fd3767fc700 1 --2- 172.21.15.81:0/4042921735 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc3c049270 0x55fc3c04b690 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3f56c8dfb80c06b server_cookie=bc2641a3f6a8b397 in_seq=0 out_seq=0 2024-05-09T00:08:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.223+0000 7fd35aff5700 10 client.17031 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.223+0000 7fd35aff5700 1 -- 172.21.15.81:0/4042921735 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fc3bffe810 con 0x55fc3c049270 2024-05-09T00:08:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.223+0000 7fd35aff5700 10 client.17031 handle_command_reply: tid=0 2024-05-09T00:08:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.223+0000 7fd389447b80 1 client.17031 shutdown 2024-05-09T00:08:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.224+0000 7fd389447b80 1 -- 172.21.15.81:0/4042921735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c02f890 msgr2=0x55fc3c03b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.224+0000 7fd389447b80 1 --2- 172.21.15.81:0/4042921735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c02f890 0x55fc3c03b740 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0997c0 tx=0x7fd36c0999b0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.224+0000 7fd389447b80 1 -- 172.21.15.81:0/4042921735 shutdown_connections 2024-05-09T00:08:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.224+0000 7fd389447b80 1 --2- 172.21.15.81:0/4042921735 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc3c049270 0x55fc3c04b690 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.224+0000 7fd389447b80 1 --2- 172.21.15.81:0/4042921735 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c035720 0x55fc3c039170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.224+0000 7fd389447b80 1 --2- 172.21.15.81:0/4042921735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c02f890 0x55fc3c03b740 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.224+0000 7fd35aff5700 0 client.17031 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:32.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.224+0000 7fd389447b80 1 --2- 172.21.15.81:0/4042921735 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c034e00 0x55fc3c038a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.224+0000 7fd389447b80 1 -- 172.21.15.81:0/4042921735 >> 172.21.15.81:0/4042921735 conn(0x55fc3bf8d210 msgr2=0x55fc3c0295a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:32.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.224+0000 7fd389447b80 1 -- 172.21.15.81:0/4042921735 shutdown_connections 2024-05-09T00:08:32.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.224+0000 7fd389447b80 1 -- 172.21.15.81:0/4042921735 wait complete. 2024-05-09T00:08:32.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.224+0000 7fd389447b80 20 client.17031 trim_cache size 0 max 16384 2024-05-09T00:08:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd389447b80 1 Processor -- start 2024-05-09T00:08:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd389447b80 1 -- start start 2024-05-09T00:08:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd389447b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c02f890 0x55fc3c02f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd389447b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c034e00 0x55fc3c02fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd389447b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c035720 0x55fc3c044c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd389447b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3c036f80 con 0x55fc3c034e00 2024-05-09T00:08:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd389447b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3c039110 con 0x55fc3c035720 2024-05-09T00:08:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd389447b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3c0392d0 con 0x55fc3c02f890 2024-05-09T00:08:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd3767fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c034e00 0x55fc3c02fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd3767fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c034e00 0x55fc3c02fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59710/0 (socket says 172.21.15.81:59710) 2024-05-09T00:08:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd3767fc700 1 -- 172.21.15.81:0/2446274151 learned_addr learned my addr 172.21.15.81:0/2446274151 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd376ffd700 1 --2- 172.21.15.81:0/2446274151 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c02f890 0x55fc3c02f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd3777fe700 1 --2- 172.21.15.81:0/2446274151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c035720 0x55fc3c044c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd3767fc700 1 -- 172.21.15.81:0/2446274151 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c02f890 msgr2=0x55fc3c02f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd3767fc700 1 --2- 172.21.15.81:0/2446274151 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c02f890 0x55fc3c02f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd3767fc700 1 -- 172.21.15.81:0/2446274151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c035720 msgr2=0x55fc3c044c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd3767fc700 1 --2- 172.21.15.81:0/2446274151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c035720 0x55fc3c044c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd3767fc700 1 -- 172.21.15.81:0/2446274151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc3bf45560 con 0x55fc3c034e00 2024-05-09T00:08:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.237+0000 7fd3777fe700 1 --2- 172.21.15.81:0/2446274151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c035720 0x55fc3c044c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.238+0000 7fd3767fc700 1 --2- 172.21.15.81:0/2446274151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c034e00 0x55fc3c02fc70 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd368009990 tx=0x7fd36801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd839d89a1abf77a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.238+0000 7fd35dffb700 1 -- 172.21.15.81:0/2446274151 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36802b040 con 0x55fc3c034e00 2024-05-09T00:08:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.238+0000 7fd35dffb700 1 -- 172.21.15.81:0/2446274151 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd36802c040 con 0x55fc3c034e00 2024-05-09T00:08:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.238+0000 7fd35dffb700 1 -- 172.21.15.81:0/2446274151 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3680048c0 con 0x55fc3c034e00 2024-05-09T00:08:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.238+0000 7fd389447b80 1 -- 172.21.15.81:0/2446274151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c034e00 msgr2=0x55fc3c02fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.238+0000 7fd389447b80 1 --2- 172.21.15.81:0/2446274151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c034e00 0x55fc3c02fc70 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fd368009990 tx=0x7fd36801f000 comp rx=0 tx=0).stop 2024-05-09T00:08:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.238+0000 7fd389447b80 1 -- 172.21.15.81:0/2446274151 shutdown_connections 2024-05-09T00:08:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.238+0000 7fd389447b80 1 --2- 172.21.15.81:0/2446274151 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c035720 0x55fc3c044c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.238+0000 7fd389447b80 1 --2- 172.21.15.81:0/2446274151 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c02f890 0x55fc3c02f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.238+0000 7fd389447b80 1 --2- 172.21.15.81:0/2446274151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c034e00 0x55fc3c02fc70 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.238+0000 7fd389447b80 1 -- 172.21.15.81:0/2446274151 >> 172.21.15.81:0/2446274151 conn(0x55fc3bf8d210 msgr2=0x55fc3c04fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.238+0000 7fd389447b80 1 -- 172.21.15.81:0/2446274151 shutdown_connections 2024-05-09T00:08:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.238+0000 7fd389447b80 1 -- 172.21.15.81:0/2446274151 wait complete. 2024-05-09T00:08:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd389447b80 1 -- start start 2024-05-09T00:08:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd389447b80 1 Processor -- start 2024-05-09T00:08:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd389447b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c02f890 0x55fc3c031ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd389447b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c034e00 0x55fc3c032220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd389447b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c035720 0x55fc3c030930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd389447b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3c040910 con 0x55fc3c034e00 2024-05-09T00:08:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd389447b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3c040a80 con 0x55fc3c035720 2024-05-09T00:08:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd389447b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3c030e70 con 0x55fc3c02f890 2024-05-09T00:08:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd389447b80 10 client.0 _ll_register_callbacks cb 0x55fc3bf24b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd3767fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c034e00 0x55fc3c032220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd3767fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c034e00 0x55fc3c032220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59714/0 (socket says 172.21.15.81:59714) 2024-05-09T00:08:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd3767fc700 1 -- 172.21.15.81:0/1572125160 learned_addr learned my addr 172.21.15.81:0/1572125160 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd376ffd700 1 --2- 172.21.15.81:0/1572125160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c02f890 0x55fc3c031ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd3777fe700 1 --2- 172.21.15.81:0/1572125160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c035720 0x55fc3c030930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd3767fc700 1 -- 172.21.15.81:0/1572125160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c02f890 msgr2=0x55fc3c031ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd3767fc700 1 --2- 172.21.15.81:0/1572125160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c02f890 0x55fc3c031ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd3767fc700 1 -- 172.21.15.81:0/1572125160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c035720 msgr2=0x55fc3c030930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd3767fc700 1 --2- 172.21.15.81:0/1572125160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c035720 0x55fc3c030930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.239+0000 7fd3767fc700 1 -- 172.21.15.81:0/1572125160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37810e650 con 0x55fc3c034e00 2024-05-09T00:08:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd3767fc700 1 --2- 172.21.15.81:0/1572125160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c034e00 0x55fc3c032220 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd368009350 tx=0x7fd368036990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45d0f37c9b0065b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd35aff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd35aff5700 1 -- 172.21.15.81:0/1572125160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36802b040 con 0x55fc3c034e00 2024-05-09T00:08:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd35aff5700 1 -- 172.21.15.81:0/1572125160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fd368036e40 con 0x55fc3c034e00 2024-05-09T00:08:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd389447b80 1 -- 172.21.15.81:0/1572125160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd37000f050 con 0x55fc3c034e00 2024-05-09T00:08:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd35aff5700 1 -- 172.21.15.81:0/1572125160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd368036360 con 0x55fc3c034e00 2024-05-09T00:08:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd389447b80 10 client.17037 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd389447b80 1 -- 172.21.15.81:0/1572125160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fc3be04cd0 con 0x55fc3c034e00 2024-05-09T00:08:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd35aff5700 1 -- 172.21.15.81:0/1572125160 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd36804b080 con 0x55fc3c034e00 2024-05-09T00:08:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd35aff5700 1 -- 172.21.15.81:0/1572125160 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd36800f580 con 0x55fc3c034e00 2024-05-09T00:08:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd389447b80 10 client.17037 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd389447b80 10 client.17037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd389447b80 20 client.17037 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd389447b80 1 --2- 172.21.15.81:0/1572125160 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc3c09ff20 0x55fc3c0a2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd389447b80 4 client.17037 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:08:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.240+0000 7fd389447b80 1 -- 172.21.15.81:0/1572125160 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fc3bf77ec0 con 0x55fc3c09ff20 2024-05-09T00:08:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd376ffd700 1 --2- 172.21.15.81:0/1572125160 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc3c09ff20 0x55fc3c0a2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd35aff5700 10 client.17037 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd376ffd700 1 --2- 172.21.15.81:0/1572125160 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc3c09ff20 0x55fc3c0a2310 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c1632b65a5f60e6 server_cookie=2dcd356a3fa760eb in_seq=0 out_seq=0 2024-05-09T00:08:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd35aff5700 1 -- 172.21.15.81:0/1572125160 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fc3bf77ec0 con 0x55fc3c09ff20 2024-05-09T00:08:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd35aff5700 10 client.17037 handle_command_reply: tid=0 2024-05-09T00:08:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd389447b80 1 client.17037 shutdown 2024-05-09T00:08:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd389447b80 1 -- 172.21.15.81:0/1572125160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c034e00 msgr2=0x55fc3c032220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd389447b80 1 --2- 172.21.15.81:0/1572125160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c034e00 0x55fc3c032220 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fd368009350 tx=0x7fd368036990 comp rx=0 tx=0).stop 2024-05-09T00:08:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd389447b80 1 -- 172.21.15.81:0/1572125160 shutdown_connections 2024-05-09T00:08:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd389447b80 1 --2- 172.21.15.81:0/1572125160 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc3c09ff20 0x55fc3c0a2310 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd389447b80 1 --2- 172.21.15.81:0/1572125160 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc3c035720 0x55fc3c030930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd35aff5700 0 client.17037 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd389447b80 1 --2- 172.21.15.81:0/1572125160 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc3c02f890 0x55fc3c031ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd389447b80 1 --2- 172.21.15.81:0/1572125160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc3c034e00 0x55fc3c032220 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd389447b80 1 -- 172.21.15.81:0/1572125160 >> 172.21.15.81:0/1572125160 conn(0x55fc3bf8d210 msgr2=0x55fc3c032bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd389447b80 1 -- 172.21.15.81:0/1572125160 shutdown_connections 2024-05-09T00:08:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd389447b80 1 -- 172.21.15.81:0/1572125160 wait complete. 2024-05-09T00:08:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.241+0000 7fd389447b80 20 client.17037 trim_cache size 0 max 16384 2024-05-09T00:08:32.245 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:08:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.242+0000 7fd37d28d700 1 -- 172.21.15.81:0/267793353 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd3600a1310 msgr2=0x7fd3600a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.242+0000 7fd37d28d700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd3600a1310 0x7fd3600a37d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd368006010 tx=0x7fd36800b540 comp rx=0 tx=0).stop 2024-05-09T00:08:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.242+0000 7fd37d28d700 1 -- 172.21.15.81:0/267793353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd378101140 msgr2=0x7fd3781974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.242+0000 7fd37d28d700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd378101140 0x7fd3781974d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00b530 tx=0x7fd36c00b8f0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.242+0000 7fd37d28d700 1 -- 172.21.15.81:0/267793353 shutdown_connections 2024-05-09T00:08:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.242+0000 7fd37d28d700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd3600a1310 0x7fd3600a37d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.242+0000 7fd37d28d700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd37819bd60 0x7fd37819c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.242+0000 7fd37d28d700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd378101140 0x7fd3781974d0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.242+0000 7fd37d28d700 1 --2- 172.21.15.81:0/267793353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd378106260 0x7fd378197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.242+0000 7fd37d28d700 1 -- 172.21.15.81:0/267793353 >> 172.21.15.81:0/267793353 conn(0x7fd3780fc9e0 msgr2=0x7fd3780fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.242+0000 7fd37d28d700 1 -- 172.21.15.81:0/267793353 shutdown_connections 2024-05-09T00:08:32.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:32.242+0000 7fd37d28d700 1 -- 172.21.15.81:0/267793353 wait complete. 2024-05-09T00:08:32.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:32 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2329677428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:08:32.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:32 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2329677428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:08:32.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:32 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2329677428' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:08:33.249 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:08:33.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:08:33.280 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:33 smithi081 ceph-mon[42474]: pgmap v171: 97 pgs: 97 active+clean; 3.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-05-09T00:08:33.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:33 smithi171 ceph-mon[47351]: pgmap v171: 97 pgs: 97 active+clean; 3.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-05-09T00:08:33.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.394+0000 7f0c7d9ee700 1 -- 172.21.15.81:0/2593087276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c78106280 msgr2=0x7f0c7810de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.394+0000 7f0c7d9ee700 1 --2- 172.21.15.81:0/2593087276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c78106280 0x7f0c7810de00 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000b0a0 tx=0x7f0c7000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.394+0000 7f0c7d9ee700 1 -- 172.21.15.81:0/2593087276 shutdown_connections 2024-05-09T00:08:33.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.394+0000 7f0c7d9ee700 1 --2- 172.21.15.81:0/2593087276 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c78101160 0x7f0c78101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.394+0000 7f0c7d9ee700 1 --2- 172.21.15.81:0/2593087276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c78106280 0x7f0c7810de00 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.394+0000 7f0c7d9ee700 1 --2- 172.21.15.81:0/2593087276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c78101b10 0x7f0c78105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.394+0000 7f0c7d9ee700 1 -- 172.21.15.81:0/2593087276 >> 172.21.15.81:0/2593087276 conn(0x7f0c780fc9e0 msgr2=0x7f0c780fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:33.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.394+0000 7f0c7d9ee700 1 -- 172.21.15.81:0/2593087276 shutdown_connections 2024-05-09T00:08:33.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.394+0000 7f0c7d9ee700 1 -- 172.21.15.81:0/2593087276 wait complete. 2024-05-09T00:08:33.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c7d9ee700 1 Processor -- start 2024-05-09T00:08:33.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c7d9ee700 1 -- start start 2024-05-09T00:08:33.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c7d9ee700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c78101160 0x7f0c78197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c7d9ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c78106280 0x7f0c78197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c7d9ee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c7819bdc0 0x7f0c7819c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c7d9ee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7819c840 con 0x7f0c78106280 2024-05-09T00:08:33.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c7d9ee700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7819c9b0 con 0x7f0c7819bdc0 2024-05-09T00:08:33.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c7d9ee700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7819cb70 con 0x7f0c78101160 2024-05-09T00:08:33.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c767fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c78106280 0x7f0c78197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c767fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c78106280 0x7f0c78197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59724/0 (socket says 172.21.15.81:59724) 2024-05-09T00:08:33.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c767fc700 1 -- 172.21.15.81:0/443592282 learned_addr learned my addr 172.21.15.81:0/443592282 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:33.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c777fe700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c7819bdc0 0x7f0c7819c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c78101160 0x7f0c78197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c767fc700 1 -- 172.21.15.81:0/443592282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c78101160 msgr2=0x7f0c78197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c767fc700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c78101160 0x7f0c78197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c767fc700 1 -- 172.21.15.81:0/443592282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c7819bdc0 msgr2=0x7f0c7819c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c767fc700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c7819bdc0 0x7f0c7819c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c767fc700 1 -- 172.21.15.81:0/443592282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c70009d00 con 0x7f0c78106280 2024-05-09T00:08:33.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c78101160 0x7f0c78197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:33.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.395+0000 7f0c777fe700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c7819bdc0 0x7f0c7819c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:33.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.396+0000 7f0c767fc700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c78106280 0x7f0c78197a70 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800d950 tx=0x7f0c6800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:33.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.396+0000 7f0c7c9ec700 1 -- 172.21.15.81:0/443592282 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68009b40 con 0x7f0c78106280 2024-05-09T00:08:33.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.396+0000 7f0c7c9ec700 1 -- 172.21.15.81:0/443592282 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c6800de30 con 0x7f0c78106280 2024-05-09T00:08:33.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.396+0000 7f0c7d9ee700 1 -- 172.21.15.81:0/443592282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c781a40d0 con 0x7f0c78106280 2024-05-09T00:08:33.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.396+0000 7f0c7c9ec700 1 -- 172.21.15.81:0/443592282 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68005580 con 0x7f0c78106280 2024-05-09T00:08:33.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.396+0000 7f0c7d9ee700 1 -- 172.21.15.81:0/443592282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c781a4560 con 0x7f0c78106280 2024-05-09T00:08:33.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.398+0000 7f0c7c9ec700 1 -- 172.21.15.81:0/443592282 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f0c68004750 con 0x7f0c78106280 2024-05-09T00:08:33.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.398+0000 7f0c7c9ec700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0c600a1290 0x7f0c600a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.398+0000 7f0c7c9ec700 1 -- 172.21.15.81:0/443592282 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f0c680cc600 con 0x7f0c78106280 2024-05-09T00:08:33.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.398+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0c600a1290 0x7f0c600a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.399+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0c600a1290 0x7f0c600a3750 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009be0 tx=0x7f0c6c009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:33.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.399+0000 7f0c89ba8b80 1 Processor -- start 2024-05-09T00:08:33.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.399+0000 7f0c89ba8b80 1 -- start start 2024-05-09T00:08:33.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c89ba8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562391872e80 0x562391873260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c89ba8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5623918737a0 0x56239186d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c89ba8b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56239186d910 0x56239186dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c89ba8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623917c41d0 con 0x562391872e80 2024-05-09T00:08:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c89ba8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623917c1b90 con 0x5623918737a0 2024-05-09T00:08:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c89ba8b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623917bd480 con 0x56239186d910 2024-05-09T00:08:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c76ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562391872e80 0x562391873260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c76ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562391872e80 0x562391873260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59738/0 (socket says 172.21.15.81:59738) 2024-05-09T00:08:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c76ffd700 1 -- 172.21.15.81:0/3317044687 learned_addr learned my addr 172.21.15.81:0/3317044687 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:33.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c767fc700 1 --2- 172.21.15.81:0/3317044687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5623918737a0 0x56239186d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c777fe700 1 --2- 172.21.15.81:0/3317044687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56239186d910 0x56239186dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c76ffd700 1 -- 172.21.15.81:0/3317044687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56239186d910 msgr2=0x56239186dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/3317044687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56239186d910 0x56239186dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c76ffd700 1 -- 172.21.15.81:0/3317044687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5623918737a0 msgr2=0x56239186d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/3317044687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5623918737a0 0x56239186d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c76ffd700 1 -- 172.21.15.81:0/3317044687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56239163e430 con 0x562391872e80 2024-05-09T00:08:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/3317044687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562391872e80 0x562391873260 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c010d00 tx=0x7f0c6c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1bd2a6c8d9c97d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:33.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.400+0000 7f0c5dffb700 1 -- 172.21.15.81:0/3317044687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c012b60 con 0x562391872e80 2024-05-09T00:08:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.401+0000 7f0c5dffb700 1 -- 172.21.15.81:0/3317044687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c6c012cc0 con 0x562391872e80 2024-05-09T00:08:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.401+0000 7f0c5dffb700 1 -- 172.21.15.81:0/3317044687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c01e5f0 con 0x562391872e80 2024-05-09T00:08:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.401+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/3317044687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562391872e80 msgr2=0x562391873260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.401+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/3317044687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562391872e80 0x562391873260 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c010d00 tx=0x7f0c6c013000 comp rx=0 tx=0).stop 2024-05-09T00:08:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.401+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/3317044687 shutdown_connections 2024-05-09T00:08:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.401+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/3317044687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56239186d910 0x56239186dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.401+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/3317044687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562391872e80 0x562391873260 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.401+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/3317044687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5623918737a0 0x56239186d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.401+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/3317044687 >> 172.21.15.81:0/3317044687 conn(0x5623917cb290 msgr2=0x562391867e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.401+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/3317044687 shutdown_connections 2024-05-09T00:08:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.401+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/3317044687 wait complete. 2024-05-09T00:08:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.402+0000 7f0c89ba8b80 1 -- start start 2024-05-09T00:08:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.402+0000 7f0c89ba8b80 1 Processor -- start 2024-05-09T00:08:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.402+0000 7f0c89ba8b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56239186d910 0x562391876a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.402+0000 7f0c89ba8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562391872e80 0x562391876fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.402+0000 7f0c89ba8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623918737a0 0x562391877500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.402+0000 7f0c89ba8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623917595e0 con 0x5623918737a0 2024-05-09T00:08:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.402+0000 7f0c89ba8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562391759280 con 0x562391872e80 2024-05-09T00:08:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.402+0000 7f0c89ba8b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x562391640720 con 0x56239186d910 2024-05-09T00:08:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.402+0000 7f0c89ba8b80 10 client.0 _ll_register_callbacks cb 0x562391762bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.402+0000 7f0c777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623918737a0 0x562391877500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.402+0000 7f0c777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623918737a0 0x562391877500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59748/0 (socket says 172.21.15.81:59748) 2024-05-09T00:08:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.402+0000 7f0c777fe700 1 -- 172.21.15.81:0/2457364684 learned_addr learned my addr 172.21.15.81:0/2457364684 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.402+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/2457364684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56239186d910 0x562391876a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.402+0000 7f0c767fc700 1 --2- 172.21.15.81:0/2457364684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562391872e80 0x562391876fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c777fe700 1 -- 172.21.15.81:0/2457364684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56239186d910 msgr2=0x562391876a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c777fe700 1 --2- 172.21.15.81:0/2457364684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56239186d910 0x562391876a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c777fe700 1 -- 172.21.15.81:0/2457364684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562391872e80 msgr2=0x562391876fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c777fe700 1 --2- 172.21.15.81:0/2457364684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562391872e80 0x562391876fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c777fe700 1 -- 172.21.15.81:0/2457364684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6c0109b0 con 0x5623918737a0 2024-05-09T00:08:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c777fe700 1 --2- 172.21.15.81:0/2457364684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623918737a0 0x562391877500 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f0c70007e60 tx=0x7f0c70007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a955123f7af2cea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c56ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:33.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c56ffd700 1 -- 172.21.15.81:0/2457364684 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7000e040 con 0x5623918737a0 2024-05-09T00:08:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c56ffd700 1 -- 172.21.15.81:0/2457364684 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f0c7000ba50 con 0x5623918737a0 2024-05-09T00:08:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2457364684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623917162f0 con 0x5623918737a0 2024-05-09T00:08:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c56ffd700 1 -- 172.21.15.81:0/2457364684 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c7000bc10 con 0x5623918737a0 2024-05-09T00:08:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c89ba8b80 10 client.17049 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2457364684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5623915eabe0 con 0x5623918737a0 2024-05-09T00:08:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c56ffd700 1 -- 172.21.15.81:0/2457364684 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5623917162f0 con 0x5623918737a0 2024-05-09T00:08:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c56ffd700 1 -- 172.21.15.81:0/2457364684 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0c70019050 con 0x5623918737a0 2024-05-09T00:08:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c89ba8b80 10 client.17049 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:33.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c89ba8b80 10 client.17049 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c89ba8b80 20 client.17049 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/2457364684 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562391887110 0x562391889530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c89ba8b80 4 client.17049 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:08:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.403+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2457364684 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56239183c890 con 0x562391887110 2024-05-09T00:08:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.404+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/2457364684 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562391887110 0x562391889530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.404+0000 7f0c56ffd700 10 client.17049 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.404+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/2457364684 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562391887110 0x562391889530 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86ecd28bb03494c4 server_cookie=80507e964810fe0 in_seq=0 out_seq=0 2024-05-09T00:08:33.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c56ffd700 1 -- 172.21.15.81:0/2457364684 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56239183c890 con 0x562391887110 2024-05-09T00:08:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c56ffd700 10 client.17049 handle_command_reply: tid=0 2024-05-09T00:08:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c89ba8b80 1 client.17049 shutdown 2024-05-09T00:08:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2457364684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623918737a0 msgr2=0x562391877500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/2457364684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623918737a0 0x562391877500 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f0c70007e60 tx=0x7f0c70007e90 comp rx=0 tx=0).stop 2024-05-09T00:08:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2457364684 shutdown_connections 2024-05-09T00:08:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/2457364684 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562391887110 0x562391889530 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/2457364684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5623918737a0 0x562391877500 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/2457364684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56239186d910 0x562391876a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c56ffd700 0 client.17049 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/2457364684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562391872e80 0x562391876fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2457364684 >> 172.21.15.81:0/2457364684 conn(0x5623917cb290 msgr2=0x562391867620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2457364684 shutdown_connections 2024-05-09T00:08:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2457364684 wait complete. 2024-05-09T00:08:33.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.405+0000 7f0c89ba8b80 20 client.17049 trim_cache size 0 max 16384 2024-05-09T00:08:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c89ba8b80 1 Processor -- start 2024-05-09T00:08:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c89ba8b80 1 -- start start 2024-05-09T00:08:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c89ba8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56239186d910 0x56239186d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c89ba8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562391872e80 0x562391867da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c89ba8b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5623918737a0 0x562391871ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c89ba8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623918780f0 con 0x562391872e80 2024-05-09T00:08:33.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c89ba8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562391864e40 con 0x56239186d910 2024-05-09T00:08:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c89ba8b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56239188e740 con 0x5623918737a0 2024-05-09T00:08:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c767fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562391872e80 0x562391867da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c767fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562391872e80 0x562391867da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59760/0 (socket says 172.21.15.81:59760) 2024-05-09T00:08:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c767fc700 1 -- 172.21.15.81:0/581719146 learned_addr learned my addr 172.21.15.81:0/581719146 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/581719146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56239186d910 0x56239186d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c777fe700 1 --2- 172.21.15.81:0/581719146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5623918737a0 0x562391871ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c767fc700 1 -- 172.21.15.81:0/581719146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5623918737a0 msgr2=0x562391871ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c767fc700 1 --2- 172.21.15.81:0/581719146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5623918737a0 0x562391871ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c767fc700 1 -- 172.21.15.81:0/581719146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56239186d910 msgr2=0x56239186d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c767fc700 1 --2- 172.21.15.81:0/581719146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56239186d910 0x56239186d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c767fc700 1 -- 172.21.15.81:0/581719146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562391864560 con 0x562391872e80 2024-05-09T00:08:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/581719146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56239186d910 0x56239186d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c767fc700 1 --2- 172.21.15.81:0/581719146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562391872e80 0x562391867da0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0c68095c10 tx=0x7f0c680b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917a6545af36375b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.423+0000 7f0c5e7fc700 1 -- 172.21.15.81:0/581719146 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68097ab0 con 0x562391872e80 2024-05-09T00:08:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.424+0000 7f0c5e7fc700 1 -- 172.21.15.81:0/581719146 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c680056e0 con 0x562391872e80 2024-05-09T00:08:33.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.424+0000 7f0c5e7fc700 1 -- 172.21.15.81:0/581719146 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68099970 con 0x562391872e80 2024-05-09T00:08:33.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.424+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/581719146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562391872e80 msgr2=0x562391867da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.424+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/581719146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562391872e80 0x562391867da0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f0c68095c10 tx=0x7f0c680b9040 comp rx=0 tx=0).stop 2024-05-09T00:08:33.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.424+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/581719146 shutdown_connections 2024-05-09T00:08:33.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.424+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/581719146 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56239186d910 0x56239186d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.424+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/581719146 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5623918737a0 0x562391871ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.424+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/581719146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562391872e80 0x562391867da0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.424+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/581719146 >> 172.21.15.81:0/581719146 conn(0x5623917cb290 msgr2=0x562391875350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:33.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.424+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/581719146 shutdown_connections 2024-05-09T00:08:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.424+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/581719146 wait complete. 2024-05-09T00:08:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.424+0000 7f0c89ba8b80 1 -- start start 2024-05-09T00:08:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c89ba8b80 1 Processor -- start 2024-05-09T00:08:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c89ba8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56239186d910 0x56239187ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c89ba8b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562391872e80 0x56239187d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c89ba8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5623918737a0 0x56239187d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c89ba8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623918dd660 con 0x56239186d910 2024-05-09T00:08:33.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c89ba8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623918dd7d0 con 0x5623918737a0 2024-05-09T00:08:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c89ba8b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623918dd990 con 0x562391872e80 2024-05-09T00:08:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c89ba8b80 10 client.0 _ll_register_callbacks cb 0x562391762bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c76ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56239186d910 0x56239187ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c76ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56239186d910 0x56239187ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59766/0 (socket says 172.21.15.81:59766) 2024-05-09T00:08:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c76ffd700 1 -- 172.21.15.81:0/2947803074 learned_addr learned my addr 172.21.15.81:0/2947803074 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c777fe700 1 --2- 172.21.15.81:0/2947803074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5623918737a0 0x56239187d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c767fc700 1 --2- 172.21.15.81:0/2947803074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562391872e80 0x56239187d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c76ffd700 1 -- 172.21.15.81:0/2947803074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562391872e80 msgr2=0x56239187d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/2947803074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562391872e80 0x56239187d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c76ffd700 1 -- 172.21.15.81:0/2947803074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5623918737a0 msgr2=0x56239187d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/2947803074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5623918737a0 0x56239187d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.425+0000 7f0c76ffd700 1 -- 172.21.15.81:0/2947803074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c781a4560 con 0x56239186d910 2024-05-09T00:08:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c76ffd700 1 --2- 172.21.15.81:0/2947803074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56239186d910 0x56239187ce50 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c020ea0 tx=0x7f0c6c005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85374d7b4ea4aabe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c56ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c56ffd700 1 -- 172.21.15.81:0/2947803074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c02f040 con 0x56239186d910 2024-05-09T00:08:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c56ffd700 1 -- 172.21.15.81:0/2947803074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f0c6c0365f0 con 0x56239186d910 2024-05-09T00:08:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2947803074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c6c012cc0 con 0x56239186d910 2024-05-09T00:08:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c56ffd700 1 -- 172.21.15.81:0/2947803074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c6c0367b0 con 0x56239186d910 2024-05-09T00:08:33.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c89ba8b80 10 client.17055 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2947803074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5623917835e0 con 0x56239186d910 2024-05-09T00:08:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c56ffd700 1 -- 172.21.15.81:0/2947803074 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0c6c012cc0 con 0x56239186d910 2024-05-09T00:08:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c56ffd700 1 -- 172.21.15.81:0/2947803074 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0c6c0039d0 con 0x56239186d910 2024-05-09T00:08:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c89ba8b80 10 client.17055 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c89ba8b80 10 client.17055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c89ba8b80 20 client.17055 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/2947803074 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5623918df000 0x5623918e1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c89ba8b80 4 client.17055 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:08:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.426+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2947803074 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5623917b5f40 con 0x5623918df000 2024-05-09T00:08:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.427+0000 7f0c767fc700 1 --2- 172.21.15.81:0/2947803074 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5623918df000 0x5623918e1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.427+0000 7f0c56ffd700 10 client.17055 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.427+0000 7f0c767fc700 1 --2- 172.21.15.81:0/2947803074 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5623918df000 0x5623918e1420 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a80f9bcb113ea342 server_cookie=dbea35486afaf286 in_seq=0 out_seq=0 2024-05-09T00:08:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.428+0000 7f0c56ffd700 1 -- 172.21.15.81:0/2947803074 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5623917b5f40 con 0x5623918df000 2024-05-09T00:08:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.428+0000 7f0c56ffd700 10 client.17055 handle_command_reply: tid=0 2024-05-09T00:08:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.428+0000 7f0c89ba8b80 1 client.17055 shutdown 2024-05-09T00:08:33.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.428+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2947803074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56239186d910 msgr2=0x56239187ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.428+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/2947803074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56239186d910 0x56239187ce50 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c020ea0 tx=0x7f0c6c005db0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.428+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2947803074 shutdown_connections 2024-05-09T00:08:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.428+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/2947803074 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5623918df000 0x5623918e1420 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.428+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/2947803074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5623918737a0 0x56239187d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.428+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/2947803074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56239186d910 0x56239187ce50 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.428+0000 7f0c89ba8b80 1 --2- 172.21.15.81:0/2947803074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562391872e80 0x56239187d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.428+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2947803074 >> 172.21.15.81:0/2947803074 conn(0x5623917cb290 msgr2=0x562391873b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.428+0000 7f0c56ffd700 0 client.17055 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2947803074 shutdown_connections 2024-05-09T00:08:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c89ba8b80 1 -- 172.21.15.81:0/2947803074 wait complete. 2024-05-09T00:08:33.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c89ba8b80 20 client.17055 trim_cache size 0 max 16384 2024-05-09T00:08:33.440 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:08:33.440 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:08:33.440 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "ab8fe0b1-1606-48d2-877f-9d9029169890", 2024-05-09T00:08:33.440 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:08:33.440 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:08:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c7d9ee700 1 -- 172.21.15.81:0/443592282 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0c600a1290 msgr2=0x7f0c600a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c7d9ee700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0c600a1290 0x7f0c600a3750 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c009be0 tx=0x7f0c6c009260 comp rx=0 tx=0).stop 2024-05-09T00:08:33.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c7d9ee700 1 -- 172.21.15.81:0/443592282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c78106280 msgr2=0x7f0c78197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c7d9ee700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c78106280 0x7f0c78197a70 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800d950 tx=0x7f0c6800dd10 comp rx=0 tx=0).stop 2024-05-09T00:08:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c7d9ee700 1 -- 172.21.15.81:0/443592282 shutdown_connections 2024-05-09T00:08:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c7d9ee700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0c600a1290 0x7f0c600a3750 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c7d9ee700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0c7819bdc0 0x7f0c7819c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c7d9ee700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0c78101160 0x7f0c78197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c7d9ee700 1 --2- 172.21.15.81:0/443592282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c78106280 0x7f0c78197a70 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c7d9ee700 1 -- 172.21.15.81:0/443592282 >> 172.21.15.81:0/443592282 conn(0x7f0c780fc9e0 msgr2=0x7f0c780fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c7d9ee700 1 -- 172.21.15.81:0/443592282 shutdown_connections 2024-05-09T00:08:33.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.429+0000 7f0c7d9ee700 1 -- 172.21.15.81:0/443592282 wait complete. 2024-05-09T00:08:33.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:08:33.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:33 smithi150 ceph-mon[46187]: pgmap v171: 97 pgs: 97 active+clean; 3.4 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-05-09T00:08:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.610+0000 7f287e225700 1 -- 172.21.15.81:0/3695651040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2878101b10 msgr2=0x7f2878105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.610+0000 7f287e225700 1 --2- 172.21.15.81:0/3695651040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2878101b10 0x7f2878105b50 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f286c009990 tx=0x7f286c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.610+0000 7f287e225700 1 -- 172.21.15.81:0/3695651040 shutdown_connections 2024-05-09T00:08:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.610+0000 7f287e225700 1 --2- 172.21.15.81:0/3695651040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2878101160 0x7f2878101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.610+0000 7f287e225700 1 --2- 172.21.15.81:0/3695651040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2878106280 0x7f287810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.610+0000 7f287e225700 1 --2- 172.21.15.81:0/3695651040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2878101b10 0x7f2878105b50 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.610+0000 7f287e225700 1 -- 172.21.15.81:0/3695651040 >> 172.21.15.81:0/3695651040 conn(0x7f28780fc9c0 msgr2=0x7f28780fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.610+0000 7f287e225700 1 -- 172.21.15.81:0/3695651040 shutdown_connections 2024-05-09T00:08:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.610+0000 7f287e225700 1 -- 172.21.15.81:0/3695651040 wait complete. 2024-05-09T00:08:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.611+0000 7f287e225700 1 Processor -- start 2024-05-09T00:08:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.611+0000 7f287e225700 1 -- start start 2024-05-09T00:08:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.611+0000 7f287e225700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2878101160 0x7f28780732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.611+0000 7f287e225700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2878106280 0x7f28780737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.611+0000 7f287e225700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2878073d20 0x7f28781a54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.611+0000 7f287e225700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28781a5a70 con 0x7f2878106280 2024-05-09T00:08:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.611+0000 7f287e225700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28781a5bb0 con 0x7f2878073d20 2024-05-09T00:08:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.611+0000 7f287e225700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28781a5d70 con 0x7f2878101160 2024-05-09T00:08:33.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.611+0000 7f2876ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2878106280 0x7f28780737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.611+0000 7f2876ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2878106280 0x7f28780737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59782/0 (socket says 172.21.15.81:59782) 2024-05-09T00:08:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.611+0000 7f2876ffd700 1 -- 172.21.15.81:0/3147201285 learned_addr learned my addr 172.21.15.81:0/3147201285 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f2877fff700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2878073d20 0x7f28781a54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f28777fe700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2878101160 0x7f28780732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f2876ffd700 1 -- 172.21.15.81:0/3147201285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2878101160 msgr2=0x7f28780732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f2876ffd700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2878101160 0x7f28780732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f2876ffd700 1 -- 172.21.15.81:0/3147201285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2878073d20 msgr2=0x7f28781a54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f2876ffd700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2878073d20 0x7f28781a54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f2876ffd700 1 -- 172.21.15.81:0/3147201285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c0095f0 con 0x7f2878106280 2024-05-09T00:08:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f28777fe700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2878101160 0x7f28780732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f2877fff700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2878073d20 0x7f28781a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f2876ffd700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2878106280 0x7f28780737e0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f286c0059d0 tx=0x7f286c00f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:33.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f2874ff9700 1 -- 172.21.15.81:0/3147201285 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c01d070 con 0x7f2878106280 2024-05-09T00:08:33.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f2874ff9700 1 -- 172.21.15.81:0/3147201285 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f286c00fe40 con 0x7f2878106280 2024-05-09T00:08:33.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f287e225700 1 -- 172.21.15.81:0/3147201285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28781a5ff0 con 0x7f2878106280 2024-05-09T00:08:33.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f2874ff9700 1 -- 172.21.15.81:0/3147201285 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c0039f0 con 0x7f2878106280 2024-05-09T00:08:33.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.612+0000 7f287e225700 1 -- 172.21.15.81:0/3147201285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28781a63b0 con 0x7f2878106280 2024-05-09T00:08:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.614+0000 7f2874ff9700 1 -- 172.21.15.81:0/3147201285 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f286c022470 con 0x7f2878106280 2024-05-09T00:08:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.615+0000 7f2874ff9700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28600a1310 0x7f28600a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.615+0000 7f28777fe700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28600a1310 0x7f28600a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.615+0000 7f2874ff9700 1 -- 172.21.15.81:0/3147201285 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f286c022e40 con 0x7f2878106280 2024-05-09T00:08:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.615+0000 7f28777fe700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28600a1310 0x7f28600a37d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2868005fd0 tx=0x7f2868005e30 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:33.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f288a3dfb80 1 Processor -- start 2024-05-09T00:08:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f288a3dfb80 1 -- start start 2024-05-09T00:08:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f288a3dfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0302e00 0x55abd03031e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f288a3dfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 0x55abd02fd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f288a3dfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd02fdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f288a3dfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abd0254150 con 0x55abd02fd890 2024-05-09T00:08:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f288a3dfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abd0251b10 con 0x55abd0302e00 2024-05-09T00:08:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f288a3dfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abd024d400 con 0x55abd0303720 2024-05-09T00:08:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f2877fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd02fdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f2877fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd02fdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59794/0 (socket says 172.21.15.81:59794) 2024-05-09T00:08:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f2877fff700 1 -- 172.21.15.81:0/2711243861 learned_addr learned my addr 172.21.15.81:0/2711243861 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f28777fe700 1 --2- 172.21.15.81:0/2711243861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0302e00 0x55abd03031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f2876ffd700 1 --2- 172.21.15.81:0/2711243861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 0x55abd02fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f2877fff700 1 -- 172.21.15.81:0/2711243861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 msgr2=0x55abd02fd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f2877fff700 1 --2- 172.21.15.81:0/2711243861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 0x55abd02fd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f2877fff700 1 -- 172.21.15.81:0/2711243861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0302e00 msgr2=0x55abd03031e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f2877fff700 1 --2- 172.21.15.81:0/2711243861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0302e00 0x55abd03031e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f2877fff700 1 -- 172.21.15.81:0/2711243861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abd00ce3b0 con 0x55abd02fd890 2024-05-09T00:08:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f2877fff700 1 --2- 172.21.15.81:0/2711243861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd02fdcd0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f287000e160 tx=0x7f287000e470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111d06104c7e857a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.616+0000 7f285dffb700 1 -- 172.21.15.81:0/2711243861 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870018070 con 0x55abd02fd890 2024-05-09T00:08:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.617+0000 7f285dffb700 1 -- 172.21.15.81:0/2711243861 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2870007c70 con 0x55abd02fd890 2024-05-09T00:08:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.617+0000 7f285dffb700 1 -- 172.21.15.81:0/2711243861 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2870014cd0 con 0x55abd02fd890 2024-05-09T00:08:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.617+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2711243861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 msgr2=0x55abd02fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.617+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/2711243861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd02fdcd0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f287000e160 tx=0x7f287000e470 comp rx=0 tx=0).stop 2024-05-09T00:08:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.617+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2711243861 shutdown_connections 2024-05-09T00:08:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.617+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/2711243861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0302e00 0x55abd03031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.617+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/2711243861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd02fdcd0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.617+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/2711243861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 0x55abd02fd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.617+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2711243861 >> 172.21.15.81:0/2711243861 conn(0x55abd025b210 msgr2=0x55abd02f7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.617+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2711243861 shutdown_connections 2024-05-09T00:08:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.617+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2711243861 wait complete. 2024-05-09T00:08:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f288a3dfb80 1 -- start start 2024-05-09T00:08:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f288a3dfb80 1 Processor -- start 2024-05-09T00:08:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f288a3dfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd0306b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f288a3dfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0302e00 0x55abd03070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f288a3dfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 0x55abd03075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f288a3dfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abd01e9560 con 0x55abd02fd890 2024-05-09T00:08:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f288a3dfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abd01e9200 con 0x55abd0302e00 2024-05-09T00:08:33.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f288a3dfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abd00d06a0 con 0x55abd0303720 2024-05-09T00:08:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f288a3dfb80 10 client.0 _ll_register_callbacks cb 0x55abd01f2b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f28777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd0306b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f28777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd0306b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59808/0 (socket says 172.21.15.81:59808) 2024-05-09T00:08:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f28777fe700 1 -- 172.21.15.81:0/3926786246 learned_addr learned my addr 172.21.15.81:0/3926786246 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f2877fff700 1 --2- 172.21.15.81:0/3926786246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 0x55abd03075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f2876ffd700 1 --2- 172.21.15.81:0/3926786246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0302e00 0x55abd03070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f28777fe700 1 -- 172.21.15.81:0/3926786246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 msgr2=0x55abd03075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f28777fe700 1 --2- 172.21.15.81:0/3926786246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 0x55abd03075e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f28777fe700 1 -- 172.21.15.81:0/3926786246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0302e00 msgr2=0x55abd03070a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f28777fe700 1 --2- 172.21.15.81:0/3926786246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0302e00 0x55abd03070a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f28777fe700 1 -- 172.21.15.81:0/3926786246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287000f040 con 0x55abd02fd890 2024-05-09T00:08:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.618+0000 7f2877fff700 1 --2- 172.21.15.81:0/3926786246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 0x55abd03075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:33.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f28777fe700 1 --2- 172.21.15.81:0/3926786246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd0306b60 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f2868010960 tx=0x7f2868004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed07356b3495b02 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f2856ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f2856ffd700 1 -- 172.21.15.81:0/3926786246 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800fa50 con 0x55abd02fd890 2024-05-09T00:08:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f2856ffd700 1 -- 172.21.15.81:0/3926786246 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f286800fbb0 con 0x55abd02fd890 2024-05-09T00:08:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f288a3dfb80 1 -- 172.21.15.81:0/3926786246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55abd02cc810 con 0x55abd02fd890 2024-05-09T00:08:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f2856ffd700 1 -- 172.21.15.81:0/3926786246 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f286800fd70 con 0x55abd02fd890 2024-05-09T00:08:33.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f288a3dfb80 10 client.17067 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f288a3dfb80 1 -- 172.21.15.81:0/3926786246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55abd007ab60 con 0x55abd02fd890 2024-05-09T00:08:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f2856ffd700 1 -- 172.21.15.81:0/3926786246 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55abd02cc810 con 0x55abd02fd890 2024-05-09T00:08:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f2856ffd700 1 -- 172.21.15.81:0/3926786246 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2868024020 con 0x55abd02fd890 2024-05-09T00:08:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f288a3dfb80 10 client.17067 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f288a3dfb80 10 client.17067 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f288a3dfb80 20 client.17067 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:33.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/3926786246 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55abd03171c0 0x55abd03195e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f288a3dfb80 4 client.17067 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:08:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.619+0000 7f288a3dfb80 1 -- 172.21.15.81:0/3926786246 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55abd0245ec0 con 0x55abd03171c0 2024-05-09T00:08:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.620+0000 7f2876ffd700 1 --2- 172.21.15.81:0/3926786246 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55abd03171c0 0x55abd03195e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.620+0000 7f2856ffd700 10 client.17067 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.620+0000 7f2876ffd700 1 --2- 172.21.15.81:0/3926786246 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55abd03171c0 0x55abd03195e0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=121099eb3790131c server_cookie=95e8fa780d863400 in_seq=0 out_seq=0 2024-05-09T00:08:33.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f2856ffd700 1 -- 172.21.15.81:0/3926786246 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55abd0245ec0 con 0x55abd03171c0 2024-05-09T00:08:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f2856ffd700 10 client.17067 handle_command_reply: tid=0 2024-05-09T00:08:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f288a3dfb80 1 client.17067 shutdown 2024-05-09T00:08:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f288a3dfb80 1 -- 172.21.15.81:0/3926786246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 msgr2=0x55abd0306b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/3926786246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd0306b60 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f2868010960 tx=0x7f2868004750 comp rx=0 tx=0).stop 2024-05-09T00:08:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f288a3dfb80 1 -- 172.21.15.81:0/3926786246 shutdown_connections 2024-05-09T00:08:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/3926786246 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55abd03171c0 0x55abd03195e0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/3926786246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 0x55abd03075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/3926786246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd0306b60 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f2856ffd700 0 client.17067 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/3926786246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0302e00 0x55abd03070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f288a3dfb80 1 -- 172.21.15.81:0/3926786246 >> 172.21.15.81:0/3926786246 conn(0x55abd025b210 msgr2=0x55abd02f75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f288a3dfb80 1 -- 172.21.15.81:0/3926786246 shutdown_connections 2024-05-09T00:08:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f288a3dfb80 1 -- 172.21.15.81:0/3926786246 wait complete. 2024-05-09T00:08:33.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.621+0000 7f288a3dfb80 20 client.17067 trim_cache size 0 max 16384 2024-05-09T00:08:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.638+0000 7f288a3dfb80 1 Processor -- start 2024-05-09T00:08:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.638+0000 7f288a3dfb80 1 -- start start 2024-05-09T00:08:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.638+0000 7f288a3dfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd02fd890 0x55abd02fd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.638+0000 7f288a3dfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd0302e00 0x55abd0302310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.638+0000 7f288a3dfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 0x55abd02f7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.638+0000 7f288a3dfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abd02f4dc0 con 0x55abd0302e00 2024-05-09T00:08:33.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.638+0000 7f288a3dfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abd0303560 con 0x55abd02fd890 2024-05-09T00:08:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.638+0000 7f288a3dfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abd031e7d0 con 0x55abd0303720 2024-05-09T00:08:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.638+0000 7f2876ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd0302e00 0x55abd0302310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.638+0000 7f2876ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd0302e00 0x55abd0302310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59812/0 (socket says 172.21.15.81:59812) 2024-05-09T00:08:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.638+0000 7f2876ffd700 1 -- 172.21.15.81:0/2862679550 learned_addr learned my addr 172.21.15.81:0/2862679550 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.639+0000 7f28777fe700 1 --2- 172.21.15.81:0/2862679550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd02fd890 0x55abd02fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.639+0000 7f2877fff700 1 --2- 172.21.15.81:0/2862679550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 0x55abd02f7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.639+0000 7f2876ffd700 1 -- 172.21.15.81:0/2862679550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 msgr2=0x55abd02f7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.639+0000 7f2876ffd700 1 --2- 172.21.15.81:0/2862679550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 0x55abd02f7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.639+0000 7f2876ffd700 1 -- 172.21.15.81:0/2862679550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd02fd890 msgr2=0x55abd02fd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.639+0000 7f2876ffd700 1 --2- 172.21.15.81:0/2862679550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd02fd890 0x55abd02fd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.639+0000 7f2876ffd700 1 -- 172.21.15.81:0/2862679550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abd0213560 con 0x55abd0302e00 2024-05-09T00:08:33.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.639+0000 7f2876ffd700 1 --2- 172.21.15.81:0/2862679550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd0302e00 0x55abd0302310 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f286c097a00 tx=0x7f286c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6184644c6f998e3d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.639+0000 7f285e7fc700 1 -- 172.21.15.81:0/2862679550 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c09f330 con 0x55abd0302e00 2024-05-09T00:08:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.639+0000 7f285e7fc700 1 -- 172.21.15.81:0/2862679550 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f286c0a38f0 con 0x55abd0302e00 2024-05-09T00:08:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.639+0000 7f285e7fc700 1 -- 172.21.15.81:0/2862679550 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c0860b0 con 0x55abd0302e00 2024-05-09T00:08:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2862679550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd0302e00 msgr2=0x55abd0302310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/2862679550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd0302e00 0x55abd0302310 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f286c097a00 tx=0x7f286c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2862679550 shutdown_connections 2024-05-09T00:08:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/2862679550 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd02fd890 0x55abd02fd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/2862679550 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0303720 0x55abd02f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/2862679550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd0302e00 0x55abd0302310 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2862679550 >> 172.21.15.81:0/2862679550 conn(0x55abd025b210 msgr2=0x55abd0301c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2862679550 shutdown_connections 2024-05-09T00:08:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2862679550 wait complete. 2024-05-09T00:08:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 -- start start 2024-05-09T00:08:33.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 Processor -- start 2024-05-09T00:08:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd030a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0302e00 0x55abd030aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0303720 0x55abd0365650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abd0365c50 con 0x55abd02fd890 2024-05-09T00:08:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abd0365dc0 con 0x55abd0303720 2024-05-09T00:08:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.640+0000 7f288a3dfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abd0365f80 con 0x55abd0302e00 2024-05-09T00:08:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f288a3dfb80 10 client.0 _ll_register_callbacks cb 0x55abd01f2b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f28777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd030a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f28777fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd030a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59824/0 (socket says 172.21.15.81:59824) 2024-05-09T00:08:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f28777fe700 1 -- 172.21.15.81:0/2269041750 learned_addr learned my addr 172.21.15.81:0/2269041750 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f2877fff700 1 --2- 172.21.15.81:0/2269041750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0303720 0x55abd0365650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f2876ffd700 1 --2- 172.21.15.81:0/2269041750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0302e00 0x55abd030aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f28777fe700 1 -- 172.21.15.81:0/2269041750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0302e00 msgr2=0x55abd030aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f28777fe700 1 --2- 172.21.15.81:0/2269041750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0302e00 0x55abd030aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f28777fe700 1 -- 172.21.15.81:0/2269041750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0303720 msgr2=0x55abd0365650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f28777fe700 1 --2- 172.21.15.81:0/2269041750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0303720 0x55abd0365650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f28777fe700 1 -- 172.21.15.81:0/2269041750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28781a63b0 con 0x55abd02fd890 2024-05-09T00:08:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f28777fe700 1 --2- 172.21.15.81:0/2269041750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd030a660 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f286801e4c0 tx=0x7f2868004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1481fe5ff2befe70 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f2856ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f2856ffd700 1 -- 172.21.15.81:0/2269041750 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868034070 con 0x55abd02fd890 2024-05-09T00:08:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f2856ffd700 1 -- 172.21.15.81:0/2269041750 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f286801e830 con 0x55abd02fd890 2024-05-09T00:08:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2269041750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55abd01a6270 con 0x55abd02fd890 2024-05-09T00:08:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f2856ffd700 1 -- 172.21.15.81:0/2269041750 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f286800aee0 con 0x55abd02fd890 2024-05-09T00:08:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f288a3dfb80 10 client.17073 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2269041750 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55abd00d2cd0 con 0x55abd02fd890 2024-05-09T00:08:33.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.641+0000 7f2856ffd700 1 -- 172.21.15.81:0/2269041750 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2868045080 con 0x55abd02fd890 2024-05-09T00:08:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.642+0000 7f2856ffd700 1 -- 172.21.15.81:0/2269041750 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f286803f030 con 0x55abd02fd890 2024-05-09T00:08:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.642+0000 7f288a3dfb80 10 client.17073 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.642+0000 7f288a3dfb80 10 client.17073 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.642+0000 7f288a3dfb80 20 client.17073 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.642+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/2269041750 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55abd036e950 0x55abd0370d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.642+0000 7f288a3dfb80 4 client.17073 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:08:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.642+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2269041750 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55abd009bcf0 con 0x55abd036e950 2024-05-09T00:08:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.642+0000 7f2876ffd700 1 --2- 172.21.15.81:0/2269041750 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55abd036e950 0x55abd0370d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.642+0000 7f2876ffd700 1 --2- 172.21.15.81:0/2269041750 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55abd036e950 0x55abd0370d70 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a6a7eb801a322b6 server_cookie=6a55a60f10bd62a7 in_seq=0 out_seq=0 2024-05-09T00:08:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.642+0000 7f2856ffd700 10 client.17073 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.642+0000 7f2856ffd700 1 -- 172.21.15.81:0/2269041750 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55abd009bcf0 con 0x55abd036e950 2024-05-09T00:08:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.642+0000 7f2856ffd700 10 client.17073 handle_command_reply: tid=0 2024-05-09T00:08:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.642+0000 7f288a3dfb80 1 client.17073 shutdown 2024-05-09T00:08:33.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2269041750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 msgr2=0x55abd030a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/2269041750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd030a660 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f286801e4c0 tx=0x7f2868004b10 comp rx=0 tx=0).stop 2024-05-09T00:08:33.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2269041750 shutdown_connections 2024-05-09T00:08:33.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/2269041750 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55abd036e950 0x55abd0370d70 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/2269041750 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55abd0303720 0x55abd0365650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/2269041750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55abd02fd890 0x55abd030a660 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f2856ffd700 0 client.17073 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:33.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f288a3dfb80 1 --2- 172.21.15.81:0/2269041750 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55abd0302e00 0x55abd030aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2269041750 >> 172.21.15.81:0/2269041750 conn(0x55abd025b210 msgr2=0x55abd0307440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:33.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2269041750 shutdown_connections 2024-05-09T00:08:33.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f288a3dfb80 1 -- 172.21.15.81:0/2269041750 wait complete. 2024-05-09T00:08:33.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f288a3dfb80 20 client.17073 trim_cache size 0 max 16384 2024-05-09T00:08:33.646 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:08:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:08:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:08:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: "ab8fe0b1-1606-48d2-877f-9d9029169890": { 2024-05-09T00:08:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:08:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "ab8fe0b1-1606-48d2-877f-9d9029169890", 2024-05-09T00:08:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:08:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:08:33.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:08:33.646 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:08:33.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f287e225700 1 -- 172.21.15.81:0/3147201285 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28600a1310 msgr2=0x7f28600a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f287e225700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28600a1310 0x7f28600a37d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2868005fd0 tx=0x7f2868005e30 comp rx=0 tx=0).stop 2024-05-09T00:08:33.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f287e225700 1 -- 172.21.15.81:0/3147201285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2878106280 msgr2=0x7f28780737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f287e225700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2878106280 0x7f28780737e0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f286c0059d0 tx=0x7f286c00f460 comp rx=0 tx=0).stop 2024-05-09T00:08:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f287e225700 1 -- 172.21.15.81:0/3147201285 shutdown_connections 2024-05-09T00:08:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f287e225700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28600a1310 0x7f28600a37d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f287e225700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2878073d20 0x7f28781a54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f287e225700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2878101160 0x7f28780732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f287e225700 1 --2- 172.21.15.81:0/3147201285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2878106280 0x7f28780737e0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f287e225700 1 -- 172.21.15.81:0/3147201285 >> 172.21.15.81:0/3147201285 conn(0x7f28780fc9c0 msgr2=0x7f28780fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f287e225700 1 -- 172.21.15.81:0/3147201285 shutdown_connections 2024-05-09T00:08:33.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:08:33.643+0000 7f287e225700 1 -- 172.21.15.81:0/3147201285 wait complete. 2024-05-09T00:08:33.651 INFO:tasks.cephfs.filesystem:scrub status for tag:ab8fe0b1-1606-48d2-877f-9d9029169890 - {'path': '/', 'tag': 'ab8fe0b1-1606-48d2-877f-9d9029169890', 'options': 'recursive,force'} 2024-05-09T00:08:34.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:34 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:08:34.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:34 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:08:34.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:34 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:08:34.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:34 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:08:34.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:34 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:08:34.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:34 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:08:34.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:34 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:08:34.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:34 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:08:34.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:34 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:08:34.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:34 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:08:34.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:34 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:08:34.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:34 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:08:35.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:35 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:08:35.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:35 smithi171 ceph-mon[47351]: pgmap v172: 97 pgs: 97 active+clean; 3.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 18 op/s 2024-05-09T00:08:35.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:35 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:08:35.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:35 smithi081 ceph-mon[42474]: pgmap v172: 97 pgs: 97 active+clean; 3.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 18 op/s 2024-05-09T00:08:35.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:35 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:08:35.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:35 smithi150 ceph-mon[46187]: pgmap v172: 97 pgs: 97 active+clean; 3.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 54 KiB/s wr, 18 op/s 2024-05-09T00:08:37.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:37 smithi171 ceph-mon[47351]: pgmap v173: 97 pgs: 97 active+clean; 3.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-05-09T00:08:37.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:37 smithi081 ceph-mon[42474]: pgmap v173: 97 pgs: 97 active+clean; 3.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-05-09T00:08:37.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:37 smithi150 ceph-mon[46187]: pgmap v173: 97 pgs: 97 active+clean; 3.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-05-09T00:08:40.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:40 smithi171 ceph-mon[47351]: pgmap v174: 97 pgs: 97 active+clean; 3.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-05-09T00:08:40.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:40 smithi081 ceph-mon[42474]: pgmap v174: 97 pgs: 97 active+clean; 3.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-05-09T00:08:40.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:40 smithi150 ceph-mon[46187]: pgmap v174: 97 pgs: 97 active+clean; 3.6 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 37 KiB/s wr, 13 op/s 2024-05-09T00:08:40.954 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.955+0000 7f8ad06bd700 1 -- 172.21.15.81:0/1228454303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac8105e60 msgr2=0x7f8ac8106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:40.954 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.955+0000 7f8ad06bd700 1 --2- 172.21.15.81:0/1228454303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac8105e60 0x7f8ac8106240 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009990 tx=0x7f8ab8009ca0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.954 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.955+0000 7f8ad06bd700 1 -- 172.21.15.81:0/1228454303 shutdown_connections 2024-05-09T00:08:40.954 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.955+0000 7f8ad06bd700 1 --2- 172.21.15.81:0/1228454303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac8100760 0x7f8ac810cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.954 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.955+0000 7f8ad06bd700 1 --2- 172.21.15.81:0/1228454303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac8105e60 0x7f8ac8106240 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.954 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.955+0000 7f8ad06bd700 1 --2- 172.21.15.81:0/1228454303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac80ffda0 0x7f8ac8100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.954 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.955+0000 7f8ad06bd700 1 -- 172.21.15.81:0/1228454303 >> 172.21.15.81:0/1228454303 conn(0x7f8ac8076f10 msgr2=0x7f8ac8077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:40.954 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.955+0000 7f8ad06bd700 1 -- 172.21.15.81:0/1228454303 shutdown_connections 2024-05-09T00:08:40.954 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.955+0000 7f8ad06bd700 1 -- 172.21.15.81:0/1228454303 wait complete. 2024-05-09T00:08:40.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ad06bd700 1 Processor -- start 2024-05-09T00:08:40.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ad06bd700 1 -- start start 2024-05-09T00:08:40.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ad06bd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac80ffda0 0x7f8ac8197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ad06bd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac8100760 0x7f8ac81977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ad06bd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac8105e60 0x7f8ac819bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ad06bd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac819c1a0 con 0x7f8ac80ffda0 2024-05-09T00:08:40.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ad06bd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac819c310 con 0x7f8ac8100760 2024-05-09T00:08:40.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ad06bd700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac819c4d0 con 0x7f8ac8105e60 2024-05-09T00:08:40.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ace459700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac80ffda0 0x7f8ac8197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ace459700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac80ffda0 0x7f8ac8197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45516/0 (socket says 172.21.15.81:45516) 2024-05-09T00:08:40.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ace459700 1 -- 172.21.15.81:0/184920128 learned_addr learned my addr 172.21.15.81:0/184920128 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:40.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8acdc58700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac8100760 0x7f8ac81977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8acec5a700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac8105e60 0x7f8ac819bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ace459700 1 -- 172.21.15.81:0/184920128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac8105e60 msgr2=0x7f8ac819bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:40.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ace459700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac8105e60 0x7f8ac819bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ace459700 1 -- 172.21.15.81:0/184920128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac8100760 msgr2=0x7f8ac81977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:40.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ace459700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac8100760 0x7f8ac81977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ace459700 1 -- 172.21.15.81:0/184920128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab80095f0 con 0x7f8ac80ffda0 2024-05-09T00:08:40.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8acec5a700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac8105e60 0x7f8ac819bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:40.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.956+0000 7f8ace459700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac80ffda0 0x7f8ac8197280 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80098e0 tx=0x7f8ab800f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:40.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.957+0000 7f8abf7fe700 1 -- 172.21.15.81:0/184920128 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab801d070 con 0x7f8ac80ffda0 2024-05-09T00:08:40.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.957+0000 7f8abf7fe700 1 -- 172.21.15.81:0/184920128 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ab8022470 con 0x7f8ac80ffda0 2024-05-09T00:08:40.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.957+0000 7f8ad06bd700 1 -- 172.21.15.81:0/184920128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac819c750 con 0x7f8ac80ffda0 2024-05-09T00:08:40.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.957+0000 7f8abf7fe700 1 -- 172.21.15.81:0/184920128 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab8017650 con 0x7f8ac80ffda0 2024-05-09T00:08:40.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.957+0000 7f8ad06bd700 1 -- 172.21.15.81:0/184920128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac81a3ff0 con 0x7f8ac80ffda0 2024-05-09T00:08:40.963 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.959+0000 7f8abf7fe700 1 -- 172.21.15.81:0/184920128 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f8ab80225e0 con 0x7f8ac80ffda0 2024-05-09T00:08:40.963 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.959+0000 7f8abf7fe700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8ab40a1290 0x7f8ab40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.963 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.959+0000 7f8abf7fe700 1 -- 172.21.15.81:0/184920128 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f8ab80cdd60 con 0x7f8ac80ffda0 2024-05-09T00:08:40.963 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.959+0000 7f8acdc58700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8ab40a1290 0x7f8ab40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.963 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.960+0000 7f8acdc58700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8ab40a1290 0x7f8ab40a3750 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ac81987d0 tx=0x7f8ac400b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:40.963 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.960+0000 7f8adc877b80 1 Processor -- start 2024-05-09T00:08:40.963 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8adc877b80 1 -- start start 2024-05-09T00:08:40.963 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8adc877b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f747e950 0x5567f747ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.963 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8adc877b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747f270 0x5567f7478f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.963 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8adc877b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f7479480 0x5567f74798a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8adc877b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567f73d00f0 con 0x5567f747e950 2024-05-09T00:08:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8adc877b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567f73cdab0 con 0x5567f7479480 2024-05-09T00:08:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8adc877b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567f73c93a0 con 0x5567f747f270 2024-05-09T00:08:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8ace459700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f747e950 0x5567f747ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8ace459700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f747e950 0x5567f747ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45524/0 (socket says 172.21.15.81:45524) 2024-05-09T00:08:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8ace459700 1 -- 172.21.15.81:0/1542883817 learned_addr learned my addr 172.21.15.81:0/1542883817 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8acdc58700 1 --2- 172.21.15.81:0/1542883817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747f270 0x5567f7478f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8acec5a700 1 --2- 172.21.15.81:0/1542883817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f7479480 0x5567f74798a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8ace459700 1 -- 172.21.15.81:0/1542883817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747f270 msgr2=0x5567f7478f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8ace459700 1 --2- 172.21.15.81:0/1542883817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747f270 0x5567f7478f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8ace459700 1 -- 172.21.15.81:0/1542883817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f7479480 msgr2=0x5567f74798a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8ace459700 1 --2- 172.21.15.81:0/1542883817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f7479480 0x5567f74798a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8ace459700 1 -- 172.21.15.81:0/1542883817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567f724a350 con 0x5567f747e950 2024-05-09T00:08:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8acec5a700 1 --2- 172.21.15.81:0/1542883817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f7479480 0x5567f74798a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:08:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8ace459700 1 --2- 172.21.15.81:0/1542883817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f747e950 0x5567f747ed30 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8097970 tx=0x7f8ab809ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3752217d84e1a2d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8abcff9700 1 -- 172.21.15.81:0/1542883817 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab809ed30 con 0x5567f747e950 2024-05-09T00:08:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8abcff9700 1 -- 172.21.15.81:0/1542883817 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ab80a32f0 con 0x5567f747e950 2024-05-09T00:08:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.961+0000 7f8abcff9700 1 -- 172.21.15.81:0/1542883817 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab809b430 con 0x5567f747e950 2024-05-09T00:08:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.962+0000 7f8adc877b80 1 -- 172.21.15.81:0/1542883817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f747e950 msgr2=0x5567f747ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.962+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1542883817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f747e950 0x5567f747ed30 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8097970 tx=0x7f8ab809ae00 comp rx=0 tx=0).stop 2024-05-09T00:08:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.962+0000 7f8adc877b80 1 -- 172.21.15.81:0/1542883817 shutdown_connections 2024-05-09T00:08:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.962+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1542883817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f7479480 0x5567f74798a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.962+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1542883817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f747e950 0x5567f747ed30 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.962+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1542883817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747f270 0x5567f7478f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.962+0000 7f8adc877b80 1 -- 172.21.15.81:0/1542883817 >> 172.21.15.81:0/1542883817 conn(0x5567f73d71b0 msgr2=0x5567f7473840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.962+0000 7f8adc877b80 1 -- 172.21.15.81:0/1542883817 shutdown_connections 2024-05-09T00:08:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.962+0000 7f8adc877b80 1 -- 172.21.15.81:0/1542883817 wait complete. 2024-05-09T00:08:40.965 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8adc877b80 1 -- start start 2024-05-09T00:08:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8adc877b80 1 Processor -- start 2024-05-09T00:08:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8adc877b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f7479480 0x5567f7485230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8adc877b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747e950 0x5567f7482520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8adc877b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f747f270 0x5567f7482c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8adc877b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567f7365500 con 0x5567f7479480 2024-05-09T00:08:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8adc877b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567f73651a0 con 0x5567f747f270 2024-05-09T00:08:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8adc877b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567f724c640 con 0x5567f747e950 2024-05-09T00:08:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8adc877b80 10 client.0 _ll_register_callbacks cb 0x5567f736ead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8ace459700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f7479480 0x5567f7485230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8ace459700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f7479480 0x5567f7485230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45540/0 (socket says 172.21.15.81:45540) 2024-05-09T00:08:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8ace459700 1 -- 172.21.15.81:0/1362426821 learned_addr learned my addr 172.21.15.81:0/1362426821 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8acdc58700 1 --2- 172.21.15.81:0/1362426821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747e950 0x5567f7482520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8acec5a700 1 --2- 172.21.15.81:0/1362426821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f747f270 0x5567f7482c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8ace459700 1 -- 172.21.15.81:0/1362426821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747e950 msgr2=0x5567f7482520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8ace459700 1 --2- 172.21.15.81:0/1362426821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747e950 0x5567f7482520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8ace459700 1 -- 172.21.15.81:0/1362426821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f747f270 msgr2=0x5567f7482c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8ace459700 1 --2- 172.21.15.81:0/1362426821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f747f270 0x5567f7482c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.963+0000 7f8ace459700 1 -- 172.21.15.81:0/1362426821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac81a3ff0 con 0x5567f7479480 2024-05-09T00:08:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8ace459700 1 --2- 172.21.15.81:0/1362426821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f7479480 0x5567f7485230 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80095c0 tx=0x7f8ab809a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c3d188ead7164f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8ab1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8ab1ffb700 1 -- 172.21.15.81:0/1362426821 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab809ed30 con 0x5567f7479480 2024-05-09T00:08:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8ab1ffb700 1 -- 172.21.15.81:0/1362426821 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f8ab809b370 con 0x5567f7479480 2024-05-09T00:08:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8adc877b80 1 -- 172.21.15.81:0/1362426821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5567f7322210 con 0x5567f7479480 2024-05-09T00:08:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8ab1ffb700 1 -- 172.21.15.81:0/1362426821 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ab80a2e60 con 0x5567f7479480 2024-05-09T00:08:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8adc877b80 10 client.17085 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:40.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8adc877b80 1 -- 172.21.15.81:0/1362426821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5567f71f6b00 con 0x5567f7479480 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8ab1ffb700 1 -- 172.21.15.81:0/1362426821 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5567f7322210 con 0x5567f7479480 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8ab1ffb700 1 -- 172.21.15.81:0/1362426821 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8ab8096cf0 con 0x5567f7479480 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8adc877b80 10 client.17085 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8adc877b80 10 client.17085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8adc877b80 20 client.17085 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1362426821 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5567f7492340 0x5567f7494760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8adc877b80 4 client.17085 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.964+0000 7f8adc877b80 1 -- 172.21.15.81:0/1362426821 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5567f74487b0 con 0x5567f7492340 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.965+0000 7f8acdc58700 1 --2- 172.21.15.81:0/1362426821 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5567f7492340 0x5567f7494760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.965+0000 7f8acdc58700 1 --2- 172.21.15.81:0/1362426821 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5567f7492340 0x5567f7494760 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70217ff00e2886a3 server_cookie=213524d7cb379227 in_seq=0 out_seq=0 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.965+0000 7f8ab1ffb700 10 client.17085 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8ab1ffb700 1 -- 172.21.15.81:0/1362426821 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5567f74487b0 con 0x5567f7492340 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8ab1ffb700 10 client.17085 handle_command_reply: tid=0 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8adc877b80 1 client.17085 shutdown 2024-05-09T00:08:40.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8adc877b80 1 -- 172.21.15.81:0/1362426821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f7479480 msgr2=0x5567f7485230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:40.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1362426821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f7479480 0x5567f7485230 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80095c0 tx=0x7f8ab809a6d0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8adc877b80 1 -- 172.21.15.81:0/1362426821 shutdown_connections 2024-05-09T00:08:40.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1362426821 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5567f7492340 0x5567f7494760 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1362426821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f747f270 0x5567f7482c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1362426821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f7479480 0x5567f7485230 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8ab1ffb700 0 client.17085 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:40.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1362426821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747e950 0x5567f7482520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8adc877b80 1 -- 172.21.15.81:0/1362426821 >> 172.21.15.81:0/1362426821 conn(0x5567f73d71b0 msgr2=0x5567f7477f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:40.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8adc877b80 1 -- 172.21.15.81:0/1362426821 shutdown_connections 2024-05-09T00:08:40.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8adc877b80 1 -- 172.21.15.81:0/1362426821 wait complete. 2024-05-09T00:08:40.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.966+0000 7f8adc877b80 20 client.17085 trim_cache size 0 max 16384 2024-05-09T00:08:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8adc877b80 1 Processor -- start 2024-05-09T00:08:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8adc877b80 1 -- start start 2024-05-09T00:08:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8adc877b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f7479480 0x5567f7482bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8adc877b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747e950 0x5567f74824c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8adc877b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f747f270 0x5567f7473910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8adc877b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567f746bba0 con 0x5567f747f270 2024-05-09T00:08:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8adc877b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567f7499970 con 0x5567f7479480 2024-05-09T00:08:40.982 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8adc877b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567f747d160 con 0x5567f747e950 2024-05-09T00:08:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8acec5a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f747f270 0x5567f7473910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8acec5a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f747f270 0x5567f7473910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45546/0 (socket says 172.21.15.81:45546) 2024-05-09T00:08:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8acec5a700 1 -- 172.21.15.81:0/3253927202 learned_addr learned my addr 172.21.15.81:0/3253927202 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8acdc58700 1 --2- 172.21.15.81:0/3253927202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747e950 0x5567f74824c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8ace459700 1 --2- 172.21.15.81:0/3253927202 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f7479480 0x5567f7482bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8acec5a700 1 -- 172.21.15.81:0/3253927202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747e950 msgr2=0x5567f74824c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8acec5a700 1 --2- 172.21.15.81:0/3253927202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747e950 0x5567f74824c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8acec5a700 1 -- 172.21.15.81:0/3253927202 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f7479480 msgr2=0x5567f7482bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8acec5a700 1 --2- 172.21.15.81:0/3253927202 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f7479480 0x5567f7482bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.981+0000 7f8acec5a700 1 -- 172.21.15.81:0/3253927202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5567f738f500 con 0x5567f747f270 2024-05-09T00:08:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.982+0000 7f8acec5a700 1 --2- 172.21.15.81:0/3253927202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f747f270 0x5567f7473910 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009c50 tx=0x7f8ac0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2592151a9f5772 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.982+0000 7f8abd7fa700 1 -- 172.21.15.81:0/3253927202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac000e070 con 0x5567f747f270 2024-05-09T00:08:40.983 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.982+0000 7f8abd7fa700 1 -- 172.21.15.81:0/3253927202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ac0004bb0 con 0x5567f747f270 2024-05-09T00:08:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.982+0000 7f8abd7fa700 1 -- 172.21.15.81:0/3253927202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00055c0 con 0x5567f747f270 2024-05-09T00:08:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.982+0000 7f8adc877b80 1 -- 172.21.15.81:0/3253927202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f747f270 msgr2=0x5567f7473910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.982+0000 7f8adc877b80 1 --2- 172.21.15.81:0/3253927202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f747f270 0x5567f7473910 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f8ac0009c50 tx=0x7f8ac0009040 comp rx=0 tx=0).stop 2024-05-09T00:08:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.982+0000 7f8adc877b80 1 -- 172.21.15.81:0/3253927202 shutdown_connections 2024-05-09T00:08:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.982+0000 7f8adc877b80 1 --2- 172.21.15.81:0/3253927202 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f7479480 0x5567f7482bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.982+0000 7f8adc877b80 1 --2- 172.21.15.81:0/3253927202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f747f270 0x5567f7473910 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.982+0000 7f8adc877b80 1 --2- 172.21.15.81:0/3253927202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747e950 0x5567f74824c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.982+0000 7f8adc877b80 1 -- 172.21.15.81:0/3253927202 >> 172.21.15.81:0/3253927202 conn(0x5567f73d71b0 msgr2=0x5567f7481db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.982+0000 7f8adc877b80 1 -- 172.21.15.81:0/3253927202 shutdown_connections 2024-05-09T00:08:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.982+0000 7f8adc877b80 1 -- 172.21.15.81:0/3253927202 wait complete. 2024-05-09T00:08:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8adc877b80 1 -- start start 2024-05-09T00:08:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8adc877b80 1 Processor -- start 2024-05-09T00:08:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8adc877b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f7479480 0x5567f7487bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.984 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8adc877b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f747e950 0x5567f7488100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8adc877b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747f270 0x5567f74ebc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8adc877b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567f74ec190 con 0x5567f7479480 2024-05-09T00:08:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8adc877b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567f74ec2d0 con 0x5567f747e950 2024-05-09T00:08:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8adc877b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5567f74ec410 con 0x5567f747f270 2024-05-09T00:08:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8adc877b80 10 client.0 _ll_register_callbacks cb 0x5567f736ead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8ace459700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f7479480 0x5567f7487bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8ace459700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f7479480 0x5567f7487bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45554/0 (socket says 172.21.15.81:45554) 2024-05-09T00:08:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8ace459700 1 -- 172.21.15.81:0/1812415393 learned_addr learned my addr 172.21.15.81:0/1812415393 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8acdc58700 1 --2- 172.21.15.81:0/1812415393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f747e950 0x5567f7488100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8acec5a700 1 --2- 172.21.15.81:0/1812415393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747f270 0x5567f74ebc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8ace459700 1 -- 172.21.15.81:0/1812415393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747f270 msgr2=0x5567f74ebc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8ace459700 1 --2- 172.21.15.81:0/1812415393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747f270 0x5567f74ebc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8ace459700 1 -- 172.21.15.81:0/1812415393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f747e950 msgr2=0x5567f7488100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:40.985 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8ace459700 1 --2- 172.21.15.81:0/1812415393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f747e950 0x5567f7488100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.983+0000 7f8ace459700 1 -- 172.21.15.81:0/1812415393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac0011040 con 0x5567f7479480 2024-05-09T00:08:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8ace459700 1 --2- 172.21.15.81:0/1812415393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f7479480 0x5567f7487bc0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8022890 tx=0x7f8ab809ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b14a4f76468dc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8ab1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8ab1ffb700 1 -- 172.21.15.81:0/1812415393 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab809ed30 con 0x5567f7479480 2024-05-09T00:08:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8ab1ffb700 1 -- 172.21.15.81:0/1812415393 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f8ab80a2e60 con 0x5567f7479480 2024-05-09T00:08:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8adc877b80 1 -- 172.21.15.81:0/1812415393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ab80a32f0 con 0x5567f7479480 2024-05-09T00:08:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8ab1ffb700 1 -- 172.21.15.81:0/1812415393 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ab80a3020 con 0x5567f7479480 2024-05-09T00:08:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8adc877b80 10 client.17091 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8adc877b80 1 -- 172.21.15.81:0/1812415393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5567f724ec70 con 0x5567f7479480 2024-05-09T00:08:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8ab1ffb700 1 -- 172.21.15.81:0/1812415393 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ab80a7080 con 0x5567f7479480 2024-05-09T00:08:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8ab1ffb700 1 -- 172.21.15.81:0/1812415393 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8ab8099ef0 con 0x5567f7479480 2024-05-09T00:08:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8adc877b80 10 client.17091 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8adc877b80 10 client.17091 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:40.986 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8adc877b80 20 client.17091 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1812415393 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5567f74ed6c0 0x5567f74efab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8adc877b80 4 client.17091 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:08:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.984+0000 7f8adc877b80 1 -- 172.21.15.81:0/1812415393 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5567f73c1e60 con 0x5567f74ed6c0 2024-05-09T00:08:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.985+0000 7f8acdc58700 1 --2- 172.21.15.81:0/1812415393 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5567f74ed6c0 0x5567f74efab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.985+0000 7f8ab1ffb700 10 client.17091 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:40.987 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.985+0000 7f8acdc58700 1 --2- 172.21.15.81:0/1812415393 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5567f74ed6c0 0x5567f74efab0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b59d0ce95d03ff7a server_cookie=faa8b3f1c8dcad34 in_seq=0 out_seq=0 2024-05-09T00:08:40.995 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.998+0000 7f8ab1ffb700 1 -- 172.21.15.81:0/1812415393 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5567f73c1e60 con 0x5567f74ed6c0 2024-05-09T00:08:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.998+0000 7f8ab1ffb700 10 client.17091 handle_command_reply: tid=0 2024-05-09T00:08:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.998+0000 7f8adc877b80 1 client.17091 shutdown 2024-05-09T00:08:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.998+0000 7f8adc877b80 1 -- 172.21.15.81:0/1812415393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f7479480 msgr2=0x5567f7487bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.998+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1812415393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f7479480 0x5567f7487bc0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8022890 tx=0x7f8ab809ae00 comp rx=0 tx=0).stop 2024-05-09T00:08:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8adc877b80 1 -- 172.21.15.81:0/1812415393 shutdown_connections 2024-05-09T00:08:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1812415393 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5567f74ed6c0 0x5567f74efab0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1812415393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5567f747f270 0x5567f74ebc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1812415393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5567f7479480 0x5567f7487bc0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8ab1ffb700 0 client.17091 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8adc877b80 1 --2- 172.21.15.81:0/1812415393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5567f747e950 0x5567f7488100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.996 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8adc877b80 1 -- 172.21.15.81:0/1812415393 >> 172.21.15.81:0/1812415393 conn(0x5567f73d71b0 msgr2=0x5567f747c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8adc877b80 1 -- 172.21.15.81:0/1812415393 shutdown_connections 2024-05-09T00:08:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8adc877b80 1 -- 172.21.15.81:0/1812415393 wait complete. 2024-05-09T00:08:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8adc877b80 20 client.17091 trim_cache size 0 max 16384 2024-05-09T00:08:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:08:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:08:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:08:40.997 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:08:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8ad06bd700 1 -- 172.21.15.81:0/184920128 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8ab40a1290 msgr2=0x7f8ab40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8ad06bd700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8ab40a1290 0x7f8ab40a3750 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8ac81987d0 tx=0x7f8ac400b410 comp rx=0 tx=0).stop 2024-05-09T00:08:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8ad06bd700 1 -- 172.21.15.81:0/184920128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac80ffda0 msgr2=0x7f8ac8197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8ad06bd700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac80ffda0 0x7f8ac8197280 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80098e0 tx=0x7f8ab800f670 comp rx=0 tx=0).stop 2024-05-09T00:08:40.998 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8ad06bd700 1 -- 172.21.15.81:0/184920128 shutdown_connections 2024-05-09T00:08:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8ad06bd700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8ab40a1290 0x7f8ab40a3750 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8ad06bd700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8ac8105e60 0x7f8ac819bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8ad06bd700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ac80ffda0 0x7f8ac8197280 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8ad06bd700 1 --2- 172.21.15.81:0/184920128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8ac8100760 0x7f8ac81977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8ad06bd700 1 -- 172.21.15.81:0/184920128 >> 172.21.15.81:0/184920128 conn(0x7f8ac8076f10 msgr2=0x7f8ac8068450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8ad06bd700 1 -- 172.21.15.81:0/184920128 shutdown_connections 2024-05-09T00:08:40.999 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:40.999+0000 7f8ad06bd700 1 -- 172.21.15.81:0/184920128 wait complete. 2024-05-09T00:08:42.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:42 smithi171 ceph-mon[47351]: pgmap v175: 97 pgs: 97 active+clean; 3.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-05-09T00:08:42.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:42 smithi081 ceph-mon[42474]: pgmap v175: 97 pgs: 97 active+clean; 3.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-05-09T00:08:42.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:42 smithi150 ceph-mon[46187]: pgmap v175: 97 pgs: 97 active+clean; 3.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-05-09T00:08:44.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:44 smithi171 ceph-mon[47351]: pgmap v176: 97 pgs: 97 active+clean; 3.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 11 op/s 2024-05-09T00:08:44.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:44 smithi081 ceph-mon[42474]: pgmap v176: 97 pgs: 97 active+clean; 3.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 11 op/s 2024-05-09T00:08:44.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:44 smithi150 ceph-mon[46187]: pgmap v176: 97 pgs: 97 active+clean; 3.7 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 30 KiB/s wr, 11 op/s 2024-05-09T00:08:46.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:46 smithi171 ceph-mon[47351]: pgmap v177: 97 pgs: 97 active+clean; 3.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 51 KiB/s wr, 18 op/s 2024-05-09T00:08:46.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:46 smithi081 ceph-mon[42474]: pgmap v177: 97 pgs: 97 active+clean; 3.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 51 KiB/s wr, 18 op/s 2024-05-09T00:08:46.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:46 smithi150 ceph-mon[46187]: pgmap v177: 97 pgs: 97 active+clean; 3.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 51 KiB/s wr, 18 op/s 2024-05-09T00:08:47.377 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.378 INFO:tasks.workunit.client.0.smithi081.stdout:189/600: open fd = 3 2024-05-09T00:08:47.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.378 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.378 INFO:tasks.workunit.client.0.smithi081.stdout:190/600: open fd = 3 2024-05-09T00:08:47.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.378 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.378 INFO:tasks.workunit.client.0.smithi081.stdout:191/600: open fd = 3 2024-05-09T00:08:47.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:192/600: open fd = 3 2024-05-09T00:08:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:193/600: open fd = 3 2024-05-09T00:08:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:194/600: open fd = 3 2024-05-09T00:08:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.379 INFO:tasks.workunit.client.0.smithi081.stdout:195/600: open fd = 3 2024-05-09T00:08:47.380 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.380 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.380 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.380 INFO:tasks.workunit.client.0.smithi081.stdout:196/600: open fd = 3 2024-05-09T00:08:47.380 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.380 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.380 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.380 INFO:tasks.workunit.client.0.smithi081.stdout:197/600: open fd = 3 2024-05-09T00:08:47.380 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.380 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.380 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.380 INFO:tasks.workunit.client.0.smithi081.stdout:198/600: open fd = 3 2024-05-09T00:08:47.380 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:199/600: open fd = 3 2024-05-09T00:08:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:200/600: open fd = 3 2024-05-09T00:08:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:201/600: open fd = 3 2024-05-09T00:08:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.381 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.382 INFO:tasks.workunit.client.0.smithi081.stdout:202/600: open fd = 3 2024-05-09T00:08:47.382 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.382 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.382 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.382 INFO:tasks.workunit.client.0.smithi081.stdout:203/600: open fd = 3 2024-05-09T00:08:47.382 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.382 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.382 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.382 INFO:tasks.workunit.client.0.smithi081.stdout:204/600: open fd = 3 2024-05-09T00:08:47.382 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.382 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.382 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.382 INFO:tasks.workunit.client.0.smithi081.stdout:205/600: open fd = 3 2024-05-09T00:08:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:206/600: open fd = 3 2024-05-09T00:08:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:207/600: open fd = 3 2024-05-09T00:08:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:208/600: open fd = 3 2024-05-09T00:08:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.383 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:209/600: open fd = 3 2024-05-09T00:08:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:210/600: open fd = 3 2024-05-09T00:08:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:211/600: open fd = 3 2024-05-09T00:08:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.384 INFO:tasks.workunit.client.0.smithi081.stdout:212/600: open fd = 3 2024-05-09T00:08:47.385 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.385 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.385 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.385 INFO:tasks.workunit.client.0.smithi081.stdout:213/600: open fd = 3 2024-05-09T00:08:47.385 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.385 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.385 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.385 INFO:tasks.workunit.client.0.smithi081.stdout:214/600: open fd = 3 2024-05-09T00:08:47.385 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.385 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.385 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.385 INFO:tasks.workunit.client.0.smithi081.stdout:215/600: open fd = 3 2024-05-09T00:08:47.385 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.386 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.386 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.386 INFO:tasks.workunit.client.0.smithi081.stdout:216/600: open fd = 3 2024-05-09T00:08:47.386 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.386 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.386 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.386 INFO:tasks.workunit.client.0.smithi081.stdout:217/600: open fd = 3 2024-05-09T00:08:47.386 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.386 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.386 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.386 INFO:tasks.workunit.client.0.smithi081.stdout:218/600: open fd = 3 2024-05-09T00:08:47.386 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.386 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:219/600: open fd = 3 2024-05-09T00:08:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:220/600: open fd = 3 2024-05-09T00:08:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:221/600: open fd = 3 2024-05-09T00:08:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.387 INFO:tasks.workunit.client.0.smithi081.stdout:222/600: open fd = 3 2024-05-09T00:08:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:223/600: open fd = 3 2024-05-09T00:08:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:224/600: open fd = 3 2024-05-09T00:08:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:225/600: open fd = 3 2024-05-09T00:08:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.388 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:226/600: open fd = 3 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:227/600: open fd = 3 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:228/600: open fd = 3 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:229/600: open fd = 3 2024-05-09T00:08:47.389 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:230/600: open fd = 3 2024-05-09T00:08:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:231/600: open fd = 3 2024-05-09T00:08:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:232/600: open fd = 3 2024-05-09T00:08:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.390 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:233/600: open fd = 3 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:234/600: open fd = 3 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:235/600: open fd = 3 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:236/600: open fd = 3 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.391 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:237/600: open fd = 3 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:238/600: open fd = 3 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:239/600: open fd = 3 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:240/600: open fd = 3 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.392 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:241/600: open fd = 3 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:242/600: open fd = 3 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:243/600: open fd = 3 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:244/600: open fd = 3 2024-05-09T00:08:47.393 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:245/600: open fd = 3 2024-05-09T00:08:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:246/600: open fd = 3 2024-05-09T00:08:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:247/600: open fd = 3 2024-05-09T00:08:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.394 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.395 INFO:tasks.workunit.client.0.smithi081.stdout:248/600: open fd = 3 2024-05-09T00:08:47.395 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.395 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.395 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.395 INFO:tasks.workunit.client.0.smithi081.stdout:249/600: open fd = 3 2024-05-09T00:08:47.395 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.395 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.395 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:08:47.395 INFO:tasks.workunit.client.0.smithi081.stdout:250/600: open fd = 3 2024-05-09T00:08:47.395 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:47.395 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:08:48.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:48 smithi171 ceph-mon[47351]: pgmap v178: 97 pgs: 97 active+clean; 3.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-05-09T00:08:48.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:48 smithi081 ceph-mon[42474]: pgmap v178: 97 pgs: 97 active+clean; 3.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-05-09T00:08:48.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:48 smithi150 ceph-mon[46187]: pgmap v178: 97 pgs: 97 active+clean; 3.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-05-09T00:08:50.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:50 smithi171 ceph-mon[47351]: pgmap v179: 97 pgs: 97 active+clean; 3.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-05-09T00:08:50.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:50 smithi081 ceph-mon[42474]: pgmap v179: 97 pgs: 97 active+clean; 3.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-05-09T00:08:50.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:50 smithi150 ceph-mon[46187]: pgmap v179: 97 pgs: 97 active+clean; 3.9 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 33 KiB/s wr, 12 op/s 2024-05-09T00:08:52.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:52 smithi171 ceph-mon[47351]: pgmap v180: 97 pgs: 97 active+clean; 4.1 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-05-09T00:08:52.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:52 smithi081 ceph-mon[42474]: pgmap v180: 97 pgs: 97 active+clean; 4.1 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-05-09T00:08:52.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:52 smithi150 ceph-mon[46187]: pgmap v180: 97 pgs: 97 active+clean; 4.1 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 51 KiB/s wr, 17 op/s 2024-05-09T00:08:54.117 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.119+0000 7fbcc87d7700 1 -- 172.21.15.81:0/2255539982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc0106210 msgr2=0x7fbcc010dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.117 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.119+0000 7fbcc87d7700 1 --2- 172.21.15.81:0/2255539982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc0106210 0x7fbcc010dd90 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800b0a0 tx=0x7fbcb800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.117 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.119+0000 7fbcc87d7700 1 -- 172.21.15.81:0/2255539982 shutdown_connections 2024-05-09T00:08:54.117 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.119+0000 7fbcc87d7700 1 --2- 172.21.15.81:0/2255539982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc0106210 0x7fbcc010dd90 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.119+0000 7fbcc87d7700 1 --2- 172.21.15.81:0/2255539982 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcc01010f0 0x7fbcc01014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.119+0000 7fbcc87d7700 1 --2- 172.21.15.81:0/2255539982 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcc0101aa0 0x7fbcc0105ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.119+0000 7fbcc87d7700 1 -- 172.21.15.81:0/2255539982 >> 172.21.15.81:0/2255539982 conn(0x7fbcc00fc9d0 msgr2=0x7fbcc00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.119+0000 7fbcc87d7700 1 -- 172.21.15.81:0/2255539982 shutdown_connections 2024-05-09T00:08:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.119+0000 7fbcc87d7700 1 -- 172.21.15.81:0/2255539982 wait complete. 2024-05-09T00:08:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.119+0000 7fbcc87d7700 1 Processor -- start 2024-05-09T00:08:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.119+0000 7fbcc87d7700 1 -- start start 2024-05-09T00:08:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc87d7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcc01010f0 0x7fbcc0197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc87d7700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcc0106210 0x7fbcc0197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc87d7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc019bda0 0x7fbcc019c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc87d7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc019c820 con 0x7fbcc019bda0 2024-05-09T00:08:54.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc87d7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc019c990 con 0x7fbcc01010f0 2024-05-09T00:08:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc87d7700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc019cb50 con 0x7fbcc0106210 2024-05-09T00:08:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc6d74700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc019bda0 0x7fbcc019c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc6d74700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc019bda0 0x7fbcc019c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37142/0 (socket says 172.21.15.81:37142) 2024-05-09T00:08:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc6d74700 1 -- 172.21.15.81:0/573026438 learned_addr learned my addr 172.21.15.81:0/573026438 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc6573700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcc01010f0 0x7fbcc0197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc5d72700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcc0106210 0x7fbcc0197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc6d74700 1 -- 172.21.15.81:0/573026438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcc0106210 msgr2=0x7fbcc0197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc6d74700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcc0106210 0x7fbcc0197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc6d74700 1 -- 172.21.15.81:0/573026438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcc01010f0 msgr2=0x7fbcc0197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc6d74700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcc01010f0 0x7fbcc0197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc6d74700 1 -- 172.21.15.81:0/573026438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb8009d00 con 0x7fbcc019bda0 2024-05-09T00:08:54.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc6573700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcc01010f0 0x7fbcc0197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:08:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc6d74700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc019bda0 0x7fbcc019c220 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8006130 tx=0x7fbcb80093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcb77fe700 1 -- 172.21.15.81:0/573026438 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb800e040 con 0x7fbcc019bda0 2024-05-09T00:08:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcb77fe700 1 -- 172.21.15.81:0/573026438 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbcb8004e40 con 0x7fbcc019bda0 2024-05-09T00:08:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc87d7700 1 -- 172.21.15.81:0/573026438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc01a4050 con 0x7fbcc019bda0 2024-05-09T00:08:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcb77fe700 1 -- 172.21.15.81:0/573026438 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb801b7d0 con 0x7fbcc019bda0 2024-05-09T00:08:54.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.120+0000 7fbcc87d7700 1 -- 172.21.15.81:0/573026438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc01a44d0 con 0x7fbcc019bda0 2024-05-09T00:08:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.122+0000 7fbcb77fe700 1 -- 172.21.15.81:0/573026438 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fbcb801da40 con 0x7fbcc019bda0 2024-05-09T00:08:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.123+0000 7fbcb77fe700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbcac0a1290 0x7fbcac0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.123+0000 7fbcc6573700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbcac0a1290 0x7fbcac0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.124+0000 7fbcb77fe700 1 -- 172.21.15.81:0/573026438 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fbcb80ce650 con 0x7fbcc019bda0 2024-05-09T00:08:54.127 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.124+0000 7fbcc6573700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbcac0a1290 0x7fbcac0a3750 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc005950 tx=0x7fbcbc0058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.124+0000 7fbcd4991b80 1 Processor -- start 2024-05-09T00:08:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.124+0000 7fbcd4991b80 1 -- start start 2024-05-09T00:08:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcd4991b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a49950 0x55e312a49d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcd4991b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 0x55e312a43f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcd4991b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a44480 0x55e312a448a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcd4991b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e31299b0f0 con 0x55e312a49950 2024-05-09T00:08:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcd4991b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e312998ab0 con 0x55e312a4a270 2024-05-09T00:08:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcd4991b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3129943a0 con 0x55e312a44480 2024-05-09T00:08:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcc6573700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a49950 0x55e312a49d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcc6573700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a49950 0x55e312a49d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37150/0 (socket says 172.21.15.81:37150) 2024-05-09T00:08:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcc6573700 1 -- 172.21.15.81:0/3308985592 learned_addr learned my addr 172.21.15.81:0/3308985592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcc5d72700 1 --2- 172.21.15.81:0/3308985592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 0x55e312a43f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.128 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcc6d74700 1 --2- 172.21.15.81:0/3308985592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a44480 0x55e312a448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcc6573700 1 -- 172.21.15.81:0/3308985592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a44480 msgr2=0x55e312a448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcc6573700 1 --2- 172.21.15.81:0/3308985592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a44480 0x55e312a448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcc6573700 1 -- 172.21.15.81:0/3308985592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 msgr2=0x55e312a43f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcc6573700 1 --2- 172.21.15.81:0/3308985592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 0x55e312a43f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcc6573700 1 -- 172.21.15.81:0/3308985592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e312815350 con 0x55e312a49950 2024-05-09T00:08:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcc6573700 1 --2- 172.21.15.81:0/3308985592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a49950 0x55e312a49d30 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00ff00 tx=0x7fbcbc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5e0a1e465faad7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.125+0000 7fbcb4ff9700 1 -- 172.21.15.81:0/3308985592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc017040 con 0x55e312a49950 2024-05-09T00:08:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.126+0000 7fbcb4ff9700 1 -- 172.21.15.81:0/3308985592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbcbc003d40 con 0x55e312a49950 2024-05-09T00:08:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.126+0000 7fbcb4ff9700 1 -- 172.21.15.81:0/3308985592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc01fd10 con 0x55e312a49950 2024-05-09T00:08:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.126+0000 7fbcd4991b80 1 -- 172.21.15.81:0/3308985592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a49950 msgr2=0x55e312a49d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.126+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/3308985592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a49950 0x55e312a49d30 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00ff00 tx=0x7fbcbc012000 comp rx=0 tx=0).stop 2024-05-09T00:08:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.126+0000 7fbcd4991b80 1 -- 172.21.15.81:0/3308985592 shutdown_connections 2024-05-09T00:08:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.126+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/3308985592 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a44480 0x55e312a448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.129 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.126+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/3308985592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a49950 0x55e312a49d30 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.126+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/3308985592 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 0x55e312a43f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.126+0000 7fbcd4991b80 1 -- 172.21.15.81:0/3308985592 >> 172.21.15.81:0/3308985592 conn(0x55e3129a21b0 msgr2=0x55e312a3e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.126+0000 7fbcd4991b80 1 -- 172.21.15.81:0/3308985592 shutdown_connections 2024-05-09T00:08:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.126+0000 7fbcd4991b80 1 -- 172.21.15.81:0/3308985592 wait complete. 2024-05-09T00:08:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcd4991b80 1 -- start start 2024-05-09T00:08:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcd4991b80 1 Processor -- start 2024-05-09T00:08:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcd4991b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a44480 0x55e312a4d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcd4991b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a49950 0x55e312a4da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcd4991b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 0x55e312a4dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcd4991b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e312930500 con 0x55e312a44480 2024-05-09T00:08:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcd4991b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3129301a0 con 0x55e312a4a270 2024-05-09T00:08:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcd4991b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e312817640 con 0x55e312a49950 2024-05-09T00:08:54.130 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcd4991b80 10 client.0 _ll_register_callbacks cb 0x55e312939ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcc6573700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a44480 0x55e312a4d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcc6573700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a44480 0x55e312a4d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37156/0 (socket says 172.21.15.81:37156) 2024-05-09T00:08:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcc6573700 1 -- 172.21.15.81:0/2250139668 learned_addr learned my addr 172.21.15.81:0/2250139668 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcc5d72700 1 --2- 172.21.15.81:0/2250139668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a49950 0x55e312a4da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcc6d74700 1 --2- 172.21.15.81:0/2250139668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 0x55e312a4dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcc6573700 1 -- 172.21.15.81:0/2250139668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a49950 msgr2=0x55e312a4da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcc6573700 1 --2- 172.21.15.81:0/2250139668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a49950 0x55e312a4da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcc6573700 1 -- 172.21.15.81:0/2250139668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 msgr2=0x55e312a4dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.127+0000 7fbcc6573700 1 --2- 172.21.15.81:0/2250139668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 0x55e312a4dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbcc6573700 1 -- 172.21.15.81:0/2250139668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcbc00fbe0 con 0x55e312a44480 2024-05-09T00:08:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbcc6573700 1 --2- 172.21.15.81:0/2250139668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a44480 0x55e312a4d550 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00bea0 tx=0x7fbcbc020bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1b58ac7e4b4937 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbca9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:54.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbca9ffb700 1 -- 172.21.15.81:0/2250139668 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc003a90 con 0x55e312a44480 2024-05-09T00:08:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbca9ffb700 1 -- 172.21.15.81:0/2250139668 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fbcbc005050 con 0x55e312a44480 2024-05-09T00:08:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbcd4991b80 1 -- 172.21.15.81:0/2250139668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3128ed210 con 0x55e312a44480 2024-05-09T00:08:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbca9ffb700 1 -- 172.21.15.81:0/2250139668 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcbc005210 con 0x55e312a44480 2024-05-09T00:08:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbcd4991b80 10 client.17103 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbcd4991b80 1 -- 172.21.15.81:0/2250139668 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e3127c1b00 con 0x55e312a44480 2024-05-09T00:08:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbca9ffb700 1 -- 172.21.15.81:0/2250139668 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e3128ed210 con 0x55e312a44480 2024-05-09T00:08:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbca9ffb700 1 -- 172.21.15.81:0/2250139668 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbcbc01d040 con 0x55e312a44480 2024-05-09T00:08:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbcd4991b80 10 client.17103 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbcd4991b80 10 client.17103 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbcd4991b80 20 client.17103 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/2250139668 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e312a5dc90 0x55e312a600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbcd4991b80 4 client.17103 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:08:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.128+0000 7fbcd4991b80 1 -- 172.21.15.81:0/2250139668 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e312a137b0 con 0x55e312a5dc90 2024-05-09T00:08:54.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.129+0000 7fbcc5d72700 1 --2- 172.21.15.81:0/2250139668 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e312a5dc90 0x55e312a600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.129+0000 7fbca9ffb700 10 client.17103 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.129+0000 7fbcc5d72700 1 --2- 172.21.15.81:0/2250139668 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e312a5dc90 0x55e312a600b0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37a1837f3afafdb8 server_cookie=183bcbbb9a8a3135 in_seq=0 out_seq=0 2024-05-09T00:08:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbca9ffb700 1 -- 172.21.15.81:0/2250139668 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e312a137b0 con 0x55e312a5dc90 2024-05-09T00:08:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbca9ffb700 10 client.17103 handle_command_reply: tid=0 2024-05-09T00:08:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbcd4991b80 1 client.17103 shutdown 2024-05-09T00:08:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbcd4991b80 1 -- 172.21.15.81:0/2250139668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a44480 msgr2=0x55e312a4d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/2250139668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a44480 0x55e312a4d550 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00bea0 tx=0x7fbcbc020bf0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbcd4991b80 1 -- 172.21.15.81:0/2250139668 shutdown_connections 2024-05-09T00:08:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/2250139668 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e312a5dc90 0x55e312a600b0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/2250139668 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 0x55e312a4dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/2250139668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a44480 0x55e312a4d550 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/2250139668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a49950 0x55e312a4da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbca9ffb700 0 client.17103 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbcd4991b80 1 -- 172.21.15.81:0/2250139668 >> 172.21.15.81:0/2250139668 conn(0x55e3129a21b0 msgr2=0x55e312a42f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbcd4991b80 1 -- 172.21.15.81:0/2250139668 shutdown_connections 2024-05-09T00:08:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbcd4991b80 1 -- 172.21.15.81:0/2250139668 wait complete. 2024-05-09T00:08:54.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.130+0000 7fbcd4991b80 20 client.17103 trim_cache size 0 max 16384 2024-05-09T00:08:54.145 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.145+0000 7fbcd4991b80 1 Processor -- start 2024-05-09T00:08:54.145 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.145+0000 7fbcd4991b80 1 -- start start 2024-05-09T00:08:54.145 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.145+0000 7fbcd4991b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a44480 0x55e312a40540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.145+0000 7fbcd4991b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a49950 0x55e312a3e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.145+0000 7fbcd4991b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a4a270 0x55e312a48cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.145+0000 7fbcd4991b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e312a397c0 con 0x55e312a44480 2024-05-09T00:08:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.145+0000 7fbcd4991b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e312a39330 con 0x55e312a49950 2024-05-09T00:08:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.145+0000 7fbcd4991b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e312a4ebc0 con 0x55e312a4a270 2024-05-09T00:08:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.145+0000 7fbcc6573700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a44480 0x55e312a40540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.145+0000 7fbcc6573700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a44480 0x55e312a40540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37168/0 (socket says 172.21.15.81:37168) 2024-05-09T00:08:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.145+0000 7fbcc6573700 1 -- 172.21.15.81:0/1098022463 learned_addr learned my addr 172.21.15.81:0/1098022463 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.145+0000 7fbcc5d72700 1 --2- 172.21.15.81:0/1098022463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a49950 0x55e312a3e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.145+0000 7fbcc6d74700 1 --2- 172.21.15.81:0/1098022463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a4a270 0x55e312a48cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcc6573700 1 -- 172.21.15.81:0/1098022463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a4a270 msgr2=0x55e312a48cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcc6573700 1 --2- 172.21.15.81:0/1098022463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a4a270 0x55e312a48cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.146 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcc6573700 1 -- 172.21.15.81:0/1098022463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a49950 msgr2=0x55e312a3e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:54.147 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcc6573700 1 --2- 172.21.15.81:0/1098022463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a49950 0x55e312a3e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.147 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcc6573700 1 -- 172.21.15.81:0/1098022463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e31295a500 con 0x55e312a44480 2024-05-09T00:08:54.147 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcc6573700 1 --2- 172.21.15.81:0/1098022463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a44480 0x55e312a40540 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00f9d0 tx=0x7fbcbc003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b97560d2ac98f6c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:54.147 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcb57fa700 1 -- 172.21.15.81:0/1098022463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc004bd0 con 0x55e312a44480 2024-05-09T00:08:54.147 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcb57fa700 1 -- 172.21.15.81:0/1098022463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbcbc004710 con 0x55e312a44480 2024-05-09T00:08:54.147 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcb57fa700 1 -- 172.21.15.81:0/1098022463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc020030 con 0x55e312a44480 2024-05-09T00:08:54.147 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcd4991b80 1 -- 172.21.15.81:0/1098022463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a44480 msgr2=0x55e312a40540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.147 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/1098022463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a44480 0x55e312a40540 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00f9d0 tx=0x7fbcbc003f30 comp rx=0 tx=0).stop 2024-05-09T00:08:54.147 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcd4991b80 1 -- 172.21.15.81:0/1098022463 shutdown_connections 2024-05-09T00:08:54.147 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/1098022463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a4a270 0x55e312a48cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.147 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/1098022463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a44480 0x55e312a40540 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.147 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/1098022463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a49950 0x55e312a3e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.147 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcd4991b80 1 -- 172.21.15.81:0/1098022463 >> 172.21.15.81:0/1098022463 conn(0x55e3129a21b0 msgr2=0x55e312a485a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcd4991b80 1 -- 172.21.15.81:0/1098022463 shutdown_connections 2024-05-09T00:08:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.146+0000 7fbcd4991b80 1 -- 172.21.15.81:0/1098022463 wait complete. 2024-05-09T00:08:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcd4991b80 1 -- start start 2024-05-09T00:08:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcd4991b80 1 Processor -- start 2024-05-09T00:08:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcd4991b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a44480 0x55e312a54e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcd4991b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a49950 0x55e312a52bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcd4991b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 0x55e312a53130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcd4991b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e312a536b0 con 0x55e312a49950 2024-05-09T00:08:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcd4991b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e312a53820 con 0x55e312a4a270 2024-05-09T00:08:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcd4991b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e312a539e0 con 0x55e312a44480 2024-05-09T00:08:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcd4991b80 10 client.0 _ll_register_callbacks cb 0x55e312939ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:08:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcc5d72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a49950 0x55e312a52bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.148 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcc5d72700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a49950 0x55e312a52bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37184/0 (socket says 172.21.15.81:37184) 2024-05-09T00:08:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcc5d72700 1 -- 172.21.15.81:0/3052193405 learned_addr learned my addr 172.21.15.81:0/3052193405 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:08:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcc6573700 1 --2- 172.21.15.81:0/3052193405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a44480 0x55e312a54e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcc5d72700 1 -- 172.21.15.81:0/3052193405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a44480 msgr2=0x55e312a54e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcc5d72700 1 --2- 172.21.15.81:0/3052193405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a44480 0x55e312a54e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcc5d72700 1 -- 172.21.15.81:0/3052193405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 msgr2=0x55e312a53130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:08:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcc6d74700 1 --2- 172.21.15.81:0/3052193405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 0x55e312a53130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcc5d72700 1 --2- 172.21.15.81:0/3052193405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 0x55e312a53130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.147+0000 7fbcc5d72700 1 -- 172.21.15.81:0/3052193405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3127c1b00 con 0x55e312a49950 2024-05-09T00:08:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbcc5d72700 1 --2- 172.21.15.81:0/3052193405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a49950 0x55e312a52bf0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0198a10 tx=0x7fbcb001af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92968da1ea0138bc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:08:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbca9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:08:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbca9ffb700 1 -- 172.21.15.81:0/3052193405 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0018030 con 0x55e312a49950 2024-05-09T00:08:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbca9ffb700 1 -- 172.21.15.81:0/3052193405 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fbcb0004e30 con 0x55e312a49950 2024-05-09T00:08:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbcd4991b80 1 -- 172.21.15.81:0/3052193405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbcbc003d40 con 0x55e312a49950 2024-05-09T00:08:54.149 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbca9ffb700 1 -- 172.21.15.81:0/3052193405 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcb001a660 con 0x55e312a49950 2024-05-09T00:08:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbcd4991b80 10 client.17109 fetch_fsmap learned FSMap version 26 2024-05-09T00:08:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbcd4991b80 1 -- 172.21.15.81:0/3052193405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e312819c70 con 0x55e312a49950 2024-05-09T00:08:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbca9ffb700 1 -- 172.21.15.81:0/3052193405 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbcbc003d40 con 0x55e312a49950 2024-05-09T00:08:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbca9ffb700 1 -- 172.21.15.81:0/3052193405 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbcb00124e0 con 0x55e312a49950 2024-05-09T00:08:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbcd4991b80 10 client.17109 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:08:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbcd4991b80 10 client.17109 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:08:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbcd4991b80 20 client.17109 populate_metadata read hostname 'smithi081' 2024-05-09T00:08:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/3052193405 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e312ab4760 0x55e312ab6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:08:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbcd4991b80 4 client.17109 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:08:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.148+0000 7fbcd4991b80 1 -- 172.21.15.81:0/3052193405 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e31298ce60 con 0x55e312ab4760 2024-05-09T00:08:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.149+0000 7fbcc6573700 1 --2- 172.21.15.81:0/3052193405 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e312ab4760 0x55e312ab6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:08:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.149+0000 7fbcc6573700 1 --2- 172.21.15.81:0/3052193405 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e312ab4760 0x55e312ab6b80 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93ed8d59d2024d4c server_cookie=ed45a158b7b4b299 in_seq=0 out_seq=0 2024-05-09T00:08:54.150 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.149+0000 7fbca9ffb700 10 client.17109 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbca9ffb700 1 -- 172.21.15.81:0/3052193405 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e31298ce60 con 0x55e312ab4760 2024-05-09T00:08:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbca9ffb700 10 client.17109 handle_command_reply: tid=0 2024-05-09T00:08:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcd4991b80 1 client.17109 shutdown 2024-05-09T00:08:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcd4991b80 1 -- 172.21.15.81:0/3052193405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a49950 msgr2=0x55e312a52bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/3052193405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a49950 0x55e312a52bf0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0198a10 tx=0x7fbcb001af00 comp rx=0 tx=0).stop 2024-05-09T00:08:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcd4991b80 1 -- 172.21.15.81:0/3052193405 shutdown_connections 2024-05-09T00:08:54.159 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/3052193405 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e312ab4760 0x55e312ab6b80 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/3052193405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e312a4a270 0x55e312a53130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbca9ffb700 0 client.17109 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:08:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/3052193405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e312a44480 0x55e312a54e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcd4991b80 1 --2- 172.21.15.81:0/3052193405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e312a49950 0x55e312a52bf0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcd4991b80 1 -- 172.21.15.81:0/3052193405 >> 172.21.15.81:0/3052193405 conn(0x55e3129a21b0 msgr2=0x55e312a485a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcd4991b80 1 -- 172.21.15.81:0/3052193405 shutdown_connections 2024-05-09T00:08:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcd4991b80 1 -- 172.21.15.81:0/3052193405 wait complete. 2024-05-09T00:08:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcd4991b80 20 client.17109 trim_cache size 0 max 16384 2024-05-09T00:08:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:08:54.160 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:08:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:08:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:08:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcc87d7700 1 -- 172.21.15.81:0/573026438 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbcac0a1290 msgr2=0x7fbcac0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcc87d7700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbcac0a1290 0x7fbcac0a3750 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc005950 tx=0x7fbcbc0058e0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcc87d7700 1 -- 172.21.15.81:0/573026438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc019bda0 msgr2=0x7fbcc019c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:08:54.161 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.163+0000 7fbcc87d7700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc019bda0 0x7fbcc019c220 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8006130 tx=0x7fbcb80093b0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.164+0000 7fbcc87d7700 1 -- 172.21.15.81:0/573026438 shutdown_connections 2024-05-09T00:08:54.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.164+0000 7fbcc87d7700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbcac0a1290 0x7fbcac0a3750 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.164+0000 7fbcc87d7700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbcc01010f0 0x7fbcc0197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.164+0000 7fbcc87d7700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbcc019bda0 0x7fbcc019c220 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.164+0000 7fbcc87d7700 1 --2- 172.21.15.81:0/573026438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcc0106210 0x7fbcc0197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:08:54.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.164+0000 7fbcc87d7700 1 -- 172.21.15.81:0/573026438 >> 172.21.15.81:0/573026438 conn(0x7fbcc00fc9d0 msgr2=0x7fbcc00fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:08:54.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.164+0000 7fbcc87d7700 1 -- 172.21.15.81:0/573026438 shutdown_connections 2024-05-09T00:08:54.162 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:08:54.164+0000 7fbcc87d7700 1 -- 172.21.15.81:0/573026438 wait complete. 2024-05-09T00:08:54.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:54 smithi171 ceph-mon[47351]: pgmap v181: 97 pgs: 97 active+clean; 4.1 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-05-09T00:08:54.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:54 smithi081 ceph-mon[42474]: pgmap v181: 97 pgs: 97 active+clean; 4.1 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-05-09T00:08:54.515 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:54 smithi150 ceph-mon[46187]: pgmap v181: 97 pgs: 97 active+clean; 4.1 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-05-09T00:08:56.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:56 smithi171 ceph-mon[47351]: pgmap v182: 97 pgs: 97 active+clean; 4.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-05-09T00:08:56.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:56 smithi081 ceph-mon[42474]: pgmap v182: 97 pgs: 97 active+clean; 4.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-05-09T00:08:56.518 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:56 smithi150 ceph-mon[46187]: pgmap v182: 97 pgs: 97 active+clean; 4.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-05-09T00:08:58.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:08:58 smithi171 ceph-mon[47351]: pgmap v183: 97 pgs: 97 active+clean; 4.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-05-09T00:08:58.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:08:58 smithi081 ceph-mon[42474]: pgmap v183: 97 pgs: 97 active+clean; 4.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-05-09T00:08:58.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:08:58 smithi150 ceph-mon[46187]: pgmap v183: 97 pgs: 97 active+clean; 4.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-05-09T00:09:00.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:00 smithi081 ceph-mon[42474]: pgmap v184: 97 pgs: 97 active+clean; 4.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-05-09T00:09:00.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:00 smithi150 ceph-mon[46187]: pgmap v184: 97 pgs: 97 active+clean; 4.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-05-09T00:09:00.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:00 smithi171 ceph-mon[47351]: pgmap v184: 97 pgs: 97 active+clean; 4.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 37 KiB/s wr, 12 op/s 2024-05-09T00:09:02.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:02 smithi081 ceph-mon[42474]: pgmap v185: 97 pgs: 97 active+clean; 4.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 53 KiB/s wr, 17 op/s 2024-05-09T00:09:02.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:02 smithi150 ceph-mon[46187]: pgmap v185: 97 pgs: 97 active+clean; 4.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 53 KiB/s wr, 17 op/s 2024-05-09T00:09:02.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:02 smithi171 ceph-mon[47351]: pgmap v185: 97 pgs: 97 active+clean; 4.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 53 KiB/s wr, 17 op/s 2024-05-09T00:09:03.651 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:09:03.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.794+0000 7fd16f3ef700 1 -- 172.21.15.81:0/1325821606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168101160 msgr2=0x7fd168101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.794+0000 7fd16f3ef700 1 --2- 172.21.15.81:0/1325821606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168101160 0x7fd168101540 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fd164009990 tx=0x7fd164009ca0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.794+0000 7fd16f3ef700 1 -- 172.21.15.81:0/1325821606 shutdown_connections 2024-05-09T00:09:03.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.794+0000 7fd16f3ef700 1 --2- 172.21.15.81:0/1325821606 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd168106280 0x7fd16810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.794+0000 7fd16f3ef700 1 --2- 172.21.15.81:0/1325821606 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168101160 0x7fd168101540 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.794+0000 7fd16f3ef700 1 --2- 172.21.15.81:0/1325821606 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd168101b10 0x7fd168105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.794+0000 7fd16f3ef700 1 -- 172.21.15.81:0/1325821606 >> 172.21.15.81:0/1325821606 conn(0x7fd1680fc9e0 msgr2=0x7fd1680fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.794+0000 7fd16f3ef700 1 -- 172.21.15.81:0/1325821606 shutdown_connections 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.794+0000 7fd16f3ef700 1 -- 172.21.15.81:0/1325821606 wait complete. 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16f3ef700 1 Processor -- start 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16f3ef700 1 -- start start 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16f3ef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168101160 0x7fd168197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16f3ef700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd168106280 0x7fd168197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16f3ef700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd16819bca0 0x7fd16819c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16f3ef700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16819c720 con 0x7fd168101160 2024-05-09T00:09:03.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16f3ef700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16819c890 con 0x7fd16819bca0 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16f3ef700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16819ca50 con 0x7fd168106280 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16d18b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168101160 0x7fd168197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16d18b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168101160 0x7fd168197410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60146/0 (socket says 172.21.15.81:60146) 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16d18b700 1 -- 172.21.15.81:0/565981679 learned_addr learned my addr 172.21.15.81:0/565981679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16c98a700 1 --2- 172.21.15.81:0/565981679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd168106280 0x7fd168197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16d98c700 1 --2- 172.21.15.81:0/565981679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd16819bca0 0x7fd16819c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16d18b700 1 -- 172.21.15.81:0/565981679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd168106280 msgr2=0x7fd168197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16d18b700 1 --2- 172.21.15.81:0/565981679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd168106280 0x7fd168197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16d18b700 1 -- 172.21.15.81:0/565981679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd16819bca0 msgr2=0x7fd16819c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16d18b700 1 --2- 172.21.15.81:0/565981679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd16819bca0 0x7fd16819c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16d18b700 1 -- 172.21.15.81:0/565981679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1640095f0 con 0x7fd168101160 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.795+0000 7fd16d18b700 1 --2- 172.21.15.81:0/565981679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168101160 0x7fd168197410 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fd164000c00 tx=0x7fd164009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.796+0000 7fd15e7fc700 1 -- 172.21.15.81:0/565981679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16401d070 con 0x7fd168101160 2024-05-09T00:09:03.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.796+0000 7fd15e7fc700 1 -- 172.21.15.81:0/565981679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd16400fb30 con 0x7fd168101160 2024-05-09T00:09:03.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.796+0000 7fd16f3ef700 1 -- 172.21.15.81:0/565981679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1681a3f50 con 0x7fd168101160 2024-05-09T00:09:03.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.796+0000 7fd15e7fc700 1 -- 172.21.15.81:0/565981679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd164022b20 con 0x7fd168101160 2024-05-09T00:09:03.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.796+0000 7fd16f3ef700 1 -- 172.21.15.81:0/565981679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1681a4310 con 0x7fd168101160 2024-05-09T00:09:03.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.798+0000 7fd15e7fc700 1 -- 172.21.15.81:0/565981679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fd16400fca0 con 0x7fd168101160 2024-05-09T00:09:03.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.798+0000 7fd15e7fc700 1 --2- 172.21.15.81:0/565981679 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd1540a1290 0x7fd1540a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.798+0000 7fd15e7fc700 1 -- 172.21.15.81:0/565981679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fd1640ce0f0 con 0x7fd168101160 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.798+0000 7fd16c98a700 1 --2- 172.21.15.81:0/565981679 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd1540a1290 0x7fd1540a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.799+0000 7fd16c98a700 1 --2- 172.21.15.81:0/565981679 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd1540a1290 0x7fd1540a3750 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd168198910 tx=0x7fd15800b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd17b5a9b80 1 Processor -- start 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd17b5a9b80 1 -- start start 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd17b5a9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa729e00 0x5649fa72a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd17b5a9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa72a720 0x5649fa724350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd17b5a9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa724890 0x5649fa724cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd17b5a9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fa67b150 con 0x5649fa724890 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd17b5a9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fa678b10 con 0x5649fa72a720 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd17b5a9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fa674400 con 0x5649fa729e00 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd16d98c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa724890 0x5649fa724cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd16d98c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa724890 0x5649fa724cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60154/0 (socket says 172.21.15.81:60154) 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd16d98c700 1 -- 172.21.15.81:0/1745931998 learned_addr learned my addr 172.21.15.81:0/1745931998 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd16c98a700 1 --2- 172.21.15.81:0/1745931998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa72a720 0x5649fa724350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd16d18b700 1 --2- 172.21.15.81:0/1745931998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa729e00 0x5649fa72a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd16d98c700 1 -- 172.21.15.81:0/1745931998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa729e00 msgr2=0x5649fa72a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd16d98c700 1 --2- 172.21.15.81:0/1745931998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa729e00 0x5649fa72a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd16d98c700 1 -- 172.21.15.81:0/1745931998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa72a720 msgr2=0x5649fa724350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd16d98c700 1 --2- 172.21.15.81:0/1745931998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa72a720 0x5649fa724350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd16d98c700 1 -- 172.21.15.81:0/1745931998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649fa4f53b0 con 0x5649fa724890 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd16d18b700 1 --2- 172.21.15.81:0/1745931998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa729e00 0x5649fa72a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd16c98a700 1 --2- 172.21.15.81:0/1745931998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa72a720 0x5649fa724350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd16d98c700 1 --2- 172.21.15.81:0/1745931998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa724890 0x5649fa724cd0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fd16000f410 tx=0x7fd16000f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1717ced35bb85cfa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.800+0000 7fd1537fe700 1 -- 172.21.15.81:0/1745931998 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16000fe50 con 0x5649fa724890 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.801+0000 7fd1537fe700 1 -- 172.21.15.81:0/1745931998 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd160004bb0 con 0x5649fa724890 2024-05-09T00:09:03.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.801+0000 7fd1537fe700 1 -- 172.21.15.81:0/1745931998 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1600050f0 con 0x5649fa724890 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.801+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/1745931998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa724890 msgr2=0x5649fa724cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.801+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/1745931998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa724890 0x5649fa724cd0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fd16000f410 tx=0x7fd16000f720 comp rx=0 tx=0).stop 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.801+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/1745931998 shutdown_connections 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.801+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/1745931998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa724890 0x5649fa724cd0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.801+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/1745931998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa729e00 0x5649fa72a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.801+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/1745931998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa72a720 0x5649fa724350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.801+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/1745931998 >> 172.21.15.81:0/1745931998 conn(0x5649fa682210 msgr2=0x5649fa71edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.801+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/1745931998 shutdown_connections 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.801+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/1745931998 wait complete. 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.802+0000 7fd17b5a9b80 1 -- start start 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.802+0000 7fd17b5a9b80 1 Processor -- start 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.802+0000 7fd17b5a9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa724890 0x5649fa72da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.802+0000 7fd17b5a9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa72dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.802+0000 7fd17b5a9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa72a720 0x5649fa72e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.802+0000 7fd17b5a9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fa610560 con 0x5649fa724890 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.802+0000 7fd17b5a9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fa610200 con 0x5649fa729e00 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.802+0000 7fd17b5a9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fa4f76a0 con 0x5649fa72a720 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.802+0000 7fd17b5a9b80 10 client.0 _ll_register_callbacks cb 0x5649fa619b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.802+0000 7fd16d18b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa724890 0x5649fa72da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.802+0000 7fd16d18b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa724890 0x5649fa72da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60170/0 (socket says 172.21.15.81:60170) 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.802+0000 7fd16d18b700 1 -- 172.21.15.81:0/790698043 learned_addr learned my addr 172.21.15.81:0/790698043 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.802+0000 7fd16d98c700 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa72a720 0x5649fa72e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.802+0000 7fd16c98a700 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa72dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd16d18b700 1 -- 172.21.15.81:0/790698043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa72a720 msgr2=0x5649fa72e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd16d18b700 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa72a720 0x5649fa72e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd16d18b700 1 -- 172.21.15.81:0/790698043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 msgr2=0x5649fa72dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd16d18b700 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa72dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd16d18b700 1 -- 172.21.15.81:0/790698043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd160007e50 con 0x5649fa724890 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd16c98a700 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa72dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd16d98c700 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa72a720 0x5649fa72e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd16d18b700 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa724890 0x5649fa72da90 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fd16400c010 tx=0x7fd164005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e48ade671ff98d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd150ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd150ff9700 1 -- 172.21.15.81:0/790698043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16409ba30 con 0x5649fa724890 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd150ff9700 1 -- 172.21.15.81:0/790698043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fd16409b330 con 0x5649fa724890 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/790698043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649fa5cd270 con 0x5649fa724890 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd150ff9700 1 -- 172.21.15.81:0/790698043 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd16409f160 con 0x5649fa724890 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd17b5a9b80 10 client.17121 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/790698043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5649fa4a1b60 con 0x5649fa724890 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd150ff9700 1 -- 172.21.15.81:0/790698043 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5649fa5cd270 con 0x5649fa724890 2024-05-09T00:09:03.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd150ff9700 1 -- 172.21.15.81:0/790698043 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd164084b30 con 0x5649fa724890 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd17b5a9b80 10 client.17121 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd17b5a9b80 10 client.17121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd17b5a9b80 20 client.17121 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649fa73dd70 0x5649fa740190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd17b5a9b80 4 client.17121 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.803+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/790698043 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5649fa6f3810 con 0x5649fa73dd70 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.804+0000 7fd16c98a700 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649fa73dd70 0x5649fa740190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.804+0000 7fd150ff9700 10 client.17121 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.804+0000 7fd16c98a700 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649fa73dd70 0x5649fa740190 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71338b5b9937d74f server_cookie=35eba3a8aadd8476 in_seq=0 out_seq=0 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd150ff9700 1 -- 172.21.15.81:0/790698043 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5649fa6f3810 con 0x5649fa73dd70 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd150ff9700 10 client.17121 handle_command_reply: tid=0 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd17b5a9b80 1 client.17121 shutdown 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/790698043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa724890 msgr2=0x5649fa72da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa724890 0x5649fa72da90 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fd16400c010 tx=0x7fd164005fd0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/790698043 shutdown_connections 2024-05-09T00:09:03.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649fa73dd70 0x5649fa740190 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa72a720 0x5649fa72e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa724890 0x5649fa72da90 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd150ff9700 0 client.17121 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:03.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/790698043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa72dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/790698043 >> 172.21.15.81:0/790698043 conn(0x5649fa682210 msgr2=0x5649fa71e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/790698043 shutdown_connections 2024-05-09T00:09:03.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/790698043 wait complete. 2024-05-09T00:09:03.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.805+0000 7fd17b5a9b80 20 client.17121 trim_cache size 0 max 16384 2024-05-09T00:09:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.822+0000 7fd17b5a9b80 1 Processor -- start 2024-05-09T00:09:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.822+0000 7fd17b5a9b80 1 -- start start 2024-05-09T00:09:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.822+0000 7fd17b5a9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa724890 0x5649fa724350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.822+0000 7fd17b5a9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa739c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.822+0000 7fd17b5a9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa72a720 0x5649fa71ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.822+0000 7fd17b5a9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fa745360 con 0x5649fa72a720 2024-05-09T00:09:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.822+0000 7fd17b5a9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fa719800 con 0x5649fa729e00 2024-05-09T00:09:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.822+0000 7fd17b5a9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fa720a00 con 0x5649fa724890 2024-05-09T00:09:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.822+0000 7fd16d98c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa72a720 0x5649fa71ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.822+0000 7fd16d98c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa72a720 0x5649fa71ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60184/0 (socket says 172.21.15.81:60184) 2024-05-09T00:09:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.822+0000 7fd16d98c700 1 -- 172.21.15.81:0/490353618 learned_addr learned my addr 172.21.15.81:0/490353618 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.823+0000 7fd16d18b700 1 --2- 172.21.15.81:0/490353618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa724890 0x5649fa724350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.823+0000 7fd16d98c700 1 -- 172.21.15.81:0/490353618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa724890 msgr2=0x5649fa724350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.823+0000 7fd16d98c700 1 --2- 172.21.15.81:0/490353618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa724890 0x5649fa724350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.823+0000 7fd16d98c700 1 -- 172.21.15.81:0/490353618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 msgr2=0x5649fa739c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.823+0000 7fd16c98a700 1 --2- 172.21.15.81:0/490353618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa739c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.823+0000 7fd16d98c700 1 --2- 172.21.15.81:0/490353618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa739c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.823+0000 7fd16d98c700 1 -- 172.21.15.81:0/490353618 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649fa63a560 con 0x5649fa72a720 2024-05-09T00:09:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.823+0000 7fd16c98a700 1 --2- 172.21.15.81:0/490353618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa739c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.823+0000 7fd16d98c700 1 --2- 172.21.15.81:0/490353618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa72a720 0x5649fa71ed20 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fd16000f410 tx=0x7fd1600060c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec08f6ded1234c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.823+0000 7fd153fff700 1 -- 172.21.15.81:0/490353618 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160003c30 con 0x5649fa72a720 2024-05-09T00:09:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.823+0000 7fd153fff700 1 -- 172.21.15.81:0/490353618 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd160003d90 con 0x5649fa72a720 2024-05-09T00:09:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.823+0000 7fd153fff700 1 -- 172.21.15.81:0/490353618 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1600046f0 con 0x5649fa72a720 2024-05-09T00:09:03.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/490353618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa72a720 msgr2=0x5649fa71ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/490353618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa72a720 0x5649fa71ed20 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fd16000f410 tx=0x7fd1600060c0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/490353618 shutdown_connections 2024-05-09T00:09:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/490353618 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa72a720 0x5649fa71ed20 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/490353618 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa724890 0x5649fa724350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/490353618 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa739c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/490353618 >> 172.21.15.81:0/490353618 conn(0x5649fa682210 msgr2=0x5649fa72c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/490353618 shutdown_connections 2024-05-09T00:09:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/490353618 wait complete. 2024-05-09T00:09:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 -- start start 2024-05-09T00:09:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 Processor -- start 2024-05-09T00:09:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa724890 0x5649fa731430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa731970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa72a720 0x5649fa793220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fa793760 con 0x5649fa72a720 2024-05-09T00:09:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fa7938a0 con 0x5649fa729e00 2024-05-09T00:09:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649fa7939e0 con 0x5649fa724890 2024-05-09T00:09:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.824+0000 7fd17b5a9b80 10 client.0 _ll_register_callbacks cb 0x5649fa619b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd16d98c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa72a720 0x5649fa793220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd16d98c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa72a720 0x5649fa793220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60196/0 (socket says 172.21.15.81:60196) 2024-05-09T00:09:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd16d98c700 1 -- 172.21.15.81:0/1541769454 learned_addr learned my addr 172.21.15.81:0/1541769454 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd16d18b700 1 --2- 172.21.15.81:0/1541769454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa724890 0x5649fa731430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd16c98a700 1 --2- 172.21.15.81:0/1541769454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa731970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd16d98c700 1 -- 172.21.15.81:0/1541769454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa724890 msgr2=0x5649fa731430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd16d98c700 1 --2- 172.21.15.81:0/1541769454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa724890 0x5649fa731430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd16d98c700 1 -- 172.21.15.81:0/1541769454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 msgr2=0x5649fa731970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:03.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd16d98c700 1 --2- 172.21.15.81:0/1541769454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa731970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd16d98c700 1 -- 172.21.15.81:0/1541769454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5649fa4f53b0 con 0x5649fa72a720 2024-05-09T00:09:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd16c98a700 1 --2- 172.21.15.81:0/1541769454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa731970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd16d98c700 1 --2- 172.21.15.81:0/1541769454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa72a720 0x5649fa793220 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fd160000f80 tx=0x7fd1600148b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1330555fc7a92316 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd150ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd150ff9700 1 -- 172.21.15.81:0/1541769454 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd160014d90 con 0x5649fa72a720 2024-05-09T00:09:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd150ff9700 1 -- 172.21.15.81:0/1541769454 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fd160004250 con 0x5649fa72a720 2024-05-09T00:09:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/1541769454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd160004bb0 con 0x5649fa72a720 2024-05-09T00:09:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd150ff9700 1 -- 172.21.15.81:0/1541769454 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd160004410 con 0x5649fa72a720 2024-05-09T00:09:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd17b5a9b80 10 client.17127 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/1541769454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5649fa4f9cd0 con 0x5649fa72a720 2024-05-09T00:09:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.825+0000 7fd150ff9700 1 -- 172.21.15.81:0/1541769454 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd16003d020 con 0x5649fa72a720 2024-05-09T00:09:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.826+0000 7fd150ff9700 1 -- 172.21.15.81:0/1541769454 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd160012070 con 0x5649fa72a720 2024-05-09T00:09:03.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.826+0000 7fd17b5a9b80 10 client.17127 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.826+0000 7fd17b5a9b80 10 client.17127 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.826+0000 7fd17b5a9b80 20 client.17127 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.826+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/1541769454 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649fa794dc0 0x5649fa7971e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.826+0000 7fd17b5a9b80 4 client.17127 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:09:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.826+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/1541769454 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5649fa66cec0 con 0x5649fa794dc0 2024-05-09T00:09:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.826+0000 7fd16d18b700 1 --2- 172.21.15.81:0/1541769454 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649fa794dc0 0x5649fa7971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.826+0000 7fd16d18b700 1 --2- 172.21.15.81:0/1541769454 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649fa794dc0 0x5649fa7971e0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2aea17acb1c8ccae server_cookie=adf80d88b8a38298 in_seq=0 out_seq=0 2024-05-09T00:09:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.826+0000 7fd150ff9700 10 client.17127 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.826+0000 7fd150ff9700 1 -- 172.21.15.81:0/1541769454 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5649fa66cec0 con 0x5649fa794dc0 2024-05-09T00:09:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.826+0000 7fd150ff9700 10 client.17127 handle_command_reply: tid=0 2024-05-09T00:09:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.826+0000 7fd17b5a9b80 1 client.17127 shutdown 2024-05-09T00:09:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/1541769454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa72a720 msgr2=0x5649fa793220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/1541769454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa72a720 0x5649fa793220 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fd160000f80 tx=0x7fd1600148b0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/1541769454 shutdown_connections 2024-05-09T00:09:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/1541769454 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649fa794dc0 0x5649fa7971e0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/1541769454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649fa72a720 0x5649fa793220 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd150ff9700 0 client.17127 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/1541769454 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649fa724890 0x5649fa731430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd17b5a9b80 1 --2- 172.21.15.81:0/1541769454 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649fa729e00 0x5649fa731970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/1541769454 >> 172.21.15.81:0/1541769454 conn(0x5649fa682210 msgr2=0x5649fa728b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/1541769454 shutdown_connections 2024-05-09T00:09:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd17b5a9b80 1 -- 172.21.15.81:0/1541769454 wait complete. 2024-05-09T00:09:03.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd17b5a9b80 20 client.17127 trim_cache size 0 max 16384 2024-05-09T00:09:03.830 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:09:03.831 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:09:03.831 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:09:03.831 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:09:03.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd16f3ef700 1 -- 172.21.15.81:0/565981679 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd1540a1290 msgr2=0x7fd1540a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd16f3ef700 1 --2- 172.21.15.81:0/565981679 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd1540a1290 0x7fd1540a3750 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd168198910 tx=0x7fd15800b410 comp rx=0 tx=0).stop 2024-05-09T00:09:03.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd16f3ef700 1 -- 172.21.15.81:0/565981679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168101160 msgr2=0x7fd168197410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd16f3ef700 1 --2- 172.21.15.81:0/565981679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168101160 0x7fd168197410 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fd164000c00 tx=0x7fd164009580 comp rx=0 tx=0).stop 2024-05-09T00:09:03.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd16f3ef700 1 -- 172.21.15.81:0/565981679 shutdown_connections 2024-05-09T00:09:03.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd16f3ef700 1 --2- 172.21.15.81:0/565981679 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd1540a1290 0x7fd1540a3750 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd16f3ef700 1 --2- 172.21.15.81:0/565981679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd16819bca0 0x7fd16819c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd16f3ef700 1 --2- 172.21.15.81:0/565981679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd168101160 0x7fd168197410 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd16f3ef700 1 --2- 172.21.15.81:0/565981679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd168106280 0x7fd168197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd16f3ef700 1 -- 172.21.15.81:0/565981679 >> 172.21.15.81:0/565981679 conn(0x7fd1680fc9e0 msgr2=0x7fd1680fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd16f3ef700 1 -- 172.21.15.81:0/565981679 shutdown_connections 2024-05-09T00:09:03.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.827+0000 7fd16f3ef700 1 -- 172.21.15.81:0/565981679 wait complete. 2024-05-09T00:09:03.835 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:09:03.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:09:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.962+0000 7f0a24f1e700 1 -- 172.21.15.81:0/1185131291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a20101060 msgr2=0x7f0a20101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.962+0000 7f0a24f1e700 1 --2- 172.21.15.81:0/1185131291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a20101060 0x7f0a20101440 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009990 tx=0x7f0a14009ca0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.962+0000 7f0a24f1e700 1 -- 172.21.15.81:0/1185131291 shutdown_connections 2024-05-09T00:09:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.962+0000 7f0a24f1e700 1 --2- 172.21.15.81:0/1185131291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a20106180 0x7f0a2010dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.962+0000 7f0a24f1e700 1 --2- 172.21.15.81:0/1185131291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a20101060 0x7f0a20101440 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.962+0000 7f0a24f1e700 1 --2- 172.21.15.81:0/1185131291 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a20101a10 0x7f0a20105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.962+0000 7f0a24f1e700 1 -- 172.21.15.81:0/1185131291 >> 172.21.15.81:0/1185131291 conn(0x7f0a20078360 msgr2=0x7f0a20078770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.962+0000 7f0a24f1e700 1 -- 172.21.15.81:0/1185131291 shutdown_connections 2024-05-09T00:09:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.962+0000 7f0a24f1e700 1 -- 172.21.15.81:0/1185131291 wait complete. 2024-05-09T00:09:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a24f1e700 1 Processor -- start 2024-05-09T00:09:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a24f1e700 1 -- start start 2024-05-09T00:09:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a24f1e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a20101060 0x7f0a201972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a24f1e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a20106180 0x7f0a20197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a24f1e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a2019bbb0 0x7f0a2019c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a24f1e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2019c630 con 0x7f0a20101060 2024-05-09T00:09:03.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a24f1e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2019c7a0 con 0x7f0a20106180 2024-05-09T00:09:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a24f1e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2019c960 con 0x7f0a2019bbb0 2024-05-09T00:09:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a1e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a20101060 0x7f0a201972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a1e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a20101060 0x7f0a201972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60216/0 (socket says 172.21.15.81:60216) 2024-05-09T00:09:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a1e59c700 1 -- 172.21.15.81:0/861132731 learned_addr learned my addr 172.21.15.81:0/861132731 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a1ed9d700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a2019bbb0 0x7f0a2019c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a1dd9b700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a20106180 0x7f0a20197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a1e59c700 1 -- 172.21.15.81:0/861132731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a2019bbb0 msgr2=0x7f0a2019c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a1e59c700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a2019bbb0 0x7f0a2019c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a1e59c700 1 -- 172.21.15.81:0/861132731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a20106180 msgr2=0x7f0a20197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a1e59c700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a20106180 0x7f0a20197810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a1e59c700 1 -- 172.21.15.81:0/861132731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a140095f0 con 0x7f0a20101060 2024-05-09T00:09:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a1ed9d700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a2019bbb0 0x7f0a2019c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:03.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.963+0000 7f0a1e59c700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a20101060 0x7f0a201972d0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f0a14000c00 tx=0x7f0a14009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.964+0000 7f0a0f7fe700 1 -- 172.21.15.81:0/861132731 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1401d070 con 0x7f0a20101060 2024-05-09T00:09:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.964+0000 7f0a0f7fe700 1 -- 172.21.15.81:0/861132731 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a1400fb30 con 0x7f0a20101060 2024-05-09T00:09:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.964+0000 7f0a24f1e700 1 -- 172.21.15.81:0/861132731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a201a3e60 con 0x7f0a20101060 2024-05-09T00:09:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.964+0000 7f0a0f7fe700 1 -- 172.21.15.81:0/861132731 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a14022c20 con 0x7f0a20101060 2024-05-09T00:09:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.964+0000 7f0a24f1e700 1 -- 172.21.15.81:0/861132731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a201a4220 con 0x7f0a20101060 2024-05-09T00:09:03.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.965+0000 7f0a24f1e700 1 -- 172.21.15.81:0/861132731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a201093f0 con 0x7f0a20101060 2024-05-09T00:09:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.966+0000 7f0a0f7fe700 1 -- 172.21.15.81:0/861132731 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f0a1400fca0 con 0x7f0a20101060 2024-05-09T00:09:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.966+0000 7f0a0f7fe700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a080a1290 0x7f0a080a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.967+0000 7f0a1dd9b700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a080a1290 0x7f0a080a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.967+0000 7f0a0f7fe700 1 -- 172.21.15.81:0/861132731 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f0a140ce930 con 0x7f0a20101060 2024-05-09T00:09:03.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.967+0000 7f0a1dd9b700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a080a1290 0x7f0a080a3750 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0a10005950 tx=0x7f0a100058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:03.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:03.970+0000 7f0a0f7fe700 1 -- 172.21.15.81:0/861132731 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0a14097e10 con 0x7f0a20101060 2024-05-09T00:09:04.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.215+0000 7f0a24f1e700 1 -- 172.21.15.81:0/861132731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a20102530 con 0x7f0a20101060 2024-05-09T00:09:04.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.215+0000 7f0a0f7fe700 1 -- 172.21.15.81:0/861132731 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7f0a1409b430 con 0x7f0a20101060 2024-05-09T00:09:04.211 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:09:04.211 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:09:04.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.218+0000 7f0a24f1e700 1 -- 172.21.15.81:0/861132731 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a080a1290 msgr2=0x7f0a080a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.218+0000 7f0a24f1e700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a080a1290 0x7f0a080a3750 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0a10005950 tx=0x7f0a100058e0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.218+0000 7f0a24f1e700 1 -- 172.21.15.81:0/861132731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a20101060 msgr2=0x7f0a201972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.218+0000 7f0a24f1e700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a20101060 0x7f0a201972d0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f0a14000c00 tx=0x7f0a14009580 comp rx=0 tx=0).stop 2024-05-09T00:09:04.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.218+0000 7f0a24f1e700 1 -- 172.21.15.81:0/861132731 shutdown_connections 2024-05-09T00:09:04.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.218+0000 7f0a24f1e700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a080a1290 0x7f0a080a3750 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.218+0000 7f0a24f1e700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a2019bbb0 0x7f0a2019c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.218+0000 7f0a24f1e700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a20101060 0x7f0a201972d0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.218+0000 7f0a24f1e700 1 --2- 172.21.15.81:0/861132731 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a20106180 0x7f0a20197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.218+0000 7f0a24f1e700 1 -- 172.21.15.81:0/861132731 >> 172.21.15.81:0/861132731 conn(0x7f0a20078360 msgr2=0x7f0a200ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.218+0000 7f0a24f1e700 1 -- 172.21.15.81:0/861132731 shutdown_connections 2024-05-09T00:09:04.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.218+0000 7f0a24f1e700 1 -- 172.21.15.81:0/861132731 wait complete. 2024-05-09T00:09:04.215 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:09:04.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:09:04.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.354+0000 7f657c9e8700 1 -- 172.21.15.81:0/1966877507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578100060 msgr2=0x7f6578100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.354+0000 7f657c9e8700 1 --2- 172.21.15.81:0/1966877507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578100060 0x7f6578100440 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f6568009990 tx=0x7f6568009ca0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.354+0000 7f657c9e8700 1 -- 172.21.15.81:0/1966877507 shutdown_connections 2024-05-09T00:09:04.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.354+0000 7f657c9e8700 1 --2- 172.21.15.81:0/1966877507 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6578105160 0x7f657810cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.354+0000 7f657c9e8700 1 --2- 172.21.15.81:0/1966877507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578100060 0x7f6578100440 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.354+0000 7f657c9e8700 1 --2- 172.21.15.81:0/1966877507 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6578100a10 0x7f6578104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.354+0000 7f657c9e8700 1 -- 172.21.15.81:0/1966877507 >> 172.21.15.81:0/1966877507 conn(0x7f6578076f40 msgr2=0x7f6578077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.355+0000 7f657c9e8700 1 -- 172.21.15.81:0/1966877507 shutdown_connections 2024-05-09T00:09:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.355+0000 7f657c9e8700 1 -- 172.21.15.81:0/1966877507 wait complete. 2024-05-09T00:09:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.355+0000 7f657c9e8700 1 Processor -- start 2024-05-09T00:09:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.355+0000 7f657c9e8700 1 -- start start 2024-05-09T00:09:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.355+0000 7f657c9e8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578100060 0x7f6578101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.355+0000 7f657c9e8700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6578105160 0x7f6578102010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657c9e8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6578102550 0x7f65781a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657c9e8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65781a5b50 con 0x7f6578100060 2024-05-09T00:09:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657c9e8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65781a5cc0 con 0x7f6578102550 2024-05-09T00:09:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657c9e8700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65781a5e80 con 0x7f6578105160 2024-05-09T00:09:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578100060 0x7f6578101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578100060 0x7f6578101ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60234/0 (socket says 172.21.15.81:60234) 2024-05-09T00:09:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657659c700 1 -- 172.21.15.81:0/3298365459 learned_addr learned my addr 172.21.15.81:0/3298365459 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f6575d9b700 1 --2- 172.21.15.81:0/3298365459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6578105160 0x7f6578102010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657659c700 1 -- 172.21.15.81:0/3298365459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6578105160 msgr2=0x7f6578102010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657659c700 1 --2- 172.21.15.81:0/3298365459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6578105160 0x7f6578102010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657659c700 1 -- 172.21.15.81:0/3298365459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6578102550 msgr2=0x7f65781a5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657659c700 1 --2- 172.21.15.81:0/3298365459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6578102550 0x7f65781a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657659c700 1 -- 172.21.15.81:0/3298365459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65680095f0 con 0x7f6578100060 2024-05-09T00:09:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657659c700 1 --2- 172.21.15.81:0/3298365459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578100060 0x7f6578101ad0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f6568005770 tx=0x7f6568005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f65677fe700 1 -- 172.21.15.81:0/3298365459 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656801d070 con 0x7f6578100060 2024-05-09T00:09:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657c9e8700 1 -- 172.21.15.81:0/3298365459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65781a6100 con 0x7f6578100060 2024-05-09T00:09:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f65677fe700 1 -- 172.21.15.81:0/3298365459 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6568022470 con 0x7f6578100060 2024-05-09T00:09:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f65677fe700 1 -- 172.21.15.81:0/3298365459 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568017650 con 0x7f6578100060 2024-05-09T00:09:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.356+0000 7f657c9e8700 1 -- 172.21.15.81:0/3298365459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65781a6580 con 0x7f6578100060 2024-05-09T00:09:04.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.358+0000 7f65677fe700 1 -- 172.21.15.81:0/3298365459 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f65680225e0 con 0x7f6578100060 2024-05-09T00:09:04.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.359+0000 7f65677fe700 1 --2- 172.21.15.81:0/3298365459 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f65600a1290 0x7f65600a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.359+0000 7f6575d9b700 1 --2- 172.21.15.81:0/3298365459 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f65600a1290 0x7f65600a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.359+0000 7f65677fe700 1 -- 172.21.15.81:0/3298365459 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f65680ce230 con 0x7f6578100060 2024-05-09T00:09:04.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.359+0000 7f6575d9b700 1 --2- 172.21.15.81:0/3298365459 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f65600a1290 0x7f65600a3750 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f656c005ea0 tx=0x7f656c005e30 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f6588ba2b80 1 Processor -- start 2024-05-09T00:09:04.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f6588ba2b80 1 -- start start 2024-05-09T00:09:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f6588ba2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895818e00 0x5628958191e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f6588ba2b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895819720 0x562895813350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f6588ba2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895813890 0x562895813cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f6588ba2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289576a150 con 0x562895818e00 2024-05-09T00:09:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f6588ba2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562895767b10 con 0x562895813890 2024-05-09T00:09:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f6588ba2b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x562895763400 con 0x562895819720 2024-05-09T00:09:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f657659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895818e00 0x5628958191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f657659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895818e00 0x5628958191e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60246/0 (socket says 172.21.15.81:60246) 2024-05-09T00:09:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f657659c700 1 -- 172.21.15.81:0/2978856500 learned_addr learned my addr 172.21.15.81:0/2978856500 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f6575d9b700 1 --2- 172.21.15.81:0/2978856500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895819720 0x562895813350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f6576d9d700 1 --2- 172.21.15.81:0/2978856500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895813890 0x562895813cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f657659c700 1 -- 172.21.15.81:0/2978856500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895819720 msgr2=0x562895813350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f657659c700 1 --2- 172.21.15.81:0/2978856500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895819720 0x562895813350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f657659c700 1 -- 172.21.15.81:0/2978856500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895813890 msgr2=0x562895813cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f657659c700 1 --2- 172.21.15.81:0/2978856500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895813890 0x562895813cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f657659c700 1 -- 172.21.15.81:0/2978856500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628955e43b0 con 0x562895818e00 2024-05-09T00:09:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.360+0000 7f6576d9d700 1 --2- 172.21.15.81:0/2978856500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895813890 0x562895813cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.361+0000 7f657659c700 1 --2- 172.21.15.81:0/2978856500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895818e00 0x5628958191e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f65680979f0 tx=0x7f656809b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92293a7f58dc88d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.361+0000 7f6564ff9700 1 -- 172.21.15.81:0/2978856500 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656809b4f0 con 0x562895818e00 2024-05-09T00:09:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.361+0000 7f6564ff9700 1 -- 172.21.15.81:0/2978856500 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f656809f320 con 0x562895818e00 2024-05-09T00:09:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.361+0000 7f6564ff9700 1 -- 172.21.15.81:0/2978856500 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656809a9e0 con 0x562895818e00 2024-05-09T00:09:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.361+0000 7f6588ba2b80 1 -- 172.21.15.81:0/2978856500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895818e00 msgr2=0x5628958191e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.361+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/2978856500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895818e00 0x5628958191e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f65680979f0 tx=0x7f656809b120 comp rx=0 tx=0).stop 2024-05-09T00:09:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.361+0000 7f6588ba2b80 1 -- 172.21.15.81:0/2978856500 shutdown_connections 2024-05-09T00:09:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.361+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/2978856500 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895813890 0x562895813cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.361+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/2978856500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895818e00 0x5628958191e0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.361+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/2978856500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895819720 0x562895813350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.361+0000 7f6588ba2b80 1 -- 172.21.15.81:0/2978856500 >> 172.21.15.81:0/2978856500 conn(0x562895771210 msgr2=0x56289580ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f6588ba2b80 1 -- 172.21.15.81:0/2978856500 shutdown_connections 2024-05-09T00:09:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f6588ba2b80 1 -- 172.21.15.81:0/2978856500 wait complete. 2024-05-09T00:09:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f6588ba2b80 1 -- start start 2024-05-09T00:09:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f6588ba2b80 1 Processor -- start 2024-05-09T00:09:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f6588ba2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895813890 0x56289581cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f6588ba2b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895818e00 0x56289581d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f6588ba2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895819720 0x56289581d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f6588ba2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628956ff560 con 0x562895819720 2024-05-09T00:09:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f6588ba2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628956ff200 con 0x562895813890 2024-05-09T00:09:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f6588ba2b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628955e66a0 con 0x562895818e00 2024-05-09T00:09:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f6588ba2b80 10 client.0 _ll_register_callbacks cb 0x562895708b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f6576d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895819720 0x56289581d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f6576d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895819720 0x56289581d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60262/0 (socket says 172.21.15.81:60262) 2024-05-09T00:09:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f6576d9d700 1 -- 172.21.15.81:0/1882901830 learned_addr learned my addr 172.21.15.81:0/1882901830 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.362+0000 7f657659c700 1 --2- 172.21.15.81:0/1882901830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895813890 0x56289581cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f6575d9b700 1 --2- 172.21.15.81:0/1882901830 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895818e00 0x56289581d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f6576d9d700 1 -- 172.21.15.81:0/1882901830 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895818e00 msgr2=0x56289581d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f6576d9d700 1 --2- 172.21.15.81:0/1882901830 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895818e00 0x56289581d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f6576d9d700 1 -- 172.21.15.81:0/1882901830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895813890 msgr2=0x56289581cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f6576d9d700 1 --2- 172.21.15.81:0/1882901830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895813890 0x56289581cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f6576d9d700 1 -- 172.21.15.81:0/1882901830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65781a6580 con 0x562895819720 2024-05-09T00:09:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f6576d9d700 1 --2- 172.21.15.81:0/1882901830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895819720 0x56289581d550 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6570007b60 tx=0x7f6570007e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62ef1cbaf5117a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f655dffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f655dffb700 1 -- 172.21.15.81:0/1882901830 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6570003c00 con 0x562895819720 2024-05-09T00:09:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f655dffb700 1 -- 172.21.15.81:0/1882901830 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f6570003d60 con 0x562895819720 2024-05-09T00:09:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1882901830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628956bc270 con 0x562895819720 2024-05-09T00:09:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f655dffb700 1 -- 172.21.15.81:0/1882901830 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6570004bb0 con 0x562895819720 2024-05-09T00:09:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f6588ba2b80 10 client.17145 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1882901830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562895590b60 con 0x562895819720 2024-05-09T00:09:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f655dffb700 1 -- 172.21.15.81:0/1882901830 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5628956bc270 con 0x562895819720 2024-05-09T00:09:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.363+0000 7f655dffb700 1 -- 172.21.15.81:0/1882901830 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6570004160 con 0x562895819720 2024-05-09T00:09:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.364+0000 7f6588ba2b80 10 client.17145 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.364+0000 7f6588ba2b80 10 client.17145 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:09:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.364+0000 7f6588ba2b80 20 client.17145 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.364+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/1882901830 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56289582cfd0 0x56289582f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.364+0000 7f6588ba2b80 4 client.17145 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.364+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1882901830 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628957e2810 con 0x56289582cfd0 2024-05-09T00:09:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.364+0000 7f657659c700 1 --2- 172.21.15.81:0/1882901830 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56289582cfd0 0x56289582f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.364+0000 7f655dffb700 10 client.17145 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:09:04.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.364+0000 7f657659c700 1 --2- 172.21.15.81:0/1882901830 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56289582cfd0 0x56289582f3f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f45ee56eb2d9ebe3 server_cookie=7433f0d22b40d224 in_seq=0 out_seq=0 2024-05-09T00:09:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.365+0000 7f655dffb700 1 -- 172.21.15.81:0/1882901830 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5628957e2810 con 0x56289582cfd0 2024-05-09T00:09:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.365+0000 7f655dffb700 10 client.17145 handle_command_reply: tid=0 2024-05-09T00:09:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.365+0000 7f6588ba2b80 1 client.17145 shutdown 2024-05-09T00:09:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.365+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1882901830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895819720 msgr2=0x56289581d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.365+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/1882901830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895819720 0x56289581d550 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6570007b60 tx=0x7f6570007e70 comp rx=0 tx=0).stop 2024-05-09T00:09:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.365+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1882901830 shutdown_connections 2024-05-09T00:09:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.365+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/1882901830 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56289582cfd0 0x56289582f3f0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.365+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/1882901830 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895813890 0x56289581cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.365+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/1882901830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895819720 0x56289581d550 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.365+0000 7f655dffb700 0 client.17145 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:09:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.365+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/1882901830 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895818e00 0x56289581d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.365+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1882901830 >> 172.21.15.81:0/1882901830 conn(0x562895771210 msgr2=0x56289580d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.365+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1882901830 shutdown_connections 2024-05-09T00:09:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.365+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1882901830 wait complete. 2024-05-09T00:09:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.366+0000 7f6588ba2b80 20 client.17145 trim_cache size 0 max 16384 2024-05-09T00:09:04.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:04 smithi081 ceph-mon[42474]: pgmap v186: 97 pgs: 97 active+clean; 4.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-05-09T00:09:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f6588ba2b80 1 Processor -- start 2024-05-09T00:09:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f6588ba2b80 1 -- start start 2024-05-09T00:09:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f6588ba2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895813890 0x56289580dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f6588ba2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895818e00 0x562895823ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f6588ba2b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895819720 0x562895824420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f6588ba2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289580eec0 con 0x562895813890 2024-05-09T00:09:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f6588ba2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289580f0a0 con 0x562895818e00 2024-05-09T00:09:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f6588ba2b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289580fe50 con 0x562895819720 2024-05-09T00:09:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f657659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895813890 0x56289580dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f657659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895813890 0x56289580dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60272/0 (socket says 172.21.15.81:60272) 2024-05-09T00:09:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f657659c700 1 -- 172.21.15.81:0/778923373 learned_addr learned my addr 172.21.15.81:0/778923373 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f6575d9b700 1 --2- 172.21.15.81:0/778923373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895818e00 0x562895823ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f6576d9d700 1 --2- 172.21.15.81:0/778923373 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895819720 0x562895824420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f657659c700 1 -- 172.21.15.81:0/778923373 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895819720 msgr2=0x562895824420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f657659c700 1 --2- 172.21.15.81:0/778923373 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895819720 0x562895824420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f657659c700 1 -- 172.21.15.81:0/778923373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895818e00 msgr2=0x562895823ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f657659c700 1 --2- 172.21.15.81:0/778923373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895818e00 0x562895823ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f657659c700 1 -- 172.21.15.81:0/778923373 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562895729560 con 0x562895813890 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f6576d9d700 1 --2- 172.21.15.81:0/778923373 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895819720 0x562895824420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.379+0000 7f657659c700 1 --2- 172.21.15.81:0/778923373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895813890 0x56289580dd20 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6568022890 tx=0x7f65680b3040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc5505573264f96 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.380+0000 7f65657fa700 1 -- 172.21.15.81:0/778923373 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656809b4f0 con 0x562895813890 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.380+0000 7f65657fa700 1 -- 172.21.15.81:0/778923373 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65680228e0 con 0x562895813890 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.380+0000 7f65657fa700 1 -- 172.21.15.81:0/778923373 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656809b970 con 0x562895813890 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.380+0000 7f6588ba2b80 1 -- 172.21.15.81:0/778923373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895813890 msgr2=0x56289580dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.380+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/778923373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895813890 0x56289580dd20 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6568022890 tx=0x7f65680b3040 comp rx=0 tx=0).stop 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.380+0000 7f6588ba2b80 1 -- 172.21.15.81:0/778923373 shutdown_connections 2024-05-09T00:09:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.380+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/778923373 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895819720 0x562895824420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.380+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/778923373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895813890 0x56289580dd20 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.380+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/778923373 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895818e00 0x562895823ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.380+0000 7f6588ba2b80 1 -- 172.21.15.81:0/778923373 >> 172.21.15.81:0/778923373 conn(0x562895771210 msgr2=0x562895816c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.380+0000 7f6588ba2b80 1 -- 172.21.15.81:0/778923373 shutdown_connections 2024-05-09T00:09:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.380+0000 7f6588ba2b80 1 -- 172.21.15.81:0/778923373 wait complete. 2024-05-09T00:09:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.380+0000 7f6588ba2b80 1 -- start start 2024-05-09T00:09:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f6588ba2b80 1 Processor -- start 2024-05-09T00:09:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f6588ba2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895813890 0x562895877420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f6588ba2b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895818e00 0x562895877960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f6588ba2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895819720 0x562895877ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f6588ba2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562895824830 con 0x562895813890 2024-05-09T00:09:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f6588ba2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628958824a0 con 0x562895819720 2024-05-09T00:09:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f6588ba2b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x562895882630 con 0x562895818e00 2024-05-09T00:09:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f6588ba2b80 10 client.0 _ll_register_callbacks cb 0x562895708b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f657659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895813890 0x562895877420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f657659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895813890 0x562895877420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60286/0 (socket says 172.21.15.81:60286) 2024-05-09T00:09:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f657659c700 1 -- 172.21.15.81:0/1986728296 learned_addr learned my addr 172.21.15.81:0/1986728296 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f6575d9b700 1 --2- 172.21.15.81:0/1986728296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895818e00 0x562895877960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f657659c700 1 -- 172.21.15.81:0/1986728296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895818e00 msgr2=0x562895877960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f657659c700 1 --2- 172.21.15.81:0/1986728296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895818e00 0x562895877960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f657659c700 1 -- 172.21.15.81:0/1986728296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895819720 msgr2=0x562895877ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f657659c700 1 --2- 172.21.15.81:0/1986728296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895819720 0x562895877ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f657659c700 1 -- 172.21.15.81:0/1986728296 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628955e43b0 con 0x562895813890 2024-05-09T00:09:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f6575d9b700 1 --2- 172.21.15.81:0/1986728296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895818e00 0x562895877960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f657659c700 1 --2- 172.21.15.81:0/1986728296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895813890 0x562895877420 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f6568009580 tx=0x7f65680a3a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da59b1a303e79c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.381+0000 7f655dffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.382+0000 7f655dffb700 1 -- 172.21.15.81:0/1986728296 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656809b4f0 con 0x562895813890 2024-05-09T00:09:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.382+0000 7f655dffb700 1 -- 172.21.15.81:0/1986728296 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f65680b8070 con 0x562895813890 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.382+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1986728296 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f656809f320 con 0x562895813890 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.382+0000 7f655dffb700 1 -- 172.21.15.81:0/1986728296 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f656809b750 con 0x562895813890 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.382+0000 7f6588ba2b80 10 client.17151 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.382+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1986728296 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5628955e8cd0 con 0x562895813890 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.382+0000 7f655dffb700 1 -- 172.21.15.81:0/1986728296 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f656809f320 con 0x562895813890 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.382+0000 7f655dffb700 1 -- 172.21.15.81:0/1986728296 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f65680a3b30 con 0x562895813890 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.382+0000 7f6588ba2b80 10 client.17151 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.382+0000 7f6588ba2b80 10 client.17151 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.382+0000 7f6588ba2b80 20 client.17151 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.382+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/1986728296 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5628958838e0 0x562895885d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.382+0000 7f6588ba2b80 4 client.17151 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.382+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1986728296 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56289575bec0 con 0x5628958838e0 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f6575d9b700 1 --2- 172.21.15.81:0/1986728296 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5628958838e0 0x562895885d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f655dffb700 10 client.17151 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:09:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f6575d9b700 1 --2- 172.21.15.81:0/1986728296 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5628958838e0 0x562895885d00 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4ea48af1eeab5738 server_cookie=558b1deaea874546 in_seq=0 out_seq=0 2024-05-09T00:09:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f655dffb700 1 -- 172.21.15.81:0/1986728296 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56289575bec0 con 0x5628958838e0 2024-05-09T00:09:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f655dffb700 10 client.17151 handle_command_reply: tid=0 2024-05-09T00:09:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f6588ba2b80 1 client.17151 shutdown 2024-05-09T00:09:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1986728296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895813890 msgr2=0x562895877420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/1986728296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895813890 0x562895877420 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f6568009580 tx=0x7f65680a3a60 comp rx=0 tx=0).stop 2024-05-09T00:09:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1986728296 shutdown_connections 2024-05-09T00:09:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/1986728296 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5628958838e0 0x562895885d00 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/1986728296 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562895819720 0x562895877ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/1986728296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562895813890 0x562895877420 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f6588ba2b80 1 --2- 172.21.15.81:0/1986728296 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562895818e00 0x562895877960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f655dffb700 0 client.17151 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:09:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1986728296 >> 172.21.15.81:0/1986728296 conn(0x562895771210 msgr2=0x562895819bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1986728296 shutdown_connections 2024-05-09T00:09:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f6588ba2b80 1 -- 172.21.15.81:0/1986728296 wait complete. 2024-05-09T00:09:04.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.383+0000 7f6588ba2b80 20 client.17151 trim_cache size 0 max 16384 2024-05-09T00:09:04.386 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:09:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.384+0000 7f657c9e8700 1 -- 172.21.15.81:0/3298365459 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f65600a1290 msgr2=0x7f65600a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.384+0000 7f657c9e8700 1 --2- 172.21.15.81:0/3298365459 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f65600a1290 0x7f65600a3750 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f656c005ea0 tx=0x7f656c005e30 comp rx=0 tx=0).stop 2024-05-09T00:09:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.384+0000 7f657c9e8700 1 -- 172.21.15.81:0/3298365459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578100060 msgr2=0x7f6578101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.384+0000 7f657c9e8700 1 --2- 172.21.15.81:0/3298365459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578100060 0x7f6578101ad0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f6568005770 tx=0x7f6568005e80 comp rx=0 tx=0).stop 2024-05-09T00:09:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.384+0000 7f657c9e8700 1 -- 172.21.15.81:0/3298365459 shutdown_connections 2024-05-09T00:09:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.384+0000 7f657c9e8700 1 --2- 172.21.15.81:0/3298365459 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f65600a1290 0x7f65600a3750 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.384+0000 7f657c9e8700 1 --2- 172.21.15.81:0/3298365459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6578102550 0x7f65781a5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.384+0000 7f657c9e8700 1 --2- 172.21.15.81:0/3298365459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578100060 0x7f6578101ad0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.384+0000 7f657c9e8700 1 --2- 172.21.15.81:0/3298365459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6578105160 0x7f6578102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.384+0000 7f657c9e8700 1 -- 172.21.15.81:0/3298365459 >> 172.21.15.81:0/3298365459 conn(0x7f6578076f40 msgr2=0x7f6578068370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.384+0000 7f657c9e8700 1 -- 172.21.15.81:0/3298365459 shutdown_connections 2024-05-09T00:09:04.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.384+0000 7f657c9e8700 1 -- 172.21.15.81:0/3298365459 wait complete. 2024-05-09T00:09:04.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:09:04.518 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:04 smithi150 ceph-mon[46187]: pgmap v186: 97 pgs: 97 active+clean; 4.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-05-09T00:09:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.519+0000 7ffaccdf0700 1 -- 172.21.15.81:0/3561105075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac8105640 msgr2=0x7ffac8105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.519+0000 7ffaccdf0700 1 --2- 172.21.15.81:0/3561105075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac8105640 0x7ffac8105a20 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7ffab800aad0 tx=0x7ffab800ade0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.520+0000 7ffaccdf0700 1 -- 172.21.15.81:0/3561105075 shutdown_connections 2024-05-09T00:09:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.520+0000 7ffaccdf0700 1 --2- 172.21.15.81:0/3561105075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffac80fff40 0x7ffac810c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.520+0000 7ffaccdf0700 1 --2- 172.21.15.81:0/3561105075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac8105640 0x7ffac8105a20 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.520+0000 7ffaccdf0700 1 --2- 172.21.15.81:0/3561105075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffac80ff580 0x7ffac80ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.520+0000 7ffaccdf0700 1 -- 172.21.15.81:0/3561105075 >> 172.21.15.81:0/3561105075 conn(0x7ffac80763a0 msgr2=0x7ffac80fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.520+0000 7ffaccdf0700 1 -- 172.21.15.81:0/3561105075 shutdown_connections 2024-05-09T00:09:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.520+0000 7ffaccdf0700 1 -- 172.21.15.81:0/3561105075 wait complete. 2024-05-09T00:09:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.520+0000 7ffaccdf0700 1 Processor -- start 2024-05-09T00:09:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.520+0000 7ffaccdf0700 1 -- start start 2024-05-09T00:09:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffaccdf0700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffac80ff580 0x7ffac81973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffaccdf0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac80fff40 0x7ffac81978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffaccdf0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffac8105640 0x7ffac819bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffaccdf0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac819c2c0 con 0x7ffac80fff40 2024-05-09T00:09:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffaccdf0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac819c430 con 0x7ffac8105640 2024-05-09T00:09:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffaccdf0700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac819c5f0 con 0x7ffac80ff580 2024-05-09T00:09:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffac5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac80fff40 0x7ffac81978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffac5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac80fff40 0x7ffac81978e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60296/0 (socket says 172.21.15.81:60296) 2024-05-09T00:09:04.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffac5d9b700 1 -- 172.21.15.81:0/3314258065 learned_addr learned my addr 172.21.15.81:0/3314258065 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffac6d9d700 1 --2- 172.21.15.81:0/3314258065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffac8105640 0x7ffac819bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffac5d9b700 1 -- 172.21.15.81:0/3314258065 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffac80ff580 msgr2=0x7ffac81973a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffac659c700 1 --2- 172.21.15.81:0/3314258065 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffac80ff580 0x7ffac81973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffac5d9b700 1 --2- 172.21.15.81:0/3314258065 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffac80ff580 0x7ffac81973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffac5d9b700 1 -- 172.21.15.81:0/3314258065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffac8105640 msgr2=0x7ffac819bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffac5d9b700 1 --2- 172.21.15.81:0/3314258065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffac8105640 0x7ffac819bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffac5d9b700 1 -- 172.21.15.81:0/3314258065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab800a700 con 0x7ffac80fff40 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffac5d9b700 1 --2- 172.21.15.81:0/3314258065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac80fff40 0x7ffac81978e0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00d980 tx=0x7ffabc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffab77fe700 1 -- 172.21.15.81:0/3314258065 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc00bb60 con 0x7ffac80fff40 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffab77fe700 1 -- 172.21.15.81:0/3314258065 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffabc007640 con 0x7ffac80fff40 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffaccdf0700 1 -- 172.21.15.81:0/3314258065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac819c8d0 con 0x7ffac80fff40 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffab77fe700 1 -- 172.21.15.81:0/3314258065 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc004e90 con 0x7ffac80fff40 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.521+0000 7ffaccdf0700 1 -- 172.21.15.81:0/3314258065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac81a4110 con 0x7ffac80fff40 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.523+0000 7ffab77fe700 1 -- 172.21.15.81:0/3314258065 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ffabc00bcc0 con 0x7ffac80fff40 2024-05-09T00:09:04.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.524+0000 7ffab77fe700 1 --2- 172.21.15.81:0/3314258065 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffab00a1290 0x7ffab00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.524+0000 7ffac659c700 1 --2- 172.21.15.81:0/3314258065 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffab00a1290 0x7ffab00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.524+0000 7ffab77fe700 1 -- 172.21.15.81:0/3314258065 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ffabc0ccb70 con 0x7ffac80fff40 2024-05-09T00:09:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.524+0000 7ffac659c700 1 --2- 172.21.15.81:0/3314258065 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffab00a1290 0x7ffab00a3750 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffab800c690 tx=0x7ffab8005fb0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.525+0000 7ffad8faab80 1 Processor -- start 2024-05-09T00:09:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.525+0000 7ffad8faab80 1 -- start start 2024-05-09T00:09:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.525+0000 7ffad8faab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4d2e00 0x56104d4d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.525+0000 7ffad8faab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d3720 0x56104d4cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.525+0000 7ffad8faab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4cd890 0x56104d4cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.525+0000 7ffad8faab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104d424150 con 0x56104d4d3720 2024-05-09T00:09:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.525+0000 7ffad8faab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104d421b10 con 0x56104d4d2e00 2024-05-09T00:09:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.525+0000 7ffad8faab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104d41d400 con 0x56104d4cd890 2024-05-09T00:09:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffac5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d3720 0x56104d4cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffac5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d3720 0x56104d4cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60302/0 (socket says 172.21.15.81:60302) 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffac5d9b700 1 -- 172.21.15.81:0/920737697 learned_addr learned my addr 172.21.15.81:0/920737697 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffac659c700 1 --2- 172.21.15.81:0/920737697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4d2e00 0x56104d4d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffac6d9d700 1 --2- 172.21.15.81:0/920737697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4cd890 0x56104d4cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffac5d9b700 1 -- 172.21.15.81:0/920737697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4cd890 msgr2=0x56104d4cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffac5d9b700 1 --2- 172.21.15.81:0/920737697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4cd890 0x56104d4cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffac5d9b700 1 -- 172.21.15.81:0/920737697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4d2e00 msgr2=0x56104d4d31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffac5d9b700 1 --2- 172.21.15.81:0/920737697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4d2e00 0x56104d4d31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffac5d9b700 1 -- 172.21.15.81:0/920737697 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56104d29e3b0 con 0x56104d4d3720 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffac6d9d700 1 --2- 172.21.15.81:0/920737697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4cd890 0x56104d4cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffac5d9b700 1 --2- 172.21.15.81:0/920737697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d3720 0x56104d4cd350 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0a1bd0 tx=0x7ffabc004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e21725ad3320d0d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffab4ff9700 1 -- 172.21.15.81:0/920737697 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc09dab0 con 0x56104d4d3720 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffab4ff9700 1 -- 172.21.15.81:0/920737697 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffabc0a2100 con 0x56104d4d3720 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.526+0000 7ffab4ff9700 1 -- 172.21.15.81:0/920737697 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0a1c70 con 0x56104d4d3720 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.527+0000 7ffad8faab80 1 -- 172.21.15.81:0/920737697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d3720 msgr2=0x56104d4cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.527+0000 7ffad8faab80 1 --2- 172.21.15.81:0/920737697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d3720 0x56104d4cd350 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0a1bd0 tx=0x7ffabc004840 comp rx=0 tx=0).stop 2024-05-09T00:09:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.527+0000 7ffad8faab80 1 -- 172.21.15.81:0/920737697 shutdown_connections 2024-05-09T00:09:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.527+0000 7ffad8faab80 1 --2- 172.21.15.81:0/920737697 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4d2e00 0x56104d4d31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.527+0000 7ffad8faab80 1 --2- 172.21.15.81:0/920737697 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4cd890 0x56104d4cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.527+0000 7ffad8faab80 1 --2- 172.21.15.81:0/920737697 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d3720 0x56104d4cd350 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.527+0000 7ffad8faab80 1 -- 172.21.15.81:0/920737697 >> 172.21.15.81:0/920737697 conn(0x56104d42b210 msgr2=0x56104d4c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.527+0000 7ffad8faab80 1 -- 172.21.15.81:0/920737697 shutdown_connections 2024-05-09T00:09:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.527+0000 7ffad8faab80 1 -- 172.21.15.81:0/920737697 wait complete. 2024-05-09T00:09:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.527+0000 7ffad8faab80 1 -- start start 2024-05-09T00:09:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.527+0000 7ffad8faab80 1 Processor -- start 2024-05-09T00:09:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffad8faab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4cd890 0x56104d4d6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffad8faab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4d2e00 0x56104d4d70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffad8faab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d3720 0x56104d4d75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffad8faab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104d3b9560 con 0x56104d4cd890 2024-05-09T00:09:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffad8faab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104d3b9200 con 0x56104d4d2e00 2024-05-09T00:09:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffad8faab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104d2a06a0 con 0x56104d4d3720 2024-05-09T00:09:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffad8faab80 10 client.0 _ll_register_callbacks cb 0x56104d3c2b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffac659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4cd890 0x56104d4d6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffac659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4cd890 0x56104d4d6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60308/0 (socket says 172.21.15.81:60308) 2024-05-09T00:09:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffac659c700 1 -- 172.21.15.81:0/807300716 learned_addr learned my addr 172.21.15.81:0/807300716 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffac5d9b700 1 --2- 172.21.15.81:0/807300716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4d2e00 0x56104d4d70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffac6d9d700 1 --2- 172.21.15.81:0/807300716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d3720 0x56104d4d75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffac659c700 1 -- 172.21.15.81:0/807300716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d3720 msgr2=0x56104d4d75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffac659c700 1 --2- 172.21.15.81:0/807300716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d3720 0x56104d4d75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffac659c700 1 -- 172.21.15.81:0/807300716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4d2e00 msgr2=0x56104d4d70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffac659c700 1 --2- 172.21.15.81:0/807300716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4d2e00 0x56104d4d70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffac659c700 1 -- 172.21.15.81:0/807300716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac81a4110 con 0x56104d4cd890 2024-05-09T00:09:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffac6d9d700 1 --2- 172.21.15.81:0/807300716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d3720 0x56104d4d75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:04.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffac659c700 1 --2- 172.21.15.81:0/807300716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4cd890 0x56104d4d6b70 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ffab8003fd0 tx=0x7ffab800a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d3e5b175cd4f78 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffaadffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffaadffb700 1 -- 172.21.15.81:0/807300716 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8004280 con 0x56104d4cd890 2024-05-09T00:09:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffad8faab80 1 -- 172.21.15.81:0/807300716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56104d376270 con 0x56104d4cd890 2024-05-09T00:09:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.528+0000 7ffaadffb700 1 -- 172.21.15.81:0/807300716 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ffab8012070 con 0x56104d4cd890 2024-05-09T00:09:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.529+0000 7ffaadffb700 1 -- 172.21.15.81:0/807300716 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffab8005490 con 0x56104d4cd890 2024-05-09T00:09:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.529+0000 7ffad8faab80 10 client.17163 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.529+0000 7ffad8faab80 1 -- 172.21.15.81:0/807300716 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56104d24ab60 con 0x56104d4cd890 2024-05-09T00:09:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.529+0000 7ffaadffb700 1 -- 172.21.15.81:0/807300716 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56104d376270 con 0x56104d4cd890 2024-05-09T00:09:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.529+0000 7ffaadffb700 1 -- 172.21.15.81:0/807300716 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ffab802e070 con 0x56104d4cd890 2024-05-09T00:09:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.529+0000 7ffad8faab80 10 client.17163 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.529+0000 7ffad8faab80 10 client.17163 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:09:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.529+0000 7ffad8faab80 20 client.17163 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.529+0000 7ffad8faab80 1 --2- 172.21.15.81:0/807300716 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56104d4e7120 0x56104d4e9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.529+0000 7ffad8faab80 4 client.17163 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.529+0000 7ffad8faab80 1 -- 172.21.15.81:0/807300716 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56104d49c810 con 0x56104d4e7120 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.529+0000 7ffac5d9b700 1 --2- 172.21.15.81:0/807300716 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56104d4e7120 0x56104d4e9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffaadffb700 10 client.17163 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffac5d9b700 1 --2- 172.21.15.81:0/807300716 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56104d4e7120 0x56104d4e9540 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2c5c9bb1367144f7 server_cookie=874e727e4145e8c1 in_seq=0 out_seq=0 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffaadffb700 1 -- 172.21.15.81:0/807300716 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56104d49c810 con 0x56104d4e7120 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffaadffb700 10 client.17163 handle_command_reply: tid=0 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffad8faab80 1 client.17163 shutdown 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffad8faab80 1 -- 172.21.15.81:0/807300716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4cd890 msgr2=0x56104d4d6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffad8faab80 1 --2- 172.21.15.81:0/807300716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4cd890 0x56104d4d6b70 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ffab8003fd0 tx=0x7ffab800a420 comp rx=0 tx=0).stop 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffad8faab80 1 -- 172.21.15.81:0/807300716 shutdown_connections 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffad8faab80 1 --2- 172.21.15.81:0/807300716 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56104d4e7120 0x56104d4e9540 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffad8faab80 1 --2- 172.21.15.81:0/807300716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d3720 0x56104d4d75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffad8faab80 1 --2- 172.21.15.81:0/807300716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4cd890 0x56104d4d6b70 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffaadffb700 0 client.17163 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:09:04.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffad8faab80 1 --2- 172.21.15.81:0/807300716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4d2e00 0x56104d4d70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffad8faab80 1 -- 172.21.15.81:0/807300716 >> 172.21.15.81:0/807300716 conn(0x56104d42b210 msgr2=0x56104d4c75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffad8faab80 1 -- 172.21.15.81:0/807300716 shutdown_connections 2024-05-09T00:09:04.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.530+0000 7ffad8faab80 1 -- 172.21.15.81:0/807300716 wait complete. 2024-05-09T00:09:04.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.531+0000 7ffad8faab80 20 client.17163 trim_cache size 0 max 16384 2024-05-09T00:09:04.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.543+0000 7ffad8faab80 1 Processor -- start 2024-05-09T00:09:04.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.543+0000 7ffad8faab80 1 -- start start 2024-05-09T00:09:04.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffad8faab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4cd890 0x56104d4c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffad8faab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d2e00 0x56104d4d7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffad8faab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d3720 0x56104d4de000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffad8faab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104d4d8120 con 0x56104d4d2e00 2024-05-09T00:09:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffad8faab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104d4c97e0 con 0x56104d4cd890 2024-05-09T00:09:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffad8faab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104d4c2800 con 0x56104d4d3720 2024-05-09T00:09:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffac5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d2e00 0x56104d4d7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffac5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d2e00 0x56104d4d7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60322/0 (socket says 172.21.15.81:60322) 2024-05-09T00:09:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffac5d9b700 1 -- 172.21.15.81:0/2384244519 learned_addr learned my addr 172.21.15.81:0/2384244519 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffac5d9b700 1 -- 172.21.15.81:0/2384244519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d3720 msgr2=0x56104d4de000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffac5d9b700 1 --2- 172.21.15.81:0/2384244519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d3720 0x56104d4de000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffac5d9b700 1 -- 172.21.15.81:0/2384244519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4cd890 msgr2=0x56104d4c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffac5d9b700 1 --2- 172.21.15.81:0/2384244519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4cd890 0x56104d4c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffac5d9b700 1 -- 172.21.15.81:0/2384244519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56104d3e3560 con 0x56104d4d2e00 2024-05-09T00:09:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffac5d9b700 1 --2- 172.21.15.81:0/2384244519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d2e00 0x56104d4d7410 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ffabc099c10 tx=0x7ffabc004930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd1d941d6d95822 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffab57fa700 1 -- 172.21.15.81:0/2384244519 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc063070 con 0x56104d4d2e00 2024-05-09T00:09:04.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffab57fa700 1 -- 172.21.15.81:0/2384244519 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffabc098020 con 0x56104d4d2e00 2024-05-09T00:09:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.544+0000 7ffab57fa700 1 -- 172.21.15.81:0/2384244519 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0a1c70 con 0x56104d4d2e00 2024-05-09T00:09:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 -- 172.21.15.81:0/2384244519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d2e00 msgr2=0x56104d4d7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 --2- 172.21.15.81:0/2384244519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d2e00 0x56104d4d7410 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ffabc099c10 tx=0x7ffabc004930 comp rx=0 tx=0).stop 2024-05-09T00:09:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 -- 172.21.15.81:0/2384244519 shutdown_connections 2024-05-09T00:09:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 --2- 172.21.15.81:0/2384244519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4cd890 0x56104d4c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 --2- 172.21.15.81:0/2384244519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d3720 0x56104d4de000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 --2- 172.21.15.81:0/2384244519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d2e00 0x56104d4d7410 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 -- 172.21.15.81:0/2384244519 >> 172.21.15.81:0/2384244519 conn(0x56104d42b210 msgr2=0x56104d4d5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 -- 172.21.15.81:0/2384244519 shutdown_connections 2024-05-09T00:09:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 -- 172.21.15.81:0/2384244519 wait complete. 2024-05-09T00:09:04.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 -- start start 2024-05-09T00:09:04.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 Processor -- start 2024-05-09T00:09:04.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4cd890 0x56104d4d9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d2e00 0x56104d4da520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d3720 0x56104d4daa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104d53c670 con 0x56104d4d3720 2024-05-09T00:09:04.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104d53c7b0 con 0x56104d4cd890 2024-05-09T00:09:04.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.545+0000 7ffad8faab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56104d53c8f0 con 0x56104d4d2e00 2024-05-09T00:09:04.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffad8faab80 10 client.0 _ll_register_callbacks cb 0x56104d3c2b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:04.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffac6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d3720 0x56104d4daa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffac6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d3720 0x56104d4daa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60334/0 (socket says 172.21.15.81:60334) 2024-05-09T00:09:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffac6d9d700 1 -- 172.21.15.81:0/986825393 learned_addr learned my addr 172.21.15.81:0/986825393 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffac5d9b700 1 --2- 172.21.15.81:0/986825393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d2e00 0x56104d4da520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffac6d9d700 1 -- 172.21.15.81:0/986825393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d2e00 msgr2=0x56104d4da520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffac6d9d700 1 --2- 172.21.15.81:0/986825393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d2e00 0x56104d4da520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffac6d9d700 1 -- 172.21.15.81:0/986825393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4cd890 msgr2=0x56104d4d9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffac6d9d700 1 --2- 172.21.15.81:0/986825393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4cd890 0x56104d4d9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffac6d9d700 1 -- 172.21.15.81:0/986825393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56104d29e3b0 con 0x56104d4d3720 2024-05-09T00:09:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffac6d9d700 1 --2- 172.21.15.81:0/986825393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d3720 0x56104d4daa60 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ffac00089e0 tx=0x7ffac0008da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381f4eb83e55e7b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffaadffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:04.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffaadffb700 1 -- 172.21.15.81:0/986825393 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac0011a40 con 0x56104d4d3720 2024-05-09T00:09:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffaadffb700 1 -- 172.21.15.81:0/986825393 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ffac0011ba0 con 0x56104d4d3720 2024-05-09T00:09:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffad8faab80 1 -- 172.21.15.81:0/986825393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffabc0a2100 con 0x56104d4d3720 2024-05-09T00:09:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffaadffb700 1 -- 172.21.15.81:0/986825393 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffac0011d60 con 0x56104d4d3720 2024-05-09T00:09:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffad8faab80 10 client.17169 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffad8faab80 1 -- 172.21.15.81:0/986825393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56104d2a2cd0 con 0x56104d4d3720 2024-05-09T00:09:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.546+0000 7ffaadffb700 1 -- 172.21.15.81:0/986825393 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffabc0a2100 con 0x56104d4d3720 2024-05-09T00:09:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.547+0000 7ffaadffb700 1 -- 172.21.15.81:0/986825393 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ffac00163e0 con 0x56104d4d3720 2024-05-09T00:09:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.547+0000 7ffad8faab80 10 client.17169 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.547+0000 7ffad8faab80 10 client.17169 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:09:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.547+0000 7ffad8faab80 20 client.17169 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.547+0000 7ffad8faab80 1 --2- 172.21.15.81:0/986825393 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56104d53e110 0x56104d540500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.547+0000 7ffad8faab80 4 client.17169 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:09:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.547+0000 7ffad8faab80 1 -- 172.21.15.81:0/986825393 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56104d415ec0 con 0x56104d53e110 2024-05-09T00:09:04.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.547+0000 7ffac659c700 1 --2- 172.21.15.81:0/986825393 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56104d53e110 0x56104d540500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.547+0000 7ffaadffb700 10 client.17169 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:09:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.547+0000 7ffac659c700 1 --2- 172.21.15.81:0/986825393 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56104d53e110 0x56104d540500 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5de11ee6d5e48aab server_cookie=373d908478c04fc3 in_seq=0 out_seq=0 2024-05-09T00:09:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.547+0000 7ffaadffb700 1 -- 172.21.15.81:0/986825393 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56104d415ec0 con 0x56104d53e110 2024-05-09T00:09:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.547+0000 7ffaadffb700 10 client.17169 handle_command_reply: tid=0 2024-05-09T00:09:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.547+0000 7ffad8faab80 1 client.17169 shutdown 2024-05-09T00:09:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffad8faab80 1 -- 172.21.15.81:0/986825393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d3720 msgr2=0x56104d4daa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffad8faab80 1 --2- 172.21.15.81:0/986825393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d3720 0x56104d4daa60 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ffac00089e0 tx=0x7ffac0008da0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffad8faab80 1 -- 172.21.15.81:0/986825393 shutdown_connections 2024-05-09T00:09:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffad8faab80 1 --2- 172.21.15.81:0/986825393 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x56104d53e110 0x56104d540500 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffad8faab80 1 --2- 172.21.15.81:0/986825393 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56104d4cd890 0x56104d4d9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffad8faab80 1 --2- 172.21.15.81:0/986825393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56104d4d3720 0x56104d4daa60 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffad8faab80 1 --2- 172.21.15.81:0/986825393 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56104d4d2e00 0x56104d4da520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffaadffb700 0 client.17169 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:09:04.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffad8faab80 1 -- 172.21.15.81:0/986825393 >> 172.21.15.81:0/986825393 conn(0x56104d42b210 msgr2=0x56104d4d1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffad8faab80 1 -- 172.21.15.81:0/986825393 shutdown_connections 2024-05-09T00:09:04.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffad8faab80 1 -- 172.21.15.81:0/986825393 wait complete. 2024-05-09T00:09:04.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffad8faab80 20 client.17169 trim_cache size 0 max 16384 2024-05-09T00:09:04.594 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:09:04.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffaccdf0700 1 -- 172.21.15.81:0/3314258065 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffab00a1290 msgr2=0x7ffab00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffaccdf0700 1 --2- 172.21.15.81:0/3314258065 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffab00a1290 0x7ffab00a3750 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffab800c690 tx=0x7ffab8005fb0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffaccdf0700 1 -- 172.21.15.81:0/3314258065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac80fff40 msgr2=0x7ffac81978e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffaccdf0700 1 --2- 172.21.15.81:0/3314258065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac80fff40 0x7ffac81978e0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ffabc00d980 tx=0x7ffabc00dd40 comp rx=0 tx=0).stop 2024-05-09T00:09:04.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffaccdf0700 1 -- 172.21.15.81:0/3314258065 shutdown_connections 2024-05-09T00:09:04.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffaccdf0700 1 --2- 172.21.15.81:0/3314258065 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffab00a1290 0x7ffab00a3750 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffaccdf0700 1 --2- 172.21.15.81:0/3314258065 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffac8105640 0x7ffac819bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffaccdf0700 1 --2- 172.21.15.81:0/3314258065 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffac80ff580 0x7ffac81973a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffaccdf0700 1 --2- 172.21.15.81:0/3314258065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffac80fff40 0x7ffac81978e0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffaccdf0700 1 -- 172.21.15.81:0/3314258065 >> 172.21.15.81:0/3314258065 conn(0x7ffac80763a0 msgr2=0x7ffac80fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffaccdf0700 1 -- 172.21.15.81:0/3314258065 shutdown_connections 2024-05-09T00:09:04.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.548+0000 7ffaccdf0700 1 -- 172.21.15.81:0/3314258065 wait complete. 2024-05-09T00:09:04.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:09:04.598 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:04 smithi171 ceph-mon[47351]: pgmap v186: 97 pgs: 97 active+clean; 4.5 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 36 KiB/s wr, 12 op/s 2024-05-09T00:09:04.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.728+0000 7f2848e39700 1 -- 172.21.15.81:0/1074976763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2844105160 msgr2=0x7f284410cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.728+0000 7f2848e39700 1 --2- 172.21.15.81:0/1074976763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2844105160 0x7f284410cce0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f283c00b0a0 tx=0x7f283c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.728+0000 7f2848e39700 1 -- 172.21.15.81:0/1074976763 shutdown_connections 2024-05-09T00:09:04.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.728+0000 7f2848e39700 1 --2- 172.21.15.81:0/1074976763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2844105160 0x7f284410cce0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.728+0000 7f2848e39700 1 --2- 172.21.15.81:0/1074976763 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2844100060 0x7f2844100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.728+0000 7f2848e39700 1 --2- 172.21.15.81:0/1074976763 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2844100a10 0x7f2844104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.728+0000 7f2848e39700 1 -- 172.21.15.81:0/1074976763 >> 172.21.15.81:0/1074976763 conn(0x7f2844076f40 msgr2=0x7f2844077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.728+0000 7f2848e39700 1 -- 172.21.15.81:0/1074976763 shutdown_connections 2024-05-09T00:09:04.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.728+0000 7f2848e39700 1 -- 172.21.15.81:0/1074976763 wait complete. 2024-05-09T00:09:04.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.729+0000 7f2848e39700 1 Processor -- start 2024-05-09T00:09:04.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.729+0000 7f2848e39700 1 -- start start 2024-05-09T00:09:04.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.729+0000 7f2848e39700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2844100060 0x7f2844198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.729+0000 7f2848e39700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2844105160 0x7f2844198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.729+0000 7f2848e39700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2844198d90 0x7f28441a3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.729+0000 7f2848e39700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28441a3a20 con 0x7f2844105160 2024-05-09T00:09:04.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.729+0000 7f2848e39700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28441a3b90 con 0x7f2844198d90 2024-05-09T00:09:04.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.729+0000 7f2848e39700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28441a3d50 con 0x7f2844100060 2024-05-09T00:09:04.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.729+0000 7f2841d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2844105160 0x7f2844198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.729+0000 7f2841d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2844105160 0x7f2844198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60350/0 (socket says 172.21.15.81:60350) 2024-05-09T00:09:04.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.729+0000 7f2841d9b700 1 -- 172.21.15.81:0/3967644037 learned_addr learned my addr 172.21.15.81:0/3967644037 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.729+0000 7f2842d9d700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2844198d90 0x7f28441a3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.729+0000 7f284259c700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2844100060 0x7f2844198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.730+0000 7f2841d9b700 1 -- 172.21.15.81:0/3967644037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2844100060 msgr2=0x7f2844198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.730+0000 7f2841d9b700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2844100060 0x7f2844198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.730+0000 7f2841d9b700 1 -- 172.21.15.81:0/3967644037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2844198d90 msgr2=0x7f28441a3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.730+0000 7f2841d9b700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2844198d90 0x7f28441a3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.730+0000 7f2841d9b700 1 -- 172.21.15.81:0/3967644037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c009d00 con 0x7f2844105160 2024-05-09T00:09:04.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.730+0000 7f284259c700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2844100060 0x7f2844198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:04.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.730+0000 7f2841d9b700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2844105160 0x7f2844198850 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f283800c8f0 tx=0x7f283800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.730+0000 7f28337fe700 1 -- 172.21.15.81:0/3967644037 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838007940 con 0x7f2844105160 2024-05-09T00:09:04.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.730+0000 7f28337fe700 1 -- 172.21.15.81:0/3967644037 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f283800f450 con 0x7f2844105160 2024-05-09T00:09:04.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.730+0000 7f2848e39700 1 -- 172.21.15.81:0/3967644037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28441a3fd0 con 0x7f2844105160 2024-05-09T00:09:04.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.730+0000 7f28337fe700 1 -- 172.21.15.81:0/3967644037 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838018660 con 0x7f2844105160 2024-05-09T00:09:04.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.730+0000 7f2848e39700 1 -- 172.21.15.81:0/3967644037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28441a44b0 con 0x7f2844105160 2024-05-09T00:09:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.733+0000 7f28337fe700 1 -- 172.21.15.81:0/3967644037 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f283800f5c0 con 0x7f2844105160 2024-05-09T00:09:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.733+0000 7f28337fe700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f282c0a1290 0x7f282c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.733+0000 7f284259c700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f282c0a1290 0x7f282c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.733+0000 7f28337fe700 1 -- 172.21.15.81:0/3967644037 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f28380ccb50 con 0x7f2844105160 2024-05-09T00:09:04.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.734+0000 7f2854ff3b80 1 Processor -- start 2024-05-09T00:09:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.734+0000 7f284259c700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f282c0a1290 0x7f282c0a3750 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2834005950 tx=0x7f28340058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.734+0000 7f2854ff3b80 1 -- start start 2024-05-09T00:09:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.734+0000 7f2854ff3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad547e00 0x5649ad5481e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.734+0000 7f2854ff3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad548720 0x5649ad542350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.734+0000 7f2854ff3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad542890 0x5649ad542cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.734+0000 7f2854ff3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649ad499150 con 0x5649ad547e00 2024-05-09T00:09:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.734+0000 7f2854ff3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649ad496b10 con 0x5649ad548720 2024-05-09T00:09:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.734+0000 7f2854ff3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649ad492400 con 0x5649ad542890 2024-05-09T00:09:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.734+0000 7f284259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad547e00 0x5649ad5481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.734+0000 7f284259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad547e00 0x5649ad5481e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60364/0 (socket says 172.21.15.81:60364) 2024-05-09T00:09:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.734+0000 7f284259c700 1 -- 172.21.15.81:0/618561924 learned_addr learned my addr 172.21.15.81:0/618561924 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.735+0000 7f2842d9d700 1 --2- 172.21.15.81:0/618561924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad542890 0x5649ad542cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.735+0000 7f2841d9b700 1 --2- 172.21.15.81:0/618561924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad548720 0x5649ad542350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.735+0000 7f284259c700 1 -- 172.21.15.81:0/618561924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad542890 msgr2=0x5649ad542cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.735+0000 7f284259c700 1 --2- 172.21.15.81:0/618561924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad542890 0x5649ad542cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.735+0000 7f284259c700 1 -- 172.21.15.81:0/618561924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad548720 msgr2=0x5649ad542350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.735+0000 7f284259c700 1 --2- 172.21.15.81:0/618561924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad548720 0x5649ad542350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.735+0000 7f284259c700 1 -- 172.21.15.81:0/618561924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649ad3133b0 con 0x5649ad547e00 2024-05-09T00:09:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.735+0000 7f284259c700 1 --2- 172.21.15.81:0/618561924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad547e00 0x5649ad5481e0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f283400ff00 tx=0x7f2834012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877cb63cfb503b27 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.735+0000 7f2830ff9700 1 -- 172.21.15.81:0/618561924 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2834017040 con 0x5649ad547e00 2024-05-09T00:09:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.735+0000 7f2830ff9700 1 -- 172.21.15.81:0/618561924 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2834003b40 con 0x5649ad547e00 2024-05-09T00:09:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.735+0000 7f2830ff9700 1 -- 172.21.15.81:0/618561924 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283401fcb0 con 0x5649ad547e00 2024-05-09T00:09:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.736+0000 7f2854ff3b80 1 -- 172.21.15.81:0/618561924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad547e00 msgr2=0x5649ad5481e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.736+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/618561924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad547e00 0x5649ad5481e0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f283400ff00 tx=0x7f2834012000 comp rx=0 tx=0).stop 2024-05-09T00:09:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.736+0000 7f2854ff3b80 1 -- 172.21.15.81:0/618561924 shutdown_connections 2024-05-09T00:09:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.736+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/618561924 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad542890 0x5649ad542cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.736+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/618561924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad547e00 0x5649ad5481e0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.736+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/618561924 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad548720 0x5649ad542350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.736+0000 7f2854ff3b80 1 -- 172.21.15.81:0/618561924 >> 172.21.15.81:0/618561924 conn(0x5649ad4a0210 msgr2=0x5649ad53cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.736+0000 7f2854ff3b80 1 -- 172.21.15.81:0/618561924 shutdown_connections 2024-05-09T00:09:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.736+0000 7f2854ff3b80 1 -- 172.21.15.81:0/618561924 wait complete. 2024-05-09T00:09:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.736+0000 7f2854ff3b80 1 -- start start 2024-05-09T00:09:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.736+0000 7f2854ff3b80 1 Processor -- start 2024-05-09T00:09:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2854ff3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad542890 0x5649ad54ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2854ff3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad547e00 0x5649ad54bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2854ff3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad548720 0x5649ad54c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2854ff3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649ad42e560 con 0x5649ad548720 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2854ff3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649ad42e200 con 0x5649ad542890 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2854ff3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649ad3156a0 con 0x5649ad547e00 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2854ff3b80 10 client.0 _ll_register_callbacks cb 0x5649ad437b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2842d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad548720 0x5649ad54c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2842d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad548720 0x5649ad54c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60374/0 (socket says 172.21.15.81:60374) 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2842d9d700 1 -- 172.21.15.81:0/193625300 learned_addr learned my addr 172.21.15.81:0/193625300 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f284259c700 1 --2- 172.21.15.81:0/193625300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad542890 0x5649ad54ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2841d9b700 1 --2- 172.21.15.81:0/193625300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad547e00 0x5649ad54bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2842d9d700 1 -- 172.21.15.81:0/193625300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad547e00 msgr2=0x5649ad54bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2842d9d700 1 --2- 172.21.15.81:0/193625300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad547e00 0x5649ad54bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2842d9d700 1 -- 172.21.15.81:0/193625300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad542890 msgr2=0x5649ad54ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2842d9d700 1 --2- 172.21.15.81:0/193625300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad542890 0x5649ad54ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2842d9d700 1 -- 172.21.15.81:0/193625300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283400fbe0 con 0x5649ad548720 2024-05-09T00:09:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2841d9b700 1 --2- 172.21.15.81:0/193625300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad547e00 0x5649ad54bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2842d9d700 1 --2- 172.21.15.81:0/193625300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad548720 0x5649ad54c480 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f283c015000 tx=0x7f283c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ed0a484cca26c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2829ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2829ffb700 1 -- 172.21.15.81:0/193625300 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c00e040 con 0x5649ad548720 2024-05-09T00:09:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2829ffb700 1 -- 172.21.15.81:0/193625300 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f283c0074e0 con 0x5649ad548720 2024-05-09T00:09:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2854ff3b80 1 -- 172.21.15.81:0/193625300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649ad3eb270 con 0x5649ad548720 2024-05-09T00:09:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2829ffb700 1 -- 172.21.15.81:0/193625300 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f283c0076e0 con 0x5649ad548720 2024-05-09T00:09:04.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2854ff3b80 10 client.17181 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.737+0000 7f2854ff3b80 1 -- 172.21.15.81:0/193625300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5649ad2bfb60 con 0x5649ad548720 2024-05-09T00:09:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.738+0000 7f2829ffb700 1 -- 172.21.15.81:0/193625300 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5649ad3eb270 con 0x5649ad548720 2024-05-09T00:09:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.738+0000 7f2829ffb700 1 -- 172.21.15.81:0/193625300 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f283c019070 con 0x5649ad548720 2024-05-09T00:09:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.738+0000 7f2854ff3b80 10 client.17181 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.738+0000 7f2854ff3b80 10 client.17181 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.738+0000 7f2854ff3b80 20 client.17181 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.738+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/193625300 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649ad55c0f0 0x5649ad55e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.738+0000 7f2854ff3b80 4 client.17181 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.738+0000 7f2854ff3b80 1 -- 172.21.15.81:0/193625300 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5649ad511810 con 0x5649ad55c0f0 2024-05-09T00:09:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.738+0000 7f284259c700 1 --2- 172.21.15.81:0/193625300 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649ad55c0f0 0x5649ad55e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.738+0000 7f2829ffb700 10 client.17181 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.738+0000 7f284259c700 1 --2- 172.21.15.81:0/193625300 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649ad55c0f0 0x5649ad55e510 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dced8ad36ac2d5a server_cookie=c3410fcc3be74dbd in_seq=0 out_seq=0 2024-05-09T00:09:04.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2829ffb700 1 -- 172.21.15.81:0/193625300 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5649ad511810 con 0x5649ad55c0f0 2024-05-09T00:09:04.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2829ffb700 10 client.17181 handle_command_reply: tid=0 2024-05-09T00:09:04.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2854ff3b80 1 client.17181 shutdown 2024-05-09T00:09:04.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2854ff3b80 1 -- 172.21.15.81:0/193625300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad548720 msgr2=0x5649ad54c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/193625300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad548720 0x5649ad54c480 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f283c015000 tx=0x7f283c009580 comp rx=0 tx=0).stop 2024-05-09T00:09:04.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2854ff3b80 1 -- 172.21.15.81:0/193625300 shutdown_connections 2024-05-09T00:09:04.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/193625300 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649ad55c0f0 0x5649ad55e510 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/193625300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad542890 0x5649ad54ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/193625300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad548720 0x5649ad54c480 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/193625300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad547e00 0x5649ad54bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2854ff3b80 1 -- 172.21.15.81:0/193625300 >> 172.21.15.81:0/193625300 conn(0x5649ad4a0210 msgr2=0x5649ad53c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2829ffb700 0 client.17181 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:04.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2854ff3b80 1 -- 172.21.15.81:0/193625300 shutdown_connections 2024-05-09T00:09:04.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2854ff3b80 1 -- 172.21.15.81:0/193625300 wait complete. 2024-05-09T00:09:04.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.739+0000 7f2854ff3b80 20 client.17181 trim_cache size 0 max 16384 2024-05-09T00:09:04.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.752+0000 7f2854ff3b80 1 Processor -- start 2024-05-09T00:09:04.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2854ff3b80 1 -- start start 2024-05-09T00:09:04.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2854ff3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad542890 0x5649ad542350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2854ff3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad547e00 0x5649ad53cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2854ff3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad548720 0x5649ad54a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2854ff3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649ad537800 con 0x5649ad548720 2024-05-09T00:09:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2854ff3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649ad563700 con 0x5649ad547e00 2024-05-09T00:09:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2854ff3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649ad5481e0 con 0x5649ad542890 2024-05-09T00:09:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2842d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad548720 0x5649ad54a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2842d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad548720 0x5649ad54a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60390/0 (socket says 172.21.15.81:60390) 2024-05-09T00:09:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2842d9d700 1 -- 172.21.15.81:0/1316698372 learned_addr learned my addr 172.21.15.81:0/1316698372 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f284259c700 1 --2- 172.21.15.81:0/1316698372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad542890 0x5649ad542350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2842d9d700 1 -- 172.21.15.81:0/1316698372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad542890 msgr2=0x5649ad542350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2842d9d700 1 --2- 172.21.15.81:0/1316698372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad542890 0x5649ad542350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2841d9b700 1 --2- 172.21.15.81:0/1316698372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad547e00 0x5649ad53cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2842d9d700 1 -- 172.21.15.81:0/1316698372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad547e00 msgr2=0x5649ad53cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2842d9d700 1 --2- 172.21.15.81:0/1316698372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad547e00 0x5649ad53cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2842d9d700 1 -- 172.21.15.81:0/1316698372 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649ad458560 con 0x5649ad548720 2024-05-09T00:09:04.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f2842d9d700 1 --2- 172.21.15.81:0/1316698372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad548720 0x5649ad54a2d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f283c02ffb0 tx=0x7f283c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214469f6a0006a2d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f28317fa700 1 -- 172.21.15.81:0/1316698372 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c003ab0 con 0x5649ad548720 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f28317fa700 1 -- 172.21.15.81:0/1316698372 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f283c021070 con 0x5649ad548720 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.753+0000 7f28317fa700 1 -- 172.21.15.81:0/1316698372 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0074a0 con 0x5649ad548720 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.754+0000 7f2854ff3b80 1 -- 172.21.15.81:0/1316698372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad548720 msgr2=0x5649ad54a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.754+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/1316698372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad548720 0x5649ad54a2d0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f283c02ffb0 tx=0x7f283c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.754+0000 7f2854ff3b80 1 -- 172.21.15.81:0/1316698372 shutdown_connections 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.754+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/1316698372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad548720 0x5649ad54a2d0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.754+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/1316698372 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad542890 0x5649ad542350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.754+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/1316698372 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad547e00 0x5649ad53cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.754+0000 7f2854ff3b80 1 -- 172.21.15.81:0/1316698372 >> 172.21.15.81:0/1316698372 conn(0x5649ad4a0210 msgr2=0x5649ad545b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.754+0000 7f2854ff3b80 1 -- 172.21.15.81:0/1316698372 shutdown_connections 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.754+0000 7f2854ff3b80 1 -- 172.21.15.81:0/1316698372 wait complete. 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.754+0000 7f2854ff3b80 1 -- start start 2024-05-09T00:09:04.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.754+0000 7f2854ff3b80 1 Processor -- start 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f2854ff3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad542890 0x5649ad551150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f2854ff3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad547e00 0x5649ad551690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f2854ff3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad548720 0x5649ad551bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f2854ff3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649ad5b15f0 con 0x5649ad542890 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f2854ff3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649ad5b1730 con 0x5649ad547e00 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f2854ff3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649ad5b18a0 con 0x5649ad548720 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f2854ff3b80 10 client.0 _ll_register_callbacks cb 0x5649ad437b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f284259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad542890 0x5649ad551150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f284259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad542890 0x5649ad551150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60394/0 (socket says 172.21.15.81:60394) 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f284259c700 1 -- 172.21.15.81:0/2308767808 learned_addr learned my addr 172.21.15.81:0/2308767808 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f2841d9b700 1 --2- 172.21.15.81:0/2308767808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad547e00 0x5649ad551690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f2842d9d700 1 --2- 172.21.15.81:0/2308767808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad548720 0x5649ad551bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f284259c700 1 -- 172.21.15.81:0/2308767808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad548720 msgr2=0x5649ad551bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f284259c700 1 --2- 172.21.15.81:0/2308767808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad548720 0x5649ad551bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f284259c700 1 -- 172.21.15.81:0/2308767808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad547e00 msgr2=0x5649ad551690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f284259c700 1 --2- 172.21.15.81:0/2308767808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad547e00 0x5649ad551690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f284259c700 1 -- 172.21.15.81:0/2308767808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5649ad2bfb60 con 0x5649ad542890 2024-05-09T00:09:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f284259c700 1 --2- 172.21.15.81:0/2308767808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad542890 0x5649ad551150 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f283400fed0 tx=0x7f2834003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a96702dab11b80 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.755+0000 7f2829ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2829ffb700 1 -- 172.21.15.81:0/2308767808 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2834030040 con 0x5649ad542890 2024-05-09T00:09:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2829ffb700 1 -- 172.21.15.81:0/2308767808 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2834003880 con 0x5649ad542890 2024-05-09T00:09:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2854ff3b80 1 -- 172.21.15.81:0/2308767808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2834003b40 con 0x5649ad542890 2024-05-09T00:09:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2829ffb700 1 -- 172.21.15.81:0/2308767808 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2834034a90 con 0x5649ad542890 2024-05-09T00:09:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2854ff3b80 10 client.17187 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2854ff3b80 1 -- 172.21.15.81:0/2308767808 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5649ad317cd0 con 0x5649ad542890 2024-05-09T00:09:04.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2829ffb700 1 -- 172.21.15.81:0/2308767808 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2834041020 con 0x5649ad542890 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2829ffb700 1 -- 172.21.15.81:0/2308767808 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f283401d040 con 0x5649ad542890 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2854ff3b80 10 client.17187 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2854ff3b80 10 client.17187 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2854ff3b80 20 client.17187 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/2308767808 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649ad5b3020 0x5649ad5b5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2854ff3b80 4 client.17187 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2854ff3b80 1 -- 172.21.15.81:0/2308767808 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5649ad48aec0 con 0x5649ad5b3020 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.756+0000 7f2841d9b700 1 --2- 172.21.15.81:0/2308767808 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649ad5b3020 0x5649ad5b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2841d9b700 1 --2- 172.21.15.81:0/2308767808 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649ad5b3020 0x5649ad5b5440 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9aaae99a2b26438 server_cookie=fab6ceae849edd3f in_seq=0 out_seq=0 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2829ffb700 10 client.17187 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2829ffb700 1 -- 172.21.15.81:0/2308767808 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5649ad48aec0 con 0x5649ad5b3020 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2829ffb700 10 client.17187 handle_command_reply: tid=0 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2854ff3b80 1 client.17187 shutdown 2024-05-09T00:09:04.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2854ff3b80 1 -- 172.21.15.81:0/2308767808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad542890 msgr2=0x5649ad551150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/2308767808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad542890 0x5649ad551150 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f283400fed0 tx=0x7f2834003d60 comp rx=0 tx=0).stop 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2854ff3b80 1 -- 172.21.15.81:0/2308767808 shutdown_connections 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/2308767808 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5649ad5b3020 0x5649ad5b5440 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/2308767808 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5649ad548720 0x5649ad551bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2829ffb700 0 client.17187 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/2308767808 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5649ad542890 0x5649ad551150 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2854ff3b80 1 --2- 172.21.15.81:0/2308767808 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5649ad547e00 0x5649ad551690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2854ff3b80 1 -- 172.21.15.81:0/2308767808 >> 172.21.15.81:0/2308767808 conn(0x5649ad4a0210 msgr2=0x5649ad54a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2854ff3b80 1 -- 172.21.15.81:0/2308767808 shutdown_connections 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2854ff3b80 1 -- 172.21.15.81:0/2308767808 wait complete. 2024-05-09T00:09:04.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.757+0000 7f2854ff3b80 20 client.17187 trim_cache size 0 max 16384 2024-05-09T00:09:04.761 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:09:04.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.758+0000 7f2848e39700 1 -- 172.21.15.81:0/3967644037 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f282c0a1290 msgr2=0x7f282c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.758+0000 7f2848e39700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f282c0a1290 0x7f282c0a3750 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2834005950 tx=0x7f28340058e0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.758+0000 7f2848e39700 1 -- 172.21.15.81:0/3967644037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2844105160 msgr2=0x7f2844198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.758+0000 7f2848e39700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2844105160 0x7f2844198850 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f283800c8f0 tx=0x7f283800cc00 comp rx=0 tx=0).stop 2024-05-09T00:09:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.758+0000 7f2848e39700 1 -- 172.21.15.81:0/3967644037 shutdown_connections 2024-05-09T00:09:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.758+0000 7f2848e39700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f282c0a1290 0x7f282c0a3750 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.758+0000 7f2848e39700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2844198d90 0x7f28441a3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.758+0000 7f2848e39700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2844100060 0x7f2844198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.758+0000 7f2848e39700 1 --2- 172.21.15.81:0/3967644037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2844105160 0x7f2844198850 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.758+0000 7f2848e39700 1 -- 172.21.15.81:0/3967644037 >> 172.21.15.81:0/3967644037 conn(0x7f2844076f40 msgr2=0x7f28440fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.758+0000 7f2848e39700 1 -- 172.21.15.81:0/3967644037 shutdown_connections 2024-05-09T00:09:04.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:04.758+0000 7f2848e39700 1 -- 172.21.15.81:0/3967644037 wait complete. 2024-05-09T00:09:05.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:05 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/861132731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:09:05.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:05 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/861132731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:09:05.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:05 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/861132731' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:09:05.766 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:09:05.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:09:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.910+0000 7fa405435700 1 -- 172.21.15.81:0/2018279244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa400104e50 msgr2=0x7fa400105230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.910+0000 7fa405435700 1 --2- 172.21.15.81:0/2018279244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa400104e50 0x7fa400105230 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fa3f40099c0 tx=0x7fa3f4009cd0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.910+0000 7fa405435700 1 -- 172.21.15.81:0/2018279244 shutdown_connections 2024-05-09T00:09:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.910+0000 7fa405435700 1 --2- 172.21.15.81:0/2018279244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4001013a0 0x7fa40010cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.910+0000 7fa405435700 1 --2- 172.21.15.81:0/2018279244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa400104e50 0x7fa400105230 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.910+0000 7fa405435700 1 --2- 172.21.15.81:0/2018279244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4001009e0 0x7fa400100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.910+0000 7fa405435700 1 -- 172.21.15.81:0/2018279244 >> 172.21.15.81:0/2018279244 conn(0x7fa400075070 msgr2=0x7fa400075480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:05.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.910+0000 7fa405435700 1 -- 172.21.15.81:0/2018279244 shutdown_connections 2024-05-09T00:09:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.910+0000 7fa405435700 1 -- 172.21.15.81:0/2018279244 wait complete. 2024-05-09T00:09:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.911+0000 7fa405435700 1 Processor -- start 2024-05-09T00:09:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.911+0000 7fa405435700 1 -- start start 2024-05-09T00:09:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.911+0000 7fa405435700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4001009e0 0x7fa400198140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.911+0000 7fa405435700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4001013a0 0x7fa400198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.911+0000 7fa405435700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa400104e50 0x7fa4001a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.911+0000 7fa405435700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa400198ed0 con 0x7fa400104e50 2024-05-09T00:09:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.911+0000 7fa405435700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4001a3700 con 0x7fa4001013a0 2024-05-09T00:09:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.911+0000 7fa405435700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4001a3840 con 0x7fa4001009e0 2024-05-09T00:09:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.911+0000 7fa3ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa400104e50 0x7fa4001a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.911+0000 7fa3ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa400104e50 0x7fa4001a31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60414/0 (socket says 172.21.15.81:60414) 2024-05-09T00:09:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa3ff7fe700 1 -- 172.21.15.81:0/4199614703 learned_addr learned my addr 172.21.15.81:0/4199614703 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa3fe7fc700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4001013a0 0x7fa400198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa3feffd700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4001009e0 0x7fa400198140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa3ff7fe700 1 -- 172.21.15.81:0/4199614703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4001009e0 msgr2=0x7fa400198140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa3ff7fe700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4001009e0 0x7fa400198140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa3ff7fe700 1 -- 172.21.15.81:0/4199614703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4001013a0 msgr2=0x7fa400198680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa3ff7fe700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4001013a0 0x7fa400198680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa3ff7fe700 1 -- 172.21.15.81:0/4199614703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f40095f0 con 0x7fa400104e50 2024-05-09T00:09:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa3feffd700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4001009e0 0x7fa400198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa3ff7fe700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa400104e50 0x7fa4001a31c0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8007f10 tx=0x7fa3f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa3e7fff700 1 -- 172.21.15.81:0/4199614703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8017070 con 0x7fa400104e50 2024-05-09T00:09:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa3e7fff700 1 -- 172.21.15.81:0/4199614703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3f800f040 con 0x7fa400104e50 2024-05-09T00:09:05.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa405435700 1 -- 172.21.15.81:0/4199614703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4001a3aa0 con 0x7fa400104e50 2024-05-09T00:09:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa3e7fff700 1 -- 172.21.15.81:0/4199614703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8005740 con 0x7fa400104e50 2024-05-09T00:09:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.912+0000 7fa405435700 1 -- 172.21.15.81:0/4199614703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4001a3f60 con 0x7fa400104e50 2024-05-09T00:09:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.914+0000 7fa3e7fff700 1 -- 172.21.15.81:0/4199614703 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa3f80058a0 con 0x7fa400104e50 2024-05-09T00:09:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.915+0000 7fa3e7fff700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3e80a1290 0x7fa3e80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.915+0000 7fa3feffd700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3e80a1290 0x7fa3e80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.915+0000 7fa3e7fff700 1 -- 172.21.15.81:0/4199614703 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa3f80cc510 con 0x7fa400104e50 2024-05-09T00:09:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.915+0000 7fa3feffd700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3e80a1290 0x7fa3e80a3750 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4006010 tx=0x7fa3f4009f10 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa4115efb80 1 Processor -- start 2024-05-09T00:09:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa4115efb80 1 -- start start 2024-05-09T00:09:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa4115efb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874b290 0x55f45874b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa4115efb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874bbb0 0x55f4587457e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa4115efb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f458746160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa4115efb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4586981d0 con 0x55f45874bbb0 2024-05-09T00:09:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa4115efb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f458695b90 con 0x55f45874b290 2024-05-09T00:09:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa4115efb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f458691480 con 0x55f458745d20 2024-05-09T00:09:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa3fe7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874bbb0 0x55f4587457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa3fe7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874bbb0 0x55f4587457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60426/0 (socket says 172.21.15.81:60426) 2024-05-09T00:09:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa3fe7fc700 1 -- 172.21.15.81:0/4136390546 learned_addr learned my addr 172.21.15.81:0/4136390546 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa3ff7fe700 1 --2- 172.21.15.81:0/4136390546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f458746160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa3fe7fc700 1 -- 172.21.15.81:0/4136390546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 msgr2=0x55f458746160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa3fe7fc700 1 --2- 172.21.15.81:0/4136390546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f458746160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa3fe7fc700 1 -- 172.21.15.81:0/4136390546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874b290 msgr2=0x55f45874b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa3feffd700 1 --2- 172.21.15.81:0/4136390546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874b290 0x55f45874b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa3fe7fc700 1 --2- 172.21.15.81:0/4136390546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874b290 0x55f45874b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.916+0000 7fa3fe7fc700 1 -- 172.21.15.81:0/4136390546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f458512430 con 0x55f45874bbb0 2024-05-09T00:09:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.917+0000 7fa3fe7fc700 1 --2- 172.21.15.81:0/4136390546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874bbb0 0x55f4587457e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000bd30 tx=0x7fa3f00106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57b8a182d633bee server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.917+0000 7fa3e57fa700 1 -- 172.21.15.81:0/4136390546 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0010ec0 con 0x55f45874bbb0 2024-05-09T00:09:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.917+0000 7fa3e57fa700 1 -- 172.21.15.81:0/4136390546 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3f0015070 con 0x55f45874bbb0 2024-05-09T00:09:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.917+0000 7fa3e57fa700 1 -- 172.21.15.81:0/4136390546 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0011440 con 0x55f45874bbb0 2024-05-09T00:09:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.917+0000 7fa4115efb80 1 -- 172.21.15.81:0/4136390546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874bbb0 msgr2=0x55f4587457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.917+0000 7fa4115efb80 1 --2- 172.21.15.81:0/4136390546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874bbb0 0x55f4587457e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000bd30 tx=0x7fa3f00106b0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.917+0000 7fa4115efb80 1 -- 172.21.15.81:0/4136390546 shutdown_connections 2024-05-09T00:09:05.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.917+0000 7fa4115efb80 1 --2- 172.21.15.81:0/4136390546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874b290 0x55f45874b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.917+0000 7fa4115efb80 1 --2- 172.21.15.81:0/4136390546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f458746160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.917+0000 7fa4115efb80 1 --2- 172.21.15.81:0/4136390546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874bbb0 0x55f4587457e0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.917+0000 7fa4115efb80 1 -- 172.21.15.81:0/4136390546 >> 172.21.15.81:0/4136390546 conn(0x55f45869f290 msgr2=0x55f45873be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.918+0000 7fa4115efb80 1 -- 172.21.15.81:0/4136390546 shutdown_connections 2024-05-09T00:09:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.918+0000 7fa4115efb80 1 -- 172.21.15.81:0/4136390546 wait complete. 2024-05-09T00:09:05.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.918+0000 7fa4115efb80 1 -- start start 2024-05-09T00:09:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.918+0000 7fa4115efb80 1 Processor -- start 2024-05-09T00:09:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.918+0000 7fa4115efb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f458751c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.918+0000 7fa4115efb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874b290 0x55f45874ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.918+0000 7fa4115efb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874bbb0 0x55f45874f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.918+0000 7fa4115efb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f45862d5e0 con 0x55f45874b290 2024-05-09T00:09:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.918+0000 7fa4115efb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f45862d280 con 0x55f45874bbb0 2024-05-09T00:09:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.918+0000 7fa4115efb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f458514720 con 0x55f458745d20 2024-05-09T00:09:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.918+0000 7fa4115efb80 10 client.0 _ll_register_callbacks cb 0x55f458636bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:05.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.918+0000 7fa3fe7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874b290 0x55f45874ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3fe7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874b290 0x55f45874ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60428/0 (socket says 172.21.15.81:60428) 2024-05-09T00:09:05.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3fe7fc700 1 -- 172.21.15.81:0/1982472868 learned_addr learned my addr 172.21.15.81:0/1982472868 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3feffd700 1 --2- 172.21.15.81:0/1982472868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f458751c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3ff7fe700 1 --2- 172.21.15.81:0/1982472868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874bbb0 0x55f45874f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3fe7fc700 1 -- 172.21.15.81:0/1982472868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 msgr2=0x55f458751c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3fe7fc700 1 --2- 172.21.15.81:0/1982472868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f458751c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3fe7fc700 1 -- 172.21.15.81:0/1982472868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874bbb0 msgr2=0x55f45874f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:05.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3fe7fc700 1 --2- 172.21.15.81:0/1982472868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874bbb0 0x55f45874f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3fe7fc700 1 -- 172.21.15.81:0/1982472868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3f000b960 con 0x55f45874b290 2024-05-09T00:09:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3fe7fc700 1 --2- 172.21.15.81:0/1982472868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874b290 0x55f45874ee80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000b900 tx=0x7fa3f0003920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be87e9711fc15ff0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:05.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3e2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3e2ff5700 1 -- 172.21.15.81:0/1982472868 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0005250 con 0x55f45874b290 2024-05-09T00:09:05.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3e2ff5700 1 -- 172.21.15.81:0/1982472868 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa3f0017070 con 0x55f45874b290 2024-05-09T00:09:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa4115efb80 1 -- 172.21.15.81:0/1982472868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4585ea2f0 con 0x55f45874b290 2024-05-09T00:09:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3e2ff5700 1 -- 172.21.15.81:0/1982472868 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3f00053b0 con 0x55f45874b290 2024-05-09T00:09:05.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa4115efb80 10 client.17199 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:05.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa4115efb80 1 -- 172.21.15.81:0/1982472868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f4584bebe0 con 0x55f45874b290 2024-05-09T00:09:05.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.919+0000 7fa3e2ff5700 1 -- 172.21.15.81:0/1982472868 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3f0031020 con 0x55f45874b290 2024-05-09T00:09:05.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.920+0000 7fa3e2ff5700 1 -- 172.21.15.81:0/1982472868 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa3f0011670 con 0x55f45874b290 2024-05-09T00:09:05.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.920+0000 7fa4115efb80 10 client.17199 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:05.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.920+0000 7fa4115efb80 10 client.17199 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:05.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.920+0000 7fa4115efb80 20 client.17199 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:05.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.920+0000 7fa4115efb80 1 --2- 172.21.15.81:0/1982472868 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f45875f5d0 0x55f4587619f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.920+0000 7fa4115efb80 4 client.17199 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:05.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.920+0000 7fa4115efb80 1 -- 172.21.15.81:0/1982472868 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f458710890 con 0x55f45875f5d0 2024-05-09T00:09:05.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.920+0000 7fa3feffd700 1 --2- 172.21.15.81:0/1982472868 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f45875f5d0 0x55f4587619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.920+0000 7fa3feffd700 1 --2- 172.21.15.81:0/1982472868 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f45875f5d0 0x55f4587619f0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1fd3c0948f0642 server_cookie=97f30581c81384fc in_seq=0 out_seq=0 2024-05-09T00:09:05.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.920+0000 7fa3e2ff5700 10 client.17199 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:05.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa3e2ff5700 1 -- 172.21.15.81:0/1982472868 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f458710890 con 0x55f45875f5d0 2024-05-09T00:09:05.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa3e2ff5700 10 client.17199 handle_command_reply: tid=0 2024-05-09T00:09:05.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa4115efb80 1 client.17199 shutdown 2024-05-09T00:09:05.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa4115efb80 1 -- 172.21.15.81:0/1982472868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874b290 msgr2=0x55f45874ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa4115efb80 1 --2- 172.21.15.81:0/1982472868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874b290 0x55f45874ee80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000b900 tx=0x7fa3f0003920 comp rx=0 tx=0).stop 2024-05-09T00:09:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa4115efb80 1 -- 172.21.15.81:0/1982472868 shutdown_connections 2024-05-09T00:09:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa4115efb80 1 --2- 172.21.15.81:0/1982472868 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f45875f5d0 0x55f4587619f0 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa4115efb80 1 --2- 172.21.15.81:0/1982472868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874bbb0 0x55f45874f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa3e2ff5700 0 client.17199 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa4115efb80 1 --2- 172.21.15.81:0/1982472868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f458751c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa4115efb80 1 --2- 172.21.15.81:0/1982472868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874b290 0x55f45874ee80 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa4115efb80 1 -- 172.21.15.81:0/1982472868 >> 172.21.15.81:0/1982472868 conn(0x55f45869f290 msgr2=0x55f45873b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa4115efb80 1 -- 172.21.15.81:0/1982472868 shutdown_connections 2024-05-09T00:09:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa4115efb80 1 -- 172.21.15.81:0/1982472868 wait complete. 2024-05-09T00:09:05.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.921+0000 7fa4115efb80 20 client.17199 trim_cache size 0 max 16384 2024-05-09T00:09:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.938+0000 7fa4115efb80 1 Processor -- start 2024-05-09T00:09:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.938+0000 7fa4115efb80 1 -- start start 2024-05-09T00:09:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa4115efb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f45873bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa4115efb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874b290 0x55f458751730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa4115efb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874bbb0 0x55f458756640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa4115efb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f458750540 con 0x55f45874bbb0 2024-05-09T00:09:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa4115efb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f458738e70 con 0x55f45874b290 2024-05-09T00:09:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa4115efb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f458766bc0 con 0x55f458745d20 2024-05-09T00:09:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874bbb0 0x55f458756640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3ff7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874bbb0 0x55f458756640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60444/0 (socket says 172.21.15.81:60444) 2024-05-09T00:09:05.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3ff7fe700 1 -- 172.21.15.81:0/3005552297 learned_addr learned my addr 172.21.15.81:0/3005552297 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3feffd700 1 --2- 172.21.15.81:0/3005552297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f45873bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3ff7fe700 1 -- 172.21.15.81:0/3005552297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 msgr2=0x55f45873bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3fe7fc700 1 --2- 172.21.15.81:0/3005552297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874b290 0x55f458751730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3ff7fe700 1 --2- 172.21.15.81:0/3005552297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f45873bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3ff7fe700 1 -- 172.21.15.81:0/3005552297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874b290 msgr2=0x55f458751730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3ff7fe700 1 --2- 172.21.15.81:0/3005552297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874b290 0x55f458751730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3ff7fe700 1 -- 172.21.15.81:0/3005552297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f458738560 con 0x55f45874bbb0 2024-05-09T00:09:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3feffd700 1 --2- 172.21.15.81:0/3005552297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f45873bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3fe7fc700 1 --2- 172.21.15.81:0/3005552297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874b290 0x55f458751730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3ff7fe700 1 --2- 172.21.15.81:0/3005552297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874bbb0 0x55f458756640 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8095ae0 tx=0x7fa3f8084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb247cc3c46c4ad server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3e5ffb700 1 -- 172.21.15.81:0/3005552297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f80995e0 con 0x55f45874bbb0 2024-05-09T00:09:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3e5ffb700 1 -- 172.21.15.81:0/3005552297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3f809d410 con 0x55f45874bbb0 2024-05-09T00:09:05.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.939+0000 7fa3e5ffb700 1 -- 172.21.15.81:0/3005552297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8095eb0 con 0x55f45874bbb0 2024-05-09T00:09:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 -- 172.21.15.81:0/3005552297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874bbb0 msgr2=0x55f458756640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 --2- 172.21.15.81:0/3005552297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874bbb0 0x55f458756640 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8095ae0 tx=0x7fa3f8084040 comp rx=0 tx=0).stop 2024-05-09T00:09:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 -- 172.21.15.81:0/3005552297 shutdown_connections 2024-05-09T00:09:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 --2- 172.21.15.81:0/3005552297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874bbb0 0x55f458756640 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 --2- 172.21.15.81:0/3005552297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f45873bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 --2- 172.21.15.81:0/3005552297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874b290 0x55f458751730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 -- 172.21.15.81:0/3005552297 >> 172.21.15.81:0/3005552297 conn(0x55f45869f290 msgr2=0x55f45875b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 -- 172.21.15.81:0/3005552297 shutdown_connections 2024-05-09T00:09:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 -- 172.21.15.81:0/3005552297 wait complete. 2024-05-09T00:09:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 -- start start 2024-05-09T00:09:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 Processor -- start 2024-05-09T00:09:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f458756650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874b290 0x55f458756b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874bbb0 0x55f458754700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f458754e10 con 0x55f45874b290 2024-05-09T00:09:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f458754f80 con 0x55f45874bbb0 2024-05-09T00:09:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f458755140 con 0x55f458745d20 2024-05-09T00:09:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.940+0000 7fa4115efb80 10 client.0 _ll_register_callbacks cb 0x55f458636bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3fe7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874b290 0x55f458756b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3fe7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874b290 0x55f458756b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60450/0 (socket says 172.21.15.81:60450) 2024-05-09T00:09:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3fe7fc700 1 -- 172.21.15.81:0/3182337193 learned_addr learned my addr 172.21.15.81:0/3182337193 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3ff7fe700 1 --2- 172.21.15.81:0/3182337193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874bbb0 0x55f458754700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3fe7fc700 1 -- 172.21.15.81:0/3182337193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 msgr2=0x55f458756650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3fe7fc700 1 --2- 172.21.15.81:0/3182337193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f458756650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3fe7fc700 1 -- 172.21.15.81:0/3182337193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874bbb0 msgr2=0x55f458754700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3fe7fc700 1 --2- 172.21.15.81:0/3182337193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874bbb0 0x55f458754700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3fe7fc700 1 -- 172.21.15.81:0/3182337193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4001a3f60 con 0x55f45874b290 2024-05-09T00:09:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3ff7fe700 1 --2- 172.21.15.81:0/3182337193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874bbb0 0x55f458754700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3fe7fc700 1 --2- 172.21.15.81:0/3182337193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874b290 0x55f458756b90 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c010 tx=0x7fa3f000b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e638de99a67df98 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3e2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3e2ff5700 1 -- 172.21.15.81:0/3182337193 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0003e10 con 0x55f45874b290 2024-05-09T00:09:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3e2ff5700 1 -- 172.21.15.81:0/3182337193 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fa3f0017070 con 0x55f45874b290 2024-05-09T00:09:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa4115efb80 1 -- 172.21.15.81:0/3182337193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa3f0015070 con 0x55f45874b290 2024-05-09T00:09:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3e2ff5700 1 -- 172.21.15.81:0/3182337193 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3f0011cf0 con 0x55f45874b290 2024-05-09T00:09:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa4115efb80 10 client.17205 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa4115efb80 1 -- 172.21.15.81:0/3182337193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f4586575e0 con 0x55f45874b290 2024-05-09T00:09:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.941+0000 7fa3e2ff5700 1 -- 172.21.15.81:0/3182337193 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3f0015070 con 0x55f45874b290 2024-05-09T00:09:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.942+0000 7fa3e2ff5700 1 -- 172.21.15.81:0/3182337193 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa3f0024690 con 0x55f45874b290 2024-05-09T00:09:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.942+0000 7fa4115efb80 10 client.17205 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.942+0000 7fa4115efb80 10 client.17205 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.942+0000 7fa4115efb80 20 client.17205 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.942+0000 7fa4115efb80 1 --2- 172.21.15.81:0/3182337193 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f4587b7a00 0x55f4587b9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.942+0000 7fa4115efb80 4 client.17205 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:09:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.942+0000 7fa4115efb80 1 -- 172.21.15.81:0/3182337193 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f458689f40 con 0x55f4587b7a00 2024-05-09T00:09:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.942+0000 7fa3feffd700 1 --2- 172.21.15.81:0/3182337193 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f4587b7a00 0x55f4587b9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.942+0000 7fa3e2ff5700 10 client.17205 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.942+0000 7fa3feffd700 1 --2- 172.21.15.81:0/3182337193 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f4587b7a00 0x55f4587b9e20 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b21de9f0cb81138 server_cookie=89f42eec549aad44 in_seq=0 out_seq=0 2024-05-09T00:09:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.943+0000 7fa3e2ff5700 1 -- 172.21.15.81:0/3182337193 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f458689f40 con 0x55f4587b7a00 2024-05-09T00:09:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.943+0000 7fa3e2ff5700 10 client.17205 handle_command_reply: tid=0 2024-05-09T00:09:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.943+0000 7fa4115efb80 1 client.17205 shutdown 2024-05-09T00:09:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.943+0000 7fa4115efb80 1 -- 172.21.15.81:0/3182337193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874b290 msgr2=0x55f458756b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.943+0000 7fa4115efb80 1 --2- 172.21.15.81:0/3182337193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874b290 0x55f458756b90 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c010 tx=0x7fa3f000b410 comp rx=0 tx=0).stop 2024-05-09T00:09:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.943+0000 7fa4115efb80 1 -- 172.21.15.81:0/3182337193 shutdown_connections 2024-05-09T00:09:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.943+0000 7fa4115efb80 1 --2- 172.21.15.81:0/3182337193 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f4587b7a00 0x55f4587b9e20 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.943+0000 7fa4115efb80 1 --2- 172.21.15.81:0/3182337193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f45874bbb0 0x55f458754700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.943+0000 7fa3e2ff5700 0 client.17205 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.943+0000 7fa4115efb80 1 --2- 172.21.15.81:0/3182337193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f458745d20 0x55f458756650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.943+0000 7fa4115efb80 1 --2- 172.21.15.81:0/3182337193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f45874b290 0x55f458756b90 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa4115efb80 1 -- 172.21.15.81:0/3182337193 >> 172.21.15.81:0/3182337193 conn(0x55f45869f290 msgr2=0x55f458749f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:05.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa4115efb80 1 -- 172.21.15.81:0/3182337193 shutdown_connections 2024-05-09T00:09:05.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa4115efb80 1 -- 172.21.15.81:0/3182337193 wait complete. 2024-05-09T00:09:05.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa4115efb80 20 client.17205 trim_cache size 0 max 16384 2024-05-09T00:09:05.954 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:09:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:09:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "056393d5-fe1c-4f74-a090-4ab63ab2206c", 2024-05-09T00:09:05.954 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:09:05.954 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:09:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa405435700 1 -- 172.21.15.81:0/4199614703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3e80a1290 msgr2=0x7fa3e80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa405435700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3e80a1290 0x7fa3e80a3750 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4006010 tx=0x7fa3f4009f10 comp rx=0 tx=0).stop 2024-05-09T00:09:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa405435700 1 -- 172.21.15.81:0/4199614703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa400104e50 msgr2=0x7fa4001a31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa405435700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa400104e50 0x7fa4001a31c0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8007f10 tx=0x7fa3f800d3b0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa405435700 1 -- 172.21.15.81:0/4199614703 shutdown_connections 2024-05-09T00:09:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa405435700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3e80a1290 0x7fa3e80a3750 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa405435700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa400104e50 0x7fa4001a31c0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa405435700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa4001009e0 0x7fa400198140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa405435700 1 --2- 172.21.15.81:0/4199614703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4001013a0 0x7fa400198680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa405435700 1 -- 172.21.15.81:0/4199614703 >> 172.21.15.81:0/4199614703 conn(0x7fa400075070 msgr2=0x7fa4000fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa405435700 1 -- 172.21.15.81:0/4199614703 shutdown_connections 2024-05-09T00:09:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:05.944+0000 7fa405435700 1 -- 172.21.15.81:0/4199614703 wait complete. 2024-05-09T00:09:05.959 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:09:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.088+0000 7ff5caa5f700 1 -- 172.21.15.81:0/1749184215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c4101b30 msgr2=0x7ff5c4105b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.088+0000 7ff5caa5f700 1 --2- 172.21.15.81:0/1749184215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c4101b30 0x7ff5c4105b70 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009990 tx=0x7ff5ac009ca0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.088+0000 7ff5caa5f700 1 -- 172.21.15.81:0/1749184215 shutdown_connections 2024-05-09T00:09:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.088+0000 7ff5caa5f700 1 --2- 172.21.15.81:0/1749184215 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c4101180 0x7ff5c4101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.088+0000 7ff5caa5f700 1 --2- 172.21.15.81:0/1749184215 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5c41062a0 0x7ff5c410de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.088+0000 7ff5caa5f700 1 --2- 172.21.15.81:0/1749184215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c4101b30 0x7ff5c4105b70 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.088+0000 7ff5caa5f700 1 -- 172.21.15.81:0/1749184215 >> 172.21.15.81:0/1749184215 conn(0x7ff5c40fc9e0 msgr2=0x7ff5c40fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:06.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.088+0000 7ff5caa5f700 1 -- 172.21.15.81:0/1749184215 shutdown_connections 2024-05-09T00:09:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.088+0000 7ff5caa5f700 1 -- 172.21.15.81:0/1749184215 wait complete. 2024-05-09T00:09:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.089+0000 7ff5caa5f700 1 Processor -- start 2024-05-09T00:09:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.089+0000 7ff5caa5f700 1 -- start start 2024-05-09T00:09:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.089+0000 7ff5caa5f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5c4101180 0x7ff5c40732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.089+0000 7ff5caa5f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c41062a0 0x7ff5c40737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.089+0000 7ff5caa5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c4073d20 0x7ff5c41a5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.089+0000 7ff5caa5f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c41a5bf0 con 0x7ff5c4073d20 2024-05-09T00:09:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.089+0000 7ff5caa5f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c41a5d60 con 0x7ff5c41062a0 2024-05-09T00:09:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.089+0000 7ff5caa5f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c41a5f20 con 0x7ff5c4101180 2024-05-09T00:09:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.089+0000 7ff5c8ffc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c4073d20 0x7ff5c41a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.089+0000 7ff5c8ffc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c4073d20 0x7ff5c41a5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60456/0 (socket says 172.21.15.81:60456) 2024-05-09T00:09:06.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.089+0000 7ff5c8ffc700 1 -- 172.21.15.81:0/2237426128 learned_addr learned my addr 172.21.15.81:0/2237426128 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.089+0000 7ff5c3fff700 1 --2- 172.21.15.81:0/2237426128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5c4101180 0x7ff5c40732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.089+0000 7ff5c37fe700 1 --2- 172.21.15.81:0/2237426128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c41062a0 0x7ff5c40737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.090+0000 7ff5c8ffc700 1 -- 172.21.15.81:0/2237426128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5c4101180 msgr2=0x7ff5c40732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.090+0000 7ff5c8ffc700 1 --2- 172.21.15.81:0/2237426128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5c4101180 0x7ff5c40732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.090+0000 7ff5c8ffc700 1 -- 172.21.15.81:0/2237426128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c41062a0 msgr2=0x7ff5c40737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.090+0000 7ff5c8ffc700 1 --2- 172.21.15.81:0/2237426128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c41062a0 0x7ff5c40737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.090+0000 7ff5c8ffc700 1 -- 172.21.15.81:0/2237426128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac0095f0 con 0x7ff5c4073d20 2024-05-09T00:09:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.090+0000 7ff5c8ffc700 1 --2- 172.21.15.81:0/2237426128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c4073d20 0x7ff5c41a5620 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00b970 tx=0x7ff5bc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.090+0000 7ff5c17fa700 1 -- 172.21.15.81:0/2237426128 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00c930 con 0x7ff5c4073d20 2024-05-09T00:09:06.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.090+0000 7ff5c17fa700 1 -- 172.21.15.81:0/2237426128 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5bc014440 con 0x7ff5c4073d20 2024-05-09T00:09:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.090+0000 7ff5caa5f700 1 -- 172.21.15.81:0/2237426128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c41a6200 con 0x7ff5c4073d20 2024-05-09T00:09:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.090+0000 7ff5c17fa700 1 -- 172.21.15.81:0/2237426128 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0075d0 con 0x7ff5c4073d20 2024-05-09T00:09:06.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.090+0000 7ff5caa5f700 1 -- 172.21.15.81:0/2237426128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c41a6710 con 0x7ff5c4073d20 2024-05-09T00:09:06.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.092+0000 7ff5c17fa700 1 -- 172.21.15.81:0/2237426128 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ff5bc0145b0 con 0x7ff5c4073d20 2024-05-09T00:09:06.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.093+0000 7ff5c17fa700 1 --2- 172.21.15.81:0/2237426128 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff5b00a1310 0x7ff5b00a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.093+0000 7ff5c3fff700 1 --2- 172.21.15.81:0/2237426128 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff5b00a1310 0x7ff5b00a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.093+0000 7ff5c17fa700 1 -- 172.21.15.81:0/2237426128 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ff5bc006e40 con 0x7ff5c4073d20 2024-05-09T00:09:06.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.093+0000 7ff5c3fff700 1 --2- 172.21.15.81:0/2237426128 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff5b00a1310 0x7ff5b00a37d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4005950 tx=0x7ff5b400b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:06.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.093+0000 7ff5d6c19b80 1 Processor -- start 2024-05-09T00:09:06.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.093+0000 7ff5d6c19b80 1 -- start start 2024-05-09T00:09:06.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5d6c19b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff53e00 0x564c3ff541e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5d6c19b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff54720 0x564c3ff4e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5d6c19b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff4e890 0x564c3ff4ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5d6c19b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3fea5150 con 0x564c3ff54720 2024-05-09T00:09:06.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5d6c19b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3fea2b10 con 0x564c3ff4e890 2024-05-09T00:09:06.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5d6c19b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3fe9e400 con 0x564c3ff53e00 2024-05-09T00:09:06.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff54720 0x564c3ff4e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff54720 0x564c3ff4e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60462/0 (socket says 172.21.15.81:60462) 2024-05-09T00:09:06.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5c37fe700 1 -- 172.21.15.81:0/1211370058 learned_addr learned my addr 172.21.15.81:0/1211370058 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:06.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5c3fff700 1 --2- 172.21.15.81:0/1211370058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff53e00 0x564c3ff541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5c8ffc700 1 --2- 172.21.15.81:0/1211370058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff4e890 0x564c3ff4ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5c37fe700 1 -- 172.21.15.81:0/1211370058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff53e00 msgr2=0x564c3ff541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:06.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5c37fe700 1 --2- 172.21.15.81:0/1211370058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff53e00 0x564c3ff541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5c37fe700 1 -- 172.21.15.81:0/1211370058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff4e890 msgr2=0x564c3ff4ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5c37fe700 1 --2- 172.21.15.81:0/1211370058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff4e890 0x564c3ff4ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5c37fe700 1 -- 172.21.15.81:0/1211370058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c3fd1f3b0 con 0x564c3ff54720 2024-05-09T00:09:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.094+0000 7ff5c37fe700 1 --2- 172.21.15.81:0/1211370058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff54720 0x564c3ff4e350 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac015000 tx=0x7ff5ac009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773e540c5d0873ac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.095+0000 7ff5ba7fc700 1 -- 172.21.15.81:0/1211370058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac005340 con 0x564c3ff54720 2024-05-09T00:09:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.095+0000 7ff5ba7fc700 1 -- 172.21.15.81:0/1211370058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5ac01e040 con 0x564c3ff54720 2024-05-09T00:09:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.095+0000 7ff5ba7fc700 1 -- 172.21.15.81:0/1211370058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac004920 con 0x564c3ff54720 2024-05-09T00:09:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.095+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1211370058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff54720 msgr2=0x564c3ff4e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.095+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/1211370058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff54720 0x564c3ff4e350 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac015000 tx=0x7ff5ac009ee0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.095+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1211370058 shutdown_connections 2024-05-09T00:09:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.095+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/1211370058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff4e890 0x564c3ff4ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.095+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/1211370058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff53e00 0x564c3ff541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.095+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/1211370058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff54720 0x564c3ff4e350 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.095+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1211370058 >> 172.21.15.81:0/1211370058 conn(0x564c3feac210 msgr2=0x564c3ff48df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.095+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1211370058 shutdown_connections 2024-05-09T00:09:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.095+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1211370058 wait complete. 2024-05-09T00:09:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5d6c19b80 1 -- start start 2024-05-09T00:09:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5d6c19b80 1 Processor -- start 2024-05-09T00:09:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5d6c19b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff4e890 0x564c3ff57ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5d6c19b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff53e00 0x564c3ff57ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5d6c19b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff54720 0x564c3ff58530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5d6c19b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3fe3a560 con 0x564c3ff4e890 2024-05-09T00:09:06.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5d6c19b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3fe3a200 con 0x564c3ff54720 2024-05-09T00:09:06.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5d6c19b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3fd216a0 con 0x564c3ff53e00 2024-05-09T00:09:06.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5d6c19b80 10 client.0 _ll_register_callbacks cb 0x564c3fe43b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:06.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff4e890 0x564c3ff57ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff4e890 0x564c3ff57ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60468/0 (socket says 172.21.15.81:60468) 2024-05-09T00:09:06.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5c3fff700 1 -- 172.21.15.81:0/1467308646 learned_addr learned my addr 172.21.15.81:0/1467308646 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:06.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5c37fe700 1 --2- 172.21.15.81:0/1467308646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff53e00 0x564c3ff57ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5c3fff700 1 -- 172.21.15.81:0/1467308646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff53e00 msgr2=0x564c3ff57ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:06.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5c3fff700 1 --2- 172.21.15.81:0/1467308646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff53e00 0x564c3ff57ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.096+0000 7ff5c3fff700 1 -- 172.21.15.81:0/1467308646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff54720 msgr2=0x564c3ff58530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:06.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5c3fff700 1 --2- 172.21.15.81:0/1467308646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff54720 0x564c3ff58530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5c3fff700 1 -- 172.21.15.81:0/1467308646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c410e690 con 0x564c3ff4e890 2024-05-09T00:09:06.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5c37fe700 1 --2- 172.21.15.81:0/1467308646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff53e00 0x564c3ff57ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:06.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5c3fff700 1 --2- 172.21.15.81:0/1467308646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff4e890 0x564c3ff57ab0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40116f0 tx=0x7ff5b40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93031271118eb9a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:06.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5a37fe700 1 -- 172.21.15.81:0/1467308646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b4011ea0 con 0x564c3ff4e890 2024-05-09T00:09:06.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5a37fe700 1 -- 172.21.15.81:0/1467308646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ff5b4017070 con 0x564c3ff4e890 2024-05-09T00:09:06.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1467308646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c3fdf7270 con 0x564c3ff4e890 2024-05-09T00:09:06.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5a37fe700 1 -- 172.21.15.81:0/1467308646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5b4028670 con 0x564c3ff4e890 2024-05-09T00:09:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5d6c19b80 10 client.17217 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1467308646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564c3fccbb60 con 0x564c3ff4e890 2024-05-09T00:09:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5a37fe700 1 -- 172.21.15.81:0/1467308646 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564c3fdf7270 con 0x564c3ff4e890 2024-05-09T00:09:06.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5a37fe700 1 -- 172.21.15.81:0/1467308646 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff5b401f9d0 con 0x564c3ff4e890 2024-05-09T00:09:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5d6c19b80 10 client.17217 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5d6c19b80 10 client.17217 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5d6c19b80 20 client.17217 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:06.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/1467308646 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564c3ff68300 0x564c3ff6a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5d6c19b80 4 client.17217 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:06.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.097+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1467308646 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c3ff1d810 con 0x564c3ff68300 2024-05-09T00:09:06.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.098+0000 7ff5c37fe700 1 --2- 172.21.15.81:0/1467308646 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564c3ff68300 0x564c3ff6a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.098+0000 7ff5c37fe700 1 --2- 172.21.15.81:0/1467308646 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564c3ff68300 0x564c3ff6a720 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85222fe07a640c80 server_cookie=3ee3d84e458d7600 in_seq=0 out_seq=0 2024-05-09T00:09:06.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.098+0000 7ff5a37fe700 10 client.17217 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:06.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5a37fe700 1 -- 172.21.15.81:0/1467308646 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564c3ff1d810 con 0x564c3ff68300 2024-05-09T00:09:06.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5a37fe700 10 client.17217 handle_command_reply: tid=0 2024-05-09T00:09:06.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5d6c19b80 1 client.17217 shutdown 2024-05-09T00:09:06.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1467308646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff4e890 msgr2=0x564c3ff57ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/1467308646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff4e890 0x564c3ff57ab0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7ff5b40116f0 tx=0x7ff5b40047c0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1467308646 shutdown_connections 2024-05-09T00:09:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/1467308646 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564c3ff68300 0x564c3ff6a720 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/1467308646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff54720 0x564c3ff58530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5a37fe700 0 client.17217 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/1467308646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff4e890 0x564c3ff57ab0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/1467308646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff53e00 0x564c3ff57ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1467308646 >> 172.21.15.81:0/1467308646 conn(0x564c3feac210 msgr2=0x564c3ff485a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:06.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1467308646 shutdown_connections 2024-05-09T00:09:06.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1467308646 wait complete. 2024-05-09T00:09:06.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.099+0000 7ff5d6c19b80 20 client.17217 trim_cache size 0 max 16384 2024-05-09T00:09:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5d6c19b80 1 Processor -- start 2024-05-09T00:09:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5d6c19b80 1 -- start start 2024-05-09T00:09:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5d6c19b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff4e890 0x564c3ff64290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5d6c19b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff53e00 0x564c3ff4ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5d6c19b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff54720 0x564c3ff63bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5d6c19b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3ff5a620 con 0x564c3ff54720 2024-05-09T00:09:06.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5d6c19b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3ff45dc0 con 0x564c3ff53e00 2024-05-09T00:09:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5d6c19b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3ff4ae50 con 0x564c3ff4e890 2024-05-09T00:09:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5c8ffc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff54720 0x564c3ff63bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5c8ffc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff54720 0x564c3ff63bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60474/0 (socket says 172.21.15.81:60474) 2024-05-09T00:09:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5c8ffc700 1 -- 172.21.15.81:0/1522946685 learned_addr learned my addr 172.21.15.81:0/1522946685 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5c3fff700 1 --2- 172.21.15.81:0/1522946685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff4e890 0x564c3ff64290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5c37fe700 1 --2- 172.21.15.81:0/1522946685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff53e00 0x564c3ff4ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5c8ffc700 1 -- 172.21.15.81:0/1522946685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff4e890 msgr2=0x564c3ff64290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5c8ffc700 1 --2- 172.21.15.81:0/1522946685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff4e890 0x564c3ff64290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5c8ffc700 1 -- 172.21.15.81:0/1522946685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff53e00 msgr2=0x564c3ff4ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5c8ffc700 1 --2- 172.21.15.81:0/1522946685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff53e00 0x564c3ff4ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5c8ffc700 1 -- 172.21.15.81:0/1522946685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c3fe64560 con 0x564c3ff54720 2024-05-09T00:09:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5c37fe700 1 --2- 172.21.15.81:0/1522946685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff53e00 0x564c3ff4ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.116+0000 7ff5c3fff700 1 --2- 172.21.15.81:0/1522946685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff4e890 0x564c3ff64290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:06.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.117+0000 7ff5c8ffc700 1 --2- 172.21.15.81:0/1522946685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff54720 0x564c3ff63bc0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc095eb0 tx=0x7ff5bc009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b44ca4ff5a63d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.117+0000 7ff5baffd700 1 -- 172.21.15.81:0/1522946685 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc099440 con 0x564c3ff54720 2024-05-09T00:09:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.117+0000 7ff5baffd700 1 -- 172.21.15.81:0/1522946685 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5bc09d270 con 0x564c3ff54720 2024-05-09T00:09:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.117+0000 7ff5baffd700 1 -- 172.21.15.81:0/1522946685 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc099900 con 0x564c3ff54720 2024-05-09T00:09:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.117+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1522946685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff54720 msgr2=0x564c3ff63bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.117+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/1522946685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff54720 0x564c3ff63bc0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc095eb0 tx=0x7ff5bc009930 comp rx=0 tx=0).stop 2024-05-09T00:09:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.117+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1522946685 shutdown_connections 2024-05-09T00:09:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.117+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/1522946685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff54720 0x564c3ff63bc0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.117+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/1522946685 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff4e890 0x564c3ff64290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.117+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/1522946685 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff53e00 0x564c3ff4ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.117+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1522946685 >> 172.21.15.81:0/1522946685 conn(0x564c3feac210 msgr2=0x564c3ff563a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.117+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1522946685 shutdown_connections 2024-05-09T00:09:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.117+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/1522946685 wait complete. 2024-05-09T00:09:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5d6c19b80 1 -- start start 2024-05-09T00:09:06.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5d6c19b80 1 Processor -- start 2024-05-09T00:09:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5d6c19b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff4e890 0x564c3ff5d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5d6c19b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff53e00 0x564c3ff5d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5d6c19b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff54720 0x564c3ff5db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5d6c19b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3ffbd820 con 0x564c3ff53e00 2024-05-09T00:09:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5d6c19b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3ffbd960 con 0x564c3ff4e890 2024-05-09T00:09:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5d6c19b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c3ffbdaf0 con 0x564c3ff54720 2024-05-09T00:09:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5d6c19b80 10 client.0 _ll_register_callbacks cb 0x564c3fe43b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff53e00 0x564c3ff5d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff53e00 0x564c3ff5d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60478/0 (socket says 172.21.15.81:60478) 2024-05-09T00:09:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5c37fe700 1 -- 172.21.15.81:0/2507180732 learned_addr learned my addr 172.21.15.81:0/2507180732 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5c8ffc700 1 --2- 172.21.15.81:0/2507180732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff54720 0x564c3ff5db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5c3fff700 1 --2- 172.21.15.81:0/2507180732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff4e890 0x564c3ff5d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5c37fe700 1 -- 172.21.15.81:0/2507180732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff54720 msgr2=0x564c3ff5db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:06.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5c37fe700 1 --2- 172.21.15.81:0/2507180732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff54720 0x564c3ff5db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5c37fe700 1 -- 172.21.15.81:0/2507180732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff4e890 msgr2=0x564c3ff5d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5c37fe700 1 --2- 172.21.15.81:0/2507180732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff4e890 0x564c3ff5d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5c37fe700 1 -- 172.21.15.81:0/2507180732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c41a6710 con 0x564c3ff53e00 2024-05-09T00:09:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.118+0000 7ff5c3fff700 1 --2- 172.21.15.81:0/2507180732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff4e890 0x564c3ff5d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5c37fe700 1 --2- 172.21.15.81:0/2507180732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff53e00 0x564c3ff5d630 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac025040 tx=0x7ff5ac00b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfc2dc0024fce0a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5a37fe700 1 -- 172.21.15.81:0/2507180732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac031ea0 con 0x564c3ff53e00 2024-05-09T00:09:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5a37fe700 1 -- 172.21.15.81:0/2507180732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7ff5ac0052c0 con 0x564c3ff53e00 2024-05-09T00:09:06.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/2507180732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5ac01e040 con 0x564c3ff53e00 2024-05-09T00:09:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5a37fe700 1 -- 172.21.15.81:0/2507180732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5ac00bc40 con 0x564c3ff53e00 2024-05-09T00:09:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5d6c19b80 10 client.17223 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/2507180732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564c3fd23cd0 con 0x564c3ff53e00 2024-05-09T00:09:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5a37fe700 1 -- 172.21.15.81:0/2507180732 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5ac01e040 con 0x564c3ff53e00 2024-05-09T00:09:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5a37fe700 1 -- 172.21.15.81:0/2507180732 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff5ac004500 con 0x564c3ff53e00 2024-05-09T00:09:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5d6c19b80 10 client.17223 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5d6c19b80 10 client.17223 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5d6c19b80 20 client.17223 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/2507180732 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564c3ffbef50 0x564c3ffc1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5d6c19b80 4 client.17223 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:09:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.119+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/2507180732 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564c3fe96ec0 con 0x564c3ffbef50 2024-05-09T00:09:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5c3fff700 1 --2- 172.21.15.81:0/2507180732 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564c3ffbef50 0x564c3ffc1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:06.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5a37fe700 10 client.17223 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5c3fff700 1 --2- 172.21.15.81:0/2507180732 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564c3ffbef50 0x564c3ffc1370 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=156074fb89bedac7 server_cookie=84d166470be0394e in_seq=0 out_seq=0 2024-05-09T00:09:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5a37fe700 1 -- 172.21.15.81:0/2507180732 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x564c3fe96ec0 con 0x564c3ffbef50 2024-05-09T00:09:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5a37fe700 10 client.17223 handle_command_reply: tid=0 2024-05-09T00:09:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5d6c19b80 1 client.17223 shutdown 2024-05-09T00:09:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/2507180732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff53e00 msgr2=0x564c3ff5d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/2507180732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff53e00 0x564c3ff5d630 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac025040 tx=0x7ff5ac00b540 comp rx=0 tx=0).stop 2024-05-09T00:09:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/2507180732 shutdown_connections 2024-05-09T00:09:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/2507180732 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564c3ffbef50 0x564c3ffc1370 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/2507180732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564c3ff4e890 0x564c3ff5d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5a37fe700 0 client.17223 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/2507180732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564c3ff54720 0x564c3ff5db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5d6c19b80 1 --2- 172.21.15.81:0/2507180732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564c3ff53e00 0x564c3ff5d630 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/2507180732 >> 172.21.15.81:0/2507180732 conn(0x564c3feac210 msgr2=0x564c3ff52ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:06.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/2507180732 shutdown_connections 2024-05-09T00:09:06.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.120+0000 7ff5d6c19b80 1 -- 172.21.15.81:0/2507180732 wait complete. 2024-05-09T00:09:06.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.121+0000 7ff5d6c19b80 20 client.17223 trim_cache size 0 max 16384 2024-05-09T00:09:06.129 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:09:06.129 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:09:06.129 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:09:06.129 INFO:teuthology.orchestra.run.smithi081.stdout: "056393d5-fe1c-4f74-a090-4ab63ab2206c": { 2024-05-09T00:09:06.129 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:09:06.130 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "056393d5-fe1c-4f74-a090-4ab63ab2206c", 2024-05-09T00:09:06.130 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:09:06.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:09:06.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:09:06.130 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:09:06.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.121+0000 7ff5caa5f700 1 -- 172.21.15.81:0/2237426128 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff5b00a1310 msgr2=0x7ff5b00a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.121+0000 7ff5caa5f700 1 --2- 172.21.15.81:0/2237426128 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff5b00a1310 0x7ff5b00a37d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff5b4005950 tx=0x7ff5b400b410 comp rx=0 tx=0).stop 2024-05-09T00:09:06.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.121+0000 7ff5caa5f700 1 -- 172.21.15.81:0/2237426128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c4073d20 msgr2=0x7ff5c41a5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.121+0000 7ff5caa5f700 1 --2- 172.21.15.81:0/2237426128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c4073d20 0x7ff5c41a5620 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc00b970 tx=0x7ff5bc00bc80 comp rx=0 tx=0).stop 2024-05-09T00:09:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.121+0000 7ff5caa5f700 1 -- 172.21.15.81:0/2237426128 shutdown_connections 2024-05-09T00:09:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.121+0000 7ff5caa5f700 1 --2- 172.21.15.81:0/2237426128 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff5b00a1310 0x7ff5b00a37d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.121+0000 7ff5caa5f700 1 --2- 172.21.15.81:0/2237426128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5c4073d20 0x7ff5c41a5620 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.121+0000 7ff5caa5f700 1 --2- 172.21.15.81:0/2237426128 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff5c4101180 0x7ff5c40732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.121+0000 7ff5caa5f700 1 --2- 172.21.15.81:0/2237426128 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff5c41062a0 0x7ff5c40737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.121+0000 7ff5caa5f700 1 -- 172.21.15.81:0/2237426128 >> 172.21.15.81:0/2237426128 conn(0x7ff5c40fc9e0 msgr2=0x7ff5c40fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.121+0000 7ff5caa5f700 1 -- 172.21.15.81:0/2237426128 shutdown_connections 2024-05-09T00:09:06.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:06.121+0000 7ff5caa5f700 1 -- 172.21.15.81:0/2237426128 wait complete. 2024-05-09T00:09:06.132 INFO:tasks.cephfs.filesystem:scrub status for tag:056393d5-fe1c-4f74-a090-4ab63ab2206c - {'path': '/', 'tag': '056393d5-fe1c-4f74-a090-4ab63ab2206c', 'options': 'recursive,force'} 2024-05-09T00:09:06.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:06 smithi081 ceph-mon[42474]: pgmap v187: 97 pgs: 97 active+clean; 4.7 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 75 KiB/s wr, 32 op/s 2024-05-09T00:09:06.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:06 smithi150 ceph-mon[46187]: pgmap v187: 97 pgs: 97 active+clean; 4.7 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 75 KiB/s wr, 32 op/s 2024-05-09T00:09:06.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:06 smithi171 ceph-mon[47351]: pgmap v187: 97 pgs: 97 active+clean; 4.7 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 75 KiB/s wr, 32 op/s 2024-05-09T00:09:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.270+0000 7fe65a10a700 1 -- 172.21.15.81:0/1467833861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe654100760 msgr2=0x7fe65410cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.270+0000 7fe65a10a700 1 --2- 172.21.15.81:0/1467833861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe654100760 0x7fe65410cc00 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00b0a0 tx=0x7fe64c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.270+0000 7fe65a10a700 1 -- 172.21.15.81:0/1467833861 shutdown_connections 2024-05-09T00:09:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.270+0000 7fe65a10a700 1 --2- 172.21.15.81:0/1467833861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe654100760 0x7fe65410cc00 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.268 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.270+0000 7fe65a10a700 1 --2- 172.21.15.81:0/1467833861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe654105e60 0x7fe654106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.270+0000 7fe65a10a700 1 --2- 172.21.15.81:0/1467833861 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe6540ffda0 0x7fe654100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.270+0000 7fe65a10a700 1 -- 172.21.15.81:0/1467833861 >> 172.21.15.81:0/1467833861 conn(0x7fe654076f10 msgr2=0x7fe654077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.270+0000 7fe65a10a700 1 -- 172.21.15.81:0/1467833861 shutdown_connections 2024-05-09T00:09:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.270+0000 7fe65a10a700 1 -- 172.21.15.81:0/1467833861 wait complete. 2024-05-09T00:09:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe65a10a700 1 Processor -- start 2024-05-09T00:09:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe65a10a700 1 -- start start 2024-05-09T00:09:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe65a10a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6540ffda0 0x7fe654101a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe65a10a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe654100760 0x7fe654101f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe65a10a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe654105e60 0x7fe6541024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe65a10a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6541a5810 con 0x7fe654105e60 2024-05-09T00:09:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe65a10a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6541a5980 con 0x7fe654100760 2024-05-09T00:09:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe65a10a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6541a5b40 con 0x7fe6540ffda0 2024-05-09T00:09:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe653fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe654105e60 0x7fe6541024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe6537fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6540ffda0 0x7fe654101a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe6537fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6540ffda0 0x7fe654101a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:53572/0 (socket says 172.21.15.81:53572) 2024-05-09T00:09:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe6537fe700 1 -- 172.21.15.81:0/1913859143 learned_addr learned my addr 172.21.15.81:0/1913859143 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe653fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe654105e60 0x7fe6541024f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52038/0 (socket says 172.21.15.81:52038) 2024-05-09T00:09:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe652ffd700 1 --2- 172.21.15.81:0/1913859143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe654100760 0x7fe654101f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe653fff700 1 -- 172.21.15.81:0/1913859143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6540ffda0 msgr2=0x7fe654101a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe653fff700 1 --2- 172.21.15.81:0/1913859143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6540ffda0 0x7fe654101a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe653fff700 1 -- 172.21.15.81:0/1913859143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe654100760 msgr2=0x7fe654101f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe653fff700 1 --2- 172.21.15.81:0/1913859143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe654100760 0x7fe654101f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.271+0000 7fe653fff700 1 -- 172.21.15.81:0/1913859143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c009d00 con 0x7fe654105e60 2024-05-09T00:09:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.272+0000 7fe653fff700 1 --2- 172.21.15.81:0/1913859143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe654105e60 0x7fe6541024f0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00b0a0 tx=0x7fe64c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.272+0000 7fe650ff9700 1 -- 172.21.15.81:0/1913859143 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c00e040 con 0x7fe654105e60 2024-05-09T00:09:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.272+0000 7fe650ff9700 1 -- 172.21.15.81:0/1913859143 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe64c00cec0 con 0x7fe654105e60 2024-05-09T00:09:07.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.272+0000 7fe65a10a700 1 -- 172.21.15.81:0/1913859143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6541a5dc0 con 0x7fe654105e60 2024-05-09T00:09:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.272+0000 7fe650ff9700 1 -- 172.21.15.81:0/1913859143 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c01b450 con 0x7fe654105e60 2024-05-09T00:09:07.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.272+0000 7fe65a10a700 1 -- 172.21.15.81:0/1913859143 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6541a6280 con 0x7fe654105e60 2024-05-09T00:09:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.274+0000 7fe650ff9700 1 -- 172.21.15.81:0/1913859143 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe64c01d480 con 0x7fe654105e60 2024-05-09T00:09:07.277 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.275+0000 7fe650ff9700 1 --2- 172.21.15.81:0/1913859143 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6400a1290 0x7fe6400a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.275+0000 7fe6537fe700 1 --2- 172.21.15.81:0/1913859143 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6400a1290 0x7fe6400a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.275+0000 7fe650ff9700 1 -- 172.21.15.81:0/1913859143 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fe64c0ce6d0 con 0x7fe654105e60 2024-05-09T00:09:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.275+0000 7fe6537fe700 1 --2- 172.21.15.81:0/1913859143 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6400a1290 0x7fe6400a3750 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe644005950 tx=0x7fe64400b500 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe6662c4b80 1 Processor -- start 2024-05-09T00:09:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe6662c4b80 1 -- start start 2024-05-09T00:09:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe6662c4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d5950 0x5605588d5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe6662c4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d6270 0x5605588cff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe6662c4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d0480 0x5605588d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe6662c4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605588270f0 con 0x5605588d6270 2024-05-09T00:09:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe6662c4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x560558824ab0 con 0x5605588d0480 2024-05-09T00:09:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe6662c4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605588203a0 con 0x5605588d5950 2024-05-09T00:09:07.278 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe652ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d6270 0x5605588cff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe652ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d6270 0x5605588cff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52050/0 (socket says 172.21.15.81:52050) 2024-05-09T00:09:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe652ffd700 1 -- 172.21.15.81:0/3965716656 learned_addr learned my addr 172.21.15.81:0/3965716656 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe6537fe700 1 --2- 172.21.15.81:0/3965716656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d5950 0x5605588d5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe652ffd700 1 -- 172.21.15.81:0/3965716656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d5950 msgr2=0x5605588d5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe652ffd700 1 --2- 172.21.15.81:0/3965716656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d5950 0x5605588d5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe653fff700 1 --2- 172.21.15.81:0/3965716656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d0480 0x5605588d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe652ffd700 1 -- 172.21.15.81:0/3965716656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d0480 msgr2=0x5605588d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe652ffd700 1 --2- 172.21.15.81:0/3965716656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d0480 0x5605588d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.276+0000 7fe652ffd700 1 -- 172.21.15.81:0/3965716656 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605586a1350 con 0x5605588d6270 2024-05-09T00:09:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.277+0000 7fe652ffd700 1 --2- 172.21.15.81:0/3965716656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d6270 0x5605588cff40 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00ac40 tx=0x7fe63c00af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9201721cf1d234b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.277+0000 7fe649ffb700 1 -- 172.21.15.81:0/3965716656 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c00fe90 con 0x5605588d6270 2024-05-09T00:09:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.277+0000 7fe649ffb700 1 -- 172.21.15.81:0/3965716656 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe63c018900 con 0x5605588d6270 2024-05-09T00:09:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.277+0000 7fe649ffb700 1 -- 172.21.15.81:0/3965716656 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c010990 con 0x5605588d6270 2024-05-09T00:09:07.279 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.277+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3965716656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d6270 msgr2=0x5605588cff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.277+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3965716656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d6270 0x5605588cff40 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fe63c00ac40 tx=0x7fe63c00af50 comp rx=0 tx=0).stop 2024-05-09T00:09:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.277+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3965716656 shutdown_connections 2024-05-09T00:09:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.277+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3965716656 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d0480 0x5605588d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.277+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3965716656 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d5950 0x5605588d5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.277+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3965716656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d6270 0x5605588cff40 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.277+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3965716656 >> 172.21.15.81:0/3965716656 conn(0x56055882e1b0 msgr2=0x5605588ca840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.277+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3965716656 shutdown_connections 2024-05-09T00:09:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.277+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3965716656 wait complete. 2024-05-09T00:09:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.278+0000 7fe6662c4b80 1 -- start start 2024-05-09T00:09:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.278+0000 7fe6662c4b80 1 Processor -- start 2024-05-09T00:09:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.278+0000 7fe6662c4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d0480 0x5605588dc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.278+0000 7fe6662c4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d5950 0x5605588d9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.278+0000 7fe6662c4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d6270 0x5605588d9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.280 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.278+0000 7fe6662c4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605587bc500 con 0x5605588d5950 2024-05-09T00:09:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.278+0000 7fe6662c4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605587bc1a0 con 0x5605588d6270 2024-05-09T00:09:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.278+0000 7fe6662c4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605586a3640 con 0x5605588d0480 2024-05-09T00:09:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.278+0000 7fe6662c4b80 10 client.0 _ll_register_callbacks cb 0x5605587c5ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.278+0000 7fe652ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d5950 0x5605588d9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.278+0000 7fe652ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d5950 0x5605588d9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52066/0 (socket says 172.21.15.81:52066) 2024-05-09T00:09:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.278+0000 7fe652ffd700 1 -- 172.21.15.81:0/3829691282 learned_addr learned my addr 172.21.15.81:0/3829691282 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe6537fe700 1 --2- 172.21.15.81:0/3829691282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d0480 0x5605588dc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe652ffd700 1 -- 172.21.15.81:0/3829691282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d0480 msgr2=0x5605588dc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe652ffd700 1 --2- 172.21.15.81:0/3829691282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d0480 0x5605588dc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe652ffd700 1 -- 172.21.15.81:0/3829691282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d6270 msgr2=0x5605588d9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe652ffd700 1 --2- 172.21.15.81:0/3829691282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d6270 0x5605588d9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe652ffd700 1 -- 172.21.15.81:0/3829691282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c00a870 con 0x5605588d5950 2024-05-09T00:09:07.281 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe6537fe700 1 --2- 172.21.15.81:0/3829691282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d0480 0x5605588dc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe652ffd700 1 --2- 172.21.15.81:0/3829691282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d5950 0x5605588d9570 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fe63c010570 tx=0x7fe63c018dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa31b68fc2cf90b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe632ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe632ffd700 1 -- 172.21.15.81:0/3829691282 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c005040 con 0x5605588d5950 2024-05-09T00:09:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe632ffd700 1 -- 172.21.15.81:0/3829691282 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fe63c0051a0 con 0x5605588d5950 2024-05-09T00:09:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3829691282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560558779210 con 0x5605588d5950 2024-05-09T00:09:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe632ffd700 1 -- 172.21.15.81:0/3829691282 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe63c005360 con 0x5605588d5950 2024-05-09T00:09:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe6662c4b80 10 client.17235 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3829691282 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56055864db00 con 0x5605588d5950 2024-05-09T00:09:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe632ffd700 1 -- 172.21.15.81:0/3829691282 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560558779210 con 0x5605588d5950 2024-05-09T00:09:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe632ffd700 1 -- 172.21.15.81:0/3829691282 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe63c010790 con 0x5605588d5950 2024-05-09T00:09:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe6662c4b80 10 client.17235 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:07.282 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe6662c4b80 10 client.17235 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe6662c4b80 20 client.17235 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3829691282 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5605588e9bc0 0x5605588ebfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe6662c4b80 4 client.17235 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.279+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3829691282 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56055889f7b0 con 0x5605588e9bc0 2024-05-09T00:09:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.280+0000 7fe6537fe700 1 --2- 172.21.15.81:0/3829691282 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5605588e9bc0 0x5605588ebfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.280+0000 7fe632ffd700 10 client.17235 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.280+0000 7fe6537fe700 1 --2- 172.21.15.81:0/3829691282 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5605588e9bc0 0x5605588ebfe0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5502788756658b77 server_cookie=77a88405d246bd2 in_seq=0 out_seq=0 2024-05-09T00:09:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe632ffd700 1 -- 172.21.15.81:0/3829691282 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56055889f7b0 con 0x5605588e9bc0 2024-05-09T00:09:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe632ffd700 10 client.17235 handle_command_reply: tid=0 2024-05-09T00:09:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe6662c4b80 1 client.17235 shutdown 2024-05-09T00:09:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3829691282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d5950 msgr2=0x5605588d9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3829691282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d5950 0x5605588d9570 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fe63c010570 tx=0x7fe63c018dd0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3829691282 shutdown_connections 2024-05-09T00:09:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3829691282 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5605588e9bc0 0x5605588ebfe0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3829691282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d6270 0x5605588d9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe632ffd700 0 client.17235 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3829691282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d0480 0x5605588dc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3829691282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d5950 0x5605588d9570 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3829691282 >> 172.21.15.81:0/3829691282 conn(0x56055882e1b0 msgr2=0x5605588d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3829691282 shutdown_connections 2024-05-09T00:09:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3829691282 wait complete. 2024-05-09T00:09:07.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.281+0000 7fe6662c4b80 20 client.17235 trim_cache size 0 max 16384 2024-05-09T00:09:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6662c4b80 1 Processor -- start 2024-05-09T00:09:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6662c4b80 1 -- start start 2024-05-09T00:09:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6662c4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d0480 0x5605588d0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6662c4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d5950 0x5605588ca910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6662c4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d6270 0x5605588dbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.297 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6662c4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605588f11d0 con 0x5605588d0480 2024-05-09T00:09:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6662c4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605588cf200 con 0x5605588d5950 2024-05-09T00:09:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6662c4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605588dc810 con 0x5605588d6270 2024-05-09T00:09:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6537fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d0480 0x5605588d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6537fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d0480 0x5605588d0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52068/0 (socket says 172.21.15.81:52068) 2024-05-09T00:09:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6537fe700 1 -- 172.21.15.81:0/1522651860 learned_addr learned my addr 172.21.15.81:0/1522651860 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe652ffd700 1 --2- 172.21.15.81:0/1522651860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d5950 0x5605588ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe653fff700 1 --2- 172.21.15.81:0/1522651860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d6270 0x5605588dbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6537fe700 1 -- 172.21.15.81:0/1522651860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d6270 msgr2=0x5605588dbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6537fe700 1 --2- 172.21.15.81:0/1522651860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d6270 0x5605588dbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6537fe700 1 -- 172.21.15.81:0/1522651860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d5950 msgr2=0x5605588ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6537fe700 1 --2- 172.21.15.81:0/1522651860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d5950 0x5605588ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6537fe700 1 -- 172.21.15.81:0/1522651860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5605587e6500 con 0x5605588d0480 2024-05-09T00:09:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe6537fe700 1 --2- 172.21.15.81:0/1522651860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d0480 0x5605588d0860 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fe644010a40 tx=0x7fe644013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec65b3f0e07e1b49 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.296+0000 7fe64a7fc700 1 -- 172.21.15.81:0/1522651860 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644025040 con 0x5605588d0480 2024-05-09T00:09:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.297+0000 7fe64a7fc700 1 -- 172.21.15.81:0/1522651860 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe644015070 con 0x5605588d0480 2024-05-09T00:09:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.297+0000 7fe64a7fc700 1 -- 172.21.15.81:0/1522651860 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644028730 con 0x5605588d0480 2024-05-09T00:09:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.297+0000 7fe6662c4b80 1 -- 172.21.15.81:0/1522651860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d0480 msgr2=0x5605588d0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.297+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/1522651860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d0480 0x5605588d0860 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fe644010a40 tx=0x7fe644013000 comp rx=0 tx=0).stop 2024-05-09T00:09:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.297+0000 7fe6662c4b80 1 -- 172.21.15.81:0/1522651860 shutdown_connections 2024-05-09T00:09:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.297+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/1522651860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d6270 0x5605588dbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.297+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/1522651860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d0480 0x5605588d0860 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.297+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/1522651860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d5950 0x5605588ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.297+0000 7fe6662c4b80 1 -- 172.21.15.81:0/1522651860 >> 172.21.15.81:0/1522651860 conn(0x56055882e1b0 msgr2=0x5605588e56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.297+0000 7fe6662c4b80 1 -- 172.21.15.81:0/1522651860 shutdown_connections 2024-05-09T00:09:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.297+0000 7fe6662c4b80 1 -- 172.21.15.81:0/1522651860 wait complete. 2024-05-09T00:09:07.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.297+0000 7fe6662c4b80 1 -- start start 2024-05-09T00:09:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe6662c4b80 1 Processor -- start 2024-05-09T00:09:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe6662c4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d0480 0x5605588e1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe6662c4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d5950 0x5605588dec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe6662c4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d6270 0x5605588df360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe6662c4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5605588dfa70 con 0x5605588d5950 2024-05-09T00:09:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe6662c4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56055893f0a0 con 0x5605588d6270 2024-05-09T00:09:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe6662c4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56055893f1e0 con 0x5605588d0480 2024-05-09T00:09:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe6662c4b80 10 client.0 _ll_register_callbacks cb 0x5605587c5ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe652ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d5950 0x5605588dec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe652ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d5950 0x5605588dec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52082/0 (socket says 172.21.15.81:52082) 2024-05-09T00:09:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe652ffd700 1 -- 172.21.15.81:0/3672440581 learned_addr learned my addr 172.21.15.81:0/3672440581 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe6537fe700 1 --2- 172.21.15.81:0/3672440581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d0480 0x5605588e1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe653fff700 1 --2- 172.21.15.81:0/3672440581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d6270 0x5605588df360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe652ffd700 1 -- 172.21.15.81:0/3672440581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d0480 msgr2=0x5605588e1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe652ffd700 1 --2- 172.21.15.81:0/3672440581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d0480 0x5605588e1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe652ffd700 1 -- 172.21.15.81:0/3672440581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d6270 msgr2=0x5605588df360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe652ffd700 1 --2- 172.21.15.81:0/3672440581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d6270 0x5605588df360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe652ffd700 1 -- 172.21.15.81:0/3672440581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64400beb0 con 0x5605588d5950 2024-05-09T00:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe653fff700 1 --2- 172.21.15.81:0/3672440581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d6270 0x5605588df360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe652ffd700 1 --2- 172.21.15.81:0/3672440581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d5950 0x5605588dec20 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x5605588dc7e0 tx=0x7fe63c0173a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eaac5c82093db1a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.298+0000 7fe632ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe632ffd700 1 -- 172.21.15.81:0/3672440581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c004020 con 0x5605588d5950 2024-05-09T00:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe632ffd700 1 -- 172.21.15.81:0/3672440581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fe63c004180 con 0x5605588d5950 2024-05-09T00:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3672440581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe63c018900 con 0x5605588d5950 2024-05-09T00:09:07.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe632ffd700 1 -- 172.21.15.81:0/3672440581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe63c004340 con 0x5605588d5950 2024-05-09T00:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe6662c4b80 10 client.17241 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3672440581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5605586a5c70 con 0x5605588d5950 2024-05-09T00:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe632ffd700 1 -- 172.21.15.81:0/3672440581 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe63c018900 con 0x5605588d5950 2024-05-09T00:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe632ffd700 1 -- 172.21.15.81:0/3672440581 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe63c0047f0 con 0x5605588d5950 2024-05-09T00:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe6662c4b80 10 client.17241 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe6662c4b80 10 client.17241 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe6662c4b80 20 client.17241 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3672440581 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5605588e9bc0 0x560558942580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe6662c4b80 4 client.17241 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3672440581 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560558818e60 con 0x5605588e9bc0 2024-05-09T00:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.299+0000 7fe6537fe700 1 --2- 172.21.15.81:0/3672440581 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5605588e9bc0 0x560558942580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.300+0000 7fe632ffd700 10 client.17241 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:07.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.300+0000 7fe6537fe700 1 --2- 172.21.15.81:0/3672440581 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5605588e9bc0 0x560558942580 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ef42989a3d76a5c server_cookie=ddf3cc3d69fff66f in_seq=0 out_seq=0 2024-05-09T00:09:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe632ffd700 1 -- 172.21.15.81:0/3672440581 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560558818e60 con 0x5605588e9bc0 2024-05-09T00:09:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe632ffd700 10 client.17241 handle_command_reply: tid=0 2024-05-09T00:09:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe6662c4b80 1 client.17241 shutdown 2024-05-09T00:09:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3672440581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d5950 msgr2=0x5605588dec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.309 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3672440581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d5950 0x5605588dec20 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x5605588dc7e0 tx=0x7fe63c0173a0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3672440581 shutdown_connections 2024-05-09T00:09:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3672440581 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5605588e9bc0 0x560558942580 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3672440581 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5605588d6270 0x5605588df360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe632ffd700 0 client.17241 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3672440581 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5605588d0480 0x5605588e1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe6662c4b80 1 --2- 172.21.15.81:0/3672440581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5605588d5950 0x5605588dec20 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3672440581 >> 172.21.15.81:0/3672440581 conn(0x56055882e1b0 msgr2=0x5605588e56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3672440581 shutdown_connections 2024-05-09T00:09:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe6662c4b80 1 -- 172.21.15.81:0/3672440581 wait complete. 2024-05-09T00:09:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.313+0000 7fe6662c4b80 20 client.17241 trim_cache size 0 max 16384 2024-05-09T00:09:07.310 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:09:07.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:09:07.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:09:07.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:09:07.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.314+0000 7fe65a10a700 1 -- 172.21.15.81:0/1913859143 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6400a1290 msgr2=0x7fe6400a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.311 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.314+0000 7fe65a10a700 1 --2- 172.21.15.81:0/1913859143 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6400a1290 0x7fe6400a3750 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe644005950 tx=0x7fe64400b500 comp rx=0 tx=0).stop 2024-05-09T00:09:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.314+0000 7fe65a10a700 1 -- 172.21.15.81:0/1913859143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe654105e60 msgr2=0x7fe6541024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.314+0000 7fe65a10a700 1 --2- 172.21.15.81:0/1913859143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe654105e60 0x7fe6541024f0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe64c00b0a0 tx=0x7fe64c007870 comp rx=0 tx=0).stop 2024-05-09T00:09:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.314+0000 7fe65a10a700 1 -- 172.21.15.81:0/1913859143 shutdown_connections 2024-05-09T00:09:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.314+0000 7fe65a10a700 1 --2- 172.21.15.81:0/1913859143 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6400a1290 0x7fe6400a3750 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.314+0000 7fe65a10a700 1 --2- 172.21.15.81:0/1913859143 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe654105e60 0x7fe6541024f0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.314+0000 7fe65a10a700 1 --2- 172.21.15.81:0/1913859143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe6540ffda0 0x7fe654101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.314+0000 7fe65a10a700 1 --2- 172.21.15.81:0/1913859143 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe654100760 0x7fe654101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.314+0000 7fe65a10a700 1 -- 172.21.15.81:0/1913859143 >> 172.21.15.81:0/1913859143 conn(0x7fe654076f10 msgr2=0x7fe654068500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.314+0000 7fe65a10a700 1 -- 172.21.15.81:0/1913859143 shutdown_connections 2024-05-09T00:09:07.312 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:07.314+0000 7fe65a10a700 1 -- 172.21.15.81:0/1913859143 wait complete. 2024-05-09T00:09:07.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:07 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:09:07.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:07 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:09:07.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:07 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:09:07.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:07 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:09:07.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:07 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:09:07.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:07 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:09:07.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:07 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:09:07.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:07 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:09:07.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:07 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:09:07.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:07 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:09:07.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:07 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:09:07.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:07 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:09:07.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:07 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:09:07.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:07 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:09:07.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:07 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:09:07.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:07 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:09:07.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:07 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:09:07.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:07 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:09:07.554 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:07 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:09:07.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:07 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:09:07.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:07 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:09:07.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:07 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:09:07.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:07 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:09:07.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:07 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:09:09.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:08 smithi081 ceph-mon[42474]: pgmap v188: 97 pgs: 97 active+clean; 4.7 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 55 KiB/s wr, 24 op/s 2024-05-09T00:09:09.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:08 smithi150 ceph-mon[46187]: pgmap v188: 97 pgs: 97 active+clean; 4.7 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 55 KiB/s wr, 24 op/s 2024-05-09T00:09:09.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:08 smithi171 ceph-mon[47351]: pgmap v188: 97 pgs: 97 active+clean; 4.7 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 55 KiB/s wr, 24 op/s 2024-05-09T00:09:10.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:09 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:09:10.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:09 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:09:10.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:09 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:09:11.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:10 smithi081 ceph-mon[42474]: pgmap v189: 97 pgs: 97 active+clean; 4.7 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 55 KiB/s wr, 24 op/s 2024-05-09T00:09:11.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:10 smithi150 ceph-mon[46187]: pgmap v189: 97 pgs: 97 active+clean; 4.7 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 55 KiB/s wr, 24 op/s 2024-05-09T00:09:11.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:10 smithi171 ceph-mon[47351]: pgmap v189: 97 pgs: 97 active+clean; 4.7 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 55 KiB/s wr, 24 op/s 2024-05-09T00:09:13.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:12 smithi081 ceph-mon[42474]: pgmap v190: 97 pgs: 97 active+clean; 4.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 78 KiB/s wr, 33 op/s 2024-05-09T00:09:13.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:12 smithi150 ceph-mon[46187]: pgmap v190: 97 pgs: 97 active+clean; 4.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 78 KiB/s wr, 33 op/s 2024-05-09T00:09:13.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:12 smithi171 ceph-mon[47351]: pgmap v190: 97 pgs: 97 active+clean; 4.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 78 KiB/s wr, 33 op/s 2024-05-09T00:09:15.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:14 smithi081 ceph-mon[42474]: pgmap v191: 97 pgs: 97 active+clean; 4.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 62 KiB/s wr, 28 op/s 2024-05-09T00:09:15.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:14 smithi150 ceph-mon[46187]: pgmap v191: 97 pgs: 97 active+clean; 4.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 62 KiB/s wr, 28 op/s 2024-05-09T00:09:15.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:14 smithi171 ceph-mon[47351]: pgmap v191: 97 pgs: 97 active+clean; 4.9 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 62 KiB/s wr, 28 op/s 2024-05-09T00:09:17.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:16 smithi081 ceph-mon[42474]: pgmap v192: 97 pgs: 97 active+clean; 5.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 79 KiB/s wr, 33 op/s 2024-05-09T00:09:17.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:16 smithi150 ceph-mon[46187]: pgmap v192: 97 pgs: 97 active+clean; 5.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 79 KiB/s wr, 33 op/s 2024-05-09T00:09:17.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:16 smithi171 ceph-mon[47351]: pgmap v192: 97 pgs: 97 active+clean; 5.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 79 KiB/s wr, 33 op/s 2024-05-09T00:09:19.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:18 smithi081 ceph-mon[42474]: pgmap v193: 97 pgs: 97 active+clean; 5.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:09:19.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:18 smithi150 ceph-mon[46187]: pgmap v193: 97 pgs: 97 active+clean; 5.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:09:19.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:18 smithi171 ceph-mon[47351]: pgmap v193: 97 pgs: 97 active+clean; 5.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:09:20.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.431+0000 7f285e30a700 1 -- 172.21.15.81:0/1769715333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2858100760 msgr2=0x7f285810cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.431+0000 7f285e30a700 1 --2- 172.21.15.81:0/1769715333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2858100760 0x7f285810cc00 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f285000b0a0 tx=0x7f285000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.431+0000 7f285e30a700 1 -- 172.21.15.81:0/1769715333 shutdown_connections 2024-05-09T00:09:20.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.431+0000 7f285e30a700 1 --2- 172.21.15.81:0/1769715333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2858100760 0x7f285810cc00 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.431+0000 7f285e30a700 1 --2- 172.21.15.81:0/1769715333 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2858105e60 0x7f2858106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.431+0000 7f285e30a700 1 --2- 172.21.15.81:0/1769715333 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f28580ffda0 0x7f2858100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.431+0000 7f285e30a700 1 -- 172.21.15.81:0/1769715333 >> 172.21.15.81:0/1769715333 conn(0x7f2858076f10 msgr2=0x7f2858077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:20.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.431+0000 7f285e30a700 1 -- 172.21.15.81:0/1769715333 shutdown_connections 2024-05-09T00:09:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.431+0000 7f285e30a700 1 -- 172.21.15.81:0/1769715333 wait complete. 2024-05-09T00:09:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.432+0000 7f285e30a700 1 Processor -- start 2024-05-09T00:09:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.432+0000 7f285e30a700 1 -- start start 2024-05-09T00:09:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.432+0000 7f285e30a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28580ffda0 0x7f2858101a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.432+0000 7f285e30a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2858100760 0x7f2858101f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.432+0000 7f285e30a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2858105e60 0x7f28581024d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.432+0000 7f285e30a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28581a57e0 con 0x7f2858100760 2024-05-09T00:09:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.432+0000 7f285e30a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28581a5950 con 0x7f2858105e60 2024-05-09T00:09:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.432+0000 7f285e30a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28581a5b10 con 0x7f28580ffda0 2024-05-09T00:09:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.432+0000 7f28577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2858100760 0x7f2858101f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.432+0000 7f28577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2858100760 0x7f2858101f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41978/0 (socket says 172.21.15.81:41978) 2024-05-09T00:09:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.432+0000 7f28577fe700 1 -- 172.21.15.81:0/3879388435 learned_addr learned my addr 172.21.15.81:0/3879388435 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.432+0000 7f285c8a7700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2858105e60 0x7f28581024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.432+0000 7f2857fff700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28580ffda0 0x7f2858101a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.432+0000 7f28577fe700 1 -- 172.21.15.81:0/3879388435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28580ffda0 msgr2=0x7f2858101a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.433+0000 7f28577fe700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28580ffda0 0x7f2858101a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.433+0000 7f28577fe700 1 -- 172.21.15.81:0/3879388435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2858105e60 msgr2=0x7f28581024d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.433+0000 7f28577fe700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2858105e60 0x7f28581024d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.433+0000 7f28577fe700 1 -- 172.21.15.81:0/3879388435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2850009d00 con 0x7f2858100760 2024-05-09T00:09:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.433+0000 7f285c8a7700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2858105e60 0x7f28581024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.433+0000 7f28577fe700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2858100760 0x7f2858101f90 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f284c00d980 tx=0x7f284c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.433+0000 7f28557fa700 1 -- 172.21.15.81:0/3879388435 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c00bb60 con 0x7f2858100760 2024-05-09T00:09:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.433+0000 7f28557fa700 1 -- 172.21.15.81:0/3879388435 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f284c007640 con 0x7f2858100760 2024-05-09T00:09:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.433+0000 7f285e30a700 1 -- 172.21.15.81:0/3879388435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28581a5df0 con 0x7f2858100760 2024-05-09T00:09:20.433 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.433+0000 7f28557fa700 1 -- 172.21.15.81:0/3879388435 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c004e90 con 0x7f2858100760 2024-05-09T00:09:20.433 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.433+0000 7f285e30a700 1 -- 172.21.15.81:0/3879388435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28581a6270 con 0x7f2858100760 2024-05-09T00:09:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.436+0000 7f28557fa700 1 -- 172.21.15.81:0/3879388435 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f284c00bcc0 con 0x7f2858100760 2024-05-09T00:09:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.436+0000 7f28557fa700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28400a1290 0x7f28400a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.436+0000 7f2857fff700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28400a1290 0x7f28400a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.436+0000 7f28557fa700 1 -- 172.21.15.81:0/3879388435 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f284c0ccbd0 con 0x7f2858100760 2024-05-09T00:09:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.437+0000 7f2857fff700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28400a1290 0x7f28400a3750 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2848009bd0 tx=0x7f2848009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.437+0000 7f286a4c4b80 1 Processor -- start 2024-05-09T00:09:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.437+0000 7f286a4c4b80 1 -- start start 2024-05-09T00:09:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.437+0000 7f286a4c4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27007950 0x556f27007d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.437+0000 7f286a4c4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27008270 0x556f27001f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.437+0000 7f286a4c4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27002480 0x556f270028a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.437+0000 7f286a4c4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f26f590f0 con 0x556f27007950 2024-05-09T00:09:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.437+0000 7f286a4c4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f26f56ab0 con 0x556f27002480 2024-05-09T00:09:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.437+0000 7f286a4c4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f26f523a0 con 0x556f27008270 2024-05-09T00:09:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.437+0000 7f2857fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27007950 0x556f27007d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.437+0000 7f2857fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27007950 0x556f27007d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41986/0 (socket says 172.21.15.81:41986) 2024-05-09T00:09:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.437+0000 7f2857fff700 1 -- 172.21.15.81:0/856296321 learned_addr learned my addr 172.21.15.81:0/856296321 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.437+0000 7f28577fe700 1 --2- 172.21.15.81:0/856296321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27008270 0x556f27001f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.437+0000 7f285c8a7700 1 --2- 172.21.15.81:0/856296321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27002480 0x556f270028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.438+0000 7f2857fff700 1 -- 172.21.15.81:0/856296321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27008270 msgr2=0x556f27001f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.438+0000 7f2857fff700 1 --2- 172.21.15.81:0/856296321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27008270 0x556f27001f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.438+0000 7f2857fff700 1 -- 172.21.15.81:0/856296321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27002480 msgr2=0x556f270028a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.438+0000 7f2857fff700 1 --2- 172.21.15.81:0/856296321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27002480 0x556f270028a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.438+0000 7f2857fff700 1 -- 172.21.15.81:0/856296321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f26dd3350 con 0x556f27007950 2024-05-09T00:09:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.438+0000 7f2857fff700 1 --2- 172.21.15.81:0/856296321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27007950 0x556f27007d30 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f2848005910 tx=0x7f2848013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f69c2b55336e37e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.438+0000 7f283e7fc700 1 -- 172.21.15.81:0/856296321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848011db0 con 0x556f27007950 2024-05-09T00:09:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.438+0000 7f283e7fc700 1 -- 172.21.15.81:0/856296321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2848015070 con 0x556f27007950 2024-05-09T00:09:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.438+0000 7f283e7fc700 1 -- 172.21.15.81:0/856296321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284801c610 con 0x556f27007950 2024-05-09T00:09:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.439+0000 7f286a4c4b80 1 -- 172.21.15.81:0/856296321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27007950 msgr2=0x556f27007d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.439+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/856296321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27007950 0x556f27007d30 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f2848005910 tx=0x7f2848013000 comp rx=0 tx=0).stop 2024-05-09T00:09:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.439+0000 7f286a4c4b80 1 -- 172.21.15.81:0/856296321 shutdown_connections 2024-05-09T00:09:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.439+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/856296321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27002480 0x556f270028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.439+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/856296321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27007950 0x556f27007d30 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.439+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/856296321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27008270 0x556f27001f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.439+0000 7f286a4c4b80 1 -- 172.21.15.81:0/856296321 >> 172.21.15.81:0/856296321 conn(0x556f26f601b0 msgr2=0x556f26ffc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.439+0000 7f286a4c4b80 1 -- 172.21.15.81:0/856296321 shutdown_connections 2024-05-09T00:09:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.439+0000 7f286a4c4b80 1 -- 172.21.15.81:0/856296321 wait complete. 2024-05-09T00:09:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.439+0000 7f286a4c4b80 1 -- start start 2024-05-09T00:09:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.439+0000 7f286a4c4b80 1 Processor -- start 2024-05-09T00:09:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f286a4c4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27002480 0x556f2700e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f286a4c4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27007950 0x556f2700b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f286a4c4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27008270 0x556f2700bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f286a4c4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f26eee500 con 0x556f27002480 2024-05-09T00:09:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f286a4c4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f26eee1a0 con 0x556f27008270 2024-05-09T00:09:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f286a4c4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f26dd5640 con 0x556f27007950 2024-05-09T00:09:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f286a4c4b80 10 client.0 _ll_register_callbacks cb 0x556f26ef7ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f2857fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27002480 0x556f2700e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f2857fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27002480 0x556f2700e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42000/0 (socket says 172.21.15.81:42000) 2024-05-09T00:09:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f2857fff700 1 -- 172.21.15.81:0/4225331663 learned_addr learned my addr 172.21.15.81:0/4225331663 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f28577fe700 1 --2- 172.21.15.81:0/4225331663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27007950 0x556f2700b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f285c8a7700 1 --2- 172.21.15.81:0/4225331663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27008270 0x556f2700bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f2857fff700 1 -- 172.21.15.81:0/4225331663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27007950 msgr2=0x556f2700b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f2857fff700 1 --2- 172.21.15.81:0/4225331663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27007950 0x556f2700b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f2857fff700 1 -- 172.21.15.81:0/4225331663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27008270 msgr2=0x556f2700bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f2857fff700 1 --2- 172.21.15.81:0/4225331663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27008270 0x556f2700bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f2857fff700 1 -- 172.21.15.81:0/4225331663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2848010b40 con 0x556f27002480 2024-05-09T00:09:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f2857fff700 1 --2- 172.21.15.81:0/4225331663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27002480 0x556f2700e220 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f28480058e0 tx=0x7f284801e6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6325e9b88f90a6c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f28377fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f28377fe700 1 -- 172.21.15.81:0/4225331663 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284802c070 con 0x556f27002480 2024-05-09T00:09:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f28377fe700 1 -- 172.21.15.81:0/4225331663 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2848017070 con 0x556f27002480 2024-05-09T00:09:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f286a4c4b80 1 -- 172.21.15.81:0/4225331663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556f26eab210 con 0x556f27002480 2024-05-09T00:09:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f28377fe700 1 -- 172.21.15.81:0/4225331663 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2848005ce0 con 0x556f27002480 2024-05-09T00:09:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f286a4c4b80 10 client.17253 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.440+0000 7f286a4c4b80 1 -- 172.21.15.81:0/4225331663 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556f26d7fb00 con 0x556f27002480 2024-05-09T00:09:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.441+0000 7f28377fe700 1 -- 172.21.15.81:0/4225331663 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f284803d020 con 0x556f27002480 2024-05-09T00:09:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.441+0000 7f28377fe700 1 -- 172.21.15.81:0/4225331663 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2848004ad0 con 0x556f27002480 2024-05-09T00:09:20.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.441+0000 7f286a4c4b80 10 client.17253 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.441+0000 7f286a4c4b80 10 client.17253 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.441+0000 7f286a4c4b80 20 client.17253 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.441+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/4225331663 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f2701bb30 0x556f2701df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.441+0000 7f286a4c4b80 4 client.17253 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.441+0000 7f286a4c4b80 1 -- 172.21.15.81:0/4225331663 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556f26fd17b0 con 0x556f2701bb30 2024-05-09T00:09:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.441+0000 7f28577fe700 1 --2- 172.21.15.81:0/4225331663 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f2701bb30 0x556f2701df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.441+0000 7f28377fe700 10 client.17253 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.441+0000 7f28577fe700 1 --2- 172.21.15.81:0/4225331663 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f2701bb30 0x556f2701df50 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20eb7119feefa495 server_cookie=17becbe57f7dbad9 in_seq=0 out_seq=0 2024-05-09T00:09:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f28377fe700 1 -- 172.21.15.81:0/4225331663 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556f26fd17b0 con 0x556f2701bb30 2024-05-09T00:09:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f28377fe700 10 client.17253 handle_command_reply: tid=0 2024-05-09T00:09:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f286a4c4b80 1 client.17253 shutdown 2024-05-09T00:09:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f286a4c4b80 1 -- 172.21.15.81:0/4225331663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27002480 msgr2=0x556f2700e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/4225331663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27002480 0x556f2700e220 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f28480058e0 tx=0x7f284801e6a0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f286a4c4b80 1 -- 172.21.15.81:0/4225331663 shutdown_connections 2024-05-09T00:09:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/4225331663 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f2701bb30 0x556f2701df50 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/4225331663 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27008270 0x556f2700bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/4225331663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27002480 0x556f2700e220 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f28377fe700 0 client.17253 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/4225331663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27007950 0x556f2700b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f286a4c4b80 1 -- 172.21.15.81:0/4225331663 >> 172.21.15.81:0/4225331663 conn(0x556f26f601b0 msgr2=0x556f27000f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f286a4c4b80 1 -- 172.21.15.81:0/4225331663 shutdown_connections 2024-05-09T00:09:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f286a4c4b80 1 -- 172.21.15.81:0/4225331663 wait complete. 2024-05-09T00:09:20.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.442+0000 7f286a4c4b80 20 client.17253 trim_cache size 0 max 16384 2024-05-09T00:09:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.457+0000 7f286a4c4b80 1 Processor -- start 2024-05-09T00:09:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.457+0000 7f286a4c4b80 1 -- start start 2024-05-09T00:09:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.457+0000 7f286a4c4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27002480 0x556f2700bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.457+0000 7f286a4c4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27007950 0x556f27002860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.457+0000 7f286a4c4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27008270 0x556f270017a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.457+0000 7f286a4c4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27006180 con 0x556f27002480 2024-05-09T00:09:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.457+0000 7f286a4c4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27017fb0 con 0x556f27007950 2024-05-09T00:09:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.457+0000 7f286a4c4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f26ff4b20 con 0x556f27008270 2024-05-09T00:09:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.457+0000 7f2857fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27002480 0x556f2700bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.458+0000 7f2857fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27002480 0x556f2700bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42006/0 (socket says 172.21.15.81:42006) 2024-05-09T00:09:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.458+0000 7f2857fff700 1 -- 172.21.15.81:0/1551344321 learned_addr learned my addr 172.21.15.81:0/1551344321 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.458+0000 7f2857fff700 1 -- 172.21.15.81:0/1551344321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27008270 msgr2=0x556f270017a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.458+0000 7f2857fff700 1 --2- 172.21.15.81:0/1551344321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27008270 0x556f270017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.458+0000 7f2857fff700 1 -- 172.21.15.81:0/1551344321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27007950 msgr2=0x556f27002860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.458+0000 7f2857fff700 1 --2- 172.21.15.81:0/1551344321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27007950 0x556f27002860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.458+0000 7f2857fff700 1 -- 172.21.15.81:0/1551344321 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f26f18500 con 0x556f27002480 2024-05-09T00:09:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.458+0000 7f2857fff700 1 --2- 172.21.15.81:0/1551344321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27002480 0x556f2700bc30 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2848009990 tx=0x7f28480108d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bf727542ea3fe2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.458+0000 7f283effd700 1 -- 172.21.15.81:0/1551344321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284802c070 con 0x556f27002480 2024-05-09T00:09:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.458+0000 7f283effd700 1 -- 172.21.15.81:0/1551344321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f284803d030 con 0x556f27002480 2024-05-09T00:09:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.458+0000 7f283effd700 1 -- 172.21.15.81:0/1551344321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28480046d0 con 0x556f27002480 2024-05-09T00:09:20.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.459+0000 7f286a4c4b80 1 -- 172.21.15.81:0/1551344321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27002480 msgr2=0x556f2700bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.459+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/1551344321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27002480 0x556f2700bc30 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f2848009990 tx=0x7f28480108d0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.459+0000 7f286a4c4b80 1 -- 172.21.15.81:0/1551344321 shutdown_connections 2024-05-09T00:09:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.459+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/1551344321 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27008270 0x556f270017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.459+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/1551344321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27002480 0x556f2700bc30 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.459+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/1551344321 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27007950 0x556f27002860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.459+0000 7f286a4c4b80 1 -- 172.21.15.81:0/1551344321 >> 172.21.15.81:0/1551344321 conn(0x556f26f601b0 msgr2=0x556f27000f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.459+0000 7f286a4c4b80 1 -- 172.21.15.81:0/1551344321 shutdown_connections 2024-05-09T00:09:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.459+0000 7f286a4c4b80 1 -- 172.21.15.81:0/1551344321 wait complete. 2024-05-09T00:09:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.459+0000 7f286a4c4b80 1 -- start start 2024-05-09T00:09:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.459+0000 7f286a4c4b80 1 Processor -- start 2024-05-09T00:09:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f286a4c4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27002480 0x556f27012c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f286a4c4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27007950 0x556f27013150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f286a4c4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27008270 0x556f27010bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f286a4c4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f270111c0 con 0x556f27007950 2024-05-09T00:09:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f286a4c4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f27011330 con 0x556f27008270 2024-05-09T00:09:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f286a4c4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f270114f0 con 0x556f27002480 2024-05-09T00:09:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f286a4c4b80 10 client.0 _ll_register_callbacks cb 0x556f26ef7ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f28577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27007950 0x556f27013150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f28577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27007950 0x556f27013150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42022/0 (socket says 172.21.15.81:42022) 2024-05-09T00:09:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f28577fe700 1 -- 172.21.15.81:0/462573992 learned_addr learned my addr 172.21.15.81:0/462573992 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f2857fff700 1 --2- 172.21.15.81:0/462573992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27002480 0x556f27012c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f28577fe700 1 -- 172.21.15.81:0/462573992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27002480 msgr2=0x556f27012c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f28577fe700 1 --2- 172.21.15.81:0/462573992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27002480 0x556f27012c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f28577fe700 1 -- 172.21.15.81:0/462573992 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27008270 msgr2=0x556f27010bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f28577fe700 1 --2- 172.21.15.81:0/462573992 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27008270 0x556f27010bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f28577fe700 1 -- 172.21.15.81:0/462573992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f26d7fb00 con 0x556f27007950 2024-05-09T00:09:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f28577fe700 1 --2- 172.21.15.81:0/462573992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27007950 0x556f27013150 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f284c00b540 tx=0x7f284c099ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8189f1d108d4388 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f28377fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f28377fe700 1 -- 172.21.15.81:0/462573992 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c099f40 con 0x556f27007950 2024-05-09T00:09:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f28377fe700 1 -- 172.21.15.81:0/462573992 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f284c09a0a0 con 0x556f27007950 2024-05-09T00:09:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f286a4c4b80 1 -- 172.21.15.81:0/462573992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2848015070 con 0x556f27007950 2024-05-09T00:09:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f28377fe700 1 -- 172.21.15.81:0/462573992 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f284c0991d0 con 0x556f27007950 2024-05-09T00:09:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f286a4c4b80 10 client.17259 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.460+0000 7f286a4c4b80 1 -- 172.21.15.81:0/462573992 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556f26dd7c70 con 0x556f27007950 2024-05-09T00:09:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.461+0000 7f28377fe700 1 -- 172.21.15.81:0/462573992 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2848015070 con 0x556f27007950 2024-05-09T00:09:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.461+0000 7f28377fe700 1 -- 172.21.15.81:0/462573992 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f284c0adbb0 con 0x556f27007950 2024-05-09T00:09:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.461+0000 7f286a4c4b80 10 client.17259 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.461+0000 7f286a4c4b80 10 client.17259 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.461+0000 7f286a4c4b80 20 client.17259 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:20.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.461+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/462573992 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f27071fd0 0x556f270743f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.461+0000 7f286a4c4b80 4 client.17259 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:09:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.461+0000 7f286a4c4b80 1 -- 172.21.15.81:0/462573992 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556f26f4ae60 con 0x556f27071fd0 2024-05-09T00:09:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.461+0000 7f2857fff700 1 --2- 172.21.15.81:0/462573992 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f27071fd0 0x556f270743f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.461+0000 7f28377fe700 10 client.17259 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.461+0000 7f2857fff700 1 --2- 172.21.15.81:0/462573992 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f27071fd0 0x556f270743f0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ab0588bf44ba6af server_cookie=e51489b3ba6a6580 in_seq=0 out_seq=0 2024-05-09T00:09:20.472 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f28377fe700 1 -- 172.21.15.81:0/462573992 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556f26f4ae60 con 0x556f27071fd0 2024-05-09T00:09:20.472 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f28377fe700 10 client.17259 handle_command_reply: tid=0 2024-05-09T00:09:20.472 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f286a4c4b80 1 client.17259 shutdown 2024-05-09T00:09:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f286a4c4b80 1 -- 172.21.15.81:0/462573992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27007950 msgr2=0x556f27013150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/462573992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27007950 0x556f27013150 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f284c00b540 tx=0x7f284c099ab0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f286a4c4b80 1 -- 172.21.15.81:0/462573992 shutdown_connections 2024-05-09T00:09:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/462573992 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556f27071fd0 0x556f270743f0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/462573992 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556f27008270 0x556f27010bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/462573992 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556f27002480 0x556f27012c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f286a4c4b80 1 --2- 172.21.15.81:0/462573992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556f27007950 0x556f27013150 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f28377fe700 0 client.17259 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f286a4c4b80 1 -- 172.21.15.81:0/462573992 >> 172.21.15.81:0/462573992 conn(0x556f26f601b0 msgr2=0x556f27001710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f286a4c4b80 1 -- 172.21.15.81:0/462573992 shutdown_connections 2024-05-09T00:09:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f286a4c4b80 1 -- 172.21.15.81:0/462573992 wait complete. 2024-05-09T00:09:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.476+0000 7f286a4c4b80 20 client.17259 trim_cache size 0 max 16384 2024-05-09T00:09:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:09:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:09:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:09:20.474 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:09:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.477+0000 7f285e30a700 1 -- 172.21.15.81:0/3879388435 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28400a1290 msgr2=0x7f28400a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.477+0000 7f285e30a700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28400a1290 0x7f28400a3750 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2848009bd0 tx=0x7f2848009260 comp rx=0 tx=0).stop 2024-05-09T00:09:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.477+0000 7f285e30a700 1 -- 172.21.15.81:0/3879388435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2858100760 msgr2=0x7f2858101f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.477+0000 7f285e30a700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2858100760 0x7f2858101f90 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f284c00d980 tx=0x7f284c00dd40 comp rx=0 tx=0).stop 2024-05-09T00:09:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.477+0000 7f285e30a700 1 -- 172.21.15.81:0/3879388435 shutdown_connections 2024-05-09T00:09:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.477+0000 7f285e30a700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f28400a1290 0x7f28400a3750 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.477+0000 7f285e30a700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2858105e60 0x7f28581024d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.477+0000 7f285e30a700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f28580ffda0 0x7f2858101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.477+0000 7f285e30a700 1 --2- 172.21.15.81:0/3879388435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2858100760 0x7f2858101f90 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.477+0000 7f285e30a700 1 -- 172.21.15.81:0/3879388435 >> 172.21.15.81:0/3879388435 conn(0x7f2858076f10 msgr2=0x7f28580685c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.477+0000 7f285e30a700 1 -- 172.21.15.81:0/3879388435 shutdown_connections 2024-05-09T00:09:20.476 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:20.477+0000 7f285e30a700 1 -- 172.21.15.81:0/3879388435 wait complete. 2024-05-09T00:09:21.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:20 smithi081 ceph-mon[42474]: pgmap v194: 97 pgs: 97 active+clean; 5.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:09:21.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:20 smithi150 ceph-mon[46187]: pgmap v194: 97 pgs: 97 active+clean; 5.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:09:21.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:20 smithi171 ceph-mon[47351]: pgmap v194: 97 pgs: 97 active+clean; 5.1 MiB data, 410 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:09:23.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:22 smithi081 ceph-mon[42474]: pgmap v195: 97 pgs: 97 active+clean; 5.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-05-09T00:09:23.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:22 smithi150 ceph-mon[46187]: pgmap v195: 97 pgs: 97 active+clean; 5.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-05-09T00:09:23.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:22 smithi171 ceph-mon[47351]: pgmap v195: 97 pgs: 97 active+clean; 5.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-05-09T00:09:25.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:24 smithi081 ceph-mon[42474]: pgmap v196: 97 pgs: 97 active+clean; 5.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-05-09T00:09:25.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:24 smithi150 ceph-mon[46187]: pgmap v196: 97 pgs: 97 active+clean; 5.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-05-09T00:09:25.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:24 smithi171 ceph-mon[47351]: pgmap v196: 97 pgs: 97 active+clean; 5.3 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 33 KiB/s wr, 9 op/s 2024-05-09T00:09:27.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:26 smithi081 ceph-mon[42474]: pgmap v197: 97 pgs: 97 active+clean; 5.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-05-09T00:09:27.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:26 smithi150 ceph-mon[46187]: pgmap v197: 97 pgs: 97 active+clean; 5.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-05-09T00:09:27.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:26 smithi171 ceph-mon[47351]: pgmap v197: 97 pgs: 97 active+clean; 5.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-05-09T00:09:29.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:28 smithi081 ceph-mon[42474]: pgmap v198: 97 pgs: 97 active+clean; 5.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:09:29.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:28 smithi150 ceph-mon[46187]: pgmap v198: 97 pgs: 97 active+clean; 5.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:09:29.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:28 smithi171 ceph-mon[47351]: pgmap v198: 97 pgs: 97 active+clean; 5.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:09:31.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:30 smithi081 ceph-mon[42474]: pgmap v199: 97 pgs: 97 active+clean; 5.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:09:31.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:30 smithi150 ceph-mon[46187]: pgmap v199: 97 pgs: 97 active+clean; 5.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:09:31.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:30 smithi171 ceph-mon[47351]: pgmap v199: 97 pgs: 97 active+clean; 5.5 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:09:33.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:32 smithi081 ceph-mon[42474]: pgmap v200: 97 pgs: 97 active+clean; 5.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-05-09T00:09:33.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:32 smithi150 ceph-mon[46187]: pgmap v200: 97 pgs: 97 active+clean; 5.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-05-09T00:09:33.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:32 smithi171 ceph-mon[47351]: pgmap v200: 97 pgs: 97 active+clean; 5.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 17 op/s 2024-05-09T00:09:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.592+0000 7f528b696700 1 -- 172.21.15.81:0/2389335937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52840ffda0 msgr2=0x7f5284100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.592+0000 7f528b696700 1 --2- 172.21.15.81:0/2389335937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52840ffda0 0x7f5284100220 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5280009990 tx=0x7f5280009ca0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.592+0000 7f528b696700 1 -- 172.21.15.81:0/2389335937 shutdown_connections 2024-05-09T00:09:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.592+0000 7f528b696700 1 --2- 172.21.15.81:0/2389335937 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5284105e60 0x7f5284106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.592+0000 7f528b696700 1 --2- 172.21.15.81:0/2389335937 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5284100760 0x7f528410cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.592+0000 7f528b696700 1 --2- 172.21.15.81:0/2389335937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52840ffda0 0x7f5284100220 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.592+0000 7f528b696700 1 -- 172.21.15.81:0/2389335937 >> 172.21.15.81:0/2389335937 conn(0x7f5284076fd0 msgr2=0x7f52840773e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.593+0000 7f528b696700 1 -- 172.21.15.81:0/2389335937 shutdown_connections 2024-05-09T00:09:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.593+0000 7f528b696700 1 -- 172.21.15.81:0/2389335937 wait complete. 2024-05-09T00:09:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.593+0000 7f528b696700 1 Processor -- start 2024-05-09T00:09:33.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.593+0000 7f528b696700 1 -- start start 2024-05-09T00:09:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.593+0000 7f528b696700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52840ffda0 0x7f5284101ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.593+0000 7f528b696700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5284100760 0x7f5284102400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.593+0000 7f528b696700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5284105e60 0x7f5284102940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.593+0000 7f528b696700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52841a5620 con 0x7f52840ffda0 2024-05-09T00:09:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.593+0000 7f528b696700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52841a5790 con 0x7f5284105e60 2024-05-09T00:09:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.593+0000 7f528b696700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52841a5950 con 0x7f5284100760 2024-05-09T00:09:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.593+0000 7f5289432700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52840ffda0 0x7f5284101ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f5289432700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52840ffda0 0x7f5284101ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51186/0 (socket says 172.21.15.81:51186) 2024-05-09T00:09:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f5289432700 1 -- 172.21.15.81:0/4194042856 learned_addr learned my addr 172.21.15.81:0/4194042856 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f5289c33700 1 --2- 172.21.15.81:0/4194042856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5284105e60 0x7f5284102940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f5288c31700 1 --2- 172.21.15.81:0/4194042856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5284100760 0x7f5284102400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f5289432700 1 -- 172.21.15.81:0/4194042856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5284100760 msgr2=0x7f5284102400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f5289432700 1 --2- 172.21.15.81:0/4194042856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5284100760 0x7f5284102400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f5289432700 1 -- 172.21.15.81:0/4194042856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5284105e60 msgr2=0x7f5284102940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f5289432700 1 --2- 172.21.15.81:0/4194042856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5284105e60 0x7f5284102940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f5289432700 1 -- 172.21.15.81:0/4194042856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52800095f0 con 0x7f52840ffda0 2024-05-09T00:09:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f5289432700 1 --2- 172.21.15.81:0/4194042856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52840ffda0 0x7f5284101ec0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f527400d980 tx=0x7f527400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f527a7fc700 1 -- 172.21.15.81:0/4194042856 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527400bb60 con 0x7f52840ffda0 2024-05-09T00:09:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f527a7fc700 1 -- 172.21.15.81:0/4194042856 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5274007640 con 0x7f52840ffda0 2024-05-09T00:09:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f527a7fc700 1 -- 172.21.15.81:0/4194042856 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5274004e90 con 0x7f52840ffda0 2024-05-09T00:09:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f528b696700 1 -- 172.21.15.81:0/4194042856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52841a5c30 con 0x7f52840ffda0 2024-05-09T00:09:33.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.594+0000 7f528b696700 1 -- 172.21.15.81:0/4194042856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52841a6140 con 0x7f52840ffda0 2024-05-09T00:09:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.596+0000 7f527a7fc700 1 -- 172.21.15.81:0/4194042856 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f527400bcc0 con 0x7f52840ffda0 2024-05-09T00:09:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.597+0000 7f527a7fc700 1 --2- 172.21.15.81:0/4194042856 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f52700a1310 0x7f52700a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.597+0000 7f527a7fc700 1 -- 172.21.15.81:0/4194042856 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f52740ccb50 con 0x7f52840ffda0 2024-05-09T00:09:33.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.597+0000 7f5288c31700 1 --2- 172.21.15.81:0/4194042856 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f52700a1310 0x7f52700a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.597+0000 7f5288c31700 1 --2- 172.21.15.81:0/4194042856 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f52700a1310 0x7f52700a37d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5280005850 tx=0x7f528001a040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.598+0000 7f5297850b80 1 Processor -- start 2024-05-09T00:09:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.598+0000 7f5297850b80 1 -- start start 2024-05-09T00:09:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.598+0000 7f5297850b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 0x55f376ff8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.598+0000 7f5297850b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff9270 0x55f376ff2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.598+0000 7f5297850b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f376ff38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.598+0000 7f5297850b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f376f4a0f0 con 0x55f376ff3480 2024-05-09T00:09:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.598+0000 7f5297850b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f376f47ab0 con 0x55f376ff8950 2024-05-09T00:09:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.598+0000 7f5297850b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f376f433a0 con 0x55f376ff9270 2024-05-09T00:09:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f5289c33700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f376ff38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f5289c33700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f376ff38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51198/0 (socket says 172.21.15.81:51198) 2024-05-09T00:09:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f5289c33700 1 -- 172.21.15.81:0/3863149535 learned_addr learned my addr 172.21.15.81:0/3863149535 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f5289432700 1 --2- 172.21.15.81:0/3863149535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 0x55f376ff8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f5288c31700 1 --2- 172.21.15.81:0/3863149535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff9270 0x55f376ff2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f5289c33700 1 -- 172.21.15.81:0/3863149535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff9270 msgr2=0x55f376ff2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f5289c33700 1 --2- 172.21.15.81:0/3863149535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff9270 0x55f376ff2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f5289c33700 1 -- 172.21.15.81:0/3863149535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 msgr2=0x55f376ff8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f5289c33700 1 --2- 172.21.15.81:0/3863149535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 0x55f376ff8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f5289c33700 1 -- 172.21.15.81:0/3863149535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f376dc4350 con 0x55f376ff3480 2024-05-09T00:09:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f5289432700 1 --2- 172.21.15.81:0/3863149535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 0x55f376ff8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f5289c33700 1 --2- 172.21.15.81:0/3863149535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f376ff38a0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f527c009dc0 tx=0x7f527c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317db04f1f8e19e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f526f7fe700 1 -- 172.21.15.81:0/3863149535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c014610 con 0x55f376ff3480 2024-05-09T00:09:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f526f7fe700 1 -- 172.21.15.81:0/3863149535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f527c00f050 con 0x55f376ff3480 2024-05-09T00:09:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.599+0000 7f526f7fe700 1 -- 172.21.15.81:0/3863149535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c0138f0 con 0x55f376ff3480 2024-05-09T00:09:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.600+0000 7f5297850b80 1 -- 172.21.15.81:0/3863149535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 msgr2=0x55f376ff38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.600+0000 7f5297850b80 1 --2- 172.21.15.81:0/3863149535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f376ff38a0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f527c009dc0 tx=0x7f527c0077e0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.600+0000 7f5297850b80 1 -- 172.21.15.81:0/3863149535 shutdown_connections 2024-05-09T00:09:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.600+0000 7f5297850b80 1 --2- 172.21.15.81:0/3863149535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 0x55f376ff8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.600+0000 7f5297850b80 1 --2- 172.21.15.81:0/3863149535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f376ff38a0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.600+0000 7f5297850b80 1 --2- 172.21.15.81:0/3863149535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff9270 0x55f376ff2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.600+0000 7f5297850b80 1 -- 172.21.15.81:0/3863149535 >> 172.21.15.81:0/3863149535 conn(0x55f376f511b0 msgr2=0x55f376fed840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.600+0000 7f5297850b80 1 -- 172.21.15.81:0/3863149535 shutdown_connections 2024-05-09T00:09:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.600+0000 7f5297850b80 1 -- 172.21.15.81:0/3863149535 wait complete. 2024-05-09T00:09:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.600+0000 7f5297850b80 1 -- start start 2024-05-09T00:09:33.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.600+0000 7f5297850b80 1 Processor -- start 2024-05-09T00:09:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5297850b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff3480 0x55f376fff190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5297850b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 0x55f376ffc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5297850b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff9270 0x55f376ffca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5297850b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f376edf500 con 0x55f376ff9270 2024-05-09T00:09:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5297850b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f376edf1a0 con 0x55f376ff8950 2024-05-09T00:09:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5297850b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f376dc6640 con 0x55f376ff3480 2024-05-09T00:09:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5297850b80 10 client.0 _ll_register_callbacks cb 0x55f376ee8ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:33.604 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5289c33700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff9270 0x55f376ffca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5289c33700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff9270 0x55f376ffca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51214/0 (socket says 172.21.15.81:51214) 2024-05-09T00:09:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5289c33700 1 -- 172.21.15.81:0/2225706211 learned_addr learned my addr 172.21.15.81:0/2225706211 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5289432700 1 --2- 172.21.15.81:0/2225706211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff3480 0x55f376fff190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5288c31700 1 --2- 172.21.15.81:0/2225706211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 0x55f376ffc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5289c33700 1 -- 172.21.15.81:0/2225706211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff3480 msgr2=0x55f376fff190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5289c33700 1 --2- 172.21.15.81:0/2225706211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff3480 0x55f376fff190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5289c33700 1 -- 172.21.15.81:0/2225706211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 msgr2=0x55f376ffc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5289c33700 1 --2- 172.21.15.81:0/2225706211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 0x55f376ffc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5289c33700 1 -- 172.21.15.81:0/2225706211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c009a20 con 0x55f376ff9270 2024-05-09T00:09:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.601+0000 7f5288c31700 1 --2- 172.21.15.81:0/2225706211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 0x55f376ffc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f5289c33700 1 --2- 172.21.15.81:0/2225706211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff9270 0x55f376ffca90 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f527c009f50 tx=0x7f527c014b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f10c08ccd619a57 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f526cff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:33.605 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f526cff9700 1 -- 172.21.15.81:0/2225706211 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527c006000 con 0x55f376ff9270 2024-05-09T00:09:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f526cff9700 1 -- 172.21.15.81:0/2225706211 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f527c013550 con 0x55f376ff9270 2024-05-09T00:09:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f5297850b80 1 -- 172.21.15.81:0/2225706211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f376e9c210 con 0x55f376ff9270 2024-05-09T00:09:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f526cff9700 1 -- 172.21.15.81:0/2225706211 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f527c013710 con 0x55f376ff9270 2024-05-09T00:09:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f5297850b80 10 client.17271 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f5297850b80 1 -- 172.21.15.81:0/2225706211 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f376d70b00 con 0x55f376ff9270 2024-05-09T00:09:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f526cff9700 1 -- 172.21.15.81:0/2225706211 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f376e9c210 con 0x55f376ff9270 2024-05-09T00:09:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f526cff9700 1 -- 172.21.15.81:0/2225706211 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f527c0267e0 con 0x55f376ff9270 2024-05-09T00:09:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f5297850b80 10 client.17271 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f5297850b80 10 client.17271 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f5297850b80 20 client.17271 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f5297850b80 1 --2- 172.21.15.81:0/2225706211 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f37700ca80 0x55f37700eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f5297850b80 4 client.17271 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.602+0000 7f5297850b80 1 -- 172.21.15.81:0/2225706211 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f376fc27b0 con 0x55f37700ca80 2024-05-09T00:09:33.606 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.603+0000 7f5289432700 1 --2- 172.21.15.81:0/2225706211 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f37700ca80 0x55f37700eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.603+0000 7f526cff9700 10 client.17271 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.603+0000 7f5289432700 1 --2- 172.21.15.81:0/2225706211 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f37700ca80 0x55f37700eea0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=154fc74ffc0de4a3 server_cookie=bb4829cc904287e8 in_seq=0 out_seq=0 2024-05-09T00:09:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f526cff9700 1 -- 172.21.15.81:0/2225706211 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f376fc27b0 con 0x55f37700ca80 2024-05-09T00:09:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f526cff9700 10 client.17271 handle_command_reply: tid=0 2024-05-09T00:09:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f5297850b80 1 client.17271 shutdown 2024-05-09T00:09:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f5297850b80 1 -- 172.21.15.81:0/2225706211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff9270 msgr2=0x55f376ffca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f5297850b80 1 --2- 172.21.15.81:0/2225706211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff9270 0x55f376ffca90 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f527c009f50 tx=0x7f527c014b20 comp rx=0 tx=0).stop 2024-05-09T00:09:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f5297850b80 1 -- 172.21.15.81:0/2225706211 shutdown_connections 2024-05-09T00:09:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f5297850b80 1 --2- 172.21.15.81:0/2225706211 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f37700ca80 0x55f37700eea0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f5297850b80 1 --2- 172.21.15.81:0/2225706211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff9270 0x55f376ffca90 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f5297850b80 1 --2- 172.21.15.81:0/2225706211 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff3480 0x55f376fff190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f526cff9700 0 client.17271 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f5297850b80 1 --2- 172.21.15.81:0/2225706211 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 0x55f376ffc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f5297850b80 1 -- 172.21.15.81:0/2225706211 >> 172.21.15.81:0/2225706211 conn(0x55f376f511b0 msgr2=0x55f376ff74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f5297850b80 1 -- 172.21.15.81:0/2225706211 shutdown_connections 2024-05-09T00:09:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f5297850b80 1 -- 172.21.15.81:0/2225706211 wait complete. 2024-05-09T00:09:33.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.604+0000 7f5297850b80 20 client.17271 trim_cache size 0 max 16384 2024-05-09T00:09:33.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.619+0000 7f5297850b80 1 Processor -- start 2024-05-09T00:09:33.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.619+0000 7f5297850b80 1 -- start start 2024-05-09T00:09:33.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.619+0000 7f5297850b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f376fed910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.619+0000 7f5297850b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff8950 0x55f376ffecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.619+0000 7f5297850b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff9270 0x55f376ff24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.619+0000 7f5297850b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f376ffd070 con 0x55f376ff3480 2024-05-09T00:09:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.619+0000 7f5297850b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3770140b0 con 0x55f376ff9270 2024-05-09T00:09:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.619+0000 7f5297850b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f376ff8580 con 0x55f376ff8950 2024-05-09T00:09:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.619+0000 7f5289432700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f376fed910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.620+0000 7f5289432700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f376fed910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51230/0 (socket says 172.21.15.81:51230) 2024-05-09T00:09:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.620+0000 7f5289432700 1 -- 172.21.15.81:0/205443526 learned_addr learned my addr 172.21.15.81:0/205443526 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.620+0000 7f5288c31700 1 --2- 172.21.15.81:0/205443526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff8950 0x55f376ffecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.620+0000 7f5289c33700 1 --2- 172.21.15.81:0/205443526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff9270 0x55f376ff24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.620+0000 7f5289432700 1 -- 172.21.15.81:0/205443526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff8950 msgr2=0x55f376ffecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.620+0000 7f5289432700 1 --2- 172.21.15.81:0/205443526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff8950 0x55f376ffecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.620+0000 7f5289432700 1 -- 172.21.15.81:0/205443526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff9270 msgr2=0x55f376ff24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.620+0000 7f5289432700 1 --2- 172.21.15.81:0/205443526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff9270 0x55f376ff24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.620+0000 7f5289432700 1 -- 172.21.15.81:0/205443526 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f376f09500 con 0x55f376ff3480 2024-05-09T00:09:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.620+0000 7f5289c33700 1 --2- 172.21.15.81:0/205443526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff9270 0x55f376ff24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.620+0000 7f5289432700 1 --2- 172.21.15.81:0/205443526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f376fed910 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f52740ca2c0 tx=0x7f527401c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49bdba136748bc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.620+0000 7f526ffff700 1 -- 172.21.15.81:0/205443526 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52740a20a0 con 0x55f376ff3480 2024-05-09T00:09:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.620+0000 7f526ffff700 1 -- 172.21.15.81:0/205443526 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52740b1070 con 0x55f376ff3480 2024-05-09T00:09:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.620+0000 7f526ffff700 1 -- 172.21.15.81:0/205443526 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527409a0e0 con 0x55f376ff3480 2024-05-09T00:09:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.621+0000 7f5297850b80 1 -- 172.21.15.81:0/205443526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 msgr2=0x55f376fed910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.621+0000 7f5297850b80 1 --2- 172.21.15.81:0/205443526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f376fed910 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f52740ca2c0 tx=0x7f527401c040 comp rx=0 tx=0).stop 2024-05-09T00:09:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.621+0000 7f5297850b80 1 -- 172.21.15.81:0/205443526 shutdown_connections 2024-05-09T00:09:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.621+0000 7f5297850b80 1 --2- 172.21.15.81:0/205443526 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff9270 0x55f376ff24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.621+0000 7f5297850b80 1 --2- 172.21.15.81:0/205443526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f376fed910 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.621+0000 7f5297850b80 1 --2- 172.21.15.81:0/205443526 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff8950 0x55f376ffecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.621+0000 7f5297850b80 1 -- 172.21.15.81:0/205443526 >> 172.21.15.81:0/205443526 conn(0x55f376f511b0 msgr2=0x55f376ffad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.621+0000 7f5297850b80 1 -- 172.21.15.81:0/205443526 shutdown_connections 2024-05-09T00:09:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.621+0000 7f5297850b80 1 -- 172.21.15.81:0/205443526 wait complete. 2024-05-09T00:09:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.621+0000 7f5297850b80 1 -- start start 2024-05-09T00:09:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.621+0000 7f5297850b80 1 Processor -- start 2024-05-09T00:09:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5297850b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f377003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5297850b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 0x55f377002380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5297850b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff9270 0x55f3770028c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5297850b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f377002e00 con 0x55f376ff3480 2024-05-09T00:09:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5297850b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f377002f70 con 0x55f376ff8950 2024-05-09T00:09:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5297850b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f377003130 con 0x55f376ff9270 2024-05-09T00:09:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5297850b80 10 client.0 _ll_register_callbacks cb 0x55f376ee8ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5289432700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f377003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5289432700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f377003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51242/0 (socket says 172.21.15.81:51242) 2024-05-09T00:09:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5289432700 1 -- 172.21.15.81:0/1933826991 learned_addr learned my addr 172.21.15.81:0/1933826991 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5288c31700 1 --2- 172.21.15.81:0/1933826991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 0x55f377002380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5289432700 1 -- 172.21.15.81:0/1933826991 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff9270 msgr2=0x55f3770028c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:33.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5289432700 1 --2- 172.21.15.81:0/1933826991 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff9270 0x55f3770028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5289432700 1 -- 172.21.15.81:0/1933826991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 msgr2=0x55f377002380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5289432700 1 --2- 172.21.15.81:0/1933826991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 0x55f377002380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5289432700 1 -- 172.21.15.81:0/1933826991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52841a6140 con 0x55f376ff3480 2024-05-09T00:09:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5289432700 1 --2- 172.21.15.81:0/1933826991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f377003de0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f5274099bb0 tx=0x7f5274099810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d43ddd1b021faf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f526cff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f526cff9700 1 -- 172.21.15.81:0/1933826991 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52740b8030 con 0x55f376ff3480 2024-05-09T00:09:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f526cff9700 1 -- 172.21.15.81:0/1933826991 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f5274099310 con 0x55f376ff3480 2024-05-09T00:09:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5297850b80 1 -- 172.21.15.81:0/1933826991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f527c00f050 con 0x55f376ff3480 2024-05-09T00:09:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f526cff9700 1 -- 172.21.15.81:0/1933826991 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5274097e20 con 0x55f376ff3480 2024-05-09T00:09:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.622+0000 7f5297850b80 10 client.17277 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.623+0000 7f5297850b80 1 -- 172.21.15.81:0/1933826991 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f376dc8c70 con 0x55f376ff3480 2024-05-09T00:09:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.623+0000 7f526cff9700 1 -- 172.21.15.81:0/1933826991 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f527c00f050 con 0x55f376ff3480 2024-05-09T00:09:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.623+0000 7f526cff9700 1 -- 172.21.15.81:0/1933826991 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5274080030 con 0x55f376ff3480 2024-05-09T00:09:33.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.623+0000 7f5297850b80 10 client.17277 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.623+0000 7f5297850b80 10 client.17277 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.623+0000 7f5297850b80 20 client.17277 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.623+0000 7f5297850b80 1 --2- 172.21.15.81:0/1933826991 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f377063fb0 0x55f3770663d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.623+0000 7f5297850b80 4 client.17277 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:09:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.623+0000 7f5297850b80 1 -- 172.21.15.81:0/1933826991 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f376f3be60 con 0x55f377063fb0 2024-05-09T00:09:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.623+0000 7f5288c31700 1 --2- 172.21.15.81:0/1933826991 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f377063fb0 0x55f3770663d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.624+0000 7f526cff9700 10 client.17277 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.624+0000 7f5288c31700 1 --2- 172.21.15.81:0/1933826991 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f377063fb0 0x55f3770663d0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ee630df198e9b95 server_cookie=3eb2054eb82db972 in_seq=0 out_seq=0 2024-05-09T00:09:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.639+0000 7f526cff9700 1 -- 172.21.15.81:0/1933826991 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f376f3be60 con 0x55f377063fb0 2024-05-09T00:09:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.639+0000 7f526cff9700 10 client.17277 handle_command_reply: tid=0 2024-05-09T00:09:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.639+0000 7f5297850b80 1 client.17277 shutdown 2024-05-09T00:09:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.639+0000 7f5297850b80 1 -- 172.21.15.81:0/1933826991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 msgr2=0x55f377003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.639+0000 7f5297850b80 1 --2- 172.21.15.81:0/1933826991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f377003de0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f5274099bb0 tx=0x7f5274099810 comp rx=0 tx=0).stop 2024-05-09T00:09:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.639+0000 7f5297850b80 1 -- 172.21.15.81:0/1933826991 shutdown_connections 2024-05-09T00:09:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.639+0000 7f5297850b80 1 --2- 172.21.15.81:0/1933826991 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f377063fb0 0x55f3770663d0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.639+0000 7f5297850b80 1 --2- 172.21.15.81:0/1933826991 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f376ff9270 0x55f3770028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.639+0000 7f526cff9700 0 client.17277 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.639+0000 7f5297850b80 1 --2- 172.21.15.81:0/1933826991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f376ff3480 0x55f377003de0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.639+0000 7f5297850b80 1 --2- 172.21.15.81:0/1933826991 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f376ff8950 0x55f377002380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.639+0000 7f5297850b80 1 -- 172.21.15.81:0/1933826991 >> 172.21.15.81:0/1933826991 conn(0x55f376f511b0 msgr2=0x55f376ff24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f5297850b80 1 -- 172.21.15.81:0/1933826991 shutdown_connections 2024-05-09T00:09:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f5297850b80 1 -- 172.21.15.81:0/1933826991 wait complete. 2024-05-09T00:09:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f5297850b80 20 client.17277 trim_cache size 0 max 16384 2024-05-09T00:09:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:09:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:09:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:09:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:09:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f528b696700 1 -- 172.21.15.81:0/4194042856 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f52700a1310 msgr2=0x7f52700a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f528b696700 1 --2- 172.21.15.81:0/4194042856 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f52700a1310 0x7f52700a37d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5280005850 tx=0x7f528001a040 comp rx=0 tx=0).stop 2024-05-09T00:09:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f528b696700 1 -- 172.21.15.81:0/4194042856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52840ffda0 msgr2=0x7f5284101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f528b696700 1 --2- 172.21.15.81:0/4194042856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52840ffda0 0x7f5284101ec0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f527400d980 tx=0x7f527400dd40 comp rx=0 tx=0).stop 2024-05-09T00:09:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f528b696700 1 -- 172.21.15.81:0/4194042856 shutdown_connections 2024-05-09T00:09:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f528b696700 1 --2- 172.21.15.81:0/4194042856 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f52700a1310 0x7f52700a37d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f528b696700 1 --2- 172.21.15.81:0/4194042856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5284105e60 0x7f5284102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f528b696700 1 --2- 172.21.15.81:0/4194042856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52840ffda0 0x7f5284101ec0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f528b696700 1 --2- 172.21.15.81:0/4194042856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5284100760 0x7f5284102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f528b696700 1 -- 172.21.15.81:0/4194042856 >> 172.21.15.81:0/4194042856 conn(0x7f5284076fd0 msgr2=0x7f5284104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f528b696700 1 -- 172.21.15.81:0/4194042856 shutdown_connections 2024-05-09T00:09:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:33.640+0000 7f528b696700 1 -- 172.21.15.81:0/4194042856 wait complete. 2024-05-09T00:09:35.121 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:34 smithi081 ceph-mon[42474]: pgmap v201: 97 pgs: 97 active+clean; 5.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-05-09T00:09:35.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:34 smithi150 ceph-mon[46187]: pgmap v201: 97 pgs: 97 active+clean; 5.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-05-09T00:09:35.321 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:34 smithi171 ceph-mon[47351]: pgmap v201: 97 pgs: 97 active+clean; 5.7 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-05-09T00:09:36.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:09:36.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.274+0000 7f0a97979700 1 -- 172.21.15.81:0/2043061708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a90100060 msgr2=0x7f0a90100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.274+0000 7f0a97979700 1 --2- 172.21.15.81:0/2043061708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a90100060 0x7f0a90100440 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009990 tx=0x7f0a80009ca0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.274+0000 7f0a97979700 1 -- 172.21.15.81:0/2043061708 shutdown_connections 2024-05-09T00:09:36.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.274+0000 7f0a97979700 1 --2- 172.21.15.81:0/2043061708 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a90105160 0x7f0a9010cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.274+0000 7f0a97979700 1 --2- 172.21.15.81:0/2043061708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a90100060 0x7f0a90100440 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.274+0000 7f0a97979700 1 --2- 172.21.15.81:0/2043061708 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a90100a10 0x7f0a90104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.274+0000 7f0a97979700 1 -- 172.21.15.81:0/2043061708 >> 172.21.15.81:0/2043061708 conn(0x7f0a90076f40 msgr2=0x7f0a90077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:36.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.274+0000 7f0a97979700 1 -- 172.21.15.81:0/2043061708 shutdown_connections 2024-05-09T00:09:36.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.274+0000 7f0a97979700 1 -- 172.21.15.81:0/2043061708 wait complete. 2024-05-09T00:09:36.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.275+0000 7f0a97979700 1 Processor -- start 2024-05-09T00:09:36.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.275+0000 7f0a97979700 1 -- start start 2024-05-09T00:09:36.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.275+0000 7f0a97979700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a90100060 0x7f0a90196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.275+0000 7f0a97979700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a90105160 0x7f0a90196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.275+0000 7f0a97979700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a9019ab10 0x7f0a9019af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.275+0000 7f0a97979700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9019b590 con 0x7f0a90100060 2024-05-09T00:09:36.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.275+0000 7f0a97979700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9019b700 con 0x7f0a90105160 2024-05-09T00:09:36.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.275+0000 7f0a97979700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9019b8c0 con 0x7f0a9019ab10 2024-05-09T00:09:36.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.275+0000 7f0a95715700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a90100060 0x7f0a90196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.275+0000 7f0a95715700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a90100060 0x7f0a90196230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51256/0 (socket says 172.21.15.81:51256) 2024-05-09T00:09:36.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.275+0000 7f0a95715700 1 -- 172.21.15.81:0/1822005957 learned_addr learned my addr 172.21.15.81:0/1822005957 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:36.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.276+0000 7f0a95f16700 1 --2- 172.21.15.81:0/1822005957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a9019ab10 0x7f0a9019af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.276+0000 7f0a94f14700 1 --2- 172.21.15.81:0/1822005957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a90105160 0x7f0a90196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.276+0000 7f0a95715700 1 -- 172.21.15.81:0/1822005957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a9019ab10 msgr2=0x7f0a9019af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.276+0000 7f0a95715700 1 --2- 172.21.15.81:0/1822005957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a9019ab10 0x7f0a9019af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.276+0000 7f0a95715700 1 -- 172.21.15.81:0/1822005957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a90105160 msgr2=0x7f0a90196770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.276+0000 7f0a95715700 1 --2- 172.21.15.81:0/1822005957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a90105160 0x7f0a90196770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.276+0000 7f0a95715700 1 -- 172.21.15.81:0/1822005957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a800095f0 con 0x7f0a90100060 2024-05-09T00:09:36.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.276+0000 7f0a95715700 1 --2- 172.21.15.81:0/1822005957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a90100060 0x7f0a90196230 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f0a80004760 tx=0x7f0a80004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:36.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.276+0000 7f0a867fc700 1 -- 172.21.15.81:0/1822005957 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8001d070 con 0x7f0a90100060 2024-05-09T00:09:36.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.276+0000 7f0a867fc700 1 -- 172.21.15.81:0/1822005957 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a8000fc70 con 0x7f0a90100060 2024-05-09T00:09:36.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.276+0000 7f0a97979700 1 -- 172.21.15.81:0/1822005957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a901a2dc0 con 0x7f0a90100060 2024-05-09T00:09:36.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.276+0000 7f0a867fc700 1 -- 172.21.15.81:0/1822005957 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a80022e40 con 0x7f0a90100060 2024-05-09T00:09:36.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.276+0000 7f0a97979700 1 -- 172.21.15.81:0/1822005957 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a901a3190 con 0x7f0a90100060 2024-05-09T00:09:36.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.278+0000 7f0a867fc700 1 -- 172.21.15.81:0/1822005957 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f0a80022500 con 0x7f0a90100060 2024-05-09T00:09:36.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.279+0000 7f0a867fc700 1 --2- 172.21.15.81:0/1822005957 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a7c0a1290 0x7f0a7c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.279+0000 7f0a94f14700 1 --2- 172.21.15.81:0/1822005957 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a7c0a1290 0x7f0a7c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.279+0000 7f0a867fc700 1 -- 172.21.15.81:0/1822005957 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f0a800cdff0 con 0x7f0a90100060 2024-05-09T00:09:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.280+0000 7f0a94f14700 1 --2- 172.21.15.81:0/1822005957 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a7c0a1290 0x7f0a7c0a3750 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c005ea0 tx=0x7f0a8c005e30 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.280+0000 7f0aa3b33b80 1 Processor -- start 2024-05-09T00:09:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.280+0000 7f0aa3b33b80 1 -- start start 2024-05-09T00:09:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0aa3b33b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc209350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0aa3b33b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc209890 0x5624bc209d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0aa3b33b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc2179d0 0x5624bc219dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0aa3b33b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bc160150 con 0x5624bc20aed0 2024-05-09T00:09:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0aa3b33b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bc15db10 con 0x5624bc209890 2024-05-09T00:09:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0aa3b33b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bc159400 con 0x5624bc2179d0 2024-05-09T00:09:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0a95715700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc209350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0a95715700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc209350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51258/0 (socket says 172.21.15.81:51258) 2024-05-09T00:09:36.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0a95715700 1 -- 172.21.15.81:0/764196625 learned_addr learned my addr 172.21.15.81:0/764196625 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0a95715700 1 -- 172.21.15.81:0/764196625 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc2179d0 msgr2=0x5624bc219dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0a95715700 1 --2- 172.21.15.81:0/764196625 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc2179d0 0x5624bc219dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0a95715700 1 -- 172.21.15.81:0/764196625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc209890 msgr2=0x5624bc209d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0a95715700 1 --2- 172.21.15.81:0/764196625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc209890 0x5624bc209d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0a95715700 1 -- 172.21.15.81:0/764196625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624bbfda3b0 con 0x5624bc20aed0 2024-05-09T00:09:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0a95715700 1 --2- 172.21.15.81:0/764196625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc209350 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f0a800a3010 tx=0x7f0a800228a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6990efbf2e95bebd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0a7b7fe700 1 -- 172.21.15.81:0/764196625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8009fea0 con 0x5624bc20aed0 2024-05-09T00:09:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0a7b7fe700 1 -- 172.21.15.81:0/764196625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a8009b150 con 0x5624bc20aed0 2024-05-09T00:09:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.281+0000 7f0a7b7fe700 1 -- 172.21.15.81:0/764196625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8009b3b0 con 0x5624bc20aed0 2024-05-09T00:09:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.282+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/764196625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 msgr2=0x5624bc209350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.282+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/764196625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc209350 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f0a800a3010 tx=0x7f0a800228a0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.282+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/764196625 shutdown_connections 2024-05-09T00:09:36.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.282+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/764196625 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc2179d0 0x5624bc219dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.282+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/764196625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc209350 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.282+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/764196625 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc209890 0x5624bc209d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.282+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/764196625 >> 172.21.15.81:0/764196625 conn(0x5624bc167210 msgr2=0x5624bc203df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.282+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/764196625 shutdown_connections 2024-05-09T00:09:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.282+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/764196625 wait complete. 2024-05-09T00:09:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.282+0000 7f0aa3b33b80 1 -- start start 2024-05-09T00:09:36.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.282+0000 7f0aa3b33b80 1 Processor -- start 2024-05-09T00:09:36.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0aa3b33b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc209890 0x5624bc217fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0aa3b33b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc2184e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0aa3b33b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc2179d0 0x5624bc222e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0aa3b33b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bc0f5560 con 0x5624bc20aed0 2024-05-09T00:09:36.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0aa3b33b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bc0f5200 con 0x5624bc2179d0 2024-05-09T00:09:36.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0aa3b33b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bbfdc6a0 con 0x5624bc209890 2024-05-09T00:09:36.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0aa3b33b80 10 client.0 _ll_register_callbacks cb 0x5624bc0feb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:36.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0a94f14700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc2184e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0a94f14700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc2184e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51264/0 (socket says 172.21.15.81:51264) 2024-05-09T00:09:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0a94f14700 1 -- 172.21.15.81:0/1020070795 learned_addr learned my addr 172.21.15.81:0/1020070795 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0a95715700 1 --2- 172.21.15.81:0/1020070795 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc209890 0x5624bc217fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0a95f16700 1 --2- 172.21.15.81:0/1020070795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc2179d0 0x5624bc222e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0a94f14700 1 -- 172.21.15.81:0/1020070795 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc209890 msgr2=0x5624bc217fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0a94f14700 1 --2- 172.21.15.81:0/1020070795 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc209890 0x5624bc217fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0a94f14700 1 -- 172.21.15.81:0/1020070795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc2179d0 msgr2=0x5624bc222e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0a94f14700 1 --2- 172.21.15.81:0/1020070795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc2179d0 0x5624bc222e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0a94f14700 1 -- 172.21.15.81:0/1020070795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a901a3190 con 0x5624bc20aed0 2024-05-09T00:09:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0a95f16700 1 --2- 172.21.15.81:0/1020070795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc2179d0 0x5624bc222e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0a94f14700 1 --2- 172.21.15.81:0/1020070795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc2184e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c005d60 tx=0x7f0a8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd13ed3c5a2c5eb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.283+0000 7f0a78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0a78ff9700 1 -- 172.21.15.81:0/1020070795 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c01d660 con 0x5624bc20aed0 2024-05-09T00:09:36.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0a78ff9700 1 -- 172.21.15.81:0/1020070795 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f0a8c01d7c0 con 0x5624bc20aed0 2024-05-09T00:09:36.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/1020070795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624bc0b2270 con 0x5624bc20aed0 2024-05-09T00:09:36.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0a78ff9700 1 -- 172.21.15.81:0/1020070795 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a8c01d980 con 0x5624bc20aed0 2024-05-09T00:09:36.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0aa3b33b80 10 client.17289 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:36.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/1020070795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5624bbf86b60 con 0x5624bc20aed0 2024-05-09T00:09:36.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0a78ff9700 1 -- 172.21.15.81:0/1020070795 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5624bc0b2270 con 0x5624bc20aed0 2024-05-09T00:09:36.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0a78ff9700 1 -- 172.21.15.81:0/1020070795 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0a8c00fca0 con 0x5624bc20aed0 2024-05-09T00:09:36.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0aa3b33b80 10 client.17289 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:36.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0aa3b33b80 10 client.17289 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:36.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0aa3b33b80 20 client.17289 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:36.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/1020070795 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5624bc227410 0x5624bc229830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0aa3b33b80 4 client.17289 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:36.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/1020070795 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624bc1d8810 con 0x5624bc227410 2024-05-09T00:09:36.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.284+0000 7f0a95715700 1 --2- 172.21.15.81:0/1020070795 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5624bc227410 0x5624bc229830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.285+0000 7f0a78ff9700 10 client.17289 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:36.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.285+0000 7f0a95715700 1 --2- 172.21.15.81:0/1020070795 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5624bc227410 0x5624bc229830 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1792753cc281d84 server_cookie=7c07bbf5cf6cfe94 in_seq=0 out_seq=0 2024-05-09T00:09:36.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0a78ff9700 1 -- 172.21.15.81:0/1020070795 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5624bc1d8810 con 0x5624bc227410 2024-05-09T00:09:36.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0a78ff9700 10 client.17289 handle_command_reply: tid=0 2024-05-09T00:09:36.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0aa3b33b80 1 client.17289 shutdown 2024-05-09T00:09:36.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/1020070795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 msgr2=0x5624bc2184e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/1020070795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc2184e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c005d60 tx=0x7f0a8c004750 comp rx=0 tx=0).stop 2024-05-09T00:09:36.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/1020070795 shutdown_connections 2024-05-09T00:09:36.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/1020070795 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5624bc227410 0x5624bc229830 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/1020070795 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc2179d0 0x5624bc222e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0a78ff9700 0 client.17289 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:36.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/1020070795 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc209890 0x5624bc217fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/1020070795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc2184e0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/1020070795 >> 172.21.15.81:0/1020070795 conn(0x5624bc167210 msgr2=0x5624bc2035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:36.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/1020070795 shutdown_connections 2024-05-09T00:09:36.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/1020070795 wait complete. 2024-05-09T00:09:36.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.286+0000 7f0aa3b33b80 20 client.17289 trim_cache size 0 max 16384 2024-05-09T00:09:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0aa3b33b80 1 Processor -- start 2024-05-09T00:09:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0aa3b33b80 1 -- start start 2024-05-09T00:09:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0aa3b33b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc209890 0x5624bc209350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0aa3b33b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc2184c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0aa3b33b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc2179d0 0x5624bc21cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0aa3b33b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bc2048e0 con 0x5624bc20aed0 2024-05-09T00:09:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0aa3b33b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bc204ae0 con 0x5624bc2179d0 2024-05-09T00:09:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0aa3b33b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bc22ea00 con 0x5624bc209890 2024-05-09T00:09:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0a94f14700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc2184c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0a94f14700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc2184c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51270/0 (socket says 172.21.15.81:51270) 2024-05-09T00:09:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0a94f14700 1 -- 172.21.15.81:0/2057813058 learned_addr learned my addr 172.21.15.81:0/2057813058 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0a95f16700 1 --2- 172.21.15.81:0/2057813058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc2179d0 0x5624bc21cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0a95715700 1 --2- 172.21.15.81:0/2057813058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc209890 0x5624bc209350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0a94f14700 1 -- 172.21.15.81:0/2057813058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc209890 msgr2=0x5624bc209350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0a94f14700 1 --2- 172.21.15.81:0/2057813058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc209890 0x5624bc209350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0a94f14700 1 -- 172.21.15.81:0/2057813058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc2179d0 msgr2=0x5624bc21cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0a94f14700 1 --2- 172.21.15.81:0/2057813058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc2179d0 0x5624bc21cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0a94f14700 1 -- 172.21.15.81:0/2057813058 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624bc11f560 con 0x5624bc20aed0 2024-05-09T00:09:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.303+0000 7f0a95715700 1 --2- 172.21.15.81:0/2057813058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc209890 0x5624bc209350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.304+0000 7f0a94f14700 1 --2- 172.21.15.81:0/2057813058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc2184c0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c013040 tx=0x7f0a8c0256a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f4f64ae0d8fcbb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.304+0000 7f0a7bfff700 1 -- 172.21.15.81:0/2057813058 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c010cd0 con 0x5624bc20aed0 2024-05-09T00:09:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.304+0000 7f0a7bfff700 1 -- 172.21.15.81:0/2057813058 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a8c010e30 con 0x5624bc20aed0 2024-05-09T00:09:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.304+0000 7f0a7bfff700 1 -- 172.21.15.81:0/2057813058 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c026440 con 0x5624bc20aed0 2024-05-09T00:09:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.304+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/2057813058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 msgr2=0x5624bc2184c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.304+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/2057813058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc2184c0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c013040 tx=0x7f0a8c0256a0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.304+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/2057813058 shutdown_connections 2024-05-09T00:09:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.304+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/2057813058 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc2179d0 0x5624bc21cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.304+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/2057813058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc209890 0x5624bc209350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.304+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/2057813058 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc20aed0 0x5624bc2184c0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.304+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/2057813058 >> 172.21.15.81:0/2057813058 conn(0x5624bc167210 msgr2=0x5624bc217db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.304+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/2057813058 shutdown_connections 2024-05-09T00:09:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.304+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/2057813058 wait complete. 2024-05-09T00:09:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.305+0000 7f0aa3b33b80 1 -- start start 2024-05-09T00:09:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.305+0000 7f0aa3b33b80 1 Processor -- start 2024-05-09T00:09:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.305+0000 7f0aa3b33b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc209890 0x5624bc21ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.305+0000 7f0aa3b33b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc20aed0 0x5624bc21cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.305+0000 7f0aa3b33b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc2179d0 0x5624bc21afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.305+0000 7f0aa3b33b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bc21b670 con 0x5624bc2179d0 2024-05-09T00:09:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.305+0000 7f0aa3b33b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bc21b7e0 con 0x5624bc209890 2024-05-09T00:09:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.305+0000 7f0aa3b33b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624bc21b9a0 con 0x5624bc20aed0 2024-05-09T00:09:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.305+0000 7f0aa3b33b80 10 client.0 _ll_register_callbacks cb 0x5624bc0feb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.305+0000 7f0a95f16700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc2179d0 0x5624bc21afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.305+0000 7f0a95f16700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc2179d0 0x5624bc21afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51278/0 (socket says 172.21.15.81:51278) 2024-05-09T00:09:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.305+0000 7f0a95f16700 1 -- 172.21.15.81:0/4142946902 learned_addr learned my addr 172.21.15.81:0/4142946902 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.305+0000 7f0a94f14700 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc20aed0 0x5624bc21cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a95f16700 1 -- 172.21.15.81:0/4142946902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc20aed0 msgr2=0x5624bc21cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a95f16700 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc20aed0 0x5624bc21cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a95f16700 1 -- 172.21.15.81:0/4142946902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc209890 msgr2=0x5624bc21ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a95715700 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc209890 0x5624bc21ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a95f16700 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc209890 0x5624bc21ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a95f16700 1 -- 172.21.15.81:0/4142946902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5624bbf86b60 con 0x5624bc2179d0 2024-05-09T00:09:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a94f14700 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc20aed0 0x5624bc21cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a95715700 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc209890 0x5624bc21ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a95f16700 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc2179d0 0x5624bc21afb0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0a880078a0 tx=0x7f0a88007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e06861d049b51e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a78ff9700 1 -- 172.21.15.81:0/4142946902 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88007e40 con 0x5624bc2179d0 2024-05-09T00:09:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a78ff9700 1 -- 172.21.15.81:0/4142946902 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f0a88004bb0 con 0x5624bc2179d0 2024-05-09T00:09:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/4142946902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a8009b150 con 0x5624bc2179d0 2024-05-09T00:09:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a78ff9700 1 -- 172.21.15.81:0/4142946902 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a88004d70 con 0x5624bc2179d0 2024-05-09T00:09:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0aa3b33b80 10 client.17295 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/4142946902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5624bbfdecd0 con 0x5624bc2179d0 2024-05-09T00:09:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a78ff9700 1 -- 172.21.15.81:0/4142946902 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a8009b150 con 0x5624bc2179d0 2024-05-09T00:09:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0a78ff9700 1 -- 172.21.15.81:0/4142946902 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0a88017980 con 0x5624bc2179d0 2024-05-09T00:09:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0aa3b33b80 10 client.17295 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0aa3b33b80 10 client.17295 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0aa3b33b80 20 client.17295 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5624bc227410 0x5624bc280bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0aa3b33b80 4 client.17295 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:09:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.306+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/4142946902 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5624bc151ec0 con 0x5624bc227410 2024-05-09T00:09:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0a95715700 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5624bc227410 0x5624bc280bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0a78ff9700 10 client.17295 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0a95715700 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5624bc227410 0x5624bc280bc0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c2301f74c20f907 server_cookie=81f0e050526c17f4 in_seq=0 out_seq=0 2024-05-09T00:09:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0a78ff9700 1 -- 172.21.15.81:0/4142946902 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5624bc151ec0 con 0x5624bc227410 2024-05-09T00:09:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0a78ff9700 10 client.17295 handle_command_reply: tid=0 2024-05-09T00:09:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0aa3b33b80 1 client.17295 shutdown 2024-05-09T00:09:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/4142946902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc2179d0 msgr2=0x5624bc21afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc2179d0 0x5624bc21afb0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f0a880078a0 tx=0x7f0a88007c60 comp rx=0 tx=0).stop 2024-05-09T00:09:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/4142946902 shutdown_connections 2024-05-09T00:09:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5624bc227410 0x5624bc280bc0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5624bc209890 0x5624bc21ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0a78ff9700 0 client.17295 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5624bc2179d0 0x5624bc21afb0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0aa3b33b80 1 --2- 172.21.15.81:0/4142946902 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5624bc20aed0 0x5624bc21cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.307+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/4142946902 >> 172.21.15.81:0/4142946902 conn(0x5624bc167210 msgr2=0x5624bc215600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/4142946902 shutdown_connections 2024-05-09T00:09:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0aa3b33b80 1 -- 172.21.15.81:0/4142946902 wait complete. 2024-05-09T00:09:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0aa3b33b80 20 client.17295 trim_cache size 0 max 16384 2024-05-09T00:09:36.312 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:09:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:09:36.312 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:09:36.312 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:09:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0a97979700 1 -- 172.21.15.81:0/1822005957 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a7c0a1290 msgr2=0x7f0a7c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0a97979700 1 --2- 172.21.15.81:0/1822005957 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a7c0a1290 0x7f0a7c0a3750 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c005ea0 tx=0x7f0a8c005e30 comp rx=0 tx=0).stop 2024-05-09T00:09:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0a97979700 1 -- 172.21.15.81:0/1822005957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a90100060 msgr2=0x7f0a90196230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0a97979700 1 --2- 172.21.15.81:0/1822005957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a90100060 0x7f0a90196230 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f0a80004760 tx=0x7f0a80004790 comp rx=0 tx=0).stop 2024-05-09T00:09:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0a97979700 1 -- 172.21.15.81:0/1822005957 shutdown_connections 2024-05-09T00:09:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0a97979700 1 --2- 172.21.15.81:0/1822005957 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a7c0a1290 0x7f0a7c0a3750 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0a97979700 1 --2- 172.21.15.81:0/1822005957 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a9019ab10 0x7f0a9019af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0a97979700 1 --2- 172.21.15.81:0/1822005957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a90100060 0x7f0a90196230 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0a97979700 1 --2- 172.21.15.81:0/1822005957 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a90105160 0x7f0a90196770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0a97979700 1 -- 172.21.15.81:0/1822005957 >> 172.21.15.81:0/1822005957 conn(0x7f0a90076f40 msgr2=0x7f0a900fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0a97979700 1 -- 172.21.15.81:0/1822005957 shutdown_connections 2024-05-09T00:09:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.308+0000 7f0a97979700 1 -- 172.21.15.81:0/1822005957 wait complete. 2024-05-09T00:09:36.317 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:09:36.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:09:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.442+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1374803901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4980ff9a0 msgr2=0x7fc4980ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.442+0000 7fc49d5f0700 1 --2- 172.21.15.81:0/1374803901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4980ff9a0 0x7fc4980ffd80 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc48c009990 tx=0x7fc48c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.442+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1374803901 shutdown_connections 2024-05-09T00:09:36.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.442+0000 7fc49d5f0700 1 --2- 172.21.15.81:0/1374803901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4981061d0 0x7fc49810dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.442+0000 7fc49d5f0700 1 --2- 172.21.15.81:0/1374803901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4980ff9a0 0x7fc4980ffd80 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.442+0000 7fc49d5f0700 1 --2- 172.21.15.81:0/1374803901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc498100350 0x7fc498105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.442+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1374803901 >> 172.21.15.81:0/1374803901 conn(0x7fc4980750b0 msgr2=0x7fc4980754c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:36.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.442+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1374803901 shutdown_connections 2024-05-09T00:09:36.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.442+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1374803901 wait complete. 2024-05-09T00:09:36.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.442+0000 7fc49d5f0700 1 Processor -- start 2024-05-09T00:09:36.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.442+0000 7fc49d5f0700 1 -- start start 2024-05-09T00:09:36.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc49d5f0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4980ff9a0 0x7fc4981972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc49d5f0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4981061d0 0x7fc498197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc49d5f0700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc49819bbd0 0x7fc49819c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc49d5f0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49819c650 con 0x7fc4981061d0 2024-05-09T00:09:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc49d5f0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49819c7c0 con 0x7fc4980ff9a0 2024-05-09T00:09:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc49d5f0700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49819c980 con 0x7fc49819bbd0 2024-05-09T00:09:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc4967fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4981061d0 0x7fc498197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc4967fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4981061d0 0x7fc498197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51292/0 (socket says 172.21.15.81:51292) 2024-05-09T00:09:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc4967fc700 1 -- 172.21.15.81:0/1700950834 learned_addr learned my addr 172.21.15.81:0/1700950834 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc4977fe700 1 --2- 172.21.15.81:0/1700950834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc49819bbd0 0x7fc49819c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc496ffd700 1 --2- 172.21.15.81:0/1700950834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4980ff9a0 0x7fc4981972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc4967fc700 1 -- 172.21.15.81:0/1700950834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc49819bbd0 msgr2=0x7fc49819c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc4967fc700 1 --2- 172.21.15.81:0/1700950834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc49819bbd0 0x7fc49819c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc4967fc700 1 -- 172.21.15.81:0/1700950834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4980ff9a0 msgr2=0x7fc4981972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc4967fc700 1 --2- 172.21.15.81:0/1700950834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4980ff9a0 0x7fc4981972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc4967fc700 1 -- 172.21.15.81:0/1700950834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c0095f0 con 0x7fc4981061d0 2024-05-09T00:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc4967fc700 1 --2- 172.21.15.81:0/1700950834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4981061d0 0x7fc498197830 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc48800d950 tx=0x7fc48800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.443+0000 7fc47ffff700 1 -- 172.21.15.81:0/1700950834 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48800f890 con 0x7fc4981061d0 2024-05-09T00:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.444+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1700950834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4981a3ee0 con 0x7fc4981061d0 2024-05-09T00:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.444+0000 7fc47ffff700 1 -- 172.21.15.81:0/1700950834 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc488010460 con 0x7fc4981061d0 2024-05-09T00:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.444+0000 7fc47ffff700 1 -- 172.21.15.81:0/1700950834 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48800e610 con 0x7fc4981061d0 2024-05-09T00:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.444+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1700950834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4981a4360 con 0x7fc4981061d0 2024-05-09T00:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.444+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1700950834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4981093b0 con 0x7fc4981061d0 2024-05-09T00:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.446+0000 7fc47ffff700 1 -- 172.21.15.81:0/1700950834 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc488010860 con 0x7fc4981061d0 2024-05-09T00:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.446+0000 7fc47ffff700 1 --2- 172.21.15.81:0/1700950834 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc4800a1290 0x7fc4800a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.447+0000 7fc47ffff700 1 -- 172.21.15.81:0/1700950834 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7fc4880cc700 con 0x7fc4981061d0 2024-05-09T00:09:36.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.447+0000 7fc496ffd700 1 --2- 172.21.15.81:0/1700950834 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc4800a1290 0x7fc4800a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.447+0000 7fc496ffd700 1 --2- 172.21.15.81:0/1700950834 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc4800a1290 0x7fc4800a3750 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00b5c0 tx=0x7fc48c005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:36.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.450+0000 7fc47ffff700 1 -- 172.21.15.81:0/1700950834 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc488095b50 con 0x7fc4981061d0 2024-05-09T00:09:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.696+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1700950834 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc498068ee0 con 0x7fc4981061d0 2024-05-09T00:09:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.697+0000 7fc47ffff700 1 -- 172.21.15.81:0/1700950834 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7fc488099170 con 0x7fc4981061d0 2024-05-09T00:09:36.694 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:09:36.694 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:09:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.699+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1700950834 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc4800a1290 msgr2=0x7fc4800a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.699+0000 7fc49d5f0700 1 --2- 172.21.15.81:0/1700950834 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc4800a1290 0x7fc4800a3750 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00b5c0 tx=0x7fc48c005960 comp rx=0 tx=0).stop 2024-05-09T00:09:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.699+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1700950834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4981061d0 msgr2=0x7fc498197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.699+0000 7fc49d5f0700 1 --2- 172.21.15.81:0/1700950834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4981061d0 0x7fc498197830 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc48800d950 tx=0x7fc48800dc60 comp rx=0 tx=0).stop 2024-05-09T00:09:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.699+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1700950834 shutdown_connections 2024-05-09T00:09:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.699+0000 7fc49d5f0700 1 --2- 172.21.15.81:0/1700950834 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc4800a1290 0x7fc4800a3750 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.699+0000 7fc49d5f0700 1 --2- 172.21.15.81:0/1700950834 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc4980ff9a0 0x7fc4981972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.699+0000 7fc49d5f0700 1 --2- 172.21.15.81:0/1700950834 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc49819bbd0 0x7fc49819c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.699+0000 7fc49d5f0700 1 --2- 172.21.15.81:0/1700950834 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4981061d0 0x7fc498197830 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.699+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1700950834 >> 172.21.15.81:0/1700950834 conn(0x7fc4980750b0 msgr2=0x7fc4980fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.699+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1700950834 shutdown_connections 2024-05-09T00:09:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.699+0000 7fc49d5f0700 1 -- 172.21.15.81:0/1700950834 wait complete. 2024-05-09T00:09:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:09:36.710 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:09:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.838+0000 7f98f6f66700 1 -- 172.21.15.81:0/2339212328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f0100060 msgr2=0x7f98f0100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.838+0000 7f98f6f66700 1 --2- 172.21.15.81:0/2339212328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f0100060 0x7f98f0100440 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009990 tx=0x7f98e4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.838+0000 7f98f6f66700 1 -- 172.21.15.81:0/2339212328 shutdown_connections 2024-05-09T00:09:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.838+0000 7f98f6f66700 1 --2- 172.21.15.81:0/2339212328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f0105170 0x7f98f010ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.838+0000 7f98f6f66700 1 --2- 172.21.15.81:0/2339212328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f0100060 0x7f98f0100440 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.838+0000 7f98f6f66700 1 --2- 172.21.15.81:0/2339212328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98f0100a10 0x7f98f0104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.838+0000 7f98f6f66700 1 -- 172.21.15.81:0/2339212328 >> 172.21.15.81:0/2339212328 conn(0x7f98f0076f30 msgr2=0x7f98f0077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.838+0000 7f98f6f66700 1 -- 172.21.15.81:0/2339212328 shutdown_connections 2024-05-09T00:09:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.838+0000 7f98f6f66700 1 -- 172.21.15.81:0/2339212328 wait complete. 2024-05-09T00:09:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.838+0000 7f98f6f66700 1 Processor -- start 2024-05-09T00:09:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.838+0000 7f98f6f66700 1 -- start start 2024-05-09T00:09:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98f6f66700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f0100060 0x7f98f0198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98f6f66700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f0105170 0x7f98f0198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98f6f66700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98f0198d80 0x7f98f01a3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98f6f66700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f01a3a20 con 0x7f98f0105170 2024-05-09T00:09:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98f6f66700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f01a3b90 con 0x7f98f0100060 2024-05-09T00:09:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98f6f66700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f01a3d50 con 0x7f98f0198d80 2024-05-09T00:09:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98effff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f0105170 0x7f98f0198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98effff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f0105170 0x7f98f0198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51300/0 (socket says 172.21.15.81:51300) 2024-05-09T00:09:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98effff700 1 -- 172.21.15.81:0/1056124926 learned_addr learned my addr 172.21.15.81:0/1056124926 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98effff700 1 -- 172.21.15.81:0/1056124926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98f0198d80 msgr2=0x7f98f01a3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98effff700 1 --2- 172.21.15.81:0/1056124926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98f0198d80 0x7f98f01a3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98effff700 1 -- 172.21.15.81:0/1056124926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f0100060 msgr2=0x7f98f0198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98effff700 1 --2- 172.21.15.81:0/1056124926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f0100060 0x7f98f0198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98effff700 1 -- 172.21.15.81:0/1056124926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e40095f0 con 0x7f98f0105170 2024-05-09T00:09:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98effff700 1 --2- 172.21.15.81:0/1056124926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f0105170 0x7f98f0198840 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00b500 tx=0x7f98dc00b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98edffb700 1 -- 172.21.15.81:0/1056124926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc011830 con 0x7f98f0105170 2024-05-09T00:09:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98f6f66700 1 -- 172.21.15.81:0/1056124926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f01a3fd0 con 0x7f98f0105170 2024-05-09T00:09:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98edffb700 1 -- 172.21.15.81:0/1056124926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98dc011e50 con 0x7f98f0105170 2024-05-09T00:09:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.839+0000 7f98edffb700 1 -- 172.21.15.81:0/1056124926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc00f2e0 con 0x7f98f0105170 2024-05-09T00:09:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.840+0000 7f98f6f66700 1 -- 172.21.15.81:0/1056124926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f01a44d0 con 0x7f98f0105170 2024-05-09T00:09:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.841+0000 7f98edffb700 1 -- 172.21.15.81:0/1056124926 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f98dc0105a0 con 0x7f98f0105170 2024-05-09T00:09:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.842+0000 7f98edffb700 1 --2- 172.21.15.81:0/1056124926 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f98e00a1290 0x7f98e00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.842+0000 7f98edffb700 1 -- 172.21.15.81:0/1056124926 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f98dc0cc720 con 0x7f98f0105170 2024-05-09T00:09:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.842+0000 7f98f4d02700 1 --2- 172.21.15.81:0/1056124926 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f98e00a1290 0x7f98e00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.842+0000 7f98f4d02700 1 --2- 172.21.15.81:0/1056124926 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f98e00a1290 0x7f98e00a3750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f98e400b5c0 tx=0x7f98e4005fb0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.843+0000 7f9903120b80 1 Processor -- start 2024-05-09T00:09:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.843+0000 7f9903120b80 1 -- start start 2024-05-09T00:09:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.843+0000 7f9903120b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf2ae00 0x561f6cf2b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.843+0000 7f9903120b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2b720 0x561f6cf25350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.843+0000 7f9903120b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf25890 0x561f6cf25cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.843+0000 7f9903120b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6ce7c150 con 0x561f6cf25890 2024-05-09T00:09:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.843+0000 7f9903120b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6ce79b10 con 0x561f6cf2b720 2024-05-09T00:09:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.843+0000 7f9903120b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6ce75400 con 0x561f6cf2ae00 2024-05-09T00:09:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.843+0000 7f98f5503700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf25890 0x561f6cf25cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.843+0000 7f98f5503700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf25890 0x561f6cf25cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51304/0 (socket says 172.21.15.81:51304) 2024-05-09T00:09:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.843+0000 7f98f5503700 1 -- 172.21.15.81:0/2568506172 learned_addr learned my addr 172.21.15.81:0/2568506172 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.844+0000 7f98f4d02700 1 --2- 172.21.15.81:0/2568506172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf2ae00 0x561f6cf2b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.844+0000 7f98effff700 1 --2- 172.21.15.81:0/2568506172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2b720 0x561f6cf25350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.844+0000 7f98f5503700 1 -- 172.21.15.81:0/2568506172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf2ae00 msgr2=0x561f6cf2b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.844+0000 7f98f5503700 1 --2- 172.21.15.81:0/2568506172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf2ae00 0x561f6cf2b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.844+0000 7f98f5503700 1 -- 172.21.15.81:0/2568506172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2b720 msgr2=0x561f6cf25350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.844+0000 7f98f5503700 1 --2- 172.21.15.81:0/2568506172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2b720 0x561f6cf25350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.844+0000 7f98f5503700 1 -- 172.21.15.81:0/2568506172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f6ccf63b0 con 0x561f6cf25890 2024-05-09T00:09:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.844+0000 7f98f4d02700 1 --2- 172.21.15.81:0/2568506172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf2ae00 0x561f6cf2b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.844+0000 7f98f5503700 1 --2- 172.21.15.81:0/2568506172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf25890 0x561f6cf25cd0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009d00 tx=0x7f98e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59369f6c3d5ffcf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.844+0000 7f98daffd700 1 -- 172.21.15.81:0/2568506172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e800e070 con 0x561f6cf25890 2024-05-09T00:09:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.844+0000 7f98daffd700 1 -- 172.21.15.81:0/2568506172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98e8009830 con 0x561f6cf25890 2024-05-09T00:09:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.844+0000 7f98daffd700 1 -- 172.21.15.81:0/2568506172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e8011390 con 0x561f6cf25890 2024-05-09T00:09:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.845+0000 7f9903120b80 1 -- 172.21.15.81:0/2568506172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf25890 msgr2=0x561f6cf25cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.845+0000 7f9903120b80 1 --2- 172.21.15.81:0/2568506172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf25890 0x561f6cf25cd0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009d00 tx=0x7f98e800b330 comp rx=0 tx=0).stop 2024-05-09T00:09:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.845+0000 7f9903120b80 1 -- 172.21.15.81:0/2568506172 shutdown_connections 2024-05-09T00:09:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.845+0000 7f9903120b80 1 --2- 172.21.15.81:0/2568506172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf25890 0x561f6cf25cd0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.845+0000 7f9903120b80 1 --2- 172.21.15.81:0/2568506172 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf2ae00 0x561f6cf2b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.845+0000 7f9903120b80 1 --2- 172.21.15.81:0/2568506172 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2b720 0x561f6cf25350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.845+0000 7f9903120b80 1 -- 172.21.15.81:0/2568506172 >> 172.21.15.81:0/2568506172 conn(0x561f6ce83210 msgr2=0x561f6cf1fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.845+0000 7f9903120b80 1 -- 172.21.15.81:0/2568506172 shutdown_connections 2024-05-09T00:09:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.845+0000 7f9903120b80 1 -- 172.21.15.81:0/2568506172 wait complete. 2024-05-09T00:09:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.845+0000 7f9903120b80 1 -- start start 2024-05-09T00:09:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.845+0000 7f9903120b80 1 Processor -- start 2024-05-09T00:09:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f9903120b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf25890 0x561f6cf2eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f9903120b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2ae00 0x561f6cf2f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f9903120b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2b720 0x561f6cf2f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f9903120b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6ce11560 con 0x561f6cf2b720 2024-05-09T00:09:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f9903120b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6ce11200 con 0x561f6cf2ae00 2024-05-09T00:09:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f9903120b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6ccf86a0 con 0x561f6cf25890 2024-05-09T00:09:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f9903120b80 10 client.0 _ll_register_callbacks cb 0x561f6ce1ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f98f5503700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2b720 0x561f6cf2f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f98f5503700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2b720 0x561f6cf2f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51306/0 (socket says 172.21.15.81:51306) 2024-05-09T00:09:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f98f5503700 1 -- 172.21.15.81:0/1002899514 learned_addr learned my addr 172.21.15.81:0/1002899514 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f98f5503700 1 -- 172.21.15.81:0/1002899514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf25890 msgr2=0x561f6cf2eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f98f5503700 1 --2- 172.21.15.81:0/1002899514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf25890 0x561f6cf2eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f98f5503700 1 -- 172.21.15.81:0/1002899514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2ae00 msgr2=0x561f6cf2f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f98effff700 1 --2- 172.21.15.81:0/1002899514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2ae00 0x561f6cf2f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f98f5503700 1 --2- 172.21.15.81:0/1002899514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2ae00 0x561f6cf2f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f98f5503700 1 -- 172.21.15.81:0/1002899514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e80099b0 con 0x561f6cf2b720 2024-05-09T00:09:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f98effff700 1 --2- 172.21.15.81:0/1002899514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2ae00 0x561f6cf2f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f98f5503700 1 --2- 172.21.15.81:0/1002899514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2b720 0x561f6cf2f5f0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f98e8012b70 tx=0x7f98e8012430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc906139237ff9db server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f98cffff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f98cffff700 1 -- 172.21.15.81:0/1002899514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e800e040 con 0x561f6cf2b720 2024-05-09T00:09:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f98cffff700 1 -- 172.21.15.81:0/1002899514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f98e801b420 con 0x561f6cf2b720 2024-05-09T00:09:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.846+0000 7f9903120b80 1 -- 172.21.15.81:0/1002899514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f6cef4810 con 0x561f6cf2b720 2024-05-09T00:09:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.847+0000 7f98cffff700 1 -- 172.21.15.81:0/1002899514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98e801b5e0 con 0x561f6cf2b720 2024-05-09T00:09:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.847+0000 7f9903120b80 10 client.17313 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.847+0000 7f9903120b80 1 -- 172.21.15.81:0/1002899514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561f6cca2b60 con 0x561f6cf2b720 2024-05-09T00:09:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.847+0000 7f98cffff700 1 -- 172.21.15.81:0/1002899514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561f6cef4810 con 0x561f6cf2b720 2024-05-09T00:09:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.847+0000 7f98cffff700 1 -- 172.21.15.81:0/1002899514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f98e801a8c0 con 0x561f6cf2b720 2024-05-09T00:09:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.847+0000 7f9903120b80 10 client.17313 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.847+0000 7f9903120b80 10 client.17313 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:09:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.847+0000 7f9903120b80 20 client.17313 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.847+0000 7f9903120b80 1 --2- 172.21.15.81:0/1002899514 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561f6cf3f010 0x561f6cf41430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.847+0000 7f9903120b80 4 client.17313 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.847+0000 7f9903120b80 1 -- 172.21.15.81:0/1002899514 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561f6ce6dec0 con 0x561f6cf3f010 2024-05-09T00:09:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.847+0000 7f98f4d02700 1 --2- 172.21.15.81:0/1002899514 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561f6cf3f010 0x561f6cf41430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.848+0000 7f98cffff700 10 client.17313 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:09:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.848+0000 7f98f4d02700 1 --2- 172.21.15.81:0/1002899514 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561f6cf3f010 0x561f6cf41430 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ab2dccbc6b0460c4 server_cookie=c015b0b99fb757a4 in_seq=0 out_seq=0 2024-05-09T00:09:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.848+0000 7f98cffff700 1 -- 172.21.15.81:0/1002899514 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561f6ce6dec0 con 0x561f6cf3f010 2024-05-09T00:09:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.848+0000 7f98cffff700 10 client.17313 handle_command_reply: tid=0 2024-05-09T00:09:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.848+0000 7f9903120b80 1 client.17313 shutdown 2024-05-09T00:09:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.849+0000 7f9903120b80 1 -- 172.21.15.81:0/1002899514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2b720 msgr2=0x561f6cf2f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.849+0000 7f9903120b80 1 --2- 172.21.15.81:0/1002899514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2b720 0x561f6cf2f5f0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f98e8012b70 tx=0x7f98e8012430 comp rx=0 tx=0).stop 2024-05-09T00:09:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.849+0000 7f9903120b80 1 -- 172.21.15.81:0/1002899514 shutdown_connections 2024-05-09T00:09:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.849+0000 7f9903120b80 1 --2- 172.21.15.81:0/1002899514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2b720 0x561f6cf2f5f0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.849+0000 7f9903120b80 1 --2- 172.21.15.81:0/1002899514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf25890 0x561f6cf2eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.849+0000 7f9903120b80 1 --2- 172.21.15.81:0/1002899514 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561f6cf3f010 0x561f6cf41430 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.849+0000 7f9903120b80 1 --2- 172.21.15.81:0/1002899514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2ae00 0x561f6cf2f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.849+0000 7f98cffff700 0 client.17313 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:09:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.849+0000 7f9903120b80 1 -- 172.21.15.81:0/1002899514 >> 172.21.15.81:0/1002899514 conn(0x561f6ce83210 msgr2=0x561f6cf1f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.849+0000 7f9903120b80 1 -- 172.21.15.81:0/1002899514 shutdown_connections 2024-05-09T00:09:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.849+0000 7f9903120b80 1 -- 172.21.15.81:0/1002899514 wait complete. 2024-05-09T00:09:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.849+0000 7f9903120b80 20 client.17313 trim_cache size 0 max 16384 2024-05-09T00:09:36.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.862+0000 7f9903120b80 1 Processor -- start 2024-05-09T00:09:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.862+0000 7f9903120b80 1 -- start start 2024-05-09T00:09:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.862+0000 7f9903120b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf25890 0x561f6cf25350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.862+0000 7f9903120b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2ae00 0x561f6cf2a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.862+0000 7f9903120b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2b720 0x561f6cf1fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.862+0000 7f9903120b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6cef4810 con 0x561f6cf2ae00 2024-05-09T00:09:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.862+0000 7f9903120b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6cf301e0 con 0x561f6cf2b720 2024-05-09T00:09:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.862+0000 7f9903120b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6cf1cdc0 con 0x561f6cf25890 2024-05-09T00:09:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.862+0000 7f98effff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2ae00 0x561f6cf2a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.862+0000 7f98effff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2ae00 0x561f6cf2a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51312/0 (socket says 172.21.15.81:51312) 2024-05-09T00:09:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.862+0000 7f98effff700 1 -- 172.21.15.81:0/1871704463 learned_addr learned my addr 172.21.15.81:0/1871704463 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.862+0000 7f98f4d02700 1 --2- 172.21.15.81:0/1871704463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf25890 0x561f6cf25350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f98effff700 1 -- 172.21.15.81:0/1871704463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf25890 msgr2=0x561f6cf25350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f98effff700 1 --2- 172.21.15.81:0/1871704463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf25890 0x561f6cf25350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f98effff700 1 -- 172.21.15.81:0/1871704463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2b720 msgr2=0x561f6cf1fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f98f5503700 1 --2- 172.21.15.81:0/1871704463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2b720 0x561f6cf1fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f98effff700 1 --2- 172.21.15.81:0/1871704463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2b720 0x561f6cf1fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f98effff700 1 -- 172.21.15.81:0/1871704463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561f6cf25f40 con 0x561f6cf2ae00 2024-05-09T00:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f98effff700 1 --2- 172.21.15.81:0/1871704463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2ae00 0x561f6cf2a370 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f98dc095e00 tx=0x7f98dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d707c78f288c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f98db7fe700 1 -- 172.21.15.81:0/1871704463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc09d730 con 0x561f6cf2ae00 2024-05-09T00:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f98db7fe700 1 -- 172.21.15.81:0/1871704463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98dc0a1d80 con 0x561f6cf2ae00 2024-05-09T00:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f98db7fe700 1 -- 172.21.15.81:0/1871704463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc099e10 con 0x561f6cf2ae00 2024-05-09T00:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f9903120b80 1 -- 172.21.15.81:0/1871704463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2ae00 msgr2=0x561f6cf2a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f9903120b80 1 --2- 172.21.15.81:0/1871704463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2ae00 0x561f6cf2a370 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f98dc095e00 tx=0x7f98dc004750 comp rx=0 tx=0).stop 2024-05-09T00:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f9903120b80 1 -- 172.21.15.81:0/1871704463 shutdown_connections 2024-05-09T00:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f9903120b80 1 --2- 172.21.15.81:0/1871704463 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf2b720 0x561f6cf1fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f9903120b80 1 --2- 172.21.15.81:0/1871704463 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf25890 0x561f6cf25350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f9903120b80 1 --2- 172.21.15.81:0/1871704463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2ae00 0x561f6cf2a370 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f9903120b80 1 -- 172.21.15.81:0/1871704463 >> 172.21.15.81:0/1871704463 conn(0x561f6ce83210 msgr2=0x561f6cf29c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.863+0000 7f9903120b80 1 -- 172.21.15.81:0/1871704463 shutdown_connections 2024-05-09T00:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.864+0000 7f9903120b80 1 -- 172.21.15.81:0/1871704463 wait complete. 2024-05-09T00:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.864+0000 7f9903120b80 1 -- start start 2024-05-09T00:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.864+0000 7f9903120b80 1 Processor -- start 2024-05-09T00:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.864+0000 7f9903120b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf25890 0x561f6cf361c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.864+0000 7f9903120b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2ae00 0x561f6cf345b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.864+0000 7f9903120b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf2b720 0x561f6cf34af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.864+0000 7f9903120b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6cf35030 con 0x561f6cf2ae00 2024-05-09T00:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.864+0000 7f9903120b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6cf351a0 con 0x561f6cf25890 2024-05-09T00:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.864+0000 7f9903120b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561f6cf35360 con 0x561f6cf2b720 2024-05-09T00:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.864+0000 7f9903120b80 10 client.0 _ll_register_callbacks cb 0x561f6ce1ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.864+0000 7f98effff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2ae00 0x561f6cf345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.864+0000 7f98effff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2ae00 0x561f6cf345b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51318/0 (socket says 172.21.15.81:51318) 2024-05-09T00:09:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.864+0000 7f98effff700 1 -- 172.21.15.81:0/2664001014 learned_addr learned my addr 172.21.15.81:0/2664001014 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f98f4d02700 1 --2- 172.21.15.81:0/2664001014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf25890 0x561f6cf361c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f98effff700 1 -- 172.21.15.81:0/2664001014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf2b720 msgr2=0x561f6cf34af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f98effff700 1 --2- 172.21.15.81:0/2664001014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf2b720 0x561f6cf34af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f98effff700 1 -- 172.21.15.81:0/2664001014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf25890 msgr2=0x561f6cf361c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f98effff700 1 --2- 172.21.15.81:0/2664001014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf25890 0x561f6cf361c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f98effff700 1 -- 172.21.15.81:0/2664001014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f01a44d0 con 0x561f6cf2ae00 2024-05-09T00:09:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f98f4d02700 1 --2- 172.21.15.81:0/2664001014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf25890 0x561f6cf361c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f98effff700 1 --2- 172.21.15.81:0/2664001014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2ae00 0x561f6cf345b0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0a1850 tx=0x7f98dc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a821fa9bfd12febf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f98cffff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f98cffff700 1 -- 172.21.15.81:0/2664001014 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc07c070 con 0x561f6cf2ae00 2024-05-09T00:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f98cffff700 1 -- 172.21.15.81:0/2664001014 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f98dc097ca0 con 0x561f6cf2ae00 2024-05-09T00:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f9903120b80 1 -- 172.21.15.81:0/2664001014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561f6cdce270 con 0x561f6cf2ae00 2024-05-09T00:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f98cffff700 1 -- 172.21.15.81:0/2664001014 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98dc098df0 con 0x561f6cf2ae00 2024-05-09T00:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f9903120b80 10 client.17319 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f9903120b80 1 -- 172.21.15.81:0/2664001014 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561f6ce3b560 con 0x561f6cf2ae00 2024-05-09T00:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f98cffff700 1 -- 172.21.15.81:0/2664001014 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561f6cdce270 con 0x561f6cf2ae00 2024-05-09T00:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f98cffff700 1 -- 172.21.15.81:0/2664001014 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f98dc07f020 con 0x561f6cf2ae00 2024-05-09T00:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f9903120b80 10 client.17319 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f9903120b80 10 client.17319 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f9903120b80 20 client.17319 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f9903120b80 1 --2- 172.21.15.81:0/2664001014 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561f6cf965a0 0x561f6cf98990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f9903120b80 4 client.17319 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.865+0000 7f9903120b80 1 -- 172.21.15.81:0/2664001014 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561f6ccc3cf0 con 0x561f6cf965a0 2024-05-09T00:09:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.866+0000 7f98f4d02700 1 --2- 172.21.15.81:0/2664001014 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561f6cf965a0 0x561f6cf98990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.866+0000 7f98cffff700 10 client.17319 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:09:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.866+0000 7f98f4d02700 1 --2- 172.21.15.81:0/2664001014 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561f6cf965a0 0x561f6cf98990 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6e57615d1c16754f server_cookie=ce18a733b0b31347 in_seq=0 out_seq=0 2024-05-09T00:09:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.866+0000 7f98cffff700 1 -- 172.21.15.81:0/2664001014 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561f6ccc3cf0 con 0x561f6cf965a0 2024-05-09T00:09:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.866+0000 7f98cffff700 10 client.17319 handle_command_reply: tid=0 2024-05-09T00:09:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.866+0000 7f9903120b80 1 client.17319 shutdown 2024-05-09T00:09:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.866+0000 7f9903120b80 1 -- 172.21.15.81:0/2664001014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2ae00 msgr2=0x561f6cf345b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.866+0000 7f9903120b80 1 --2- 172.21.15.81:0/2664001014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2ae00 0x561f6cf345b0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0a1850 tx=0x7f98dc000bc0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f9903120b80 1 -- 172.21.15.81:0/2664001014 shutdown_connections 2024-05-09T00:09:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f9903120b80 1 --2- 172.21.15.81:0/2664001014 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561f6cf965a0 0x561f6cf98990 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f9903120b80 1 --2- 172.21.15.81:0/2664001014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561f6cf25890 0x561f6cf361c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f9903120b80 1 --2- 172.21.15.81:0/2664001014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561f6cf2b720 0x561f6cf34af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f98cffff700 0 client.17319 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:09:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f9903120b80 1 --2- 172.21.15.81:0/2664001014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561f6cf2ae00 0x561f6cf345b0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f9903120b80 1 -- 172.21.15.81:0/2664001014 >> 172.21.15.81:0/2664001014 conn(0x561f6ce83210 msgr2=0x561f6cf2f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f9903120b80 1 -- 172.21.15.81:0/2664001014 shutdown_connections 2024-05-09T00:09:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f9903120b80 1 -- 172.21.15.81:0/2664001014 wait complete. 2024-05-09T00:09:36.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f9903120b80 20 client.17319 trim_cache size 0 max 16384 2024-05-09T00:09:36.871 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:09:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f98f6f66700 1 -- 172.21.15.81:0/1056124926 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f98e00a1290 msgr2=0x7f98e00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f98f6f66700 1 --2- 172.21.15.81:0/1056124926 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f98e00a1290 0x7f98e00a3750 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f98e400b5c0 tx=0x7f98e4005fb0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f98f6f66700 1 -- 172.21.15.81:0/1056124926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f0105170 msgr2=0x7f98f0198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f98f6f66700 1 --2- 172.21.15.81:0/1056124926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f0105170 0x7f98f0198840 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00b500 tx=0x7f98dc00b8c0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f98f6f66700 1 -- 172.21.15.81:0/1056124926 shutdown_connections 2024-05-09T00:09:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f98f6f66700 1 --2- 172.21.15.81:0/1056124926 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f98e00a1290 0x7f98e00a3750 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f98f6f66700 1 --2- 172.21.15.81:0/1056124926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f98f0100060 0x7f98f0198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f98f6f66700 1 --2- 172.21.15.81:0/1056124926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98f0198d80 0x7f98f01a3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f98f6f66700 1 --2- 172.21.15.81:0/1056124926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f98f0105170 0x7f98f0198840 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.867+0000 7f98f6f66700 1 -- 172.21.15.81:0/1056124926 >> 172.21.15.81:0/1056124926 conn(0x7f98f0076f30 msgr2=0x7f98f00fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.868+0000 7f98f6f66700 1 -- 172.21.15.81:0/1056124926 shutdown_connections 2024-05-09T00:09:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:36.868+0000 7f98f6f66700 1 -- 172.21.15.81:0/1056124926 wait complete. 2024-05-09T00:09:36.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:09:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.003+0000 7f2570533700 1 -- 172.21.15.81:0/1210911376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568105160 msgr2=0x7f256810cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.003+0000 7f2570533700 1 --2- 172.21.15.81:0/1210911376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568105160 0x7f256810cce0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f256000b0a0 tx=0x7f256000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.003+0000 7f2570533700 1 -- 172.21.15.81:0/1210911376 shutdown_connections 2024-05-09T00:09:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.003+0000 7f2570533700 1 --2- 172.21.15.81:0/1210911376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568105160 0x7f256810cce0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.003+0000 7f2570533700 1 --2- 172.21.15.81:0/1210911376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2568100060 0x7f2568100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.003+0000 7f2570533700 1 --2- 172.21.15.81:0/1210911376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2568100a10 0x7f2568104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.003+0000 7f2570533700 1 -- 172.21.15.81:0/1210911376 >> 172.21.15.81:0/1210911376 conn(0x7f2568076f40 msgr2=0x7f2568077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.003+0000 7f2570533700 1 -- 172.21.15.81:0/1210911376 shutdown_connections 2024-05-09T00:09:37.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.004+0000 7f2570533700 1 -- 172.21.15.81:0/1210911376 wait complete. 2024-05-09T00:09:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.004+0000 7f2570533700 1 Processor -- start 2024-05-09T00:09:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.004+0000 7f2570533700 1 -- start start 2024-05-09T00:09:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f2570533700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568100060 0x7f2568197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f2570533700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2568105160 0x7f2568197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f2570533700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f256819bdb0 0x7f256819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f2570533700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256819c830 con 0x7f2568100060 2024-05-09T00:09:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f2570533700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256819c9a0 con 0x7f256819bdb0 2024-05-09T00:09:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f2570533700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256819cb60 con 0x7f2568105160 2024-05-09T00:09:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f256e2cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568100060 0x7f2568197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f256e2cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568100060 0x7f2568197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51336/0 (socket says 172.21.15.81:51336) 2024-05-09T00:09:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f256e2cf700 1 -- 172.21.15.81:0/1886519495 learned_addr learned my addr 172.21.15.81:0/1886519495 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f256dace700 1 --2- 172.21.15.81:0/1886519495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2568105160 0x7f2568197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f256e2cf700 1 -- 172.21.15.81:0/1886519495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2568105160 msgr2=0x7f2568197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f256e2cf700 1 --2- 172.21.15.81:0/1886519495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2568105160 0x7f2568197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f256ead0700 1 --2- 172.21.15.81:0/1886519495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f256819bdb0 0x7f256819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f256e2cf700 1 -- 172.21.15.81:0/1886519495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f256819bdb0 msgr2=0x7f256819c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f256e2cf700 1 --2- 172.21.15.81:0/1886519495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f256819bdb0 0x7f256819c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f256e2cf700 1 -- 172.21.15.81:0/1886519495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2560009d00 con 0x7f2568100060 2024-05-09T00:09:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f256e2cf700 1 --2- 172.21.15.81:0/1886519495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568100060 0x7f2568197520 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f256400c920 tx=0x7f256400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f255f7fe700 1 -- 172.21.15.81:0/1886519495 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564007b00 con 0x7f2568100060 2024-05-09T00:09:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f255f7fe700 1 -- 172.21.15.81:0/1886519495 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2564004cf0 con 0x7f2568100060 2024-05-09T00:09:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f2570533700 1 -- 172.21.15.81:0/1886519495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25681a40c0 con 0x7f2568100060 2024-05-09T00:09:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f255f7fe700 1 -- 172.21.15.81:0/1886519495 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564005610 con 0x7f2568100060 2024-05-09T00:09:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.005+0000 7f2570533700 1 -- 172.21.15.81:0/1886519495 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25681a45f0 con 0x7f2568100060 2024-05-09T00:09:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.007+0000 7f255f7fe700 1 -- 172.21.15.81:0/1886519495 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f2564004750 con 0x7f2568100060 2024-05-09T00:09:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.008+0000 7f255f7fe700 1 --2- 172.21.15.81:0/1886519495 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f25540a1310 0x7f25540a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.008+0000 7f256dace700 1 --2- 172.21.15.81:0/1886519495 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f25540a1310 0x7f25540a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.008+0000 7f255f7fe700 1 -- 172.21.15.81:0/1886519495 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f25640ccc50 con 0x7f2568100060 2024-05-09T00:09:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.008+0000 7f256dace700 1 --2- 172.21.15.81:0/1886519495 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f25540a1310 0x7f25540a37d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2558005950 tx=0x7f25580058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.009+0000 7f257c6edb80 1 Processor -- start 2024-05-09T00:09:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.009+0000 7f257c6edb80 1 -- start start 2024-05-09T00:09:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.009+0000 7f257c6edb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f6898881f0 0x55f6898885d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.009+0000 7f257c6edb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689888b10 0x55f689882760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.009+0000 7f257c6edb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689882ca0 0x55f689883100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.009+0000 7f257c6edb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6897d5150 con 0x55f689888b10 2024-05-09T00:09:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.009+0000 7f257c6edb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6897d2b10 con 0x55f689882ca0 2024-05-09T00:09:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.009+0000 7f257c6edb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6897ce400 con 0x55f6898881f0 2024-05-09T00:09:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.009+0000 7f256dace700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689888b10 0x55f689882760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.009+0000 7f256dace700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689888b10 0x55f689882760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51344/0 (socket says 172.21.15.81:51344) 2024-05-09T00:09:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.009+0000 7f256dace700 1 -- 172.21.15.81:0/3910783843 learned_addr learned my addr 172.21.15.81:0/3910783843 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.010+0000 7f256e2cf700 1 --2- 172.21.15.81:0/3910783843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f6898881f0 0x55f6898885d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.010+0000 7f256ead0700 1 --2- 172.21.15.81:0/3910783843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689882ca0 0x55f689883100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.010+0000 7f256dace700 1 -- 172.21.15.81:0/3910783843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f6898881f0 msgr2=0x55f6898885d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.010+0000 7f256dace700 1 --2- 172.21.15.81:0/3910783843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f6898881f0 0x55f6898885d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.010+0000 7f256dace700 1 -- 172.21.15.81:0/3910783843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689882ca0 msgr2=0x55f689883100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.010+0000 7f256dace700 1 --2- 172.21.15.81:0/3910783843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689882ca0 0x55f689883100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.010+0000 7f256dace700 1 -- 172.21.15.81:0/3910783843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f68964f3b0 con 0x55f689888b10 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.010+0000 7f256ead0700 1 --2- 172.21.15.81:0/3910783843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689882ca0 0x55f689883100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.010+0000 7f256dace700 1 --2- 172.21.15.81:0/3910783843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689888b10 0x55f689882760 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f255800fc70 tx=0x7f2558012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2fade5c9c64e4f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.010+0000 7f255cff9700 1 -- 172.21.15.81:0/3910783843 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558011ad0 con 0x55f689888b10 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.010+0000 7f255cff9700 1 -- 172.21.15.81:0/3910783843 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2558011c30 con 0x55f689888b10 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.010+0000 7f255cff9700 1 -- 172.21.15.81:0/3910783843 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255801d610 con 0x55f689888b10 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 -- 172.21.15.81:0/3910783843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689888b10 msgr2=0x55f689882760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 --2- 172.21.15.81:0/3910783843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689888b10 0x55f689882760 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f255800fc70 tx=0x7f2558012000 comp rx=0 tx=0).stop 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 -- 172.21.15.81:0/3910783843 shutdown_connections 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 --2- 172.21.15.81:0/3910783843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689882ca0 0x55f689883100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 --2- 172.21.15.81:0/3910783843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f6898881f0 0x55f6898885d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 --2- 172.21.15.81:0/3910783843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689888b10 0x55f689882760 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 -- 172.21.15.81:0/3910783843 >> 172.21.15.81:0/3910783843 conn(0x55f6897dc210 msgr2=0x55f689878df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 -- 172.21.15.81:0/3910783843 shutdown_connections 2024-05-09T00:09:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 -- 172.21.15.81:0/3910783843 wait complete. 2024-05-09T00:09:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 -- start start 2024-05-09T00:09:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 Processor -- start 2024-05-09T00:09:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f689882ca0 0x55f68988bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f6898881f0 0x55f68988c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689888b10 0x55f68988c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f68976a560 con 0x55f689888b10 2024-05-09T00:09:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f68976a200 con 0x55f6898881f0 2024-05-09T00:09:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6896516a0 con 0x55f689882ca0 2024-05-09T00:09:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f257c6edb80 10 client.0 _ll_register_callbacks cb 0x55f689773b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.011+0000 7f256ead0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689888b10 0x55f68988c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f256ead0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689888b10 0x55f68988c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51352/0 (socket says 172.21.15.81:51352) 2024-05-09T00:09:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f256ead0700 1 -- 172.21.15.81:0/3131738274 learned_addr learned my addr 172.21.15.81:0/3131738274 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f256e2cf700 1 --2- 172.21.15.81:0/3131738274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f689882ca0 0x55f68988bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f256dace700 1 --2- 172.21.15.81:0/3131738274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f6898881f0 0x55f68988c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f256ead0700 1 -- 172.21.15.81:0/3131738274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f689882ca0 msgr2=0x55f68988bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f256ead0700 1 --2- 172.21.15.81:0/3131738274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f689882ca0 0x55f68988bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f256ead0700 1 -- 172.21.15.81:0/3131738274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f6898881f0 msgr2=0x55f68988c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f256ead0700 1 --2- 172.21.15.81:0/3131738274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f6898881f0 0x55f68988c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f256ead0700 1 -- 172.21.15.81:0/3131738274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255800f950 con 0x55f689888b10 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f256dace700 1 --2- 172.21.15.81:0/3131738274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f6898881f0 0x55f68988c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f256ead0700 1 --2- 172.21.15.81:0/3131738274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689888b10 0x55f68988c940 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f2560009360 tx=0x7f2560009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9988dd416c4c0f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f2551ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f2551ffb700 1 -- 172.21.15.81:0/3131738274 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000e070 con 0x55f689888b10 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f2551ffb700 1 -- 172.21.15.81:0/3131738274 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2560004c60 con 0x55f689888b10 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f257c6edb80 1 -- 172.21.15.81:0/3131738274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f689727270 con 0x55f689888b10 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f2551ffb700 1 -- 172.21.15.81:0/3131738274 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2560004e20 con 0x55f689888b10 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f257c6edb80 10 client.17331 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f257c6edb80 1 -- 172.21.15.81:0/3131738274 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f6895fbb60 con 0x55f689888b10 2024-05-09T00:09:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.012+0000 7f2551ffb700 1 -- 172.21.15.81:0/3131738274 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f689727270 con 0x55f689888b10 2024-05-09T00:09:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.013+0000 7f2551ffb700 1 -- 172.21.15.81:0/3131738274 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f256000b0d0 con 0x55f689888b10 2024-05-09T00:09:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.013+0000 7f257c6edb80 10 client.17331 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.013+0000 7f257c6edb80 10 client.17331 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:09:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.013+0000 7f257c6edb80 20 client.17331 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.013+0000 7f257c6edb80 1 --2- 172.21.15.81:0/3131738274 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55f68989c5d0 0x55f68989e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.013+0000 7f257c6edb80 4 client.17331 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.013+0000 7f257c6edb80 1 -- 172.21.15.81:0/3131738274 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f68984d810 con 0x55f68989c5d0 2024-05-09T00:09:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.013+0000 7f256e2cf700 1 --2- 172.21.15.81:0/3131738274 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55f68989c5d0 0x55f68989e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.013+0000 7f256e2cf700 1 --2- 172.21.15.81:0/3131738274 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55f68989c5d0 0x55f68989e9f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb18f357d9bf2c8b server_cookie=b97524258d5e6ec3 in_seq=0 out_seq=0 2024-05-09T00:09:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.013+0000 7f2551ffb700 10 client.17331 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:09:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f2551ffb700 1 -- 172.21.15.81:0/3131738274 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f68984d810 con 0x55f68989c5d0 2024-05-09T00:09:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f2551ffb700 10 client.17331 handle_command_reply: tid=0 2024-05-09T00:09:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f257c6edb80 1 client.17331 shutdown 2024-05-09T00:09:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f257c6edb80 1 -- 172.21.15.81:0/3131738274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689888b10 msgr2=0x55f68988c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f257c6edb80 1 --2- 172.21.15.81:0/3131738274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689888b10 0x55f68988c940 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f2560009360 tx=0x7f2560009390 comp rx=0 tx=0).stop 2024-05-09T00:09:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f257c6edb80 1 -- 172.21.15.81:0/3131738274 shutdown_connections 2024-05-09T00:09:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f257c6edb80 1 --2- 172.21.15.81:0/3131738274 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55f68989c5d0 0x55f68989e9f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f257c6edb80 1 --2- 172.21.15.81:0/3131738274 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689888b10 0x55f68988c940 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f257c6edb80 1 --2- 172.21.15.81:0/3131738274 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f689882ca0 0x55f68988bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f2551ffb700 0 client.17331 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:09:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f257c6edb80 1 --2- 172.21.15.81:0/3131738274 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f6898881f0 0x55f68988c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f257c6edb80 1 -- 172.21.15.81:0/3131738274 >> 172.21.15.81:0/3131738274 conn(0x55f6897dc210 msgr2=0x55f6898785a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f257c6edb80 1 -- 172.21.15.81:0/3131738274 shutdown_connections 2024-05-09T00:09:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f257c6edb80 1 -- 172.21.15.81:0/3131738274 wait complete. 2024-05-09T00:09:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.014+0000 7f257c6edb80 20 client.17331 trim_cache size 0 max 16384 2024-05-09T00:09:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.027+0000 7f257c6edb80 1 Processor -- start 2024-05-09T00:09:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.027+0000 7f257c6edb80 1 -- start start 2024-05-09T00:09:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.027+0000 7f257c6edb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f689882ca0 0x55f689882760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.027+0000 7f257c6edb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6898881f0 0x55f689898010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.027+0000 7f257c6edb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689888b10 0x55f689878d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.027+0000 7f257c6edb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f689879a30 con 0x55f6898881f0 2024-05-09T00:09:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.027+0000 7f257c6edb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f68988d530 con 0x55f689888b10 2024-05-09T00:09:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.027+0000 7f257c6edb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f689899190 con 0x55f689882ca0 2024-05-09T00:09:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f256dace700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6898881f0 0x55f689898010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f256dace700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6898881f0 0x55f689898010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51364/0 (socket says 172.21.15.81:51364) 2024-05-09T00:09:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f256dace700 1 -- 172.21.15.81:0/3245802732 learned_addr learned my addr 172.21.15.81:0/3245802732 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f256e2cf700 1 --2- 172.21.15.81:0/3245802732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f689882ca0 0x55f689882760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f256ead0700 1 --2- 172.21.15.81:0/3245802732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689888b10 0x55f689878d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f256dace700 1 -- 172.21.15.81:0/3245802732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f689882ca0 msgr2=0x55f689882760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f256dace700 1 --2- 172.21.15.81:0/3245802732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f689882ca0 0x55f689882760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f256dace700 1 -- 172.21.15.81:0/3245802732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689888b10 msgr2=0x55f689878d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f256dace700 1 --2- 172.21.15.81:0/3245802732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689888b10 0x55f689878d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f256dace700 1 -- 172.21.15.81:0/3245802732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f689794560 con 0x55f6898881f0 2024-05-09T00:09:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f256ead0700 1 --2- 172.21.15.81:0/3245802732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689888b10 0x55f689878d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f256dace700 1 --2- 172.21.15.81:0/3245802732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6898881f0 0x55f689898010 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f255800fc70 tx=0x7f2558011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1e18da476dccd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f255d7fa700 1 -- 172.21.15.81:0/3245802732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558011ad0 con 0x55f6898881f0 2024-05-09T00:09:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f255d7fa700 1 -- 172.21.15.81:0/3245802732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f255802e040 con 0x55f6898881f0 2024-05-09T00:09:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.028+0000 7f255d7fa700 1 -- 172.21.15.81:0/3245802732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558027810 con 0x55f6898881f0 2024-05-09T00:09:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 -- 172.21.15.81:0/3245802732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6898881f0 msgr2=0x55f689898010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 --2- 172.21.15.81:0/3245802732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6898881f0 0x55f689898010 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f255800fc70 tx=0x7f2558011da0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 -- 172.21.15.81:0/3245802732 shutdown_connections 2024-05-09T00:09:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 --2- 172.21.15.81:0/3245802732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689888b10 0x55f689878d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 --2- 172.21.15.81:0/3245802732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f689882ca0 0x55f689882760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 --2- 172.21.15.81:0/3245802732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f6898881f0 0x55f689898010 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 -- 172.21.15.81:0/3245802732 >> 172.21.15.81:0/3245802732 conn(0x55f6897dc210 msgr2=0x55f689885ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 -- 172.21.15.81:0/3245802732 shutdown_connections 2024-05-09T00:09:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 -- 172.21.15.81:0/3245802732 wait complete. 2024-05-09T00:09:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 -- start start 2024-05-09T00:09:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 Processor -- start 2024-05-09T00:09:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689882ca0 0x55f68988f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f6898881f0 0x55f68988fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689888b10 0x55f68988ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6898f1b00 con 0x55f689882ca0 2024-05-09T00:09:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6898f1c70 con 0x55f689888b10 2024-05-09T00:09:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6898f1e30 con 0x55f6898881f0 2024-05-09T00:09:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f257c6edb80 10 client.0 _ll_register_callbacks cb 0x55f689773b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.029+0000 7f256e2cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689882ca0 0x55f68988f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f256e2cf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689882ca0 0x55f68988f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51376/0 (socket says 172.21.15.81:51376) 2024-05-09T00:09:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f256e2cf700 1 -- 172.21.15.81:0/1107896640 learned_addr learned my addr 172.21.15.81:0/1107896640 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f256dace700 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f6898881f0 0x55f68988fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f256ead0700 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689888b10 0x55f68988ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f256e2cf700 1 -- 172.21.15.81:0/1107896640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f6898881f0 msgr2=0x55f68988fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f256e2cf700 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f6898881f0 0x55f68988fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f256e2cf700 1 -- 172.21.15.81:0/1107896640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689888b10 msgr2=0x55f68988ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f256e2cf700 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689888b10 0x55f68988ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f256e2cf700 1 -- 172.21.15.81:0/1107896640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f68964f3b0 con 0x55f689882ca0 2024-05-09T00:09:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f256dace700 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f6898881f0 0x55f68988fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f256ead0700 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689888b10 0x55f68988ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f256e2cf700 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689882ca0 0x55f68988f530 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f2564099cf0 tx=0x7f256401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a1cf0439b7ea40 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f2551ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f2551ffb700 1 -- 172.21.15.81:0/1107896640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25640b2070 con 0x55f689882ca0 2024-05-09T00:09:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f2551ffb700 1 -- 172.21.15.81:0/1107896640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2564078e40 con 0x55f689882ca0 2024-05-09T00:09:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f257c6edb80 1 -- 172.21.15.81:0/1107896640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2558011c30 con 0x55f689882ca0 2024-05-09T00:09:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f2551ffb700 1 -- 172.21.15.81:0/1107896640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25640a21e0 con 0x55f689882ca0 2024-05-09T00:09:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f257c6edb80 10 client.17337 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f257c6edb80 1 -- 172.21.15.81:0/1107896640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f689653cd0 con 0x55f689882ca0 2024-05-09T00:09:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.030+0000 7f2551ffb700 1 -- 172.21.15.81:0/1107896640 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2558011c30 con 0x55f689882ca0 2024-05-09T00:09:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.031+0000 7f2551ffb700 1 -- 172.21.15.81:0/1107896640 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f256407e050 con 0x55f689882ca0 2024-05-09T00:09:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.031+0000 7f257c6edb80 10 client.17337 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.031+0000 7f257c6edb80 10 client.17337 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:09:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.031+0000 7f257c6edb80 20 client.17337 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.031+0000 7f257c6edb80 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55f6898f3600 0x55f6898f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.031+0000 7f257c6edb80 4 client.17337 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:09:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.031+0000 7f257c6edb80 1 -- 172.21.15.81:0/1107896640 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f6897c6ec0 con 0x55f6898f3600 2024-05-09T00:09:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.031+0000 7f256dace700 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55f6898f3600 0x55f6898f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.031+0000 7f256dace700 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55f6898f3600 0x55f6898f5a20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8bdf3ce72ab42aca server_cookie=1e64043677117c14 in_seq=0 out_seq=0 2024-05-09T00:09:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.031+0000 7f2551ffb700 10 client.17337 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:09:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.031+0000 7f2551ffb700 1 -- 172.21.15.81:0/1107896640 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f6897c6ec0 con 0x55f6898f3600 2024-05-09T00:09:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.031+0000 7f2551ffb700 10 client.17337 handle_command_reply: tid=0 2024-05-09T00:09:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.031+0000 7f257c6edb80 1 client.17337 shutdown 2024-05-09T00:09:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f257c6edb80 1 -- 172.21.15.81:0/1107896640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689882ca0 msgr2=0x55f68988f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f257c6edb80 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689882ca0 0x55f68988f530 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f2564099cf0 tx=0x7f256401a040 comp rx=0 tx=0).stop 2024-05-09T00:09:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f257c6edb80 1 -- 172.21.15.81:0/1107896640 shutdown_connections 2024-05-09T00:09:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f257c6edb80 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55f6898f3600 0x55f6898f5a20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f257c6edb80 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f689888b10 0x55f68988ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f257c6edb80 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f689882ca0 0x55f68988f530 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f257c6edb80 1 --2- 172.21.15.81:0/1107896640 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f6898881f0 0x55f68988fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f2551ffb700 0 client.17337 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:09:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f257c6edb80 1 -- 172.21.15.81:0/1107896640 >> 172.21.15.81:0/1107896640 conn(0x55f6897dc210 msgr2=0x55f68988a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f257c6edb80 1 -- 172.21.15.81:0/1107896640 shutdown_connections 2024-05-09T00:09:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f257c6edb80 1 -- 172.21.15.81:0/1107896640 wait complete. 2024-05-09T00:09:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f257c6edb80 20 client.17337 trim_cache size 0 max 16384 2024-05-09T00:09:37.039 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:09:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f2570533700 1 -- 172.21.15.81:0/1886519495 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f25540a1310 msgr2=0x7f25540a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f2570533700 1 --2- 172.21.15.81:0/1886519495 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f25540a1310 0x7f25540a37d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2558005950 tx=0x7f25580058e0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f2570533700 1 -- 172.21.15.81:0/1886519495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568100060 msgr2=0x7f2568197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f2570533700 1 --2- 172.21.15.81:0/1886519495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568100060 0x7f2568197520 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f256400c920 tx=0x7f256400cce0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f2570533700 1 -- 172.21.15.81:0/1886519495 shutdown_connections 2024-05-09T00:09:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f2570533700 1 --2- 172.21.15.81:0/1886519495 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f25540a1310 0x7f25540a37d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f2570533700 1 --2- 172.21.15.81:0/1886519495 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f256819bdb0 0x7f256819c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f2570533700 1 --2- 172.21.15.81:0/1886519495 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2568100060 0x7f2568197520 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f2570533700 1 --2- 172.21.15.81:0/1886519495 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2568105160 0x7f2568197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f2570533700 1 -- 172.21.15.81:0/1886519495 >> 172.21.15.81:0/1886519495 conn(0x7f2568076f40 msgr2=0x7f25680fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f2570533700 1 -- 172.21.15.81:0/1886519495 shutdown_connections 2024-05-09T00:09:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.032+0000 7f2570533700 1 -- 172.21.15.81:0/1886519495 wait complete. 2024-05-09T00:09:37.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:36 smithi081 ceph-mon[42474]: pgmap v202: 97 pgs: 97 active+clean; 1.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 20 op/s 2024-05-09T00:09:37.041 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:36 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1700950834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:09:37.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:09:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.171+0000 7f478314a700 1 -- 172.21.15.81:0/3981993871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f477c0682e0 msgr2=0x7f477c0686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.171+0000 7f478314a700 1 --2- 172.21.15.81:0/3981993871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f477c0682e0 0x7f477c0686c0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f477400b0d0 tx=0x7f477400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.171+0000 7f478314a700 1 -- 172.21.15.81:0/3981993871 shutdown_connections 2024-05-09T00:09:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.171+0000 7f478314a700 1 --2- 172.21.15.81:0/3981993871 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f477c106290 0x7f477c10de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.171+0000 7f478314a700 1 --2- 172.21.15.81:0/3981993871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f477c0682e0 0x7f477c0686c0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.171+0000 7f478314a700 1 --2- 172.21.15.81:0/3981993871 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f477c068c90 0x7f477c105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.171+0000 7f478314a700 1 -- 172.21.15.81:0/3981993871 >> 172.21.15.81:0/3981993871 conn(0x7f477c076f40 msgr2=0x7f477c077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.171+0000 7f478314a700 1 -- 172.21.15.81:0/3981993871 shutdown_connections 2024-05-09T00:09:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.171+0000 7f478314a700 1 -- 172.21.15.81:0/3981993871 wait complete. 2024-05-09T00:09:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f478314a700 1 Processor -- start 2024-05-09T00:09:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f478314a700 1 -- start start 2024-05-09T00:09:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f478314a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f477c0682e0 0x7f477c197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f478314a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f477c106290 0x7f477c197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f478314a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f477c19bda0 0x7f477c19c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f478314a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c19c820 con 0x7f477c19bda0 2024-05-09T00:09:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f478314a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c19c990 con 0x7f477c0682e0 2024-05-09T00:09:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f478314a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c19cb50 con 0x7f477c106290 2024-05-09T00:09:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f47816e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f477c19bda0 0x7f477c19c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f47816e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f477c19bda0 0x7f477c19c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51392/0 (socket says 172.21.15.81:51392) 2024-05-09T00:09:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f47816e7700 1 -- 172.21.15.81:0/1784043529 learned_addr learned my addr 172.21.15.81:0/1784043529 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f477bfff700 1 --2- 172.21.15.81:0/1784043529 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f477c106290 0x7f477c197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f4780ee6700 1 --2- 172.21.15.81:0/1784043529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f477c0682e0 0x7f477c197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f47816e7700 1 -- 172.21.15.81:0/1784043529 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f477c106290 msgr2=0x7f477c197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f47816e7700 1 --2- 172.21.15.81:0/1784043529 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f477c106290 0x7f477c197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f47816e7700 1 -- 172.21.15.81:0/1784043529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f477c0682e0 msgr2=0x7f477c197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f47816e7700 1 --2- 172.21.15.81:0/1784043529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f477c0682e0 0x7f477c197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f47816e7700 1 -- 172.21.15.81:0/1784043529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4774009d00 con 0x7f477c19bda0 2024-05-09T00:09:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f47816e7700 1 --2- 172.21.15.81:0/1784043529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f477c19bda0 0x7f477c19c220 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f476c00d980 tx=0x7f476c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f4779ffb700 1 -- 172.21.15.81:0/1784043529 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c009940 con 0x7f477c19bda0 2024-05-09T00:09:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.172+0000 7f4779ffb700 1 -- 172.21.15.81:0/1784043529 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f476c004830 con 0x7f477c19bda0 2024-05-09T00:09:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.173+0000 7f478314a700 1 -- 172.21.15.81:0/1784043529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c1a40b0 con 0x7f477c19bda0 2024-05-09T00:09:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.173+0000 7f4779ffb700 1 -- 172.21.15.81:0/1784043529 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c0054e0 con 0x7f477c19bda0 2024-05-09T00:09:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.173+0000 7f478314a700 1 -- 172.21.15.81:0/1784043529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c1a4540 con 0x7f477c19bda0 2024-05-09T00:09:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.175+0000 7f4779ffb700 1 -- 172.21.15.81:0/1784043529 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f476c004ca0 con 0x7f477c19bda0 2024-05-09T00:09:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.175+0000 7f4779ffb700 1 --2- 172.21.15.81:0/1784043529 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f47680a1290 0x7f47680a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.175+0000 7f4780ee6700 1 --2- 172.21.15.81:0/1784043529 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f47680a1290 0x7f47680a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.175+0000 7f4779ffb700 1 -- 172.21.15.81:0/1784043529 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f476c0ccba0 con 0x7f477c19bda0 2024-05-09T00:09:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.176+0000 7f4780ee6700 1 --2- 172.21.15.81:0/1784043529 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f47680a1290 0x7f47680a3750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4774009fd0 tx=0x7f477400b040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.176+0000 7f478f304b80 1 Processor -- start 2024-05-09T00:09:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.176+0000 7f478f304b80 1 -- start start 2024-05-09T00:09:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.176+0000 7f478f304b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc4e00 0x55c591fc51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.176+0000 7f478f304b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc5720 0x55c591fbf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.176+0000 7f478f304b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 0x55c591fbfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.176+0000 7f478f304b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c591f16150 con 0x55c591fc4e00 2024-05-09T00:09:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.176+0000 7f478f304b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c591f13b10 con 0x55c591fbf890 2024-05-09T00:09:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.176+0000 7f478f304b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c591f0f400 con 0x55c591fc5720 2024-05-09T00:09:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.176+0000 7f4780ee6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc4e00 0x55c591fc51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.177+0000 7f4780ee6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc4e00 0x55c591fc51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51404/0 (socket says 172.21.15.81:51404) 2024-05-09T00:09:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.177+0000 7f4780ee6700 1 -- 172.21.15.81:0/3017736456 learned_addr learned my addr 172.21.15.81:0/3017736456 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.177+0000 7f47816e7700 1 --2- 172.21.15.81:0/3017736456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 0x55c591fbfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.177+0000 7f4780ee6700 1 -- 172.21.15.81:0/3017736456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc5720 msgr2=0x55c591fbf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.177+0000 7f4780ee6700 1 --2- 172.21.15.81:0/3017736456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc5720 0x55c591fbf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.177+0000 7f4780ee6700 1 -- 172.21.15.81:0/3017736456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 msgr2=0x55c591fbfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.177+0000 7f4780ee6700 1 --2- 172.21.15.81:0/3017736456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 0x55c591fbfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.177+0000 7f4780ee6700 1 -- 172.21.15.81:0/3017736456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c591d903b0 con 0x55c591fc4e00 2024-05-09T00:09:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.177+0000 7f47816e7700 1 --2- 172.21.15.81:0/3017736456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 0x55c591fbfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.177+0000 7f4780ee6700 1 --2- 172.21.15.81:0/3017736456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc4e00 0x55c591fc51e0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f4774007e70 tx=0x7f477401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435bfbc08a6b92d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.177+0000 7f4772ffd700 1 -- 172.21.15.81:0/3017736456 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774004c50 con 0x55c591fc4e00 2024-05-09T00:09:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.177+0000 7f4772ffd700 1 -- 172.21.15.81:0/3017736456 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4774007960 con 0x55c591fc4e00 2024-05-09T00:09:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.177+0000 7f4772ffd700 1 -- 172.21.15.81:0/3017736456 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740056d0 con 0x55c591fc4e00 2024-05-09T00:09:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.178+0000 7f478f304b80 1 -- 172.21.15.81:0/3017736456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc4e00 msgr2=0x55c591fc51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.178+0000 7f478f304b80 1 --2- 172.21.15.81:0/3017736456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc4e00 0x55c591fc51e0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f4774007e70 tx=0x7f477401b000 comp rx=0 tx=0).stop 2024-05-09T00:09:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.178+0000 7f478f304b80 1 -- 172.21.15.81:0/3017736456 shutdown_connections 2024-05-09T00:09:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.178+0000 7f478f304b80 1 --2- 172.21.15.81:0/3017736456 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 0x55c591fbfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.178+0000 7f478f304b80 1 --2- 172.21.15.81:0/3017736456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc4e00 0x55c591fc51e0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.178+0000 7f478f304b80 1 --2- 172.21.15.81:0/3017736456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc5720 0x55c591fbf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.178+0000 7f478f304b80 1 -- 172.21.15.81:0/3017736456 >> 172.21.15.81:0/3017736456 conn(0x55c591f1d210 msgr2=0x55c591fb9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.178+0000 7f478f304b80 1 -- 172.21.15.81:0/3017736456 shutdown_connections 2024-05-09T00:09:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.178+0000 7f478f304b80 1 -- 172.21.15.81:0/3017736456 wait complete. 2024-05-09T00:09:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.178+0000 7f478f304b80 1 -- start start 2024-05-09T00:09:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.178+0000 7f478f304b80 1 Processor -- start 2024-05-09T00:09:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f478f304b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 0x55c591fcb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f478f304b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc4e00 0x55c591fc89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f478f304b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc5720 0x55c591fc9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f478f304b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c591eab560 con 0x55c591fc4e00 2024-05-09T00:09:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f478f304b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c591eab200 con 0x55c591fbf890 2024-05-09T00:09:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f478f304b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c591d926a0 con 0x55c591fc5720 2024-05-09T00:09:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f478f304b80 10 client.0 _ll_register_callbacks cb 0x55c591eb4b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f477bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc4e00 0x55c591fc89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f477bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc4e00 0x55c591fc89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51406/0 (socket says 172.21.15.81:51406) 2024-05-09T00:09:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f477bfff700 1 -- 172.21.15.81:0/368807768 learned_addr learned my addr 172.21.15.81:0/368807768 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f4780ee6700 1 --2- 172.21.15.81:0/368807768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 0x55c591fcb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f47816e7700 1 --2- 172.21.15.81:0/368807768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc5720 0x55c591fc9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f477bfff700 1 -- 172.21.15.81:0/368807768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc5720 msgr2=0x55c591fc9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f477bfff700 1 --2- 172.21.15.81:0/368807768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc5720 0x55c591fc9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f477bfff700 1 -- 172.21.15.81:0/368807768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 msgr2=0x55c591fcb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f477bfff700 1 --2- 172.21.15.81:0/368807768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 0x55c591fcb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f477bfff700 1 -- 172.21.15.81:0/368807768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c10e650 con 0x55c591fc4e00 2024-05-09T00:09:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f47816e7700 1 --2- 172.21.15.81:0/368807768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc5720 0x55c591fc9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f477bfff700 1 --2- 172.21.15.81:0/368807768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc4e00 0x55c591fc89d0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f476400dce0 tx=0x7f476400f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bff653ac8a2df9d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f475bfff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f475bfff700 1 -- 172.21.15.81:0/368807768 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476400dee0 con 0x55c591fc4e00 2024-05-09T00:09:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f475bfff700 1 -- 172.21.15.81:0/368807768 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f476400fe60 con 0x55c591fc4e00 2024-05-09T00:09:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.179+0000 7f478f304b80 1 -- 172.21.15.81:0/368807768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c591e68270 con 0x55c591fc4e00 2024-05-09T00:09:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.180+0000 7f475bfff700 1 -- 172.21.15.81:0/368807768 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4764004230 con 0x55c591fc4e00 2024-05-09T00:09:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.180+0000 7f478f304b80 10 client.17349 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.180+0000 7f478f304b80 1 -- 172.21.15.81:0/368807768 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c591d3cb60 con 0x55c591fc4e00 2024-05-09T00:09:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.180+0000 7f475bfff700 1 -- 172.21.15.81:0/368807768 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c591e68270 con 0x55c591fc4e00 2024-05-09T00:09:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.180+0000 7f475bfff700 1 -- 172.21.15.81:0/368807768 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4764019030 con 0x55c591fc4e00 2024-05-09T00:09:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.180+0000 7f478f304b80 10 client.17349 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.180+0000 7f478f304b80 10 client.17349 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.180+0000 7f478f304b80 20 client.17349 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.180+0000 7f478f304b80 1 --2- 172.21.15.81:0/368807768 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c591fd90f0 0x55c591fdb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.180+0000 7f478f304b80 4 client.17349 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.180+0000 7f478f304b80 1 -- 172.21.15.81:0/368807768 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c591f8e810 con 0x55c591fd90f0 2024-05-09T00:09:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.180+0000 7f4780ee6700 1 --2- 172.21.15.81:0/368807768 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c591fd90f0 0x55c591fdb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.181+0000 7f475bfff700 10 client.17349 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.181+0000 7f4780ee6700 1 --2- 172.21.15.81:0/368807768 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c591fd90f0 0x55c591fdb510 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=810e3b241662d454 server_cookie=8fe38a8f87afdb1e in_seq=0 out_seq=0 2024-05-09T00:09:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.181+0000 7f475bfff700 1 -- 172.21.15.81:0/368807768 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c591f8e810 con 0x55c591fd90f0 2024-05-09T00:09:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.181+0000 7f475bfff700 10 client.17349 handle_command_reply: tid=0 2024-05-09T00:09:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.181+0000 7f478f304b80 1 client.17349 shutdown 2024-05-09T00:09:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.181+0000 7f478f304b80 1 -- 172.21.15.81:0/368807768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc4e00 msgr2=0x55c591fc89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.181+0000 7f478f304b80 1 --2- 172.21.15.81:0/368807768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc4e00 0x55c591fc89d0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f476400dce0 tx=0x7f476400f640 comp rx=0 tx=0).stop 2024-05-09T00:09:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.181+0000 7f478f304b80 1 -- 172.21.15.81:0/368807768 shutdown_connections 2024-05-09T00:09:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.181+0000 7f478f304b80 1 --2- 172.21.15.81:0/368807768 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c591fd90f0 0x55c591fdb510 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.181+0000 7f478f304b80 1 --2- 172.21.15.81:0/368807768 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 0x55c591fcb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.181+0000 7f475bfff700 0 client.17349 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.181+0000 7f478f304b80 1 --2- 172.21.15.81:0/368807768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc5720 0x55c591fc9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.181+0000 7f478f304b80 1 --2- 172.21.15.81:0/368807768 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc4e00 0x55c591fc89d0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.181+0000 7f478f304b80 1 -- 172.21.15.81:0/368807768 >> 172.21.15.81:0/368807768 conn(0x55c591f1d210 msgr2=0x55c591fb95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.182+0000 7f478f304b80 1 -- 172.21.15.81:0/368807768 shutdown_connections 2024-05-09T00:09:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.182+0000 7f478f304b80 1 -- 172.21.15.81:0/368807768 wait complete. 2024-05-09T00:09:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.182+0000 7f478f304b80 20 client.17349 trim_cache size 0 max 16384 2024-05-09T00:09:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f478f304b80 1 Processor -- start 2024-05-09T00:09:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f478f304b80 1 -- start start 2024-05-09T00:09:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f478f304b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 0x55c591fbba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f478f304b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc4e00 0x55c591fd4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f478f304b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc5720 0x55c591fb9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f478f304b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c591fba930 con 0x55c591fc5720 2024-05-09T00:09:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f478f304b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c591fb6df0 con 0x55c591fbf890 2024-05-09T00:09:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f478f304b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c591fc9b60 con 0x55c591fc4e00 2024-05-09T00:09:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f47816e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc5720 0x55c591fb9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f47816e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc5720 0x55c591fb9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51408/0 (socket says 172.21.15.81:51408) 2024-05-09T00:09:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f47816e7700 1 -- 172.21.15.81:0/2219620280 learned_addr learned my addr 172.21.15.81:0/2219620280 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f477bfff700 1 --2- 172.21.15.81:0/2219620280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc4e00 0x55c591fd4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f4780ee6700 1 --2- 172.21.15.81:0/2219620280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 0x55c591fbba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f47816e7700 1 -- 172.21.15.81:0/2219620280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc4e00 msgr2=0x55c591fd4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f47816e7700 1 --2- 172.21.15.81:0/2219620280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc4e00 0x55c591fd4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f47816e7700 1 -- 172.21.15.81:0/2219620280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 msgr2=0x55c591fbba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f47816e7700 1 --2- 172.21.15.81:0/2219620280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 0x55c591fbba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.195+0000 7f47816e7700 1 -- 172.21.15.81:0/2219620280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c591ed5560 con 0x55c591fc5720 2024-05-09T00:09:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.196+0000 7f47816e7700 1 --2- 172.21.15.81:0/2219620280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc5720 0x55c591fb9d20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f476c096720 tx=0x7f476c09a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a425eb52da63f2e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.196+0000 7f47737fe700 1 -- 172.21.15.81:0/2219620280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c0a2130 con 0x55c591fc5720 2024-05-09T00:09:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.196+0000 7f47737fe700 1 -- 172.21.15.81:0/2219620280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f476c0997f0 con 0x55c591fc5720 2024-05-09T00:09:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.196+0000 7f47737fe700 1 -- 172.21.15.81:0/2219620280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c00e5c0 con 0x55c591fc5720 2024-05-09T00:09:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.196+0000 7f478f304b80 1 -- 172.21.15.81:0/2219620280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc5720 msgr2=0x55c591fb9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.196+0000 7f478f304b80 1 --2- 172.21.15.81:0/2219620280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc5720 0x55c591fb9d20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f476c096720 tx=0x7f476c09a430 comp rx=0 tx=0).stop 2024-05-09T00:09:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.196+0000 7f478f304b80 1 -- 172.21.15.81:0/2219620280 shutdown_connections 2024-05-09T00:09:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.196+0000 7f478f304b80 1 --2- 172.21.15.81:0/2219620280 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fbf890 0x55c591fbba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.196+0000 7f478f304b80 1 --2- 172.21.15.81:0/2219620280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc5720 0x55c591fb9d20 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.196+0000 7f478f304b80 1 --2- 172.21.15.81:0/2219620280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fc4e00 0x55c591fd4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.196+0000 7f478f304b80 1 -- 172.21.15.81:0/2219620280 >> 172.21.15.81:0/2219620280 conn(0x55c591f1d210 msgr2=0x55c591fc2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.196+0000 7f478f304b80 1 -- 172.21.15.81:0/2219620280 shutdown_connections 2024-05-09T00:09:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.196+0000 7f478f304b80 1 -- 172.21.15.81:0/2219620280 wait complete. 2024-05-09T00:09:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.197+0000 7f478f304b80 1 -- start start 2024-05-09T00:09:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.197+0000 7f478f304b80 1 Processor -- start 2024-05-09T00:09:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.197+0000 7f478f304b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fbf890 0x55c591fd05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.197+0000 7f478f304b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fc4e00 0x55c591fc1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.197+0000 7f478f304b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc5720 0x55c591fc2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.197+0000 7f478f304b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c591fc0900 con 0x55c591fc5720 2024-05-09T00:09:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.197+0000 7f478f304b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c591fc0a70 con 0x55c591fc4e00 2024-05-09T00:09:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.197+0000 7f478f304b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c591fc0c30 con 0x55c591fbf890 2024-05-09T00:09:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.197+0000 7f478f304b80 10 client.0 _ll_register_callbacks cb 0x55c591eb4b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.197+0000 7f47816e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc5720 0x55c591fc2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.197+0000 7f47816e7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc5720 0x55c591fc2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51420/0 (socket says 172.21.15.81:51420) 2024-05-09T00:09:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.197+0000 7f47816e7700 1 -- 172.21.15.81:0/1091719107 learned_addr learned my addr 172.21.15.81:0/1091719107 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.197+0000 7f4780ee6700 1 --2- 172.21.15.81:0/1091719107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fbf890 0x55c591fd05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.197+0000 7f477bfff700 1 --2- 172.21.15.81:0/1091719107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fc4e00 0x55c591fc1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f47816e7700 1 -- 172.21.15.81:0/1091719107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fbf890 msgr2=0x55c591fd05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f47816e7700 1 --2- 172.21.15.81:0/1091719107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fbf890 0x55c591fd05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f47816e7700 1 -- 172.21.15.81:0/1091719107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fc4e00 msgr2=0x55c591fc1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f47816e7700 1 --2- 172.21.15.81:0/1091719107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fc4e00 0x55c591fc1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f47816e7700 1 -- 172.21.15.81:0/1091719107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c1a4540 con 0x55c591fc5720 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f47816e7700 1 --2- 172.21.15.81:0/1091719107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc5720 0x55c591fc2250 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f476c00d950 tx=0x7f476c005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ff9a6447e57dc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f475bfff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f475bfff700 1 -- 172.21.15.81:0/1091719107 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476c00e550 con 0x55c591fc5720 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f475bfff700 1 -- 172.21.15.81:0/1091719107 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f476c0991a0 con 0x55c591fc5720 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f478f304b80 1 -- 172.21.15.81:0/1091719107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4774007960 con 0x55c591fc5720 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f475bfff700 1 -- 172.21.15.81:0/1091719107 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f476c099360 con 0x55c591fc5720 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f478f304b80 10 client.17355 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f478f304b80 1 -- 172.21.15.81:0/1091719107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c591d94cd0 con 0x55c591fc5720 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f475bfff700 1 -- 172.21.15.81:0/1091719107 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f476c07c070 con 0x55c591fc5720 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f475bfff700 1 -- 172.21.15.81:0/1091719107 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f476c065030 con 0x55c591fc5720 2024-05-09T00:09:37.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f478f304b80 10 client.17355 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f478f304b80 10 client.17355 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f478f304b80 20 client.17355 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f478f304b80 1 --2- 172.21.15.81:0/1091719107 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c59202fc90 0x55c5920320b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f478f304b80 4 client.17355 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:09:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.198+0000 7f478f304b80 1 -- 172.21.15.81:0/1091719107 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c591f07ec0 con 0x55c59202fc90 2024-05-09T00:09:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f4780ee6700 1 --2- 172.21.15.81:0/1091719107 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c59202fc90 0x55c5920320b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f475bfff700 10 client.17355 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f4780ee6700 1 --2- 172.21.15.81:0/1091719107 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c59202fc90 0x55c5920320b0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=932511f480e9b0a7 server_cookie=b4c95c224c5d101b in_seq=0 out_seq=0 2024-05-09T00:09:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f475bfff700 1 -- 172.21.15.81:0/1091719107 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c591f07ec0 con 0x55c59202fc90 2024-05-09T00:09:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f475bfff700 10 client.17355 handle_command_reply: tid=0 2024-05-09T00:09:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f478f304b80 1 client.17355 shutdown 2024-05-09T00:09:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f478f304b80 1 -- 172.21.15.81:0/1091719107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc5720 msgr2=0x55c591fc2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f478f304b80 1 --2- 172.21.15.81:0/1091719107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc5720 0x55c591fc2250 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f476c00d950 tx=0x7f476c005870 comp rx=0 tx=0).stop 2024-05-09T00:09:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f478f304b80 1 -- 172.21.15.81:0/1091719107 shutdown_connections 2024-05-09T00:09:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f478f304b80 1 --2- 172.21.15.81:0/1091719107 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c59202fc90 0x55c5920320b0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f478f304b80 1 --2- 172.21.15.81:0/1091719107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c591fc5720 0x55c591fc2250 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f475bfff700 0 client.17355 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f478f304b80 1 --2- 172.21.15.81:0/1091719107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c591fbf890 0x55c591fd05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f478f304b80 1 --2- 172.21.15.81:0/1091719107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c591fc4e00 0x55c591fc1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f478f304b80 1 -- 172.21.15.81:0/1091719107 >> 172.21.15.81:0/1091719107 conn(0x55c591f1d210 msgr2=0x55c591fc71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f478f304b80 1 -- 172.21.15.81:0/1091719107 shutdown_connections 2024-05-09T00:09:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.199+0000 7f478f304b80 1 -- 172.21.15.81:0/1091719107 wait complete. 2024-05-09T00:09:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.200+0000 7f478f304b80 20 client.17355 trim_cache size 0 max 16384 2024-05-09T00:09:37.203 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:09:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.200+0000 7f478314a700 1 -- 172.21.15.81:0/1784043529 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f47680a1290 msgr2=0x7f47680a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.200+0000 7f478314a700 1 --2- 172.21.15.81:0/1784043529 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f47680a1290 0x7f47680a3750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4774009fd0 tx=0x7f477400b040 comp rx=0 tx=0).stop 2024-05-09T00:09:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.200+0000 7f478314a700 1 -- 172.21.15.81:0/1784043529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f477c19bda0 msgr2=0x7f477c19c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.200+0000 7f478314a700 1 --2- 172.21.15.81:0/1784043529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f477c19bda0 0x7f477c19c220 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f476c00d980 tx=0x7f476c00dd40 comp rx=0 tx=0).stop 2024-05-09T00:09:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.200+0000 7f478314a700 1 -- 172.21.15.81:0/1784043529 shutdown_connections 2024-05-09T00:09:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.200+0000 7f478314a700 1 --2- 172.21.15.81:0/1784043529 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f47680a1290 0x7f47680a3750 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.200+0000 7f478314a700 1 --2- 172.21.15.81:0/1784043529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f477c0682e0 0x7f477c197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.200+0000 7f478314a700 1 --2- 172.21.15.81:0/1784043529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f477c19bda0 0x7f477c19c220 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.200+0000 7f478314a700 1 --2- 172.21.15.81:0/1784043529 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f477c106290 0x7f477c197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.200+0000 7f478314a700 1 -- 172.21.15.81:0/1784043529 >> 172.21.15.81:0/1784043529 conn(0x7f477c076f40 msgr2=0x7f477c0fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.200+0000 7f478314a700 1 -- 172.21.15.81:0/1784043529 shutdown_connections 2024-05-09T00:09:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:37.200+0000 7f478314a700 1 -- 172.21.15.81:0/1784043529 wait complete. 2024-05-09T00:09:37.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:36 smithi150 ceph-mon[46187]: pgmap v202: 97 pgs: 97 active+clean; 1.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 20 op/s 2024-05-09T00:09:37.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:36 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1700950834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:09:37.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:36 smithi171 ceph-mon[47351]: pgmap v202: 97 pgs: 97 active+clean; 1.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 64 KiB/s wr, 20 op/s 2024-05-09T00:09:37.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:36 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1700950834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:09:38.210 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:09:38.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:09:38.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.353+0000 7f2d29f56700 1 -- 172.21.15.81:0/2987524482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d24105f40 msgr2=0x7f2d24106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.353+0000 7f2d29f56700 1 --2- 172.21.15.81:0/2987524482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d24105f40 0x7f2d24106320 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009990 tx=0x7f2d18009ca0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.353+0000 7f2d29f56700 1 -- 172.21.15.81:0/2987524482 shutdown_connections 2024-05-09T00:09:38.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.353+0000 7f2d29f56700 1 --2- 172.21.15.81:0/2987524482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d24100220 0x7f2d2410ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.353+0000 7f2d29f56700 1 --2- 172.21.15.81:0/2987524482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d24105f40 0x7f2d24106320 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.353+0000 7f2d29f56700 1 --2- 172.21.15.81:0/2987524482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d240ff860 0x7f2d240ffce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.353+0000 7f2d29f56700 1 -- 172.21.15.81:0/2987524482 >> 172.21.15.81:0/2987524482 conn(0x7f2d240751c0 msgr2=0x7f2d240755d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:38.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.353+0000 7f2d29f56700 1 -- 172.21.15.81:0/2987524482 shutdown_connections 2024-05-09T00:09:38.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.353+0000 7f2d29f56700 1 -- 172.21.15.81:0/2987524482 wait complete. 2024-05-09T00:09:38.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.354+0000 7f2d29f56700 1 Processor -- start 2024-05-09T00:09:38.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.354+0000 7f2d29f56700 1 -- start start 2024-05-09T00:09:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.354+0000 7f2d29f56700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d240ff860 0x7f2d241973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.354+0000 7f2d29f56700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d24100220 0x7f2d24197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.354+0000 7f2d29f56700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d24105f40 0x7f2d2419bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.354+0000 7f2d29f56700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2419c290 con 0x7f2d240ff860 2024-05-09T00:09:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.354+0000 7f2d29f56700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2419c400 con 0x7f2d24105f40 2024-05-09T00:09:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.354+0000 7f2d29f56700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2419c5c0 con 0x7f2d24100220 2024-05-09T00:09:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.354+0000 7f2d237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d240ff860 0x7f2d241973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.354+0000 7f2d237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d240ff860 0x7f2d241973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38656/0 (socket says 172.21.15.81:38656) 2024-05-09T00:09:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d237fe700 1 -- 172.21.15.81:0/3645298931 learned_addr learned my addr 172.21.15.81:0/3645298931 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d23fff700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d24105f40 0x7f2d2419bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d22ffd700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d24100220 0x7f2d24197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d237fe700 1 -- 172.21.15.81:0/3645298931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d24100220 msgr2=0x7f2d24197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d237fe700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d24100220 0x7f2d24197900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d237fe700 1 -- 172.21.15.81:0/3645298931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d24105f40 msgr2=0x7f2d2419bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d237fe700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d24105f40 0x7f2d2419bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d237fe700 1 -- 172.21.15.81:0/3645298931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180095f0 con 0x7f2d240ff860 2024-05-09T00:09:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d23fff700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d24105f40 0x7f2d2419bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d237fe700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d240ff860 0x7f2d241973c0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f2d18005770 tx=0x7f2d18005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d20ff9700 1 -- 172.21.15.81:0/3645298931 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1801d070 con 0x7f2d240ff860 2024-05-09T00:09:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d20ff9700 1 -- 172.21.15.81:0/3645298931 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d18021410 con 0x7f2d240ff860 2024-05-09T00:09:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d20ff9700 1 -- 172.21.15.81:0/3645298931 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d18017650 con 0x7f2d240ff860 2024-05-09T00:09:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d29f56700 1 -- 172.21.15.81:0/3645298931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d2419c840 con 0x7f2d240ff860 2024-05-09T00:09:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.355+0000 7f2d29f56700 1 -- 172.21.15.81:0/3645298931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d2419cac0 con 0x7f2d240ff860 2024-05-09T00:09:38.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.358+0000 7f2d20ff9700 1 -- 172.21.15.81:0/3645298931 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f2d1800fb10 con 0x7f2d240ff860 2024-05-09T00:09:38.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.358+0000 7f2d20ff9700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2d0c0a1290 0x7f2d0c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.359+0000 7f2d20ff9700 1 -- 172.21.15.81:0/3645298931 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2d180cdf20 con 0x7f2d240ff860 2024-05-09T00:09:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.359+0000 7f2d22ffd700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2d0c0a1290 0x7f2d0c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.359+0000 7f2d22ffd700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2d0c0a1290 0x7f2d0c0a3750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2d241988c0 tx=0x7f2d14005d50 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.359+0000 7f2d36110b80 1 Processor -- start 2024-05-09T00:09:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.359+0000 7f2d36110b80 1 -- start start 2024-05-09T00:09:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.359+0000 7f2d36110b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f9290 0x5560192f9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.359+0000 7f2d36110b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9bb0 0x5560192f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.359+0000 7f2d36110b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f3d20 0x5560192f4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.359+0000 7f2d36110b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560192461d0 con 0x5560192f9bb0 2024-05-09T00:09:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.359+0000 7f2d36110b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556019243b90 con 0x5560192f9290 2024-05-09T00:09:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.359+0000 7f2d36110b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601923f480 con 0x5560192f3d20 2024-05-09T00:09:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.360+0000 7f2d22ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9bb0 0x5560192f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.360+0000 7f2d22ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9bb0 0x5560192f37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38668/0 (socket says 172.21.15.81:38668) 2024-05-09T00:09:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.360+0000 7f2d22ffd700 1 -- 172.21.15.81:0/3648957783 learned_addr learned my addr 172.21.15.81:0/3648957783 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.360+0000 7f2d237fe700 1 --2- 172.21.15.81:0/3648957783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f9290 0x5560192f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.360+0000 7f2d22ffd700 1 -- 172.21.15.81:0/3648957783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f3d20 msgr2=0x5560192f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.360+0000 7f2d22ffd700 1 --2- 172.21.15.81:0/3648957783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f3d20 0x5560192f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.360+0000 7f2d22ffd700 1 -- 172.21.15.81:0/3648957783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f9290 msgr2=0x5560192f9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.360+0000 7f2d22ffd700 1 --2- 172.21.15.81:0/3648957783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f9290 0x5560192f9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.360+0000 7f2d22ffd700 1 -- 172.21.15.81:0/3648957783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560190c0430 con 0x5560192f9bb0 2024-05-09T00:09:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.360+0000 7f2d237fe700 1 --2- 172.21.15.81:0/3648957783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f9290 0x5560192f9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.360+0000 7f2d22ffd700 1 --2- 172.21.15.81:0/3648957783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9bb0 0x5560192f37e0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400dbf0 tx=0x7f2d14010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bce14e59e442b12 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.360+0000 7f2d09ffb700 1 -- 172.21.15.81:0/3648957783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400f9b0 con 0x5560192f9bb0 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.360+0000 7f2d09ffb700 1 -- 172.21.15.81:0/3648957783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d1401c450 con 0x5560192f9bb0 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.360+0000 7f2d09ffb700 1 -- 172.21.15.81:0/3648957783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1401b610 con 0x5560192f9bb0 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.361+0000 7f2d36110b80 1 -- 172.21.15.81:0/3648957783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9bb0 msgr2=0x5560192f37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.361+0000 7f2d36110b80 1 --2- 172.21.15.81:0/3648957783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9bb0 0x5560192f37e0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400dbf0 tx=0x7f2d14010000 comp rx=0 tx=0).stop 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.361+0000 7f2d36110b80 1 -- 172.21.15.81:0/3648957783 shutdown_connections 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.361+0000 7f2d36110b80 1 --2- 172.21.15.81:0/3648957783 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f9290 0x5560192f9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.361+0000 7f2d36110b80 1 --2- 172.21.15.81:0/3648957783 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f3d20 0x5560192f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.361+0000 7f2d36110b80 1 --2- 172.21.15.81:0/3648957783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9bb0 0x5560192f37e0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.361+0000 7f2d36110b80 1 -- 172.21.15.81:0/3648957783 >> 172.21.15.81:0/3648957783 conn(0x55601924d290 msgr2=0x5560192e9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.361+0000 7f2d36110b80 1 -- 172.21.15.81:0/3648957783 shutdown_connections 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.361+0000 7f2d36110b80 1 -- 172.21.15.81:0/3648957783 wait complete. 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.361+0000 7f2d36110b80 1 -- start start 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.361+0000 7f2d36110b80 1 Processor -- start 2024-05-09T00:09:38.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d36110b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f3d20 0x5560192fcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d36110b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9290 0x5560192fd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d36110b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9bb0 0x5560192fd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d36110b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560191db5e0 con 0x5560192f9bb0 2024-05-09T00:09:38.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d36110b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560191db280 con 0x5560192f3d20 2024-05-09T00:09:38.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d36110b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560190c2720 con 0x5560192f9290 2024-05-09T00:09:38.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d36110b80 10 client.0 _ll_register_callbacks cb 0x5560191e4bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:38.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d23fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9bb0 0x5560192fd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d23fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9bb0 0x5560192fd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38672/0 (socket says 172.21.15.81:38672) 2024-05-09T00:09:38.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d23fff700 1 -- 172.21.15.81:0/2170143654 learned_addr learned my addr 172.21.15.81:0/2170143654 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:38.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d22ffd700 1 --2- 172.21.15.81:0/2170143654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9290 0x5560192fd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d237fe700 1 --2- 172.21.15.81:0/2170143654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f3d20 0x5560192fcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d23fff700 1 -- 172.21.15.81:0/2170143654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9290 msgr2=0x5560192fd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d23fff700 1 --2- 172.21.15.81:0/2170143654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9290 0x5560192fd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d23fff700 1 -- 172.21.15.81:0/2170143654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f3d20 msgr2=0x5560192fcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d23fff700 1 --2- 172.21.15.81:0/2170143654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f3d20 0x5560192fcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d23fff700 1 -- 172.21.15.81:0/2170143654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1400d8d0 con 0x5560192f9bb0 2024-05-09T00:09:38.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d237fe700 1 --2- 172.21.15.81:0/2170143654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f3d20 0x5560192fcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:38.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d23fff700 1 --2- 172.21.15.81:0/2170143654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9bb0 0x5560192fd9a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c007b10 tx=0x7f2d1c007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca5849d5ab8506f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:38.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d02ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:38.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d02ffd700 1 -- 172.21.15.81:0/2170143654 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c00e050 con 0x5560192f9bb0 2024-05-09T00:09:38.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d02ffd700 1 -- 172.21.15.81:0/2170143654 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2d1c010b00 con 0x5560192f9bb0 2024-05-09T00:09:38.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.362+0000 7f2d36110b80 1 -- 172.21.15.81:0/2170143654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560191982f0 con 0x5560192f9bb0 2024-05-09T00:09:38.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.363+0000 7f2d02ffd700 1 -- 172.21.15.81:0/2170143654 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d1c010cc0 con 0x5560192f9bb0 2024-05-09T00:09:38.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.363+0000 7f2d36110b80 10 client.17367 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:38.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.363+0000 7f2d36110b80 1 -- 172.21.15.81:0/2170143654 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55601906cbe0 con 0x5560192f9bb0 2024-05-09T00:09:38.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.363+0000 7f2d02ffd700 1 -- 172.21.15.81:0/2170143654 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5560191982f0 con 0x5560192f9bb0 2024-05-09T00:09:38.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.363+0000 7f2d02ffd700 1 -- 172.21.15.81:0/2170143654 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2d1c0163f0 con 0x5560192f9bb0 2024-05-09T00:09:38.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.363+0000 7f2d36110b80 10 client.17367 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:38.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.363+0000 7f2d36110b80 10 client.17367 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:38.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.363+0000 7f2d36110b80 20 client.17367 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:38.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.363+0000 7f2d36110b80 1 --2- 172.21.15.81:0/2170143654 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55601930d710 0x55601930fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.363+0000 7f2d36110b80 4 client.17367 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:38.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.363+0000 7f2d36110b80 1 -- 172.21.15.81:0/2170143654 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5560192be890 con 0x55601930d710 2024-05-09T00:09:38.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.363+0000 7f2d237fe700 1 --2- 172.21.15.81:0/2170143654 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55601930d710 0x55601930fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.364+0000 7f2d237fe700 1 --2- 172.21.15.81:0/2170143654 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55601930d710 0x55601930fb30 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c67428e2ce897e4 server_cookie=60b8ebc0161910f5 in_seq=0 out_seq=0 2024-05-09T00:09:38.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.364+0000 7f2d02ffd700 10 client.17367 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:38.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.364+0000 7f2d02ffd700 1 -- 172.21.15.81:0/2170143654 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5560192be890 con 0x55601930d710 2024-05-09T00:09:38.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.364+0000 7f2d02ffd700 10 client.17367 handle_command_reply: tid=0 2024-05-09T00:09:38.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.364+0000 7f2d36110b80 1 client.17367 shutdown 2024-05-09T00:09:38.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.365+0000 7f2d36110b80 1 -- 172.21.15.81:0/2170143654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9bb0 msgr2=0x5560192fd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.365+0000 7f2d36110b80 1 --2- 172.21.15.81:0/2170143654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9bb0 0x5560192fd9a0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c007b10 tx=0x7f2d1c007ed0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.365+0000 7f2d36110b80 1 -- 172.21.15.81:0/2170143654 shutdown_connections 2024-05-09T00:09:38.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.365+0000 7f2d36110b80 1 --2- 172.21.15.81:0/2170143654 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55601930d710 0x55601930fb30 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.365+0000 7f2d36110b80 1 --2- 172.21.15.81:0/2170143654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f3d20 0x5560192fcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.365+0000 7f2d02ffd700 0 client.17367 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:38.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.365+0000 7f2d36110b80 1 --2- 172.21.15.81:0/2170143654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9bb0 0x5560192fd9a0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.365+0000 7f2d36110b80 1 --2- 172.21.15.81:0/2170143654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9290 0x5560192fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.365+0000 7f2d36110b80 1 -- 172.21.15.81:0/2170143654 >> 172.21.15.81:0/2170143654 conn(0x55601924d290 msgr2=0x5560192e9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:38.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.365+0000 7f2d36110b80 1 -- 172.21.15.81:0/2170143654 shutdown_connections 2024-05-09T00:09:38.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.365+0000 7f2d36110b80 1 -- 172.21.15.81:0/2170143654 wait complete. 2024-05-09T00:09:38.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.365+0000 7f2d36110b80 20 client.17367 trim_cache size 0 max 16384 2024-05-09T00:09:38.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d36110b80 1 Processor -- start 2024-05-09T00:09:38.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d36110b80 1 -- start start 2024-05-09T00:09:38.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d36110b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f3d20 0x5560192f88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d36110b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9290 0x5560192fc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d36110b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9bb0 0x5560192e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d36110b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560192eabb0 con 0x5560192f9290 2024-05-09T00:09:38.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d36110b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601930ad40 con 0x5560192f3d20 2024-05-09T00:09:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d36110b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560192fe590 con 0x5560192f9bb0 2024-05-09T00:09:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d22ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9290 0x5560192fc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d22ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9290 0x5560192fc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38686/0 (socket says 172.21.15.81:38686) 2024-05-09T00:09:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d22ffd700 1 -- 172.21.15.81:0/1242358303 learned_addr learned my addr 172.21.15.81:0/1242358303 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d23fff700 1 --2- 172.21.15.81:0/1242358303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9bb0 0x5560192e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d237fe700 1 --2- 172.21.15.81:0/1242358303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f3d20 0x5560192f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d22ffd700 1 -- 172.21.15.81:0/1242358303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9bb0 msgr2=0x5560192e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d22ffd700 1 --2- 172.21.15.81:0/1242358303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9bb0 0x5560192e9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d22ffd700 1 -- 172.21.15.81:0/1242358303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f3d20 msgr2=0x5560192f88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d22ffd700 1 --2- 172.21.15.81:0/1242358303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f3d20 0x5560192f88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d22ffd700 1 -- 172.21.15.81:0/1242358303 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560192f43d0 con 0x5560192f9290 2024-05-09T00:09:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.382+0000 7f2d237fe700 1 --2- 172.21.15.81:0/1242358303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f3d20 0x5560192f88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:38.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.383+0000 7f2d22ffd700 1 --2- 172.21.15.81:0/1242358303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9290 0x5560192fc820 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400dbf0 tx=0x7f2d1400b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cb0a295ee6f21c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:38.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.383+0000 7f2d0a7fc700 1 -- 172.21.15.81:0/1242358303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1401c800 con 0x5560192f9290 2024-05-09T00:09:38.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.383+0000 7f2d0a7fc700 1 -- 172.21.15.81:0/1242358303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d1402c040 con 0x5560192f9290 2024-05-09T00:09:38.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.383+0000 7f2d0a7fc700 1 -- 172.21.15.81:0/1242358303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400fba0 con 0x5560192f9290 2024-05-09T00:09:38.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.383+0000 7f2d36110b80 1 -- 172.21.15.81:0/1242358303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9290 msgr2=0x5560192fc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.383+0000 7f2d36110b80 1 --2- 172.21.15.81:0/1242358303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9290 0x5560192fc820 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f2d1400dbf0 tx=0x7f2d1400b7f0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.383+0000 7f2d36110b80 1 -- 172.21.15.81:0/1242358303 shutdown_connections 2024-05-09T00:09:38.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.383+0000 7f2d36110b80 1 --2- 172.21.15.81:0/1242358303 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f3d20 0x5560192f88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.383+0000 7f2d36110b80 1 --2- 172.21.15.81:0/1242358303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9bb0 0x5560192e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.383+0000 7f2d36110b80 1 --2- 172.21.15.81:0/1242358303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f9290 0x5560192fc820 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.383+0000 7f2d36110b80 1 -- 172.21.15.81:0/1242358303 >> 172.21.15.81:0/1242358303 conn(0x55601924d290 msgr2=0x5560192ee3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:38.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.383+0000 7f2d36110b80 1 -- 172.21.15.81:0/1242358303 shutdown_connections 2024-05-09T00:09:38.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.383+0000 7f2d36110b80 1 -- 172.21.15.81:0/1242358303 wait complete. 2024-05-09T00:09:38.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.384+0000 7f2d36110b80 1 -- start start 2024-05-09T00:09:38.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.384+0000 7f2d36110b80 1 Processor -- start 2024-05-09T00:09:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.384+0000 7f2d36110b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f3d20 0x5560193010b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.384+0000 7f2d36110b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f9290 0x5560193015f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.384+0000 7f2d36110b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9bb0 0x556019301b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.384+0000 7f2d36110b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556019363bd0 con 0x5560192f3d20 2024-05-09T00:09:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.384+0000 7f2d36110b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556019363d10 con 0x5560192f9290 2024-05-09T00:09:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.384+0000 7f2d36110b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556019363e50 con 0x5560192f9bb0 2024-05-09T00:09:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.384+0000 7f2d36110b80 10 client.0 _ll_register_callbacks cb 0x5560191e4bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.384+0000 7f2d237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f3d20 0x5560193010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.384+0000 7f2d237fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f3d20 0x5560193010b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38700/0 (socket says 172.21.15.81:38700) 2024-05-09T00:09:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.384+0000 7f2d237fe700 1 -- 172.21.15.81:0/2762432307 learned_addr learned my addr 172.21.15.81:0/2762432307 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d23fff700 1 --2- 172.21.15.81:0/2762432307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9bb0 0x556019301b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d237fe700 1 -- 172.21.15.81:0/2762432307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9bb0 msgr2=0x556019301b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d237fe700 1 --2- 172.21.15.81:0/2762432307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9bb0 0x556019301b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d237fe700 1 -- 172.21.15.81:0/2762432307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f9290 msgr2=0x5560193015f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d22ffd700 1 --2- 172.21.15.81:0/2762432307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f9290 0x5560193015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d237fe700 1 --2- 172.21.15.81:0/2762432307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f9290 0x5560193015f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d237fe700 1 -- 172.21.15.81:0/2762432307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560190c0430 con 0x5560192f3d20 2024-05-09T00:09:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d23fff700 1 --2- 172.21.15.81:0/2762432307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9bb0 0x556019301b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d237fe700 1 --2- 172.21.15.81:0/2762432307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f3d20 0x5560193010b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f2d18005740 tx=0x7f2d18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6cbcfcdc278ab9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d02ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d02ffd700 1 -- 172.21.15.81:0/2762432307 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1809e030 con 0x5560192f3d20 2024-05-09T00:09:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d02ffd700 1 -- 172.21.15.81:0/2762432307 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2d180a3470 con 0x5560192f3d20 2024-05-09T00:09:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d36110b80 1 -- 172.21.15.81:0/2762432307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d1401c450 con 0x5560192f3d20 2024-05-09T00:09:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d02ffd700 1 -- 172.21.15.81:0/2762432307 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d180a10b0 con 0x5560192f3d20 2024-05-09T00:09:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d36110b80 10 client.17373 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d36110b80 1 -- 172.21.15.81:0/2762432307 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5560192055e0 con 0x5560192f3d20 2024-05-09T00:09:38.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d02ffd700 1 -- 172.21.15.81:0/2762432307 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d180b7080 con 0x5560192f3d20 2024-05-09T00:09:38.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.385+0000 7f2d02ffd700 1 -- 172.21.15.81:0/2762432307 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2d1809a670 con 0x5560192f3d20 2024-05-09T00:09:38.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.386+0000 7f2d36110b80 10 client.17373 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:38.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.386+0000 7f2d36110b80 10 client.17373 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:38.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.386+0000 7f2d36110b80 20 client.17373 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:38.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.386+0000 7f2d36110b80 1 --2- 172.21.15.81:0/2762432307 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556019365320 0x556019367740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.386+0000 7f2d36110b80 4 client.17373 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:09:38.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.386+0000 7f2d36110b80 1 -- 172.21.15.81:0/2762432307 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x556019237f40 con 0x556019365320 2024-05-09T00:09:38.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.386+0000 7f2d22ffd700 1 --2- 172.21.15.81:0/2762432307 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556019365320 0x556019367740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.386+0000 7f2d22ffd700 1 --2- 172.21.15.81:0/2762432307 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556019365320 0x556019367740 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59e0e47e0fefe936 server_cookie=dd262d4bf63a6f4d in_seq=0 out_seq=0 2024-05-09T00:09:38.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.386+0000 7f2d02ffd700 10 client.17373 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:38.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d02ffd700 1 -- 172.21.15.81:0/2762432307 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x556019237f40 con 0x556019365320 2024-05-09T00:09:38.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d02ffd700 10 client.17373 handle_command_reply: tid=0 2024-05-09T00:09:38.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d36110b80 1 client.17373 shutdown 2024-05-09T00:09:38.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d36110b80 1 -- 172.21.15.81:0/2762432307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f3d20 msgr2=0x5560193010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d36110b80 1 --2- 172.21.15.81:0/2762432307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f3d20 0x5560193010b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f2d18005740 tx=0x7f2d18005880 comp rx=0 tx=0).stop 2024-05-09T00:09:38.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d36110b80 1 -- 172.21.15.81:0/2762432307 shutdown_connections 2024-05-09T00:09:38.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d36110b80 1 --2- 172.21.15.81:0/2762432307 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556019365320 0x556019367740 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d36110b80 1 --2- 172.21.15.81:0/2762432307 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5560192f9bb0 0x556019301b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d36110b80 1 --2- 172.21.15.81:0/2762432307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5560192f3d20 0x5560193010b0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d36110b80 1 --2- 172.21.15.81:0/2762432307 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5560192f9290 0x5560193015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d02ffd700 0 client.17373 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:38.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d36110b80 1 -- 172.21.15.81:0/2762432307 >> 172.21.15.81:0/2762432307 conn(0x55601924d290 msgr2=0x5560192f8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:38.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d36110b80 1 -- 172.21.15.81:0/2762432307 shutdown_connections 2024-05-09T00:09:38.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d36110b80 1 -- 172.21.15.81:0/2762432307 wait complete. 2024-05-09T00:09:38.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.388+0000 7f2d36110b80 20 client.17373 trim_cache size 0 max 16384 2024-05-09T00:09:38.392 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:09:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:09:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "30d02e7e-5e6b-4fe5-a8ef-eaba6ae6fb64", 2024-05-09T00:09:38.392 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:09:38.393 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:09:38.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.389+0000 7f2d29f56700 1 -- 172.21.15.81:0/3645298931 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2d0c0a1290 msgr2=0x7f2d0c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.389+0000 7f2d29f56700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2d0c0a1290 0x7f2d0c0a3750 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2d241988c0 tx=0x7f2d14005d50 comp rx=0 tx=0).stop 2024-05-09T00:09:38.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.389+0000 7f2d29f56700 1 -- 172.21.15.81:0/3645298931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d240ff860 msgr2=0x7f2d241973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.389+0000 7f2d29f56700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d240ff860 0x7f2d241973c0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f2d18005770 tx=0x7f2d18005ef0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.389+0000 7f2d29f56700 1 -- 172.21.15.81:0/3645298931 shutdown_connections 2024-05-09T00:09:38.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.389+0000 7f2d29f56700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2d0c0a1290 0x7f2d0c0a3750 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.389+0000 7f2d29f56700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2d24105f40 0x7f2d2419bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.389+0000 7f2d29f56700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d240ff860 0x7f2d241973c0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.389+0000 7f2d29f56700 1 --2- 172.21.15.81:0/3645298931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d24100220 0x7f2d24197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.389+0000 7f2d29f56700 1 -- 172.21.15.81:0/3645298931 >> 172.21.15.81:0/3645298931 conn(0x7f2d240751c0 msgr2=0x7f2d240fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:38.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.389+0000 7f2d29f56700 1 -- 172.21.15.81:0/3645298931 shutdown_connections 2024-05-09T00:09:38.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.389+0000 7f2d29f56700 1 -- 172.21.15.81:0/3645298931 wait complete. 2024-05-09T00:09:38.398 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:09:38.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.524+0000 7f411b445700 1 -- 172.21.15.81:0/142114012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41140ff410 msgr2=0x7f41140ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.524+0000 7f411b445700 1 --2- 172.21.15.81:0/142114012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41140ff410 0x7f41140ff890 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f4110009990 tx=0x7f4110009ca0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.524+0000 7f411b445700 1 -- 172.21.15.81:0/142114012 shutdown_connections 2024-05-09T00:09:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.524+0000 7f411b445700 1 --2- 172.21.15.81:0/142114012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4114105ef0 0x7f41141062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.524+0000 7f411b445700 1 --2- 172.21.15.81:0/142114012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41140ffdd0 0x7f411410dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.524+0000 7f411b445700 1 --2- 172.21.15.81:0/142114012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41140ff410 0x7f41140ff890 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.524+0000 7f411b445700 1 -- 172.21.15.81:0/142114012 >> 172.21.15.81:0/142114012 conn(0x7f41140763a0 msgr2=0x7f41140fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.524+0000 7f411b445700 1 -- 172.21.15.81:0/142114012 shutdown_connections 2024-05-09T00:09:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.524+0000 7f411b445700 1 -- 172.21.15.81:0/142114012 wait complete. 2024-05-09T00:09:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f411b445700 1 Processor -- start 2024-05-09T00:09:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f411b445700 1 -- start start 2024-05-09T00:09:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f411b445700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41140ff410 0x7f41141005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f411b445700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41140ffdd0 0x7f4114100b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f411b445700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4114105ef0 0x7f4114101070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f411b445700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41141a5770 con 0x7f4114105ef0 2024-05-09T00:09:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f411b445700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41141a58e0 con 0x7f41140ff410 2024-05-09T00:09:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f411b445700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41141a5aa0 con 0x7f41140ffdd0 2024-05-09T00:09:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f41199e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4114105ef0 0x7f4114101070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f41199e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4114105ef0 0x7f4114101070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38718/0 (socket says 172.21.15.81:38718) 2024-05-09T00:09:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f41199e2700 1 -- 172.21.15.81:0/2153538758 learned_addr learned my addr 172.21.15.81:0/2153538758 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f41191e1700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41140ff410 0x7f41141005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f41189e0700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41140ffdd0 0x7f4114100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f41199e2700 1 -- 172.21.15.81:0/2153538758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41140ffdd0 msgr2=0x7f4114100b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f41199e2700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41140ffdd0 0x7f4114100b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f41199e2700 1 -- 172.21.15.81:0/2153538758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41140ff410 msgr2=0x7f41141005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f41199e2700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41140ff410 0x7f41141005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f41199e2700 1 -- 172.21.15.81:0/2153538758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41100095f0 con 0x7f4114105ef0 2024-05-09T00:09:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.525+0000 7f41189e0700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41140ffdd0 0x7f4114100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.526+0000 7f41199e2700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4114105ef0 0x7f4114101070 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f410c007d70 tx=0x7f410c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.526+0000 7f410a7fc700 1 -- 172.21.15.81:0/2153538758 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c00ad40 con 0x7f4114105ef0 2024-05-09T00:09:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.526+0000 7f411b445700 1 -- 172.21.15.81:0/2153538758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41141a5d80 con 0x7f4114105ef0 2024-05-09T00:09:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.526+0000 7f410a7fc700 1 -- 172.21.15.81:0/2153538758 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f410c0128e0 con 0x7f4114105ef0 2024-05-09T00:09:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.526+0000 7f410a7fc700 1 -- 172.21.15.81:0/2153538758 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c0116b0 con 0x7f4114105ef0 2024-05-09T00:09:38.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.526+0000 7f411b445700 1 -- 172.21.15.81:0/2153538758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41141a6240 con 0x7f4114105ef0 2024-05-09T00:09:38.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.528+0000 7f410a7fc700 1 -- 172.21.15.81:0/2153538758 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f410c012420 con 0x7f4114105ef0 2024-05-09T00:09:38.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.528+0000 7f410a7fc700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f41000a1290 0x7f41000a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.529+0000 7f41191e1700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f41000a1290 0x7f41000a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.529+0000 7f410a7fc700 1 -- 172.21.15.81:0/2153538758 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f410c0cceb0 con 0x7f4114105ef0 2024-05-09T00:09:38.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.529+0000 7f41191e1700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f41000a1290 0x7f41000a3750 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4104005950 tx=0x7f410400a300 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:38.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.529+0000 7f41275ffb80 1 Processor -- start 2024-05-09T00:09:38.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.529+0000 7f41275ffb80 1 -- start start 2024-05-09T00:09:38.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41275ffb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae60be00 0x5619ae60c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41275ffb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae606350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41275ffb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 0x5619ae606cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41275ffb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619ae55d150 con 0x5619ae60c720 2024-05-09T00:09:38.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41275ffb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619ae55ab10 con 0x5619ae606890 2024-05-09T00:09:38.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41275ffb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619ae556400 con 0x5619ae60be00 2024-05-09T00:09:38.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41189e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae606350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41189e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae606350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38726/0 (socket says 172.21.15.81:38726) 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41189e0700 1 -- 172.21.15.81:0/2569875566 learned_addr learned my addr 172.21.15.81:0/2569875566 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41189e0700 1 -- 172.21.15.81:0/2569875566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae60be00 msgr2=0x5619ae60c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41189e0700 1 --2- 172.21.15.81:0/2569875566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae60be00 0x5619ae60c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41189e0700 1 -- 172.21.15.81:0/2569875566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 msgr2=0x5619ae606cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41189e0700 1 --2- 172.21.15.81:0/2569875566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 0x5619ae606cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41189e0700 1 -- 172.21.15.81:0/2569875566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619ae3d73b0 con 0x5619ae60c720 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f41189e0700 1 --2- 172.21.15.81:0/2569875566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae606350 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f4110015000 tx=0x7f4110005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1895c6af3ff7981a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f40ff7fe700 1 -- 172.21.15.81:0/2569875566 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411001d040 con 0x5619ae60c720 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f40ff7fe700 1 -- 172.21.15.81:0/2569875566 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f411000b9d0 con 0x5619ae60c720 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.530+0000 7f40ff7fe700 1 -- 172.21.15.81:0/2569875566 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110003d30 con 0x5619ae60c720 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.531+0000 7f41275ffb80 1 -- 172.21.15.81:0/2569875566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 msgr2=0x5619ae606350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.531+0000 7f41275ffb80 1 --2- 172.21.15.81:0/2569875566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae606350 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f4110015000 tx=0x7f4110005c00 comp rx=0 tx=0).stop 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.531+0000 7f41275ffb80 1 -- 172.21.15.81:0/2569875566 shutdown_connections 2024-05-09T00:09:38.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.531+0000 7f41275ffb80 1 --2- 172.21.15.81:0/2569875566 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 0x5619ae606cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.531+0000 7f41275ffb80 1 --2- 172.21.15.81:0/2569875566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae60be00 0x5619ae60c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.531+0000 7f41275ffb80 1 --2- 172.21.15.81:0/2569875566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae606350 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.531+0000 7f41275ffb80 1 -- 172.21.15.81:0/2569875566 >> 172.21.15.81:0/2569875566 conn(0x5619ae564210 msgr2=0x5619ae600df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.531+0000 7f41275ffb80 1 -- 172.21.15.81:0/2569875566 shutdown_connections 2024-05-09T00:09:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.531+0000 7f41275ffb80 1 -- 172.21.15.81:0/2569875566 wait complete. 2024-05-09T00:09:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.531+0000 7f41275ffb80 1 -- start start 2024-05-09T00:09:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41275ffb80 1 Processor -- start 2024-05-09T00:09:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41275ffb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 0x5619ae60fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41275ffb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60be00 0x5619ae610110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41275ffb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae60c720 0x5619ae610650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41275ffb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619ae4f2560 con 0x5619ae60be00 2024-05-09T00:09:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41275ffb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619ae4f2200 con 0x5619ae606890 2024-05-09T00:09:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41275ffb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619ae3d96a0 con 0x5619ae60c720 2024-05-09T00:09:38.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41275ffb80 10 client.0 _ll_register_callbacks cb 0x5619ae4fbb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41189e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60be00 0x5619ae610110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41189e0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60be00 0x5619ae610110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38742/0 (socket says 172.21.15.81:38742) 2024-05-09T00:09:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41189e0700 1 -- 172.21.15.81:0/1582512560 learned_addr learned my addr 172.21.15.81:0/1582512560 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41191e1700 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 0x5619ae60fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41199e2700 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae60c720 0x5619ae610650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41189e0700 1 -- 172.21.15.81:0/1582512560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae60c720 msgr2=0x5619ae610650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41189e0700 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae60c720 0x5619ae610650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41189e0700 1 -- 172.21.15.81:0/1582512560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 msgr2=0x5619ae60fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41189e0700 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 0x5619ae60fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.532+0000 7f41189e0700 1 -- 172.21.15.81:0/1582512560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411410e750 con 0x5619ae60be00 2024-05-09T00:09:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f41191e1700 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 0x5619ae60fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f41199e2700 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae60c720 0x5619ae610650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f41189e0700 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60be00 0x5619ae610110 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f4110009ce0 tx=0x7f4110022860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb72dfbf37dfe39 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:38.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f40fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f40fcff9700 1 -- 172.21.15.81:0/1582512560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411002f070 con 0x5619ae60be00 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f40fcff9700 1 -- 172.21.15.81:0/1582512560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f411000b7d0 con 0x5619ae60be00 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f41275ffb80 1 -- 172.21.15.81:0/1582512560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5619ae4af270 con 0x5619ae60be00 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f40fcff9700 1 -- 172.21.15.81:0/1582512560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f411001d040 con 0x5619ae60be00 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f41275ffb80 10 client.17385 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f41275ffb80 1 -- 172.21.15.81:0/1582512560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5619ae383b60 con 0x5619ae60be00 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f40fcff9700 1 -- 172.21.15.81:0/1582512560 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5619ae4af270 con 0x5619ae60be00 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f40fcff9700 1 -- 172.21.15.81:0/1582512560 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f41100039d0 con 0x5619ae60be00 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f41275ffb80 10 client.17385 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f41275ffb80 10 client.17385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f41275ffb80 20 client.17385 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f41275ffb80 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5619ae61fdc0 0x5619ae6221b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f41275ffb80 4 client.17385 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.533+0000 7f41275ffb80 1 -- 172.21.15.81:0/1582512560 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5619ae5d5810 con 0x5619ae61fdc0 2024-05-09T00:09:38.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.534+0000 7f41191e1700 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5619ae61fdc0 0x5619ae6221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.534+0000 7f41191e1700 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5619ae61fdc0 0x5619ae6221b0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a25e8ac9505bacd7 server_cookie=87cfced998ed6e39 in_seq=0 out_seq=0 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.534+0000 7f40fcff9700 10 client.17385 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f40fcff9700 1 -- 172.21.15.81:0/1582512560 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5619ae5d5810 con 0x5619ae61fdc0 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f40fcff9700 10 client.17385 handle_command_reply: tid=0 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f41275ffb80 1 client.17385 shutdown 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f41275ffb80 1 -- 172.21.15.81:0/1582512560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60be00 msgr2=0x5619ae610110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f41275ffb80 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60be00 0x5619ae610110 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f4110009ce0 tx=0x7f4110022860 comp rx=0 tx=0).stop 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f41275ffb80 1 -- 172.21.15.81:0/1582512560 shutdown_connections 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f41275ffb80 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5619ae61fdc0 0x5619ae6221b0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f41275ffb80 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 0x5619ae60fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f41275ffb80 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae60c720 0x5619ae610650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f41275ffb80 1 --2- 172.21.15.81:0/1582512560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60be00 0x5619ae610110 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f41275ffb80 1 -- 172.21.15.81:0/1582512560 >> 172.21.15.81:0/1582512560 conn(0x5619ae564210 msgr2=0x5619ae6005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f40fcff9700 0 client.17385 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:38.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f41275ffb80 1 -- 172.21.15.81:0/1582512560 shutdown_connections 2024-05-09T00:09:38.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f41275ffb80 1 -- 172.21.15.81:0/1582512560 wait complete. 2024-05-09T00:09:38.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.535+0000 7f41275ffb80 20 client.17385 trim_cache size 0 max 16384 2024-05-09T00:09:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41275ffb80 1 Processor -- start 2024-05-09T00:09:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41275ffb80 1 -- start start 2024-05-09T00:09:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41275ffb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 0x5619ae60b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41275ffb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae60be00 0x5619ae600d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41275ffb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae60e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41275ffb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619ae4af270 con 0x5619ae60c720 2024-05-09T00:09:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41275ffb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619ae602090 con 0x5619ae606890 2024-05-09T00:09:38.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41275ffb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619ae602800 con 0x5619ae60be00 2024-05-09T00:09:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41199e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae60e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41199e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae60e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38758/0 (socket says 172.21.15.81:38758) 2024-05-09T00:09:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41199e2700 1 -- 172.21.15.81:0/1046360546 learned_addr learned my addr 172.21.15.81:0/1046360546 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41199e2700 1 -- 172.21.15.81:0/1046360546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae60be00 msgr2=0x5619ae600d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41191e1700 1 --2- 172.21.15.81:0/1046360546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 0x5619ae60b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41199e2700 1 --2- 172.21.15.81:0/1046360546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae60be00 0x5619ae600d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41199e2700 1 -- 172.21.15.81:0/1046360546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 msgr2=0x5619ae60b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41199e2700 1 --2- 172.21.15.81:0/1046360546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 0x5619ae60b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41199e2700 1 -- 172.21.15.81:0/1046360546 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619ae51c560 con 0x5619ae60c720 2024-05-09T00:09:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.552+0000 7f41191e1700 1 --2- 172.21.15.81:0/1046360546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 0x5619ae60b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.553+0000 7f41199e2700 1 --2- 172.21.15.81:0/1046360546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae60e4c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f410c096b40 tx=0x7f410c012ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698ef9aa2d17dda9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.553+0000 7f40fffff700 1 -- 172.21.15.81:0/1046360546 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c007aa0 con 0x5619ae60c720 2024-05-09T00:09:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.553+0000 7f40fffff700 1 -- 172.21.15.81:0/1046360546 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f410c09d070 con 0x5619ae60c720 2024-05-09T00:09:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.553+0000 7f40fffff700 1 -- 172.21.15.81:0/1046360546 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c09a330 con 0x5619ae60c720 2024-05-09T00:09:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.553+0000 7f41275ffb80 1 -- 172.21.15.81:0/1046360546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 msgr2=0x5619ae60e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.553+0000 7f41275ffb80 1 --2- 172.21.15.81:0/1046360546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae60e4c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f410c096b40 tx=0x7f410c012ad0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.553+0000 7f41275ffb80 1 -- 172.21.15.81:0/1046360546 shutdown_connections 2024-05-09T00:09:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.553+0000 7f41275ffb80 1 --2- 172.21.15.81:0/1046360546 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae606890 0x5619ae60b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.553+0000 7f41275ffb80 1 --2- 172.21.15.81:0/1046360546 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae60e4c0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.553+0000 7f41275ffb80 1 --2- 172.21.15.81:0/1046360546 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae60be00 0x5619ae600d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.553+0000 7f41275ffb80 1 -- 172.21.15.81:0/1046360546 >> 172.21.15.81:0/1046360546 conn(0x5619ae564210 msgr2=0x5619ae60acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.553+0000 7f41275ffb80 1 -- 172.21.15.81:0/1046360546 shutdown_connections 2024-05-09T00:09:38.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.553+0000 7f41275ffb80 1 -- 172.21.15.81:0/1046360546 wait complete. 2024-05-09T00:09:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.554+0000 7f41275ffb80 1 -- start start 2024-05-09T00:09:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.554+0000 7f41275ffb80 1 Processor -- start 2024-05-09T00:09:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.554+0000 7f41275ffb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae606890 0x5619ae617340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.554+0000 7f41275ffb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae60be00 0x5619ae615780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.554+0000 7f41275ffb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae615cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.554+0000 7f41275ffb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619ae616240 con 0x5619ae60c720 2024-05-09T00:09:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.554+0000 7f41275ffb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619ae616380 con 0x5619ae60be00 2024-05-09T00:09:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.554+0000 7f41275ffb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619ae616540 con 0x5619ae606890 2024-05-09T00:09:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.554+0000 7f41275ffb80 10 client.0 _ll_register_callbacks cb 0x5619ae4fbb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.554+0000 7f41199e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae615cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.554+0000 7f41199e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae615cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38760/0 (socket says 172.21.15.81:38760) 2024-05-09T00:09:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.554+0000 7f41199e2700 1 -- 172.21.15.81:0/4206639046 learned_addr learned my addr 172.21.15.81:0/4206639046 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.554+0000 7f41191e1700 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae606890 0x5619ae617340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41189e0700 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae60be00 0x5619ae615780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41199e2700 1 -- 172.21.15.81:0/4206639046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae606890 msgr2=0x5619ae617340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41199e2700 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae606890 0x5619ae617340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41199e2700 1 -- 172.21.15.81:0/4206639046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae60be00 msgr2=0x5619ae615780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41199e2700 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae60be00 0x5619ae615780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41199e2700 1 -- 172.21.15.81:0/4206639046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41141a6240 con 0x5619ae60c720 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41191e1700 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae606890 0x5619ae617340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41189e0700 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae60be00 0x5619ae615780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41199e2700 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae615cc0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f410c0a2020 tx=0x7f410c0a2600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8777e17d810cbd47 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f40fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f40fcff9700 1 -- 172.21.15.81:0/4206639046 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410c09a0d0 con 0x5619ae60c720 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f40fcff9700 1 -- 172.21.15.81:0/4206639046 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f410c0995c0 con 0x5619ae60c720 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41275ffb80 1 -- 172.21.15.81:0/4206639046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f411000b9d0 con 0x5619ae60c720 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f40fcff9700 1 -- 172.21.15.81:0/4206639046 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f410c0997a0 con 0x5619ae60c720 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41275ffb80 10 client.17391 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:38.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41275ffb80 1 -- 172.21.15.81:0/4206639046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5619ae3dbcd0 con 0x5619ae60c720 2024-05-09T00:09:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f40fcff9700 1 -- 172.21.15.81:0/4206639046 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f411000b9d0 con 0x5619ae60c720 2024-05-09T00:09:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f40fcff9700 1 -- 172.21.15.81:0/4206639046 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f410c0a21c0 con 0x5619ae60c720 2024-05-09T00:09:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41275ffb80 10 client.17391 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41275ffb80 10 client.17391 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41275ffb80 20 client.17391 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41275ffb80 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5619ae6773c0 0x5619ae6797e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41275ffb80 4 client.17391 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:09:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.555+0000 7f41275ffb80 1 -- 172.21.15.81:0/4206639046 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5619ae54eec0 con 0x5619ae6773c0 2024-05-09T00:09:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f41191e1700 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5619ae6773c0 0x5619ae6797e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:38.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f40fcff9700 10 client.17391 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f41191e1700 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5619ae6773c0 0x5619ae6797e0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=faa04a44f85a9a29 server_cookie=590f2d5f829c5e0e in_seq=0 out_seq=0 2024-05-09T00:09:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f40fcff9700 1 -- 172.21.15.81:0/4206639046 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5619ae54eec0 con 0x5619ae6773c0 2024-05-09T00:09:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f40fcff9700 10 client.17391 handle_command_reply: tid=0 2024-05-09T00:09:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f41275ffb80 1 client.17391 shutdown 2024-05-09T00:09:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f41275ffb80 1 -- 172.21.15.81:0/4206639046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 msgr2=0x5619ae615cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f41275ffb80 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae615cc0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f410c0a2020 tx=0x7f410c0a2600 comp rx=0 tx=0).stop 2024-05-09T00:09:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f41275ffb80 1 -- 172.21.15.81:0/4206639046 shutdown_connections 2024-05-09T00:09:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f41275ffb80 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5619ae6773c0 0x5619ae6797e0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f41275ffb80 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5619ae60c720 0x5619ae615cc0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f41275ffb80 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5619ae606890 0x5619ae617340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f40fcff9700 0 client.17391 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f41275ffb80 1 --2- 172.21.15.81:0/4206639046 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5619ae60be00 0x5619ae615780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f41275ffb80 1 -- 172.21.15.81:0/4206639046 >> 172.21.15.81:0/4206639046 conn(0x5619ae564210 msgr2=0x5619ae60e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:38.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f41275ffb80 1 -- 172.21.15.81:0/4206639046 shutdown_connections 2024-05-09T00:09:38.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.556+0000 7f41275ffb80 1 -- 172.21.15.81:0/4206639046 wait complete. 2024-05-09T00:09:38.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.557+0000 7f41275ffb80 20 client.17391 trim_cache size 0 max 16384 2024-05-09T00:09:38.563 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:09:38.563 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:09:38.563 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:09:38.563 INFO:teuthology.orchestra.run.smithi081.stdout: "30d02e7e-5e6b-4fe5-a8ef-eaba6ae6fb64": { 2024-05-09T00:09:38.563 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:09:38.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "30d02e7e-5e6b-4fe5-a8ef-eaba6ae6fb64", 2024-05-09T00:09:38.563 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:09:38.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:09:38.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:09:38.564 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:09:38.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.557+0000 7f411b445700 1 -- 172.21.15.81:0/2153538758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f41000a1290 msgr2=0x7f41000a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.557+0000 7f411b445700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f41000a1290 0x7f41000a3750 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4104005950 tx=0x7f410400a300 comp rx=0 tx=0).stop 2024-05-09T00:09:38.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.557+0000 7f411b445700 1 -- 172.21.15.81:0/2153538758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4114105ef0 msgr2=0x7f4114101070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:38.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.557+0000 7f411b445700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4114105ef0 0x7f4114101070 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f410c007d70 tx=0x7f410c00a340 comp rx=0 tx=0).stop 2024-05-09T00:09:38.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.557+0000 7f411b445700 1 -- 172.21.15.81:0/2153538758 shutdown_connections 2024-05-09T00:09:38.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.557+0000 7f411b445700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f41000a1290 0x7f41000a3750 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.557+0000 7f411b445700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f41140ff410 0x7f41141005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.557+0000 7f411b445700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4114105ef0 0x7f4114101070 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.557+0000 7f411b445700 1 --2- 172.21.15.81:0/2153538758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f41140ffdd0 0x7f4114100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:38.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.557+0000 7f411b445700 1 -- 172.21.15.81:0/2153538758 >> 172.21.15.81:0/2153538758 conn(0x7f41140763a0 msgr2=0x7f4114103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:38.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.557+0000 7f411b445700 1 -- 172.21.15.81:0/2153538758 shutdown_connections 2024-05-09T00:09:38.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:09:38.557+0000 7f411b445700 1 -- 172.21.15.81:0/2153538758 wait complete. 2024-05-09T00:09:38.566 INFO:tasks.cephfs.filesystem:scrub status for tag:30d02e7e-5e6b-4fe5-a8ef-eaba6ae6fb64 - {'path': '/', 'tag': '30d02e7e-5e6b-4fe5-a8ef-eaba6ae6fb64', 'options': 'recursive,force'} 2024-05-09T00:09:39.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:38 smithi081 ceph-mon[42474]: pgmap v203: 97 pgs: 97 active+clean; 1.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-05-09T00:09:39.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:38 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:09:39.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:38 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:09:39.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:38 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:09:39.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:38 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:09:39.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:38 smithi150 ceph-mon[46187]: pgmap v203: 97 pgs: 97 active+clean; 1.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-05-09T00:09:39.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:38 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:09:39.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:38 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:09:39.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:38 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:09:39.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:38 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:09:39.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:38 smithi171 ceph-mon[47351]: pgmap v203: 97 pgs: 97 active+clean; 1.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-05-09T00:09:39.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:38 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:09:39.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:38 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:09:39.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:38 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:09:39.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:38 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:09:40.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:39 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:09:40.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:39 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:09:40.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:39 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:09:41.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:40 smithi150 ceph-mon[46187]: pgmap v204: 97 pgs: 97 active+clean; 1.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-05-09T00:09:41.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:40 smithi171 ceph-mon[47351]: pgmap v204: 97 pgs: 97 active+clean; 1.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-05-09T00:09:41.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:40 smithi081 ceph-mon[42474]: pgmap v204: 97 pgs: 97 active+clean; 1.9 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-05-09T00:09:43.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:42 smithi150 ceph-mon[46187]: pgmap v205: 97 pgs: 97 active+clean; 2.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-05-09T00:09:43.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:42 smithi171 ceph-mon[47351]: pgmap v205: 97 pgs: 97 active+clean; 2.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-05-09T00:09:43.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:42 smithi081 ceph-mon[42474]: pgmap v205: 97 pgs: 97 active+clean; 2.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 57 KiB/s wr, 19 op/s 2024-05-09T00:09:45.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:44 smithi150 ceph-mon[46187]: pgmap v206: 97 pgs: 97 active+clean; 2.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 14 op/s 2024-05-09T00:09:45.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:44 smithi171 ceph-mon[47351]: pgmap v206: 97 pgs: 97 active+clean; 2.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 14 op/s 2024-05-09T00:09:45.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:44 smithi081 ceph-mon[42474]: pgmap v206: 97 pgs: 97 active+clean; 2.1 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 14 op/s 2024-05-09T00:09:46.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.758+0000 7f2966563700 1 -- 172.21.15.81:0/2504507589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2960100760 msgr2=0x7f296010cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.758+0000 7f2966563700 1 --2- 172.21.15.81:0/2504507589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2960100760 0x7f296010cc00 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f295800b0a0 tx=0x7f295800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.758+0000 7f2966563700 1 -- 172.21.15.81:0/2504507589 shutdown_connections 2024-05-09T00:09:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.758+0000 7f2966563700 1 --2- 172.21.15.81:0/2504507589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2960100760 0x7f296010cc00 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.758+0000 7f2966563700 1 --2- 172.21.15.81:0/2504507589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2960105e60 0x7f2960106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.758+0000 7f2966563700 1 --2- 172.21.15.81:0/2504507589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29600ffda0 0x7f2960100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.758+0000 7f2966563700 1 -- 172.21.15.81:0/2504507589 >> 172.21.15.81:0/2504507589 conn(0x7f2960076f10 msgr2=0x7f2960077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.758+0000 7f2966563700 1 -- 172.21.15.81:0/2504507589 shutdown_connections 2024-05-09T00:09:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.758+0000 7f2966563700 1 -- 172.21.15.81:0/2504507589 wait complete. 2024-05-09T00:09:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.759+0000 7f2966563700 1 Processor -- start 2024-05-09T00:09:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.759+0000 7f2966563700 1 -- start start 2024-05-09T00:09:46.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.759+0000 7f2966563700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29600ffda0 0x7f29601973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.759+0000 7f2966563700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2960100760 0x7f2960197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.759+0000 7f2966563700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2960105e60 0x7f296019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.759+0000 7f2966563700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296019c2f0 con 0x7f2960105e60 2024-05-09T00:09:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.759+0000 7f2966563700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296019c460 con 0x7f29600ffda0 2024-05-09T00:09:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.759+0000 7f2966563700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296019c620 con 0x7f2960100760 2024-05-09T00:09:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.759+0000 7f2964b00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2960105e60 0x7f296019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f2964b00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2960105e60 0x7f296019bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38772/0 (socket says 172.21.15.81:38772) 2024-05-09T00:09:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f2964b00700 1 -- 172.21.15.81:0/842180869 learned_addr learned my addr 172.21.15.81:0/842180869 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f295f7fe700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2960100760 0x7f2960197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f295ffff700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29600ffda0 0x7f29601973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f2964b00700 1 -- 172.21.15.81:0/842180869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2960100760 msgr2=0x7f2960197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f2964b00700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2960100760 0x7f2960197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f2964b00700 1 -- 172.21.15.81:0/842180869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29600ffda0 msgr2=0x7f29601973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f2964b00700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29600ffda0 0x7f29601973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f2964b00700 1 -- 172.21.15.81:0/842180869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2958009d00 con 0x7f2960105e60 2024-05-09T00:09:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f295f7fe700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2960100760 0x7f2960197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f2964b00700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2960105e60 0x7f296019bcb0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f295800b070 tx=0x7f2958007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f295d7fa700 1 -- 172.21.15.81:0/842180869 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295800e040 con 0x7f2960105e60 2024-05-09T00:09:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f295d7fa700 1 -- 172.21.15.81:0/842180869 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2958009440 con 0x7f2960105e60 2024-05-09T00:09:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f2966563700 1 -- 172.21.15.81:0/842180869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296019c8a0 con 0x7f2960105e60 2024-05-09T00:09:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f295d7fa700 1 -- 172.21.15.81:0/842180869 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295801b6b0 con 0x7f2960105e60 2024-05-09T00:09:46.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.760+0000 7f2966563700 1 -- 172.21.15.81:0/842180869 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29601a4140 con 0x7f2960105e60 2024-05-09T00:09:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.762+0000 7f295d7fa700 1 -- 172.21.15.81:0/842180869 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f295801d480 con 0x7f2960105e60 2024-05-09T00:09:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.763+0000 7f295d7fa700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f29480a1290 0x7f29480a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.763+0000 7f295d7fa700 1 -- 172.21.15.81:0/842180869 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f29580ce2a0 con 0x7f2960105e60 2024-05-09T00:09:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.763+0000 7f295ffff700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f29480a1290 0x7f29480a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.763+0000 7f295ffff700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f29480a1290 0x7f29480a3750 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2950005fd0 tx=0x7f295000a560 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.764+0000 7f297271db80 1 Processor -- start 2024-05-09T00:09:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.764+0000 7f297271db80 1 -- start start 2024-05-09T00:09:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.764+0000 7f297271db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17a9fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.764+0000 7f297271db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17aa0270 0x55bc17a99f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.764+0000 7f297271db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 0x55bc17a9a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.767 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.764+0000 7f297271db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc179f10f0 con 0x55bc17a9f950 2024-05-09T00:09:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.764+0000 7f297271db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc179eeab0 con 0x55bc17a9a480 2024-05-09T00:09:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.764+0000 7f297271db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc179ea3a0 con 0x55bc17aa0270 2024-05-09T00:09:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.764+0000 7f295ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17a9fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.764+0000 7f295ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17a9fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38788/0 (socket says 172.21.15.81:38788) 2024-05-09T00:09:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.764+0000 7f295ffff700 1 -- 172.21.15.81:0/2724111353 learned_addr learned my addr 172.21.15.81:0/2724111353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.765+0000 7f295ffff700 1 -- 172.21.15.81:0/2724111353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17aa0270 msgr2=0x55bc17a99f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.765+0000 7f295ffff700 1 --2- 172.21.15.81:0/2724111353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17aa0270 0x55bc17a99f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.765+0000 7f295ffff700 1 -- 172.21.15.81:0/2724111353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 msgr2=0x55bc17a9a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.765+0000 7f2964b00700 1 --2- 172.21.15.81:0/2724111353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 0x55bc17a9a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.765+0000 7f295ffff700 1 --2- 172.21.15.81:0/2724111353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 0x55bc17a9a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.765+0000 7f295ffff700 1 -- 172.21.15.81:0/2724111353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc1786b350 con 0x55bc17a9f950 2024-05-09T00:09:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.765+0000 7f295ffff700 1 --2- 172.21.15.81:0/2724111353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17a9fd30 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f295000ec80 tx=0x7f2950011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c91f13d28a23d123 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.765+0000 7f29467fc700 1 -- 172.21.15.81:0/2724111353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2950010cd0 con 0x55bc17a9f950 2024-05-09T00:09:46.768 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.765+0000 7f29467fc700 1 -- 172.21.15.81:0/2724111353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2950010e30 con 0x55bc17a9f950 2024-05-09T00:09:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.765+0000 7f29467fc700 1 -- 172.21.15.81:0/2724111353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295000f7e0 con 0x55bc17a9f950 2024-05-09T00:09:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.766+0000 7f297271db80 1 -- 172.21.15.81:0/2724111353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 msgr2=0x55bc17a9fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.766+0000 7f297271db80 1 --2- 172.21.15.81:0/2724111353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17a9fd30 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f295000ec80 tx=0x7f2950011000 comp rx=0 tx=0).stop 2024-05-09T00:09:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.766+0000 7f297271db80 1 -- 172.21.15.81:0/2724111353 shutdown_connections 2024-05-09T00:09:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.766+0000 7f297271db80 1 --2- 172.21.15.81:0/2724111353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 0x55bc17a9a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.766+0000 7f297271db80 1 --2- 172.21.15.81:0/2724111353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17a9fd30 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.766+0000 7f297271db80 1 --2- 172.21.15.81:0/2724111353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17aa0270 0x55bc17a99f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.766+0000 7f297271db80 1 -- 172.21.15.81:0/2724111353 >> 172.21.15.81:0/2724111353 conn(0x55bc179f81b0 msgr2=0x55bc17a94840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.766+0000 7f297271db80 1 -- 172.21.15.81:0/2724111353 shutdown_connections 2024-05-09T00:09:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.766+0000 7f297271db80 1 -- 172.21.15.81:0/2724111353 wait complete. 2024-05-09T00:09:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.766+0000 7f297271db80 1 -- start start 2024-05-09T00:09:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.766+0000 7f297271db80 1 Processor -- start 2024-05-09T00:09:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f297271db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 0x55bc17aada80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.769 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f297271db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17a9f950 0x55bc17aadfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f297271db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17aa0270 0x55bc17aa7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f297271db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc17986500 con 0x55bc17aa0270 2024-05-09T00:09:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f297271db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc179861a0 con 0x55bc17a9a480 2024-05-09T00:09:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f297271db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1786d640 con 0x55bc17a9f950 2024-05-09T00:09:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f297271db80 10 client.0 _ll_register_callbacks cb 0x55bc1798fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f2964b00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17aa0270 0x55bc17aa7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f295ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 0x55bc17aada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f2964b00700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17aa0270 0x55bc17aa7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38798/0 (socket says 172.21.15.81:38798) 2024-05-09T00:09:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f2964b00700 1 -- 172.21.15.81:0/2196144926 learned_addr learned my addr 172.21.15.81:0/2196144926 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f295f7fe700 1 --2- 172.21.15.81:0/2196144926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17a9f950 0x55bc17aadfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f2964b00700 1 -- 172.21.15.81:0/2196144926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17a9f950 msgr2=0x55bc17aadfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f2964b00700 1 --2- 172.21.15.81:0/2196144926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17a9f950 0x55bc17aadfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f2964b00700 1 -- 172.21.15.81:0/2196144926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 msgr2=0x55bc17aada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f2964b00700 1 --2- 172.21.15.81:0/2196144926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 0x55bc17aada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f2964b00700 1 -- 172.21.15.81:0/2196144926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295000e930 con 0x55bc17aa0270 2024-05-09T00:09:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f2964b00700 1 --2- 172.21.15.81:0/2196144926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17aa0270 0x55bc17aa7d80 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f295800b830 tx=0x7f295809ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebce6996c9edb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.767+0000 7f293f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f293f7fe700 1 -- 172.21.15.81:0/2196144926 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295801d930 con 0x55bc17aa0270 2024-05-09T00:09:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f293f7fe700 1 -- 172.21.15.81:0/2196144926 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f29580a1070 con 0x55bc17aa0270 2024-05-09T00:09:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f297271db80 1 -- 172.21.15.81:0/2196144926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc17943210 con 0x55bc17aa0270 2024-05-09T00:09:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f293f7fe700 1 -- 172.21.15.81:0/2196144926 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2958004c60 con 0x55bc17aa0270 2024-05-09T00:09:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f297271db80 10 client.17403 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f297271db80 1 -- 172.21.15.81:0/2196144926 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bc17817b00 con 0x55bc17aa0270 2024-05-09T00:09:46.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f293f7fe700 1 -- 172.21.15.81:0/2196144926 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bc17943210 con 0x55bc17aa0270 2024-05-09T00:09:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f293f7fe700 1 -- 172.21.15.81:0/2196144926 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f295809b6a0 con 0x55bc17aa0270 2024-05-09T00:09:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f297271db80 10 client.17403 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f297271db80 10 client.17403 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f297271db80 20 client.17403 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f297271db80 1 --2- 172.21.15.81:0/2196144926 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bc17ab7dc0 0x55bc17aba1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f297271db80 4 client.17403 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f297271db80 1 -- 172.21.15.81:0/2196144926 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc17a697b0 con 0x55bc17ab7dc0 2024-05-09T00:09:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.768+0000 7f295ffff700 1 --2- 172.21.15.81:0/2196144926 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bc17ab7dc0 0x55bc17aba1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.769+0000 7f295ffff700 1 --2- 172.21.15.81:0/2196144926 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bc17ab7dc0 0x55bc17aba1b0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c4394e920bd9b2d server_cookie=b458a79fff6a1a6e in_seq=0 out_seq=0 2024-05-09T00:09:46.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.769+0000 7f293f7fe700 10 client.17403 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.769+0000 7f293f7fe700 1 -- 172.21.15.81:0/2196144926 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bc17a697b0 con 0x55bc17ab7dc0 2024-05-09T00:09:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.769+0000 7f293f7fe700 10 client.17403 handle_command_reply: tid=0 2024-05-09T00:09:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.769+0000 7f297271db80 1 client.17403 shutdown 2024-05-09T00:09:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.770+0000 7f297271db80 1 -- 172.21.15.81:0/2196144926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17aa0270 msgr2=0x55bc17aa7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.770+0000 7f297271db80 1 --2- 172.21.15.81:0/2196144926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17aa0270 0x55bc17aa7d80 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f295800b830 tx=0x7f295809ada0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.770+0000 7f297271db80 1 -- 172.21.15.81:0/2196144926 shutdown_connections 2024-05-09T00:09:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.770+0000 7f297271db80 1 --2- 172.21.15.81:0/2196144926 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bc17ab7dc0 0x55bc17aba1b0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.773 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.770+0000 7f297271db80 1 --2- 172.21.15.81:0/2196144926 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 0x55bc17aada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.770+0000 7f293f7fe700 0 client.17403 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.770+0000 7f297271db80 1 --2- 172.21.15.81:0/2196144926 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17aa0270 0x55bc17aa7d80 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.770+0000 7f297271db80 1 --2- 172.21.15.81:0/2196144926 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17a9f950 0x55bc17aadfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.770+0000 7f297271db80 1 -- 172.21.15.81:0/2196144926 >> 172.21.15.81:0/2196144926 conn(0x55bc179f81b0 msgr2=0x55bc17a98f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.770+0000 7f297271db80 1 -- 172.21.15.81:0/2196144926 shutdown_connections 2024-05-09T00:09:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.770+0000 7f297271db80 1 -- 172.21.15.81:0/2196144926 wait complete. 2024-05-09T00:09:46.774 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.770+0000 7f297271db80 20 client.17403 trim_cache size 0 max 16384 2024-05-09T00:09:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f297271db80 1 Processor -- start 2024-05-09T00:09:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f297271db80 1 -- start start 2024-05-09T00:09:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f297271db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17a9a480 0x55bc17a9eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f297271db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17a99940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f297271db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17aa0270 0x55bc17aa5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f297271db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc17a919f0 con 0x55bc17a9f950 2024-05-09T00:09:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f297271db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc17a8f360 con 0x55bc17aa0270 2024-05-09T00:09:46.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f297271db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc17aa93a0 con 0x55bc17a9a480 2024-05-09T00:09:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f295f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17a99940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f295f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17a99940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38806/0 (socket says 172.21.15.81:38806) 2024-05-09T00:09:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f295f7fe700 1 -- 172.21.15.81:0/2427518616 learned_addr learned my addr 172.21.15.81:0/2427518616 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f295ffff700 1 --2- 172.21.15.81:0/2427518616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17a9a480 0x55bc17a9eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f2964b00700 1 --2- 172.21.15.81:0/2427518616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17aa0270 0x55bc17aa5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f295f7fe700 1 -- 172.21.15.81:0/2427518616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17a9a480 msgr2=0x55bc17a9eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f295f7fe700 1 --2- 172.21.15.81:0/2427518616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17a9a480 0x55bc17a9eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f295f7fe700 1 -- 172.21.15.81:0/2427518616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17aa0270 msgr2=0x55bc17aa5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f295f7fe700 1 --2- 172.21.15.81:0/2427518616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17aa0270 0x55bc17aa5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f295f7fe700 1 -- 172.21.15.81:0/2427518616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc179b0500 con 0x55bc17a9f950 2024-05-09T00:09:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f295f7fe700 1 --2- 172.21.15.81:0/2427518616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17a99940 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f2954003a50 tx=0x7f2954003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af8578ea0983c20 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f2946ffd700 1 -- 172.21.15.81:0/2427518616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954011ad0 con 0x55bc17a9f950 2024-05-09T00:09:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.785+0000 7f2946ffd700 1 -- 172.21.15.81:0/2427518616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2954016070 con 0x55bc17a9f950 2024-05-09T00:09:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.786+0000 7f2946ffd700 1 -- 172.21.15.81:0/2427518616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295401a3d0 con 0x55bc17a9f950 2024-05-09T00:09:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.786+0000 7f297271db80 1 -- 172.21.15.81:0/2427518616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 msgr2=0x55bc17a99940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.786+0000 7f297271db80 1 --2- 172.21.15.81:0/2427518616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17a99940 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f2954003a50 tx=0x7f2954003d60 comp rx=0 tx=0).stop 2024-05-09T00:09:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.786+0000 7f297271db80 1 -- 172.21.15.81:0/2427518616 shutdown_connections 2024-05-09T00:09:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.786+0000 7f297271db80 1 --2- 172.21.15.81:0/2427518616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17aa0270 0x55bc17aa5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.786+0000 7f297271db80 1 --2- 172.21.15.81:0/2427518616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17a9a480 0x55bc17a9eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.786+0000 7f297271db80 1 --2- 172.21.15.81:0/2427518616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17a99940 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.786+0000 7f297271db80 1 -- 172.21.15.81:0/2427518616 >> 172.21.15.81:0/2427518616 conn(0x55bc179f81b0 msgr2=0x55bc17a98f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.786+0000 7f297271db80 1 -- 172.21.15.81:0/2427518616 shutdown_connections 2024-05-09T00:09:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.786+0000 7f297271db80 1 -- 172.21.15.81:0/2427518616 wait complete. 2024-05-09T00:09:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.786+0000 7f297271db80 1 -- start start 2024-05-09T00:09:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f297271db80 1 Processor -- start 2024-05-09T00:09:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f297271db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 0x55bc17ab07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f297271db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17ab0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f297271db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17aa0270 0x55bc17ab1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f297271db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc17b0d340 con 0x55bc17a9f950 2024-05-09T00:09:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f297271db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc17b0d4b0 con 0x55bc17a9a480 2024-05-09T00:09:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f297271db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc17b0d670 con 0x55bc17aa0270 2024-05-09T00:09:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f297271db80 10 client.0 _ll_register_callbacks cb 0x55bc1798fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f295f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17ab0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f295f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17ab0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38816/0 (socket says 172.21.15.81:38816) 2024-05-09T00:09:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f295f7fe700 1 -- 172.21.15.81:0/856087131 learned_addr learned my addr 172.21.15.81:0/856087131 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f2964b00700 1 --2- 172.21.15.81:0/856087131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17aa0270 0x55bc17ab1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f295ffff700 1 --2- 172.21.15.81:0/856087131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 0x55bc17ab07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f295f7fe700 1 -- 172.21.15.81:0/856087131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17aa0270 msgr2=0x55bc17ab1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f295f7fe700 1 --2- 172.21.15.81:0/856087131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17aa0270 0x55bc17ab1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f295f7fe700 1 -- 172.21.15.81:0/856087131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 msgr2=0x55bc17ab07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f295f7fe700 1 --2- 172.21.15.81:0/856087131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 0x55bc17ab07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f295f7fe700 1 -- 172.21.15.81:0/856087131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2954003680 con 0x55bc17a9f950 2024-05-09T00:09:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.787+0000 7f295ffff700 1 --2- 172.21.15.81:0/856087131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 0x55bc17ab07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f295f7fe700 1 --2- 172.21.15.81:0/856087131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17ab0d10 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f2954003a20 tx=0x7f2954013c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6de841199e9d9ea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f293f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f293f7fe700 1 -- 172.21.15.81:0/856087131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954012650 con 0x55bc17a9f950 2024-05-09T00:09:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f293f7fe700 1 -- 172.21.15.81:0/856087131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f29540127b0 con 0x55bc17a9f950 2024-05-09T00:09:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f297271db80 1 -- 172.21.15.81:0/856087131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2950010e30 con 0x55bc17a9f950 2024-05-09T00:09:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f293f7fe700 1 -- 172.21.15.81:0/856087131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29540118d0 con 0x55bc17a9f950 2024-05-09T00:09:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f297271db80 10 client.17409 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f297271db80 1 -- 172.21.15.81:0/856087131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55bc1786fc70 con 0x55bc17a9f950 2024-05-09T00:09:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f293f7fe700 1 -- 172.21.15.81:0/856087131 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2950010e30 con 0x55bc17a9f950 2024-05-09T00:09:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f293f7fe700 1 -- 172.21.15.81:0/856087131 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2954004750 con 0x55bc17a9f950 2024-05-09T00:09:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f297271db80 10 client.17409 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f297271db80 10 client.17409 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f297271db80 20 client.17409 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f297271db80 1 --2- 172.21.15.81:0/856087131 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bc17b0ed70 0x55bc17b11190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f297271db80 4 client.17409 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:09:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f297271db80 1 -- 172.21.15.81:0/856087131 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bc179e2e60 con 0x55bc17b0ed70 2024-05-09T00:09:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.788+0000 7f295ffff700 1 --2- 172.21.15.81:0/856087131 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bc17b0ed70 0x55bc17b11190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.789+0000 7f293f7fe700 10 client.17409 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.789+0000 7f295ffff700 1 --2- 172.21.15.81:0/856087131 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bc17b0ed70 0x55bc17b11190 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5af43e7bc694e7bd server_cookie=4e499205c6fe9ea3 in_seq=0 out_seq=0 2024-05-09T00:09:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.803+0000 7f293f7fe700 1 -- 172.21.15.81:0/856087131 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bc179e2e60 con 0x55bc17b0ed70 2024-05-09T00:09:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.803+0000 7f293f7fe700 10 client.17409 handle_command_reply: tid=0 2024-05-09T00:09:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.803+0000 7f297271db80 1 client.17409 shutdown 2024-05-09T00:09:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.803+0000 7f297271db80 1 -- 172.21.15.81:0/856087131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 msgr2=0x55bc17ab0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.803+0000 7f297271db80 1 --2- 172.21.15.81:0/856087131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17ab0d10 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f2954003a20 tx=0x7f2954013c30 comp rx=0 tx=0).stop 2024-05-09T00:09:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.803+0000 7f297271db80 1 -- 172.21.15.81:0/856087131 shutdown_connections 2024-05-09T00:09:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.803+0000 7f297271db80 1 --2- 172.21.15.81:0/856087131 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55bc17b0ed70 0x55bc17b11190 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.803+0000 7f297271db80 1 --2- 172.21.15.81:0/856087131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55bc17a9a480 0x55bc17ab07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.803+0000 7f297271db80 1 --2- 172.21.15.81:0/856087131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55bc17aa0270 0x55bc17ab1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.803+0000 7f293f7fe700 0 client.17409 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.803+0000 7f297271db80 1 --2- 172.21.15.81:0/856087131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55bc17a9f950 0x55bc17ab0d10 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.803+0000 7f297271db80 1 -- 172.21.15.81:0/856087131 >> 172.21.15.81:0/856087131 conn(0x55bc179f81b0 msgr2=0x55bc17a9ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f297271db80 1 -- 172.21.15.81:0/856087131 shutdown_connections 2024-05-09T00:09:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f297271db80 1 -- 172.21.15.81:0/856087131 wait complete. 2024-05-09T00:09:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f297271db80 20 client.17409 trim_cache size 0 max 16384 2024-05-09T00:09:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:09:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:09:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:09:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:09:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f2966563700 1 -- 172.21.15.81:0/842180869 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f29480a1290 msgr2=0x7f29480a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f2966563700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f29480a1290 0x7f29480a3750 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2950005fd0 tx=0x7f295000a560 comp rx=0 tx=0).stop 2024-05-09T00:09:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f2966563700 1 -- 172.21.15.81:0/842180869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2960105e60 msgr2=0x7f296019bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f2966563700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2960105e60 0x7f296019bcb0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f295800b070 tx=0x7f2958007920 comp rx=0 tx=0).stop 2024-05-09T00:09:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f2966563700 1 -- 172.21.15.81:0/842180869 shutdown_connections 2024-05-09T00:09:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f2966563700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f29480a1290 0x7f29480a3750 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f2966563700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f29600ffda0 0x7f29601973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f2966563700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2960105e60 0x7f296019bcb0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f2966563700 1 --2- 172.21.15.81:0/842180869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2960100760 0x7f2960197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f2966563700 1 -- 172.21.15.81:0/842180869 >> 172.21.15.81:0/842180869 conn(0x7f2960076f10 msgr2=0x7f2960068590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f2966563700 1 -- 172.21.15.81:0/842180869 shutdown_connections 2024-05-09T00:09:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:46.804+0000 7f2966563700 1 -- 172.21.15.81:0/842180869 wait complete. 2024-05-09T00:09:47.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:46 smithi150 ceph-mon[46187]: pgmap v207: 97 pgs: 97 active+clean; 2.3 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-05-09T00:09:47.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:46 smithi171 ceph-mon[47351]: pgmap v207: 97 pgs: 97 active+clean; 2.3 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-05-09T00:09:47.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:46 smithi081 ceph-mon[42474]: pgmap v207: 97 pgs: 97 active+clean; 2.3 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-05-09T00:09:49.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:48 smithi150 ceph-mon[46187]: pgmap v208: 97 pgs: 97 active+clean; 2.3 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-05-09T00:09:49.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:48 smithi171 ceph-mon[47351]: pgmap v208: 97 pgs: 97 active+clean; 2.3 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-05-09T00:09:49.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:48 smithi081 ceph-mon[42474]: pgmap v208: 97 pgs: 97 active+clean; 2.3 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-05-09T00:09:49.896 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.896 INFO:tasks.workunit.client.0.smithi081.stdout:251/600: open fd = 3 2024-05-09T00:09:49.896 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.896 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.896 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.897 INFO:tasks.workunit.client.0.smithi081.stdout:252/600: open fd = 3 2024-05-09T00:09:49.897 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.897 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.897 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.897 INFO:tasks.workunit.client.0.smithi081.stdout:253/600: open fd = 3 2024-05-09T00:09:49.897 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.897 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.897 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.897 INFO:tasks.workunit.client.0.smithi081.stdout:254/600: open fd = 3 2024-05-09T00:09:49.897 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.898 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.898 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.898 INFO:tasks.workunit.client.0.smithi081.stdout:255/600: open fd = 3 2024-05-09T00:09:49.898 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.898 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.898 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.898 INFO:tasks.workunit.client.0.smithi081.stdout:256/600: open fd = 3 2024-05-09T00:09:49.898 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.898 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.898 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.899 INFO:tasks.workunit.client.0.smithi081.stdout:257/600: open fd = 3 2024-05-09T00:09:49.899 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.899 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.899 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.899 INFO:tasks.workunit.client.0.smithi081.stdout:258/600: open fd = 3 2024-05-09T00:09:49.899 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.900 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.900 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.900 INFO:tasks.workunit.client.0.smithi081.stdout:259/600: open fd = 3 2024-05-09T00:09:49.900 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.900 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.900 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.900 INFO:tasks.workunit.client.0.smithi081.stdout:260/600: open fd = 3 2024-05-09T00:09:49.900 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.901 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.901 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.901 INFO:tasks.workunit.client.0.smithi081.stdout:261/600: open fd = 3 2024-05-09T00:09:49.901 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.901 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.901 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.901 INFO:tasks.workunit.client.0.smithi081.stdout:262/600: open fd = 3 2024-05-09T00:09:49.901 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.902 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.902 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.902 INFO:tasks.workunit.client.0.smithi081.stdout:263/600: open fd = 3 2024-05-09T00:09:49.902 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.902 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.902 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.902 INFO:tasks.workunit.client.0.smithi081.stdout:264/600: open fd = 3 2024-05-09T00:09:49.902 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.903 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.903 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.903 INFO:tasks.workunit.client.0.smithi081.stdout:265/600: open fd = 3 2024-05-09T00:09:49.903 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.903 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.903 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.903 INFO:tasks.workunit.client.0.smithi081.stdout:266/600: open fd = 3 2024-05-09T00:09:49.903 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.903 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.904 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.904 INFO:tasks.workunit.client.0.smithi081.stdout:267/600: open fd = 3 2024-05-09T00:09:49.904 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.904 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.904 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.904 INFO:tasks.workunit.client.0.smithi081.stdout:268/600: open fd = 3 2024-05-09T00:09:49.904 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.904 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.904 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.905 INFO:tasks.workunit.client.0.smithi081.stdout:269/600: open fd = 3 2024-05-09T00:09:49.905 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.905 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.905 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.905 INFO:tasks.workunit.client.0.smithi081.stdout:270/600: open fd = 3 2024-05-09T00:09:49.905 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.905 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.906 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.906 INFO:tasks.workunit.client.0.smithi081.stdout:271/600: open fd = 3 2024-05-09T00:09:49.906 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.906 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.906 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.906 INFO:tasks.workunit.client.0.smithi081.stdout:272/600: open fd = 3 2024-05-09T00:09:49.906 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.906 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.906 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.907 INFO:tasks.workunit.client.0.smithi081.stdout:273/600: open fd = 3 2024-05-09T00:09:49.907 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.907 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.907 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.907 INFO:tasks.workunit.client.0.smithi081.stdout:274/600: open fd = 3 2024-05-09T00:09:49.907 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.907 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.907 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.907 INFO:tasks.workunit.client.0.smithi081.stdout:275/600: open fd = 3 2024-05-09T00:09:49.908 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.908 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.908 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.908 INFO:tasks.workunit.client.0.smithi081.stdout:276/600: open fd = 3 2024-05-09T00:09:49.908 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.908 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.908 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.908 INFO:tasks.workunit.client.0.smithi081.stdout:277/600: open fd = 3 2024-05-09T00:09:49.909 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.909 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.909 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.909 INFO:tasks.workunit.client.0.smithi081.stdout:278/600: open fd = 3 2024-05-09T00:09:49.909 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.909 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.909 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.909 INFO:tasks.workunit.client.0.smithi081.stdout:279/600: open fd = 3 2024-05-09T00:09:49.909 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.910 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.910 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.910 INFO:tasks.workunit.client.0.smithi081.stdout:280/600: open fd = 3 2024-05-09T00:09:49.910 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.910 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.910 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.910 INFO:tasks.workunit.client.0.smithi081.stdout:281/600: open fd = 3 2024-05-09T00:09:49.910 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.910 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.911 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.911 INFO:tasks.workunit.client.0.smithi081.stdout:282/600: open fd = 3 2024-05-09T00:09:49.911 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.911 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.911 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.911 INFO:tasks.workunit.client.0.smithi081.stdout:283/600: open fd = 3 2024-05-09T00:09:49.911 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.911 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.911 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.912 INFO:tasks.workunit.client.0.smithi081.stdout:284/600: open fd = 3 2024-05-09T00:09:49.912 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.912 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.912 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.912 INFO:tasks.workunit.client.0.smithi081.stdout:285/600: open fd = 3 2024-05-09T00:09:49.912 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.912 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.912 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.912 INFO:tasks.workunit.client.0.smithi081.stdout:286/600: open fd = 3 2024-05-09T00:09:49.913 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.913 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.913 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.913 INFO:tasks.workunit.client.0.smithi081.stdout:287/600: open fd = 3 2024-05-09T00:09:49.913 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.913 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.913 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.913 INFO:tasks.workunit.client.0.smithi081.stdout:288/600: open fd = 3 2024-05-09T00:09:49.914 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.914 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.914 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.914 INFO:tasks.workunit.client.0.smithi081.stdout:289/600: open fd = 3 2024-05-09T00:09:49.914 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.914 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.914 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.914 INFO:tasks.workunit.client.0.smithi081.stdout:290/600: open fd = 3 2024-05-09T00:09:49.914 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.915 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.915 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.915 INFO:tasks.workunit.client.0.smithi081.stdout:291/600: open fd = 3 2024-05-09T00:09:49.915 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.915 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.915 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.915 INFO:tasks.workunit.client.0.smithi081.stdout:292/600: open fd = 3 2024-05-09T00:09:49.915 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.916 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.916 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.916 INFO:tasks.workunit.client.0.smithi081.stdout:293/600: open fd = 3 2024-05-09T00:09:49.916 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.916 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.916 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.916 INFO:tasks.workunit.client.0.smithi081.stdout:294/600: open fd = 3 2024-05-09T00:09:49.916 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.916 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.917 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.917 INFO:tasks.workunit.client.0.smithi081.stdout:295/600: open fd = 3 2024-05-09T00:09:49.917 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.917 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.917 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.917 INFO:tasks.workunit.client.0.smithi081.stdout:296/600: open fd = 3 2024-05-09T00:09:49.917 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.917 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.917 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.918 INFO:tasks.workunit.client.0.smithi081.stdout:297/600: open fd = 3 2024-05-09T00:09:49.918 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.918 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.918 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.918 INFO:tasks.workunit.client.0.smithi081.stdout:298/600: open fd = 3 2024-05-09T00:09:49.918 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.918 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.918 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.918 INFO:tasks.workunit.client.0.smithi081.stdout:299/600: open fd = 3 2024-05-09T00:09:49.919 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.919 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.919 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.919 INFO:tasks.workunit.client.0.smithi081.stdout:300/600: open fd = 3 2024-05-09T00:09:49.919 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.919 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.919 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.919 INFO:tasks.workunit.client.0.smithi081.stdout:301/600: open fd = 3 2024-05-09T00:09:49.920 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.920 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.920 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.920 INFO:tasks.workunit.client.0.smithi081.stdout:302/600: open fd = 3 2024-05-09T00:09:49.920 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.920 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.920 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.920 INFO:tasks.workunit.client.0.smithi081.stdout:303/600: open fd = 3 2024-05-09T00:09:49.920 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.921 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.921 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.921 INFO:tasks.workunit.client.0.smithi081.stdout:304/600: open fd = 3 2024-05-09T00:09:49.921 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.921 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.921 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.921 INFO:tasks.workunit.client.0.smithi081.stdout:305/600: open fd = 3 2024-05-09T00:09:49.921 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.922 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.922 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.922 INFO:tasks.workunit.client.0.smithi081.stdout:306/600: open fd = 3 2024-05-09T00:09:49.922 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.922 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.922 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.922 INFO:tasks.workunit.client.0.smithi081.stdout:307/600: open fd = 3 2024-05-09T00:09:49.922 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.922 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.923 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.923 INFO:tasks.workunit.client.0.smithi081.stdout:308/600: open fd = 3 2024-05-09T00:09:49.923 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.923 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.923 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.923 INFO:tasks.workunit.client.0.smithi081.stdout:309/600: open fd = 3 2024-05-09T00:09:49.923 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.923 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.923 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.924 INFO:tasks.workunit.client.0.smithi081.stdout:310/600: open fd = 3 2024-05-09T00:09:49.924 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.924 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.924 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.924 INFO:tasks.workunit.client.0.smithi081.stdout:311/600: open fd = 3 2024-05-09T00:09:49.924 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.924 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.924 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:09:49.924 INFO:tasks.workunit.client.0.smithi081.stdout:312/600: open fd = 3 2024-05-09T00:09:49.925 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:49.925 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:09:51.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:50 smithi150 ceph-mon[46187]: pgmap v209: 97 pgs: 97 active+clean; 2.3 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-05-09T00:09:51.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:50 smithi171 ceph-mon[47351]: pgmap v209: 97 pgs: 97 active+clean; 2.3 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-05-09T00:09:51.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:50 smithi081 ceph-mon[42474]: pgmap v209: 97 pgs: 97 active+clean; 2.3 MiB data, 405 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 10 op/s 2024-05-09T00:09:53.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:52 smithi150 ceph-mon[46187]: pgmap v210: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-05-09T00:09:53.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:52 smithi171 ceph-mon[47351]: pgmap v210: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-05-09T00:09:53.371 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:52 smithi081 ceph-mon[42474]: pgmap v210: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 56 KiB/s wr, 18 op/s 2024-05-09T00:09:55.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:54 smithi150 ceph-mon[46187]: pgmap v211: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:09:55.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:54 smithi171 ceph-mon[47351]: pgmap v211: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:09:55.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:54 smithi081 ceph-mon[42474]: pgmap v211: 97 pgs: 97 active+clean; 2.5 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:09:57.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:56 smithi150 ceph-mon[46187]: pgmap v212: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-05-09T00:09:57.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:56 smithi171 ceph-mon[47351]: pgmap v212: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-05-09T00:09:57.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:56 smithi081 ceph-mon[42474]: pgmap v212: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 16 op/s 2024-05-09T00:09:59.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:09:58 smithi150 ceph-mon[46187]: pgmap v213: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:09:59.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:09:58 smithi171 ceph-mon[47351]: pgmap v213: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:09:59.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:09:58 smithi081 ceph-mon[42474]: pgmap v213: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:09:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.924+0000 7f2c1da1c700 1 -- 172.21.15.81:0/3368087602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c180ffd80 msgr2=0x7f2c18100200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.924+0000 7f2c1da1c700 1 --2- 172.21.15.81:0/3368087602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c180ffd80 0x7f2c18100200 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f2c00009990 tx=0x7f2c00009ca0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.924+0000 7f2c1da1c700 1 -- 172.21.15.81:0/3368087602 shutdown_connections 2024-05-09T00:09:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.924+0000 7f2c1da1c700 1 --2- 172.21.15.81:0/3368087602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c18100740 0x7f2c1810cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.924+0000 7f2c1da1c700 1 --2- 172.21.15.81:0/3368087602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c18105e40 0x7f2c18106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.924+0000 7f2c1da1c700 1 --2- 172.21.15.81:0/3368087602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c180ffd80 0x7f2c18100200 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.924+0000 7f2c1da1c700 1 -- 172.21.15.81:0/3368087602 >> 172.21.15.81:0/3368087602 conn(0x7f2c18076f00 msgr2=0x7f2c18077310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.924+0000 7f2c1da1c700 1 -- 172.21.15.81:0/3368087602 shutdown_connections 2024-05-09T00:09:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.924+0000 7f2c1da1c700 1 -- 172.21.15.81:0/3368087602 wait complete. 2024-05-09T00:09:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.924+0000 7f2c1da1c700 1 Processor -- start 2024-05-09T00:09:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c1da1c700 1 -- start start 2024-05-09T00:09:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c1da1c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c180ffd80 0x7f2c18196280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c1da1c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c18100740 0x7f2c181967c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c1da1c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c18105e40 0x7f2c1819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c1da1c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1819b1a0 con 0x7f2c18105e40 2024-05-09T00:09:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c1da1c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1819b310 con 0x7f2c18100740 2024-05-09T00:09:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c1da1c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1819b4d0 con 0x7f2c180ffd80 2024-05-09T00:09:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c18105e40 0x7f2c1819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c18105e40 0x7f2c1819ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50516/0 (socket says 172.21.15.81:50516) 2024-05-09T00:09:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c177fe700 1 -- 172.21.15.81:0/861290381 learned_addr learned my addr 172.21.15.81:0/861290381 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c167fc700 1 --2- 172.21.15.81:0/861290381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c18100740 0x7f2c181967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/861290381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c180ffd80 0x7f2c18196280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c177fe700 1 -- 172.21.15.81:0/861290381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c180ffd80 msgr2=0x7f2c18196280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c177fe700 1 --2- 172.21.15.81:0/861290381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c180ffd80 0x7f2c18196280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c177fe700 1 -- 172.21.15.81:0/861290381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c18100740 msgr2=0x7f2c181967c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c177fe700 1 --2- 172.21.15.81:0/861290381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c18100740 0x7f2c181967c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.925+0000 7f2c177fe700 1 -- 172.21.15.81:0/861290381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c000095f0 con 0x7f2c18105e40 2024-05-09T00:09:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.926+0000 7f2c177fe700 1 --2- 172.21.15.81:0/861290381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c18105e40 0x7f2c1819ab60 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000efb0 tx=0x7f2c1000c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.926+0000 7f2c1ca1a700 1 -- 172.21.15.81:0/861290381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c10011670 con 0x7f2c18105e40 2024-05-09T00:09:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.926+0000 7f2c1ca1a700 1 -- 172.21.15.81:0/861290381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c1000ce20 con 0x7f2c18105e40 2024-05-09T00:09:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.926+0000 7f2c1da1c700 1 -- 172.21.15.81:0/861290381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1819b7b0 con 0x7f2c18105e40 2024-05-09T00:09:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.926+0000 7f2c1ca1a700 1 -- 172.21.15.81:0/861290381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1001ab80 con 0x7f2c18105e40 2024-05-09T00:09:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.926+0000 7f2c1da1c700 1 -- 172.21.15.81:0/861290381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c18069870 con 0x7f2c18105e40 2024-05-09T00:09:59.929 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.928+0000 7f2c1ca1a700 1 -- 172.21.15.81:0/861290381 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f2c100117d0 con 0x7f2c18105e40 2024-05-09T00:09:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.929+0000 7f2c1ca1a700 1 --2- 172.21.15.81:0/861290381 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2c040a1290 0x7f2c040a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.929+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/861290381 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2c040a1290 0x7f2c040a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.929+0000 7f2c1ca1a700 1 -- 172.21.15.81:0/861290381 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2c100cf700 con 0x7f2c18105e40 2024-05-09T00:09:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.929+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/861290381 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2c040a1290 0x7f2c040a3750 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009a10 tx=0x7f2c08009190 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.929+0000 7f2c29bd6b80 1 Processor -- start 2024-05-09T00:09:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c29bd6b80 1 -- start start 2024-05-09T00:09:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c29bd6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e3950 0x55e00c1e3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c29bd6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1e4270 0x55e00c1ddf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c29bd6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c1de8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c29bd6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00c1350f0 con 0x55e00c1de480 2024-05-09T00:09:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c29bd6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00c132ab0 con 0x55e00c1e3950 2024-05-09T00:09:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c29bd6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00c12e3a0 con 0x55e00c1e4270 2024-05-09T00:09:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c1de8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c1de8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50528/0 (socket says 172.21.15.81:50528) 2024-05-09T00:09:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c177fe700 1 -- 172.21.15.81:0/1835256961 learned_addr learned my addr 172.21.15.81:0/1835256961 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c167fc700 1 --2- 172.21.15.81:0/1835256961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1e4270 0x55e00c1ddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/1835256961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e3950 0x55e00c1e3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c177fe700 1 -- 172.21.15.81:0/1835256961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1e4270 msgr2=0x55e00c1ddf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c177fe700 1 --2- 172.21.15.81:0/1835256961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1e4270 0x55e00c1ddf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c177fe700 1 -- 172.21.15.81:0/1835256961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e3950 msgr2=0x55e00c1e3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c177fe700 1 --2- 172.21.15.81:0/1835256961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e3950 0x55e00c1e3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c177fe700 1 -- 172.21.15.81:0/1835256961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e00bfaf350 con 0x55e00c1de480 2024-05-09T00:09:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/1835256961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e3950 0x55e00c1e3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:09:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c177fe700 1 --2- 172.21.15.81:0/1835256961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c1de8a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f2c10098d10 tx=0x7f2c1009c1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e433e62605c9b533 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.930+0000 7f2c0dffb700 1 -- 172.21.15.81:0/1835256961 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c100a0640 con 0x55e00c1de480 2024-05-09T00:09:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.931+0000 7f2c0dffb700 1 -- 172.21.15.81:0/1835256961 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c100a4c90 con 0x55e00c1de480 2024-05-09T00:09:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.931+0000 7f2c0dffb700 1 -- 172.21.15.81:0/1835256961 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c100cd0d0 con 0x55e00c1de480 2024-05-09T00:09:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.931+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/1835256961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 msgr2=0x55e00c1de8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.931+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/1835256961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c1de8a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f2c10098d10 tx=0x7f2c1009c1f0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.931+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/1835256961 shutdown_connections 2024-05-09T00:09:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.931+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/1835256961 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e3950 0x55e00c1e3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.931+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/1835256961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c1de8a0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.931+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/1835256961 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1e4270 0x55e00c1ddf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.931+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/1835256961 >> 172.21.15.81:0/1835256961 conn(0x55e00c13c1b0 msgr2=0x55e00c1d8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.931+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/1835256961 shutdown_connections 2024-05-09T00:09:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.931+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/1835256961 wait complete. 2024-05-09T00:09:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.932+0000 7f2c29bd6b80 1 -- start start 2024-05-09T00:09:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.932+0000 7f2c29bd6b80 1 Processor -- start 2024-05-09T00:09:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.932+0000 7f2c29bd6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1de480 0x55e00c1ea2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.932+0000 7f2c29bd6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e3950 0x55e00c1e76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.932+0000 7f2c29bd6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1e4270 0x55e00c1e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.932+0000 7f2c29bd6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00c0ca500 con 0x55e00c1e4270 2024-05-09T00:09:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.932+0000 7f2c29bd6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00c0ca1a0 con 0x55e00c1e3950 2024-05-09T00:09:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.932+0000 7f2c29bd6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00bfb1640 con 0x55e00c1de480 2024-05-09T00:09:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.932+0000 7f2c29bd6b80 10 client.0 _ll_register_callbacks cb 0x55e00c0d3ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.933+0000 7f2c16ffd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1de480 0x55e00c1ea2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.933+0000 7f2c16ffd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1de480 0x55e00c1ea2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:55172/0 (socket says 172.21.15.81:55172) 2024-05-09T00:09:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.933+0000 7f2c16ffd700 1 -- 172.21.15.81:0/81272110 learned_addr learned my addr 172.21.15.81:0/81272110 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.933+0000 7f2c177fe700 1 --2- 172.21.15.81:0/81272110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1e4270 0x55e00c1e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.933+0000 7f2c16ffd700 1 -- 172.21.15.81:0/81272110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e3950 msgr2=0x55e00c1e76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.933+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/81272110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e3950 0x55e00c1e76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.933+0000 7f2c16ffd700 1 -- 172.21.15.81:0/81272110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1e4270 msgr2=0x55e00c1e7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.933+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/81272110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1e4270 0x55e00c1e7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.933+0000 7f2c16ffd700 1 -- 172.21.15.81:0/81272110 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c18069870 con 0x55e00c1de480 2024-05-09T00:09:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.933+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/81272110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1de480 0x55e00c1ea2b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009510 tx=0x7f2c08004860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=226a3869cd92f198 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.933+0000 7f2bf6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-05-09T00:09:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.933+0000 7f2bf6ffd700 1 -- 172.21.15.81:0/81272110 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08015c40 con 0x55e00c1de480 2024-05-09T00:09:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.934+0000 7f2bf6ffd700 1 -- 172.21.15.81:0/81272110 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2c08015da0 con 0x55e00c1de480 2024-05-09T00:09:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.934+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/81272110 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e00c087210 con 0x55e00c1de480 2024-05-09T00:09:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.934+0000 7f2bf6ffd700 1 -- 172.21.15.81:0/81272110 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c08021470 con 0x55e00c1de480 2024-05-09T00:09:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.934+0000 7f2c29bd6b80 10 client.26353 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.934+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/81272110 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e00bf5bb00 con 0x55e00c1de480 2024-05-09T00:09:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.934+0000 7f2bf6ffd700 1 -- 172.21.15.81:0/81272110 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e00c087210 con 0x55e00c1de480 2024-05-09T00:09:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.934+0000 7f2bf6ffd700 1 -- 172.21.15.81:0/81272110 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2c080135f0 con 0x55e00c1de480 2024-05-09T00:09:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.934+0000 7f2c29bd6b80 10 client.26353 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.934+0000 7f2c29bd6b80 10 client.26353 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.934+0000 7f2c29bd6b80 20 client.26353 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.934+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/81272110 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e00c1f6450 0x55e00c1f6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.934+0000 7f2c29bd6b80 4 client.26353 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:09:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.934+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/81272110 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e00c1ad7b0 con 0x55e00c1f6450 2024-05-09T00:09:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.935+0000 7f2c167fc700 1 --2- 172.21.15.81:0/81272110 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e00c1f6450 0x55e00c1f6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.935+0000 7f2bf6ffd700 10 client.26353 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.935+0000 7f2c167fc700 1 --2- 172.21.15.81:0/81272110 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e00c1f6450 0x55e00c1f6860 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94c6601584852add server_cookie=eaea7fce6733604b in_seq=0 out_seq=0 2024-05-09T00:09:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2bf6ffd700 1 -- 172.21.15.81:0/81272110 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e00c1ad7b0 con 0x55e00c1f6450 2024-05-09T00:09:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2bf6ffd700 10 client.26353 handle_command_reply: tid=0 2024-05-09T00:09:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2c29bd6b80 1 client.26353 shutdown 2024-05-09T00:09:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/81272110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1de480 msgr2=0x55e00c1ea2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/81272110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1de480 0x55e00c1ea2b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009510 tx=0x7f2c08004860 comp rx=0 tx=0).stop 2024-05-09T00:09:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/81272110 shutdown_connections 2024-05-09T00:09:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/81272110 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e00c1f6450 0x55e00c1f6860 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/81272110 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1e4270 0x55e00c1e7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/81272110 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1de480 0x55e00c1ea2b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/81272110 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e3950 0x55e00c1e76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2bf6ffd700 0 client.26353 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/81272110 >> 172.21.15.81:0/81272110 conn(0x55e00c13c1b0 msgr2=0x55e00c1e24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/81272110 shutdown_connections 2024-05-09T00:09:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/81272110 wait complete. 2024-05-09T00:09:59.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.936+0000 7f2c29bd6b80 20 client.26353 trim_cache size 0 max 16384 2024-05-09T00:09:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.951+0000 7f2c29bd6b80 1 Processor -- start 2024-05-09T00:09:59.949 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.951+0000 7f2c29bd6b80 1 -- start start 2024-05-09T00:09:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.951+0000 7f2c29bd6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c1e7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.951+0000 7f2c29bd6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1e3950 0x55e00c1da540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.951+0000 7f2c29bd6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e4270 0x55e00c207eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.951+0000 7f2c29bd6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00c1e5660 con 0x55e00c1de480 2024-05-09T00:09:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.951+0000 7f2c29bd6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00c1e5bd0 con 0x55e00c1e4270 2024-05-09T00:09:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.951+0000 7f2c29bd6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00c1dd220 con 0x55e00c1e3950 2024-05-09T00:09:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.951+0000 7f2c16ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c1e7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.952+0000 7f2c16ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c1e7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50552/0 (socket says 172.21.15.81:50552) 2024-05-09T00:09:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.952+0000 7f2c16ffd700 1 -- 172.21.15.81:0/983168402 learned_addr learned my addr 172.21.15.81:0/983168402 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.952+0000 7f2c16ffd700 1 -- 172.21.15.81:0/983168402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1e3950 msgr2=0x55e00c1da540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.952+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/983168402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1e3950 0x55e00c1da540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.952+0000 7f2c177fe700 1 --2- 172.21.15.81:0/983168402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e4270 0x55e00c207eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.950 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.952+0000 7f2c16ffd700 1 -- 172.21.15.81:0/983168402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e4270 msgr2=0x55e00c207eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.952+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/983168402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e4270 0x55e00c207eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.952+0000 7f2c16ffd700 1 -- 172.21.15.81:0/983168402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e00c0f4500 con 0x55e00c1de480 2024-05-09T00:09:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.952+0000 7f2c177fe700 1 --2- 172.21.15.81:0/983168402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e4270 0x55e00c207eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:09:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.952+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/983168402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c1e7d30 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f2c080097f0 tx=0x7f2c0800e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570ed855c2ffeac2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.952+0000 7f2c0e7fc700 1 -- 172.21.15.81:0/983168402 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08013450 con 0x55e00c1de480 2024-05-09T00:09:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.952+0000 7f2c0e7fc700 1 -- 172.21.15.81:0/983168402 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c080135b0 con 0x55e00c1de480 2024-05-09T00:09:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.952+0000 7f2c0e7fc700 1 -- 172.21.15.81:0/983168402 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08021c70 con 0x55e00c1de480 2024-05-09T00:09:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.953+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/983168402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 msgr2=0x55e00c1e7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.953+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/983168402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c1e7d30 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f2c080097f0 tx=0x7f2c0800e740 comp rx=0 tx=0).stop 2024-05-09T00:09:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.953+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/983168402 shutdown_connections 2024-05-09T00:09:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.953+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/983168402 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e4270 0x55e00c207eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.953+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/983168402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c1e7d30 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.953+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/983168402 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1e3950 0x55e00c1da540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.951 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.953+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/983168402 >> 172.21.15.81:0/983168402 conn(0x55e00c13c1b0 msgr2=0x55e00c1e5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.953+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/983168402 shutdown_connections 2024-05-09T00:09:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.953+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/983168402 wait complete. 2024-05-09T00:09:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.953+0000 7f2c29bd6b80 1 -- start start 2024-05-09T00:09:59.952 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.953+0000 7f2c29bd6b80 1 Processor -- start 2024-05-09T00:09:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c29bd6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c2068f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c29bd6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1e3950 0x55e00c206e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c29bd6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e4270 0x55e00c1d7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c29bd6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00c2074f0 con 0x55e00c1de480 2024-05-09T00:09:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c29bd6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00c1d8460 con 0x55e00c1e4270 2024-05-09T00:09:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c29bd6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00c1d8620 con 0x55e00c1e3950 2024-05-09T00:09:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c29bd6b80 10 client.0 _ll_register_callbacks cb 0x55e00c0d3ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:09:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c16ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c2068f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c16ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c2068f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50556/0 (socket says 172.21.15.81:50556) 2024-05-09T00:09:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c16ffd700 1 -- 172.21.15.81:0/1259953229 learned_addr learned my addr 172.21.15.81:0/1259953229 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:09:59.955 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c167fc700 1 --2- 172.21.15.81:0/1259953229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1e3950 0x55e00c206e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c177fe700 1 --2- 172.21.15.81:0/1259953229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e4270 0x55e00c1d7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c16ffd700 1 -- 172.21.15.81:0/1259953229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1e3950 msgr2=0x55e00c206e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/1259953229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1e3950 0x55e00c206e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c16ffd700 1 -- 172.21.15.81:0/1259953229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e4270 msgr2=0x55e00c1d7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:09:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/1259953229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e4270 0x55e00c1d7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c16ffd700 1 -- 172.21.15.81:0/1259953229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e00bf5bb00 con 0x55e00c1de480 2024-05-09T00:09:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c16ffd700 1 --2- 172.21.15.81:0/1259953229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c2068f0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f2c08013920 tx=0x7f2c08013e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc97cd84b2104cae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:09:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2bf6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:09:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2bf6ffd700 1 -- 172.21.15.81:0/1259953229 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08021470 con 0x55e00c1de480 2024-05-09T00:09:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2bf6ffd700 1 -- 172.21.15.81:0/1259953229 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8528+0+0 (secure 0 0 0) 0x7f2c080215d0 con 0x55e00c1de480 2024-05-09T00:09:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/1259953229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c100a4c90 con 0x55e00c1de480 2024-05-09T00:09:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.954+0000 7f2bf6ffd700 1 -- 172.21.15.81:0/1259953229 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c08021790 con 0x55e00c1de480 2024-05-09T00:09:59.956 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.955+0000 7f2c29bd6b80 10 client.17427 fetch_fsmap learned FSMap version 26 2024-05-09T00:09:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.955+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/1259953229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e00bfb3c70 con 0x55e00c1de480 2024-05-09T00:09:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.955+0000 7f2bf6ffd700 1 -- 172.21.15.81:0/1259953229 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c0804e020 con 0x55e00c1de480 2024-05-09T00:09:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.955+0000 7f2bf6ffd700 1 -- 172.21.15.81:0/1259953229 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2c08036960 con 0x55e00c1de480 2024-05-09T00:09:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.955+0000 7f2c29bd6b80 10 client.17427 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:09:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.955+0000 7f2c29bd6b80 10 client.17427 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:09:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.955+0000 7f2c29bd6b80 20 client.17427 populate_metadata read hostname 'smithi081' 2024-05-09T00:09:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.955+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/1259953229 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e00c205e70 0x55e00c259630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:09:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.955+0000 7f2c29bd6b80 4 client.17427 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:09:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.955+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/1259953229 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e00c126e60 con 0x55e00c205e70 2024-05-09T00:09:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.955+0000 7f2c167fc700 1 --2- 172.21.15.81:0/1259953229 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e00c205e70 0x55e00c259630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:09:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.955+0000 7f2c167fc700 1 --2- 172.21.15.81:0/1259953229 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e00c205e70 0x55e00c259630 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5790b8e1de7277bf server_cookie=b5c310375bd501 in_seq=0 out_seq=0 2024-05-09T00:09:59.957 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.955+0000 7f2bf6ffd700 10 client.17427 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2bf6ffd700 1 -- 172.21.15.81:0/1259953229 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e00c126e60 con 0x55e00c205e70 2024-05-09T00:09:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2bf6ffd700 10 client.17427 handle_command_reply: tid=0 2024-05-09T00:09:59.966 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c29bd6b80 1 client.17427 shutdown 2024-05-09T00:09:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/1259953229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 msgr2=0x55e00c2068f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/1259953229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c2068f0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f2c08013920 tx=0x7f2c08013e20 comp rx=0 tx=0).stop 2024-05-09T00:09:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/1259953229 shutdown_connections 2024-05-09T00:09:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/1259953229 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e00c205e70 0x55e00c259630 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/1259953229 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e00c1e4270 0x55e00c1d7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/1259953229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e00c1de480 0x55e00c2068f0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2bf6ffd700 0 client.17427 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:09:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c29bd6b80 1 --2- 172.21.15.81:0/1259953229 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e00c1e3950 0x55e00c206e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/1259953229 >> 172.21.15.81:0/1259953229 conn(0x55e00c13c1b0 msgr2=0x55e00c1dd630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/1259953229 shutdown_connections 2024-05-09T00:09:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c29bd6b80 1 -- 172.21.15.81:0/1259953229 wait complete. 2024-05-09T00:09:59.967 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c29bd6b80 20 client.17427 trim_cache size 0 max 16384 2024-05-09T00:09:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:09:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:09:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:09:59.968 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:09:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c1da1c700 1 -- 172.21.15.81:0/861290381 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2c040a1290 msgr2=0x7f2c040a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c1da1c700 1 --2- 172.21.15.81:0/861290381 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2c040a1290 0x7f2c040a3750 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009a10 tx=0x7f2c08009190 comp rx=0 tx=0).stop 2024-05-09T00:09:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c1da1c700 1 -- 172.21.15.81:0/861290381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c18105e40 msgr2=0x7f2c1819ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:09:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c1da1c700 1 --2- 172.21.15.81:0/861290381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c18105e40 0x7f2c1819ab60 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000efb0 tx=0x7f2c1000c550 comp rx=0 tx=0).stop 2024-05-09T00:09:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c1da1c700 1 -- 172.21.15.81:0/861290381 shutdown_connections 2024-05-09T00:09:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c1da1c700 1 --2- 172.21.15.81:0/861290381 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2c040a1290 0x7f2c040a3750 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c1da1c700 1 --2- 172.21.15.81:0/861290381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c18105e40 0x7f2c1819ab60 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c1da1c700 1 --2- 172.21.15.81:0/861290381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2c180ffd80 0x7f2c18196280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c1da1c700 1 --2- 172.21.15.81:0/861290381 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2c18100740 0x7f2c181967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:09:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.970+0000 7f2c1da1c700 1 -- 172.21.15.81:0/861290381 >> 172.21.15.81:0/861290381 conn(0x7f2c18076f00 msgr2=0x7f2c180feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:09:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.971+0000 7f2c1da1c700 1 -- 172.21.15.81:0/861290381 shutdown_connections 2024-05-09T00:09:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:09:59.971+0000 7f2c1da1c700 1 -- 172.21.15.81:0/861290381 wait complete. 2024-05-09T00:10:01.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:00 smithi150 ceph-mon[46187]: pgmap v214: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:10:01.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:00 smithi150 ceph-mon[46187]: overall HEALTH_OK 2024-05-09T00:10:01.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:00 smithi171 ceph-mon[47351]: pgmap v214: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:10:01.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:00 smithi171 ceph-mon[47351]: overall HEALTH_OK 2024-05-09T00:10:01.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:00 smithi081 ceph-mon[42474]: pgmap v214: 97 pgs: 97 active+clean; 2.7 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:10:01.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:00 smithi081 ceph-mon[42474]: overall HEALTH_OK 2024-05-09T00:10:03.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:02 smithi150 ceph-mon[46187]: pgmap v215: 97 pgs: 97 active+clean; 2.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-05-09T00:10:03.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:02 smithi171 ceph-mon[47351]: pgmap v215: 97 pgs: 97 active+clean; 2.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-05-09T00:10:03.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:02 smithi081 ceph-mon[42474]: pgmap v215: 97 pgs: 97 active+clean; 2.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-05-09T00:10:05.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:04 smithi150 ceph-mon[46187]: pgmap v216: 97 pgs: 97 active+clean; 2.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-05-09T00:10:05.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:04 smithi171 ceph-mon[47351]: pgmap v216: 97 pgs: 97 active+clean; 2.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-05-09T00:10:05.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:04 smithi081 ceph-mon[42474]: pgmap v216: 97 pgs: 97 active+clean; 2.9 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 30 KiB/s wr, 9 op/s 2024-05-09T00:10:06.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:05 smithi150 ceph-mon[46187]: osdmap e84: 12 total, 12 up, 12 in 2024-05-09T00:10:06.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:05 smithi171 ceph-mon[47351]: osdmap e84: 12 total, 12 up, 12 in 2024-05-09T00:10:06.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:05 smithi081 ceph-mon[42474]: osdmap e84: 12 total, 12 up, 12 in 2024-05-09T00:10:07.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:06 smithi150 ceph-mon[46187]: pgmap v218: 97 pgs: 97 active+clean; 3.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 102 KiB/s wr, 35 op/s 2024-05-09T00:10:07.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:06 smithi171 ceph-mon[47351]: pgmap v218: 97 pgs: 97 active+clean; 3.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 102 KiB/s wr, 35 op/s 2024-05-09T00:10:07.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:06 smithi081 ceph-mon[42474]: pgmap v218: 97 pgs: 97 active+clean; 3.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 102 KiB/s wr, 35 op/s 2024-05-09T00:10:08.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:07 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:10:08.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:07 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:08.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:07 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:10:08.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:07 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:10:08.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:07 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:10:08.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:07 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:08.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:07 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:10:08.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:07 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:10:08.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:07 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:10:08.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:07 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:10:08.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:07 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:10:08.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:07 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:10:08.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:10:08.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.710+0000 7f77c439d700 1 -- 172.21.15.81:0/341999149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77bc069db0 msgr2=0x7f77bc105b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:08.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.710+0000 7f77c439d700 1 --2- 172.21.15.81:0/341999149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77bc069db0 0x7f77bc105b70 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009990 tx=0x7f77ac009ca0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.710+0000 7f77c439d700 1 -- 172.21.15.81:0/341999149 shutdown_connections 2024-05-09T00:10:08.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.710+0000 7f77c439d700 1 --2- 172.21.15.81:0/341999149 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc1062a0 0x7f77bc10de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.710+0000 7f77c439d700 1 --2- 172.21.15.81:0/341999149 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77bc069400 0x7f77bc0697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.710+0000 7f77c439d700 1 --2- 172.21.15.81:0/341999149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77bc069db0 0x7f77bc105b70 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.710+0000 7f77c439d700 1 -- 172.21.15.81:0/341999149 >> 172.21.15.81:0/341999149 conn(0x7f77bc076ba0 msgr2=0x7f77bc076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:08.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.710+0000 7f77c439d700 1 -- 172.21.15.81:0/341999149 shutdown_connections 2024-05-09T00:10:08.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.710+0000 7f77c439d700 1 -- 172.21.15.81:0/341999149 wait complete. 2024-05-09T00:10:08.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.710+0000 7f77c439d700 1 Processor -- start 2024-05-09T00:10:08.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.710+0000 7f77c439d700 1 -- start start 2024-05-09T00:10:08.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c439d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77bc069400 0x7f77bc1001c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c439d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc1062a0 0x7f77bc100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c439d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77bc100c40 0x7f77bc1a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c439d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc1a5d00 con 0x7f77bc100c40 2024-05-09T00:10:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c439d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc1a5e40 con 0x7f77bc1062a0 2024-05-09T00:10:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c439d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc1a6000 con 0x7f77bc069400 2024-05-09T00:10:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c293a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77bc100c40 0x7f77bc1a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c293a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77bc100c40 0x7f77bc1a5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48910/0 (socket says 172.21.15.81:48910) 2024-05-09T00:10:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c293a700 1 -- 172.21.15.81:0/1319669411 learned_addr learned my addr 172.21.15.81:0/1319669411 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c1938700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc1062a0 0x7f77bc100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c2139700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77bc069400 0x7f77bc1001c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c293a700 1 -- 172.21.15.81:0/1319669411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77bc069400 msgr2=0x7f77bc1001c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c293a700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77bc069400 0x7f77bc1001c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c293a700 1 -- 172.21.15.81:0/1319669411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc1062a0 msgr2=0x7f77bc100700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:08.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c293a700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc1062a0 0x7f77bc100700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c293a700 1 -- 172.21.15.81:0/1319669411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac0095f0 con 0x7f77bc100c40 2024-05-09T00:10:08.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c2139700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77bc069400 0x7f77bc1001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:08.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c293a700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77bc100c40 0x7f77bc1a5730 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f77b400b970 tx=0x7f77b400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:08.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77b37fe700 1 -- 172.21.15.81:0/1319669411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b400c930 con 0x7f77bc100c40 2024-05-09T00:10:08.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77b37fe700 1 -- 172.21.15.81:0/1319669411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77b4014440 con 0x7f77bc100c40 2024-05-09T00:10:08.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77c439d700 1 -- 172.21.15.81:0/1319669411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77bc1a62e0 con 0x7f77bc100c40 2024-05-09T00:10:08.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.711+0000 7f77b37fe700 1 -- 172.21.15.81:0/1319669411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b40075d0 con 0x7f77bc100c40 2024-05-09T00:10:08.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.712+0000 7f77c439d700 1 -- 172.21.15.81:0/1319669411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77bc1a67f0 con 0x7f77bc100c40 2024-05-09T00:10:08.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.713+0000 7f77b37fe700 1 -- 172.21.15.81:0/1319669411 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f77b40145b0 con 0x7f77bc100c40 2024-05-09T00:10:08.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.714+0000 7f77b37fe700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f77a80a1390 0x7f77a80a3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.714+0000 7f77c2139700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f77a80a1390 0x7f77a80a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.714+0000 7f77b37fe700 1 -- 172.21.15.81:0/1319669411 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f77b4006e40 con 0x7f77bc100c40 2024-05-09T00:10:08.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.714+0000 7f77c2139700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f77a80a1390 0x7f77a80a3850 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f77b8007900 tx=0x7f77b8008040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:08.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.715+0000 7f77d0557b80 1 Processor -- start 2024-05-09T00:10:08.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.715+0000 7f77d0557b80 1 -- start start 2024-05-09T00:10:08.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.715+0000 7f77d0557b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e4e00 0x55ff231e51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.715+0000 7f77d0557b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231e5720 0x55ff231df350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.715+0000 7f77d0557b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231df890 0x55ff231dfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.715+0000 7f77d0557b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff23136150 con 0x55ff231e4e00 2024-05-09T00:10:08.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.715+0000 7f77d0557b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff23133b10 con 0x55ff231e5720 2024-05-09T00:10:08.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.715+0000 7f77d0557b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2312f400 con 0x55ff231df890 2024-05-09T00:10:08.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.715+0000 7f77c2139700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e4e00 0x55ff231e51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.715+0000 7f77c2139700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e4e00 0x55ff231e51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48924/0 (socket says 172.21.15.81:48924) 2024-05-09T00:10:08.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.715+0000 7f77c2139700 1 -- 172.21.15.81:0/1276170574 learned_addr learned my addr 172.21.15.81:0/1276170574 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:08.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.716+0000 7f77c2139700 1 -- 172.21.15.81:0/1276170574 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231df890 msgr2=0x55ff231dfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:08.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.716+0000 7f77c2139700 1 --2- 172.21.15.81:0/1276170574 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231df890 0x55ff231dfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.716+0000 7f77c2139700 1 -- 172.21.15.81:0/1276170574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231e5720 msgr2=0x55ff231df350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:08.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.716+0000 7f77c1938700 1 --2- 172.21.15.81:0/1276170574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231e5720 0x55ff231df350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.716+0000 7f77c2139700 1 --2- 172.21.15.81:0/1276170574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231e5720 0x55ff231df350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.716+0000 7f77c2139700 1 -- 172.21.15.81:0/1276170574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff22fb03b0 con 0x55ff231e4e00 2024-05-09T00:10:08.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.716+0000 7f77c2139700 1 --2- 172.21.15.81:0/1276170574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e4e00 0x55ff231e51e0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f77b800c910 tx=0x7f77b800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c4f23dd2e53f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:08.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.716+0000 7f77b0da4700 1 -- 172.21.15.81:0/1276170574 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b80139b0 con 0x55ff231e4e00 2024-05-09T00:10:08.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.716+0000 7f77b0da4700 1 -- 172.21.15.81:0/1276170574 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77b8007e40 con 0x55ff231e4e00 2024-05-09T00:10:08.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.716+0000 7f77b0da4700 1 -- 172.21.15.81:0/1276170574 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b80113d0 con 0x55ff231e4e00 2024-05-09T00:10:08.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.717+0000 7f77d0557b80 1 -- 172.21.15.81:0/1276170574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e4e00 msgr2=0x55ff231e51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:08.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.717+0000 7f77d0557b80 1 --2- 172.21.15.81:0/1276170574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e4e00 0x55ff231e51e0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f77b800c910 tx=0x7f77b800f000 comp rx=0 tx=0).stop 2024-05-09T00:10:08.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.717+0000 7f77d0557b80 1 -- 172.21.15.81:0/1276170574 shutdown_connections 2024-05-09T00:10:08.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.717+0000 7f77d0557b80 1 --2- 172.21.15.81:0/1276170574 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231df890 0x55ff231dfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.717+0000 7f77d0557b80 1 --2- 172.21.15.81:0/1276170574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e4e00 0x55ff231e51e0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.717+0000 7f77d0557b80 1 --2- 172.21.15.81:0/1276170574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231e5720 0x55ff231df350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.717+0000 7f77d0557b80 1 -- 172.21.15.81:0/1276170574 >> 172.21.15.81:0/1276170574 conn(0x55ff2313d210 msgr2=0x55ff231d9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:08.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.717+0000 7f77d0557b80 1 -- 172.21.15.81:0/1276170574 shutdown_connections 2024-05-09T00:10:08.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.717+0000 7f77d0557b80 1 -- 172.21.15.81:0/1276170574 wait complete. 2024-05-09T00:10:08.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.717+0000 7f77d0557b80 1 -- start start 2024-05-09T00:10:08.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.717+0000 7f77d0557b80 1 Processor -- start 2024-05-09T00:10:08.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.717+0000 7f77d0557b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231df890 0x55ff231e8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77d0557b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e4e00 0x55ff231e9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77d0557b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e5720 0x55ff231e9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77d0557b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff230cb560 con 0x55ff231e5720 2024-05-09T00:10:08.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77d0557b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff230cb200 con 0x55ff231df890 2024-05-09T00:10:08.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77d0557b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff22fb26a0 con 0x55ff231e4e00 2024-05-09T00:10:08.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77d0557b80 10 client.0 _ll_register_callbacks cb 0x55ff230d4b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:08.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77c293a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e5720 0x55ff231e9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77c293a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e5720 0x55ff231e9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48938/0 (socket says 172.21.15.81:48938) 2024-05-09T00:10:08.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77c293a700 1 -- 172.21.15.81:0/3689250098 learned_addr learned my addr 172.21.15.81:0/3689250098 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:08.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77c2139700 1 --2- 172.21.15.81:0/3689250098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231df890 0x55ff231e8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77c1938700 1 --2- 172.21.15.81:0/3689250098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e4e00 0x55ff231e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77c293a700 1 -- 172.21.15.81:0/3689250098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e4e00 msgr2=0x55ff231e9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:08.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77c293a700 1 --2- 172.21.15.81:0/3689250098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e4e00 0x55ff231e9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77c293a700 1 -- 172.21.15.81:0/3689250098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231df890 msgr2=0x55ff231e8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:08.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77c293a700 1 --2- 172.21.15.81:0/3689250098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231df890 0x55ff231e8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77c293a700 1 -- 172.21.15.81:0/3689250098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b800c680 con 0x55ff231e5720 2024-05-09T00:10:08.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77c293a700 1 --2- 172.21.15.81:0/3689250098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e5720 0x55ff231e9670 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f77b4095eb0 tx=0x7f77b40c9ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d505378a3ef15888 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:08.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:08.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77a5ffb700 1 -- 172.21.15.81:0/3689250098 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b4098b30 con 0x55ff231e5720 2024-05-09T00:10:08.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77a5ffb700 1 -- 172.21.15.81:0/3689250098 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f77b4099440 con 0x55ff231e5720 2024-05-09T00:10:08.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77d0557b80 1 -- 172.21.15.81:0/3689250098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff23088270 con 0x55ff231e5720 2024-05-09T00:10:08.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.718+0000 7f77a5ffb700 1 -- 172.21.15.81:0/3689250098 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77b409d270 con 0x55ff231e5720 2024-05-09T00:10:08.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.719+0000 7f77d0557b80 10 client.17439 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:08.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.719+0000 7f77d0557b80 1 -- 172.21.15.81:0/3689250098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ff22f5cb60 con 0x55ff231e5720 2024-05-09T00:10:08.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.719+0000 7f77a5ffb700 1 -- 172.21.15.81:0/3689250098 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ff23088270 con 0x55ff231e5720 2024-05-09T00:10:08.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.719+0000 7f77a5ffb700 1 -- 172.21.15.81:0/3689250098 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f77b40a14c0 con 0x55ff231e5720 2024-05-09T00:10:08.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.719+0000 7f77d0557b80 10 client.17439 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:08.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.719+0000 7f77d0557b80 10 client.17439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:08.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.719+0000 7f77d0557b80 20 client.17439 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:08.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.719+0000 7f77d0557b80 1 --2- 172.21.15.81:0/3689250098 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff231f9260 0x55ff231fb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.719+0000 7f77d0557b80 4 client.17439 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:08.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.719+0000 7f77d0557b80 1 -- 172.21.15.81:0/3689250098 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff231ae810 con 0x55ff231f9260 2024-05-09T00:10:08.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.719+0000 7f77c2139700 1 --2- 172.21.15.81:0/3689250098 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff231f9260 0x55ff231fb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77a5ffb700 10 client.17439 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:08.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77c2139700 1 --2- 172.21.15.81:0/3689250098 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff231f9260 0x55ff231fb650 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ab710c7e6818ede server_cookie=da7646142c103001 in_seq=0 out_seq=0 2024-05-09T00:10:08.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77a5ffb700 1 -- 172.21.15.81:0/3689250098 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ff231ae810 con 0x55ff231f9260 2024-05-09T00:10:08.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77a5ffb700 10 client.17439 handle_command_reply: tid=0 2024-05-09T00:10:08.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77d0557b80 1 client.17439 shutdown 2024-05-09T00:10:08.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77d0557b80 1 -- 172.21.15.81:0/3689250098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e5720 msgr2=0x55ff231e9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:08.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77d0557b80 1 --2- 172.21.15.81:0/3689250098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e5720 0x55ff231e9670 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f77b4095eb0 tx=0x7f77b40c9ed0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77d0557b80 1 -- 172.21.15.81:0/3689250098 shutdown_connections 2024-05-09T00:10:08.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77d0557b80 1 --2- 172.21.15.81:0/3689250098 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff231f9260 0x55ff231fb650 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77d0557b80 1 --2- 172.21.15.81:0/3689250098 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231df890 0x55ff231e8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77a5ffb700 0 client.17439 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:08.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77d0557b80 1 --2- 172.21.15.81:0/3689250098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e5720 0x55ff231e9670 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77d0557b80 1 --2- 172.21.15.81:0/3689250098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e4e00 0x55ff231e9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77d0557b80 1 -- 172.21.15.81:0/3689250098 >> 172.21.15.81:0/3689250098 conn(0x55ff2313d210 msgr2=0x55ff231d95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:08.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77d0557b80 1 -- 172.21.15.81:0/3689250098 shutdown_connections 2024-05-09T00:10:08.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.720+0000 7f77d0557b80 1 -- 172.21.15.81:0/3689250098 wait complete. 2024-05-09T00:10:08.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.721+0000 7f77d0557b80 20 client.17439 trim_cache size 0 max 16384 2024-05-09T00:10:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77d0557b80 1 Processor -- start 2024-05-09T00:10:08.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77d0557b80 1 -- start start 2024-05-09T00:10:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77d0557b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231df890 0x55ff231dba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77d0557b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231e4e00 0x55ff231f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77d0557b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e5720 0x55ff231d9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77d0557b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff231eb730 con 0x55ff231df890 2024-05-09T00:10:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77d0557b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff231f9080 con 0x55ff231e4e00 2024-05-09T00:10:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77d0557b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff231ebb70 con 0x55ff231e5720 2024-05-09T00:10:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77c2139700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231df890 0x55ff231dba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77c2139700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231df890 0x55ff231dba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48950/0 (socket says 172.21.15.81:48950) 2024-05-09T00:10:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77c2139700 1 -- 172.21.15.81:0/4058924580 learned_addr learned my addr 172.21.15.81:0/4058924580 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77c2139700 1 -- 172.21.15.81:0/4058924580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e5720 msgr2=0x55ff231d9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77c293a700 1 --2- 172.21.15.81:0/4058924580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e5720 0x55ff231d9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77c2139700 1 --2- 172.21.15.81:0/4058924580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e5720 0x55ff231d9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77c2139700 1 -- 172.21.15.81:0/4058924580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231e4e00 msgr2=0x55ff231f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:08.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77c2139700 1 --2- 172.21.15.81:0/4058924580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231e4e00 0x55ff231f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77c2139700 1 -- 172.21.15.81:0/4058924580 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff230f5560 con 0x55ff231df890 2024-05-09T00:10:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.738+0000 7f77c2139700 1 --2- 172.21.15.81:0/4058924580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231df890 0x55ff231dba20 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f77b8020000 tx=0x7f77b800cfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b7004ae40ee81a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.739+0000 7f77b15a5700 1 -- 172.21.15.81:0/4058924580 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8030070 con 0x55ff231df890 2024-05-09T00:10:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.739+0000 7f77b15a5700 1 -- 172.21.15.81:0/4058924580 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77b8013c70 con 0x55ff231df890 2024-05-09T00:10:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.739+0000 7f77b15a5700 1 -- 172.21.15.81:0/4058924580 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b802a690 con 0x55ff231df890 2024-05-09T00:10:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.739+0000 7f77d0557b80 1 -- 172.21.15.81:0/4058924580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231df890 msgr2=0x55ff231dba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.739+0000 7f77d0557b80 1 --2- 172.21.15.81:0/4058924580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231df890 0x55ff231dba20 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f77b8020000 tx=0x7f77b800cfb0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.739+0000 7f77d0557b80 1 -- 172.21.15.81:0/4058924580 shutdown_connections 2024-05-09T00:10:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.739+0000 7f77d0557b80 1 --2- 172.21.15.81:0/4058924580 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e5720 0x55ff231d9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.739+0000 7f77d0557b80 1 --2- 172.21.15.81:0/4058924580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231df890 0x55ff231dba20 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.739+0000 7f77d0557b80 1 --2- 172.21.15.81:0/4058924580 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231e4e00 0x55ff231f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.739+0000 7f77d0557b80 1 -- 172.21.15.81:0/4058924580 >> 172.21.15.81:0/4058924580 conn(0x55ff2313d210 msgr2=0x55ff231e74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.739+0000 7f77d0557b80 1 -- 172.21.15.81:0/4058924580 shutdown_connections 2024-05-09T00:10:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.739+0000 7f77d0557b80 1 -- 172.21.15.81:0/4058924580 wait complete. 2024-05-09T00:10:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.739+0000 7f77d0557b80 1 -- start start 2024-05-09T00:10:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77d0557b80 1 Processor -- start 2024-05-09T00:10:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77d0557b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231df890 0x55ff231ee150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77d0557b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e4e00 0x55ff231ee690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77d0557b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e5720 0x55ff231eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77d0557b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2324e7a0 con 0x55ff231e5720 2024-05-09T00:10:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77d0557b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2324e910 con 0x55ff231df890 2024-05-09T00:10:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77d0557b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff2324ead0 con 0x55ff231e4e00 2024-05-09T00:10:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77d0557b80 10 client.0 _ll_register_callbacks cb 0x55ff230d4b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77c293a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e5720 0x55ff231eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77c293a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e5720 0x55ff231eebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48960/0 (socket says 172.21.15.81:48960) 2024-05-09T00:10:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77c293a700 1 -- 172.21.15.81:0/4276493238 learned_addr learned my addr 172.21.15.81:0/4276493238 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77c1938700 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e4e00 0x55ff231ee690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77c2139700 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231df890 0x55ff231ee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77c293a700 1 -- 172.21.15.81:0/4276493238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e4e00 msgr2=0x55ff231ee690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77c293a700 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e4e00 0x55ff231ee690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77c293a700 1 -- 172.21.15.81:0/4276493238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231df890 msgr2=0x55ff231ee150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77c293a700 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231df890 0x55ff231ee150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77c293a700 1 -- 172.21.15.81:0/4276493238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff22fb03b0 con 0x55ff231e5720 2024-05-09T00:10:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77c1938700 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e4e00 0x55ff231ee690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77c2139700 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231df890 0x55ff231ee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77c293a700 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e5720 0x55ff231eebd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f77b400bfd0 tx=0x7f77b40a1710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=831b5928e489d13b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.740+0000 7f77a5ffb700 1 -- 172.21.15.81:0/4276493238 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b40098b0 con 0x55ff231e5720 2024-05-09T00:10:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.741+0000 7f77a5ffb700 1 -- 172.21.15.81:0/4276493238 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f77b4099440 con 0x55ff231e5720 2024-05-09T00:10:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.741+0000 7f77d0557b80 1 -- 172.21.15.81:0/4276493238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f77b8007e40 con 0x55ff231e5720 2024-05-09T00:10:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.741+0000 7f77a5ffb700 1 -- 172.21.15.81:0/4276493238 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77b409d270 con 0x55ff231e5720 2024-05-09T00:10:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.741+0000 7f77d0557b80 10 client.17445 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.741+0000 7f77d0557b80 1 -- 172.21.15.81:0/4276493238 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ff22fb4cd0 con 0x55ff231e5720 2024-05-09T00:10:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.741+0000 7f77a5ffb700 1 -- 172.21.15.81:0/4276493238 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77b8007e40 con 0x55ff231e5720 2024-05-09T00:10:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.741+0000 7f77a5ffb700 1 -- 172.21.15.81:0/4276493238 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f77b409e190 con 0x55ff231e5720 2024-05-09T00:10:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.741+0000 7f77d0557b80 10 client.17445 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.741+0000 7f77d0557b80 10 client.17445 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.741+0000 7f77d0557b80 20 client.17445 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.741+0000 7f77d0557b80 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff2324fe30 0x55ff23252220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.741+0000 7f77d0557b80 4 client.17445 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:10:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.741+0000 7f77d0557b80 1 -- 172.21.15.81:0/4276493238 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ff23127ec0 con 0x55ff2324fe30 2024-05-09T00:10:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.741+0000 7f77c2139700 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff2324fe30 0x55ff23252220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77c2139700 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff2324fe30 0x55ff23252220 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaa2cec1a2e08b3f server_cookie=36a73e49e1389ac0 in_seq=0 out_seq=0 2024-05-09T00:10:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77a5ffb700 10 client.17445 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77a5ffb700 1 -- 172.21.15.81:0/4276493238 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ff23127ec0 con 0x55ff2324fe30 2024-05-09T00:10:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77a5ffb700 10 client.17445 handle_command_reply: tid=0 2024-05-09T00:10:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77d0557b80 1 client.17445 shutdown 2024-05-09T00:10:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77d0557b80 1 -- 172.21.15.81:0/4276493238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e5720 msgr2=0x55ff231eebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77d0557b80 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e5720 0x55ff231eebd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f77b400bfd0 tx=0x7f77b40a1710 comp rx=0 tx=0).stop 2024-05-09T00:10:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77d0557b80 1 -- 172.21.15.81:0/4276493238 shutdown_connections 2024-05-09T00:10:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77d0557b80 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ff2324fe30 0x55ff23252220 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77d0557b80 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ff231df890 0x55ff231ee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77d0557b80 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ff231e5720 0x55ff231eebd0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77a5ffb700 0 client.17445 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77d0557b80 1 --2- 172.21.15.81:0/4276493238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ff231e4e00 0x55ff231ee690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77d0557b80 1 -- 172.21.15.81:0/4276493238 >> 172.21.15.81:0/4276493238 conn(0x55ff2313d210 msgr2=0x55ff231e3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:08.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77d0557b80 1 -- 172.21.15.81:0/4276493238 shutdown_connections 2024-05-09T00:10:08.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77d0557b80 1 -- 172.21.15.81:0/4276493238 wait complete. 2024-05-09T00:10:08.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.742+0000 7f77d0557b80 20 client.17445 trim_cache size 0 max 16384 2024-05-09T00:10:08.746 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:10:08.746 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:10:08.746 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:10:08.746 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:10:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.743+0000 7f77c439d700 1 -- 172.21.15.81:0/1319669411 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f77a80a1390 msgr2=0x7f77a80a3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.743+0000 7f77c439d700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f77a80a1390 0x7f77a80a3850 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f77b8007900 tx=0x7f77b8008040 comp rx=0 tx=0).stop 2024-05-09T00:10:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.743+0000 7f77c439d700 1 -- 172.21.15.81:0/1319669411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77bc100c40 msgr2=0x7f77bc1a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.743+0000 7f77c439d700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77bc100c40 0x7f77bc1a5730 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f77b400b970 tx=0x7f77b400bc80 comp rx=0 tx=0).stop 2024-05-09T00:10:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.743+0000 7f77c439d700 1 -- 172.21.15.81:0/1319669411 shutdown_connections 2024-05-09T00:10:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.743+0000 7f77c439d700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f77a80a1390 0x7f77a80a3850 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.743+0000 7f77c439d700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77bc100c40 0x7f77bc1a5730 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.743+0000 7f77c439d700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77bc069400 0x7f77bc1001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.743+0000 7f77c439d700 1 --2- 172.21.15.81:0/1319669411 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f77bc1062a0 0x7f77bc100700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.743+0000 7f77c439d700 1 -- 172.21.15.81:0/1319669411 >> 172.21.15.81:0/1319669411 conn(0x7f77bc076ba0 msgr2=0x7f77bc0ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.743+0000 7f77c439d700 1 -- 172.21.15.81:0/1319669411 shutdown_connections 2024-05-09T00:10:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.743+0000 7f77c439d700 1 -- 172.21.15.81:0/1319669411 wait complete. 2024-05-09T00:10:08.751 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:10:08.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:10:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.878+0000 7f32e988d700 1 -- 172.21.15.81:0/1382354792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e4102970 msgr2=0x7f32e410ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.878+0000 7f32e988d700 1 --2- 172.21.15.81:0/1382354792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e4102970 0x7f32e410ae50 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f32cc009990 tx=0x7f32cc009ca0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.878+0000 7f32e988d700 1 -- 172.21.15.81:0/1382354792 shutdown_connections 2024-05-09T00:10:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.878+0000 7f32e988d700 1 --2- 172.21.15.81:0/1382354792 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32e410b420 0x7f32e410d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.878+0000 7f32e988d700 1 --2- 172.21.15.81:0/1382354792 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32e4102050 0x7f32e4102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.878+0000 7f32e988d700 1 --2- 172.21.15.81:0/1382354792 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e4102970 0x7f32e410ae50 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.878+0000 7f32e988d700 1 -- 172.21.15.81:0/1382354792 >> 172.21.15.81:0/1382354792 conn(0x7f32e40fb810 msgr2=0x7f32e40fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.878+0000 7f32e988d700 1 -- 172.21.15.81:0/1382354792 shutdown_connections 2024-05-09T00:10:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.878+0000 7f32e988d700 1 -- 172.21.15.81:0/1382354792 wait complete. 2024-05-09T00:10:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.878+0000 7f32e988d700 1 Processor -- start 2024-05-09T00:10:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.878+0000 7f32e988d700 1 -- start start 2024-05-09T00:10:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e988d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32e4102050 0x7f32e4199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e988d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32e4102970 0x7f32e4199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e988d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e410b420 0x7f32e419de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e988d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e419e440 con 0x7f32e410b420 2024-05-09T00:10:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e988d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e419e5b0 con 0x7f32e4102050 2024-05-09T00:10:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e988d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e419e770 con 0x7f32e4102970 2024-05-09T00:10:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e410b420 0x7f32e419de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e410b420 0x7f32e419de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48980/0 (socket says 172.21.15.81:48980) 2024-05-09T00:10:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e37fe700 1 -- 172.21.15.81:0/3142576481 learned_addr learned my addr 172.21.15.81:0/3142576481 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e27fc700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32e4102970 0x7f32e4199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e2ffd700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32e4102050 0x7f32e4199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e37fe700 1 -- 172.21.15.81:0/3142576481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32e4102970 msgr2=0x7f32e4199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e37fe700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32e4102970 0x7f32e4199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e37fe700 1 -- 172.21.15.81:0/3142576481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32e4102050 msgr2=0x7f32e4199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e37fe700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32e4102050 0x7f32e4199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e37fe700 1 -- 172.21.15.81:0/3142576481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32cc0095f0 con 0x7f32e410b420 2024-05-09T00:10:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e27fc700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32e4102970 0x7f32e4199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e37fe700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e410b420 0x7f32e419de00 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f32d400ef30 tx=0x7f32d400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:08.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e888b700 1 -- 172.21.15.81:0/3142576481 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4018070 con 0x7f32e410b420 2024-05-09T00:10:08.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e888b700 1 -- 172.21.15.81:0/3142576481 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32d400f040 con 0x7f32e410b420 2024-05-09T00:10:08.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e988d700 1 -- 172.21.15.81:0/3142576481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e419e9f0 con 0x7f32e410b420 2024-05-09T00:10:08.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e888b700 1 -- 172.21.15.81:0/3142576481 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4003dc0 con 0x7f32e410b420 2024-05-09T00:10:08.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.879+0000 7f32e988d700 1 -- 172.21.15.81:0/3142576481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e41a6290 con 0x7f32e410b420 2024-05-09T00:10:08.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.880+0000 7f32e988d700 1 -- 172.21.15.81:0/3142576481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e4069a90 con 0x7f32e410b420 2024-05-09T00:10:08.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.881+0000 7f32e888b700 1 -- 172.21.15.81:0/3142576481 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f32d400caa0 con 0x7f32e410b420 2024-05-09T00:10:08.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.882+0000 7f32e888b700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f32d00a1290 0x7f32d00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:08.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.882+0000 7f32e888b700 1 -- 172.21.15.81:0/3142576481 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f32d40cd3b0 con 0x7f32e410b420 2024-05-09T00:10:08.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.882+0000 7f32e2ffd700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f32d00a1290 0x7f32d00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:08.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.882+0000 7f32e2ffd700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f32d00a1290 0x7f32d00a3750 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009bf0 tx=0x7f32dc009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:08.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:08.886+0000 7f32e888b700 1 -- 172.21.15.81:0/3142576481 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f32d4096830 con 0x7f32e410b420 2024-05-09T00:10:09.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.135+0000 7f32e988d700 1 -- 172.21.15.81:0/3142576481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32e419a850 con 0x7f32e410b420 2024-05-09T00:10:09.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.135+0000 7f32e888b700 1 -- 172.21.15.81:0/3142576481 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7f32d4099e50 con 0x7f32e410b420 2024-05-09T00:10:09.132 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:10:09.132 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:10:09.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.138+0000 7f32e988d700 1 -- 172.21.15.81:0/3142576481 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f32d00a1290 msgr2=0x7f32d00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.138+0000 7f32e988d700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f32d00a1290 0x7f32d00a3750 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009bf0 tx=0x7f32dc009260 comp rx=0 tx=0).stop 2024-05-09T00:10:09.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.138+0000 7f32e988d700 1 -- 172.21.15.81:0/3142576481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e410b420 msgr2=0x7f32e419de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.138+0000 7f32e988d700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e410b420 0x7f32e419de00 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f32d400ef30 tx=0x7f32d400c450 comp rx=0 tx=0).stop 2024-05-09T00:10:09.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.138+0000 7f32e988d700 1 -- 172.21.15.81:0/3142576481 shutdown_connections 2024-05-09T00:10:09.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.138+0000 7f32e988d700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f32d00a1290 0x7f32d00a3750 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.138+0000 7f32e988d700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f32e4102050 0x7f32e4199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.138+0000 7f32e988d700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32e410b420 0x7f32e419de00 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.138+0000 7f32e988d700 1 --2- 172.21.15.81:0/3142576481 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32e4102970 0x7f32e4199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.138+0000 7f32e988d700 1 -- 172.21.15.81:0/3142576481 >> 172.21.15.81:0/3142576481 conn(0x7f32e40fb810 msgr2=0x7f32e4100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.138+0000 7f32e988d700 1 -- 172.21.15.81:0/3142576481 shutdown_connections 2024-05-09T00:10:09.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.138+0000 7f32e988d700 1 -- 172.21.15.81:0/3142576481 wait complete. 2024-05-09T00:10:09.136 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:10:09.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:10:09.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:08 smithi150 ceph-mon[46187]: pgmap v219: 97 pgs: 97 active+clean; 3.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 102 KiB/s wr, 35 op/s 2024-05-09T00:10:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.275+0000 7f167705d700 1 -- 172.21.15.81:0/2955989970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16701062a0 msgr2=0x7f167010de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.275+0000 7f167705d700 1 --2- 172.21.15.81:0/2955989970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16701062a0 0x7f167010de20 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f166800b0a0 tx=0x7f166800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.275+0000 7f167705d700 1 -- 172.21.15.81:0/2955989970 shutdown_connections 2024-05-09T00:10:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.275+0000 7f167705d700 1 --2- 172.21.15.81:0/2955989970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1670101180 0x7f1670101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.275+0000 7f167705d700 1 --2- 172.21.15.81:0/2955989970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16701062a0 0x7f167010de20 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.275+0000 7f167705d700 1 --2- 172.21.15.81:0/2955989970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1670101b30 0x7f1670105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.275+0000 7f167705d700 1 -- 172.21.15.81:0/2955989970 >> 172.21.15.81:0/2955989970 conn(0x7f16700fc9e0 msgr2=0x7f16700fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.275+0000 7f167705d700 1 -- 172.21.15.81:0/2955989970 shutdown_connections 2024-05-09T00:10:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.275+0000 7f167705d700 1 -- 172.21.15.81:0/2955989970 wait complete. 2024-05-09T00:10:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f167705d700 1 Processor -- start 2024-05-09T00:10:09.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f167705d700 1 -- start start 2024-05-09T00:10:09.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f167705d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1670101180 0x7f16700732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f167705d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16701062a0 0x7f16700737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f167705d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1670073d20 0x7f16701a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f167705d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16701a5d00 con 0x7f1670073d20 2024-05-09T00:10:09.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f167705d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16701a5e40 con 0x7f16701062a0 2024-05-09T00:10:09.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f167705d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16701a6000 con 0x7f1670101180 2024-05-09T00:10:09.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f16755fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1670073d20 0x7f16701a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f1674df9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1670101180 0x7f16700732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f16755fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1670073d20 0x7f16701a5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48994/0 (socket says 172.21.15.81:48994) 2024-05-09T00:10:09.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f166ffff700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16701062a0 0x7f16700737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f16755fa700 1 -- 172.21.15.81:0/2455588314 learned_addr learned my addr 172.21.15.81:0/2455588314 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f16755fa700 1 -- 172.21.15.81:0/2455588314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1670101180 msgr2=0x7f16700732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f16755fa700 1 --2- 172.21.15.81:0/2455588314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1670101180 0x7f16700732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f16755fa700 1 -- 172.21.15.81:0/2455588314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16701062a0 msgr2=0x7f16700737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f16755fa700 1 --2- 172.21.15.81:0/2455588314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16701062a0 0x7f16700737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f16755fa700 1 -- 172.21.15.81:0/2455588314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1668009d00 con 0x7f1670073d20 2024-05-09T00:10:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.276+0000 7f16755fa700 1 --2- 172.21.15.81:0/2455588314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1670073d20 0x7f16701a5730 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f1668006130 tx=0x7f1668007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.277+0000 7f166dffb700 1 -- 172.21.15.81:0/2455588314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166800e040 con 0x7f1670073d20 2024-05-09T00:10:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.277+0000 7f166dffb700 1 -- 172.21.15.81:0/2455588314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1668009480 con 0x7f1670073d20 2024-05-09T00:10:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.277+0000 7f167705d700 1 -- 172.21.15.81:0/2455588314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16701a6280 con 0x7f1670073d20 2024-05-09T00:10:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.277+0000 7f166dffb700 1 -- 172.21.15.81:0/2455588314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166801b6b0 con 0x7f1670073d20 2024-05-09T00:10:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.277+0000 7f167705d700 1 -- 172.21.15.81:0/2455588314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16701a6750 con 0x7f1670073d20 2024-05-09T00:10:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.279+0000 7f166dffb700 1 -- 172.21.15.81:0/2455588314 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f166801d480 con 0x7f1670073d20 2024-05-09T00:10:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.280+0000 7f166dffb700 1 --2- 172.21.15.81:0/2455588314 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f16600a1310 0x7f16600a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.280+0000 7f1674df9700 1 --2- 172.21.15.81:0/2455588314 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f16600a1310 0x7f16600a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.280+0000 7f166dffb700 1 -- 172.21.15.81:0/2455588314 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f16680ce2b0 con 0x7f1670073d20 2024-05-09T00:10:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.280+0000 7f1674df9700 1 --2- 172.21.15.81:0/2455588314 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f16600a1310 0x7f16600a37d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1664009c60 tx=0x7f1664009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1683217b80 1 Processor -- start 2024-05-09T00:10:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1683217b80 1 -- start start 2024-05-09T00:10:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1683217b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4c2e00 0x56237e4c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1683217b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 0x56237e4bd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1683217b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4bd890 0x56237e4bdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1683217b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237e414150 con 0x56237e4c2e00 2024-05-09T00:10:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1683217b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237e411b10 con 0x56237e4c3720 2024-05-09T00:10:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1683217b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237e40d400 con 0x56237e4bd890 2024-05-09T00:10:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1674df9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4c2e00 0x56237e4c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1674df9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4c2e00 0x56237e4c31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49002/0 (socket says 172.21.15.81:49002) 2024-05-09T00:10:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1674df9700 1 -- 172.21.15.81:0/2904606405 learned_addr learned my addr 172.21.15.81:0/2904606405 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1674df9700 1 -- 172.21.15.81:0/2904606405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4bd890 msgr2=0x56237e4bdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1674df9700 1 --2- 172.21.15.81:0/2904606405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4bd890 0x56237e4bdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f166ffff700 1 --2- 172.21.15.81:0/2904606405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 0x56237e4bd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1674df9700 1 -- 172.21.15.81:0/2904606405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 msgr2=0x56237e4bd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1674df9700 1 --2- 172.21.15.81:0/2904606405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 0x56237e4bd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1674df9700 1 -- 172.21.15.81:0/2904606405 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56237e28e3b0 con 0x56237e4c2e00 2024-05-09T00:10:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f1674df9700 1 --2- 172.21.15.81:0/2904606405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4c2e00 0x56237e4c31e0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f166400e4e0 tx=0x7f1664014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aca25636f9178dd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.281+0000 7f165affd700 1 -- 172.21.15.81:0/2904606405 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1664026430 con 0x56237e4c2e00 2024-05-09T00:10:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.282+0000 7f165affd700 1 -- 172.21.15.81:0/2904606405 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1664021070 con 0x56237e4c2e00 2024-05-09T00:10:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.282+0000 7f165affd700 1 -- 172.21.15.81:0/2904606405 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166401d6e0 con 0x56237e4c2e00 2024-05-09T00:10:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.282+0000 7f1683217b80 1 -- 172.21.15.81:0/2904606405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4c2e00 msgr2=0x56237e4c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.282+0000 7f1683217b80 1 --2- 172.21.15.81:0/2904606405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4c2e00 0x56237e4c31e0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f166400e4e0 tx=0x7f1664014000 comp rx=0 tx=0).stop 2024-05-09T00:10:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.282+0000 7f1683217b80 1 -- 172.21.15.81:0/2904606405 shutdown_connections 2024-05-09T00:10:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.282+0000 7f1683217b80 1 --2- 172.21.15.81:0/2904606405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4bd890 0x56237e4bdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.282+0000 7f1683217b80 1 --2- 172.21.15.81:0/2904606405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4c2e00 0x56237e4c31e0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.282+0000 7f1683217b80 1 --2- 172.21.15.81:0/2904606405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 0x56237e4bd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.282+0000 7f1683217b80 1 -- 172.21.15.81:0/2904606405 >> 172.21.15.81:0/2904606405 conn(0x56237e41b210 msgr2=0x56237e4b7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.282+0000 7f1683217b80 1 -- 172.21.15.81:0/2904606405 shutdown_connections 2024-05-09T00:10:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.282+0000 7f1683217b80 1 -- 172.21.15.81:0/2904606405 wait complete. 2024-05-09T00:10:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1683217b80 1 -- start start 2024-05-09T00:10:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1683217b80 1 Processor -- start 2024-05-09T00:10:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1683217b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4bd890 0x56237e4c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1683217b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4c2e00 0x56237e4c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1683217b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 0x56237e4c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1683217b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237e3a9560 con 0x56237e4bd890 2024-05-09T00:10:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1683217b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237e3a9200 con 0x56237e4c3720 2024-05-09T00:10:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1683217b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237e2906a0 con 0x56237e4c2e00 2024-05-09T00:10:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1683217b80 10 client.0 _ll_register_callbacks cb 0x56237e3b2b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1674df9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4bd890 0x56237e4c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1674df9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4bd890 0x56237e4c6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49004/0 (socket says 172.21.15.81:49004) 2024-05-09T00:10:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1674df9700 1 -- 172.21.15.81:0/4174126144 learned_addr learned my addr 172.21.15.81:0/4174126144 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f166ffff700 1 --2- 172.21.15.81:0/4174126144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4c2e00 0x56237e4c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f16755fa700 1 --2- 172.21.15.81:0/4174126144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 0x56237e4c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1674df9700 1 -- 172.21.15.81:0/4174126144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4c2e00 msgr2=0x56237e4c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1674df9700 1 --2- 172.21.15.81:0/4174126144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4c2e00 0x56237e4c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1674df9700 1 -- 172.21.15.81:0/4174126144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 msgr2=0x56237e4c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1674df9700 1 --2- 172.21.15.81:0/4174126144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 0x56237e4c7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.283+0000 7f1674df9700 1 -- 172.21.15.81:0/4174126144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1664017070 con 0x56237e4bd890 2024-05-09T00:10:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f1674df9700 1 --2- 172.21.15.81:0/4174126144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4bd890 0x56237e4c6c80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f166400ed30 tx=0x7f166400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db125921b6fe87e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f164ffff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f164ffff700 1 -- 172.21.15.81:0/4174126144 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1664005390 con 0x56237e4bd890 2024-05-09T00:10:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f1683217b80 1 -- 172.21.15.81:0/4174126144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56237e366270 con 0x56237e4bd890 2024-05-09T00:10:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f164ffff700 1 -- 172.21.15.81:0/4174126144 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f16640054f0 con 0x56237e4bd890 2024-05-09T00:10:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f164ffff700 1 -- 172.21.15.81:0/4174126144 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16640056b0 con 0x56237e4bd890 2024-05-09T00:10:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f1683217b80 10 client.17463 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f1683217b80 1 -- 172.21.15.81:0/4174126144 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56237e23ab60 con 0x56237e4bd890 2024-05-09T00:10:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f164ffff700 1 -- 172.21.15.81:0/4174126144 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56237e366270 con 0x56237e4bd890 2024-05-09T00:10:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f164ffff700 1 -- 172.21.15.81:0/4174126144 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1664003c00 con 0x56237e4bd890 2024-05-09T00:10:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f1683217b80 10 client.17463 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f1683217b80 10 client.17463 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:10:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f1683217b80 20 client.17463 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f1683217b80 1 --2- 172.21.15.81:0/4174126144 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56237e4d7160 0x56237e4d9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f1683217b80 4 client.17463 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.284+0000 7f1683217b80 1 -- 172.21.15.81:0/4174126144 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56237e48c810 con 0x56237e4d7160 2024-05-09T00:10:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.285+0000 7f166ffff700 1 --2- 172.21.15.81:0/4174126144 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56237e4d7160 0x56237e4d9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.285+0000 7f164ffff700 10 client.17463 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:10:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.285+0000 7f166ffff700 1 --2- 172.21.15.81:0/4174126144 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56237e4d7160 0x56237e4d9580 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=327856092ad030ab server_cookie=185d6fdcdb40c787 in_seq=0 out_seq=0 2024-05-09T00:10:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f164ffff700 1 -- 172.21.15.81:0/4174126144 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56237e48c810 con 0x56237e4d7160 2024-05-09T00:10:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f164ffff700 10 client.17463 handle_command_reply: tid=0 2024-05-09T00:10:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f1683217b80 1 client.17463 shutdown 2024-05-09T00:10:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f1683217b80 1 -- 172.21.15.81:0/4174126144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4bd890 msgr2=0x56237e4c6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f1683217b80 1 --2- 172.21.15.81:0/4174126144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4bd890 0x56237e4c6c80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f166400ed30 tx=0x7f166400ed60 comp rx=0 tx=0).stop 2024-05-09T00:10:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f1683217b80 1 -- 172.21.15.81:0/4174126144 shutdown_connections 2024-05-09T00:10:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f1683217b80 1 --2- 172.21.15.81:0/4174126144 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56237e4d7160 0x56237e4d9580 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f1683217b80 1 --2- 172.21.15.81:0/4174126144 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 0x56237e4c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f164ffff700 0 client.17463 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:10:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f1683217b80 1 --2- 172.21.15.81:0/4174126144 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4bd890 0x56237e4c6c80 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f1683217b80 1 --2- 172.21.15.81:0/4174126144 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4c2e00 0x56237e4c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f1683217b80 1 -- 172.21.15.81:0/4174126144 >> 172.21.15.81:0/4174126144 conn(0x56237e41b210 msgr2=0x56237e4b75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f1683217b80 1 -- 172.21.15.81:0/4174126144 shutdown_connections 2024-05-09T00:10:09.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f1683217b80 1 -- 172.21.15.81:0/4174126144 wait complete. 2024-05-09T00:10:09.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.286+0000 7f1683217b80 20 client.17463 trim_cache size 0 max 16384 2024-05-09T00:10:09.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1683217b80 1 Processor -- start 2024-05-09T00:10:09.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1683217b80 1 -- start start 2024-05-09T00:10:09.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1683217b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4bd890 0x56237e4d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1683217b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4c2e00 0x56237e4d2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1683217b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 0x56237e4b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1683217b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237e4de790 con 0x56237e4bd890 2024-05-09T00:10:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1683217b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237e4d9be0 con 0x56237e4c3720 2024-05-09T00:10:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1683217b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237e4c51d0 con 0x56237e4c2e00 2024-05-09T00:10:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1674df9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4bd890 0x56237e4d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1674df9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4bd890 0x56237e4d32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49008/0 (socket says 172.21.15.81:49008) 2024-05-09T00:10:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1674df9700 1 -- 172.21.15.81:0/3978359050 learned_addr learned my addr 172.21.15.81:0/3978359050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f166ffff700 1 --2- 172.21.15.81:0/3978359050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4c2e00 0x56237e4d2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f16755fa700 1 --2- 172.21.15.81:0/3978359050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 0x56237e4b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1674df9700 1 -- 172.21.15.81:0/3978359050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4c2e00 msgr2=0x56237e4d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1674df9700 1 --2- 172.21.15.81:0/3978359050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4c2e00 0x56237e4d2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1674df9700 1 -- 172.21.15.81:0/3978359050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 msgr2=0x56237e4b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1674df9700 1 --2- 172.21.15.81:0/3978359050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 0x56237e4b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f1674df9700 1 -- 172.21.15.81:0/3978359050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56237e3d3560 con 0x56237e4bd890 2024-05-09T00:10:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.299+0000 7f16755fa700 1 --2- 172.21.15.81:0/3978359050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 0x56237e4b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:09.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.300+0000 7f1674df9700 1 --2- 172.21.15.81:0/3978359050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4bd890 0x56237e4d32f0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f1664009ac0 tx=0x7f1664005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a378714fe2d279d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.300+0000 7f165b7fe700 1 -- 172.21.15.81:0/3978359050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16640092d0 con 0x56237e4bd890 2024-05-09T00:10:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.300+0000 7f165b7fe700 1 -- 172.21.15.81:0/3978359050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1664026620 con 0x56237e4bd890 2024-05-09T00:10:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.300+0000 7f165b7fe700 1 -- 172.21.15.81:0/3978359050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166401c410 con 0x56237e4bd890 2024-05-09T00:10:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.300+0000 7f1683217b80 1 -- 172.21.15.81:0/3978359050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4bd890 msgr2=0x56237e4d32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.300+0000 7f1683217b80 1 --2- 172.21.15.81:0/3978359050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4bd890 0x56237e4d32f0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f1664009ac0 tx=0x7f1664005ce0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.300+0000 7f1683217b80 1 -- 172.21.15.81:0/3978359050 shutdown_connections 2024-05-09T00:10:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.300+0000 7f1683217b80 1 --2- 172.21.15.81:0/3978359050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c3720 0x56237e4b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.300+0000 7f1683217b80 1 --2- 172.21.15.81:0/3978359050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4bd890 0x56237e4d32f0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.300+0000 7f1683217b80 1 --2- 172.21.15.81:0/3978359050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4c2e00 0x56237e4d2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.300+0000 7f1683217b80 1 -- 172.21.15.81:0/3978359050 >> 172.21.15.81:0/3978359050 conn(0x56237e41b210 msgr2=0x56237e4c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.300+0000 7f1683217b80 1 -- 172.21.15.81:0/3978359050 shutdown_connections 2024-05-09T00:10:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.300+0000 7f1683217b80 1 -- 172.21.15.81:0/3978359050 wait complete. 2024-05-09T00:10:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f1683217b80 1 -- start start 2024-05-09T00:10:09.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f1683217b80 1 Processor -- start 2024-05-09T00:10:09.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f1683217b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4bd890 0x56237e4cc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f1683217b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c2e00 0x56237e4cc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f1683217b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4c3720 0x56237e4ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f1683217b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237e52c750 con 0x56237e4c3720 2024-05-09T00:10:09.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f1683217b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237e52c8c0 con 0x56237e4c2e00 2024-05-09T00:10:09.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f1683217b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237e52ca80 con 0x56237e4bd890 2024-05-09T00:10:09.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f1683217b80 10 client.0 _ll_register_callbacks cb 0x56237e3b2b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:09.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f16755fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4c3720 0x56237e4ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f16755fa700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4c3720 0x56237e4ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49016/0 (socket says 172.21.15.81:49016) 2024-05-09T00:10:09.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f16755fa700 1 -- 172.21.15.81:0/3207350699 learned_addr learned my addr 172.21.15.81:0/3207350699 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f1674df9700 1 --2- 172.21.15.81:0/3207350699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4bd890 0x56237e4cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f166ffff700 1 --2- 172.21.15.81:0/3207350699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c2e00 0x56237e4cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f16755fa700 1 -- 172.21.15.81:0/3207350699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4bd890 msgr2=0x56237e4cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f16755fa700 1 --2- 172.21.15.81:0/3207350699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4bd890 0x56237e4cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.301+0000 7f16755fa700 1 -- 172.21.15.81:0/3207350699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c2e00 msgr2=0x56237e4cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f16755fa700 1 --2- 172.21.15.81:0/3207350699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c2e00 0x56237e4cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f16755fa700 1 -- 172.21.15.81:0/3207350699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56237e23ab60 con 0x56237e4c3720 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f166ffff700 1 --2- 172.21.15.81:0/3207350699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c2e00 0x56237e4cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f16755fa700 1 --2- 172.21.15.81:0/3207350699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4c3720 0x56237e4ccbd0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f1668009fd0 tx=0x7f1668097750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=202c13ae5ad05e98 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f164ffff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f164ffff700 1 -- 172.21.15.81:0/3207350699 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166809acf0 con 0x56237e4c3720 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f1683217b80 1 -- 172.21.15.81:0/3207350699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1664021070 con 0x56237e4c3720 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f164ffff700 1 -- 172.21.15.81:0/3207350699 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f166809ba90 con 0x56237e4c3720 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f164ffff700 1 -- 172.21.15.81:0/3207350699 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f166809b390 con 0x56237e4c3720 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f1683217b80 10 client.17469 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f1683217b80 1 -- 172.21.15.81:0/3207350699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56237e292cd0 con 0x56237e4c3720 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f164ffff700 1 -- 172.21.15.81:0/3207350699 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16680a7020 con 0x56237e4c3720 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f164ffff700 1 -- 172.21.15.81:0/3207350699 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f166809a880 con 0x56237e4c3720 2024-05-09T00:10:09.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f1683217b80 10 client.17469 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f1683217b80 10 client.17469 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f1683217b80 20 client.17469 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f1683217b80 1 --2- 172.21.15.81:0/3207350699 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56237e52e030 0x56237e530450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f1683217b80 4 client.17469 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.302+0000 7f1683217b80 1 -- 172.21.15.81:0/3207350699 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56237e405ec0 con 0x56237e52e030 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.303+0000 7f1674df9700 1 --2- 172.21.15.81:0/3207350699 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56237e52e030 0x56237e530450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.303+0000 7f164ffff700 10 client.17469 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.303+0000 7f1674df9700 1 --2- 172.21.15.81:0/3207350699 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56237e52e030 0x56237e530450 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ea864bde83cb6cc server_cookie=f6cabf14966688b5 in_seq=0 out_seq=0 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.303+0000 7f164ffff700 1 -- 172.21.15.81:0/3207350699 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56237e405ec0 con 0x56237e52e030 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.303+0000 7f164ffff700 10 client.17469 handle_command_reply: tid=0 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.303+0000 7f1683217b80 1 client.17469 shutdown 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f1683217b80 1 -- 172.21.15.81:0/3207350699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4c3720 msgr2=0x56237e4ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f1683217b80 1 --2- 172.21.15.81:0/3207350699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4c3720 0x56237e4ccbd0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f1668009fd0 tx=0x7f1668097750 comp rx=0 tx=0).stop 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f1683217b80 1 -- 172.21.15.81:0/3207350699 shutdown_connections 2024-05-09T00:10:09.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f1683217b80 1 --2- 172.21.15.81:0/3207350699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56237e4c3720 0x56237e4ccbd0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f1683217b80 1 --2- 172.21.15.81:0/3207350699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56237e4bd890 0x56237e4cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f1683217b80 1 --2- 172.21.15.81:0/3207350699 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56237e52e030 0x56237e530450 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f1683217b80 1 --2- 172.21.15.81:0/3207350699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56237e4c2e00 0x56237e4cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f164ffff700 0 client.17469 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:10:09.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f1683217b80 1 -- 172.21.15.81:0/3207350699 >> 172.21.15.81:0/3207350699 conn(0x56237e41b210 msgr2=0x56237e4c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f1683217b80 1 -- 172.21.15.81:0/3207350699 shutdown_connections 2024-05-09T00:10:09.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f1683217b80 1 -- 172.21.15.81:0/3207350699 wait complete. 2024-05-09T00:10:09.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f1683217b80 20 client.17469 trim_cache size 0 max 16384 2024-05-09T00:10:09.307 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:10:09.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f167705d700 1 -- 172.21.15.81:0/2455588314 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f16600a1310 msgr2=0x7f16600a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f167705d700 1 --2- 172.21.15.81:0/2455588314 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f16600a1310 0x7f16600a37d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1664009c60 tx=0x7f1664009260 comp rx=0 tx=0).stop 2024-05-09T00:10:09.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f167705d700 1 -- 172.21.15.81:0/2455588314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1670073d20 msgr2=0x7f16701a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f167705d700 1 --2- 172.21.15.81:0/2455588314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1670073d20 0x7f16701a5730 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f1668006130 tx=0x7f1668007cf0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f167705d700 1 -- 172.21.15.81:0/2455588314 shutdown_connections 2024-05-09T00:10:09.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f167705d700 1 --2- 172.21.15.81:0/2455588314 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f16600a1310 0x7f16600a37d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f167705d700 1 --2- 172.21.15.81:0/2455588314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1670073d20 0x7f16701a5730 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f167705d700 1 --2- 172.21.15.81:0/2455588314 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1670101180 0x7f16700732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f167705d700 1 --2- 172.21.15.81:0/2455588314 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f16701062a0 0x7f16700737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f167705d700 1 -- 172.21.15.81:0/2455588314 >> 172.21.15.81:0/2455588314 conn(0x7f16700fc9e0 msgr2=0x7f16700fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f167705d700 1 -- 172.21.15.81:0/2455588314 shutdown_connections 2024-05-09T00:10:09.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.304+0000 7f167705d700 1 -- 172.21.15.81:0/2455588314 wait complete. 2024-05-09T00:10:09.309 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:08 smithi171 ceph-mon[47351]: pgmap v219: 97 pgs: 97 active+clean; 3.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 102 KiB/s wr, 35 op/s 2024-05-09T00:10:09.311 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:08 smithi081 ceph-mon[42474]: pgmap v219: 97 pgs: 97 active+clean; 3.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 102 KiB/s wr, 35 op/s 2024-05-09T00:10:09.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:10:09.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.440+0000 7f6ad3901700 1 -- 172.21.15.81:0/1657251862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc1062a0 msgr2=0x7f6acc10de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.440+0000 7f6ad3901700 1 --2- 172.21.15.81:0/1657251862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc1062a0 0x7f6acc10de20 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400b0a0 tx=0x7f6ac400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.440+0000 7f6ad3901700 1 -- 172.21.15.81:0/1657251862 shutdown_connections 2024-05-09T00:10:09.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.440+0000 7f6ad3901700 1 --2- 172.21.15.81:0/1657251862 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6acc101180 0x7f6acc101560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.440+0000 7f6ad3901700 1 --2- 172.21.15.81:0/1657251862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc1062a0 0x7f6acc10de20 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.440+0000 7f6ad3901700 1 --2- 172.21.15.81:0/1657251862 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6acc101b30 0x7f6acc105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.440+0000 7f6ad3901700 1 -- 172.21.15.81:0/1657251862 >> 172.21.15.81:0/1657251862 conn(0x7f6acc0fc9e0 msgr2=0x7f6acc0fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.440+0000 7f6ad3901700 1 -- 172.21.15.81:0/1657251862 shutdown_connections 2024-05-09T00:10:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.440+0000 7f6ad3901700 1 -- 172.21.15.81:0/1657251862 wait complete. 2024-05-09T00:10:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad3901700 1 Processor -- start 2024-05-09T00:10:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad3901700 1 -- start start 2024-05-09T00:10:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad3901700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc101180 0x7f6acc1975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad3901700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6acc1062a0 0x7f6acc197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad3901700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6acc19be40 0x7f6acc19c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad3901700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc19c8c0 con 0x7f6acc101180 2024-05-09T00:10:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad3901700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc19ca30 con 0x7f6acc1062a0 2024-05-09T00:10:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad3901700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc19cbf0 con 0x7f6acc19be40 2024-05-09T00:10:09.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad169d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc101180 0x7f6acc1975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad169d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc101180 0x7f6acc1975b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49040/0 (socket says 172.21.15.81:49040) 2024-05-09T00:10:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad169d700 1 -- 172.21.15.81:0/3984852383 learned_addr learned my addr 172.21.15.81:0/3984852383 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad1e9e700 1 --2- 172.21.15.81:0/3984852383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6acc19be40 0x7f6acc19c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad0e9c700 1 --2- 172.21.15.81:0/3984852383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6acc1062a0 0x7f6acc197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad169d700 1 -- 172.21.15.81:0/3984852383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6acc19be40 msgr2=0x7f6acc19c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad169d700 1 --2- 172.21.15.81:0/3984852383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6acc19be40 0x7f6acc19c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad169d700 1 -- 172.21.15.81:0/3984852383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6acc1062a0 msgr2=0x7f6acc197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad169d700 1 --2- 172.21.15.81:0/3984852383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6acc1062a0 0x7f6acc197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.441+0000 7f6ad169d700 1 -- 172.21.15.81:0/3984852383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac4009d00 con 0x7f6acc101180 2024-05-09T00:10:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.442+0000 7f6ad169d700 1 --2- 172.21.15.81:0/3984852383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc101180 0x7f6acc1975b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800c920 tx=0x7f6ac800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.442+0000 7f6abe7fc700 1 -- 172.21.15.81:0/3984852383 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8004a30 con 0x7f6acc101180 2024-05-09T00:10:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.442+0000 7f6abe7fc700 1 -- 172.21.15.81:0/3984852383 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ac80054e0 con 0x7f6acc101180 2024-05-09T00:10:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.442+0000 7f6ad3901700 1 -- 172.21.15.81:0/3984852383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6acc1a4150 con 0x7f6acc101180 2024-05-09T00:10:09.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.442+0000 7f6abe7fc700 1 -- 172.21.15.81:0/3984852383 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8007bd0 con 0x7f6acc101180 2024-05-09T00:10:09.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.442+0000 7f6ad3901700 1 -- 172.21.15.81:0/3984852383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6acc1a4630 con 0x7f6acc101180 2024-05-09T00:10:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.444+0000 7f6abe7fc700 1 -- 172.21.15.81:0/3984852383 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6ac8005000 con 0x7f6acc101180 2024-05-09T00:10:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.444+0000 7f6abe7fc700 1 --2- 172.21.15.81:0/3984852383 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6ab80a1290 0x7f6ab80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.444+0000 7f6abe7fc700 1 -- 172.21.15.81:0/3984852383 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f6ac80cc8b0 con 0x7f6acc101180 2024-05-09T00:10:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.444+0000 7f6ad0e9c700 1 --2- 172.21.15.81:0/3984852383 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6ab80a1290 0x7f6ab80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.445+0000 7f6ad0e9c700 1 --2- 172.21.15.81:0/3984852383 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6ab80a1290 0x7f6ab80a3750 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6acc198ab0 tx=0x7f6ac00073d0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.445+0000 7f6adfabbb80 1 Processor -- start 2024-05-09T00:10:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.445+0000 7f6adfabbb80 1 -- start start 2024-05-09T00:10:09.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6adfabbb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de5180be00 0x55de5180c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6adfabbb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180c720 0x55de51806350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6adfabbb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de51806890 0x55de51806cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6adfabbb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5175d150 con 0x55de5180c720 2024-05-09T00:10:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6adfabbb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5175ab10 con 0x55de5180be00 2024-05-09T00:10:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6adfabbb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de51756400 con 0x55de51806890 2024-05-09T00:10:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6ad0e9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180c720 0x55de51806350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6ad0e9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180c720 0x55de51806350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49052/0 (socket says 172.21.15.81:49052) 2024-05-09T00:10:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6ad0e9c700 1 -- 172.21.15.81:0/2605887851 learned_addr learned my addr 172.21.15.81:0/2605887851 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6ad1e9e700 1 --2- 172.21.15.81:0/2605887851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de51806890 0x55de51806cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6ad169d700 1 --2- 172.21.15.81:0/2605887851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de5180be00 0x55de5180c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6ad0e9c700 1 -- 172.21.15.81:0/2605887851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de51806890 msgr2=0x55de51806cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6ad0e9c700 1 --2- 172.21.15.81:0/2605887851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de51806890 0x55de51806cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6ad0e9c700 1 -- 172.21.15.81:0/2605887851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de5180be00 msgr2=0x55de5180c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6ad0e9c700 1 --2- 172.21.15.81:0/2605887851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de5180be00 0x55de5180c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6ad0e9c700 1 -- 172.21.15.81:0/2605887851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de515d73b0 con 0x55de5180c720 2024-05-09T00:10:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6ad0e9c700 1 --2- 172.21.15.81:0/2605887851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180c720 0x55de51806350 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0010d30 tx=0x7f6ac0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4130499b0da0e145 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6ab77fe700 1 -- 172.21.15.81:0/2605887851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0011b80 con 0x55de5180c720 2024-05-09T00:10:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6ab77fe700 1 -- 172.21.15.81:0/2605887851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ac0015070 con 0x55de5180c720 2024-05-09T00:10:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.446+0000 7f6ab77fe700 1 -- 172.21.15.81:0/2605887851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac001c610 con 0x55de5180c720 2024-05-09T00:10:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.447+0000 7f6adfabbb80 1 -- 172.21.15.81:0/2605887851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180c720 msgr2=0x55de51806350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.447+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/2605887851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180c720 0x55de51806350 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0010d30 tx=0x7f6ac0013000 comp rx=0 tx=0).stop 2024-05-09T00:10:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.447+0000 7f6adfabbb80 1 -- 172.21.15.81:0/2605887851 shutdown_connections 2024-05-09T00:10:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.447+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/2605887851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de5180be00 0x55de5180c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.447+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/2605887851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de51806890 0x55de51806cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.447+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/2605887851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180c720 0x55de51806350 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.447+0000 7f6adfabbb80 1 -- 172.21.15.81:0/2605887851 >> 172.21.15.81:0/2605887851 conn(0x55de51764210 msgr2=0x55de51800df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.447+0000 7f6adfabbb80 1 -- 172.21.15.81:0/2605887851 shutdown_connections 2024-05-09T00:10:09.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.447+0000 7f6adfabbb80 1 -- 172.21.15.81:0/2605887851 wait complete. 2024-05-09T00:10:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.447+0000 7f6adfabbb80 1 -- start start 2024-05-09T00:10:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6adfabbb80 1 Processor -- start 2024-05-09T00:10:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6adfabbb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de51806890 0x55de5180fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6adfabbb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180be00 0x55de5180ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6adfabbb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de5180c720 0x55de518104b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6adfabbb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de516f2560 con 0x55de5180be00 2024-05-09T00:10:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6adfabbb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de516f2200 con 0x55de51806890 2024-05-09T00:10:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6adfabbb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de515d96a0 con 0x55de5180c720 2024-05-09T00:10:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6adfabbb80 10 client.0 _ll_register_callbacks cb 0x55de516fbb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6ad0e9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180be00 0x55de5180ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6ad0e9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180be00 0x55de5180ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49060/0 (socket says 172.21.15.81:49060) 2024-05-09T00:10:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6ad0e9c700 1 -- 172.21.15.81:0/4278134844 learned_addr learned my addr 172.21.15.81:0/4278134844 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6ad1e9e700 1 --2- 172.21.15.81:0/4278134844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de5180c720 0x55de518104b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6ad169d700 1 --2- 172.21.15.81:0/4278134844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de51806890 0x55de5180fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6ad0e9c700 1 -- 172.21.15.81:0/4278134844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de5180c720 msgr2=0x55de518104b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6ad0e9c700 1 --2- 172.21.15.81:0/4278134844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de5180c720 0x55de518104b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6ad0e9c700 1 -- 172.21.15.81:0/4278134844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de51806890 msgr2=0x55de5180fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6ad0e9c700 1 --2- 172.21.15.81:0/4278134844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de51806890 0x55de5180fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.448+0000 7f6ad0e9c700 1 -- 172.21.15.81:0/4278134844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac00109e0 con 0x55de5180be00 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6ad0e9c700 1 --2- 172.21.15.81:0/4278134844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180be00 0x55de5180ff70 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0010d00 tx=0x7f6ac0011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405d426fd3f58b59 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6ab4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6ab4ff9700 1 -- 172.21.15.81:0/4278134844 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac002d070 con 0x55de5180be00 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6adfabbb80 1 -- 172.21.15.81:0/4278134844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de516af270 con 0x55de5180be00 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6ab4ff9700 1 -- 172.21.15.81:0/4278134844 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f6ac0017070 con 0x55de5180be00 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6ab4ff9700 1 -- 172.21.15.81:0/4278134844 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ac001fe70 con 0x55de5180be00 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6adfabbb80 10 client.17481 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6adfabbb80 1 -- 172.21.15.81:0/4278134844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55de51583b60 con 0x55de5180be00 2024-05-09T00:10:09.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6ab4ff9700 1 -- 172.21.15.81:0/4278134844 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ac003d020 con 0x55de5180be00 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6ab4ff9700 1 -- 172.21.15.81:0/4278134844 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6ac0003840 con 0x55de5180be00 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6adfabbb80 10 client.17481 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6adfabbb80 10 client.17481 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6adfabbb80 20 client.17481 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/4278134844 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55de518200d0 0x55de518224f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6adfabbb80 4 client.17481 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.449+0000 7f6adfabbb80 1 -- 172.21.15.81:0/4278134844 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de517d5810 con 0x55de518200d0 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.450+0000 7f6ad169d700 1 --2- 172.21.15.81:0/4278134844 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55de518200d0 0x55de518224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.450+0000 7f6ad169d700 1 --2- 172.21.15.81:0/4278134844 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55de518200d0 0x55de518224f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4032192b315d8fe0 server_cookie=e88564ff7941b100 in_seq=0 out_seq=0 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.450+0000 7f6ab4ff9700 10 client.17481 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6ab4ff9700 1 -- 172.21.15.81:0/4278134844 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55de517d5810 con 0x55de518200d0 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6ab4ff9700 10 client.17481 handle_command_reply: tid=0 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6adfabbb80 1 client.17481 shutdown 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6adfabbb80 1 -- 172.21.15.81:0/4278134844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180be00 msgr2=0x55de5180ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/4278134844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180be00 0x55de5180ff70 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0010d00 tx=0x7f6ac0011bb0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6adfabbb80 1 -- 172.21.15.81:0/4278134844 shutdown_connections 2024-05-09T00:10:09.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/4278134844 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55de518200d0 0x55de518224f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/4278134844 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de51806890 0x55de5180fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/4278134844 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de5180c720 0x55de518104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6ab4ff9700 0 client.17481 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:10:09.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/4278134844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180be00 0x55de5180ff70 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6adfabbb80 1 -- 172.21.15.81:0/4278134844 >> 172.21.15.81:0/4278134844 conn(0x55de51764210 msgr2=0x55de518005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6adfabbb80 1 -- 172.21.15.81:0/4278134844 shutdown_connections 2024-05-09T00:10:09.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6adfabbb80 1 -- 172.21.15.81:0/4278134844 wait complete. 2024-05-09T00:10:09.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.451+0000 7f6adfabbb80 20 client.17481 trim_cache size 0 max 16384 2024-05-09T00:10:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.464+0000 7f6adfabbb80 1 Processor -- start 2024-05-09T00:10:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.464+0000 7f6adfabbb80 1 -- start start 2024-05-09T00:10:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.464+0000 7f6adfabbb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de51806890 0x55de51806350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.464+0000 7f6adfabbb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180be00 0x55de51800d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.464+0000 7f6adfabbb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de5180c720 0x55de5180b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.464+0000 7f6adfabbb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de518276c0 con 0x55de5180be00 2024-05-09T00:10:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.464+0000 7f6adfabbb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5180df80 con 0x55de5180c720 2024-05-09T00:10:09.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.464+0000 7f6adfabbb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5180a450 con 0x55de51806890 2024-05-09T00:10:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.464+0000 7f6ad0e9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180be00 0x55de51800d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.464+0000 7f6ad0e9c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180be00 0x55de51800d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49072/0 (socket says 172.21.15.81:49072) 2024-05-09T00:10:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.464+0000 7f6ad0e9c700 1 -- 172.21.15.81:0/3995046264 learned_addr learned my addr 172.21.15.81:0/3995046264 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.464+0000 7f6ad169d700 1 --2- 172.21.15.81:0/3995046264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de51806890 0x55de51806350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.464+0000 7f6ad1e9e700 1 --2- 172.21.15.81:0/3995046264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de5180c720 0x55de5180b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6ad0e9c700 1 -- 172.21.15.81:0/3995046264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de51806890 msgr2=0x55de51806350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6ad0e9c700 1 --2- 172.21.15.81:0/3995046264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de51806890 0x55de51806350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6ad0e9c700 1 -- 172.21.15.81:0/3995046264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de5180c720 msgr2=0x55de5180b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6ad0e9c700 1 --2- 172.21.15.81:0/3995046264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de5180c720 0x55de5180b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6ad0e9c700 1 -- 172.21.15.81:0/3995046264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de51806f40 con 0x55de5180be00 2024-05-09T00:10:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6ad0e9c700 1 --2- 172.21.15.81:0/3995046264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180be00 0x55de51800d20 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0032420 tx=0x7f6ac0011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3168919acdbc62 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6ab7fff700 1 -- 172.21.15.81:0/3995046264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac002d070 con 0x55de5180be00 2024-05-09T00:10:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6ab7fff700 1 -- 172.21.15.81:0/3995046264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ac003d030 con 0x55de5180be00 2024-05-09T00:10:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6ab7fff700 1 -- 172.21.15.81:0/3995046264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac00324a0 con 0x55de5180be00 2024-05-09T00:10:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6adfabbb80 1 -- 172.21.15.81:0/3995046264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180be00 msgr2=0x55de51800d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/3995046264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180be00 0x55de51800d20 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0032420 tx=0x7f6ac0011ca0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6adfabbb80 1 -- 172.21.15.81:0/3995046264 shutdown_connections 2024-05-09T00:10:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/3995046264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de5180c720 0x55de5180b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/3995046264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de51806890 0x55de51806350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/3995046264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180be00 0x55de51800d20 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.465+0000 7f6adfabbb80 1 -- 172.21.15.81:0/3995046264 >> 172.21.15.81:0/3995046264 conn(0x55de51764210 msgr2=0x55de5180aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.466+0000 7f6adfabbb80 1 -- 172.21.15.81:0/3995046264 shutdown_connections 2024-05-09T00:10:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.466+0000 7f6adfabbb80 1 -- 172.21.15.81:0/3995046264 wait complete. 2024-05-09T00:10:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.466+0000 7f6adfabbb80 1 -- start start 2024-05-09T00:10:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.466+0000 7f6adfabbb80 1 Processor -- start 2024-05-09T00:10:09.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.466+0000 7f6adfabbb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de51806890 0x55de51815400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.466+0000 7f6adfabbb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de5180be00 0x55de51815940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.466+0000 7f6adfabbb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180c720 0x55de518799a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.466+0000 7f6adfabbb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de51879ee0 con 0x55de5180c720 2024-05-09T00:10:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.466+0000 7f6adfabbb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5187a020 con 0x55de51806890 2024-05-09T00:10:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.466+0000 7f6adfabbb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de5187a160 con 0x55de5180be00 2024-05-09T00:10:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.466+0000 7f6adfabbb80 10 client.0 _ll_register_callbacks cb 0x55de516fbb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.466+0000 7f6ad1e9e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180c720 0x55de518799a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.466+0000 7f6ad1e9e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180c720 0x55de518799a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49074/0 (socket says 172.21.15.81:49074) 2024-05-09T00:10:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.466+0000 7f6ad1e9e700 1 -- 172.21.15.81:0/342961610 learned_addr learned my addr 172.21.15.81:0/342961610 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ad0e9c700 1 --2- 172.21.15.81:0/342961610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de5180be00 0x55de51815940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ad169d700 1 --2- 172.21.15.81:0/342961610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de51806890 0x55de51815400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ad1e9e700 1 -- 172.21.15.81:0/342961610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de5180be00 msgr2=0x55de51815940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ad1e9e700 1 --2- 172.21.15.81:0/342961610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de5180be00 0x55de51815940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ad1e9e700 1 -- 172.21.15.81:0/342961610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de51806890 msgr2=0x55de51815400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ad1e9e700 1 --2- 172.21.15.81:0/342961610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de51806890 0x55de51815400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ad1e9e700 1 -- 172.21.15.81:0/342961610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de51583b60 con 0x55de5180c720 2024-05-09T00:10:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ad169d700 1 --2- 172.21.15.81:0/342961610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de51806890 0x55de51815400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ad1e9e700 1 --2- 172.21.15.81:0/342961610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180c720 0x55de518799a0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400b0a0 tx=0x7f6ac4003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1117068238fcbac2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ab4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ab4ff9700 1 -- 172.21.15.81:0/342961610 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400e040 con 0x55de5180c720 2024-05-09T00:10:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ab4ff9700 1 -- 172.21.15.81:0/342961610 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f6ac4024070 con 0x55de5180c720 2024-05-09T00:10:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6adfabbb80 1 -- 172.21.15.81:0/342961610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ac0015070 con 0x55de5180c720 2024-05-09T00:10:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ab4ff9700 1 -- 172.21.15.81:0/342961610 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ac4003e50 con 0x55de5180c720 2024-05-09T00:10:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6adfabbb80 10 client.17487 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6adfabbb80 1 -- 172.21.15.81:0/342961610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55de5171c560 con 0x55de5180c720 2024-05-09T00:10:09.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ab4ff9700 1 -- 172.21.15.81:0/342961610 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ac4034080 con 0x55de5180c720 2024-05-09T00:10:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6ab4ff9700 1 -- 172.21.15.81:0/342961610 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6ac400b0d0 con 0x55de5180c720 2024-05-09T00:10:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6adfabbb80 10 client.17487 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6adfabbb80 10 client.17487 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:10:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.467+0000 7f6adfabbb80 20 client.17487 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/342961610 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55de5187b950 0x55de5187dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6adfabbb80 4 client.17487 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:10:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6adfabbb80 1 -- 172.21.15.81:0/342961610 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55de5174eec0 con 0x55de5187b950 2024-05-09T00:10:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6ad169d700 1 --2- 172.21.15.81:0/342961610 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55de5187b950 0x55de5187dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6ab4ff9700 10 client.17487 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:10:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6ad169d700 1 --2- 172.21.15.81:0/342961610 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55de5187b950 0x55de5187dd70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e30e44506f186a29 server_cookie=94ca0d9c676168e7 in_seq=0 out_seq=0 2024-05-09T00:10:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6ab4ff9700 1 -- 172.21.15.81:0/342961610 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55de5174eec0 con 0x55de5187b950 2024-05-09T00:10:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6ab4ff9700 10 client.17487 handle_command_reply: tid=0 2024-05-09T00:10:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6adfabbb80 1 client.17487 shutdown 2024-05-09T00:10:09.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6adfabbb80 1 -- 172.21.15.81:0/342961610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180c720 msgr2=0x55de518799a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/342961610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180c720 0x55de518799a0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400b0a0 tx=0x7f6ac4003c30 comp rx=0 tx=0).stop 2024-05-09T00:10:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6adfabbb80 1 -- 172.21.15.81:0/342961610 shutdown_connections 2024-05-09T00:10:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/342961610 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55de5187b950 0x55de5187dd70 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/342961610 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de51806890 0x55de51815400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6ab4ff9700 0 client.17487 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:10:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/342961610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55de5180c720 0x55de518799a0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6adfabbb80 1 --2- 172.21.15.81:0/342961610 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55de5180be00 0x55de51815940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.468+0000 7f6adfabbb80 1 -- 172.21.15.81:0/342961610 >> 172.21.15.81:0/342961610 conn(0x55de51764210 msgr2=0x55de5180d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6adfabbb80 1 -- 172.21.15.81:0/342961610 shutdown_connections 2024-05-09T00:10:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6adfabbb80 1 -- 172.21.15.81:0/342961610 wait complete. 2024-05-09T00:10:09.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6adfabbb80 20 client.17487 trim_cache size 0 max 16384 2024-05-09T00:10:09.472 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:10:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6ad3901700 1 -- 172.21.15.81:0/3984852383 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6ab80a1290 msgr2=0x7f6ab80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6ad3901700 1 --2- 172.21.15.81:0/3984852383 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6ab80a1290 0x7f6ab80a3750 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6acc198ab0 tx=0x7f6ac00073d0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6ad3901700 1 -- 172.21.15.81:0/3984852383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc101180 msgr2=0x7f6acc1975b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6ad3901700 1 --2- 172.21.15.81:0/3984852383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc101180 0x7f6acc1975b0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800c920 tx=0x7f6ac800cc30 comp rx=0 tx=0).stop 2024-05-09T00:10:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6ad3901700 1 -- 172.21.15.81:0/3984852383 shutdown_connections 2024-05-09T00:10:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6ad3901700 1 --2- 172.21.15.81:0/3984852383 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6ab80a1290 0x7f6ab80a3750 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6ad3901700 1 --2- 172.21.15.81:0/3984852383 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6acc19be40 0x7f6acc19c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6ad3901700 1 --2- 172.21.15.81:0/3984852383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6acc101180 0x7f6acc1975b0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6ad3901700 1 --2- 172.21.15.81:0/3984852383 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6acc1062a0 0x7f6acc197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6ad3901700 1 -- 172.21.15.81:0/3984852383 >> 172.21.15.81:0/3984852383 conn(0x7f6acc0fc9e0 msgr2=0x7f6acc0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6ad3901700 1 -- 172.21.15.81:0/3984852383 shutdown_connections 2024-05-09T00:10:09.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.469+0000 7f6ad3901700 1 -- 172.21.15.81:0/3984852383 wait complete. 2024-05-09T00:10:09.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:10:09.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.604+0000 7f6eb2229700 1 -- 172.21.15.81:0/3200202361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac100a10 msgr2=0x7f6eac104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.604+0000 7f6eb2229700 1 --2- 172.21.15.81:0/3200202361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac100a10 0x7f6eac104a30 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009990 tx=0x7f6e94009ca0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.604+0000 7f6eb2229700 1 -- 172.21.15.81:0/3200202361 shutdown_connections 2024-05-09T00:10:09.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.604+0000 7f6eb2229700 1 --2- 172.21.15.81:0/3200202361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eac100060 0x7f6eac100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.604+0000 7f6eb2229700 1 --2- 172.21.15.81:0/3200202361 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eac105160 0x7f6eac10cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.604+0000 7f6eb2229700 1 --2- 172.21.15.81:0/3200202361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac100a10 0x7f6eac104a30 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.604+0000 7f6eb2229700 1 -- 172.21.15.81:0/3200202361 >> 172.21.15.81:0/3200202361 conn(0x7f6eac076f40 msgr2=0x7f6eac077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.604+0000 7f6eb2229700 1 -- 172.21.15.81:0/3200202361 shutdown_connections 2024-05-09T00:10:09.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.604+0000 7f6eb2229700 1 -- 172.21.15.81:0/3200202361 wait complete. 2024-05-09T00:10:09.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eb2229700 1 Processor -- start 2024-05-09T00:10:09.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eb2229700 1 -- start start 2024-05-09T00:10:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eb2229700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac100060 0x7f6eac1973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eb2229700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eac105160 0x7f6eac197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eb2229700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eac19bcc0 0x7f6eac19c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eb2229700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac19c740 con 0x7f6eac100060 2024-05-09T00:10:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eb2229700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac19c8b0 con 0x7f6eac19bcc0 2024-05-09T00:10:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eb2229700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eac19ca70 con 0x7f6eac105160 2024-05-09T00:10:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac100060 0x7f6eac1973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac100060 0x7f6eac1973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49084/0 (socket says 172.21.15.81:49084) 2024-05-09T00:10:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eab7fe700 1 -- 172.21.15.81:0/3305147209 learned_addr learned my addr 172.21.15.81:0/3305147209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eaaffd700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eac105160 0x7f6eac197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eabfff700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eac19bcc0 0x7f6eac19c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eab7fe700 1 -- 172.21.15.81:0/3305147209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eac105160 msgr2=0x7f6eac197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eab7fe700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eac105160 0x7f6eac197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eab7fe700 1 -- 172.21.15.81:0/3305147209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eac19bcc0 msgr2=0x7f6eac19c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eab7fe700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eac19bcc0 0x7f6eac19c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.605+0000 7f6eab7fe700 1 -- 172.21.15.81:0/3305147209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e940095f0 con 0x7f6eac100060 2024-05-09T00:10:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.606+0000 7f6eabfff700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eac19bcc0 0x7f6eac19c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.606+0000 7f6eab7fe700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac100060 0x7f6eac1973e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00d980 tx=0x7f6e9c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.606+0000 7f6ea8ff9700 1 -- 172.21.15.81:0/3305147209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c004220 con 0x7f6eac100060 2024-05-09T00:10:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.606+0000 7f6ea8ff9700 1 -- 172.21.15.81:0/3305147209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e9c007640 con 0x7f6eac100060 2024-05-09T00:10:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.606+0000 7f6eb2229700 1 -- 172.21.15.81:0/3305147209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eac1a3fd0 con 0x7f6eac100060 2024-05-09T00:10:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.606+0000 7f6ea8ff9700 1 -- 172.21.15.81:0/3305147209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c005610 con 0x7f6eac100060 2024-05-09T00:10:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.606+0000 7f6eb2229700 1 -- 172.21.15.81:0/3305147209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac1a43f0 con 0x7f6eac100060 2024-05-09T00:10:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.608+0000 7f6ea8ff9700 1 -- 172.21.15.81:0/3305147209 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6e9c004750 con 0x7f6eac100060 2024-05-09T00:10:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.608+0000 7f6ea8ff9700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6e980a1290 0x7f6e980a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.609+0000 7f6eaaffd700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6e980a1290 0x7f6e980a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.609+0000 7f6ea8ff9700 1 -- 172.21.15.81:0/3305147209 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f6e9c0ccb20 con 0x7f6eac100060 2024-05-09T00:10:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.609+0000 7f6eaaffd700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6e980a1290 0x7f6e980a3750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400b5c0 tx=0x7f6e94005a90 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.609+0000 7f6ebe3e3b80 1 Processor -- start 2024-05-09T00:10:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.609+0000 7f6ebe3e3b80 1 -- start start 2024-05-09T00:10:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.609+0000 7f6ebe3e3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 0x564f9875c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.609+0000 7f6ebe3e3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98756350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.609+0000 7f6ebe3e3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f98756890 0x564f98756cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.609+0000 7f6ebe3e3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f986ad150 con 0x564f98756890 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.609+0000 7f6ebe3e3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f986aab10 con 0x564f9875c720 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.609+0000 7f6ebe3e3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f986a6400 con 0x564f9875be00 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6eabfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f98756890 0x564f98756cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6eabfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f98756890 0x564f98756cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49088/0 (socket says 172.21.15.81:49088) 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6eabfff700 1 -- 172.21.15.81:0/3268734107 learned_addr learned my addr 172.21.15.81:0/3268734107 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6eab7fe700 1 --2- 172.21.15.81:0/3268734107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 0x564f9875c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6eaaffd700 1 --2- 172.21.15.81:0/3268734107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98756350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6eabfff700 1 -- 172.21.15.81:0/3268734107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 msgr2=0x564f9875c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6eabfff700 1 --2- 172.21.15.81:0/3268734107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 0x564f9875c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6eabfff700 1 -- 172.21.15.81:0/3268734107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 msgr2=0x564f98756350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6eabfff700 1 --2- 172.21.15.81:0/3268734107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98756350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6eabfff700 1 -- 172.21.15.81:0/3268734107 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f985273b0 con 0x564f98756890 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6eab7fe700 1 --2- 172.21.15.81:0/3268734107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 0x564f9875c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6eaaffd700 1 --2- 172.21.15.81:0/3268734107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98756350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6eabfff700 1 --2- 172.21.15.81:0/3268734107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f98756890 0x564f98756cd0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009cd0 tx=0x7f6ea4007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da72ec2df431680 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6ea1ffb700 1 -- 172.21.15.81:0/3268734107 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4014600 con 0x564f98756890 2024-05-09T00:10:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6ea1ffb700 1 -- 172.21.15.81:0/3268734107 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ea4007e40 con 0x564f98756890 2024-05-09T00:10:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.610+0000 7f6ea1ffb700 1 -- 172.21.15.81:0/3268734107 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4013ae0 con 0x564f98756890 2024-05-09T00:10:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.611+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/3268734107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f98756890 msgr2=0x564f98756cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.611+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/3268734107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f98756890 0x564f98756cd0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009cd0 tx=0x7f6ea4007500 comp rx=0 tx=0).stop 2024-05-09T00:10:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.611+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/3268734107 shutdown_connections 2024-05-09T00:10:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.611+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/3268734107 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f98756890 0x564f98756cd0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.611+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/3268734107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 0x564f9875c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.611+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/3268734107 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98756350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.611+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/3268734107 >> 172.21.15.81:0/3268734107 conn(0x564f986b4210 msgr2=0x564f98750df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.611+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/3268734107 shutdown_connections 2024-05-09T00:10:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.611+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/3268734107 wait complete. 2024-05-09T00:10:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.611+0000 7f6ebe3e3b80 1 -- start start 2024-05-09T00:10:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.611+0000 7f6ebe3e3b80 1 Processor -- start 2024-05-09T00:10:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6ebe3e3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f98756890 0x564f987627f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6ebe3e3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f9875be00 0x564f9875fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6ebe3e3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98760160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6ebe3e3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f98642560 con 0x564f9875be00 2024-05-09T00:10:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6ebe3e3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f98642200 con 0x564f9875c720 2024-05-09T00:10:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6ebe3e3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f985296a0 con 0x564f98756890 2024-05-09T00:10:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6ebe3e3b80 10 client.0 _ll_register_callbacks cb 0x564f9864bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6eaaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f9875be00 0x564f9875fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6eaaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f9875be00 0x564f9875fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49102/0 (socket says 172.21.15.81:49102) 2024-05-09T00:10:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6eaaffd700 1 -- 172.21.15.81:0/3770013602 learned_addr learned my addr 172.21.15.81:0/3770013602 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6eabfff700 1 --2- 172.21.15.81:0/3770013602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98760160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6eaaffd700 1 -- 172.21.15.81:0/3770013602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f98756890 msgr2=0x564f987627f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6eab7fe700 1 --2- 172.21.15.81:0/3770013602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f98756890 0x564f987627f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6eaaffd700 1 --2- 172.21.15.81:0/3770013602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f98756890 0x564f987627f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6eaaffd700 1 -- 172.21.15.81:0/3770013602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 msgr2=0x564f98760160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6eaaffd700 1 --2- 172.21.15.81:0/3770013602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98760160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6eaaffd700 1 -- 172.21.15.81:0/3770013602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea4009900 con 0x564f9875be00 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6eabfff700 1 --2- 172.21.15.81:0/3770013602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98760160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6eaaffd700 1 --2- 172.21.15.81:0/3770013602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f9875be00 0x564f9875fa70 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009990 tx=0x7f6e9401a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af59ddadac6c9db5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6e8affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6e8affd700 1 -- 172.21.15.81:0/3770013602 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94004d70 con 0x564f9875be00 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6e8affd700 1 -- 172.21.15.81:0/3770013602 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f6e9400f460 con 0x564f9875be00 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.612+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/3770013602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f985ff270 con 0x564f9875be00 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.613+0000 7f6e8affd700 1 -- 172.21.15.81:0/3770013602 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e94004ed0 con 0x564f9875be00 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.613+0000 7f6ebe3e3b80 10 client.17499 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.613+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/3770013602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564f984d3b60 con 0x564f9875be00 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.613+0000 7f6e8affd700 1 -- 172.21.15.81:0/3770013602 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564f985ff270 con 0x564f9875be00 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.613+0000 7f6e8affd700 1 -- 172.21.15.81:0/3770013602 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6e940039f0 con 0x564f9875be00 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.613+0000 7f6ebe3e3b80 10 client.17499 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.613+0000 7f6ebe3e3b80 10 client.17499 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.613+0000 7f6ebe3e3b80 20 client.17499 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.613+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/3770013602 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564f9876ffd0 0x564f987723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.613+0000 7f6ebe3e3b80 4 client.17499 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.613+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/3770013602 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f98725810 con 0x564f9876ffd0 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.613+0000 7f6eab7fe700 1 --2- 172.21.15.81:0/3770013602 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564f9876ffd0 0x564f987723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.614+0000 7f6e8affd700 10 client.17499 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.614+0000 7f6eab7fe700 1 --2- 172.21.15.81:0/3770013602 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564f9876ffd0 0x564f987723f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=598efc2a8e60063f server_cookie=82870d2fd6cb6fa9 in_seq=0 out_seq=0 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.614+0000 7f6e8affd700 1 -- 172.21.15.81:0/3770013602 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564f98725810 con 0x564f9876ffd0 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.614+0000 7f6e8affd700 10 client.17499 handle_command_reply: tid=0 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.614+0000 7f6ebe3e3b80 1 client.17499 shutdown 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.614+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/3770013602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f9875be00 msgr2=0x564f9875fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.614+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/3770013602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f9875be00 0x564f9875fa70 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009990 tx=0x7f6e9401a050 comp rx=0 tx=0).stop 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.614+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/3770013602 shutdown_connections 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.614+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/3770013602 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564f9876ffd0 0x564f987723f0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.614+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/3770013602 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98760160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.614+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/3770013602 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f98756890 0x564f987627f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.614+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/3770013602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f9875be00 0x564f9875fa70 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.614+0000 7f6e8affd700 0 client.17499 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:09.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.614+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/3770013602 >> 172.21.15.81:0/3770013602 conn(0x564f986b4210 msgr2=0x564f987505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.615+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/3770013602 shutdown_connections 2024-05-09T00:10:09.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.615+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/3770013602 wait complete. 2024-05-09T00:10:09.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.615+0000 7f6ebe3e3b80 20 client.17499 trim_cache size 0 max 16384 2024-05-09T00:10:09.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6ebe3e3b80 1 Processor -- start 2024-05-09T00:10:09.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6ebe3e3b80 1 -- start start 2024-05-09T00:10:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6ebe3e3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f98756890 0x564f98756350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6ebe3e3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 0x564f98750d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6ebe3e3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f9875c720 0x564f98767160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6ebe3e3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f9875c560 con 0x564f9875c720 2024-05-09T00:10:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6ebe3e3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f987775e0 con 0x564f98756890 2024-05-09T00:10:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6ebe3e3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f98757230 con 0x564f9875be00 2024-05-09T00:10:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6eabfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f9875c720 0x564f98767160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6eabfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f9875c720 0x564f98767160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49110/0 (socket says 172.21.15.81:49110) 2024-05-09T00:10:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6eabfff700 1 -- 172.21.15.81:0/230230051 learned_addr learned my addr 172.21.15.81:0/230230051 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6eaaffd700 1 --2- 172.21.15.81:0/230230051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 0x564f98750d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6eab7fe700 1 --2- 172.21.15.81:0/230230051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f98756890 0x564f98756350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6eabfff700 1 -- 172.21.15.81:0/230230051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 msgr2=0x564f98750d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6eabfff700 1 --2- 172.21.15.81:0/230230051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 0x564f98750d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6eabfff700 1 -- 172.21.15.81:0/230230051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f98756890 msgr2=0x564f98756350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6eabfff700 1 --2- 172.21.15.81:0/230230051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f98756890 0x564f98756350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.628+0000 7f6eabfff700 1 -- 172.21.15.81:0/230230051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f9866c560 con 0x564f9875c720 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.629+0000 7f6eabfff700 1 --2- 172.21.15.81:0/230230051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f9875c720 0x564f98767160 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400c040 tx=0x7f6ea4009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517e03c88a5e0ba5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.629+0000 7f6ea27fc700 1 -- 172.21.15.81:0/230230051 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4004c90 con 0x564f9875c720 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.629+0000 7f6ea27fc700 1 -- 172.21.15.81:0/230230051 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ea4004df0 con 0x564f9875c720 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.629+0000 7f6ea27fc700 1 -- 172.21.15.81:0/230230051 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea401d8c0 con 0x564f9875c720 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.629+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/230230051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f9875c720 msgr2=0x564f98767160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.629+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/230230051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f9875c720 0x564f98767160 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400c040 tx=0x7f6ea4009860 comp rx=0 tx=0).stop 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.629+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/230230051 shutdown_connections 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.629+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/230230051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f98756890 0x564f98756350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.629+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/230230051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f9875c720 0x564f98767160 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.629+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/230230051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 0x564f98750d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.629+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/230230051 >> 172.21.15.81:0/230230051 conn(0x564f986b4210 msgr2=0x564f98752850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.629+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/230230051 shutdown_connections 2024-05-09T00:10:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.629+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/230230051 wait complete. 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6ebe3e3b80 1 -- start start 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6ebe3e3b80 1 Processor -- start 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6ebe3e3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f98756890 0x564f98767170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6ebe3e3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 0x564f987676b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6ebe3e3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98757930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6ebe3e3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f98757e70 con 0x564f98756890 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6ebe3e3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f98757fe0 con 0x564f9875c720 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6ebe3e3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f987581a0 con 0x564f9875be00 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6ebe3e3b80 10 client.0 _ll_register_callbacks cb 0x564f9864bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6eab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f98756890 0x564f98767170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6eab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f98756890 0x564f98767170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49122/0 (socket says 172.21.15.81:49122) 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6eab7fe700 1 -- 172.21.15.81:0/94337684 learned_addr learned my addr 172.21.15.81:0/94337684 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6eaaffd700 1 --2- 172.21.15.81:0/94337684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 0x564f987676b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6eabfff700 1 --2- 172.21.15.81:0/94337684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98757930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6eab7fe700 1 -- 172.21.15.81:0/94337684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 msgr2=0x564f987676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6eab7fe700 1 --2- 172.21.15.81:0/94337684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 0x564f987676b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6eab7fe700 1 -- 172.21.15.81:0/94337684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 msgr2=0x564f98757930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6eab7fe700 1 --2- 172.21.15.81:0/94337684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98757930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6eab7fe700 1 -- 172.21.15.81:0/94337684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f985273b0 con 0x564f98756890 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.630+0000 7f6eabfff700 1 --2- 172.21.15.81:0/94337684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98757930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6eab7fe700 1 --2- 172.21.15.81:0/94337684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f98756890 0x564f98767170 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0998d0 tx=0x7f6e9c00d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b831108059a622f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6e8affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6e8affd700 1 -- 172.21.15.81:0/94337684 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c004380 con 0x564f98756890 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6e8affd700 1 -- 172.21.15.81:0/94337684 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f6e9c09abe0 con 0x564f98756890 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/94337684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ea4007e40 con 0x564f98756890 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6e8affd700 1 -- 172.21.15.81:0/94337684 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e9c09ada0 con 0x564f98756890 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6ebe3e3b80 10 client.17505 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/94337684 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564f9852bcd0 con 0x564f98756890 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6e8affd700 1 -- 172.21.15.81:0/94337684 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e9c065080 con 0x564f98756890 2024-05-09T00:10:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6e8affd700 1 -- 172.21.15.81:0/94337684 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6e9c0b22f0 con 0x564f98756890 2024-05-09T00:10:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6ebe3e3b80 10 client.17505 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6ebe3e3b80 10 client.17505 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6ebe3e3b80 20 client.17505 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/94337684 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564f987c7240 0x564f987c9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6ebe3e3b80 4 client.17505 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:10:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.631+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/94337684 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564f9869eec0 con 0x564f987c7240 2024-05-09T00:10:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6eaaffd700 1 --2- 172.21.15.81:0/94337684 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564f987c7240 0x564f987c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6e8affd700 10 client.17505 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6eaaffd700 1 --2- 172.21.15.81:0/94337684 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564f987c7240 0x564f987c9660 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42fd60bd05bff8f2 server_cookie=136e0b78edae918f in_seq=0 out_seq=0 2024-05-09T00:10:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6e8affd700 1 -- 172.21.15.81:0/94337684 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564f9869eec0 con 0x564f987c7240 2024-05-09T00:10:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6e8affd700 10 client.17505 handle_command_reply: tid=0 2024-05-09T00:10:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6ebe3e3b80 1 client.17505 shutdown 2024-05-09T00:10:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/94337684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f98756890 msgr2=0x564f98767170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/94337684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f98756890 0x564f98767170 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0998d0 tx=0x7f6e9c00d8d0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/94337684 shutdown_connections 2024-05-09T00:10:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/94337684 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564f987c7240 0x564f987c9660 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/94337684 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564f9875c720 0x564f98757930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6e8affd700 0 client.17505 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/94337684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564f98756890 0x564f98767170 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6ebe3e3b80 1 --2- 172.21.15.81:0/94337684 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564f9875be00 0x564f987676b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/94337684 >> 172.21.15.81:0/94337684 conn(0x564f986b4210 msgr2=0x564f98759c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/94337684 shutdown_connections 2024-05-09T00:10:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.632+0000 7f6ebe3e3b80 1 -- 172.21.15.81:0/94337684 wait complete. 2024-05-09T00:10:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.633+0000 7f6ebe3e3b80 20 client.17505 trim_cache size 0 max 16384 2024-05-09T00:10:09.635 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:10:09.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.633+0000 7f6eb2229700 1 -- 172.21.15.81:0/3305147209 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6e980a1290 msgr2=0x7f6e980a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.633+0000 7f6eb2229700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6e980a1290 0x7f6e980a3750 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6e9400b5c0 tx=0x7f6e94005a90 comp rx=0 tx=0).stop 2024-05-09T00:10:09.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.633+0000 7f6eb2229700 1 -- 172.21.15.81:0/3305147209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac100060 msgr2=0x7f6eac1973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:09.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.633+0000 7f6eb2229700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac100060 0x7f6eac1973e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00d980 tx=0x7f6e9c00dc90 comp rx=0 tx=0).stop 2024-05-09T00:10:09.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.633+0000 7f6eb2229700 1 -- 172.21.15.81:0/3305147209 shutdown_connections 2024-05-09T00:10:09.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.633+0000 7f6eb2229700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6e980a1290 0x7f6e980a3750 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.633+0000 7f6eb2229700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6eac19bcc0 0x7f6eac19c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.633+0000 7f6eb2229700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6eac100060 0x7f6eac1973e0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.633+0000 7f6eb2229700 1 --2- 172.21.15.81:0/3305147209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6eac105160 0x7f6eac197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:09.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.633+0000 7f6eb2229700 1 -- 172.21.15.81:0/3305147209 >> 172.21.15.81:0/3305147209 conn(0x7f6eac076f40 msgr2=0x7f6eac068410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:09.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.633+0000 7f6eb2229700 1 -- 172.21.15.81:0/3305147209 shutdown_connections 2024-05-09T00:10:09.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:09.633+0000 7f6eb2229700 1 -- 172.21.15.81:0/3305147209 wait complete. 2024-05-09T00:10:10.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:09 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3142576481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:10:10.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:09 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3142576481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:10:10.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:09 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3142576481' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:10:10.642 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:10:10.642 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:10:10.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 -- 172.21.15.81:0/1845848150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d94105180 msgr2=0x7f8d9410cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 --2- 172.21.15.81:0/1845848150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d94105180 0x7f8d9410cd00 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c00b0a0 tx=0x7f8d8c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 -- 172.21.15.81:0/1845848150 shutdown_connections 2024-05-09T00:10:10.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 --2- 172.21.15.81:0/1845848150 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d94100060 0x7f8d94100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 --2- 172.21.15.81:0/1845848150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d94105180 0x7f8d9410cd00 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 --2- 172.21.15.81:0/1845848150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d94100a10 0x7f8d94104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 -- 172.21.15.81:0/1845848150 >> 172.21.15.81:0/1845848150 conn(0x7f8d94076f70 msgr2=0x7f8d94077380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 -- 172.21.15.81:0/1845848150 shutdown_connections 2024-05-09T00:10:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 -- 172.21.15.81:0/1845848150 wait complete. 2024-05-09T00:10:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 Processor -- start 2024-05-09T00:10:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 -- start start 2024-05-09T00:10:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d94100060 0x7f8d94197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d94105180 0x7f8d94197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d9419be20 0x7f8d9419c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9419c8a0 con 0x7f8d94105180 2024-05-09T00:10:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9419ca10 con 0x7f8d94100060 2024-05-09T00:10:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.787+0000 7f8d9b074700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9419cbd0 con 0x7f8d9419be20 2024-05-09T00:10:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d94105180 0x7f8d94197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d94105180 0x7f8d94197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49140/0 (socket says 172.21.15.81:49140) 2024-05-09T00:10:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d93fff700 1 -- 172.21.15.81:0/1272696261 learned_addr learned my addr 172.21.15.81:0/1272696261 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d99611700 1 --2- 172.21.15.81:0/1272696261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d9419be20 0x7f8d9419c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d93fff700 1 -- 172.21.15.81:0/1272696261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d9419be20 msgr2=0x7f8d9419c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d93fff700 1 --2- 172.21.15.81:0/1272696261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d9419be20 0x7f8d9419c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d93fff700 1 -- 172.21.15.81:0/1272696261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d94100060 msgr2=0x7f8d94197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d93fff700 1 --2- 172.21.15.81:0/1272696261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d94100060 0x7f8d94197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d93fff700 1 -- 172.21.15.81:0/1272696261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c009d00 con 0x7f8d94105180 2024-05-09T00:10:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d93fff700 1 --2- 172.21.15.81:0/1272696261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d94105180 0x7f8d94197a80 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000e970 tx=0x7f8d8000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d91ffb700 1 -- 172.21.15.81:0/1272696261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80009790 con 0x7f8d94105180 2024-05-09T00:10:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d91ffb700 1 -- 172.21.15.81:0/1272696261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d80004cf0 con 0x7f8d94105180 2024-05-09T00:10:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d9b074700 1 -- 172.21.15.81:0/1272696261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d941a4130 con 0x7f8d94105180 2024-05-09T00:10:10.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d91ffb700 1 -- 172.21.15.81:0/1272696261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80005680 con 0x7f8d94105180 2024-05-09T00:10:10.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.788+0000 7f8d9b074700 1 -- 172.21.15.81:0/1272696261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d941a4610 con 0x7f8d94105180 2024-05-09T00:10:10.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.790+0000 7f8d91ffb700 1 -- 172.21.15.81:0/1272696261 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f8d80004750 con 0x7f8d94105180 2024-05-09T00:10:10.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.791+0000 7f8d91ffb700 1 --2- 172.21.15.81:0/1272696261 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8d840a1290 0x7f8d840a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.791+0000 7f8d91ffb700 1 -- 172.21.15.81:0/1272696261 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f8d80014070 con 0x7f8d94105180 2024-05-09T00:10:10.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.791+0000 7f8d98e10700 1 --2- 172.21.15.81:0/1272696261 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8d840a1290 0x7f8d840a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.791+0000 7f8d98e10700 1 --2- 172.21.15.81:0/1272696261 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8d840a1290 0x7f8d840a3750 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8d88005950 tx=0x7f8d880058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:10.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.792+0000 7f8da722eb80 1 Processor -- start 2024-05-09T00:10:10.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.792+0000 7f8da722eb80 1 -- start start 2024-05-09T00:10:10.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.792+0000 7f8da722eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3cfe80 0x55e9bb3d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.792+0000 7f8da722eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3d07a0 0x55e9bb3ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.792+0000 7f8da722eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3ca910 0x55e9bb3cad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.792+0000 7f8da722eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bb3211d0 con 0x55e9bb3d07a0 2024-05-09T00:10:10.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.792+0000 7f8da722eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bb31eb90 con 0x55e9bb3cfe80 2024-05-09T00:10:10.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.792+0000 7f8da722eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bb31a480 con 0x55e9bb3ca910 2024-05-09T00:10:10.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.792+0000 7f8d93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3d07a0 0x55e9bb3ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.792+0000 7f8d93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3d07a0 0x55e9bb3ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49146/0 (socket says 172.21.15.81:49146) 2024-05-09T00:10:10.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.792+0000 7f8d93fff700 1 -- 172.21.15.81:0/894622266 learned_addr learned my addr 172.21.15.81:0/894622266 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:10.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.793+0000 7f8d98e10700 1 --2- 172.21.15.81:0/894622266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3cfe80 0x55e9bb3d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.793+0000 7f8d93fff700 1 -- 172.21.15.81:0/894622266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3ca910 msgr2=0x55e9bb3cad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.793+0000 7f8d93fff700 1 --2- 172.21.15.81:0/894622266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3ca910 0x55e9bb3cad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.793+0000 7f8d93fff700 1 -- 172.21.15.81:0/894622266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3cfe80 msgr2=0x55e9bb3d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.793+0000 7f8d93fff700 1 --2- 172.21.15.81:0/894622266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3cfe80 0x55e9bb3d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.793+0000 7f8d93fff700 1 -- 172.21.15.81:0/894622266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9bb19b430 con 0x55e9bb3d07a0 2024-05-09T00:10:10.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.793+0000 7f8d98e10700 1 --2- 172.21.15.81:0/894622266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3cfe80 0x55e9bb3d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:10.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.793+0000 7f8d93fff700 1 --2- 172.21.15.81:0/894622266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3d07a0 0x55e9bb3ca3d0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009230 tx=0x7f8d8009a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fc178390ea8178 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:10.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.793+0000 7f8d7effd700 1 -- 172.21.15.81:0/894622266 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d800a24d0 con 0x55e9bb3d07a0 2024-05-09T00:10:10.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.793+0000 7f8d7effd700 1 -- 172.21.15.81:0/894622266 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d800983f0 con 0x55e9bb3d07a0 2024-05-09T00:10:10.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.793+0000 7f8d7effd700 1 -- 172.21.15.81:0/894622266 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80096760 con 0x55e9bb3d07a0 2024-05-09T00:10:10.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.794+0000 7f8da722eb80 1 -- 172.21.15.81:0/894622266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3d07a0 msgr2=0x55e9bb3ca3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.794+0000 7f8da722eb80 1 --2- 172.21.15.81:0/894622266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3d07a0 0x55e9bb3ca3d0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009230 tx=0x7f8d8009a750 comp rx=0 tx=0).stop 2024-05-09T00:10:10.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.794+0000 7f8da722eb80 1 -- 172.21.15.81:0/894622266 shutdown_connections 2024-05-09T00:10:10.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.794+0000 7f8da722eb80 1 --2- 172.21.15.81:0/894622266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3cfe80 0x55e9bb3d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.794+0000 7f8da722eb80 1 --2- 172.21.15.81:0/894622266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3ca910 0x55e9bb3cad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.794+0000 7f8da722eb80 1 --2- 172.21.15.81:0/894622266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3d07a0 0x55e9bb3ca3d0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.794+0000 7f8da722eb80 1 -- 172.21.15.81:0/894622266 >> 172.21.15.81:0/894622266 conn(0x55e9bb328290 msgr2=0x55e9bb3c4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:10.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.794+0000 7f8da722eb80 1 -- 172.21.15.81:0/894622266 shutdown_connections 2024-05-09T00:10:10.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.794+0000 7f8da722eb80 1 -- 172.21.15.81:0/894622266 wait complete. 2024-05-09T00:10:10.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.794+0000 7f8da722eb80 1 -- start start 2024-05-09T00:10:10.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.794+0000 7f8da722eb80 1 Processor -- start 2024-05-09T00:10:10.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8da722eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3ca910 0x55e9bb3d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8da722eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3cfe80 0x55e9bb3d4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8da722eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3d07a0 0x55e9bb3d4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8da722eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bb2b65e0 con 0x55e9bb3ca910 2024-05-09T00:10:10.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8da722eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bb2b6280 con 0x55e9bb3d07a0 2024-05-09T00:10:10.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8da722eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bb19d720 con 0x55e9bb3cfe80 2024-05-09T00:10:10.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8da722eb80 10 client.0 _ll_register_callbacks cb 0x55e9bb2bfbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:10.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8d98e10700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3ca910 0x55e9bb3d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8d98e10700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3ca910 0x55e9bb3d3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49150/0 (socket says 172.21.15.81:49150) 2024-05-09T00:10:10.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8d98e10700 1 -- 172.21.15.81:0/3840077431 learned_addr learned my addr 172.21.15.81:0/3840077431 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:10.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8d98e10700 1 -- 172.21.15.81:0/3840077431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3cfe80 msgr2=0x55e9bb3d4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8d98e10700 1 --2- 172.21.15.81:0/3840077431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3cfe80 0x55e9bb3d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8d98e10700 1 -- 172.21.15.81:0/3840077431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3d07a0 msgr2=0x55e9bb3d4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8d98e10700 1 --2- 172.21.15.81:0/3840077431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3d07a0 0x55e9bb3d4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8d98e10700 1 -- 172.21.15.81:0/3840077431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d941a4610 con 0x55e9bb3ca910 2024-05-09T00:10:10.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8d98e10700 1 --2- 172.21.15.81:0/3840077431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3ca910 0x55e9bb3d3be0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800efc0 tx=0x7f8d88004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06e3b55e83ceb06 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:10.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8d73fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:10.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8d73fff700 1 -- 172.21.15.81:0/3840077431 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d88010ba0 con 0x55e9bb3ca910 2024-05-09T00:10:10.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8d73fff700 1 -- 172.21.15.81:0/3840077431 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f8d88010d00 con 0x55e9bb3ca910 2024-05-09T00:10:10.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8da722eb80 1 -- 172.21.15.81:0/3840077431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9bb2732f0 con 0x55e9bb3ca910 2024-05-09T00:10:10.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8d73fff700 1 -- 172.21.15.81:0/3840077431 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d88025430 con 0x55e9bb3ca910 2024-05-09T00:10:10.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8da722eb80 10 client.17517 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:10.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.795+0000 7f8da722eb80 1 -- 172.21.15.81:0/3840077431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e9bb147be0 con 0x55e9bb3ca910 2024-05-09T00:10:10.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.796+0000 7f8d73fff700 1 -- 172.21.15.81:0/3840077431 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d88030020 con 0x55e9bb3ca910 2024-05-09T00:10:10.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.796+0000 7f8d73fff700 1 -- 172.21.15.81:0/3840077431 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8d8801c5e0 con 0x55e9bb3ca910 2024-05-09T00:10:10.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.796+0000 7f8da722eb80 10 client.17517 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.796+0000 7f8da722eb80 10 client.17517 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.796+0000 7f8da722eb80 20 client.17517 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.796+0000 7f8da722eb80 1 --2- 172.21.15.81:0/3840077431 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e9bb3e4390 0x55e9bb3e67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.796+0000 7f8da722eb80 4 client.17517 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.796+0000 7f8da722eb80 1 -- 172.21.15.81:0/3840077431 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9bb399890 con 0x55e9bb3e4390 2024-05-09T00:10:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.796+0000 7f8d93fff700 1 --2- 172.21.15.81:0/3840077431 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e9bb3e4390 0x55e9bb3e67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.797+0000 7f8d93fff700 1 --2- 172.21.15.81:0/3840077431 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e9bb3e4390 0x55e9bb3e67b0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd01da5b35491214 server_cookie=fa86462220b7c096 in_seq=0 out_seq=0 2024-05-09T00:10:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.797+0000 7f8d73fff700 10 client.17517 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.797+0000 7f8d73fff700 1 -- 172.21.15.81:0/3840077431 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e9bb399890 con 0x55e9bb3e4390 2024-05-09T00:10:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.797+0000 7f8d73fff700 10 client.17517 handle_command_reply: tid=0 2024-05-09T00:10:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.797+0000 7f8da722eb80 1 client.17517 shutdown 2024-05-09T00:10:10.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.797+0000 7f8da722eb80 1 -- 172.21.15.81:0/3840077431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3ca910 msgr2=0x55e9bb3d3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.797+0000 7f8da722eb80 1 --2- 172.21.15.81:0/3840077431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3ca910 0x55e9bb3d3be0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800efc0 tx=0x7f8d88004750 comp rx=0 tx=0).stop 2024-05-09T00:10:10.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.797+0000 7f8da722eb80 1 -- 172.21.15.81:0/3840077431 shutdown_connections 2024-05-09T00:10:10.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.797+0000 7f8da722eb80 1 --2- 172.21.15.81:0/3840077431 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e9bb3e4390 0x55e9bb3e67b0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.797+0000 7f8da722eb80 1 --2- 172.21.15.81:0/3840077431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3d07a0 0x55e9bb3d4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.797+0000 7f8da722eb80 1 --2- 172.21.15.81:0/3840077431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3ca910 0x55e9bb3d3be0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.797+0000 7f8d73fff700 0 client.17517 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:10.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.797+0000 7f8da722eb80 1 --2- 172.21.15.81:0/3840077431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3cfe80 0x55e9bb3d4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.797+0000 7f8da722eb80 1 -- 172.21.15.81:0/3840077431 >> 172.21.15.81:0/3840077431 conn(0x55e9bb328290 msgr2=0x55e9bb3c4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:10.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.798+0000 7f8da722eb80 1 -- 172.21.15.81:0/3840077431 shutdown_connections 2024-05-09T00:10:10.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.798+0000 7f8da722eb80 1 -- 172.21.15.81:0/3840077431 wait complete. 2024-05-09T00:10:10.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.798+0000 7f8da722eb80 20 client.17517 trim_cache size 0 max 16384 2024-05-09T00:10:10.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8da722eb80 1 Processor -- start 2024-05-09T00:10:10.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8da722eb80 1 -- start start 2024-05-09T00:10:10.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8da722eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3ca910 0x55e9bb3cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8da722eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3cfe80 0x55e9bb3c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8da722eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3d07a0 0x55e9bb3db1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8da722eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bb3bd0c0 con 0x55e9bb3cfe80 2024-05-09T00:10:10.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8da722eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bb3c1e40 con 0x55e9bb3d07a0 2024-05-09T00:10:10.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8da722eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bb3ca750 con 0x55e9bb3ca910 2024-05-09T00:10:10.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8d93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3cfe80 0x55e9bb3c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8d93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3cfe80 0x55e9bb3c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49162/0 (socket says 172.21.15.81:49162) 2024-05-09T00:10:10.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8d93fff700 1 -- 172.21.15.81:0/2610037077 learned_addr learned my addr 172.21.15.81:0/2610037077 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:10.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8d98e10700 1 --2- 172.21.15.81:0/2610037077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3ca910 0x55e9bb3cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8d99611700 1 --2- 172.21.15.81:0/2610037077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3d07a0 0x55e9bb3db1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8d93fff700 1 -- 172.21.15.81:0/2610037077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3ca910 msgr2=0x55e9bb3cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8d93fff700 1 --2- 172.21.15.81:0/2610037077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3ca910 0x55e9bb3cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8d93fff700 1 -- 172.21.15.81:0/2610037077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3d07a0 msgr2=0x55e9bb3db1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8d93fff700 1 --2- 172.21.15.81:0/2610037077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3d07a0 0x55e9bb3db1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8d93fff700 1 -- 172.21.15.81:0/2610037077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9bb2e05e0 con 0x55e9bb3cfe80 2024-05-09T00:10:10.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8d99611700 1 --2- 172.21.15.81:0/2610037077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3d07a0 0x55e9bb3db1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:10.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.815+0000 7f8d98e10700 1 --2- 172.21.15.81:0/2610037077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3ca910 0x55e9bb3cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:10.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.816+0000 7f8d93fff700 1 --2- 172.21.15.81:0/2610037077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3cfe80 0x55e9bb3c4da0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f8d80096550 tx=0x7f8d80005120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88bbd3c7a3e0730 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:10.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.816+0000 7f8d7f7fe700 1 -- 172.21.15.81:0/2610037077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80016e10 con 0x55e9bb3cfe80 2024-05-09T00:10:10.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.816+0000 7f8d7f7fe700 1 -- 172.21.15.81:0/2610037077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d8000ccd0 con 0x55e9bb3cfe80 2024-05-09T00:10:10.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.816+0000 7f8d7f7fe700 1 -- 172.21.15.81:0/2610037077 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d800ca910 con 0x55e9bb3cfe80 2024-05-09T00:10:10.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.816+0000 7f8da722eb80 1 -- 172.21.15.81:0/2610037077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3cfe80 msgr2=0x55e9bb3c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.816+0000 7f8da722eb80 1 --2- 172.21.15.81:0/2610037077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3cfe80 0x55e9bb3c4da0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f8d80096550 tx=0x7f8d80005120 comp rx=0 tx=0).stop 2024-05-09T00:10:10.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.816+0000 7f8da722eb80 1 -- 172.21.15.81:0/2610037077 shutdown_connections 2024-05-09T00:10:10.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.816+0000 7f8da722eb80 1 --2- 172.21.15.81:0/2610037077 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3d07a0 0x55e9bb3db1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.816+0000 7f8da722eb80 1 --2- 172.21.15.81:0/2610037077 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3ca910 0x55e9bb3cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.816+0000 7f8da722eb80 1 --2- 172.21.15.81:0/2610037077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3cfe80 0x55e9bb3c4da0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.816+0000 7f8da722eb80 1 -- 172.21.15.81:0/2610037077 >> 172.21.15.81:0/2610037077 conn(0x55e9bb328290 msgr2=0x55e9bb3cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.816+0000 7f8da722eb80 1 -- 172.21.15.81:0/2610037077 shutdown_connections 2024-05-09T00:10:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.816+0000 7f8da722eb80 1 -- 172.21.15.81:0/2610037077 wait complete. 2024-05-09T00:10:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8da722eb80 1 -- start start 2024-05-09T00:10:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8da722eb80 1 Processor -- start 2024-05-09T00:10:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8da722eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3ca910 0x55e9bb434330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8da722eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3cfe80 0x55e9bb434870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8da722eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3d07a0 0x55e9bb42e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8da722eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bb42ee00 con 0x55e9bb3cfe80 2024-05-09T00:10:10.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8da722eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bb42ef70 con 0x55e9bb3ca910 2024-05-09T00:10:10.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8da722eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9bb42f130 con 0x55e9bb3d07a0 2024-05-09T00:10:10.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8da722eb80 10 client.0 _ll_register_callbacks cb 0x55e9bb2bfbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:10.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8d93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3cfe80 0x55e9bb434870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8d93fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3cfe80 0x55e9bb434870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49172/0 (socket says 172.21.15.81:49172) 2024-05-09T00:10:10.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8d93fff700 1 -- 172.21.15.81:0/421301043 learned_addr learned my addr 172.21.15.81:0/421301043 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:10.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8d98e10700 1 --2- 172.21.15.81:0/421301043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3ca910 0x55e9bb434330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8d99611700 1 --2- 172.21.15.81:0/421301043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3d07a0 0x55e9bb42e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8d93fff700 1 -- 172.21.15.81:0/421301043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3d07a0 msgr2=0x55e9bb42e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8d93fff700 1 --2- 172.21.15.81:0/421301043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3d07a0 0x55e9bb42e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8d93fff700 1 -- 172.21.15.81:0/421301043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3ca910 msgr2=0x55e9bb434330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8d93fff700 1 --2- 172.21.15.81:0/421301043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3ca910 0x55e9bb434330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.817+0000 7f8d93fff700 1 -- 172.21.15.81:0/421301043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d800b6040 con 0x55e9bb3cfe80 2024-05-09T00:10:10.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8d93fff700 1 --2- 172.21.15.81:0/421301043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3cfe80 0x55e9bb434870 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000c5b0 tx=0x7f8d80005080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c7f0e5b411c933 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:10.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8d73fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:10.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8d73fff700 1 -- 172.21.15.81:0/421301043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8007a030 con 0x55e9bb3cfe80 2024-05-09T00:10:10.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8d73fff700 1 -- 172.21.15.81:0/421301043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f8d8007b070 con 0x55e9bb3cfe80 2024-05-09T00:10:10.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8da722eb80 1 -- 172.21.15.81:0/421301043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d800983f0 con 0x55e9bb3cfe80 2024-05-09T00:10:10.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8d73fff700 1 -- 172.21.15.81:0/421301043 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d800b82d0 con 0x55e9bb3cfe80 2024-05-09T00:10:10.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8da722eb80 10 client.17523 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:10.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8da722eb80 1 -- 172.21.15.81:0/421301043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e9bb19fd50 con 0x55e9bb3cfe80 2024-05-09T00:10:10.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8d73fff700 1 -- 172.21.15.81:0/421301043 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d800983f0 con 0x55e9bb3cfe80 2024-05-09T00:10:10.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8d73fff700 1 -- 172.21.15.81:0/421301043 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8d80099540 con 0x55e9bb3cfe80 2024-05-09T00:10:10.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8da722eb80 10 client.17523 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:10.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8da722eb80 10 client.17523 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:10.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8da722eb80 20 client.17523 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:10.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8da722eb80 1 --2- 172.21.15.81:0/421301043 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e9bb43bcc0 0x55e9bb43e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8da722eb80 4 client.17523 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:10:10.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8da722eb80 1 -- 172.21.15.81:0/421301043 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55e9bb312f40 con 0x55e9bb43bcc0 2024-05-09T00:10:10.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.818+0000 7f8d98e10700 1 --2- 172.21.15.81:0/421301043 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e9bb43bcc0 0x55e9bb43e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.819+0000 7f8d73fff700 10 client.17523 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:10.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.819+0000 7f8d98e10700 1 --2- 172.21.15.81:0/421301043 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e9bb43bcc0 0x55e9bb43e0b0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ff69fa1d0fc6a0b server_cookie=36d88acb299efce2 in_seq=0 out_seq=0 2024-05-09T00:10:10.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8d73fff700 1 -- 172.21.15.81:0/421301043 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e9bb312f40 con 0x55e9bb43bcc0 2024-05-09T00:10:10.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8d73fff700 10 client.17523 handle_command_reply: tid=0 2024-05-09T00:10:10.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8da722eb80 1 client.17523 shutdown 2024-05-09T00:10:10.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8da722eb80 1 -- 172.21.15.81:0/421301043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3cfe80 msgr2=0x55e9bb434870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8da722eb80 1 --2- 172.21.15.81:0/421301043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3cfe80 0x55e9bb434870 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000c5b0 tx=0x7f8d80005080 comp rx=0 tx=0).stop 2024-05-09T00:10:10.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8da722eb80 1 -- 172.21.15.81:0/421301043 shutdown_connections 2024-05-09T00:10:10.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8da722eb80 1 --2- 172.21.15.81:0/421301043 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e9bb43bcc0 0x55e9bb43e0b0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8da722eb80 1 --2- 172.21.15.81:0/421301043 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e9bb3ca910 0x55e9bb434330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8da722eb80 1 --2- 172.21.15.81:0/421301043 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e9bb3d07a0 0x55e9bb42e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8da722eb80 1 --2- 172.21.15.81:0/421301043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e9bb3cfe80 0x55e9bb434870 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8da722eb80 1 -- 172.21.15.81:0/421301043 >> 172.21.15.81:0/421301043 conn(0x55e9bb328290 msgr2=0x55e9bb3cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:10.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8d73fff700 0 client.17523 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:10.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8da722eb80 1 -- 172.21.15.81:0/421301043 shutdown_connections 2024-05-09T00:10:10.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8da722eb80 1 -- 172.21.15.81:0/421301043 wait complete. 2024-05-09T00:10:10.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.820+0000 7f8da722eb80 20 client.17523 trim_cache size 0 max 16384 2024-05-09T00:10:10.826 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:10:10.826 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:10:10.826 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "32e4c11c-9874-4d88-88c8-be1f819fc9dc", 2024-05-09T00:10:10.826 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:10:10.826 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:10:10.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.821+0000 7f8d9b074700 1 -- 172.21.15.81:0/1272696261 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8d840a1290 msgr2=0x7f8d840a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.821+0000 7f8d9b074700 1 --2- 172.21.15.81:0/1272696261 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8d840a1290 0x7f8d840a3750 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8d88005950 tx=0x7f8d880058e0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.821+0000 7f8d9b074700 1 -- 172.21.15.81:0/1272696261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d94105180 msgr2=0x7f8d94197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.821+0000 7f8d9b074700 1 --2- 172.21.15.81:0/1272696261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d94105180 0x7f8d94197a80 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f8d8000e970 tx=0x7f8d8000ed30 comp rx=0 tx=0).stop 2024-05-09T00:10:10.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.821+0000 7f8d9b074700 1 -- 172.21.15.81:0/1272696261 shutdown_connections 2024-05-09T00:10:10.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.821+0000 7f8d9b074700 1 --2- 172.21.15.81:0/1272696261 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8d840a1290 0x7f8d840a3750 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.821+0000 7f8d9b074700 1 --2- 172.21.15.81:0/1272696261 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8d94100060 0x7f8d94197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.821+0000 7f8d9b074700 1 --2- 172.21.15.81:0/1272696261 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d9419be20 0x7f8d9419c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.821+0000 7f8d9b074700 1 --2- 172.21.15.81:0/1272696261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d94105180 0x7f8d94197a80 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.821+0000 7f8d9b074700 1 -- 172.21.15.81:0/1272696261 >> 172.21.15.81:0/1272696261 conn(0x7f8d94076f70 msgr2=0x7f8d940697d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:10.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.821+0000 7f8d9b074700 1 -- 172.21.15.81:0/1272696261 shutdown_connections 2024-05-09T00:10:10.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.821+0000 7f8d9b074700 1 -- 172.21.15.81:0/1272696261 wait complete. 2024-05-09T00:10:10.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:10:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.957+0000 7f6a5754f700 1 -- 172.21.15.81:0/1439092787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a50100790 msgr2=0x7f6a50100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.957+0000 7f6a5754f700 1 --2- 172.21.15.81:0/1439092787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a50100790 0x7f6a50100b70 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f6a40009990 tx=0x7f6a40009ca0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.957+0000 7f6a5754f700 1 -- 172.21.15.81:0/1439092787 shutdown_connections 2024-05-09T00:10:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.957+0000 7f6a5754f700 1 --2- 172.21.15.81:0/1439092787 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a50105390 0x7f6a5010cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.957+0000 7f6a5754f700 1 --2- 172.21.15.81:0/1439092787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a50100790 0x7f6a50100b70 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.957+0000 7f6a5754f700 1 --2- 172.21.15.81:0/1439092787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a50101140 0x7f6a50104c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.957+0000 7f6a5754f700 1 -- 172.21.15.81:0/1439092787 >> 172.21.15.81:0/1439092787 conn(0x7f6a500763a0 msgr2=0x7f6a500fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.957+0000 7f6a5754f700 1 -- 172.21.15.81:0/1439092787 shutdown_connections 2024-05-09T00:10:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.957+0000 7f6a5754f700 1 -- 172.21.15.81:0/1439092787 wait complete. 2024-05-09T00:10:10.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.957+0000 7f6a5754f700 1 Processor -- start 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a5754f700 1 -- start start 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a5754f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a50100790 0x7f6a50196490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a5754f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a50105390 0x7f6a501969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a5754f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5019ad70 0x7f6a5019b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a5754f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5019b7f0 con 0x7f6a5019ad70 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a5754f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5019b960 con 0x7f6a50100790 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a5754f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5019bb20 con 0x7f6a50105390 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a55aec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5019ad70 0x7f6a5019b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a55aec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5019ad70 0x7f6a5019b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49194/0 (socket says 172.21.15.81:49194) 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a55aec700 1 -- 172.21.15.81:0/883064217 learned_addr learned my addr 172.21.15.81:0/883064217 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a54aea700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a50105390 0x7f6a501969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a552eb700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a50100790 0x7f6a50196490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a55aec700 1 -- 172.21.15.81:0/883064217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a50105390 msgr2=0x7f6a501969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a55aec700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a50105390 0x7f6a501969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a55aec700 1 -- 172.21.15.81:0/883064217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a50100790 msgr2=0x7f6a50196490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a55aec700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a50100790 0x7f6a50196490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a55aec700 1 -- 172.21.15.81:0/883064217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a400095f0 con 0x7f6a5019ad70 2024-05-09T00:10:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a552eb700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a50100790 0x7f6a50196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a55aec700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5019ad70 0x7f6a5019b1f0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f6a48007d70 tx=0x7f6a4800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.958+0000 7f6a467fc700 1 -- 172.21.15.81:0/883064217 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800ad40 con 0x7f6a5019ad70 2024-05-09T00:10:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.959+0000 7f6a467fc700 1 -- 172.21.15.81:0/883064217 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a480128e0 con 0x7f6a5019ad70 2024-05-09T00:10:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.959+0000 7f6a5754f700 1 -- 172.21.15.81:0/883064217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a501a3080 con 0x7f6a5019ad70 2024-05-09T00:10:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.959+0000 7f6a467fc700 1 -- 172.21.15.81:0/883064217 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480116b0 con 0x7f6a5019ad70 2024-05-09T00:10:10.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.959+0000 7f6a5754f700 1 -- 172.21.15.81:0/883064217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a501a3510 con 0x7f6a5019ad70 2024-05-09T00:10:10.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.961+0000 7f6a467fc700 1 -- 172.21.15.81:0/883064217 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6a48012420 con 0x7f6a5019ad70 2024-05-09T00:10:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.961+0000 7f6a467fc700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6a3c0a1290 0x7f6a3c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.961+0000 7f6a467fc700 1 -- 172.21.15.81:0/883064217 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f6a480cce80 con 0x7f6a5019ad70 2024-05-09T00:10:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.961+0000 7f6a552eb700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6a3c0a1290 0x7f6a3c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.962+0000 7f6a552eb700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6a3c0a1290 0x7f6a3c0a3750 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000b2e0 tx=0x7f6a40005940 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.962+0000 7f6a63709b80 1 Processor -- start 2024-05-09T00:10:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.962+0000 7f6a63709b80 1 -- start start 2024-05-09T00:10:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.962+0000 7f6a63709b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73060 0x555dbcf73440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.962+0000 7f6a63709b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf6d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.962+0000 7f6a63709b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf6daf0 0x555dbcf6df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.962+0000 7f6a63709b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbcec2150 con 0x555dbcf73980 2024-05-09T00:10:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.962+0000 7f6a63709b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbcebfb10 con 0x555dbcf73060 2024-05-09T00:10:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.962+0000 7f6a63709b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbcebb400 con 0x555dbcf6daf0 2024-05-09T00:10:10.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.962+0000 7f6a54aea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf6d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.962+0000 7f6a54aea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf6d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49210/0 (socket says 172.21.15.81:49210) 2024-05-09T00:10:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.963+0000 7f6a54aea700 1 -- 172.21.15.81:0/3400772816 learned_addr learned my addr 172.21.15.81:0/3400772816 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.963+0000 7f6a55aec700 1 --2- 172.21.15.81:0/3400772816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf6daf0 0x555dbcf6df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.963+0000 7f6a552eb700 1 --2- 172.21.15.81:0/3400772816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73060 0x555dbcf73440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.963+0000 7f6a54aea700 1 -- 172.21.15.81:0/3400772816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf6daf0 msgr2=0x555dbcf6df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.963+0000 7f6a54aea700 1 --2- 172.21.15.81:0/3400772816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf6daf0 0x555dbcf6df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.963+0000 7f6a54aea700 1 -- 172.21.15.81:0/3400772816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73060 msgr2=0x555dbcf73440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.963+0000 7f6a54aea700 1 --2- 172.21.15.81:0/3400772816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73060 0x555dbcf73440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.963+0000 7f6a54aea700 1 -- 172.21.15.81:0/3400772816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dbcd3c3b0 con 0x555dbcf73980 2024-05-09T00:10:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.963+0000 7f6a552eb700 1 --2- 172.21.15.81:0/3400772816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73060 0x555dbcf73440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.963+0000 7f6a54aea700 1 --2- 172.21.15.81:0/3400772816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf6d560 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009cf0 tx=0x7f6a4c011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e0c9ef7853bf27 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.963+0000 7f6a3b7fe700 1 -- 172.21.15.81:0/3400772816 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c011d80 con 0x555dbcf73980 2024-05-09T00:10:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.963+0000 7f6a3b7fe700 1 -- 172.21.15.81:0/3400772816 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a4c004510 con 0x555dbcf73980 2024-05-09T00:10:10.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.963+0000 7f6a3b7fe700 1 -- 172.21.15.81:0/3400772816 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c005280 con 0x555dbcf73980 2024-05-09T00:10:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.964+0000 7f6a63709b80 1 -- 172.21.15.81:0/3400772816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 msgr2=0x555dbcf6d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.964+0000 7f6a63709b80 1 --2- 172.21.15.81:0/3400772816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf6d560 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009cf0 tx=0x7f6a4c011440 comp rx=0 tx=0).stop 2024-05-09T00:10:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.964+0000 7f6a63709b80 1 -- 172.21.15.81:0/3400772816 shutdown_connections 2024-05-09T00:10:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.964+0000 7f6a63709b80 1 --2- 172.21.15.81:0/3400772816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73060 0x555dbcf73440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.964+0000 7f6a63709b80 1 --2- 172.21.15.81:0/3400772816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf6daf0 0x555dbcf6df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.964+0000 7f6a63709b80 1 --2- 172.21.15.81:0/3400772816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf6d560 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.964+0000 7f6a63709b80 1 -- 172.21.15.81:0/3400772816 >> 172.21.15.81:0/3400772816 conn(0x555dbcec9210 msgr2=0x555dbcf65df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.964+0000 7f6a63709b80 1 -- 172.21.15.81:0/3400772816 shutdown_connections 2024-05-09T00:10:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.964+0000 7f6a63709b80 1 -- 172.21.15.81:0/3400772816 wait complete. 2024-05-09T00:10:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.964+0000 7f6a63709b80 1 -- start start 2024-05-09T00:10:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.964+0000 7f6a63709b80 1 Processor -- start 2024-05-09T00:10:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a63709b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf6daf0 0x555dbcf76c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a63709b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73060 0x555dbcf771b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a63709b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf776f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a63709b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbce57560 con 0x555dbcf73980 2024-05-09T00:10:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a63709b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbce57200 con 0x555dbcf73060 2024-05-09T00:10:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a63709b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbcd3e6a0 con 0x555dbcf6daf0 2024-05-09T00:10:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a63709b80 10 client.0 _ll_register_callbacks cb 0x555dbce60b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a55aec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf776f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a55aec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf776f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49226/0 (socket says 172.21.15.81:49226) 2024-05-09T00:10:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a55aec700 1 -- 172.21.15.81:0/2696612397 learned_addr learned my addr 172.21.15.81:0/2696612397 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a552eb700 1 --2- 172.21.15.81:0/2696612397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf6daf0 0x555dbcf76c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a55aec700 1 -- 172.21.15.81:0/2696612397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf6daf0 msgr2=0x555dbcf76c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a54aea700 1 --2- 172.21.15.81:0/2696612397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73060 0x555dbcf771b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a55aec700 1 --2- 172.21.15.81:0/2696612397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf6daf0 0x555dbcf76c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a55aec700 1 -- 172.21.15.81:0/2696612397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73060 msgr2=0x555dbcf771b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a55aec700 1 --2- 172.21.15.81:0/2696612397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73060 0x555dbcf771b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a55aec700 1 -- 172.21.15.81:0/2696612397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c009920 con 0x555dbcf73980 2024-05-09T00:10:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a55aec700 1 --2- 172.21.15.81:0/2696612397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf776f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f6a480ca6e0 tx=0x7f6a4809a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd032ee743f1236 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a38ff9700 1 -- 172.21.15.81:0/2696612397 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480a24c0 con 0x555dbcf73980 2024-05-09T00:10:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a38ff9700 1 -- 172.21.15.81:0/2696612397 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f6a48018da0 con 0x555dbcf73980 2024-05-09T00:10:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a63709b80 1 -- 172.21.15.81:0/2696612397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555dbce14270 con 0x555dbcf73980 2024-05-09T00:10:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a38ff9700 1 -- 172.21.15.81:0/2696612397 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a480b8320 con 0x555dbcf73980 2024-05-09T00:10:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a63709b80 10 client.17535 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.965+0000 7f6a63709b80 1 -- 172.21.15.81:0/2696612397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555dbcce8b60 con 0x555dbcf73980 2024-05-09T00:10:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.966+0000 7f6a38ff9700 1 -- 172.21.15.81:0/2696612397 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a48063070 con 0x555dbcf73980 2024-05-09T00:10:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.966+0000 7f6a38ff9700 1 -- 172.21.15.81:0/2696612397 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6a480a2030 con 0x555dbcf73980 2024-05-09T00:10:10.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.966+0000 7f6a63709b80 10 client.17535 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.966+0000 7f6a63709b80 10 client.17535 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.966+0000 7f6a63709b80 20 client.17535 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.966+0000 7f6a63709b80 1 --2- 172.21.15.81:0/2696612397 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555dbcf87450 0x555dbcf89870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.966+0000 7f6a63709b80 4 client.17535 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.966+0000 7f6a63709b80 1 -- 172.21.15.81:0/2696612397 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555dbcf3a810 con 0x555dbcf87450 2024-05-09T00:10:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.966+0000 7f6a552eb700 1 --2- 172.21.15.81:0/2696612397 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555dbcf87450 0x555dbcf89870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.966+0000 7f6a38ff9700 10 client.17535 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.966+0000 7f6a552eb700 1 --2- 172.21.15.81:0/2696612397 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555dbcf87450 0x555dbcf89870 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74b1304be6f099e9 server_cookie=c6fa9183bce7758 in_seq=0 out_seq=0 2024-05-09T00:10:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.967+0000 7f6a38ff9700 1 -- 172.21.15.81:0/2696612397 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555dbcf3a810 con 0x555dbcf87450 2024-05-09T00:10:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.967+0000 7f6a38ff9700 10 client.17535 handle_command_reply: tid=0 2024-05-09T00:10:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.967+0000 7f6a63709b80 1 client.17535 shutdown 2024-05-09T00:10:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.967+0000 7f6a63709b80 1 -- 172.21.15.81:0/2696612397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 msgr2=0x555dbcf776f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.967+0000 7f6a63709b80 1 --2- 172.21.15.81:0/2696612397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf776f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f6a480ca6e0 tx=0x7f6a4809a870 comp rx=0 tx=0).stop 2024-05-09T00:10:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.967+0000 7f6a63709b80 1 -- 172.21.15.81:0/2696612397 shutdown_connections 2024-05-09T00:10:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.967+0000 7f6a63709b80 1 --2- 172.21.15.81:0/2696612397 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555dbcf87450 0x555dbcf89870 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.967+0000 7f6a63709b80 1 --2- 172.21.15.81:0/2696612397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf776f0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.967+0000 7f6a38ff9700 0 client.17535 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.967+0000 7f6a63709b80 1 --2- 172.21.15.81:0/2696612397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf6daf0 0x555dbcf76c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.967+0000 7f6a63709b80 1 --2- 172.21.15.81:0/2696612397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73060 0x555dbcf771b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.967+0000 7f6a63709b80 1 -- 172.21.15.81:0/2696612397 >> 172.21.15.81:0/2696612397 conn(0x555dbcec9210 msgr2=0x555dbcf655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.967+0000 7f6a63709b80 1 -- 172.21.15.81:0/2696612397 shutdown_connections 2024-05-09T00:10:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.967+0000 7f6a63709b80 1 -- 172.21.15.81:0/2696612397 wait complete. 2024-05-09T00:10:10.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.968+0000 7f6a63709b80 20 client.17535 trim_cache size 0 max 16384 2024-05-09T00:10:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a63709b80 1 Processor -- start 2024-05-09T00:10:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a63709b80 1 -- start start 2024-05-09T00:10:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a63709b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf6daf0 0x555dbcf6d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a63709b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf73060 0x555dbcf65d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a63709b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73980 0x555dbcf7e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a63709b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbcf782e0 con 0x555dbcf6daf0 2024-05-09T00:10:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a63709b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbcf67640 con 0x555dbcf73980 2024-05-09T00:10:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a63709b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbcf62dc0 con 0x555dbcf73060 2024-05-09T00:10:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a552eb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf6daf0 0x555dbcf6d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a552eb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf6daf0 0x555dbcf6d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49242/0 (socket says 172.21.15.81:49242) 2024-05-09T00:10:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a552eb700 1 -- 172.21.15.81:0/1725481396 learned_addr learned my addr 172.21.15.81:0/1725481396 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a54aea700 1 --2- 172.21.15.81:0/1725481396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf73060 0x555dbcf65d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a55aec700 1 --2- 172.21.15.81:0/1725481396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73980 0x555dbcf7e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a552eb700 1 -- 172.21.15.81:0/1725481396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf73060 msgr2=0x555dbcf65d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a552eb700 1 --2- 172.21.15.81:0/1725481396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf73060 0x555dbcf65d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a552eb700 1 -- 172.21.15.81:0/1725481396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73980 msgr2=0x555dbcf7e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a552eb700 1 --2- 172.21.15.81:0/1725481396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73980 0x555dbcf7e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a552eb700 1 -- 172.21.15.81:0/1725481396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dbce81560 con 0x555dbcf6daf0 2024-05-09T00:10:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a54aea700 1 --2- 172.21.15.81:0/1725481396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf73060 0x555dbcf65d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a55aec700 1 --2- 172.21.15.81:0/1725481396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73980 0x555dbcf7e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.985+0000 7f6a552eb700 1 --2- 172.21.15.81:0/1725481396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf6daf0 0x555dbcf6d560 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f6a40000c00 tx=0x7f6a4001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef498a69cd1f6ae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.986+0000 7f6a3bfff700 1 -- 172.21.15.81:0/1725481396 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40036070 con 0x555dbcf6daf0 2024-05-09T00:10:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.986+0000 7f6a3bfff700 1 -- 172.21.15.81:0/1725481396 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a4001e040 con 0x555dbcf6daf0 2024-05-09T00:10:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.986+0000 7f6a3bfff700 1 -- 172.21.15.81:0/1725481396 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40004830 con 0x555dbcf6daf0 2024-05-09T00:10:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.986+0000 7f6a63709b80 1 -- 172.21.15.81:0/1725481396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf6daf0 msgr2=0x555dbcf6d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.986+0000 7f6a63709b80 1 --2- 172.21.15.81:0/1725481396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf6daf0 0x555dbcf6d560 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f6a40000c00 tx=0x7f6a4001f000 comp rx=0 tx=0).stop 2024-05-09T00:10:10.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.986+0000 7f6a63709b80 1 -- 172.21.15.81:0/1725481396 shutdown_connections 2024-05-09T00:10:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.986+0000 7f6a63709b80 1 --2- 172.21.15.81:0/1725481396 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf73980 0x555dbcf7e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.986+0000 7f6a63709b80 1 --2- 172.21.15.81:0/1725481396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf6daf0 0x555dbcf6d560 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.986+0000 7f6a63709b80 1 --2- 172.21.15.81:0/1725481396 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf73060 0x555dbcf65d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.986+0000 7f6a63709b80 1 -- 172.21.15.81:0/1725481396 >> 172.21.15.81:0/1725481396 conn(0x555dbcec9210 msgr2=0x555dbcf62210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.986+0000 7f6a63709b80 1 -- 172.21.15.81:0/1725481396 shutdown_connections 2024-05-09T00:10:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.986+0000 7f6a63709b80 1 -- 172.21.15.81:0/1725481396 wait complete. 2024-05-09T00:10:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a63709b80 1 -- start start 2024-05-09T00:10:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a63709b80 1 Processor -- start 2024-05-09T00:10:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a63709b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf6daf0 0x555dbcf7e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a63709b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf73060 0x555dbcf7e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a63709b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf6f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a63709b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbcf6f770 con 0x555dbcf73980 2024-05-09T00:10:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a63709b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbcf6f8e0 con 0x555dbcf6daf0 2024-05-09T00:10:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a63709b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbcf6faa0 con 0x555dbcf73060 2024-05-09T00:10:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a63709b80 10 client.0 _ll_register_callbacks cb 0x555dbce60b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a55aec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf6f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a55aec700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf6f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49244/0 (socket says 172.21.15.81:49244) 2024-05-09T00:10:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a55aec700 1 -- 172.21.15.81:0/1358248593 learned_addr learned my addr 172.21.15.81:0/1358248593 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a552eb700 1 --2- 172.21.15.81:0/1358248593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf6daf0 0x555dbcf7e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a54aea700 1 --2- 172.21.15.81:0/1358248593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf73060 0x555dbcf7e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a55aec700 1 -- 172.21.15.81:0/1358248593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf73060 msgr2=0x555dbcf7e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a55aec700 1 --2- 172.21.15.81:0/1358248593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf73060 0x555dbcf7e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a55aec700 1 -- 172.21.15.81:0/1358248593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf6daf0 msgr2=0x555dbcf7e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a55aec700 1 --2- 172.21.15.81:0/1358248593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf6daf0 0x555dbcf7e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.987+0000 7f6a55aec700 1 -- 172.21.15.81:0/1358248593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5010d780 con 0x555dbcf73980 2024-05-09T00:10:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a55aec700 1 --2- 172.21.15.81:0/1358248593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf6f090 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f6a48096ab0 tx=0x7f6a4809a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e377dcca16bab80 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a38ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a38ff9700 1 -- 172.21.15.81:0/1358248593 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480a24c0 con 0x555dbcf73980 2024-05-09T00:10:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a38ff9700 1 -- 172.21.15.81:0/1358248593 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f6a480b8320 con 0x555dbcf73980 2024-05-09T00:10:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a63709b80 1 -- 172.21.15.81:0/1358248593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a4c004510 con 0x555dbcf73980 2024-05-09T00:10:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a38ff9700 1 -- 172.21.15.81:0/1358248593 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a48099530 con 0x555dbcf73980 2024-05-09T00:10:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a63709b80 10 client.17541 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a63709b80 1 -- 172.21.15.81:0/1358248593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555dbcd40cd0 con 0x555dbcf73980 2024-05-09T00:10:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a38ff9700 1 -- 172.21.15.81:0/1358248593 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a4c004510 con 0x555dbcf73980 2024-05-09T00:10:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a38ff9700 1 -- 172.21.15.81:0/1358248593 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6a48004b60 con 0x555dbcf73980 2024-05-09T00:10:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a63709b80 10 client.17541 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:10.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a63709b80 10 client.17541 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a63709b80 20 client.17541 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a63709b80 1 --2- 172.21.15.81:0/1358248593 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555dbcfde7f0 0x555dbcfe0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a63709b80 4 client.17541 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:10:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a63709b80 1 -- 172.21.15.81:0/1358248593 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555dbceb3ec0 con 0x555dbcfde7f0 2024-05-09T00:10:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.988+0000 7f6a552eb700 1 --2- 172.21.15.81:0/1358248593 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555dbcfde7f0 0x555dbcfe0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a552eb700 1 --2- 172.21.15.81:0/1358248593 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555dbcfde7f0 0x555dbcfe0c10 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65ca0f9dd267ccae server_cookie=aa2be300a5db9b63 in_seq=0 out_seq=0 2024-05-09T00:10:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a38ff9700 10 client.17541 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a38ff9700 1 -- 172.21.15.81:0/1358248593 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x555dbceb3ec0 con 0x555dbcfde7f0 2024-05-09T00:10:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a38ff9700 10 client.17541 handle_command_reply: tid=0 2024-05-09T00:10:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a63709b80 1 client.17541 shutdown 2024-05-09T00:10:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a63709b80 1 -- 172.21.15.81:0/1358248593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 msgr2=0x555dbcf6f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a63709b80 1 --2- 172.21.15.81:0/1358248593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf6f090 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f6a48096ab0 tx=0x7f6a4809a170 comp rx=0 tx=0).stop 2024-05-09T00:10:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a63709b80 1 -- 172.21.15.81:0/1358248593 shutdown_connections 2024-05-09T00:10:10.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a63709b80 1 --2- 172.21.15.81:0/1358248593 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555dbcfde7f0 0x555dbcfe0c10 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a63709b80 1 --2- 172.21.15.81:0/1358248593 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555dbcf6daf0 0x555dbcf7e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a38ff9700 0 client.17541 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a63709b80 1 --2- 172.21.15.81:0/1358248593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555dbcf73980 0x555dbcf6f090 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a63709b80 1 --2- 172.21.15.81:0/1358248593 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555dbcf73060 0x555dbcf7e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a63709b80 1 -- 172.21.15.81:0/1358248593 >> 172.21.15.81:0/1358248593 conn(0x555dbcec9210 msgr2=0x555dbcf754e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a63709b80 1 -- 172.21.15.81:0/1358248593 shutdown_connections 2024-05-09T00:10:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a63709b80 1 -- 172.21.15.81:0/1358248593 wait complete. 2024-05-09T00:10:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.989+0000 7f6a63709b80 20 client.17541 trim_cache size 0 max 16384 2024-05-09T00:10:10.994 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: "32e4c11c-9874-4d88-88c8-be1f819fc9dc": { 2024-05-09T00:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "32e4c11c-9874-4d88-88c8-be1f819fc9dc", 2024-05-09T00:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:10:10.995 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:10:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.990+0000 7f6a5754f700 1 -- 172.21.15.81:0/883064217 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6a3c0a1290 msgr2=0x7f6a3c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.990+0000 7f6a5754f700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6a3c0a1290 0x7f6a3c0a3750 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000b2e0 tx=0x7f6a40005940 comp rx=0 tx=0).stop 2024-05-09T00:10:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.990+0000 7f6a5754f700 1 -- 172.21.15.81:0/883064217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5019ad70 msgr2=0x7f6a5019b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.990+0000 7f6a5754f700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5019ad70 0x7f6a5019b1f0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f6a48007d70 tx=0x7f6a4800a340 comp rx=0 tx=0).stop 2024-05-09T00:10:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.990+0000 7f6a5754f700 1 -- 172.21.15.81:0/883064217 shutdown_connections 2024-05-09T00:10:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.990+0000 7f6a5754f700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6a3c0a1290 0x7f6a3c0a3750 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.990+0000 7f6a5754f700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a50100790 0x7f6a50196490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.990+0000 7f6a5754f700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a5019ad70 0x7f6a5019b1f0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.990+0000 7f6a5754f700 1 --2- 172.21.15.81:0/883064217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a50105390 0x7f6a501969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.990+0000 7f6a5754f700 1 -- 172.21.15.81:0/883064217 >> 172.21.15.81:0/883064217 conn(0x7f6a500763a0 msgr2=0x7f6a50103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.990+0000 7f6a5754f700 1 -- 172.21.15.81:0/883064217 shutdown_connections 2024-05-09T00:10:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:10.990+0000 7f6a5754f700 1 -- 172.21.15.81:0/883064217 wait complete. 2024-05-09T00:10:10.998 INFO:tasks.cephfs.filesystem:scrub status for tag:32e4c11c-9874-4d88-88c8-be1f819fc9dc - {'path': '/', 'tag': '32e4c11c-9874-4d88-88c8-be1f819fc9dc', 'options': 'recursive,force'} 2024-05-09T00:10:11.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:10 smithi150 ceph-mon[46187]: pgmap v220: 97 pgs: 97 active+clean; 3.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 102 KiB/s wr, 35 op/s 2024-05-09T00:10:11.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:10 smithi171 ceph-mon[47351]: pgmap v220: 97 pgs: 97 active+clean; 3.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 102 KiB/s wr, 35 op/s 2024-05-09T00:10:11.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:10 smithi081 ceph-mon[42474]: pgmap v220: 97 pgs: 97 active+clean; 3.1 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 102 KiB/s wr, 35 op/s 2024-05-09T00:10:12.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:11 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:10:12.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:11 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:10:12.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:11 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:10:12.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:11 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:10:12.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:11 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:10:12.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:11 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:10:12.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:11 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:10:12.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:11 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:10:12.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:11 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:10:12.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:11 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:10:12.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:11 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:10:12.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:11 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:10:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.090+0000 7fcaee131700 1 -- 172.21.15.81:0/2427471250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcae8106f50 msgr2=0x7fcae8107330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.090+0000 7fcaee131700 1 --2- 172.21.15.81:0/2427471250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcae8106f50 0x7fcae8107330 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fcad8009990 tx=0x7fcad8009ca0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.090+0000 7fcaee131700 1 -- 172.21.15.81:0/2427471250 shutdown_connections 2024-05-09T00:10:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.090+0000 7fcaee131700 1 --2- 172.21.15.81:0/2427471250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcae806a0d0 0x7fcae810dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.090+0000 7fcaee131700 1 --2- 172.21.15.81:0/2427471250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcae8106f50 0x7fcae8107330 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.090+0000 7fcaee131700 1 --2- 172.21.15.81:0/2427471250 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcae8069730 0x7fcae8069b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.090+0000 7fcaee131700 1 -- 172.21.15.81:0/2427471250 >> 172.21.15.81:0/2427471250 conn(0x7fcae8076fd0 msgr2=0x7fcae80773e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.090+0000 7fcaee131700 1 -- 172.21.15.81:0/2427471250 shutdown_connections 2024-05-09T00:10:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.090+0000 7fcaee131700 1 -- 172.21.15.81:0/2427471250 wait complete. 2024-05-09T00:10:13.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.091+0000 7fcaee131700 1 Processor -- start 2024-05-09T00:10:13.089 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.091+0000 7fcaee131700 1 -- start start 2024-05-09T00:10:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.091+0000 7fcaee131700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcae8069730 0x7fcae8197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.091+0000 7fcaee131700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcae806a0d0 0x7fcae81978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.091+0000 7fcaee131700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcae8106f50 0x7fcae819bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.091+0000 7fcaee131700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae819c290 con 0x7fcae8069730 2024-05-09T00:10:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.091+0000 7fcaee131700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae819c400 con 0x7fcae8106f50 2024-05-09T00:10:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.091+0000 7fcaee131700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae819c5c0 con 0x7fcae806a0d0 2024-05-09T00:10:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.091+0000 7fcae77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcae8069730 0x7fcae8197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.091+0000 7fcae77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcae8069730 0x7fcae8197370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49262/0 (socket says 172.21.15.81:49262) 2024-05-09T00:10:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.091+0000 7fcae77fe700 1 -- 172.21.15.81:0/3144387247 learned_addr learned my addr 172.21.15.81:0/3144387247 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.091+0000 7fcae7fff700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcae8106f50 0x7fcae819bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.091+0000 7fcae6ffd700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcae806a0d0 0x7fcae81978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.090 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.092+0000 7fcae77fe700 1 -- 172.21.15.81:0/3144387247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcae806a0d0 msgr2=0x7fcae81978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.092+0000 7fcae77fe700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcae806a0d0 0x7fcae81978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.092+0000 7fcae77fe700 1 -- 172.21.15.81:0/3144387247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcae8106f50 msgr2=0x7fcae819bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.092+0000 7fcae77fe700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcae8106f50 0x7fcae819bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.092+0000 7fcae77fe700 1 -- 172.21.15.81:0/3144387247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad80095f0 con 0x7fcae8069730 2024-05-09T00:10:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.092+0000 7fcae7fff700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcae8106f50 0x7fcae819bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.092+0000 7fcae6ffd700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcae806a0d0 0x7fcae81978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.092+0000 7fcae77fe700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcae8069730 0x7fcae8197370 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fcad8005910 tx=0x7fcad8009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.092+0000 7fcae4ff9700 1 -- 172.21.15.81:0/3144387247 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad801d070 con 0x7fcae8069730 2024-05-09T00:10:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.092+0000 7fcaee131700 1 -- 172.21.15.81:0/3144387247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae819c840 con 0x7fcae8069730 2024-05-09T00:10:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.092+0000 7fcae4ff9700 1 -- 172.21.15.81:0/3144387247 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcad8022470 con 0x7fcae8069730 2024-05-09T00:10:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.092+0000 7fcae4ff9700 1 -- 172.21.15.81:0/3144387247 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad8017650 con 0x7fcae8069730 2024-05-09T00:10:13.091 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.092+0000 7fcaee131700 1 -- 172.21.15.81:0/3144387247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae81a40e0 con 0x7fcae8069730 2024-05-09T00:10:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.094+0000 7fcae4ff9700 1 -- 172.21.15.81:0/3144387247 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fcad80225e0 con 0x7fcae8069730 2024-05-09T00:10:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.095+0000 7fcae4ff9700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcad00a1310 0x7fcad00a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.095+0000 7fcae6ffd700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcad00a1310 0x7fcad00a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.095+0000 7fcae4ff9700 1 -- 172.21.15.81:0/3144387247 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fcad80ce250 con 0x7fcae8069730 2024-05-09T00:10:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.096+0000 7fcae6ffd700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcad00a1310 0x7fcad00a37d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcadc005950 tx=0x7fcadc0058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.096+0000 7fcafa2ebb80 1 Processor -- start 2024-05-09T00:10:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.096+0000 7fcafa2ebb80 1 -- start start 2024-05-09T00:10:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.096+0000 7fcafa2ebb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d18cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.096+0000 7fcafa2ebb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d186f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.096+0000 7fcafa2ebb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d187480 0x56549d1878a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.096+0000 7fcafa2ebb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549d0de0f0 con 0x56549d18d270 2024-05-09T00:10:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.096+0000 7fcafa2ebb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549d0dbab0 con 0x56549d18c950 2024-05-09T00:10:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.096+0000 7fcafa2ebb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549d0d73a0 con 0x56549d187480 2024-05-09T00:10:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.097+0000 7fcae6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d186f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.097+0000 7fcae6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d186f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49274/0 (socket says 172.21.15.81:49274) 2024-05-09T00:10:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.097+0000 7fcae6ffd700 1 -- 172.21.15.81:0/3090460243 learned_addr learned my addr 172.21.15.81:0/3090460243 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.097+0000 7fcae77fe700 1 --2- 172.21.15.81:0/3090460243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d18cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.097+0000 7fcae7fff700 1 --2- 172.21.15.81:0/3090460243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d187480 0x56549d1878a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.097+0000 7fcae6ffd700 1 -- 172.21.15.81:0/3090460243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d187480 msgr2=0x56549d1878a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.097+0000 7fcae6ffd700 1 --2- 172.21.15.81:0/3090460243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d187480 0x56549d1878a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.097+0000 7fcae6ffd700 1 -- 172.21.15.81:0/3090460243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 msgr2=0x56549d18cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.097+0000 7fcae6ffd700 1 --2- 172.21.15.81:0/3090460243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d18cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.097+0000 7fcae6ffd700 1 -- 172.21.15.81:0/3090460243 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56549cf58350 con 0x56549d18d270 2024-05-09T00:10:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.097+0000 7fcae6ffd700 1 --2- 172.21.15.81:0/3090460243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d186f40 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00fed0 tx=0x7fcadc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f467b81839338d6b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.097+0000 7fcacdffb700 1 -- 172.21.15.81:0/3090460243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc017040 con 0x56549d18d270 2024-05-09T00:10:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.097+0000 7fcacdffb700 1 -- 172.21.15.81:0/3090460243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcadc003d40 con 0x56549d18d270 2024-05-09T00:10:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.097+0000 7fcacdffb700 1 -- 172.21.15.81:0/3090460243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcadc01fcd0 con 0x56549d18d270 2024-05-09T00:10:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.098+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/3090460243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 msgr2=0x56549d186f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.098+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/3090460243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d186f40 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00fed0 tx=0x7fcadc012000 comp rx=0 tx=0).stop 2024-05-09T00:10:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.098+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/3090460243 shutdown_connections 2024-05-09T00:10:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.098+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/3090460243 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d18cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.098+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/3090460243 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d187480 0x56549d1878a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.098+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/3090460243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d186f40 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.098+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/3090460243 >> 172.21.15.81:0/3090460243 conn(0x56549d0e51b0 msgr2=0x56549d181840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.098+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/3090460243 shutdown_connections 2024-05-09T00:10:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.098+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/3090460243 wait complete. 2024-05-09T00:10:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.098+0000 7fcafa2ebb80 1 -- start start 2024-05-09T00:10:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcafa2ebb80 1 Processor -- start 2024-05-09T00:10:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcafa2ebb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d187480 0x56549d193260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcafa2ebb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d190550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcafa2ebb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d190c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcafa2ebb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549d073500 con 0x56549d18d270 2024-05-09T00:10:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcafa2ebb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549d0731a0 con 0x56549d18c950 2024-05-09T00:10:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcafa2ebb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549cf5a640 con 0x56549d187480 2024-05-09T00:10:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcafa2ebb80 10 client.0 _ll_register_callbacks cb 0x56549d07cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcae7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d190c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcae7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d190c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49284/0 (socket says 172.21.15.81:49284) 2024-05-09T00:10:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcae7fff700 1 -- 172.21.15.81:0/663305847 learned_addr learned my addr 172.21.15.81:0/663305847 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcae77fe700 1 --2- 172.21.15.81:0/663305847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d187480 0x56549d193260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcae6ffd700 1 --2- 172.21.15.81:0/663305847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d190550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcae7fff700 1 -- 172.21.15.81:0/663305847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d187480 msgr2=0x56549d193260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcae7fff700 1 --2- 172.21.15.81:0/663305847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d187480 0x56549d193260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcae7fff700 1 -- 172.21.15.81:0/663305847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 msgr2=0x56549d190550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcae7fff700 1 --2- 172.21.15.81:0/663305847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d190550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcae7fff700 1 -- 172.21.15.81:0/663305847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcadc00fbb0 con 0x56549d18d270 2024-05-09T00:10:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcae7fff700 1 --2- 172.21.15.81:0/663305847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d190c90 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fcae0007f00 tx=0x7fcae0007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996a0d2f9d69c8c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.099+0000 7fcac6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcac6ffd700 1 -- 172.21.15.81:0/663305847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae000e070 con 0x56549d18d270 2024-05-09T00:10:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcac6ffd700 1 -- 172.21.15.81:0/663305847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fcae0003a00 con 0x56549d18d270 2024-05-09T00:10:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/663305847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56549d030210 con 0x56549d18d270 2024-05-09T00:10:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcac6ffd700 1 -- 172.21.15.81:0/663305847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcae00093b0 con 0x56549d18d270 2024-05-09T00:10:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcafa2ebb80 10 client.17553 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/663305847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56549cf04b00 con 0x56549d18d270 2024-05-09T00:10:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcac6ffd700 1 -- 172.21.15.81:0/663305847 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56549d030210 con 0x56549d18d270 2024-05-09T00:10:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcac6ffd700 1 -- 172.21.15.81:0/663305847 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcae0016a70 con 0x56549d18d270 2024-05-09T00:10:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcafa2ebb80 10 client.17553 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcafa2ebb80 10 client.17553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcafa2ebb80 20 client.17553 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/663305847 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56549d1a0c50 0x56549d1a3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcafa2ebb80 4 client.17553 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/663305847 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56549d1567b0 con 0x56549d1a0c50 2024-05-09T00:10:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.100+0000 7fcae77fe700 1 --2- 172.21.15.81:0/663305847 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56549d1a0c50 0x56549d1a3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.101+0000 7fcac6ffd700 10 client.17553 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.101+0000 7fcae77fe700 1 --2- 172.21.15.81:0/663305847 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56549d1a0c50 0x56549d1a3070 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a9e53a43691b802 server_cookie=34870f9d4c08d535 in_seq=0 out_seq=0 2024-05-09T00:10:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.101+0000 7fcac6ffd700 1 -- 172.21.15.81:0/663305847 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56549d1567b0 con 0x56549d1a0c50 2024-05-09T00:10:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.101+0000 7fcac6ffd700 10 client.17553 handle_command_reply: tid=0 2024-05-09T00:10:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.101+0000 7fcafa2ebb80 1 client.17553 shutdown 2024-05-09T00:10:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.102+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/663305847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 msgr2=0x56549d190c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.102+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/663305847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d190c90 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fcae0007f00 tx=0x7fcae0007f30 comp rx=0 tx=0).stop 2024-05-09T00:10:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.102+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/663305847 shutdown_connections 2024-05-09T00:10:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.102+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/663305847 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56549d1a0c50 0x56549d1a3070 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.102+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/663305847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d190c90 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.102+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/663305847 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d187480 0x56549d193260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.102+0000 7fcac6ffd700 0 client.17553 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.102+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/663305847 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d190550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.102+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/663305847 >> 172.21.15.81:0/663305847 conn(0x56549d0e51b0 msgr2=0x56549d18a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.102+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/663305847 shutdown_connections 2024-05-09T00:10:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.102+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/663305847 wait complete. 2024-05-09T00:10:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.102+0000 7fcafa2ebb80 20 client.17553 trim_cache size 0 max 16384 2024-05-09T00:10:13.117 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcafa2ebb80 1 Processor -- start 2024-05-09T00:10:13.117 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcafa2ebb80 1 -- start start 2024-05-09T00:10:13.117 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcafa2ebb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d187480 0x56549d1830f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcafa2ebb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d181910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcafa2ebb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d187860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcafa2ebb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549d187de0 con 0x56549d18d270 2024-05-09T00:10:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcafa2ebb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549d183690 con 0x56549d18c950 2024-05-09T00:10:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcafa2ebb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549d183820 con 0x56549d187480 2024-05-09T00:10:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcae7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d187860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcae7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d187860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49294/0 (socket says 172.21.15.81:49294) 2024-05-09T00:10:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcae7fff700 1 -- 172.21.15.81:0/4084953246 learned_addr learned my addr 172.21.15.81:0/4084953246 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcae6ffd700 1 --2- 172.21.15.81:0/4084953246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d181910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcae7fff700 1 -- 172.21.15.81:0/4084953246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d187480 msgr2=0x56549d1830f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcae7fff700 1 --2- 172.21.15.81:0/4084953246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d187480 0x56549d1830f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcae7fff700 1 -- 172.21.15.81:0/4084953246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 msgr2=0x56549d181910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcae7fff700 1 --2- 172.21.15.81:0/4084953246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d181910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcae7fff700 1 -- 172.21.15.81:0/4084953246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56549d09d500 con 0x56549d18d270 2024-05-09T00:10:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcae6ffd700 1 --2- 172.21.15.81:0/4084953246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d181910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcae7fff700 1 --2- 172.21.15.81:0/4084953246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d187860 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fcae0002230 tx=0x7fcae00099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e72d2c60f18ef4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcace7fc700 1 -- 172.21.15.81:0/4084953246 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae000e040 con 0x56549d18d270 2024-05-09T00:10:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcace7fc700 1 -- 172.21.15.81:0/4084953246 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcae000f040 con 0x56549d18d270 2024-05-09T00:10:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.117+0000 7fcace7fc700 1 -- 172.21.15.81:0/4084953246 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae0013d30 con 0x56549d18d270 2024-05-09T00:10:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.118+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/4084953246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 msgr2=0x56549d187860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.118+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/4084953246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d187860 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fcae0002230 tx=0x7fcae00099b0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.118+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/4084953246 shutdown_connections 2024-05-09T00:10:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.118+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/4084953246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d18d270 0x56549d187860 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.118+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/4084953246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d187480 0x56549d1830f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.118+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/4084953246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d181910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.118+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/4084953246 >> 172.21.15.81:0/4084953246 conn(0x56549d0e51b0 msgr2=0x56549d185630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.118+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/4084953246 shutdown_connections 2024-05-09T00:10:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.118+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/4084953246 wait complete. 2024-05-09T00:10:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.118+0000 7fcafa2ebb80 1 -- start start 2024-05-09T00:10:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcafa2ebb80 1 Processor -- start 2024-05-09T00:10:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcafa2ebb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d187480 0x56549d197e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcafa2ebb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d18ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcafa2ebb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d18d270 0x56549d18b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcafa2ebb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549d18b6f0 con 0x56549d187480 2024-05-09T00:10:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcafa2ebb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549d18b860 con 0x56549d18c950 2024-05-09T00:10:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcafa2ebb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549d18ba20 con 0x56549d18d270 2024-05-09T00:10:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcafa2ebb80 10 client.0 _ll_register_callbacks cb 0x56549d07cad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcae77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d187480 0x56549d197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcae77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d187480 0x56549d197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49298/0 (socket says 172.21.15.81:49298) 2024-05-09T00:10:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcae77fe700 1 -- 172.21.15.81:0/1780169819 learned_addr learned my addr 172.21.15.81:0/1780169819 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcae7fff700 1 --2- 172.21.15.81:0/1780169819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d18d270 0x56549d18b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcae6ffd700 1 --2- 172.21.15.81:0/1780169819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d18ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcae77fe700 1 -- 172.21.15.81:0/1780169819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d18d270 msgr2=0x56549d18b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcae77fe700 1 --2- 172.21.15.81:0/1780169819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d18d270 0x56549d18b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcae77fe700 1 -- 172.21.15.81:0/1780169819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 msgr2=0x56549d18ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcae77fe700 1 --2- 172.21.15.81:0/1780169819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d18ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcae77fe700 1 -- 172.21.15.81:0/1780169819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56549cf04b00 con 0x56549d187480 2024-05-09T00:10:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcae6ffd700 1 --2- 172.21.15.81:0/1780169819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d18ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcae77fe700 1 --2- 172.21.15.81:0/1780169819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d187480 0x56549d197e00 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fcad80cba20 tx=0x7fcad8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669dea1bf873b199 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcac6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.119+0000 7fcac6ffd700 1 -- 172.21.15.81:0/1780169819 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad80ce040 con 0x56549d187480 2024-05-09T00:10:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.120+0000 7fcac6ffd700 1 -- 172.21.15.81:0/1780169819 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fcad809bbe0 con 0x56549d187480 2024-05-09T00:10:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.120+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/1780169819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcadc003d40 con 0x56549d187480 2024-05-09T00:10:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.120+0000 7fcac6ffd700 1 -- 172.21.15.81:0/1780169819 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcad809b4e0 con 0x56549d187480 2024-05-09T00:10:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.120+0000 7fcafa2ebb80 10 client.17559 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.120+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/1780169819 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56549cf5cc70 con 0x56549d187480 2024-05-09T00:10:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.120+0000 7fcac6ffd700 1 -- 172.21.15.81:0/1780169819 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcadc003d40 con 0x56549d187480 2024-05-09T00:10:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.120+0000 7fcac6ffd700 1 -- 172.21.15.81:0/1780169819 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcad809a9d0 con 0x56549d187480 2024-05-09T00:10:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.120+0000 7fcafa2ebb80 10 client.17559 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.120+0000 7fcafa2ebb80 10 client.17559 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.120+0000 7fcafa2ebb80 20 client.17559 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.120+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/1780169819 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56549d1f77a0 0x56549d1f9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.120+0000 7fcafa2ebb80 4 client.17559 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:10:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.120+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/1780169819 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56549d0cfe60 con 0x56549d1f77a0 2024-05-09T00:10:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.120+0000 7fcae6ffd700 1 --2- 172.21.15.81:0/1780169819 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56549d1f77a0 0x56549d1f9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.121+0000 7fcac6ffd700 10 client.17559 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:13.123 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.121+0000 7fcae6ffd700 1 --2- 172.21.15.81:0/1780169819 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56549d1f77a0 0x56549d1f9bc0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5122c01a3c5a70fc server_cookie=6f8e71862345dbd in_seq=0 out_seq=0 2024-05-09T00:10:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcac6ffd700 1 -- 172.21.15.81:0/1780169819 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56549d0cfe60 con 0x56549d1f77a0 2024-05-09T00:10:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcac6ffd700 10 client.17559 handle_command_reply: tid=0 2024-05-09T00:10:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcafa2ebb80 1 client.17559 shutdown 2024-05-09T00:10:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/1780169819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d187480 msgr2=0x56549d197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/1780169819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d187480 0x56549d197e00 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fcad80cba20 tx=0x7fcad8005fd0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/1780169819 shutdown_connections 2024-05-09T00:10:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/1780169819 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56549d1f77a0 0x56549d1f9bc0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/1780169819 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56549d18d270 0x56549d18b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/1780169819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56549d187480 0x56549d197e00 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcac6ffd700 0 client.17559 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcafa2ebb80 1 --2- 172.21.15.81:0/1780169819 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56549d18c950 0x56549d18ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/1780169819 >> 172.21.15.81:0/1780169819 conn(0x56549d0e51b0 msgr2=0x56549d185630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/1780169819 shutdown_connections 2024-05-09T00:10:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcafa2ebb80 1 -- 172.21.15.81:0/1780169819 wait complete. 2024-05-09T00:10:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.134+0000 7fcafa2ebb80 20 client.17559 trim_cache size 0 max 16384 2024-05-09T00:10:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:10:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:10:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:10:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:10:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.135+0000 7fcaee131700 1 -- 172.21.15.81:0/3144387247 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcad00a1310 msgr2=0x7fcad00a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.135+0000 7fcaee131700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcad00a1310 0x7fcad00a37d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fcadc005950 tx=0x7fcadc0058e0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.135+0000 7fcaee131700 1 -- 172.21.15.81:0/3144387247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcae8069730 msgr2=0x7fcae8197370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.135+0000 7fcaee131700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcae8069730 0x7fcae8197370 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fcad8005910 tx=0x7fcad8009570 comp rx=0 tx=0).stop 2024-05-09T00:10:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.135+0000 7fcaee131700 1 -- 172.21.15.81:0/3144387247 shutdown_connections 2024-05-09T00:10:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.135+0000 7fcaee131700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcad00a1310 0x7fcad00a37d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.135+0000 7fcaee131700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcae8106f50 0x7fcae819bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.135+0000 7fcaee131700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcae8069730 0x7fcae8197370 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.135+0000 7fcaee131700 1 --2- 172.21.15.81:0/3144387247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcae806a0d0 0x7fcae81978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:13.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.135+0000 7fcaee131700 1 -- 172.21.15.81:0/3144387247 >> 172.21.15.81:0/3144387247 conn(0x7fcae8076fd0 msgr2=0x7fcae80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:13.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.135+0000 7fcaee131700 1 -- 172.21.15.81:0/3144387247 shutdown_connections 2024-05-09T00:10:13.134 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:13.135+0000 7fcaee131700 1 -- 172.21.15.81:0/3144387247 wait complete. 2024-05-09T00:10:13.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:12 smithi150 ceph-mon[46187]: pgmap v221: 97 pgs: 97 active+clean; 3.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 110 KiB/s wr, 35 op/s 2024-05-09T00:10:13.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:12 smithi150 ceph-mon[46187]: osdmap e85: 12 total, 12 up, 12 in 2024-05-09T00:10:13.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:12 smithi171 ceph-mon[47351]: pgmap v221: 97 pgs: 97 active+clean; 3.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 110 KiB/s wr, 35 op/s 2024-05-09T00:10:13.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:12 smithi171 ceph-mon[47351]: osdmap e85: 12 total, 12 up, 12 in 2024-05-09T00:10:13.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:12 smithi081 ceph-mon[42474]: pgmap v221: 97 pgs: 97 active+clean; 3.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 110 KiB/s wr, 35 op/s 2024-05-09T00:10:13.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:12 smithi081 ceph-mon[42474]: osdmap e85: 12 total, 12 up, 12 in 2024-05-09T00:10:15.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:14 smithi150 ceph-mon[46187]: pgmap v223: 97 pgs: 97 active+clean; 3.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 136 KiB/s wr, 44 op/s 2024-05-09T00:10:15.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:14 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:10:15.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:14 smithi171 ceph-mon[47351]: pgmap v223: 97 pgs: 97 active+clean; 3.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 136 KiB/s wr, 44 op/s 2024-05-09T00:10:15.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:14 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:10:15.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:14 smithi081 ceph-mon[42474]: pgmap v223: 97 pgs: 97 active+clean; 3.4 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 136 KiB/s wr, 44 op/s 2024-05-09T00:10:15.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:14 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:10:17.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:16 smithi150 ceph-mon[46187]: pgmap v224: 97 pgs: 97 active+clean; 3.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-05-09T00:10:17.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:16 smithi171 ceph-mon[47351]: pgmap v224: 97 pgs: 97 active+clean; 3.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-05-09T00:10:17.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:16 smithi081 ceph-mon[42474]: pgmap v224: 97 pgs: 97 active+clean; 3.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-05-09T00:10:19.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:18 smithi150 ceph-mon[46187]: pgmap v225: 97 pgs: 97 active+clean; 3.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-05-09T00:10:19.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:18 smithi171 ceph-mon[47351]: pgmap v225: 97 pgs: 97 active+clean; 3.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-05-09T00:10:19.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:18 smithi081 ceph-mon[42474]: pgmap v225: 97 pgs: 97 active+clean; 3.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-05-09T00:10:21.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:20 smithi150 ceph-mon[46187]: pgmap v226: 97 pgs: 97 active+clean; 3.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-05-09T00:10:21.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:20 smithi171 ceph-mon[47351]: pgmap v226: 97 pgs: 97 active+clean; 3.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-05-09T00:10:21.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:20 smithi081 ceph-mon[42474]: pgmap v226: 97 pgs: 97 active+clean; 3.6 MiB data, 412 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 53 KiB/s wr, 16 op/s 2024-05-09T00:10:23.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:22 smithi150 ceph-mon[46187]: pgmap v227: 97 pgs: 97 active+clean; 3.8 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 16 op/s 2024-05-09T00:10:23.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:22 smithi171 ceph-mon[47351]: pgmap v227: 97 pgs: 97 active+clean; 3.8 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 16 op/s 2024-05-09T00:10:23.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:22 smithi081 ceph-mon[42474]: pgmap v227: 97 pgs: 97 active+clean; 3.8 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 16 op/s 2024-05-09T00:10:25.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:24 smithi150 ceph-mon[46187]: pgmap v228: 97 pgs: 97 active+clean; 3.8 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 16 op/s 2024-05-09T00:10:25.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:24 smithi171 ceph-mon[47351]: pgmap v228: 97 pgs: 97 active+clean; 3.8 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 16 op/s 2024-05-09T00:10:25.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:24 smithi081 ceph-mon[42474]: pgmap v228: 97 pgs: 97 active+clean; 3.8 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 50 KiB/s wr, 16 op/s 2024-05-09T00:10:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.251+0000 7f7ab2029700 1 -- 172.21.15.81:0/1647997996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7aac0ffda0 msgr2=0x7f7aac100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.251+0000 7f7ab2029700 1 --2- 172.21.15.81:0/1647997996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7aac0ffda0 0x7f7aac100220 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009990 tx=0x7f7aa0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.251+0000 7f7ab2029700 1 -- 172.21.15.81:0/1647997996 shutdown_connections 2024-05-09T00:10:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.251+0000 7f7ab2029700 1 --2- 172.21.15.81:0/1647997996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aac105e60 0x7f7aac106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.251+0000 7f7ab2029700 1 --2- 172.21.15.81:0/1647997996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7aac100760 0x7f7aac10cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.251+0000 7f7ab2029700 1 --2- 172.21.15.81:0/1647997996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7aac0ffda0 0x7f7aac100220 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.251+0000 7f7ab2029700 1 -- 172.21.15.81:0/1647997996 >> 172.21.15.81:0/1647997996 conn(0x7f7aac076f10 msgr2=0x7f7aac077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:26.252 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.251+0000 7f7ab2029700 1 -- 172.21.15.81:0/1647997996 shutdown_connections 2024-05-09T00:10:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.251+0000 7f7ab2029700 1 -- 172.21.15.81:0/1647997996 wait complete. 2024-05-09T00:10:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.252+0000 7f7ab2029700 1 Processor -- start 2024-05-09T00:10:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.252+0000 7f7ab2029700 1 -- start start 2024-05-09T00:10:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.252+0000 7f7ab2029700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7aac0ffda0 0x7f7aac198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.252+0000 7f7ab2029700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aac100760 0x7f7aac1986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.252+0000 7f7ab2029700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7aac105e60 0x7f7aac1a31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.252+0000 7f7ab2029700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac198ed0 con 0x7f7aac105e60 2024-05-09T00:10:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.252+0000 7f7ab2029700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac1a3720 con 0x7f7aac100760 2024-05-09T00:10:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7ab2029700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac1a3860 con 0x7f7aac0ffda0 2024-05-09T00:10:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7aabfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7aac105e60 0x7f7aac1a31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7aabfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7aac105e60 0x7f7aac1a31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37554/0 (socket says 172.21.15.81:37554) 2024-05-09T00:10:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7aabfff700 1 -- 172.21.15.81:0/404362285 learned_addr learned my addr 172.21.15.81:0/404362285 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7aab7fe700 1 --2- 172.21.15.81:0/404362285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7aac0ffda0 0x7f7aac198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.253 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7aaaffd700 1 --2- 172.21.15.81:0/404362285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aac100760 0x7f7aac1986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7aabfff700 1 -- 172.21.15.81:0/404362285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7aac0ffda0 msgr2=0x7f7aac198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7aabfff700 1 --2- 172.21.15.81:0/404362285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7aac0ffda0 0x7f7aac198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7aabfff700 1 -- 172.21.15.81:0/404362285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aac100760 msgr2=0x7f7aac1986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7aabfff700 1 --2- 172.21.15.81:0/404362285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aac100760 0x7f7aac1986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7aabfff700 1 -- 172.21.15.81:0/404362285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa00095f0 con 0x7f7aac105e60 2024-05-09T00:10:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7aabfff700 1 --2- 172.21.15.81:0/404362285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7aac105e60 0x7f7aac1a31e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4007ee0 tx=0x7f7aa400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7aa8ff9700 1 -- 172.21.15.81:0/404362285 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4017070 con 0x7f7aac105e60 2024-05-09T00:10:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7aa8ff9700 1 -- 172.21.15.81:0/404362285 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7aa400f040 con 0x7f7aac105e60 2024-05-09T00:10:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7ab2029700 1 -- 172.21.15.81:0/404362285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aac1a3ac0 con 0x7f7aac105e60 2024-05-09T00:10:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7aa8ff9700 1 -- 172.21.15.81:0/404362285 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4005740 con 0x7f7aac105e60 2024-05-09T00:10:26.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.253+0000 7f7ab2029700 1 -- 172.21.15.81:0/404362285 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aac1a3fa0 con 0x7f7aac105e60 2024-05-09T00:10:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.255+0000 7f7aa8ff9700 1 -- 172.21.15.81:0/404362285 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f7aa40058a0 con 0x7f7aac105e60 2024-05-09T00:10:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.256+0000 7f7aa8ff9700 1 --2- 172.21.15.81:0/404362285 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7a940a1290 0x7f7a940a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.256+0000 7f7aab7fe700 1 --2- 172.21.15.81:0/404362285 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7a940a1290 0x7f7a940a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.256+0000 7f7aa8ff9700 1 -- 172.21.15.81:0/404362285 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f7aa40cc570 con 0x7f7aac105e60 2024-05-09T00:10:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.256+0000 7f7aab7fe700 1 --2- 172.21.15.81:0/404362285 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7a940a1290 0x7f7a940a3750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c005fd0 tx=0x7f7a9c00a560 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.257+0000 7f7abe1e3b80 1 Processor -- start 2024-05-09T00:10:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.257+0000 7f7abe1e3b80 1 -- start start 2024-05-09T00:10:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.257+0000 7f7abe1e3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011f9950 0x55d8011f9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.257+0000 7f7abe1e3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011fa270 0x55d8011f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.257+0000 7f7abe1e3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f4480 0x55d8011f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.257+0000 7f7abe1e3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d80114b0f0 con 0x55d8011f4480 2024-05-09T00:10:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.257+0000 7f7abe1e3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d801148ab0 con 0x55d8011fa270 2024-05-09T00:10:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.257+0000 7f7abe1e3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8011443a0 con 0x55d8011f9950 2024-05-09T00:10:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.257+0000 7f7aabfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f4480 0x55d8011f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.257+0000 7f7aabfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f4480 0x55d8011f48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37564/0 (socket says 172.21.15.81:37564) 2024-05-09T00:10:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.257+0000 7f7aabfff700 1 -- 172.21.15.81:0/490968427 learned_addr learned my addr 172.21.15.81:0/490968427 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.257+0000 7f7aab7fe700 1 --2- 172.21.15.81:0/490968427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011f9950 0x55d8011f9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.257+0000 7f7aaaffd700 1 --2- 172.21.15.81:0/490968427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011fa270 0x55d8011f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.258+0000 7f7aabfff700 1 -- 172.21.15.81:0/490968427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011f9950 msgr2=0x55d8011f9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:26.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.258+0000 7f7aabfff700 1 --2- 172.21.15.81:0/490968427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011f9950 0x55d8011f9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.258+0000 7f7aabfff700 1 -- 172.21.15.81:0/490968427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011fa270 msgr2=0x55d8011f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.258+0000 7f7aabfff700 1 --2- 172.21.15.81:0/490968427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011fa270 0x55d8011f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.258+0000 7f7aabfff700 1 -- 172.21.15.81:0/490968427 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d800fc5350 con 0x55d8011f4480 2024-05-09T00:10:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.258+0000 7f7aaaffd700 1 --2- 172.21.15.81:0/490968427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011fa270 0x55d8011f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.258+0000 7f7aabfff700 1 --2- 172.21.15.81:0/490968427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f4480 0x55d8011f48a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40995e0 tx=0x7f7aa4099420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2659423bc2b24255 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.258+0000 7f7a91ffb700 1 -- 172.21.15.81:0/490968427 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa40b90d0 con 0x55d8011f4480 2024-05-09T00:10:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.258+0000 7f7a91ffb700 1 -- 172.21.15.81:0/490968427 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7aa409d480 con 0x55d8011f4480 2024-05-09T00:10:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.258+0000 7f7a91ffb700 1 -- 172.21.15.81:0/490968427 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400dbd0 con 0x55d8011f4480 2024-05-09T00:10:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.258+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/490968427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f4480 msgr2=0x55d8011f48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.265 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.258+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/490968427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f4480 0x55d8011f48a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40995e0 tx=0x7f7aa4099420 comp rx=0 tx=0).stop 2024-05-09T00:10:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/490968427 shutdown_connections 2024-05-09T00:10:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/490968427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f4480 0x55d8011f48a0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/490968427 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011f9950 0x55d8011f9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/490968427 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011fa270 0x55d8011f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/490968427 >> 172.21.15.81:0/490968427 conn(0x55d8011521b0 msgr2=0x55d8011ee840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/490968427 shutdown_connections 2024-05-09T00:10:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/490968427 wait complete. 2024-05-09T00:10:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 -- start start 2024-05-09T00:10:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 Processor -- start 2024-05-09T00:10:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f4480 0x55d8011fd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f9950 0x55d8011fdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.266 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011fa270 0x55d8011fe030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8010e0500 con 0x55d8011f9950 2024-05-09T00:10:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8010e01a0 con 0x55d8011f4480 2024-05-09T00:10:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.259+0000 7f7abe1e3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d800fc7640 con 0x55d8011fa270 2024-05-09T00:10:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7abe1e3b80 10 client.0 _ll_register_callbacks cb 0x55d8010e9ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7aaaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f9950 0x55d8011fdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7aaaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f9950 0x55d8011fdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37572/0 (socket says 172.21.15.81:37572) 2024-05-09T00:10:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7aaaffd700 1 -- 172.21.15.81:0/1487985064 learned_addr learned my addr 172.21.15.81:0/1487985064 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:26.267 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7aabfff700 1 --2- 172.21.15.81:0/1487985064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011fa270 0x55d8011fe030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7aab7fe700 1 --2- 172.21.15.81:0/1487985064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f4480 0x55d8011fd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7aaaffd700 1 -- 172.21.15.81:0/1487985064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011fa270 msgr2=0x55d8011fe030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:26.268 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7aaaffd700 1 --2- 172.21.15.81:0/1487985064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011fa270 0x55d8011fe030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7aaaffd700 1 -- 172.21.15.81:0/1487985064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f4480 msgr2=0x55d8011fd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7aaaffd700 1 --2- 172.21.15.81:0/1487985064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f4480 0x55d8011fd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7aaaffd700 1 -- 172.21.15.81:0/1487985064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aac1a3fa0 con 0x55d8011f9950 2024-05-09T00:10:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7aabfff700 1 --2- 172.21.15.81:0/1487985064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011fa270 0x55d8011fe030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7aaaffd700 1 --2- 172.21.15.81:0/1487985064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f9950 0x55d8011fdaf0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009990 tx=0x7f7aa0009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6eddc68f88f305d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7a8affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7a8affd700 1 -- 172.21.15.81:0/1487985064 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0005610 con 0x55d8011f9950 2024-05-09T00:10:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7a8affd700 1 -- 172.21.15.81:0/1487985064 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f7aa0003790 con 0x55d8011f9950 2024-05-09T00:10:26.269 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/1487985064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d80109d210 con 0x55d8011f9950 2024-05-09T00:10:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7a8affd700 1 -- 172.21.15.81:0/1487985064 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7aa0003950 con 0x55d8011f9950 2024-05-09T00:10:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7abe1e3b80 10 client.17571 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.260+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/1487985064 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d800f71b00 con 0x55d8011f9950 2024-05-09T00:10:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.261+0000 7f7a8affd700 1 -- 172.21.15.81:0/1487985064 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d80109d210 con 0x55d8011f9950 2024-05-09T00:10:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.261+0000 7f7a8affd700 1 -- 172.21.15.81:0/1487985064 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7aa0021070 con 0x55d8011f9950 2024-05-09T00:10:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.261+0000 7f7abe1e3b80 10 client.17571 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.261+0000 7f7abe1e3b80 10 client.17571 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.261+0000 7f7abe1e3b80 20 client.17571 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.261+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/1487985064 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d80120dbc0 0x55d80120ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.261+0000 7f7abe1e3b80 4 client.17571 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.261+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/1487985064 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8011c37b0 con 0x55d80120dbc0 2024-05-09T00:10:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.261+0000 7f7aab7fe700 1 --2- 172.21.15.81:0/1487985064 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d80120dbc0 0x55d80120ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.270 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.261+0000 7f7a8affd700 10 client.17571 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.261+0000 7f7aab7fe700 1 --2- 172.21.15.81:0/1487985064 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d80120dbc0 0x55d80120ffe0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ba4b186c475d138 server_cookie=cc088854d83e4959 in_seq=0 out_seq=0 2024-05-09T00:10:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.262+0000 7f7a8affd700 1 -- 172.21.15.81:0/1487985064 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d8011c37b0 con 0x55d80120dbc0 2024-05-09T00:10:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.262+0000 7f7a8affd700 10 client.17571 handle_command_reply: tid=0 2024-05-09T00:10:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.262+0000 7f7abe1e3b80 1 client.17571 shutdown 2024-05-09T00:10:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.262+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/1487985064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f9950 msgr2=0x55d8011fdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.262+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/1487985064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f9950 0x55d8011fdaf0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009990 tx=0x7f7aa0009f50 comp rx=0 tx=0).stop 2024-05-09T00:10:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.262+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/1487985064 shutdown_connections 2024-05-09T00:10:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.262+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/1487985064 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d80120dbc0 0x55d80120ffe0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.262+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/1487985064 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f4480 0x55d8011fd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.262+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/1487985064 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011fa270 0x55d8011fe030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.262+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/1487985064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f9950 0x55d8011fdaf0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.262+0000 7f7a8affd700 0 client.17571 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.262+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/1487985064 >> 172.21.15.81:0/1487985064 conn(0x55d8011521b0 msgr2=0x55d8011f84a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:26.271 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.262+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/1487985064 shutdown_connections 2024-05-09T00:10:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.262+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/1487985064 wait complete. 2024-05-09T00:10:26.272 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.263+0000 7f7abe1e3b80 20 client.17571 trim_cache size 0 max 16384 2024-05-09T00:10:26.284 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.277+0000 7f7abe1e3b80 1 Processor -- start 2024-05-09T00:10:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.277+0000 7f7abe1e3b80 1 -- start start 2024-05-09T00:10:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7abe1e3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f4480 0x55d801209630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7abe1e3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f9950 0x55d8011ee910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7abe1e3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011fa270 0x55d8011fde50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7abe1e3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8011ef930 con 0x55d8011f4480 2024-05-09T00:10:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7abe1e3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8012151b0 con 0x55d8011f9950 2024-05-09T00:10:26.285 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7abe1e3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8012005a0 con 0x55d8011fa270 2024-05-09T00:10:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7aab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f4480 0x55d801209630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7aab7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f4480 0x55d801209630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37576/0 (socket says 172.21.15.81:37576) 2024-05-09T00:10:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7aab7fe700 1 -- 172.21.15.81:0/2563894671 learned_addr learned my addr 172.21.15.81:0/2563894671 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7aaaffd700 1 --2- 172.21.15.81:0/2563894671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f9950 0x55d8011ee910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7aab7fe700 1 -- 172.21.15.81:0/2563894671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011fa270 msgr2=0x55d8011fde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:26.286 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7aabfff700 1 --2- 172.21.15.81:0/2563894671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011fa270 0x55d8011fde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7aab7fe700 1 --2- 172.21.15.81:0/2563894671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011fa270 0x55d8011fde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7aab7fe700 1 -- 172.21.15.81:0/2563894671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f9950 msgr2=0x55d8011ee910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7aab7fe700 1 --2- 172.21.15.81:0/2563894671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f9950 0x55d8011ee910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7aab7fe700 1 -- 172.21.15.81:0/2563894671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d80110a500 con 0x55d8011f4480 2024-05-09T00:10:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7aaaffd700 1 --2- 172.21.15.81:0/2563894671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f9950 0x55d8011ee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7aabfff700 1 --2- 172.21.15.81:0/2563894671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011fa270 0x55d8011fde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7aab7fe700 1 --2- 172.21.15.81:0/2563894671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f4480 0x55d801209630 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c013040 tx=0x7f7a9c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f933adf97afac860 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7a927fc700 1 -- 172.21.15.81:0/2563894671 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c024040 con 0x55d8011f4480 2024-05-09T00:10:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7a927fc700 1 -- 172.21.15.81:0/2563894671 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a9c026770 con 0x55d8011f4480 2024-05-09T00:10:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.278+0000 7f7a927fc700 1 -- 172.21.15.81:0/2563894671 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c010430 con 0x55d8011f4480 2024-05-09T00:10:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.279+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/2563894671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f4480 msgr2=0x55d801209630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.279+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/2563894671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f4480 0x55d801209630 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c013040 tx=0x7f7a9c014000 comp rx=0 tx=0).stop 2024-05-09T00:10:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.279+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/2563894671 shutdown_connections 2024-05-09T00:10:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.279+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/2563894671 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011fa270 0x55d8011fde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.279+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/2563894671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011f4480 0x55d801209630 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.279+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/2563894671 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f9950 0x55d8011ee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.279+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/2563894671 >> 172.21.15.81:0/2563894671 conn(0x55d8011521b0 msgr2=0x55d8011f2630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.279+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/2563894671 shutdown_connections 2024-05-09T00:10:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.279+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/2563894671 wait complete. 2024-05-09T00:10:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.279+0000 7f7abe1e3b80 1 -- start start 2024-05-09T00:10:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7abe1e3b80 1 Processor -- start 2024-05-09T00:10:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7abe1e3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011f4480 0x55d8012050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7abe1e3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f9950 0x55d8011f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7abe1e3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011fa270 0x55d8011f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7abe1e3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8011f73f0 con 0x55d8011fa270 2024-05-09T00:10:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7abe1e3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8011f7530 con 0x55d8011f9950 2024-05-09T00:10:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7abe1e3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8011f76c0 con 0x55d8011f4480 2024-05-09T00:10:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7abe1e3b80 10 client.0 _ll_register_callbacks cb 0x55d8010e9ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7aabfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011fa270 0x55d8011f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7aabfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011fa270 0x55d8011f8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37588/0 (socket says 172.21.15.81:37588) 2024-05-09T00:10:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7aabfff700 1 -- 172.21.15.81:0/953210169 learned_addr learned my addr 172.21.15.81:0/953210169 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7aab7fe700 1 --2- 172.21.15.81:0/953210169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011f4480 0x55d8012050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7aaaffd700 1 --2- 172.21.15.81:0/953210169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f9950 0x55d8011f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7aabfff700 1 -- 172.21.15.81:0/953210169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011f4480 msgr2=0x55d8012050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7aabfff700 1 --2- 172.21.15.81:0/953210169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011f4480 0x55d8012050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7aabfff700 1 -- 172.21.15.81:0/953210169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f9950 msgr2=0x55d8011f84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7aabfff700 1 --2- 172.21.15.81:0/953210169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f9950 0x55d8011f84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.280+0000 7f7aabfff700 1 -- 172.21.15.81:0/953210169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9c00ed70 con 0x55d8011fa270 2024-05-09T00:10:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7aabfff700 1 --2- 172.21.15.81:0/953210169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011fa270 0x55d8011f8c20 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40979a0 tx=0x7f7aa409d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0aefb3fdd3cc11 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7a8affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7a8affd700 1 -- 172.21.15.81:0/953210169 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400dde0 con 0x55d8011fa270 2024-05-09T00:10:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7a8affd700 1 -- 172.21.15.81:0/953210169 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f7aa40a1ad0 con 0x55d8011fa270 2024-05-09T00:10:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/953210169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7aa409d480 con 0x55d8011fa270 2024-05-09T00:10:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7a8affd700 1 -- 172.21.15.81:0/953210169 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7aa40b90d0 con 0x55d8011fa270 2024-05-09T00:10:26.293 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7abe1e3b80 10 client.17577 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/953210169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d800fc9c70 con 0x55d8011fa270 2024-05-09T00:10:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7a8affd700 1 -- 172.21.15.81:0/953210169 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7aa409d480 con 0x55d8011fa270 2024-05-09T00:10:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7a8affd700 1 -- 172.21.15.81:0/953210169 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7aa4084080 con 0x55d8011fa270 2024-05-09T00:10:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7abe1e3b80 10 client.17577 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7abe1e3b80 10 client.17577 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7abe1e3b80 20 client.17577 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/953210169 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d801268af0 0x55d80126aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:26.294 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7abe1e3b80 4 client.17577 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:10:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.281+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/953210169 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d80113ce60 con 0x55d801268af0 2024-05-09T00:10:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.282+0000 7f7aab7fe700 1 --2- 172.21.15.81:0/953210169 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d801268af0 0x55d80126aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.282+0000 7f7aab7fe700 1 --2- 172.21.15.81:0/953210169 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d801268af0 0x55d80126aee0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2115bba4af4e1049 server_cookie=23bb5beb34327ae1 in_seq=0 out_seq=0 2024-05-09T00:10:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.282+0000 7f7a8affd700 10 client.17577 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.296+0000 7f7a8affd700 1 -- 172.21.15.81:0/953210169 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d80113ce60 con 0x55d801268af0 2024-05-09T00:10:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.296+0000 7f7a8affd700 10 client.17577 handle_command_reply: tid=0 2024-05-09T00:10:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.296+0000 7f7abe1e3b80 1 client.17577 shutdown 2024-05-09T00:10:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/953210169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011fa270 msgr2=0x55d8011f8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/953210169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011fa270 0x55d8011f8c20 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40979a0 tx=0x7f7aa409d3a0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/953210169 shutdown_connections 2024-05-09T00:10:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/953210169 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d801268af0 0x55d80126aee0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/953210169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d8011fa270 0x55d8011f8c20 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/953210169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d8011f4480 0x55d8012050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7a8affd700 0 client.17577 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7abe1e3b80 1 --2- 172.21.15.81:0/953210169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d8011f9950 0x55d8011f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/953210169 >> 172.21.15.81:0/953210169 conn(0x55d8011521b0 msgr2=0x55d8011fbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/953210169 shutdown_connections 2024-05-09T00:10:26.299 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7abe1e3b80 1 -- 172.21.15.81:0/953210169 wait complete. 2024-05-09T00:10:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7abe1e3b80 20 client.17577 trim_cache size 0 max 16384 2024-05-09T00:10:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:10:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:10:26.300 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:10:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:10:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7ab2029700 1 -- 172.21.15.81:0/404362285 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7a940a1290 msgr2=0x7f7a940a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7ab2029700 1 --2- 172.21.15.81:0/404362285 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7a940a1290 0x7f7a940a3750 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c005fd0 tx=0x7f7a9c00a560 comp rx=0 tx=0).stop 2024-05-09T00:10:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7ab2029700 1 -- 172.21.15.81:0/404362285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7aac105e60 msgr2=0x7f7aac1a31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7ab2029700 1 --2- 172.21.15.81:0/404362285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7aac105e60 0x7f7aac1a31e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4007ee0 tx=0x7f7aa400d3b0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7ab2029700 1 -- 172.21.15.81:0/404362285 shutdown_connections 2024-05-09T00:10:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7ab2029700 1 --2- 172.21.15.81:0/404362285 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7a940a1290 0x7f7a940a3750 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7ab2029700 1 --2- 172.21.15.81:0/404362285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7aac105e60 0x7f7aac1a31e0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7ab2029700 1 --2- 172.21.15.81:0/404362285 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7aac0ffda0 0x7f7aac198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7ab2029700 1 --2- 172.21.15.81:0/404362285 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7aac100760 0x7f7aac1986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.297+0000 7f7ab2029700 1 -- 172.21.15.81:0/404362285 >> 172.21.15.81:0/404362285 conn(0x7f7aac076f10 msgr2=0x7f7aac0fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.298+0000 7f7ab2029700 1 -- 172.21.15.81:0/404362285 shutdown_connections 2024-05-09T00:10:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:26.298+0000 7f7ab2029700 1 -- 172.21.15.81:0/404362285 wait complete. 2024-05-09T00:10:27.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:26 smithi150 ceph-mon[46187]: pgmap v229: 97 pgs: 97 active+clean; 4.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-05-09T00:10:27.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:26 smithi171 ceph-mon[47351]: pgmap v229: 97 pgs: 97 active+clean; 4.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-05-09T00:10:27.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:26 smithi081 ceph-mon[42474]: pgmap v229: 97 pgs: 97 active+clean; 4.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-05-09T00:10:29.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:28 smithi150 ceph-mon[46187]: pgmap v230: 97 pgs: 97 active+clean; 4.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-09T00:10:29.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:28 smithi171 ceph-mon[47351]: pgmap v230: 97 pgs: 97 active+clean; 4.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-09T00:10:29.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:28 smithi081 ceph-mon[42474]: pgmap v230: 97 pgs: 97 active+clean; 4.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-09T00:10:31.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:30 smithi150 ceph-mon[46187]: pgmap v231: 97 pgs: 97 active+clean; 4.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-09T00:10:31.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:30 smithi171 ceph-mon[47351]: pgmap v231: 97 pgs: 97 active+clean; 4.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-09T00:10:31.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:30 smithi081 ceph-mon[42474]: pgmap v231: 97 pgs: 97 active+clean; 4.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-09T00:10:33.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:32 smithi150 ceph-mon[46187]: pgmap v232: 97 pgs: 97 active+clean; 4.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-05-09T00:10:33.304 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:32 smithi171 ceph-mon[47351]: pgmap v232: 97 pgs: 97 active+clean; 4.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-05-09T00:10:33.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:32 smithi081 ceph-mon[42474]: pgmap v232: 97 pgs: 97 active+clean; 4.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-05-09T00:10:35.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:34 smithi150 ceph-mon[46187]: pgmap v233: 97 pgs: 97 active+clean; 4.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-05-09T00:10:35.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:34 smithi171 ceph-mon[47351]: pgmap v233: 97 pgs: 97 active+clean; 4.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-05-09T00:10:35.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:34 smithi081 ceph-mon[42474]: pgmap v233: 97 pgs: 97 active+clean; 4.2 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 40 KiB/s wr, 12 op/s 2024-05-09T00:10:37.266 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:36 smithi150 ceph-mon[46187]: pgmap v234: 97 pgs: 97 active+clean; 4.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-05-09T00:10:37.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:36 smithi171 ceph-mon[47351]: pgmap v234: 97 pgs: 97 active+clean; 4.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-05-09T00:10:37.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:36 smithi081 ceph-mon[42474]: pgmap v234: 97 pgs: 97 active+clean; 4.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-05-09T00:10:38.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:38 smithi171 ceph-mon[47351]: pgmap v235: 97 pgs: 97 active+clean; 4.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-05-09T00:10:38.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:38 smithi081 ceph-mon[42474]: pgmap v235: 97 pgs: 97 active+clean; 4.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-05-09T00:10:38.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:38 smithi150 ceph-mon[46187]: pgmap v235: 97 pgs: 97 active+clean; 4.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-05-09T00:10:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.416+0000 7ff31098c700 1 -- 172.21.15.81:0/2768755376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c0ffdd0 msgr2=0x7ff30c10dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.416+0000 7ff31098c700 1 --2- 172.21.15.81:0/2768755376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c0ffdd0 0x7ff30c10dde0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7ff30400b0d0 tx=0x7ff30400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.416+0000 7ff31098c700 1 -- 172.21.15.81:0/2768755376 shutdown_connections 2024-05-09T00:10:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.416+0000 7ff31098c700 1 --2- 172.21.15.81:0/2768755376 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff30c107020 0x7ff30c107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.416+0000 7ff31098c700 1 --2- 172.21.15.81:0/2768755376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c0ffdd0 0x7ff30c10dde0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.416+0000 7ff31098c700 1 --2- 172.21.15.81:0/2768755376 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff30c0ff410 0x7ff30c0ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.416+0000 7ff31098c700 1 -- 172.21.15.81:0/2768755376 >> 172.21.15.81:0/2768755376 conn(0x7ff30c0763a0 msgr2=0x7ff30c0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:39.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.416+0000 7ff31098c700 1 -- 172.21.15.81:0/2768755376 shutdown_connections 2024-05-09T00:10:39.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.416+0000 7ff31098c700 1 -- 172.21.15.81:0/2768755376 wait complete. 2024-05-09T00:10:39.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.417+0000 7ff31098c700 1 Processor -- start 2024-05-09T00:10:39.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.417+0000 7ff31098c700 1 -- start start 2024-05-09T00:10:39.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.417+0000 7ff31098c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff30c0ff410 0x7ff30c1005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.417+0000 7ff31098c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff30c0ffdd0 0x7ff30c100b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.417+0000 7ff31098c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c107020 0x7ff30c101070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.417+0000 7ff31098c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c1a58a0 con 0x7ff30c107020 2024-05-09T00:10:39.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.417+0000 7ff31098c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c1a5a10 con 0x7ff30c0ffdd0 2024-05-09T00:10:39.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.417+0000 7ff31098c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c1a5bd0 con 0x7ff30c0ff410 2024-05-09T00:10:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.417+0000 7ff30ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c107020 0x7ff30c101070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.417+0000 7ff30ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c107020 0x7ff30c101070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38842/0 (socket says 172.21.15.81:38842) 2024-05-09T00:10:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.417+0000 7ff30ad9d700 1 -- 172.21.15.81:0/3114924439 learned_addr learned my addr 172.21.15.81:0/3114924439 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.417+0000 7ff30a59c700 1 --2- 172.21.15.81:0/3114924439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff30c0ff410 0x7ff30c1005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.417+0000 7ff309d9b700 1 --2- 172.21.15.81:0/3114924439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff30c0ffdd0 0x7ff30c100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.418+0000 7ff30ad9d700 1 -- 172.21.15.81:0/3114924439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff30c0ff410 msgr2=0x7ff30c1005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.418+0000 7ff30ad9d700 1 --2- 172.21.15.81:0/3114924439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff30c0ff410 0x7ff30c1005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.418+0000 7ff30ad9d700 1 -- 172.21.15.81:0/3114924439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff30c0ffdd0 msgr2=0x7ff30c100b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.418+0000 7ff30ad9d700 1 --2- 172.21.15.81:0/3114924439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff30c0ffdd0 0x7ff30c100b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.418+0000 7ff30ad9d700 1 -- 172.21.15.81:0/3114924439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff304009d00 con 0x7ff30c107020 2024-05-09T00:10:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.418+0000 7ff30ad9d700 1 --2- 172.21.15.81:0/3114924439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c107020 0x7ff30c101070 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ff3040094c0 tx=0x7ff3040094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.418+0000 7ff3037fe700 1 -- 172.21.15.81:0/3114924439 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30400e040 con 0x7ff30c107020 2024-05-09T00:10:39.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.418+0000 7ff31098c700 1 -- 172.21.15.81:0/3114924439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30c1a5e50 con 0x7ff30c107020 2024-05-09T00:10:39.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.418+0000 7ff3037fe700 1 -- 172.21.15.81:0/3114924439 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff30401d940 con 0x7ff30c107020 2024-05-09T00:10:39.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.418+0000 7ff3037fe700 1 -- 172.21.15.81:0/3114924439 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30401b9e0 con 0x7ff30c107020 2024-05-09T00:10:39.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.418+0000 7ff31098c700 1 -- 172.21.15.81:0/3114924439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30c1a6320 con 0x7ff30c107020 2024-05-09T00:10:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.421+0000 7ff3037fe700 1 -- 172.21.15.81:0/3114924439 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ff30401d480 con 0x7ff30c107020 2024-05-09T00:10:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.421+0000 7ff3037fe700 1 --2- 172.21.15.81:0/3114924439 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2f80a1290 0x7ff2f80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.421+0000 7ff30a59c700 1 --2- 172.21.15.81:0/3114924439 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2f80a1290 0x7ff2f80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.421+0000 7ff3037fe700 1 -- 172.21.15.81:0/3114924439 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7ff3040ce560 con 0x7ff30c107020 2024-05-09T00:10:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.422+0000 7ff30a59c700 1 --2- 172.21.15.81:0/3114924439 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2f80a1290 0x7ff2f80a3750 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4005950 tx=0x7ff2f400b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.422+0000 7ff31cb46b80 1 Processor -- start 2024-05-09T00:10:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.422+0000 7ff31cb46b80 1 -- start start 2024-05-09T00:10:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff31cb46b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 0x56230a8e6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff31cb46b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e7270 0x56230a8e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff31cb46b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e1480 0x56230a8e18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff31cb46b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230a8380f0 con 0x56230a8e1480 2024-05-09T00:10:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff31cb46b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230a835ab0 con 0x56230a8e7270 2024-05-09T00:10:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff31cb46b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230a8313a0 con 0x56230a8e6950 2024-05-09T00:10:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff30ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e1480 0x56230a8e18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff30ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e1480 0x56230a8e18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38848/0 (socket says 172.21.15.81:38848) 2024-05-09T00:10:39.426 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff30ad9d700 1 -- 172.21.15.81:0/3284057218 learned_addr learned my addr 172.21.15.81:0/3284057218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff30a59c700 1 --2- 172.21.15.81:0/3284057218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 0x56230a8e6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff309d9b700 1 --2- 172.21.15.81:0/3284057218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e7270 0x56230a8e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff30ad9d700 1 -- 172.21.15.81:0/3284057218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 msgr2=0x56230a8e6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff30ad9d700 1 --2- 172.21.15.81:0/3284057218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 0x56230a8e6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff30ad9d700 1 -- 172.21.15.81:0/3284057218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e7270 msgr2=0x56230a8e0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff30ad9d700 1 --2- 172.21.15.81:0/3284057218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e7270 0x56230a8e0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff30ad9d700 1 -- 172.21.15.81:0/3284057218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56230a6b2350 con 0x56230a8e1480 2024-05-09T00:10:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff30a59c700 1 --2- 172.21.15.81:0/3284057218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 0x56230a8e6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff30ad9d700 1 --2- 172.21.15.81:0/3284057218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e1480 0x56230a8e18a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ff304098140 tx=0x7ff3040099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86eaf1e0b9b22254 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff300ff9700 1 -- 172.21.15.81:0/3284057218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3040bb0b0 con 0x56230a8e1480 2024-05-09T00:10:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff300ff9700 1 -- 172.21.15.81:0/3284057218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff30409b6d0 con 0x56230a8e1480 2024-05-09T00:10:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.423+0000 7ff300ff9700 1 -- 172.21.15.81:0/3284057218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304097de0 con 0x56230a8e1480 2024-05-09T00:10:39.427 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.424+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3284057218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e1480 msgr2=0x56230a8e18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.424+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/3284057218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e1480 0x56230a8e18a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ff304098140 tx=0x7ff3040099e0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.424+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3284057218 shutdown_connections 2024-05-09T00:10:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.424+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/3284057218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e1480 0x56230a8e18a0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.424+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/3284057218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 0x56230a8e6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.424+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/3284057218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e7270 0x56230a8e0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.424+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3284057218 >> 172.21.15.81:0/3284057218 conn(0x56230a83f1b0 msgr2=0x56230a8db840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.424+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3284057218 shutdown_connections 2024-05-09T00:10:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.424+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3284057218 wait complete. 2024-05-09T00:10:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff31cb46b80 1 -- start start 2024-05-09T00:10:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff31cb46b80 1 Processor -- start 2024-05-09T00:10:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff31cb46b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e1480 0x56230a8ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.428 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff31cb46b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 0x56230a8ea510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff31cb46b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e7270 0x56230a8eabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff31cb46b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230a7cd500 con 0x56230a8e1480 2024-05-09T00:10:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff31cb46b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230a7cd1a0 con 0x56230a8e7270 2024-05-09T00:10:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff31cb46b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230a6b4640 con 0x56230a8e6950 2024-05-09T00:10:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff31cb46b80 10 client.0 _ll_register_callbacks cb 0x56230a7d6ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff30a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e1480 0x56230a8ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff30a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e1480 0x56230a8ed1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38852/0 (socket says 172.21.15.81:38852) 2024-05-09T00:10:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff30a59c700 1 -- 172.21.15.81:0/4164083018 learned_addr learned my addr 172.21.15.81:0/4164083018 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff309d9b700 1 --2- 172.21.15.81:0/4164083018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 0x56230a8ea510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff30ad9d700 1 --2- 172.21.15.81:0/4164083018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e7270 0x56230a8eabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff30a59c700 1 -- 172.21.15.81:0/4164083018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 msgr2=0x56230a8ea510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff30a59c700 1 --2- 172.21.15.81:0/4164083018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 0x56230a8ea510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff30a59c700 1 -- 172.21.15.81:0/4164083018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e7270 msgr2=0x56230a8eabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:39.429 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff30a59c700 1 --2- 172.21.15.81:0/4164083018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e7270 0x56230a8eabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff30a59c700 1 -- 172.21.15.81:0/4164083018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30c1a6320 con 0x56230a8e1480 2024-05-09T00:10:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff309d9b700 1 --2- 172.21.15.81:0/4164083018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 0x56230a8ea510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff30a59c700 1 --2- 172.21.15.81:0/4164083018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e1480 0x56230a8ed1d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4011740 tx=0x7ff2f40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49d330d669414fb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.425+0000 7ff2f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff2f1ffb700 1 -- 172.21.15.81:0/4164083018 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4004a30 con 0x56230a8e1480 2024-05-09T00:10:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff2f1ffb700 1 -- 172.21.15.81:0/4164083018 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7ff2f4017070 con 0x56230a8e1480 2024-05-09T00:10:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff31cb46b80 1 -- 172.21.15.81:0/4164083018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56230a78a210 con 0x56230a8e1480 2024-05-09T00:10:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff2f1ffb700 1 -- 172.21.15.81:0/4164083018 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff2f4010ec0 con 0x56230a8e1480 2024-05-09T00:10:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff31cb46b80 10 client.17589 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff31cb46b80 1 -- 172.21.15.81:0/4164083018 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56230a65eb00 con 0x56230a8e1480 2024-05-09T00:10:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff2f1ffb700 1 -- 172.21.15.81:0/4164083018 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56230a78a210 con 0x56230a8e1480 2024-05-09T00:10:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff2f1ffb700 1 -- 172.21.15.81:0/4164083018 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff2f401f7d0 con 0x56230a8e1480 2024-05-09T00:10:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff31cb46b80 10 client.17589 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:39.430 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff31cb46b80 10 client.17589 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff31cb46b80 20 client.17589 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/4164083018 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56230a8fa9e0 0x56230a8fce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff31cb46b80 4 client.17589 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff31cb46b80 1 -- 172.21.15.81:0/4164083018 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56230a8b07b0 con 0x56230a8fa9e0 2024-05-09T00:10:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.426+0000 7ff309d9b700 1 --2- 172.21.15.81:0/4164083018 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56230a8fa9e0 0x56230a8fce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.427+0000 7ff309d9b700 1 --2- 172.21.15.81:0/4164083018 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56230a8fa9e0 0x56230a8fce00 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3542f86a2a7ac692 server_cookie=fc474613657a110c in_seq=0 out_seq=0 2024-05-09T00:10:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.427+0000 7ff2f1ffb700 10 client.17589 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.427+0000 7ff2f1ffb700 1 -- 172.21.15.81:0/4164083018 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56230a8b07b0 con 0x56230a8fa9e0 2024-05-09T00:10:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.427+0000 7ff2f1ffb700 10 client.17589 handle_command_reply: tid=0 2024-05-09T00:10:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.427+0000 7ff31cb46b80 1 client.17589 shutdown 2024-05-09T00:10:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.428+0000 7ff31cb46b80 1 -- 172.21.15.81:0/4164083018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e1480 msgr2=0x56230a8ed1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.428+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/4164083018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e1480 0x56230a8ed1d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4011740 tx=0x7ff2f40047c0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.428+0000 7ff31cb46b80 1 -- 172.21.15.81:0/4164083018 shutdown_connections 2024-05-09T00:10:39.431 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.428+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/4164083018 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56230a8fa9e0 0x56230a8fce00 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.428+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/4164083018 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e7270 0x56230a8eabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.428+0000 7ff2f1ffb700 0 client.17589 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:39.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.428+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/4164083018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e1480 0x56230a8ed1d0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.428+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/4164083018 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 0x56230a8ea510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.428+0000 7ff31cb46b80 1 -- 172.21.15.81:0/4164083018 >> 172.21.15.81:0/4164083018 conn(0x56230a83f1b0 msgr2=0x56230a8e4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:39.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.428+0000 7ff31cb46b80 1 -- 172.21.15.81:0/4164083018 shutdown_connections 2024-05-09T00:10:39.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.428+0000 7ff31cb46b80 1 -- 172.21.15.81:0/4164083018 wait complete. 2024-05-09T00:10:39.432 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.428+0000 7ff31cb46b80 20 client.17589 trim_cache size 0 max 16384 2024-05-09T00:10:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff31cb46b80 1 Processor -- start 2024-05-09T00:10:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff31cb46b80 1 -- start start 2024-05-09T00:10:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff31cb46b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e1480 0x56230a8e61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff31cb46b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e6950 0x56230a8db910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff31cb46b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e7270 0x56230a8f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff31cb46b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230a8d3a40 con 0x56230a8e6950 2024-05-09T00:10:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff31cb46b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230a8dd0f0 con 0x56230a8e1480 2024-05-09T00:10:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff31cb46b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230a901ff0 con 0x56230a8e7270 2024-05-09T00:10:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff309d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e6950 0x56230a8db910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff309d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e6950 0x56230a8db910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38864/0 (socket says 172.21.15.81:38864) 2024-05-09T00:10:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff309d9b700 1 -- 172.21.15.81:0/3093095983 learned_addr learned my addr 172.21.15.81:0/3093095983 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff30ad9d700 1 --2- 172.21.15.81:0/3093095983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e7270 0x56230a8f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff30a59c700 1 --2- 172.21.15.81:0/3093095983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e1480 0x56230a8e61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff309d9b700 1 -- 172.21.15.81:0/3093095983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e7270 msgr2=0x56230a8f19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff309d9b700 1 --2- 172.21.15.81:0/3093095983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e7270 0x56230a8f19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff309d9b700 1 -- 172.21.15.81:0/3093095983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e1480 msgr2=0x56230a8e61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff309d9b700 1 --2- 172.21.15.81:0/3093095983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e1480 0x56230a8e61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff309d9b700 1 -- 172.21.15.81:0/3093095983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56230a7f7500 con 0x56230a8e6950 2024-05-09T00:10:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.443+0000 7ff309d9b700 1 --2- 172.21.15.81:0/3093095983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e6950 0x56230a8db910 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x56230a8eba00 tx=0x7ff2fc00f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3608b21b11a80787 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.444+0000 7ff3017fa700 1 -- 172.21.15.81:0/3093095983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc018040 con 0x56230a8e6950 2024-05-09T00:10:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.444+0000 7ff3017fa700 1 -- 172.21.15.81:0/3093095983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2fc01e070 con 0x56230a8e6950 2024-05-09T00:10:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.444+0000 7ff3017fa700 1 -- 172.21.15.81:0/3093095983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc014ab0 con 0x56230a8e6950 2024-05-09T00:10:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.444+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3093095983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e6950 msgr2=0x56230a8db910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.444+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/3093095983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e6950 0x56230a8db910 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x56230a8eba00 tx=0x7ff2fc00f3c0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.444+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3093095983 shutdown_connections 2024-05-09T00:10:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.444+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/3093095983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e1480 0x56230a8e61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.444+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/3093095983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e7270 0x56230a8f19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.444+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/3093095983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e6950 0x56230a8db910 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.444+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3093095983 >> 172.21.15.81:0/3093095983 conn(0x56230a83f1b0 msgr2=0x56230a8f6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.444+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3093095983 shutdown_connections 2024-05-09T00:10:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.444+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3093095983 wait complete. 2024-05-09T00:10:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.444+0000 7ff31cb46b80 1 -- start start 2024-05-09T00:10:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff31cb46b80 1 Processor -- start 2024-05-09T00:10:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff31cb46b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e1480 0x56230a8ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff31cb46b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 0x56230a8edef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff31cb46b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e7270 0x56230a94fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff31cb46b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230a8ee6d0 con 0x56230a8e7270 2024-05-09T00:10:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff31cb46b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230a8ee840 con 0x56230a8e1480 2024-05-09T00:10:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff31cb46b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230a950410 con 0x56230a8e6950 2024-05-09T00:10:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff31cb46b80 10 client.0 _ll_register_callbacks cb 0x56230a7d6ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff30ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e7270 0x56230a94fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff30ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e7270 0x56230a94fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38878/0 (socket says 172.21.15.81:38878) 2024-05-09T00:10:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff30ad9d700 1 -- 172.21.15.81:0/3324437941 learned_addr learned my addr 172.21.15.81:0/3324437941 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff309d9b700 1 --2- 172.21.15.81:0/3324437941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 0x56230a8edef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff30a59c700 1 --2- 172.21.15.81:0/3324437941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e1480 0x56230a8ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff30ad9d700 1 -- 172.21.15.81:0/3324437941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 msgr2=0x56230a8edef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff30ad9d700 1 --2- 172.21.15.81:0/3324437941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 0x56230a8edef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff30ad9d700 1 -- 172.21.15.81:0/3324437941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e1480 msgr2=0x56230a8ed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff30ad9d700 1 --2- 172.21.15.81:0/3324437941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e1480 0x56230a8ed9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff30ad9d700 1 -- 172.21.15.81:0/3324437941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2fc00f9c0 con 0x56230a8e7270 2024-05-09T00:10:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff30ad9d700 1 --2- 172.21.15.81:0/3324437941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e7270 0x56230a94fed0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7ff304097b80 tx=0x7ff30409b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b26bc0a2b6bbdc53 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff2f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff2f1ffb700 1 -- 172.21.15.81:0/3324437941 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30409f500 con 0x56230a8e7270 2024-05-09T00:10:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff2f1ffb700 1 -- 172.21.15.81:0/3324437941 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7ff30401dd40 con 0x56230a8e7270 2024-05-09T00:10:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.445+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3324437941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff30409b6d0 con 0x56230a8e7270 2024-05-09T00:10:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.446+0000 7ff2f1ffb700 1 -- 172.21.15.81:0/3324437941 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff304097de0 con 0x56230a8e7270 2024-05-09T00:10:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.446+0000 7ff31cb46b80 10 client.17595 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.446+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3324437941 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56230a6b6c70 con 0x56230a8e7270 2024-05-09T00:10:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.446+0000 7ff2f1ffb700 1 -- 172.21.15.81:0/3324437941 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff304067020 con 0x56230a8e7270 2024-05-09T00:10:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.446+0000 7ff2f1ffb700 1 -- 172.21.15.81:0/3324437941 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff304019350 con 0x56230a8e7270 2024-05-09T00:10:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.446+0000 7ff31cb46b80 10 client.17595 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.446+0000 7ff31cb46b80 10 client.17595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.446+0000 7ff31cb46b80 20 client.17595 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.446+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/3324437941 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56230a9517e0 0x56230a953c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.446+0000 7ff31cb46b80 4 client.17595 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:10:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.446+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3324437941 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56230a829e60 con 0x56230a9517e0 2024-05-09T00:10:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.446+0000 7ff30a59c700 1 --2- 172.21.15.81:0/3324437941 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56230a9517e0 0x56230a953c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.447+0000 7ff2f1ffb700 10 client.17595 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.447+0000 7ff30a59c700 1 --2- 172.21.15.81:0/3324437941 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56230a9517e0 0x56230a953c00 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f926c0fe59f9d6c5 server_cookie=f601ae4f78b2dff5 in_seq=0 out_seq=0 2024-05-09T00:10:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.462+0000 7ff2f1ffb700 1 -- 172.21.15.81:0/3324437941 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56230a829e60 con 0x56230a9517e0 2024-05-09T00:10:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.462+0000 7ff2f1ffb700 10 client.17595 handle_command_reply: tid=0 2024-05-09T00:10:39.459 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.462+0000 7ff31cb46b80 1 client.17595 shutdown 2024-05-09T00:10:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.462+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3324437941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e7270 msgr2=0x56230a94fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.462+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/3324437941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e7270 0x56230a94fed0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7ff304097b80 tx=0x7ff30409b5c0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.462+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3324437941 shutdown_connections 2024-05-09T00:10:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.462+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/3324437941 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56230a9517e0 0x56230a953c00 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.462+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/3324437941 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56230a8e1480 0x56230a8ed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.462+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/3324437941 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56230a8e7270 0x56230a94fed0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.462+0000 7ff2f1ffb700 0 client.17595 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.462+0000 7ff31cb46b80 1 --2- 172.21.15.81:0/3324437941 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56230a8e6950 0x56230a8edef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.462+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3324437941 >> 172.21.15.81:0/3324437941 conn(0x56230a83f1b0 msgr2=0x56230a8f6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.462+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3324437941 shutdown_connections 2024-05-09T00:10:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.462+0000 7ff31cb46b80 1 -- 172.21.15.81:0/3324437941 wait complete. 2024-05-09T00:10:39.460 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.463+0000 7ff31cb46b80 20 client.17595 trim_cache size 0 max 16384 2024-05-09T00:10:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:10:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:10:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:10:39.461 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:10:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.463+0000 7ff31098c700 1 -- 172.21.15.81:0/3114924439 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2f80a1290 msgr2=0x7ff2f80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.463+0000 7ff31098c700 1 --2- 172.21.15.81:0/3114924439 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2f80a1290 0x7ff2f80a3750 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff2f4005950 tx=0x7ff2f400b410 comp rx=0 tx=0).stop 2024-05-09T00:10:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.463+0000 7ff31098c700 1 -- 172.21.15.81:0/3114924439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c107020 msgr2=0x7ff30c101070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.463+0000 7ff31098c700 1 --2- 172.21.15.81:0/3114924439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c107020 0x7ff30c101070 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ff3040094c0 tx=0x7ff3040094f0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.463+0000 7ff31098c700 1 -- 172.21.15.81:0/3114924439 shutdown_connections 2024-05-09T00:10:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.463+0000 7ff31098c700 1 --2- 172.21.15.81:0/3114924439 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2f80a1290 0x7ff2f80a3750 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.463+0000 7ff31098c700 1 --2- 172.21.15.81:0/3114924439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c107020 0x7ff30c101070 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.463+0000 7ff31098c700 1 --2- 172.21.15.81:0/3114924439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff30c0ff410 0x7ff30c1005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.463+0000 7ff31098c700 1 --2- 172.21.15.81:0/3114924439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff30c0ffdd0 0x7ff30c100b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.463+0000 7ff31098c700 1 -- 172.21.15.81:0/3114924439 >> 172.21.15.81:0/3114924439 conn(0x7ff30c0763a0 msgr2=0x7ff30c103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:39.462 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.463+0000 7ff31098c700 1 -- 172.21.15.81:0/3114924439 shutdown_connections 2024-05-09T00:10:39.463 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:39.463+0000 7ff31098c700 1 -- 172.21.15.81:0/3114924439 wait complete. 2024-05-09T00:10:40.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:40 smithi171 ceph-mon[47351]: pgmap v236: 97 pgs: 97 active+clean; 4.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-05-09T00:10:40.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:40 smithi081 ceph-mon[42474]: pgmap v236: 97 pgs: 97 active+clean; 4.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-05-09T00:10:40.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:40 smithi150 ceph-mon[46187]: pgmap v236: 97 pgs: 97 active+clean; 4.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 45 KiB/s wr, 12 op/s 2024-05-09T00:10:40.999 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:10:41.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.144+0000 7f53b525a700 1 -- 172.21.15.81:0/533567998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53b00682e0 msgr2=0x7f53b00686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.144+0000 7f53b525a700 1 --2- 172.21.15.81:0/533567998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53b00682e0 0x7f53b00686c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f53980099c0 tx=0x7f5398009cd0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.144+0000 7f53b525a700 1 -- 172.21.15.81:0/533567998 shutdown_connections 2024-05-09T00:10:41.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.144+0000 7f53b525a700 1 --2- 172.21.15.81:0/533567998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53b0106290 0x7f53b010de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.144+0000 7f53b525a700 1 --2- 172.21.15.81:0/533567998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53b00682e0 0x7f53b00686c0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.144+0000 7f53b525a700 1 --2- 172.21.15.81:0/533567998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b0068c90 0x7f53b0105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.144+0000 7f53b525a700 1 -- 172.21.15.81:0/533567998 >> 172.21.15.81:0/533567998 conn(0x7f53b0076f40 msgr2=0x7f53b0077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.144+0000 7f53b525a700 1 -- 172.21.15.81:0/533567998 shutdown_connections 2024-05-09T00:10:41.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.144+0000 7f53b525a700 1 -- 172.21.15.81:0/533567998 wait complete. 2024-05-09T00:10:41.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.145+0000 7f53b525a700 1 Processor -- start 2024-05-09T00:10:41.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.145+0000 7f53b525a700 1 -- start start 2024-05-09T00:10:41.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.145+0000 7f53b525a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b00682e0 0x7f53b00ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.145+0000 7f53b525a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53b0106290 0x7f53b01003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.145+0000 7f53b525a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53b01008e0 0x7f53b01a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.145+0000 7f53b525a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b01a5aa0 con 0x7f53b0106290 2024-05-09T00:10:41.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.145+0000 7f53b525a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b01a5c10 con 0x7f53b00682e0 2024-05-09T00:10:41.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.145+0000 7f53b525a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b01a5dd0 con 0x7f53b01008e0 2024-05-09T00:10:41.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.145+0000 7f53ae59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53b0106290 0x7f53b01003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.145+0000 7f53ae59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53b0106290 0x7f53b01003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38900/0 (socket says 172.21.15.81:38900) 2024-05-09T00:10:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.145+0000 7f53ae59c700 1 -- 172.21.15.81:0/3286805758 learned_addr learned my addr 172.21.15.81:0/3286805758 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.145+0000 7f53af59e700 1 --2- 172.21.15.81:0/3286805758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53b01008e0 0x7f53b01a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.145+0000 7f53aed9d700 1 --2- 172.21.15.81:0/3286805758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b00682e0 0x7f53b00ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.146+0000 7f53ae59c700 1 -- 172.21.15.81:0/3286805758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53b01008e0 msgr2=0x7f53b01a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.146+0000 7f53ae59c700 1 --2- 172.21.15.81:0/3286805758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53b01008e0 0x7f53b01a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.146+0000 7f53ae59c700 1 -- 172.21.15.81:0/3286805758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b00682e0 msgr2=0x7f53b00ffe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.146+0000 7f53ae59c700 1 --2- 172.21.15.81:0/3286805758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b00682e0 0x7f53b00ffe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.146+0000 7f53ae59c700 1 -- 172.21.15.81:0/3286805758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53980095f0 con 0x7f53b0106290 2024-05-09T00:10:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.146+0000 7f53ae59c700 1 --2- 172.21.15.81:0/3286805758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53b0106290 0x7f53b01003a0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f53a000d980 tx=0x7f53a000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.146+0000 7f53a7fff700 1 -- 172.21.15.81:0/3286805758 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a0009930 con 0x7f53b0106290 2024-05-09T00:10:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.146+0000 7f53a7fff700 1 -- 172.21.15.81:0/3286805758 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53a0010460 con 0x7f53b0106290 2024-05-09T00:10:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.146+0000 7f53b525a700 1 -- 172.21.15.81:0/3286805758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b01a60b0 con 0x7f53b0106290 2024-05-09T00:10:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.146+0000 7f53a7fff700 1 -- 172.21.15.81:0/3286805758 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a000f620 con 0x7f53b0106290 2024-05-09T00:10:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.146+0000 7f53b525a700 1 -- 172.21.15.81:0/3286805758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b01a65c0 con 0x7f53b0106290 2024-05-09T00:10:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.148+0000 7f53a7fff700 1 -- 172.21.15.81:0/3286805758 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f53a00108d0 con 0x7f53b0106290 2024-05-09T00:10:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.149+0000 7f53a7fff700 1 --2- 172.21.15.81:0/3286805758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f539c0a1290 0x7f539c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.149+0000 7f53aed9d700 1 --2- 172.21.15.81:0/3286805758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f539c0a1290 0x7f539c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.149+0000 7f53a7fff700 1 -- 172.21.15.81:0/3286805758 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f53a00cc820 con 0x7f53b0106290 2024-05-09T00:10:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.150+0000 7f53aed9d700 1 --2- 172.21.15.81:0/3286805758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f539c0a1290 0x7f539c0a3750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5398000c00 tx=0x7f5398005fd0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.150+0000 7f53c1414b80 1 Processor -- start 2024-05-09T00:10:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.150+0000 7f53c1414b80 1 -- start start 2024-05-09T00:10:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.150+0000 7f53c1414b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64ae00 0x561bac64b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.150+0000 7f53c1414b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64b720 0x561bac645350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.150+0000 7f53c1414b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac645890 0x561bac645cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.150+0000 7f53c1414b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bac59c150 con 0x561bac64b720 2024-05-09T00:10:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.150+0000 7f53c1414b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bac599b10 con 0x561bac645890 2024-05-09T00:10:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.150+0000 7f53c1414b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bac595400 con 0x561bac64ae00 2024-05-09T00:10:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.150+0000 7f53ae59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64b720 0x561bac645350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.150+0000 7f53ae59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64b720 0x561bac645350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38916/0 (socket says 172.21.15.81:38916) 2024-05-09T00:10:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.150+0000 7f53ae59c700 1 -- 172.21.15.81:0/314503345 learned_addr learned my addr 172.21.15.81:0/314503345 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.150+0000 7f53aed9d700 1 --2- 172.21.15.81:0/314503345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64ae00 0x561bac64b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.150+0000 7f53af59e700 1 --2- 172.21.15.81:0/314503345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac645890 0x561bac645cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.151+0000 7f53ae59c700 1 -- 172.21.15.81:0/314503345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64ae00 msgr2=0x561bac64b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.151+0000 7f53ae59c700 1 --2- 172.21.15.81:0/314503345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64ae00 0x561bac64b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.151+0000 7f53ae59c700 1 -- 172.21.15.81:0/314503345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac645890 msgr2=0x561bac645cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.151+0000 7f53ae59c700 1 --2- 172.21.15.81:0/314503345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac645890 0x561bac645cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.151+0000 7f53ae59c700 1 -- 172.21.15.81:0/314503345 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bac4163b0 con 0x561bac64b720 2024-05-09T00:10:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.151+0000 7f53ae59c700 1 --2- 172.21.15.81:0/314503345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64b720 0x561bac645350 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f53a00a17f0 tx=0x7f53a009a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f26db58237b7bc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.151+0000 7f53a57fa700 1 -- 172.21.15.81:0/314503345 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a00a1d20 con 0x561bac64b720 2024-05-09T00:10:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.151+0000 7f53a57fa700 1 -- 172.21.15.81:0/314503345 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53a00b7e90 con 0x561bac64b720 2024-05-09T00:10:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.151+0000 7f53a57fa700 1 -- 172.21.15.81:0/314503345 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a0098d90 con 0x561bac64b720 2024-05-09T00:10:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.152+0000 7f53c1414b80 1 -- 172.21.15.81:0/314503345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64b720 msgr2=0x561bac645350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.152+0000 7f53c1414b80 1 --2- 172.21.15.81:0/314503345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64b720 0x561bac645350 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f53a00a17f0 tx=0x7f53a009a070 comp rx=0 tx=0).stop 2024-05-09T00:10:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.152+0000 7f53c1414b80 1 -- 172.21.15.81:0/314503345 shutdown_connections 2024-05-09T00:10:41.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.152+0000 7f53c1414b80 1 --2- 172.21.15.81:0/314503345 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac645890 0x561bac645cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.152+0000 7f53c1414b80 1 --2- 172.21.15.81:0/314503345 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64ae00 0x561bac64b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.152+0000 7f53c1414b80 1 --2- 172.21.15.81:0/314503345 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64b720 0x561bac645350 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.152+0000 7f53c1414b80 1 -- 172.21.15.81:0/314503345 >> 172.21.15.81:0/314503345 conn(0x561bac5a3210 msgr2=0x561bac63fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.152+0000 7f53c1414b80 1 -- 172.21.15.81:0/314503345 shutdown_connections 2024-05-09T00:10:41.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.152+0000 7f53c1414b80 1 -- 172.21.15.81:0/314503345 wait complete. 2024-05-09T00:10:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.152+0000 7f53c1414b80 1 -- start start 2024-05-09T00:10:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.152+0000 7f53c1414b80 1 Processor -- start 2024-05-09T00:10:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.152+0000 7f53c1414b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac645890 0x561bac64ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.152+0000 7f53c1414b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac64ae00 0x561bac64efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53c1414b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64b720 0x561bac64f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53c1414b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bac531560 con 0x561bac645890 2024-05-09T00:10:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53c1414b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bac531200 con 0x561bac64ae00 2024-05-09T00:10:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53c1414b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bac4186a0 con 0x561bac64b720 2024-05-09T00:10:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53c1414b80 10 client.0 _ll_register_callbacks cb 0x561bac53ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:41.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53aed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac645890 0x561bac64ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53aed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac645890 0x561bac64ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38930/0 (socket says 172.21.15.81:38930) 2024-05-09T00:10:41.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53aed9d700 1 -- 172.21.15.81:0/3809823843 learned_addr learned my addr 172.21.15.81:0/3809823843 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53af59e700 1 --2- 172.21.15.81:0/3809823843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64b720 0x561bac64f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53ae59c700 1 --2- 172.21.15.81:0/3809823843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac64ae00 0x561bac64efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53aed9d700 1 -- 172.21.15.81:0/3809823843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64b720 msgr2=0x561bac64f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53aed9d700 1 --2- 172.21.15.81:0/3809823843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64b720 0x561bac64f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53aed9d700 1 -- 172.21.15.81:0/3809823843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac64ae00 msgr2=0x561bac64efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53aed9d700 1 --2- 172.21.15.81:0/3809823843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac64ae00 0x561bac64efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53aed9d700 1 -- 172.21.15.81:0/3809823843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b01a65c0 con 0x561bac645890 2024-05-09T00:10:41.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53aed9d700 1 --2- 172.21.15.81:0/3809823843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac645890 0x561bac64ea70 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f53980099c0 tx=0x7f539801a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c464fd1672d0ec7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53967fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:41.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53967fc700 1 -- 172.21.15.81:0/3809823843 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539802b050 con 0x561bac645890 2024-05-09T00:10:41.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53967fc700 1 -- 172.21.15.81:0/3809823843 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f5398004a10 con 0x561bac645890 2024-05-09T00:10:41.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53c1414b80 1 -- 172.21.15.81:0/3809823843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561bac4ee270 con 0x561bac645890 2024-05-09T00:10:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53967fc700 1 -- 172.21.15.81:0/3809823843 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5398004bd0 con 0x561bac645890 2024-05-09T00:10:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53c1414b80 10 client.17607 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.153+0000 7f53c1414b80 1 -- 172.21.15.81:0/3809823843 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561bac3c2b60 con 0x561bac645890 2024-05-09T00:10:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.154+0000 7f53967fc700 1 -- 172.21.15.81:0/3809823843 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561bac4ee270 con 0x561bac645890 2024-05-09T00:10:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.154+0000 7f53967fc700 1 -- 172.21.15.81:0/3809823843 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f53980037c0 con 0x561bac645890 2024-05-09T00:10:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.154+0000 7f53c1414b80 10 client.17607 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.154+0000 7f53c1414b80 10 client.17607 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.154+0000 7f53c1414b80 20 client.17607 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.154+0000 7f53c1414b80 1 --2- 172.21.15.81:0/3809823843 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561bac65f1f0 0x561bac661610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.154+0000 7f53c1414b80 4 client.17607 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.154+0000 7f53c1414b80 1 -- 172.21.15.81:0/3809823843 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561bac614810 con 0x561bac65f1f0 2024-05-09T00:10:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.154+0000 7f53ae59c700 1 --2- 172.21.15.81:0/3809823843 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561bac65f1f0 0x561bac661610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53ae59c700 1 --2- 172.21.15.81:0/3809823843 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561bac65f1f0 0x561bac661610 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b171ade3f6dab31c server_cookie=a1332763c5f3ffcd in_seq=0 out_seq=0 2024-05-09T00:10:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53967fc700 10 client.17607 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53967fc700 1 -- 172.21.15.81:0/3809823843 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561bac614810 con 0x561bac65f1f0 2024-05-09T00:10:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53967fc700 10 client.17607 handle_command_reply: tid=0 2024-05-09T00:10:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53c1414b80 1 client.17607 shutdown 2024-05-09T00:10:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53c1414b80 1 -- 172.21.15.81:0/3809823843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac645890 msgr2=0x561bac64ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53c1414b80 1 --2- 172.21.15.81:0/3809823843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac645890 0x561bac64ea70 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f53980099c0 tx=0x7f539801a050 comp rx=0 tx=0).stop 2024-05-09T00:10:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53c1414b80 1 -- 172.21.15.81:0/3809823843 shutdown_connections 2024-05-09T00:10:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53c1414b80 1 --2- 172.21.15.81:0/3809823843 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561bac65f1f0 0x561bac661610 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53c1414b80 1 --2- 172.21.15.81:0/3809823843 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64b720 0x561bac64f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53967fc700 0 client.17607 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53c1414b80 1 --2- 172.21.15.81:0/3809823843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac645890 0x561bac64ea70 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53c1414b80 1 --2- 172.21.15.81:0/3809823843 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac64ae00 0x561bac64efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53c1414b80 1 -- 172.21.15.81:0/3809823843 >> 172.21.15.81:0/3809823843 conn(0x561bac5a3210 msgr2=0x561bac63f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53c1414b80 1 -- 172.21.15.81:0/3809823843 shutdown_connections 2024-05-09T00:10:41.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.155+0000 7f53c1414b80 1 -- 172.21.15.81:0/3809823843 wait complete. 2024-05-09T00:10:41.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.156+0000 7f53c1414b80 20 client.17607 trim_cache size 0 max 16384 2024-05-09T00:10:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53c1414b80 1 Processor -- start 2024-05-09T00:10:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53c1414b80 1 -- start start 2024-05-09T00:10:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53c1414b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac645890 0x561bac645350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53c1414b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64ae00 0x561bac63fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53c1414b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64b720 0x561bac64a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53c1414b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bac651a90 con 0x561bac64ae00 2024-05-09T00:10:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53c1414b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bac65bb30 con 0x561bac645890 2024-05-09T00:10:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53c1414b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bac640260 con 0x561bac64b720 2024-05-09T00:10:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53ae59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64ae00 0x561bac63fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53ae59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64ae00 0x561bac63fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38936/0 (socket says 172.21.15.81:38936) 2024-05-09T00:10:41.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53ae59c700 1 -- 172.21.15.81:0/2854157863 learned_addr learned my addr 172.21.15.81:0/2854157863 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53aed9d700 1 --2- 172.21.15.81:0/2854157863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac645890 0x561bac645350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53af59e700 1 --2- 172.21.15.81:0/2854157863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64b720 0x561bac64a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53ae59c700 1 -- 172.21.15.81:0/2854157863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64b720 msgr2=0x561bac64a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53ae59c700 1 --2- 172.21.15.81:0/2854157863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64b720 0x561bac64a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53ae59c700 1 -- 172.21.15.81:0/2854157863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac645890 msgr2=0x561bac645350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53ae59c700 1 --2- 172.21.15.81:0/2854157863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac645890 0x561bac645350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53ae59c700 1 -- 172.21.15.81:0/2854157863 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561bac55b560 con 0x561bac64ae00 2024-05-09T00:10:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.173+0000 7f53aed9d700 1 --2- 172.21.15.81:0/2854157863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac645890 0x561bac645350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.174+0000 7f53ae59c700 1 --2- 172.21.15.81:0/2854157863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64ae00 0x561bac63fd20 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f53a000d950 tx=0x7f53a0099510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c931cbe3a3bdb920 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.174+0000 7f53a5ffb700 1 -- 172.21.15.81:0/2854157863 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a00a1da0 con 0x561bac64ae00 2024-05-09T00:10:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.174+0000 7f53a5ffb700 1 -- 172.21.15.81:0/2854157863 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53a00b2260 con 0x561bac64ae00 2024-05-09T00:10:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.174+0000 7f53a5ffb700 1 -- 172.21.15.81:0/2854157863 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a0099b00 con 0x561bac64ae00 2024-05-09T00:10:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.174+0000 7f53c1414b80 1 -- 172.21.15.81:0/2854157863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64ae00 msgr2=0x561bac63fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.174+0000 7f53c1414b80 1 --2- 172.21.15.81:0/2854157863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64ae00 0x561bac63fd20 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f53a000d950 tx=0x7f53a0099510 comp rx=0 tx=0).stop 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.174+0000 7f53c1414b80 1 -- 172.21.15.81:0/2854157863 shutdown_connections 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.174+0000 7f53c1414b80 1 --2- 172.21.15.81:0/2854157863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac645890 0x561bac645350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.174+0000 7f53c1414b80 1 --2- 172.21.15.81:0/2854157863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac64b720 0x561bac64a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.174+0000 7f53c1414b80 1 --2- 172.21.15.81:0/2854157863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64ae00 0x561bac63fd20 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.174+0000 7f53c1414b80 1 -- 172.21.15.81:0/2854157863 >> 172.21.15.81:0/2854157863 conn(0x561bac5a3210 msgr2=0x561bac649b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.174+0000 7f53c1414b80 1 -- 172.21.15.81:0/2854157863 shutdown_connections 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.174+0000 7f53c1414b80 1 -- 172.21.15.81:0/2854157863 wait complete. 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53c1414b80 1 -- start start 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53c1414b80 1 Processor -- start 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53c1414b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac645890 0x561bac652330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53c1414b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64ae00 0x561bac652870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53c1414b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac64b720 0x561bac6b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53c1414b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bac6b4c20 con 0x561bac64ae00 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53c1414b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bac6b4d60 con 0x561bac64b720 2024-05-09T00:10:41.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53c1414b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561bac6b4ea0 con 0x561bac645890 2024-05-09T00:10:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53c1414b80 10 client.0 _ll_register_callbacks cb 0x561bac53ab30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53ae59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64ae00 0x561bac652870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53ae59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64ae00 0x561bac652870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38952/0 (socket says 172.21.15.81:38952) 2024-05-09T00:10:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53ae59c700 1 -- 172.21.15.81:0/2338884560 learned_addr learned my addr 172.21.15.81:0/2338884560 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53ae59c700 1 -- 172.21.15.81:0/2338884560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac645890 msgr2=0x561bac652330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53ae59c700 1 --2- 172.21.15.81:0/2338884560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac645890 0x561bac652330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53ae59c700 1 -- 172.21.15.81:0/2338884560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac64b720 msgr2=0x561bac6b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.175+0000 7f53ae59c700 1 --2- 172.21.15.81:0/2338884560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac64b720 0x561bac6b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53ae59c700 1 -- 172.21.15.81:0/2338884560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561bac4163b0 con 0x561bac64ae00 2024-05-09T00:10:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53ae59c700 1 --2- 172.21.15.81:0/2338884560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64ae00 0x561bac652870 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f53a0097bf0 tx=0x7f53a0099930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2374f8d31cae72 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53967fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53967fc700 1 -- 172.21.15.81:0/2338884560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a0098d90 con 0x561bac64ae00 2024-05-09T00:10:41.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53967fc700 1 -- 172.21.15.81:0/2338884560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f53a0098ef0 con 0x561bac64ae00 2024-05-09T00:10:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53c1414b80 1 -- 172.21.15.81:0/2338884560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f53a00b7e90 con 0x561bac64ae00 2024-05-09T00:10:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53967fc700 1 -- 172.21.15.81:0/2338884560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53a0099b00 con 0x561bac64ae00 2024-05-09T00:10:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53c1414b80 10 client.17613 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53c1414b80 1 -- 172.21.15.81:0/2338884560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561bac41acd0 con 0x561bac64ae00 2024-05-09T00:10:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53967fc700 1 -- 172.21.15.81:0/2338884560 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53a00b7e90 con 0x561bac64ae00 2024-05-09T00:10:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53967fc700 1 -- 172.21.15.81:0/2338884560 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f53a00b90b0 con 0x561bac64ae00 2024-05-09T00:10:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53c1414b80 10 client.17613 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53c1414b80 10 client.17613 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53c1414b80 20 client.17613 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53c1414b80 1 --2- 172.21.15.81:0/2338884560 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561bac6b6220 0x561bac6b8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53c1414b80 4 client.17613 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:10:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.176+0000 7f53c1414b80 1 -- 172.21.15.81:0/2338884560 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561bac58dec0 con 0x561bac6b6220 2024-05-09T00:10:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53aed9d700 1 --2- 172.21.15.81:0/2338884560 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561bac6b6220 0x561bac6b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53aed9d700 1 --2- 172.21.15.81:0/2338884560 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561bac6b6220 0x561bac6b8610 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b88eb520dff3090a server_cookie=77a01f1704338499 in_seq=0 out_seq=0 2024-05-09T00:10:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53967fc700 10 client.17613 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53967fc700 1 -- 172.21.15.81:0/2338884560 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561bac58dec0 con 0x561bac6b6220 2024-05-09T00:10:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53967fc700 10 client.17613 handle_command_reply: tid=0 2024-05-09T00:10:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53c1414b80 1 client.17613 shutdown 2024-05-09T00:10:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53c1414b80 1 -- 172.21.15.81:0/2338884560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64ae00 msgr2=0x561bac652870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53c1414b80 1 --2- 172.21.15.81:0/2338884560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64ae00 0x561bac652870 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f53a0097bf0 tx=0x7f53a0099930 comp rx=0 tx=0).stop 2024-05-09T00:10:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53c1414b80 1 -- 172.21.15.81:0/2338884560 shutdown_connections 2024-05-09T00:10:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53c1414b80 1 --2- 172.21.15.81:0/2338884560 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x561bac6b6220 0x561bac6b8610 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53c1414b80 1 --2- 172.21.15.81:0/2338884560 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561bac64b720 0x561bac6b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53967fc700 0 client.17613 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53c1414b80 1 --2- 172.21.15.81:0/2338884560 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561bac645890 0x561bac652330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53c1414b80 1 --2- 172.21.15.81:0/2338884560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561bac64ae00 0x561bac652870 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53c1414b80 1 -- 172.21.15.81:0/2338884560 >> 172.21.15.81:0/2338884560 conn(0x561bac5a3210 msgr2=0x561bac64a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53c1414b80 1 -- 172.21.15.81:0/2338884560 shutdown_connections 2024-05-09T00:10:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53c1414b80 1 -- 172.21.15.81:0/2338884560 wait complete. 2024-05-09T00:10:41.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.177+0000 7f53c1414b80 20 client.17613 trim_cache size 0 max 16384 2024-05-09T00:10:41.181 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:10:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:10:41.181 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:10:41.181 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:10:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.178+0000 7f53b525a700 1 -- 172.21.15.81:0/3286805758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f539c0a1290 msgr2=0x7f539c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.178+0000 7f53b525a700 1 --2- 172.21.15.81:0/3286805758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f539c0a1290 0x7f539c0a3750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5398000c00 tx=0x7f5398005fd0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.178+0000 7f53b525a700 1 -- 172.21.15.81:0/3286805758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53b0106290 msgr2=0x7f53b01003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.178+0000 7f53b525a700 1 --2- 172.21.15.81:0/3286805758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53b0106290 0x7f53b01003a0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f53a000d980 tx=0x7f53a000dc90 comp rx=0 tx=0).stop 2024-05-09T00:10:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.178+0000 7f53b525a700 1 -- 172.21.15.81:0/3286805758 shutdown_connections 2024-05-09T00:10:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.178+0000 7f53b525a700 1 --2- 172.21.15.81:0/3286805758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f539c0a1290 0x7f539c0a3750 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.178+0000 7f53b525a700 1 --2- 172.21.15.81:0/3286805758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f53b00682e0 0x7f53b00ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.178+0000 7f53b525a700 1 --2- 172.21.15.81:0/3286805758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53b01008e0 0x7f53b01a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.178+0000 7f53b525a700 1 --2- 172.21.15.81:0/3286805758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53b0106290 0x7f53b01003a0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.178+0000 7f53b525a700 1 -- 172.21.15.81:0/3286805758 >> 172.21.15.81:0/3286805758 conn(0x7f53b0076f40 msgr2=0x7f53b00fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.178+0000 7f53b525a700 1 -- 172.21.15.81:0/3286805758 shutdown_connections 2024-05-09T00:10:41.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.178+0000 7f53b525a700 1 -- 172.21.15.81:0/3286805758 wait complete. 2024-05-09T00:10:41.186 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:10:41.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:10:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.312+0000 7f4dd925e700 1 -- 172.21.15.81:0/1236066054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd4100900 msgr2=0x7f4dd4104940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.312+0000 7f4dd925e700 1 --2- 172.21.15.81:0/1236066054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd4100900 0x7f4dd4104940 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009990 tx=0x7f4dc4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.312+0000 7f4dd925e700 1 -- 172.21.15.81:0/1236066054 shutdown_connections 2024-05-09T00:10:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.312+0000 7f4dd925e700 1 --2- 172.21.15.81:0/1236066054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd40fff50 0x7f4dd4100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.312+0000 7f4dd925e700 1 --2- 172.21.15.81:0/1236066054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dd4105070 0x7f4dd410cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.312+0000 7f4dd925e700 1 --2- 172.21.15.81:0/1236066054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd4100900 0x7f4dd4104940 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.312+0000 7f4dd925e700 1 -- 172.21.15.81:0/1236066054 >> 172.21.15.81:0/1236066054 conn(0x7f4dd40fb810 msgr2=0x7f4dd40fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.312+0000 7f4dd925e700 1 -- 172.21.15.81:0/1236066054 shutdown_connections 2024-05-09T00:10:41.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.312+0000 7f4dd925e700 1 -- 172.21.15.81:0/1236066054 wait complete. 2024-05-09T00:10:41.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd925e700 1 Processor -- start 2024-05-09T00:10:41.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd925e700 1 -- start start 2024-05-09T00:10:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd925e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd40fff50 0x7f4dd4198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd925e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd4105070 0x7f4dd41986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd925e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dd4198c00 0x7f4dd41a3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd925e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41a3910 con 0x7f4dd40fff50 2024-05-09T00:10:41.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd925e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41a3a80 con 0x7f4dd4105070 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd925e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd41a3c40 con 0x7f4dd4198c00 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd40fff50 0x7f4dd4198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd40fff50 0x7f4dd4198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38970/0 (socket says 172.21.15.81:38970) 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd2d9d700 1 -- 172.21.15.81:0/352496893 learned_addr learned my addr 172.21.15.81:0/352496893 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd359e700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dd4198c00 0x7f4dd41a3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd259c700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd4105070 0x7f4dd41986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd2d9d700 1 -- 172.21.15.81:0/352496893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dd4198c00 msgr2=0x7f4dd41a3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd2d9d700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dd4198c00 0x7f4dd41a3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd2d9d700 1 -- 172.21.15.81:0/352496893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd4105070 msgr2=0x7f4dd41986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.313+0000 7f4dd2d9d700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd4105070 0x7f4dd41986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.314+0000 7f4dd2d9d700 1 -- 172.21.15.81:0/352496893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40095f0 con 0x7f4dd40fff50 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.314+0000 7f4dd259c700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd4105070 0x7f4dd41986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.314+0000 7f4dd359e700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dd4198c00 0x7f4dd41a3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.314+0000 7f4dd2d9d700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd40fff50 0x7f4dd4198180 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00e9a0 tx=0x7f4dbc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.314+0000 7f4dcbfff700 1 -- 172.21.15.81:0/352496893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc009790 con 0x7f4dd40fff50 2024-05-09T00:10:41.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.314+0000 7f4dd925e700 1 -- 172.21.15.81:0/352496893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd41a3f20 con 0x7f4dd40fff50 2024-05-09T00:10:41.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.314+0000 7f4dcbfff700 1 -- 172.21.15.81:0/352496893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4dbc00cbd0 con 0x7f4dd40fff50 2024-05-09T00:10:41.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.314+0000 7f4dcbfff700 1 -- 172.21.15.81:0/352496893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc018680 con 0x7f4dd40fff50 2024-05-09T00:10:41.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.314+0000 7f4dd925e700 1 -- 172.21.15.81:0/352496893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd41a43a0 con 0x7f4dd40fff50 2024-05-09T00:10:41.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.315+0000 7f4dd925e700 1 -- 172.21.15.81:0/352496893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd4108290 con 0x7f4dd40fff50 2024-05-09T00:10:41.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.316+0000 7f4dcbfff700 1 -- 172.21.15.81:0/352496893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4dbc00cd40 con 0x7f4dd40fff50 2024-05-09T00:10:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.316+0000 7f4dcbfff700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4dc00a1290 0x7f4dc00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.317+0000 7f4dd259c700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4dc00a1290 0x7f4dc00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.317+0000 7f4dcbfff700 1 -- 172.21.15.81:0/352496893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f4dbc014070 con 0x7f4dd40fff50 2024-05-09T00:10:41.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.317+0000 7f4dd259c700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4dc00a1290 0x7f4dc00a3750 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4000c00 tx=0x7f4dc4005fd0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.320+0000 7f4dcbfff700 1 -- 172.21.15.81:0/352496893 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4dbc096920 con 0x7f4dd40fff50 2024-05-09T00:10:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.563+0000 7f4dd925e700 1 -- 172.21.15.81:0/352496893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dd40697c0 con 0x7f4dd40fff50 2024-05-09T00:10:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.563+0000 7f4dcbfff700 1 -- 172.21.15.81:0/352496893 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7f4dbc099f40 con 0x7f4dd40fff50 2024-05-09T00:10:41.560 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:10:41.560 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:10:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.565+0000 7f4dd925e700 1 -- 172.21.15.81:0/352496893 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4dc00a1290 msgr2=0x7f4dc00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.565+0000 7f4dd925e700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4dc00a1290 0x7f4dc00a3750 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4000c00 tx=0x7f4dc4005fd0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.565+0000 7f4dd925e700 1 -- 172.21.15.81:0/352496893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd40fff50 msgr2=0x7f4dd4198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.565+0000 7f4dd925e700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd40fff50 0x7f4dd4198180 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00e9a0 tx=0x7f4dbc00ed60 comp rx=0 tx=0).stop 2024-05-09T00:10:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.565+0000 7f4dd925e700 1 -- 172.21.15.81:0/352496893 shutdown_connections 2024-05-09T00:10:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.565+0000 7f4dd925e700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4dc00a1290 0x7f4dc00a3750 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.565+0000 7f4dd925e700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dd4198c00 0x7f4dd41a3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.565+0000 7f4dd925e700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4dd40fff50 0x7f4dd4198180 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.565+0000 7f4dd925e700 1 --2- 172.21.15.81:0/352496893 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4dd4105070 0x7f4dd41986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.565+0000 7f4dd925e700 1 -- 172.21.15.81:0/352496893 >> 172.21.15.81:0/352496893 conn(0x7f4dd40fb810 msgr2=0x7f4dd40fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.565+0000 7f4dd925e700 1 -- 172.21.15.81:0/352496893 shutdown_connections 2024-05-09T00:10:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.565+0000 7f4dd925e700 1 -- 172.21.15.81:0/352496893 wait complete. 2024-05-09T00:10:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:10:41.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:10:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.702+0000 7f242ae44700 1 -- 172.21.15.81:0/3781715664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2424100060 msgr2=0x7f2424100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.702+0000 7f242ae44700 1 --2- 172.21.15.81:0/3781715664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2424100060 0x7f2424100440 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f2418009990 tx=0x7f2418009ca0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.702+0000 7f242ae44700 1 -- 172.21.15.81:0/3781715664 shutdown_connections 2024-05-09T00:10:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.702+0000 7f242ae44700 1 --2- 172.21.15.81:0/3781715664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2424105180 0x7f242410cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.702+0000 7f242ae44700 1 --2- 172.21.15.81:0/3781715664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2424100060 0x7f2424100440 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.702+0000 7f242ae44700 1 --2- 172.21.15.81:0/3781715664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2424100a10 0x7f2424104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.702+0000 7f242ae44700 1 -- 172.21.15.81:0/3781715664 >> 172.21.15.81:0/3781715664 conn(0x7f2424076f70 msgr2=0x7f2424077380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.702+0000 7f242ae44700 1 -- 172.21.15.81:0/3781715664 shutdown_connections 2024-05-09T00:10:41.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.702+0000 7f242ae44700 1 -- 172.21.15.81:0/3781715664 wait complete. 2024-05-09T00:10:41.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.702+0000 7f242ae44700 1 Processor -- start 2024-05-09T00:10:41.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.702+0000 7f242ae44700 1 -- start start 2024-05-09T00:10:41.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f242ae44700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2424100060 0x7f2424101af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f242ae44700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2424105180 0x7f2424102030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f242ae44700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2424102570 0x7f24241a5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f242ae44700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24241a5b60 con 0x7f2424102570 2024-05-09T00:10:41.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f242ae44700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24241a5cd0 con 0x7f2424105180 2024-05-09T00:10:41.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f242ae44700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24241a5e90 con 0x7f2424100060 2024-05-09T00:10:41.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f24293e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2424102570 0x7f24241a5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f24293e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2424102570 0x7f24241a5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38986/0 (socket says 172.21.15.81:38986) 2024-05-09T00:10:41.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f24293e1700 1 -- 172.21.15.81:0/836027109 learned_addr learned my addr 172.21.15.81:0/836027109 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f2423fff700 1 --2- 172.21.15.81:0/836027109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2424105180 0x7f2424102030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f2428be0700 1 --2- 172.21.15.81:0/836027109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2424100060 0x7f2424101af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f24293e1700 1 -- 172.21.15.81:0/836027109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2424100060 msgr2=0x7f2424101af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f24293e1700 1 --2- 172.21.15.81:0/836027109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2424100060 0x7f2424101af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f24293e1700 1 -- 172.21.15.81:0/836027109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2424105180 msgr2=0x7f2424102030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f24293e1700 1 --2- 172.21.15.81:0/836027109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2424105180 0x7f2424102030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f24293e1700 1 -- 172.21.15.81:0/836027109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24180095f0 con 0x7f2424102570 2024-05-09T00:10:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f24293e1700 1 --2- 172.21.15.81:0/836027109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2424102570 0x7f24241a5590 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f241c007ee0 tx=0x7f241c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f2421ffb700 1 -- 172.21.15.81:0/836027109 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c017070 con 0x7f2424102570 2024-05-09T00:10:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f2421ffb700 1 -- 172.21.15.81:0/836027109 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f241c00f040 con 0x7f2424102570 2024-05-09T00:10:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f242ae44700 1 -- 172.21.15.81:0/836027109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24241a6170 con 0x7f2424102570 2024-05-09T00:10:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f2421ffb700 1 -- 172.21.15.81:0/836027109 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c005580 con 0x7f2424102570 2024-05-09T00:10:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.703+0000 7f242ae44700 1 -- 172.21.15.81:0/836027109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24241a6630 con 0x7f2424102570 2024-05-09T00:10:41.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.705+0000 7f2421ffb700 1 -- 172.21.15.81:0/836027109 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f241c00db20 con 0x7f2424102570 2024-05-09T00:10:41.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.706+0000 7f2421ffb700 1 --2- 172.21.15.81:0/836027109 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f24140a1290 0x7f24140a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.706+0000 7f2428be0700 1 --2- 172.21.15.81:0/836027109 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f24140a1290 0x7f24140a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.706+0000 7f2421ffb700 1 -- 172.21.15.81:0/836027109 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f241c0cc400 con 0x7f2424102570 2024-05-09T00:10:41.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.706+0000 7f2428be0700 1 --2- 172.21.15.81:0/836027109 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f24140a1290 0x7f24140a3750 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f241800b5c0 tx=0x7f2418005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.707+0000 7f2436ffeb80 1 Processor -- start 2024-05-09T00:10:41.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.707+0000 7f2436ffeb80 1 -- start start 2024-05-09T00:10:41.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.707+0000 7f2436ffeb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9ad2e00 0x5626d9ad31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.707+0000 7f2436ffeb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9acd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.707+0000 7f2436ffeb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9acd890 0x5626d9acdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.707+0000 7f2436ffeb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626d9a24150 con 0x5626d9acd890 2024-05-09T00:10:41.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.707+0000 7f2436ffeb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626d9a21b10 con 0x5626d9ad3720 2024-05-09T00:10:41.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.707+0000 7f2436ffeb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626d9a1d400 con 0x5626d9ad2e00 2024-05-09T00:10:41.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.707+0000 7f24293e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9acd890 0x5626d9acdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.707+0000 7f24293e1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9acd890 0x5626d9acdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39000/0 (socket says 172.21.15.81:39000) 2024-05-09T00:10:41.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.707+0000 7f24293e1700 1 -- 172.21.15.81:0/717875876 learned_addr learned my addr 172.21.15.81:0/717875876 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.707+0000 7f2428be0700 1 --2- 172.21.15.81:0/717875876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9ad2e00 0x5626d9ad31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.708+0000 7f2423fff700 1 --2- 172.21.15.81:0/717875876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9acd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.708+0000 7f24293e1700 1 -- 172.21.15.81:0/717875876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9ad2e00 msgr2=0x5626d9ad31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.708+0000 7f24293e1700 1 --2- 172.21.15.81:0/717875876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9ad2e00 0x5626d9ad31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.708+0000 7f24293e1700 1 -- 172.21.15.81:0/717875876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 msgr2=0x5626d9acd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.708+0000 7f24293e1700 1 --2- 172.21.15.81:0/717875876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9acd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.708+0000 7f24293e1700 1 -- 172.21.15.81:0/717875876 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626d989e3b0 con 0x5626d9acd890 2024-05-09T00:10:41.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.708+0000 7f2423fff700 1 --2- 172.21.15.81:0/717875876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9acd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:41.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.708+0000 7f24293e1700 1 --2- 172.21.15.81:0/717875876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9acd890 0x5626d9acdcd0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f241c099470 tx=0x7f241c095820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1478808a949c5e2f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.708+0000 7f240effd700 1 -- 172.21.15.81:0/717875876 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c09d120 con 0x5626d9acd890 2024-05-09T00:10:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.708+0000 7f240effd700 1 -- 172.21.15.81:0/717875876 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f241c09d310 con 0x5626d9acd890 2024-05-09T00:10:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.708+0000 7f240effd700 1 -- 172.21.15.81:0/717875876 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c095bf0 con 0x5626d9acd890 2024-05-09T00:10:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 -- 172.21.15.81:0/717875876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9acd890 msgr2=0x5626d9acdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/717875876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9acd890 0x5626d9acdcd0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f241c099470 tx=0x7f241c095820 comp rx=0 tx=0).stop 2024-05-09T00:10:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 -- 172.21.15.81:0/717875876 shutdown_connections 2024-05-09T00:10:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/717875876 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9acd890 0x5626d9acdcd0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/717875876 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9ad2e00 0x5626d9ad31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/717875876 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9acd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 -- 172.21.15.81:0/717875876 >> 172.21.15.81:0/717875876 conn(0x5626d9a2b210 msgr2=0x5626d9ac7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 -- 172.21.15.81:0/717875876 shutdown_connections 2024-05-09T00:10:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 -- 172.21.15.81:0/717875876 wait complete. 2024-05-09T00:10:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 -- start start 2024-05-09T00:10:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 Processor -- start 2024-05-09T00:10:41.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9acd890 0x5626d9ad6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad2e00 0x5626d9ad6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9ad3720 0x5626d9ad7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626d99b9560 con 0x5626d9acd890 2024-05-09T00:10:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626d99b9200 con 0x5626d9ad2e00 2024-05-09T00:10:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.709+0000 7f2436ffeb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626d98a06a0 con 0x5626d9ad3720 2024-05-09T00:10:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2436ffeb80 10 client.0 _ll_register_callbacks cb 0x5626d99c2b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2428be0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9acd890 0x5626d9ad6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2428be0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9acd890 0x5626d9ad6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39014/0 (socket says 172.21.15.81:39014) 2024-05-09T00:10:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2428be0700 1 -- 172.21.15.81:0/3871902517 learned_addr learned my addr 172.21.15.81:0/3871902517 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f24293e1700 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9ad3720 0x5626d9ad7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2423fff700 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad2e00 0x5626d9ad6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2428be0700 1 -- 172.21.15.81:0/3871902517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9ad3720 msgr2=0x5626d9ad7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2428be0700 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9ad3720 0x5626d9ad7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2428be0700 1 -- 172.21.15.81:0/3871902517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad2e00 msgr2=0x5626d9ad6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2428be0700 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad2e00 0x5626d9ad6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2428be0700 1 -- 172.21.15.81:0/3871902517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24241a6630 con 0x5626d9acd890 2024-05-09T00:10:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f24293e1700 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9ad3720 0x5626d9ad7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2423fff700 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad2e00 0x5626d9ad6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2428be0700 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9acd890 0x5626d9ad6ab0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f2418015000 tx=0x7f2418009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9430de965809be8e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2403fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2403fff700 1 -- 172.21.15.81:0/3871902517 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418004ba0 con 0x5626d9acd890 2024-05-09T00:10:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2403fff700 1 -- 172.21.15.81:0/3871902517 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f2418004d00 con 0x5626d9acd890 2024-05-09T00:10:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2436ffeb80 1 -- 172.21.15.81:0/3871902517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626d9976270 con 0x5626d9acd890 2024-05-09T00:10:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2403fff700 1 -- 172.21.15.81:0/3871902517 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2418004ec0 con 0x5626d9acd890 2024-05-09T00:10:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2436ffeb80 10 client.17631 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.710+0000 7f2436ffeb80 1 -- 172.21.15.81:0/3871902517 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5626d984ab60 con 0x5626d9acd890 2024-05-09T00:10:41.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.711+0000 7f2403fff700 1 -- 172.21.15.81:0/3871902517 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5626d9976270 con 0x5626d9acd890 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.711+0000 7f2403fff700 1 -- 172.21.15.81:0/3871902517 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f241802f070 con 0x5626d9acd890 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.711+0000 7f2436ffeb80 10 client.17631 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.711+0000 7f2436ffeb80 10 client.17631 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.711+0000 7f2436ffeb80 20 client.17631 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.711+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5626d9ae72a0 0x5626d9ae96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.711+0000 7f2436ffeb80 4 client.17631 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.711+0000 7f2436ffeb80 1 -- 172.21.15.81:0/3871902517 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626d9a9c810 con 0x5626d9ae72a0 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.711+0000 7f2423fff700 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5626d9ae72a0 0x5626d9ae96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.712+0000 7f2403fff700 10 client.17631 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.712+0000 7f2423fff700 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5626d9ae72a0 0x5626d9ae96c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3b1cdada5a55d298 server_cookie=51a77ee050680b in_seq=0 out_seq=0 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.712+0000 7f2403fff700 1 -- 172.21.15.81:0/3871902517 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5626d9a9c810 con 0x5626d9ae72a0 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.712+0000 7f2403fff700 10 client.17631 handle_command_reply: tid=0 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.712+0000 7f2436ffeb80 1 client.17631 shutdown 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.712+0000 7f2436ffeb80 1 -- 172.21.15.81:0/3871902517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9acd890 msgr2=0x5626d9ad6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.712+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9acd890 0x5626d9ad6ab0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f2418015000 tx=0x7f2418009ca0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.712+0000 7f2436ffeb80 1 -- 172.21.15.81:0/3871902517 shutdown_connections 2024-05-09T00:10:41.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.712+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9ad3720 0x5626d9ad7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.712+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9acd890 0x5626d9ad6ab0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.712+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5626d9ae72a0 0x5626d9ae96c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.712+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/3871902517 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad2e00 0x5626d9ad6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.712+0000 7f2403fff700 0 client.17631 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:10:41.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.712+0000 7f2436ffeb80 1 -- 172.21.15.81:0/3871902517 >> 172.21.15.81:0/3871902517 conn(0x5626d9a2b210 msgr2=0x5626d9ac75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.713+0000 7f2436ffeb80 1 -- 172.21.15.81:0/3871902517 shutdown_connections 2024-05-09T00:10:41.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.713+0000 7f2436ffeb80 1 -- 172.21.15.81:0/3871902517 wait complete. 2024-05-09T00:10:41.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.713+0000 7f2436ffeb80 20 client.17631 trim_cache size 0 max 16384 2024-05-09T00:10:41.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.725+0000 7f2436ffeb80 1 Processor -- start 2024-05-09T00:10:41.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2436ffeb80 1 -- start start 2024-05-09T00:10:41.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2436ffeb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9acd890 0x5626d9acd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2436ffeb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9ad2e00 0x5626d9acdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2436ffeb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9ae2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2436ffeb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626d9ac4dc0 con 0x5626d9ad2e00 2024-05-09T00:10:41.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2436ffeb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626d9ac9e50 con 0x5626d9ad3720 2024-05-09T00:10:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2436ffeb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626d9ad7f10 con 0x5626d9acd890 2024-05-09T00:10:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2423fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9ad2e00 0x5626d9acdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2423fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9ad2e00 0x5626d9acdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39028/0 (socket says 172.21.15.81:39028) 2024-05-09T00:10:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2423fff700 1 -- 172.21.15.81:0/1285761071 learned_addr learned my addr 172.21.15.81:0/1285761071 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f24293e1700 1 --2- 172.21.15.81:0/1285761071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9ae2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2423fff700 1 -- 172.21.15.81:0/1285761071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9acd890 msgr2=0x5626d9acd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2423fff700 1 --2- 172.21.15.81:0/1285761071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9acd890 0x5626d9acd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2423fff700 1 -- 172.21.15.81:0/1285761071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 msgr2=0x5626d9ae2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2423fff700 1 --2- 172.21.15.81:0/1285761071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9ae2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2423fff700 1 -- 172.21.15.81:0/1285761071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626d99e3560 con 0x5626d9ad2e00 2024-05-09T00:10:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f24293e1700 1 --2- 172.21.15.81:0/1285761071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9ae2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f2423fff700 1 --2- 172.21.15.81:0/1285761071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9ad2e00 0x5626d9acdc70 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f2410005950 tx=0x7f241000b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cd868ef94570f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f240f7fe700 1 -- 172.21.15.81:0/1285761071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410018040 con 0x5626d9ad2e00 2024-05-09T00:10:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f240f7fe700 1 -- 172.21.15.81:0/1285761071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f241001e070 con 0x5626d9ad2e00 2024-05-09T00:10:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.726+0000 7f240f7fe700 1 -- 172.21.15.81:0/1285761071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241001a510 con 0x5626d9ad2e00 2024-05-09T00:10:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.727+0000 7f2436ffeb80 1 -- 172.21.15.81:0/1285761071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9ad2e00 msgr2=0x5626d9acdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.727+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/1285761071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9ad2e00 0x5626d9acdc70 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f2410005950 tx=0x7f241000b410 comp rx=0 tx=0).stop 2024-05-09T00:10:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.727+0000 7f2436ffeb80 1 -- 172.21.15.81:0/1285761071 shutdown_connections 2024-05-09T00:10:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.727+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/1285761071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9ae2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.727+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/1285761071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9acd890 0x5626d9acd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.727+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/1285761071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9ad2e00 0x5626d9acdc70 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.727+0000 7f2436ffeb80 1 -- 172.21.15.81:0/1285761071 >> 172.21.15.81:0/1285761071 conn(0x5626d9a2b210 msgr2=0x5626d9ad53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.727+0000 7f2436ffeb80 1 -- 172.21.15.81:0/1285761071 shutdown_connections 2024-05-09T00:10:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.727+0000 7f2436ffeb80 1 -- 172.21.15.81:0/1285761071 wait complete. 2024-05-09T00:10:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.727+0000 7f2436ffeb80 1 -- start start 2024-05-09T00:10:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.727+0000 7f2436ffeb80 1 Processor -- start 2024-05-09T00:10:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2436ffeb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9acd890 0x5626d9adc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2436ffeb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9ad2e00 0x5626d9adc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2436ffeb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9adcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2436ffeb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626d9b3c790 con 0x5626d9ad2e00 2024-05-09T00:10:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2436ffeb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626d9b3c900 con 0x5626d9ad3720 2024-05-09T00:10:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2436ffeb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626d9b3cac0 con 0x5626d9acd890 2024-05-09T00:10:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2436ffeb80 10 client.0 _ll_register_callbacks cb 0x5626d99c2b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2423fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9ad2e00 0x5626d9adc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2423fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9ad2e00 0x5626d9adc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39038/0 (socket says 172.21.15.81:39038) 2024-05-09T00:10:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2423fff700 1 -- 172.21.15.81:0/4098134013 learned_addr learned my addr 172.21.15.81:0/4098134013 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2428be0700 1 --2- 172.21.15.81:0/4098134013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9acd890 0x5626d9adc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f24293e1700 1 --2- 172.21.15.81:0/4098134013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9adcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2423fff700 1 -- 172.21.15.81:0/4098134013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9acd890 msgr2=0x5626d9adc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2423fff700 1 --2- 172.21.15.81:0/4098134013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9acd890 0x5626d9adc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2423fff700 1 -- 172.21.15.81:0/4098134013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 msgr2=0x5626d9adcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2423fff700 1 --2- 172.21.15.81:0/4098134013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9adcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2423fff700 1 -- 172.21.15.81:0/4098134013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626d98a2cd0 con 0x5626d9ad2e00 2024-05-09T00:10:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f24293e1700 1 --2- 172.21.15.81:0/4098134013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9adcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2423fff700 1 --2- 172.21.15.81:0/4098134013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9ad2e00 0x5626d9adc690 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f2410014d90 tx=0x7f2410014240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35828fb547804e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2403fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.728+0000 7f2403fff700 1 -- 172.21.15.81:0/4098134013 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410014b90 con 0x5626d9ad2e00 2024-05-09T00:10:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.729+0000 7f2403fff700 1 -- 172.21.15.81:0/4098134013 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f2410004050 con 0x5626d9ad2e00 2024-05-09T00:10:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.729+0000 7f2436ffeb80 1 -- 172.21.15.81:0/4098134013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f241c09d310 con 0x5626d9ad2e00 2024-05-09T00:10:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.729+0000 7f2403fff700 1 -- 172.21.15.81:0/4098134013 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2410004230 con 0x5626d9ad2e00 2024-05-09T00:10:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.729+0000 7f2436ffeb80 10 client.17637 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.729+0000 7f2436ffeb80 1 -- 172.21.15.81:0/4098134013 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5626d9849030 con 0x5626d9ad2e00 2024-05-09T00:10:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.729+0000 7f2403fff700 1 -- 172.21.15.81:0/4098134013 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2410039020 con 0x5626d9ad2e00 2024-05-09T00:10:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.729+0000 7f2403fff700 1 -- 172.21.15.81:0/4098134013 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2410003840 con 0x5626d9ad2e00 2024-05-09T00:10:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.729+0000 7f2436ffeb80 10 client.17637 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.729+0000 7f2436ffeb80 10 client.17637 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:10:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.729+0000 7f2436ffeb80 20 client.17637 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.729+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/4098134013 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5626d9b3e210 0x5626d9b40630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.729+0000 7f2436ffeb80 4 client.17637 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:10:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.729+0000 7f2436ffeb80 1 -- 172.21.15.81:0/4098134013 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5626d9a15ec0 con 0x5626d9b3e210 2024-05-09T00:10:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.729+0000 7f2428be0700 1 --2- 172.21.15.81:0/4098134013 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5626d9b3e210 0x5626d9b40630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2403fff700 10 client.17637 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:10:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2428be0700 1 --2- 172.21.15.81:0/4098134013 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5626d9b3e210 0x5626d9b40630 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=830b75753e6d24c8 server_cookie=3dc701703143beb0 in_seq=0 out_seq=0 2024-05-09T00:10:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2403fff700 1 -- 172.21.15.81:0/4098134013 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5626d9a15ec0 con 0x5626d9b3e210 2024-05-09T00:10:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2403fff700 10 client.17637 handle_command_reply: tid=0 2024-05-09T00:10:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2436ffeb80 1 client.17637 shutdown 2024-05-09T00:10:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2436ffeb80 1 -- 172.21.15.81:0/4098134013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9ad2e00 msgr2=0x5626d9adc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/4098134013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9ad2e00 0x5626d9adc690 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f2410014d90 tx=0x7f2410014240 comp rx=0 tx=0).stop 2024-05-09T00:10:41.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2436ffeb80 1 -- 172.21.15.81:0/4098134013 shutdown_connections 2024-05-09T00:10:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/4098134013 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5626d9b3e210 0x5626d9b40630 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/4098134013 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626d9ad3720 0x5626d9adcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/4098134013 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626d9acd890 0x5626d9adc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2436ffeb80 1 --2- 172.21.15.81:0/4098134013 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626d9ad2e00 0x5626d9adc690 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2403fff700 0 client.17637 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:10:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2436ffeb80 1 -- 172.21.15.81:0/4098134013 >> 172.21.15.81:0/4098134013 conn(0x5626d9a2b210 msgr2=0x5626d9ad1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2436ffeb80 1 -- 172.21.15.81:0/4098134013 shutdown_connections 2024-05-09T00:10:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2436ffeb80 1 -- 172.21.15.81:0/4098134013 wait complete. 2024-05-09T00:10:41.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.730+0000 7f2436ffeb80 20 client.17637 trim_cache size 0 max 16384 2024-05-09T00:10:41.734 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:10:41.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.731+0000 7f242ae44700 1 -- 172.21.15.81:0/836027109 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f24140a1290 msgr2=0x7f24140a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.731+0000 7f242ae44700 1 --2- 172.21.15.81:0/836027109 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f24140a1290 0x7f24140a3750 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f241800b5c0 tx=0x7f2418005960 comp rx=0 tx=0).stop 2024-05-09T00:10:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.731+0000 7f242ae44700 1 -- 172.21.15.81:0/836027109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2424102570 msgr2=0x7f24241a5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.731+0000 7f242ae44700 1 --2- 172.21.15.81:0/836027109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2424102570 0x7f24241a5590 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f241c007ee0 tx=0x7f241c00d3b0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.731+0000 7f242ae44700 1 -- 172.21.15.81:0/836027109 shutdown_connections 2024-05-09T00:10:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.731+0000 7f242ae44700 1 --2- 172.21.15.81:0/836027109 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f24140a1290 0x7f24140a3750 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.731+0000 7f242ae44700 1 --2- 172.21.15.81:0/836027109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2424102570 0x7f24241a5590 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.731+0000 7f242ae44700 1 --2- 172.21.15.81:0/836027109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2424100060 0x7f2424101af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.731+0000 7f242ae44700 1 --2- 172.21.15.81:0/836027109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2424105180 0x7f2424102030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.731+0000 7f242ae44700 1 -- 172.21.15.81:0/836027109 >> 172.21.15.81:0/836027109 conn(0x7f2424076f70 msgr2=0x7f24240698d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.731+0000 7f242ae44700 1 -- 172.21.15.81:0/836027109 shutdown_connections 2024-05-09T00:10:41.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.731+0000 7f242ae44700 1 -- 172.21.15.81:0/836027109 wait complete. 2024-05-09T00:10:41.739 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:10:41.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 -- 172.21.15.81:0/2083866886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50cc105160 msgr2=0x7f50cc10cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 --2- 172.21.15.81:0/2083866886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50cc105160 0x7f50cc10cce0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f50c400b0a0 tx=0x7f50c400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 -- 172.21.15.81:0/2083866886 shutdown_connections 2024-05-09T00:10:41.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 --2- 172.21.15.81:0/2083866886 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50cc100060 0x7f50cc100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 --2- 172.21.15.81:0/2083866886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50cc105160 0x7f50cc10cce0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 --2- 172.21.15.81:0/2083866886 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50cc100a10 0x7f50cc104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 -- 172.21.15.81:0/2083866886 >> 172.21.15.81:0/2083866886 conn(0x7f50cc076f40 msgr2=0x7f50cc077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 -- 172.21.15.81:0/2083866886 shutdown_connections 2024-05-09T00:10:41.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 -- 172.21.15.81:0/2083866886 wait complete. 2024-05-09T00:10:41.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 Processor -- start 2024-05-09T00:10:41.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 -- start start 2024-05-09T00:10:41.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50cc100060 0x7f50cc197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50cc105160 0x7f50cc197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50cc19bdb0 0x7f50cc19c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc19c830 con 0x7f50cc19bdb0 2024-05-09T00:10:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc19c9a0 con 0x7f50cc105160 2024-05-09T00:10:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.867+0000 7f50d2738700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc19cb60 con 0x7f50cc100060 2024-05-09T00:10:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50d0cd5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50cc19bdb0 0x7f50cc19c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50d0cd5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50cc19bdb0 0x7f50cc19c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39062/0 (socket says 172.21.15.81:39062) 2024-05-09T00:10:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50d0cd5700 1 -- 172.21.15.81:0/1161304643 learned_addr learned my addr 172.21.15.81:0/1161304643 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50d0cd5700 1 -- 172.21.15.81:0/1161304643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50cc100060 msgr2=0x7f50cc197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50cbfff700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50cc100060 0x7f50cc197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50d0cd5700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50cc100060 0x7f50cc197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50d0cd5700 1 -- 172.21.15.81:0/1161304643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50cc105160 msgr2=0x7f50cc197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50c37fe700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50cc105160 0x7f50cc197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50d0cd5700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50cc105160 0x7f50cc197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50d0cd5700 1 -- 172.21.15.81:0/1161304643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c4009d00 con 0x7f50cc19bdb0 2024-05-09T00:10:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50cbfff700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50cc100060 0x7f50cc197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50c37fe700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50cc105160 0x7f50cc197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50d0cd5700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50cc19bdb0 0x7f50cc19c230 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f50c4006130 tx=0x7f50c40093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50c9ffb700 1 -- 172.21.15.81:0/1161304643 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c400e040 con 0x7f50cc19bdb0 2024-05-09T00:10:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50c9ffb700 1 -- 172.21.15.81:0/1161304643 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50c4004e40 con 0x7f50cc19bdb0 2024-05-09T00:10:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50d2738700 1 -- 172.21.15.81:0/1161304643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50cc1a4060 con 0x7f50cc19bdb0 2024-05-09T00:10:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50c9ffb700 1 -- 172.21.15.81:0/1161304643 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c401b7d0 con 0x7f50cc19bdb0 2024-05-09T00:10:41.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.868+0000 7f50d2738700 1 -- 172.21.15.81:0/1161304643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50cc1a44e0 con 0x7f50cc19bdb0 2024-05-09T00:10:41.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.871+0000 7f50c9ffb700 1 -- 172.21.15.81:0/1161304643 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f50c401da40 con 0x7f50cc19bdb0 2024-05-09T00:10:41.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.871+0000 7f50c9ffb700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f50b80a1290 0x7f50b80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.871+0000 7f50c9ffb700 1 -- 172.21.15.81:0/1161304643 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f50c40ce640 con 0x7f50cc19bdb0 2024-05-09T00:10:41.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.871+0000 7f50cbfff700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f50b80a1290 0x7f50b80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.872+0000 7f50cbfff700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f50b80a1290 0x7f50b80a3750 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f50b4005fd0 tx=0x7f50b4005ee0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.872+0000 7f50de8f2b80 1 Processor -- start 2024-05-09T00:10:41.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.872+0000 7f50de8f2b80 1 -- start start 2024-05-09T00:10:41.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.872+0000 7f50de8f2b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af209e00 0x5564af20a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.872+0000 7f50de8f2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af20a720 0x5564af204350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.872+0000 7f50de8f2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af204890 0x5564af204cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.872+0000 7f50de8f2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af15b150 con 0x5564af20a720 2024-05-09T00:10:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.872+0000 7f50de8f2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af158b10 con 0x5564af204890 2024-05-09T00:10:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.872+0000 7f50de8f2b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af154400 con 0x5564af209e00 2024-05-09T00:10:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.872+0000 7f50c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af20a720 0x5564af204350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.872+0000 7f50c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af20a720 0x5564af204350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39064/0 (socket says 172.21.15.81:39064) 2024-05-09T00:10:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.872+0000 7f50c37fe700 1 -- 172.21.15.81:0/4137111287 learned_addr learned my addr 172.21.15.81:0/4137111287 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.872+0000 7f50cbfff700 1 --2- 172.21.15.81:0/4137111287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af209e00 0x5564af20a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.873+0000 7f50d0cd5700 1 --2- 172.21.15.81:0/4137111287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af204890 0x5564af204cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.873+0000 7f50c37fe700 1 -- 172.21.15.81:0/4137111287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af209e00 msgr2=0x5564af20a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.873+0000 7f50c37fe700 1 --2- 172.21.15.81:0/4137111287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af209e00 0x5564af20a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.873+0000 7f50c37fe700 1 -- 172.21.15.81:0/4137111287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af204890 msgr2=0x5564af204cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.873+0000 7f50c37fe700 1 --2- 172.21.15.81:0/4137111287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af204890 0x5564af204cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.873+0000 7f50c37fe700 1 -- 172.21.15.81:0/4137111287 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564aefd53b0 con 0x5564af20a720 2024-05-09T00:10:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.873+0000 7f50c37fe700 1 --2- 172.21.15.81:0/4137111287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af20a720 0x5564af204350 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009bf0 tx=0x7f50bc009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9915bc7cdfbedbb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.873+0000 7f50c27fc700 1 -- 172.21.15.81:0/4137111287 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc00eb50 con 0x5564af20a720 2024-05-09T00:10:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.873+0000 7f50c27fc700 1 -- 172.21.15.81:0/4137111287 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50bc004cf0 con 0x5564af20a720 2024-05-09T00:10:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.873+0000 7f50c27fc700 1 -- 172.21.15.81:0/4137111287 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc005720 con 0x5564af20a720 2024-05-09T00:10:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.874+0000 7f50de8f2b80 1 -- 172.21.15.81:0/4137111287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af20a720 msgr2=0x5564af204350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.874+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/4137111287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af20a720 0x5564af204350 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009bf0 tx=0x7f50bc009f00 comp rx=0 tx=0).stop 2024-05-09T00:10:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.874+0000 7f50de8f2b80 1 -- 172.21.15.81:0/4137111287 shutdown_connections 2024-05-09T00:10:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.874+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/4137111287 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af204890 0x5564af204cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.874+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/4137111287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af209e00 0x5564af20a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.874+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/4137111287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af20a720 0x5564af204350 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.874+0000 7f50de8f2b80 1 -- 172.21.15.81:0/4137111287 >> 172.21.15.81:0/4137111287 conn(0x5564af162210 msgr2=0x5564af1fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.874+0000 7f50de8f2b80 1 -- 172.21.15.81:0/4137111287 shutdown_connections 2024-05-09T00:10:41.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.874+0000 7f50de8f2b80 1 -- 172.21.15.81:0/4137111287 wait complete. 2024-05-09T00:10:41.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.874+0000 7f50de8f2b80 1 -- start start 2024-05-09T00:10:41.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.874+0000 7f50de8f2b80 1 Processor -- start 2024-05-09T00:10:41.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.874+0000 7f50de8f2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af204890 0x5564af20db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.874+0000 7f50de8f2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af209e00 0x5564af20e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.874+0000 7f50de8f2b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af20a720 0x5564af20e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50de8f2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af0f0560 con 0x5564af204890 2024-05-09T00:10:41.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50de8f2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af0f0200 con 0x5564af209e00 2024-05-09T00:10:41.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50de8f2b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564aefd76a0 con 0x5564af20a720 2024-05-09T00:10:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50de8f2b80 10 client.0 _ll_register_callbacks cb 0x5564af0f9b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af204890 0x5564af20db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af204890 0x5564af20db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39074/0 (socket says 172.21.15.81:39074) 2024-05-09T00:10:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50cbfff700 1 -- 172.21.15.81:0/4134981929 learned_addr learned my addr 172.21.15.81:0/4134981929 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50d0cd5700 1 --2- 172.21.15.81:0/4134981929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af20a720 0x5564af20e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50cbfff700 1 -- 172.21.15.81:0/4134981929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af20a720 msgr2=0x5564af20e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50cbfff700 1 --2- 172.21.15.81:0/4134981929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af20a720 0x5564af20e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50cbfff700 1 -- 172.21.15.81:0/4134981929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af209e00 msgr2=0x5564af20e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50c37fe700 1 --2- 172.21.15.81:0/4134981929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af209e00 0x5564af20e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50cbfff700 1 --2- 172.21.15.81:0/4134981929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af209e00 0x5564af20e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50cbfff700 1 -- 172.21.15.81:0/4134981929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50bc009820 con 0x5564af204890 2024-05-09T00:10:41.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50cbfff700 1 --2- 172.21.15.81:0/4134981929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af204890 0x5564af20db00 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f50b40117a0 tx=0x7f50b40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5039431c7e18562 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:41.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50ab7fe700 1 -- 172.21.15.81:0/4134981929 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4004220 con 0x5564af204890 2024-05-09T00:10:41.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50ab7fe700 1 -- 172.21.15.81:0/4134981929 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f50b4004380 con 0x5564af204890 2024-05-09T00:10:41.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50de8f2b80 1 -- 172.21.15.81:0/4134981929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564af0ad270 con 0x5564af204890 2024-05-09T00:10:41.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50ab7fe700 1 -- 172.21.15.81:0/4134981929 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50b4004540 con 0x5564af204890 2024-05-09T00:10:41.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50de8f2b80 10 client.17649 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:41.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.875+0000 7f50de8f2b80 1 -- 172.21.15.81:0/4134981929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5564aef81b60 con 0x5564af204890 2024-05-09T00:10:41.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.876+0000 7f50ab7fe700 1 -- 172.21.15.81:0/4134981929 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5564af0ad270 con 0x5564af204890 2024-05-09T00:10:41.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.876+0000 7f50ab7fe700 1 -- 172.21.15.81:0/4134981929 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f50b4003b30 con 0x5564af204890 2024-05-09T00:10:41.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.876+0000 7f50de8f2b80 10 client.17649 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:41.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.876+0000 7f50de8f2b80 10 client.17649 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:10:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.876+0000 7f50de8f2b80 20 client.17649 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.876+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/4134981929 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5564af21e2d0 0x5564af2206f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.876+0000 7f50de8f2b80 4 client.17649 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.876+0000 7f50de8f2b80 1 -- 172.21.15.81:0/4134981929 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5564af1d3810 con 0x5564af21e2d0 2024-05-09T00:10:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.876+0000 7f50c37fe700 1 --2- 172.21.15.81:0/4134981929 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5564af21e2d0 0x5564af2206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50ab7fe700 10 client.17649 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:10:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50c37fe700 1 --2- 172.21.15.81:0/4134981929 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5564af21e2d0 0x5564af2206f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ef116b0304cefda server_cookie=4e3a18a157671a06 in_seq=0 out_seq=0 2024-05-09T00:10:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50ab7fe700 1 -- 172.21.15.81:0/4134981929 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5564af1d3810 con 0x5564af21e2d0 2024-05-09T00:10:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50ab7fe700 10 client.17649 handle_command_reply: tid=0 2024-05-09T00:10:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50de8f2b80 1 client.17649 shutdown 2024-05-09T00:10:41.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50de8f2b80 1 -- 172.21.15.81:0/4134981929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af204890 msgr2=0x5564af20db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/4134981929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af204890 0x5564af20db00 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f50b40117a0 tx=0x7f50b40047c0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50de8f2b80 1 -- 172.21.15.81:0/4134981929 shutdown_connections 2024-05-09T00:10:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/4134981929 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5564af21e2d0 0x5564af2206f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/4134981929 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af20a720 0x5564af20e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50ab7fe700 0 client.17649 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:10:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/4134981929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af204890 0x5564af20db00 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/4134981929 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af209e00 0x5564af20e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50de8f2b80 1 -- 172.21.15.81:0/4134981929 >> 172.21.15.81:0/4134981929 conn(0x5564af162210 msgr2=0x5564af1fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50de8f2b80 1 -- 172.21.15.81:0/4134981929 shutdown_connections 2024-05-09T00:10:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.877+0000 7f50de8f2b80 1 -- 172.21.15.81:0/4134981929 wait complete. 2024-05-09T00:10:41.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.878+0000 7f50de8f2b80 20 client.17649 trim_cache size 0 max 16384 2024-05-09T00:10:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.890+0000 7f50de8f2b80 1 Processor -- start 2024-05-09T00:10:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.890+0000 7f50de8f2b80 1 -- start start 2024-05-09T00:10:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50de8f2b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af204890 0x5564af20a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50de8f2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af209e00 0x5564af219c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50de8f2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af20a720 0x5564af1fed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50de8f2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af1fbdc0 con 0x5564af209e00 2024-05-09T00:10:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50de8f2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af200e50 con 0x5564af20a720 2024-05-09T00:10:41.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50de8f2b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af200640 con 0x5564af204890 2024-05-09T00:10:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af209e00 0x5564af219c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af209e00 0x5564af219c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39080/0 (socket says 172.21.15.81:39080) 2024-05-09T00:10:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50c37fe700 1 -- 172.21.15.81:0/855998109 learned_addr learned my addr 172.21.15.81:0/855998109 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50cbfff700 1 --2- 172.21.15.81:0/855998109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af204890 0x5564af20a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50c37fe700 1 -- 172.21.15.81:0/855998109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af204890 msgr2=0x5564af20a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50c37fe700 1 --2- 172.21.15.81:0/855998109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af204890 0x5564af20a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50c37fe700 1 -- 172.21.15.81:0/855998109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af20a720 msgr2=0x5564af1fed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50c37fe700 1 --2- 172.21.15.81:0/855998109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af20a720 0x5564af1fed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50c37fe700 1 -- 172.21.15.81:0/855998109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564af11a560 con 0x5564af209e00 2024-05-09T00:10:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50c37fe700 1 --2- 172.21.15.81:0/855998109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af209e00 0x5564af219c20 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x5564af20ab80 tx=0x7f50bc009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31490ab09fcbb6f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50c2ffd700 1 -- 172.21.15.81:0/855998109 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc004f60 con 0x5564af209e00 2024-05-09T00:10:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50c2ffd700 1 -- 172.21.15.81:0/855998109 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50bc005680 con 0x5564af209e00 2024-05-09T00:10:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.891+0000 7f50c2ffd700 1 -- 172.21.15.81:0/855998109 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc028070 con 0x5564af209e00 2024-05-09T00:10:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.892+0000 7f50de8f2b80 1 -- 172.21.15.81:0/855998109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af209e00 msgr2=0x5564af219c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.892+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/855998109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af209e00 0x5564af219c20 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x5564af20ab80 tx=0x7f50bc009480 comp rx=0 tx=0).stop 2024-05-09T00:10:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.892+0000 7f50de8f2b80 1 -- 172.21.15.81:0/855998109 shutdown_connections 2024-05-09T00:10:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.892+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/855998109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af20a720 0x5564af1fed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.892+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/855998109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af204890 0x5564af20a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.892+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/855998109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af209e00 0x5564af219c20 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.892+0000 7f50de8f2b80 1 -- 172.21.15.81:0/855998109 >> 172.21.15.81:0/855998109 conn(0x5564af162210 msgr2=0x5564af1fb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.892+0000 7f50de8f2b80 1 -- 172.21.15.81:0/855998109 shutdown_connections 2024-05-09T00:10:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.892+0000 7f50de8f2b80 1 -- 172.21.15.81:0/855998109 wait complete. 2024-05-09T00:10:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.892+0000 7f50de8f2b80 1 -- start start 2024-05-09T00:10:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50de8f2b80 1 Processor -- start 2024-05-09T00:10:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50de8f2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af204890 0x5564af215360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50de8f2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af209e00 0x5564af213150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50de8f2b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af20a720 0x5564af213690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50de8f2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af213bd0 con 0x5564af209e00 2024-05-09T00:10:41.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50de8f2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af213d40 con 0x5564af204890 2024-05-09T00:10:41.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50de8f2b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564af213f00 con 0x5564af20a720 2024-05-09T00:10:41.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50de8f2b80 10 client.0 _ll_register_callbacks cb 0x5564af0f9b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:41.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af209e00 0x5564af213150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af209e00 0x5564af213150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39088/0 (socket says 172.21.15.81:39088) 2024-05-09T00:10:41.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50c37fe700 1 -- 172.21.15.81:0/2943791340 learned_addr learned my addr 172.21.15.81:0/2943791340 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:41.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50cbfff700 1 --2- 172.21.15.81:0/2943791340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af204890 0x5564af215360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50d0cd5700 1 --2- 172.21.15.81:0/2943791340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af20a720 0x5564af213690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50c37fe700 1 -- 172.21.15.81:0/2943791340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af20a720 msgr2=0x5564af213690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50c37fe700 1 --2- 172.21.15.81:0/2943791340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af20a720 0x5564af213690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50c37fe700 1 -- 172.21.15.81:0/2943791340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af204890 msgr2=0x5564af215360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:41.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50c37fe700 1 --2- 172.21.15.81:0/2943791340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af204890 0x5564af215360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.893+0000 7f50c37fe700 1 -- 172.21.15.81:0/2943791340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564aefd53b0 con 0x5564af209e00 2024-05-09T00:10:41.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50c37fe700 1 --2- 172.21.15.81:0/2943791340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af209e00 0x5564af213150 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0095e0 tx=0x7f50bc00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9eb6e50778cfb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:41.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50ab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:41.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50ab7fe700 1 -- 172.21.15.81:0/2943791340 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc00ee80 con 0x5564af209e00 2024-05-09T00:10:41.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50ab7fe700 1 -- 172.21.15.81:0/2943791340 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f50bc004710 con 0x5564af209e00 2024-05-09T00:10:41.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50de8f2b80 1 -- 172.21.15.81:0/2943791340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f50bc004cf0 con 0x5564af209e00 2024-05-09T00:10:41.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50ab7fe700 1 -- 172.21.15.81:0/2943791340 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50bc0048d0 con 0x5564af209e00 2024-05-09T00:10:41.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50de8f2b80 10 client.17655 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:41.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50de8f2b80 1 -- 172.21.15.81:0/2943791340 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5564aefd9cd0 con 0x5564af209e00 2024-05-09T00:10:41.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50ab7fe700 1 -- 172.21.15.81:0/2943791340 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50bc004cf0 con 0x5564af209e00 2024-05-09T00:10:41.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50ab7fe700 1 -- 172.21.15.81:0/2943791340 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f50bc037020 con 0x5564af209e00 2024-05-09T00:10:41.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50de8f2b80 10 client.17655 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:41.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50de8f2b80 10 client.17655 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:10:41.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50de8f2b80 20 client.17655 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:41.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/2943791340 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5564af2748e0 0x5564af276d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:41.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50de8f2b80 4 client.17655 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:10:41.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50de8f2b80 1 -- 172.21.15.81:0/2943791340 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5564af14cec0 con 0x5564af2748e0 2024-05-09T00:10:41.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.894+0000 7f50cbfff700 1 --2- 172.21.15.81:0/2943791340 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5564af2748e0 0x5564af276d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:41.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50ab7fe700 10 client.17655 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:10:41.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50cbfff700 1 --2- 172.21.15.81:0/2943791340 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5564af2748e0 0x5564af276d00 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df70247e791abdbf server_cookie=ffc90fbcd3301c24 in_seq=0 out_seq=0 2024-05-09T00:10:41.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50ab7fe700 1 -- 172.21.15.81:0/2943791340 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5564af14cec0 con 0x5564af2748e0 2024-05-09T00:10:41.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50ab7fe700 10 client.17655 handle_command_reply: tid=0 2024-05-09T00:10:41.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50de8f2b80 1 client.17655 shutdown 2024-05-09T00:10:41.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50de8f2b80 1 -- 172.21.15.81:0/2943791340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af209e00 msgr2=0x5564af213150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/2943791340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af209e00 0x5564af213150 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0095e0 tx=0x7f50bc00ea00 comp rx=0 tx=0).stop 2024-05-09T00:10:41.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50de8f2b80 1 -- 172.21.15.81:0/2943791340 shutdown_connections 2024-05-09T00:10:41.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/2943791340 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5564af2748e0 0x5564af276d00 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/2943791340 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5564af204890 0x5564af215360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/2943791340 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5564af20a720 0x5564af213690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50de8f2b80 1 --2- 172.21.15.81:0/2943791340 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5564af209e00 0x5564af213150 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50ab7fe700 0 client.17655 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:10:41.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50de8f2b80 1 -- 172.21.15.81:0/2943791340 >> 172.21.15.81:0/2943791340 conn(0x5564af162210 msgr2=0x5564af20c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50de8f2b80 1 -- 172.21.15.81:0/2943791340 shutdown_connections 2024-05-09T00:10:41.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50de8f2b80 1 -- 172.21.15.81:0/2943791340 wait complete. 2024-05-09T00:10:41.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.895+0000 7f50de8f2b80 20 client.17655 trim_cache size 0 max 16384 2024-05-09T00:10:41.900 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:10:41.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.896+0000 7f50d2738700 1 -- 172.21.15.81:0/1161304643 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f50b80a1290 msgr2=0x7f50b80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.896+0000 7f50d2738700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f50b80a1290 0x7f50b80a3750 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f50b4005fd0 tx=0x7f50b4005ee0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.896+0000 7f50d2738700 1 -- 172.21.15.81:0/1161304643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50cc19bdb0 msgr2=0x7f50cc19c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:41.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.896+0000 7f50d2738700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50cc19bdb0 0x7f50cc19c230 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f50c4006130 tx=0x7f50c40093b0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.896+0000 7f50d2738700 1 -- 172.21.15.81:0/1161304643 shutdown_connections 2024-05-09T00:10:41.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.896+0000 7f50d2738700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f50b80a1290 0x7f50b80a3750 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.896+0000 7f50d2738700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50cc19bdb0 0x7f50cc19c230 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.896+0000 7f50d2738700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f50cc100060 0x7f50cc197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.896+0000 7f50d2738700 1 --2- 172.21.15.81:0/1161304643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f50cc105160 0x7f50cc197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:41.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.896+0000 7f50d2738700 1 -- 172.21.15.81:0/1161304643 >> 172.21.15.81:0/1161304643 conn(0x7f50cc076f40 msgr2=0x7f50cc0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:41.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.896+0000 7f50d2738700 1 -- 172.21.15.81:0/1161304643 shutdown_connections 2024-05-09T00:10:41.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:41.896+0000 7f50d2738700 1 -- 172.21.15.81:0/1161304643 wait complete. 2024-05-09T00:10:41.904 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:10:42.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.032+0000 7fe805baf700 1 -- 172.21.15.81:0/3676951932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe800100ab0 msgr2=0x7fe80010ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:42.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.032+0000 7fe805baf700 1 --2- 172.21.15.81:0/3676951932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe800100ab0 0x7fe80010ccc0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800b0d0 tx=0x7fe7f800b3e0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.032+0000 7fe805baf700 1 -- 172.21.15.81:0/3676951932 shutdown_connections 2024-05-09T00:10:42.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.032+0000 7fe805baf700 1 --2- 172.21.15.81:0/3676951932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe800105f90 0x7fe800106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.032+0000 7fe805baf700 1 --2- 172.21.15.81:0/3676951932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe800100ab0 0x7fe80010ccc0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.032+0000 7fe805baf700 1 --2- 172.21.15.81:0/3676951932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8001000f0 0x7fe800100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.032+0000 7fe805baf700 1 -- 172.21.15.81:0/3676951932 >> 172.21.15.81:0/3676951932 conn(0x7fe800076ba0 msgr2=0x7fe800076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:42.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.032+0000 7fe805baf700 1 -- 172.21.15.81:0/3676951932 shutdown_connections 2024-05-09T00:10:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.032+0000 7fe805baf700 1 -- 172.21.15.81:0/3676951932 wait complete. 2024-05-09T00:10:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.032+0000 7fe805baf700 1 Processor -- start 2024-05-09T00:10:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe805baf700 1 -- start start 2024-05-09T00:10:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe805baf700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8001000f0 0x7fe800196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe805baf700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe800100ab0 0x7fe800196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe805baf700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe800105f90 0x7fe80019abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe805baf700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80019b230 con 0x7fe800105f90 2024-05-09T00:10:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe805baf700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80019b3a0 con 0x7fe8001000f0 2024-05-09T00:10:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe805baf700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80019b560 con 0x7fe800100ab0 2024-05-09T00:10:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe7fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe800105f90 0x7fe80019abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe7fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe800105f90 0x7fe80019abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39106/0 (socket says 172.21.15.81:39106) 2024-05-09T00:10:42.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe7fffff700 1 -- 172.21.15.81:0/3958765472 learned_addr learned my addr 172.21.15.81:0/3958765472 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe7ff7fe700 1 --2- 172.21.15.81:0/3958765472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8001000f0 0x7fe800196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe7feffd700 1 --2- 172.21.15.81:0/3958765472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe800100ab0 0x7fe800196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe7fffff700 1 -- 172.21.15.81:0/3958765472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe800100ab0 msgr2=0x7fe800196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe7fffff700 1 --2- 172.21.15.81:0/3958765472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe800100ab0 0x7fe800196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe7fffff700 1 -- 172.21.15.81:0/3958765472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8001000f0 msgr2=0x7fe800196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe7fffff700 1 --2- 172.21.15.81:0/3958765472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8001000f0 0x7fe800196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe7fffff700 1 -- 172.21.15.81:0/3958765472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f8009d00 con 0x7fe800105f90 2024-05-09T00:10:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.033+0000 7fe7fffff700 1 --2- 172.21.15.81:0/3958765472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe800105f90 0x7fe80019abf0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800bd50 tx=0x7fe7f800bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.034+0000 7fe7fcff9700 1 -- 172.21.15.81:0/3958765472 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f800e040 con 0x7fe800105f90 2024-05-09T00:10:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.034+0000 7fe7fcff9700 1 -- 172.21.15.81:0/3958765472 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7f801d930 con 0x7fe800105f90 2024-05-09T00:10:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.034+0000 7fe805baf700 1 -- 172.21.15.81:0/3958765472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80019b7e0 con 0x7fe800105f90 2024-05-09T00:10:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.034+0000 7fe7fcff9700 1 -- 172.21.15.81:0/3958765472 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f801ba10 con 0x7fe800105f90 2024-05-09T00:10:42.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.034+0000 7fe805baf700 1 -- 172.21.15.81:0/3958765472 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8001a3080 con 0x7fe800105f90 2024-05-09T00:10:42.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.036+0000 7fe7fcff9700 1 -- 172.21.15.81:0/3958765472 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe7f801d470 con 0x7fe800105f90 2024-05-09T00:10:42.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.036+0000 7fe7fcff9700 1 --2- 172.21.15.81:0/3958765472 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe7ec0a1290 0x7fe7ec0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.037+0000 7fe7ff7fe700 1 --2- 172.21.15.81:0/3958765472 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe7ec0a1290 0x7fe7ec0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.037+0000 7fe7fcff9700 1 -- 172.21.15.81:0/3958765472 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe7f80ce0a0 con 0x7fe800105f90 2024-05-09T00:10:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.037+0000 7fe7ff7fe700 1 --2- 172.21.15.81:0/3958765472 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe7ec0a1290 0x7fe7ec0a3750 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe800067bb0 tx=0x7fe7e8009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.037+0000 7fe811d69b80 1 Processor -- start 2024-05-09T00:10:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.037+0000 7fe811d69b80 1 -- start start 2024-05-09T00:10:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.037+0000 7fe811d69b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a1ff0 0x5637153a23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.037+0000 7fe811d69b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637153a2910 0x56371539c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.037+0000 7fe811d69b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56371539caa0 0x56371539cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.037+0000 7fe811d69b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637152f1150 con 0x56371539caa0 2024-05-09T00:10:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.037+0000 7fe811d69b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637152eeb10 con 0x5637153a2910 2024-05-09T00:10:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.037+0000 7fe811d69b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637152ea400 con 0x5637153a1ff0 2024-05-09T00:10:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.038+0000 7fe7fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56371539caa0 0x56371539cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.038+0000 7fe7fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56371539caa0 0x56371539cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39120/0 (socket says 172.21.15.81:39120) 2024-05-09T00:10:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.038+0000 7fe7fffff700 1 -- 172.21.15.81:0/3913756406 learned_addr learned my addr 172.21.15.81:0/3913756406 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.038+0000 7fe7ff7fe700 1 --2- 172.21.15.81:0/3913756406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a1ff0 0x5637153a23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.038+0000 7fe7fffff700 1 -- 172.21.15.81:0/3913756406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a1ff0 msgr2=0x5637153a23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.038+0000 7fe7fffff700 1 --2- 172.21.15.81:0/3913756406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a1ff0 0x5637153a23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.038+0000 7fe7fffff700 1 -- 172.21.15.81:0/3913756406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637153a2910 msgr2=0x56371539c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.038+0000 7fe7fffff700 1 --2- 172.21.15.81:0/3913756406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637153a2910 0x56371539c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.038+0000 7fe7fffff700 1 -- 172.21.15.81:0/3913756406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56371516b3b0 con 0x56371539caa0 2024-05-09T00:10:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.038+0000 7fe7fffff700 1 --2- 172.21.15.81:0/3913756406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56371539caa0 0x56371539cf00 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fe7f809af10 tx=0x7fe7f801b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70777e71a86964b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.038+0000 7fe7f5ffb700 1 -- 172.21.15.81:0/3913756406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f809b210 con 0x56371539caa0 2024-05-09T00:10:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.038+0000 7fe7f5ffb700 1 -- 172.21.15.81:0/3913756406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7f809f040 con 0x56371539caa0 2024-05-09T00:10:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.038+0000 7fe7f5ffb700 1 -- 172.21.15.81:0/3913756406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f801de50 con 0x56371539caa0 2024-05-09T00:10:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.039+0000 7fe811d69b80 1 -- 172.21.15.81:0/3913756406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56371539caa0 msgr2=0x56371539cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:42.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.039+0000 7fe811d69b80 1 --2- 172.21.15.81:0/3913756406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56371539caa0 0x56371539cf00 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fe7f809af10 tx=0x7fe7f801b4b0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.039+0000 7fe811d69b80 1 -- 172.21.15.81:0/3913756406 shutdown_connections 2024-05-09T00:10:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.039+0000 7fe811d69b80 1 --2- 172.21.15.81:0/3913756406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56371539caa0 0x56371539cf00 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.039+0000 7fe811d69b80 1 --2- 172.21.15.81:0/3913756406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a1ff0 0x5637153a23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.039+0000 7fe811d69b80 1 --2- 172.21.15.81:0/3913756406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5637153a2910 0x56371539c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.039+0000 7fe811d69b80 1 -- 172.21.15.81:0/3913756406 >> 172.21.15.81:0/3913756406 conn(0x5637152f8210 msgr2=0x563715394df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.039+0000 7fe811d69b80 1 -- 172.21.15.81:0/3913756406 shutdown_connections 2024-05-09T00:10:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.039+0000 7fe811d69b80 1 -- 172.21.15.81:0/3913756406 wait complete. 2024-05-09T00:10:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.039+0000 7fe811d69b80 1 -- start start 2024-05-09T00:10:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.039+0000 7fe811d69b80 1 Processor -- start 2024-05-09T00:10:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe811d69b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 0x5637153a5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe811d69b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a1ff0 0x5637153a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe811d69b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a2910 0x5637153a6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe811d69b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563715286560 con 0x5637153a1ff0 2024-05-09T00:10:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe811d69b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563715286200 con 0x56371539caa0 2024-05-09T00:10:42.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe811d69b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56371516d6a0 con 0x5637153a2910 2024-05-09T00:10:42.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe811d69b80 10 client.0 _ll_register_callbacks cb 0x56371528fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7feffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a1ff0 0x5637153a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7feffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a1ff0 0x5637153a61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39128/0 (socket says 172.21.15.81:39128) 2024-05-09T00:10:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7feffd700 1 -- 172.21.15.81:0/2273798905 learned_addr learned my addr 172.21.15.81:0/2273798905 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7fffff700 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a2910 0x5637153a6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7ff7fe700 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 0x5637153a5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7feffd700 1 -- 172.21.15.81:0/2273798905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a2910 msgr2=0x5637153a6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:42.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7feffd700 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a2910 0x5637153a6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7feffd700 1 -- 172.21.15.81:0/2273798905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 msgr2=0x5637153a5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7feffd700 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 0x5637153a5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7feffd700 1 -- 172.21.15.81:0/2273798905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8001a3080 con 0x5637153a1ff0 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7fffff700 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a2910 0x5637153a6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7ff7fe700 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 0x5637153a5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7feffd700 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a1ff0 0x5637153a61c0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000e370 tx=0x7fe7f000e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8aa177d6b32cd63 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7deffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7deffd700 1 -- 172.21.15.81:0/2273798905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0004a30 con 0x5637153a1ff0 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe7deffd700 1 -- 172.21.15.81:0/2273798905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe7f000ee60 con 0x5637153a1ff0 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.040+0000 7fe811d69b80 1 -- 172.21.15.81:0/2273798905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563715243270 con 0x5637153a1ff0 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.041+0000 7fe7deffd700 1 -- 172.21.15.81:0/2273798905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7f0004b90 con 0x5637153a1ff0 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.041+0000 7fe811d69b80 10 client.17667 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.041+0000 7fe811d69b80 1 -- 172.21.15.81:0/2273798905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563715117b60 con 0x5637153a1ff0 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.041+0000 7fe7deffd700 1 -- 172.21.15.81:0/2273798905 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563715243270 con 0x5637153a1ff0 2024-05-09T00:10:42.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.041+0000 7fe7deffd700 1 -- 172.21.15.81:0/2273798905 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe7f000c070 con 0x5637153a1ff0 2024-05-09T00:10:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.041+0000 7fe811d69b80 10 client.17667 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.041+0000 7fe811d69b80 10 client.17667 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.041+0000 7fe811d69b80 20 client.17667 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.041+0000 7fe811d69b80 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5637153b6220 0x5637153b8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.041+0000 7fe811d69b80 4 client.17667 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.041+0000 7fe811d69b80 1 -- 172.21.15.81:0/2273798905 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563715369810 con 0x5637153b6220 2024-05-09T00:10:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.041+0000 7fe7ff7fe700 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5637153b6220 0x5637153b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe7deffd700 10 client.17667 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe7ff7fe700 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5637153b6220 0x5637153b8640 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96fecb7707c71bd3 server_cookie=213dbe66b4482286 in_seq=0 out_seq=0 2024-05-09T00:10:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe7deffd700 1 -- 172.21.15.81:0/2273798905 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563715369810 con 0x5637153b6220 2024-05-09T00:10:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe7deffd700 10 client.17667 handle_command_reply: tid=0 2024-05-09T00:10:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe811d69b80 1 client.17667 shutdown 2024-05-09T00:10:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe811d69b80 1 -- 172.21.15.81:0/2273798905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a1ff0 msgr2=0x5637153a61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:42.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe811d69b80 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a1ff0 0x5637153a61c0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000e370 tx=0x7fe7f000e730 comp rx=0 tx=0).stop 2024-05-09T00:10:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe811d69b80 1 -- 172.21.15.81:0/2273798905 shutdown_connections 2024-05-09T00:10:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe811d69b80 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5637153b6220 0x5637153b8640 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe811d69b80 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 0x5637153a5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe811d69b80 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a2910 0x5637153a6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe7deffd700 0 client.17667 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe811d69b80 1 --2- 172.21.15.81:0/2273798905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a1ff0 0x5637153a61c0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe811d69b80 1 -- 172.21.15.81:0/2273798905 >> 172.21.15.81:0/2273798905 conn(0x5637152f8210 msgr2=0x5637153945a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe811d69b80 1 -- 172.21.15.81:0/2273798905 shutdown_connections 2024-05-09T00:10:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.042+0000 7fe811d69b80 1 -- 172.21.15.81:0/2273798905 wait complete. 2024-05-09T00:10:42.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.043+0000 7fe811d69b80 20 client.17667 trim_cache size 0 max 16384 2024-05-09T00:10:42.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.056+0000 7fe811d69b80 1 Processor -- start 2024-05-09T00:10:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.056+0000 7fe811d69b80 1 -- start start 2024-05-09T00:10:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.056+0000 7fe811d69b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 0x56371539ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.056+0000 7fe811d69b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a1ff0 0x563715394d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.056+0000 7fe811d69b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a2910 0x5637153ad160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.056+0000 7fe811d69b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56371539d460 con 0x5637153a2910 2024-05-09T00:10:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.056+0000 7fe811d69b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637153a3d00 con 0x56371539caa0 2024-05-09T00:10:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.056+0000 7fe811d69b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563715396640 con 0x5637153a1ff0 2024-05-09T00:10:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.056+0000 7fe7fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a2910 0x5637153ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.056+0000 7fe7fffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a2910 0x5637153ad160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39130/0 (socket says 172.21.15.81:39130) 2024-05-09T00:10:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.056+0000 7fe7fffff700 1 -- 172.21.15.81:0/1376030728 learned_addr learned my addr 172.21.15.81:0/1376030728 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.057+0000 7fe7fffff700 1 -- 172.21.15.81:0/1376030728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a1ff0 msgr2=0x563715394d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.057+0000 7fe7fffff700 1 --2- 172.21.15.81:0/1376030728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a1ff0 0x563715394d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.057+0000 7fe7fffff700 1 -- 172.21.15.81:0/1376030728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 msgr2=0x56371539ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.057+0000 7fe7fffff700 1 --2- 172.21.15.81:0/1376030728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 0x56371539ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.057+0000 7fe7fffff700 1 -- 172.21.15.81:0/1376030728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637152b0560 con 0x5637153a2910 2024-05-09T00:10:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.057+0000 7fe7fffff700 1 --2- 172.21.15.81:0/1376030728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a2910 0x5637153ad160 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8009cd0 tx=0x7fe7f809ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c9b658ae9f4e4a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.057+0000 7fe7f67fc700 1 -- 172.21.15.81:0/1376030728 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f809b210 con 0x5637153a2910 2024-05-09T00:10:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.057+0000 7fe7f67fc700 1 -- 172.21.15.81:0/1376030728 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7f801daa0 con 0x5637153a2910 2024-05-09T00:10:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.057+0000 7fe7f67fc700 1 -- 172.21.15.81:0/1376030728 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f80a1310 con 0x5637153a2910 2024-05-09T00:10:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.058+0000 7fe811d69b80 1 -- 172.21.15.81:0/1376030728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a2910 msgr2=0x5637153ad160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.058+0000 7fe811d69b80 1 --2- 172.21.15.81:0/1376030728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a2910 0x5637153ad160 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8009cd0 tx=0x7fe7f809ae80 comp rx=0 tx=0).stop 2024-05-09T00:10:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.058+0000 7fe811d69b80 1 -- 172.21.15.81:0/1376030728 shutdown_connections 2024-05-09T00:10:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.058+0000 7fe811d69b80 1 --2- 172.21.15.81:0/1376030728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 0x56371539ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.058+0000 7fe811d69b80 1 --2- 172.21.15.81:0/1376030728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a2910 0x5637153ad160 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.058+0000 7fe811d69b80 1 --2- 172.21.15.81:0/1376030728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a1ff0 0x563715394d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.058+0000 7fe811d69b80 1 -- 172.21.15.81:0/1376030728 >> 172.21.15.81:0/1376030728 conn(0x5637152f8210 msgr2=0x5637153a6560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:42.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.058+0000 7fe811d69b80 1 -- 172.21.15.81:0/1376030728 shutdown_connections 2024-05-09T00:10:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.058+0000 7fe811d69b80 1 -- 172.21.15.81:0/1376030728 wait complete. 2024-05-09T00:10:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.058+0000 7fe811d69b80 1 -- start start 2024-05-09T00:10:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.058+0000 7fe811d69b80 1 Processor -- start 2024-05-09T00:10:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.058+0000 7fe811d69b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 0x5637154006b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.058+0000 7fe811d69b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a1ff0 0x563715400bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.058+0000 7fe811d69b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a2910 0x563715401150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe811d69b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56371540b930 con 0x5637153a1ff0 2024-05-09T00:10:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe811d69b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56371540baa0 con 0x56371539caa0 2024-05-09T00:10:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe811d69b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56371540bc60 con 0x5637153a2910 2024-05-09T00:10:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe811d69b80 10 client.0 _ll_register_callbacks cb 0x56371528fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7feffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a1ff0 0x563715400bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7feffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a1ff0 0x563715400bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39134/0 (socket says 172.21.15.81:39134) 2024-05-09T00:10:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7feffd700 1 -- 172.21.15.81:0/101091080 learned_addr learned my addr 172.21.15.81:0/101091080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7ff7fe700 1 --2- 172.21.15.81:0/101091080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 0x5637154006b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7fffff700 1 --2- 172.21.15.81:0/101091080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a2910 0x563715401150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7feffd700 1 -- 172.21.15.81:0/101091080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a2910 msgr2=0x563715401150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7feffd700 1 --2- 172.21.15.81:0/101091080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a2910 0x563715401150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7feffd700 1 -- 172.21.15.81:0/101091080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 msgr2=0x5637154006b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7feffd700 1 --2- 172.21.15.81:0/101091080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 0x5637154006b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7feffd700 1 -- 172.21.15.81:0/101091080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56371516b3b0 con 0x5637153a1ff0 2024-05-09T00:10:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7feffd700 1 --2- 172.21.15.81:0/101091080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a1ff0 0x563715400bf0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0001eb0 tx=0x7fe7f0010600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cb1679d738be9a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7deffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7deffd700 1 -- 172.21.15.81:0/101091080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0010b50 con 0x5637153a1ff0 2024-05-09T00:10:42.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7deffd700 1 -- 172.21.15.81:0/101091080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe7f000ee60 con 0x5637153a1ff0 2024-05-09T00:10:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe811d69b80 1 -- 172.21.15.81:0/101091080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7f809f040 con 0x5637153a1ff0 2024-05-09T00:10:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe7deffd700 1 -- 172.21.15.81:0/101091080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7f000eb30 con 0x5637153a1ff0 2024-05-09T00:10:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe811d69b80 10 client.17673 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.059+0000 7fe811d69b80 1 -- 172.21.15.81:0/101091080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56371516fcd0 con 0x5637153a1ff0 2024-05-09T00:10:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.060+0000 7fe7deffd700 1 -- 172.21.15.81:0/101091080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7f809f040 con 0x5637153a1ff0 2024-05-09T00:10:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.060+0000 7fe7deffd700 1 -- 172.21.15.81:0/101091080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe7f000e450 con 0x5637153a1ff0 2024-05-09T00:10:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.060+0000 7fe811d69b80 10 client.17673 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.060+0000 7fe811d69b80 10 client.17673 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.060+0000 7fe811d69b80 20 client.17673 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.060+0000 7fe811d69b80 1 --2- 172.21.15.81:0/101091080 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56371540d320 0x56371540f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.060+0000 7fe811d69b80 4 client.17673 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:10:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.060+0000 7fe811d69b80 1 -- 172.21.15.81:0/101091080 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5637152e2ec0 con 0x56371540d320 2024-05-09T00:10:42.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.060+0000 7fe7ff7fe700 1 --2- 172.21.15.81:0/101091080 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56371540d320 0x56371540f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.060+0000 7fe7deffd700 10 client.17673 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.060+0000 7fe7ff7fe700 1 --2- 172.21.15.81:0/101091080 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56371540d320 0x56371540f710 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=980b125f1d9c53f6 server_cookie=ee5e71abbb7b64b7 in_seq=0 out_seq=0 2024-05-09T00:10:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe7deffd700 1 -- 172.21.15.81:0/101091080 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5637152e2ec0 con 0x56371540d320 2024-05-09T00:10:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe7deffd700 10 client.17673 handle_command_reply: tid=0 2024-05-09T00:10:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe811d69b80 1 client.17673 shutdown 2024-05-09T00:10:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe811d69b80 1 -- 172.21.15.81:0/101091080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a1ff0 msgr2=0x563715400bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe811d69b80 1 --2- 172.21.15.81:0/101091080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a1ff0 0x563715400bf0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0001eb0 tx=0x7fe7f0010600 comp rx=0 tx=0).stop 2024-05-09T00:10:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe811d69b80 1 -- 172.21.15.81:0/101091080 shutdown_connections 2024-05-09T00:10:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe811d69b80 1 --2- 172.21.15.81:0/101091080 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56371540d320 0x56371540f710 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe811d69b80 1 --2- 172.21.15.81:0/101091080 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56371539caa0 0x5637154006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe811d69b80 1 --2- 172.21.15.81:0/101091080 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5637153a2910 0x563715401150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe7deffd700 0 client.17673 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe811d69b80 1 --2- 172.21.15.81:0/101091080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5637153a1ff0 0x563715400bf0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe811d69b80 1 -- 172.21.15.81:0/101091080 >> 172.21.15.81:0/101091080 conn(0x5637152f8210 msgr2=0x5637153a7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:42.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe811d69b80 1 -- 172.21.15.81:0/101091080 shutdown_connections 2024-05-09T00:10:42.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe811d69b80 1 -- 172.21.15.81:0/101091080 wait complete. 2024-05-09T00:10:42.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe811d69b80 20 client.17673 trim_cache size 0 max 16384 2024-05-09T00:10:42.065 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:10:42.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe805baf700 1 -- 172.21.15.81:0/3958765472 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe7ec0a1290 msgr2=0x7fe7ec0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:42.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe805baf700 1 --2- 172.21.15.81:0/3958765472 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe7ec0a1290 0x7fe7ec0a3750 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe800067bb0 tx=0x7fe7e8009260 comp rx=0 tx=0).stop 2024-05-09T00:10:42.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe805baf700 1 -- 172.21.15.81:0/3958765472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe800105f90 msgr2=0x7fe80019abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:42.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe805baf700 1 --2- 172.21.15.81:0/3958765472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe800105f90 0x7fe80019abf0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fe7f800bd50 tx=0x7fe7f800bd80 comp rx=0 tx=0).stop 2024-05-09T00:10:42.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe805baf700 1 -- 172.21.15.81:0/3958765472 shutdown_connections 2024-05-09T00:10:42.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe805baf700 1 --2- 172.21.15.81:0/3958765472 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe7ec0a1290 0x7fe7ec0a3750 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe805baf700 1 --2- 172.21.15.81:0/3958765472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8001000f0 0x7fe800196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe805baf700 1 --2- 172.21.15.81:0/3958765472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe800105f90 0x7fe80019abf0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe805baf700 1 --2- 172.21.15.81:0/3958765472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe800100ab0 0x7fe800196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:42.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.061+0000 7fe805baf700 1 -- 172.21.15.81:0/3958765472 >> 172.21.15.81:0/3958765472 conn(0x7fe800076ba0 msgr2=0x7fe8000fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:42.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.062+0000 7fe805baf700 1 -- 172.21.15.81:0/3958765472 shutdown_connections 2024-05-09T00:10:42.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:42.062+0000 7fe805baf700 1 -- 172.21.15.81:0/3958765472 wait complete. 2024-05-09T00:10:42.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:42 smithi171 ceph-mon[47351]: pgmap v237: 97 pgs: 97 active+clean; 4.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 68 KiB/s wr, 20 op/s 2024-05-09T00:10:42.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:42 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/352496893' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:10:42.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:42 smithi081 ceph-mon[42474]: pgmap v237: 97 pgs: 97 active+clean; 4.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 68 KiB/s wr, 20 op/s 2024-05-09T00:10:42.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:42 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/352496893' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:10:42.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:42 smithi150 ceph-mon[46187]: pgmap v237: 97 pgs: 97 active+clean; 4.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 68 KiB/s wr, 20 op/s 2024-05-09T00:10:42.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:42 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/352496893' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:10:43.070 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:10:43.071 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:10:43.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.215+0000 7faf386be700 1 -- 172.21.15.81:0/4141332503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf300ffdd0 msgr2=0x7faf3010dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.215+0000 7faf386be700 1 --2- 172.21.15.81:0/4141332503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf300ffdd0 0x7faf3010dda0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7faf2800b0a0 tx=0x7faf2800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.215+0000 7faf386be700 1 -- 172.21.15.81:0/4141332503 shutdown_connections 2024-05-09T00:10:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.215+0000 7faf386be700 1 --2- 172.21.15.81:0/4141332503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf300ffdd0 0x7faf3010dda0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.215+0000 7faf386be700 1 --2- 172.21.15.81:0/4141332503 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf30105ef0 0x7faf301062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.215+0000 7faf386be700 1 --2- 172.21.15.81:0/4141332503 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf300ff410 0x7faf300ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.215+0000 7faf386be700 1 -- 172.21.15.81:0/4141332503 >> 172.21.15.81:0/4141332503 conn(0x7faf300763a0 msgr2=0x7faf300fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.215+0000 7faf386be700 1 -- 172.21.15.81:0/4141332503 shutdown_connections 2024-05-09T00:10:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.215+0000 7faf386be700 1 -- 172.21.15.81:0/4141332503 wait complete. 2024-05-09T00:10:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.215+0000 7faf386be700 1 Processor -- start 2024-05-09T00:10:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.215+0000 7faf386be700 1 -- start start 2024-05-09T00:10:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf386be700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf300ff410 0x7faf30197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf386be700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf300ffdd0 0x7faf30197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf386be700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf30105ef0 0x7faf3019be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf386be700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3019c460 con 0x7faf30105ef0 2024-05-09T00:10:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf386be700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3019c5d0 con 0x7faf300ffdd0 2024-05-09T00:10:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf386be700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3019c790 con 0x7faf300ff410 2024-05-09T00:10:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf36c5b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf30105ef0 0x7faf3019be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf36c5b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf30105ef0 0x7faf3019be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39146/0 (socket says 172.21.15.81:39146) 2024-05-09T00:10:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf36c5b700 1 -- 172.21.15.81:0/4226450529 learned_addr learned my addr 172.21.15.81:0/4226450529 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf36c5b700 1 -- 172.21.15.81:0/4226450529 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf300ff410 msgr2=0x7faf30197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf3645a700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf300ff410 0x7faf30197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf35c59700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf300ffdd0 0x7faf30197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf36c5b700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf300ff410 0x7faf30197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf36c5b700 1 -- 172.21.15.81:0/4226450529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf300ffdd0 msgr2=0x7faf30197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf36c5b700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf300ffdd0 0x7faf30197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf36c5b700 1 -- 172.21.15.81:0/4226450529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf28009d00 con 0x7faf30105ef0 2024-05-09T00:10:43.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf35c59700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf300ffdd0 0x7faf30197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:43.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf36c5b700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf30105ef0 0x7faf3019be20 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7faf280077f0 tx=0x7faf280078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:43.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf277fe700 1 -- 172.21.15.81:0/4226450529 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2800e040 con 0x7faf30105ef0 2024-05-09T00:10:43.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf277fe700 1 -- 172.21.15.81:0/4226450529 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf280094c0 con 0x7faf30105ef0 2024-05-09T00:10:43.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf386be700 1 -- 172.21.15.81:0/4226450529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3019ca10 con 0x7faf30105ef0 2024-05-09T00:10:43.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf277fe700 1 -- 172.21.15.81:0/4226450529 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2801b780 con 0x7faf30105ef0 2024-05-09T00:10:43.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.216+0000 7faf386be700 1 -- 172.21.15.81:0/4226450529 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf301a42b0 con 0x7faf30105ef0 2024-05-09T00:10:43.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.218+0000 7faf277fe700 1 -- 172.21.15.81:0/4226450529 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7faf2801d9d0 con 0x7faf30105ef0 2024-05-09T00:10:43.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.219+0000 7faf277fe700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf1c0a1290 0x7faf1c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.219+0000 7faf3645a700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf1c0a1290 0x7faf1c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.220+0000 7faf277fe700 1 -- 172.21.15.81:0/4226450529 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7faf280ce830 con 0x7faf30105ef0 2024-05-09T00:10:43.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.220+0000 7faf3645a700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf1c0a1290 0x7faf1c0a3750 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faf2c005950 tx=0x7faf2c005cf0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:43.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.220+0000 7faf44878b80 1 Processor -- start 2024-05-09T00:10:43.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf44878b80 1 -- start start 2024-05-09T00:10:43.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf44878b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 0x55f954616260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf44878b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f9546103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf44878b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 0x55f954610d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf44878b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9545671d0 con 0x55f9546167a0 2024-05-09T00:10:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf44878b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f954564b90 con 0x55f954610910 2024-05-09T00:10:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf44878b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f954560480 con 0x55f954615e80 2024-05-09T00:10:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf35c59700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f9546103d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf35c59700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f9546103d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39154/0 (socket says 172.21.15.81:39154) 2024-05-09T00:10:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf35c59700 1 -- 172.21.15.81:0/1065422754 learned_addr learned my addr 172.21.15.81:0/1065422754 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf36c5b700 1 --2- 172.21.15.81:0/1065422754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 0x55f954610d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf3645a700 1 --2- 172.21.15.81:0/1065422754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 0x55f954616260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf35c59700 1 -- 172.21.15.81:0/1065422754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 msgr2=0x55f954616260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf35c59700 1 --2- 172.21.15.81:0/1065422754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 0x55f954616260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf35c59700 1 -- 172.21.15.81:0/1065422754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 msgr2=0x55f954610d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf35c59700 1 --2- 172.21.15.81:0/1065422754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 0x55f954610d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf35c59700 1 -- 172.21.15.81:0/1065422754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9543e1430 con 0x55f9546167a0 2024-05-09T00:10:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf36c5b700 1 --2- 172.21.15.81:0/1065422754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 0x55f954610d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf3645a700 1 --2- 172.21.15.81:0/1065422754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 0x55f954616260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.221+0000 7faf35c59700 1 --2- 172.21.15.81:0/1065422754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f9546103d0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7faf2000bbe0 tx=0x7faf2000bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2360b530b8af1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.222+0000 7faf24ff9700 1 -- 172.21.15.81:0/1065422754 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2000ddb0 con 0x55f9546167a0 2024-05-09T00:10:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.222+0000 7faf24ff9700 1 -- 172.21.15.81:0/1065422754 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf2000b690 con 0x55f9546167a0 2024-05-09T00:10:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.222+0000 7faf24ff9700 1 -- 172.21.15.81:0/1065422754 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2000f8e0 con 0x55f9546167a0 2024-05-09T00:10:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.222+0000 7faf44878b80 1 -- 172.21.15.81:0/1065422754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 msgr2=0x55f9546103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.222+0000 7faf44878b80 1 --2- 172.21.15.81:0/1065422754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f9546103d0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7faf2000bbe0 tx=0x7faf2000bef0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.222+0000 7faf44878b80 1 -- 172.21.15.81:0/1065422754 shutdown_connections 2024-05-09T00:10:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.222+0000 7faf44878b80 1 --2- 172.21.15.81:0/1065422754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 0x55f954610d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.222+0000 7faf44878b80 1 --2- 172.21.15.81:0/1065422754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 0x55f954616260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.222+0000 7faf44878b80 1 --2- 172.21.15.81:0/1065422754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f9546103d0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.222+0000 7faf44878b80 1 -- 172.21.15.81:0/1065422754 >> 172.21.15.81:0/1065422754 conn(0x55f95456e290 msgr2=0x55f95460ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:43.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.222+0000 7faf44878b80 1 -- 172.21.15.81:0/1065422754 shutdown_connections 2024-05-09T00:10:43.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.222+0000 7faf44878b80 1 -- 172.21.15.81:0/1065422754 wait complete. 2024-05-09T00:10:43.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf44878b80 1 -- start start 2024-05-09T00:10:43.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf44878b80 1 Processor -- start 2024-05-09T00:10:43.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf44878b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f954610910 0x55f95461c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf44878b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954615e80 0x55f954619b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf44878b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9546167a0 0x55f95461a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf44878b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9544fc5e0 con 0x55f954610910 2024-05-09T00:10:43.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf44878b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9544fc280 con 0x55f954615e80 2024-05-09T00:10:43.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf44878b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9543e3720 con 0x55f9546167a0 2024-05-09T00:10:43.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf44878b80 10 client.0 _ll_register_callbacks cb 0x55f954505bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:43.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf3645a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f954610910 0x55f95461c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf3645a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f954610910 0x55f95461c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39170/0 (socket says 172.21.15.81:39170) 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf3645a700 1 -- 172.21.15.81:0/1859514339 learned_addr learned my addr 172.21.15.81:0/1859514339 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf35c59700 1 --2- 172.21.15.81:0/1859514339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954615e80 0x55f954619b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf36c5b700 1 --2- 172.21.15.81:0/1859514339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9546167a0 0x55f95461a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf3645a700 1 -- 172.21.15.81:0/1859514339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9546167a0 msgr2=0x55f95461a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf3645a700 1 --2- 172.21.15.81:0/1859514339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9546167a0 0x55f95461a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf3645a700 1 -- 172.21.15.81:0/1859514339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954615e80 msgr2=0x55f954619b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf3645a700 1 --2- 172.21.15.81:0/1859514339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954615e80 0x55f954619b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf3645a700 1 -- 172.21.15.81:0/1859514339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2000b810 con 0x55f954610910 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.223+0000 7faf35c59700 1 --2- 172.21.15.81:0/1859514339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954615e80 0x55f954619b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf3645a700 1 --2- 172.21.15.81:0/1859514339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f954610910 0x55f95461c7d0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00f6f0 tx=0x7faf2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe56b6dee4a8d07c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf19ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf19ffb700 1 -- 172.21.15.81:0/1859514339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c004a30 con 0x55f954610910 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf44878b80 1 -- 172.21.15.81:0/1859514339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9545df890 con 0x55f954610910 2024-05-09T00:10:43.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf19ffb700 1 -- 172.21.15.81:0/1859514339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7faf2c004b90 con 0x55f954610910 2024-05-09T00:10:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf19ffb700 1 -- 172.21.15.81:0/1859514339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf2c004d50 con 0x55f954610910 2024-05-09T00:10:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf44878b80 10 client.17685 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf44878b80 1 -- 172.21.15.81:0/1859514339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f95438dbe0 con 0x55f954610910 2024-05-09T00:10:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf19ffb700 1 -- 172.21.15.81:0/1859514339 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f9545df890 con 0x55f954610910 2024-05-09T00:10:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf19ffb700 1 -- 172.21.15.81:0/1859514339 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faf2c022030 con 0x55f954610910 2024-05-09T00:10:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf44878b80 10 client.17685 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf44878b80 10 client.17685 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf44878b80 20 client.17685 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf44878b80 1 --2- 172.21.15.81:0/1859514339 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f95462a2d0 0x55f95462c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf44878b80 4 client.17685 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.224+0000 7faf44878b80 1 -- 172.21.15.81:0/1859514339 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f954558f40 con 0x55f95462a2d0 2024-05-09T00:10:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.225+0000 7faf35c59700 1 --2- 172.21.15.81:0/1859514339 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f95462a2d0 0x55f95462c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.225+0000 7faf35c59700 1 --2- 172.21.15.81:0/1859514339 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f95462a2d0 0x55f95462c6f0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cfe71aed5ba2b73 server_cookie=1c152d37f44318a5 in_seq=0 out_seq=0 2024-05-09T00:10:43.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.225+0000 7faf19ffb700 10 client.17685 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:43.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf19ffb700 1 -- 172.21.15.81:0/1859514339 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f954558f40 con 0x55f95462a2d0 2024-05-09T00:10:43.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf19ffb700 10 client.17685 handle_command_reply: tid=0 2024-05-09T00:10:43.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf44878b80 1 client.17685 shutdown 2024-05-09T00:10:43.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf44878b80 1 -- 172.21.15.81:0/1859514339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f954610910 msgr2=0x55f95461c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf44878b80 1 --2- 172.21.15.81:0/1859514339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f954610910 0x55f95461c7d0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00f6f0 tx=0x7faf2c004750 comp rx=0 tx=0).stop 2024-05-09T00:10:43.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf44878b80 1 -- 172.21.15.81:0/1859514339 shutdown_connections 2024-05-09T00:10:43.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf44878b80 1 --2- 172.21.15.81:0/1859514339 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f95462a2d0 0x55f95462c6f0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf44878b80 1 --2- 172.21.15.81:0/1859514339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f9546167a0 0x55f95461a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf19ffb700 0 client.17685 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:43.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf44878b80 1 --2- 172.21.15.81:0/1859514339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f954610910 0x55f95461c7d0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf44878b80 1 --2- 172.21.15.81:0/1859514339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954615e80 0x55f954619b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf44878b80 1 -- 172.21.15.81:0/1859514339 >> 172.21.15.81:0/1859514339 conn(0x55f95456e290 msgr2=0x55f95460a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:43.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf44878b80 1 -- 172.21.15.81:0/1859514339 shutdown_connections 2024-05-09T00:10:43.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf44878b80 1 -- 172.21.15.81:0/1859514339 wait complete. 2024-05-09T00:10:43.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.226+0000 7faf44878b80 20 client.17685 trim_cache size 0 max 16384 2024-05-09T00:10:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.243+0000 7faf44878b80 1 Processor -- start 2024-05-09T00:10:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.243+0000 7faf44878b80 1 -- start start 2024-05-09T00:10:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.243+0000 7faf44878b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 0x55f95460ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.243+0000 7faf44878b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 0x55f954614c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.243+0000 7faf44878b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f954615160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.243+0000 7faf44878b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f954607e40 con 0x55f9546167a0 2024-05-09T00:10:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.243+0000 7faf44878b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f95460ced0 con 0x55f954610910 2024-05-09T00:10:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.243+0000 7faf44878b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f95460c6c0 con 0x55f954615e80 2024-05-09T00:10:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.244+0000 7faf36c5b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f954615160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.244+0000 7faf36c5b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f954615160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39184/0 (socket says 172.21.15.81:39184) 2024-05-09T00:10:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.244+0000 7faf36c5b700 1 -- 172.21.15.81:0/1578762544 learned_addr learned my addr 172.21.15.81:0/1578762544 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.244+0000 7faf35c59700 1 --2- 172.21.15.81:0/1578762544 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 0x55f954614c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.244+0000 7faf3645a700 1 --2- 172.21.15.81:0/1578762544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 0x55f95460ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.244+0000 7faf36c5b700 1 -- 172.21.15.81:0/1578762544 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 msgr2=0x55f954614c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.244+0000 7faf36c5b700 1 --2- 172.21.15.81:0/1578762544 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 0x55f954614c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.244+0000 7faf36c5b700 1 -- 172.21.15.81:0/1578762544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 msgr2=0x55f95460ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.244+0000 7faf36c5b700 1 --2- 172.21.15.81:0/1578762544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 0x55f95460ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.244+0000 7faf36c5b700 1 -- 172.21.15.81:0/1578762544 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f954607560 con 0x55f9546167a0 2024-05-09T00:10:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.244+0000 7faf36c5b700 1 --2- 172.21.15.81:0/1578762544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f954615160 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7faf280cc000 tx=0x7faf2801dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40810ddaafa04fa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.244+0000 7faf257fa700 1 -- 172.21.15.81:0/1578762544 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2809f7d0 con 0x55f9546167a0 2024-05-09T00:10:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.244+0000 7faf257fa700 1 -- 172.21.15.81:0/1578762544 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf280a3d90 con 0x55f9546167a0 2024-05-09T00:10:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.244+0000 7faf257fa700 1 -- 172.21.15.81:0/1578762544 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2809ae90 con 0x55f9546167a0 2024-05-09T00:10:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 -- 172.21.15.81:0/1578762544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 msgr2=0x55f954615160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 --2- 172.21.15.81:0/1578762544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f954615160 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7faf280cc000 tx=0x7faf2801dd70 comp rx=0 tx=0).stop 2024-05-09T00:10:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 -- 172.21.15.81:0/1578762544 shutdown_connections 2024-05-09T00:10:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 --2- 172.21.15.81:0/1578762544 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 0x55f95460ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 --2- 172.21.15.81:0/1578762544 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f954615160 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 --2- 172.21.15.81:0/1578762544 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 0x55f954614c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 -- 172.21.15.81:0/1578762544 >> 172.21.15.81:0/1578762544 conn(0x55f95456e290 msgr2=0x55f954618420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 -- 172.21.15.81:0/1578762544 shutdown_connections 2024-05-09T00:10:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 -- 172.21.15.81:0/1578762544 wait complete. 2024-05-09T00:10:43.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 -- start start 2024-05-09T00:10:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 Processor -- start 2024-05-09T00:10:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 0x55f954612590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 0x55f954612ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f954613010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f954680910 con 0x55f9546167a0 2024-05-09T00:10:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f954680a80 con 0x55f954610910 2024-05-09T00:10:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f954680c40 con 0x55f954615e80 2024-05-09T00:10:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf44878b80 10 client.0 _ll_register_callbacks cb 0x55f954505bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf36c5b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f954613010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf36c5b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f954613010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39186/0 (socket says 172.21.15.81:39186) 2024-05-09T00:10:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.245+0000 7faf36c5b700 1 -- 172.21.15.81:0/418627007 learned_addr learned my addr 172.21.15.81:0/418627007 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf36c5b700 1 -- 172.21.15.81:0/418627007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 msgr2=0x55f954612ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf35c59700 1 --2- 172.21.15.81:0/418627007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 0x55f954612ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf36c5b700 1 --2- 172.21.15.81:0/418627007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 0x55f954612ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf36c5b700 1 -- 172.21.15.81:0/418627007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 msgr2=0x55f954612590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf36c5b700 1 --2- 172.21.15.81:0/418627007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 0x55f954612590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf36c5b700 1 -- 172.21.15.81:0/418627007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf301a42b0 con 0x55f9546167a0 2024-05-09T00:10:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf36c5b700 1 --2- 172.21.15.81:0/418627007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f954613010 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7faf2801dd20 tx=0x7faf280cbf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd57d2e46c515715 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf19ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf19ffb700 1 -- 172.21.15.81:0/418627007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf280b8070 con 0x55f9546167a0 2024-05-09T00:10:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf19ffb700 1 -- 172.21.15.81:0/418627007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7faf2809ae90 con 0x55f9546167a0 2024-05-09T00:10:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf44878b80 1 -- 172.21.15.81:0/418627007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9544b92f0 con 0x55f9546167a0 2024-05-09T00:10:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf19ffb700 1 -- 172.21.15.81:0/418627007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf28067340 con 0x55f9546167a0 2024-05-09T00:10:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf44878b80 10 client.17691 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf44878b80 1 -- 172.21.15.81:0/418627007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f9545265e0 con 0x55f9546167a0 2024-05-09T00:10:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf19ffb700 1 -- 172.21.15.81:0/418627007 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf2807e080 con 0x55f9546167a0 2024-05-09T00:10:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf19ffb700 1 -- 172.21.15.81:0/418627007 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faf280bb0b0 con 0x55f9546167a0 2024-05-09T00:10:43.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf44878b80 10 client.17691 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf44878b80 10 client.17691 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf44878b80 20 client.17691 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf44878b80 1 --2- 172.21.15.81:0/418627007 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f954681f50 0x55f954684340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf44878b80 4 client.17691 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:10:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.246+0000 7faf44878b80 1 -- 172.21.15.81:0/418627007 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f9543aed70 con 0x55f954681f50 2024-05-09T00:10:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.247+0000 7faf3645a700 1 --2- 172.21.15.81:0/418627007 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f954681f50 0x55f954684340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.247+0000 7faf19ffb700 10 client.17691 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.247+0000 7faf3645a700 1 --2- 172.21.15.81:0/418627007 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f954681f50 0x55f954684340 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87e80e460864492f server_cookie=60f0f8fed513e0bf in_seq=0 out_seq=0 2024-05-09T00:10:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.248+0000 7faf19ffb700 1 -- 172.21.15.81:0/418627007 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f9543aed70 con 0x55f954681f50 2024-05-09T00:10:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.248+0000 7faf19ffb700 10 client.17691 handle_command_reply: tid=0 2024-05-09T00:10:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.248+0000 7faf44878b80 1 client.17691 shutdown 2024-05-09T00:10:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.248+0000 7faf44878b80 1 -- 172.21.15.81:0/418627007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 msgr2=0x55f954613010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.248+0000 7faf44878b80 1 --2- 172.21.15.81:0/418627007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f954613010 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7faf2801dd20 tx=0x7faf280cbf70 comp rx=0 tx=0).stop 2024-05-09T00:10:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.248+0000 7faf44878b80 1 -- 172.21.15.81:0/418627007 shutdown_connections 2024-05-09T00:10:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.248+0000 7faf44878b80 1 --2- 172.21.15.81:0/418627007 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f954681f50 0x55f954684340 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.248+0000 7faf44878b80 1 --2- 172.21.15.81:0/418627007 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f954610910 0x55f954612590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.248+0000 7faf44878b80 1 --2- 172.21.15.81:0/418627007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f9546167a0 0x55f954613010 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.248+0000 7faf44878b80 1 --2- 172.21.15.81:0/418627007 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f954615e80 0x55f954612ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.248+0000 7faf44878b80 1 -- 172.21.15.81:0/418627007 >> 172.21.15.81:0/418627007 conn(0x55f95456e290 msgr2=0x55f954619090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.248+0000 7faf19ffb700 0 client.17691 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.248+0000 7faf44878b80 1 -- 172.21.15.81:0/418627007 shutdown_connections 2024-05-09T00:10:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.248+0000 7faf44878b80 1 -- 172.21.15.81:0/418627007 wait complete. 2024-05-09T00:10:43.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.249+0000 7faf44878b80 20 client.17691 trim_cache size 0 max 16384 2024-05-09T00:10:43.251 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:10:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:10:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "c7df62fc-e539-439d-8c7a-0031e91298a6", 2024-05-09T00:10:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:10:43.252 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:10:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.249+0000 7faf386be700 1 -- 172.21.15.81:0/4226450529 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf1c0a1290 msgr2=0x7faf1c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.249+0000 7faf386be700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf1c0a1290 0x7faf1c0a3750 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faf2c005950 tx=0x7faf2c005cf0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.249+0000 7faf386be700 1 -- 172.21.15.81:0/4226450529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf30105ef0 msgr2=0x7faf3019be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.249+0000 7faf386be700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf30105ef0 0x7faf3019be20 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7faf280077f0 tx=0x7faf280078d0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.249+0000 7faf386be700 1 -- 172.21.15.81:0/4226450529 shutdown_connections 2024-05-09T00:10:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.249+0000 7faf386be700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf1c0a1290 0x7faf1c0a3750 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.249+0000 7faf386be700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf30105ef0 0x7faf3019be20 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.249+0000 7faf386be700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf300ff410 0x7faf30197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.249+0000 7faf386be700 1 --2- 172.21.15.81:0/4226450529 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf300ffdd0 0x7faf30197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.249+0000 7faf386be700 1 -- 172.21.15.81:0/4226450529 >> 172.21.15.81:0/4226450529 conn(0x7faf300763a0 msgr2=0x7faf30103f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.249+0000 7faf386be700 1 -- 172.21.15.81:0/4226450529 shutdown_connections 2024-05-09T00:10:43.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.249+0000 7faf386be700 1 -- 172.21.15.81:0/4226450529 wait complete. 2024-05-09T00:10:43.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:10:43.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.385+0000 7fb1beb64700 1 -- 172.21.15.81:0/528594014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8100060 msgr2=0x7fb1b8100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.385+0000 7fb1beb64700 1 --2- 172.21.15.81:0/528594014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8100060 0x7fb1b8100440 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009990 tx=0x7fb1ac009ca0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.385+0000 7fb1beb64700 1 -- 172.21.15.81:0/528594014 shutdown_connections 2024-05-09T00:10:43.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.385+0000 7fb1beb64700 1 --2- 172.21.15.81:0/528594014 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1b8105180 0x7fb1b810cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.385+0000 7fb1beb64700 1 --2- 172.21.15.81:0/528594014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8100060 0x7fb1b8100440 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.385+0000 7fb1beb64700 1 --2- 172.21.15.81:0/528594014 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b8100a10 0x7fb1b8104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.385+0000 7fb1beb64700 1 -- 172.21.15.81:0/528594014 >> 172.21.15.81:0/528594014 conn(0x7fb1b8076fa0 msgr2=0x7fb1b80773b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:43.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.385+0000 7fb1beb64700 1 -- 172.21.15.81:0/528594014 shutdown_connections 2024-05-09T00:10:43.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.385+0000 7fb1beb64700 1 -- 172.21.15.81:0/528594014 wait complete. 2024-05-09T00:10:43.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.386+0000 7fb1beb64700 1 Processor -- start 2024-05-09T00:10:43.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.386+0000 7fb1beb64700 1 -- start start 2024-05-09T00:10:43.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.386+0000 7fb1beb64700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b8100060 0x7fb1b8196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.386+0000 7fb1beb64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8105180 0x7fb1b81968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.386+0000 7fb1beb64700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1b819ac70 0x7fb1b819b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.386+0000 7fb1beb64700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b819b6f0 con 0x7fb1b8105180 2024-05-09T00:10:43.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.386+0000 7fb1beb64700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b819b860 con 0x7fb1b8100060 2024-05-09T00:10:43.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.386+0000 7fb1beb64700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b819ba20 con 0x7fb1b819ac70 2024-05-09T00:10:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.386+0000 7fb1b7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8105180 0x7fb1b81968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.386+0000 7fb1b7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8105180 0x7fb1b81968d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39206/0 (socket says 172.21.15.81:39206) 2024-05-09T00:10:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.386+0000 7fb1b7fff700 1 -- 172.21.15.81:0/3180013758 learned_addr learned my addr 172.21.15.81:0/3180013758 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.386+0000 7fb1bd101700 1 --2- 172.21.15.81:0/3180013758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1b819ac70 0x7fb1b819b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.387+0000 7fb1bc900700 1 --2- 172.21.15.81:0/3180013758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b8100060 0x7fb1b8196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.387+0000 7fb1b7fff700 1 -- 172.21.15.81:0/3180013758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1b819ac70 msgr2=0x7fb1b819b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.387+0000 7fb1b7fff700 1 --2- 172.21.15.81:0/3180013758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1b819ac70 0x7fb1b819b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.387+0000 7fb1b7fff700 1 -- 172.21.15.81:0/3180013758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b8100060 msgr2=0x7fb1b8196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.387+0000 7fb1b7fff700 1 --2- 172.21.15.81:0/3180013758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b8100060 0x7fb1b8196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.387+0000 7fb1b7fff700 1 -- 172.21.15.81:0/3180013758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac0095f0 con 0x7fb1b8105180 2024-05-09T00:10:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.387+0000 7fb1b7fff700 1 --2- 172.21.15.81:0/3180013758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8105180 0x7fb1b81968d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400c8f0 tx=0x7fb1a400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:43.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.387+0000 7fb1b5ffb700 1 -- 172.21.15.81:0/3180013758 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4007940 con 0x7fb1b8105180 2024-05-09T00:10:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.387+0000 7fb1b5ffb700 1 -- 172.21.15.81:0/3180013758 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1a400f450 con 0x7fb1b8105180 2024-05-09T00:10:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.387+0000 7fb1beb64700 1 -- 172.21.15.81:0/3180013758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b81a2f80 con 0x7fb1b8105180 2024-05-09T00:10:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.387+0000 7fb1b5ffb700 1 -- 172.21.15.81:0/3180013758 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4018660 con 0x7fb1b8105180 2024-05-09T00:10:43.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.387+0000 7fb1beb64700 1 -- 172.21.15.81:0/3180013758 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b81a3450 con 0x7fb1b8105180 2024-05-09T00:10:43.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.389+0000 7fb1b5ffb700 1 -- 172.21.15.81:0/3180013758 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fb1a400f5c0 con 0x7fb1b8105180 2024-05-09T00:10:43.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.390+0000 7fb1b5ffb700 1 --2- 172.21.15.81:0/3180013758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1a80a1310 0x7fb1a80a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.390+0000 7fb1b5ffb700 1 -- 172.21.15.81:0/3180013758 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fb1a40ccbd0 con 0x7fb1b8105180 2024-05-09T00:10:43.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.390+0000 7fb1bc900700 1 --2- 172.21.15.81:0/3180013758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1a80a1310 0x7fb1a80a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1bc900700 1 --2- 172.21.15.81:0/3180013758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1a80a1310 0x7fb1a80a37d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00b5c0 tx=0x7fb1ac005fd0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:43.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1cad1eb80 1 Processor -- start 2024-05-09T00:10:43.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1cad1eb80 1 -- start start 2024-05-09T00:10:43.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1cad1eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08eff0 0x55d07e08f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1cad1eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08f910 0x55d07e089560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1cad1eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e089aa0 0x55d07e089f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1cad1eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d07dfde150 con 0x55d07e08eff0 2024-05-09T00:10:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1cad1eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d07dfdbb10 con 0x55d07e089aa0 2024-05-09T00:10:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1cad1eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d07dfd7400 con 0x55d07e08f910 2024-05-09T00:10:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1bc900700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08eff0 0x55d07e08f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1bc900700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08eff0 0x55d07e08f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39212/0 (socket says 172.21.15.81:39212) 2024-05-09T00:10:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1bc900700 1 -- 172.21.15.81:0/3247781415 learned_addr learned my addr 172.21.15.81:0/3247781415 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1b7fff700 1 --2- 172.21.15.81:0/3247781415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08f910 0x55d07e089560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1bd101700 1 --2- 172.21.15.81:0/3247781415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e089aa0 0x55d07e089f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1bc900700 1 -- 172.21.15.81:0/3247781415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08f910 msgr2=0x55d07e089560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1bc900700 1 --2- 172.21.15.81:0/3247781415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08f910 0x55d07e089560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1bc900700 1 -- 172.21.15.81:0/3247781415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e089aa0 msgr2=0x55d07e089f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1bc900700 1 --2- 172.21.15.81:0/3247781415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e089aa0 0x55d07e089f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1bc900700 1 -- 172.21.15.81:0/3247781415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d07de583b0 con 0x55d07e08eff0 2024-05-09T00:10:43.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1b7fff700 1 --2- 172.21.15.81:0/3247781415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08f910 0x55d07e089560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:43.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.391+0000 7fb1bd101700 1 --2- 172.21.15.81:0/3247781415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e089aa0 0x55d07e089f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:43.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.392+0000 7fb1bc900700 1 --2- 172.21.15.81:0/3247781415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08eff0 0x55d07e08f3d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac005510 tx=0x7fb1ac01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3718e8bbac4c3629 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:43.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.392+0000 7fb1a2ffd700 1 -- 172.21.15.81:0/3247781415 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac02b070 con 0x55d07e08eff0 2024-05-09T00:10:43.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.392+0000 7fb1a2ffd700 1 -- 172.21.15.81:0/3247781415 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1ac01e040 con 0x55d07e08eff0 2024-05-09T00:10:43.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.392+0000 7fb1a2ffd700 1 -- 172.21.15.81:0/3247781415 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac004d20 con 0x55d07e08eff0 2024-05-09T00:10:43.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.392+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/3247781415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08eff0 msgr2=0x55d07e08f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.392+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/3247781415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08eff0 0x55d07e08f3d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac005510 tx=0x7fb1ac01f000 comp rx=0 tx=0).stop 2024-05-09T00:10:43.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.392+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/3247781415 shutdown_connections 2024-05-09T00:10:43.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.392+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/3247781415 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e089aa0 0x55d07e089f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.392+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/3247781415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08eff0 0x55d07e08f3d0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.392+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/3247781415 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08f910 0x55d07e089560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.392+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/3247781415 >> 172.21.15.81:0/3247781415 conn(0x55d07dfe5210 msgr2=0x55d07e081df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:43.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.393+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/3247781415 shutdown_connections 2024-05-09T00:10:43.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.393+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/3247781415 wait complete. 2024-05-09T00:10:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.393+0000 7fb1cad1eb80 1 -- start start 2024-05-09T00:10:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.393+0000 7fb1cad1eb80 1 Processor -- start 2024-05-09T00:10:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.393+0000 7fb1cad1eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e089aa0 0x55d07e092d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.393+0000 7fb1cad1eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08eff0 0x55d07e0932b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.393+0000 7fb1cad1eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e08f910 0x55d07e0937f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.393+0000 7fb1cad1eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d07df73560 con 0x55d07e08eff0 2024-05-09T00:10:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.393+0000 7fb1cad1eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d07df73200 con 0x55d07e08f910 2024-05-09T00:10:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.393+0000 7fb1cad1eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d07de5a6a0 con 0x55d07e089aa0 2024-05-09T00:10:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.393+0000 7fb1cad1eb80 10 client.0 _ll_register_callbacks cb 0x55d07df7cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.393+0000 7fb1b7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08eff0 0x55d07e0932b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.393+0000 7fb1b7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08eff0 0x55d07e0932b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39226/0 (socket says 172.21.15.81:39226) 2024-05-09T00:10:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.393+0000 7fb1b7fff700 1 -- 172.21.15.81:0/703722408 learned_addr learned my addr 172.21.15.81:0/703722408 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb1bc900700 1 --2- 172.21.15.81:0/703722408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e089aa0 0x55d07e092d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb1bd101700 1 --2- 172.21.15.81:0/703722408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e08f910 0x55d07e0937f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb1b7fff700 1 -- 172.21.15.81:0/703722408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e089aa0 msgr2=0x55d07e092d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb1b7fff700 1 --2- 172.21.15.81:0/703722408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e089aa0 0x55d07e092d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb1b7fff700 1 -- 172.21.15.81:0/703722408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e08f910 msgr2=0x55d07e0937f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb1b7fff700 1 --2- 172.21.15.81:0/703722408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e08f910 0x55d07e0937f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb1b7fff700 1 -- 172.21.15.81:0/703722408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b810d570 con 0x55d07e08eff0 2024-05-09T00:10:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb1bd101700 1 --2- 172.21.15.81:0/703722408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e08f910 0x55d07e0937f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb1b7fff700 1 --2- 172.21.15.81:0/703722408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08eff0 0x55d07e0932b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40999b0 tx=0x7fb1a409a4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a5aa685c198546 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb197fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb197fff700 1 -- 172.21.15.81:0/703722408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a409a110 con 0x55d07e08eff0 2024-05-09T00:10:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb197fff700 1 -- 172.21.15.81:0/703722408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fb1a40a2130 con 0x55d07e08eff0 2024-05-09T00:10:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/703722408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d07df30270 con 0x55d07e08eff0 2024-05-09T00:10:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb197fff700 1 -- 172.21.15.81:0/703722408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1a40991a0 con 0x55d07e08eff0 2024-05-09T00:10:43.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb1cad1eb80 10 client.17703 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/703722408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d07de04b60 con 0x55d07e08eff0 2024-05-09T00:10:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.394+0000 7fb197fff700 1 -- 172.21.15.81:0/703722408 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d07df30270 con 0x55d07e08eff0 2024-05-09T00:10:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.395+0000 7fb197fff700 1 -- 172.21.15.81:0/703722408 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb1a40add10 con 0x55d07e08eff0 2024-05-09T00:10:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.395+0000 7fb1cad1eb80 10 client.17703 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.395+0000 7fb1cad1eb80 10 client.17703 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.395+0000 7fb1cad1eb80 20 client.17703 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.395+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/703722408 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d07e0a31c0 0x55d07e0a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.395+0000 7fb1cad1eb80 4 client.17703 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.395+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/703722408 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d07e056810 con 0x55d07e0a31c0 2024-05-09T00:10:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.395+0000 7fb1bc900700 1 --2- 172.21.15.81:0/703722408 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d07e0a31c0 0x55d07e0a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.395+0000 7fb197fff700 10 client.17703 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.395+0000 7fb1bc900700 1 --2- 172.21.15.81:0/703722408 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d07e0a31c0 0x55d07e0a55b0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee252be15c36da19 server_cookie=bc869400dca619dc in_seq=0 out_seq=0 2024-05-09T00:10:43.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb197fff700 1 -- 172.21.15.81:0/703722408 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d07e056810 con 0x55d07e0a31c0 2024-05-09T00:10:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb197fff700 10 client.17703 handle_command_reply: tid=0 2024-05-09T00:10:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb1cad1eb80 1 client.17703 shutdown 2024-05-09T00:10:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/703722408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08eff0 msgr2=0x55d07e0932b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/703722408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08eff0 0x55d07e0932b0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40999b0 tx=0x7fb1a409a4f0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/703722408 shutdown_connections 2024-05-09T00:10:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/703722408 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d07e0a31c0 0x55d07e0a55b0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/703722408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e08f910 0x55d07e0937f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/703722408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e089aa0 0x55d07e092d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb197fff700 0 client.17703 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/703722408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08eff0 0x55d07e0932b0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/703722408 >> 172.21.15.81:0/703722408 conn(0x55d07dfe5210 msgr2=0x55d07e0815a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/703722408 shutdown_connections 2024-05-09T00:10:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/703722408 wait complete. 2024-05-09T00:10:43.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.396+0000 7fb1cad1eb80 20 client.17703 trim_cache size 0 max 16384 2024-05-09T00:10:43.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.413+0000 7fb1cad1eb80 1 Processor -- start 2024-05-09T00:10:43.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.413+0000 7fb1cad1eb80 1 -- start start 2024-05-09T00:10:43.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.413+0000 7fb1cad1eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e089aa0 0x55d07e08e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1cad1eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08eff0 0x55d07e092630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1cad1eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08f910 0x55d07e081d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1cad1eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d07e083640 con 0x55d07e08f910 2024-05-09T00:10:43.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1cad1eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d07e0aa7c0 con 0x55d07e089aa0 2024-05-09T00:10:43.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1cad1eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d07e07c800 con 0x55d07e08eff0 2024-05-09T00:10:43.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1bd101700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08f910 0x55d07e081d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1bd101700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08f910 0x55d07e081d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39228/0 (socket says 172.21.15.81:39228) 2024-05-09T00:10:43.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1bd101700 1 -- 172.21.15.81:0/1905949816 learned_addr learned my addr 172.21.15.81:0/1905949816 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:43.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1bc900700 1 --2- 172.21.15.81:0/1905949816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e089aa0 0x55d07e08e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1bd101700 1 -- 172.21.15.81:0/1905949816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08eff0 msgr2=0x55d07e092630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1bd101700 1 --2- 172.21.15.81:0/1905949816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08eff0 0x55d07e092630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1bd101700 1 -- 172.21.15.81:0/1905949816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e089aa0 msgr2=0x55d07e08e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1bd101700 1 --2- 172.21.15.81:0/1905949816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e089aa0 0x55d07e08e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1bd101700 1 -- 172.21.15.81:0/1905949816 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d07df9d560 con 0x55d07e08f910 2024-05-09T00:10:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1bd101700 1 --2- 172.21.15.81:0/1905949816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08f910 0x55d07e081d20 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb1b000a530 tx=0x7fb1b0009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad45591492a3bac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1a37fe700 1 -- 172.21.15.81:0/1905949816 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0010050 con 0x55d07e08f910 2024-05-09T00:10:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1a37fe700 1 -- 172.21.15.81:0/1905949816 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1b0011040 con 0x55d07e08f910 2024-05-09T00:10:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.414+0000 7fb1a37fe700 1 -- 172.21.15.81:0/1905949816 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0015880 con 0x55d07e08f910 2024-05-09T00:10:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.415+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/1905949816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08f910 msgr2=0x55d07e081d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.415+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/1905949816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08f910 0x55d07e081d20 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7fb1b000a530 tx=0x7fb1b0009650 comp rx=0 tx=0).stop 2024-05-09T00:10:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.415+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/1905949816 shutdown_connections 2024-05-09T00:10:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.415+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/1905949816 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e089aa0 0x55d07e08e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.415+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/1905949816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e08f910 0x55d07e081d20 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.415+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/1905949816 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08eff0 0x55d07e092630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.415+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/1905949816 >> 172.21.15.81:0/1905949816 conn(0x55d07dfe5210 msgr2=0x55d07e092d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.415+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/1905949816 shutdown_connections 2024-05-09T00:10:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.415+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/1905949816 wait complete. 2024-05-09T00:10:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.415+0000 7fb1cad1eb80 1 -- start start 2024-05-09T00:10:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.415+0000 7fb1cad1eb80 1 Processor -- start 2024-05-09T00:10:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1cad1eb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e089aa0 0x55d07e09a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1cad1eb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e08eff0 0x55d07e098920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1cad1eb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08f910 0x55d07e098e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1cad1eb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d07e0995a0 con 0x55d07e089aa0 2024-05-09T00:10:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1cad1eb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d07e099710 con 0x55d07e08eff0 2024-05-09T00:10:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1cad1eb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d07e0f96a0 con 0x55d07e08f910 2024-05-09T00:10:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1cad1eb80 10 client.0 _ll_register_callbacks cb 0x55d07df7cb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:43.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1bc900700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e089aa0 0x55d07e09a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1bc900700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e089aa0 0x55d07e09a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39240/0 (socket says 172.21.15.81:39240) 2024-05-09T00:10:43.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1bc900700 1 -- 172.21.15.81:0/3161449111 learned_addr learned my addr 172.21.15.81:0/3161449111 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:43.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1b7fff700 1 --2- 172.21.15.81:0/3161449111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e08eff0 0x55d07e098920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1bd101700 1 --2- 172.21.15.81:0/3161449111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08f910 0x55d07e098e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1bc900700 1 -- 172.21.15.81:0/3161449111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08f910 msgr2=0x55d07e098e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1bc900700 1 --2- 172.21.15.81:0/3161449111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08f910 0x55d07e098e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1bc900700 1 -- 172.21.15.81:0/3161449111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e08eff0 msgr2=0x55d07e098920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:43.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1bc900700 1 --2- 172.21.15.81:0/3161449111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e08eff0 0x55d07e098920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1bc900700 1 -- 172.21.15.81:0/3161449111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b0009d70 con 0x55d07e089aa0 2024-05-09T00:10:43.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1b7fff700 1 --2- 172.21.15.81:0/3161449111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e08eff0 0x55d07e098920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:43.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1bc900700 1 --2- 172.21.15.81:0/3161449111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e089aa0 0x55d07e09a580 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0098e0 tx=0x7fb1ac005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fbe4daececf0ed server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:43.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb197fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:43.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb197fff700 1 -- 172.21.15.81:0/3161449111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac02b070 con 0x55d07e089aa0 2024-05-09T00:10:43.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/3161449111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1ac01e040 con 0x55d07e089aa0 2024-05-09T00:10:43.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.416+0000 7fb197fff700 1 -- 172.21.15.81:0/3161449111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fb1ac0048d0 con 0x55d07e089aa0 2024-05-09T00:10:43.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.417+0000 7fb197fff700 1 -- 172.21.15.81:0/3161449111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1ac00be90 con 0x55d07e089aa0 2024-05-09T00:10:43.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.417+0000 7fb1cad1eb80 10 client.17709 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:43.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.417+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/3161449111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d07de5ccd0 con 0x55d07e089aa0 2024-05-09T00:10:43.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.417+0000 7fb197fff700 1 -- 172.21.15.81:0/3161449111 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb1ac01e040 con 0x55d07e089aa0 2024-05-09T00:10:43.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.417+0000 7fb197fff700 1 -- 172.21.15.81:0/3161449111 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb1ac039780 con 0x55d07e089aa0 2024-05-09T00:10:43.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.417+0000 7fb1cad1eb80 10 client.17709 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:43.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.417+0000 7fb1cad1eb80 10 client.17709 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:43.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.417+0000 7fb1cad1eb80 20 client.17709 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:43.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.417+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/3161449111 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d07e0fa900 0x55d07e0fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:43.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.417+0000 7fb1cad1eb80 4 client.17709 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:10:43.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.417+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/3161449111 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d07dfcfec0 con 0x55d07e0fa900 2024-05-09T00:10:43.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.417+0000 7fb1b7fff700 1 --2- 172.21.15.81:0/3161449111 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d07e0fa900 0x55d07e0fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:43.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb197fff700 10 client.17709 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:43.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb1b7fff700 1 --2- 172.21.15.81:0/3161449111 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d07e0fa900 0x55d07e0fcd20 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=841a2a1f93232f3 server_cookie=b78d4a385bd5274d in_seq=0 out_seq=0 2024-05-09T00:10:43.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb197fff700 1 -- 172.21.15.81:0/3161449111 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d07dfcfec0 con 0x55d07e0fa900 2024-05-09T00:10:43.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb197fff700 10 client.17709 handle_command_reply: tid=0 2024-05-09T00:10:43.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb1cad1eb80 1 client.17709 shutdown 2024-05-09T00:10:43.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/3161449111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e089aa0 msgr2=0x55d07e09a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/3161449111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e089aa0 0x55d07e09a580 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0098e0 tx=0x7fb1ac005ab0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/3161449111 shutdown_connections 2024-05-09T00:10:43.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/3161449111 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d07e0fa900 0x55d07e0fcd20 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/3161449111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d07e08f910 0x55d07e098e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/3161449111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d07e089aa0 0x55d07e09a580 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb197fff700 0 client.17709 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:43.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb1cad1eb80 1 --2- 172.21.15.81:0/3161449111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d07e08eff0 0x55d07e098920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/3161449111 >> 172.21.15.81:0/3161449111 conn(0x55d07dfe5210 msgr2=0x55d07e08e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:43.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/3161449111 shutdown_connections 2024-05-09T00:10:43.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb1cad1eb80 1 -- 172.21.15.81:0/3161449111 wait complete. 2024-05-09T00:10:43.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.418+0000 7fb1cad1eb80 20 client.17709 trim_cache size 0 max 16384 2024-05-09T00:10:43.422 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:10:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:10:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:10:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "c7df62fc-e539-439d-8c7a-0031e91298a6": { 2024-05-09T00:10:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:10:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "c7df62fc-e539-439d-8c7a-0031e91298a6", 2024-05-09T00:10:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:10:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:10:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:10:43.423 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:10:43.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.419+0000 7fb1beb64700 1 -- 172.21.15.81:0/3180013758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1a80a1310 msgr2=0x7fb1a80a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.419+0000 7fb1beb64700 1 --2- 172.21.15.81:0/3180013758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1a80a1310 0x7fb1a80a37d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00b5c0 tx=0x7fb1ac005fd0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.419+0000 7fb1beb64700 1 -- 172.21.15.81:0/3180013758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8105180 msgr2=0x7fb1b81968d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:43.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.419+0000 7fb1beb64700 1 --2- 172.21.15.81:0/3180013758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8105180 0x7fb1b81968d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400c8f0 tx=0x7fb1a400cc00 comp rx=0 tx=0).stop 2024-05-09T00:10:43.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.419+0000 7fb1beb64700 1 -- 172.21.15.81:0/3180013758 shutdown_connections 2024-05-09T00:10:43.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.419+0000 7fb1beb64700 1 --2- 172.21.15.81:0/3180013758 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb1a80a1310 0x7fb1a80a37d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.419+0000 7fb1beb64700 1 --2- 172.21.15.81:0/3180013758 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb1b8100060 0x7fb1b8196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.419+0000 7fb1beb64700 1 --2- 172.21.15.81:0/3180013758 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1b819ac70 0x7fb1b819b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.419+0000 7fb1beb64700 1 --2- 172.21.15.81:0/3180013758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb1b8105180 0x7fb1b81968d0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:43.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.419+0000 7fb1beb64700 1 -- 172.21.15.81:0/3180013758 >> 172.21.15.81:0/3180013758 conn(0x7fb1b8076fa0 msgr2=0x7fb1b80fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:43.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.419+0000 7fb1beb64700 1 -- 172.21.15.81:0/3180013758 shutdown_connections 2024-05-09T00:10:43.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:10:43.419+0000 7fb1beb64700 1 -- 172.21.15.81:0/3180013758 wait complete. 2024-05-09T00:10:43.427 INFO:tasks.cephfs.filesystem:scrub status for tag:c7df62fc-e539-439d-8c7a-0031e91298a6 - {'path': '/', 'tag': 'c7df62fc-e539-439d-8c7a-0031e91298a6', 'options': 'recursive,force'} 2024-05-09T00:10:44.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:44 smithi171 ceph-mon[47351]: pgmap v238: 97 pgs: 97 active+clean; 4.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:10:44.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:44 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:10:44.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:44 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:10:44.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:44 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:10:44.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:44 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:10:44.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:44 smithi081 ceph-mon[42474]: pgmap v238: 97 pgs: 97 active+clean; 4.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:10:44.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:44 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:10:44.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:44 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:10:44.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:44 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:10:44.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:44 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:10:44.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:44 smithi150 ceph-mon[46187]: pgmap v238: 97 pgs: 97 active+clean; 4.7 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:10:44.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:44 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:10:44.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:44 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:10:44.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:44 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:10:44.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:44 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:10:45.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:45 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:10:45.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:45 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:10:45.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:45 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:10:46.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:46 smithi081 ceph-mon[42474]: pgmap v239: 97 pgs: 97 active+clean; 4.9 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 18 op/s 2024-05-09T00:10:46.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:46 smithi150 ceph-mon[46187]: pgmap v239: 97 pgs: 97 active+clean; 4.9 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 18 op/s 2024-05-09T00:10:46.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:46 smithi171 ceph-mon[47351]: pgmap v239: 97 pgs: 97 active+clean; 4.9 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 62 KiB/s wr, 18 op/s 2024-05-09T00:10:48.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:48 smithi081 ceph-mon[42474]: pgmap v240: 97 pgs: 97 active+clean; 4.9 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:10:48.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:48 smithi150 ceph-mon[46187]: pgmap v240: 97 pgs: 97 active+clean; 4.9 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:10:48.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:48 smithi171 ceph-mon[47351]: pgmap v240: 97 pgs: 97 active+clean; 4.9 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:10:50.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:50 smithi081 ceph-mon[42474]: pgmap v241: 97 pgs: 97 active+clean; 4.9 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:10:50.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:50 smithi150 ceph-mon[46187]: pgmap v241: 97 pgs: 97 active+clean; 4.9 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:10:50.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:50 smithi171 ceph-mon[47351]: pgmap v241: 97 pgs: 97 active+clean; 4.9 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:10:52.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:52 smithi081 ceph-mon[42474]: pgmap v242: 97 pgs: 97 active+clean; 5.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-05-09T00:10:52.435 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:313/600: open fd = 3 2024-05-09T00:10:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:314/600: open fd = 3 2024-05-09T00:10:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:315/600: open fd = 3 2024-05-09T00:10:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:316/600: open fd = 3 2024-05-09T00:10:52.436 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:317/600: open fd = 3 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:318/600: open fd = 3 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:319/600: open fd = 3 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.437 INFO:tasks.workunit.client.0.smithi081.stdout:320/600: open fd = 3 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:321/600: open fd = 3 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:322/600: open fd = 3 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:323/600: open fd = 3 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.438 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.439 INFO:tasks.workunit.client.0.smithi081.stdout:324/600: open fd = 3 2024-05-09T00:10:52.439 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.439 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.439 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.439 INFO:tasks.workunit.client.0.smithi081.stdout:325/600: open fd = 3 2024-05-09T00:10:52.439 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.439 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.439 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.439 INFO:tasks.workunit.client.0.smithi081.stdout:326/600: open fd = 3 2024-05-09T00:10:52.439 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.439 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.439 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.439 INFO:tasks.workunit.client.0.smithi081.stdout:327/600: open fd = 3 2024-05-09T00:10:52.439 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:328/600: open fd = 3 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:329/600: open fd = 3 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:330/600: open fd = 3 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.440 INFO:tasks.workunit.client.0.smithi081.stdout:331/600: open fd = 3 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:332/600: open fd = 3 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:333/600: open fd = 3 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:334/600: open fd = 3 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.441 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.442 INFO:tasks.workunit.client.0.smithi081.stdout:335/600: open fd = 3 2024-05-09T00:10:52.442 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.442 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.442 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.442 INFO:tasks.workunit.client.0.smithi081.stdout:336/600: open fd = 3 2024-05-09T00:10:52.442 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.442 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.442 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.442 INFO:tasks.workunit.client.0.smithi081.stdout:337/600: open fd = 3 2024-05-09T00:10:52.442 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.442 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.442 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.442 INFO:tasks.workunit.client.0.smithi081.stdout:338/600: open fd = 3 2024-05-09T00:10:52.442 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:339/600: open fd = 3 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:340/600: open fd = 3 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:341/600: open fd = 3 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.443 INFO:tasks.workunit.client.0.smithi081.stdout:342/600: open fd = 3 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:343/600: open fd = 3 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:344/600: open fd = 3 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:345/600: open fd = 3 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.444 INFO:tasks.workunit.client.0.smithi081.stdout:346/600: open fd = 3 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:347/600: open fd = 3 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:348/600: open fd = 3 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:349/600: open fd = 3 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.445 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.446 INFO:tasks.workunit.client.0.smithi081.stdout:350/600: open fd = 3 2024-05-09T00:10:52.446 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.446 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.446 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.446 INFO:tasks.workunit.client.0.smithi081.stdout:351/600: open fd = 3 2024-05-09T00:10:52.446 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.446 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.446 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.446 INFO:tasks.workunit.client.0.smithi081.stdout:352/600: open fd = 3 2024-05-09T00:10:52.446 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.446 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.446 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.446 INFO:tasks.workunit.client.0.smithi081.stdout:353/600: open fd = 3 2024-05-09T00:10:52.446 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:354/600: open fd = 3 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:355/600: open fd = 3 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:356/600: open fd = 3 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.447 INFO:tasks.workunit.client.0.smithi081.stdout:357/600: open fd = 3 2024-05-09T00:10:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:358/600: open fd = 3 2024-05-09T00:10:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:359/600: open fd = 3 2024-05-09T00:10:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:360/600: open fd = 3 2024-05-09T00:10:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.448 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:361/600: open fd = 3 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:362/600: open fd = 3 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:363/600: open fd = 3 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:364/600: open fd = 3 2024-05-09T00:10:52.449 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:365/600: open fd = 3 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:366/600: open fd = 3 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:367/600: open fd = 3 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.450 INFO:tasks.workunit.client.0.smithi081.stdout:368/600: open fd = 3 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:369/600: open fd = 3 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:370/600: open fd = 3 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:371/600: open fd = 3 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.451 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:372/600: open fd = 3 2024-05-09T00:10:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:373/600: open fd = 3 2024-05-09T00:10:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:374/600: open fd = 3 2024-05-09T00:10:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:10:52.452 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:10:52.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:52 smithi150 ceph-mon[46187]: pgmap v242: 97 pgs: 97 active+clean; 5.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-05-09T00:10:52.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:52 smithi171 ceph-mon[47351]: pgmap v242: 97 pgs: 97 active+clean; 5.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-05-09T00:10:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.580+0000 7fa3ce97d700 1 -- 172.21.15.81:0/3443206776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3c8102110 msgr2=0x7fa3c81024f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.580+0000 7fa3ce97d700 1 --2- 172.21.15.81:0/3443206776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3c8102110 0x7fa3c81024f0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009990 tx=0x7fa3b8009ca0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.580+0000 7fa3ce97d700 1 -- 172.21.15.81:0/3443206776 shutdown_connections 2024-05-09T00:10:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.580+0000 7fa3ce97d700 1 --2- 172.21.15.81:0/3443206776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3c810b4e0 0x7fa3c810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.580+0000 7fa3ce97d700 1 --2- 172.21.15.81:0/3443206776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3c8102110 0x7fa3c81024f0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.580+0000 7fa3ce97d700 1 --2- 172.21.15.81:0/3443206776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3c8102a30 0x7fa3c810af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.580+0000 7fa3ce97d700 1 -- 172.21.15.81:0/3443206776 >> 172.21.15.81:0/3443206776 conn(0x7fa3c80fb870 msgr2=0x7fa3c80fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.580+0000 7fa3ce97d700 1 -- 172.21.15.81:0/3443206776 shutdown_connections 2024-05-09T00:10:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.580+0000 7fa3ce97d700 1 -- 172.21.15.81:0/3443206776 wait complete. 2024-05-09T00:10:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.580+0000 7fa3ce97d700 1 Processor -- start 2024-05-09T00:10:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.580+0000 7fa3ce97d700 1 -- start start 2024-05-09T00:10:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ce97d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3c8102110 0x7fa3c81972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ce97d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3c8102a30 0x7fa3c8197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ce97d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3c810b4e0 0x7fa3c819bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ce97d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c819c1f0 con 0x7fa3c810b4e0 2024-05-09T00:10:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ce97d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c819c360 con 0x7fa3c8102a30 2024-05-09T00:10:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ce97d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c819c520 con 0x7fa3c8102110 2024-05-09T00:10:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ccf1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3c810b4e0 0x7fa3c819bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ccf1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3c810b4e0 0x7fa3c819bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60072/0 (socket says 172.21.15.81:60072) 2024-05-09T00:10:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ccf1a700 1 -- 172.21.15.81:0/2259030523 learned_addr learned my addr 172.21.15.81:0/2259030523 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3c8102110 0x7fa3c81972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3c77fe700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3c8102a30 0x7fa3c8197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ccf1a700 1 -- 172.21.15.81:0/2259030523 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3c8102110 msgr2=0x7fa3c81972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ccf1a700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3c8102110 0x7fa3c81972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ccf1a700 1 -- 172.21.15.81:0/2259030523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3c8102a30 msgr2=0x7fa3c8197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ccf1a700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3c8102a30 0x7fa3c8197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ccf1a700 1 -- 172.21.15.81:0/2259030523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b80095f0 con 0x7fa3c810b4e0 2024-05-09T00:10:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3c8102110 0x7fa3c81972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.581+0000 7fa3ccf1a700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3c810b4e0 0x7fa3c819bbb0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000ada0 tx=0x7fa3c000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.582+0000 7fa3c57fa700 1 -- 172.21.15.81:0/2259030523 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c000f070 con 0x7fa3c810b4e0 2024-05-09T00:10:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.582+0000 7fa3c57fa700 1 -- 172.21.15.81:0/2259030523 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3c0007b30 con 0x7fa3c810b4e0 2024-05-09T00:10:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.582+0000 7fa3ce97d700 1 -- 172.21.15.81:0/2259030523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c819c800 con 0x7fa3c810b4e0 2024-05-09T00:10:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.582+0000 7fa3c57fa700 1 -- 172.21.15.81:0/2259030523 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0005440 con 0x7fa3c810b4e0 2024-05-09T00:10:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.582+0000 7fa3ce97d700 1 -- 172.21.15.81:0/2259030523 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c81a4040 con 0x7fa3c810b4e0 2024-05-09T00:10:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.584+0000 7fa3c57fa700 1 -- 172.21.15.81:0/2259030523 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa3c0004ad0 con 0x7fa3c810b4e0 2024-05-09T00:10:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.584+0000 7fa3c57fa700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3b40a1290 0x7fa3b40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.585+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3b40a1290 0x7fa3b40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.585+0000 7fa3c57fa700 1 -- 172.21.15.81:0/2259030523 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fa3c00cc3f0 con 0x7fa3c810b4e0 2024-05-09T00:10:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.585+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3b40a1290 0x7fa3b40a3750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8006010 tx=0x7fa3b801a040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3dab37b80 1 Processor -- start 2024-05-09T00:10:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3dab37b80 1 -- start start 2024-05-09T00:10:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3dab37b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a2950 0x564acb6a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3dab37b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a3270 0x564acb69cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3dab37b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 0x564acb69d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3dab37b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acb5f40f0 con 0x564acb6a2950 2024-05-09T00:10:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3dab37b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acb5f1ab0 con 0x564acb6a3270 2024-05-09T00:10:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3dab37b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acb5ed3a0 con 0x564acb69d480 2024-05-09T00:10:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a2950 0x564acb6a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a2950 0x564acb6a2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60078/0 (socket says 172.21.15.81:60078) 2024-05-09T00:10:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3c7fff700 1 -- 172.21.15.81:0/3534864931 learned_addr learned my addr 172.21.15.81:0/3534864931 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3c77fe700 1 --2- 172.21.15.81:0/3534864931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a3270 0x564acb69cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3ccf1a700 1 --2- 172.21.15.81:0/3534864931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 0x564acb69d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3c7fff700 1 -- 172.21.15.81:0/3534864931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 msgr2=0x564acb69d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/3534864931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 0x564acb69d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3c7fff700 1 -- 172.21.15.81:0/3534864931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a3270 msgr2=0x564acb69cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/3534864931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a3270 0x564acb69cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3c7fff700 1 -- 172.21.15.81:0/3534864931 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564acb46e350 con 0x564acb6a2950 2024-05-09T00:10:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.586+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/3534864931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a2950 0x564acb6a2d30 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8015000 tx=0x7fa3b801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d187ce5e8fdf6a3b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.587+0000 7fa3be7fc700 1 -- 172.21.15.81:0/3534864931 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b802a070 con 0x564acb6a2950 2024-05-09T00:10:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.587+0000 7fa3be7fc700 1 -- 172.21.15.81:0/3534864931 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3b8003c50 con 0x564acb6a2950 2024-05-09T00:10:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.587+0000 7fa3be7fc700 1 -- 172.21.15.81:0/3534864931 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b801d040 con 0x564acb6a2950 2024-05-09T00:10:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.587+0000 7fa3dab37b80 1 -- 172.21.15.81:0/3534864931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a2950 msgr2=0x564acb6a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.587+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/3534864931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a2950 0x564acb6a2d30 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8015000 tx=0x7fa3b801e000 comp rx=0 tx=0).stop 2024-05-09T00:10:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.587+0000 7fa3dab37b80 1 -- 172.21.15.81:0/3534864931 shutdown_connections 2024-05-09T00:10:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.587+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/3534864931 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 0x564acb69d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.587+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/3534864931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a2950 0x564acb6a2d30 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.587+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/3534864931 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a3270 0x564acb69cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.587+0000 7fa3dab37b80 1 -- 172.21.15.81:0/3534864931 >> 172.21.15.81:0/3534864931 conn(0x564acb5fb1b0 msgr2=0x564acb697840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.587+0000 7fa3dab37b80 1 -- 172.21.15.81:0/3534864931 shutdown_connections 2024-05-09T00:10:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.587+0000 7fa3dab37b80 1 -- 172.21.15.81:0/3534864931 wait complete. 2024-05-09T00:10:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.588+0000 7fa3dab37b80 1 -- start start 2024-05-09T00:10:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.588+0000 7fa3dab37b80 1 Processor -- start 2024-05-09T00:10:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.588+0000 7fa3dab37b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 0x564acb6a9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.588+0000 7fa3dab37b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a2950 0x564acb6a6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.588+0000 7fa3dab37b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a3270 0x564acb6a6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.588+0000 7fa3dab37b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acb589500 con 0x564acb6a2950 2024-05-09T00:10:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.588+0000 7fa3dab37b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acb5891a0 con 0x564acb6a3270 2024-05-09T00:10:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.588+0000 7fa3dab37b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acb470640 con 0x564acb69d480 2024-05-09T00:10:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.588+0000 7fa3dab37b80 10 client.0 _ll_register_callbacks cb 0x564acb592ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.588+0000 7fa3c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a2950 0x564acb6a6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.588+0000 7fa3c77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a2950 0x564acb6a6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60088/0 (socket says 172.21.15.81:60088) 2024-05-09T00:10:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.588+0000 7fa3c77fe700 1 -- 172.21.15.81:0/1798223209 learned_addr learned my addr 172.21.15.81:0/1798223209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 0x564acb6a9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3c77fe700 1 -- 172.21.15.81:0/1798223209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 msgr2=0x564acb6a9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3ccf1a700 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a3270 0x564acb6a6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3c77fe700 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 0x564acb6a9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3c77fe700 1 -- 172.21.15.81:0/1798223209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a3270 msgr2=0x564acb6a6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3c77fe700 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a3270 0x564acb6a6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3c77fe700 1 -- 172.21.15.81:0/1798223209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c810e610 con 0x564acb6a2950 2024-05-09T00:10:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 0x564acb6a9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:10:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3ccf1a700 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a3270 0x564acb6a6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:10:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3c77fe700 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a2950 0x564acb6a6550 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000f410 tx=0x7fa3b000f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fb9be645851f14 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3a77fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3a77fe700 1 -- 172.21.15.81:0/1798223209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0004a30 con 0x564acb6a2950 2024-05-09T00:10:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3a77fe700 1 -- 172.21.15.81:0/1798223209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fa3b0015070 con 0x564acb6a2950 2024-05-09T00:10:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1798223209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564acb546210 con 0x564acb6a2950 2024-05-09T00:10:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3a77fe700 1 -- 172.21.15.81:0/1798223209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3b0004b90 con 0x564acb6a2950 2024-05-09T00:10:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3dab37b80 10 client.17721 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1798223209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564acb41ab00 con 0x564acb6a2950 2024-05-09T00:10:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3a77fe700 1 -- 172.21.15.81:0/1798223209 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564acb546210 con 0x564acb6a2950 2024-05-09T00:10:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.589+0000 7fa3a77fe700 1 -- 172.21.15.81:0/1798223209 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa3b0005080 con 0x564acb6a2950 2024-05-09T00:10:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.590+0000 7fa3dab37b80 10 client.17721 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.590+0000 7fa3dab37b80 10 client.17721 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.590+0000 7fa3dab37b80 20 client.17721 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.590+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564acb6b6c40 0x564acb6b9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.590+0000 7fa3dab37b80 4 client.17721 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:10:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.590+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1798223209 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564acb66c7b0 con 0x564acb6b6c40 2024-05-09T00:10:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.590+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564acb6b6c40 0x564acb6b9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.590+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564acb6b6c40 0x564acb6b9060 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=923bd23961e092aa server_cookie=1f2fcce5f9ab4e20 in_seq=0 out_seq=0 2024-05-09T00:10:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.590+0000 7fa3a77fe700 10 client.17721 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3a77fe700 1 -- 172.21.15.81:0/1798223209 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564acb66c7b0 con 0x564acb6b6c40 2024-05-09T00:10:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3a77fe700 10 client.17721 handle_command_reply: tid=0 2024-05-09T00:10:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3dab37b80 1 client.17721 shutdown 2024-05-09T00:10:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1798223209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a2950 msgr2=0x564acb6a6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a2950 0x564acb6a6550 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fa3b000f410 tx=0x7fa3b000f7d0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1798223209 shutdown_connections 2024-05-09T00:10:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564acb6b6c40 0x564acb6b9060 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a3270 0x564acb6a6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 0x564acb6a9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/1798223209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a2950 0x564acb6a6550 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3a77fe700 0 client.17721 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1798223209 >> 172.21.15.81:0/1798223209 conn(0x564acb5fb1b0 msgr2=0x564acb69bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1798223209 shutdown_connections 2024-05-09T00:10:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1798223209 wait complete. 2024-05-09T00:10:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.591+0000 7fa3dab37b80 20 client.17721 trim_cache size 0 max 16384 2024-05-09T00:10:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.606+0000 7fa3dab37b80 1 Processor -- start 2024-05-09T00:10:52.607 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.606+0000 7fa3dab37b80 1 -- start start 2024-05-09T00:10:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.606+0000 7fa3dab37b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb69d480 0x564acb697910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.606+0000 7fa3dab37b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a2950 0x564acb699540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.606+0000 7fa3dab37b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb6a3270 0x564acb6adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.606+0000 7fa3dab37b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acb69d2e0 con 0x564acb69d480 2024-05-09T00:10:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.606+0000 7fa3dab37b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acb698330 con 0x564acb6a2950 2024-05-09T00:10:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.606+0000 7fa3dab37b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acb6be250 con 0x564acb6a3270 2024-05-09T00:10:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.607+0000 7fa3c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb69d480 0x564acb697910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.607+0000 7fa3c7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb69d480 0x564acb697910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60096/0 (socket says 172.21.15.81:60096) 2024-05-09T00:10:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.607+0000 7fa3c7fff700 1 -- 172.21.15.81:0/3037795315 learned_addr learned my addr 172.21.15.81:0/3037795315 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.607+0000 7fa3c7fff700 1 -- 172.21.15.81:0/3037795315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb6a3270 msgr2=0x564acb6adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.607+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/3037795315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb6a3270 0x564acb6adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.607+0000 7fa3c7fff700 1 -- 172.21.15.81:0/3037795315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a2950 msgr2=0x564acb699540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:52.608 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.607+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/3037795315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a2950 0x564acb699540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.607+0000 7fa3c7fff700 1 -- 172.21.15.81:0/3037795315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564acb5b3500 con 0x564acb69d480 2024-05-09T00:10:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.607+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/3037795315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb69d480 0x564acb697910 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800f5e0 tx=0x7fa3b800f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29371c649d765020 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.607+0000 7fa3beffd700 1 -- 172.21.15.81:0/3037795315 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b801d070 con 0x564acb69d480 2024-05-09T00:10:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.607+0000 7fa3beffd700 1 -- 172.21.15.81:0/3037795315 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3b802b040 con 0x564acb69d480 2024-05-09T00:10:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.607+0000 7fa3beffd700 1 -- 172.21.15.81:0/3037795315 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b802a040 con 0x564acb69d480 2024-05-09T00:10:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 -- 172.21.15.81:0/3037795315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb69d480 msgr2=0x564acb697910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/3037795315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb69d480 0x564acb697910 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800f5e0 tx=0x7fa3b800f460 comp rx=0 tx=0).stop 2024-05-09T00:10:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 -- 172.21.15.81:0/3037795315 shutdown_connections 2024-05-09T00:10:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/3037795315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb6a3270 0x564acb6adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/3037795315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb69d480 0x564acb697910 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/3037795315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a2950 0x564acb699540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 -- 172.21.15.81:0/3037795315 >> 172.21.15.81:0/3037795315 conn(0x564acb5fb1b0 msgr2=0x564acb6b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:52.609 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 -- 172.21.15.81:0/3037795315 shutdown_connections 2024-05-09T00:10:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 -- 172.21.15.81:0/3037795315 wait complete. 2024-05-09T00:10:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 -- start start 2024-05-09T00:10:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 Processor -- start 2024-05-09T00:10:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 0x564acb6adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a2950 0x564acb6abb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a3270 0x564acb6ac170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acb6ac880 con 0x564acb6a3270 2024-05-09T00:10:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acb6ac9f0 con 0x564acb6a2950 2024-05-09T00:10:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.608+0000 7fa3dab37b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564acb70c170 con 0x564acb69d480 2024-05-09T00:10:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3dab37b80 10 client.0 _ll_register_callbacks cb 0x564acb592ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:10:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3ccf1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a3270 0x564acb6ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3ccf1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a3270 0x564acb6ac170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60104/0 (socket says 172.21.15.81:60104) 2024-05-09T00:10:52.610 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3ccf1a700 1 -- 172.21.15.81:0/1521051679 learned_addr learned my addr 172.21.15.81:0/1521051679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:10:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/1521051679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 0x564acb6adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3c77fe700 1 --2- 172.21.15.81:0/1521051679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a2950 0x564acb6abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3ccf1a700 1 -- 172.21.15.81:0/1521051679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 msgr2=0x564acb6adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3ccf1a700 1 --2- 172.21.15.81:0/1521051679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 0x564acb6adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3ccf1a700 1 -- 172.21.15.81:0/1521051679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a2950 msgr2=0x564acb6abb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:10:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3ccf1a700 1 --2- 172.21.15.81:0/1521051679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a2950 0x564acb6abb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3ccf1a700 1 -- 172.21.15.81:0/1521051679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564acb46e350 con 0x564acb6a3270 2024-05-09T00:10:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3ccf1a700 1 --2- 172.21.15.81:0/1521051679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a3270 0x564acb6ac170 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000c730 tx=0x7fa3c0098e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397d126f9e9762a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:10:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3a77fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:10:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3a77fe700 1 -- 172.21.15.81:0/1521051679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c009d170 con 0x564acb6a3270 2024-05-09T00:10:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3a77fe700 1 -- 172.21.15.81:0/1521051679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fa3c009d330 con 0x564acb6a3270 2024-05-09T00:10:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1521051679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa3b8003c50 con 0x564acb6a3270 2024-05-09T00:10:52.611 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3a77fe700 1 -- 172.21.15.81:0/1521051679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3c00a18f0 con 0x564acb6a3270 2024-05-09T00:10:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3dab37b80 10 client.17727 fetch_fsmap learned FSMap version 26 2024-05-09T00:10:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1521051679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564acb472c70 con 0x564acb6a3270 2024-05-09T00:10:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.609+0000 7fa3a77fe700 1 -- 172.21.15.81:0/1521051679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3c0064080 con 0x564acb6a3270 2024-05-09T00:10:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.610+0000 7fa3a77fe700 1 -- 172.21.15.81:0/1521051679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa3c00a1460 con 0x564acb6a3270 2024-05-09T00:10:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.610+0000 7fa3dab37b80 10 client.17727 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:10:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.610+0000 7fa3dab37b80 10 client.17727 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:10:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.610+0000 7fa3dab37b80 20 client.17727 populate_metadata read hostname 'smithi081' 2024-05-09T00:10:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.610+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/1521051679 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564acb70d7e0 0x564acb70fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:10:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.610+0000 7fa3dab37b80 4 client.17727 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:10:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.610+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1521051679 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564acb5e5e60 con 0x564acb70d7e0 2024-05-09T00:10:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.610+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/1521051679 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564acb70d7e0 0x564acb70fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:10:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.610+0000 7fa3c7fff700 1 --2- 172.21.15.81:0/1521051679 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564acb70d7e0 0x564acb70fc00 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ea3e18657c8be1d server_cookie=8d85a77ecd5ac46c in_seq=0 out_seq=0 2024-05-09T00:10:52.612 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.610+0000 7fa3a77fe700 10 client.17727 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.624+0000 7fa3a77fe700 1 -- 172.21.15.81:0/1521051679 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564acb5e5e60 con 0x564acb70d7e0 2024-05-09T00:10:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.624+0000 7fa3a77fe700 10 client.17727 handle_command_reply: tid=0 2024-05-09T00:10:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.624+0000 7fa3dab37b80 1 client.17727 shutdown 2024-05-09T00:10:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.624+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1521051679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a3270 msgr2=0x564acb6ac170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.624+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/1521051679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a3270 0x564acb6ac170 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000c730 tx=0x7fa3c0098e60 comp rx=0 tx=0).stop 2024-05-09T00:10:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.624+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1521051679 shutdown_connections 2024-05-09T00:10:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.624+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/1521051679 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564acb70d7e0 0x564acb70fc00 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.624+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/1521051679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564acb6a3270 0x564acb6ac170 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.624+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/1521051679 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564acb69d480 0x564acb6adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.624+0000 7fa3dab37b80 1 --2- 172.21.15.81:0/1521051679 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564acb6a2950 0x564acb6abb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.624+0000 7fa3a77fe700 0 client.17727 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:10:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1521051679 >> 172.21.15.81:0/1521051679 conn(0x564acb5fb1b0 msgr2=0x564acb6b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1521051679 shutdown_connections 2024-05-09T00:10:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3dab37b80 1 -- 172.21.15.81:0/1521051679 wait complete. 2024-05-09T00:10:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3dab37b80 20 client.17727 trim_cache size 0 max 16384 2024-05-09T00:10:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:10:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:10:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:10:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:10:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3ce97d700 1 -- 172.21.15.81:0/2259030523 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3b40a1290 msgr2=0x7fa3b40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3ce97d700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3b40a1290 0x7fa3b40a3750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8006010 tx=0x7fa3b801a040 comp rx=0 tx=0).stop 2024-05-09T00:10:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3ce97d700 1 -- 172.21.15.81:0/2259030523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3c810b4e0 msgr2=0x7fa3c819bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:10:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3ce97d700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3c810b4e0 0x7fa3c819bbb0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000ada0 tx=0x7fa3c000c330 comp rx=0 tx=0).stop 2024-05-09T00:10:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3ce97d700 1 -- 172.21.15.81:0/2259030523 shutdown_connections 2024-05-09T00:10:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3ce97d700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa3b40a1290 0x7fa3b40a3750 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3ce97d700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3c810b4e0 0x7fa3c819bbb0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3ce97d700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3c8102110 0x7fa3c81972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3ce97d700 1 --2- 172.21.15.81:0/2259030523 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3c8102a30 0x7fa3c8197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:10:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3ce97d700 1 -- 172.21.15.81:0/2259030523 >> 172.21.15.81:0/2259030523 conn(0x7fa3c80fb870 msgr2=0x7fa3c80fc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:10:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3ce97d700 1 -- 172.21.15.81:0/2259030523 shutdown_connections 2024-05-09T00:10:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:10:52.625+0000 7fa3ce97d700 1 -- 172.21.15.81:0/2259030523 wait complete. 2024-05-09T00:10:54.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:54 smithi081 ceph-mon[42474]: pgmap v243: 97 pgs: 97 active+clean; 5.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-05-09T00:10:54.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:54 smithi150 ceph-mon[46187]: pgmap v243: 97 pgs: 97 active+clean; 5.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-05-09T00:10:54.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:54 smithi171 ceph-mon[47351]: pgmap v243: 97 pgs: 97 active+clean; 5.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 KiB/s wr, 10 op/s 2024-05-09T00:10:56.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:56 smithi081 ceph-mon[42474]: pgmap v244: 97 pgs: 97 active+clean; 5.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 58 KiB/s wr, 18 op/s 2024-05-09T00:10:56.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:56 smithi150 ceph-mon[46187]: pgmap v244: 97 pgs: 97 active+clean; 5.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 58 KiB/s wr, 18 op/s 2024-05-09T00:10:56.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:56 smithi171 ceph-mon[47351]: pgmap v244: 97 pgs: 97 active+clean; 5.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 58 KiB/s wr, 18 op/s 2024-05-09T00:10:58.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:10:58 smithi081 ceph-mon[42474]: pgmap v245: 97 pgs: 97 active+clean; 5.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:10:58.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:10:58 smithi150 ceph-mon[46187]: pgmap v245: 97 pgs: 97 active+clean; 5.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:10:58.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:10:58 smithi171 ceph-mon[47351]: pgmap v245: 97 pgs: 97 active+clean; 5.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:11:00.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:00 smithi081 ceph-mon[42474]: pgmap v246: 97 pgs: 97 active+clean; 5.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:11:00.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:00 smithi150 ceph-mon[46187]: pgmap v246: 97 pgs: 97 active+clean; 5.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:11:00.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:00 smithi171 ceph-mon[47351]: pgmap v246: 97 pgs: 97 active+clean; 5.3 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:11:02.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:02 smithi081 ceph-mon[42474]: pgmap v247: 97 pgs: 97 active+clean; 5.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-05-09T00:11:02.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:02 smithi150 ceph-mon[46187]: pgmap v247: 97 pgs: 97 active+clean; 5.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-05-09T00:11:02.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:02 smithi171 ceph-mon[47351]: pgmap v247: 97 pgs: 97 active+clean; 5.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-05-09T00:11:04.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:04 smithi081 ceph-mon[42474]: pgmap v248: 97 pgs: 97 active+clean; 5.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-05-09T00:11:04.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:04 smithi150 ceph-mon[46187]: pgmap v248: 97 pgs: 97 active+clean; 5.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-05-09T00:11:04.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:04 smithi171 ceph-mon[47351]: pgmap v248: 97 pgs: 97 active+clean; 5.5 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-05-09T00:11:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.744+0000 7f30afd05700 1 -- 172.21.15.81:0/2985395511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a8100280 msgr2=0x7f30a8100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.744+0000 7f30afd05700 1 --2- 172.21.15.81:0/2985395511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a8100280 0x7f30a8100700 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f3098009990 tx=0x7f3098009ca0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.744+0000 7f30afd05700 1 -- 172.21.15.81:0/2985395511 shutdown_connections 2024-05-09T00:11:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.744+0000 7f30afd05700 1 --2- 172.21.15.81:0/2985395511 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a8105f20 0x7f30a8106300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.744+0000 7f30afd05700 1 --2- 172.21.15.81:0/2985395511 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a8100c40 0x7f30a810cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.744+0000 7f30afd05700 1 --2- 172.21.15.81:0/2985395511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a8100280 0x7f30a8100700 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.744+0000 7f30afd05700 1 -- 172.21.15.81:0/2985395511 >> 172.21.15.81:0/2985395511 conn(0x7f30a8076bc0 msgr2=0x7f30a8076fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.744+0000 7f30afd05700 1 -- 172.21.15.81:0/2985395511 shutdown_connections 2024-05-09T00:11:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.744+0000 7f30afd05700 1 -- 172.21.15.81:0/2985395511 wait complete. 2024-05-09T00:11:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.744+0000 7f30afd05700 1 Processor -- start 2024-05-09T00:11:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30afd05700 1 -- start start 2024-05-09T00:11:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30afd05700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a8100280 0x7f30a8198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30afd05700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a8100c40 0x7f30a81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30afd05700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a8105f20 0x7f30a81a30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30afd05700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a8198df0 con 0x7f30a8100c40 2024-05-09T00:11:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30afd05700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a81a3620 con 0x7f30a8105f20 2024-05-09T00:11:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30afd05700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a81a3760 con 0x7f30a8100280 2024-05-09T00:11:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30ad2a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a8100c40 0x7f30a81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30ad2a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a8100c40 0x7f30a81985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57970/0 (socket says 172.21.15.81:57970) 2024-05-09T00:11:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30ad2a0700 1 -- 172.21.15.81:0/4035284361 learned_addr learned my addr 172.21.15.81:0/4035284361 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30adaa1700 1 --2- 172.21.15.81:0/4035284361 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a8100280 0x7f30a8198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30ae2a2700 1 --2- 172.21.15.81:0/4035284361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a8105f20 0x7f30a81a30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30ad2a0700 1 -- 172.21.15.81:0/4035284361 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a8100280 msgr2=0x7f30a8198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30ad2a0700 1 --2- 172.21.15.81:0/4035284361 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a8100280 0x7f30a8198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30ad2a0700 1 -- 172.21.15.81:0/4035284361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a8105f20 msgr2=0x7f30a81a30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30ad2a0700 1 --2- 172.21.15.81:0/4035284361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a8105f20 0x7f30a81a30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30ad2a0700 1 -- 172.21.15.81:0/4035284361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980095f0 con 0x7f30a8100c40 2024-05-09T00:11:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.745+0000 7f30ad2a0700 1 --2- 172.21.15.81:0/4035284361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a8100c40 0x7f30a81985a0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f309800f670 tx=0x7f309800f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.746+0000 7f309effd700 1 -- 172.21.15.81:0/4035284361 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309801d070 con 0x7f30a8100c40 2024-05-09T00:11:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.746+0000 7f309effd700 1 -- 172.21.15.81:0/4035284361 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3098005050 con 0x7f30a8100c40 2024-05-09T00:11:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.746+0000 7f30afd05700 1 -- 172.21.15.81:0/4035284361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a81a3960 con 0x7f30a8100c40 2024-05-09T00:11:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.746+0000 7f309effd700 1 -- 172.21.15.81:0/4035284361 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3098004a80 con 0x7f30a8100c40 2024-05-09T00:11:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.746+0000 7f30afd05700 1 -- 172.21.15.81:0/4035284361 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a81a3e60 con 0x7f30a8100c40 2024-05-09T00:11:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.748+0000 7f309effd700 1 -- 172.21.15.81:0/4035284361 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f3098005430 con 0x7f30a8100c40 2024-05-09T00:11:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.749+0000 7f309effd700 1 --2- 172.21.15.81:0/4035284361 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f30940a1310 0x7f30940a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.749+0000 7f309effd700 1 -- 172.21.15.81:0/4035284361 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f30980cd9b0 con 0x7f30a8100c40 2024-05-09T00:11:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.749+0000 7f30adaa1700 1 --2- 172.21.15.81:0/4035284361 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f30940a1310 0x7f30940a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.749+0000 7f30adaa1700 1 --2- 172.21.15.81:0/4035284361 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f30940a1310 0x7f30940a37d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f30a4007be0 tx=0x7f30a40073d0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30bbebfb80 1 Processor -- start 2024-05-09T00:11:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30bbebfb80 1 -- start start 2024-05-09T00:11:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30bbebfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711e950 0x5565f711ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30bbebfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711f270 0x5565f7118f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30bbebfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f7119480 0x5565f71198a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.755 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30bbebfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f70700f0 con 0x5565f711f270 2024-05-09T00:11:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30bbebfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f706dab0 con 0x5565f7119480 2024-05-09T00:11:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30bbebfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f70693a0 con 0x5565f711e950 2024-05-09T00:11:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30ad2a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711f270 0x5565f7118f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30ad2a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711f270 0x5565f7118f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57974/0 (socket says 172.21.15.81:57974) 2024-05-09T00:11:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30ad2a0700 1 -- 172.21.15.81:0/419714607 learned_addr learned my addr 172.21.15.81:0/419714607 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30ae2a2700 1 --2- 172.21.15.81:0/419714607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f7119480 0x5565f71198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30adaa1700 1 --2- 172.21.15.81:0/419714607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711e950 0x5565f711ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30ad2a0700 1 -- 172.21.15.81:0/419714607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711e950 msgr2=0x5565f711ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30ad2a0700 1 --2- 172.21.15.81:0/419714607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711e950 0x5565f711ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30ad2a0700 1 -- 172.21.15.81:0/419714607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f7119480 msgr2=0x5565f71198a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30ad2a0700 1 --2- 172.21.15.81:0/419714607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f7119480 0x5565f71198a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.750+0000 7f30ad2a0700 1 -- 172.21.15.81:0/419714607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565f6eea350 con 0x5565f711f270 2024-05-09T00:11:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.751+0000 7f30ad2a0700 1 --2- 172.21.15.81:0/419714607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711f270 0x5565f7118f40 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f30980a29b0 tx=0x7f309809a520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d269e3cf024bd40 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:05.756 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.751+0000 7f3093fff700 1 -- 172.21.15.81:0/419714607 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309809e920 con 0x5565f711f270 2024-05-09T00:11:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.751+0000 7f3093fff700 1 -- 172.21.15.81:0/419714607 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30980a2ee0 con 0x5565f711f270 2024-05-09T00:11:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.751+0000 7f3093fff700 1 -- 172.21.15.81:0/419714607 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3098004e40 con 0x5565f711f270 2024-05-09T00:11:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.752+0000 7f30bbebfb80 1 -- 172.21.15.81:0/419714607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711f270 msgr2=0x5565f7118f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.752+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/419714607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711f270 0x5565f7118f40 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f30980a29b0 tx=0x7f309809a520 comp rx=0 tx=0).stop 2024-05-09T00:11:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.752+0000 7f30bbebfb80 1 -- 172.21.15.81:0/419714607 shutdown_connections 2024-05-09T00:11:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.752+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/419714607 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f7119480 0x5565f71198a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.752+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/419714607 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711e950 0x5565f711ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.752+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/419714607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711f270 0x5565f7118f40 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.752+0000 7f30bbebfb80 1 -- 172.21.15.81:0/419714607 >> 172.21.15.81:0/419714607 conn(0x5565f70771b0 msgr2=0x5565f7113840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.752+0000 7f30bbebfb80 1 -- 172.21.15.81:0/419714607 shutdown_connections 2024-05-09T00:11:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.752+0000 7f30bbebfb80 1 -- 172.21.15.81:0/419714607 wait complete. 2024-05-09T00:11:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.752+0000 7f30bbebfb80 1 -- start start 2024-05-09T00:11:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.752+0000 7f30bbebfb80 1 Processor -- start 2024-05-09T00:11:05.757 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30bbebfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f7119480 0x5565f7125250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30bbebfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711e950 0x5565f71225e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30bbebfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711f270 0x5565f7122d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30bbebfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f7005500 con 0x5565f711e950 2024-05-09T00:11:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30bbebfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f70051a0 con 0x5565f7119480 2024-05-09T00:11:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30bbebfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f6eec640 con 0x5565f711f270 2024-05-09T00:11:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30bbebfb80 10 client.0 _ll_register_callbacks cb 0x5565f700ead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30ad2a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711e950 0x5565f71225e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30ad2a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711e950 0x5565f71225e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57980/0 (socket says 172.21.15.81:57980) 2024-05-09T00:11:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30adaa1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f7119480 0x5565f7125250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30ad2a0700 1 -- 172.21.15.81:0/635963382 learned_addr learned my addr 172.21.15.81:0/635963382 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30ae2a2700 1 --2- 172.21.15.81:0/635963382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711f270 0x5565f7122d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:05.758 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30ad2a0700 1 -- 172.21.15.81:0/635963382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711f270 msgr2=0x5565f7122d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30ad2a0700 1 --2- 172.21.15.81:0/635963382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711f270 0x5565f7122d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30ad2a0700 1 -- 172.21.15.81:0/635963382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f7119480 msgr2=0x5565f7125250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30ad2a0700 1 --2- 172.21.15.81:0/635963382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f7119480 0x5565f7125250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30ad2a0700 1 -- 172.21.15.81:0/635963382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a81a3e60 con 0x5565f711e950 2024-05-09T00:11:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30ad2a0700 1 --2- 172.21.15.81:0/635963382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711e950 0x5565f71225e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f3098023000 tx=0x7f3098009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd1daef8db38e92 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.753+0000 7f30917fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30917fa700 1 -- 172.21.15.81:0/635963382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3098004de0 con 0x5565f711e950 2024-05-09T00:11:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30917fa700 1 -- 172.21.15.81:0/635963382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f309809ad50 con 0x5565f711e950 2024-05-09T00:11:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30bbebfb80 1 -- 172.21.15.81:0/635963382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5565f6fc2210 con 0x5565f711e950 2024-05-09T00:11:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30917fa700 1 -- 172.21.15.81:0/635963382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f309809af90 con 0x5565f711e950 2024-05-09T00:11:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30bbebfb80 10 client.17739 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30bbebfb80 1 -- 172.21.15.81:0/635963382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5565f6e96b00 con 0x5565f711e950 2024-05-09T00:11:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30917fa700 1 -- 172.21.15.81:0/635963382 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5565f6fc2210 con 0x5565f711e950 2024-05-09T00:11:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30917fa700 1 -- 172.21.15.81:0/635963382 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f30980b3120 con 0x5565f711e950 2024-05-09T00:11:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30bbebfb80 10 client.17739 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30bbebfb80 10 client.17739 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30bbebfb80 20 client.17739 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/635963382 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5565f71323d0 0x5565f71347c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30bbebfb80 4 client.17739 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30bbebfb80 1 -- 172.21.15.81:0/635963382 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5565f70e87b0 con 0x5565f71323d0 2024-05-09T00:11:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.754+0000 7f30adaa1700 1 --2- 172.21.15.81:0/635963382 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5565f71323d0 0x5565f71347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.755+0000 7f30917fa700 10 client.17739 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.755+0000 7f30adaa1700 1 --2- 172.21.15.81:0/635963382 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5565f71323d0 0x5565f71347c0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=189a542c95af7540 server_cookie=1c0f7d7189abb5be in_seq=0 out_seq=0 2024-05-09T00:11:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.755+0000 7f30917fa700 1 -- 172.21.15.81:0/635963382 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5565f70e87b0 con 0x5565f71323d0 2024-05-09T00:11:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.755+0000 7f30917fa700 10 client.17739 handle_command_reply: tid=0 2024-05-09T00:11:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.755+0000 7f30bbebfb80 1 client.17739 shutdown 2024-05-09T00:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.756+0000 7f30bbebfb80 1 -- 172.21.15.81:0/635963382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711e950 msgr2=0x5565f71225e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.756+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/635963382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711e950 0x5565f71225e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f3098023000 tx=0x7f3098009ca0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.756+0000 7f30bbebfb80 1 -- 172.21.15.81:0/635963382 shutdown_connections 2024-05-09T00:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.756+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/635963382 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5565f71323d0 0x5565f71347c0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.756+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/635963382 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f7119480 0x5565f7125250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.756+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/635963382 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711f270 0x5565f7122d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.756+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/635963382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711e950 0x5565f71225e0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.756+0000 7f30917fa700 0 client.17739 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.756+0000 7f30bbebfb80 1 -- 172.21.15.81:0/635963382 >> 172.21.15.81:0/635963382 conn(0x5565f70771b0 msgr2=0x5565f711d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.756+0000 7f30bbebfb80 1 -- 172.21.15.81:0/635963382 shutdown_connections 2024-05-09T00:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.756+0000 7f30bbebfb80 1 -- 172.21.15.81:0/635963382 wait complete. 2024-05-09T00:11:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.756+0000 7f30bbebfb80 20 client.17739 trim_cache size 0 max 16384 2024-05-09T00:11:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.771+0000 7f30bbebfb80 1 Processor -- start 2024-05-09T00:11:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.771+0000 7f30bbebfb80 1 -- start start 2024-05-09T00:11:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.771+0000 7f30bbebfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f7119480 0x5565f7122580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f30bbebfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711e950 0x5565f7113910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f30bbebfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711f270 0x5565f71154d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f30bbebfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f7115320 con 0x5565f711e950 2024-05-09T00:11:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f30bbebfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f7123b40 con 0x5565f7119480 2024-05-09T00:11:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f30bbebfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f71150f0 con 0x5565f711f270 2024-05-09T00:11:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f30ad2a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711e950 0x5565f7113910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f30ad2a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711e950 0x5565f7113910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57984/0 (socket says 172.21.15.81:57984) 2024-05-09T00:11:05.770 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f30ad2a0700 1 -- 172.21.15.81:0/2271834971 learned_addr learned my addr 172.21.15.81:0/2271834971 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f30ad2a0700 1 -- 172.21.15.81:0/2271834971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711f270 msgr2=0x5565f71154d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f30ad2a0700 1 --2- 172.21.15.81:0/2271834971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711f270 0x5565f71154d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f30ad2a0700 1 -- 172.21.15.81:0/2271834971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f7119480 msgr2=0x5565f7122580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f30ad2a0700 1 --2- 172.21.15.81:0/2271834971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f7119480 0x5565f7122580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f30ad2a0700 1 -- 172.21.15.81:0/2271834971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565f702f500 con 0x5565f711e950 2024-05-09T00:11:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f30ad2a0700 1 --2- 172.21.15.81:0/2271834971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711e950 0x5565f7113910 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f309809a7f0 tx=0x7f30980990a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1accf0e29ebbdab server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f309cff9700 1 -- 172.21.15.81:0/2271834971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3098004be0 con 0x5565f711e950 2024-05-09T00:11:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f309cff9700 1 -- 172.21.15.81:0/2271834971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3098004d40 con 0x5565f711e950 2024-05-09T00:11:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.772+0000 7f309cff9700 1 -- 172.21.15.81:0/2271834971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309809ad50 con 0x5565f711e950 2024-05-09T00:11:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.773+0000 7f30bbebfb80 1 -- 172.21.15.81:0/2271834971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711e950 msgr2=0x5565f7113910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.773+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/2271834971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711e950 0x5565f7113910 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f309809a7f0 tx=0x7f30980990a0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.773+0000 7f30bbebfb80 1 -- 172.21.15.81:0/2271834971 shutdown_connections 2024-05-09T00:11:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.773+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/2271834971 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f7119480 0x5565f7122580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.773+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/2271834971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711f270 0x5565f71154d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.773+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/2271834971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f711e950 0x5565f7113910 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.773+0000 7f30bbebfb80 1 -- 172.21.15.81:0/2271834971 >> 172.21.15.81:0/2271834971 conn(0x5565f70771b0 msgr2=0x5565f7121e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.773+0000 7f30bbebfb80 1 -- 172.21.15.81:0/2271834971 shutdown_connections 2024-05-09T00:11:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.773+0000 7f30bbebfb80 1 -- 172.21.15.81:0/2271834971 wait complete. 2024-05-09T00:11:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.773+0000 7f30bbebfb80 1 -- start start 2024-05-09T00:11:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.773+0000 7f30bbebfb80 1 Processor -- start 2024-05-09T00:11:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30bbebfb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f7119480 0x5565f7180a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30bbebfb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711e950 0x5565f7180f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30bbebfb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f711f270 0x5565f718b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30bbebfb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f7181660 con 0x5565f7119480 2024-05-09T00:11:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30bbebfb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f718bde0 con 0x5565f711f270 2024-05-09T00:11:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30bbebfb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565f718bf50 con 0x5565f711e950 2024-05-09T00:11:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30bbebfb80 10 client.0 _ll_register_callbacks cb 0x5565f700ead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30adaa1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f7119480 0x5565f7180a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30adaa1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f7119480 0x5565f7180a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57990/0 (socket says 172.21.15.81:57990) 2024-05-09T00:11:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30adaa1700 1 -- 172.21.15.81:0/1937715597 learned_addr learned my addr 172.21.15.81:0/1937715597 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:05.775 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30adaa1700 1 -- 172.21.15.81:0/1937715597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711e950 msgr2=0x5565f7180f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30adaa1700 1 --2- 172.21.15.81:0/1937715597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711e950 0x5565f7180f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30adaa1700 1 -- 172.21.15.81:0/1937715597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f711f270 msgr2=0x5565f718b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30adaa1700 1 --2- 172.21.15.81:0/1937715597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f711f270 0x5565f718b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30adaa1700 1 -- 172.21.15.81:0/1937715597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5565f6e96b00 con 0x5565f7119480 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30adaa1700 1 --2- 172.21.15.81:0/1937715597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f7119480 0x5565f7180a10 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f30a4007920 tx=0x7f30a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb128d4671def6e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30917fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30917fa700 1 -- 172.21.15.81:0/1937715597 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a4027070 con 0x5565f7119480 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30917fa700 1 -- 172.21.15.81:0/1937715597 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8616+0+0 (secure 0 0 0) 0x7f30a402c030 con 0x5565f7119480 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30bbebfb80 1 -- 172.21.15.81:0/1937715597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f30980a2ee0 con 0x5565f7119480 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30917fa700 1 -- 172.21.15.81:0/1937715597 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30a4003880 con 0x5565f7119480 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30bbebfb80 10 client.17745 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.774+0000 7f30bbebfb80 1 -- 172.21.15.81:0/1937715597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5565f6eeec70 con 0x5565f7119480 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.775+0000 7f30917fa700 1 -- 172.21.15.81:0/1937715597 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30980a2ee0 con 0x5565f7119480 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.775+0000 7f30917fa700 1 -- 172.21.15.81:0/1937715597 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f30a4011bd0 con 0x5565f7119480 2024-05-09T00:11:05.776 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.775+0000 7f30bbebfb80 10 client.17745 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:05.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.775+0000 7f30bbebfb80 10 client.17745 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:05.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.775+0000 7f30bbebfb80 20 client.17745 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:05.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.775+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/1937715597 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5565f718d890 0x5565f718fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:05.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.775+0000 7f30bbebfb80 4 client.17745 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:11:05.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.775+0000 7f30bbebfb80 1 -- 172.21.15.81:0/1937715597 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5565f7061e60 con 0x5565f718d890 2024-05-09T00:11:05.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.775+0000 7f30ad2a0700 1 --2- 172.21.15.81:0/1937715597 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5565f718d890 0x5565f718fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:05.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.775+0000 7f30917fa700 10 client.17745 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:05.777 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.775+0000 7f30ad2a0700 1 --2- 172.21.15.81:0/1937715597 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5565f718d890 0x5565f718fcb0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281292a516697f19 server_cookie=f31bcfba015a0545 in_seq=0 out_seq=0 2024-05-09T00:11:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30917fa700 1 -- 172.21.15.81:0/1937715597 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5565f7061e60 con 0x5565f718d890 2024-05-09T00:11:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30917fa700 10 client.17745 handle_command_reply: tid=0 2024-05-09T00:11:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30bbebfb80 1 client.17745 shutdown 2024-05-09T00:11:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30bbebfb80 1 -- 172.21.15.81:0/1937715597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f7119480 msgr2=0x5565f7180a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/1937715597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f7119480 0x5565f7180a10 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f30a4007920 tx=0x7f30a4004750 comp rx=0 tx=0).stop 2024-05-09T00:11:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30bbebfb80 1 -- 172.21.15.81:0/1937715597 shutdown_connections 2024-05-09T00:11:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/1937715597 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5565f718d890 0x5565f718fcb0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/1937715597 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5565f711f270 0x5565f718b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30917fa700 0 client.17745 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/1937715597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565f7119480 0x5565f7180a10 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30bbebfb80 1 --2- 172.21.15.81:0/1937715597 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5565f711e950 0x5565f7180f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30bbebfb80 1 -- 172.21.15.81:0/1937715597 >> 172.21.15.81:0/1937715597 conn(0x5565f70771b0 msgr2=0x5565f7118620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30bbebfb80 1 -- 172.21.15.81:0/1937715597 shutdown_connections 2024-05-09T00:11:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30bbebfb80 1 -- 172.21.15.81:0/1937715597 wait complete. 2024-05-09T00:11:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.789+0000 7f30bbebfb80 20 client.17745 trim_cache size 0 max 16384 2024-05-09T00:11:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:11:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:11:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:11:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:11:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.790+0000 7f30afd05700 1 -- 172.21.15.81:0/4035284361 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f30940a1310 msgr2=0x7f30940a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.790+0000 7f30afd05700 1 --2- 172.21.15.81:0/4035284361 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f30940a1310 0x7f30940a37d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f30a4007be0 tx=0x7f30a40073d0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.790+0000 7f30afd05700 1 -- 172.21.15.81:0/4035284361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a8100c40 msgr2=0x7f30a81985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.790+0000 7f30afd05700 1 --2- 172.21.15.81:0/4035284361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a8100c40 0x7f30a81985a0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f309800f670 tx=0x7f309800f6a0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.790+0000 7f30afd05700 1 -- 172.21.15.81:0/4035284361 shutdown_connections 2024-05-09T00:11:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.790+0000 7f30afd05700 1 --2- 172.21.15.81:0/4035284361 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f30940a1310 0x7f30940a37d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.790+0000 7f30afd05700 1 --2- 172.21.15.81:0/4035284361 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f30a8105f20 0x7f30a81a30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.790+0000 7f30afd05700 1 --2- 172.21.15.81:0/4035284361 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30a8100280 0x7f30a8198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.790+0000 7f30afd05700 1 --2- 172.21.15.81:0/4035284361 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30a8100c40 0x7f30a81985a0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.790+0000 7f30afd05700 1 -- 172.21.15.81:0/4035284361 >> 172.21.15.81:0/4035284361 conn(0x7f30a8076bc0 msgr2=0x7f30a80feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.790+0000 7f30afd05700 1 -- 172.21.15.81:0/4035284361 shutdown_connections 2024-05-09T00:11:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:05.790+0000 7f30afd05700 1 -- 172.21.15.81:0/4035284361 wait complete. 2024-05-09T00:11:06.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:06 smithi081 ceph-mon[42474]: pgmap v249: 97 pgs: 97 active+clean; 5.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:11:06.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:06 smithi081 ceph-mon[42474]: osdmap e86: 12 total, 12 up, 12 in 2024-05-09T00:11:06.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:06 smithi150 ceph-mon[46187]: pgmap v249: 97 pgs: 97 active+clean; 5.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:11:06.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:06 smithi150 ceph-mon[46187]: osdmap e86: 12 total, 12 up, 12 in 2024-05-09T00:11:06.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:06 smithi171 ceph-mon[47351]: pgmap v249: 97 pgs: 97 active+clean; 5.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:11:06.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:06 smithi171 ceph-mon[47351]: osdmap e86: 12 total, 12 up, 12 in 2024-05-09T00:11:08.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:08 smithi081 ceph-mon[42474]: pgmap v251: 97 pgs: 97 active+clean; 5.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 101 KiB/s wr, 33 op/s 2024-05-09T00:11:08.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:08 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:11:08.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:08 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:11:08.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:08 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:11:08.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:08 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:11:08.516 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:08 smithi150 ceph-mon[46187]: pgmap v251: 97 pgs: 97 active+clean; 5.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 101 KiB/s wr, 33 op/s 2024-05-09T00:11:08.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:08 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:11:08.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:08 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:11:08.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:08 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:11:08.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:08 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:11:08.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:08 smithi171 ceph-mon[47351]: pgmap v251: 97 pgs: 97 active+clean; 5.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 101 KiB/s wr, 33 op/s 2024-05-09T00:11:08.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:08 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:11:08.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:08 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:11:08.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:08 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:11:08.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:08 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:11:10.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:10 smithi081 ceph-mon[42474]: pgmap v252: 97 pgs: 97 active+clean; 5.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 101 KiB/s wr, 33 op/s 2024-05-09T00:11:10.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:10 smithi150 ceph-mon[46187]: pgmap v252: 97 pgs: 97 active+clean; 5.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 101 KiB/s wr, 33 op/s 2024-05-09T00:11:10.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:10 smithi171 ceph-mon[47351]: pgmap v252: 97 pgs: 97 active+clean; 5.7 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 101 KiB/s wr, 33 op/s 2024-05-09T00:11:12.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:12 smithi081 ceph-mon[42474]: pgmap v253: 97 pgs: 97 active+clean; 2.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 107 KiB/s wr, 36 op/s 2024-05-09T00:11:12.517 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:12 smithi150 ceph-mon[46187]: pgmap v253: 97 pgs: 97 active+clean; 2.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 107 KiB/s wr, 36 op/s 2024-05-09T00:11:12.555 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:12 smithi171 ceph-mon[47351]: pgmap v253: 97 pgs: 97 active+clean; 2.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 107 KiB/s wr, 36 op/s 2024-05-09T00:11:13.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:11:13.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.581+0000 7f4a9062a700 1 -- 172.21.15.81:0/3582163967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a88101b10 msgr2=0x7f4a88105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.581+0000 7f4a9062a700 1 --2- 172.21.15.81:0/3582163967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a88101b10 0x7f4a88105b50 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009990 tx=0x7f4a78009ca0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.581+0000 7f4a9062a700 1 -- 172.21.15.81:0/3582163967 shutdown_connections 2024-05-09T00:11:13.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.581+0000 7f4a9062a700 1 --2- 172.21.15.81:0/3582163967 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a88101160 0x7f4a88101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.581+0000 7f4a9062a700 1 --2- 172.21.15.81:0/3582163967 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a88106280 0x7f4a8810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.581+0000 7f4a9062a700 1 --2- 172.21.15.81:0/3582163967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a88101b10 0x7f4a88105b50 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.581+0000 7f4a9062a700 1 -- 172.21.15.81:0/3582163967 >> 172.21.15.81:0/3582163967 conn(0x7f4a880fc9c0 msgr2=0x7f4a880fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:13.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.581+0000 7f4a9062a700 1 -- 172.21.15.81:0/3582163967 shutdown_connections 2024-05-09T00:11:13.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.581+0000 7f4a9062a700 1 -- 172.21.15.81:0/3582163967 wait complete. 2024-05-09T00:11:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.582+0000 7f4a9062a700 1 Processor -- start 2024-05-09T00:11:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.582+0000 7f4a9062a700 1 -- start start 2024-05-09T00:11:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.582+0000 7f4a9062a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a88101160 0x7f4a881973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.582+0000 7f4a9062a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a88106280 0x7f4a881978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.582+0000 7f4a9062a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a8819bc90 0x7f4a8819c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.582+0000 7f4a9062a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8819c710 con 0x7f4a88101160 2024-05-09T00:11:13.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.582+0000 7f4a9062a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8819c880 con 0x7f4a88106280 2024-05-09T00:11:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.582+0000 7f4a9062a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8819ca40 con 0x7f4a8819bc90 2024-05-09T00:11:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.582+0000 7f4a8e3c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a88101160 0x7f4a881973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.583+0000 7f4a8e3c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a88101160 0x7f4a881973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59546/0 (socket says 172.21.15.81:59546) 2024-05-09T00:11:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.583+0000 7f4a8e3c6700 1 -- 172.21.15.81:0/372926445 learned_addr learned my addr 172.21.15.81:0/372926445 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.583+0000 7f4a8dbc5700 1 --2- 172.21.15.81:0/372926445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a88106280 0x7f4a881978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.583+0000 7f4a8e3c6700 1 -- 172.21.15.81:0/372926445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a8819bc90 msgr2=0x7f4a8819c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.583+0000 7f4a8e3c6700 1 --2- 172.21.15.81:0/372926445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a8819bc90 0x7f4a8819c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.583+0000 7f4a8e3c6700 1 -- 172.21.15.81:0/372926445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a88106280 msgr2=0x7f4a881978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.583+0000 7f4a8e3c6700 1 --2- 172.21.15.81:0/372926445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a88106280 0x7f4a881978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.583+0000 7f4a8e3c6700 1 -- 172.21.15.81:0/372926445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a780095f0 con 0x7f4a88101160 2024-05-09T00:11:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.583+0000 7f4a8e3c6700 1 --2- 172.21.15.81:0/372926445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a88101160 0x7f4a881973b0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400d950 tx=0x7f4a8400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.583+0000 7f4a7f7fe700 1 -- 172.21.15.81:0/372926445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a84009b40 con 0x7f4a88101160 2024-05-09T00:11:13.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.583+0000 7f4a7f7fe700 1 -- 172.21.15.81:0/372926445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a84009ca0 con 0x7f4a88101160 2024-05-09T00:11:13.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.583+0000 7f4a7f7fe700 1 -- 172.21.15.81:0/372926445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8400f620 con 0x7f4a88101160 2024-05-09T00:11:13.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.583+0000 7f4a9062a700 1 -- 172.21.15.81:0/372926445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a881a3fa0 con 0x7f4a88101160 2024-05-09T00:11:13.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.583+0000 7f4a9062a700 1 -- 172.21.15.81:0/372926445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a881a43d0 con 0x7f4a88101160 2024-05-09T00:11:13.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.585+0000 7f4a7f7fe700 1 -- 172.21.15.81:0/372926445 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4a84010460 con 0x7f4a88101160 2024-05-09T00:11:13.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.586+0000 7f4a7f7fe700 1 --2- 172.21.15.81:0/372926445 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4a740a1290 0x7f4a740a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.586+0000 7f4a8dbc5700 1 --2- 172.21.15.81:0/372926445 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4a740a1290 0x7f4a740a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.586+0000 7f4a7f7fe700 1 -- 172.21.15.81:0/372926445 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f4a840cd0f0 con 0x7f4a88101160 2024-05-09T00:11:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.586+0000 7f4a8dbc5700 1 --2- 172.21.15.81:0/372926445 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4a740a1290 0x7f4a740a3750 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4a78006010 tx=0x7f4a7800b540 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.586+0000 7f4a9c7e4b80 1 Processor -- start 2024-05-09T00:11:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a9c7e4b80 1 -- start start 2024-05-09T00:11:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a9c7e4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d7251e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a9c7e4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d725720 0x563a9d71f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a9c7e4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d71f890 0x563a9d71fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a9c7e4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9d676150 con 0x563a9d724e00 2024-05-09T00:11:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a9c7e4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9d673b10 con 0x563a9d71f890 2024-05-09T00:11:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a9c7e4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9d66f400 con 0x563a9d725720 2024-05-09T00:11:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a8e3c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d7251e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a8e3c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d7251e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59560/0 (socket says 172.21.15.81:59560) 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a8e3c6700 1 -- 172.21.15.81:0/2980102728 learned_addr learned my addr 172.21.15.81:0/2980102728 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a8ebc7700 1 --2- 172.21.15.81:0/2980102728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d71f890 0x563a9d71fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a8e3c6700 1 -- 172.21.15.81:0/2980102728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d725720 msgr2=0x563a9d71f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a8e3c6700 1 --2- 172.21.15.81:0/2980102728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d725720 0x563a9d71f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a8e3c6700 1 -- 172.21.15.81:0/2980102728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d71f890 msgr2=0x563a9d71fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a8e3c6700 1 --2- 172.21.15.81:0/2980102728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d71f890 0x563a9d71fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a8e3c6700 1 -- 172.21.15.81:0/2980102728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a9d4f03b0 con 0x563a9d724e00 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a8ebc7700 1 --2- 172.21.15.81:0/2980102728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d71f890 0x563a9d71fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a8e3c6700 1 --2- 172.21.15.81:0/2980102728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d7251e0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f4a840a20c0 tx=0x7f4a84099db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1816913284c218 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a7cff9700 1 -- 172.21.15.81:0/2980102728 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8409a170 con 0x563a9d724e00 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a7cff9700 1 -- 172.21.15.81:0/2980102728 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a8409dfa0 con 0x563a9d724e00 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.587+0000 7f4a7cff9700 1 -- 172.21.15.81:0/2980102728 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8409a630 con 0x563a9d724e00 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.588+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/2980102728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 msgr2=0x563a9d7251e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.588+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/2980102728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d7251e0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f4a840a20c0 tx=0x7f4a84099db0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.588+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/2980102728 shutdown_connections 2024-05-09T00:11:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.588+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/2980102728 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d71f890 0x563a9d71fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.588+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/2980102728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d7251e0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.588+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/2980102728 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d725720 0x563a9d71f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.588+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/2980102728 >> 172.21.15.81:0/2980102728 conn(0x563a9d67d210 msgr2=0x563a9d719df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.588+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/2980102728 shutdown_connections 2024-05-09T00:11:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.588+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/2980102728 wait complete. 2024-05-09T00:11:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a9c7e4b80 1 -- start start 2024-05-09T00:11:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a9c7e4b80 1 Processor -- start 2024-05-09T00:11:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a9c7e4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d71f890 0x563a9d728b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a9c7e4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d7290b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a9c7e4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d725720 0x563a9d7295f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a9c7e4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9d60b560 con 0x563a9d724e00 2024-05-09T00:11:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a9c7e4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9d60b200 con 0x563a9d725720 2024-05-09T00:11:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a9c7e4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9d4f26a0 con 0x563a9d71f890 2024-05-09T00:11:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a9c7e4b80 10 client.0 _ll_register_callbacks cb 0x563a9d614b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a8dbc5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d7290b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a8dbc5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d7290b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59564/0 (socket says 172.21.15.81:59564) 2024-05-09T00:11:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a8dbc5700 1 -- 172.21.15.81:0/1009231868 learned_addr learned my addr 172.21.15.81:0/1009231868 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a8ebc7700 1 --2- 172.21.15.81:0/1009231868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d725720 0x563a9d7295f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a8e3c6700 1 --2- 172.21.15.81:0/1009231868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d71f890 0x563a9d728b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a8dbc5700 1 -- 172.21.15.81:0/1009231868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d71f890 msgr2=0x563a9d728b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a8dbc5700 1 --2- 172.21.15.81:0/1009231868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d71f890 0x563a9d728b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a8dbc5700 1 -- 172.21.15.81:0/1009231868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d725720 msgr2=0x563a9d7295f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a8dbc5700 1 --2- 172.21.15.81:0/1009231868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d725720 0x563a9d7295f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a8dbc5700 1 -- 172.21.15.81:0/1009231868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a881a43d0 con 0x563a9d724e00 2024-05-09T00:11:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.589+0000 7f4a8dbc5700 1 --2- 172.21.15.81:0/1009231868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d7290b0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4a8806a580 tx=0x7f4a78009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c017551f77696bc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.590+0000 7f4a71ffb700 1 -- 172.21.15.81:0/1009231868 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7802b070 con 0x563a9d724e00 2024-05-09T00:11:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.590+0000 7f4a71ffb700 1 -- 172.21.15.81:0/1009231868 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f4a78004500 con 0x563a9d724e00 2024-05-09T00:11:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.590+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/1009231868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a9d5c8270 con 0x563a9d724e00 2024-05-09T00:11:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.590+0000 7f4a71ffb700 1 -- 172.21.15.81:0/1009231868 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a780056d0 con 0x563a9d724e00 2024-05-09T00:11:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.590+0000 7f4a9c7e4b80 10 client.17757 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.590+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/1009231868 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563a9d49cb60 con 0x563a9d724e00 2024-05-09T00:11:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.590+0000 7f4a71ffb700 1 -- 172.21.15.81:0/1009231868 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a7803b020 con 0x563a9d724e00 2024-05-09T00:11:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.590+0000 7f4a71ffb700 1 -- 172.21.15.81:0/1009231868 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4a7800f7e0 con 0x563a9d724e00 2024-05-09T00:11:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.590+0000 7f4a9c7e4b80 10 client.17757 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.590+0000 7f4a9c7e4b80 10 client.17757 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.590+0000 7f4a9c7e4b80 20 client.17757 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.590+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/1009231868 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563a9d739270 0x563a9d73b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.590+0000 7f4a9c7e4b80 4 client.17757 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.590+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/1009231868 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a9d6ee810 con 0x563a9d739270 2024-05-09T00:11:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.591+0000 7f4a8e3c6700 1 --2- 172.21.15.81:0/1009231868 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563a9d739270 0x563a9d73b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.591+0000 7f4a71ffb700 10 client.17757 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.591+0000 7f4a8e3c6700 1 --2- 172.21.15.81:0/1009231868 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563a9d739270 0x563a9d73b690 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa668285b66ec711 server_cookie=cbbdf92a9b6e2743 in_seq=0 out_seq=0 2024-05-09T00:11:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a71ffb700 1 -- 172.21.15.81:0/1009231868 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563a9d6ee810 con 0x563a9d739270 2024-05-09T00:11:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a71ffb700 10 client.17757 handle_command_reply: tid=0 2024-05-09T00:11:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a9c7e4b80 1 client.17757 shutdown 2024-05-09T00:11:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/1009231868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 msgr2=0x563a9d7290b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/1009231868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d7290b0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f4a8806a580 tx=0x7f4a78009310 comp rx=0 tx=0).stop 2024-05-09T00:11:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/1009231868 shutdown_connections 2024-05-09T00:11:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/1009231868 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563a9d739270 0x563a9d73b690 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/1009231868 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d725720 0x563a9d7295f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a71ffb700 0 client.17757 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/1009231868 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d71f890 0x563a9d728b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/1009231868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d7290b0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/1009231868 >> 172.21.15.81:0/1009231868 conn(0x563a9d67d210 msgr2=0x563a9d7195a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:13.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/1009231868 shutdown_connections 2024-05-09T00:11:13.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/1009231868 wait complete. 2024-05-09T00:11:13.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.592+0000 7f4a9c7e4b80 20 client.17757 trim_cache size 0 max 16384 2024-05-09T00:11:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a9c7e4b80 1 Processor -- start 2024-05-09T00:11:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a9c7e4b80 1 -- start start 2024-05-09T00:11:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a9c7e4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d71f890 0x563a9d734bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a9c7e4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d719d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a9c7e4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d725720 0x563a9d727460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a9c7e4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9d738fe0 con 0x563a9d724e00 2024-05-09T00:11:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a9c7e4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9d716dc0 con 0x563a9d725720 2024-05-09T00:11:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a9c7e4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9d740860 con 0x563a9d71f890 2024-05-09T00:11:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a8dbc5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d719d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a8dbc5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d719d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59568/0 (socket says 172.21.15.81:59568) 2024-05-09T00:11:13.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a8dbc5700 1 -- 172.21.15.81:0/637177614 learned_addr learned my addr 172.21.15.81:0/637177614 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a8dbc5700 1 -- 172.21.15.81:0/637177614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d71f890 msgr2=0x563a9d734bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a8dbc5700 1 --2- 172.21.15.81:0/637177614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d71f890 0x563a9d734bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a8dbc5700 1 -- 172.21.15.81:0/637177614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d725720 msgr2=0x563a9d727460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a8dbc5700 1 --2- 172.21.15.81:0/637177614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d725720 0x563a9d727460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a8dbc5700 1 -- 172.21.15.81:0/637177614 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a9d635560 con 0x563a9d724e00 2024-05-09T00:11:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a8dbc5700 1 --2- 172.21.15.81:0/637177614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d719d20 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f4a78000c00 tx=0x7f4a78005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34aeb95a235b5b5a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a7d7fa700 1 -- 172.21.15.81:0/637177614 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7802b040 con 0x563a9d724e00 2024-05-09T00:11:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a7d7fa700 1 -- 172.21.15.81:0/637177614 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a7803b030 con 0x563a9d724e00 2024-05-09T00:11:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.609+0000 7f4a7d7fa700 1 -- 172.21.15.81:0/637177614 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a78024410 con 0x563a9d724e00 2024-05-09T00:11:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.610+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/637177614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 msgr2=0x563a9d719d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.610+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/637177614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d719d20 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f4a78000c00 tx=0x7f4a78005960 comp rx=0 tx=0).stop 2024-05-09T00:11:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.610+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/637177614 shutdown_connections 2024-05-09T00:11:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.610+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/637177614 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d725720 0x563a9d727460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.610+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/637177614 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d71f890 0x563a9d734bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.610+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/637177614 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d724e00 0x563a9d719d20 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.610+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/637177614 >> 172.21.15.81:0/637177614 conn(0x563a9d67d210 msgr2=0x563a9d716210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.610+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/637177614 shutdown_connections 2024-05-09T00:11:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.610+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/637177614 wait complete. 2024-05-09T00:11:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.610+0000 7f4a9c7e4b80 1 -- start start 2024-05-09T00:11:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.610+0000 7f4a9c7e4b80 1 Processor -- start 2024-05-09T00:11:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a9c7e4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d71f890 0x563a9d72e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a9c7e4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d724e00 0x563a9d72e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a9c7e4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d725720 0x563a9d72eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a9c7e4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9d78e860 con 0x563a9d71f890 2024-05-09T00:11:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a9c7e4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9d78e9d0 con 0x563a9d724e00 2024-05-09T00:11:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a9c7e4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a9d78eb90 con 0x563a9d725720 2024-05-09T00:11:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a9c7e4b80 10 client.0 _ll_register_callbacks cb 0x563a9d614b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:13.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a8e3c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d71f890 0x563a9d72e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a8e3c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d71f890 0x563a9d72e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59570/0 (socket says 172.21.15.81:59570) 2024-05-09T00:11:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a8e3c6700 1 -- 172.21.15.81:0/3219213988 learned_addr learned my addr 172.21.15.81:0/3219213988 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a8e3c6700 1 -- 172.21.15.81:0/3219213988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d725720 msgr2=0x563a9d72eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a8e3c6700 1 --2- 172.21.15.81:0/3219213988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d725720 0x563a9d72eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a8e3c6700 1 -- 172.21.15.81:0/3219213988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d724e00 msgr2=0x563a9d72e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a8e3c6700 1 --2- 172.21.15.81:0/3219213988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d724e00 0x563a9d72e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a8e3c6700 1 -- 172.21.15.81:0/3219213988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a9d49cb60 con 0x563a9d71f890 2024-05-09T00:11:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a8e3c6700 1 --2- 172.21.15.81:0/3219213988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d71f890 0x563a9d72e0f0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f4a8409a100 tx=0x7f4a84005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c79f023a15be83 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a71ffb700 1 -- 172.21.15.81:0/3219213988 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a840985c0 con 0x563a9d71f890 2024-05-09T00:11:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a71ffb700 1 -- 172.21.15.81:0/3219213988 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f4a84010710 con 0x563a9d71f890 2024-05-09T00:11:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/3219213988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a8409dfa0 con 0x563a9d71f890 2024-05-09T00:11:13.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a71ffb700 1 -- 172.21.15.81:0/3219213988 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a840108d0 con 0x563a9d71f890 2024-05-09T00:11:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a9c7e4b80 10 client.17763 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.611+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/3219213988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563a9d4f4cd0 con 0x563a9d71f890 2024-05-09T00:11:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.612+0000 7f4a71ffb700 1 -- 172.21.15.81:0/3219213988 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a8409dfa0 con 0x563a9d71f890 2024-05-09T00:11:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.612+0000 7f4a71ffb700 1 -- 172.21.15.81:0/3219213988 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4a84023070 con 0x563a9d71f890 2024-05-09T00:11:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.612+0000 7f4a9c7e4b80 10 client.17763 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.612+0000 7f4a9c7e4b80 10 client.17763 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.612+0000 7f4a9c7e4b80 20 client.17763 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.612+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/3219213988 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563a9d790030 0x563a9d792450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.612+0000 7f4a9c7e4b80 4 client.17763 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:11:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.612+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/3219213988 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563a9d667ec0 con 0x563a9d790030 2024-05-09T00:11:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.612+0000 7f4a8dbc5700 1 --2- 172.21.15.81:0/3219213988 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563a9d790030 0x563a9d792450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.612+0000 7f4a8dbc5700 1 --2- 172.21.15.81:0/3219213988 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563a9d790030 0x563a9d792450 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=547fe615dfb721a2 server_cookie=803d0dcecfb8f846 in_seq=0 out_seq=0 2024-05-09T00:11:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.612+0000 7f4a71ffb700 10 client.17763 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:13.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a71ffb700 1 -- 172.21.15.81:0/3219213988 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x563a9d667ec0 con 0x563a9d790030 2024-05-09T00:11:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a71ffb700 10 client.17763 handle_command_reply: tid=0 2024-05-09T00:11:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a9c7e4b80 1 client.17763 shutdown 2024-05-09T00:11:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/3219213988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d71f890 msgr2=0x563a9d72e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/3219213988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d71f890 0x563a9d72e0f0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f4a8409a100 tx=0x7f4a84005910 comp rx=0 tx=0).stop 2024-05-09T00:11:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/3219213988 shutdown_connections 2024-05-09T00:11:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/3219213988 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563a9d790030 0x563a9d792450 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/3219213988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563a9d725720 0x563a9d72eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a71ffb700 0 client.17763 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/3219213988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563a9d71f890 0x563a9d72e0f0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a9c7e4b80 1 --2- 172.21.15.81:0/3219213988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563a9d724e00 0x563a9d72e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/3219213988 >> 172.21.15.81:0/3219213988 conn(0x563a9d67d210 msgr2=0x563a9d727420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/3219213988 shutdown_connections 2024-05-09T00:11:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a9c7e4b80 1 -- 172.21.15.81:0/3219213988 wait complete. 2024-05-09T00:11:13.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.613+0000 7f4a9c7e4b80 20 client.17763 trim_cache size 0 max 16384 2024-05-09T00:11:13.617 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:11:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:11:13.617 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:11:13.617 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:11:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.614+0000 7f4a9062a700 1 -- 172.21.15.81:0/372926445 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4a740a1290 msgr2=0x7f4a740a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.614+0000 7f4a9062a700 1 --2- 172.21.15.81:0/372926445 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4a740a1290 0x7f4a740a3750 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4a78006010 tx=0x7f4a7800b540 comp rx=0 tx=0).stop 2024-05-09T00:11:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.614+0000 7f4a9062a700 1 -- 172.21.15.81:0/372926445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a88101160 msgr2=0x7f4a881973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.614+0000 7f4a9062a700 1 --2- 172.21.15.81:0/372926445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a88101160 0x7f4a881973b0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400d950 tx=0x7f4a8400dd10 comp rx=0 tx=0).stop 2024-05-09T00:11:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.614+0000 7f4a9062a700 1 -- 172.21.15.81:0/372926445 shutdown_connections 2024-05-09T00:11:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.614+0000 7f4a9062a700 1 --2- 172.21.15.81:0/372926445 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4a740a1290 0x7f4a740a3750 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.614+0000 7f4a9062a700 1 --2- 172.21.15.81:0/372926445 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4a8819bc90 0x7f4a8819c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.614+0000 7f4a9062a700 1 --2- 172.21.15.81:0/372926445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a88101160 0x7f4a881973b0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.614+0000 7f4a9062a700 1 --2- 172.21.15.81:0/372926445 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4a88106280 0x7f4a881978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.614+0000 7f4a9062a700 1 -- 172.21.15.81:0/372926445 >> 172.21.15.81:0/372926445 conn(0x7f4a880fc9c0 msgr2=0x7f4a880fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:13.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.614+0000 7f4a9062a700 1 -- 172.21.15.81:0/372926445 shutdown_connections 2024-05-09T00:11:13.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.614+0000 7f4a9062a700 1 -- 172.21.15.81:0/372926445 wait complete. 2024-05-09T00:11:13.622 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:11:13.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.750+0000 7fc1ea77d700 1 -- 172.21.15.81:0/2106610839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e40fff70 msgr2=0x7fc1e4100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.750+0000 7fc1ea77d700 1 --2- 172.21.15.81:0/2106610839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e40fff70 0x7fc1e4100350 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fc1d4009990 tx=0x7fc1d4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.750+0000 7fc1ea77d700 1 -- 172.21.15.81:0/2106610839 shutdown_connections 2024-05-09T00:11:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.750+0000 7fc1ea77d700 1 --2- 172.21.15.81:0/2106610839 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1e4105090 0x7fc1e410cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.750+0000 7fc1ea77d700 1 --2- 172.21.15.81:0/2106610839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e40fff70 0x7fc1e4100350 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.750+0000 7fc1ea77d700 1 --2- 172.21.15.81:0/2106610839 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e4100920 0x7fc1e4104960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.750+0000 7fc1ea77d700 1 -- 172.21.15.81:0/2106610839 >> 172.21.15.81:0/2106610839 conn(0x7fc1e40fb7d0 msgr2=0x7fc1e40fdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.750+0000 7fc1ea77d700 1 -- 172.21.15.81:0/2106610839 shutdown_connections 2024-05-09T00:11:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.750+0000 7fc1ea77d700 1 -- 172.21.15.81:0/2106610839 wait complete. 2024-05-09T00:11:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.750+0000 7fc1ea77d700 1 Processor -- start 2024-05-09T00:11:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.751+0000 7fc1ea77d700 1 -- start start 2024-05-09T00:11:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.751+0000 7fc1ea77d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1e40fff70 0x7fc1e41962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.751+0000 7fc1ea77d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e4105090 0x7fc1e4196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.751+0000 7fc1ea77d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e419abc0 0x7fc1e419b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.751+0000 7fc1ea77d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e419b640 con 0x7fc1e419abc0 2024-05-09T00:11:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.751+0000 7fc1ea77d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e419b7b0 con 0x7fc1e4105090 2024-05-09T00:11:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.751+0000 7fc1ea77d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e419b970 con 0x7fc1e40fff70 2024-05-09T00:11:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.751+0000 7fc1e8d1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e419abc0 0x7fc1e419b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.751+0000 7fc1e8d1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e419abc0 0x7fc1e419b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59582/0 (socket says 172.21.15.81:59582) 2024-05-09T00:11:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.751+0000 7fc1e8d1a700 1 -- 172.21.15.81:0/876311704 learned_addr learned my addr 172.21.15.81:0/876311704 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.751+0000 7fc1e3fff700 1 --2- 172.21.15.81:0/876311704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1e40fff70 0x7fc1e41962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.751+0000 7fc1e37fe700 1 --2- 172.21.15.81:0/876311704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e4105090 0x7fc1e4196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.751+0000 7fc1e8d1a700 1 -- 172.21.15.81:0/876311704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1e40fff70 msgr2=0x7fc1e41962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.752+0000 7fc1e8d1a700 1 --2- 172.21.15.81:0/876311704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1e40fff70 0x7fc1e41962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.752+0000 7fc1e8d1a700 1 -- 172.21.15.81:0/876311704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e4105090 msgr2=0x7fc1e4196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.752+0000 7fc1e8d1a700 1 --2- 172.21.15.81:0/876311704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e4105090 0x7fc1e4196820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.752+0000 7fc1e8d1a700 1 -- 172.21.15.81:0/876311704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d40095f0 con 0x7fc1e419abc0 2024-05-09T00:11:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.752+0000 7fc1e8d1a700 1 --2- 172.21.15.81:0/876311704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e419abc0 0x7fc1e419b040 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00ef30 tx=0x7fc1dc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.754+0000 7fc1e17fa700 1 -- 172.21.15.81:0/876311704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc018070 con 0x7fc1e419abc0 2024-05-09T00:11:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.754+0000 7fc1e17fa700 1 -- 172.21.15.81:0/876311704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1dc00f040 con 0x7fc1e419abc0 2024-05-09T00:11:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.754+0000 7fc1ea77d700 1 -- 172.21.15.81:0/876311704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e41a2e70 con 0x7fc1e419abc0 2024-05-09T00:11:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.754+0000 7fc1e17fa700 1 -- 172.21.15.81:0/876311704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc00cd00 con 0x7fc1e419abc0 2024-05-09T00:11:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.754+0000 7fc1ea77d700 1 -- 172.21.15.81:0/876311704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e41a32a0 con 0x7fc1e419abc0 2024-05-09T00:11:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.755+0000 7fc1ea77d700 1 -- 172.21.15.81:0/876311704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e4108300 con 0x7fc1e419abc0 2024-05-09T00:11:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.756+0000 7fc1e17fa700 1 -- 172.21.15.81:0/876311704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc1dc003a00 con 0x7fc1e419abc0 2024-05-09T00:11:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.756+0000 7fc1e17fa700 1 --2- 172.21.15.81:0/876311704 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc1cc0a1290 0x7fc1cc0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.756+0000 7fc1e17fa700 1 -- 172.21.15.81:0/876311704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fc1dc0cd130 con 0x7fc1e419abc0 2024-05-09T00:11:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.756+0000 7fc1e3fff700 1 --2- 172.21.15.81:0/876311704 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc1cc0a1290 0x7fc1cc0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.757+0000 7fc1e3fff700 1 --2- 172.21.15.81:0/876311704 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc1cc0a1290 0x7fc1cc0a3750 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400b2e0 tx=0x7fc1d4005fd0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:13.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:13.760+0000 7fc1e17fa700 1 -- 172.21.15.81:0/876311704 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc1dc0965e0 con 0x7fc1e419abc0 2024-05-09T00:11:13.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.003+0000 7fc1ea77d700 1 -- 172.21.15.81:0/876311704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1e4197680 con 0x7fc1e419abc0 2024-05-09T00:11:14.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.003+0000 7fc1e17fa700 1 -- 172.21.15.81:0/876311704 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7fc1dc099c00 con 0x7fc1e419abc0 2024-05-09T00:11:14.000 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:11:14.000 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:11:14.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.005+0000 7fc1ea77d700 1 -- 172.21.15.81:0/876311704 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc1cc0a1290 msgr2=0x7fc1cc0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.005+0000 7fc1ea77d700 1 --2- 172.21.15.81:0/876311704 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc1cc0a1290 0x7fc1cc0a3750 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400b2e0 tx=0x7fc1d4005fd0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.005+0000 7fc1ea77d700 1 -- 172.21.15.81:0/876311704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e419abc0 msgr2=0x7fc1e419b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.005+0000 7fc1ea77d700 1 --2- 172.21.15.81:0/876311704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e419abc0 0x7fc1e419b040 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc00ef30 tx=0x7fc1dc00c3a0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.006+0000 7fc1ea77d700 1 -- 172.21.15.81:0/876311704 shutdown_connections 2024-05-09T00:11:14.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.006+0000 7fc1ea77d700 1 --2- 172.21.15.81:0/876311704 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc1cc0a1290 0x7fc1cc0a3750 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.006+0000 7fc1ea77d700 1 --2- 172.21.15.81:0/876311704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1e419abc0 0x7fc1e419b040 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.006+0000 7fc1ea77d700 1 --2- 172.21.15.81:0/876311704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc1e40fff70 0x7fc1e41962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.006+0000 7fc1ea77d700 1 --2- 172.21.15.81:0/876311704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc1e4105090 0x7fc1e4196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.006+0000 7fc1ea77d700 1 -- 172.21.15.81:0/876311704 >> 172.21.15.81:0/876311704 conn(0x7fc1e40fb7d0 msgr2=0x7fc1e40fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.006+0000 7fc1ea77d700 1 -- 172.21.15.81:0/876311704 shutdown_connections 2024-05-09T00:11:14.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.006+0000 7fc1ea77d700 1 -- 172.21.15.81:0/876311704 wait complete. 2024-05-09T00:11:14.004 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:11:14.013 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:13 smithi081 ceph-mon[42474]: osdmap e87: 12 total, 12 up, 12 in 2024-05-09T00:11:14.015 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:11:14.016 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:13 smithi150 ceph-mon[46187]: osdmap e87: 12 total, 12 up, 12 in 2024-05-09T00:11:14.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:13 smithi171 ceph-mon[47351]: osdmap e87: 12 total, 12 up, 12 in 2024-05-09T00:11:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.141+0000 7f342ef68700 1 -- 172.21.15.81:0/1329663585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3428100a10 msgr2=0x7f3428104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.141+0000 7f342ef68700 1 --2- 172.21.15.81:0/1329663585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3428100a10 0x7f3428104a30 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f3414009990 tx=0x7f3414009ca0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.141+0000 7f342ef68700 1 -- 172.21.15.81:0/1329663585 shutdown_connections 2024-05-09T00:11:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.141+0000 7f342ef68700 1 --2- 172.21.15.81:0/1329663585 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3428100060 0x7f3428100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.141+0000 7f342ef68700 1 --2- 172.21.15.81:0/1329663585 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3428105160 0x7f342810cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.141+0000 7f342ef68700 1 --2- 172.21.15.81:0/1329663585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3428100a10 0x7f3428104a30 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.141+0000 7f342ef68700 1 -- 172.21.15.81:0/1329663585 >> 172.21.15.81:0/1329663585 conn(0x7f3428076f40 msgr2=0x7f3428077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.141+0000 7f342ef68700 1 -- 172.21.15.81:0/1329663585 shutdown_connections 2024-05-09T00:11:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.141+0000 7f342ef68700 1 -- 172.21.15.81:0/1329663585 wait complete. 2024-05-09T00:11:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342ef68700 1 Processor -- start 2024-05-09T00:11:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342ef68700 1 -- start start 2024-05-09T00:11:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342ef68700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3428100060 0x7f3428101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342ef68700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3428105160 0x7f3428102010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342ef68700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3428102550 0x7f34281a55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342ef68700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34281a5bf0 con 0x7f3428102550 2024-05-09T00:11:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342ef68700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34281a5d60 con 0x7f3428105160 2024-05-09T00:11:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342ef68700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34281a5f20 con 0x7f3428100060 2024-05-09T00:11:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342d505700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3428102550 0x7f34281a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342d505700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3428102550 0x7f34281a55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59604/0 (socket says 172.21.15.81:59604) 2024-05-09T00:11:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342d505700 1 -- 172.21.15.81:0/2241365849 learned_addr learned my addr 172.21.15.81:0/2241365849 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342cd04700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3428100060 0x7f3428101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f3427fff700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3428105160 0x7f3428102010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342d505700 1 -- 172.21.15.81:0/2241365849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3428100060 msgr2=0x7f3428101ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342d505700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3428100060 0x7f3428101ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342d505700 1 -- 172.21.15.81:0/2241365849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3428105160 msgr2=0x7f3428102010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342d505700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3428105160 0x7f3428102010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342d505700 1 -- 172.21.15.81:0/2241365849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34140095f0 con 0x7f3428102550 2024-05-09T00:11:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342cd04700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3428100060 0x7f3428101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f3427fff700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3428105160 0x7f3428102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.142+0000 7f342d505700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3428102550 0x7f34281a55b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f3420007ee0 tx=0x7f342000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.143+0000 7f3425ffb700 1 -- 172.21.15.81:0/2241365849 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420017070 con 0x7f3428102550 2024-05-09T00:11:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.143+0000 7f3425ffb700 1 -- 172.21.15.81:0/2241365849 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f342000f040 con 0x7f3428102550 2024-05-09T00:11:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.143+0000 7f342ef68700 1 -- 172.21.15.81:0/2241365849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34281a6200 con 0x7f3428102550 2024-05-09T00:11:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.143+0000 7f3425ffb700 1 -- 172.21.15.81:0/2241365849 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420005740 con 0x7f3428102550 2024-05-09T00:11:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.143+0000 7f342ef68700 1 -- 172.21.15.81:0/2241365849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34281a66c0 con 0x7f3428102550 2024-05-09T00:11:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.145+0000 7f3425ffb700 1 -- 172.21.15.81:0/2241365849 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f34200058a0 con 0x7f3428102550 2024-05-09T00:11:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.145+0000 7f3425ffb700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f34180a1290 0x7f34180a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.145+0000 7f3425ffb700 1 -- 172.21.15.81:0/2241365849 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f34200cc560 con 0x7f3428102550 2024-05-09T00:11:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.145+0000 7f342cd04700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f34180a1290 0x7f34180a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.146+0000 7f342cd04700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f34180a1290 0x7f34180a3750 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f341c005fd0 tx=0x7f341c005dc0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.146+0000 7f343b122b80 1 Processor -- start 2024-05-09T00:11:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.146+0000 7f343b122b80 1 -- start start 2024-05-09T00:11:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f343b122b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06815e00 0x556d068161e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f343b122b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06816720 0x556d06810350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f343b122b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06810890 0x556d06810cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f343b122b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d06767150 con 0x556d06815e00 2024-05-09T00:11:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f343b122b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d06764b10 con 0x556d06810890 2024-05-09T00:11:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f343b122b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d06760400 con 0x556d06816720 2024-05-09T00:11:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f342cd04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06815e00 0x556d068161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f342cd04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06815e00 0x556d068161e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59606/0 (socket says 172.21.15.81:59606) 2024-05-09T00:11:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f342cd04700 1 -- 172.21.15.81:0/3146345112 learned_addr learned my addr 172.21.15.81:0/3146345112 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f342d505700 1 --2- 172.21.15.81:0/3146345112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06810890 0x556d06810cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f342cd04700 1 -- 172.21.15.81:0/3146345112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06816720 msgr2=0x556d06810350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f342cd04700 1 --2- 172.21.15.81:0/3146345112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06816720 0x556d06810350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f342cd04700 1 -- 172.21.15.81:0/3146345112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06810890 msgr2=0x556d06810cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f342cd04700 1 --2- 172.21.15.81:0/3146345112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06810890 0x556d06810cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f342cd04700 1 -- 172.21.15.81:0/3146345112 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d065e13b0 con 0x556d06815e00 2024-05-09T00:11:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f342d505700 1 --2- 172.21.15.81:0/3146345112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06810890 0x556d06810cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f342cd04700 1 --2- 172.21.15.81:0/3146345112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06815e00 0x556d068161e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f341c00db90 tx=0x7f341c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b350cfc4afb0616c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f3412ffd700 1 -- 172.21.15.81:0/3146345112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c00f930 con 0x556d06815e00 2024-05-09T00:11:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f3412ffd700 1 -- 172.21.15.81:0/3146345112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f341c01c450 con 0x556d06815e00 2024-05-09T00:11:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.147+0000 7f3412ffd700 1 -- 172.21.15.81:0/3146345112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c01b610 con 0x556d06815e00 2024-05-09T00:11:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.148+0000 7f343b122b80 1 -- 172.21.15.81:0/3146345112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06815e00 msgr2=0x556d068161e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.148+0000 7f343b122b80 1 --2- 172.21.15.81:0/3146345112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06815e00 0x556d068161e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f341c00db90 tx=0x7f341c010000 comp rx=0 tx=0).stop 2024-05-09T00:11:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.148+0000 7f343b122b80 1 -- 172.21.15.81:0/3146345112 shutdown_connections 2024-05-09T00:11:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.148+0000 7f343b122b80 1 --2- 172.21.15.81:0/3146345112 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06810890 0x556d06810cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.148+0000 7f343b122b80 1 --2- 172.21.15.81:0/3146345112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06815e00 0x556d068161e0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.148+0000 7f343b122b80 1 --2- 172.21.15.81:0/3146345112 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06816720 0x556d06810350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.148+0000 7f343b122b80 1 -- 172.21.15.81:0/3146345112 >> 172.21.15.81:0/3146345112 conn(0x556d0676e210 msgr2=0x556d0680adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.148+0000 7f343b122b80 1 -- 172.21.15.81:0/3146345112 shutdown_connections 2024-05-09T00:11:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.148+0000 7f343b122b80 1 -- 172.21.15.81:0/3146345112 wait complete. 2024-05-09T00:11:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.148+0000 7f343b122b80 1 -- start start 2024-05-09T00:11:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.148+0000 7f343b122b80 1 Processor -- start 2024-05-09T00:11:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f343b122b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06810890 0x556d06819b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f343b122b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06815e00 0x556d0681a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f343b122b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06816720 0x556d0681a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f343b122b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d066fc560 con 0x556d06815e00 2024-05-09T00:11:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f343b122b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d066fc200 con 0x556d06816720 2024-05-09T00:11:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f343b122b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d065e36a0 con 0x556d06810890 2024-05-09T00:11:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f343b122b80 10 client.0 _ll_register_callbacks cb 0x556d06705b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f3427fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06815e00 0x556d0681a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f3427fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06815e00 0x556d0681a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59620/0 (socket says 172.21.15.81:59620) 2024-05-09T00:11:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f3427fff700 1 -- 172.21.15.81:0/1670461737 learned_addr learned my addr 172.21.15.81:0/1670461737 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f342d505700 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06816720 0x556d0681a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f342cd04700 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06810890 0x556d06819b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f3427fff700 1 -- 172.21.15.81:0/1670461737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06810890 msgr2=0x556d06819b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f3427fff700 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06810890 0x556d06819b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f3427fff700 1 -- 172.21.15.81:0/1670461737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06816720 msgr2=0x556d0681a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f3427fff700 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06816720 0x556d0681a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f3427fff700 1 -- 172.21.15.81:0/1670461737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f341c00d840 con 0x556d06815e00 2024-05-09T00:11:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f342d505700 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06816720 0x556d0681a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f342cd04700 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06810890 0x556d06819b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f3427fff700 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06815e00 0x556d0681a0a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f3414006010 tx=0x7f341400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b042066a3c60daa0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.149+0000 7f3407fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f3407fff700 1 -- 172.21.15.81:0/1670461737 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414025070 con 0x556d06815e00 2024-05-09T00:11:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f343b122b80 1 -- 172.21.15.81:0/1670461737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556d066b9270 con 0x556d06815e00 2024-05-09T00:11:14.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f3407fff700 1 -- 172.21.15.81:0/1670461737 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f341400be80 con 0x556d06815e00 2024-05-09T00:11:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f3407fff700 1 -- 172.21.15.81:0/1670461737 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3414004830 con 0x556d06815e00 2024-05-09T00:11:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f343b122b80 10 client.17781 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f343b122b80 1 -- 172.21.15.81:0/1670461737 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556d0658db60 con 0x556d06815e00 2024-05-09T00:11:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f3407fff700 1 -- 172.21.15.81:0/1670461737 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556d066b9270 con 0x556d06815e00 2024-05-09T00:11:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f3407fff700 1 -- 172.21.15.81:0/1670461737 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3414028020 con 0x556d06815e00 2024-05-09T00:11:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f343b122b80 10 client.17781 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f343b122b80 10 client.17781 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:11:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f343b122b80 20 client.17781 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f343b122b80 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x556d0682a260 0x556d0682c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f343b122b80 4 client.17781 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f343b122b80 1 -- 172.21.15.81:0/1670461737 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556d067df810 con 0x556d0682a260 2024-05-09T00:11:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.150+0000 7f342cd04700 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x556d0682a260 0x556d0682c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.151+0000 7f3407fff700 10 client.17781 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:11:14.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.151+0000 7f342cd04700 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x556d0682a260 0x556d0682c680 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=caec42730e4f6ee1 server_cookie=5978e23838b5b035 in_seq=0 out_seq=0 2024-05-09T00:11:14.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.151+0000 7f3407fff700 1 -- 172.21.15.81:0/1670461737 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556d067df810 con 0x556d0682a260 2024-05-09T00:11:14.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.151+0000 7f3407fff700 10 client.17781 handle_command_reply: tid=0 2024-05-09T00:11:14.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.151+0000 7f343b122b80 1 client.17781 shutdown 2024-05-09T00:11:14.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.152+0000 7f343b122b80 1 -- 172.21.15.81:0/1670461737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06815e00 msgr2=0x556d0681a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.152+0000 7f343b122b80 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06815e00 0x556d0681a0a0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f3414006010 tx=0x7f341400ba50 comp rx=0 tx=0).stop 2024-05-09T00:11:14.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.152+0000 7f343b122b80 1 -- 172.21.15.81:0/1670461737 shutdown_connections 2024-05-09T00:11:14.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.152+0000 7f343b122b80 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x556d0682a260 0x556d0682c680 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.152+0000 7f343b122b80 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06816720 0x556d0681a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.152+0000 7f343b122b80 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06810890 0x556d06819b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.152+0000 7f3407fff700 0 client.17781 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:11:14.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.152+0000 7f343b122b80 1 --2- 172.21.15.81:0/1670461737 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06815e00 0x556d0681a0a0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.152+0000 7f343b122b80 1 -- 172.21.15.81:0/1670461737 >> 172.21.15.81:0/1670461737 conn(0x556d0676e210 msgr2=0x556d0680a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.152+0000 7f343b122b80 1 -- 172.21.15.81:0/1670461737 shutdown_connections 2024-05-09T00:11:14.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.152+0000 7f343b122b80 1 -- 172.21.15.81:0/1670461737 wait complete. 2024-05-09T00:11:14.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.152+0000 7f343b122b80 20 client.17781 trim_cache size 0 max 16384 2024-05-09T00:11:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f343b122b80 1 Processor -- start 2024-05-09T00:11:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f343b122b80 1 -- start start 2024-05-09T00:11:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f343b122b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06810890 0x556d06826390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f343b122b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06815e00 0x556d06825c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f343b122b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06816720 0x556d0680ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f343b122b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d0680b8e0 con 0x556d06816720 2024-05-09T00:11:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f343b122b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d06826e40 con 0x556d06815e00 2024-05-09T00:11:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f343b122b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d06807dc0 con 0x556d06810890 2024-05-09T00:11:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f342d505700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06816720 0x556d0680ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f342d505700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06816720 0x556d0680ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59624/0 (socket says 172.21.15.81:59624) 2024-05-09T00:11:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f342d505700 1 -- 172.21.15.81:0/2624940664 learned_addr learned my addr 172.21.15.81:0/2624940664 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f342cd04700 1 --2- 172.21.15.81:0/2624940664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06810890 0x556d06826390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f3427fff700 1 --2- 172.21.15.81:0/2624940664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06815e00 0x556d06825c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f342d505700 1 -- 172.21.15.81:0/2624940664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06810890 msgr2=0x556d06826390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f342d505700 1 --2- 172.21.15.81:0/2624940664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06810890 0x556d06826390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f342d505700 1 -- 172.21.15.81:0/2624940664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06815e00 msgr2=0x556d06825c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f342d505700 1 --2- 172.21.15.81:0/2624940664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06815e00 0x556d06825c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f342d505700 1 -- 172.21.15.81:0/2624940664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d06726560 con 0x556d06816720 2024-05-09T00:11:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f342cd04700 1 --2- 172.21.15.81:0/2624940664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06810890 0x556d06826390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.165+0000 7f342d505700 1 --2- 172.21.15.81:0/2624940664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06816720 0x556d0680ad20 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f3420095b40 tx=0x7f34200b9040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a0f8ab69c7fcf0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.166+0000 7f34137fe700 1 -- 172.21.15.81:0/2624940664 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34200b90b0 con 0x556d06816720 2024-05-09T00:11:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.166+0000 7f34137fe700 1 -- 172.21.15.81:0/2624940664 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3420099640 con 0x556d06816720 2024-05-09T00:11:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.166+0000 7f34137fe700 1 -- 172.21.15.81:0/2624940664 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342009d290 con 0x556d06816720 2024-05-09T00:11:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.166+0000 7f343b122b80 1 -- 172.21.15.81:0/2624940664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06816720 msgr2=0x556d0680ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.166+0000 7f343b122b80 1 --2- 172.21.15.81:0/2624940664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06816720 0x556d0680ad20 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f3420095b40 tx=0x7f34200b9040 comp rx=0 tx=0).stop 2024-05-09T00:11:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.166+0000 7f343b122b80 1 -- 172.21.15.81:0/2624940664 shutdown_connections 2024-05-09T00:11:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.166+0000 7f343b122b80 1 --2- 172.21.15.81:0/2624940664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06816720 0x556d0680ad20 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.166+0000 7f343b122b80 1 --2- 172.21.15.81:0/2624940664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06810890 0x556d06826390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.166+0000 7f343b122b80 1 --2- 172.21.15.81:0/2624940664 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06815e00 0x556d06825c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.166+0000 7f343b122b80 1 -- 172.21.15.81:0/2624940664 >> 172.21.15.81:0/2624940664 conn(0x556d0676e210 msgr2=0x556d0681a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.166+0000 7f343b122b80 1 -- 172.21.15.81:0/2624940664 shutdown_connections 2024-05-09T00:11:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.166+0000 7f343b122b80 1 -- 172.21.15.81:0/2624940664 wait complete. 2024-05-09T00:11:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f343b122b80 1 -- start start 2024-05-09T00:11:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f343b122b80 1 Processor -- start 2024-05-09T00:11:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f343b122b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06810890 0x556d068746f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f343b122b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06815e00 0x556d06874c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f343b122b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06816720 0x556d06875170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f343b122b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d0687f800 con 0x556d06816720 2024-05-09T00:11:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f343b122b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d0687f940 con 0x556d06810890 2024-05-09T00:11:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f343b122b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d0687fb00 con 0x556d06815e00 2024-05-09T00:11:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f343b122b80 10 client.0 _ll_register_callbacks cb 0x556d06705b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f342d505700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06816720 0x556d06875170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f342d505700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06816720 0x556d06875170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59626/0 (socket says 172.21.15.81:59626) 2024-05-09T00:11:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f342d505700 1 -- 172.21.15.81:0/3722752436 learned_addr learned my addr 172.21.15.81:0/3722752436 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f3427fff700 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06815e00 0x556d06874c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f342cd04700 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06810890 0x556d068746f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f342d505700 1 -- 172.21.15.81:0/3722752436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06815e00 msgr2=0x556d06874c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f342d505700 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06815e00 0x556d06874c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f342d505700 1 -- 172.21.15.81:0/3722752436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06810890 msgr2=0x556d068746f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f342d505700 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06810890 0x556d068746f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f342d505700 1 -- 172.21.15.81:0/3722752436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34281a66c0 con 0x556d06816720 2024-05-09T00:11:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f342cd04700 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06810890 0x556d068746f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.167+0000 7f3427fff700 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06815e00 0x556d06874c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f342d505700 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06816720 0x556d06875170 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f34200995d0 tx=0x7f3420099e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa812af96256d4b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f3407fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f3407fff700 1 -- 172.21.15.81:0/3722752436 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342000ddd0 con 0x556d06816720 2024-05-09T00:11:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f343b122b80 1 -- 172.21.15.81:0/3722752436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f341c01c450 con 0x556d06816720 2024-05-09T00:11:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f3407fff700 1 -- 172.21.15.81:0/3722752436 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f3420082e40 con 0x556d06816720 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f3407fff700 1 -- 172.21.15.81:0/3722752436 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34200b90b0 con 0x556d06816720 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f343b122b80 10 client.17787 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f343b122b80 1 -- 172.21.15.81:0/3722752436 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556d065e5cd0 con 0x556d06816720 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f3407fff700 1 -- 172.21.15.81:0/3722752436 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f341c01c450 con 0x556d06816720 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f3407fff700 1 -- 172.21.15.81:0/3722752436 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f34200a1630 con 0x556d06816720 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f343b122b80 10 client.17787 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f343b122b80 10 client.17787 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f343b122b80 20 client.17787 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f343b122b80 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x556d06881020 0x556d06883410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f343b122b80 4 client.17787 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f343b122b80 1 -- 172.21.15.81:0/3722752436 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556d06758ec0 con 0x556d06881020 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.168+0000 7f342cd04700 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x556d06881020 0x556d06883410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f3407fff700 10 client.17787 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f342cd04700 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x556d06881020 0x556d06883410 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f491dd965691de02 server_cookie=fae39ee1001ce386 in_seq=0 out_seq=0 2024-05-09T00:11:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f3407fff700 1 -- 172.21.15.81:0/3722752436 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556d06758ec0 con 0x556d06881020 2024-05-09T00:11:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f3407fff700 10 client.17787 handle_command_reply: tid=0 2024-05-09T00:11:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f343b122b80 1 client.17787 shutdown 2024-05-09T00:11:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f343b122b80 1 -- 172.21.15.81:0/3722752436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06816720 msgr2=0x556d06875170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f343b122b80 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06816720 0x556d06875170 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f34200995d0 tx=0x7f3420099e00 comp rx=0 tx=0).stop 2024-05-09T00:11:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f343b122b80 1 -- 172.21.15.81:0/3722752436 shutdown_connections 2024-05-09T00:11:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f343b122b80 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x556d06881020 0x556d06883410 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f343b122b80 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d06810890 0x556d068746f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f343b122b80 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d06816720 0x556d06875170 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f3407fff700 0 client.17787 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:11:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f343b122b80 1 --2- 172.21.15.81:0/3722752436 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d06815e00 0x556d06874c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f343b122b80 1 -- 172.21.15.81:0/3722752436 >> 172.21.15.81:0/3722752436 conn(0x556d0676e210 msgr2=0x556d0681a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f343b122b80 1 -- 172.21.15.81:0/3722752436 shutdown_connections 2024-05-09T00:11:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f343b122b80 1 -- 172.21.15.81:0/3722752436 wait complete. 2024-05-09T00:11:14.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.169+0000 7f343b122b80 20 client.17787 trim_cache size 0 max 16384 2024-05-09T00:11:14.174 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:11:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.170+0000 7f342ef68700 1 -- 172.21.15.81:0/2241365849 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f34180a1290 msgr2=0x7f34180a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.170+0000 7f342ef68700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f34180a1290 0x7f34180a3750 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f341c005fd0 tx=0x7f341c005dc0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.170+0000 7f342ef68700 1 -- 172.21.15.81:0/2241365849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3428102550 msgr2=0x7f34281a55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.170+0000 7f342ef68700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3428102550 0x7f34281a55b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f3420007ee0 tx=0x7f342000d3b0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.170+0000 7f342ef68700 1 -- 172.21.15.81:0/2241365849 shutdown_connections 2024-05-09T00:11:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.170+0000 7f342ef68700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f34180a1290 0x7f34180a3750 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.170+0000 7f342ef68700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3428102550 0x7f34281a55b0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.170+0000 7f342ef68700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3428100060 0x7f3428101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.170+0000 7f342ef68700 1 --2- 172.21.15.81:0/2241365849 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3428105160 0x7f3428102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.170+0000 7f342ef68700 1 -- 172.21.15.81:0/2241365849 >> 172.21.15.81:0/2241365849 conn(0x7f3428076f40 msgr2=0x7f3428068410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.170+0000 7f342ef68700 1 -- 172.21.15.81:0/2241365849 shutdown_connections 2024-05-09T00:11:14.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.170+0000 7f342ef68700 1 -- 172.21.15.81:0/2241365849 wait complete. 2024-05-09T00:11:14.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:11:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.306+0000 7f6aa0540700 1 -- 172.21.15.81:0/1839465127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a98100060 msgr2=0x7f6a98100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.306+0000 7f6aa0540700 1 --2- 172.21.15.81:0/1839465127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a98100060 0x7f6a98100440 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009990 tx=0x7f6a88009ca0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.306+0000 7f6aa0540700 1 -- 172.21.15.81:0/1839465127 shutdown_connections 2024-05-09T00:11:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.306+0000 7f6aa0540700 1 --2- 172.21.15.81:0/1839465127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a98105180 0x7f6a9810cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.306+0000 7f6aa0540700 1 --2- 172.21.15.81:0/1839465127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a98100060 0x7f6a98100440 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.306+0000 7f6aa0540700 1 --2- 172.21.15.81:0/1839465127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a98100a10 0x7f6a98104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.306+0000 7f6aa0540700 1 -- 172.21.15.81:0/1839465127 >> 172.21.15.81:0/1839465127 conn(0x7f6a98076f70 msgr2=0x7f6a98077380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.306+0000 7f6aa0540700 1 -- 172.21.15.81:0/1839465127 shutdown_connections 2024-05-09T00:11:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.306+0000 7f6aa0540700 1 -- 172.21.15.81:0/1839465127 wait complete. 2024-05-09T00:11:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6aa0540700 1 Processor -- start 2024-05-09T00:11:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6aa0540700 1 -- start start 2024-05-09T00:11:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6aa0540700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a98100060 0x7f6a981973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6aa0540700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a98105180 0x7f6a98197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6aa0540700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a9819bcb0 0x7f6a9819c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6aa0540700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9819c730 con 0x7f6a98105180 2024-05-09T00:11:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6aa0540700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9819c8a0 con 0x7f6a9819bcb0 2024-05-09T00:11:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6aa0540700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9819ca60 con 0x7f6a98100060 2024-05-09T00:11:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6a9dadb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a98105180 0x7f6a98197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6a9dadb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a98105180 0x7f6a98197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59640/0 (socket says 172.21.15.81:59640) 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6a9dadb700 1 -- 172.21.15.81:0/4213965364 learned_addr learned my addr 172.21.15.81:0/4213965364 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6a9e2dc700 1 --2- 172.21.15.81:0/4213965364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a98100060 0x7f6a981973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6a9eadd700 1 --2- 172.21.15.81:0/4213965364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a9819bcb0 0x7f6a9819c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6a9dadb700 1 -- 172.21.15.81:0/4213965364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a98100060 msgr2=0x7f6a981973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6a9dadb700 1 --2- 172.21.15.81:0/4213965364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a98100060 0x7f6a981973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6a9dadb700 1 -- 172.21.15.81:0/4213965364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a9819bcb0 msgr2=0x7f6a9819c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6a9dadb700 1 --2- 172.21.15.81:0/4213965364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a9819bcb0 0x7f6a9819c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.307+0000 7f6a9dadb700 1 -- 172.21.15.81:0/4213965364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a880095f0 con 0x7f6a98105180 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.308+0000 7f6a9dadb700 1 --2- 172.21.15.81:0/4213965364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a98105180 0x7f6a98197910 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400d980 tx=0x7f6a9400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.308+0000 7f6a8f7fe700 1 -- 172.21.15.81:0/4213965364 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94009930 con 0x7f6a98105180 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.308+0000 7f6a8f7fe700 1 -- 172.21.15.81:0/4213965364 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a94010460 con 0x7f6a98105180 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.308+0000 7f6aa0540700 1 -- 172.21.15.81:0/4213965364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a981a3fc0 con 0x7f6a98105180 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.308+0000 7f6a8f7fe700 1 -- 172.21.15.81:0/4213965364 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400f620 con 0x7f6a98105180 2024-05-09T00:11:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.308+0000 7f6aa0540700 1 -- 172.21.15.81:0/4213965364 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a981a4440 con 0x7f6a98105180 2024-05-09T00:11:14.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.310+0000 7f6a8f7fe700 1 -- 172.21.15.81:0/4213965364 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6a940108d0 con 0x7f6a98105180 2024-05-09T00:11:14.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.310+0000 7f6a8f7fe700 1 --2- 172.21.15.81:0/4213965364 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6a840a1310 0x7f6a840a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.311+0000 7f6a9e2dc700 1 --2- 172.21.15.81:0/4213965364 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6a840a1310 0x7f6a840a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.311+0000 7f6a8f7fe700 1 -- 172.21.15.81:0/4213965364 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f6a940cc800 con 0x7f6a98105180 2024-05-09T00:11:14.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.311+0000 7f6a9e2dc700 1 --2- 172.21.15.81:0/4213965364 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6a840a1310 0x7f6a840a37d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800b5c0 tx=0x7f6a88005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.311+0000 7f6aac6fab80 1 Processor -- start 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6aac6fab80 1 -- start start 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6aac6fab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee788fe00 0x55eee78901e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6aac6fab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee7890720 0x55eee788a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6aac6fab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788a890 0x55eee788acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6aac6fab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee77e1150 con 0x55eee788fe00 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6aac6fab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee77deb10 con 0x55eee7890720 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6aac6fab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee77da400 con 0x55eee788a890 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6a9e2dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee788fe00 0x55eee78901e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6a9e2dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee788fe00 0x55eee78901e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59642/0 (socket says 172.21.15.81:59642) 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6a9e2dc700 1 -- 172.21.15.81:0/792177339 learned_addr learned my addr 172.21.15.81:0/792177339 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6a9eadd700 1 --2- 172.21.15.81:0/792177339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788a890 0x55eee788acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6a9e2dc700 1 -- 172.21.15.81:0/792177339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788a890 msgr2=0x55eee788acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6a9dadb700 1 --2- 172.21.15.81:0/792177339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee7890720 0x55eee788a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6a9e2dc700 1 --2- 172.21.15.81:0/792177339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788a890 0x55eee788acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6a9e2dc700 1 -- 172.21.15.81:0/792177339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee7890720 msgr2=0x55eee788a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6a9e2dc700 1 --2- 172.21.15.81:0/792177339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee7890720 0x55eee788a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6a9e2dc700 1 -- 172.21.15.81:0/792177339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eee765b3b0 con 0x55eee788fe00 2024-05-09T00:11:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.312+0000 7f6a9e2dc700 1 --2- 172.21.15.81:0/792177339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee788fe00 0x55eee78901e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f6a88005370 tx=0x7f6a88020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d93a5c45ab4bf9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.313+0000 7f6a8cff9700 1 -- 172.21.15.81:0/792177339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800be00 con 0x55eee788fe00 2024-05-09T00:11:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.313+0000 7f6a8cff9700 1 -- 172.21.15.81:0/792177339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a8801e040 con 0x55eee788fe00 2024-05-09T00:11:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.313+0000 7f6a8cff9700 1 -- 172.21.15.81:0/792177339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800f6a0 con 0x55eee788fe00 2024-05-09T00:11:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.313+0000 7f6aac6fab80 1 -- 172.21.15.81:0/792177339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee788fe00 msgr2=0x55eee78901e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.313+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/792177339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee788fe00 0x55eee78901e0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f6a88005370 tx=0x7f6a88020000 comp rx=0 tx=0).stop 2024-05-09T00:11:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.313+0000 7f6aac6fab80 1 -- 172.21.15.81:0/792177339 shutdown_connections 2024-05-09T00:11:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.313+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/792177339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788a890 0x55eee788acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.313+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/792177339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee788fe00 0x55eee78901e0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.313+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/792177339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee7890720 0x55eee788a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.313+0000 7f6aac6fab80 1 -- 172.21.15.81:0/792177339 >> 172.21.15.81:0/792177339 conn(0x55eee77e8210 msgr2=0x55eee7884df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.313+0000 7f6aac6fab80 1 -- 172.21.15.81:0/792177339 shutdown_connections 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.313+0000 7f6aac6fab80 1 -- 172.21.15.81:0/792177339 wait complete. 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.314+0000 7f6aac6fab80 1 -- start start 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.314+0000 7f6aac6fab80 1 Processor -- start 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.314+0000 7f6aac6fab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788a890 0x55eee7893aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.314+0000 7f6aac6fab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788fe00 0x55eee7893fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.314+0000 7f6aac6fab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee7890720 0x55eee7894520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.314+0000 7f6aac6fab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee7776560 con 0x55eee7890720 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.314+0000 7f6aac6fab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee7776200 con 0x55eee788fe00 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.314+0000 7f6aac6fab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee765d6a0 con 0x55eee788a890 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.314+0000 7f6aac6fab80 10 client.0 _ll_register_callbacks cb 0x55eee777fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.314+0000 7f6a9eadd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee7890720 0x55eee7894520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.314+0000 7f6a9eadd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee7890720 0x55eee7894520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59658/0 (socket says 172.21.15.81:59658) 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.314+0000 7f6a9eadd700 1 -- 172.21.15.81:0/389686266 learned_addr learned my addr 172.21.15.81:0/389686266 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6a9e2dc700 1 --2- 172.21.15.81:0/389686266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788a890 0x55eee7893aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6a9dadb700 1 --2- 172.21.15.81:0/389686266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788fe00 0x55eee7893fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6a9eadd700 1 -- 172.21.15.81:0/389686266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788a890 msgr2=0x55eee7893aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6a9eadd700 1 --2- 172.21.15.81:0/389686266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788a890 0x55eee7893aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6a9eadd700 1 -- 172.21.15.81:0/389686266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788fe00 msgr2=0x55eee7893fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6a9eadd700 1 --2- 172.21.15.81:0/389686266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788fe00 0x55eee7893fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6a9eadd700 1 -- 172.21.15.81:0/389686266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9810d570 con 0x55eee7890720 2024-05-09T00:11:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6a9eadd700 1 --2- 172.21.15.81:0/389686266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee7890720 0x55eee7894520 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007a80 tx=0x7f6a90007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec1fbce27eedcfd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6a81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6a81ffb700 1 -- 172.21.15.81:0/389686266 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a900118d0 con 0x55eee7890720 2024-05-09T00:11:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6a81ffb700 1 -- 172.21.15.81:0/389686266 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f6a90011a30 con 0x55eee7890720 2024-05-09T00:11:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6aac6fab80 1 -- 172.21.15.81:0/389686266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eee7733270 con 0x55eee7890720 2024-05-09T00:11:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6a81ffb700 1 -- 172.21.15.81:0/389686266 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a90011bf0 con 0x55eee7890720 2024-05-09T00:11:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6aac6fab80 10 client.17799 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6aac6fab80 1 -- 172.21.15.81:0/389686266 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55eee7607b60 con 0x55eee7890720 2024-05-09T00:11:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6a81ffb700 1 -- 172.21.15.81:0/389686266 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55eee7733270 con 0x55eee7890720 2024-05-09T00:11:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6a81ffb700 1 -- 172.21.15.81:0/389686266 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6a90014070 con 0x55eee7890720 2024-05-09T00:11:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6aac6fab80 10 client.17799 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6aac6fab80 10 client.17799 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:11:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6aac6fab80 20 client.17799 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/389686266 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55eee78a4240 0x55eee78a6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.315+0000 7f6aac6fab80 4 client.17799 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.316+0000 7f6aac6fab80 1 -- 172.21.15.81:0/389686266 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eee7859810 con 0x55eee78a4240 2024-05-09T00:11:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.316+0000 7f6a9e2dc700 1 --2- 172.21.15.81:0/389686266 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55eee78a4240 0x55eee78a6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.316+0000 7f6a81ffb700 10 client.17799 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:11:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.316+0000 7f6a9e2dc700 1 --2- 172.21.15.81:0/389686266 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55eee78a4240 0x55eee78a6660 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=65ae9d093ed6b025 server_cookie=5d54608b27ccb128 in_seq=0 out_seq=0 2024-05-09T00:11:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6a81ffb700 1 -- 172.21.15.81:0/389686266 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55eee7859810 con 0x55eee78a4240 2024-05-09T00:11:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6a81ffb700 10 client.17799 handle_command_reply: tid=0 2024-05-09T00:11:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6aac6fab80 1 client.17799 shutdown 2024-05-09T00:11:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6aac6fab80 1 -- 172.21.15.81:0/389686266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee7890720 msgr2=0x55eee7894520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/389686266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee7890720 0x55eee7894520 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007a80 tx=0x7f6a90007e40 comp rx=0 tx=0).stop 2024-05-09T00:11:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6aac6fab80 1 -- 172.21.15.81:0/389686266 shutdown_connections 2024-05-09T00:11:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/389686266 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55eee78a4240 0x55eee78a6660 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/389686266 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee7890720 0x55eee7894520 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/389686266 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788a890 0x55eee7893aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/389686266 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788fe00 0x55eee7893fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6a81ffb700 0 client.17799 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:11:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6aac6fab80 1 -- 172.21.15.81:0/389686266 >> 172.21.15.81:0/389686266 conn(0x55eee77e8210 msgr2=0x55eee78845a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6aac6fab80 1 -- 172.21.15.81:0/389686266 shutdown_connections 2024-05-09T00:11:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6aac6fab80 1 -- 172.21.15.81:0/389686266 wait complete. 2024-05-09T00:11:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.317+0000 7f6aac6fab80 20 client.17799 trim_cache size 0 max 16384 2024-05-09T00:11:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.330+0000 7f6aac6fab80 1 Processor -- start 2024-05-09T00:11:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.330+0000 7f6aac6fab80 1 -- start start 2024-05-09T00:11:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.330+0000 7f6aac6fab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788a890 0x55eee788a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.330+0000 7f6aac6fab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788fe00 0x55eee788f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.330+0000 7f6aac6fab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee7890720 0x55eee7893380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.330+0000 7f6aac6fab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee7881dc0 con 0x55eee7890720 2024-05-09T00:11:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.330+0000 7f6aac6fab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee7886020 con 0x55eee788a890 2024-05-09T00:11:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.330+0000 7f6aac6fab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee78ab870 con 0x55eee788fe00 2024-05-09T00:11:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a9eadd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee7890720 0x55eee7893380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a9eadd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee7890720 0x55eee7893380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59666/0 (socket says 172.21.15.81:59666) 2024-05-09T00:11:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a9eadd700 1 -- 172.21.15.81:0/424515221 learned_addr learned my addr 172.21.15.81:0/424515221 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a9e2dc700 1 --2- 172.21.15.81:0/424515221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788a890 0x55eee788a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a9dadb700 1 --2- 172.21.15.81:0/424515221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788fe00 0x55eee788f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a9eadd700 1 -- 172.21.15.81:0/424515221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788fe00 msgr2=0x55eee788f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a9eadd700 1 --2- 172.21.15.81:0/424515221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788fe00 0x55eee788f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a9eadd700 1 -- 172.21.15.81:0/424515221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788a890 msgr2=0x55eee788a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a9eadd700 1 --2- 172.21.15.81:0/424515221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788a890 0x55eee788a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a9eadd700 1 -- 172.21.15.81:0/424515221 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eee77a0560 con 0x55eee7890720 2024-05-09T00:11:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a9dadb700 1 --2- 172.21.15.81:0/424515221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788fe00 0x55eee788f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a9e2dc700 1 --2- 172.21.15.81:0/424515221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788a890 0x55eee788a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a9eadd700 1 --2- 172.21.15.81:0/424515221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee7890720 0x55eee7893380 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007a50 tx=0x7f6a900095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32890fcebedd309 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a8d7fa700 1 -- 172.21.15.81:0/424515221 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a900114b0 con 0x55eee7890720 2024-05-09T00:11:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a8d7fa700 1 -- 172.21.15.81:0/424515221 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a9000f050 con 0x55eee7890720 2024-05-09T00:11:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.331+0000 7f6a8d7fa700 1 -- 172.21.15.81:0/424515221 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90011ea0 con 0x55eee7890720 2024-05-09T00:11:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 -- 172.21.15.81:0/424515221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee7890720 msgr2=0x55eee7893380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/424515221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee7890720 0x55eee7893380 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f6a90007a50 tx=0x7f6a900095e0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 -- 172.21.15.81:0/424515221 shutdown_connections 2024-05-09T00:11:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/424515221 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788a890 0x55eee788a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/424515221 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee7890720 0x55eee7893380 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/424515221 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee788fe00 0x55eee788f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 -- 172.21.15.81:0/424515221 >> 172.21.15.81:0/424515221 conn(0x55eee77e8210 msgr2=0x55eee7890bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 -- 172.21.15.81:0/424515221 shutdown_connections 2024-05-09T00:11:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 -- 172.21.15.81:0/424515221 wait complete. 2024-05-09T00:11:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 -- start start 2024-05-09T00:11:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 Processor -- start 2024-05-09T00:11:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788a890 0x55eee78992e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee788fe00 0x55eee7899820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee7890720 0x55eee78f9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee78f9c80 con 0x55eee788fe00 2024-05-09T00:11:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee78f9dc0 con 0x55eee788a890 2024-05-09T00:11:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eee78f9f50 con 0x55eee7890720 2024-05-09T00:11:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6aac6fab80 10 client.0 _ll_register_callbacks cb 0x55eee777fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6a9dadb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee788fe00 0x55eee7899820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6a9dadb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee788fe00 0x55eee7899820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59672/0 (socket says 172.21.15.81:59672) 2024-05-09T00:11:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.332+0000 7f6a9dadb700 1 -- 172.21.15.81:0/1207689241 learned_addr learned my addr 172.21.15.81:0/1207689241 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a9e2dc700 1 --2- 172.21.15.81:0/1207689241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788a890 0x55eee78992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a9eadd700 1 --2- 172.21.15.81:0/1207689241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee7890720 0x55eee78f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a9dadb700 1 -- 172.21.15.81:0/1207689241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee7890720 msgr2=0x55eee78f9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a9dadb700 1 --2- 172.21.15.81:0/1207689241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee7890720 0x55eee78f9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a9dadb700 1 -- 172.21.15.81:0/1207689241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788a890 msgr2=0x55eee78992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a9dadb700 1 --2- 172.21.15.81:0/1207689241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788a890 0x55eee78992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a9dadb700 1 -- 172.21.15.81:0/1207689241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eee7607b60 con 0x55eee788fe00 2024-05-09T00:11:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a9eadd700 1 --2- 172.21.15.81:0/1207689241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee7890720 0x55eee78f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a9dadb700 1 --2- 172.21.15.81:0/1207689241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee788fe00 0x55eee7899820 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009520 tx=0x7f6a940992d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d132739549d7b40 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a81ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a81ffb700 1 -- 172.21.15.81:0/1207689241 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a940b92b0 con 0x55eee788fe00 2024-05-09T00:11:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a81ffb700 1 -- 172.21.15.81:0/1207689241 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f6a940a1d00 con 0x55eee788fe00 2024-05-09T00:11:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6aac6fab80 1 -- 172.21.15.81:0/1207689241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a8801e040 con 0x55eee788fe00 2024-05-09T00:11:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a81ffb700 1 -- 172.21.15.81:0/1207689241 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a940ca350 con 0x55eee788fe00 2024-05-09T00:11:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6aac6fab80 10 client.17805 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6aac6fab80 1 -- 172.21.15.81:0/1207689241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55eee765fcd0 con 0x55eee788fe00 2024-05-09T00:11:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a81ffb700 1 -- 172.21.15.81:0/1207689241 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a8801e040 con 0x55eee788fe00 2024-05-09T00:11:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6a81ffb700 1 -- 172.21.15.81:0/1207689241 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6a94098d70 con 0x55eee788fe00 2024-05-09T00:11:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6aac6fab80 10 client.17805 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6aac6fab80 10 client.17805 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:11:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.333+0000 7f6aac6fab80 20 client.17805 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.334+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/1207689241 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55eee78fb690 0x55eee78fdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.334+0000 7f6aac6fab80 4 client.17805 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:11:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.334+0000 7f6aac6fab80 1 -- 172.21.15.81:0/1207689241 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55eee77d2ec0 con 0x55eee78fb690 2024-05-09T00:11:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.334+0000 7f6a9e2dc700 1 --2- 172.21.15.81:0/1207689241 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55eee78fb690 0x55eee78fdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.334+0000 7f6a81ffb700 10 client.17805 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:11:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.334+0000 7f6a9e2dc700 1 --2- 172.21.15.81:0/1207689241 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55eee78fb690 0x55eee78fdab0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=28af2050e0297772 server_cookie=69109f02602df23d in_seq=0 out_seq=0 2024-05-09T00:11:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.334+0000 7f6a81ffb700 1 -- 172.21.15.81:0/1207689241 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55eee77d2ec0 con 0x55eee78fb690 2024-05-09T00:11:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.334+0000 7f6a81ffb700 10 client.17805 handle_command_reply: tid=0 2024-05-09T00:11:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.334+0000 7f6aac6fab80 1 client.17805 shutdown 2024-05-09T00:11:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.334+0000 7f6aac6fab80 1 -- 172.21.15.81:0/1207689241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee788fe00 msgr2=0x55eee7899820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.334+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/1207689241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee788fe00 0x55eee7899820 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009520 tx=0x7f6a940992d0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aac6fab80 1 -- 172.21.15.81:0/1207689241 shutdown_connections 2024-05-09T00:11:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/1207689241 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55eee78fb690 0x55eee78fdab0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/1207689241 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55eee788a890 0x55eee78992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/1207689241 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55eee7890720 0x55eee78f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6a81ffb700 0 client.17805 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:11:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aac6fab80 1 --2- 172.21.15.81:0/1207689241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55eee788fe00 0x55eee7899820 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aac6fab80 1 -- 172.21.15.81:0/1207689241 >> 172.21.15.81:0/1207689241 conn(0x55eee77e8210 msgr2=0x55eee788f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aac6fab80 1 -- 172.21.15.81:0/1207689241 shutdown_connections 2024-05-09T00:11:14.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aac6fab80 1 -- 172.21.15.81:0/1207689241 wait complete. 2024-05-09T00:11:14.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aac6fab80 20 client.17805 trim_cache size 0 max 16384 2024-05-09T00:11:14.339 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:11:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aa0540700 1 -- 172.21.15.81:0/4213965364 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6a840a1310 msgr2=0x7f6a840a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aa0540700 1 --2- 172.21.15.81:0/4213965364 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6a840a1310 0x7f6a840a37d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800b5c0 tx=0x7f6a88005960 comp rx=0 tx=0).stop 2024-05-09T00:11:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aa0540700 1 -- 172.21.15.81:0/4213965364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a98105180 msgr2=0x7f6a98197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aa0540700 1 --2- 172.21.15.81:0/4213965364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a98105180 0x7f6a98197910 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f6a9400d980 tx=0x7f6a9400dc90 comp rx=0 tx=0).stop 2024-05-09T00:11:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aa0540700 1 -- 172.21.15.81:0/4213965364 shutdown_connections 2024-05-09T00:11:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aa0540700 1 --2- 172.21.15.81:0/4213965364 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6a840a1310 0x7f6a840a37d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aa0540700 1 --2- 172.21.15.81:0/4213965364 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6a9819bcb0 0x7f6a9819c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aa0540700 1 --2- 172.21.15.81:0/4213965364 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a98100060 0x7f6a981973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aa0540700 1 --2- 172.21.15.81:0/4213965364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a98105180 0x7f6a98197910 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aa0540700 1 -- 172.21.15.81:0/4213965364 >> 172.21.15.81:0/4213965364 conn(0x7f6a98076f70 msgr2=0x7f6a980fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aa0540700 1 -- 172.21.15.81:0/4213965364 shutdown_connections 2024-05-09T00:11:14.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.335+0000 7f6aa0540700 1 -- 172.21.15.81:0/4213965364 wait complete. 2024-05-09T00:11:14.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:11:14.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.471+0000 7f68550ee700 1 -- 172.21.15.81:0/309437654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6850100060 msgr2=0x7f6850100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.471+0000 7f68550ee700 1 --2- 172.21.15.81:0/309437654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6850100060 0x7f6850100440 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f6844009990 tx=0x7f6844009ca0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.471+0000 7f68550ee700 1 -- 172.21.15.81:0/309437654 shutdown_connections 2024-05-09T00:11:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.471+0000 7f68550ee700 1 --2- 172.21.15.81:0/309437654 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6850105170 0x7f685010ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.471+0000 7f68550ee700 1 --2- 172.21.15.81:0/309437654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6850100060 0x7f6850100440 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.471+0000 7f68550ee700 1 --2- 172.21.15.81:0/309437654 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6850100a10 0x7f6850104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.471+0000 7f68550ee700 1 -- 172.21.15.81:0/309437654 >> 172.21.15.81:0/309437654 conn(0x7f6850076f30 msgr2=0x7f6850077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.471+0000 7f68550ee700 1 -- 172.21.15.81:0/309437654 shutdown_connections 2024-05-09T00:11:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.471+0000 7f68550ee700 1 -- 172.21.15.81:0/309437654 wait complete. 2024-05-09T00:11:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.472+0000 7f68550ee700 1 Processor -- start 2024-05-09T00:11:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.472+0000 7f68550ee700 1 -- start start 2024-05-09T00:11:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.472+0000 7f68550ee700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6850100060 0x7f6850101ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.472+0000 7f68550ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6850105170 0x7f6850102020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.472+0000 7f68550ee700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6850102560 0x7f68501a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.472+0000 7f68550ee700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68501a5b90 con 0x7f6850105170 2024-05-09T00:11:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.472+0000 7f68550ee700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68501a5d00 con 0x7f6850102560 2024-05-09T00:11:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.472+0000 7f68550ee700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68501a5ec0 con 0x7f6850100060 2024-05-09T00:11:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.472+0000 7f684e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6850105170 0x7f6850102020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.472+0000 7f684e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6850105170 0x7f6850102020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59702/0 (socket says 172.21.15.81:59702) 2024-05-09T00:11:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.472+0000 7f684e59c700 1 -- 172.21.15.81:0/3733904066 learned_addr learned my addr 172.21.15.81:0/3733904066 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.472+0000 7f684ed9d700 1 --2- 172.21.15.81:0/3733904066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6850100060 0x7f6850101ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.472+0000 7f684f59e700 1 --2- 172.21.15.81:0/3733904066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6850102560 0x7f68501a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.473+0000 7f684e59c700 1 -- 172.21.15.81:0/3733904066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6850100060 msgr2=0x7f6850101ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.473+0000 7f684e59c700 1 --2- 172.21.15.81:0/3733904066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6850100060 0x7f6850101ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.473+0000 7f684e59c700 1 -- 172.21.15.81:0/3733904066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6850102560 msgr2=0x7f68501a55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.473+0000 7f684e59c700 1 --2- 172.21.15.81:0/3733904066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6850102560 0x7f68501a55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.473+0000 7f684e59c700 1 -- 172.21.15.81:0/3733904066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68440095f0 con 0x7f6850105170 2024-05-09T00:11:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.473+0000 7f684e59c700 1 --2- 172.21.15.81:0/3733904066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6850105170 0x7f6850102020 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f684000d980 tx=0x7f684000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.473+0000 7f6837fff700 1 -- 172.21.15.81:0/3733904066 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840009930 con 0x7f6850105170 2024-05-09T00:11:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.473+0000 7f68550ee700 1 -- 172.21.15.81:0/3733904066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68501a61a0 con 0x7f6850105170 2024-05-09T00:11:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.473+0000 7f6837fff700 1 -- 172.21.15.81:0/3733904066 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6840010460 con 0x7f6850105170 2024-05-09T00:11:14.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.473+0000 7f6837fff700 1 -- 172.21.15.81:0/3733904066 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f684000f620 con 0x7f6850105170 2024-05-09T00:11:14.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.473+0000 7f68550ee700 1 -- 172.21.15.81:0/3733904066 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68501a66b0 con 0x7f6850105170 2024-05-09T00:11:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.475+0000 7f6837fff700 1 -- 172.21.15.81:0/3733904066 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f68400108d0 con 0x7f6850105170 2024-05-09T00:11:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.476+0000 7f6837fff700 1 --2- 172.21.15.81:0/3733904066 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f68380a1290 0x7f68380a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.476+0000 7f6837fff700 1 -- 172.21.15.81:0/3733904066 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f68400cc820 con 0x7f6850105170 2024-05-09T00:11:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.476+0000 7f684ed9d700 1 --2- 172.21.15.81:0/3733904066 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f68380a1290 0x7f68380a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.476+0000 7f684ed9d700 1 --2- 172.21.15.81:0/3733904066 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f68380a1290 0x7f68380a3750 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f684400b5c0 tx=0x7f6844005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f68612a8b80 1 Processor -- start 2024-05-09T00:11:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f68612a8b80 1 -- start start 2024-05-09T00:11:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f68612a8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd97e00 0x5629dfd981e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f68612a8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd98720 0x5629dfd92350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f68612a8b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd92890 0x5629dfd92cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f68612a8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629dfce9150 con 0x5629dfd98720 2024-05-09T00:11:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f68612a8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629dfce6b10 con 0x5629dfd97e00 2024-05-09T00:11:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f68612a8b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629dfce2400 con 0x5629dfd92890 2024-05-09T00:11:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f684e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd98720 0x5629dfd92350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f684e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd98720 0x5629dfd92350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59712/0 (socket says 172.21.15.81:59712) 2024-05-09T00:11:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f684e59c700 1 -- 172.21.15.81:0/2279154350 learned_addr learned my addr 172.21.15.81:0/2279154350 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f684ed9d700 1 --2- 172.21.15.81:0/2279154350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd97e00 0x5629dfd981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f684f59e700 1 --2- 172.21.15.81:0/2279154350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd92890 0x5629dfd92cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f684e59c700 1 -- 172.21.15.81:0/2279154350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd92890 msgr2=0x5629dfd92cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f684e59c700 1 --2- 172.21.15.81:0/2279154350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd92890 0x5629dfd92cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f684e59c700 1 -- 172.21.15.81:0/2279154350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd97e00 msgr2=0x5629dfd981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f684e59c700 1 --2- 172.21.15.81:0/2279154350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd97e00 0x5629dfd981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f684e59c700 1 -- 172.21.15.81:0/2279154350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629dfb633b0 con 0x5629dfd98720 2024-05-09T00:11:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f684ed9d700 1 --2- 172.21.15.81:0/2279154350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd97e00 0x5629dfd981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.477+0000 7f684e59c700 1 --2- 172.21.15.81:0/2279154350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd98720 0x5629dfd92350 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f68400a17f0 tx=0x7f684009a090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46827a98a674c881 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.478+0000 7f68357fa700 1 -- 172.21.15.81:0/2279154350 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68400a1d20 con 0x5629dfd98720 2024-05-09T00:11:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.478+0000 7f68357fa700 1 -- 172.21.15.81:0/2279154350 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68400b7e90 con 0x5629dfd98720 2024-05-09T00:11:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.478+0000 7f68357fa700 1 -- 172.21.15.81:0/2279154350 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840098ff0 con 0x5629dfd98720 2024-05-09T00:11:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.478+0000 7f68612a8b80 1 -- 172.21.15.81:0/2279154350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd98720 msgr2=0x5629dfd92350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.478+0000 7f68612a8b80 1 --2- 172.21.15.81:0/2279154350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd98720 0x5629dfd92350 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f68400a17f0 tx=0x7f684009a090 comp rx=0 tx=0).stop 2024-05-09T00:11:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.478+0000 7f68612a8b80 1 -- 172.21.15.81:0/2279154350 shutdown_connections 2024-05-09T00:11:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.478+0000 7f68612a8b80 1 --2- 172.21.15.81:0/2279154350 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd97e00 0x5629dfd981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.478+0000 7f68612a8b80 1 --2- 172.21.15.81:0/2279154350 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd92890 0x5629dfd92cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.478+0000 7f68612a8b80 1 --2- 172.21.15.81:0/2279154350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd98720 0x5629dfd92350 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.478+0000 7f68612a8b80 1 -- 172.21.15.81:0/2279154350 >> 172.21.15.81:0/2279154350 conn(0x5629dfcf0210 msgr2=0x5629dfd8cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.478+0000 7f68612a8b80 1 -- 172.21.15.81:0/2279154350 shutdown_connections 2024-05-09T00:11:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.478+0000 7f68612a8b80 1 -- 172.21.15.81:0/2279154350 wait complete. 2024-05-09T00:11:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f68612a8b80 1 -- start start 2024-05-09T00:11:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f68612a8b80 1 Processor -- start 2024-05-09T00:11:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f68612a8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd92890 0x5629dfd9bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f68612a8b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd97e00 0x5629dfd9c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f68612a8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 0x5629dfd9c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f68612a8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629dfc7e560 con 0x5629dfd92890 2024-05-09T00:11:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f68612a8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629dfc7e200 con 0x5629dfd98720 2024-05-09T00:11:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f68612a8b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629dfb656a0 con 0x5629dfd97e00 2024-05-09T00:11:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f68612a8b80 10 client.0 _ll_register_callbacks cb 0x5629dfc87b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:14.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f684ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd92890 0x5629dfd9bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f684ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd92890 0x5629dfd9bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59722/0 (socket says 172.21.15.81:59722) 2024-05-09T00:11:14.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f684ed9d700 1 -- 172.21.15.81:0/3500144294 learned_addr learned my addr 172.21.15.81:0/3500144294 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f684e59c700 1 --2- 172.21.15.81:0/3500144294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd97e00 0x5629dfd9c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f684f59e700 1 --2- 172.21.15.81:0/3500144294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 0x5629dfd9c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f684ed9d700 1 -- 172.21.15.81:0/3500144294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd97e00 msgr2=0x5629dfd9c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f684ed9d700 1 --2- 172.21.15.81:0/3500144294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd97e00 0x5629dfd9c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f684ed9d700 1 -- 172.21.15.81:0/3500144294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 msgr2=0x5629dfd9c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f684ed9d700 1 --2- 172.21.15.81:0/3500144294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 0x5629dfd9c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f684ed9d700 1 -- 172.21.15.81:0/3500144294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68501a66b0 con 0x5629dfd92890 2024-05-09T00:11:14.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f684ed9d700 1 --2- 172.21.15.81:0/3500144294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd92890 0x5629dfd9bad0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f6844015000 tx=0x7f684401a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d929b851218c06 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.479+0000 7f6832ff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:14.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f6832ff5700 1 -- 172.21.15.81:0/3500144294 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6844005220 con 0x5629dfd92890 2024-05-09T00:11:14.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f6832ff5700 1 -- 172.21.15.81:0/3500144294 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f68440048e0 con 0x5629dfd92890 2024-05-09T00:11:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f68612a8b80 1 -- 172.21.15.81:0/3500144294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5629dfc3b270 con 0x5629dfd92890 2024-05-09T00:11:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f6832ff5700 1 -- 172.21.15.81:0/3500144294 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6844004aa0 con 0x5629dfd92890 2024-05-09T00:11:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f68612a8b80 10 client.17817 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f68612a8b80 1 -- 172.21.15.81:0/3500144294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5629dfb0fb60 con 0x5629dfd92890 2024-05-09T00:11:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f6832ff5700 1 -- 172.21.15.81:0/3500144294 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f684403d020 con 0x5629dfd92890 2024-05-09T00:11:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f6832ff5700 1 -- 172.21.15.81:0/3500144294 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6844030420 con 0x5629dfd92890 2024-05-09T00:11:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f68612a8b80 10 client.17817 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f68612a8b80 10 client.17817 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f68612a8b80 20 client.17817 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f68612a8b80 1 --2- 172.21.15.81:0/3500144294 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5629dfdac190 0x5629dfdae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f68612a8b80 4 client.17817 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f68612a8b80 1 -- 172.21.15.81:0/3500144294 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629dfd61810 con 0x5629dfdac190 2024-05-09T00:11:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.480+0000 7f684e59c700 1 --2- 172.21.15.81:0/3500144294 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5629dfdac190 0x5629dfdae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.481+0000 7f684e59c700 1 --2- 172.21.15.81:0/3500144294 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5629dfdac190 0x5629dfdae5b0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ed76917050d83b6 server_cookie=7b0d9dd209b3db2b in_seq=0 out_seq=0 2024-05-09T00:11:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.481+0000 7f6832ff5700 10 client.17817 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.482+0000 7f6832ff5700 1 -- 172.21.15.81:0/3500144294 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5629dfd61810 con 0x5629dfdac190 2024-05-09T00:11:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.482+0000 7f6832ff5700 10 client.17817 handle_command_reply: tid=0 2024-05-09T00:11:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.482+0000 7f68612a8b80 1 client.17817 shutdown 2024-05-09T00:11:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.482+0000 7f68612a8b80 1 -- 172.21.15.81:0/3500144294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd92890 msgr2=0x5629dfd9bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.482+0000 7f68612a8b80 1 --2- 172.21.15.81:0/3500144294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd92890 0x5629dfd9bad0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f6844015000 tx=0x7f684401a050 comp rx=0 tx=0).stop 2024-05-09T00:11:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.482+0000 7f68612a8b80 1 -- 172.21.15.81:0/3500144294 shutdown_connections 2024-05-09T00:11:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.482+0000 7f68612a8b80 1 --2- 172.21.15.81:0/3500144294 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5629dfdac190 0x5629dfdae5b0 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.483+0000 7f6832ff5700 0 client.17817 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.482+0000 7f68612a8b80 1 --2- 172.21.15.81:0/3500144294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 0x5629dfd9c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.483+0000 7f68612a8b80 1 --2- 172.21.15.81:0/3500144294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd92890 0x5629dfd9bad0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.483+0000 7f68612a8b80 1 --2- 172.21.15.81:0/3500144294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd97e00 0x5629dfd9c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.483+0000 7f68612a8b80 1 -- 172.21.15.81:0/3500144294 >> 172.21.15.81:0/3500144294 conn(0x5629dfcf0210 msgr2=0x5629dfd8c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.483+0000 7f68612a8b80 1 -- 172.21.15.81:0/3500144294 shutdown_connections 2024-05-09T00:11:14.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.483+0000 7f68612a8b80 1 -- 172.21.15.81:0/3500144294 wait complete. 2024-05-09T00:11:14.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.483+0000 7f68612a8b80 20 client.17817 trim_cache size 0 max 16384 2024-05-09T00:11:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.496+0000 7f68612a8b80 1 Processor -- start 2024-05-09T00:11:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.496+0000 7f68612a8b80 1 -- start start 2024-05-09T00:11:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.496+0000 7f68612a8b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd92890 0x5629dfd92350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.496+0000 7f68612a8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd97e00 0x5629dfda7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.496+0000 7f68612a8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 0x5629dfd8cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.496+0000 7f68612a8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629dfd8e810 con 0x5629dfd97e00 2024-05-09T00:11:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.496+0000 7f68612a8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629dfd87a90 con 0x5629dfd98720 2024-05-09T00:11:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.496+0000 7f68612a8b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629dfdb37b0 con 0x5629dfd92890 2024-05-09T00:11:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.496+0000 7f684e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd97e00 0x5629dfda7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.496+0000 7f684e59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd97e00 0x5629dfda7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59726/0 (socket says 172.21.15.81:59726) 2024-05-09T00:11:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.496+0000 7f684e59c700 1 -- 172.21.15.81:0/3667343408 learned_addr learned my addr 172.21.15.81:0/3667343408 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.497+0000 7f684ed9d700 1 --2- 172.21.15.81:0/3667343408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd92890 0x5629dfd92350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.497+0000 7f684f59e700 1 --2- 172.21.15.81:0/3667343408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 0x5629dfd8cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.497+0000 7f684e59c700 1 -- 172.21.15.81:0/3667343408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd92890 msgr2=0x5629dfd92350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.497+0000 7f684e59c700 1 --2- 172.21.15.81:0/3667343408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd92890 0x5629dfd92350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.497+0000 7f684e59c700 1 -- 172.21.15.81:0/3667343408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 msgr2=0x5629dfd8cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.497+0000 7f684e59c700 1 --2- 172.21.15.81:0/3667343408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 0x5629dfd8cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.497+0000 7f684e59c700 1 -- 172.21.15.81:0/3667343408 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629dfca8560 con 0x5629dfd97e00 2024-05-09T00:11:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.497+0000 7f684e59c700 1 --2- 172.21.15.81:0/3667343408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd97e00 0x5629dfda7b60 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f684000d950 tx=0x7f6840010cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322fd1fefa48e77d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.497+0000 7f6835ffb700 1 -- 172.21.15.81:0/3667343408 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840097cc0 con 0x5629dfd97e00 2024-05-09T00:11:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.497+0000 7f6835ffb700 1 -- 172.21.15.81:0/3667343408 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6840095fb0 con 0x5629dfd97e00 2024-05-09T00:11:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.497+0000 7f6835ffb700 1 -- 172.21.15.81:0/3667343408 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6840099d60 con 0x5629dfd97e00 2024-05-09T00:11:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 -- 172.21.15.81:0/3667343408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd97e00 msgr2=0x5629dfda7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 --2- 172.21.15.81:0/3667343408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd97e00 0x5629dfda7b60 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f684000d950 tx=0x7f6840010cd0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 -- 172.21.15.81:0/3667343408 shutdown_connections 2024-05-09T00:11:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 --2- 172.21.15.81:0/3667343408 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 0x5629dfd8cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 --2- 172.21.15.81:0/3667343408 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd92890 0x5629dfd92350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 --2- 172.21.15.81:0/3667343408 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd97e00 0x5629dfda7b60 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 -- 172.21.15.81:0/3667343408 >> 172.21.15.81:0/3667343408 conn(0x5629dfcf0210 msgr2=0x5629dfd92c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 -- 172.21.15.81:0/3667343408 shutdown_connections 2024-05-09T00:11:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 -- 172.21.15.81:0/3667343408 wait complete. 2024-05-09T00:11:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 -- start start 2024-05-09T00:11:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 Processor -- start 2024-05-09T00:11:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd92890 0x5629dfdf65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd97e00 0x5629dfdf6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 0x5629dfe01660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629dfdf7400 con 0x5629dfd92890 2024-05-09T00:11:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629dfe01ba0 con 0x5629dfd98720 2024-05-09T00:11:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629dfe01ce0 con 0x5629dfd97e00 2024-05-09T00:11:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f68612a8b80 10 client.0 _ll_register_callbacks cb 0x5629dfc87b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.498+0000 7f684ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd92890 0x5629dfdf65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f684ed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd92890 0x5629dfdf65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59736/0 (socket says 172.21.15.81:59736) 2024-05-09T00:11:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f684ed9d700 1 -- 172.21.15.81:0/2388933704 learned_addr learned my addr 172.21.15.81:0/2388933704 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f684e59c700 1 --2- 172.21.15.81:0/2388933704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd97e00 0x5629dfdf6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f684f59e700 1 --2- 172.21.15.81:0/2388933704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 0x5629dfe01660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f684ed9d700 1 -- 172.21.15.81:0/2388933704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd97e00 msgr2=0x5629dfdf6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f684ed9d700 1 --2- 172.21.15.81:0/2388933704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd97e00 0x5629dfdf6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f684ed9d700 1 -- 172.21.15.81:0/2388933704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 msgr2=0x5629dfe01660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f684ed9d700 1 --2- 172.21.15.81:0/2388933704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 0x5629dfe01660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f684ed9d700 1 -- 172.21.15.81:0/2388933704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629dfb633b0 con 0x5629dfd92890 2024-05-09T00:11:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f684f59e700 1 --2- 172.21.15.81:0/2388933704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 0x5629dfe01660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f684ed9d700 1 --2- 172.21.15.81:0/2388933704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd92890 0x5629dfdf65e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f6844006010 tx=0x7f6844005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e5f1915d15a3c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f6832ff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f6832ff5700 1 -- 172.21.15.81:0/2388933704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6844030b20 con 0x5629dfd92890 2024-05-09T00:11:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f6832ff5700 1 -- 172.21.15.81:0/2388933704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f684403e080 con 0x5629dfd92890 2024-05-09T00:11:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f68612a8b80 1 -- 172.21.15.81:0/2388933704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f68400b7e90 con 0x5629dfd92890 2024-05-09T00:11:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f6832ff5700 1 -- 172.21.15.81:0/2388933704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68440049f0 con 0x5629dfd92890 2024-05-09T00:11:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f68612a8b80 10 client.17823 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f68612a8b80 1 -- 172.21.15.81:0/2388933704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5629dfb67cd0 con 0x5629dfd92890 2024-05-09T00:11:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.499+0000 7f6832ff5700 1 -- 172.21.15.81:0/2388933704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f684404f020 con 0x5629dfd92890 2024-05-09T00:11:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.500+0000 7f6832ff5700 1 -- 172.21.15.81:0/2388933704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f684400f460 con 0x5629dfd92890 2024-05-09T00:11:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.500+0000 7f68612a8b80 10 client.17823 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.500+0000 7f68612a8b80 10 client.17823 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.500+0000 7f68612a8b80 20 client.17823 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.500+0000 7f68612a8b80 1 --2- 172.21.15.81:0/2388933704 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5629dfe02f30 0x5629dfe05350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.500+0000 7f68612a8b80 4 client.17823 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:11:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.500+0000 7f68612a8b80 1 -- 172.21.15.81:0/2388933704 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5629dfcdaec0 con 0x5629dfe02f30 2024-05-09T00:11:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.500+0000 7f684e59c700 1 --2- 172.21.15.81:0/2388933704 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5629dfe02f30 0x5629dfe05350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.500+0000 7f6832ff5700 10 client.17823 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.500+0000 7f684e59c700 1 --2- 172.21.15.81:0/2388933704 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5629dfe02f30 0x5629dfe05350 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef8ce39c5736a898 server_cookie=21f894e2060b5579 in_seq=0 out_seq=0 2024-05-09T00:11:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.500+0000 7f6832ff5700 1 -- 172.21.15.81:0/2388933704 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5629dfcdaec0 con 0x5629dfe02f30 2024-05-09T00:11:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.500+0000 7f6832ff5700 10 client.17823 handle_command_reply: tid=0 2024-05-09T00:11:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68612a8b80 1 client.17823 shutdown 2024-05-09T00:11:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68612a8b80 1 -- 172.21.15.81:0/2388933704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd92890 msgr2=0x5629dfdf65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68612a8b80 1 --2- 172.21.15.81:0/2388933704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd92890 0x5629dfdf65e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f6844006010 tx=0x7f6844005c70 comp rx=0 tx=0).stop 2024-05-09T00:11:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68612a8b80 1 -- 172.21.15.81:0/2388933704 shutdown_connections 2024-05-09T00:11:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68612a8b80 1 --2- 172.21.15.81:0/2388933704 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5629dfe02f30 0x5629dfe05350 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68612a8b80 1 --2- 172.21.15.81:0/2388933704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5629dfd98720 0x5629dfe01660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f6832ff5700 0 client.17823 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68612a8b80 1 --2- 172.21.15.81:0/2388933704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5629dfd92890 0x5629dfdf65e0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68612a8b80 1 --2- 172.21.15.81:0/2388933704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5629dfd97e00 0x5629dfdf6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68612a8b80 1 -- 172.21.15.81:0/2388933704 >> 172.21.15.81:0/2388933704 conn(0x5629dfcf0210 msgr2=0x5629dfd95c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68612a8b80 1 -- 172.21.15.81:0/2388933704 shutdown_connections 2024-05-09T00:11:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68612a8b80 1 -- 172.21.15.81:0/2388933704 wait complete. 2024-05-09T00:11:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68612a8b80 20 client.17823 trim_cache size 0 max 16384 2024-05-09T00:11:14.505 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:11:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68550ee700 1 -- 172.21.15.81:0/3733904066 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f68380a1290 msgr2=0x7f68380a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68550ee700 1 --2- 172.21.15.81:0/3733904066 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f68380a1290 0x7f68380a3750 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f684400b5c0 tx=0x7f6844005960 comp rx=0 tx=0).stop 2024-05-09T00:11:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68550ee700 1 -- 172.21.15.81:0/3733904066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6850105170 msgr2=0x7f6850102020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68550ee700 1 --2- 172.21.15.81:0/3733904066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6850105170 0x7f6850102020 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f684000d980 tx=0x7f684000dc90 comp rx=0 tx=0).stop 2024-05-09T00:11:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68550ee700 1 -- 172.21.15.81:0/3733904066 shutdown_connections 2024-05-09T00:11:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68550ee700 1 --2- 172.21.15.81:0/3733904066 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f68380a1290 0x7f68380a3750 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68550ee700 1 --2- 172.21.15.81:0/3733904066 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6850102560 0x7f68501a55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68550ee700 1 --2- 172.21.15.81:0/3733904066 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6850100060 0x7f6850101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68550ee700 1 --2- 172.21.15.81:0/3733904066 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6850105170 0x7f6850102020 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68550ee700 1 -- 172.21.15.81:0/3733904066 >> 172.21.15.81:0/3733904066 conn(0x7f6850076f30 msgr2=0x7f68500696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68550ee700 1 -- 172.21.15.81:0/3733904066 shutdown_connections 2024-05-09T00:11:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:14.501+0000 7f68550ee700 1 -- 172.21.15.81:0/3733904066 wait complete. 2024-05-09T00:11:15.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:14 smithi150 ceph-mon[46187]: pgmap v255: 97 pgs: 97 active+clean; 2.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-05-09T00:11:15.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:14 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/876311704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:11:15.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:14 smithi171 ceph-mon[47351]: pgmap v255: 97 pgs: 97 active+clean; 2.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-05-09T00:11:15.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:14 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/876311704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:11:15.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:14 smithi081 ceph-mon[42474]: pgmap v255: 97 pgs: 97 active+clean; 2.0 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 38 KiB/s wr, 11 op/s 2024-05-09T00:11:15.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:14 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/876311704' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:11:15.510 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:11:15.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:11:15.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.644+0000 7f1c4b52a700 1 -- 172.21.15.81:0/3541941040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c440682e0 msgr2=0x7f1c440686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.644+0000 7f1c4b52a700 1 --2- 172.21.15.81:0/3541941040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c440682e0 0x7f1c440686c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f1c340099c0 tx=0x7f1c34009cd0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.644+0000 7f1c4b52a700 1 -- 172.21.15.81:0/3541941040 shutdown_connections 2024-05-09T00:11:15.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.644+0000 7f1c4b52a700 1 --2- 172.21.15.81:0/3541941040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c44106290 0x7f1c4410de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.644+0000 7f1c4b52a700 1 --2- 172.21.15.81:0/3541941040 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c440682e0 0x7f1c440686c0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.644+0000 7f1c4b52a700 1 --2- 172.21.15.81:0/3541941040 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c44068c90 0x7f1c44105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.644+0000 7f1c4b52a700 1 -- 172.21.15.81:0/3541941040 >> 172.21.15.81:0/3541941040 conn(0x7f1c44076f40 msgr2=0x7f1c44077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.644+0000 7f1c4b52a700 1 -- 172.21.15.81:0/3541941040 shutdown_connections 2024-05-09T00:11:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.644+0000 7f1c4b52a700 1 -- 172.21.15.81:0/3541941040 wait complete. 2024-05-09T00:11:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.644+0000 7f1c4b52a700 1 Processor -- start 2024-05-09T00:11:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c4b52a700 1 -- start start 2024-05-09T00:11:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c4b52a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c440682e0 0x7f1c440ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c4b52a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c44106290 0x7f1c441003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c4b52a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c441008e0 0x7f1c441a5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c4b52a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c441a5b20 con 0x7f1c441008e0 2024-05-09T00:11:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c4b52a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c441a5c90 con 0x7f1c440682e0 2024-05-09T00:11:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c4b52a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c441a5e50 con 0x7f1c44106290 2024-05-09T00:11:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c49ac7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c441008e0 0x7f1c441a5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c49ac7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c441008e0 0x7f1c441a5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59762/0 (socket says 172.21.15.81:59762) 2024-05-09T00:11:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c49ac7700 1 -- 172.21.15.81:0/887667803 learned_addr learned my addr 172.21.15.81:0/887667803 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:15.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c492c6700 1 --2- 172.21.15.81:0/887667803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c440682e0 0x7f1c440ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c48ac5700 1 --2- 172.21.15.81:0/887667803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c44106290 0x7f1c441003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c49ac7700 1 -- 172.21.15.81:0/887667803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c44106290 msgr2=0x7f1c441003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c49ac7700 1 --2- 172.21.15.81:0/887667803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c44106290 0x7f1c441003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c49ac7700 1 -- 172.21.15.81:0/887667803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c440682e0 msgr2=0x7f1c440ffe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c49ac7700 1 --2- 172.21.15.81:0/887667803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c440682e0 0x7f1c440ffe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c49ac7700 1 -- 172.21.15.81:0/887667803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c340095f0 con 0x7f1c441008e0 2024-05-09T00:11:15.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c49ac7700 1 --2- 172.21.15.81:0/887667803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c441008e0 0x7f1c441a5550 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00b970 tx=0x7f1c3c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:15.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.645+0000 7f1c3a7fc700 1 -- 172.21.15.81:0/887667803 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c00c930 con 0x7f1c441008e0 2024-05-09T00:11:15.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.646+0000 7f1c4b52a700 1 -- 172.21.15.81:0/887667803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c441a6130 con 0x7f1c441008e0 2024-05-09T00:11:15.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.646+0000 7f1c3a7fc700 1 -- 172.21.15.81:0/887667803 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c3c014440 con 0x7f1c441008e0 2024-05-09T00:11:15.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.646+0000 7f1c3a7fc700 1 -- 172.21.15.81:0/887667803 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0075d0 con 0x7f1c441008e0 2024-05-09T00:11:15.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.646+0000 7f1c4b52a700 1 -- 172.21.15.81:0/887667803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c441a65f0 con 0x7f1c441008e0 2024-05-09T00:11:15.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.648+0000 7f1c3a7fc700 1 -- 172.21.15.81:0/887667803 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f1c3c0145b0 con 0x7f1c441008e0 2024-05-09T00:11:15.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.648+0000 7f1c3a7fc700 1 --2- 172.21.15.81:0/887667803 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1c300a1290 0x7f1c300a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.648+0000 7f1c3a7fc700 1 -- 172.21.15.81:0/887667803 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f1c3c006e40 con 0x7f1c441008e0 2024-05-09T00:11:15.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.648+0000 7f1c492c6700 1 --2- 172.21.15.81:0/887667803 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1c300a1290 0x7f1c300a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.649+0000 7f1c492c6700 1 --2- 172.21.15.81:0/887667803 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1c300a1290 0x7f1c300a3750 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009990 tx=0x7f1c34005c60 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:15.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.649+0000 7f1c576e4b80 1 Processor -- start 2024-05-09T00:11:15.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.649+0000 7f1c576e4b80 1 -- start start 2024-05-09T00:11:15.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.649+0000 7f1c576e4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda7901260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.649+0000 7f1c576e4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda79017a0 0x55cda78fb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.649+0000 7f1c576e4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda78fb910 0x55cda78fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.649+0000 7f1c576e4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda78521d0 con 0x55cda7900e80 2024-05-09T00:11:15.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.649+0000 7f1c576e4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda784fb90 con 0x55cda79017a0 2024-05-09T00:11:15.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.649+0000 7f1c576e4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda784b480 con 0x55cda78fb910 2024-05-09T00:11:15.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.649+0000 7f1c492c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda7901260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.649+0000 7f1c492c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda7901260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59778/0 (socket says 172.21.15.81:59778) 2024-05-09T00:11:15.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.649+0000 7f1c492c6700 1 -- 172.21.15.81:0/3854993904 learned_addr learned my addr 172.21.15.81:0/3854993904 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:15.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.649+0000 7f1c49ac7700 1 --2- 172.21.15.81:0/3854993904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda78fb910 0x55cda78fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.650+0000 7f1c48ac5700 1 --2- 172.21.15.81:0/3854993904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda79017a0 0x55cda78fb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.650+0000 7f1c492c6700 1 -- 172.21.15.81:0/3854993904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda78fb910 msgr2=0x55cda78fbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.650+0000 7f1c492c6700 1 --2- 172.21.15.81:0/3854993904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda78fb910 0x55cda78fbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.650+0000 7f1c492c6700 1 -- 172.21.15.81:0/3854993904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda79017a0 msgr2=0x55cda78fb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.650+0000 7f1c492c6700 1 --2- 172.21.15.81:0/3854993904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda79017a0 0x55cda78fb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.650+0000 7f1c492c6700 1 -- 172.21.15.81:0/3854993904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cda76cc430 con 0x55cda7900e80 2024-05-09T00:11:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.650+0000 7f1c49ac7700 1 --2- 172.21.15.81:0/3854993904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda78fb910 0x55cda78fbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.650+0000 7f1c492c6700 1 --2- 172.21.15.81:0/3854993904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda7901260 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f1c34000c00 tx=0x7f1c34020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f2d1a5c179eed9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.650+0000 7f1c2f7fe700 1 -- 172.21.15.81:0/3854993904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400bea0 con 0x55cda7900e80 2024-05-09T00:11:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.650+0000 7f1c2f7fe700 1 -- 172.21.15.81:0/3854993904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c3401e040 con 0x55cda7900e80 2024-05-09T00:11:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.650+0000 7f1c2f7fe700 1 -- 172.21.15.81:0/3854993904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400f850 con 0x55cda7900e80 2024-05-09T00:11:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.651+0000 7f1c576e4b80 1 -- 172.21.15.81:0/3854993904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 msgr2=0x55cda7901260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.651+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/3854993904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda7901260 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f1c34000c00 tx=0x7f1c34020000 comp rx=0 tx=0).stop 2024-05-09T00:11:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.651+0000 7f1c576e4b80 1 -- 172.21.15.81:0/3854993904 shutdown_connections 2024-05-09T00:11:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.651+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/3854993904 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda78fb910 0x55cda78fbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.651+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/3854993904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda7901260 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.651+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/3854993904 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda79017a0 0x55cda78fb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.651+0000 7f1c576e4b80 1 -- 172.21.15.81:0/3854993904 >> 172.21.15.81:0/3854993904 conn(0x55cda7859290 msgr2=0x55cda78f5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.651+0000 7f1c576e4b80 1 -- 172.21.15.81:0/3854993904 shutdown_connections 2024-05-09T00:11:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.651+0000 7f1c576e4b80 1 -- 172.21.15.81:0/3854993904 wait complete. 2024-05-09T00:11:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.651+0000 7f1c576e4b80 1 -- start start 2024-05-09T00:11:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.651+0000 7f1c576e4b80 1 Processor -- start 2024-05-09T00:11:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c576e4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda78fb910 0x55cda7904bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c576e4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda7900e80 0x55cda7905130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c576e4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda79017a0 0x55cda7905670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c576e4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda77e75e0 con 0x55cda79017a0 2024-05-09T00:11:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c576e4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda77e7280 con 0x55cda7900e80 2024-05-09T00:11:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c576e4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda76ce720 con 0x55cda78fb910 2024-05-09T00:11:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c576e4b80 10 client.0 _ll_register_callbacks cb 0x55cda77f0bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:15.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c49ac7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda79017a0 0x55cda7905670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c49ac7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda79017a0 0x55cda7905670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59786/0 (socket says 172.21.15.81:59786) 2024-05-09T00:11:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c49ac7700 1 -- 172.21.15.81:0/1197714259 learned_addr learned my addr 172.21.15.81:0/1197714259 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c48ac5700 1 --2- 172.21.15.81:0/1197714259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda7900e80 0x55cda7905130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c492c6700 1 --2- 172.21.15.81:0/1197714259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda78fb910 0x55cda7904bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c49ac7700 1 -- 172.21.15.81:0/1197714259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda78fb910 msgr2=0x55cda7904bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c49ac7700 1 --2- 172.21.15.81:0/1197714259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda78fb910 0x55cda7904bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c49ac7700 1 -- 172.21.15.81:0/1197714259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda7900e80 msgr2=0x55cda7905130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c49ac7700 1 --2- 172.21.15.81:0/1197714259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda7900e80 0x55cda7905130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c49ac7700 1 -- 172.21.15.81:0/1197714259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4410e650 con 0x55cda79017a0 2024-05-09T00:11:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c49ac7700 1 --2- 172.21.15.81:0/1197714259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda79017a0 0x55cda7905670 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0c9fd0 tx=0x7f1c3c098f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b70970d0bd9388 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c2cff9700 1 -- 172.21.15.81:0/1197714259 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c09d2d0 con 0x55cda79017a0 2024-05-09T00:11:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c2cff9700 1 -- 172.21.15.81:0/1197714259 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f1c3c0a1920 con 0x55cda79017a0 2024-05-09T00:11:15.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c576e4b80 1 -- 172.21.15.81:0/1197714259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cda77a42f0 con 0x55cda79017a0 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.652+0000 7f1c2cff9700 1 -- 172.21.15.81:0/1197714259 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c3c098990 con 0x55cda79017a0 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.653+0000 7f1c576e4b80 10 client.17835 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.653+0000 7f1c576e4b80 1 -- 172.21.15.81:0/1197714259 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cda7678be0 con 0x55cda79017a0 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.653+0000 7f1c2cff9700 1 -- 172.21.15.81:0/1197714259 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cda77a42f0 con 0x55cda79017a0 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.653+0000 7f1c2cff9700 1 -- 172.21.15.81:0/1197714259 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1c3c0a15b0 con 0x55cda79017a0 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.653+0000 7f1c576e4b80 10 client.17835 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.653+0000 7f1c576e4b80 10 client.17835 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.653+0000 7f1c576e4b80 20 client.17835 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.653+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/1197714259 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55cda7915320 0x55cda7917740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.653+0000 7f1c576e4b80 4 client.17835 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.653+0000 7f1c576e4b80 1 -- 172.21.15.81:0/1197714259 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cda78ca890 con 0x55cda7915320 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.653+0000 7f1c492c6700 1 --2- 172.21.15.81:0/1197714259 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55cda7915320 0x55cda7917740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.653+0000 7f1c2cff9700 10 client.17835 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.653+0000 7f1c492c6700 1 --2- 172.21.15.81:0/1197714259 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55cda7915320 0x55cda7917740 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80a304f99aad6c1d server_cookie=485baa1f528e5ac7 in_seq=0 out_seq=0 2024-05-09T00:11:15.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.654+0000 7f1c2cff9700 1 -- 172.21.15.81:0/1197714259 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cda78ca890 con 0x55cda7915320 2024-05-09T00:11:15.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.654+0000 7f1c2cff9700 10 client.17835 handle_command_reply: tid=0 2024-05-09T00:11:15.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.654+0000 7f1c576e4b80 1 client.17835 shutdown 2024-05-09T00:11:15.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.654+0000 7f1c576e4b80 1 -- 172.21.15.81:0/1197714259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda79017a0 msgr2=0x55cda7905670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.654+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/1197714259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda79017a0 0x55cda7905670 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0c9fd0 tx=0x7f1c3c098f00 comp rx=0 tx=0).stop 2024-05-09T00:11:15.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.654+0000 7f1c576e4b80 1 -- 172.21.15.81:0/1197714259 shutdown_connections 2024-05-09T00:11:15.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.654+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/1197714259 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55cda7915320 0x55cda7917740 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.654+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/1197714259 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda79017a0 0x55cda7905670 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.654+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/1197714259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda78fb910 0x55cda7904bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.654+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/1197714259 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda7900e80 0x55cda7905130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.654+0000 7f1c2cff9700 0 client.17835 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:15.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.654+0000 7f1c576e4b80 1 -- 172.21.15.81:0/1197714259 >> 172.21.15.81:0/1197714259 conn(0x55cda7859290 msgr2=0x55cda78f5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:15.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.654+0000 7f1c576e4b80 1 -- 172.21.15.81:0/1197714259 shutdown_connections 2024-05-09T00:11:15.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.654+0000 7f1c576e4b80 1 -- 172.21.15.81:0/1197714259 wait complete. 2024-05-09T00:11:15.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.655+0000 7f1c576e4b80 20 client.17835 trim_cache size 0 max 16384 2024-05-09T00:11:15.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.671+0000 7f1c576e4b80 1 Processor -- start 2024-05-09T00:11:15.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.671+0000 7f1c576e4b80 1 -- start start 2024-05-09T00:11:15.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c576e4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda78fb910 0x55cda78f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c576e4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda78ffd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c576e4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda79017a0 0x55cda7900240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c576e4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda78ca890 con 0x55cda7900e80 2024-05-09T00:11:15.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c576e4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda77a42f0 con 0x55cda78fb910 2024-05-09T00:11:15.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c576e4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda78f7f10 con 0x55cda79017a0 2024-05-09T00:11:15.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c48ac5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda78ffd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c48ac5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda78ffd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59794/0 (socket says 172.21.15.81:59794) 2024-05-09T00:11:15.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c48ac5700 1 -- 172.21.15.81:0/4262937106 learned_addr learned my addr 172.21.15.81:0/4262937106 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:15.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c48ac5700 1 -- 172.21.15.81:0/4262937106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda79017a0 msgr2=0x55cda7900240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c48ac5700 1 --2- 172.21.15.81:0/4262937106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda79017a0 0x55cda7900240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c48ac5700 1 -- 172.21.15.81:0/4262937106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda78fb910 msgr2=0x55cda78f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c492c6700 1 --2- 172.21.15.81:0/4262937106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda78fb910 0x55cda78f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c48ac5700 1 --2- 172.21.15.81:0/4262937106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda78fb910 0x55cda78f5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c48ac5700 1 -- 172.21.15.81:0/4262937106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cda7904750 con 0x55cda7900e80 2024-05-09T00:11:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c48ac5700 1 --2- 172.21.15.81:0/4262937106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda78ffd00 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f1c4406a6d0 tx=0x7f1c4000af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0cb8d06a4069bb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c2ffff700 1 -- 172.21.15.81:0/4262937106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40012ea0 con 0x55cda7900e80 2024-05-09T00:11:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c2ffff700 1 -- 172.21.15.81:0/4262937106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c400044f0 con 0x55cda7900e80 2024-05-09T00:11:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.672+0000 7f1c2ffff700 1 -- 172.21.15.81:0/4262937106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40005390 con 0x55cda7900e80 2024-05-09T00:11:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.673+0000 7f1c576e4b80 1 -- 172.21.15.81:0/4262937106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 msgr2=0x55cda78ffd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.673+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/4262937106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda78ffd00 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f1c4406a6d0 tx=0x7f1c4000af10 comp rx=0 tx=0).stop 2024-05-09T00:11:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.673+0000 7f1c576e4b80 1 -- 172.21.15.81:0/4262937106 shutdown_connections 2024-05-09T00:11:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.673+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/4262937106 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda78fb910 0x55cda78f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.673+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/4262937106 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda79017a0 0x55cda7900240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.673+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/4262937106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda78ffd00 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.673+0000 7f1c576e4b80 1 -- 172.21.15.81:0/4262937106 >> 172.21.15.81:0/4262937106 conn(0x55cda7859290 msgr2=0x55cda79034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.673+0000 7f1c576e4b80 1 -- 172.21.15.81:0/4262937106 shutdown_connections 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.673+0000 7f1c576e4b80 1 -- 172.21.15.81:0/4262937106 wait complete. 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.673+0000 7f1c576e4b80 1 -- start start 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.673+0000 7f1c576e4b80 1 Processor -- start 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c576e4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda78fb910 0x55cda790afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c576e4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda790b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c576e4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda79017a0 0x55cda790ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c576e4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda796b9b0 con 0x55cda7900e80 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c576e4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda796bb20 con 0x55cda78fb910 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c576e4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda796bce0 con 0x55cda79017a0 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c576e4b80 10 client.0 _ll_register_callbacks cb 0x55cda77f0bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c48ac5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda790b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c48ac5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda790b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59806/0 (socket says 172.21.15.81:59806) 2024-05-09T00:11:15.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c48ac5700 1 -- 172.21.15.81:0/2452883059 learned_addr learned my addr 172.21.15.81:0/2452883059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:15.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c492c6700 1 --2- 172.21.15.81:0/2452883059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda78fb910 0x55cda790afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c49ac7700 1 --2- 172.21.15.81:0/2452883059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda79017a0 0x55cda790ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c48ac5700 1 -- 172.21.15.81:0/2452883059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda79017a0 msgr2=0x55cda790ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c48ac5700 1 --2- 172.21.15.81:0/2452883059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda79017a0 0x55cda790ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c48ac5700 1 -- 172.21.15.81:0/2452883059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda78fb910 msgr2=0x55cda790afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c48ac5700 1 --2- 172.21.15.81:0/2452883059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda78fb910 0x55cda790afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c48ac5700 1 -- 172.21.15.81:0/2452883059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4000a910 con 0x55cda7900e80 2024-05-09T00:11:15.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c492c6700 1 --2- 172.21.15.81:0/2452883059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda78fb910 0x55cda790afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:15.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c48ac5700 1 --2- 172.21.15.81:0/2452883059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda790b4e0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f1c40000c00 tx=0x7f1c40004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26baf768ded0f8c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:15.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c2cff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:15.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c2cff9700 1 -- 172.21.15.81:0/2452883059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40005020 con 0x55cda7900e80 2024-05-09T00:11:15.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c2cff9700 1 -- 172.21.15.81:0/2452883059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f1c40005180 con 0x55cda7900e80 2024-05-09T00:11:15.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c576e4b80 1 -- 172.21.15.81:0/2452883059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c3401e040 con 0x55cda7900e80 2024-05-09T00:11:15.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c2cff9700 1 -- 172.21.15.81:0/2452883059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c40005340 con 0x55cda7900e80 2024-05-09T00:11:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c576e4b80 10 client.17841 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.674+0000 7f1c576e4b80 1 -- 172.21.15.81:0/2452883059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cda78fbfc0 con 0x55cda7900e80 2024-05-09T00:11:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.675+0000 7f1c2cff9700 1 -- 172.21.15.81:0/2452883059 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c40032080 con 0x55cda7900e80 2024-05-09T00:11:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.675+0000 7f1c2cff9700 1 -- 172.21.15.81:0/2452883059 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1c40026430 con 0x55cda7900e80 2024-05-09T00:11:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.675+0000 7f1c576e4b80 10 client.17841 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.675+0000 7f1c576e4b80 10 client.17841 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.675+0000 7f1c576e4b80 20 client.17841 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.675+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/2452883059 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55cda796d490 0x55cda796f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.675+0000 7f1c576e4b80 4 client.17841 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:11:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.675+0000 7f1c576e4b80 1 -- 172.21.15.81:0/2452883059 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55cda7843f40 con 0x55cda796d490 2024-05-09T00:11:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.675+0000 7f1c492c6700 1 --2- 172.21.15.81:0/2452883059 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55cda796d490 0x55cda796f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.675+0000 7f1c2cff9700 10 client.17841 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:15.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.675+0000 7f1c492c6700 1 --2- 172.21.15.81:0/2452883059 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55cda796d490 0x55cda796f8b0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=639710f6975ab927 server_cookie=4007c8f57e16be18 in_seq=0 out_seq=0 2024-05-09T00:11:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.676+0000 7f1c2cff9700 1 -- 172.21.15.81:0/2452883059 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55cda7843f40 con 0x55cda796d490 2024-05-09T00:11:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.676+0000 7f1c2cff9700 10 client.17841 handle_command_reply: tid=0 2024-05-09T00:11:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.676+0000 7f1c576e4b80 1 client.17841 shutdown 2024-05-09T00:11:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c576e4b80 1 -- 172.21.15.81:0/2452883059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 msgr2=0x55cda790b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/2452883059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda790b4e0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f1c40000c00 tx=0x7f1c40004800 comp rx=0 tx=0).stop 2024-05-09T00:11:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c576e4b80 1 -- 172.21.15.81:0/2452883059 shutdown_connections 2024-05-09T00:11:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/2452883059 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55cda796d490 0x55cda796f8b0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/2452883059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55cda78fb910 0x55cda790afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/2452883059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55cda79017a0 0x55cda790ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c2cff9700 0 client.17841 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c576e4b80 1 --2- 172.21.15.81:0/2452883059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55cda7900e80 0x55cda790b4e0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c576e4b80 1 -- 172.21.15.81:0/2452883059 >> 172.21.15.81:0/2452883059 conn(0x55cda7859290 msgr2=0x55cda78ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:15.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c576e4b80 1 -- 172.21.15.81:0/2452883059 shutdown_connections 2024-05-09T00:11:15.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c576e4b80 1 -- 172.21.15.81:0/2452883059 wait complete. 2024-05-09T00:11:15.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c576e4b80 20 client.17841 trim_cache size 0 max 16384 2024-05-09T00:11:15.680 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:11:15.680 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:11:15.680 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "83b838cd-ef23-4877-9e75-cdeb003b93ab", 2024-05-09T00:11:15.680 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:11:15.680 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:11:15.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c4b52a700 1 -- 172.21.15.81:0/887667803 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1c300a1290 msgr2=0x7f1c300a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c4b52a700 1 --2- 172.21.15.81:0/887667803 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1c300a1290 0x7f1c300a3750 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009990 tx=0x7f1c34005c60 comp rx=0 tx=0).stop 2024-05-09T00:11:15.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c4b52a700 1 -- 172.21.15.81:0/887667803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c441008e0 msgr2=0x7f1c441a5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c4b52a700 1 --2- 172.21.15.81:0/887667803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c441008e0 0x7f1c441a5550 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00b970 tx=0x7f1c3c00bc80 comp rx=0 tx=0).stop 2024-05-09T00:11:15.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c4b52a700 1 -- 172.21.15.81:0/887667803 shutdown_connections 2024-05-09T00:11:15.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c4b52a700 1 --2- 172.21.15.81:0/887667803 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1c300a1290 0x7f1c300a3750 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c4b52a700 1 --2- 172.21.15.81:0/887667803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1c440682e0 0x7f1c440ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c4b52a700 1 --2- 172.21.15.81:0/887667803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1c441008e0 0x7f1c441a5550 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c4b52a700 1 --2- 172.21.15.81:0/887667803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1c44106290 0x7f1c441003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c4b52a700 1 -- 172.21.15.81:0/887667803 >> 172.21.15.81:0/887667803 conn(0x7f1c44076f40 msgr2=0x7f1c440fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:15.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c4b52a700 1 -- 172.21.15.81:0/887667803 shutdown_connections 2024-05-09T00:11:15.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.677+0000 7f1c4b52a700 1 -- 172.21.15.81:0/887667803 wait complete. 2024-05-09T00:11:15.686 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:11:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.814+0000 7fd5d3068700 1 -- 172.21.15.81:0/159102745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc101b10 msgr2=0x7fd5cc105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.814+0000 7fd5d3068700 1 --2- 172.21.15.81:0/159102745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc101b10 0x7fd5cc105b50 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009990 tx=0x7fd5b4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.814+0000 7fd5d3068700 1 -- 172.21.15.81:0/159102745 shutdown_connections 2024-05-09T00:11:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.814+0000 7fd5d3068700 1 --2- 172.21.15.81:0/159102745 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc101160 0x7fd5cc101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.814+0000 7fd5d3068700 1 --2- 172.21.15.81:0/159102745 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5cc106280 0x7fd5cc10de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.814+0000 7fd5d3068700 1 --2- 172.21.15.81:0/159102745 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc101b10 0x7fd5cc105b50 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.814+0000 7fd5d3068700 1 -- 172.21.15.81:0/159102745 >> 172.21.15.81:0/159102745 conn(0x7fd5cc0fc9c0 msgr2=0x7fd5cc0fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.814+0000 7fd5d3068700 1 -- 172.21.15.81:0/159102745 shutdown_connections 2024-05-09T00:11:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.814+0000 7fd5d3068700 1 -- 172.21.15.81:0/159102745 wait complete. 2024-05-09T00:11:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5d3068700 1 Processor -- start 2024-05-09T00:11:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5d3068700 1 -- start start 2024-05-09T00:11:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5d3068700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc101160 0x7fd5cc197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5d3068700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc106280 0x7fd5cc197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5d3068700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5cc19bc30 0x7fd5cc19c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5d3068700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc19c6b0 con 0x7fd5cc106280 2024-05-09T00:11:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5d3068700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc19c820 con 0x7fd5cc101160 2024-05-09T00:11:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5d3068700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5cc19c9e0 con 0x7fd5cc19bc30 2024-05-09T00:11:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc106280 0x7fd5cc197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc106280 0x7fd5cc197890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59826/0 (socket says 172.21.15.81:59826) 2024-05-09T00:11:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5cbfff700 1 -- 172.21.15.81:0/2977762175 learned_addr learned my addr 172.21.15.81:0/2977762175 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5cbfff700 1 -- 172.21.15.81:0/2977762175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5cc19bc30 msgr2=0x7fd5cc19c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/2977762175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5cc19bc30 0x7fd5cc19c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5cbfff700 1 -- 172.21.15.81:0/2977762175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc101160 msgr2=0x7fd5cc197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/2977762175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc101160 0x7fd5cc197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.815+0000 7fd5cbfff700 1 -- 172.21.15.81:0/2977762175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b40095f0 con 0x7fd5cc106280 2024-05-09T00:11:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.816+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/2977762175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc106280 0x7fd5cc197890 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4005770 tx=0x7fd5b4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.816+0000 7fd5c9ffb700 1 -- 172.21.15.81:0/2977762175 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b401d070 con 0x7fd5cc106280 2024-05-09T00:11:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.816+0000 7fd5c9ffb700 1 -- 172.21.15.81:0/2977762175 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5b400fbb0 con 0x7fd5cc106280 2024-05-09T00:11:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.816+0000 7fd5d3068700 1 -- 172.21.15.81:0/2977762175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5cc1a3ee0 con 0x7fd5cc106280 2024-05-09T00:11:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.816+0000 7fd5c9ffb700 1 -- 172.21.15.81:0/2977762175 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4022c00 con 0x7fd5cc106280 2024-05-09T00:11:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.816+0000 7fd5d3068700 1 -- 172.21.15.81:0/2977762175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc1a4300 con 0x7fd5cc106280 2024-05-09T00:11:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.819+0000 7fd5c9ffb700 1 -- 172.21.15.81:0/2977762175 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fd5b400fd20 con 0x7fd5cc106280 2024-05-09T00:11:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.819+0000 7fd5c9ffb700 1 --2- 172.21.15.81:0/2977762175 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd5b80a1290 0x7fd5b80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.819+0000 7fd5c9ffb700 1 -- 172.21.15.81:0/2977762175 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fd5b40ce210 con 0x7fd5cc106280 2024-05-09T00:11:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.819+0000 7fd5d0e04700 1 --2- 172.21.15.81:0/2977762175 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd5b80a1290 0x7fd5b80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5d0e04700 1 --2- 172.21.15.81:0/2977762175 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd5b80a1290 0x7fd5b80a3750 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400d0e0 tx=0x7fd5c40085a0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5df222b80 1 Processor -- start 2024-05-09T00:11:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5df222b80 1 -- start start 2024-05-09T00:11:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5df222b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 0x559f1cc445f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5df222b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc3e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5df222b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 0x559f1cc3f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5df222b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1cb91150 con 0x559f1cc44b30 2024-05-09T00:11:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5df222b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1cb8eb10 con 0x559f1cc44210 2024-05-09T00:11:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5df222b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1cb8a400 con 0x559f1cc3eca0 2024-05-09T00:11:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc3e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc3e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59842/0 (socket says 172.21.15.81:59842) 2024-05-09T00:11:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5cbfff700 1 -- 172.21.15.81:0/1573641866 learned_addr learned my addr 172.21.15.81:0/1573641866 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5d0e04700 1 --2- 172.21.15.81:0/1573641866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 0x559f1cc445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5d1605700 1 --2- 172.21.15.81:0/1573641866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 0x559f1cc3f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5cbfff700 1 -- 172.21.15.81:0/1573641866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 msgr2=0x559f1cc3f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/1573641866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 0x559f1cc3f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5cbfff700 1 -- 172.21.15.81:0/1573641866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 msgr2=0x559f1cc445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/1573641866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 0x559f1cc445f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5cbfff700 1 -- 172.21.15.81:0/1573641866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f1ca0b3b0 con 0x559f1cc44b30 2024-05-09T00:11:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.820+0000 7fd5d1605700 1 --2- 172.21.15.81:0/1573641866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 0x559f1cc3f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.821+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/1573641866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc3e760 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40cbf30 tx=0x7fd5b4095f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55475aae2a3efbe server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.821+0000 7fd5c2ffd700 1 -- 172.21.15.81:0/1573641866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b409b380 con 0x559f1cc44b30 2024-05-09T00:11:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.821+0000 7fd5c2ffd700 1 -- 172.21.15.81:0/1573641866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5b409f1b0 con 0x559f1cc44b30 2024-05-09T00:11:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.821+0000 7fd5c2ffd700 1 -- 172.21.15.81:0/1573641866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b409aad0 con 0x559f1cc44b30 2024-05-09T00:11:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.821+0000 7fd5df222b80 1 -- 172.21.15.81:0/1573641866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 msgr2=0x559f1cc3e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.821+0000 7fd5df222b80 1 --2- 172.21.15.81:0/1573641866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc3e760 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40cbf30 tx=0x7fd5b4095f90 comp rx=0 tx=0).stop 2024-05-09T00:11:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.821+0000 7fd5df222b80 1 -- 172.21.15.81:0/1573641866 shutdown_connections 2024-05-09T00:11:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.821+0000 7fd5df222b80 1 --2- 172.21.15.81:0/1573641866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 0x559f1cc445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.821+0000 7fd5df222b80 1 --2- 172.21.15.81:0/1573641866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 0x559f1cc3f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.821+0000 7fd5df222b80 1 --2- 172.21.15.81:0/1573641866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc3e760 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.821+0000 7fd5df222b80 1 -- 172.21.15.81:0/1573641866 >> 172.21.15.81:0/1573641866 conn(0x559f1cb98210 msgr2=0x559f1cc34df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.821+0000 7fd5df222b80 1 -- 172.21.15.81:0/1573641866 shutdown_connections 2024-05-09T00:11:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.821+0000 7fd5df222b80 1 -- 172.21.15.81:0/1573641866 wait complete. 2024-05-09T00:11:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.822+0000 7fd5df222b80 1 -- start start 2024-05-09T00:11:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.822+0000 7fd5df222b80 1 Processor -- start 2024-05-09T00:11:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.822+0000 7fd5df222b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 0x559f1cc4ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.822+0000 7fd5df222b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 0x559f1cc47e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.822+0000 7fd5df222b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc485a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.822+0000 7fd5df222b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1cb26560 con 0x559f1cc44b30 2024-05-09T00:11:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.822+0000 7fd5df222b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1cb26200 con 0x559f1cc44210 2024-05-09T00:11:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.822+0000 7fd5df222b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1ca0d6a0 con 0x559f1cc3eca0 2024-05-09T00:11:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.822+0000 7fd5df222b80 10 client.0 _ll_register_callbacks cb 0x559f1cb2fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.822+0000 7fd5d1605700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5d1605700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc485a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59850/0 (socket says 172.21.15.81:59850) 2024-05-09T00:11:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5d1605700 1 -- 172.21.15.81:0/1861577897 learned_addr learned my addr 172.21.15.81:0/1861577897 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5d0e04700 1 --2- 172.21.15.81:0/1861577897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 0x559f1cc4ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/1861577897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 0x559f1cc47e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5d1605700 1 -- 172.21.15.81:0/1861577897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 msgr2=0x559f1cc4ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5d1605700 1 --2- 172.21.15.81:0/1861577897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 0x559f1cc4ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5d1605700 1 -- 172.21.15.81:0/1861577897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 msgr2=0x559f1cc47e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5d1605700 1 --2- 172.21.15.81:0/1861577897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 0x559f1cc47e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5d1605700 1 -- 172.21.15.81:0/1861577897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5cc1a4300 con 0x559f1cc44b30 2024-05-09T00:11:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/1861577897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 0x559f1cc47e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5d1605700 1 --2- 172.21.15.81:0/1861577897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc485a0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00e3a0 tx=0x7fd5bc00e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8458b523a7444a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5abfff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5abfff700 1 -- 172.21.15.81:0/1861577897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc004a30 con 0x559f1cc44b30 2024-05-09T00:11:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5abfff700 1 -- 172.21.15.81:0/1861577897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fd5bc004b90 con 0x559f1cc44b30 2024-05-09T00:11:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5df222b80 1 -- 172.21.15.81:0/1861577897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f1cae3270 con 0x559f1cc44b30 2024-05-09T00:11:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5abfff700 1 -- 172.21.15.81:0/1861577897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5bc004d50 con 0x559f1cc44b30 2024-05-09T00:11:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5df222b80 10 client.17853 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5df222b80 1 -- 172.21.15.81:0/1861577897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559f1c9b7b60 con 0x559f1cc44b30 2024-05-09T00:11:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.823+0000 7fd5abfff700 1 -- 172.21.15.81:0/1861577897 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559f1cae3270 con 0x559f1cc44b30 2024-05-09T00:11:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.824+0000 7fd5abfff700 1 -- 172.21.15.81:0/1861577897 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd5bc00c070 con 0x559f1cc44b30 2024-05-09T00:11:15.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.824+0000 7fd5df222b80 10 client.17853 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.824+0000 7fd5df222b80 10 client.17853 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.824+0000 7fd5df222b80 20 client.17853 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.824+0000 7fd5df222b80 1 --2- 172.21.15.81:0/1861577897 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559f1cc58270 0x559f1cc5a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.824+0000 7fd5df222b80 4 client.17853 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.824+0000 7fd5df222b80 1 -- 172.21.15.81:0/1861577897 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f1cc09810 con 0x559f1cc58270 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.824+0000 7fd5d0e04700 1 --2- 172.21.15.81:0/1861577897 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559f1cc58270 0x559f1cc5a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.824+0000 7fd5abfff700 10 client.17853 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.824+0000 7fd5d0e04700 1 --2- 172.21.15.81:0/1861577897 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559f1cc58270 0x559f1cc5a690 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beec9729c1c1012c server_cookie=3a9205af271f329c in_seq=0 out_seq=0 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.825+0000 7fd5abfff700 1 -- 172.21.15.81:0/1861577897 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559f1cc09810 con 0x559f1cc58270 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.825+0000 7fd5abfff700 10 client.17853 handle_command_reply: tid=0 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.825+0000 7fd5df222b80 1 client.17853 shutdown 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.825+0000 7fd5df222b80 1 -- 172.21.15.81:0/1861577897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 msgr2=0x559f1cc485a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.825+0000 7fd5df222b80 1 --2- 172.21.15.81:0/1861577897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc485a0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00e3a0 tx=0x7fd5bc00e760 comp rx=0 tx=0).stop 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.825+0000 7fd5df222b80 1 -- 172.21.15.81:0/1861577897 shutdown_connections 2024-05-09T00:11:15.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.825+0000 7fd5df222b80 1 --2- 172.21.15.81:0/1861577897 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559f1cc58270 0x559f1cc5a690 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.825+0000 7fd5df222b80 1 --2- 172.21.15.81:0/1861577897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc485a0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.825+0000 7fd5df222b80 1 --2- 172.21.15.81:0/1861577897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 0x559f1cc4ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.825+0000 7fd5abfff700 0 client.17853 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.825+0000 7fd5df222b80 1 --2- 172.21.15.81:0/1861577897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 0x559f1cc47e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.825+0000 7fd5df222b80 1 -- 172.21.15.81:0/1861577897 >> 172.21.15.81:0/1861577897 conn(0x559f1cb98210 msgr2=0x559f1cc345a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.825+0000 7fd5df222b80 1 -- 172.21.15.81:0/1861577897 shutdown_connections 2024-05-09T00:11:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.825+0000 7fd5df222b80 1 -- 172.21.15.81:0/1861577897 wait complete. 2024-05-09T00:11:15.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.826+0000 7fd5df222b80 20 client.17853 trim_cache size 0 max 16384 2024-05-09T00:11:15.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5df222b80 1 Processor -- start 2024-05-09T00:11:15.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5df222b80 1 -- start start 2024-05-09T00:11:15.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5df222b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 0x559f1cc3f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5df222b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 0x559f1cc34d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5df222b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc5eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5df222b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1cc54d80 con 0x559f1cc44b30 2024-05-09T00:11:15.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5df222b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1cc2f800 con 0x559f1cc44210 2024-05-09T00:11:15.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5df222b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1cc47c30 con 0x559f1cc3eca0 2024-05-09T00:11:15.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5d0e04700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 0x559f1cc3f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5d1605700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc5eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5d0e04700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 0x559f1cc3f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:52630/0 (socket says 172.21.15.81:52630) 2024-05-09T00:11:15.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5d0e04700 1 -- 172.21.15.81:0/306288590 learned_addr learned my addr 172.21.15.81:0/306288590 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:15.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5d1605700 1 -- 172.21.15.81:0/306288590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 msgr2=0x559f1cc3f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5d1605700 1 --2- 172.21.15.81:0/306288590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 0x559f1cc3f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5d1605700 1 -- 172.21.15.81:0/306288590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 msgr2=0x559f1cc34d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.843+0000 7fd5d1605700 1 --2- 172.21.15.81:0/306288590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 0x559f1cc34d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.844+0000 7fd5d1605700 1 -- 172.21.15.81:0/306288590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f1cb50560 con 0x559f1cc44b30 2024-05-09T00:11:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.844+0000 7fd5d1605700 1 --2- 172.21.15.81:0/306288590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc5eff0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0119c0 tx=0x7fd5bc005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c207cd2e94437275 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.844+0000 7fd5c37fe700 1 -- 172.21.15.81:0/306288590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0103d0 con 0x559f1cc44b30 2024-05-09T00:11:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.844+0000 7fd5c37fe700 1 -- 172.21.15.81:0/306288590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5bc010530 con 0x559f1cc44b30 2024-05-09T00:11:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.844+0000 7fd5c37fe700 1 -- 172.21.15.81:0/306288590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc010980 con 0x559f1cc44b30 2024-05-09T00:11:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.844+0000 7fd5df222b80 1 -- 172.21.15.81:0/306288590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 msgr2=0x559f1cc5eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.844+0000 7fd5df222b80 1 --2- 172.21.15.81:0/306288590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc5eff0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc0119c0 tx=0x7fd5bc005960 comp rx=0 tx=0).stop 2024-05-09T00:11:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.844+0000 7fd5df222b80 1 -- 172.21.15.81:0/306288590 shutdown_connections 2024-05-09T00:11:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.844+0000 7fd5df222b80 1 --2- 172.21.15.81:0/306288590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44b30 0x559f1cc5eff0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.844+0000 7fd5df222b80 1 --2- 172.21.15.81:0/306288590 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc3eca0 0x559f1cc3f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.844+0000 7fd5df222b80 1 --2- 172.21.15.81:0/306288590 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc44210 0x559f1cc34d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.844+0000 7fd5df222b80 1 -- 172.21.15.81:0/306288590 >> 172.21.15.81:0/306288590 conn(0x559f1cb98210 msgr2=0x559f1cc31210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:15.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.844+0000 7fd5df222b80 1 -- 172.21.15.81:0/306288590 shutdown_connections 2024-05-09T00:11:15.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.845+0000 7fd5df222b80 1 -- 172.21.15.81:0/306288590 wait complete. 2024-05-09T00:11:15.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.845+0000 7fd5df222b80 1 -- start start 2024-05-09T00:11:15.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.845+0000 7fd5df222b80 1 Processor -- start 2024-05-09T00:11:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.845+0000 7fd5df222b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc3eca0 0x559f1cc4f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.845+0000 7fd5df222b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44210 0x559f1cc4d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.845+0000 7fd5df222b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc44b30 0x559f1cc4de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.845+0000 7fd5df222b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1cc4e340 con 0x559f1cc44210 2024-05-09T00:11:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.845+0000 7fd5df222b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1cc4e4b0 con 0x559f1cc3eca0 2024-05-09T00:11:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.845+0000 7fd5df222b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f1cc4e670 con 0x559f1cc44b30 2024-05-09T00:11:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.845+0000 7fd5df222b80 10 client.0 _ll_register_callbacks cb 0x559f1cb2fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.845+0000 7fd5cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44210 0x559f1cc4d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.845+0000 7fd5cbfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44210 0x559f1cc4d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59858/0 (socket says 172.21.15.81:59858) 2024-05-09T00:11:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.845+0000 7fd5cbfff700 1 -- 172.21.15.81:0/3473546619 learned_addr learned my addr 172.21.15.81:0/3473546619 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:15.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.845+0000 7fd5d0e04700 1 --2- 172.21.15.81:0/3473546619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc3eca0 0x559f1cc4f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5d1605700 1 --2- 172.21.15.81:0/3473546619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc44b30 0x559f1cc4de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5cbfff700 1 -- 172.21.15.81:0/3473546619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc44b30 msgr2=0x559f1cc4de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/3473546619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc44b30 0x559f1cc4de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5cbfff700 1 -- 172.21.15.81:0/3473546619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc3eca0 msgr2=0x559f1cc4f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/3473546619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc3eca0 0x559f1cc4f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5cbfff700 1 -- 172.21.15.81:0/3473546619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f1c9b7b60 con 0x559f1cc44210 2024-05-09T00:11:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5d1605700 1 --2- 172.21.15.81:0/3473546619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc44b30 0x559f1cc4de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5cbfff700 1 --2- 172.21.15.81:0/3473546619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44210 0x559f1cc4d8c0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4005740 tx=0x7fd5b409ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59326d7296969cb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5abfff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5abfff700 1 -- 172.21.15.81:0/3473546619 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b40b3ea0 con 0x559f1cc44210 2024-05-09T00:11:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5abfff700 1 -- 172.21.15.81:0/3473546619 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fd5b409b380 con 0x559f1cc44210 2024-05-09T00:11:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5df222b80 1 -- 172.21.15.81:0/3473546619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd5b409f1b0 con 0x559f1cc44210 2024-05-09T00:11:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5abfff700 1 -- 172.21.15.81:0/3473546619 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5b40a3770 con 0x559f1cc44210 2024-05-09T00:11:15.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5df222b80 10 client.17859 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5df222b80 1 -- 172.21.15.81:0/3473546619 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559f1ca0fcd0 con 0x559f1cc44210 2024-05-09T00:11:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5abfff700 1 -- 172.21.15.81:0/3473546619 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd5b409f1b0 con 0x559f1cc44210 2024-05-09T00:11:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5abfff700 1 -- 172.21.15.81:0/3473546619 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd5b40a1140 con 0x559f1cc44210 2024-05-09T00:11:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5df222b80 10 client.17859 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5df222b80 10 client.17859 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5df222b80 20 client.17859 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5df222b80 1 --2- 172.21.15.81:0/3473546619 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559f1ccaf6e0 0x559f1ccb1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5df222b80 4 client.17859 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:11:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.846+0000 7fd5df222b80 1 -- 172.21.15.81:0/3473546619 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559f1cb82ec0 con 0x559f1ccaf6e0 2024-05-09T00:11:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5d0e04700 1 --2- 172.21.15.81:0/3473546619 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559f1ccaf6e0 0x559f1ccb1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5abfff700 10 client.17859 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5d0e04700 1 --2- 172.21.15.81:0/3473546619 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559f1ccaf6e0 0x559f1ccb1b00 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de08b43ca2c2c4e0 server_cookie=2f0678bb67a78c3c in_seq=0 out_seq=0 2024-05-09T00:11:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5abfff700 1 -- 172.21.15.81:0/3473546619 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559f1cb82ec0 con 0x559f1ccaf6e0 2024-05-09T00:11:15.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5abfff700 10 client.17859 handle_command_reply: tid=0 2024-05-09T00:11:15.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5df222b80 1 client.17859 shutdown 2024-05-09T00:11:15.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5df222b80 1 -- 172.21.15.81:0/3473546619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44210 msgr2=0x559f1cc4d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5df222b80 1 --2- 172.21.15.81:0/3473546619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44210 0x559f1cc4d8c0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4005740 tx=0x7fd5b409ac20 comp rx=0 tx=0).stop 2024-05-09T00:11:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5df222b80 1 -- 172.21.15.81:0/3473546619 shutdown_connections 2024-05-09T00:11:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5df222b80 1 --2- 172.21.15.81:0/3473546619 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559f1ccaf6e0 0x559f1ccb1b00 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5df222b80 1 --2- 172.21.15.81:0/3473546619 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559f1cc3eca0 0x559f1cc4f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5df222b80 1 --2- 172.21.15.81:0/3473546619 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559f1cc44b30 0x559f1cc4de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5abfff700 0 client.17859 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5df222b80 1 --2- 172.21.15.81:0/3473546619 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559f1cc44210 0x559f1cc4d8c0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.847+0000 7fd5df222b80 1 -- 172.21.15.81:0/3473546619 >> 172.21.15.81:0/3473546619 conn(0x559f1cb98210 msgr2=0x559f1cc3f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5df222b80 1 -- 172.21.15.81:0/3473546619 shutdown_connections 2024-05-09T00:11:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5df222b80 1 -- 172.21.15.81:0/3473546619 wait complete. 2024-05-09T00:11:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5df222b80 20 client.17859 trim_cache size 0 max 16384 2024-05-09T00:11:15.854 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:11:15.854 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:11:15.854 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:11:15.854 INFO:teuthology.orchestra.run.smithi081.stdout: "83b838cd-ef23-4877-9e75-cdeb003b93ab": { 2024-05-09T00:11:15.854 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:11:15.854 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "83b838cd-ef23-4877-9e75-cdeb003b93ab", 2024-05-09T00:11:15.854 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:11:15.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:11:15.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:11:15.854 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:11:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5d3068700 1 -- 172.21.15.81:0/2977762175 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd5b80a1290 msgr2=0x7fd5b80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5d3068700 1 --2- 172.21.15.81:0/2977762175 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd5b80a1290 0x7fd5b80a3750 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd5c400d0e0 tx=0x7fd5c40085a0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5d3068700 1 -- 172.21.15.81:0/2977762175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc106280 msgr2=0x7fd5cc197890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5d3068700 1 --2- 172.21.15.81:0/2977762175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc106280 0x7fd5cc197890 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4005770 tx=0x7fd5b4009580 comp rx=0 tx=0).stop 2024-05-09T00:11:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5d3068700 1 -- 172.21.15.81:0/2977762175 shutdown_connections 2024-05-09T00:11:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5d3068700 1 --2- 172.21.15.81:0/2977762175 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd5b80a1290 0x7fd5b80a3750 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5d3068700 1 --2- 172.21.15.81:0/2977762175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd5cc101160 0x7fd5cc197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5d3068700 1 --2- 172.21.15.81:0/2977762175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd5cc19bc30 0x7fd5cc19c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5d3068700 1 --2- 172.21.15.81:0/2977762175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5cc106280 0x7fd5cc197890 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5d3068700 1 -- 172.21.15.81:0/2977762175 >> 172.21.15.81:0/2977762175 conn(0x7fd5cc0fc9c0 msgr2=0x7fd5cc0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5d3068700 1 -- 172.21.15.81:0/2977762175 shutdown_connections 2024-05-09T00:11:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:15.848+0000 7fd5d3068700 1 -- 172.21.15.81:0/2977762175 wait complete. 2024-05-09T00:11:15.857 INFO:tasks.cephfs.filesystem:scrub status for tag:83b838cd-ef23-4877-9e75-cdeb003b93ab - {'path': '/', 'tag': '83b838cd-ef23-4877-9e75-cdeb003b93ab', 'options': 'recursive,force'} 2024-05-09T00:11:17.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:16 smithi150 ceph-mon[46187]: pgmap v256: 97 pgs: 97 active+clean; 2.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-05-09T00:11:17.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:16 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:11:17.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:16 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:11:17.018 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:16 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:11:17.018 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:16 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:11:17.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:16 smithi171 ceph-mon[47351]: pgmap v256: 97 pgs: 97 active+clean; 2.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-05-09T00:11:17.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:16 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:11:17.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:16 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:11:17.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:16 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:11:17.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:16 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:11:17.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:16 smithi081 ceph-mon[42474]: pgmap v256: 97 pgs: 97 active+clean; 2.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-05-09T00:11:17.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:16 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:11:17.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:16 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:11:17.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:16 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:11:17.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:16 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:11:18.905 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.905+0000 7f8304a2c700 1 -- 172.21.15.81:0/42428374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300100ee0 msgr2=0x7f830010cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.905+0000 7f8304a2c700 1 --2- 172.21.15.81:0/42428374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300100ee0 0x7f830010cbf0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f82f800b0a0 tx=0x7f82f800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.905+0000 7f8304a2c700 1 -- 172.21.15.81:0/42428374 shutdown_connections 2024-05-09T00:11:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.905+0000 7f8304a2c700 1 --2- 172.21.15.81:0/42428374 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8300104d80 0x7f8300105160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.905+0000 7f8304a2c700 1 --2- 172.21.15.81:0/42428374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300100ee0 0x7f830010cbf0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.905+0000 7f8304a2c700 1 --2- 172.21.15.81:0/42428374 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8300100520 0x7f83001009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.905+0000 7f8304a2c700 1 -- 172.21.15.81:0/42428374 >> 172.21.15.81:0/42428374 conn(0x7f83000763a0 msgr2=0x7f83000fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.905+0000 7f8304a2c700 1 -- 172.21.15.81:0/42428374 shutdown_connections 2024-05-09T00:11:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.905+0000 7f8304a2c700 1 -- 172.21.15.81:0/42428374 wait complete. 2024-05-09T00:11:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.906+0000 7f8304a2c700 1 Processor -- start 2024-05-09T00:11:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.906+0000 7f8304a2c700 1 -- start start 2024-05-09T00:11:18.906 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.906+0000 7f8304a2c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8300100520 0x7f8300198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.906+0000 7f8304a2c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8300100ee0 0x7f8300198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.906+0000 7f8304a2c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300104d80 0x7f83001a33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.906+0000 7f8304a2c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83001990a0 con 0x7f8300104d80 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.906+0000 7f8304a2c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83001a38f0 con 0x7f8300100ee0 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.906+0000 7f8304a2c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83001a3a30 con 0x7f8300100520 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f82fed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300104d80 0x7f83001a33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f82fed9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300104d80 0x7f83001a33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35882/0 (socket says 172.21.15.81:35882) 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f82fed9d700 1 -- 172.21.15.81:0/823800894 learned_addr learned my addr 172.21.15.81:0/823800894 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f82fe59c700 1 --2- 172.21.15.81:0/823800894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8300100520 0x7f8300198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f82fdd9b700 1 --2- 172.21.15.81:0/823800894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8300100ee0 0x7f8300198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f82fed9d700 1 -- 172.21.15.81:0/823800894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8300100520 msgr2=0x7f8300198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f82fed9d700 1 --2- 172.21.15.81:0/823800894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8300100520 0x7f8300198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f82fed9d700 1 -- 172.21.15.81:0/823800894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8300100ee0 msgr2=0x7f8300198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f82fed9d700 1 --2- 172.21.15.81:0/823800894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8300100ee0 0x7f8300198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.907 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f82fed9d700 1 -- 172.21.15.81:0/823800894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f8009d00 con 0x7f8300104d80 2024-05-09T00:11:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f82fed9d700 1 --2- 172.21.15.81:0/823800894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300104d80 0x7f83001a33b0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f82f800b070 tx=0x7f82f8004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f82f77fe700 1 -- 172.21.15.81:0/823800894 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f800e040 con 0x7f8300104d80 2024-05-09T00:11:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f82f77fe700 1 -- 172.21.15.81:0/823800894 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82f8009440 con 0x7f8300104d80 2024-05-09T00:11:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f8304a2c700 1 -- 172.21.15.81:0/823800894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83001a3c30 con 0x7f8300104d80 2024-05-09T00:11:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f82f77fe700 1 -- 172.21.15.81:0/823800894 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f801b450 con 0x7f8300104d80 2024-05-09T00:11:18.908 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.907+0000 7f8304a2c700 1 -- 172.21.15.81:0/823800894 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83001a4060 con 0x7f8300104d80 2024-05-09T00:11:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.909+0000 7f82f77fe700 1 -- 172.21.15.81:0/823800894 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f82f801d480 con 0x7f8300104d80 2024-05-09T00:11:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.910+0000 7f82f77fe700 1 --2- 172.21.15.81:0/823800894 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f82ec0a1290 0x7f82ec0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.910+0000 7f82fe59c700 1 --2- 172.21.15.81:0/823800894 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f82ec0a1290 0x7f82ec0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.910+0000 7f82f77fe700 1 -- 172.21.15.81:0/823800894 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f82f80ce640 con 0x7f8300104d80 2024-05-09T00:11:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.910+0000 7f82fe59c700 1 --2- 172.21.15.81:0/823800894 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f82ec0a1290 0x7f82ec0a3750 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f82f000abd0 tx=0x7f82f000a380 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.911+0000 7f8310be6b80 1 Processor -- start 2024-05-09T00:11:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.911+0000 7f8310be6b80 1 -- start start 2024-05-09T00:11:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f8310be6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63eca950 0x564a63ecad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f8310be6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63ecb270 0x564a63ec4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f8310be6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ec5480 0x564a63ec58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f8310be6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a63e1c0f0 con 0x564a63eca950 2024-05-09T00:11:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f8310be6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a63e19ab0 con 0x564a63ecb270 2024-05-09T00:11:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f8310be6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a63e153a0 con 0x564a63ec5480 2024-05-09T00:11:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f82fe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63eca950 0x564a63ecad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f82fe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63eca950 0x564a63ecad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35884/0 (socket says 172.21.15.81:35884) 2024-05-09T00:11:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f82fe59c700 1 -- 172.21.15.81:0/1125294435 learned_addr learned my addr 172.21.15.81:0/1125294435 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f82fdd9b700 1 --2- 172.21.15.81:0/1125294435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63ecb270 0x564a63ec4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f82fe59c700 1 -- 172.21.15.81:0/1125294435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ec5480 msgr2=0x564a63ec58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f82fe59c700 1 --2- 172.21.15.81:0/1125294435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ec5480 0x564a63ec58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f82fe59c700 1 -- 172.21.15.81:0/1125294435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63ecb270 msgr2=0x564a63ec4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f82fe59c700 1 --2- 172.21.15.81:0/1125294435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63ecb270 0x564a63ec4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f82fe59c700 1 -- 172.21.15.81:0/1125294435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a63c96350 con 0x564a63eca950 2024-05-09T00:11:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f82fe59c700 1 --2- 172.21.15.81:0/1125294435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63eca950 0x564a63ecad30 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f82f0004530 tx=0x7f82f0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806253c7ed4d9d66 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f82f4ff9700 1 -- 172.21.15.81:0/1125294435 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0003af0 con 0x564a63eca950 2024-05-09T00:11:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f82f4ff9700 1 -- 172.21.15.81:0/1125294435 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82f0003c50 con 0x564a63eca950 2024-05-09T00:11:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.912+0000 7f82f4ff9700 1 -- 172.21.15.81:0/1125294435 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f001d660 con 0x564a63eca950 2024-05-09T00:11:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.913+0000 7f8310be6b80 1 -- 172.21.15.81:0/1125294435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63eca950 msgr2=0x564a63ecad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.913+0000 7f8310be6b80 1 --2- 172.21.15.81:0/1125294435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63eca950 0x564a63ecad30 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f82f0004530 tx=0x7f82f0012000 comp rx=0 tx=0).stop 2024-05-09T00:11:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.913+0000 7f8310be6b80 1 -- 172.21.15.81:0/1125294435 shutdown_connections 2024-05-09T00:11:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.913+0000 7f8310be6b80 1 --2- 172.21.15.81:0/1125294435 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ec5480 0x564a63ec58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.913+0000 7f8310be6b80 1 --2- 172.21.15.81:0/1125294435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63eca950 0x564a63ecad30 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.913 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.913+0000 7f8310be6b80 1 --2- 172.21.15.81:0/1125294435 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63ecb270 0x564a63ec4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.913+0000 7f8310be6b80 1 -- 172.21.15.81:0/1125294435 >> 172.21.15.81:0/1125294435 conn(0x564a63e231b0 msgr2=0x564a63ebf840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.913+0000 7f8310be6b80 1 -- 172.21.15.81:0/1125294435 shutdown_connections 2024-05-09T00:11:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.913+0000 7f8310be6b80 1 -- 172.21.15.81:0/1125294435 wait complete. 2024-05-09T00:11:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f8310be6b80 1 -- start start 2024-05-09T00:11:18.914 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f8310be6b80 1 Processor -- start 2024-05-09T00:11:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f8310be6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ed1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f8310be6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ece550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f8310be6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 0x564a63ecec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f8310be6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a63db1500 con 0x564a63ec5480 2024-05-09T00:11:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f8310be6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a63db11a0 con 0x564a63eca950 2024-05-09T00:11:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f8310be6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a63c98640 con 0x564a63ecb270 2024-05-09T00:11:18.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f82fe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ed1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f8310be6b80 10 client.0 _ll_register_callbacks cb 0x564a63dbaad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f82fe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ed1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35896/0 (socket says 172.21.15.81:35896) 2024-05-09T00:11:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f82fe59c700 1 -- 172.21.15.81:0/2838984072 learned_addr learned my addr 172.21.15.81:0/2838984072 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f82fed9d700 1 --2- 172.21.15.81:0/2838984072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 0x564a63ecec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f82fdd9b700 1 --2- 172.21.15.81:0/2838984072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ece550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f82fe59c700 1 -- 172.21.15.81:0/2838984072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 msgr2=0x564a63ecec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f82fe59c700 1 --2- 172.21.15.81:0/2838984072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 0x564a63ecec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f82fe59c700 1 -- 172.21.15.81:0/2838984072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 msgr2=0x564a63ece550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f82fe59c700 1 --2- 172.21.15.81:0/2838984072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ece550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f82fe59c700 1 -- 172.21.15.81:0/2838984072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f00041e0 con 0x564a63ec5480 2024-05-09T00:11:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.914+0000 7f82fdd9b700 1 --2- 172.21.15.81:0/2838984072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ece550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f82fe59c700 1 --2- 172.21.15.81:0/2838984072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ed1280 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f82f0004500 tx=0x7f82f0003b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144010a6230a1868 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f82e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:18.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f82e5ffb700 1 -- 172.21.15.81:0/2838984072 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f002b070 con 0x564a63ec5480 2024-05-09T00:11:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f82e5ffb700 1 -- 172.21.15.81:0/2838984072 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f82f0010700 con 0x564a63ec5480 2024-05-09T00:11:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f8310be6b80 1 -- 172.21.15.81:0/2838984072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a63d6e210 con 0x564a63ec5480 2024-05-09T00:11:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f82e5ffb700 1 -- 172.21.15.81:0/2838984072 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82f00108c0 con 0x564a63ec5480 2024-05-09T00:11:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f8310be6b80 10 client.17871 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f8310be6b80 1 -- 172.21.15.81:0/2838984072 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564a63c42b00 con 0x564a63ec5480 2024-05-09T00:11:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f82e5ffb700 1 -- 172.21.15.81:0/2838984072 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82f003c080 con 0x564a63ec5480 2024-05-09T00:11:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f82e5ffb700 1 -- 172.21.15.81:0/2838984072 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f82f0004b40 con 0x564a63ec5480 2024-05-09T00:11:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f8310be6b80 10 client.17871 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f8310be6b80 10 client.17871 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f8310be6b80 20 client.17871 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f8310be6b80 1 --2- 172.21.15.81:0/2838984072 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a63edeb00 0x564a63ee0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f8310be6b80 4 client.17871 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.915+0000 7f8310be6b80 1 -- 172.21.15.81:0/2838984072 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a63e947b0 con 0x564a63edeb00 2024-05-09T00:11:18.919 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.916+0000 7f82fdd9b700 1 --2- 172.21.15.81:0/2838984072 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a63edeb00 0x564a63ee0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.916+0000 7f82e5ffb700 10 client.17871 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.916+0000 7f82fdd9b700 1 --2- 172.21.15.81:0/2838984072 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a63edeb00 0x564a63ee0f20 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=579b6da9dc0d119a server_cookie=c8ba433c564281ba in_seq=0 out_seq=0 2024-05-09T00:11:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f82e5ffb700 1 -- 172.21.15.81:0/2838984072 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564a63e947b0 con 0x564a63edeb00 2024-05-09T00:11:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f82e5ffb700 10 client.17871 handle_command_reply: tid=0 2024-05-09T00:11:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f8310be6b80 1 client.17871 shutdown 2024-05-09T00:11:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f8310be6b80 1 -- 172.21.15.81:0/2838984072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 msgr2=0x564a63ed1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f8310be6b80 1 --2- 172.21.15.81:0/2838984072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ed1280 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f82f0004500 tx=0x7f82f0003b70 comp rx=0 tx=0).stop 2024-05-09T00:11:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f8310be6b80 1 -- 172.21.15.81:0/2838984072 shutdown_connections 2024-05-09T00:11:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f8310be6b80 1 --2- 172.21.15.81:0/2838984072 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a63edeb00 0x564a63ee0f20 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f8310be6b80 1 --2- 172.21.15.81:0/2838984072 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 0x564a63ecec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f8310be6b80 1 --2- 172.21.15.81:0/2838984072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ed1280 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f8310be6b80 1 --2- 172.21.15.81:0/2838984072 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ece550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f82e5ffb700 0 client.17871 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:18.920 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f8310be6b80 1 -- 172.21.15.81:0/2838984072 >> 172.21.15.81:0/2838984072 conn(0x564a63e231b0 msgr2=0x564a63ec94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:18.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f8310be6b80 1 -- 172.21.15.81:0/2838984072 shutdown_connections 2024-05-09T00:11:18.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f8310be6b80 1 -- 172.21.15.81:0/2838984072 wait complete. 2024-05-09T00:11:18.921 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.917+0000 7f8310be6b80 20 client.17871 trim_cache size 0 max 16384 2024-05-09T00:11:18.934 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f8310be6b80 1 Processor -- start 2024-05-09T00:11:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f8310be6b80 1 -- start start 2024-05-09T00:11:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f8310be6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ecec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f8310be6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ec5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f8310be6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 0x564a63eda6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f8310be6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a63ee6180 con 0x564a63ec5480 2024-05-09T00:11:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f8310be6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a63eccaa0 con 0x564a63eca950 2024-05-09T00:11:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f8310be6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a63ec0580 con 0x564a63ecb270 2024-05-09T00:11:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f82fe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ecec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f82fe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ecec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35904/0 (socket says 172.21.15.81:35904) 2024-05-09T00:11:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f82fe59c700 1 -- 172.21.15.81:0/4072693033 learned_addr learned my addr 172.21.15.81:0/4072693033 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f82fed9d700 1 --2- 172.21.15.81:0/4072693033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 0x564a63eda6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f82fdd9b700 1 --2- 172.21.15.81:0/4072693033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ec5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.935 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f82fe59c700 1 -- 172.21.15.81:0/4072693033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 msgr2=0x564a63eda6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f82fe59c700 1 --2- 172.21.15.81:0/4072693033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 0x564a63eda6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f82fe59c700 1 -- 172.21.15.81:0/4072693033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 msgr2=0x564a63ec5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f82fe59c700 1 --2- 172.21.15.81:0/4072693033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ec5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f82fe59c700 1 -- 172.21.15.81:0/4072693033 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a63ddb500 con 0x564a63ec5480 2024-05-09T00:11:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f82fdd9b700 1 --2- 172.21.15.81:0/4072693033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ec5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.932+0000 7f82fe59c700 1 --2- 172.21.15.81:0/4072693033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ecec90 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f82f0005c20 tx=0x7f82f0003be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e90e4543aba0167 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.933+0000 7f82f57fa700 1 -- 172.21.15.81:0/4072693033 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f002b030 con 0x564a63ec5480 2024-05-09T00:11:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.933+0000 7f82f57fa700 1 -- 172.21.15.81:0/4072693033 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564a63d6e210 con 0x564a63ec5480 2024-05-09T00:11:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.933+0000 7f82f57fa700 1 -- 172.21.15.81:0/4072693033 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0004940 con 0x564a63ec5480 2024-05-09T00:11:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.933+0000 7f8310be6b80 1 -- 172.21.15.81:0/4072693033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 msgr2=0x564a63ecec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.933+0000 7f8310be6b80 1 --2- 172.21.15.81:0/4072693033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ecec90 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f82f0005c20 tx=0x7f82f0003be0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.933+0000 7f8310be6b80 1 -- 172.21.15.81:0/4072693033 shutdown_connections 2024-05-09T00:11:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.933+0000 7f8310be6b80 1 --2- 172.21.15.81:0/4072693033 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 0x564a63eda6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.936 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.933+0000 7f8310be6b80 1 --2- 172.21.15.81:0/4072693033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ecec90 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.933+0000 7f8310be6b80 1 --2- 172.21.15.81:0/4072693033 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ec5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.933+0000 7f8310be6b80 1 -- 172.21.15.81:0/4072693033 >> 172.21.15.81:0/4072693033 conn(0x564a63e231b0 msgr2=0x564a63ecce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.933+0000 7f8310be6b80 1 -- 172.21.15.81:0/4072693033 shutdown_connections 2024-05-09T00:11:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.933+0000 7f8310be6b80 1 -- 172.21.15.81:0/4072693033 wait complete. 2024-05-09T00:11:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.933+0000 7f8310be6b80 1 -- start start 2024-05-09T00:11:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f8310be6b80 1 Processor -- start 2024-05-09T00:11:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f8310be6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ed5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f8310be6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ec83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f8310be6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 0x564a63ec8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f8310be6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a63ed6550 con 0x564a63ec5480 2024-05-09T00:11:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f8310be6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a63ec8ea0 con 0x564a63eca950 2024-05-09T00:11:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f8310be6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a63ec9060 con 0x564a63ecb270 2024-05-09T00:11:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f8310be6b80 10 client.0 _ll_register_callbacks cb 0x564a63dbaad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:18.937 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82fe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ed5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82fe59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ed5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35906/0 (socket says 172.21.15.81:35906) 2024-05-09T00:11:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82fe59c700 1 -- 172.21.15.81:0/192787231 learned_addr learned my addr 172.21.15.81:0/192787231 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82fdd9b700 1 --2- 172.21.15.81:0/192787231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ec83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82fed9d700 1 --2- 172.21.15.81:0/192787231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 0x564a63ec8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82fe59c700 1 -- 172.21.15.81:0/192787231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 msgr2=0x564a63ec8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82fe59c700 1 --2- 172.21.15.81:0/192787231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 0x564a63ec8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82fe59c700 1 -- 172.21.15.81:0/192787231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 msgr2=0x564a63ec83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82fe59c700 1 --2- 172.21.15.81:0/192787231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ec83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82fe59c700 1 -- 172.21.15.81:0/192787231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a63c42b00 con 0x564a63ec5480 2024-05-09T00:11:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82fdd9b700 1 --2- 172.21.15.81:0/192787231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ec83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82fe59c700 1 --2- 172.21.15.81:0/192787231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ed5e00 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f82f0028040 tx=0x7f82f0003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e6e3b931482467 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:18.938 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82e5ffb700 1 -- 172.21.15.81:0/192787231 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f002b070 con 0x564a63ec5480 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.934+0000 7f82e5ffb700 1 -- 172.21.15.81:0/192787231 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f82f002c070 con 0x564a63ec5480 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.935+0000 7f8310be6b80 1 -- 172.21.15.81:0/192787231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82f0003c50 con 0x564a63ec5480 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.935+0000 7f82e5ffb700 1 -- 172.21.15.81:0/192787231 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82f0004af0 con 0x564a63ec5480 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.935+0000 7f8310be6b80 10 client.17877 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.935+0000 7f8310be6b80 1 -- 172.21.15.81:0/192787231 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564a63c9ac70 con 0x564a63ec5480 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.935+0000 7f82e5ffb700 1 -- 172.21.15.81:0/192787231 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82f004e020 con 0x564a63ec5480 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.935+0000 7f82e5ffb700 1 -- 172.21.15.81:0/192787231 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f82f0041070 con 0x564a63ec5480 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.935+0000 7f8310be6b80 10 client.17877 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.935+0000 7f8310be6b80 10 client.17877 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.935+0000 7f8310be6b80 20 client.17877 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.935+0000 7f8310be6b80 1 --2- 172.21.15.81:0/192787231 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a63f39640 0x564a63f3ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.935+0000 7f8310be6b80 4 client.17877 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.935+0000 7f8310be6b80 1 -- 172.21.15.81:0/192787231 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564a63e0de60 con 0x564a63f39640 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.935+0000 7f82fdd9b700 1 --2- 172.21.15.81:0/192787231 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a63f39640 0x564a63f3ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:18.939 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.936+0000 7f82e5ffb700 10 client.17877 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:18.940 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.936+0000 7f82fdd9b700 1 --2- 172.21.15.81:0/192787231 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a63f39640 0x564a63f3ba30 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d895cf8ac4858dd5 server_cookie=563569e2c0a123a5 in_seq=0 out_seq=0 2024-05-09T00:11:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f82e5ffb700 1 -- 172.21.15.81:0/192787231 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564a63e0de60 con 0x564a63f39640 2024-05-09T00:11:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f82e5ffb700 10 client.17877 handle_command_reply: tid=0 2024-05-09T00:11:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f8310be6b80 1 client.17877 shutdown 2024-05-09T00:11:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f8310be6b80 1 -- 172.21.15.81:0/192787231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 msgr2=0x564a63ed5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f8310be6b80 1 --2- 172.21.15.81:0/192787231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ed5e00 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f82f0028040 tx=0x7f82f0003f40 comp rx=0 tx=0).stop 2024-05-09T00:11:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f8310be6b80 1 -- 172.21.15.81:0/192787231 shutdown_connections 2024-05-09T00:11:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f8310be6b80 1 --2- 172.21.15.81:0/192787231 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a63f39640 0x564a63f3ba30 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f8310be6b80 1 --2- 172.21.15.81:0/192787231 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a63ecb270 0x564a63ec8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f8310be6b80 1 --2- 172.21.15.81:0/192787231 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a63ec5480 0x564a63ed5e00 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f82e5ffb700 0 client.17877 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f8310be6b80 1 --2- 172.21.15.81:0/192787231 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a63eca950 0x564a63ec83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f8310be6b80 1 -- 172.21.15.81:0/192787231 >> 172.21.15.81:0/192787231 conn(0x564a63e231b0 msgr2=0x564a63ecdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f8310be6b80 1 -- 172.21.15.81:0/192787231 shutdown_connections 2024-05-09T00:11:18.947 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f8310be6b80 1 -- 172.21.15.81:0/192787231 wait complete. 2024-05-09T00:11:18.948 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.948+0000 7f8310be6b80 20 client.17877 trim_cache size 0 max 16384 2024-05-09T00:11:18.948 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:11:18.948 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:11:18.948 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:11:18.948 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:11:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.949+0000 7f8304a2c700 1 -- 172.21.15.81:0/823800894 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f82ec0a1290 msgr2=0x7f82ec0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.949+0000 7f8304a2c700 1 --2- 172.21.15.81:0/823800894 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f82ec0a1290 0x7f82ec0a3750 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f82f000abd0 tx=0x7f82f000a380 comp rx=0 tx=0).stop 2024-05-09T00:11:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.949+0000 7f8304a2c700 1 -- 172.21.15.81:0/823800894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300104d80 msgr2=0x7f83001a33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.949+0000 7f8304a2c700 1 --2- 172.21.15.81:0/823800894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300104d80 0x7f83001a33b0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f82f800b070 tx=0x7f82f8004d00 comp rx=0 tx=0).stop 2024-05-09T00:11:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.949+0000 7f8304a2c700 1 -- 172.21.15.81:0/823800894 shutdown_connections 2024-05-09T00:11:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.949+0000 7f8304a2c700 1 --2- 172.21.15.81:0/823800894 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f82ec0a1290 0x7f82ec0a3750 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.949+0000 7f8304a2c700 1 --2- 172.21.15.81:0/823800894 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8300104d80 0x7f83001a33b0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.949+0000 7f8304a2c700 1 --2- 172.21.15.81:0/823800894 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8300100520 0x7f8300198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.949+0000 7f8304a2c700 1 --2- 172.21.15.81:0/823800894 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8300100ee0 0x7f8300198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.949+0000 7f8304a2c700 1 -- 172.21.15.81:0/823800894 >> 172.21.15.81:0/823800894 conn(0x7f83000763a0 msgr2=0x7f83000fb990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:18.949 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.949+0000 7f8304a2c700 1 -- 172.21.15.81:0/823800894 shutdown_connections 2024-05-09T00:11:18.950 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:18.949+0000 7f8304a2c700 1 -- 172.21.15.81:0/823800894 wait complete. 2024-05-09T00:11:19.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:18 smithi150 ceph-mon[46187]: pgmap v257: 97 pgs: 97 active+clean; 2.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 52 KiB/s wr, 15 op/s 2024-05-09T00:11:19.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:18 smithi171 ceph-mon[47351]: pgmap v257: 97 pgs: 97 active+clean; 2.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 52 KiB/s wr, 15 op/s 2024-05-09T00:11:19.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:18 smithi081 ceph-mon[42474]: pgmap v257: 97 pgs: 97 active+clean; 2.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 52 KiB/s wr, 15 op/s 2024-05-09T00:11:20.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:19 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:11:20.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:19 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:11:20.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:19 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:11:21.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:20 smithi150 ceph-mon[46187]: pgmap v258: 97 pgs: 97 active+clean; 2.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 52 KiB/s wr, 15 op/s 2024-05-09T00:11:21.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:20 smithi171 ceph-mon[47351]: pgmap v258: 97 pgs: 97 active+clean; 2.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 52 KiB/s wr, 15 op/s 2024-05-09T00:11:21.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:20 smithi081 ceph-mon[42474]: pgmap v258: 97 pgs: 97 active+clean; 2.1 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 52 KiB/s wr, 15 op/s 2024-05-09T00:11:23.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:22 smithi150 ceph-mon[46187]: pgmap v259: 97 pgs: 97 active+clean; 2.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 16 op/s 2024-05-09T00:11:23.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:22 smithi171 ceph-mon[47351]: pgmap v259: 97 pgs: 97 active+clean; 2.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 16 op/s 2024-05-09T00:11:23.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:22 smithi081 ceph-mon[42474]: pgmap v259: 97 pgs: 97 active+clean; 2.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 51 KiB/s wr, 16 op/s 2024-05-09T00:11:25.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:24 smithi171 ceph-mon[47351]: pgmap v260: 97 pgs: 97 active+clean; 2.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 16 op/s 2024-05-09T00:11:25.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:24 smithi081 ceph-mon[42474]: pgmap v260: 97 pgs: 97 active+clean; 2.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 16 op/s 2024-05-09T00:11:25.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:24 smithi150 ceph-mon[46187]: pgmap v260: 97 pgs: 97 active+clean; 2.4 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 16 op/s 2024-05-09T00:11:27.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:26 smithi171 ceph-mon[47351]: pgmap v261: 97 pgs: 97 active+clean; 2.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:11:27.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:26 smithi081 ceph-mon[42474]: pgmap v261: 97 pgs: 97 active+clean; 2.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:11:27.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:26 smithi150 ceph-mon[46187]: pgmap v261: 97 pgs: 97 active+clean; 2.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:11:29.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:28 smithi171 ceph-mon[47351]: pgmap v262: 97 pgs: 97 active+clean; 2.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:11:29.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:28 smithi081 ceph-mon[42474]: pgmap v262: 97 pgs: 97 active+clean; 2.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:11:29.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:28 smithi150 ceph-mon[46187]: pgmap v262: 97 pgs: 97 active+clean; 2.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:11:31.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:30 smithi171 ceph-mon[47351]: pgmap v263: 97 pgs: 97 active+clean; 2.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:11:31.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:30 smithi081 ceph-mon[42474]: pgmap v263: 97 pgs: 97 active+clean; 2.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:11:31.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:30 smithi150 ceph-mon[46187]: pgmap v263: 97 pgs: 97 active+clean; 2.6 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:11:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.068+0000 7f4d28665700 1 -- 172.21.15.81:0/2360410405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d20100080 msgr2=0x7f4d20100500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.068+0000 7f4d28665700 1 --2- 172.21.15.81:0/2360410405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d20100080 0x7f4d20100500 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f4d100099c0 tx=0x7f4d10009cd0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.068+0000 7f4d28665700 1 -- 172.21.15.81:0/2360410405 shutdown_connections 2024-05-09T00:11:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.068+0000 7f4d28665700 1 --2- 172.21.15.81:0/2360410405 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d20100a40 0x7f4d2010cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.068+0000 7f4d28665700 1 --2- 172.21.15.81:0/2360410405 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d20104de0 0x7f4d201051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.068+0000 7f4d28665700 1 --2- 172.21.15.81:0/2360410405 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d20100080 0x7f4d20100500 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.068+0000 7f4d28665700 1 -- 172.21.15.81:0/2360410405 >> 172.21.15.81:0/2360410405 conn(0x7f4d20076c10 msgr2=0x7f4d20077020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.068+0000 7f4d28665700 1 -- 172.21.15.81:0/2360410405 shutdown_connections 2024-05-09T00:11:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.068+0000 7f4d28665700 1 -- 172.21.15.81:0/2360410405 wait complete. 2024-05-09T00:11:32.068 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d28665700 1 Processor -- start 2024-05-09T00:11:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d28665700 1 -- start start 2024-05-09T00:11:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d28665700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d20100080 0x7f4d2010d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d28665700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d20100a40 0x7f4d2010db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d28665700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d20104de0 0x7f4d2010e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d28665700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d201a5660 con 0x7f4d20104de0 2024-05-09T00:11:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d28665700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d201a57d0 con 0x7f4d20100a40 2024-05-09T00:11:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d28665700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d201a5990 con 0x7f4d20100080 2024-05-09T00:11:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d26c02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d20104de0 0x7f4d2010e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d26c02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d20104de0 0x7f4d2010e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47856/0 (socket says 172.21.15.81:47856) 2024-05-09T00:11:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d26c02700 1 -- 172.21.15.81:0/56866770 learned_addr learned my addr 172.21.15.81:0/56866770 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d25c00700 1 --2- 172.21.15.81:0/56866770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d20100a40 0x7f4d2010db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d26401700 1 --2- 172.21.15.81:0/56866770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d20100080 0x7f4d2010d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d26c02700 1 -- 172.21.15.81:0/56866770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d20100080 msgr2=0x7f4d2010d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:32.069 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d26c02700 1 --2- 172.21.15.81:0/56866770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d20100080 0x7f4d2010d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d26c02700 1 -- 172.21.15.81:0/56866770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d20100a40 msgr2=0x7f4d2010db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d26c02700 1 --2- 172.21.15.81:0/56866770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d20100a40 0x7f4d2010db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.069+0000 7f4d26c02700 1 -- 172.21.15.81:0/56866770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d100095f0 con 0x7f4d20104de0 2024-05-09T00:11:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.070+0000 7f4d26c02700 1 --2- 172.21.15.81:0/56866770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d20104de0 0x7f4d2010e0b0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800ada0 tx=0x7f4d1800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.070+0000 7f4d177fe700 1 -- 172.21.15.81:0/56866770 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800f070 con 0x7f4d20104de0 2024-05-09T00:11:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.070+0000 7f4d177fe700 1 -- 172.21.15.81:0/56866770 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d18007b30 con 0x7f4d20104de0 2024-05-09T00:11:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.070+0000 7f4d28665700 1 -- 172.21.15.81:0/56866770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d201a5c70 con 0x7f4d20104de0 2024-05-09T00:11:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.070+0000 7f4d177fe700 1 -- 172.21.15.81:0/56866770 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18005280 con 0x7f4d20104de0 2024-05-09T00:11:32.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.070+0000 7f4d28665700 1 -- 172.21.15.81:0/56866770 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d201a6100 con 0x7f4d20104de0 2024-05-09T00:11:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.072+0000 7f4d177fe700 1 -- 172.21.15.81:0/56866770 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4d1800c8d0 con 0x7f4d20104de0 2024-05-09T00:11:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.073+0000 7f4d177fe700 1 --2- 172.21.15.81:0/56866770 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4d0c0a1290 0x7f4d0c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.073+0000 7f4d26401700 1 --2- 172.21.15.81:0/56866770 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4d0c0a1290 0x7f4d0c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.073+0000 7f4d177fe700 1 -- 172.21.15.81:0/56866770 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f4d180cc2e0 con 0x7f4d20104de0 2024-05-09T00:11:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.073+0000 7f4d26401700 1 --2- 172.21.15.81:0/56866770 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4d0c0a1290 0x7f4d0c0a3750 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00ac50 tx=0x7f4d1c00a380 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.073+0000 7f4d3481fb80 1 Processor -- start 2024-05-09T00:11:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.074+0000 7f4d3481fb80 1 -- start start 2024-05-09T00:11:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.074+0000 7f4d3481fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f53950 0x5641d5f53d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.074+0000 7f4d3481fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f54270 0x5641d5f4df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.074+0000 7f4d3481fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f4e480 0x5641d5f4e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.074+0000 7f4d3481fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d5ea50f0 con 0x5641d5f4e480 2024-05-09T00:11:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.074+0000 7f4d3481fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d5ea2ab0 con 0x5641d5f53950 2024-05-09T00:11:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.074+0000 7f4d3481fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d5e9e3a0 con 0x5641d5f54270 2024-05-09T00:11:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.074+0000 7f4d26c02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f4e480 0x5641d5f4e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.074+0000 7f4d26c02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f4e480 0x5641d5f4e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47860/0 (socket says 172.21.15.81:47860) 2024-05-09T00:11:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.074+0000 7f4d26c02700 1 -- 172.21.15.81:0/1311537459 learned_addr learned my addr 172.21.15.81:0/1311537459 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.074+0000 7f4d26401700 1 --2- 172.21.15.81:0/1311537459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f53950 0x5641d5f53d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.074+0000 7f4d25c00700 1 --2- 172.21.15.81:0/1311537459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f54270 0x5641d5f4df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.074+0000 7f4d26c02700 1 -- 172.21.15.81:0/1311537459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f54270 msgr2=0x5641d5f4df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.074+0000 7f4d26c02700 1 --2- 172.21.15.81:0/1311537459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f54270 0x5641d5f4df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.075+0000 7f4d26c02700 1 -- 172.21.15.81:0/1311537459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f53950 msgr2=0x5641d5f53d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.075+0000 7f4d26c02700 1 --2- 172.21.15.81:0/1311537459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f53950 0x5641d5f53d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.075+0000 7f4d26c02700 1 -- 172.21.15.81:0/1311537459 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641d5d1f350 con 0x5641d5f4e480 2024-05-09T00:11:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.075+0000 7f4d26401700 1 --2- 172.21.15.81:0/1311537459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f53950 0x5641d5f53d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.075+0000 7f4d26c02700 1 --2- 172.21.15.81:0/1311537459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f4e480 0x5641d5f4e8a0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f4d180a12b0 tx=0x7f4d18098e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7f70daff9a72fa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.075+0000 7f4d14ff9700 1 -- 172.21.15.81:0/1311537459 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1809d220 con 0x5641d5f4e480 2024-05-09T00:11:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.075+0000 7f4d14ff9700 1 -- 172.21.15.81:0/1311537459 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d1809f050 con 0x5641d5f4e480 2024-05-09T00:11:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.075+0000 7f4d14ff9700 1 -- 172.21.15.81:0/1311537459 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d180c9c20 con 0x5641d5f4e480 2024-05-09T00:11:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.075+0000 7f4d3481fb80 1 -- 172.21.15.81:0/1311537459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f4e480 msgr2=0x5641d5f4e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.075+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/1311537459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f4e480 0x5641d5f4e8a0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f4d180a12b0 tx=0x7f4d18098e80 comp rx=0 tx=0).stop 2024-05-09T00:11:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 -- 172.21.15.81:0/1311537459 shutdown_connections 2024-05-09T00:11:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/1311537459 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f53950 0x5641d5f53d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/1311537459 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f4e480 0x5641d5f4e8a0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/1311537459 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f54270 0x5641d5f4df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 -- 172.21.15.81:0/1311537459 >> 172.21.15.81:0/1311537459 conn(0x5641d5eac1b0 msgr2=0x5641d5f48840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 -- 172.21.15.81:0/1311537459 shutdown_connections 2024-05-09T00:11:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 -- 172.21.15.81:0/1311537459 wait complete. 2024-05-09T00:11:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 -- start start 2024-05-09T00:11:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 Processor -- start 2024-05-09T00:11:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f4e480 0x5641d5f5a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f53950 0x5641d5f57590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f57c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d5e3a500 con 0x5641d5f54270 2024-05-09T00:11:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d5e3a1a0 con 0x5641d5f53950 2024-05-09T00:11:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d5d21640 con 0x5641d5f4e480 2024-05-09T00:11:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d3481fb80 10 client.0 _ll_register_callbacks cb 0x5641d5e43ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d26c02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f57c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.076+0000 7f4d26c02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f57c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47876/0 (socket says 172.21.15.81:47876) 2024-05-09T00:11:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d26c02700 1 -- 172.21.15.81:0/25199044 learned_addr learned my addr 172.21.15.81:0/25199044 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d25c00700 1 --2- 172.21.15.81:0/25199044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f53950 0x5641d5f57590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d26401700 1 --2- 172.21.15.81:0/25199044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f4e480 0x5641d5f5a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d26c02700 1 -- 172.21.15.81:0/25199044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f4e480 msgr2=0x5641d5f5a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d26c02700 1 --2- 172.21.15.81:0/25199044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f4e480 0x5641d5f5a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d26c02700 1 -- 172.21.15.81:0/25199044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f53950 msgr2=0x5641d5f57590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d26c02700 1 --2- 172.21.15.81:0/25199044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f53950 0x5641d5f57590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d26c02700 1 -- 172.21.15.81:0/25199044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d201a6100 con 0x5641d5f54270 2024-05-09T00:11:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d26c02700 1 --2- 172.21.15.81:0/25199044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f57c80 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f4d18099380 tx=0x7f4d180a1890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04acbd71bf1a95a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d09ffb700 1 -- 172.21.15.81:0/25199044 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d180c9e30 con 0x5641d5f54270 2024-05-09T00:11:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d09ffb700 1 -- 172.21.15.81:0/25199044 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f4d180cc030 con 0x5641d5f54270 2024-05-09T00:11:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d3481fb80 1 -- 172.21.15.81:0/25199044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641d5df7210 con 0x5641d5f54270 2024-05-09T00:11:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d09ffb700 1 -- 172.21.15.81:0/25199044 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d18099650 con 0x5641d5f54270 2024-05-09T00:11:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d3481fb80 10 client.17889 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d3481fb80 1 -- 172.21.15.81:0/25199044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5641d5ccbb00 con 0x5641d5f54270 2024-05-09T00:11:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.077+0000 7f4d09ffb700 1 -- 172.21.15.81:0/25199044 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5641d5df7210 con 0x5641d5f54270 2024-05-09T00:11:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.078+0000 7f4d09ffb700 1 -- 172.21.15.81:0/25199044 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4d180a13e0 con 0x5641d5f54270 2024-05-09T00:11:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.078+0000 7f4d3481fb80 10 client.17889 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.078+0000 7f4d3481fb80 10 client.17889 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.078+0000 7f4d3481fb80 20 client.17889 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.078+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/25199044 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5641d5f677d0 0x5641d5f69bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.078+0000 7f4d3481fb80 4 client.17889 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.078+0000 7f4d3481fb80 1 -- 172.21.15.81:0/25199044 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641d5f1d7b0 con 0x5641d5f677d0 2024-05-09T00:11:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.078+0000 7f4d26401700 1 --2- 172.21.15.81:0/25199044 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5641d5f677d0 0x5641d5f69bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.078+0000 7f4d09ffb700 10 client.17889 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.078+0000 7f4d26401700 1 --2- 172.21.15.81:0/25199044 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5641d5f677d0 0x5641d5f69bc0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62d3b2c6e5aeee7e server_cookie=8a43634bf34cf156 in_seq=0 out_seq=0 2024-05-09T00:11:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d09ffb700 1 -- 172.21.15.81:0/25199044 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5641d5f1d7b0 con 0x5641d5f677d0 2024-05-09T00:11:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d09ffb700 10 client.17889 handle_command_reply: tid=0 2024-05-09T00:11:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d3481fb80 1 client.17889 shutdown 2024-05-09T00:11:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d3481fb80 1 -- 172.21.15.81:0/25199044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 msgr2=0x5641d5f57c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/25199044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f57c80 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f4d18099380 tx=0x7f4d180a1890 comp rx=0 tx=0).stop 2024-05-09T00:11:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d3481fb80 1 -- 172.21.15.81:0/25199044 shutdown_connections 2024-05-09T00:11:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/25199044 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5641d5f677d0 0x5641d5f69bc0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/25199044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f57c80 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/25199044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f4e480 0x5641d5f5a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/25199044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f53950 0x5641d5f57590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d3481fb80 1 -- 172.21.15.81:0/25199044 >> 172.21.15.81:0/25199044 conn(0x5641d5eac1b0 msgr2=0x5641d5f524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d09ffb700 0 client.17889 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d3481fb80 1 -- 172.21.15.81:0/25199044 shutdown_connections 2024-05-09T00:11:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d3481fb80 1 -- 172.21.15.81:0/25199044 wait complete. 2024-05-09T00:11:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.079+0000 7f4d3481fb80 20 client.17889 trim_cache size 0 max 16384 2024-05-09T00:11:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.094+0000 7f4d3481fb80 1 Processor -- start 2024-05-09T00:11:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.094+0000 7f4d3481fb80 1 -- start start 2024-05-09T00:11:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.094+0000 7f4d3481fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f4e480 0x5641d5f48910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.094+0000 7f4d3481fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f53950 0x5641d5f59d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.094+0000 7f4d3481fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f5ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.094+0000 7f4d3481fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d5f4d180 con 0x5641d5f54270 2024-05-09T00:11:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.094+0000 7f4d3481fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d5f4a2b0 con 0x5641d5f4e480 2024-05-09T00:11:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.094+0000 7f4d3481fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d5f53540 con 0x5641d5f53950 2024-05-09T00:11:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d26c02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f5ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d26c02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f5ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47882/0 (socket says 172.21.15.81:47882) 2024-05-09T00:11:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d26c02700 1 -- 172.21.15.81:0/439318468 learned_addr learned my addr 172.21.15.81:0/439318468 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d26401700 1 --2- 172.21.15.81:0/439318468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f4e480 0x5641d5f48910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d26c02700 1 -- 172.21.15.81:0/439318468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f53950 msgr2=0x5641d5f59d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d25c00700 1 --2- 172.21.15.81:0/439318468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f53950 0x5641d5f59d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d26c02700 1 --2- 172.21.15.81:0/439318468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f53950 0x5641d5f59d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d26c02700 1 -- 172.21.15.81:0/439318468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f4e480 msgr2=0x5641d5f48910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d26c02700 1 --2- 172.21.15.81:0/439318468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f4e480 0x5641d5f48910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d26c02700 1 -- 172.21.15.81:0/439318468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641d5e64500 con 0x5641d5f54270 2024-05-09T00:11:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d26401700 1 --2- 172.21.15.81:0/439318468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f4e480 0x5641d5f48910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d26c02700 1 --2- 172.21.15.81:0/439318468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f5ebd0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800ad70 tx=0x7f4d1801afe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25068b5d0d67cc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d157fa700 1 -- 172.21.15.81:0/439318468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d180c9e30 con 0x5641d5f54270 2024-05-09T00:11:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d157fa700 1 -- 172.21.15.81:0/439318468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d1800cdc0 con 0x5641d5f54270 2024-05-09T00:11:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.095+0000 7f4d157fa700 1 -- 172.21.15.81:0/439318468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d180988e0 con 0x5641d5f54270 2024-05-09T00:11:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 -- 172.21.15.81:0/439318468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 msgr2=0x5641d5f5ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/439318468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f5ebd0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800ad70 tx=0x7f4d1801afe0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 -- 172.21.15.81:0/439318468 shutdown_connections 2024-05-09T00:11:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/439318468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f4e480 0x5641d5f48910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/439318468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f5ebd0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/439318468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f53950 0x5641d5f59d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 -- 172.21.15.81:0/439318468 >> 172.21.15.81:0/439318468 conn(0x5641d5eac1b0 msgr2=0x5641d5f63690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 -- 172.21.15.81:0/439318468 shutdown_connections 2024-05-09T00:11:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 -- 172.21.15.81:0/439318468 wait complete. 2024-05-09T00:11:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 -- start start 2024-05-09T00:11:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 Processor -- start 2024-05-09T00:11:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f4e480 0x5641d5f5edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f53950 0x5641d5f513f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f51930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d5f51e70 con 0x5641d5f54270 2024-05-09T00:11:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d5f51fe0 con 0x5641d5f4e480 2024-05-09T00:11:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641d5f521a0 con 0x5641d5f53950 2024-05-09T00:11:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.096+0000 7f4d3481fb80 10 client.0 _ll_register_callbacks cb 0x5641d5e43ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d26c02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f51930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d26c02700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f51930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47898/0 (socket says 172.21.15.81:47898) 2024-05-09T00:11:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d26c02700 1 -- 172.21.15.81:0/4253937234 learned_addr learned my addr 172.21.15.81:0/4253937234 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d26401700 1 --2- 172.21.15.81:0/4253937234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f4e480 0x5641d5f5edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d25c00700 1 --2- 172.21.15.81:0/4253937234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f53950 0x5641d5f513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d26c02700 1 -- 172.21.15.81:0/4253937234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f53950 msgr2=0x5641d5f513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d26c02700 1 --2- 172.21.15.81:0/4253937234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f53950 0x5641d5f513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d26c02700 1 -- 172.21.15.81:0/4253937234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f4e480 msgr2=0x5641d5f5edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d26c02700 1 --2- 172.21.15.81:0/4253937234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f4e480 0x5641d5f5edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d26c02700 1 -- 172.21.15.81:0/4253937234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641d5ccbb00 con 0x5641d5f54270 2024-05-09T00:11:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d26c02700 1 --2- 172.21.15.81:0/4253937234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f51930 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f4d180840b0 tx=0x7f4d18004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ceba17dcfc28484 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d09ffb700 1 -- 172.21.15.81:0/4253937234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d180c9e30 con 0x5641d5f54270 2024-05-09T00:11:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d09ffb700 1 -- 172.21.15.81:0/4253937234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f4d180cc040 con 0x5641d5f54270 2024-05-09T00:11:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d3481fb80 1 -- 172.21.15.81:0/4253937234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d1809f050 con 0x5641d5f54270 2024-05-09T00:11:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d09ffb700 1 -- 172.21.15.81:0/4253937234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d18095730 con 0x5641d5f54270 2024-05-09T00:11:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d3481fb80 10 client.17895 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d3481fb80 1 -- 172.21.15.81:0/4253937234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5641d5d23c70 con 0x5641d5f54270 2024-05-09T00:11:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.097+0000 7f4d09ffb700 1 -- 172.21.15.81:0/4253937234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d1809f050 con 0x5641d5f54270 2024-05-09T00:11:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.098+0000 7f4d09ffb700 1 -- 172.21.15.81:0/4253937234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4d18098350 con 0x5641d5f54270 2024-05-09T00:11:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.098+0000 7f4d3481fb80 10 client.17895 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.098+0000 7f4d3481fb80 10 client.17895 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.098+0000 7f4d3481fb80 20 client.17895 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.098+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/4253937234 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5641d5fbdc90 0x5641d5fc0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.098+0000 7f4d3481fb80 4 client.17895 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:11:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.098+0000 7f4d3481fb80 1 -- 172.21.15.81:0/4253937234 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5641d5e96e60 con 0x5641d5fbdc90 2024-05-09T00:11:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.098+0000 7f4d26401700 1 --2- 172.21.15.81:0/4253937234 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5641d5fbdc90 0x5641d5fc0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.098+0000 7f4d09ffb700 10 client.17895 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.098+0000 7f4d26401700 1 --2- 172.21.15.81:0/4253937234 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5641d5fbdc90 0x5641d5fc0080 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dfc70f798c9592a server_cookie=4c1743a3e657ce0e in_seq=0 out_seq=0 2024-05-09T00:11:32.109 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.111+0000 7f4d09ffb700 1 -- 172.21.15.81:0/4253937234 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5641d5e96e60 con 0x5641d5fbdc90 2024-05-09T00:11:32.109 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.111+0000 7f4d09ffb700 10 client.17895 handle_command_reply: tid=0 2024-05-09T00:11:32.109 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.111+0000 7f4d3481fb80 1 client.17895 shutdown 2024-05-09T00:11:32.109 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.111+0000 7f4d3481fb80 1 -- 172.21.15.81:0/4253937234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 msgr2=0x5641d5f51930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:32.109 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.111+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/4253937234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f51930 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f4d180840b0 tx=0x7f4d18004cb0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.109 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.111+0000 7f4d3481fb80 1 -- 172.21.15.81:0/4253937234 shutdown_connections 2024-05-09T00:11:32.109 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.111+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/4253937234 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5641d5fbdc90 0x5641d5fc0080 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.109 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.111+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/4253937234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5641d5f4e480 0x5641d5f5edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.109 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.111+0000 7f4d09ffb700 0 client.17895 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:32.109 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.111+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/4253937234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5641d5f54270 0x5641d5f51930 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.109 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.111+0000 7f4d3481fb80 1 --2- 172.21.15.81:0/4253937234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5641d5f53950 0x5641d5f513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.110 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.111+0000 7f4d3481fb80 1 -- 172.21.15.81:0/4253937234 >> 172.21.15.81:0/4253937234 conn(0x5641d5eac1b0 msgr2=0x5641d5f4d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:32.110 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.111+0000 7f4d3481fb80 1 -- 172.21.15.81:0/4253937234 shutdown_connections 2024-05-09T00:11:32.110 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.112+0000 7f4d3481fb80 1 -- 172.21.15.81:0/4253937234 wait complete. 2024-05-09T00:11:32.110 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.112+0000 7f4d3481fb80 20 client.17895 trim_cache size 0 max 16384 2024-05-09T00:11:32.110 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:11:32.110 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:11:32.110 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:11:32.110 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:11:32.111 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.112+0000 7f4d28665700 1 -- 172.21.15.81:0/56866770 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4d0c0a1290 msgr2=0x7f4d0c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:32.111 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.112+0000 7f4d28665700 1 --2- 172.21.15.81:0/56866770 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4d0c0a1290 0x7f4d0c0a3750 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00ac50 tx=0x7f4d1c00a380 comp rx=0 tx=0).stop 2024-05-09T00:11:32.111 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.112+0000 7f4d28665700 1 -- 172.21.15.81:0/56866770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d20104de0 msgr2=0x7f4d2010e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.112+0000 7f4d28665700 1 --2- 172.21.15.81:0/56866770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d20104de0 0x7f4d2010e0b0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800ada0 tx=0x7f4d1800c330 comp rx=0 tx=0).stop 2024-05-09T00:11:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.112+0000 7f4d28665700 1 -- 172.21.15.81:0/56866770 shutdown_connections 2024-05-09T00:11:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.112+0000 7f4d28665700 1 --2- 172.21.15.81:0/56866770 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4d0c0a1290 0x7f4d0c0a3750 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.112+0000 7f4d28665700 1 --2- 172.21.15.81:0/56866770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d20104de0 0x7f4d2010e0b0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.112+0000 7f4d28665700 1 --2- 172.21.15.81:0/56866770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d20100080 0x7f4d2010d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.112+0000 7f4d28665700 1 --2- 172.21.15.81:0/56866770 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d20100a40 0x7f4d2010db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.112+0000 7f4d28665700 1 -- 172.21.15.81:0/56866770 >> 172.21.15.81:0/56866770 conn(0x7f4d20076c10 msgr2=0x7f4d200fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.112+0000 7f4d28665700 1 -- 172.21.15.81:0/56866770 shutdown_connections 2024-05-09T00:11:32.112 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:32.112+0000 7f4d28665700 1 -- 172.21.15.81:0/56866770 wait complete. 2024-05-09T00:11:33.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:32 smithi171 ceph-mon[47351]: pgmap v264: 97 pgs: 97 active+clean; 2.8 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-05-09T00:11:33.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:32 smithi081 ceph-mon[42474]: pgmap v264: 97 pgs: 97 active+clean; 2.8 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-05-09T00:11:33.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:32 smithi150 ceph-mon[46187]: pgmap v264: 97 pgs: 97 active+clean; 2.8 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-05-09T00:11:35.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:34 smithi171 ceph-mon[47351]: pgmap v265: 97 pgs: 97 active+clean; 2.8 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-09T00:11:35.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:34 smithi081 ceph-mon[42474]: pgmap v265: 97 pgs: 97 active+clean; 2.8 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-09T00:11:35.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:34 smithi150 ceph-mon[46187]: pgmap v265: 97 pgs: 97 active+clean; 2.8 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-09T00:11:37.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:36 smithi171 ceph-mon[47351]: pgmap v266: 97 pgs: 97 active+clean; 3.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-05-09T00:11:37.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:36 smithi081 ceph-mon[42474]: pgmap v266: 97 pgs: 97 active+clean; 3.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-05-09T00:11:37.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:36 smithi150 ceph-mon[46187]: pgmap v266: 97 pgs: 97 active+clean; 3.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-05-09T00:11:39.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:38 smithi171 ceph-mon[47351]: pgmap v267: 97 pgs: 97 active+clean; 3.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-05-09T00:11:39.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:38 smithi081 ceph-mon[42474]: pgmap v267: 97 pgs: 97 active+clean; 3.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-05-09T00:11:39.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:38 smithi150 ceph-mon[46187]: pgmap v267: 97 pgs: 97 active+clean; 3.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-05-09T00:11:41.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:40 smithi171 ceph-mon[47351]: pgmap v268: 97 pgs: 97 active+clean; 3.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-05-09T00:11:41.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:40 smithi081 ceph-mon[42474]: pgmap v268: 97 pgs: 97 active+clean; 3.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-05-09T00:11:41.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:40 smithi150 ceph-mon[46187]: pgmap v268: 97 pgs: 97 active+clean; 3.0 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 41 KiB/s wr, 12 op/s 2024-05-09T00:11:43.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:42 smithi171 ceph-mon[47351]: pgmap v269: 97 pgs: 97 active+clean; 3.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-05-09T00:11:43.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:42 smithi081 ceph-mon[42474]: pgmap v269: 97 pgs: 97 active+clean; 3.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-05-09T00:11:43.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:42 smithi150 ceph-mon[46187]: pgmap v269: 97 pgs: 97 active+clean; 3.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-05-09T00:11:45.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:44 smithi171 ceph-mon[47351]: pgmap v270: 97 pgs: 97 active+clean; 3.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:11:45.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:44 smithi081 ceph-mon[42474]: pgmap v270: 97 pgs: 97 active+clean; 3.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:11:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.231+0000 7f8a8bb7d700 1 -- 172.21.15.81:0/1264318369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a84101aa0 msgr2=0x7f8a84105ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.231+0000 7f8a8bb7d700 1 --2- 172.21.15.81:0/1264318369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a84101aa0 0x7f8a84105ae0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009990 tx=0x7f8a74009ca0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.231+0000 7f8a8bb7d700 1 -- 172.21.15.81:0/1264318369 shutdown_connections 2024-05-09T00:11:45.228 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.231+0000 7f8a8bb7d700 1 --2- 172.21.15.81:0/1264318369 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a84106210 0x7f8a8410dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.231+0000 7f8a8bb7d700 1 --2- 172.21.15.81:0/1264318369 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a841010f0 0x7f8a841014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.231+0000 7f8a8bb7d700 1 --2- 172.21.15.81:0/1264318369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a84101aa0 0x7f8a84105ae0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.231+0000 7f8a8bb7d700 1 -- 172.21.15.81:0/1264318369 >> 172.21.15.81:0/1264318369 conn(0x7f8a840fc9d0 msgr2=0x7f8a840fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.231+0000 7f8a8bb7d700 1 -- 172.21.15.81:0/1264318369 shutdown_connections 2024-05-09T00:11:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.231+0000 7f8a8bb7d700 1 -- 172.21.15.81:0/1264318369 wait complete. 2024-05-09T00:11:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.231+0000 7f8a8bb7d700 1 Processor -- start 2024-05-09T00:11:45.229 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.231+0000 7f8a8bb7d700 1 -- start start 2024-05-09T00:11:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a8bb7d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a841010f0 0x7f8a841972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.231 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a8bb7d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a84106210 0x7f8a84197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a8bb7d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a8419bba0 0x7f8a8419c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a8bb7d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8419c620 con 0x7f8a841010f0 2024-05-09T00:11:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a8bb7d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8419c790 con 0x7f8a8419bba0 2024-05-09T00:11:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a8bb7d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8419c950 con 0x7f8a84106210 2024-05-09T00:11:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a89919700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a841010f0 0x7f8a841972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a89919700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a841010f0 0x7f8a841972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50746/0 (socket says 172.21.15.81:50746) 2024-05-09T00:11:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a89919700 1 -- 172.21.15.81:0/2692268836 learned_addr learned my addr 172.21.15.81:0/2692268836 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a89118700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a84106210 0x7f8a84197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a8a11a700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a8419bba0 0x7f8a8419c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a89919700 1 -- 172.21.15.81:0/2692268836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a84106210 msgr2=0x7f8a84197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a89919700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a84106210 0x7f8a84197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a89919700 1 -- 172.21.15.81:0/2692268836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a8419bba0 msgr2=0x7f8a8419c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:45.232 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a89919700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a8419bba0 0x7f8a8419c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.233 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a89919700 1 -- 172.21.15.81:0/2692268836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a740095f0 con 0x7f8a841010f0 2024-05-09T00:11:45.233 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a89118700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a84106210 0x7f8a84197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:45.233 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a89919700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a841010f0 0x7f8a841972c0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000d950 tx=0x7f8a8000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:45.233 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a7affd700 1 -- 172.21.15.81:0/2692268836 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80009b40 con 0x7f8a841010f0 2024-05-09T00:11:45.233 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a7affd700 1 -- 172.21.15.81:0/2692268836 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a80009ca0 con 0x7f8a841010f0 2024-05-09T00:11:45.233 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.232+0000 7f8a8bb7d700 1 -- 172.21.15.81:0/2692268836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a841a3eb0 con 0x7f8a841010f0 2024-05-09T00:11:45.233 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.233+0000 7f8a7affd700 1 -- 172.21.15.81:0/2692268836 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8000f620 con 0x7f8a841010f0 2024-05-09T00:11:45.233 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.233+0000 7f8a8bb7d700 1 -- 172.21.15.81:0/2692268836 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a841a4330 con 0x7f8a841010f0 2024-05-09T00:11:45.233 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.235+0000 7f8a7affd700 1 -- 172.21.15.81:0/2692268836 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f8a80010460 con 0x7f8a841010f0 2024-05-09T00:11:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.235+0000 7f8a7affd700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8a700a1290 0x7f8a700a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.235+0000 7f8a89118700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8a700a1290 0x7f8a700a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.235+0000 7f8a7affd700 1 -- 172.21.15.81:0/2692268836 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f8a800cd090 con 0x7f8a841010f0 2024-05-09T00:11:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.236+0000 7f8a89118700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8a700a1290 0x7f8a700a3750 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a74006010 tx=0x7f8a7400b540 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.236+0000 7f8a97d37b80 1 Processor -- start 2024-05-09T00:11:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.236+0000 7f8a97d37b80 1 -- start start 2024-05-09T00:11:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a97d37b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 0x55a4fb10ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a97d37b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 0x55a4fb108f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a97d37b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb1098a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a97d37b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4fb0600f0 con 0x55a4fb109480 2024-05-09T00:11:45.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a97d37b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4fb05dab0 con 0x55a4fb10f270 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a97d37b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4fb0593a0 con 0x55a4fb10e950 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a8a11a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb1098a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a8a11a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb1098a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50762/0 (socket says 172.21.15.81:50762) 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a8a11a700 1 -- 172.21.15.81:0/2250872738 learned_addr learned my addr 172.21.15.81:0/2250872738 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a89118700 1 --2- 172.21.15.81:0/2250872738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 0x55a4fb108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a89919700 1 --2- 172.21.15.81:0/2250872738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 0x55a4fb10ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a8a11a700 1 -- 172.21.15.81:0/2250872738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 msgr2=0x55a4fb10ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a8a11a700 1 --2- 172.21.15.81:0/2250872738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 0x55a4fb10ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a8a11a700 1 -- 172.21.15.81:0/2250872738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 msgr2=0x55a4fb108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a8a11a700 1 --2- 172.21.15.81:0/2250872738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 0x55a4fb108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a8a11a700 1 -- 172.21.15.81:0/2250872738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4faeda350 con 0x55a4fb109480 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a8a11a700 1 --2- 172.21.15.81:0/2250872738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb1098a0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00d1d0 tx=0x7f8a7c00d4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9729145cb74de07b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a6ffff700 1 -- 172.21.15.81:0/2250872738 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0125f0 con 0x55a4fb109480 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a6ffff700 1 -- 172.21.15.81:0/2250872738 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a7c00de20 con 0x55a4fb109480 2024-05-09T00:11:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.237+0000 7f8a6ffff700 1 -- 172.21.15.81:0/2250872738 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c011a50 con 0x55a4fb109480 2024-05-09T00:11:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.238+0000 7f8a97d37b80 1 -- 172.21.15.81:0/2250872738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 msgr2=0x55a4fb1098a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.238+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/2250872738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb1098a0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c00d1d0 tx=0x7f8a7c00d4e0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.238+0000 7f8a97d37b80 1 -- 172.21.15.81:0/2250872738 shutdown_connections 2024-05-09T00:11:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.238+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/2250872738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb1098a0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.238+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/2250872738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 0x55a4fb10ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.238+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/2250872738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 0x55a4fb108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.238+0000 7f8a97d37b80 1 -- 172.21.15.81:0/2250872738 >> 172.21.15.81:0/2250872738 conn(0x55a4fb0671b0 msgr2=0x55a4fb103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.238+0000 7f8a97d37b80 1 -- 172.21.15.81:0/2250872738 shutdown_connections 2024-05-09T00:11:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.238+0000 7f8a97d37b80 1 -- 172.21.15.81:0/2250872738 wait complete. 2024-05-09T00:11:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.238+0000 7f8a97d37b80 1 -- start start 2024-05-09T00:11:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a97d37b80 1 Processor -- start 2024-05-09T00:11:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a97d37b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb115100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a97d37b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 0x55a4fb112440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a97d37b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 0x55a4fb112a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a97d37b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4faff5500 con 0x55a4fb109480 2024-05-09T00:11:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a97d37b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4faff51a0 con 0x55a4fb10f270 2024-05-09T00:11:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a97d37b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4faedc640 con 0x55a4fb10e950 2024-05-09T00:11:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a97d37b80 10 client.0 _ll_register_callbacks cb 0x55a4faffead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a89919700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb115100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a89919700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb115100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50766/0 (socket says 172.21.15.81:50766) 2024-05-09T00:11:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a89919700 1 -- 172.21.15.81:0/225159512 learned_addr learned my addr 172.21.15.81:0/225159512 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a89118700 1 --2- 172.21.15.81:0/225159512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 0x55a4fb112440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a89919700 1 -- 172.21.15.81:0/225159512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 msgr2=0x55a4fb112440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a89919700 1 --2- 172.21.15.81:0/225159512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 0x55a4fb112440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a89919700 1 -- 172.21.15.81:0/225159512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 msgr2=0x55a4fb112a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a8a11a700 1 --2- 172.21.15.81:0/225159512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 0x55a4fb112a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a89919700 1 --2- 172.21.15.81:0/225159512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 0x55a4fb112a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a89919700 1 -- 172.21.15.81:0/225159512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7c007cd0 con 0x55a4fb109480 2024-05-09T00:11:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.239+0000 7f8a89118700 1 --2- 172.21.15.81:0/225159512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 0x55a4fb112440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a89919700 1 --2- 172.21.15.81:0/225159512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb115100 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f8a800cadb0 tx=0x7f8a8009a9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52686a6ec0a6ec37 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a6d7fa700 1 -- 172.21.15.81:0/225159512 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80010910 con 0x55a4fb109480 2024-05-09T00:11:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a6d7fa700 1 -- 172.21.15.81:0/225159512 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f8a8009a3d0 con 0x55a4fb109480 2024-05-09T00:11:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a97d37b80 1 -- 172.21.15.81:0/225159512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4fafb2210 con 0x55a4fb109480 2024-05-09T00:11:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a6d7fa700 1 -- 172.21.15.81:0/225159512 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a8009a590 con 0x55a4fb109480 2024-05-09T00:11:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a97d37b80 10 client.17907 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a97d37b80 1 -- 172.21.15.81:0/225159512 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a4fae86b00 con 0x55a4fb109480 2024-05-09T00:11:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a6d7fa700 1 -- 172.21.15.81:0/225159512 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a80063020 con 0x55a4fb109480 2024-05-09T00:11:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a6d7fa700 1 -- 172.21.15.81:0/225159512 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8a800b2d20 con 0x55a4fb109480 2024-05-09T00:11:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a97d37b80 10 client.17907 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a97d37b80 10 client.17907 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a97d37b80 20 client.17907 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/225159512 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a4fb122ad0 0x55a4fb124ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a97d37b80 4 client.17907 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a97d37b80 1 -- 172.21.15.81:0/225159512 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4fb0d87b0 con 0x55a4fb122ad0 2024-05-09T00:11:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.240+0000 7f8a89118700 1 --2- 172.21.15.81:0/225159512 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a4fb122ad0 0x55a4fb124ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.241+0000 7f8a6d7fa700 10 client.17907 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.241+0000 7f8a89118700 1 --2- 172.21.15.81:0/225159512 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a4fb122ad0 0x55a4fb124ec0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e486c39b0510985a server_cookie=b654827073300e3c in_seq=0 out_seq=0 2024-05-09T00:11:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a6d7fa700 1 -- 172.21.15.81:0/225159512 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a4fb0d87b0 con 0x55a4fb122ad0 2024-05-09T00:11:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a6d7fa700 10 client.17907 handle_command_reply: tid=0 2024-05-09T00:11:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a97d37b80 1 client.17907 shutdown 2024-05-09T00:11:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a97d37b80 1 -- 172.21.15.81:0/225159512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 msgr2=0x55a4fb115100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/225159512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb115100 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f8a800cadb0 tx=0x7f8a8009a9a0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a97d37b80 1 -- 172.21.15.81:0/225159512 shutdown_connections 2024-05-09T00:11:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/225159512 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a4fb122ad0 0x55a4fb124ec0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/225159512 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 0x55a4fb112a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a6d7fa700 0 client.17907 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/225159512 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb115100 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/225159512 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 0x55a4fb112440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a97d37b80 1 -- 172.21.15.81:0/225159512 >> 172.21.15.81:0/225159512 conn(0x55a4fb0671b0 msgr2=0x55a4fb10c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a97d37b80 1 -- 172.21.15.81:0/225159512 shutdown_connections 2024-05-09T00:11:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a97d37b80 1 -- 172.21.15.81:0/225159512 wait complete. 2024-05-09T00:11:45.247 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.242+0000 7f8a97d37b80 20 client.17907 trim_cache size 0 max 16384 2024-05-09T00:11:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a97d37b80 1 Processor -- start 2024-05-09T00:11:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a97d37b80 1 -- start start 2024-05-09T00:11:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a97d37b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb109480 0x55a4fb109860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a97d37b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb10e950 0x55a4fb103910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a97d37b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10f270 0x55a4fb119c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a97d37b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4fb105490 con 0x55a4fb10e950 2024-05-09T00:11:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a97d37b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4fb12a0d0 con 0x55a4fb109480 2024-05-09T00:11:45.259 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a97d37b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4fb104a30 con 0x55a4fb10f270 2024-05-09T00:11:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a89118700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb10e950 0x55a4fb103910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a89118700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb10e950 0x55a4fb103910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50780/0 (socket says 172.21.15.81:50780) 2024-05-09T00:11:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a89118700 1 -- 172.21.15.81:0/3934211175 learned_addr learned my addr 172.21.15.81:0/3934211175 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a89919700 1 --2- 172.21.15.81:0/3934211175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb109480 0x55a4fb109860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a8a11a700 1 --2- 172.21.15.81:0/3934211175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10f270 0x55a4fb119c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a89118700 1 -- 172.21.15.81:0/3934211175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10f270 msgr2=0x55a4fb119c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a89118700 1 --2- 172.21.15.81:0/3934211175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10f270 0x55a4fb119c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a89118700 1 -- 172.21.15.81:0/3934211175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb109480 msgr2=0x55a4fb109860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a89118700 1 --2- 172.21.15.81:0/3934211175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb109480 0x55a4fb109860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.257+0000 7f8a89118700 1 -- 172.21.15.81:0/3934211175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4fb01f500 con 0x55a4fb10e950 2024-05-09T00:11:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.258+0000 7f8a89118700 1 --2- 172.21.15.81:0/3934211175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb10e950 0x55a4fb103910 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009990 tx=0x7f8a7401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1ac3a145d84bf66 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.258+0000 7f8a78da4700 1 -- 172.21.15.81:0/3934211175 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74035370 con 0x55a4fb10e950 2024-05-09T00:11:45.260 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.258+0000 7f8a78da4700 1 -- 172.21.15.81:0/3934211175 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a7402c040 con 0x55a4fb10e950 2024-05-09T00:11:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.258+0000 7f8a78da4700 1 -- 172.21.15.81:0/3934211175 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7400fd10 con 0x55a4fb10e950 2024-05-09T00:11:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.258+0000 7f8a97d37b80 1 -- 172.21.15.81:0/3934211175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb10e950 msgr2=0x55a4fb103910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.258+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/3934211175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb10e950 0x55a4fb103910 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009990 tx=0x7f8a7401f000 comp rx=0 tx=0).stop 2024-05-09T00:11:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.258+0000 7f8a97d37b80 1 -- 172.21.15.81:0/3934211175 shutdown_connections 2024-05-09T00:11:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.258+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/3934211175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb109480 0x55a4fb109860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.258+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/3934211175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10f270 0x55a4fb119c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.258+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/3934211175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb10e950 0x55a4fb103910 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.258+0000 7f8a97d37b80 1 -- 172.21.15.81:0/3934211175 >> 172.21.15.81:0/3934211175 conn(0x55a4fb0671b0 msgr2=0x55a4fb11e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.258+0000 7f8a97d37b80 1 -- 172.21.15.81:0/3934211175 shutdown_connections 2024-05-09T00:11:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.258+0000 7f8a97d37b80 1 -- 172.21.15.81:0/3934211175 wait complete. 2024-05-09T00:11:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.259+0000 7f8a97d37b80 1 -- start start 2024-05-09T00:11:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.259+0000 7f8a97d37b80 1 Processor -- start 2024-05-09T00:11:45.261 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.259+0000 7f8a97d37b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb117c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.259+0000 7f8a97d37b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 0x55a4fb118160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.259+0000 7f8a97d37b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 0x55a4fb177fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.259+0000 7f8a97d37b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4fb1189f0 con 0x55a4fb109480 2024-05-09T00:11:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.259+0000 7f8a97d37b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4fb1784e0 con 0x55a4fb10f270 2024-05-09T00:11:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.259+0000 7f8a97d37b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4fb178620 con 0x55a4fb10e950 2024-05-09T00:11:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.259+0000 7f8a97d37b80 10 client.0 _ll_register_callbacks cb 0x55a4faffead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.259+0000 7f8a89919700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb117c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.259+0000 7f8a89919700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb117c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50796/0 (socket says 172.21.15.81:50796) 2024-05-09T00:11:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.259+0000 7f8a89919700 1 -- 172.21.15.81:0/1388217297 learned_addr learned my addr 172.21.15.81:0/1388217297 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a8a11a700 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 0x55a4fb177fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a89919700 1 -- 172.21.15.81:0/1388217297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 msgr2=0x55a4fb118160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a89118700 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 0x55a4fb118160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.262 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a89919700 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 0x55a4fb118160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a89919700 1 -- 172.21.15.81:0/1388217297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 msgr2=0x55a4fb177fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a89919700 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 0x55a4fb177fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a89919700 1 -- 172.21.15.81:0/1388217297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8410e600 con 0x55a4fb109480 2024-05-09T00:11:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a8a11a700 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 0x55a4fb177fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a89118700 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 0x55a4fb118160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a89919700 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb117c20 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000e010 tx=0x7f8a80099b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741c52bb8e879c0b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a6d7fa700 1 -- 172.21.15.81:0/1388217297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80014040 con 0x55a4fb109480 2024-05-09T00:11:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a6d7fa700 1 -- 172.21.15.81:0/1388217297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f8a80064080 con 0x55a4fb109480 2024-05-09T00:11:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a97d37b80 1 -- 172.21.15.81:0/1388217297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a7c00de20 con 0x55a4fb109480 2024-05-09T00:11:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a6d7fa700 1 -- 172.21.15.81:0/1388217297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a800998d0 con 0x55a4fb109480 2024-05-09T00:11:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a97d37b80 10 client.17913 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a97d37b80 1 -- 172.21.15.81:0/1388217297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a4faedec70 con 0x55a4fb109480 2024-05-09T00:11:45.263 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a6d7fa700 1 -- 172.21.15.81:0/1388217297 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a7c00de20 con 0x55a4fb109480 2024-05-09T00:11:45.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a6d7fa700 1 -- 172.21.15.81:0/1388217297 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8a800b2d20 con 0x55a4fb109480 2024-05-09T00:11:45.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a97d37b80 10 client.17913 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:45.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a97d37b80 10 client.17913 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:45.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.260+0000 7f8a97d37b80 20 client.17913 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:45.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.261+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a4fb1799a0 0x55a4fb17bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.261+0000 7f8a97d37b80 4 client.17913 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:11:45.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.261+0000 7f8a97d37b80 1 -- 172.21.15.81:0/1388217297 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a4fb051e60 con 0x55a4fb1799a0 2024-05-09T00:11:45.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.261+0000 7f8a89118700 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a4fb1799a0 0x55a4fb17bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.261+0000 7f8a89118700 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a4fb1799a0 0x55a4fb17bdc0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=941a61c44faa33c3 server_cookie=4b9bbdb50d19c979 in_seq=0 out_seq=0 2024-05-09T00:11:45.264 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.261+0000 7f8a6d7fa700 10 client.17913 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:45.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:44 smithi150 ceph-mon[46187]: pgmap v270: 97 pgs: 97 active+clean; 3.2 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:11:45.272 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.274+0000 7f8a6d7fa700 1 -- 172.21.15.81:0/1388217297 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a4fb051e60 con 0x55a4fb1799a0 2024-05-09T00:11:45.272 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.274+0000 7f8a6d7fa700 10 client.17913 handle_command_reply: tid=0 2024-05-09T00:11:45.272 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a97d37b80 1 client.17913 shutdown 2024-05-09T00:11:45.272 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a97d37b80 1 -- 172.21.15.81:0/1388217297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 msgr2=0x55a4fb117c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb117c20 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000e010 tx=0x7f8a80099b80 comp rx=0 tx=0).stop 2024-05-09T00:11:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a97d37b80 1 -- 172.21.15.81:0/1388217297 shutdown_connections 2024-05-09T00:11:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a4fb1799a0 0x55a4fb17bdc0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a4fb10f270 0x55a4fb177fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a6d7fa700 0 client.17913 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a4fb109480 0x55a4fb117c20 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a97d37b80 1 --2- 172.21.15.81:0/1388217297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a4fb10e950 0x55a4fb118160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a97d37b80 1 -- 172.21.15.81:0/1388217297 >> 172.21.15.81:0/1388217297 conn(0x55a4fb0671b0 msgr2=0x55a4fb11e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a97d37b80 1 -- 172.21.15.81:0/1388217297 shutdown_connections 2024-05-09T00:11:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a97d37b80 1 -- 172.21.15.81:0/1388217297 wait complete. 2024-05-09T00:11:45.273 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a97d37b80 20 client.17913 trim_cache size 0 max 16384 2024-05-09T00:11:45.274 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:11:45.274 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:11:45.274 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:11:45.274 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:11:45.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a8bb7d700 1 -- 172.21.15.81:0/2692268836 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8a700a1290 msgr2=0x7f8a700a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:45.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a8bb7d700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8a700a1290 0x7f8a700a3750 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8a74006010 tx=0x7f8a7400b540 comp rx=0 tx=0).stop 2024-05-09T00:11:45.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a8bb7d700 1 -- 172.21.15.81:0/2692268836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a841010f0 msgr2=0x7f8a841972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:45.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.275+0000 7f8a8bb7d700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a841010f0 0x7f8a841972c0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000d950 tx=0x7f8a8000dd10 comp rx=0 tx=0).stop 2024-05-09T00:11:45.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.276+0000 7f8a8bb7d700 1 -- 172.21.15.81:0/2692268836 shutdown_connections 2024-05-09T00:11:45.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.276+0000 7f8a8bb7d700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8a700a1290 0x7f8a700a3750 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.275 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.276+0000 7f8a8bb7d700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8a8419bba0 0x7f8a8419c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.276+0000 7f8a8bb7d700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a841010f0 0x7f8a841972c0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.276+0000 7f8a8bb7d700 1 --2- 172.21.15.81:0/2692268836 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8a84106210 0x7f8a84197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.276+0000 7f8a8bb7d700 1 -- 172.21.15.81:0/2692268836 >> 172.21.15.81:0/2692268836 conn(0x7f8a840fc9d0 msgr2=0x7f8a840fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.276+0000 7f8a8bb7d700 1 -- 172.21.15.81:0/2692268836 shutdown_connections 2024-05-09T00:11:45.276 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:45.276+0000 7f8a8bb7d700 1 -- 172.21.15.81:0/2692268836 wait complete. 2024-05-09T00:11:45.857 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:11:45.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.995+0000 7f06de6fc700 1 -- 172.21.15.81:0/3598870198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d8069db0 msgr2=0x7f06d8105b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:45.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.995+0000 7f06de6fc700 1 --2- 172.21.15.81:0/3598870198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d8069db0 0x7f06d8105b70 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009990 tx=0x7f06cc009ca0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.995+0000 7f06de6fc700 1 -- 172.21.15.81:0/3598870198 shutdown_connections 2024-05-09T00:11:45.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.995+0000 7f06de6fc700 1 --2- 172.21.15.81:0/3598870198 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d81062a0 0x7f06d810de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.995+0000 7f06de6fc700 1 --2- 172.21.15.81:0/3598870198 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06d8069400 0x7f06d80697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.995+0000 7f06de6fc700 1 --2- 172.21.15.81:0/3598870198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d8069db0 0x7f06d8105b70 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.995+0000 7f06de6fc700 1 -- 172.21.15.81:0/3598870198 >> 172.21.15.81:0/3598870198 conn(0x7f06d8076ba0 msgr2=0x7f06d8076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:45.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.995+0000 7f06de6fc700 1 -- 172.21.15.81:0/3598870198 shutdown_connections 2024-05-09T00:11:45.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.995+0000 7f06de6fc700 1 -- 172.21.15.81:0/3598870198 wait complete. 2024-05-09T00:11:45.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.996+0000 7f06de6fc700 1 Processor -- start 2024-05-09T00:11:45.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.996+0000 7f06de6fc700 1 -- start start 2024-05-09T00:11:45.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.996+0000 7f06de6fc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06d8069400 0x7f06d81974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.996+0000 7f06de6fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d81062a0 0x7f06d8197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.996+0000 7f06de6fc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d819bdb0 0x7f06d819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.996+0000 7f06de6fc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d819c830 con 0x7f06d81062a0 2024-05-09T00:11:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.996+0000 7f06de6fc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d819c9a0 con 0x7f06d819bdb0 2024-05-09T00:11:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.996+0000 7f06de6fc700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d819cb60 con 0x7f06d8069400 2024-05-09T00:11:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06d77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d81062a0 0x7f06d8197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06d77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d81062a0 0x7f06d8197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50818/0 (socket says 172.21.15.81:50818) 2024-05-09T00:11:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06d77fe700 1 -- 172.21.15.81:0/4288187748 learned_addr learned my addr 172.21.15.81:0/4288187748 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06dcc99700 1 --2- 172.21.15.81:0/4288187748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d819bdb0 0x7f06d819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06d7fff700 1 --2- 172.21.15.81:0/4288187748 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06d8069400 0x7f06d81974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06d77fe700 1 -- 172.21.15.81:0/4288187748 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06d8069400 msgr2=0x7f06d81974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06d77fe700 1 --2- 172.21.15.81:0/4288187748 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06d8069400 0x7f06d81974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06d77fe700 1 -- 172.21.15.81:0/4288187748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d819bdb0 msgr2=0x7f06d819c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:45.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06d77fe700 1 --2- 172.21.15.81:0/4288187748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d819bdb0 0x7f06d819c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06d77fe700 1 -- 172.21.15.81:0/4288187748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc0095f0 con 0x7f06d81062a0 2024-05-09T00:11:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06d77fe700 1 --2- 172.21.15.81:0/4288187748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d81062a0 0x7f06d8197a10 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0059d0 tx=0x7f06cc009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06d57fa700 1 -- 172.21.15.81:0/4288187748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc01d070 con 0x7f06d81062a0 2024-05-09T00:11:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06d57fa700 1 -- 172.21.15.81:0/4288187748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06cc00fb30 con 0x7f06d81062a0 2024-05-09T00:11:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06de6fc700 1 -- 172.21.15.81:0/4288187748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d81a4060 con 0x7f06d81062a0 2024-05-09T00:11:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06d57fa700 1 -- 172.21.15.81:0/4288187748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc022b40 con 0x7f06d81062a0 2024-05-09T00:11:45.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.997+0000 7f06de6fc700 1 -- 172.21.15.81:0/4288187748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d81a4480 con 0x7f06d81062a0 2024-05-09T00:11:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:45.999+0000 7f06d57fa700 1 -- 172.21.15.81:0/4288187748 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f06cc00fca0 con 0x7f06d81062a0 2024-05-09T00:11:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.000+0000 7f06d57fa700 1 --2- 172.21.15.81:0/4288187748 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f06c00a1290 0x7f06c00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.000+0000 7f06d7fff700 1 --2- 172.21.15.81:0/4288187748 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f06c00a1290 0x7f06c00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.000+0000 7f06d57fa700 1 -- 172.21.15.81:0/4288187748 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f06cc0cdd50 con 0x7f06d81062a0 2024-05-09T00:11:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.000+0000 7f06d7fff700 1 --2- 172.21.15.81:0/4288187748 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f06c00a1290 0x7f06c00a3750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009a10 tx=0x7f06c8009190 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06ea8b6b80 1 Processor -- start 2024-05-09T00:11:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06ea8b6b80 1 -- start start 2024-05-09T00:11:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06ea8b6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b8e00 0x55e17c8b91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06ea8b6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b9720 0x55e17c8b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06ea8b6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b3890 0x55e17c8b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06ea8b6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17c80a150 con 0x55e17c8b8e00 2024-05-09T00:11:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06ea8b6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17c807b10 con 0x55e17c8b9720 2024-05-09T00:11:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06ea8b6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17c803400 con 0x55e17c8b3890 2024-05-09T00:11:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06d7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b8e00 0x55e17c8b91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06d7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b8e00 0x55e17c8b91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50822/0 (socket says 172.21.15.81:50822) 2024-05-09T00:11:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06d7fff700 1 -- 172.21.15.81:0/3032752932 learned_addr learned my addr 172.21.15.81:0/3032752932 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06dcc99700 1 --2- 172.21.15.81:0/3032752932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b3890 0x55e17c8b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06d77fe700 1 --2- 172.21.15.81:0/3032752932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b9720 0x55e17c8b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06d7fff700 1 -- 172.21.15.81:0/3032752932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b3890 msgr2=0x55e17c8b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06d7fff700 1 --2- 172.21.15.81:0/3032752932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b3890 0x55e17c8b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06d7fff700 1 -- 172.21.15.81:0/3032752932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b9720 msgr2=0x55e17c8b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06d7fff700 1 --2- 172.21.15.81:0/3032752932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b9720 0x55e17c8b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06d7fff700 1 -- 172.21.15.81:0/3032752932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e17c6843b0 con 0x55e17c8b8e00 2024-05-09T00:11:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.001+0000 7f06d77fe700 1 --2- 172.21.15.81:0/3032752932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b9720 0x55e17c8b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.002+0000 7f06d7fff700 1 --2- 172.21.15.81:0/3032752932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b8e00 0x55e17c8b91e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f06c800ea00 tx=0x7f06c8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df9715e4f1f87cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.002+0000 7f06be7fc700 1 -- 172.21.15.81:0/3032752932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8015480 con 0x55e17c8b8e00 2024-05-09T00:11:46.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.002+0000 7f06be7fc700 1 -- 172.21.15.81:0/3032752932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06c8015aa0 con 0x55e17c8b8e00 2024-05-09T00:11:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.002+0000 7f06be7fc700 1 -- 172.21.15.81:0/3032752932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c80139f0 con 0x55e17c8b8e00 2024-05-09T00:11:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.002+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/3032752932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b8e00 msgr2=0x55e17c8b91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.002+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/3032752932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b8e00 0x55e17c8b91e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f06c800ea00 tx=0x7f06c8011000 comp rx=0 tx=0).stop 2024-05-09T00:11:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.002+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/3032752932 shutdown_connections 2024-05-09T00:11:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.002+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/3032752932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b3890 0x55e17c8b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.002+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/3032752932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b8e00 0x55e17c8b91e0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.002+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/3032752932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b9720 0x55e17c8b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.002+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/3032752932 >> 172.21.15.81:0/3032752932 conn(0x55e17c811210 msgr2=0x55e17c8addf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.002+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/3032752932 shutdown_connections 2024-05-09T00:11:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.003+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/3032752932 wait complete. 2024-05-09T00:11:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.003+0000 7f06ea8b6b80 1 -- start start 2024-05-09T00:11:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.003+0000 7f06ea8b6b80 1 Processor -- start 2024-05-09T00:11:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.003+0000 7f06ea8b6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b3890 0x55e17c8bca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06ea8b6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b8e00 0x55e17c8bcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06ea8b6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b9720 0x55e17c8bd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06ea8b6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17c79f560 con 0x55e17c8b3890 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06ea8b6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17c79f200 con 0x55e17c8b9720 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06ea8b6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17c6866a0 con 0x55e17c8b8e00 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06ea8b6b80 10 client.0 _ll_register_callbacks cb 0x55e17c7a8b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06d7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b3890 0x55e17c8bca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06d7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b3890 0x55e17c8bca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50824/0 (socket says 172.21.15.81:50824) 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06d7fff700 1 -- 172.21.15.81:0/3743745157 learned_addr learned my addr 172.21.15.81:0/3743745157 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06d77fe700 1 --2- 172.21.15.81:0/3743745157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b8e00 0x55e17c8bcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06d7fff700 1 -- 172.21.15.81:0/3743745157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b8e00 msgr2=0x55e17c8bcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06d7fff700 1 --2- 172.21.15.81:0/3743745157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b8e00 0x55e17c8bcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06d7fff700 1 -- 172.21.15.81:0/3743745157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b9720 msgr2=0x55e17c8bd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06d7fff700 1 --2- 172.21.15.81:0/3743745157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b9720 0x55e17c8bd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06d7fff700 1 -- 172.21.15.81:0/3743745157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c800e6e0 con 0x55e17c8b3890 2024-05-09T00:11:46.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06d7fff700 1 --2- 172.21.15.81:0/3743745157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b3890 0x55e17c8bca70 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f06c80094c0 tx=0x7f06c80097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6043597f4a4586b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06b77fe700 1 -- 172.21.15.81:0/3743745157 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8013bb0 con 0x55e17c8b3890 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06b77fe700 1 -- 172.21.15.81:0/3743745157 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f06c8013d10 con 0x55e17c8b3890 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/3743745157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e17c75c270 con 0x55e17c8b3890 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06b77fe700 1 -- 172.21.15.81:0/3743745157 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06c8013ed0 con 0x55e17c8b3890 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06ea8b6b80 10 client.17925 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/3743745157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e17c630b60 con 0x55e17c8b3890 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.004+0000 7f06b77fe700 1 -- 172.21.15.81:0/3743745157 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06c803e080 con 0x55e17c8b3890 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.005+0000 7f06b77fe700 1 -- 172.21.15.81:0/3743745157 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f06c80325f0 con 0x55e17c8b3890 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.005+0000 7f06ea8b6b80 10 client.17925 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.005+0000 7f06ea8b6b80 10 client.17925 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.005+0000 7f06ea8b6b80 20 client.17925 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.005+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/3743745157 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e17c8cd0b0 0x55e17c8cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.005+0000 7f06ea8b6b80 4 client.17925 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:46.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.005+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/3743745157 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e17c882810 con 0x55e17c8cd0b0 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.005+0000 7f06d77fe700 1 --2- 172.21.15.81:0/3743745157 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e17c8cd0b0 0x55e17c8cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.005+0000 7f06b77fe700 10 client.17925 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.005+0000 7f06d77fe700 1 --2- 172.21.15.81:0/3743745157 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e17c8cd0b0 0x55e17c8cf4d0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=355a698ab0255d35 server_cookie=316d112a19502a23 in_seq=0 out_seq=0 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06b77fe700 1 -- 172.21.15.81:0/3743745157 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e17c882810 con 0x55e17c8cd0b0 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06b77fe700 10 client.17925 handle_command_reply: tid=0 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06ea8b6b80 1 client.17925 shutdown 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/3743745157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b3890 msgr2=0x55e17c8bca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/3743745157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b3890 0x55e17c8bca70 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f06c80094c0 tx=0x7f06c80097c0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/3743745157 shutdown_connections 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/3743745157 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e17c8cd0b0 0x55e17c8cf4d0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/3743745157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b9720 0x55e17c8bd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06b77fe700 0 client.17925 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/3743745157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b3890 0x55e17c8bca70 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/3743745157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b8e00 0x55e17c8bcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/3743745157 >> 172.21.15.81:0/3743745157 conn(0x55e17c811210 msgr2=0x55e17c8ad5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/3743745157 shutdown_connections 2024-05-09T00:11:46.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/3743745157 wait complete. 2024-05-09T00:11:46.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.006+0000 7f06ea8b6b80 20 client.17925 trim_cache size 0 max 16384 2024-05-09T00:11:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06ea8b6b80 1 Processor -- start 2024-05-09T00:11:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06ea8b6b80 1 -- start start 2024-05-09T00:11:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06ea8b6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b3890 0x55e17c8b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06ea8b6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b8e00 0x55e17c8add20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06ea8b6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b9720 0x55e17c8b8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06ea8b6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17c8bb000 con 0x55e17c8b3890 2024-05-09T00:11:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06ea8b6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17c8b7750 con 0x55e17c8b8e00 2024-05-09T00:11:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06ea8b6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17c8a6040 con 0x55e17c8b9720 2024-05-09T00:11:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06d7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b3890 0x55e17c8b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06d7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b3890 0x55e17c8b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50838/0 (socket says 172.21.15.81:50838) 2024-05-09T00:11:46.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06d7fff700 1 -- 172.21.15.81:0/2168181368 learned_addr learned my addr 172.21.15.81:0/2168181368 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06d7fff700 1 -- 172.21.15.81:0/2168181368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b9720 msgr2=0x55e17c8b8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06d7fff700 1 --2- 172.21.15.81:0/2168181368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b9720 0x55e17c8b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06d7fff700 1 -- 172.21.15.81:0/2168181368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b8e00 msgr2=0x55e17c8add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06d7fff700 1 --2- 172.21.15.81:0/2168181368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b8e00 0x55e17c8add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06d7fff700 1 -- 172.21.15.81:0/2168181368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e17c7c9560 con 0x55e17c8b3890 2024-05-09T00:11:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.024+0000 7f06d7fff700 1 --2- 172.21.15.81:0/2168181368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b3890 0x55e17c8b3350 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f06c8000c00 tx=0x7f06c8006be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f31770a7440345 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.025+0000 7f06beffd700 1 -- 172.21.15.81:0/2168181368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8032c30 con 0x55e17c8b3890 2024-05-09T00:11:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.025+0000 7f06beffd700 1 -- 172.21.15.81:0/2168181368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e17c75c270 con 0x55e17c8b3890 2024-05-09T00:11:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.025+0000 7f06beffd700 1 -- 172.21.15.81:0/2168181368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c803a690 con 0x55e17c8b3890 2024-05-09T00:11:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.025+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/2168181368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b3890 msgr2=0x55e17c8b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.025+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/2168181368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b3890 0x55e17c8b3350 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f06c8000c00 tx=0x7f06c8006be0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.025+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/2168181368 shutdown_connections 2024-05-09T00:11:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.025+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/2168181368 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b9720 0x55e17c8b8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.025+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/2168181368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b3890 0x55e17c8b3350 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.025+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/2168181368 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b8e00 0x55e17c8add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.025+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/2168181368 >> 172.21.15.81:0/2168181368 conn(0x55e17c811210 msgr2=0x55e17c8b7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.025+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/2168181368 shutdown_connections 2024-05-09T00:11:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.025+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/2168181368 wait complete. 2024-05-09T00:11:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.026+0000 7f06ea8b6b80 1 -- start start 2024-05-09T00:11:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.026+0000 7f06ea8b6b80 1 Processor -- start 2024-05-09T00:11:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.026+0000 7f06ea8b6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b3890 0x55e17c8c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.026+0000 7f06ea8b6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b8e00 0x55e17c8c0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.026+0000 7f06ea8b6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b9720 0x55e17c91c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.026+0000 7f06ea8b6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17c91cad0 con 0x55e17c8b9720 2024-05-09T00:11:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.026+0000 7f06ea8b6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17c91cc40 con 0x55e17c8b8e00 2024-05-09T00:11:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.026+0000 7f06ea8b6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17c91ce00 con 0x55e17c8b3890 2024-05-09T00:11:46.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.026+0000 7f06ea8b6b80 10 client.0 _ll_register_callbacks cb 0x55e17c7a8b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.026+0000 7f06dcc99700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b9720 0x55e17c91c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.026+0000 7f06dcc99700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b9720 0x55e17c91c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50846/0 (socket says 172.21.15.81:50846) 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.026+0000 7f06dcc99700 1 -- 172.21.15.81:0/384735699 learned_addr learned my addr 172.21.15.81:0/384735699 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.026+0000 7f06d77fe700 1 --2- 172.21.15.81:0/384735699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b8e00 0x55e17c8c0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.026+0000 7f06d7fff700 1 --2- 172.21.15.81:0/384735699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b3890 0x55e17c8c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06dcc99700 1 -- 172.21.15.81:0/384735699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b3890 msgr2=0x55e17c8c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06dcc99700 1 --2- 172.21.15.81:0/384735699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b3890 0x55e17c8c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06dcc99700 1 -- 172.21.15.81:0/384735699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b8e00 msgr2=0x55e17c8c0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06dcc99700 1 --2- 172.21.15.81:0/384735699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b8e00 0x55e17c8c0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06dcc99700 1 -- 172.21.15.81:0/384735699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e17c630b60 con 0x55e17c8b9720 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06d77fe700 1 --2- 172.21.15.81:0/384735699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b8e00 0x55e17c8c0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06dcc99700 1 --2- 172.21.15.81:0/384735699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b9720 0x55e17c91c590 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009690 tx=0x7f06d0004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0af5182496619a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06b77fe700 1 -- 172.21.15.81:0/384735699 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0007910 con 0x55e17c8b9720 2024-05-09T00:11:46.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06b77fe700 1 -- 172.21.15.81:0/384735699 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f06d00048b0 con 0x55e17c8b9720 2024-05-09T00:11:46.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/384735699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06c8015aa0 con 0x55e17c8b9720 2024-05-09T00:11:46.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06b77fe700 1 -- 172.21.15.81:0/384735699 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06d0007a70 con 0x55e17c8b9720 2024-05-09T00:11:46.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06ea8b6b80 10 client.17931 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:46.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/384735699 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e17c688cd0 con 0x55e17c8b9720 2024-05-09T00:11:46.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06b77fe700 1 -- 172.21.15.81:0/384735699 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06c8015aa0 con 0x55e17c8b9720 2024-05-09T00:11:46.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06b77fe700 1 -- 172.21.15.81:0/384735699 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f06d0014040 con 0x55e17c8b9720 2024-05-09T00:11:46.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06ea8b6b80 10 client.17931 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:46.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06ea8b6b80 10 client.17931 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:46.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06ea8b6b80 20 client.17931 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:46.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/384735699 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e17c9247a0 0x55e17c926bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06ea8b6b80 4 client.17931 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:11:46.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.027+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/384735699 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e17c7fbec0 con 0x55e17c9247a0 2024-05-09T00:11:46.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06d7fff700 1 --2- 172.21.15.81:0/384735699 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e17c9247a0 0x55e17c926bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06d7fff700 1 --2- 172.21.15.81:0/384735699 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e17c9247a0 0x55e17c926bc0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64fcc5cc8a4a8272 server_cookie=78122afd0141a78a in_seq=0 out_seq=0 2024-05-09T00:11:46.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06b77fe700 10 client.17931 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:46.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06b77fe700 1 -- 172.21.15.81:0/384735699 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e17c7fbec0 con 0x55e17c9247a0 2024-05-09T00:11:46.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06b77fe700 10 client.17931 handle_command_reply: tid=0 2024-05-09T00:11:46.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06ea8b6b80 1 client.17931 shutdown 2024-05-09T00:11:46.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/384735699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b9720 msgr2=0x55e17c91c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/384735699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b9720 0x55e17c91c590 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f06d0009690 tx=0x7f06d0004320 comp rx=0 tx=0).stop 2024-05-09T00:11:46.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/384735699 shutdown_connections 2024-05-09T00:11:46.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/384735699 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e17c9247a0 0x55e17c926bc0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/384735699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e17c8b9720 0x55e17c91c590 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/384735699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e17c8b3890 0x55e17c8c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06ea8b6b80 1 --2- 172.21.15.81:0/384735699 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e17c8b8e00 0x55e17c8c0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06b77fe700 0 client.17931 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:46.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/384735699 >> 172.21.15.81:0/384735699 conn(0x55e17c811210 msgr2=0x55e17c8ba390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.028+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/384735699 shutdown_connections 2024-05-09T00:11:46.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.029+0000 7f06ea8b6b80 1 -- 172.21.15.81:0/384735699 wait complete. 2024-05-09T00:11:46.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.029+0000 7f06ea8b6b80 20 client.17931 trim_cache size 0 max 16384 2024-05-09T00:11:46.032 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:11:46.032 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:11:46.032 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:11:46.032 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:11:46.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.029+0000 7f06de6fc700 1 -- 172.21.15.81:0/4288187748 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f06c00a1290 msgr2=0x7f06c00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.029+0000 7f06de6fc700 1 --2- 172.21.15.81:0/4288187748 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f06c00a1290 0x7f06c00a3750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f06c8009a10 tx=0x7f06c8009190 comp rx=0 tx=0).stop 2024-05-09T00:11:46.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.029+0000 7f06de6fc700 1 -- 172.21.15.81:0/4288187748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d81062a0 msgr2=0x7f06d8197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.029+0000 7f06de6fc700 1 --2- 172.21.15.81:0/4288187748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d81062a0 0x7f06d8197a10 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f06cc0059d0 tx=0x7f06cc009580 comp rx=0 tx=0).stop 2024-05-09T00:11:46.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.029+0000 7f06de6fc700 1 -- 172.21.15.81:0/4288187748 shutdown_connections 2024-05-09T00:11:46.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.029+0000 7f06de6fc700 1 --2- 172.21.15.81:0/4288187748 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f06c00a1290 0x7f06c00a3750 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.029+0000 7f06de6fc700 1 --2- 172.21.15.81:0/4288187748 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f06d819bdb0 0x7f06d819c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.029+0000 7f06de6fc700 1 --2- 172.21.15.81:0/4288187748 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f06d8069400 0x7f06d81974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.029+0000 7f06de6fc700 1 --2- 172.21.15.81:0/4288187748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06d81062a0 0x7f06d8197a10 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.029+0000 7f06de6fc700 1 -- 172.21.15.81:0/4288187748 >> 172.21.15.81:0/4288187748 conn(0x7f06d8076ba0 msgr2=0x7f06d80fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.029+0000 7f06de6fc700 1 -- 172.21.15.81:0/4288187748 shutdown_connections 2024-05-09T00:11:46.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.029+0000 7f06de6fc700 1 -- 172.21.15.81:0/4288187748 wait complete. 2024-05-09T00:11:46.038 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:11:46.038 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:11:46.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.162+0000 7f27db2da700 1 -- 172.21.15.81:0/494192491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d4105060 msgr2=0x7f27d410cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.162+0000 7f27db2da700 1 --2- 172.21.15.81:0/494192491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d4105060 0x7f27d410cbe0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00b0a0 tx=0x7f27cc00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.162+0000 7f27db2da700 1 -- 172.21.15.81:0/494192491 shutdown_connections 2024-05-09T00:11:46.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.162+0000 7f27db2da700 1 --2- 172.21.15.81:0/494192491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d40fff40 0x7f27d4100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.162+0000 7f27db2da700 1 --2- 172.21.15.81:0/494192491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d4105060 0x7f27d410cbe0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.162+0000 7f27db2da700 1 --2- 172.21.15.81:0/494192491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27d41008f0 0x7f27d4104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.162+0000 7f27db2da700 1 -- 172.21.15.81:0/494192491 >> 172.21.15.81:0/494192491 conn(0x7f27d40fb7e0 msgr2=0x7f27d40fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.163+0000 7f27db2da700 1 -- 172.21.15.81:0/494192491 shutdown_connections 2024-05-09T00:11:46.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.163+0000 7f27db2da700 1 -- 172.21.15.81:0/494192491 wait complete. 2024-05-09T00:11:46.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.163+0000 7f27db2da700 1 Processor -- start 2024-05-09T00:11:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.163+0000 7f27db2da700 1 -- start start 2024-05-09T00:11:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.163+0000 7f27db2da700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d40fff40 0x7f27d4196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.163+0000 7f27db2da700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d4105060 0x7f27d4196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.163+0000 7f27db2da700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27d419aba0 0x7f27d419b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.163+0000 7f27db2da700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d419b620 con 0x7f27d40fff40 2024-05-09T00:11:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.163+0000 7f27db2da700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d419b790 con 0x7f27d4105060 2024-05-09T00:11:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.163+0000 7f27db2da700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d419b950 con 0x7f27d419aba0 2024-05-09T00:11:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.163+0000 7f27d9076700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d40fff40 0x7f27d4196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27d9076700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d40fff40 0x7f27d4196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50874/0 (socket says 172.21.15.81:50874) 2024-05-09T00:11:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27d9076700 1 -- 172.21.15.81:0/1310812109 learned_addr learned my addr 172.21.15.81:0/1310812109 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27d9877700 1 --2- 172.21.15.81:0/1310812109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27d419aba0 0x7f27d419b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27d8875700 1 --2- 172.21.15.81:0/1310812109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d4105060 0x7f27d4196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27d9076700 1 -- 172.21.15.81:0/1310812109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27d419aba0 msgr2=0x7f27d419b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27d9076700 1 --2- 172.21.15.81:0/1310812109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27d419aba0 0x7f27d419b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27d9076700 1 -- 172.21.15.81:0/1310812109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d4105060 msgr2=0x7f27d4196850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27d9076700 1 --2- 172.21.15.81:0/1310812109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d4105060 0x7f27d4196850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27d9076700 1 -- 172.21.15.81:0/1310812109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc009d00 con 0x7f27d40fff40 2024-05-09T00:11:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27d9076700 1 --2- 172.21.15.81:0/1310812109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d40fff40 0x7f27d4196310 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c920 tx=0x7f27c400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27ca7fc700 1 -- 172.21.15.81:0/1310812109 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4007b00 con 0x7f27d40fff40 2024-05-09T00:11:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27ca7fc700 1 -- 172.21.15.81:0/1310812109 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27c400ce70 con 0x7f27d40fff40 2024-05-09T00:11:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27ca7fc700 1 -- 172.21.15.81:0/1310812109 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c40054e0 con 0x7f27d40fff40 2024-05-09T00:11:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27db2da700 1 -- 172.21.15.81:0/1310812109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d41a2eb0 con 0x7f27d40fff40 2024-05-09T00:11:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.164+0000 7f27db2da700 1 -- 172.21.15.81:0/1310812109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d41a32e0 con 0x7f27d40fff40 2024-05-09T00:11:46.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.165+0000 7f27db2da700 1 -- 172.21.15.81:0/1310812109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d4108330 con 0x7f27d40fff40 2024-05-09T00:11:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.166+0000 7f27ca7fc700 1 -- 172.21.15.81:0/1310812109 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f27c4004750 con 0x7f27d40fff40 2024-05-09T00:11:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.167+0000 7f27ca7fc700 1 --2- 172.21.15.81:0/1310812109 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27c00a1310 0x7f27c00a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.167+0000 7f27d8875700 1 --2- 172.21.15.81:0/1310812109 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27c00a1310 0x7f27c00a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.167+0000 7f27ca7fc700 1 -- 172.21.15.81:0/1310812109 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f27c40cccf0 con 0x7f27d40fff40 2024-05-09T00:11:46.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.167+0000 7f27d8875700 1 --2- 172.21.15.81:0/1310812109 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27c00a1310 0x7f27c00a37d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f27d4197810 tx=0x7f27d0009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.170+0000 7f27ca7fc700 1 -- 172.21.15.81:0/1310812109 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f27c40960b0 con 0x7f27d40fff40 2024-05-09T00:11:46.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.410+0000 7f27db2da700 1 -- 172.21.15.81:0/1310812109 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27d4067c10 con 0x7f27d40fff40 2024-05-09T00:11:46.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.411+0000 7f27ca7fc700 1 -- 172.21.15.81:0/1310812109 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7f27c401d020 con 0x7f27d40fff40 2024-05-09T00:11:46.408 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:11:46.408 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:11:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.413+0000 7f27db2da700 1 -- 172.21.15.81:0/1310812109 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27c00a1310 msgr2=0x7f27c00a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.413+0000 7f27db2da700 1 --2- 172.21.15.81:0/1310812109 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27c00a1310 0x7f27c00a37d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f27d4197810 tx=0x7f27d0009260 comp rx=0 tx=0).stop 2024-05-09T00:11:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.413+0000 7f27db2da700 1 -- 172.21.15.81:0/1310812109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d40fff40 msgr2=0x7f27d4196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.413+0000 7f27db2da700 1 --2- 172.21.15.81:0/1310812109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d40fff40 0x7f27d4196310 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c920 tx=0x7f27c400cc30 comp rx=0 tx=0).stop 2024-05-09T00:11:46.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.413+0000 7f27db2da700 1 -- 172.21.15.81:0/1310812109 shutdown_connections 2024-05-09T00:11:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.413+0000 7f27db2da700 1 --2- 172.21.15.81:0/1310812109 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f27c00a1310 0x7f27c00a37d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.413+0000 7f27db2da700 1 --2- 172.21.15.81:0/1310812109 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f27d419aba0 0x7f27d419b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.413+0000 7f27db2da700 1 --2- 172.21.15.81:0/1310812109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d40fff40 0x7f27d4196310 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.413+0000 7f27db2da700 1 --2- 172.21.15.81:0/1310812109 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f27d4105060 0x7f27d4196850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.413+0000 7f27db2da700 1 -- 172.21.15.81:0/1310812109 >> 172.21.15.81:0/1310812109 conn(0x7f27d40fb7e0 msgr2=0x7f27d40fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.413+0000 7f27db2da700 1 -- 172.21.15.81:0/1310812109 shutdown_connections 2024-05-09T00:11:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.413+0000 7f27db2da700 1 -- 172.21.15.81:0/1310812109 wait complete. 2024-05-09T00:11:46.411 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:11:46.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:11:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.549+0000 7f4c2d3e2700 1 -- 172.21.15.81:0/1577401295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c28105160 msgr2=0x7f4c2810cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.549+0000 7f4c2d3e2700 1 --2- 172.21.15.81:0/1577401295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c28105160 0x7f4c2810cce0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000b0a0 tx=0x7f4c2000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.549+0000 7f4c2d3e2700 1 -- 172.21.15.81:0/1577401295 shutdown_connections 2024-05-09T00:11:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.549+0000 7f4c2d3e2700 1 --2- 172.21.15.81:0/1577401295 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c28100060 0x7f4c28100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.549+0000 7f4c2d3e2700 1 --2- 172.21.15.81:0/1577401295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c28105160 0x7f4c2810cce0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.549+0000 7f4c2d3e2700 1 --2- 172.21.15.81:0/1577401295 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c28100a10 0x7f4c28104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.549+0000 7f4c2d3e2700 1 -- 172.21.15.81:0/1577401295 >> 172.21.15.81:0/1577401295 conn(0x7f4c28076f40 msgr2=0x7f4c28077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.549+0000 7f4c2d3e2700 1 -- 172.21.15.81:0/1577401295 shutdown_connections 2024-05-09T00:11:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.549+0000 7f4c2d3e2700 1 -- 172.21.15.81:0/1577401295 wait complete. 2024-05-09T00:11:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.549+0000 7f4c2d3e2700 1 Processor -- start 2024-05-09T00:11:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c2d3e2700 1 -- start start 2024-05-09T00:11:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c2d3e2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c28100060 0x7f4c281974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c2d3e2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c28105160 0x7f4c28197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c2d3e2700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c2819bda0 0x7f4c2819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c2d3e2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2819c820 con 0x7f4c28105160 2024-05-09T00:11:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c2d3e2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2819c990 con 0x7f4c28100060 2024-05-09T00:11:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c2d3e2700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2819cb50 con 0x7f4c2819bda0 2024-05-09T00:11:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c267fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c28105160 0x7f4c28197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c267fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c28105160 0x7f4c28197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50888/0 (socket says 172.21.15.81:50888) 2024-05-09T00:11:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c267fc700 1 -- 172.21.15.81:0/4163734051 learned_addr learned my addr 172.21.15.81:0/4163734051 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c26ffd700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c28100060 0x7f4c281974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c277fe700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c2819bda0 0x7f4c2819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c267fc700 1 -- 172.21.15.81:0/4163734051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c2819bda0 msgr2=0x7f4c2819c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c267fc700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c2819bda0 0x7f4c2819c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c267fc700 1 -- 172.21.15.81:0/4163734051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c28100060 msgr2=0x7f4c281974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c267fc700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c28100060 0x7f4c281974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c267fc700 1 -- 172.21.15.81:0/4163734051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c20009d00 con 0x7f4c28105160 2024-05-09T00:11:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c277fe700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c2819bda0 0x7f4c2819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.550+0000 7f4c267fc700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c28105160 0x7f4c28197a00 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800c8f0 tx=0x7f4c1800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.551+0000 7f4c0ffff700 1 -- 172.21.15.81:0/4163734051 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18007940 con 0x7f4c28105160 2024-05-09T00:11:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.551+0000 7f4c2d3e2700 1 -- 172.21.15.81:0/4163734051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c281a40b0 con 0x7f4c28105160 2024-05-09T00:11:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.551+0000 7f4c0ffff700 1 -- 172.21.15.81:0/4163734051 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c1800f450 con 0x7f4c28105160 2024-05-09T00:11:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.551+0000 7f4c0ffff700 1 -- 172.21.15.81:0/4163734051 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c18018660 con 0x7f4c28105160 2024-05-09T00:11:46.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.551+0000 7f4c2d3e2700 1 -- 172.21.15.81:0/4163734051 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c281a45e0 con 0x7f4c28105160 2024-05-09T00:11:46.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.553+0000 7f4c0ffff700 1 -- 172.21.15.81:0/4163734051 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4c1800f5c0 con 0x7f4c28105160 2024-05-09T00:11:46.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.553+0000 7f4c0ffff700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4c100a1290 0x7f4c100a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.554+0000 7f4c26ffd700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4c100a1290 0x7f4c100a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.554+0000 7f4c0ffff700 1 -- 172.21.15.81:0/4163734051 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f4c180ccbb0 con 0x7f4c28105160 2024-05-09T00:11:46.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.554+0000 7f4c26ffd700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4c100a1290 0x7f4c100a3750 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c005950 tx=0x7f4c1c00b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.554+0000 7f4c3959cb80 1 Processor -- start 2024-05-09T00:11:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.554+0000 7f4c3959cb80 1 -- start start 2024-05-09T00:11:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.554+0000 7f4c3959cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10dd210 0x5562f10dd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.554+0000 7f4c3959cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10ddb30 0x5562f10d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.554+0000 7f4c3959cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10d7ca0 0x5562f10d80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.554+0000 7f4c3959cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f102a150 con 0x5562f10d7ca0 2024-05-09T00:11:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.554+0000 7f4c3959cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f1027b10 con 0x5562f10ddb30 2024-05-09T00:11:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.554+0000 7f4c3959cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f1023400 con 0x5562f10dd210 2024-05-09T00:11:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.555+0000 7f4c277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10d7ca0 0x5562f10d80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.555+0000 7f4c277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10d7ca0 0x5562f10d80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50904/0 (socket says 172.21.15.81:50904) 2024-05-09T00:11:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.555+0000 7f4c277fe700 1 -- 172.21.15.81:0/1993770242 learned_addr learned my addr 172.21.15.81:0/1993770242 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.555+0000 7f4c267fc700 1 --2- 172.21.15.81:0/1993770242 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10ddb30 0x5562f10d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.555+0000 7f4c277fe700 1 -- 172.21.15.81:0/1993770242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10dd210 msgr2=0x5562f10dd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.555+0000 7f4c277fe700 1 --2- 172.21.15.81:0/1993770242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10dd210 0x5562f10dd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.555+0000 7f4c277fe700 1 -- 172.21.15.81:0/1993770242 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10ddb30 msgr2=0x5562f10d7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.555+0000 7f4c277fe700 1 --2- 172.21.15.81:0/1993770242 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10ddb30 0x5562f10d7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.555+0000 7f4c277fe700 1 -- 172.21.15.81:0/1993770242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562f0ea43b0 con 0x5562f10d7ca0 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.555+0000 7f4c277fe700 1 --2- 172.21.15.81:0/1993770242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10d7ca0 0x5562f10d80e0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f4c20007c30 tx=0x7f4c20007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8507a729dec2e27e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.555+0000 7f4c0d7fa700 1 -- 172.21.15.81:0/1993770242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2000e050 con 0x5562f10d7ca0 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.555+0000 7f4c0d7fa700 1 -- 172.21.15.81:0/1993770242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c200092d0 con 0x5562f10d7ca0 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.555+0000 7f4c0d7fa700 1 -- 172.21.15.81:0/1993770242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20005240 con 0x5562f10d7ca0 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.556+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1993770242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10d7ca0 msgr2=0x5562f10d80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.556+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1993770242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10d7ca0 0x5562f10d80e0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f4c20007c30 tx=0x7f4c20007c60 comp rx=0 tx=0).stop 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.556+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1993770242 shutdown_connections 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.556+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1993770242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10d7ca0 0x5562f10d80e0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.556+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1993770242 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10dd210 0x5562f10dd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.556+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1993770242 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10ddb30 0x5562f10d7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.556+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1993770242 >> 172.21.15.81:0/1993770242 conn(0x5562f1031210 msgr2=0x5562f10cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.556+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1993770242 shutdown_connections 2024-05-09T00:11:46.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.556+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1993770242 wait complete. 2024-05-09T00:11:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.556+0000 7f4c3959cb80 1 -- start start 2024-05-09T00:11:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.556+0000 7f4c3959cb80 1 Processor -- start 2024-05-09T00:11:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c3959cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10d7ca0 0x5562f10e0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c3959cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10dd210 0x5562f10e1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c3959cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10ddb30 0x5562f10e1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c3959cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f0fbf560 con 0x5562f10dd210 2024-05-09T00:11:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c3959cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f0fbf200 con 0x5562f10ddb30 2024-05-09T00:11:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c3959cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f0ea66a0 con 0x5562f10d7ca0 2024-05-09T00:11:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c3959cb80 10 client.0 _ll_register_callbacks cb 0x5562f0fc8b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c267fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10dd210 0x5562f10e1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c267fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10dd210 0x5562f10e1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50920/0 (socket says 172.21.15.81:50920) 2024-05-09T00:11:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c267fc700 1 -- 172.21.15.81:0/1766226721 learned_addr learned my addr 172.21.15.81:0/1766226721 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c277fe700 1 --2- 172.21.15.81:0/1766226721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10ddb30 0x5562f10e1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c26ffd700 1 --2- 172.21.15.81:0/1766226721 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10d7ca0 0x5562f10e0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c267fc700 1 -- 172.21.15.81:0/1766226721 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10d7ca0 msgr2=0x5562f10e0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c267fc700 1 --2- 172.21.15.81:0/1766226721 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10d7ca0 0x5562f10e0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c267fc700 1 -- 172.21.15.81:0/1766226721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10ddb30 msgr2=0x5562f10e1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c267fc700 1 --2- 172.21.15.81:0/1766226721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10ddb30 0x5562f10e1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c267fc700 1 -- 172.21.15.81:0/1766226721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c28067ff0 con 0x5562f10dd210 2024-05-09T00:11:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c277fe700 1 --2- 172.21.15.81:0/1766226721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10ddb30 0x5562f10e1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c267fc700 1 --2- 172.21.15.81:0/1766226721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10dd210 0x5562f10e1410 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f4c180071c0 tx=0x7f4c18099c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45abd1640fd200f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c0aff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c0aff5700 1 -- 172.21.15.81:0/1766226721 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1809a0f0 con 0x5562f10dd210 2024-05-09T00:11:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c0aff5700 1 -- 172.21.15.81:0/1766226721 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f4c180a2110 con 0x5562f10dd210 2024-05-09T00:11:46.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.557+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1766226721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562f0f7c270 con 0x5562f10dd210 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.558+0000 7f4c0aff5700 1 -- 172.21.15.81:0/1766226721 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c18099180 con 0x5562f10dd210 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.558+0000 7f4c3959cb80 10 client.17949 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.558+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1766226721 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5562f0e50b60 con 0x5562f10dd210 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.558+0000 7f4c0aff5700 1 -- 172.21.15.81:0/1766226721 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5562f0f7c270 con 0x5562f10dd210 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.558+0000 7f4c0aff5700 1 -- 172.21.15.81:0/1766226721 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4c180adbf0 con 0x5562f10dd210 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.558+0000 7f4c3959cb80 10 client.17949 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.558+0000 7f4c3959cb80 10 client.17949 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.558+0000 7f4c3959cb80 20 client.17949 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.558+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1766226721 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5562f10f13a0 0x5562f10f3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.558+0000 7f4c3959cb80 4 client.17949 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.558+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1766226721 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562f10a2810 con 0x5562f10f13a0 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.558+0000 7f4c26ffd700 1 --2- 172.21.15.81:0/1766226721 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5562f10f13a0 0x5562f10f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.559+0000 7f4c0aff5700 10 client.17949 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.559+0000 7f4c26ffd700 1 --2- 172.21.15.81:0/1766226721 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5562f10f13a0 0x5562f10f3790 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7a2f8231a15cfe08 server_cookie=9e0ccac43b7797f7 in_seq=0 out_seq=0 2024-05-09T00:11:46.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.559+0000 7f4c0aff5700 1 -- 172.21.15.81:0/1766226721 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5562f10a2810 con 0x5562f10f13a0 2024-05-09T00:11:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.559+0000 7f4c0aff5700 10 client.17949 handle_command_reply: tid=0 2024-05-09T00:11:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.559+0000 7f4c3959cb80 1 client.17949 shutdown 2024-05-09T00:11:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.559+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1766226721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10dd210 msgr2=0x5562f10e1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.559+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1766226721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10dd210 0x5562f10e1410 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f4c180071c0 tx=0x7f4c18099c90 comp rx=0 tx=0).stop 2024-05-09T00:11:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.559+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1766226721 shutdown_connections 2024-05-09T00:11:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.559+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1766226721 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5562f10f13a0 0x5562f10f3790 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.559+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1766226721 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10ddb30 0x5562f10e1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.559+0000 7f4c0aff5700 0 client.17949 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:11:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.559+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1766226721 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10d7ca0 0x5562f10e0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.559+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1766226721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10dd210 0x5562f10e1410 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.560+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1766226721 >> 172.21.15.81:0/1766226721 conn(0x5562f1031210 msgr2=0x5562f10cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.560+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1766226721 shutdown_connections 2024-05-09T00:11:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.560+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1766226721 wait complete. 2024-05-09T00:11:46.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.560+0000 7f4c3959cb80 20 client.17949 trim_cache size 0 max 16384 2024-05-09T00:11:46.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.572+0000 7f4c3959cb80 1 Processor -- start 2024-05-09T00:11:46.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c3959cb80 1 -- start start 2024-05-09T00:11:46.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c3959cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10d7ca0 0x5562f10ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c3959cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10dd210 0x5562f10d8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c3959cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10ddb30 0x5562f10cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c3959cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f10ee0a0 con 0x5562f10ddb30 2024-05-09T00:11:46.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c3959cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f10e24d0 con 0x5562f10d7ca0 2024-05-09T00:11:46.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c3959cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f10cadf0 con 0x5562f10dd210 2024-05-09T00:11:46.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10ddb30 0x5562f10cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10ddb30 0x5562f10cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50926/0 (socket says 172.21.15.81:50926) 2024-05-09T00:11:46.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c277fe700 1 -- 172.21.15.81:0/3863786108 learned_addr learned my addr 172.21.15.81:0/3863786108 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c277fe700 1 -- 172.21.15.81:0/3863786108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10dd210 msgr2=0x5562f10d8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c277fe700 1 --2- 172.21.15.81:0/3863786108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10dd210 0x5562f10d8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c26ffd700 1 --2- 172.21.15.81:0/3863786108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10d7ca0 0x5562f10ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c277fe700 1 -- 172.21.15.81:0/3863786108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10d7ca0 msgr2=0x5562f10ecff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c277fe700 1 --2- 172.21.15.81:0/3863786108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10d7ca0 0x5562f10ecff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c277fe700 1 -- 172.21.15.81:0/3863786108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562f0fe9560 con 0x5562f10ddb30 2024-05-09T00:11:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c277fe700 1 --2- 172.21.15.81:0/3863786108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10ddb30 0x5562f10cdd20 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f4c20007c30 tx=0x7f4c20008f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2685b975908f6747 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c0dffb700 1 -- 172.21.15.81:0/3863786108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20004a50 con 0x5562f10ddb30 2024-05-09T00:11:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c0dffb700 1 -- 172.21.15.81:0/3863786108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c20029070 con 0x5562f10ddb30 2024-05-09T00:11:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.573+0000 7f4c0dffb700 1 -- 172.21.15.81:0/3863786108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2001b8a0 con 0x5562f10ddb30 2024-05-09T00:11:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.574+0000 7f4c3959cb80 1 -- 172.21.15.81:0/3863786108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10ddb30 msgr2=0x5562f10cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.574+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/3863786108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10ddb30 0x5562f10cdd20 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f4c20007c30 tx=0x7f4c20008f60 comp rx=0 tx=0).stop 2024-05-09T00:11:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.574+0000 7f4c3959cb80 1 -- 172.21.15.81:0/3863786108 shutdown_connections 2024-05-09T00:11:46.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.574+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/3863786108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10d7ca0 0x5562f10ecff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.574+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/3863786108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10ddb30 0x5562f10cdd20 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.574+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/3863786108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10dd210 0x5562f10d8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.574+0000 7f4c3959cb80 1 -- 172.21.15.81:0/3863786108 >> 172.21.15.81:0/3863786108 conn(0x5562f1031210 msgr2=0x5562f10ca210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.574+0000 7f4c3959cb80 1 -- 172.21.15.81:0/3863786108 shutdown_connections 2024-05-09T00:11:46.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.574+0000 7f4c3959cb80 1 -- 172.21.15.81:0/3863786108 wait complete. 2024-05-09T00:11:46.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.574+0000 7f4c3959cb80 1 -- start start 2024-05-09T00:11:46.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.574+0000 7f4c3959cb80 1 Processor -- start 2024-05-09T00:11:46.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c3959cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10d7ca0 0x5562f10e4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c3959cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10dd210 0x5562f10e4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c3959cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10ddb30 0x5562f10e4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c3959cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f1146990 con 0x5562f10ddb30 2024-05-09T00:11:46.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c3959cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f1146b00 con 0x5562f10dd210 2024-05-09T00:11:46.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c3959cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562f1146cc0 con 0x5562f10d7ca0 2024-05-09T00:11:46.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c3959cb80 10 client.0 _ll_register_callbacks cb 0x5562f0fc8b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10ddb30 0x5562f10e4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c277fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10ddb30 0x5562f10e4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50930/0 (socket says 172.21.15.81:50930) 2024-05-09T00:11:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c277fe700 1 -- 172.21.15.81:0/1490254047 learned_addr learned my addr 172.21.15.81:0/1490254047 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c26ffd700 1 --2- 172.21.15.81:0/1490254047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10d7ca0 0x5562f10e4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c267fc700 1 --2- 172.21.15.81:0/1490254047 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10dd210 0x5562f10e4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c277fe700 1 -- 172.21.15.81:0/1490254047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10d7ca0 msgr2=0x5562f10e4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c277fe700 1 --2- 172.21.15.81:0/1490254047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10d7ca0 0x5562f10e4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c277fe700 1 -- 172.21.15.81:0/1490254047 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10dd210 msgr2=0x5562f10e4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c277fe700 1 --2- 172.21.15.81:0/1490254047 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10dd210 0x5562f10e4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c277fe700 1 -- 172.21.15.81:0/1490254047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562f0ea43b0 con 0x5562f10ddb30 2024-05-09T00:11:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c267fc700 1 --2- 172.21.15.81:0/1490254047 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10dd210 0x5562f10e4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c277fe700 1 --2- 172.21.15.81:0/1490254047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10ddb30 0x5562f10e4f90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000d010 tx=0x7f4c20009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5a74eabbfbd4bb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c0aff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c0aff5700 1 -- 172.21.15.81:0/1490254047 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2000e050 con 0x5562f10ddb30 2024-05-09T00:11:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c0aff5700 1 -- 172.21.15.81:0/1490254047 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f4c200076a0 con 0x5562f10ddb30 2024-05-09T00:11:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1490254047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c200092d0 con 0x5562f10ddb30 2024-05-09T00:11:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c0aff5700 1 -- 172.21.15.81:0/1490254047 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c20004e20 con 0x5562f10ddb30 2024-05-09T00:11:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c3959cb80 10 client.17955 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.575+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1490254047 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5562f0ea8cd0 con 0x5562f10ddb30 2024-05-09T00:11:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.576+0000 7f4c0aff5700 1 -- 172.21.15.81:0/1490254047 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c20042020 con 0x5562f10ddb30 2024-05-09T00:11:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.576+0000 7f4c0aff5700 1 -- 172.21.15.81:0/1490254047 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4c2000b0d0 con 0x5562f10ddb30 2024-05-09T00:11:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.576+0000 7f4c3959cb80 10 client.17955 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.576+0000 7f4c3959cb80 10 client.17955 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:11:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.576+0000 7f4c3959cb80 20 client.17955 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.576+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1490254047 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5562f1147ff0 0x5562f114a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.576+0000 7f4c3959cb80 4 client.17955 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:11:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.576+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1490254047 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5562f101bec0 con 0x5562f1147ff0 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.576+0000 7f4c26ffd700 1 --2- 172.21.15.81:0/1490254047 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5562f1147ff0 0x5562f114a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.576+0000 7f4c0aff5700 10 client.17955 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.576+0000 7f4c26ffd700 1 --2- 172.21.15.81:0/1490254047 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5562f1147ff0 0x5562f114a410 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e158d8aa1a91586d server_cookie=3d7aa75489155e49 in_seq=0 out_seq=0 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c0aff5700 1 -- 172.21.15.81:0/1490254047 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5562f101bec0 con 0x5562f1147ff0 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c0aff5700 10 client.17955 handle_command_reply: tid=0 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c3959cb80 1 client.17955 shutdown 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1490254047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10ddb30 msgr2=0x5562f10e4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1490254047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10ddb30 0x5562f10e4f90 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000d010 tx=0x7f4c20009570 comp rx=0 tx=0).stop 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1490254047 shutdown_connections 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1490254047 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5562f10ddb30 0x5562f10e4f90 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1490254047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5562f10d7ca0 0x5562f10e4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1490254047 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5562f1147ff0 0x5562f114a410 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c3959cb80 1 --2- 172.21.15.81:0/1490254047 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5562f10dd210 0x5562f10e4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c0aff5700 0 client.17955 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1490254047 >> 172.21.15.81:0/1490254047 conn(0x5562f1031210 msgr2=0x5562f10d8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1490254047 shutdown_connections 2024-05-09T00:11:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c3959cb80 1 -- 172.21.15.81:0/1490254047 wait complete. 2024-05-09T00:11:46.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c3959cb80 20 client.17955 trim_cache size 0 max 16384 2024-05-09T00:11:46.581 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:11:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c2d3e2700 1 -- 172.21.15.81:0/4163734051 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4c100a1290 msgr2=0x7f4c100a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c2d3e2700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4c100a1290 0x7f4c100a3750 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c005950 tx=0x7f4c1c00b410 comp rx=0 tx=0).stop 2024-05-09T00:11:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c2d3e2700 1 -- 172.21.15.81:0/4163734051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c28105160 msgr2=0x7f4c28197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c2d3e2700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c28105160 0x7f4c28197a00 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f4c1800c8f0 tx=0x7f4c1800cc00 comp rx=0 tx=0).stop 2024-05-09T00:11:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c2d3e2700 1 -- 172.21.15.81:0/4163734051 shutdown_connections 2024-05-09T00:11:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c2d3e2700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4c100a1290 0x7f4c100a3750 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c2d3e2700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4c28100060 0x7f4c281974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c2d3e2700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4c2819bda0 0x7f4c2819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c2d3e2700 1 --2- 172.21.15.81:0/4163734051 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c28105160 0x7f4c28197a00 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c2d3e2700 1 -- 172.21.15.81:0/4163734051 >> 172.21.15.81:0/4163734051 conn(0x7f4c28076f40 msgr2=0x7f4c280fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.577+0000 7f4c2d3e2700 1 -- 172.21.15.81:0/4163734051 shutdown_connections 2024-05-09T00:11:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.578+0000 7f4c2d3e2700 1 -- 172.21.15.81:0/4163734051 wait complete. 2024-05-09T00:11:46.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:11:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.712+0000 7f26e42f1700 1 -- 172.21.15.81:0/3442101917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26dc106280 msgr2=0x7f26dc10de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.712+0000 7f26e42f1700 1 --2- 172.21.15.81:0/3442101917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26dc106280 0x7f26dc10de00 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f26d400b0a0 tx=0x7f26d400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.712+0000 7f26e42f1700 1 -- 172.21.15.81:0/3442101917 shutdown_connections 2024-05-09T00:11:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.712+0000 7f26e42f1700 1 --2- 172.21.15.81:0/3442101917 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26dc101160 0x7f26dc101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.712+0000 7f26e42f1700 1 --2- 172.21.15.81:0/3442101917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26dc106280 0x7f26dc10de00 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.712+0000 7f26e42f1700 1 --2- 172.21.15.81:0/3442101917 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26dc101b10 0x7f26dc105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.712+0000 7f26e42f1700 1 -- 172.21.15.81:0/3442101917 >> 172.21.15.81:0/3442101917 conn(0x7f26dc0fc9e0 msgr2=0x7f26dc0fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.712+0000 7f26e42f1700 1 -- 172.21.15.81:0/3442101917 shutdown_connections 2024-05-09T00:11:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.712+0000 7f26e42f1700 1 -- 172.21.15.81:0/3442101917 wait complete. 2024-05-09T00:11:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e42f1700 1 Processor -- start 2024-05-09T00:11:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e42f1700 1 -- start start 2024-05-09T00:11:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e42f1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26dc101160 0x7f26dc197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e42f1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26dc106280 0x7f26dc197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e42f1700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26dc19bde0 0x7f26dc19c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e42f1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc19c860 con 0x7f26dc106280 2024-05-09T00:11:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e42f1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc19c9d0 con 0x7f26dc101160 2024-05-09T00:11:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e42f1700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc19cb90 con 0x7f26dc19bde0 2024-05-09T00:11:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e188c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26dc106280 0x7f26dc197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e188c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26dc106280 0x7f26dc197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50952/0 (socket says 172.21.15.81:50952) 2024-05-09T00:11:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e188c700 1 -- 172.21.15.81:0/3674919998 learned_addr learned my addr 172.21.15.81:0/3674919998 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e208d700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26dc101160 0x7f26dc197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e288e700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26dc19bde0 0x7f26dc19c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e188c700 1 -- 172.21.15.81:0/3674919998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26dc19bde0 msgr2=0x7f26dc19c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e188c700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26dc19bde0 0x7f26dc19c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e188c700 1 -- 172.21.15.81:0/3674919998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26dc101160 msgr2=0x7f26dc197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e188c700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26dc101160 0x7f26dc197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e188c700 1 -- 172.21.15.81:0/3674919998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d4009d00 con 0x7f26dc106280 2024-05-09T00:11:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.713+0000 7f26e288e700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26dc19bde0 0x7f26dc19c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.714+0000 7f26e188c700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26dc106280 0x7f26dc197a40 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f26d800d950 tx=0x7f26d800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.714+0000 7f26d37fe700 1 -- 172.21.15.81:0/3674919998 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8004220 con 0x7f26dc106280 2024-05-09T00:11:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.714+0000 7f26e42f1700 1 -- 172.21.15.81:0/3674919998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26dc1a40f0 con 0x7f26dc106280 2024-05-09T00:11:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.714+0000 7f26d37fe700 1 -- 172.21.15.81:0/3674919998 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26d8007620 con 0x7f26dc106280 2024-05-09T00:11:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.714+0000 7f26d37fe700 1 -- 172.21.15.81:0/3674919998 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8005690 con 0x7f26dc106280 2024-05-09T00:11:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.714+0000 7f26e42f1700 1 -- 172.21.15.81:0/3674919998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26dc1a4620 con 0x7f26dc106280 2024-05-09T00:11:46.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.716+0000 7f26d37fe700 1 -- 172.21.15.81:0/3674919998 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f26d8004750 con 0x7f26dc106280 2024-05-09T00:11:46.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.717+0000 7f26d37fe700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f26c80a1290 0x7f26c80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.717+0000 7f26e208d700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f26c80a1290 0x7f26c80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.717+0000 7f26d37fe700 1 -- 172.21.15.81:0/3674919998 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f26d80cca80 con 0x7f26dc106280 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.717+0000 7f26e208d700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f26c80a1290 0x7f26c80a3750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f26cc005950 tx=0x7f26cc00a300 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26f04abb80 1 Processor -- start 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26f04abb80 1 -- start start 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26f04abb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266b9e00 0x5654266ba1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26f04abb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266ba720 0x5654266b4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26f04abb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 0x5654266b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26f04abb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56542660b150 con 0x5654266ba720 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26f04abb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x565426608b10 con 0x5654266b9e00 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26f04abb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x565426604400 con 0x5654266b4890 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26e188c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266ba720 0x5654266b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26e188c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266ba720 0x5654266b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50958/0 (socket says 172.21.15.81:50958) 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26e208d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266b9e00 0x5654266ba1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26e188c700 1 -- 172.21.15.81:0/2509770878 learned_addr learned my addr 172.21.15.81:0/2509770878 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26e288e700 1 --2- 172.21.15.81:0/2509770878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 0x5654266b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26e188c700 1 -- 172.21.15.81:0/2509770878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 msgr2=0x5654266b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26e188c700 1 --2- 172.21.15.81:0/2509770878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 0x5654266b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26e188c700 1 -- 172.21.15.81:0/2509770878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266b9e00 msgr2=0x5654266ba1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26e188c700 1 --2- 172.21.15.81:0/2509770878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266b9e00 0x5654266ba1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26e188c700 1 -- 172.21.15.81:0/2509770878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654264853b0 con 0x5654266ba720 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26e288e700 1 --2- 172.21.15.81:0/2509770878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 0x5654266b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.718+0000 7f26e208d700 1 --2- 172.21.15.81:0/2509770878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266b9e00 0x5654266ba1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.719+0000 7f26e188c700 1 --2- 172.21.15.81:0/2509770878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266ba720 0x5654266b4350 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f26d8005cd0 tx=0x7f26d8099460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267faa60f5178dd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.719+0000 7f26d0da4700 1 -- 172.21.15.81:0/2509770878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d809d930 con 0x5654266ba720 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.719+0000 7f26d0da4700 1 -- 172.21.15.81:0/2509770878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26d80a1f80 con 0x5654266ba720 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.719+0000 7f26d0da4700 1 -- 172.21.15.81:0/2509770878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d8098ff0 con 0x5654266ba720 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.719+0000 7f26f04abb80 1 -- 172.21.15.81:0/2509770878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266ba720 msgr2=0x5654266b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.719+0000 7f26f04abb80 1 --2- 172.21.15.81:0/2509770878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266ba720 0x5654266b4350 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f26d8005cd0 tx=0x7f26d8099460 comp rx=0 tx=0).stop 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 -- 172.21.15.81:0/2509770878 shutdown_connections 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 --2- 172.21.15.81:0/2509770878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266b9e00 0x5654266ba1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 --2- 172.21.15.81:0/2509770878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 0x5654266b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 --2- 172.21.15.81:0/2509770878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266ba720 0x5654266b4350 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 -- 172.21.15.81:0/2509770878 >> 172.21.15.81:0/2509770878 conn(0x565426612210 msgr2=0x5654266aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 -- 172.21.15.81:0/2509770878 shutdown_connections 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 -- 172.21.15.81:0/2509770878 wait complete. 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 -- start start 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 Processor -- start 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 0x5654266bdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b9e00 0x5654266be160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266ba720 0x5654266be6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654265a0560 con 0x5654266b9e00 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654265a0200 con 0x5654266ba720 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654264876a0 con 0x5654266b4890 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26f04abb80 10 client.0 _ll_register_callbacks cb 0x5654265a9b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26e188c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b9e00 0x5654266be160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26e188c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b9e00 0x5654266be160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50968/0 (socket says 172.21.15.81:50968) 2024-05-09T00:11:46.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26e188c700 1 -- 172.21.15.81:0/753440800 learned_addr learned my addr 172.21.15.81:0/753440800 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.720+0000 7f26e208d700 1 --2- 172.21.15.81:0/753440800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 0x5654266bdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26e288e700 1 --2- 172.21.15.81:0/753440800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266ba720 0x5654266be6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26e188c700 1 -- 172.21.15.81:0/753440800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 msgr2=0x5654266bdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26e188c700 1 --2- 172.21.15.81:0/753440800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 0x5654266bdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26e188c700 1 -- 172.21.15.81:0/753440800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266ba720 msgr2=0x5654266be6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26e188c700 1 --2- 172.21.15.81:0/753440800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266ba720 0x5654266be6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26e188c700 1 -- 172.21.15.81:0/753440800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc00f9e0 con 0x5654266b9e00 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26e288e700 1 --2- 172.21.15.81:0/753440800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266ba720 0x5654266be6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26e188c700 1 --2- 172.21.15.81:0/753440800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b9e00 0x5654266be160 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f26d80a1a50 tx=0x7f26d80050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7529170be85cff server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26c5ffb700 1 -- 172.21.15.81:0/753440800 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d80b2230 con 0x5654266b9e00 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26c5ffb700 1 -- 172.21.15.81:0/753440800 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f26d80b2390 con 0x5654266b9e00 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26f04abb80 1 -- 172.21.15.81:0/753440800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56542655d270 con 0x5654266b9e00 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26c5ffb700 1 -- 172.21.15.81:0/753440800 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26d8065330 con 0x5654266b9e00 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26f04abb80 10 client.17967 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:46.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26f04abb80 1 -- 172.21.15.81:0/753440800 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f26dc1a4620 con 0x5654266b9e00 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.721+0000 7f26c5ffb700 1 -- 172.21.15.81:0/753440800 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56542655d270 con 0x5654266b9e00 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.722+0000 7f26c5ffb700 1 -- 172.21.15.81:0/753440800 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f26d8099140 con 0x5654266b9e00 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.722+0000 7f26f04abb80 10 client.17967 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.722+0000 7f26f04abb80 10 client.17967 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.722+0000 7f26f04abb80 20 client.17967 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.722+0000 7f26f04abb80 1 --2- 172.21.15.81:0/753440800 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5654266cdc50 0x5654266d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.722+0000 7f26f04abb80 4 client.17967 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.722+0000 7f26f04abb80 1 -- 172.21.15.81:0/753440800 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565426683810 con 0x5654266cdc50 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.722+0000 7f26e208d700 1 --2- 172.21.15.81:0/753440800 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5654266cdc50 0x5654266d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.722+0000 7f26c5ffb700 10 client.17967 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.722+0000 7f26e208d700 1 --2- 172.21.15.81:0/753440800 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5654266cdc50 0x5654266d0070 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=155432eb4065921b server_cookie=380bf700d2dba614 in_seq=0 out_seq=0 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26c5ffb700 1 -- 172.21.15.81:0/753440800 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x565426683810 con 0x5654266cdc50 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26c5ffb700 10 client.17967 handle_command_reply: tid=0 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26f04abb80 1 client.17967 shutdown 2024-05-09T00:11:46.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26f04abb80 1 -- 172.21.15.81:0/753440800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b9e00 msgr2=0x5654266be160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26f04abb80 1 --2- 172.21.15.81:0/753440800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b9e00 0x5654266be160 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f26d80a1a50 tx=0x7f26d80050b0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26f04abb80 1 -- 172.21.15.81:0/753440800 shutdown_connections 2024-05-09T00:11:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26f04abb80 1 --2- 172.21.15.81:0/753440800 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5654266cdc50 0x5654266d0070 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26f04abb80 1 --2- 172.21.15.81:0/753440800 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266ba720 0x5654266be6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26c5ffb700 0 client.17967 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:11:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26f04abb80 1 --2- 172.21.15.81:0/753440800 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 0x5654266bdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26f04abb80 1 --2- 172.21.15.81:0/753440800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b9e00 0x5654266be160 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26f04abb80 1 -- 172.21.15.81:0/753440800 >> 172.21.15.81:0/753440800 conn(0x565426612210 msgr2=0x5654266ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26f04abb80 1 -- 172.21.15.81:0/753440800 shutdown_connections 2024-05-09T00:11:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26f04abb80 1 -- 172.21.15.81:0/753440800 wait complete. 2024-05-09T00:11:46.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.723+0000 7f26f04abb80 20 client.17967 trim_cache size 0 max 16384 2024-05-09T00:11:46.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.736+0000 7f26f04abb80 1 Processor -- start 2024-05-09T00:11:46.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.736+0000 7f26f04abb80 1 -- start start 2024-05-09T00:11:46.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.736+0000 7f26f04abb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b4890 0x5654266b9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.736+0000 7f26f04abb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266b9e00 0x5654266aed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.736+0000 7f26f04abb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266ba720 0x5654266bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.736+0000 7f26f04abb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654266bf180 con 0x5654266b4890 2024-05-09T00:11:46.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.736+0000 7f26f04abb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654266cacc0 con 0x5654266b9e00 2024-05-09T00:11:46.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.736+0000 7f26f04abb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654266c0cc0 con 0x5654266ba720 2024-05-09T00:11:46.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.736+0000 7f26e208d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b4890 0x5654266b9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.736+0000 7f26e208d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b4890 0x5654266b9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50972/0 (socket says 172.21.15.81:50972) 2024-05-09T00:11:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.737+0000 7f26e208d700 1 -- 172.21.15.81:0/1522941928 learned_addr learned my addr 172.21.15.81:0/1522941928 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.737+0000 7f26e208d700 1 -- 172.21.15.81:0/1522941928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266ba720 msgr2=0x5654266bc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.737+0000 7f26e208d700 1 --2- 172.21.15.81:0/1522941928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266ba720 0x5654266bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.737+0000 7f26e208d700 1 -- 172.21.15.81:0/1522941928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266b9e00 msgr2=0x5654266aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.737+0000 7f26e208d700 1 --2- 172.21.15.81:0/1522941928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266b9e00 0x5654266aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.737+0000 7f26e208d700 1 -- 172.21.15.81:0/1522941928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565426431b60 con 0x5654266b4890 2024-05-09T00:11:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.737+0000 7f26e208d700 1 --2- 172.21.15.81:0/1522941928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b4890 0x5654266b9410 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x5654266d0940 tx=0x7f26cc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88319d99c1ff721d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.737+0000 7f26d15a5700 1 -- 172.21.15.81:0/1522941928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc02d070 con 0x5654266b4890 2024-05-09T00:11:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.737+0000 7f26d15a5700 1 -- 172.21.15.81:0/1522941928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26cc024040 con 0x5654266b4890 2024-05-09T00:11:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.737+0000 7f26d15a5700 1 -- 172.21.15.81:0/1522941928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc022040 con 0x5654266b4890 2024-05-09T00:11:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 -- 172.21.15.81:0/1522941928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b4890 msgr2=0x5654266b9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 --2- 172.21.15.81:0/1522941928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b4890 0x5654266b9410 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x5654266d0940 tx=0x7f26cc012000 comp rx=0 tx=0).stop 2024-05-09T00:11:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 -- 172.21.15.81:0/1522941928 shutdown_connections 2024-05-09T00:11:46.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 --2- 172.21.15.81:0/1522941928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266ba720 0x5654266bc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 --2- 172.21.15.81:0/1522941928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b4890 0x5654266b9410 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 --2- 172.21.15.81:0/1522941928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266b9e00 0x5654266aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 -- 172.21.15.81:0/1522941928 >> 172.21.15.81:0/1522941928 conn(0x565426612210 msgr2=0x5654266b8d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 -- 172.21.15.81:0/1522941928 shutdown_connections 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 -- 172.21.15.81:0/1522941928 wait complete. 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 -- start start 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 Processor -- start 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 0x5654266c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b9e00 0x5654266c3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266ba720 0x565426723110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565426723650 con 0x5654266b9e00 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654267237c0 con 0x5654266ba720 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x565426723980 con 0x5654266b4890 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26f04abb80 10 client.0 _ll_register_callbacks cb 0x5654265a9b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:46.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26e188c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b9e00 0x5654266c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26e188c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b9e00 0x5654266c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50978/0 (socket says 172.21.15.81:50978) 2024-05-09T00:11:46.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.738+0000 7f26e188c700 1 -- 172.21.15.81:0/4083499947 learned_addr learned my addr 172.21.15.81:0/4083499947 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26e208d700 1 --2- 172.21.15.81:0/4083499947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 0x5654266c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26e188c700 1 -- 172.21.15.81:0/4083499947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 msgr2=0x5654266c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26e188c700 1 --2- 172.21.15.81:0/4083499947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 0x5654266c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26e188c700 1 -- 172.21.15.81:0/4083499947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266ba720 msgr2=0x565426723110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26e188c700 1 --2- 172.21.15.81:0/4083499947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266ba720 0x565426723110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26e188c700 1 -- 172.21.15.81:0/4083499947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26cc01d550 con 0x5654266b9e00 2024-05-09T00:11:46.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26e208d700 1 --2- 172.21.15.81:0/4083499947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 0x5654266c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:46.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26e188c700 1 --2- 172.21.15.81:0/4083499947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b9e00 0x5654266c3900 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f26d8099a90 tx=0x7f26d80ca240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e22fbac1ce8731e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:46.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26c5ffb700 1 -- 172.21.15.81:0/4083499947 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d80a1d00 con 0x5654266b9e00 2024-05-09T00:11:46.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26c5ffb700 1 -- 172.21.15.81:0/4083499947 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f26d80b2230 con 0x5654266b9e00 2024-05-09T00:11:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26f04abb80 1 -- 172.21.15.81:0/4083499947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f26d80a1f80 con 0x5654266b9e00 2024-05-09T00:11:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26c5ffb700 1 -- 172.21.15.81:0/4083499947 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26d8099eb0 con 0x5654266b9e00 2024-05-09T00:11:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26f04abb80 10 client.17973 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26f04abb80 1 -- 172.21.15.81:0/4083499947 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5654265ca560 con 0x5654266b9e00 2024-05-09T00:11:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26c5ffb700 1 -- 172.21.15.81:0/4083499947 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26d80a1f80 con 0x5654266b9e00 2024-05-09T00:11:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26c5ffb700 1 -- 172.21.15.81:0/4083499947 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f26d8099080 con 0x5654266b9e00 2024-05-09T00:11:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26f04abb80 10 client.17973 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26f04abb80 10 client.17973 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:11:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26f04abb80 20 client.17973 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26f04abb80 1 --2- 172.21.15.81:0/4083499947 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x565426724cc0 0x5654267270e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26f04abb80 4 client.17973 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:11:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.739+0000 7f26f04abb80 1 -- 172.21.15.81:0/4083499947 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5654265fcec0 con 0x565426724cc0 2024-05-09T00:11:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.740+0000 7f26e208d700 1 --2- 172.21.15.81:0/4083499947 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x565426724cc0 0x5654267270e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.740+0000 7f26c5ffb700 10 client.17973 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.740+0000 7f26e208d700 1 --2- 172.21.15.81:0/4083499947 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x565426724cc0 0x5654267270e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7a17bb20ef9fc005 server_cookie=88e11eb9c3ce2611 in_seq=0 out_seq=0 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.740+0000 7f26c5ffb700 1 -- 172.21.15.81:0/4083499947 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5654265fcec0 con 0x565426724cc0 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.740+0000 7f26c5ffb700 10 client.17973 handle_command_reply: tid=0 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.740+0000 7f26f04abb80 1 client.17973 shutdown 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.740+0000 7f26f04abb80 1 -- 172.21.15.81:0/4083499947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b9e00 msgr2=0x5654266c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.740+0000 7f26f04abb80 1 --2- 172.21.15.81:0/4083499947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b9e00 0x5654266c3900 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f26d8099a90 tx=0x7f26d80ca240 comp rx=0 tx=0).stop 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.740+0000 7f26f04abb80 1 -- 172.21.15.81:0/4083499947 shutdown_connections 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26f04abb80 1 --2- 172.21.15.81:0/4083499947 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x565426724cc0 0x5654267270e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26f04abb80 1 --2- 172.21.15.81:0/4083499947 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5654266ba720 0x565426723110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26f04abb80 1 --2- 172.21.15.81:0/4083499947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5654266b4890 0x5654266c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26c5ffb700 0 client.17973 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26f04abb80 1 --2- 172.21.15.81:0/4083499947 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5654266b9e00 0x5654266c3900 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26f04abb80 1 -- 172.21.15.81:0/4083499947 >> 172.21.15.81:0/4083499947 conn(0x565426612210 msgr2=0x5654266bc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26f04abb80 1 -- 172.21.15.81:0/4083499947 shutdown_connections 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26f04abb80 1 -- 172.21.15.81:0/4083499947 wait complete. 2024-05-09T00:11:46.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26f04abb80 20 client.17973 trim_cache size 0 max 16384 2024-05-09T00:11:46.744 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:11:46.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26e42f1700 1 -- 172.21.15.81:0/3674919998 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f26c80a1290 msgr2=0x7f26c80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26e42f1700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f26c80a1290 0x7f26c80a3750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f26cc005950 tx=0x7f26cc00a300 comp rx=0 tx=0).stop 2024-05-09T00:11:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26e42f1700 1 -- 172.21.15.81:0/3674919998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26dc106280 msgr2=0x7f26dc197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26e42f1700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26dc106280 0x7f26dc197a40 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f26d800d950 tx=0x7f26d800dc60 comp rx=0 tx=0).stop 2024-05-09T00:11:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26e42f1700 1 -- 172.21.15.81:0/3674919998 shutdown_connections 2024-05-09T00:11:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26e42f1700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f26c80a1290 0x7f26c80a3750 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26e42f1700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f26dc101160 0x7f26dc197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26e42f1700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f26dc19bde0 0x7f26dc19c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26e42f1700 1 --2- 172.21.15.81:0/3674919998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26dc106280 0x7f26dc197a40 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26e42f1700 1 -- 172.21.15.81:0/3674919998 >> 172.21.15.81:0/3674919998 conn(0x7f26dc0fc9e0 msgr2=0x7f26dc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26e42f1700 1 -- 172.21.15.81:0/3674919998 shutdown_connections 2024-05-09T00:11:46.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.741+0000 7f26e42f1700 1 -- 172.21.15.81:0/3674919998 wait complete. 2024-05-09T00:11:46.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:11:46.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.877+0000 7fbd81290700 1 -- 172.21.15.81:0/4021289052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c105180 msgr2=0x7fbd7c10cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.877+0000 7fbd81290700 1 --2- 172.21.15.81:0/4021289052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c105180 0x7fbd7c10cd00 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400b0a0 tx=0x7fbd7400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.877+0000 7fbd81290700 1 -- 172.21.15.81:0/4021289052 shutdown_connections 2024-05-09T00:11:46.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.877+0000 7fbd81290700 1 --2- 172.21.15.81:0/4021289052 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd7c100060 0x7fbd7c100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.877+0000 7fbd81290700 1 --2- 172.21.15.81:0/4021289052 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c105180 0x7fbd7c10cd00 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.877+0000 7fbd81290700 1 --2- 172.21.15.81:0/4021289052 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd7c100a10 0x7fbd7c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.877+0000 7fbd81290700 1 -- 172.21.15.81:0/4021289052 >> 172.21.15.81:0/4021289052 conn(0x7fbd7c076f10 msgr2=0x7fbd7c077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.877+0000 7fbd81290700 1 -- 172.21.15.81:0/4021289052 shutdown_connections 2024-05-09T00:11:46.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.877+0000 7fbd81290700 1 -- 172.21.15.81:0/4021289052 wait complete. 2024-05-09T00:11:46.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.878+0000 7fbd81290700 1 Processor -- start 2024-05-09T00:11:46.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.878+0000 7fbd81290700 1 -- start start 2024-05-09T00:11:46.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.878+0000 7fbd81290700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd7c100060 0x7fbd7c101af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.878+0000 7fbd81290700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c105180 0x7fbd7c102030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.878+0000 7fbd81290700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd7c102570 0x7fbd7c1a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.878+0000 7fbd81290700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c1a5cf0 con 0x7fbd7c105180 2024-05-09T00:11:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.878+0000 7fbd81290700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c1a5e60 con 0x7fbd7c102570 2024-05-09T00:11:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.878+0000 7fbd81290700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7c1a6020 con 0x7fbd7c100060 2024-05-09T00:11:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.878+0000 7fbd7a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c105180 0x7fbd7c102030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.878+0000 7fbd7a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c105180 0x7fbd7c102030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50988/0 (socket says 172.21.15.81:50988) 2024-05-09T00:11:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.878+0000 7fbd7a7fc700 1 -- 172.21.15.81:0/3240560897 learned_addr learned my addr 172.21.15.81:0/3240560897 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.878+0000 7fbd7affd700 1 --2- 172.21.15.81:0/3240560897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd7c100060 0x7fbd7c101af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.879+0000 7fbd7a7fc700 1 -- 172.21.15.81:0/3240560897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd7c100060 msgr2=0x7fbd7c101af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.879+0000 7fbd7a7fc700 1 --2- 172.21.15.81:0/3240560897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd7c100060 0x7fbd7c101af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.879+0000 7fbd7b7fe700 1 --2- 172.21.15.81:0/3240560897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd7c102570 0x7fbd7c1a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.879+0000 7fbd7a7fc700 1 -- 172.21.15.81:0/3240560897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd7c102570 msgr2=0x7fbd7c1a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.879+0000 7fbd7a7fc700 1 --2- 172.21.15.81:0/3240560897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd7c102570 0x7fbd7c1a56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.879+0000 7fbd7a7fc700 1 -- 172.21.15.81:0/3240560897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd74009d00 con 0x7fbd7c105180 2024-05-09T00:11:46.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.879+0000 7fbd7a7fc700 1 --2- 172.21.15.81:0/3240560897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c105180 0x7fbd7c102030 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00c8f0 tx=0x7fbd6c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.879+0000 7fbd63fff700 1 -- 172.21.15.81:0/3240560897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c007940 con 0x7fbd7c105180 2024-05-09T00:11:46.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.879+0000 7fbd63fff700 1 -- 172.21.15.81:0/3240560897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd6c00f450 con 0x7fbd7c105180 2024-05-09T00:11:46.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.879+0000 7fbd63fff700 1 -- 172.21.15.81:0/3240560897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c018660 con 0x7fbd7c105180 2024-05-09T00:11:46.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.879+0000 7fbd81290700 1 -- 172.21.15.81:0/3240560897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7c1a6300 con 0x7fbd7c105180 2024-05-09T00:11:46.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.879+0000 7fbd81290700 1 -- 172.21.15.81:0/3240560897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7c1a67c0 con 0x7fbd7c105180 2024-05-09T00:11:46.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.881+0000 7fbd63fff700 1 -- 172.21.15.81:0/3240560897 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fbd6c00f5c0 con 0x7fbd7c105180 2024-05-09T00:11:46.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.881+0000 7fbd63fff700 1 --2- 172.21.15.81:0/3240560897 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbd640a1290 0x7fbd640a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.882+0000 7fbd7affd700 1 --2- 172.21.15.81:0/3240560897 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbd640a1290 0x7fbd640a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.882+0000 7fbd63fff700 1 -- 172.21.15.81:0/3240560897 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fbd6c0ccb90 con 0x7fbd7c105180 2024-05-09T00:11:46.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.882+0000 7fbd7affd700 1 --2- 172.21.15.81:0/3240560897 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbd640a1290 0x7fbd640a3750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbd70005950 tx=0x7fbd7000b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.882+0000 7fbd8d44ab80 1 Processor -- start 2024-05-09T00:11:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.882+0000 7fbd8d44ab80 1 -- start start 2024-05-09T00:11:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd8d44ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71be00 0x55ab6b71c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd8d44ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b71c720 0x55ab6b716350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd8d44ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b716890 0x55ab6b716cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd8d44ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab6b66d150 con 0x55ab6b71be00 2024-05-09T00:11:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd8d44ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab6b66ab10 con 0x55ab6b716890 2024-05-09T00:11:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd8d44ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab6b666400 con 0x55ab6b71c720 2024-05-09T00:11:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd7affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71be00 0x55ab6b71c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd7affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71be00 0x55ab6b71c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51002/0 (socket says 172.21.15.81:51002) 2024-05-09T00:11:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd7affd700 1 -- 172.21.15.81:0/55191356 learned_addr learned my addr 172.21.15.81:0/55191356 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd7b7fe700 1 --2- 172.21.15.81:0/55191356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b716890 0x55ab6b716cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd7affd700 1 -- 172.21.15.81:0/55191356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b71c720 msgr2=0x55ab6b716350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd7a7fc700 1 --2- 172.21.15.81:0/55191356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b71c720 0x55ab6b716350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd7affd700 1 --2- 172.21.15.81:0/55191356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b71c720 0x55ab6b716350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd7affd700 1 -- 172.21.15.81:0/55191356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b716890 msgr2=0x55ab6b716cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd7affd700 1 --2- 172.21.15.81:0/55191356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b716890 0x55ab6b716cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd7affd700 1 -- 172.21.15.81:0/55191356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab6b4e73b0 con 0x55ab6b71be00 2024-05-09T00:11:46.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd7b7fe700 1 --2- 172.21.15.81:0/55191356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b716890 0x55ab6b716cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:46.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd7affd700 1 --2- 172.21.15.81:0/55191356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71be00 0x55ab6b71c1e0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fbd70010fa0 tx=0x7fbd70013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8c5e5960dd6c08 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd617fa700 1 -- 172.21.15.81:0/55191356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7001e620 con 0x55ab6b71be00 2024-05-09T00:11:46.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd617fa700 1 -- 172.21.15.81:0/55191356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd70015070 con 0x55ab6b71be00 2024-05-09T00:11:46.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.883+0000 7fbd617fa700 1 -- 172.21.15.81:0/55191356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7001c980 con 0x55ab6b71be00 2024-05-09T00:11:46.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.884+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/55191356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71be00 msgr2=0x55ab6b71c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.884+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/55191356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71be00 0x55ab6b71c1e0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fbd70010fa0 tx=0x7fbd70013000 comp rx=0 tx=0).stop 2024-05-09T00:11:46.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.884+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/55191356 shutdown_connections 2024-05-09T00:11:46.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.884+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/55191356 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b716890 0x55ab6b716cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.884+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/55191356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71be00 0x55ab6b71c1e0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.884+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/55191356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b71c720 0x55ab6b716350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.884+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/55191356 >> 172.21.15.81:0/55191356 conn(0x55ab6b674210 msgr2=0x55ab6b710df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.884+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/55191356 shutdown_connections 2024-05-09T00:11:46.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.884+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/55191356 wait complete. 2024-05-09T00:11:46.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.884+0000 7fbd8d44ab80 1 -- start start 2024-05-09T00:11:46.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd8d44ab80 1 Processor -- start 2024-05-09T00:11:46.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd8d44ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b716890 0x55ab6b71fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd8d44ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b71be00 0x55ab6b71ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd8d44ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b71c720 0x55ab6b7204d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd8d44ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab6b602560 con 0x55ab6b716890 2024-05-09T00:11:46.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd8d44ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab6b602200 con 0x55ab6b71be00 2024-05-09T00:11:46.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd8d44ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab6b4e96a0 con 0x55ab6b71c720 2024-05-09T00:11:46.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd8d44ab80 10 client.0 _ll_register_callbacks cb 0x55ab6b60bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:46.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd7affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b716890 0x55ab6b71fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd7affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b716890 0x55ab6b71fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51014/0 (socket says 172.21.15.81:51014) 2024-05-09T00:11:46.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd7affd700 1 -- 172.21.15.81:0/3720266990 learned_addr learned my addr 172.21.15.81:0/3720266990 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd7a7fc700 1 --2- 172.21.15.81:0/3720266990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b71be00 0x55ab6b71ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd7affd700 1 -- 172.21.15.81:0/3720266990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b71c720 msgr2=0x55ab6b7204d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd7affd700 1 --2- 172.21.15.81:0/3720266990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b71c720 0x55ab6b7204d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd7affd700 1 -- 172.21.15.81:0/3720266990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b71be00 msgr2=0x55ab6b71ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd7affd700 1 --2- 172.21.15.81:0/3720266990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b71be00 0x55ab6b71ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd7affd700 1 -- 172.21.15.81:0/3720266990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd70010c50 con 0x55ab6b716890 2024-05-09T00:11:46.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd7affd700 1 --2- 172.21.15.81:0/3720266990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b716890 0x55ab6b71fa50 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fbd70005d90 tx=0x7fbd70005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd61e9bbd90224e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd5eff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:46.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.885+0000 7fbd5eff5700 1 -- 172.21.15.81:0/3720266990 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7002d070 con 0x55ab6b716890 2024-05-09T00:11:46.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.886+0000 7fbd5eff5700 1 -- 172.21.15.81:0/3720266990 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fbd70017070 con 0x55ab6b716890 2024-05-09T00:11:46.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.886+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/3720266990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab6b5bf270 con 0x55ab6b716890 2024-05-09T00:11:46.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.886+0000 7fbd5eff5700 1 -- 172.21.15.81:0/3720266990 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd700056d0 con 0x55ab6b716890 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.886+0000 7fbd8d44ab80 10 client.17985 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.886+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/3720266990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ab6b493b60 con 0x55ab6b716890 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.886+0000 7fbd5eff5700 1 -- 172.21.15.81:0/3720266990 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd7003e020 con 0x55ab6b716890 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.886+0000 7fbd5eff5700 1 -- 172.21.15.81:0/3720266990 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbd7001e890 con 0x55ab6b716890 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.886+0000 7fbd8d44ab80 10 client.17985 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.886+0000 7fbd8d44ab80 10 client.17985 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.886+0000 7fbd8d44ab80 20 client.17985 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.886+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/3720266990 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ab6b730120 0x55ab6b732510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.886+0000 7fbd8d44ab80 4 client.17985 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.886+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/3720266990 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab6b6e5810 con 0x55ab6b730120 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.886+0000 7fbd7a7fc700 1 --2- 172.21.15.81:0/3720266990 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ab6b730120 0x55ab6b732510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.887+0000 7fbd5eff5700 10 client.17985 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.887+0000 7fbd7a7fc700 1 --2- 172.21.15.81:0/3720266990 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ab6b730120 0x55ab6b732510 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fad46b7ab46ad5fb server_cookie=a3a888ec0ccb0d48 in_seq=0 out_seq=0 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.887+0000 7fbd5eff5700 1 -- 172.21.15.81:0/3720266990 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ab6b6e5810 con 0x55ab6b730120 2024-05-09T00:11:46.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.887+0000 7fbd5eff5700 10 client.17985 handle_command_reply: tid=0 2024-05-09T00:11:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.887+0000 7fbd8d44ab80 1 client.17985 shutdown 2024-05-09T00:11:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.887+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/3720266990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b716890 msgr2=0x55ab6b71fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.887+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/3720266990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b716890 0x55ab6b71fa50 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fbd70005d90 tx=0x7fbd70005270 comp rx=0 tx=0).stop 2024-05-09T00:11:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.887+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/3720266990 shutdown_connections 2024-05-09T00:11:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.887+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/3720266990 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ab6b730120 0x55ab6b732510 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.887+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/3720266990 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b71c720 0x55ab6b7204d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.887+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/3720266990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b716890 0x55ab6b71fa50 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.887+0000 7fbd5eff5700 0 client.17985 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.887+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/3720266990 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b71be00 0x55ab6b71ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.887+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/3720266990 >> 172.21.15.81:0/3720266990 conn(0x55ab6b674210 msgr2=0x55ab6b7105a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.888+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/3720266990 shutdown_connections 2024-05-09T00:11:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.888+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/3720266990 wait complete. 2024-05-09T00:11:46.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.888+0000 7fbd8d44ab80 20 client.17985 trim_cache size 0 max 16384 2024-05-09T00:11:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd8d44ab80 1 Processor -- start 2024-05-09T00:11:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd8d44ab80 1 -- start start 2024-05-09T00:11:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd8d44ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b716890 0x55ab6b72bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd8d44ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b71be00 0x55ab6b710d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd8d44ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71c720 0x55ab6b71ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd8d44ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab6b717230 con 0x55ab6b71c720 2024-05-09T00:11:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd8d44ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab6b70ba90 con 0x55ab6b71be00 2024-05-09T00:11:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd8d44ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab6b709040 con 0x55ab6b716890 2024-05-09T00:11:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd7b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71c720 0x55ab6b71ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd7b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71c720 0x55ab6b71ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51020/0 (socket says 172.21.15.81:51020) 2024-05-09T00:11:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd7b7fe700 1 -- 172.21.15.81:0/1257682131 learned_addr learned my addr 172.21.15.81:0/1257682131 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd7a7fc700 1 --2- 172.21.15.81:0/1257682131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b71be00 0x55ab6b710d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd7affd700 1 --2- 172.21.15.81:0/1257682131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b716890 0x55ab6b72bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd7b7fe700 1 -- 172.21.15.81:0/1257682131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b716890 msgr2=0x55ab6b72bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd7b7fe700 1 --2- 172.21.15.81:0/1257682131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b716890 0x55ab6b72bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd7b7fe700 1 -- 172.21.15.81:0/1257682131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b71be00 msgr2=0x55ab6b710d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd7b7fe700 1 --2- 172.21.15.81:0/1257682131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b71be00 0x55ab6b710d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd7b7fe700 1 -- 172.21.15.81:0/1257682131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab6b62c560 con 0x55ab6b71c720 2024-05-09T00:11:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.902+0000 7fbd7b7fe700 1 --2- 172.21.15.81:0/1257682131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71c720 0x55ab6b71ea50 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fbd74007ba0 tx=0x7fbd74007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89c9002daf5a25d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.903+0000 7fbd61ffb700 1 -- 172.21.15.81:0/1257682131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7400e040 con 0x55ab6b71c720 2024-05-09T00:11:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.903+0000 7fbd61ffb700 1 -- 172.21.15.81:0/1257682131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd74004a50 con 0x55ab6b71c720 2024-05-09T00:11:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.903+0000 7fbd61ffb700 1 -- 172.21.15.81:0/1257682131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7401c440 con 0x55ab6b71c720 2024-05-09T00:11:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.903+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/1257682131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71c720 msgr2=0x55ab6b71ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.903+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/1257682131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71c720 0x55ab6b71ea50 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fbd74007ba0 tx=0x7fbd74007bd0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.903+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/1257682131 shutdown_connections 2024-05-09T00:11:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.903+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/1257682131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71c720 0x55ab6b71ea50 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.903+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/1257682131 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b716890 0x55ab6b72bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.903+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/1257682131 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b71be00 0x55ab6b710d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.903+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/1257682131 >> 172.21.15.81:0/1257682131 conn(0x55ab6b674210 msgr2=0x55ab6b71e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.903+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/1257682131 shutdown_connections 2024-05-09T00:11:46.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.903+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/1257682131 wait complete. 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd8d44ab80 1 -- start start 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd8d44ab80 1 Processor -- start 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd8d44ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b716890 0x55ab6b725290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd8d44ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b71be00 0x55ab6b7257d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd8d44ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71c720 0x55ab6b785610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd8d44ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab6b725f40 con 0x55ab6b71c720 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd8d44ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab6b785b50 con 0x55ab6b716890 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd8d44ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab6b785d10 con 0x55ab6b71be00 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd8d44ab80 10 client.0 _ll_register_callbacks cb 0x55ab6b60bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd7b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71c720 0x55ab6b785610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd7b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71c720 0x55ab6b785610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51028/0 (socket says 172.21.15.81:51028) 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd7b7fe700 1 -- 172.21.15.81:0/2795981505 learned_addr learned my addr 172.21.15.81:0/2795981505 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd7affd700 1 --2- 172.21.15.81:0/2795981505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b716890 0x55ab6b725290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd7a7fc700 1 --2- 172.21.15.81:0/2795981505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b71be00 0x55ab6b7257d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd7b7fe700 1 -- 172.21.15.81:0/2795981505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b71be00 msgr2=0x55ab6b7257d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd7b7fe700 1 --2- 172.21.15.81:0/2795981505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b71be00 0x55ab6b7257d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd7b7fe700 1 -- 172.21.15.81:0/2795981505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b716890 msgr2=0x55ab6b725290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd7b7fe700 1 --2- 172.21.15.81:0/2795981505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b716890 0x55ab6b725290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd7b7fe700 1 -- 172.21.15.81:0/2795981505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd7c10d570 con 0x55ab6b71c720 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd7b7fe700 1 --2- 172.21.15.81:0/2795981505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71c720 0x55ab6b785610 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009fd0 tx=0x7fbd74008fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c808551815f73e9c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.904+0000 7fbd5eff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd5eff5700 1 -- 172.21.15.81:0/2795981505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7402e070 con 0x55ab6b71c720 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd5eff5700 1 -- 172.21.15.81:0/2795981505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fbd74009460 con 0x55ab6b71c720 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/2795981505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd70015070 con 0x55ab6b71c720 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd5eff5700 1 -- 172.21.15.81:0/2795981505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd7400e050 con 0x55ab6b71c720 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd8d44ab80 10 client.17991 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/2795981505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ab6b4ebcd0 con 0x55ab6b71c720 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd5eff5700 1 -- 172.21.15.81:0/2795981505 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd70015070 con 0x55ab6b71c720 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd5eff5700 1 -- 172.21.15.81:0/2795981505 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbd74031030 con 0x55ab6b71c720 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd8d44ab80 10 client.17991 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:46.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd8d44ab80 10 client.17991 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd8d44ab80 20 client.17991 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/2795981505 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ab6b787050 0x55ab6b789440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd8d44ab80 4 client.17991 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/2795981505 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ab6b65eec0 con 0x55ab6b787050 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.905+0000 7fbd7affd700 1 --2- 172.21.15.81:0/2795981505 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ab6b787050 0x55ab6b789440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd5eff5700 10 client.17991 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd7affd700 1 --2- 172.21.15.81:0/2795981505 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ab6b787050 0x55ab6b789440 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35e3c23aa03acefc server_cookie=551692162548da3c in_seq=0 out_seq=0 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd5eff5700 1 -- 172.21.15.81:0/2795981505 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ab6b65eec0 con 0x55ab6b787050 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd5eff5700 10 client.17991 handle_command_reply: tid=0 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd8d44ab80 1 client.17991 shutdown 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/2795981505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71c720 msgr2=0x55ab6b785610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/2795981505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71c720 0x55ab6b785610 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009fd0 tx=0x7fbd74008fb0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/2795981505 shutdown_connections 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/2795981505 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ab6b787050 0x55ab6b789440 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/2795981505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ab6b716890 0x55ab6b725290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd5eff5700 0 client.17991 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/2795981505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ab6b71c720 0x55ab6b785610 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd8d44ab80 1 --2- 172.21.15.81:0/2795981505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ab6b71be00 0x55ab6b7257d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/2795981505 >> 172.21.15.81:0/2795981505 conn(0x55ab6b674210 msgr2=0x55ab6b71d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/2795981505 shutdown_connections 2024-05-09T00:11:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd8d44ab80 1 -- 172.21.15.81:0/2795981505 wait complete. 2024-05-09T00:11:46.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.906+0000 7fbd8d44ab80 20 client.17991 trim_cache size 0 max 16384 2024-05-09T00:11:46.910 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:11:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.907+0000 7fbd81290700 1 -- 172.21.15.81:0/3240560897 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbd640a1290 msgr2=0x7fbd640a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.907+0000 7fbd81290700 1 --2- 172.21.15.81:0/3240560897 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbd640a1290 0x7fbd640a3750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbd70005950 tx=0x7fbd7000b410 comp rx=0 tx=0).stop 2024-05-09T00:11:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.907+0000 7fbd81290700 1 -- 172.21.15.81:0/3240560897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c105180 msgr2=0x7fbd7c102030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.907+0000 7fbd81290700 1 --2- 172.21.15.81:0/3240560897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c105180 0x7fbd7c102030 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c00c8f0 tx=0x7fbd6c00cc00 comp rx=0 tx=0).stop 2024-05-09T00:11:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.907+0000 7fbd81290700 1 -- 172.21.15.81:0/3240560897 shutdown_connections 2024-05-09T00:11:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.907+0000 7fbd81290700 1 --2- 172.21.15.81:0/3240560897 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbd640a1290 0x7fbd640a3750 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.907+0000 7fbd81290700 1 --2- 172.21.15.81:0/3240560897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd7c102570 0x7fbd7c1a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.907+0000 7fbd81290700 1 --2- 172.21.15.81:0/3240560897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd7c100060 0x7fbd7c101af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.907+0000 7fbd81290700 1 --2- 172.21.15.81:0/3240560897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd7c105180 0x7fbd7c102030 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:46.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.907+0000 7fbd81290700 1 -- 172.21.15.81:0/3240560897 >> 172.21.15.81:0/3240560897 conn(0x7fbd7c076f10 msgr2=0x7fbd7c0697f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:46.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.907+0000 7fbd81290700 1 -- 172.21.15.81:0/3240560897 shutdown_connections 2024-05-09T00:11:46.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:46.907+0000 7fbd81290700 1 -- 172.21.15.81:0/3240560897 wait complete. 2024-05-09T00:11:47.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:46 smithi171 ceph-mon[47351]: pgmap v271: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-05-09T00:11:47.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:46 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1310812109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:11:47.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:46 smithi081 ceph-mon[42474]: pgmap v271: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-05-09T00:11:47.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:46 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1310812109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:11:47.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:46 smithi150 ceph-mon[46187]: pgmap v271: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 17 op/s 2024-05-09T00:11:47.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:46 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1310812109' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:11:47.917 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:11:47.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:11:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.059+0000 7f76bc08c700 1 -- 172.21.15.81:0/4157931647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76b4100060 msgr2=0x7f76b4100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.059+0000 7f76bc08c700 1 --2- 172.21.15.81:0/4157931647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76b4100060 0x7f76b4100440 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009990 tx=0x7f76a4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.059+0000 7f76bc08c700 1 -- 172.21.15.81:0/4157931647 shutdown_connections 2024-05-09T00:11:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.059+0000 7f76bc08c700 1 --2- 172.21.15.81:0/4157931647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76b4105160 0x7f76b410cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.059+0000 7f76bc08c700 1 --2- 172.21.15.81:0/4157931647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76b4100060 0x7f76b4100440 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.059+0000 7f76bc08c700 1 --2- 172.21.15.81:0/4157931647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76b4100a10 0x7f76b4104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.059+0000 7f76bc08c700 1 -- 172.21.15.81:0/4157931647 >> 172.21.15.81:0/4157931647 conn(0x7f76b4076f40 msgr2=0x7f76b4077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.059+0000 7f76bc08c700 1 -- 172.21.15.81:0/4157931647 shutdown_connections 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.059+0000 7f76bc08c700 1 -- 172.21.15.81:0/4157931647 wait complete. 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76bc08c700 1 Processor -- start 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76bc08c700 1 -- start start 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76bc08c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76b4100060 0x7f76b41962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76bc08c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76b4105160 0x7f76b4196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76bc08c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76b419ab60 0x7f76b419afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76bc08c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b419b5e0 con 0x7f76b4105160 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76bc08c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b419b750 con 0x7f76b419ab60 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76bc08c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b419b910 con 0x7f76b4100060 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76b9627700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76b4105160 0x7f76b4196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76b9627700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76b4105160 0x7f76b4196810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37316/0 (socket says 172.21.15.81:37316) 2024-05-09T00:11:48.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76b9627700 1 -- 172.21.15.81:0/3140223108 learned_addr learned my addr 172.21.15.81:0/3140223108 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:48.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76b9e28700 1 --2- 172.21.15.81:0/3140223108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76b4100060 0x7f76b41962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76ba629700 1 --2- 172.21.15.81:0/3140223108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76b419ab60 0x7f76b419afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76b9627700 1 -- 172.21.15.81:0/3140223108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76b4100060 msgr2=0x7f76b41962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76b9627700 1 --2- 172.21.15.81:0/3140223108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76b4100060 0x7f76b41962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76b9627700 1 -- 172.21.15.81:0/3140223108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76b419ab60 msgr2=0x7f76b419afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76b9627700 1 --2- 172.21.15.81:0/3140223108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76b419ab60 0x7f76b419afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.060+0000 7f76b9627700 1 -- 172.21.15.81:0/3140223108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a40095f0 con 0x7f76b4105160 2024-05-09T00:11:48.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.061+0000 7f76b9627700 1 --2- 172.21.15.81:0/3140223108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76b4105160 0x7f76b4196810 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f76b000b500 tx=0x7f76b000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:48.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.061+0000 7f76aaffd700 1 -- 172.21.15.81:0/3140223108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0011830 con 0x7f76b4105160 2024-05-09T00:11:48.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.061+0000 7f76aaffd700 1 -- 172.21.15.81:0/3140223108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76b0011e50 con 0x7f76b4105160 2024-05-09T00:11:48.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.061+0000 7f76bc08c700 1 -- 172.21.15.81:0/3140223108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b41a2e70 con 0x7f76b4105160 2024-05-09T00:11:48.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.061+0000 7f76aaffd700 1 -- 172.21.15.81:0/3140223108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0010de0 con 0x7f76b4105160 2024-05-09T00:11:48.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.061+0000 7f76bc08c700 1 -- 172.21.15.81:0/3140223108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b41a3290 con 0x7f76b4105160 2024-05-09T00:11:48.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.063+0000 7f76aaffd700 1 -- 172.21.15.81:0/3140223108 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f76b0010480 con 0x7f76b4105160 2024-05-09T00:11:48.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.063+0000 7f76aaffd700 1 --2- 172.21.15.81:0/3140223108 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76a00a1290 0x7f76a00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.064+0000 7f76b9e28700 1 --2- 172.21.15.81:0/3140223108 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76a00a1290 0x7f76a00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.064+0000 7f76aaffd700 1 -- 172.21.15.81:0/3140223108 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f76b00cc6c0 con 0x7f76b4105160 2024-05-09T00:11:48.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.064+0000 7f76b9e28700 1 --2- 172.21.15.81:0/3140223108 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76a00a1290 0x7f76a00a3750 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f76a400b5c0 tx=0x7f76a4005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:48.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.065+0000 7f76c8246b80 1 Processor -- start 2024-05-09T00:11:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.065+0000 7f76c8246b80 1 -- start start 2024-05-09T00:11:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.065+0000 7f76c8246b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f73e80 0x563ff6f74260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.065+0000 7f76c8246b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f6e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.065+0000 7f76c8246b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f6e910 0x563ff6f6ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.065+0000 7f76c8246b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6ec51d0 con 0x563ff6f747a0 2024-05-09T00:11:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.065+0000 7f76c8246b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6ec2b90 con 0x563ff6f6e910 2024-05-09T00:11:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.065+0000 7f76c8246b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6ebe480 con 0x563ff6f73e80 2024-05-09T00:11:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.065+0000 7f76b9627700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f6e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.065+0000 7f76b9627700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f6e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37326/0 (socket says 172.21.15.81:37326) 2024-05-09T00:11:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.065+0000 7f76b9627700 1 -- 172.21.15.81:0/2365343475 learned_addr learned my addr 172.21.15.81:0/2365343475 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.065+0000 7f76b9e28700 1 --2- 172.21.15.81:0/2365343475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f73e80 0x563ff6f74260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.065+0000 7f76ba629700 1 --2- 172.21.15.81:0/2365343475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f6e910 0x563ff6f6ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.066+0000 7f76b9627700 1 -- 172.21.15.81:0/2365343475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f73e80 msgr2=0x563ff6f74260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.066+0000 7f76b9627700 1 --2- 172.21.15.81:0/2365343475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f73e80 0x563ff6f74260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.066+0000 7f76b9627700 1 -- 172.21.15.81:0/2365343475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f6e910 msgr2=0x563ff6f6ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.066+0000 7f76b9627700 1 --2- 172.21.15.81:0/2365343475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f6e910 0x563ff6f6ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.066+0000 7f76b9627700 1 -- 172.21.15.81:0/2365343475 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ff6d3f430 con 0x563ff6f747a0 2024-05-09T00:11:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.066+0000 7f76b9e28700 1 --2- 172.21.15.81:0/2365343475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f73e80 0x563ff6f74260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.066+0000 7f76b9627700 1 --2- 172.21.15.81:0/2365343475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f6e3d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f76b00962c0 tx=0x7f76b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd26384f3bf9ab3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.066+0000 7f769ffff700 1 -- 172.21.15.81:0/2365343475 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0099850 con 0x563ff6f747a0 2024-05-09T00:11:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.066+0000 7f769ffff700 1 -- 172.21.15.81:0/2365343475 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76b009d680 con 0x563ff6f747a0 2024-05-09T00:11:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.066+0000 7f769ffff700 1 -- 172.21.15.81:0/2365343475 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0098d40 con 0x563ff6f747a0 2024-05-09T00:11:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.067+0000 7f76c8246b80 1 -- 172.21.15.81:0/2365343475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 msgr2=0x563ff6f6e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.067+0000 7f76c8246b80 1 --2- 172.21.15.81:0/2365343475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f6e3d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f76b00962c0 tx=0x7f76b0004750 comp rx=0 tx=0).stop 2024-05-09T00:11:48.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.067+0000 7f76c8246b80 1 -- 172.21.15.81:0/2365343475 shutdown_connections 2024-05-09T00:11:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.067+0000 7f76c8246b80 1 --2- 172.21.15.81:0/2365343475 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f6e910 0x563ff6f6ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.067+0000 7f76c8246b80 1 --2- 172.21.15.81:0/2365343475 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f73e80 0x563ff6f74260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.067+0000 7f76c8246b80 1 --2- 172.21.15.81:0/2365343475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f6e3d0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.067+0000 7f76c8246b80 1 -- 172.21.15.81:0/2365343475 >> 172.21.15.81:0/2365343475 conn(0x563ff6ecc290 msgr2=0x563ff6f68e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.067+0000 7f76c8246b80 1 -- 172.21.15.81:0/2365343475 shutdown_connections 2024-05-09T00:11:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.067+0000 7f76c8246b80 1 -- 172.21.15.81:0/2365343475 wait complete. 2024-05-09T00:11:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.067+0000 7f76c8246b80 1 -- start start 2024-05-09T00:11:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.067+0000 7f76c8246b80 1 Processor -- start 2024-05-09T00:11:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76c8246b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f6e910 0x563ff6f77bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76c8246b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f73e80 0x563ff6f78130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76c8246b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f78670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76c8246b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6e5a5e0 con 0x563ff6f747a0 2024-05-09T00:11:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76c8246b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6e5a280 con 0x563ff6f6e910 2024-05-09T00:11:48.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76c8246b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6d41720 con 0x563ff6f73e80 2024-05-09T00:11:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76c8246b80 10 client.0 _ll_register_callbacks cb 0x563ff6e63bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76ba629700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f78670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76ba629700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f78670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37328/0 (socket says 172.21.15.81:37328) 2024-05-09T00:11:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76ba629700 1 -- 172.21.15.81:0/419220365 learned_addr learned my addr 172.21.15.81:0/419220365 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76b9e28700 1 --2- 172.21.15.81:0/419220365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f6e910 0x563ff6f77bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76ba629700 1 -- 172.21.15.81:0/419220365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f73e80 msgr2=0x563ff6f78130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76ba629700 1 --2- 172.21.15.81:0/419220365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f73e80 0x563ff6f78130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76ba629700 1 -- 172.21.15.81:0/419220365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f6e910 msgr2=0x563ff6f77bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76ba629700 1 --2- 172.21.15.81:0/419220365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f6e910 0x563ff6f77bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76ba629700 1 -- 172.21.15.81:0/419220365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b41a3290 con 0x563ff6f747a0 2024-05-09T00:11:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f76ba629700 1 --2- 172.21.15.81:0/419220365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f78670 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f76ac011cc0 tx=0x7f76ac007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454f3c02949dedea server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f769d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.068+0000 7f769d7fa700 1 -- 172.21.15.81:0/419220365 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac00f900 con 0x563ff6f747a0 2024-05-09T00:11:48.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.069+0000 7f769d7fa700 1 -- 172.21.15.81:0/419220365 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f76ac00fa60 con 0x563ff6f747a0 2024-05-09T00:11:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.069+0000 7f76c8246b80 1 -- 172.21.15.81:0/419220365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ff6e172f0 con 0x563ff6f747a0 2024-05-09T00:11:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.069+0000 7f769d7fa700 1 -- 172.21.15.81:0/419220365 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76ac00fc40 con 0x563ff6f747a0 2024-05-09T00:11:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.069+0000 7f76c8246b80 10 client.18003 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.069+0000 7f76c8246b80 1 -- 172.21.15.81:0/419220365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563ff6cebbe0 con 0x563ff6f747a0 2024-05-09T00:11:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.069+0000 7f769d7fa700 1 -- 172.21.15.81:0/419220365 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563ff6e172f0 con 0x563ff6f747a0 2024-05-09T00:11:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.069+0000 7f769d7fa700 1 -- 172.21.15.81:0/419220365 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f76ac015430 con 0x563ff6f747a0 2024-05-09T00:11:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.069+0000 7f76c8246b80 10 client.18003 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.069+0000 7f76c8246b80 10 client.18003 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.069+0000 7f76c8246b80 20 client.18003 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.069+0000 7f76c8246b80 1 --2- 172.21.15.81:0/419220365 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563ff6f88400 0x563ff6f8a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.069+0000 7f76c8246b80 4 client.18003 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.069+0000 7f76c8246b80 1 -- 172.21.15.81:0/419220365 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ff6f3d890 con 0x563ff6f88400 2024-05-09T00:11:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.069+0000 7f76b9e28700 1 --2- 172.21.15.81:0/419220365 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563ff6f88400 0x563ff6f8a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.070+0000 7f769d7fa700 10 client.18003 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.070+0000 7f76b9e28700 1 --2- 172.21.15.81:0/419220365 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563ff6f88400 0x563ff6f8a820 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=121a0b348f436ee5 server_cookie=b9bcfd10662363fb in_seq=0 out_seq=0 2024-05-09T00:11:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f769d7fa700 1 -- 172.21.15.81:0/419220365 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563ff6f3d890 con 0x563ff6f88400 2024-05-09T00:11:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f769d7fa700 10 client.18003 handle_command_reply: tid=0 2024-05-09T00:11:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f76c8246b80 1 client.18003 shutdown 2024-05-09T00:11:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f76c8246b80 1 -- 172.21.15.81:0/419220365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 msgr2=0x563ff6f78670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f76c8246b80 1 --2- 172.21.15.81:0/419220365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f78670 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f76ac011cc0 tx=0x7f76ac007e50 comp rx=0 tx=0).stop 2024-05-09T00:11:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f76c8246b80 1 -- 172.21.15.81:0/419220365 shutdown_connections 2024-05-09T00:11:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f76c8246b80 1 --2- 172.21.15.81:0/419220365 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563ff6f88400 0x563ff6f8a820 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f76c8246b80 1 --2- 172.21.15.81:0/419220365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f6e910 0x563ff6f77bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f76c8246b80 1 --2- 172.21.15.81:0/419220365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f78670 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f76c8246b80 1 --2- 172.21.15.81:0/419220365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f73e80 0x563ff6f78130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f769d7fa700 0 client.18003 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f76c8246b80 1 -- 172.21.15.81:0/419220365 >> 172.21.15.81:0/419220365 conn(0x563ff6ecc290 msgr2=0x563ff6f68620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:48.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f76c8246b80 1 -- 172.21.15.81:0/419220365 shutdown_connections 2024-05-09T00:11:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f76c8246b80 1 -- 172.21.15.81:0/419220365 wait complete. 2024-05-09T00:11:48.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.071+0000 7f76c8246b80 20 client.18003 trim_cache size 0 max 16384 2024-05-09T00:11:48.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76c8246b80 1 Processor -- start 2024-05-09T00:11:48.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76c8246b80 1 -- start start 2024-05-09T00:11:48.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76c8246b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f6e910 0x563ff6f6e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76c8246b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f73e80 0x563ff6f733f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76c8246b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f747a0 0x563ff6f68da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76c8246b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6f84e60 con 0x563ff6f6e910 2024-05-09T00:11:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76c8246b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6f791f0 con 0x563ff6f73e80 2024-05-09T00:11:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76c8246b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6f65e40 con 0x563ff6f747a0 2024-05-09T00:11:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76b9e28700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f6e910 0x563ff6f6e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76b9e28700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f6e910 0x563ff6f6e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37336/0 (socket says 172.21.15.81:37336) 2024-05-09T00:11:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76b9e28700 1 -- 172.21.15.81:0/833373812 learned_addr learned my addr 172.21.15.81:0/833373812 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76b9627700 1 --2- 172.21.15.81:0/833373812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f73e80 0x563ff6f733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76b9e28700 1 -- 172.21.15.81:0/833373812 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f747a0 msgr2=0x563ff6f68da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76b9e28700 1 --2- 172.21.15.81:0/833373812 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f747a0 0x563ff6f68da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76b9e28700 1 -- 172.21.15.81:0/833373812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f73e80 msgr2=0x563ff6f733f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76b9e28700 1 --2- 172.21.15.81:0/833373812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f73e80 0x563ff6f733f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76b9e28700 1 -- 172.21.15.81:0/833373812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ff6f65560 con 0x563ff6f6e910 2024-05-09T00:11:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76b9e28700 1 --2- 172.21.15.81:0/833373812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f6e910 0x563ff6f6e3d0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009990 tx=0x7f76a4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65188e01c9c580e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:48.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.089+0000 7f76a8ff9700 1 -- 172.21.15.81:0/833373812 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a40350e0 con 0x563ff6f6e910 2024-05-09T00:11:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.090+0000 7f76a8ff9700 1 -- 172.21.15.81:0/833373812 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76a401e040 con 0x563ff6f6e910 2024-05-09T00:11:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.090+0000 7f76a8ff9700 1 -- 172.21.15.81:0/833373812 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4004a70 con 0x563ff6f6e910 2024-05-09T00:11:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.090+0000 7f76c8246b80 1 -- 172.21.15.81:0/833373812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f6e910 msgr2=0x563ff6f6e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.090+0000 7f76c8246b80 1 --2- 172.21.15.81:0/833373812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f6e910 0x563ff6f6e3d0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f76a4009990 tx=0x7f76a4020000 comp rx=0 tx=0).stop 2024-05-09T00:11:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.090+0000 7f76c8246b80 1 -- 172.21.15.81:0/833373812 shutdown_connections 2024-05-09T00:11:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.090+0000 7f76c8246b80 1 --2- 172.21.15.81:0/833373812 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f747a0 0x563ff6f68da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.090+0000 7f76c8246b80 1 --2- 172.21.15.81:0/833373812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f6e910 0x563ff6f6e3d0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.090+0000 7f76c8246b80 1 --2- 172.21.15.81:0/833373812 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f73e80 0x563ff6f733f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.090+0000 7f76c8246b80 1 -- 172.21.15.81:0/833373812 >> 172.21.15.81:0/833373812 conn(0x563ff6ecc290 msgr2=0x563ff6f72ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.090+0000 7f76c8246b80 1 -- 172.21.15.81:0/833373812 shutdown_connections 2024-05-09T00:11:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.090+0000 7f76c8246b80 1 -- 172.21.15.81:0/833373812 wait complete. 2024-05-09T00:11:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.090+0000 7f76c8246b80 1 -- start start 2024-05-09T00:11:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76c8246b80 1 Processor -- start 2024-05-09T00:11:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76c8246b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f6e910 0x563ff6f7f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76c8246b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f73e80 0x563ff6f7d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76c8246b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f7de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76c8246b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6f7e540 con 0x563ff6f747a0 2024-05-09T00:11:48.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76c8246b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6f7e6b0 con 0x563ff6f73e80 2024-05-09T00:11:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76c8246b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6fde910 con 0x563ff6f6e910 2024-05-09T00:11:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76c8246b80 10 client.0 _ll_register_callbacks cb 0x563ff6e63bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76ba629700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f7de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76ba629700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f7de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37340/0 (socket says 172.21.15.81:37340) 2024-05-09T00:11:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76ba629700 1 -- 172.21.15.81:0/4181443661 learned_addr learned my addr 172.21.15.81:0/4181443661 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76b9627700 1 --2- 172.21.15.81:0/4181443661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f73e80 0x563ff6f7d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76b9e28700 1 --2- 172.21.15.81:0/4181443661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f6e910 0x563ff6f7f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76ba629700 1 -- 172.21.15.81:0/4181443661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f6e910 msgr2=0x563ff6f7f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76ba629700 1 --2- 172.21.15.81:0/4181443661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f6e910 0x563ff6f7f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76ba629700 1 -- 172.21.15.81:0/4181443661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f73e80 msgr2=0x563ff6f7d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76ba629700 1 --2- 172.21.15.81:0/4181443661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f73e80 0x563ff6f7d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76ba629700 1 -- 172.21.15.81:0/4181443661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a402c040 con 0x563ff6f747a0 2024-05-09T00:11:48.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f76ba629700 1 --2- 172.21.15.81:0/4181443661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f7de30 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f76ac015760 tx=0x7f76ac007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44ac3cc9fd1a8dc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.091+0000 7f769d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f769d7fa700 1 -- 172.21.15.81:0/4181443661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac00f4b0 con 0x563ff6f747a0 2024-05-09T00:11:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f769d7fa700 1 -- 172.21.15.81:0/4181443661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f76ac011070 con 0x563ff6f747a0 2024-05-09T00:11:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f76c8246b80 1 -- 172.21.15.81:0/4181443661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f76b009d680 con 0x563ff6f747a0 2024-05-09T00:11:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f769d7fa700 1 -- 172.21.15.81:0/4181443661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76ac015b90 con 0x563ff6f747a0 2024-05-09T00:11:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f76c8246b80 10 client.18009 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f76c8246b80 1 -- 172.21.15.81:0/4181443661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563ff6e845e0 con 0x563ff6f747a0 2024-05-09T00:11:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f769d7fa700 1 -- 172.21.15.81:0/4181443661 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76ac037020 con 0x563ff6f747a0 2024-05-09T00:11:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f769d7fa700 1 -- 172.21.15.81:0/4181443661 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f76ac014740 con 0x563ff6f747a0 2024-05-09T00:11:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f76c8246b80 10 client.18009 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f76c8246b80 10 client.18009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f76c8246b80 20 client.18009 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:48.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f76c8246b80 1 --2- 172.21.15.81:0/4181443661 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563ff6fdfed0 0x563ff6fe22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f76c8246b80 4 client.18009 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:11:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f76c8246b80 1 -- 172.21.15.81:0/4181443661 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x563ff6eb6f40 con 0x563ff6fdfed0 2024-05-09T00:11:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.092+0000 7f76b9e28700 1 --2- 172.21.15.81:0/4181443661 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563ff6fdfed0 0x563ff6fe22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.093+0000 7f769d7fa700 10 client.18009 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:48.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.093+0000 7f76b9e28700 1 --2- 172.21.15.81:0/4181443661 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563ff6fdfed0 0x563ff6fe22f0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e59241fa3429b19 server_cookie=913c112f382a651a in_seq=0 out_seq=0 2024-05-09T00:11:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.094+0000 7f769d7fa700 1 -- 172.21.15.81:0/4181443661 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x563ff6eb6f40 con 0x563ff6fdfed0 2024-05-09T00:11:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.094+0000 7f769d7fa700 10 client.18009 handle_command_reply: tid=0 2024-05-09T00:11:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.094+0000 7f76c8246b80 1 client.18009 shutdown 2024-05-09T00:11:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.094+0000 7f76c8246b80 1 -- 172.21.15.81:0/4181443661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 msgr2=0x563ff6f7de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.094+0000 7f76c8246b80 1 --2- 172.21.15.81:0/4181443661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f7de30 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f76ac015760 tx=0x7f76ac007e20 comp rx=0 tx=0).stop 2024-05-09T00:11:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.094+0000 7f76c8246b80 1 -- 172.21.15.81:0/4181443661 shutdown_connections 2024-05-09T00:11:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.094+0000 7f76c8246b80 1 --2- 172.21.15.81:0/4181443661 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x563ff6fdfed0 0x563ff6fe22f0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.094+0000 7f76c8246b80 1 --2- 172.21.15.81:0/4181443661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563ff6f747a0 0x563ff6f7de30 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.094+0000 7f76c8246b80 1 --2- 172.21.15.81:0/4181443661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x563ff6f6e910 0x563ff6f7f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.094+0000 7f769d7fa700 0 client.18009 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.094+0000 7f76c8246b80 1 --2- 172.21.15.81:0/4181443661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x563ff6f73e80 0x563ff6f7d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.094+0000 7f76c8246b80 1 -- 172.21.15.81:0/4181443661 >> 172.21.15.81:0/4181443661 conn(0x563ff6ecc290 msgr2=0x563ff6f74c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.094+0000 7f76c8246b80 1 -- 172.21.15.81:0/4181443661 shutdown_connections 2024-05-09T00:11:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.094+0000 7f76c8246b80 1 -- 172.21.15.81:0/4181443661 wait complete. 2024-05-09T00:11:48.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.095+0000 7f76c8246b80 20 client.18009 trim_cache size 0 max 16384 2024-05-09T00:11:48.099 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:11:48.099 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:11:48.099 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "43a00413-580f-4f13-8fd2-498f2bd8e822", 2024-05-09T00:11:48.099 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:11:48.101 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:11:48.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.095+0000 7f76bc08c700 1 -- 172.21.15.81:0/3140223108 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76a00a1290 msgr2=0x7f76a00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.095+0000 7f76bc08c700 1 --2- 172.21.15.81:0/3140223108 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76a00a1290 0x7f76a00a3750 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f76a400b5c0 tx=0x7f76a4005960 comp rx=0 tx=0).stop 2024-05-09T00:11:48.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.095+0000 7f76bc08c700 1 -- 172.21.15.81:0/3140223108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76b4105160 msgr2=0x7f76b4196810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.095+0000 7f76bc08c700 1 --2- 172.21.15.81:0/3140223108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76b4105160 0x7f76b4196810 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f76b000b500 tx=0x7f76b000b810 comp rx=0 tx=0).stop 2024-05-09T00:11:48.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.095+0000 7f76bc08c700 1 -- 172.21.15.81:0/3140223108 shutdown_connections 2024-05-09T00:11:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.095+0000 7f76bc08c700 1 --2- 172.21.15.81:0/3140223108 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76a00a1290 0x7f76a00a3750 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.095+0000 7f76bc08c700 1 --2- 172.21.15.81:0/3140223108 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76b419ab60 0x7f76b419afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.095+0000 7f76bc08c700 1 --2- 172.21.15.81:0/3140223108 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76b4100060 0x7f76b41962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.095+0000 7f76bc08c700 1 --2- 172.21.15.81:0/3140223108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76b4105160 0x7f76b4196810 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.095+0000 7f76bc08c700 1 -- 172.21.15.81:0/3140223108 >> 172.21.15.81:0/3140223108 conn(0x7f76b4076f40 msgr2=0x7f76b40fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.095+0000 7f76bc08c700 1 -- 172.21.15.81:0/3140223108 shutdown_connections 2024-05-09T00:11:48.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.095+0000 7f76bc08c700 1 -- 172.21.15.81:0/3140223108 wait complete. 2024-05-09T00:11:48.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:11:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.232+0000 7f095e77d700 1 -- 172.21.15.81:0/165028736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0958105ef0 msgr2=0x7f09581062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.232+0000 7f095e77d700 1 --2- 172.21.15.81:0/165028736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0958105ef0 0x7f09581062d0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f0948009990 tx=0x7f0948009ca0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.232+0000 7f095e77d700 1 -- 172.21.15.81:0/165028736 shutdown_connections 2024-05-09T00:11:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.232+0000 7f095e77d700 1 --2- 172.21.15.81:0/165028736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09580ffdd0 0x7f095810dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.232+0000 7f095e77d700 1 --2- 172.21.15.81:0/165028736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0958105ef0 0x7f09581062d0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.232+0000 7f095e77d700 1 --2- 172.21.15.81:0/165028736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f09580ff410 0x7f09580ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.232+0000 7f095e77d700 1 -- 172.21.15.81:0/165028736 >> 172.21.15.81:0/165028736 conn(0x7f09580763a0 msgr2=0x7f09580fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.232+0000 7f095e77d700 1 -- 172.21.15.81:0/165028736 shutdown_connections 2024-05-09T00:11:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.232+0000 7f095e77d700 1 -- 172.21.15.81:0/165028736 wait complete. 2024-05-09T00:11:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.232+0000 7f095e77d700 1 Processor -- start 2024-05-09T00:11:48.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f095e77d700 1 -- start start 2024-05-09T00:11:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f095e77d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09580ff410 0x7f09581974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f095e77d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09580ffdd0 0x7f09581979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f095e77d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0958105ef0 0x7f095819bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f095e77d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095819c3c0 con 0x7f09580ff410 2024-05-09T00:11:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f095e77d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095819c530 con 0x7f09580ffdd0 2024-05-09T00:11:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f095e77d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095819c6f0 con 0x7f0958105ef0 2024-05-09T00:11:48.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f0957fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09580ff410 0x7f09581974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f0957fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09580ff410 0x7f09581974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37356/0 (socket says 172.21.15.81:37356) 2024-05-09T00:11:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f0957fff700 1 -- 172.21.15.81:0/3180667574 learned_addr learned my addr 172.21.15.81:0/3180667574 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f09577fe700 1 --2- 172.21.15.81:0/3180667574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09580ffdd0 0x7f09581979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f095cd1a700 1 --2- 172.21.15.81:0/3180667574 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0958105ef0 0x7f095819bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f0957fff700 1 -- 172.21.15.81:0/3180667574 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0958105ef0 msgr2=0x7f095819bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f0957fff700 1 --2- 172.21.15.81:0/3180667574 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0958105ef0 0x7f095819bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f0957fff700 1 -- 172.21.15.81:0/3180667574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09580ffdd0 msgr2=0x7f09581979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f0957fff700 1 --2- 172.21.15.81:0/3180667574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09580ffdd0 0x7f09581979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.233+0000 7f0957fff700 1 -- 172.21.15.81:0/3180667574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09480095f0 con 0x7f09580ff410 2024-05-09T00:11:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.234+0000 7f0957fff700 1 --2- 172.21.15.81:0/3180667574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09580ff410 0x7f09581974a0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f0948005910 tx=0x7f0948004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.234+0000 7f09557fa700 1 -- 172.21.15.81:0/3180667574 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094801d070 con 0x7f09580ff410 2024-05-09T00:11:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.234+0000 7f09557fa700 1 -- 172.21.15.81:0/3180667574 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0948022470 con 0x7f09580ff410 2024-05-09T00:11:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.234+0000 7f095e77d700 1 -- 172.21.15.81:0/3180667574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095819c970 con 0x7f09580ff410 2024-05-09T00:11:48.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.234+0000 7f09557fa700 1 -- 172.21.15.81:0/3180667574 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948017650 con 0x7f09580ff410 2024-05-09T00:11:48.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.234+0000 7f095e77d700 1 -- 172.21.15.81:0/3180667574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09581a4210 con 0x7f09580ff410 2024-05-09T00:11:48.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.236+0000 7f09557fa700 1 -- 172.21.15.81:0/3180667574 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f09480225e0 con 0x7f09580ff410 2024-05-09T00:11:48.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.236+0000 7f09557fa700 1 --2- 172.21.15.81:0/3180667574 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f09400a1290 0x7f09400a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.236+0000 7f09577fe700 1 --2- 172.21.15.81:0/3180667574 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f09400a1290 0x7f09400a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.237+0000 7f09557fa700 1 -- 172.21.15.81:0/3180667574 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f09480ce240 con 0x7f09580ff410 2024-05-09T00:11:48.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.237+0000 7f09577fe700 1 --2- 172.21.15.81:0/3180667574 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f09400a1290 0x7f09400a3750 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f09581989f0 tx=0x7f094c00b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:48.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.237+0000 7f096a937b80 1 Processor -- start 2024-05-09T00:11:48.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.237+0000 7f096a937b80 1 -- start start 2024-05-09T00:11:48.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.237+0000 7f096a937b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f4e00 0x55fc432f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.237+0000 7f096a937b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f5720 0x55fc432ef350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.237+0000 7f096a937b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432ef890 0x55fc432efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.237+0000 7f096a937b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc43246150 con 0x55fc432f5720 2024-05-09T00:11:48.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.237+0000 7f096a937b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc43243b10 con 0x55fc432ef890 2024-05-09T00:11:48.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.237+0000 7f096a937b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc4323f400 con 0x55fc432f4e00 2024-05-09T00:11:48.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.237+0000 7f09577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f5720 0x55fc432ef350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.237+0000 7f09577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f5720 0x55fc432ef350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37372/0 (socket says 172.21.15.81:37372) 2024-05-09T00:11:48.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.237+0000 7f09577fe700 1 -- 172.21.15.81:0/741633742 learned_addr learned my addr 172.21.15.81:0/741633742 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:48.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.238+0000 7f0957fff700 1 --2- 172.21.15.81:0/741633742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f4e00 0x55fc432f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.238+0000 7f095cd1a700 1 --2- 172.21.15.81:0/741633742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432ef890 0x55fc432efcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.238+0000 7f09577fe700 1 -- 172.21.15.81:0/741633742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f4e00 msgr2=0x55fc432f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.238+0000 7f09577fe700 1 --2- 172.21.15.81:0/741633742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f4e00 0x55fc432f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.238+0000 7f09577fe700 1 -- 172.21.15.81:0/741633742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432ef890 msgr2=0x55fc432efcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.238+0000 7f09577fe700 1 --2- 172.21.15.81:0/741633742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432ef890 0x55fc432efcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.238+0000 7f09577fe700 1 -- 172.21.15.81:0/741633742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc430c03b0 con 0x55fc432f5720 2024-05-09T00:11:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.238+0000 7f095cd1a700 1 --2- 172.21.15.81:0/741633742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432ef890 0x55fc432efcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.238+0000 7f09577fe700 1 --2- 172.21.15.81:0/741633742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f5720 0x55fc432ef350 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f094c010f70 tx=0x7f094c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c45a3384ea983ac server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.238+0000 7f093e7fc700 1 -- 172.21.15.81:0/741633742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c01e620 con 0x55fc432f5720 2024-05-09T00:11:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.238+0000 7f093e7fc700 1 -- 172.21.15.81:0/741633742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f094c015070 con 0x55fc432f5720 2024-05-09T00:11:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.238+0000 7f093e7fc700 1 -- 172.21.15.81:0/741633742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c01c970 con 0x55fc432f5720 2024-05-09T00:11:48.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.239+0000 7f096a937b80 1 -- 172.21.15.81:0/741633742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f5720 msgr2=0x55fc432ef350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.239+0000 7f096a937b80 1 --2- 172.21.15.81:0/741633742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f5720 0x55fc432ef350 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f094c010f70 tx=0x7f094c013000 comp rx=0 tx=0).stop 2024-05-09T00:11:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.239+0000 7f096a937b80 1 -- 172.21.15.81:0/741633742 shutdown_connections 2024-05-09T00:11:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.239+0000 7f096a937b80 1 --2- 172.21.15.81:0/741633742 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432ef890 0x55fc432efcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.239+0000 7f096a937b80 1 --2- 172.21.15.81:0/741633742 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f4e00 0x55fc432f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.239+0000 7f096a937b80 1 --2- 172.21.15.81:0/741633742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f5720 0x55fc432ef350 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.239+0000 7f096a937b80 1 -- 172.21.15.81:0/741633742 >> 172.21.15.81:0/741633742 conn(0x55fc4324d210 msgr2=0x55fc432e9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.239+0000 7f096a937b80 1 -- 172.21.15.81:0/741633742 shutdown_connections 2024-05-09T00:11:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.239+0000 7f096a937b80 1 -- 172.21.15.81:0/741633742 wait complete. 2024-05-09T00:11:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.239+0000 7f096a937b80 1 -- start start 2024-05-09T00:11:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.239+0000 7f096a937b80 1 Processor -- start 2024-05-09T00:11:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.239+0000 7f096a937b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432ef890 0x55fc432f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f096a937b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f4e00 0x55fc432f8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f096a937b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432f5720 0x55fc432f9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f096a937b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc431db560 con 0x55fc432f4e00 2024-05-09T00:11:48.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f096a937b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc431db200 con 0x55fc432f5720 2024-05-09T00:11:48.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f096a937b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc430c26a0 con 0x55fc432ef890 2024-05-09T00:11:48.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f096a937b80 10 client.0 _ll_register_callbacks cb 0x55fc431e4b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:48.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f09577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f4e00 0x55fc432f8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f09577fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f4e00 0x55fc432f8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37388/0 (socket says 172.21.15.81:37388) 2024-05-09T00:11:48.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f09577fe700 1 -- 172.21.15.81:0/3906300297 learned_addr learned my addr 172.21.15.81:0/3906300297 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:48.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f0957fff700 1 --2- 172.21.15.81:0/3906300297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432ef890 0x55fc432f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f095cd1a700 1 --2- 172.21.15.81:0/3906300297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432f5720 0x55fc432f9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f09577fe700 1 -- 172.21.15.81:0/3906300297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432ef890 msgr2=0x55fc432f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f09577fe700 1 --2- 172.21.15.81:0/3906300297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432ef890 0x55fc432f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f09577fe700 1 -- 172.21.15.81:0/3906300297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432f5720 msgr2=0x55fc432f9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f09577fe700 1 --2- 172.21.15.81:0/3906300297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432f5720 0x55fc432f9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f09577fe700 1 -- 172.21.15.81:0/3906300297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c010c20 con 0x55fc432f4e00 2024-05-09T00:11:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f09577fe700 1 --2- 172.21.15.81:0/3906300297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f4e00 0x55fc432f8ff0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f094c010f40 tx=0x7f094c005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90838ee91853b04 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f09377fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f09377fe700 1 -- 172.21.15.81:0/3906300297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c02d070 con 0x55fc432f4e00 2024-05-09T00:11:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f09377fe700 1 -- 172.21.15.81:0/3906300297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f094c017070 con 0x55fc432f4e00 2024-05-09T00:11:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f096a937b80 1 -- 172.21.15.81:0/3906300297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc43198270 con 0x55fc432f4e00 2024-05-09T00:11:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f09377fe700 1 -- 172.21.15.81:0/3906300297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f094c004710 con 0x55fc432f4e00 2024-05-09T00:11:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f096a937b80 10 client.18021 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.240+0000 7f096a937b80 1 -- 172.21.15.81:0/3906300297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fc4306cb60 con 0x55fc432f4e00 2024-05-09T00:11:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.241+0000 7f09377fe700 1 -- 172.21.15.81:0/3906300297 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f094c03e020 con 0x55fc432f4e00 2024-05-09T00:11:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.241+0000 7f09377fe700 1 -- 172.21.15.81:0/3906300297 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f094c01ea90 con 0x55fc432f4e00 2024-05-09T00:11:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.241+0000 7f096a937b80 10 client.18021 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.241+0000 7f096a937b80 10 client.18021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:48.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.241+0000 7f096a937b80 20 client.18021 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.241+0000 7f096a937b80 1 --2- 172.21.15.81:0/3906300297 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc43309030 0x55fc4330b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.241+0000 7f096a937b80 4 client.18021 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.241+0000 7f096a937b80 1 -- 172.21.15.81:0/3906300297 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc432be810 con 0x55fc43309030 2024-05-09T00:11:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.241+0000 7f0957fff700 1 --2- 172.21.15.81:0/3906300297 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc43309030 0x55fc4330b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.241+0000 7f09377fe700 10 client.18021 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.241+0000 7f0957fff700 1 --2- 172.21.15.81:0/3906300297 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc43309030 0x55fc4330b450 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74110839c423ce11 server_cookie=e04f76ad80b6cee0 in_seq=0 out_seq=0 2024-05-09T00:11:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f09377fe700 1 -- 172.21.15.81:0/3906300297 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fc432be810 con 0x55fc43309030 2024-05-09T00:11:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f09377fe700 10 client.18021 handle_command_reply: tid=0 2024-05-09T00:11:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f096a937b80 1 client.18021 shutdown 2024-05-09T00:11:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f096a937b80 1 -- 172.21.15.81:0/3906300297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f4e00 msgr2=0x55fc432f8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f096a937b80 1 --2- 172.21.15.81:0/3906300297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f4e00 0x55fc432f8ff0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f094c010f40 tx=0x7f094c005320 comp rx=0 tx=0).stop 2024-05-09T00:11:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f096a937b80 1 -- 172.21.15.81:0/3906300297 shutdown_connections 2024-05-09T00:11:48.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f096a937b80 1 --2- 172.21.15.81:0/3906300297 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc43309030 0x55fc4330b450 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f096a937b80 1 --2- 172.21.15.81:0/3906300297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432f5720 0x55fc432f9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f096a937b80 1 --2- 172.21.15.81:0/3906300297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432ef890 0x55fc432f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f09377fe700 0 client.18021 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f096a937b80 1 --2- 172.21.15.81:0/3906300297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f4e00 0x55fc432f8ff0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f096a937b80 1 -- 172.21.15.81:0/3906300297 >> 172.21.15.81:0/3906300297 conn(0x55fc4324d210 msgr2=0x55fc432e95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f096a937b80 1 -- 172.21.15.81:0/3906300297 shutdown_connections 2024-05-09T00:11:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f096a937b80 1 -- 172.21.15.81:0/3906300297 wait complete. 2024-05-09T00:11:48.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.242+0000 7f096a937b80 20 client.18021 trim_cache size 0 max 16384 2024-05-09T00:11:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.259+0000 7f096a937b80 1 Processor -- start 2024-05-09T00:11:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.259+0000 7f096a937b80 1 -- start start 2024-05-09T00:11:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.259+0000 7f096a937b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432ef890 0x55fc432e6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.259+0000 7f096a937b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432f4e00 0x55fc432e9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.259+0000 7f096a937b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f5720 0x55fc43300160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.259+0000 7f096a937b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc433106a0 con 0x55fc432ef890 2024-05-09T00:11:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.259+0000 7f096a937b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc432e4800 con 0x55fc432f4e00 2024-05-09T00:11:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.259+0000 7f096a937b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc432e6750 con 0x55fc432f5720 2024-05-09T00:11:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.259+0000 7f0957fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432ef890 0x55fc432e6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.259+0000 7f0957fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432ef890 0x55fc432e6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37392/0 (socket says 172.21.15.81:37392) 2024-05-09T00:11:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.259+0000 7f0957fff700 1 -- 172.21.15.81:0/3184326769 learned_addr learned my addr 172.21.15.81:0/3184326769 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:48.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.259+0000 7f095cd1a700 1 --2- 172.21.15.81:0/3184326769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f5720 0x55fc43300160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.259+0000 7f0957fff700 1 -- 172.21.15.81:0/3184326769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f5720 msgr2=0x55fc43300160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.259+0000 7f09577fe700 1 --2- 172.21.15.81:0/3184326769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432f4e00 0x55fc432e9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f0957fff700 1 --2- 172.21.15.81:0/3184326769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f5720 0x55fc43300160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f0957fff700 1 -- 172.21.15.81:0/3184326769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432f4e00 msgr2=0x55fc432e9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f0957fff700 1 --2- 172.21.15.81:0/3184326769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432f4e00 0x55fc432e9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f0957fff700 1 -- 172.21.15.81:0/3184326769 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc43205560 con 0x55fc432ef890 2024-05-09T00:11:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f095cd1a700 1 --2- 172.21.15.81:0/3184326769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f5720 0x55fc43300160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f09577fe700 1 --2- 172.21.15.81:0/3184326769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432f4e00 0x55fc432e9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:11:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f0957fff700 1 --2- 172.21.15.81:0/3184326769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432ef890 0x55fc432e6210 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f094809b460 tx=0x7f0948022c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1726e53f988e1c41 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f093effd700 1 -- 172.21.15.81:0/3184326769 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09480b7020 con 0x55fc432ef890 2024-05-09T00:11:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f093effd700 1 -- 172.21.15.81:0/3184326769 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f094809ae30 con 0x55fc432ef890 2024-05-09T00:11:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f093effd700 1 -- 172.21.15.81:0/3184326769 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09480228c0 con 0x55fc432ef890 2024-05-09T00:11:48.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f096a937b80 1 -- 172.21.15.81:0/3184326769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432ef890 msgr2=0x55fc432e6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f096a937b80 1 --2- 172.21.15.81:0/3184326769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432ef890 0x55fc432e6210 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f094809b460 tx=0x7f0948022c90 comp rx=0 tx=0).stop 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f096a937b80 1 -- 172.21.15.81:0/3184326769 shutdown_connections 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f096a937b80 1 --2- 172.21.15.81:0/3184326769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f5720 0x55fc43300160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f096a937b80 1 --2- 172.21.15.81:0/3184326769 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432ef890 0x55fc432e6210 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f096a937b80 1 --2- 172.21.15.81:0/3184326769 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432f4e00 0x55fc432e9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f096a937b80 1 -- 172.21.15.81:0/3184326769 >> 172.21.15.81:0/3184326769 conn(0x55fc4324d210 msgr2=0x55fc432f8340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f096a937b80 1 -- 172.21.15.81:0/3184326769 shutdown_connections 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.260+0000 7f096a937b80 1 -- 172.21.15.81:0/3184326769 wait complete. 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.261+0000 7f096a937b80 1 -- start start 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.261+0000 7f096a937b80 1 Processor -- start 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.261+0000 7f096a937b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432ef890 0x55fc432fc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.261+0000 7f096a937b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f4e00 0x55fc432fc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.261+0000 7f096a937b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f5720 0x55fc43358560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.261+0000 7f096a937b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc43358aa0 con 0x55fc432f5720 2024-05-09T00:11:48.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.261+0000 7f096a937b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc43358c10 con 0x55fc432ef890 2024-05-09T00:11:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.261+0000 7f096a937b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc43358dd0 con 0x55fc432f4e00 2024-05-09T00:11:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.261+0000 7f096a937b80 10 client.0 _ll_register_callbacks cb 0x55fc431e4b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.261+0000 7f095cd1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f5720 0x55fc43358560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.261+0000 7f095cd1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f5720 0x55fc43358560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37408/0 (socket says 172.21.15.81:37408) 2024-05-09T00:11:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.261+0000 7f095cd1a700 1 -- 172.21.15.81:0/3668891908 learned_addr learned my addr 172.21.15.81:0/3668891908 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.261+0000 7f0957fff700 1 --2- 172.21.15.81:0/3668891908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432ef890 0x55fc432fc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.261+0000 7f09577fe700 1 --2- 172.21.15.81:0/3668891908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f4e00 0x55fc432fc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f095cd1a700 1 -- 172.21.15.81:0/3668891908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f4e00 msgr2=0x55fc432fc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f095cd1a700 1 --2- 172.21.15.81:0/3668891908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f4e00 0x55fc432fc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f095cd1a700 1 -- 172.21.15.81:0/3668891908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432ef890 msgr2=0x55fc432fc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f095cd1a700 1 --2- 172.21.15.81:0/3668891908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432ef890 0x55fc432fc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f095cd1a700 1 -- 172.21.15.81:0/3668891908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09581a4210 con 0x55fc432f5720 2024-05-09T00:11:48.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f095cd1a700 1 --2- 172.21.15.81:0/3668891908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f5720 0x55fc43358560 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f0950007f00 tx=0x7f0950013250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7924f047eba41152 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f09377fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f09377fe700 1 -- 172.21.15.81:0/3668891908 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095000e040 con 0x55fc432f5720 2024-05-09T00:11:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f09377fe700 1 -- 172.21.15.81:0/3668891908 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f0950013b10 con 0x55fc432f5720 2024-05-09T00:11:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f096a937b80 1 -- 172.21.15.81:0/3668891908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f094c015070 con 0x55fc432f5720 2024-05-09T00:11:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f09377fe700 1 -- 172.21.15.81:0/3668891908 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0950013cd0 con 0x55fc432f5720 2024-05-09T00:11:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f096a937b80 10 client.18027 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f096a937b80 1 -- 172.21.15.81:0/3668891908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fc430c4cd0 con 0x55fc432f5720 2024-05-09T00:11:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f09377fe700 1 -- 172.21.15.81:0/3668891908 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f094c015070 con 0x55fc432f5720 2024-05-09T00:11:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f09377fe700 1 -- 172.21.15.81:0/3668891908 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f095001d020 con 0x55fc432f5720 2024-05-09T00:11:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f096a937b80 10 client.18027 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f096a937b80 10 client.18027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f096a937b80 20 client.18027 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:48.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f096a937b80 1 --2- 172.21.15.81:0/3668891908 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc43360660 0x55fc43362a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f096a937b80 4 client.18027 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:11:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.262+0000 7f096a937b80 1 -- 172.21.15.81:0/3668891908 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fc43237ec0 con 0x55fc43360660 2024-05-09T00:11:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f0957fff700 1 --2- 172.21.15.81:0/3668891908 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc43360660 0x55fc43362a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f0957fff700 1 --2- 172.21.15.81:0/3668891908 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc43360660 0x55fc43362a80 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=343db80e2f0716ee server_cookie=ea8e5b3e25dadca7 in_seq=0 out_seq=0 2024-05-09T00:11:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f09377fe700 10 client.18027 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f09377fe700 1 -- 172.21.15.81:0/3668891908 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55fc43237ec0 con 0x55fc43360660 2024-05-09T00:11:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f09377fe700 10 client.18027 handle_command_reply: tid=0 2024-05-09T00:11:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f096a937b80 1 client.18027 shutdown 2024-05-09T00:11:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f096a937b80 1 -- 172.21.15.81:0/3668891908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f5720 msgr2=0x55fc43358560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f096a937b80 1 --2- 172.21.15.81:0/3668891908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f5720 0x55fc43358560 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f0950007f00 tx=0x7f0950013250 comp rx=0 tx=0).stop 2024-05-09T00:11:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f096a937b80 1 -- 172.21.15.81:0/3668891908 shutdown_connections 2024-05-09T00:11:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f096a937b80 1 --2- 172.21.15.81:0/3668891908 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fc43360660 0x55fc43362a80 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f096a937b80 1 --2- 172.21.15.81:0/3668891908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fc432ef890 0x55fc432fc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f09377fe700 0 client.18027 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f096a937b80 1 --2- 172.21.15.81:0/3668891908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fc432f5720 0x55fc43358560 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f096a937b80 1 --2- 172.21.15.81:0/3668891908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fc432f4e00 0x55fc432fc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f096a937b80 1 -- 172.21.15.81:0/3668891908 >> 172.21.15.81:0/3668891908 conn(0x55fc4324d210 msgr2=0x55fc432f7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.263+0000 7f096a937b80 1 -- 172.21.15.81:0/3668891908 shutdown_connections 2024-05-09T00:11:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.264+0000 7f096a937b80 1 -- 172.21.15.81:0/3668891908 wait complete. 2024-05-09T00:11:48.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.264+0000 7f096a937b80 20 client.18027 trim_cache size 0 max 16384 2024-05-09T00:11:48.268 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:11:48.268 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:11:48.268 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:11:48.269 INFO:teuthology.orchestra.run.smithi081.stdout: "43a00413-580f-4f13-8fd2-498f2bd8e822": { 2024-05-09T00:11:48.269 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:11:48.269 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "43a00413-580f-4f13-8fd2-498f2bd8e822", 2024-05-09T00:11:48.269 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:11:48.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:11:48.269 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:11:48.269 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:11:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.264+0000 7f095e77d700 1 -- 172.21.15.81:0/3180667574 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f09400a1290 msgr2=0x7f09400a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.264+0000 7f095e77d700 1 --2- 172.21.15.81:0/3180667574 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f09400a1290 0x7f09400a3750 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f09581989f0 tx=0x7f094c00b410 comp rx=0 tx=0).stop 2024-05-09T00:11:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.264+0000 7f095e77d700 1 -- 172.21.15.81:0/3180667574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09580ff410 msgr2=0x7f09581974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.264+0000 7f095e77d700 1 --2- 172.21.15.81:0/3180667574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09580ff410 0x7f09581974a0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f0948005910 tx=0x7f0948004730 comp rx=0 tx=0).stop 2024-05-09T00:11:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.264+0000 7f095e77d700 1 -- 172.21.15.81:0/3180667574 shutdown_connections 2024-05-09T00:11:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.264+0000 7f095e77d700 1 --2- 172.21.15.81:0/3180667574 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f09400a1290 0x7f09400a3750 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.264+0000 7f095e77d700 1 --2- 172.21.15.81:0/3180667574 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0958105ef0 0x7f095819bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.264+0000 7f095e77d700 1 --2- 172.21.15.81:0/3180667574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f09580ff410 0x7f09581974a0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.264+0000 7f095e77d700 1 --2- 172.21.15.81:0/3180667574 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f09580ffdd0 0x7f09581979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.264+0000 7f095e77d700 1 -- 172.21.15.81:0/3180667574 >> 172.21.15.81:0/3180667574 conn(0x7f09580763a0 msgr2=0x7f09581040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.264+0000 7f095e77d700 1 -- 172.21.15.81:0/3180667574 shutdown_connections 2024-05-09T00:11:48.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:11:48.264+0000 7f095e77d700 1 -- 172.21.15.81:0/3180667574 wait complete. 2024-05-09T00:11:48.273 INFO:tasks.cephfs.filesystem:scrub status for tag:43a00413-580f-4f13-8fd2-498f2bd8e822 - {'path': '/', 'tag': '43a00413-580f-4f13-8fd2-498f2bd8e822', 'options': 'recursive,force'} 2024-05-09T00:11:49.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:48 smithi081 ceph-mon[42474]: pgmap v272: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-09T00:11:49.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:48 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:11:49.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:48 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:11:49.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:48 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:11:49.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:48 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:11:49.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:48 smithi150 ceph-mon[46187]: pgmap v272: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-09T00:11:49.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:48 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:11:49.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:48 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:11:49.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:48 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:11:49.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:48 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:11:49.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:48 smithi171 ceph-mon[47351]: pgmap v272: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-09T00:11:49.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:48 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:11:49.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:48 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:11:49.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:48 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:11:49.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:48 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:11:50.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:49 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:11:50.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:49 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:11:50.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:49 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:11:51.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:50 smithi081 ceph-mon[42474]: pgmap v273: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-09T00:11:51.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:50 smithi150 ceph-mon[46187]: pgmap v273: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-09T00:11:51.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:50 smithi171 ceph-mon[47351]: pgmap v273: 97 pgs: 97 active+clean; 3.4 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 KiB/s wr, 9 op/s 2024-05-09T00:11:53.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:52 smithi081 ceph-mon[42474]: pgmap v274: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:11:53.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:52 smithi150 ceph-mon[46187]: pgmap v274: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:11:53.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:52 smithi171 ceph-mon[47351]: pgmap v274: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:11:54.960 INFO:tasks.workunit.client.0.smithi081.stdout:375/600: open fd = 3 2024-05-09T00:11:54.960 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.960 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.960 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.960 INFO:tasks.workunit.client.0.smithi081.stdout:376/600: open fd = 3 2024-05-09T00:11:54.960 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.961 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.961 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.961 INFO:tasks.workunit.client.0.smithi081.stdout:377/600: open fd = 3 2024-05-09T00:11:54.961 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.961 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.961 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.961 INFO:tasks.workunit.client.0.smithi081.stdout:378/600: open fd = 3 2024-05-09T00:11:54.961 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.961 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.961 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.961 INFO:tasks.workunit.client.0.smithi081.stdout:379/600: open fd = 3 2024-05-09T00:11:54.961 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.961 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.961 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:380/600: open fd = 3 2024-05-09T00:11:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:381/600: open fd = 3 2024-05-09T00:11:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:382/600: open fd = 3 2024-05-09T00:11:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:383/600: open fd = 3 2024-05-09T00:11:54.962 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:384/600: open fd = 3 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:385/600: open fd = 3 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:386/600: open fd = 3 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:387/600: open fd = 3 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.963 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:388/600: open fd = 3 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:389/600: open fd = 3 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:390/600: open fd = 3 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:391/600: open fd = 3 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.964 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:392/600: open fd = 3 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:393/600: open fd = 3 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:394/600: open fd = 3 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:395/600: open fd = 3 2024-05-09T00:11:54.965 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.966 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.966 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.966 INFO:tasks.workunit.client.0.smithi081.stdout:396/600: open fd = 3 2024-05-09T00:11:54.966 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.966 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.966 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.966 INFO:tasks.workunit.client.0.smithi081.stdout:397/600: open fd = 3 2024-05-09T00:11:54.966 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.966 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.966 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.966 INFO:tasks.workunit.client.0.smithi081.stdout:398/600: open fd = 3 2024-05-09T00:11:54.966 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.966 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.966 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.967 INFO:tasks.workunit.client.0.smithi081.stdout:399/600: open fd = 3 2024-05-09T00:11:54.967 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.967 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.967 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.967 INFO:tasks.workunit.client.0.smithi081.stdout:400/600: open fd = 3 2024-05-09T00:11:54.967 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.967 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.967 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.967 INFO:tasks.workunit.client.0.smithi081.stdout:401/600: open fd = 3 2024-05-09T00:11:54.967 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.967 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.967 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.967 INFO:tasks.workunit.client.0.smithi081.stdout:402/600: open fd = 3 2024-05-09T00:11:54.967 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:403/600: open fd = 3 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:404/600: open fd = 3 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:405/600: open fd = 3 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.968 INFO:tasks.workunit.client.0.smithi081.stdout:406/600: open fd = 3 2024-05-09T00:11:54.969 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.969 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.969 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.969 INFO:tasks.workunit.client.0.smithi081.stdout:407/600: open fd = 3 2024-05-09T00:11:54.969 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.969 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.969 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.969 INFO:tasks.workunit.client.0.smithi081.stdout:408/600: open fd = 3 2024-05-09T00:11:54.969 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.969 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.969 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.969 INFO:tasks.workunit.client.0.smithi081.stdout:409/600: open fd = 3 2024-05-09T00:11:54.969 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:410/600: open fd = 3 2024-05-09T00:11:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:411/600: open fd = 3 2024-05-09T00:11:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:412/600: open fd = 3 2024-05-09T00:11:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.970 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.971 INFO:tasks.workunit.client.0.smithi081.stdout:413/600: open fd = 3 2024-05-09T00:11:54.971 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.971 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.971 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.971 INFO:tasks.workunit.client.0.smithi081.stdout:414/600: open fd = 3 2024-05-09T00:11:54.971 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.971 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.971 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.971 INFO:tasks.workunit.client.0.smithi081.stdout:415/600: open fd = 3 2024-05-09T00:11:54.971 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.971 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.971 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.971 INFO:tasks.workunit.client.0.smithi081.stdout:416/600: open fd = 3 2024-05-09T00:11:54.971 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.972 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.972 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.972 INFO:tasks.workunit.client.0.smithi081.stdout:417/600: open fd = 3 2024-05-09T00:11:54.972 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.972 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.972 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.972 INFO:tasks.workunit.client.0.smithi081.stdout:418/600: open fd = 3 2024-05-09T00:11:54.972 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.972 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.972 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.972 INFO:tasks.workunit.client.0.smithi081.stdout:419/600: open fd = 3 2024-05-09T00:11:54.972 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.972 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:420/600: open fd = 3 2024-05-09T00:11:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:421/600: open fd = 3 2024-05-09T00:11:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:422/600: open fd = 3 2024-05-09T00:11:54.973 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.974 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.974 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.974 INFO:tasks.workunit.client.0.smithi081.stdout:423/600: open fd = 3 2024-05-09T00:11:54.974 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.974 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.974 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.974 INFO:tasks.workunit.client.0.smithi081.stdout:424/600: open fd = 3 2024-05-09T00:11:54.974 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.974 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.974 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.974 INFO:tasks.workunit.client.0.smithi081.stdout:425/600: open fd = 3 2024-05-09T00:11:54.974 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.974 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:426/600: open fd = 3 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:427/600: open fd = 3 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:428/600: open fd = 3 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:429/600: open fd = 3 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.975 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.976 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.976 INFO:tasks.workunit.client.0.smithi081.stdout:430/600: open fd = 3 2024-05-09T00:11:54.976 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.976 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.976 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.976 INFO:tasks.workunit.client.0.smithi081.stdout:431/600: open fd = 3 2024-05-09T00:11:54.976 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.976 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.976 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.976 INFO:tasks.workunit.client.0.smithi081.stdout:432/600: open fd = 3 2024-05-09T00:11:54.976 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.976 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.976 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.976 INFO:tasks.workunit.client.0.smithi081.stdout:433/600: open fd = 3 2024-05-09T00:11:54.977 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.977 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.977 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.977 INFO:tasks.workunit.client.0.smithi081.stdout:434/600: open fd = 3 2024-05-09T00:11:54.977 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.977 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.977 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.977 INFO:tasks.workunit.client.0.smithi081.stdout:435/600: open fd = 3 2024-05-09T00:11:54.977 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.977 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.977 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:54.977 INFO:tasks.workunit.client.0.smithi081.stdout:436/600: open fd = 3 2024-05-09T00:11:54.977 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.977 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:11:54.978 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:11:55.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:54 smithi081 ceph-mon[42474]: pgmap v275: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:11:55.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:54 smithi150 ceph-mon[46187]: pgmap v275: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:11:55.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:54 smithi171 ceph-mon[47351]: pgmap v275: 97 pgs: 97 active+clean; 3.6 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:11:57.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:56 smithi081 ceph-mon[42474]: pgmap v276: 97 pgs: 97 active+clean; 3.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 58 KiB/s wr, 18 op/s 2024-05-09T00:11:57.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:56 smithi150 ceph-mon[46187]: pgmap v276: 97 pgs: 97 active+clean; 3.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 58 KiB/s wr, 18 op/s 2024-05-09T00:11:57.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:56 smithi171 ceph-mon[47351]: pgmap v276: 97 pgs: 97 active+clean; 3.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 58 KiB/s wr, 18 op/s 2024-05-09T00:11:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.392+0000 7fbd2fca2700 1 -- 172.21.15.81:0/445756646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd28101ac0 msgr2=0x7fbd28105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.392+0000 7fbd2fca2700 1 --2- 172.21.15.81:0/445756646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd28101ac0 0x7fbd28105b00 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fbd24009990 tx=0x7fbd24009ca0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.393+0000 7fbd2fca2700 1 -- 172.21.15.81:0/445756646 shutdown_connections 2024-05-09T00:11:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.393+0000 7fbd2fca2700 1 --2- 172.21.15.81:0/445756646 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd28101110 0x7fbd281014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.393+0000 7fbd2fca2700 1 --2- 172.21.15.81:0/445756646 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd28106230 0x7fbd2810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.393+0000 7fbd2fca2700 1 --2- 172.21.15.81:0/445756646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd28101ac0 0x7fbd28105b00 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.390 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.393+0000 7fbd2fca2700 1 -- 172.21.15.81:0/445756646 >> 172.21.15.81:0/445756646 conn(0x7fbd280fc9b0 msgr2=0x7fbd280fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.393+0000 7fbd2fca2700 1 -- 172.21.15.81:0/445756646 shutdown_connections 2024-05-09T00:11:58.391 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.393+0000 7fbd2fca2700 1 -- 172.21.15.81:0/445756646 wait complete. 2024-05-09T00:11:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.393+0000 7fbd2fca2700 1 Processor -- start 2024-05-09T00:11:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2fca2700 1 -- start start 2024-05-09T00:11:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2fca2700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd28101110 0x7fbd281973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2fca2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd28106230 0x7fbd28197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2fca2700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd2819bcd0 0x7fbd2819c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2fca2700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2819c750 con 0x7fbd28106230 2024-05-09T00:11:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2fca2700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2819c8c0 con 0x7fbd28101110 2024-05-09T00:11:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2fca2700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2819ca80 con 0x7fbd2819bcd0 2024-05-09T00:11:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2d23d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd28106230 0x7fbd28197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2d23d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd28106230 0x7fbd28197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41356/0 (socket says 172.21.15.81:41356) 2024-05-09T00:11:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2d23d700 1 -- 172.21.15.81:0/2788589519 learned_addr learned my addr 172.21.15.81:0/2788589519 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2da3e700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd28101110 0x7fbd281973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2e23f700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd2819bcd0 0x7fbd2819c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2d23d700 1 -- 172.21.15.81:0/2788589519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd2819bcd0 msgr2=0x7fbd2819c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2d23d700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd2819bcd0 0x7fbd2819c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2d23d700 1 -- 172.21.15.81:0/2788589519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd28101110 msgr2=0x7fbd281973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2d23d700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd28101110 0x7fbd281973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2d23d700 1 -- 172.21.15.81:0/2788589519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd240095f0 con 0x7fbd28106230 2024-05-09T00:11:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2da3e700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd28101110 0x7fbd281973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:11:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.394+0000 7fbd2d23d700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd28106230 0x7fbd28197930 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fbd24000c00 tx=0x7fbd24009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.395+0000 7fbd1affd700 1 -- 172.21.15.81:0/2788589519 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2401d070 con 0x7fbd28106230 2024-05-09T00:11:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.395+0000 7fbd1affd700 1 -- 172.21.15.81:0/2788589519 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd24021410 con 0x7fbd28106230 2024-05-09T00:11:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.395+0000 7fbd2fca2700 1 -- 172.21.15.81:0/2788589519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd281a3f80 con 0x7fbd28106230 2024-05-09T00:11:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.395+0000 7fbd1affd700 1 -- 172.21.15.81:0/2788589519 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24017650 con 0x7fbd28106230 2024-05-09T00:11:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.395+0000 7fbd2fca2700 1 -- 172.21.15.81:0/2788589519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd281a4340 con 0x7fbd28106230 2024-05-09T00:11:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.398+0000 7fbd3be5cb80 1 Processor -- start 2024-05-09T00:11:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.398+0000 7fbd3be5cb80 1 -- start start 2024-05-09T00:11:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd3be5cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70747950 0x556d70747d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd3be5cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70748270 0x556d70741f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd3be5cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70742480 0x556d707428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd3be5cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d706990f0 con 0x556d70747950 2024-05-09T00:11:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd3be5cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d70696ab0 con 0x556d70748270 2024-05-09T00:11:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd3be5cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d706923a0 con 0x556d70742480 2024-05-09T00:11:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd2e23f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70747950 0x556d70747d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd2e23f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70747950 0x556d70747d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41370/0 (socket says 172.21.15.81:41370) 2024-05-09T00:11:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd2e23f700 1 -- 172.21.15.81:0/288798786 learned_addr learned my addr 172.21.15.81:0/288798786 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd2da3e700 1 --2- 172.21.15.81:0/288798786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70748270 0x556d70741f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd2e23f700 1 -- 172.21.15.81:0/288798786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70742480 msgr2=0x556d707428a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-09T00:11:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd2e23f700 1 --2- 172.21.15.81:0/288798786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70742480 0x556d707428a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd2e23f700 1 -- 172.21.15.81:0/288798786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70748270 msgr2=0x556d70741f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd2e23f700 1 --2- 172.21.15.81:0/288798786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70748270 0x556d70741f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd2e23f700 1 -- 172.21.15.81:0/288798786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d70513350 con 0x556d70747950 2024-05-09T00:11:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd2e23f700 1 --2- 172.21.15.81:0/288798786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70747950 0x556d70747d30 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009440 tx=0x7fbd20009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b533ba66d9595dd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd13fff700 1 -- 172.21.15.81:0/288798786 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000e070 con 0x556d70747950 2024-05-09T00:11:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd13fff700 1 -- 172.21.15.81:0/288798786 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd2000f040 con 0x556d70747950 2024-05-09T00:11:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd13fff700 1 -- 172.21.15.81:0/288798786 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd20015b10 con 0x556d70747950 2024-05-09T00:11:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.399+0000 7fbd1affd700 1 -- 172.21.15.81:0/2788589519 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fbd240217f0 con 0x7fbd28106230 2024-05-09T00:11:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.400+0000 7fbd1affd700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbd140a1290 0x7fbd140a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.400+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/288798786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70747950 msgr2=0x556d70747d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.400+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/288798786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70747950 0x556d70747d30 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009440 tx=0x7fbd20009920 comp rx=0 tx=0).stop 2024-05-09T00:11:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.400+0000 7fbd2da3e700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbd140a1290 0x7fbd140a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.400+0000 7fbd1affd700 1 -- 172.21.15.81:0/2788589519 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fbd240ce040 con 0x7fbd28106230 2024-05-09T00:11:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.400+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/288798786 shutdown_connections 2024-05-09T00:11:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.400+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/288798786 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70742480 0x556d707428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.400+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/288798786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70747950 0x556d70747d30 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.400+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/288798786 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70748270 0x556d70741f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.400+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/288798786 >> 172.21.15.81:0/288798786 conn(0x556d706a01b0 msgr2=0x556d7073c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.400+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/288798786 shutdown_connections 2024-05-09T00:11:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.400+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/288798786 wait complete. 2024-05-09T00:11:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.401+0000 7fbd2da3e700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbd140a1290 0x7fbd140a3750 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x556d7073d790 tx=0x7fbd1c00c760 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.401+0000 7fbd3be5cb80 1 -- start start 2024-05-09T00:11:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.401+0000 7fbd3be5cb80 1 Processor -- start 2024-05-09T00:11:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.401+0000 7fbd3be5cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 0x556d7074e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.401+0000 7fbd3be5cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70747950 0x556d7074b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.401+0000 7fbd3be5cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70748270 0x556d7074bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.401+0000 7fbd3be5cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d7062e500 con 0x556d70748270 2024-05-09T00:11:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.401+0000 7fbd3be5cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d7062e1a0 con 0x556d70742480 2024-05-09T00:11:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.401+0000 7fbd3be5cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d70515640 con 0x556d70747950 2024-05-09T00:11:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.401+0000 7fbd3be5cb80 10 client.0 _ll_register_callbacks cb 0x556d70637ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.401+0000 7fbd2e23f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70748270 0x556d7074bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.401+0000 7fbd2e23f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70748270 0x556d7074bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41380/0 (socket says 172.21.15.81:41380) 2024-05-09T00:11:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.401+0000 7fbd2e23f700 1 -- 172.21.15.81:0/2601531533 learned_addr learned my addr 172.21.15.81:0/2601531533 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd2d23d700 1 --2- 172.21.15.81:0/2601531533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70747950 0x556d7074b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd2da3e700 1 --2- 172.21.15.81:0/2601531533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 0x556d7074e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd2e23f700 1 -- 172.21.15.81:0/2601531533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70747950 msgr2=0x556d7074b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd2e23f700 1 --2- 172.21.15.81:0/2601531533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70747950 0x556d7074b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd2e23f700 1 -- 172.21.15.81:0/2601531533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 msgr2=0x556d7074e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd2e23f700 1 --2- 172.21.15.81:0/2601531533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 0x556d7074e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd2e23f700 1 -- 172.21.15.81:0/2601531533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd200090f0 con 0x556d70748270 2024-05-09T00:11:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd2e23f700 1 --2- 172.21.15.81:0/2601531533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70748270 0x556d7074bbc0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fbd20014040 tx=0x7fbd20005b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ab71af26c0a4f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd117fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd117fa700 1 -- 172.21.15.81:0/2601531533 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000e040 con 0x556d70748270 2024-05-09T00:11:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd117fa700 1 -- 172.21.15.81:0/2601531533 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fbd20004ce0 con 0x556d70748270 2024-05-09T00:11:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/2601531533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556d705eb210 con 0x556d70748270 2024-05-09T00:11:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd117fa700 1 -- 172.21.15.81:0/2601531533 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd20004ea0 con 0x556d70748270 2024-05-09T00:11:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd3be5cb80 10 client.18039 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/2601531533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556d704bfb00 con 0x556d70748270 2024-05-09T00:11:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.402+0000 7fbd117fa700 1 -- 172.21.15.81:0/2601531533 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556d705eb210 con 0x556d70748270 2024-05-09T00:11:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.403+0000 7fbd117fa700 1 -- 172.21.15.81:0/2601531533 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbd2001c070 con 0x556d70748270 2024-05-09T00:11:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.403+0000 7fbd3be5cb80 10 client.18039 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.403+0000 7fbd3be5cb80 10 client.18039 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.403+0000 7fbd3be5cb80 20 client.18039 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.403+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/2601531533 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556d7075bae0 0x556d7075df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.403+0000 7fbd3be5cb80 4 client.18039 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:11:58.406 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.403+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/2601531533 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556d707117b0 con 0x556d7075bae0 2024-05-09T00:11:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.403+0000 7fbd2da3e700 1 --2- 172.21.15.81:0/2601531533 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556d7075bae0 0x556d7075df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd117fa700 10 client.18039 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd2da3e700 1 --2- 172.21.15.81:0/2601531533 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556d7075bae0 0x556d7075df00 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2da3722dd4ad3d69 server_cookie=f6788ee76ffd945f in_seq=0 out_seq=0 2024-05-09T00:11:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd117fa700 1 -- 172.21.15.81:0/2601531533 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556d707117b0 con 0x556d7075bae0 2024-05-09T00:11:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd117fa700 10 client.18039 handle_command_reply: tid=0 2024-05-09T00:11:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd3be5cb80 1 client.18039 shutdown 2024-05-09T00:11:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/2601531533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70748270 msgr2=0x556d7074bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/2601531533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70748270 0x556d7074bbc0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fbd20014040 tx=0x7fbd20005b80 comp rx=0 tx=0).stop 2024-05-09T00:11:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/2601531533 shutdown_connections 2024-05-09T00:11:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/2601531533 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556d7075bae0 0x556d7075df00 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/2601531533 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 0x556d7074e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/2601531533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70748270 0x556d7074bbc0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd117fa700 0 client.18039 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/2601531533 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70747950 0x556d7074b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/2601531533 >> 172.21.15.81:0/2601531533 conn(0x556d706a01b0 msgr2=0x556d70740f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.404+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/2601531533 shutdown_connections 2024-05-09T00:11:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.405+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/2601531533 wait complete. 2024-05-09T00:11:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.405+0000 7fbd3be5cb80 20 client.18039 trim_cache size 0 max 16384 2024-05-09T00:11:58.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.419+0000 7fbd3be5cb80 1 Processor -- start 2024-05-09T00:11:58.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.419+0000 7fbd3be5cb80 1 -- start start 2024-05-09T00:11:58.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd3be5cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 0x556d7075df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd3be5cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70747950 0x556d7073c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd3be5cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70748270 0x556d70752c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.418 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd3be5cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d7073e240 con 0x556d70747950 2024-05-09T00:11:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd3be5cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d707630d0 con 0x556d70742480 2024-05-09T00:11:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd3be5cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d7075e560 con 0x556d70748270 2024-05-09T00:11:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd2d23d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70747950 0x556d7073c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd2d23d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70747950 0x556d7073c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41390/0 (socket says 172.21.15.81:41390) 2024-05-09T00:11:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd2d23d700 1 -- 172.21.15.81:0/1892674354 learned_addr learned my addr 172.21.15.81:0/1892674354 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd2da3e700 1 --2- 172.21.15.81:0/1892674354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 0x556d7075df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd2d23d700 1 -- 172.21.15.81:0/1892674354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70748270 msgr2=0x556d70752c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd2d23d700 1 --2- 172.21.15.81:0/1892674354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70748270 0x556d70752c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd2d23d700 1 -- 172.21.15.81:0/1892674354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 msgr2=0x556d7075df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd2d23d700 1 --2- 172.21.15.81:0/1892674354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 0x556d7075df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd2d23d700 1 -- 172.21.15.81:0/1892674354 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d70658500 con 0x556d70747950 2024-05-09T00:11:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd2d23d700 1 --2- 172.21.15.81:0/1892674354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70747950 0x556d7073c910 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fbd2409afc0 tx=0x7fbd2409b160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c45527e4577e3f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd18da4700 1 -- 172.21.15.81:0/1892674354 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2409b2c0 con 0x556d70747950 2024-05-09T00:11:58.419 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd18da4700 1 -- 172.21.15.81:0/1892674354 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd2409f0f0 con 0x556d70747950 2024-05-09T00:11:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.420+0000 7fbd18da4700 1 -- 172.21.15.81:0/1892674354 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2409a7b0 con 0x556d70747950 2024-05-09T00:11:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.421+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/1892674354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70747950 msgr2=0x556d7073c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.421+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/1892674354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70747950 0x556d7073c910 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fbd2409afc0 tx=0x7fbd2409b160 comp rx=0 tx=0).stop 2024-05-09T00:11:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.421+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/1892674354 shutdown_connections 2024-05-09T00:11:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.421+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/1892674354 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 0x556d7075df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.421+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/1892674354 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70748270 0x556d70752c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.421+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/1892674354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70747950 0x556d7073c910 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.421+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/1892674354 >> 172.21.15.81:0/1892674354 conn(0x556d706a01b0 msgr2=0x556d70738e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.421+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/1892674354 shutdown_connections 2024-05-09T00:11:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.421+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/1892674354 wait complete. 2024-05-09T00:11:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.421+0000 7fbd3be5cb80 1 -- start start 2024-05-09T00:11:58.420 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.421+0000 7fbd3be5cb80 1 Processor -- start 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd3be5cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 0x556d70752e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd3be5cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70747950 0x556d70750c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd3be5cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70748270 0x556d70751160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd3be5cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d70753580 con 0x556d70748270 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd3be5cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d707516d0 con 0x556d70742480 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd3be5cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d70751890 con 0x556d70747950 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd3be5cb80 10 client.0 _ll_register_callbacks cb 0x556d70637ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd2e23f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70748270 0x556d70751160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd2e23f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70748270 0x556d70751160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41394/0 (socket says 172.21.15.81:41394) 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd2e23f700 1 -- 172.21.15.81:0/566932418 learned_addr learned my addr 172.21.15.81:0/566932418 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd2d23d700 1 --2- 172.21.15.81:0/566932418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70747950 0x556d70750c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd2da3e700 1 --2- 172.21.15.81:0/566932418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 0x556d70752e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd2e23f700 1 -- 172.21.15.81:0/566932418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70747950 msgr2=0x556d70750c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd2e23f700 1 --2- 172.21.15.81:0/566932418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70747950 0x556d70750c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.423 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd2e23f700 1 -- 172.21.15.81:0/566932418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 msgr2=0x556d70752e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd2e23f700 1 --2- 172.21.15.81:0/566932418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 0x556d70752e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd2e23f700 1 -- 172.21.15.81:0/566932418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd281a4340 con 0x556d70748270 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd2e23f700 1 --2- 172.21.15.81:0/566932418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70748270 0x556d70751160 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fbd20000f60 tx=0x7fbd20009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8bd4328c02864a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd117fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd117fa700 1 -- 172.21.15.81:0/566932418 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000e030 con 0x556d70748270 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd117fa700 1 -- 172.21.15.81:0/566932418 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fbd20005130 con 0x556d70748270 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.422+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/566932418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd2000f040 con 0x556d70748270 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.423+0000 7fbd117fa700 1 -- 172.21.15.81:0/566932418 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd20016070 con 0x556d70748270 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.423+0000 7fbd3be5cb80 10 client.18045 fetch_fsmap learned FSMap version 26 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.423+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/566932418 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556d70517c70 con 0x556d70748270 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.423+0000 7fbd117fa700 1 -- 172.21.15.81:0/566932418 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd2003b020 con 0x556d70748270 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.423+0000 7fbd117fa700 1 -- 172.21.15.81:0/566932418 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbd2001c070 con 0x556d70748270 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.423+0000 7fbd3be5cb80 10 client.18045 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.423+0000 7fbd3be5cb80 10 client.18045 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:11:58.424 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.423+0000 7fbd3be5cb80 20 client.18045 populate_metadata read hostname 'smithi081' 2024-05-09T00:11:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.423+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/566932418 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556d707b2280 0x556d707b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:11:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.423+0000 7fbd3be5cb80 4 client.18045 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:11:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.423+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/566932418 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556d7068ae60 con 0x556d707b2280 2024-05-09T00:11:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.423+0000 7fbd2da3e700 1 --2- 172.21.15.81:0/566932418 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556d707b2280 0x556d707b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:11:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.424+0000 7fbd2da3e700 1 --2- 172.21.15.81:0/566932418 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556d707b2280 0x556d707b46a0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e25870c1af4756be server_cookie=31df7b46c6afadfb in_seq=0 out_seq=0 2024-05-09T00:11:58.425 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.424+0000 7fbd117fa700 10 client.18045 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.436+0000 7fbd117fa700 1 -- 172.21.15.81:0/566932418 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556d7068ae60 con 0x556d707b2280 2024-05-09T00:11:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.436+0000 7fbd117fa700 10 client.18045 handle_command_reply: tid=0 2024-05-09T00:11:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd3be5cb80 1 client.18045 shutdown 2024-05-09T00:11:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/566932418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70748270 msgr2=0x556d70751160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/566932418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70748270 0x556d70751160 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fbd20000f60 tx=0x7fbd20009ce0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/566932418 shutdown_connections 2024-05-09T00:11:58.434 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/566932418 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556d707b2280 0x556d707b46a0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/566932418 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d70742480 0x556d70752e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/566932418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d70748270 0x556d70751160 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd117fa700 0 client.18045 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:11:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd3be5cb80 1 --2- 172.21.15.81:0/566932418 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d70747950 0x556d70750c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/566932418 >> 172.21.15.81:0/566932418 conn(0x556d706a01b0 msgr2=0x556d707464d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/566932418 shutdown_connections 2024-05-09T00:11:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd3be5cb80 1 -- 172.21.15.81:0/566932418 wait complete. 2024-05-09T00:11:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd3be5cb80 20 client.18045 trim_cache size 0 max 16384 2024-05-09T00:11:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:11:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:11:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:11:58.435 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:11:58.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd2fca2700 1 -- 172.21.15.81:0/2788589519 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbd140a1290 msgr2=0x7fbd140a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:58.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd2fca2700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbd140a1290 0x7fbd140a3750 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x556d7073d790 tx=0x7fbd1c00c760 comp rx=0 tx=0).stop 2024-05-09T00:11:58.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd2fca2700 1 -- 172.21.15.81:0/2788589519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd28106230 msgr2=0x7fbd28197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:11:58.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd2fca2700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd28106230 0x7fbd28197930 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fbd24000c00 tx=0x7fbd24009510 comp rx=0 tx=0).stop 2024-05-09T00:11:58.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd2fca2700 1 -- 172.21.15.81:0/2788589519 shutdown_connections 2024-05-09T00:11:58.436 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd2fca2700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbd140a1290 0x7fbd140a3750 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd2fca2700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbd28101110 0x7fbd281973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd2fca2700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd2819bcd0 0x7fbd2819c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.437+0000 7fbd2fca2700 1 --2- 172.21.15.81:0/2788589519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbd28106230 0x7fbd28197930 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:11:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.438+0000 7fbd2fca2700 1 -- 172.21.15.81:0/2788589519 >> 172.21.15.81:0/2788589519 conn(0x7fbd280fc9b0 msgr2=0x7fbd280fdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:11:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.438+0000 7fbd2fca2700 1 -- 172.21.15.81:0/2788589519 shutdown_connections 2024-05-09T00:11:58.437 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:11:58.438+0000 7fbd2fca2700 1 -- 172.21.15.81:0/2788589519 wait complete. 2024-05-09T00:11:59.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:11:58 smithi081 ceph-mon[42474]: pgmap v277: 97 pgs: 97 active+clean; 3.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:11:59.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:11:58 smithi150 ceph-mon[46187]: pgmap v277: 97 pgs: 97 active+clean; 3.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:11:59.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:11:58 smithi171 ceph-mon[47351]: pgmap v277: 97 pgs: 97 active+clean; 3.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:12:01.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:00 smithi081 ceph-mon[42474]: pgmap v278: 97 pgs: 97 active+clean; 3.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:12:01.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:00 smithi150 ceph-mon[46187]: pgmap v278: 97 pgs: 97 active+clean; 3.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:12:01.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:00 smithi171 ceph-mon[47351]: pgmap v278: 97 pgs: 97 active+clean; 3.8 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:12:03.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:02 smithi081 ceph-mon[42474]: pgmap v279: 97 pgs: 97 active+clean; 4.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 64 KiB/s wr, 20 op/s 2024-05-09T00:12:03.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:02 smithi150 ceph-mon[46187]: pgmap v279: 97 pgs: 97 active+clean; 4.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 64 KiB/s wr, 20 op/s 2024-05-09T00:12:03.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:02 smithi171 ceph-mon[47351]: pgmap v279: 97 pgs: 97 active+clean; 4.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 64 KiB/s wr, 20 op/s 2024-05-09T00:12:05.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:04 smithi081 ceph-mon[42474]: pgmap v280: 97 pgs: 97 active+clean; 4.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:12:05.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:04 smithi150 ceph-mon[46187]: pgmap v280: 97 pgs: 97 active+clean; 4.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:12:05.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:04 smithi171 ceph-mon[47351]: pgmap v280: 97 pgs: 97 active+clean; 4.0 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 39 KiB/s wr, 12 op/s 2024-05-09T00:12:06.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:05 smithi081 ceph-mon[42474]: osdmap e88: 12 total, 12 up, 12 in 2024-05-09T00:12:06.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:05 smithi150 ceph-mon[46187]: osdmap e88: 12 total, 12 up, 12 in 2024-05-09T00:12:06.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:05 smithi171 ceph-mon[47351]: osdmap e88: 12 total, 12 up, 12 in 2024-05-09T00:12:07.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:06 smithi081 ceph-mon[42474]: pgmap v282: 97 pgs: 97 active+clean; 4.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-05-09T00:12:07.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:06 smithi150 ceph-mon[46187]: pgmap v282: 97 pgs: 97 active+clean; 4.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-05-09T00:12:07.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:06 smithi171 ceph-mon[47351]: pgmap v282: 97 pgs: 97 active+clean; 4.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-05-09T00:12:09.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:08 smithi081 ceph-mon[42474]: pgmap v283: 97 pgs: 97 active+clean; 4.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-05-09T00:12:09.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:08 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:12:09.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:08 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:12:09.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:08 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:12:09.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:08 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:12:09.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:08 smithi150 ceph-mon[46187]: pgmap v283: 97 pgs: 97 active+clean; 4.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-05-09T00:12:09.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:08 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:12:09.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:08 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:12:09.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:08 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:12:09.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:08 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:12:09.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:08 smithi171 ceph-mon[47351]: pgmap v283: 97 pgs: 97 active+clean; 4.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-05-09T00:12:09.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:08 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:12:09.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:08 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:12:09.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:08 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:12:09.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:08 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:12:11.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:10 smithi081 ceph-mon[42474]: pgmap v284: 97 pgs: 97 active+clean; 4.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-05-09T00:12:11.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:10 smithi150 ceph-mon[46187]: pgmap v284: 97 pgs: 97 active+clean; 4.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-05-09T00:12:11.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:10 smithi171 ceph-mon[47351]: pgmap v284: 97 pgs: 97 active+clean; 4.3 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 109 KiB/s wr, 35 op/s 2024-05-09T00:12:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.554+0000 7fa9e4606700 1 -- 172.21.15.81:0/1424280716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc106240 msgr2=0x7fa9dc10de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.554+0000 7fa9e4606700 1 --2- 172.21.15.81:0/1424280716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc106240 0x7fa9dc10de10 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400b0a0 tx=0x7fa9d400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.554+0000 7fa9e4606700 1 -- 172.21.15.81:0/1424280716 shutdown_connections 2024-05-09T00:12:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.554+0000 7fa9e4606700 1 --2- 172.21.15.81:0/1424280716 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9dc0ff680 0x7fa9dc0ffa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.554+0000 7fa9e4606700 1 --2- 172.21.15.81:0/1424280716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc106240 0x7fa9dc10de10 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.554+0000 7fa9e4606700 1 --2- 172.21.15.81:0/1424280716 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9dc100030 0x7fa9dc105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.554+0000 7fa9e4606700 1 -- 172.21.15.81:0/1424280716 >> 172.21.15.81:0/1424280716 conn(0x7fa9dc0763d0 msgr2=0x7fa9dc0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.554+0000 7fa9e4606700 1 -- 172.21.15.81:0/1424280716 shutdown_connections 2024-05-09T00:12:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.554+0000 7fa9e4606700 1 -- 172.21.15.81:0/1424280716 wait complete. 2024-05-09T00:12:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.555+0000 7fa9e4606700 1 Processor -- start 2024-05-09T00:12:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.555+0000 7fa9e4606700 1 -- start start 2024-05-09T00:12:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.555+0000 7fa9e4606700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9dc0ff680 0x7fa9dc1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.555+0000 7fa9e4606700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc106240 0x7fa9dc197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.555+0000 7fa9e4606700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9dc19bda0 0x7fa9dc19c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.555+0000 7fa9e4606700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc19c820 con 0x7fa9dc106240 2024-05-09T00:12:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.555+0000 7fa9e4606700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc19c990 con 0x7fa9dc0ff680 2024-05-09T00:12:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.555+0000 7fa9e4606700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc19cb50 con 0x7fa9dc19bda0 2024-05-09T00:12:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.555+0000 7fa9e1ba1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc106240 0x7fa9dc197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.555+0000 7fa9e1ba1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc106240 0x7fa9dc197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48134/0 (socket says 172.21.15.81:48134) 2024-05-09T00:12:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.555+0000 7fa9e1ba1700 1 -- 172.21.15.81:0/43197410 learned_addr learned my addr 172.21.15.81:0/43197410 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.556+0000 7fa9e23a2700 1 --2- 172.21.15.81:0/43197410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9dc0ff680 0x7fa9dc1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.556+0000 7fa9e2ba3700 1 --2- 172.21.15.81:0/43197410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9dc19bda0 0x7fa9dc19c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.556+0000 7fa9e1ba1700 1 -- 172.21.15.81:0/43197410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9dc19bda0 msgr2=0x7fa9dc19c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.556+0000 7fa9e1ba1700 1 --2- 172.21.15.81:0/43197410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9dc19bda0 0x7fa9dc19c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.556+0000 7fa9e1ba1700 1 -- 172.21.15.81:0/43197410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9dc0ff680 msgr2=0x7fa9dc1974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.556+0000 7fa9e1ba1700 1 --2- 172.21.15.81:0/43197410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9dc0ff680 0x7fa9dc1974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.556+0000 7fa9e1ba1700 1 -- 172.21.15.81:0/43197410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4009d00 con 0x7fa9dc106240 2024-05-09T00:12:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.556+0000 7fa9e1ba1700 1 --2- 172.21.15.81:0/43197410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc106240 0x7fa9dc197a00 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800c8c0 tx=0x7fa9d800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.556+0000 7fa9d37fe700 1 -- 172.21.15.81:0/43197410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8004220 con 0x7fa9dc106240 2024-05-09T00:12:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.556+0000 7fa9d37fe700 1 -- 172.21.15.81:0/43197410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9d8004cf0 con 0x7fa9dc106240 2024-05-09T00:12:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.556+0000 7fa9e4606700 1 -- 172.21.15.81:0/43197410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc1a40b0 con 0x7fa9dc106240 2024-05-09T00:12:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.556+0000 7fa9d37fe700 1 -- 172.21.15.81:0/43197410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8003680 con 0x7fa9dc106240 2024-05-09T00:12:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.556+0000 7fa9e4606700 1 -- 172.21.15.81:0/43197410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc1a4590 con 0x7fa9dc106240 2024-05-09T00:12:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.558+0000 7fa9d37fe700 1 -- 172.21.15.81:0/43197410 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa9d8004750 con 0x7fa9dc106240 2024-05-09T00:12:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.559+0000 7fa9d37fe700 1 --2- 172.21.15.81:0/43197410 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa9c80a1290 0x7fa9c80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.559+0000 7fa9e23a2700 1 --2- 172.21.15.81:0/43197410 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa9c80a1290 0x7fa9c80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.559+0000 7fa9d37fe700 1 -- 172.21.15.81:0/43197410 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8616+0+0 (secure 0 0 0) 0x7fa9d80ccaf0 con 0x7fa9dc106240 2024-05-09T00:12:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.559+0000 7fa9e23a2700 1 --2- 172.21.15.81:0/43197410 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa9c80a1290 0x7fa9c80a3750 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc005950 tx=0x7fa9cc00b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.560+0000 7fa9f07c0b80 1 Processor -- start 2024-05-09T00:12:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.560+0000 7fa9f07c0b80 1 -- start start 2024-05-09T00:12:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.560+0000 7fa9f07c0b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b0c950 0x564058b0cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.560+0000 7fa9f07c0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0d270 0x564058b06f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.560+0000 7fa9f07c0b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b07480 0x564058b078a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.560+0000 7fa9f07c0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564058a5e0f0 con 0x564058b0d270 2024-05-09T00:12:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.560+0000 7fa9f07c0b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564058a5bab0 con 0x564058b0c950 2024-05-09T00:12:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.560+0000 7fa9f07c0b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564058a573a0 con 0x564058b07480 2024-05-09T00:12:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.560+0000 7fa9e1ba1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0d270 0x564058b06f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9e1ba1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0d270 0x564058b06f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48146/0 (socket says 172.21.15.81:48146) 2024-05-09T00:12:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9e1ba1700 1 -- 172.21.15.81:0/3835856002 learned_addr learned my addr 172.21.15.81:0/3835856002 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9e2ba3700 1 --2- 172.21.15.81:0/3835856002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b07480 0x564058b078a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9e23a2700 1 --2- 172.21.15.81:0/3835856002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b0c950 0x564058b0cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9e1ba1700 1 -- 172.21.15.81:0/3835856002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b07480 msgr2=0x564058b078a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9e1ba1700 1 --2- 172.21.15.81:0/3835856002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b07480 0x564058b078a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9e1ba1700 1 -- 172.21.15.81:0/3835856002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b0c950 msgr2=0x564058b0cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9e1ba1700 1 --2- 172.21.15.81:0/3835856002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b0c950 0x564058b0cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9e1ba1700 1 -- 172.21.15.81:0/3835856002 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640588d8350 con 0x564058b0d270 2024-05-09T00:12:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9e2ba3700 1 --2- 172.21.15.81:0/3835856002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b07480 0x564058b078a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9e23a2700 1 --2- 172.21.15.81:0/3835856002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b0c950 0x564058b0cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9e1ba1700 1 --2- 172.21.15.81:0/3835856002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0d270 0x564058b06f40 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80960a0 tx=0x7fa9d80995d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db717db60225ea31 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9d0ff9700 1 -- 172.21.15.81:0/3835856002 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80a2020 con 0x564058b0d270 2024-05-09T00:12:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9d0ff9700 1 -- 172.21.15.81:0/3835856002 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9d8097f40 con 0x564058b0d270 2024-05-09T00:12:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.561+0000 7fa9d0ff9700 1 -- 172.21.15.81:0/3835856002 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8004e60 con 0x564058b0d270 2024-05-09T00:12:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.562+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3835856002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0d270 msgr2=0x564058b06f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.562+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/3835856002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0d270 0x564058b06f40 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80960a0 tx=0x7fa9d80995d0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.562+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3835856002 shutdown_connections 2024-05-09T00:12:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.562+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/3835856002 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b0c950 0x564058b0cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.562+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/3835856002 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b07480 0x564058b078a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.562+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/3835856002 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0d270 0x564058b06f40 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.562+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3835856002 >> 172.21.15.81:0/3835856002 conn(0x564058a651b0 msgr2=0x564058b01840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.562+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3835856002 shutdown_connections 2024-05-09T00:12:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.562+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3835856002 wait complete. 2024-05-09T00:12:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.562+0000 7fa9f07c0b80 1 -- start start 2024-05-09T00:12:11.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.562+0000 7fa9f07c0b80 1 Processor -- start 2024-05-09T00:12:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9f07c0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b07480 0x564058b131e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9f07c0b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b0c950 0x564058b104d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9f07c0b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0d270 0x564058b10c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9f07c0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640589f3500 con 0x564058b07480 2024-05-09T00:12:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9f07c0b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640589f31a0 con 0x564058b0c950 2024-05-09T00:12:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9f07c0b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640588da640 con 0x564058b0d270 2024-05-09T00:12:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9f07c0b80 10 client.0 _ll_register_callbacks cb 0x5640589fcad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9e23a2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b07480 0x564058b131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9e23a2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b07480 0x564058b131e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48148/0 (socket says 172.21.15.81:48148) 2024-05-09T00:12:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9e23a2700 1 -- 172.21.15.81:0/2566837531 learned_addr learned my addr 172.21.15.81:0/2566837531 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9e2ba3700 1 --2- 172.21.15.81:0/2566837531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0d270 0x564058b10c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9e23a2700 1 -- 172.21.15.81:0/2566837531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0d270 msgr2=0x564058b10c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9e23a2700 1 --2- 172.21.15.81:0/2566837531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0d270 0x564058b10c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9e23a2700 1 -- 172.21.15.81:0/2566837531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b0c950 msgr2=0x564058b104d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9e23a2700 1 --2- 172.21.15.81:0/2566837531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b0c950 0x564058b104d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9e23a2700 1 -- 172.21.15.81:0/2566837531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc1a4590 con 0x564058b07480 2024-05-09T00:12:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9e23a2700 1 --2- 172.21.15.81:0/2566837531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b07480 0x564058b131e0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0116c0 tx=0x7fa9cc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c89a71f3051d9b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9c5ffb700 1 -- 172.21.15.81:0/2566837531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc01e830 con 0x564058b07480 2024-05-09T00:12:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9c5ffb700 1 -- 172.21.15.81:0/2566837531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8616+0+0 (secure 0 0 0) 0x7fa9cc017070 con 0x564058b07480 2024-05-09T00:12:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.563+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/2566837531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640589b0210 con 0x564058b07480 2024-05-09T00:12:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.564+0000 7fa9c5ffb700 1 -- 172.21.15.81:0/2566837531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9cc010e80 con 0x564058b07480 2024-05-09T00:12:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.564+0000 7fa9f07c0b80 10 client.18057 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.564+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/2566837531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564058884b00 con 0x564058b07480 2024-05-09T00:12:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.564+0000 7fa9c5ffb700 1 -- 172.21.15.81:0/2566837531 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9cc033080 con 0x564058b07480 2024-05-09T00:12:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.564+0000 7fa9c5ffb700 1 -- 172.21.15.81:0/2566837531 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa9cc027c10 con 0x564058b07480 2024-05-09T00:12:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.564+0000 7fa9f07c0b80 10 client.18057 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:11.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.564+0000 7fa9f07c0b80 10 client.18057 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.564+0000 7fa9f07c0b80 20 client.18057 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.564+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/2566837531 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564058b20b80 0x564058b22fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.564+0000 7fa9f07c0b80 4 client.18057 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.564+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/2566837531 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564058ad67b0 con 0x564058b20b80 2024-05-09T00:12:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.564+0000 7fa9e1ba1700 1 --2- 172.21.15.81:0/2566837531 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564058b20b80 0x564058b22fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9e1ba1700 1 --2- 172.21.15.81:0/2566837531 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564058b20b80 0x564058b22fa0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc79a8f83ca5d672 server_cookie=f36b0d5224c69b86 in_seq=0 out_seq=0 2024-05-09T00:12:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9c5ffb700 10 client.18057 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9c5ffb700 1 -- 172.21.15.81:0/2566837531 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564058ad67b0 con 0x564058b20b80 2024-05-09T00:12:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9c5ffb700 10 client.18057 handle_command_reply: tid=0 2024-05-09T00:12:11.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9f07c0b80 1 client.18057 shutdown 2024-05-09T00:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/2566837531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b07480 msgr2=0x564058b131e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/2566837531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b07480 0x564058b131e0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc0116c0 tx=0x7fa9cc0047c0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/2566837531 shutdown_connections 2024-05-09T00:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/2566837531 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564058b20b80 0x564058b22fa0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/2566837531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0d270 0x564058b10c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/2566837531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b07480 0x564058b131e0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9c5ffb700 0 client.18057 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/2566837531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b0c950 0x564058b104d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/2566837531 >> 172.21.15.81:0/2566837531 conn(0x564058a651b0 msgr2=0x564058b0b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.565+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/2566837531 shutdown_connections 2024-05-09T00:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.566+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/2566837531 wait complete. 2024-05-09T00:12:11.571 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.566+0000 7fa9f07c0b80 20 client.18057 trim_cache size 0 max 16384 2024-05-09T00:12:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.580+0000 7fa9f07c0b80 1 Processor -- start 2024-05-09T00:12:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.580+0000 7fa9f07c0b80 1 -- start start 2024-05-09T00:12:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.580+0000 7fa9f07c0b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b07480 0x564058b22f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.580+0000 7fa9f07c0b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0c950 0x564058b10470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9f07c0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0d270 0x564058b01910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9f07c0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564058b28170 con 0x564058b0d270 2024-05-09T00:12:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9f07c0b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564058b060e0 con 0x564058b07480 2024-05-09T00:12:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9f07c0b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564058b11a30 con 0x564058b0c950 2024-05-09T00:12:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9e2ba3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0d270 0x564058b01910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9e2ba3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0d270 0x564058b01910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48164/0 (socket says 172.21.15.81:48164) 2024-05-09T00:12:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9e2ba3700 1 -- 172.21.15.81:0/3363592311 learned_addr learned my addr 172.21.15.81:0/3363592311 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9e23a2700 1 --2- 172.21.15.81:0/3363592311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b07480 0x564058b22f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9e2ba3700 1 -- 172.21.15.81:0/3363592311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0c950 msgr2=0x564058b10470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9e2ba3700 1 --2- 172.21.15.81:0/3363592311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0c950 0x564058b10470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9e2ba3700 1 -- 172.21.15.81:0/3363592311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b07480 msgr2=0x564058b22f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9e2ba3700 1 --2- 172.21.15.81:0/3363592311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b07480 0x564058b22f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9e2ba3700 1 -- 172.21.15.81:0/3363592311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564058a1d500 con 0x564058b0d270 2024-05-09T00:12:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9e23a2700 1 --2- 172.21.15.81:0/3363592311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b07480 0x564058b22f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9e2ba3700 1 --2- 172.21.15.81:0/3363592311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0d270 0x564058b01910 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4007c90 tx=0x7fa9d4007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a8b8135af9a287 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9d17fa700 1 -- 172.21.15.81:0/3363592311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d400e040 con 0x564058b0d270 2024-05-09T00:12:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9d17fa700 1 -- 172.21.15.81:0/3363592311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9d40092d0 con 0x564058b0d270 2024-05-09T00:12:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.581+0000 7fa9d17fa700 1 -- 172.21.15.81:0/3363592311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4005280 con 0x564058b0d270 2024-05-09T00:12:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.582+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3363592311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0d270 msgr2=0x564058b01910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.582+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/3363592311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0d270 0x564058b01910 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4007c90 tx=0x7fa9d4007cc0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.582+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3363592311 shutdown_connections 2024-05-09T00:12:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.582+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/3363592311 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b07480 0x564058b22f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.582+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/3363592311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0d270 0x564058b01910 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.582+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/3363592311 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0c950 0x564058b10470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.582+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3363592311 >> 172.21.15.81:0/3363592311 conn(0x564058a651b0 msgr2=0x564058b0fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.582+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3363592311 shutdown_connections 2024-05-09T00:12:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.582+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3363592311 wait complete. 2024-05-09T00:12:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.582+0000 7fa9f07c0b80 1 -- start start 2024-05-09T00:12:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.582+0000 7fa9f07c0b80 1 Processor -- start 2024-05-09T00:12:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9f07c0b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b07480 0x564058b15bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9f07c0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0c950 0x564058b16100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9f07c0b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0d270 0x564058b16640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9f07c0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564058b76100 con 0x564058b0c950 2024-05-09T00:12:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9f07c0b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564058b76270 con 0x564058b07480 2024-05-09T00:12:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9f07c0b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564058b76430 con 0x564058b0d270 2024-05-09T00:12:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9f07c0b80 10 client.0 _ll_register_callbacks cb 0x5640589fcad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9e1ba1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0c950 0x564058b16100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9e1ba1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0c950 0x564058b16100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48170/0 (socket says 172.21.15.81:48170) 2024-05-09T00:12:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9e1ba1700 1 -- 172.21.15.81:0/3428788692 learned_addr learned my addr 172.21.15.81:0/3428788692 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9e1ba1700 1 -- 172.21.15.81:0/3428788692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0d270 msgr2=0x564058b16640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9e2ba3700 1 --2- 172.21.15.81:0/3428788692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0d270 0x564058b16640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9e1ba1700 1 --2- 172.21.15.81:0/3428788692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0d270 0x564058b16640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9e23a2700 1 --2- 172.21.15.81:0/3428788692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b07480 0x564058b15bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9e1ba1700 1 -- 172.21.15.81:0/3428788692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b07480 msgr2=0x564058b15bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9e1ba1700 1 --2- 172.21.15.81:0/3428788692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b07480 0x564058b15bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9e1ba1700 1 -- 172.21.15.81:0/3428788692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc10e650 con 0x564058b0c950 2024-05-09T00:12:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9e2ba3700 1 --2- 172.21.15.81:0/3428788692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0d270 0x564058b16640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9e1ba1700 1 --2- 172.21.15.81:0/3428788692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0c950 0x564058b16100 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80ca240 tx=0x7fa9d80a2120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3074a4e5b276e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9c5ffb700 1 -- 172.21.15.81:0/3428788692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8095ee0 con 0x564058b0c950 2024-05-09T00:12:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9c5ffb700 1 -- 172.21.15.81:0/3428788692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8616+0+0 (secure 0 0 0) 0x7fa9d80b9070 con 0x564058b0c950 2024-05-09T00:12:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3428788692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa9d8097f40 con 0x564058b0c950 2024-05-09T00:12:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9c5ffb700 1 -- 172.21.15.81:0/3428788692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9d80ca460 con 0x564058b0c950 2024-05-09T00:12:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9f07c0b80 10 client.18063 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.583+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3428788692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5640588dcc70 con 0x564058b0c950 2024-05-09T00:12:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.584+0000 7fa9c5ffb700 1 -- 172.21.15.81:0/3428788692 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9d807c020 con 0x564058b0c950 2024-05-09T00:12:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.584+0000 7fa9c5ffb700 1 -- 172.21.15.81:0/3428788692 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa9d8065370 con 0x564058b0c950 2024-05-09T00:12:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.584+0000 7fa9f07c0b80 10 client.18063 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.584+0000 7fa9f07c0b80 10 client.18063 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.584+0000 7fa9f07c0b80 20 client.18063 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.584+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/3428788692 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564058b77860 0x564058b79c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.584+0000 7fa9f07c0b80 4 client.18063 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:12:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.584+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3428788692 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564058a4fe60 con 0x564058b77860 2024-05-09T00:12:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.584+0000 7fa9e23a2700 1 --2- 172.21.15.81:0/3428788692 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564058b77860 0x564058b79c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.584+0000 7fa9c5ffb700 10 client.18063 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.584+0000 7fa9e23a2700 1 --2- 172.21.15.81:0/3428788692 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564058b77860 0x564058b79c80 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d470e3392cf7930 server_cookie=d42f2ee97aa87622 in_seq=0 out_seq=0 2024-05-09T00:12:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9c5ffb700 1 -- 172.21.15.81:0/3428788692 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564058a4fe60 con 0x564058b77860 2024-05-09T00:12:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9c5ffb700 10 client.18063 handle_command_reply: tid=0 2024-05-09T00:12:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9f07c0b80 1 client.18063 shutdown 2024-05-09T00:12:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3428788692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0c950 msgr2=0x564058b16100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/3428788692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0c950 0x564058b16100 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80ca240 tx=0x7fa9d80a2120 comp rx=0 tx=0).stop 2024-05-09T00:12:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3428788692 shutdown_connections 2024-05-09T00:12:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/3428788692 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564058b77860 0x564058b79c80 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/3428788692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564058b07480 0x564058b15bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/3428788692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564058b0d270 0x564058b16640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9f07c0b80 1 --2- 172.21.15.81:0/3428788692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564058b0c950 0x564058b16100 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3428788692 >> 172.21.15.81:0/3428788692 conn(0x564058a651b0 msgr2=0x564058b0edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9c5ffb700 0 client.18063 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3428788692 shutdown_connections 2024-05-09T00:12:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9f07c0b80 1 -- 172.21.15.81:0/3428788692 wait complete. 2024-05-09T00:12:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.598+0000 7fa9f07c0b80 20 client.18063 trim_cache size 0 max 16384 2024-05-09T00:12:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:12:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:12:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:12:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:12:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.599+0000 7fa9e4606700 1 -- 172.21.15.81:0/43197410 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa9c80a1290 msgr2=0x7fa9c80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.599+0000 7fa9e4606700 1 --2- 172.21.15.81:0/43197410 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa9c80a1290 0x7fa9c80a3750 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc005950 tx=0x7fa9cc00b410 comp rx=0 tx=0).stop 2024-05-09T00:12:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.599+0000 7fa9e4606700 1 -- 172.21.15.81:0/43197410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc106240 msgr2=0x7fa9dc197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.599+0000 7fa9e4606700 1 --2- 172.21.15.81:0/43197410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc106240 0x7fa9dc197a00 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800c8c0 tx=0x7fa9d800cbd0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.599+0000 7fa9e4606700 1 -- 172.21.15.81:0/43197410 shutdown_connections 2024-05-09T00:12:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.599+0000 7fa9e4606700 1 --2- 172.21.15.81:0/43197410 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa9c80a1290 0x7fa9c80a3750 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.599+0000 7fa9e4606700 1 --2- 172.21.15.81:0/43197410 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa9dc0ff680 0x7fa9dc1974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.599 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.599+0000 7fa9e4606700 1 --2- 172.21.15.81:0/43197410 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9dc19bda0 0x7fa9dc19c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.599+0000 7fa9e4606700 1 --2- 172.21.15.81:0/43197410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa9dc106240 0x7fa9dc197a00 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:11.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.599+0000 7fa9e4606700 1 -- 172.21.15.81:0/43197410 >> 172.21.15.81:0/43197410 conn(0x7fa9dc0763d0 msgr2=0x7fa9dc104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:11.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.599+0000 7fa9e4606700 1 -- 172.21.15.81:0/43197410 shutdown_connections 2024-05-09T00:12:11.600 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:11.599+0000 7fa9e4606700 1 -- 172.21.15.81:0/43197410 wait complete. 2024-05-09T00:12:13.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:12 smithi081 ceph-mon[42474]: pgmap v285: 97 pgs: 97 active+clean; 4.5 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 105 KiB/s wr, 32 op/s 2024-05-09T00:12:13.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:12 smithi081 ceph-mon[42474]: osdmap e89: 12 total, 12 up, 12 in 2024-05-09T00:12:13.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:12 smithi150 ceph-mon[46187]: pgmap v285: 97 pgs: 97 active+clean; 4.5 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 105 KiB/s wr, 32 op/s 2024-05-09T00:12:13.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:12 smithi150 ceph-mon[46187]: osdmap e89: 12 total, 12 up, 12 in 2024-05-09T00:12:13.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:12 smithi171 ceph-mon[47351]: pgmap v285: 97 pgs: 97 active+clean; 4.5 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 105 KiB/s wr, 32 op/s 2024-05-09T00:12:13.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:12 smithi171 ceph-mon[47351]: osdmap e89: 12 total, 12 up, 12 in 2024-05-09T00:12:15.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:14 smithi081 ceph-mon[42474]: pgmap v287: 97 pgs: 97 active+clean; 4.5 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 128 KiB/s wr, 39 op/s 2024-05-09T00:12:15.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:14 smithi150 ceph-mon[46187]: pgmap v287: 97 pgs: 97 active+clean; 4.5 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 128 KiB/s wr, 39 op/s 2024-05-09T00:12:15.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:14 smithi171 ceph-mon[47351]: pgmap v287: 97 pgs: 97 active+clean; 4.5 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 128 KiB/s wr, 39 op/s 2024-05-09T00:12:17.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:16 smithi081 ceph-mon[42474]: pgmap v288: 97 pgs: 97 active+clean; 4.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-05-09T00:12:17.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:16 smithi150 ceph-mon[46187]: pgmap v288: 97 pgs: 97 active+clean; 4.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-05-09T00:12:17.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:16 smithi171 ceph-mon[47351]: pgmap v288: 97 pgs: 97 active+clean; 4.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-05-09T00:12:18.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:12:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.413+0000 7fe3af8a0700 1 -- 172.21.15.81:0/2174346233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a81062a0 msgr2=0x7fe3a810de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.413+0000 7fe3af8a0700 1 --2- 172.21.15.81:0/2174346233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a81062a0 0x7fe3a810de20 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000b0a0 tx=0x7fe3a000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.413+0000 7fe3af8a0700 1 -- 172.21.15.81:0/2174346233 shutdown_connections 2024-05-09T00:12:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.413+0000 7fe3af8a0700 1 --2- 172.21.15.81:0/2174346233 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a8069400 0x7fe3a80697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.413+0000 7fe3af8a0700 1 --2- 172.21.15.81:0/2174346233 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a81062a0 0x7fe3a810de20 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.413+0000 7fe3af8a0700 1 --2- 172.21.15.81:0/2174346233 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3a8069db0 0x7fe3a8105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.413+0000 7fe3af8a0700 1 -- 172.21.15.81:0/2174346233 >> 172.21.15.81:0/2174346233 conn(0x7fe3a8076ba0 msgr2=0x7fe3a8076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.413+0000 7fe3af8a0700 1 -- 172.21.15.81:0/2174346233 shutdown_connections 2024-05-09T00:12:18.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.413+0000 7fe3af8a0700 1 -- 172.21.15.81:0/2174346233 wait complete. 2024-05-09T00:12:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.414+0000 7fe3af8a0700 1 Processor -- start 2024-05-09T00:12:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.414+0000 7fe3af8a0700 1 -- start start 2024-05-09T00:12:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.414+0000 7fe3af8a0700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a8069400 0x7fe3a81974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.414+0000 7fe3af8a0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a81062a0 0x7fe3a8197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.414+0000 7fe3af8a0700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3a819bdc0 0x7fe3a819c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.414+0000 7fe3af8a0700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a819c840 con 0x7fe3a81062a0 2024-05-09T00:12:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.414+0000 7fe3af8a0700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a819c9b0 con 0x7fe3a8069400 2024-05-09T00:12:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.414+0000 7fe3af8a0700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a819cb70 con 0x7fe3a819bdc0 2024-05-09T00:12:18.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe3ace3b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a81062a0 0x7fe3a8197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe3ace3b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a81062a0 0x7fe3a8197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57846/0 (socket says 172.21.15.81:57846) 2024-05-09T00:12:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe3ace3b700 1 -- 172.21.15.81:0/893116673 learned_addr learned my addr 172.21.15.81:0/893116673 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe3ace3b700 1 -- 172.21.15.81:0/893116673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3a819bdc0 msgr2=0x7fe3a819c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe3ace3b700 1 --2- 172.21.15.81:0/893116673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3a819bdc0 0x7fe3a819c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe3ace3b700 1 -- 172.21.15.81:0/893116673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a8069400 msgr2=0x7fe3a81974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe3ad63c700 1 --2- 172.21.15.81:0/893116673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a8069400 0x7fe3a81974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe3ace3b700 1 --2- 172.21.15.81:0/893116673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a8069400 0x7fe3a81974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe3ace3b700 1 -- 172.21.15.81:0/893116673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a0009d00 con 0x7fe3a81062a0 2024-05-09T00:12:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe3ace3b700 1 --2- 172.21.15.81:0/893116673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a81062a0 0x7fe3a8197a20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400c8f0 tx=0x7fe3a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe39a7fc700 1 -- 172.21.15.81:0/893116673 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4007b00 con 0x7fe3a81062a0 2024-05-09T00:12:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe39a7fc700 1 -- 172.21.15.81:0/893116673 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3a4007c60 con 0x7fe3a81062a0 2024-05-09T00:12:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe3af8a0700 1 -- 172.21.15.81:0/893116673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a81a40d0 con 0x7fe3a81062a0 2024-05-09T00:12:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe39a7fc700 1 -- 172.21.15.81:0/893116673 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4018660 con 0x7fe3a81062a0 2024-05-09T00:12:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.415+0000 7fe3af8a0700 1 -- 172.21.15.81:0/893116673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a81a4600 con 0x7fe3a81062a0 2024-05-09T00:12:18.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.417+0000 7fe39a7fc700 1 -- 172.21.15.81:0/893116673 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe3a400f450 con 0x7fe3a81062a0 2024-05-09T00:12:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.418+0000 7fe39a7fc700 1 --2- 172.21.15.81:0/893116673 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe3940a1310 0x7fe3940a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.418+0000 7fe3ad63c700 1 --2- 172.21.15.81:0/893116673 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe3940a1310 0x7fe3940a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.418+0000 7fe39a7fc700 1 -- 172.21.15.81:0/893116673 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe3a40ccbe0 con 0x7fe3a81062a0 2024-05-09T00:12:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.418+0000 7fe3ad63c700 1 --2- 172.21.15.81:0/893116673 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe3940a1310 0x7fe3940a37d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe39c005950 tx=0x7fe39c005cf0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3bba5ab80 1 Processor -- start 2024-05-09T00:12:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3bba5ab80 1 -- start start 2024-05-09T00:12:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3bba5ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 0x555a087ef1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3bba5ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a087e9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3bba5ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087e9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3bba5ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a08740150 con 0x555a087e9890 2024-05-09T00:12:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3bba5ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0873db10 con 0x555a087ef720 2024-05-09T00:12:18.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3bba5ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a08739400 con 0x555a087eee00 2024-05-09T00:12:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3ade3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087e9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3ade3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087e9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57862/0 (socket says 172.21.15.81:57862) 2024-05-09T00:12:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3ade3d700 1 -- 172.21.15.81:0/1213779300 learned_addr learned my addr 172.21.15.81:0/1213779300 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3ad63c700 1 --2- 172.21.15.81:0/1213779300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 0x555a087ef1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3ace3b700 1 --2- 172.21.15.81:0/1213779300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a087e9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3ade3d700 1 -- 172.21.15.81:0/1213779300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 msgr2=0x555a087ef1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3ade3d700 1 --2- 172.21.15.81:0/1213779300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 0x555a087ef1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3ade3d700 1 -- 172.21.15.81:0/1213779300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 msgr2=0x555a087e9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3ade3d700 1 --2- 172.21.15.81:0/1213779300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a087e9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3ade3d700 1 -- 172.21.15.81:0/1213779300 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a085ba3b0 con 0x555a087e9890 2024-05-09T00:12:18.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3ad63c700 1 --2- 172.21.15.81:0/1213779300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 0x555a087ef1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.419+0000 7fe3ace3b700 1 --2- 172.21.15.81:0/1213779300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a087e9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.420+0000 7fe3ade3d700 1 --2- 172.21.15.81:0/1213779300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087e9cd0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000cd60 tx=0x7fe3a000cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80838ba1767c0ee7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.420+0000 7fe3937fe700 1 -- 172.21.15.81:0/1213779300 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a000e040 con 0x555a087e9890 2024-05-09T00:12:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.420+0000 7fe3937fe700 1 -- 172.21.15.81:0/1213779300 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3a0007bb0 con 0x555a087e9890 2024-05-09T00:12:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.420+0000 7fe3937fe700 1 -- 172.21.15.81:0/1213779300 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a001d6e0 con 0x555a087e9890 2024-05-09T00:12:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.420+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1213779300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 msgr2=0x555a087e9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.420+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/1213779300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087e9cd0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fe3a000cd60 tx=0x7fe3a000cd90 comp rx=0 tx=0).stop 2024-05-09T00:12:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1213779300 shutdown_connections 2024-05-09T00:12:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/1213779300 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087e9cd0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/1213779300 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 0x555a087ef1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/1213779300 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a087e9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1213779300 >> 172.21.15.81:0/1213779300 conn(0x555a08747210 msgr2=0x555a087e3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:18.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1213779300 shutdown_connections 2024-05-09T00:12:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1213779300 wait complete. 2024-05-09T00:12:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 -- start start 2024-05-09T00:12:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 Processor -- start 2024-05-09T00:12:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 0x555a087f3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a087f3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a086d5560 con 0x555a087e9890 2024-05-09T00:12:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a086d5200 con 0x555a087ef720 2024-05-09T00:12:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a085bc6a0 con 0x555a087eee00 2024-05-09T00:12:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.421+0000 7fe3bba5ab80 10 client.0 _ll_register_callbacks cb 0x555a086deb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3ad63c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3ad63c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087f2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57866/0 (socket says 172.21.15.81:57866) 2024-05-09T00:12:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3ad63c700 1 -- 172.21.15.81:0/3304872650 learned_addr learned my addr 172.21.15.81:0/3304872650 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3ace3b700 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 0x555a087f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3ade3d700 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a087f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3ad63c700 1 -- 172.21.15.81:0/3304872650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 msgr2=0x555a087f3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3ad63c700 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 0x555a087f3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3ad63c700 1 -- 172.21.15.81:0/3304872650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 msgr2=0x555a087f3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3ad63c700 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a087f3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3ad63c700 1 -- 172.21.15.81:0/3304872650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a810e690 con 0x555a087e9890 2024-05-09T00:12:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3ace3b700 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 0x555a087f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3ade3d700 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a087f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3ad63c700 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087f2ad0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00f7f0 tx=0x7fe39c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577f903b11af4267 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe390ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe390ff9700 1 -- 172.21.15.81:0/3304872650 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c004a30 con 0x555a087e9890 2024-05-09T00:12:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe390ff9700 1 -- 172.21.15.81:0/3304872650 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe39c00fe10 con 0x555a087e9890 2024-05-09T00:12:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/3304872650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a08692270 con 0x555a087e9890 2024-05-09T00:12:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe390ff9700 1 -- 172.21.15.81:0/3304872650 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe39c004b90 con 0x555a087e9890 2024-05-09T00:12:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3bba5ab80 10 client.18075 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/3304872650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555a08566b60 con 0x555a087e9890 2024-05-09T00:12:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.422+0000 7fe390ff9700 1 -- 172.21.15.81:0/3304872650 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555a08692270 con 0x555a087e9890 2024-05-09T00:12:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.423+0000 7fe390ff9700 1 -- 172.21.15.81:0/3304872650 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe39c023030 con 0x555a087e9890 2024-05-09T00:12:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.423+0000 7fe3bba5ab80 10 client.18075 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.423+0000 7fe3bba5ab80 10 client.18075 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.423+0000 7fe3bba5ab80 20 client.18075 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.423+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555a08803160 0x555a08805580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.423+0000 7fe3bba5ab80 4 client.18075 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.423+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/3304872650 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a087b8810 con 0x555a08803160 2024-05-09T00:12:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.423+0000 7fe3ace3b700 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555a08803160 0x555a08805580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.423+0000 7fe390ff9700 10 client.18075 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.423+0000 7fe3ace3b700 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555a08803160 0x555a08805580 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c78e5c31887e10f server_cookie=ec5863538c643534 in_seq=0 out_seq=0 2024-05-09T00:12:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.424+0000 7fe390ff9700 1 -- 172.21.15.81:0/3304872650 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555a087b8810 con 0x555a08803160 2024-05-09T00:12:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.424+0000 7fe390ff9700 10 client.18075 handle_command_reply: tid=0 2024-05-09T00:12:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.424+0000 7fe3bba5ab80 1 client.18075 shutdown 2024-05-09T00:12:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.424+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/3304872650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 msgr2=0x555a087f2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.424+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087f2ad0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00f7f0 tx=0x7fe39c004750 comp rx=0 tx=0).stop 2024-05-09T00:12:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.425+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/3304872650 shutdown_connections 2024-05-09T00:12:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.425+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555a08803160 0x555a08805580 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.425+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a087f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.425+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087f2ad0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.425+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/3304872650 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 0x555a087f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.425+0000 7fe390ff9700 0 client.18075 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:18.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.425+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/3304872650 >> 172.21.15.81:0/3304872650 conn(0x555a08747210 msgr2=0x555a087e35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:18.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.425+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/3304872650 shutdown_connections 2024-05-09T00:12:18.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.425+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/3304872650 wait complete. 2024-05-09T00:12:18.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.425+0000 7fe3bba5ab80 20 client.18075 trim_cache size 0 max 16384 2024-05-09T00:12:18.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3bba5ab80 1 Processor -- start 2024-05-09T00:12:18.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3bba5ab80 1 -- start start 2024-05-09T00:12:18.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3bba5ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087e9890 0x555a087e9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3bba5ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087eee00 0x555a087e3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3bba5ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087ef720 0x555a087ee280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3bba5ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a0880a790 con 0x555a087eee00 2024-05-09T00:12:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3bba5ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a087f40a0 con 0x555a087e9890 2024-05-09T00:12:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3bba5ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a087f1020 con 0x555a087ef720 2024-05-09T00:12:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3ace3b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087eee00 0x555a087e3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3ace3b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087eee00 0x555a087e3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57876/0 (socket says 172.21.15.81:57876) 2024-05-09T00:12:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3ace3b700 1 -- 172.21.15.81:0/1013527897 learned_addr learned my addr 172.21.15.81:0/1013527897 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3ad63c700 1 --2- 172.21.15.81:0/1013527897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087e9890 0x555a087e9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3ade3d700 1 --2- 172.21.15.81:0/1013527897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087ef720 0x555a087ee280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3ace3b700 1 -- 172.21.15.81:0/1013527897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087ef720 msgr2=0x555a087ee280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3ace3b700 1 --2- 172.21.15.81:0/1013527897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087ef720 0x555a087ee280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3ace3b700 1 -- 172.21.15.81:0/1013527897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087e9890 msgr2=0x555a087e9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3ace3b700 1 --2- 172.21.15.81:0/1013527897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087e9890 0x555a087e9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.442+0000 7fe3ace3b700 1 -- 172.21.15.81:0/1013527897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a086ff560 con 0x555a087eee00 2024-05-09T00:12:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.443+0000 7fe3ace3b700 1 --2- 172.21.15.81:0/1013527897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087eee00 0x555a087e3d20 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40ca300 tx=0x7fe3a400fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0bccd71b3c3ca9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.443+0000 7fe393fff700 1 -- 172.21.15.81:0/1013527897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a409da90 con 0x555a087eee00 2024-05-09T00:12:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.443+0000 7fe393fff700 1 -- 172.21.15.81:0/1013527897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3a40a20e0 con 0x555a087eee00 2024-05-09T00:12:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.443+0000 7fe393fff700 1 -- 172.21.15.81:0/1013527897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a4099ec0 con 0x555a087eee00 2024-05-09T00:12:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.443+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1013527897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087eee00 msgr2=0x555a087e3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.443+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/1013527897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087eee00 0x555a087e3d20 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fe3a40ca300 tx=0x7fe3a400fc00 comp rx=0 tx=0).stop 2024-05-09T00:12:18.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.443+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1013527897 shutdown_connections 2024-05-09T00:12:18.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.443+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/1013527897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087e9890 0x555a087e9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.443+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/1013527897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087ef720 0x555a087ee280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.443+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/1013527897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087eee00 0x555a087e3d20 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.443+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1013527897 >> 172.21.15.81:0/1013527897 conn(0x555a08747210 msgr2=0x555a087edb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:18.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.443+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1013527897 shutdown_connections 2024-05-09T00:12:18.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.443+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1013527897 wait complete. 2024-05-09T00:12:18.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3bba5ab80 1 -- start start 2024-05-09T00:12:18.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3bba5ab80 1 Processor -- start 2024-05-09T00:12:18.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3bba5ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087f6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3bba5ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 0x555a087f6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3bba5ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a08858650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3bba5ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a08858c00 con 0x555a087e9890 2024-05-09T00:12:18.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3bba5ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a08858d70 con 0x555a087ef720 2024-05-09T00:12:18.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3bba5ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a08858f30 con 0x555a087eee00 2024-05-09T00:12:18.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3bba5ab80 10 client.0 _ll_register_callbacks cb 0x555a086deb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:18.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3ad63c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3ad63c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087f6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57890/0 (socket says 172.21.15.81:57890) 2024-05-09T00:12:18.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3ad63c700 1 -- 172.21.15.81:0/1310579709 learned_addr learned my addr 172.21.15.81:0/1310579709 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:18.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3ade3d700 1 --2- 172.21.15.81:0/1310579709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a08858650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3ad63c700 1 -- 172.21.15.81:0/1310579709 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 msgr2=0x555a087f6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:18.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3ad63c700 1 --2- 172.21.15.81:0/1310579709 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 0x555a087f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3ad63c700 1 -- 172.21.15.81:0/1310579709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 msgr2=0x555a08858650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:18.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3ad63c700 1 --2- 172.21.15.81:0/1310579709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a08858650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.444+0000 7fe3ad63c700 1 -- 172.21.15.81:0/1310579709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a81a4600 con 0x555a087e9890 2024-05-09T00:12:18.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe3ade3d700 1 --2- 172.21.15.81:0/1310579709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a08858650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:18.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe390ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:18.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe3ad63c700 1 --2- 172.21.15.81:0/1310579709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087f6310 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00f7f0 tx=0x7fe39c00d6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9a8779b7ffaacb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:18.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe390ff9700 1 -- 172.21.15.81:0/1310579709 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c005040 con 0x555a087e9890 2024-05-09T00:12:18.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe390ff9700 1 -- 172.21.15.81:0/1310579709 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe39c0051a0 con 0x555a087e9890 2024-05-09T00:12:18.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1310579709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe3a0007bb0 con 0x555a087e9890 2024-05-09T00:12:18.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe390ff9700 1 -- 172.21.15.81:0/1310579709 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe39c005360 con 0x555a087e9890 2024-05-09T00:12:18.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe3bba5ab80 10 client.18081 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:18.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1310579709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555a085becd0 con 0x555a087e9890 2024-05-09T00:12:18.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe390ff9700 1 -- 172.21.15.81:0/1310579709 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe3a0007bb0 con 0x555a087e9890 2024-05-09T00:12:18.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe390ff9700 1 -- 172.21.15.81:0/1310579709 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe39c023070 con 0x555a087e9890 2024-05-09T00:12:18.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe3bba5ab80 10 client.18081 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe3bba5ab80 10 client.18081 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe3bba5ab80 20 client.18081 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/1310579709 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555a0885a730 0x555a0885cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe3bba5ab80 4 client.18081 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:12:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.445+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1310579709 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555a08731ec0 con 0x555a0885a730 2024-05-09T00:12:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.446+0000 7fe3ace3b700 1 --2- 172.21.15.81:0/1310579709 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555a0885a730 0x555a0885cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.446+0000 7fe390ff9700 10 client.18081 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.446+0000 7fe3ace3b700 1 --2- 172.21.15.81:0/1310579709 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555a0885a730 0x555a0885cb50 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46032dbfdd558644 server_cookie=10e0727a3b75d83a in_seq=0 out_seq=0 2024-05-09T00:12:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.446+0000 7fe390ff9700 1 -- 172.21.15.81:0/1310579709 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x555a08731ec0 con 0x555a0885a730 2024-05-09T00:12:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.446+0000 7fe390ff9700 10 client.18081 handle_command_reply: tid=0 2024-05-09T00:12:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.446+0000 7fe3bba5ab80 1 client.18081 shutdown 2024-05-09T00:12:18.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.446+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1310579709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 msgr2=0x555a087f6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.446+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/1310579709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087f6310 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00f7f0 tx=0x7fe39c00d6d0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1310579709 shutdown_connections 2024-05-09T00:12:18.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/1310579709 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x555a0885a730 0x555a0885cb50 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/1310579709 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555a087ef720 0x555a08858650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe390ff9700 0 client.18081 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:18.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/1310579709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555a087e9890 0x555a087f6310 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3bba5ab80 1 --2- 172.21.15.81:0/1310579709 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555a087eee00 0x555a087f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1310579709 >> 172.21.15.81:0/1310579709 conn(0x555a08747210 msgr2=0x555a087ee400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:18.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1310579709 shutdown_connections 2024-05-09T00:12:18.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3bba5ab80 1 -- 172.21.15.81:0/1310579709 wait complete. 2024-05-09T00:12:18.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3bba5ab80 20 client.18081 trim_cache size 0 max 16384 2024-05-09T00:12:18.455 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:12:18.455 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:12:18.455 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:12:18.455 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:12:18.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3af8a0700 1 -- 172.21.15.81:0/893116673 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe3940a1310 msgr2=0x7fe3940a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3af8a0700 1 --2- 172.21.15.81:0/893116673 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe3940a1310 0x7fe3940a37d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe39c005950 tx=0x7fe39c005cf0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3af8a0700 1 -- 172.21.15.81:0/893116673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a81062a0 msgr2=0x7fe3a8197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3af8a0700 1 --2- 172.21.15.81:0/893116673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a81062a0 0x7fe3a8197a20 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fe3a400c8f0 tx=0x7fe3a400ccb0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3af8a0700 1 -- 172.21.15.81:0/893116673 shutdown_connections 2024-05-09T00:12:18.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3af8a0700 1 --2- 172.21.15.81:0/893116673 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe3940a1310 0x7fe3940a37d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3af8a0700 1 --2- 172.21.15.81:0/893116673 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe3a8069400 0x7fe3a81974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3af8a0700 1 --2- 172.21.15.81:0/893116673 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe3a819bdc0 0x7fe3a819c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3af8a0700 1 --2- 172.21.15.81:0/893116673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3a81062a0 0x7fe3a8197a20 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3af8a0700 1 -- 172.21.15.81:0/893116673 >> 172.21.15.81:0/893116673 conn(0x7fe3a8076ba0 msgr2=0x7fe3a80ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3af8a0700 1 -- 172.21.15.81:0/893116673 shutdown_connections 2024-05-09T00:12:18.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.447+0000 7fe3af8a0700 1 -- 172.21.15.81:0/893116673 wait complete. 2024-05-09T00:12:18.458 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:12:18.458 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:12:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.582+0000 7ff291ba1700 1 -- 172.21.15.81:0/3963295777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c101080 msgr2=0x7ff28c101460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.582+0000 7ff291ba1700 1 --2- 172.21.15.81:0/3963295777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c101080 0x7ff28c101460 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7ff280009990 tx=0x7ff280009ca0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.582+0000 7ff291ba1700 1 -- 172.21.15.81:0/3963295777 shutdown_connections 2024-05-09T00:12:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.582+0000 7ff291ba1700 1 --2- 172.21.15.81:0/3963295777 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff28c1061a0 0x7ff28c10dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.582+0000 7ff291ba1700 1 --2- 172.21.15.81:0/3963295777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c101080 0x7ff28c101460 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.582+0000 7ff291ba1700 1 --2- 172.21.15.81:0/3963295777 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff28c101a30 0x7ff28c105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.582+0000 7ff291ba1700 1 -- 172.21.15.81:0/3963295777 >> 172.21.15.81:0/3963295777 conn(0x7ff28c0fc940 msgr2=0x7ff28c0fed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.582+0000 7ff291ba1700 1 -- 172.21.15.81:0/3963295777 shutdown_connections 2024-05-09T00:12:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.582+0000 7ff291ba1700 1 -- 172.21.15.81:0/3963295777 wait complete. 2024-05-09T00:12:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.582+0000 7ff291ba1700 1 Processor -- start 2024-05-09T00:12:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff291ba1700 1 -- start start 2024-05-09T00:12:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff291ba1700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff28c101080 0x7ff28c197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff291ba1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c1061a0 0x7ff28c1978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff291ba1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff28c19bbf0 0x7ff28c19c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff291ba1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c19c670 con 0x7ff28c1061a0 2024-05-09T00:12:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff291ba1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c19c7e0 con 0x7ff28c19bbf0 2024-05-09T00:12:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff291ba1700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c19c9a0 con 0x7ff28c101080 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff28affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c1061a0 0x7ff28c1978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff28affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c1061a0 0x7ff28c1978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57916/0 (socket says 172.21.15.81:57916) 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff28affd700 1 -- 172.21.15.81:0/429968594 learned_addr learned my addr 172.21.15.81:0/429968594 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff28b7fe700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff28c101080 0x7ff28c197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff28bfff700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff28c19bbf0 0x7ff28c19c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff28affd700 1 -- 172.21.15.81:0/429968594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff28c101080 msgr2=0x7ff28c197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff28affd700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff28c101080 0x7ff28c197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff28affd700 1 -- 172.21.15.81:0/429968594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff28c19bbf0 msgr2=0x7ff28c19c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff28affd700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff28c19bbf0 0x7ff28c19c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff28affd700 1 -- 172.21.15.81:0/429968594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2800095f0 con 0x7ff28c1061a0 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff28bfff700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff28c19bbf0 0x7ff28c19c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff28affd700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c1061a0 0x7ff28c1978a0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00d980 tx=0x7ff27c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.583+0000 7ff288ff9700 1 -- 172.21.15.81:0/429968594 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c009b40 con 0x7ff28c1061a0 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.584+0000 7ff291ba1700 1 -- 172.21.15.81:0/429968594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c1a3f00 con 0x7ff28c1061a0 2024-05-09T00:12:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.584+0000 7ff288ff9700 1 -- 172.21.15.81:0/429968594 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff27c00de60 con 0x7ff28c1061a0 2024-05-09T00:12:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.584+0000 7ff288ff9700 1 -- 172.21.15.81:0/429968594 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c00f620 con 0x7ff28c1061a0 2024-05-09T00:12:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.584+0000 7ff291ba1700 1 -- 172.21.15.81:0/429968594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c1a4380 con 0x7ff28c1061a0 2024-05-09T00:12:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.585+0000 7ff291ba1700 1 -- 172.21.15.81:0/429968594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28c109410 con 0x7ff28c1061a0 2024-05-09T00:12:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.586+0000 7ff288ff9700 1 -- 172.21.15.81:0/429968594 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ff27c010460 con 0x7ff28c1061a0 2024-05-09T00:12:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.586+0000 7ff288ff9700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2740a1290 0x7ff2740a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.586+0000 7ff288ff9700 1 -- 172.21.15.81:0/429968594 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7ff27c0cc8a0 con 0x7ff28c1061a0 2024-05-09T00:12:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.586+0000 7ff28b7fe700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2740a1290 0x7ff2740a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.587+0000 7ff28b7fe700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2740a1290 0x7ff2740a3750 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff28000b5c0 tx=0x7ff280005fb0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.590+0000 7ff288ff9700 1 -- 172.21.15.81:0/429968594 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff27c095cc0 con 0x7ff28c1061a0 2024-05-09T00:12:18.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.834+0000 7ff291ba1700 1 -- 172.21.15.81:0/429968594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff28c102550 con 0x7ff28c1061a0 2024-05-09T00:12:18.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.834+0000 7ff288ff9700 1 -- 172.21.15.81:0/429968594 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7ff27c020090 con 0x7ff28c1061a0 2024-05-09T00:12:18.832 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:12:18.833 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:12:18.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.837+0000 7ff291ba1700 1 -- 172.21.15.81:0/429968594 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2740a1290 msgr2=0x7ff2740a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.837+0000 7ff291ba1700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2740a1290 0x7ff2740a3750 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff28000b5c0 tx=0x7ff280005fb0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.837+0000 7ff291ba1700 1 -- 172.21.15.81:0/429968594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c1061a0 msgr2=0x7ff28c1978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.837+0000 7ff291ba1700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c1061a0 0x7ff28c1978a0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00d980 tx=0x7ff27c00dd40 comp rx=0 tx=0).stop 2024-05-09T00:12:18.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.837+0000 7ff291ba1700 1 -- 172.21.15.81:0/429968594 shutdown_connections 2024-05-09T00:12:18.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.837+0000 7ff291ba1700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2740a1290 0x7ff2740a3750 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.837+0000 7ff291ba1700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff28c19bbf0 0x7ff28c19c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.837+0000 7ff291ba1700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff28c101080 0x7ff28c197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.837+0000 7ff291ba1700 1 --2- 172.21.15.81:0/429968594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff28c1061a0 0x7ff28c1978a0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.837+0000 7ff291ba1700 1 -- 172.21.15.81:0/429968594 >> 172.21.15.81:0/429968594 conn(0x7ff28c0fc940 msgr2=0x7ff28c0fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:18.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.837+0000 7ff291ba1700 1 -- 172.21.15.81:0/429968594 shutdown_connections 2024-05-09T00:12:18.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.837+0000 7ff291ba1700 1 -- 172.21.15.81:0/429968594 wait complete. 2024-05-09T00:12:18.836 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:12:18.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:12:18.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.972+0000 7fe4c9e2d700 1 -- 172.21.15.81:0/2662076851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c4106290 msgr2=0x7fe4c410de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.972+0000 7fe4c9e2d700 1 --2- 172.21.15.81:0/2662076851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c4106290 0x7fe4c410de10 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00b0d0 tx=0x7fe4bc00b3e0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.972+0000 7fe4c9e2d700 1 -- 172.21.15.81:0/2662076851 shutdown_connections 2024-05-09T00:12:18.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.972+0000 7fe4c9e2d700 1 --2- 172.21.15.81:0/2662076851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c4106290 0x7fe4c410de10 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.972+0000 7fe4c9e2d700 1 --2- 172.21.15.81:0/2662076851 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4c40694e0 0x7fe4c40698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.972+0000 7fe4c9e2d700 1 --2- 172.21.15.81:0/2662076851 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c4069e90 0x7fe4c4105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.972+0000 7fe4c9e2d700 1 -- 172.21.15.81:0/2662076851 >> 172.21.15.81:0/2662076851 conn(0x7fe4c4076f30 msgr2=0x7fe4c4077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:18.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.972+0000 7fe4c9e2d700 1 -- 172.21.15.81:0/2662076851 shutdown_connections 2024-05-09T00:12:18.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.973+0000 7fe4c9e2d700 1 -- 172.21.15.81:0/2662076851 wait complete. 2024-05-09T00:12:18.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.973+0000 7fe4c9e2d700 1 Processor -- start 2024-05-09T00:12:18.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.973+0000 7fe4c9e2d700 1 -- start start 2024-05-09T00:12:18.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c9e2d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c40694e0 0x7fe4c41974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c9e2d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4c4106290 0x7fe4c4197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c9e2d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c419bdd0 0x7fe4c419c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c9e2d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c419c850 con 0x7fe4c40694e0 2024-05-09T00:12:18.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c9e2d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c419c9c0 con 0x7fe4c419bdd0 2024-05-09T00:12:18.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c9e2d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c419cb80 con 0x7fe4c4106290 2024-05-09T00:12:18.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c40694e0 0x7fe4c41974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c40694e0 0x7fe4c41974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57930/0 (socket says 172.21.15.81:57930) 2024-05-09T00:12:18.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c37fe700 1 -- 172.21.15.81:0/2521494835 learned_addr learned my addr 172.21.15.81:0/2521494835 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:18.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c3fff700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c419bdd0 0x7fe4c419c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c2ffd700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4c4106290 0x7fe4c4197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c37fe700 1 -- 172.21.15.81:0/2521494835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4c4106290 msgr2=0x7fe4c4197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c37fe700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4c4106290 0x7fe4c4197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c37fe700 1 -- 172.21.15.81:0/2521494835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c419bdd0 msgr2=0x7fe4c419c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c37fe700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c419bdd0 0x7fe4c419c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c37fe700 1 -- 172.21.15.81:0/2521494835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc009d00 con 0x7fe4c40694e0 2024-05-09T00:12:18.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c3fff700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c419bdd0 0x7fe4c419c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:18.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c37fe700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c40694e0 0x7fe4c41974f0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400d950 tx=0x7fe4b400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:18.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.974+0000 7fe4c0ff9700 1 -- 172.21.15.81:0/2521494835 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b4009b40 con 0x7fe4c40694e0 2024-05-09T00:12:18.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.975+0000 7fe4c9e2d700 1 -- 172.21.15.81:0/2521494835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c41a40e0 con 0x7fe4c40694e0 2024-05-09T00:12:18.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.975+0000 7fe4c0ff9700 1 -- 172.21.15.81:0/2521494835 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4b4009ca0 con 0x7fe4c40694e0 2024-05-09T00:12:18.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.975+0000 7fe4c0ff9700 1 -- 172.21.15.81:0/2521494835 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b400f620 con 0x7fe4c40694e0 2024-05-09T00:12:18.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.975+0000 7fe4c9e2d700 1 -- 172.21.15.81:0/2521494835 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c41a45c0 con 0x7fe4c40694e0 2024-05-09T00:12:18.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.977+0000 7fe4c0ff9700 1 -- 172.21.15.81:0/2521494835 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe4b4010460 con 0x7fe4c40694e0 2024-05-09T00:12:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.977+0000 7fe4c0ff9700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe4ac0a1290 0x7fe4ac0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.977+0000 7fe4c2ffd700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe4ac0a1290 0x7fe4ac0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.977+0000 7fe4c0ff9700 1 -- 172.21.15.81:0/2521494835 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe4b40cd0a0 con 0x7fe4c40694e0 2024-05-09T00:12:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.977+0000 7fe4c2ffd700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe4ac0a1290 0x7fe4ac0a3750 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8005950 tx=0x7fe4b80058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4d5fe7b80 1 Processor -- start 2024-05-09T00:12:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4d5fe7b80 1 -- start start 2024-05-09T00:12:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4d5fe7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 0x564b9554a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4d5fe7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b9554a720 0x564b95544350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4d5fe7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b95544890 0x564b95544cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4d5fe7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b9549b150 con 0x564b9554a720 2024-05-09T00:12:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4d5fe7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b95498b10 con 0x564b95544890 2024-05-09T00:12:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4d5fe7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b95494400 con 0x564b95549e00 2024-05-09T00:12:18.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4c2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b9554a720 0x564b95544350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4c2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b9554a720 0x564b95544350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57944/0 (socket says 172.21.15.81:57944) 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4c2ffd700 1 -- 172.21.15.81:0/1819846371 learned_addr learned my addr 172.21.15.81:0/1819846371 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4c37fe700 1 --2- 172.21.15.81:0/1819846371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 0x564b9554a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4c2ffd700 1 -- 172.21.15.81:0/1819846371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 msgr2=0x564b9554a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4c2ffd700 1 --2- 172.21.15.81:0/1819846371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 0x564b9554a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4c2ffd700 1 -- 172.21.15.81:0/1819846371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b95544890 msgr2=0x564b95544cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4c2ffd700 1 --2- 172.21.15.81:0/1819846371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b95544890 0x564b95544cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.978+0000 7fe4c2ffd700 1 -- 172.21.15.81:0/1819846371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b953153b0 con 0x564b9554a720 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.979+0000 7fe4c2ffd700 1 --2- 172.21.15.81:0/1819846371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b9554a720 0x564b95544350 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800fc70 tx=0x7fe4b8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f138c69dcab342 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.979+0000 7fe4a9ffb700 1 -- 172.21.15.81:0/1819846371 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8011ad0 con 0x564b9554a720 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.979+0000 7fe4a9ffb700 1 -- 172.21.15.81:0/1819846371 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4b8011c30 con 0x564b9554a720 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.979+0000 7fe4a9ffb700 1 -- 172.21.15.81:0/1819846371 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b801d610 con 0x564b9554a720 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.979+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/1819846371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b9554a720 msgr2=0x564b95544350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.979+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/1819846371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b9554a720 0x564b95544350 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800fc70 tx=0x7fe4b8012000 comp rx=0 tx=0).stop 2024-05-09T00:12:18.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.979+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/1819846371 shutdown_connections 2024-05-09T00:12:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.979+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/1819846371 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b95544890 0x564b95544cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.979+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/1819846371 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 0x564b9554a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.979+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/1819846371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b9554a720 0x564b95544350 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.979+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/1819846371 >> 172.21.15.81:0/1819846371 conn(0x564b954a2210 msgr2=0x564b9553edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.979+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/1819846371 shutdown_connections 2024-05-09T00:12:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.979+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/1819846371 wait complete. 2024-05-09T00:12:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.980+0000 7fe4d5fe7b80 1 -- start start 2024-05-09T00:12:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.980+0000 7fe4d5fe7b80 1 Processor -- start 2024-05-09T00:12:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.980+0000 7fe4d5fe7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b95544890 0x564b9554db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.980+0000 7fe4d5fe7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 0x564b9554e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.980+0000 7fe4d5fe7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b9554a720 0x564b9554e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.980+0000 7fe4d5fe7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b95430560 con 0x564b9554a720 2024-05-09T00:12:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.980+0000 7fe4d5fe7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b95430200 con 0x564b95544890 2024-05-09T00:12:18.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.980+0000 7fe4d5fe7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b953176a0 con 0x564b95549e00 2024-05-09T00:12:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.980+0000 7fe4d5fe7b80 10 client.0 _ll_register_callbacks cb 0x564b95439b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.980+0000 7fe4c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b9554a720 0x564b9554e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.980+0000 7fe4c3fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b9554a720 0x564b9554e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57956/0 (socket says 172.21.15.81:57956) 2024-05-09T00:12:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.980+0000 7fe4c3fff700 1 -- 172.21.15.81:0/3278557086 learned_addr learned my addr 172.21.15.81:0/3278557086 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4c37fe700 1 --2- 172.21.15.81:0/3278557086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b95544890 0x564b9554db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4c2ffd700 1 --2- 172.21.15.81:0/3278557086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 0x564b9554e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4c3fff700 1 -- 172.21.15.81:0/3278557086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 msgr2=0x564b9554e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4c3fff700 1 --2- 172.21.15.81:0/3278557086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 0x564b9554e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4c3fff700 1 -- 172.21.15.81:0/3278557086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b95544890 msgr2=0x564b9554db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4c3fff700 1 --2- 172.21.15.81:0/3278557086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b95544890 0x564b9554db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4c3fff700 1 -- 172.21.15.81:0/3278557086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b800f950 con 0x564b9554a720 2024-05-09T00:12:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4c37fe700 1 --2- 172.21.15.81:0/3278557086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b95544890 0x564b9554db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:18.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4c3fff700 1 --2- 172.21.15.81:0/3278557086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b9554a720 0x564b9554e5f0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009a20 tx=0x7fe4bc009180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db1270e7c337edd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4a2ffd700 1 -- 172.21.15.81:0/3278557086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc00e050 con 0x564b9554a720 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4a2ffd700 1 -- 172.21.15.81:0/3278557086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe4bc004c50 con 0x564b9554a720 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/3278557086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b953ed270 con 0x564b9554a720 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4a2ffd700 1 -- 172.21.15.81:0/3278557086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4bc004e10 con 0x564b9554a720 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4d5fe7b80 10 client.18099 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/3278557086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564b952c1b60 con 0x564b9554a720 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4a2ffd700 1 -- 172.21.15.81:0/3278557086 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564b953ed270 con 0x564b9554a720 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4a2ffd700 1 -- 172.21.15.81:0/3278557086 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe4bc00b100 con 0x564b9554a720 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4d5fe7b80 10 client.18099 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4d5fe7b80 10 client.18099 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.981+0000 7fe4d5fe7b80 20 client.18099 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.982+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/3278557086 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x564b9555e240 0x564b95560660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.982+0000 7fe4d5fe7b80 4 client.18099 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:18.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.982+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/3278557086 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b95513810 con 0x564b9555e240 2024-05-09T00:12:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.982+0000 7fe4c37fe700 1 --2- 172.21.15.81:0/3278557086 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x564b9555e240 0x564b95560660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.982+0000 7fe4a2ffd700 10 client.18099 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:12:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.982+0000 7fe4c37fe700 1 --2- 172.21.15.81:0/3278557086 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x564b9555e240 0x564b95560660 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3f04f191bf0edeb server_cookie=e1f7ff53395b00ea in_seq=0 out_seq=0 2024-05-09T00:12:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4a2ffd700 1 -- 172.21.15.81:0/3278557086 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564b95513810 con 0x564b9555e240 2024-05-09T00:12:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4a2ffd700 10 client.18099 handle_command_reply: tid=0 2024-05-09T00:12:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4d5fe7b80 1 client.18099 shutdown 2024-05-09T00:12:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/3278557086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b9554a720 msgr2=0x564b9554e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/3278557086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b9554a720 0x564b9554e5f0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009a20 tx=0x7fe4bc009180 comp rx=0 tx=0).stop 2024-05-09T00:12:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/3278557086 shutdown_connections 2024-05-09T00:12:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/3278557086 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x564b9555e240 0x564b95560660 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/3278557086 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b95544890 0x564b9554db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/3278557086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b9554a720 0x564b9554e5f0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/3278557086 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 0x564b9554e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:18.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4a2ffd700 0 client.18099 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:12:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/3278557086 >> 172.21.15.81:0/3278557086 conn(0x564b954a2210 msgr2=0x564b9553e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/3278557086 shutdown_connections 2024-05-09T00:12:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/3278557086 wait complete. 2024-05-09T00:12:18.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.983+0000 7fe4d5fe7b80 20 client.18099 trim_cache size 0 max 16384 2024-05-09T00:12:19.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.996+0000 7fe4d5fe7b80 1 Processor -- start 2024-05-09T00:12:19.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.996+0000 7fe4d5fe7b80 1 -- start start 2024-05-09T00:12:19.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.996+0000 7fe4d5fe7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b95544890 0x564b95559c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.996+0000 7fe4d5fe7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b95549e00 0x564b9553ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.996+0000 7fe4d5fe7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b9554a720 0x564b9554e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.996+0000 7fe4d5fe7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b9555ad70 con 0x564b95549e00 2024-05-09T00:12:19.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.996+0000 7fe4d5fe7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b9554f120 con 0x564b95544890 2024-05-09T00:12:19.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.996+0000 7fe4d5fe7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b9553bdf0 con 0x564b9554a720 2024-05-09T00:12:19.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.997+0000 7fe4c2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b95549e00 0x564b9553ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.997+0000 7fe4c2ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b95549e00 0x564b9553ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57970/0 (socket says 172.21.15.81:57970) 2024-05-09T00:12:19.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.997+0000 7fe4c2ffd700 1 -- 172.21.15.81:0/75211965 learned_addr learned my addr 172.21.15.81:0/75211965 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:19.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.997+0000 7fe4c2ffd700 1 -- 172.21.15.81:0/75211965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b9554a720 msgr2=0x564b9554e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.997+0000 7fe4c2ffd700 1 --2- 172.21.15.81:0/75211965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b9554a720 0x564b9554e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.997+0000 7fe4c2ffd700 1 -- 172.21.15.81:0/75211965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b95544890 msgr2=0x564b95559c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.997+0000 7fe4c2ffd700 1 --2- 172.21.15.81:0/75211965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b95544890 0x564b95559c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.997+0000 7fe4c2ffd700 1 -- 172.21.15.81:0/75211965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b9545a560 con 0x564b95549e00 2024-05-09T00:12:19.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.997+0000 7fe4c2ffd700 1 --2- 172.21.15.81:0/75211965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b95549e00 0x564b9553ed20 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800fc40 tx=0x7fe4b800b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ad68d4a0c8c8a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:19.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.997+0000 7fe4aa7fc700 1 -- 172.21.15.81:0/75211965 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b802e070 con 0x564b95549e00 2024-05-09T00:12:19.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.997+0000 7fe4aa7fc700 1 -- 172.21.15.81:0/75211965 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4b8011da0 con 0x564b95549e00 2024-05-09T00:12:19.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.997+0000 7fe4aa7fc700 1 -- 172.21.15.81:0/75211965 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80276b0 con 0x564b95549e00 2024-05-09T00:12:19.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/75211965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b95549e00 msgr2=0x564b9553ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/75211965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b95549e00 0x564b9553ed20 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800fc40 tx=0x7fe4b800b9c0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/75211965 shutdown_connections 2024-05-09T00:12:19.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/75211965 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b95544890 0x564b95559c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/75211965 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b9554a720 0x564b9554e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/75211965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b95549e00 0x564b9553ed20 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/75211965 >> 172.21.15.81:0/75211965 conn(0x564b954a2210 msgr2=0x564b9554c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/75211965 shutdown_connections 2024-05-09T00:12:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/75211965 wait complete. 2024-05-09T00:12:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 -- start start 2024-05-09T00:12:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 Processor -- start 2024-05-09T00:12:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b95544890 0x564b95553150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 0x564b95553690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b9554a720 0x564b95553bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b955b38b0 con 0x564b95544890 2024-05-09T00:12:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b955b3a20 con 0x564b9554a720 2024-05-09T00:12:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b955b3be0 con 0x564b95549e00 2024-05-09T00:12:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.998+0000 7fe4d5fe7b80 10 client.0 _ll_register_callbacks cb 0x564b95439b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b95544890 0x564b95553150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4c37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b95544890 0x564b95553150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57980/0 (socket says 172.21.15.81:57980) 2024-05-09T00:12:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4c37fe700 1 -- 172.21.15.81:0/2628256648 learned_addr learned my addr 172.21.15.81:0/2628256648 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4c2ffd700 1 --2- 172.21.15.81:0/2628256648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 0x564b95553690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4c3fff700 1 --2- 172.21.15.81:0/2628256648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b9554a720 0x564b95553bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4c37fe700 1 -- 172.21.15.81:0/2628256648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 msgr2=0x564b95553690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4c37fe700 1 --2- 172.21.15.81:0/2628256648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 0x564b95553690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4c37fe700 1 -- 172.21.15.81:0/2628256648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b9554a720 msgr2=0x564b95553bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4c37fe700 1 --2- 172.21.15.81:0/2628256648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b9554a720 0x564b95553bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4c37fe700 1 -- 172.21.15.81:0/2628256648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b953153b0 con 0x564b95544890 2024-05-09T00:12:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4c3fff700 1 --2- 172.21.15.81:0/2628256648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b9554a720 0x564b95553bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4c37fe700 1 --2- 172.21.15.81:0/2628256648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b95544890 0x564b95553150 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4096680 tx=0x7fe4b400def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b2622cdbce1d42 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4a2ffd700 1 -- 172.21.15.81:0/2628256648 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b40a2600 con 0x564b95544890 2024-05-09T00:12:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4a2ffd700 1 -- 172.21.15.81:0/2628256648 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe4b409c040 con 0x564b95544890 2024-05-09T00:12:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/2628256648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe4b8011c30 con 0x564b95544890 2024-05-09T00:12:19.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4a2ffd700 1 -- 172.21.15.81:0/2628256648 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4b4096890 con 0x564b95544890 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4d5fe7b80 10 client.18105 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/2628256648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564b95319cd0 con 0x564b95544890 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:18.999+0000 7fe4a2ffd700 1 -- 172.21.15.81:0/2628256648 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4b8011c30 con 0x564b95544890 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.000+0000 7fe4a2ffd700 1 -- 172.21.15.81:0/2628256648 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe4b4099670 con 0x564b95544890 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.000+0000 7fe4d5fe7b80 10 client.18105 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.000+0000 7fe4d5fe7b80 10 client.18105 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.000+0000 7fe4d5fe7b80 20 client.18105 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.000+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/2628256648 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x564b955b5250 0x564b955b7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.000+0000 7fe4d5fe7b80 4 client.18105 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.000+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/2628256648 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564b9548cec0 con 0x564b955b5250 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.000+0000 7fe4c2ffd700 1 --2- 172.21.15.81:0/2628256648 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x564b955b5250 0x564b955b7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.000+0000 7fe4c2ffd700 1 --2- 172.21.15.81:0/2628256648 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x564b955b5250 0x564b955b7640 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1a29c9f2726bd416 server_cookie=dc8a93b2a9a6bd8 in_seq=0 out_seq=0 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.000+0000 7fe4a2ffd700 10 client.18105 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4a2ffd700 1 -- 172.21.15.81:0/2628256648 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564b9548cec0 con 0x564b955b5250 2024-05-09T00:12:19.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4a2ffd700 10 client.18105 handle_command_reply: tid=0 2024-05-09T00:12:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4d5fe7b80 1 client.18105 shutdown 2024-05-09T00:12:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/2628256648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b95544890 msgr2=0x564b95553150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/2628256648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b95544890 0x564b95553150 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4096680 tx=0x7fe4b400def0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/2628256648 shutdown_connections 2024-05-09T00:12:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/2628256648 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x564b955b5250 0x564b955b7640 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/2628256648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564b9554a720 0x564b95553bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4a2ffd700 0 client.18105 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:12:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/2628256648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564b95544890 0x564b95553150 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4d5fe7b80 1 --2- 172.21.15.81:0/2628256648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564b95549e00 0x564b95553690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/2628256648 >> 172.21.15.81:0/2628256648 conn(0x564b954a2210 msgr2=0x564b9554c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/2628256648 shutdown_connections 2024-05-09T00:12:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4d5fe7b80 1 -- 172.21.15.81:0/2628256648 wait complete. 2024-05-09T00:12:19.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4d5fe7b80 20 client.18105 trim_cache size 0 max 16384 2024-05-09T00:12:19.007 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:12:19.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.001+0000 7fe4c9e2d700 1 -- 172.21.15.81:0/2521494835 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe4ac0a1290 msgr2=0x7fe4ac0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.002+0000 7fe4c9e2d700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe4ac0a1290 0x7fe4ac0a3750 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8005950 tx=0x7fe4b80058e0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.002+0000 7fe4c9e2d700 1 -- 172.21.15.81:0/2521494835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c40694e0 msgr2=0x7fe4c41974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.002+0000 7fe4c9e2d700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c40694e0 0x7fe4c41974f0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fe4b400d950 tx=0x7fe4b400dd10 comp rx=0 tx=0).stop 2024-05-09T00:12:19.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.002+0000 7fe4c9e2d700 1 -- 172.21.15.81:0/2521494835 shutdown_connections 2024-05-09T00:12:19.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.002+0000 7fe4c9e2d700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe4ac0a1290 0x7fe4ac0a3750 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.002+0000 7fe4c9e2d700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe4c419bdd0 0x7fe4c419c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.002+0000 7fe4c9e2d700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c40694e0 0x7fe4c41974f0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.002+0000 7fe4c9e2d700 1 --2- 172.21.15.81:0/2521494835 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe4c4106290 0x7fe4c4197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.002+0000 7fe4c9e2d700 1 -- 172.21.15.81:0/2521494835 >> 172.21.15.81:0/2521494835 conn(0x7fe4c4076f30 msgr2=0x7fe4c40fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.002+0000 7fe4c9e2d700 1 -- 172.21.15.81:0/2521494835 shutdown_connections 2024-05-09T00:12:19.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.002+0000 7fe4c9e2d700 1 -- 172.21.15.81:0/2521494835 wait complete. 2024-05-09T00:12:19.012 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:12:19.122 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:18 smithi081 ceph-mon[42474]: pgmap v289: 97 pgs: 97 active+clean; 4.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-05-09T00:12:19.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:18 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/429968594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:12:19.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.137+0000 7faf904f3700 1 -- 172.21.15.81:0/2679114430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf88105160 msgr2=0x7faf8810cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.137+0000 7faf904f3700 1 --2- 172.21.15.81:0/2679114430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf88105160 0x7faf8810cce0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7faf8000b0a0 tx=0x7faf8000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.137+0000 7faf904f3700 1 -- 172.21.15.81:0/2679114430 shutdown_connections 2024-05-09T00:12:19.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.137+0000 7faf904f3700 1 --2- 172.21.15.81:0/2679114430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf88105160 0x7faf8810cce0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.137+0000 7faf904f3700 1 --2- 172.21.15.81:0/2679114430 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf88100060 0x7faf88100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.137+0000 7faf904f3700 1 --2- 172.21.15.81:0/2679114430 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf88100a10 0x7faf88104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.137+0000 7faf904f3700 1 -- 172.21.15.81:0/2679114430 >> 172.21.15.81:0/2679114430 conn(0x7faf88076f40 msgr2=0x7faf88077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.137+0000 7faf904f3700 1 -- 172.21.15.81:0/2679114430 shutdown_connections 2024-05-09T00:12:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.137+0000 7faf904f3700 1 -- 172.21.15.81:0/2679114430 wait complete. 2024-05-09T00:12:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.137+0000 7faf904f3700 1 Processor -- start 2024-05-09T00:12:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf904f3700 1 -- start start 2024-05-09T00:12:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf904f3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf88100060 0x7faf88196340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf904f3700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf88105160 0x7faf88196880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf904f3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8819ac20 0x7faf8819b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf904f3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8819b6a0 con 0x7faf88100060 2024-05-09T00:12:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf904f3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8819b810 con 0x7faf8819ac20 2024-05-09T00:12:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf904f3700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8819b9d0 con 0x7faf88105160 2024-05-09T00:12:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf8e28f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf88100060 0x7faf88196340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf8e28f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf88100060 0x7faf88196340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58010/0 (socket says 172.21.15.81:58010) 2024-05-09T00:12:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf8e28f700 1 -- 172.21.15.81:0/3219160209 learned_addr learned my addr 172.21.15.81:0/3219160209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf8da8e700 1 --2- 172.21.15.81:0/3219160209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf88105160 0x7faf88196880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf8e28f700 1 -- 172.21.15.81:0/3219160209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf88105160 msgr2=0x7faf88196880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf8e28f700 1 --2- 172.21.15.81:0/3219160209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf88105160 0x7faf88196880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf8e28f700 1 -- 172.21.15.81:0/3219160209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8819ac20 msgr2=0x7faf8819b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf8e28f700 1 --2- 172.21.15.81:0/3219160209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8819ac20 0x7faf8819b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf8e28f700 1 -- 172.21.15.81:0/3219160209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf80009d00 con 0x7faf88100060 2024-05-09T00:12:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf8da8e700 1 --2- 172.21.15.81:0/3219160209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf88105160 0x7faf88196880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:19.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf8e28f700 1 --2- 172.21.15.81:0/3219160209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf88100060 0x7faf88196340 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7faf7800c9b0 tx=0x7faf7800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:19.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.138+0000 7faf7f7fe700 1 -- 172.21.15.81:0/3219160209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78007b00 con 0x7faf88100060 2024-05-09T00:12:19.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.139+0000 7faf7f7fe700 1 -- 172.21.15.81:0/3219160209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf78007c60 con 0x7faf88100060 2024-05-09T00:12:19.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.139+0000 7faf7f7fe700 1 -- 172.21.15.81:0/3219160209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78018660 con 0x7faf88100060 2024-05-09T00:12:19.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.139+0000 7faf904f3700 1 -- 172.21.15.81:0/3219160209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf881a2f30 con 0x7faf88100060 2024-05-09T00:12:19.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.139+0000 7faf904f3700 1 -- 172.21.15.81:0/3219160209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf881a33b0 con 0x7faf88100060 2024-05-09T00:12:19.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.141+0000 7faf7f7fe700 1 -- 172.21.15.81:0/3219160209 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7faf78018880 con 0x7faf88100060 2024-05-09T00:12:19.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.141+0000 7faf7f7fe700 1 --2- 172.21.15.81:0/3219160209 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf740a1310 0x7faf740a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.141+0000 7faf7f7fe700 1 -- 172.21.15.81:0/3219160209 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7faf780ccd30 con 0x7faf88100060 2024-05-09T00:12:19.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.141+0000 7faf8da8e700 1 --2- 172.21.15.81:0/3219160209 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf740a1310 0x7faf740a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.142+0000 7faf8da8e700 1 --2- 172.21.15.81:0/3219160209 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf740a1310 0x7faf740a37d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf84005e90 tx=0x7faf84005d20 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:19.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.142+0000 7faf9c6adb80 1 Processor -- start 2024-05-09T00:12:19.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.142+0000 7faf9c6adb80 1 -- start start 2024-05-09T00:12:19.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.142+0000 7faf9c6adb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef19e00 0x55b07ef1a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.142+0000 7faf9c6adb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef1a720 0x55b07ef14350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.142+0000 7faf9c6adb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef14890 0x55b07ef14cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.142+0000 7faf9c6adb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07ee6b150 con 0x55b07ef19e00 2024-05-09T00:12:19.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.142+0000 7faf9c6adb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07ee68b10 con 0x55b07ef1a720 2024-05-09T00:12:19.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.142+0000 7faf9c6adb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07ee64400 con 0x55b07ef14890 2024-05-09T00:12:19.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.143+0000 7faf8e28f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef19e00 0x55b07ef1a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.143+0000 7faf8e28f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef19e00 0x55b07ef1a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58020/0 (socket says 172.21.15.81:58020) 2024-05-09T00:12:19.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.143+0000 7faf8e28f700 1 -- 172.21.15.81:0/4210742152 learned_addr learned my addr 172.21.15.81:0/4210742152 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:19.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.143+0000 7faf8ea90700 1 --2- 172.21.15.81:0/4210742152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef14890 0x55b07ef14cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.143+0000 7faf8da8e700 1 --2- 172.21.15.81:0/4210742152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef1a720 0x55b07ef14350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.143+0000 7faf8e28f700 1 -- 172.21.15.81:0/4210742152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef14890 msgr2=0x55b07ef14cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.143+0000 7faf8e28f700 1 --2- 172.21.15.81:0/4210742152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef14890 0x55b07ef14cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.143+0000 7faf8e28f700 1 -- 172.21.15.81:0/4210742152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef1a720 msgr2=0x55b07ef14350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.143+0000 7faf8e28f700 1 --2- 172.21.15.81:0/4210742152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef1a720 0x55b07ef14350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.143+0000 7faf8e28f700 1 -- 172.21.15.81:0/4210742152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b07ece53b0 con 0x55b07ef19e00 2024-05-09T00:12:19.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.143+0000 7faf8e28f700 1 --2- 172.21.15.81:0/4210742152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef19e00 0x55b07ef1a1e0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7faf78099da0 tx=0x7faf7809a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f471537c267e62b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:19.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.143+0000 7faf7cff9700 1 -- 172.21.15.81:0/4210742152 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf780a2290 con 0x55b07ef19e00 2024-05-09T00:12:19.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.143+0000 7faf7cff9700 1 -- 172.21.15.81:0/4210742152 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf78096520 con 0x55b07ef19e00 2024-05-09T00:12:19.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.143+0000 7faf7cff9700 1 -- 172.21.15.81:0/4210742152 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78099560 con 0x55b07ef19e00 2024-05-09T00:12:19.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.144+0000 7faf9c6adb80 1 -- 172.21.15.81:0/4210742152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef19e00 msgr2=0x55b07ef1a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.144+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/4210742152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef19e00 0x55b07ef1a1e0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7faf78099da0 tx=0x7faf7809a510 comp rx=0 tx=0).stop 2024-05-09T00:12:19.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.144+0000 7faf9c6adb80 1 -- 172.21.15.81:0/4210742152 shutdown_connections 2024-05-09T00:12:19.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.144+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/4210742152 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef14890 0x55b07ef14cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.144+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/4210742152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef19e00 0x55b07ef1a1e0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.144+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/4210742152 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef1a720 0x55b07ef14350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.144+0000 7faf9c6adb80 1 -- 172.21.15.81:0/4210742152 >> 172.21.15.81:0/4210742152 conn(0x55b07ee72210 msgr2=0x55b07ef0edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.144+0000 7faf9c6adb80 1 -- 172.21.15.81:0/4210742152 shutdown_connections 2024-05-09T00:12:19.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.144+0000 7faf9c6adb80 1 -- 172.21.15.81:0/4210742152 wait complete. 2024-05-09T00:12:19.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.144+0000 7faf9c6adb80 1 -- start start 2024-05-09T00:12:19.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.144+0000 7faf9c6adb80 1 Processor -- start 2024-05-09T00:12:19.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.144+0000 7faf9c6adb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef14890 0x55b07ef1db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf9c6adb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef19e00 0x55b07ef1e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf9c6adb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef1a720 0x55b07ef1e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf9c6adb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07ee00560 con 0x55b07ef1a720 2024-05-09T00:12:19.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf9c6adb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07ee00200 con 0x55b07ef19e00 2024-05-09T00:12:19.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf9c6adb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07ece76a0 con 0x55b07ef14890 2024-05-09T00:12:19.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf9c6adb80 10 client.0 _ll_register_callbacks cb 0x55b07ee09b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:19.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf8ea90700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef1a720 0x55b07ef1e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf8ea90700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef1a720 0x55b07ef1e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58036/0 (socket says 172.21.15.81:58036) 2024-05-09T00:12:19.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf8ea90700 1 -- 172.21.15.81:0/2969552180 learned_addr learned my addr 172.21.15.81:0/2969552180 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:19.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf8da8e700 1 --2- 172.21.15.81:0/2969552180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef19e00 0x55b07ef1e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf8e28f700 1 --2- 172.21.15.81:0/2969552180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef14890 0x55b07ef1db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf8ea90700 1 -- 172.21.15.81:0/2969552180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef14890 msgr2=0x55b07ef1db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf8ea90700 1 --2- 172.21.15.81:0/2969552180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef14890 0x55b07ef1db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf8ea90700 1 -- 172.21.15.81:0/2969552180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef19e00 msgr2=0x55b07ef1e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf8ea90700 1 --2- 172.21.15.81:0/2969552180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef19e00 0x55b07ef1e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf8ea90700 1 -- 172.21.15.81:0/2969552180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf881a33b0 con 0x55b07ef1a720 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf8ea90700 1 --2- 172.21.15.81:0/2969552180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef1a720 0x55b07ef1e5e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7faf800093a0 tx=0x7faf800093d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56bd5389f4b59b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf71ffb700 1 -- 172.21.15.81:0/2969552180 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8000e070 con 0x55b07ef1a720 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf71ffb700 1 -- 172.21.15.81:0/2969552180 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7faf80004c40 con 0x55b07ef1a720 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf9c6adb80 1 -- 172.21.15.81:0/2969552180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b07edbd270 con 0x55b07ef1a720 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf71ffb700 1 -- 172.21.15.81:0/2969552180 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf80004e00 con 0x55b07ef1a720 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf9c6adb80 10 client.18117 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.145+0000 7faf9c6adb80 1 -- 172.21.15.81:0/2969552180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b07ec91b60 con 0x55b07ef1a720 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.146+0000 7faf71ffb700 1 -- 172.21.15.81:0/2969552180 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b07edbd270 con 0x55b07ef1a720 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.146+0000 7faf71ffb700 1 -- 172.21.15.81:0/2969552180 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faf8000b0d0 con 0x55b07ef1a720 2024-05-09T00:12:19.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.146+0000 7faf9c6adb80 10 client.18117 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.146+0000 7faf9c6adb80 10 client.18117 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:12:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.146+0000 7faf9c6adb80 20 client.18117 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.146+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/2969552180 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b07ef2e1d0 0x55b07ef305f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.146+0000 7faf9c6adb80 4 client.18117 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.146+0000 7faf9c6adb80 1 -- 172.21.15.81:0/2969552180 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b07eee3810 con 0x55b07ef2e1d0 2024-05-09T00:12:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.146+0000 7faf8e28f700 1 --2- 172.21.15.81:0/2969552180 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b07ef2e1d0 0x55b07ef305f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf71ffb700 10 client.18117 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:12:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf8e28f700 1 --2- 172.21.15.81:0/2969552180 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b07ef2e1d0 0x55b07ef305f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=52710d81ae988718 server_cookie=c8024bed7d87d8cd in_seq=0 out_seq=0 2024-05-09T00:12:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf71ffb700 1 -- 172.21.15.81:0/2969552180 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b07eee3810 con 0x55b07ef2e1d0 2024-05-09T00:12:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf71ffb700 10 client.18117 handle_command_reply: tid=0 2024-05-09T00:12:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf9c6adb80 1 client.18117 shutdown 2024-05-09T00:12:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf9c6adb80 1 -- 172.21.15.81:0/2969552180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef1a720 msgr2=0x55b07ef1e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/2969552180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef1a720 0x55b07ef1e5e0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7faf800093a0 tx=0x7faf800093d0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf9c6adb80 1 -- 172.21.15.81:0/2969552180 shutdown_connections 2024-05-09T00:12:19.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/2969552180 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b07ef2e1d0 0x55b07ef305f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/2969552180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef1a720 0x55b07ef1e5e0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/2969552180 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef14890 0x55b07ef1db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf71ffb700 0 client.18117 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:12:19.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/2969552180 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef19e00 0x55b07ef1e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf9c6adb80 1 -- 172.21.15.81:0/2969552180 >> 172.21.15.81:0/2969552180 conn(0x55b07ee72210 msgr2=0x55b07ef0e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf9c6adb80 1 -- 172.21.15.81:0/2969552180 shutdown_connections 2024-05-09T00:12:19.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.147+0000 7faf9c6adb80 1 -- 172.21.15.81:0/2969552180 wait complete. 2024-05-09T00:12:19.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.148+0000 7faf9c6adb80 20 client.18117 trim_cache size 0 max 16384 2024-05-09T00:12:19.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf9c6adb80 1 Processor -- start 2024-05-09T00:12:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf9c6adb80 1 -- start start 2024-05-09T00:12:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf9c6adb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef14890 0x55b07ef14350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf9c6adb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef19e00 0x55b07ef19350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf9c6adb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef1a720 0x55b07ef0ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf9c6adb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07ef1a5a0 con 0x55b07ef14890 2024-05-09T00:12:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf9c6adb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07ef19890 con 0x55b07ef1a720 2024-05-09T00:12:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf9c6adb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07ef2ad60 con 0x55b07ef19e00 2024-05-09T00:12:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf8e28f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef14890 0x55b07ef14350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf8e28f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef14890 0x55b07ef14350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58046/0 (socket says 172.21.15.81:58046) 2024-05-09T00:12:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf8e28f700 1 -- 172.21.15.81:0/1925600958 learned_addr learned my addr 172.21.15.81:0/1925600958 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf8e28f700 1 -- 172.21.15.81:0/1925600958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef19e00 msgr2=0x55b07ef19350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf8e28f700 1 --2- 172.21.15.81:0/1925600958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef19e00 0x55b07ef19350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf8e28f700 1 -- 172.21.15.81:0/1925600958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef1a720 msgr2=0x55b07ef0ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf8e28f700 1 --2- 172.21.15.81:0/1925600958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef1a720 0x55b07ef0ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf8e28f700 1 -- 172.21.15.81:0/1925600958 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b07ee2a560 con 0x55b07ef14890 2024-05-09T00:12:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf8e28f700 1 --2- 172.21.15.81:0/1925600958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef14890 0x55b07ef14350 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7faf780cd010 tx=0x7faf78000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2f6aee176ceb672 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf7d7fa700 1 -- 172.21.15.81:0/1925600958 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf780b8220 con 0x55b07ef14890 2024-05-09T00:12:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf7d7fa700 1 -- 172.21.15.81:0/1925600958 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf78096150 con 0x55b07ef14890 2024-05-09T00:12:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.161+0000 7faf7d7fa700 1 -- 172.21.15.81:0/1925600958 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7809a2d0 con 0x55b07ef14890 2024-05-09T00:12:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.162+0000 7faf9c6adb80 1 -- 172.21.15.81:0/1925600958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef14890 msgr2=0x55b07ef14350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.162+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/1925600958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef14890 0x55b07ef14350 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7faf780cd010 tx=0x7faf78000bc0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.162+0000 7faf9c6adb80 1 -- 172.21.15.81:0/1925600958 shutdown_connections 2024-05-09T00:12:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.162+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/1925600958 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef1a720 0x55b07ef0ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.162+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/1925600958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef14890 0x55b07ef14350 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.162+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/1925600958 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef19e00 0x55b07ef19350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.162+0000 7faf9c6adb80 1 -- 172.21.15.81:0/1925600958 >> 172.21.15.81:0/1925600958 conn(0x55b07ee72210 msgr2=0x55b07ef18c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.162+0000 7faf9c6adb80 1 -- 172.21.15.81:0/1925600958 shutdown_connections 2024-05-09T00:12:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.162+0000 7faf9c6adb80 1 -- 172.21.15.81:0/1925600958 wait complete. 2024-05-09T00:12:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.162+0000 7faf9c6adb80 1 -- start start 2024-05-09T00:12:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.162+0000 7faf9c6adb80 1 Processor -- start 2024-05-09T00:12:19.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf9c6adb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef14890 0x55b07ef7a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf9c6adb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef19e00 0x55b07ef7abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf9c6adb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef1a720 0x55b07ef7b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf9c6adb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07ef85780 con 0x55b07ef14890 2024-05-09T00:12:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf9c6adb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07ef858c0 con 0x55b07ef1a720 2024-05-09T00:12:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf9c6adb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07ef85a80 con 0x55b07ef19e00 2024-05-09T00:12:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf9c6adb80 10 client.0 _ll_register_callbacks cb 0x55b07ee09b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf8e28f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef14890 0x55b07ef7a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf8e28f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef14890 0x55b07ef7a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58058/0 (socket says 172.21.15.81:58058) 2024-05-09T00:12:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf8e28f700 1 -- 172.21.15.81:0/1192461312 learned_addr learned my addr 172.21.15.81:0/1192461312 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf8da8e700 1 --2- 172.21.15.81:0/1192461312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef19e00 0x55b07ef7abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf8e28f700 1 -- 172.21.15.81:0/1192461312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef19e00 msgr2=0x55b07ef7abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf8e28f700 1 --2- 172.21.15.81:0/1192461312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef19e00 0x55b07ef7abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf8e28f700 1 -- 172.21.15.81:0/1192461312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef1a720 msgr2=0x55b07ef7b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf8e28f700 1 --2- 172.21.15.81:0/1192461312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef1a720 0x55b07ef7b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf8e28f700 1 -- 172.21.15.81:0/1192461312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b07ece53b0 con 0x55b07ef14890 2024-05-09T00:12:19.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf8e28f700 1 --2- 172.21.15.81:0/1192461312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef14890 0x55b07ef7a670 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7faf78099b10 tx=0x7faf780a2290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c389e00e138f05c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf71ffb700 1 -- 172.21.15.81:0/1192461312 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7809a070 con 0x55b07ef14890 2024-05-09T00:12:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf71ffb700 1 -- 172.21.15.81:0/1192461312 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7faf7809a1d0 con 0x55b07ef14890 2024-05-09T00:12:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf9c6adb80 1 -- 172.21.15.81:0/1192461312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf78096520 con 0x55b07ef14890 2024-05-09T00:12:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf71ffb700 1 -- 172.21.15.81:0/1192461312 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf780a1e00 con 0x55b07ef14890 2024-05-09T00:12:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf9c6adb80 10 client.18123 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.163+0000 7faf9c6adb80 1 -- 172.21.15.81:0/1192461312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b07ece9cd0 con 0x55b07ef14890 2024-05-09T00:12:19.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.164+0000 7faf71ffb700 1 -- 172.21.15.81:0/1192461312 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf78096520 con 0x55b07ef14890 2024-05-09T00:12:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.164+0000 7faf71ffb700 1 -- 172.21.15.81:0/1192461312 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faf78095c00 con 0x55b07ef14890 2024-05-09T00:12:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.164+0000 7faf9c6adb80 10 client.18123 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.164+0000 7faf9c6adb80 10 client.18123 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:12:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.164+0000 7faf9c6adb80 20 client.18123 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.164+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/1192461312 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b07ef86d30 0x55b07ef89120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.164+0000 7faf9c6adb80 4 client.18123 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:12:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.164+0000 7faf9c6adb80 1 -- 172.21.15.81:0/1192461312 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b07ee5cec0 con 0x55b07ef86d30 2024-05-09T00:12:19.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.164+0000 7faf8da8e700 1 --2- 172.21.15.81:0/1192461312 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b07ef86d30 0x55b07ef89120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.164+0000 7faf71ffb700 10 client.18123 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:12:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.164+0000 7faf8da8e700 1 --2- 172.21.15.81:0/1192461312 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b07ef86d30 0x55b07ef89120 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78e3bee37c855c82 server_cookie=667388e13c72655f in_seq=0 out_seq=0 2024-05-09T00:12:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf71ffb700 1 -- 172.21.15.81:0/1192461312 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b07ee5cec0 con 0x55b07ef86d30 2024-05-09T00:12:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf71ffb700 10 client.18123 handle_command_reply: tid=0 2024-05-09T00:12:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf9c6adb80 1 client.18123 shutdown 2024-05-09T00:12:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf9c6adb80 1 -- 172.21.15.81:0/1192461312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef14890 msgr2=0x55b07ef7a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/1192461312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef14890 0x55b07ef7a670 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7faf78099b10 tx=0x7faf780a2290 comp rx=0 tx=0).stop 2024-05-09T00:12:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf9c6adb80 1 -- 172.21.15.81:0/1192461312 shutdown_connections 2024-05-09T00:12:19.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/1192461312 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55b07ef86d30 0x55b07ef89120 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/1192461312 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b07ef1a720 0x55b07ef7b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf71ffb700 0 client.18123 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:12:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/1192461312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b07ef14890 0x55b07ef7a670 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf9c6adb80 1 --2- 172.21.15.81:0/1192461312 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b07ef19e00 0x55b07ef7abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf9c6adb80 1 -- 172.21.15.81:0/1192461312 >> 172.21.15.81:0/1192461312 conn(0x55b07ee72210 msgr2=0x55b07ef1c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf9c6adb80 1 -- 172.21.15.81:0/1192461312 shutdown_connections 2024-05-09T00:12:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf9c6adb80 1 -- 172.21.15.81:0/1192461312 wait complete. 2024-05-09T00:12:19.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf9c6adb80 20 client.18123 trim_cache size 0 max 16384 2024-05-09T00:12:19.174 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:12:19.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf904f3700 1 -- 172.21.15.81:0/3219160209 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf740a1310 msgr2=0x7faf740a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf904f3700 1 --2- 172.21.15.81:0/3219160209 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf740a1310 0x7faf740a37d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf84005e90 tx=0x7faf84005d20 comp rx=0 tx=0).stop 2024-05-09T00:12:19.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf904f3700 1 -- 172.21.15.81:0/3219160209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf88100060 msgr2=0x7faf88196340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf904f3700 1 --2- 172.21.15.81:0/3219160209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf88100060 0x7faf88196340 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7faf7800c9b0 tx=0x7faf7800cd70 comp rx=0 tx=0).stop 2024-05-09T00:12:19.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf904f3700 1 -- 172.21.15.81:0/3219160209 shutdown_connections 2024-05-09T00:12:19.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf904f3700 1 --2- 172.21.15.81:0/3219160209 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf740a1310 0x7faf740a37d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf904f3700 1 --2- 172.21.15.81:0/3219160209 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf8819ac20 0x7faf8819b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf904f3700 1 --2- 172.21.15.81:0/3219160209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf88100060 0x7faf88196340 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf904f3700 1 --2- 172.21.15.81:0/3219160209 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf88105160 0x7faf88196880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.165+0000 7faf904f3700 1 -- 172.21.15.81:0/3219160209 >> 172.21.15.81:0/3219160209 conn(0x7faf88076f40 msgr2=0x7faf880fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.166+0000 7faf904f3700 1 -- 172.21.15.81:0/3219160209 shutdown_connections 2024-05-09T00:12:19.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.166+0000 7faf904f3700 1 -- 172.21.15.81:0/3219160209 wait complete. 2024-05-09T00:12:19.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:12:19.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:18 smithi150 ceph-mon[46187]: pgmap v289: 97 pgs: 97 active+clean; 4.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-05-09T00:12:19.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:18 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/429968594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:12:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.302+0000 7f76a8da5700 1 -- 172.21.15.81:0/2023905378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a4105f90 msgr2=0x7f76a4106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.302+0000 7f76a8da5700 1 --2- 172.21.15.81:0/2023905378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a4105f90 0x7f76a4106370 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f768c0099c0 tx=0x7f768c009cd0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.302+0000 7f76a8da5700 1 -- 172.21.15.81:0/2023905378 shutdown_connections 2024-05-09T00:12:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.303+0000 7f76a8da5700 1 --2- 172.21.15.81:0/2023905378 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76a4100ab0 0x7f76a410ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.303+0000 7f76a8da5700 1 --2- 172.21.15.81:0/2023905378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a4105f90 0x7f76a4106370 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.303+0000 7f76a8da5700 1 --2- 172.21.15.81:0/2023905378 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a41000f0 0x7f76a4100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.303+0000 7f76a8da5700 1 -- 172.21.15.81:0/2023905378 >> 172.21.15.81:0/2023905378 conn(0x7f76a4076ba0 msgr2=0x7f76a4076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.303+0000 7f76a8da5700 1 -- 172.21.15.81:0/2023905378 shutdown_connections 2024-05-09T00:12:19.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.303+0000 7f76a8da5700 1 -- 172.21.15.81:0/2023905378 wait complete. 2024-05-09T00:12:19.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.303+0000 7f76a8da5700 1 Processor -- start 2024-05-09T00:12:19.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.303+0000 7f76a8da5700 1 -- start start 2024-05-09T00:12:19.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.303+0000 7f76a8da5700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76a41000f0 0x7f76a41973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a8da5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a4100ab0 0x7f76a4197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a8da5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a4105f90 0x7f76a419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a8da5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a419c2f0 con 0x7f76a4105f90 2024-05-09T00:12:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a8da5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a419c460 con 0x7f76a4100ab0 2024-05-09T00:12:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a8da5700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a419c620 con 0x7f76a41000f0 2024-05-09T00:12:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a4105f90 0x7f76a419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a2d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a4105f90 0x7f76a419bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58072/0 (socket says 172.21.15.81:58072) 2024-05-09T00:12:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a2d9d700 1 -- 172.21.15.81:0/3559402621 learned_addr learned my addr 172.21.15.81:0/3559402621 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a259c700 1 --2- 172.21.15.81:0/3559402621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76a41000f0 0x7f76a41973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a1d9b700 1 --2- 172.21.15.81:0/3559402621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a4100ab0 0x7f76a4197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a2d9d700 1 -- 172.21.15.81:0/3559402621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76a41000f0 msgr2=0x7f76a41973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a2d9d700 1 --2- 172.21.15.81:0/3559402621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76a41000f0 0x7f76a41973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a2d9d700 1 -- 172.21.15.81:0/3559402621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a4100ab0 msgr2=0x7f76a4197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a2d9d700 1 --2- 172.21.15.81:0/3559402621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a4100ab0 0x7f76a4197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a2d9d700 1 -- 172.21.15.81:0/3559402621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c0095f0 con 0x7f76a4105f90 2024-05-09T00:12:19.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a2d9d700 1 --2- 172.21.15.81:0/3559402621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a4105f90 0x7f76a419bcb0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f769c00ada0 tx=0x7f769c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:19.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f769b7fe700 1 -- 172.21.15.81:0/3559402621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c00f070 con 0x7f76a4105f90 2024-05-09T00:12:19.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f769b7fe700 1 -- 172.21.15.81:0/3559402621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f769c007b30 con 0x7f76a4105f90 2024-05-09T00:12:19.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a8da5700 1 -- 172.21.15.81:0/3559402621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a419c900 con 0x7f76a4105f90 2024-05-09T00:12:19.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f769b7fe700 1 -- 172.21.15.81:0/3559402621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c005280 con 0x7f76a4105f90 2024-05-09T00:12:19.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.304+0000 7f76a8da5700 1 -- 172.21.15.81:0/3559402621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a41a4140 con 0x7f76a4105f90 2024-05-09T00:12:19.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:18 smithi171 ceph-mon[47351]: pgmap v289: 97 pgs: 97 active+clean; 4.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-05-09T00:12:19.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:18 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/429968594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:12:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.307+0000 7f769b7fe700 1 -- 172.21.15.81:0/3559402621 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f769c00c8d0 con 0x7f76a4105f90 2024-05-09T00:12:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.307+0000 7f769b7fe700 1 --2- 172.21.15.81:0/3559402621 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76900a1290 0x7f76900a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.308+0000 7f76a259c700 1 --2- 172.21.15.81:0/3559402621 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76900a1290 0x7f76900a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.308+0000 7f769b7fe700 1 -- 172.21.15.81:0/3559402621 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f769c0cc250 con 0x7f76a4105f90 2024-05-09T00:12:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.308+0000 7f76a259c700 1 --2- 172.21.15.81:0/3559402621 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76900a1290 0x7f76900a3750 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f768c006010 tx=0x7f768c003680 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.308+0000 7f76b4f5fb80 1 Processor -- start 2024-05-09T00:12:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76b4f5fb80 1 -- start start 2024-05-09T00:12:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76b4f5fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x5590566f8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76b4f5fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f8b80 0x5590566f2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76b4f5fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f2cf0 0x5590566f3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76b4f5fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559056645150 con 0x5590566f8260 2024-05-09T00:12:19.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76b4f5fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559056642b10 con 0x5590566f2cf0 2024-05-09T00:12:19.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76b4f5fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55905663e400 con 0x5590566f8b80 2024-05-09T00:12:19.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76a259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x5590566f8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76a259c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x5590566f8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58080/0 (socket says 172.21.15.81:58080) 2024-05-09T00:12:19.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76a259c700 1 -- 172.21.15.81:0/2562821901 learned_addr learned my addr 172.21.15.81:0/2562821901 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:19.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76a2d9d700 1 --2- 172.21.15.81:0/2562821901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f2cf0 0x5590566f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76a259c700 1 -- 172.21.15.81:0/2562821901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f8b80 msgr2=0x5590566f2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76a259c700 1 --2- 172.21.15.81:0/2562821901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f8b80 0x5590566f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76a259c700 1 -- 172.21.15.81:0/2562821901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f2cf0 msgr2=0x5590566f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76a259c700 1 --2- 172.21.15.81:0/2562821901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f2cf0 0x5590566f3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76a259c700 1 -- 172.21.15.81:0/2562821901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590564bf3b0 con 0x5590566f8260 2024-05-09T00:12:19.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76a2d9d700 1 --2- 172.21.15.81:0/2562821901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f2cf0 0x5590566f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:19.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f76a259c700 1 --2- 172.21.15.81:0/2562821901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x5590566f8640 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f768c000c00 tx=0x7f768c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320c5768484c7458 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:19.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f7698ff9700 1 -- 172.21.15.81:0/2562821901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c00bd70 con 0x5590566f8260 2024-05-09T00:12:19.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f7698ff9700 1 -- 172.21.15.81:0/2562821901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f768c01e040 con 0x5590566f8260 2024-05-09T00:12:19.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.309+0000 7f7698ff9700 1 -- 172.21.15.81:0/2562821901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c00f750 con 0x5590566f8260 2024-05-09T00:12:19.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.310+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/2562821901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 msgr2=0x5590566f8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.310+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/2562821901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x5590566f8640 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f768c000c00 tx=0x7f768c020000 comp rx=0 tx=0).stop 2024-05-09T00:12:19.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.310+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/2562821901 shutdown_connections 2024-05-09T00:12:19.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.310+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/2562821901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f2cf0 0x5590566f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.310+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/2562821901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x5590566f8640 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.310+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/2562821901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f8b80 0x5590566f2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.310+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/2562821901 >> 172.21.15.81:0/2562821901 conn(0x55905664c210 msgr2=0x5590566e8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.310+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/2562821901 shutdown_connections 2024-05-09T00:12:19.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.310+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/2562821901 wait complete. 2024-05-09T00:12:19.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76b4f5fb80 1 -- start start 2024-05-09T00:12:19.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76b4f5fb80 1 Processor -- start 2024-05-09T00:12:19.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76b4f5fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f2cf0 0x5590566fbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76b4f5fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x5590566fc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76b4f5fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f8b80 0x5590566fca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76b4f5fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590565da560 con 0x5590566f8260 2024-05-09T00:12:19.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76b4f5fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590565da200 con 0x5590566f8b80 2024-05-09T00:12:19.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76b4f5fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590564c16a0 con 0x5590566f2cf0 2024-05-09T00:12:19.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76a1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x5590566fc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76b4f5fb80 10 client.0 _ll_register_callbacks cb 0x5590565e3b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:19.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76a1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x5590566fc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58094/0 (socket says 172.21.15.81:58094) 2024-05-09T00:12:19.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76a1d9b700 1 -- 172.21.15.81:0/4079172508 learned_addr learned my addr 172.21.15.81:0/4079172508 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:19.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76a259c700 1 --2- 172.21.15.81:0/4079172508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f2cf0 0x5590566fbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76a2d9d700 1 --2- 172.21.15.81:0/4079172508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f8b80 0x5590566fca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76a1d9b700 1 -- 172.21.15.81:0/4079172508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f2cf0 msgr2=0x5590566fbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76a1d9b700 1 --2- 172.21.15.81:0/4079172508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f2cf0 0x5590566fbf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76a1d9b700 1 -- 172.21.15.81:0/4079172508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f8b80 msgr2=0x5590566fca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.311+0000 7f76a1d9b700 1 --2- 172.21.15.81:0/4079172508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f8b80 0x5590566fca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f76a1d9b700 1 -- 172.21.15.81:0/4079172508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a4069190 con 0x5590566f8260 2024-05-09T00:12:19.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f76a1d9b700 1 --2- 172.21.15.81:0/4079172508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x5590566fc4c0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f769400b6c0 tx=0x7f76940106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cb91546038051a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:19.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f7689ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:19.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f7689ffb700 1 -- 172.21.15.81:0/4079172508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694004230 con 0x5590566f8260 2024-05-09T00:12:19.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f7689ffb700 1 -- 172.21.15.81:0/4079172508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f7694017070 con 0x5590566f8260 2024-05-09T00:12:19.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/4079172508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559056597270 con 0x5590566f8260 2024-05-09T00:12:19.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f7689ffb700 1 -- 172.21.15.81:0/4079172508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7694010e50 con 0x5590566f8260 2024-05-09T00:12:19.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f76b4f5fb80 10 client.18135 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:19.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/4079172508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55905646bb60 con 0x5590566f8260 2024-05-09T00:12:19.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f7689ffb700 1 -- 172.21.15.81:0/4079172508 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559056597270 con 0x5590566f8260 2024-05-09T00:12:19.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f7689ffb700 1 -- 172.21.15.81:0/4079172508 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7694011560 con 0x5590566f8260 2024-05-09T00:12:19.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f76b4f5fb80 10 client.18135 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:19.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f76b4f5fb80 10 client.18135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f76b4f5fb80 20 client.18135 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/4079172508 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55905670c6c0 0x55905670eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f76b4f5fb80 4 client.18135 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.312+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/4079172508 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590566bd810 con 0x55905670c6c0 2024-05-09T00:12:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.313+0000 7f76a259c700 1 --2- 172.21.15.81:0/4079172508 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55905670c6c0 0x55905670eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.313+0000 7f7689ffb700 10 client.18135 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.313+0000 7f76a259c700 1 --2- 172.21.15.81:0/4079172508 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55905670c6c0 0x55905670eae0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d8282a690970243 server_cookie=ad7d655ad11f9c74 in_seq=0 out_seq=0 2024-05-09T00:12:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f7689ffb700 1 -- 172.21.15.81:0/4079172508 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5590566bd810 con 0x55905670c6c0 2024-05-09T00:12:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f7689ffb700 10 client.18135 handle_command_reply: tid=0 2024-05-09T00:12:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f76b4f5fb80 1 client.18135 shutdown 2024-05-09T00:12:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/4079172508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 msgr2=0x5590566fc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/4079172508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x5590566fc4c0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f769400b6c0 tx=0x7f76940106b0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/4079172508 shutdown_connections 2024-05-09T00:12:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/4079172508 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55905670c6c0 0x55905670eae0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/4079172508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f8b80 0x5590566fca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/4079172508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f2cf0 0x5590566fbf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f7689ffb700 0 client.18135 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/4079172508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x5590566fc4c0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/4079172508 >> 172.21.15.81:0/4079172508 conn(0x55905664c210 msgr2=0x5590566e85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/4079172508 shutdown_connections 2024-05-09T00:12:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/4079172508 wait complete. 2024-05-09T00:12:19.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.314+0000 7f76b4f5fb80 20 client.18135 trim_cache size 0 max 16384 2024-05-09T00:12:19.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.327+0000 7f76b4f5fb80 1 Processor -- start 2024-05-09T00:12:19.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.327+0000 7f76b4f5fb80 1 -- start start 2024-05-09T00:12:19.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.327+0000 7f76b4f5fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f2cf0 0x5590566f2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.327+0000 7f76b4f5fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x559056707fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.327+0000 7f76b4f5fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f8b80 0x5590566e8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.327+0000 7f76b4f5fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559056713cb0 con 0x5590566f8260 2024-05-09T00:12:19.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.327+0000 7f76b4f5fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590566fcf50 con 0x5590566f2cf0 2024-05-09T00:12:19.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.327+0000 7f76b4f5fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590566f6920 con 0x5590566f8b80 2024-05-09T00:12:19.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.327+0000 7f76a1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x559056707fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.327+0000 7f76a1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x559056707fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58108/0 (socket says 172.21.15.81:58108) 2024-05-09T00:12:19.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.327+0000 7f76a1d9b700 1 -- 172.21.15.81:0/2197565519 learned_addr learned my addr 172.21.15.81:0/2197565519 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:19.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76a1d9b700 1 -- 172.21.15.81:0/2197565519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f8b80 msgr2=0x5590566e8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76a259c700 1 --2- 172.21.15.81:0/2197565519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f2cf0 0x5590566f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76a2d9d700 1 --2- 172.21.15.81:0/2197565519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f8b80 0x5590566e8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76a1d9b700 1 --2- 172.21.15.81:0/2197565519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f8b80 0x5590566e8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76a1d9b700 1 -- 172.21.15.81:0/2197565519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f2cf0 msgr2=0x5590566f2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76a1d9b700 1 --2- 172.21.15.81:0/2197565519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f2cf0 0x5590566f2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76a1d9b700 1 -- 172.21.15.81:0/2197565519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559056604560 con 0x5590566f8260 2024-05-09T00:12:19.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76a259c700 1 --2- 172.21.15.81:0/2197565519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f2cf0 0x5590566f2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:19.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76a2d9d700 1 --2- 172.21.15.81:0/2197565519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f8b80 0x5590566e8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:19.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76a1d9b700 1 --2- 172.21.15.81:0/2197565519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x559056707fc0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f7694011a10 tx=0x7f7694005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4782af788b92b248 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76997fa700 1 -- 172.21.15.81:0/2197565519 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76940116c0 con 0x5590566f8260 2024-05-09T00:12:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76997fa700 1 -- 172.21.15.81:0/2197565519 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7694015070 con 0x5590566f8260 2024-05-09T00:12:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76997fa700 1 -- 172.21.15.81:0/2197565519 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76940038e0 con 0x5590566f8260 2024-05-09T00:12:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/2197565519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 msgr2=0x559056707fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/2197565519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x559056707fc0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f7694011a10 tx=0x7f7694005cc0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.328+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/2197565519 shutdown_connections 2024-05-09T00:12:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/2197565519 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f2cf0 0x5590566f2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/2197565519 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f8b80 0x5590566e8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/2197565519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x559056707fc0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/2197565519 >> 172.21.15.81:0/2197565519 conn(0x55905664c210 msgr2=0x5590566e5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/2197565519 shutdown_connections 2024-05-09T00:12:19.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/2197565519 wait complete. 2024-05-09T00:12:19.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 1 -- start start 2024-05-09T00:12:19.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 1 Processor -- start 2024-05-09T00:12:19.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f2cf0 0x559056701720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x559056701c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f8b80 0x559056761b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590567620c0 con 0x5590566f8260 2024-05-09T00:12:19.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559056762200 con 0x5590566f8b80 2024-05-09T00:12:19.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559056762340 con 0x5590566f2cf0 2024-05-09T00:12:19.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76b4f5fb80 10 client.0 _ll_register_callbacks cb 0x5590565e3b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76a1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x559056701c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76a1d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x559056701c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58112/0 (socket says 172.21.15.81:58112) 2024-05-09T00:12:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.329+0000 7f76a1d9b700 1 -- 172.21.15.81:0/3258762996 learned_addr learned my addr 172.21.15.81:0/3258762996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f76a259c700 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f2cf0 0x559056701720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f76a2d9d700 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f8b80 0x559056761b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f76a1d9b700 1 -- 172.21.15.81:0/3258762996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f2cf0 msgr2=0x559056701720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f76a1d9b700 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f2cf0 0x559056701720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f76a1d9b700 1 -- 172.21.15.81:0/3258762996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f8b80 msgr2=0x559056761b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:19.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f76a1d9b700 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f8b80 0x559056761b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f76a1d9b700 1 -- 172.21.15.81:0/3258762996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55905646bb60 con 0x5590566f8260 2024-05-09T00:12:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f76a259c700 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f2cf0 0x559056701720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f76a2d9d700 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f8b80 0x559056761b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f76a1d9b700 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x559056701c60 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f769402e040 tx=0x7f7694005890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0ed36fde7c2d3a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f7689ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f7689ffb700 1 -- 172.21.15.81:0/3258762996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694003680 con 0x5590566f8260 2024-05-09T00:12:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f7689ffb700 1 -- 172.21.15.81:0/3258762996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f7694000e40 con 0x5590566f8260 2024-05-09T00:12:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/3258762996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f768c01e040 con 0x5590566f8260 2024-05-09T00:12:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f7689ffb700 1 -- 172.21.15.81:0/3258762996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76940037e0 con 0x5590566f8260 2024-05-09T00:12:19.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f76b4f5fb80 10 client.18141 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/3258762996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5590564c3cd0 con 0x5590566f8260 2024-05-09T00:12:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f7689ffb700 1 -- 172.21.15.81:0/3258762996 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f768c01e040 con 0x5590566f8260 2024-05-09T00:12:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.330+0000 7f7689ffb700 1 -- 172.21.15.81:0/3258762996 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7694032070 con 0x5590566f8260 2024-05-09T00:12:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.331+0000 7f76b4f5fb80 10 client.18141 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.331+0000 7f76b4f5fb80 10 client.18141 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.331+0000 7f76b4f5fb80 20 client.18141 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.331+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559056763630 0x559056765a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.331+0000 7f76b4f5fb80 4 client.18141 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:12:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.331+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/3258762996 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559056636ec0 con 0x559056763630 2024-05-09T00:12:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.331+0000 7f76a259c700 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559056763630 0x559056765a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.331+0000 7f7689ffb700 10 client.18141 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:19.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.331+0000 7f76a259c700 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559056763630 0x559056765a20 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a96b1fbb4a369806 server_cookie=2966c11b8c859237 in_seq=0 out_seq=0 2024-05-09T00:12:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.331+0000 7f7689ffb700 1 -- 172.21.15.81:0/3258762996 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559056636ec0 con 0x559056763630 2024-05-09T00:12:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.331+0000 7f7689ffb700 10 client.18141 handle_command_reply: tid=0 2024-05-09T00:12:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76b4f5fb80 1 client.18141 shutdown 2024-05-09T00:12:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/3258762996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 msgr2=0x559056701c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x559056701c60 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f769402e040 tx=0x7f7694005890 comp rx=0 tx=0).stop 2024-05-09T00:12:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/3258762996 shutdown_connections 2024-05-09T00:12:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559056763630 0x559056765a20 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5590566f8b80 0x559056761b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5590566f2cf0 0x559056701720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f7689ffb700 0 client.18141 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76b4f5fb80 1 --2- 172.21.15.81:0/3258762996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5590566f8260 0x559056701c60 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/3258762996 >> 172.21.15.81:0/3258762996 conn(0x55905664c210 msgr2=0x5590566f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/3258762996 shutdown_connections 2024-05-09T00:12:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76b4f5fb80 1 -- 172.21.15.81:0/3258762996 wait complete. 2024-05-09T00:12:19.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76b4f5fb80 20 client.18141 trim_cache size 0 max 16384 2024-05-09T00:12:19.340 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:12:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76a8da5700 1 -- 172.21.15.81:0/3559402621 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76900a1290 msgr2=0x7f76900a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76a8da5700 1 --2- 172.21.15.81:0/3559402621 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76900a1290 0x7f76900a3750 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f768c006010 tx=0x7f768c003680 comp rx=0 tx=0).stop 2024-05-09T00:12:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76a8da5700 1 -- 172.21.15.81:0/3559402621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a4105f90 msgr2=0x7f76a419bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76a8da5700 1 --2- 172.21.15.81:0/3559402621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a4105f90 0x7f76a419bcb0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f769c00ada0 tx=0x7f769c00c330 comp rx=0 tx=0).stop 2024-05-09T00:12:19.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76a8da5700 1 -- 172.21.15.81:0/3559402621 shutdown_connections 2024-05-09T00:12:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76a8da5700 1 --2- 172.21.15.81:0/3559402621 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f76900a1290 0x7f76900a3750 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76a8da5700 1 --2- 172.21.15.81:0/3559402621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a4105f90 0x7f76a419bcb0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76a8da5700 1 --2- 172.21.15.81:0/3559402621 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f76a41000f0 0x7f76a41973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76a8da5700 1 --2- 172.21.15.81:0/3559402621 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f76a4100ab0 0x7f76a4197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76a8da5700 1 -- 172.21.15.81:0/3559402621 >> 172.21.15.81:0/3559402621 conn(0x7f76a4076ba0 msgr2=0x7f76a40fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76a8da5700 1 -- 172.21.15.81:0/3559402621 shutdown_connections 2024-05-09T00:12:19.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:19.332+0000 7f76a8da5700 1 -- 172.21.15.81:0/3559402621 wait complete. 2024-05-09T00:12:20.344 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:12:20.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:12:20.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.485+0000 7f8603c08700 1 -- 172.21.15.81:0/2486377782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85fc100a10 msgr2=0x7f85fc104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.485+0000 7f8603c08700 1 --2- 172.21.15.81:0/2486377782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85fc100a10 0x7f85fc104a30 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009990 tx=0x7f85f8009ca0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.485+0000 7f8603c08700 1 -- 172.21.15.81:0/2486377782 shutdown_connections 2024-05-09T00:12:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.485+0000 7f8603c08700 1 --2- 172.21.15.81:0/2486377782 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85fc105160 0x7f85fc10cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.485+0000 7f8603c08700 1 --2- 172.21.15.81:0/2486377782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85fc100060 0x7f85fc100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.485+0000 7f8603c08700 1 --2- 172.21.15.81:0/2486377782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85fc100a10 0x7f85fc104a30 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.485+0000 7f8603c08700 1 -- 172.21.15.81:0/2486377782 >> 172.21.15.81:0/2486377782 conn(0x7f85fc076f40 msgr2=0x7f85fc077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.485+0000 7f8603c08700 1 -- 172.21.15.81:0/2486377782 shutdown_connections 2024-05-09T00:12:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.485+0000 7f8603c08700 1 -- 172.21.15.81:0/2486377782 wait complete. 2024-05-09T00:12:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f8603c08700 1 Processor -- start 2024-05-09T00:12:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f8603c08700 1 -- start start 2024-05-09T00:12:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f8603c08700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85fc100060 0x7f85fc196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f8603c08700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85fc105160 0x7f85fc1968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f8603c08700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85fc19ac50 0x7f85fc19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f8603c08700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc19b6d0 con 0x7f85fc100060 2024-05-09T00:12:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f8603c08700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc19b840 con 0x7f85fc105160 2024-05-09T00:12:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f8603c08700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc19ba00 con 0x7f85fc19ac50 2024-05-09T00:12:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f86019a4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85fc100060 0x7f85fc196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f86019a4700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85fc100060 0x7f85fc196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58132/0 (socket says 172.21.15.81:58132) 2024-05-09T00:12:20.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f86019a4700 1 -- 172.21.15.81:0/3865183071 learned_addr learned my addr 172.21.15.81:0/3865183071 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f86011a3700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85fc105160 0x7f85fc1968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f86021a5700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85fc19ac50 0x7f85fc19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f86019a4700 1 -- 172.21.15.81:0/3865183071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85fc19ac50 msgr2=0x7f85fc19b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f86019a4700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85fc19ac50 0x7f85fc19b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f86019a4700 1 -- 172.21.15.81:0/3865183071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85fc105160 msgr2=0x7f85fc1968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f86019a4700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85fc105160 0x7f85fc1968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f86019a4700 1 -- 172.21.15.81:0/3865183071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80095f0 con 0x7f85fc100060 2024-05-09T00:12:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.486+0000 7f86011a3700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85fc105160 0x7f85fc1968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.487+0000 7f86019a4700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85fc100060 0x7f85fc196370 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f85f000b530 tx=0x7f85f000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.487+0000 7f85eeffd700 1 -- 172.21.15.81:0/3865183071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f0011830 con 0x7f85fc100060 2024-05-09T00:12:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.487+0000 7f85eeffd700 1 -- 172.21.15.81:0/3865183071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85f0011e50 con 0x7f85fc100060 2024-05-09T00:12:20.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.487+0000 7f8603c08700 1 -- 172.21.15.81:0/3865183071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85fc1a2f60 con 0x7f85fc100060 2024-05-09T00:12:20.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.487+0000 7f85eeffd700 1 -- 172.21.15.81:0/3865183071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f000f2e0 con 0x7f85fc100060 2024-05-09T00:12:20.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.487+0000 7f8603c08700 1 -- 172.21.15.81:0/3865183071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85fc1a3380 con 0x7f85fc100060 2024-05-09T00:12:20.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.489+0000 7f85eeffd700 1 -- 172.21.15.81:0/3865183071 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f85f0010580 con 0x7f85fc100060 2024-05-09T00:12:20.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.490+0000 7f85eeffd700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f85e80a1290 0x7f85e80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.490+0000 7f86011a3700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f85e80a1290 0x7f85e80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.490+0000 7f85eeffd700 1 -- 172.21.15.81:0/3865183071 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f85f00cc730 con 0x7f85fc100060 2024-05-09T00:12:20.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.490+0000 7f86011a3700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f85e80a1290 0x7f85e80a3750 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f85f8006010 tx=0x7f85f800b540 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:20.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.490+0000 7f860fdc2b80 1 Processor -- start 2024-05-09T00:12:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f860fdc2b80 1 -- start start 2024-05-09T00:12:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f860fdc2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba1e80 0x55e563ba2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f860fdc2b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563ba27a0 0x55e563b9c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f860fdc2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563b9c910 0x55e563b9cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f860fdc2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e563af31d0 con 0x55e563b9c910 2024-05-09T00:12:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f860fdc2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e563af0b90 con 0x55e563ba1e80 2024-05-09T00:12:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f860fdc2b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e563aec480 con 0x55e563ba27a0 2024-05-09T00:12:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f86021a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563b9c910 0x55e563b9cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f86021a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563b9c910 0x55e563b9cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58140/0 (socket says 172.21.15.81:58140) 2024-05-09T00:12:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f86021a5700 1 -- 172.21.15.81:0/436317074 learned_addr learned my addr 172.21.15.81:0/436317074 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:20.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f86019a4700 1 --2- 172.21.15.81:0/436317074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba1e80 0x55e563ba2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f86011a3700 1 --2- 172.21.15.81:0/436317074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563ba27a0 0x55e563b9c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f86021a5700 1 -- 172.21.15.81:0/436317074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563ba27a0 msgr2=0x55e563b9c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f86021a5700 1 --2- 172.21.15.81:0/436317074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563ba27a0 0x55e563b9c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f86021a5700 1 -- 172.21.15.81:0/436317074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba1e80 msgr2=0x55e563ba2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f86021a5700 1 --2- 172.21.15.81:0/436317074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba1e80 0x55e563ba2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f86021a5700 1 -- 172.21.15.81:0/436317074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e56396d430 con 0x55e563b9c910 2024-05-09T00:12:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.491+0000 7f86021a5700 1 --2- 172.21.15.81:0/436317074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563b9c910 0x55e563b9cd50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009f20 tx=0x7f85f4009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a283cee86cff483 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.492+0000 7f85e7fff700 1 -- 172.21.15.81:0/436317074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4011070 con 0x55e563b9c910 2024-05-09T00:12:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.492+0000 7f85e7fff700 1 -- 172.21.15.81:0/436317074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85f4009a50 con 0x55e563b9c910 2024-05-09T00:12:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.492+0000 7f85e7fff700 1 -- 172.21.15.81:0/436317074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f400a400 con 0x55e563b9c910 2024-05-09T00:12:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.492+0000 7f860fdc2b80 1 -- 172.21.15.81:0/436317074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563b9c910 msgr2=0x55e563b9cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.492+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/436317074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563b9c910 0x55e563b9cd50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009f20 tx=0x7f85f4009f50 comp rx=0 tx=0).stop 2024-05-09T00:12:20.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.492+0000 7f860fdc2b80 1 -- 172.21.15.81:0/436317074 shutdown_connections 2024-05-09T00:12:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.492+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/436317074 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba1e80 0x55e563ba2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.492+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/436317074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563b9c910 0x55e563b9cd50 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.492+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/436317074 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563ba27a0 0x55e563b9c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.492+0000 7f860fdc2b80 1 -- 172.21.15.81:0/436317074 >> 172.21.15.81:0/436317074 conn(0x55e563afa290 msgr2=0x55e563b96e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.492+0000 7f860fdc2b80 1 -- 172.21.15.81:0/436317074 shutdown_connections 2024-05-09T00:12:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.492+0000 7f860fdc2b80 1 -- 172.21.15.81:0/436317074 wait complete. 2024-05-09T00:12:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.493+0000 7f860fdc2b80 1 -- start start 2024-05-09T00:12:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.493+0000 7f860fdc2b80 1 Processor -- start 2024-05-09T00:12:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.493+0000 7f860fdc2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563b9c910 0x55e563ba5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.493+0000 7f860fdc2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba1e80 0x55e563ba6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.493+0000 7f860fdc2b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563ba27a0 0x55e563ba6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.493+0000 7f860fdc2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e563a885e0 con 0x55e563ba1e80 2024-05-09T00:12:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.493+0000 7f860fdc2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e563a88280 con 0x55e563b9c910 2024-05-09T00:12:20.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.493+0000 7f860fdc2b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e56396f720 con 0x55e563ba27a0 2024-05-09T00:12:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.493+0000 7f860fdc2b80 10 client.0 _ll_register_callbacks cb 0x55e563a91bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.493+0000 7f86011a3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba1e80 0x55e563ba6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.493+0000 7f86011a3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba1e80 0x55e563ba6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58142/0 (socket says 172.21.15.81:58142) 2024-05-09T00:12:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.493+0000 7f86011a3700 1 -- 172.21.15.81:0/3651773706 learned_addr learned my addr 172.21.15.81:0/3651773706 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.493+0000 7f86019a4700 1 --2- 172.21.15.81:0/3651773706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563b9c910 0x55e563ba5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.493+0000 7f86021a5700 1 --2- 172.21.15.81:0/3651773706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563ba27a0 0x55e563ba6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f86011a3700 1 -- 172.21.15.81:0/3651773706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563ba27a0 msgr2=0x55e563ba6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f86011a3700 1 --2- 172.21.15.81:0/3651773706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563ba27a0 0x55e563ba6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f86011a3700 1 -- 172.21.15.81:0/3651773706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563b9c910 msgr2=0x55e563ba5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f86011a3700 1 --2- 172.21.15.81:0/3651773706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563b9c910 0x55e563ba5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f86011a3700 1 -- 172.21.15.81:0/3651773706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f4009bd0 con 0x55e563ba1e80 2024-05-09T00:12:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f86019a4700 1 --2- 172.21.15.81:0/3651773706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563b9c910 0x55e563ba5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f86011a3700 1 --2- 172.21.15.81:0/3651773706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba1e80 0x55e563ba6200 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f85f8015000 tx=0x7f85f8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32b1921b851905bf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:20.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f85e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f85e57fa700 1 -- 172.21.15.81:0/3651773706 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8024410 con 0x55e563ba1e80 2024-05-09T00:12:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f85e57fa700 1 -- 172.21.15.81:0/3651773706 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f85f8024570 con 0x55e563ba1e80 2024-05-09T00:12:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f860fdc2b80 1 -- 172.21.15.81:0/3651773706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e563b6b890 con 0x55e563ba1e80 2024-05-09T00:12:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f85e57fa700 1 -- 172.21.15.81:0/3651773706 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85f8024730 con 0x55e563ba1e80 2024-05-09T00:12:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f860fdc2b80 10 client.18153 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f860fdc2b80 1 -- 172.21.15.81:0/3651773706 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e563919be0 con 0x55e563ba1e80 2024-05-09T00:12:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f85e57fa700 1 -- 172.21.15.81:0/3651773706 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85f803d020 con 0x55e563ba1e80 2024-05-09T00:12:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f85e57fa700 1 -- 172.21.15.81:0/3651773706 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f85f8003ba0 con 0x55e563ba1e80 2024-05-09T00:12:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f860fdc2b80 10 client.18153 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f860fdc2b80 10 client.18153 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f860fdc2b80 20 client.18153 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/3651773706 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e563bb8530 0x55e563bba950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.494+0000 7f860fdc2b80 4 client.18153 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:20.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.495+0000 7f860fdc2b80 1 -- 172.21.15.81:0/3651773706 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e563ae4f40 con 0x55e563bb8530 2024-05-09T00:12:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.495+0000 7f86019a4700 1 --2- 172.21.15.81:0/3651773706 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e563bb8530 0x55e563bba950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.495+0000 7f86019a4700 1 --2- 172.21.15.81:0/3651773706 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e563bb8530 0x55e563bba950 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef29764f598aa8f0 server_cookie=d8bc9b3a29f73d38 in_seq=0 out_seq=0 2024-05-09T00:12:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.495+0000 7f85e57fa700 10 client.18153 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f85e57fa700 1 -- 172.21.15.81:0/3651773706 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e563ae4f40 con 0x55e563bb8530 2024-05-09T00:12:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f85e57fa700 10 client.18153 handle_command_reply: tid=0 2024-05-09T00:12:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f860fdc2b80 1 client.18153 shutdown 2024-05-09T00:12:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f860fdc2b80 1 -- 172.21.15.81:0/3651773706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba1e80 msgr2=0x55e563ba6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/3651773706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba1e80 0x55e563ba6200 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f85f8015000 tx=0x7f85f8009ca0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f860fdc2b80 1 -- 172.21.15.81:0/3651773706 shutdown_connections 2024-05-09T00:12:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/3651773706 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e563bb8530 0x55e563bba950 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/3651773706 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563b9c910 0x55e563ba5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/3651773706 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563ba27a0 0x55e563ba6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f85e57fa700 0 client.18153 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:20.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/3651773706 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba1e80 0x55e563ba6200 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f860fdc2b80 1 -- 172.21.15.81:0/3651773706 >> 172.21.15.81:0/3651773706 conn(0x55e563afa290 msgr2=0x55e563b96620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:20.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f860fdc2b80 1 -- 172.21.15.81:0/3651773706 shutdown_connections 2024-05-09T00:12:20.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f860fdc2b80 1 -- 172.21.15.81:0/3651773706 wait complete. 2024-05-09T00:12:20.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.496+0000 7f860fdc2b80 20 client.18153 trim_cache size 0 max 16384 2024-05-09T00:12:20.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f860fdc2b80 1 Processor -- start 2024-05-09T00:12:20.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f860fdc2b80 1 -- start start 2024-05-09T00:12:20.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f860fdc2b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563b9c910 0x55e563b9c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f860fdc2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba1e80 0x55e563ba14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f860fdc2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba27a0 0x55e563b96da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f860fdc2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e563b9f9c0 con 0x55e563ba1e80 2024-05-09T00:12:20.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f860fdc2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e563b93e40 con 0x55e563ba27a0 2024-05-09T00:12:20.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f860fdc2b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e563b986c0 con 0x55e563b9c910 2024-05-09T00:12:20.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f86011a3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba1e80 0x55e563ba14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f86011a3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba1e80 0x55e563ba14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58146/0 (socket says 172.21.15.81:58146) 2024-05-09T00:12:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f86011a3700 1 -- 172.21.15.81:0/942025009 learned_addr learned my addr 172.21.15.81:0/942025009 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f86019a4700 1 --2- 172.21.15.81:0/942025009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563b9c910 0x55e563b9c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f86011a3700 1 -- 172.21.15.81:0/942025009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563b9c910 msgr2=0x55e563b9c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f86011a3700 1 --2- 172.21.15.81:0/942025009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563b9c910 0x55e563b9c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f86011a3700 1 -- 172.21.15.81:0/942025009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba27a0 msgr2=0x55e563b96da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f86021a5700 1 --2- 172.21.15.81:0/942025009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba27a0 0x55e563b96da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f86011a3700 1 --2- 172.21.15.81:0/942025009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba27a0 0x55e563b96da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f86011a3700 1 -- 172.21.15.81:0/942025009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e563b9cfc0 con 0x55e563ba1e80 2024-05-09T00:12:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f86019a4700 1 --2- 172.21.15.81:0/942025009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563b9c910 0x55e563b9c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f86011a3700 1 --2- 172.21.15.81:0/942025009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba1e80 0x55e563ba14c0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f85f8004000 tx=0x7f85f800f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66eafa2f7df4520b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f85ecda4700 1 -- 172.21.15.81:0/942025009 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f800fd70 con 0x55e563ba1e80 2024-05-09T00:12:20.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.514+0000 7f85ecda4700 1 -- 172.21.15.81:0/942025009 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85f803d030 con 0x55e563ba1e80 2024-05-09T00:12:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.515+0000 7f85ecda4700 1 -- 172.21.15.81:0/942025009 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8004e00 con 0x55e563ba1e80 2024-05-09T00:12:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.515+0000 7f860fdc2b80 1 -- 172.21.15.81:0/942025009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba1e80 msgr2=0x55e563ba14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.515+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/942025009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba1e80 0x55e563ba14c0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f85f8004000 tx=0x7f85f800f8f0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.515+0000 7f860fdc2b80 1 -- 172.21.15.81:0/942025009 shutdown_connections 2024-05-09T00:12:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.515+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/942025009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba27a0 0x55e563b96da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.515+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/942025009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563b9c910 0x55e563b9c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.515+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/942025009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba1e80 0x55e563ba14c0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.515+0000 7f860fdc2b80 1 -- 172.21.15.81:0/942025009 >> 172.21.15.81:0/942025009 conn(0x55e563afa290 msgr2=0x55e563ba0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.515+0000 7f860fdc2b80 1 -- 172.21.15.81:0/942025009 shutdown_connections 2024-05-09T00:12:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.515+0000 7f860fdc2b80 1 -- 172.21.15.81:0/942025009 wait complete. 2024-05-09T00:12:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.515+0000 7f860fdc2b80 1 -- start start 2024-05-09T00:12:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.515+0000 7f860fdc2b80 1 Processor -- start 2024-05-09T00:12:20.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f860fdc2b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563b9c910 0x55e563bad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f860fdc2b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba1e80 0x55e563bab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f860fdc2b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba27a0 0x55e563babf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f860fdc2b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e563bac670 con 0x55e563ba27a0 2024-05-09T00:12:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f860fdc2b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e563bac7e0 con 0x55e563ba1e80 2024-05-09T00:12:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f860fdc2b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e563c0ea60 con 0x55e563b9c910 2024-05-09T00:12:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f860fdc2b80 10 client.0 _ll_register_callbacks cb 0x55e563a91bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f86021a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba27a0 0x55e563babf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f86021a5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba27a0 0x55e563babf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58150/0 (socket says 172.21.15.81:58150) 2024-05-09T00:12:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f86021a5700 1 -- 172.21.15.81:0/1424205720 learned_addr learned my addr 172.21.15.81:0/1424205720 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:20.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f86011a3700 1 --2- 172.21.15.81:0/1424205720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba1e80 0x55e563bab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f86019a4700 1 --2- 172.21.15.81:0/1424205720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563b9c910 0x55e563bad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f86021a5700 1 -- 172.21.15.81:0/1424205720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563b9c910 msgr2=0x55e563bad5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f86021a5700 1 --2- 172.21.15.81:0/1424205720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563b9c910 0x55e563bad5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f86021a5700 1 -- 172.21.15.81:0/1424205720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba1e80 msgr2=0x55e563bab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f86021a5700 1 --2- 172.21.15.81:0/1424205720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba1e80 0x55e563bab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f86021a5700 1 -- 172.21.15.81:0/1424205720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e563919be0 con 0x55e563ba27a0 2024-05-09T00:12:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f86021a5700 1 --2- 172.21.15.81:0/1424205720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba27a0 0x55e563babf60 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f85f4018040 tx=0x7f85f40099a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472679494130b9ae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.516+0000 7f85e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f85e57fa700 1 -- 172.21.15.81:0/1424205720 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4011040 con 0x55e563ba27a0 2024-05-09T00:12:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f85e57fa700 1 -- 172.21.15.81:0/1424205720 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f85f4006e40 con 0x55e563ba27a0 2024-05-09T00:12:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f860fdc2b80 1 -- 172.21.15.81:0/1424205720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e563a452f0 con 0x55e563ba27a0 2024-05-09T00:12:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f85e57fa700 1 -- 172.21.15.81:0/1424205720 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85f4015410 con 0x55e563ba27a0 2024-05-09T00:12:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f860fdc2b80 10 client.18159 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f860fdc2b80 1 -- 172.21.15.81:0/1424205720 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e563ab25e0 con 0x55e563ba27a0 2024-05-09T00:12:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f85e57fa700 1 -- 172.21.15.81:0/1424205720 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e563a452f0 con 0x55e563ba27a0 2024-05-09T00:12:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f85e57fa700 1 -- 172.21.15.81:0/1424205720 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f85f4029ab0 con 0x55e563ba27a0 2024-05-09T00:12:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f860fdc2b80 10 client.18159 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f860fdc2b80 10 client.18159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f860fdc2b80 20 client.18159 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/1424205720 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e563c100d0 0x55e563c124f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f860fdc2b80 4 client.18159 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:12:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f860fdc2b80 1 -- 172.21.15.81:0/1424205720 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55e56393ad70 con 0x55e563c100d0 2024-05-09T00:12:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.517+0000 7f86019a4700 1 --2- 172.21.15.81:0/1424205720 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e563c100d0 0x55e563c124f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.518+0000 7f85e57fa700 10 client.18159 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.518+0000 7f86019a4700 1 --2- 172.21.15.81:0/1424205720 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e563c100d0 0x55e563c124f0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d84b50190fdcf84 server_cookie=9e57399267af09cf in_seq=0 out_seq=0 2024-05-09T00:12:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.519+0000 7f85e57fa700 1 -- 172.21.15.81:0/1424205720 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e56393ad70 con 0x55e563c100d0 2024-05-09T00:12:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.519+0000 7f85e57fa700 10 client.18159 handle_command_reply: tid=0 2024-05-09T00:12:20.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.519+0000 7f860fdc2b80 1 client.18159 shutdown 2024-05-09T00:12:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.519+0000 7f860fdc2b80 1 -- 172.21.15.81:0/1424205720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba27a0 msgr2=0x55e563babf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.519+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/1424205720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba27a0 0x55e563babf60 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f85f4018040 tx=0x7f85f40099a0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.519+0000 7f860fdc2b80 1 -- 172.21.15.81:0/1424205720 shutdown_connections 2024-05-09T00:12:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.519+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/1424205720 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e563c100d0 0x55e563c124f0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.519+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/1424205720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e563ba27a0 0x55e563babf60 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.519+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/1424205720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e563b9c910 0x55e563bad5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.519+0000 7f85e57fa700 0 client.18159 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.519+0000 7f860fdc2b80 1 --2- 172.21.15.81:0/1424205720 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e563ba1e80 0x55e563bab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.519+0000 7f860fdc2b80 1 -- 172.21.15.81:0/1424205720 >> 172.21.15.81:0/1424205720 conn(0x55e563afa290 msgr2=0x55e563ba2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.519+0000 7f860fdc2b80 1 -- 172.21.15.81:0/1424205720 shutdown_connections 2024-05-09T00:12:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.519+0000 7f860fdc2b80 1 -- 172.21.15.81:0/1424205720 wait complete. 2024-05-09T00:12:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.520+0000 7f860fdc2b80 20 client.18159 trim_cache size 0 max 16384 2024-05-09T00:12:20.526 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:12:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:12:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "ff6e14bf-66e1-4981-8bf1-aac3333a8fe7", 2024-05-09T00:12:20.526 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:12:20.526 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:12:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.520+0000 7f8603c08700 1 -- 172.21.15.81:0/3865183071 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f85e80a1290 msgr2=0x7f85e80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.520+0000 7f8603c08700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f85e80a1290 0x7f85e80a3750 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f85f8006010 tx=0x7f85f800b540 comp rx=0 tx=0).stop 2024-05-09T00:12:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.520+0000 7f8603c08700 1 -- 172.21.15.81:0/3865183071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85fc100060 msgr2=0x7f85fc196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.520+0000 7f8603c08700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85fc100060 0x7f85fc196370 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f85f000b530 tx=0x7f85f000b8f0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.520+0000 7f8603c08700 1 -- 172.21.15.81:0/3865183071 shutdown_connections 2024-05-09T00:12:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.520+0000 7f8603c08700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f85e80a1290 0x7f85e80a3750 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.520+0000 7f8603c08700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85fc19ac50 0x7f85fc19b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.520+0000 7f8603c08700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85fc100060 0x7f85fc196370 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.520+0000 7f8603c08700 1 --2- 172.21.15.81:0/3865183071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f85fc105160 0x7f85fc1968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.520+0000 7f8603c08700 1 -- 172.21.15.81:0/3865183071 >> 172.21.15.81:0/3865183071 conn(0x7f85fc076f40 msgr2=0x7f85fc0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:20.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.520+0000 7f8603c08700 1 -- 172.21.15.81:0/3865183071 shutdown_connections 2024-05-09T00:12:20.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.520+0000 7f8603c08700 1 -- 172.21.15.81:0/3865183071 wait complete. 2024-05-09T00:12:20.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:12:20.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.656+0000 7f8169e90700 1 -- 172.21.15.81:0/1161738616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81641062a0 msgr2=0x7f816410de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.656+0000 7f8169e90700 1 --2- 172.21.15.81:0/1161738616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81641062a0 0x7f816410de20 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f815c00b0d0 tx=0x7f815c00b3e0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.656+0000 7f8169e90700 1 -- 172.21.15.81:0/1161738616 shutdown_connections 2024-05-09T00:12:20.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.656+0000 7f8169e90700 1 --2- 172.21.15.81:0/1161738616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81641062a0 0x7f816410de20 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.656+0000 7f8169e90700 1 --2- 172.21.15.81:0/1161738616 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8164069740 0x7f8164069b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.656+0000 7f8169e90700 1 --2- 172.21.15.81:0/1161738616 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f816406a0f0 0x7f8164105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.656+0000 7f8169e90700 1 -- 172.21.15.81:0/1161738616 >> 172.21.15.81:0/1161738616 conn(0x7f8164076f70 msgr2=0x7f8164077380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.656+0000 7f8169e90700 1 -- 172.21.15.81:0/1161738616 shutdown_connections 2024-05-09T00:12:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.656+0000 7f8169e90700 1 -- 172.21.15.81:0/1161738616 wait complete. 2024-05-09T00:12:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f8169e90700 1 Processor -- start 2024-05-09T00:12:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f8169e90700 1 -- start start 2024-05-09T00:12:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f8169e90700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8164069740 0x7f8164197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f8169e90700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81641062a0 0x7f8164197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f8169e90700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f816419be60 0x7f816419c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f8169e90700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816419c8e0 con 0x7f81641062a0 2024-05-09T00:12:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f8169e90700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816419ca50 con 0x7f8164069740 2024-05-09T00:12:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f8169e90700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816419cc10 con 0x7f816419be60 2024-05-09T00:12:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f8162ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81641062a0 0x7f8164197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f8162ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81641062a0 0x7f8164197ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58156/0 (socket says 172.21.15.81:58156) 2024-05-09T00:12:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f8162ffd700 1 -- 172.21.15.81:0/3732071762 learned_addr learned my addr 172.21.15.81:0/3732071762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f81637fe700 1 --2- 172.21.15.81:0/3732071762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8164069740 0x7f8164197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f8163fff700 1 --2- 172.21.15.81:0/3732071762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f816419be60 0x7f816419c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f8162ffd700 1 -- 172.21.15.81:0/3732071762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f816419be60 msgr2=0x7f816419c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.657+0000 7f8162ffd700 1 --2- 172.21.15.81:0/3732071762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f816419be60 0x7f816419c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.658+0000 7f8162ffd700 1 -- 172.21.15.81:0/3732071762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8164069740 msgr2=0x7f8164197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.658+0000 7f8162ffd700 1 --2- 172.21.15.81:0/3732071762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8164069740 0x7f8164197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.658+0000 7f8162ffd700 1 -- 172.21.15.81:0/3732071762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c009d00 con 0x7f81641062a0 2024-05-09T00:12:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.658+0000 7f8162ffd700 1 --2- 172.21.15.81:0/3732071762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81641062a0 0x7f8164197ac0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f815400d980 tx=0x7f815400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.658+0000 7f8160ff9700 1 -- 172.21.15.81:0/3732071762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815400f890 con 0x7f81641062a0 2024-05-09T00:12:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.658+0000 7f8169e90700 1 -- 172.21.15.81:0/3732071762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81641a4170 con 0x7f81641062a0 2024-05-09T00:12:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.658+0000 7f8160ff9700 1 -- 172.21.15.81:0/3732071762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8154010460 con 0x7f81641062a0 2024-05-09T00:12:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.658+0000 7f8160ff9700 1 -- 172.21.15.81:0/3732071762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815400e610 con 0x7f81641062a0 2024-05-09T00:12:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.658+0000 7f8169e90700 1 -- 172.21.15.81:0/3732071762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81641a46a0 con 0x7f81641062a0 2024-05-09T00:12:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.660+0000 7f8160ff9700 1 -- 172.21.15.81:0/3732071762 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f81540105d0 con 0x7f81641062a0 2024-05-09T00:12:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.660+0000 7f8160ff9700 1 --2- 172.21.15.81:0/3732071762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f81500a1290 0x7f81500a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.661+0000 7f8160ff9700 1 -- 172.21.15.81:0/3732071762 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f81540cc650 con 0x7f81641062a0 2024-05-09T00:12:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.661+0000 7f81637fe700 1 --2- 172.21.15.81:0/3732071762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f81500a1290 0x7f81500a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.661+0000 7f81637fe700 1 --2- 172.21.15.81:0/3732071762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f81500a1290 0x7f81500a3750 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f814c005950 tx=0x7f814c00b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.661+0000 7f817604ab80 1 Processor -- start 2024-05-09T00:12:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.661+0000 7f817604ab80 1 -- start start 2024-05-09T00:12:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f817604ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99bc1f0 0x556cb99bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f817604ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f817604ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99b6ca0 0x556cb99b7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f817604ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cb9909150 con 0x556cb99bcb10 2024-05-09T00:12:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f817604ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cb9906b10 con 0x556cb99bc1f0 2024-05-09T00:12:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f817604ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cb9902400 con 0x556cb99b6ca0 2024-05-09T00:12:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f8162ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f8162ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99b6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58160/0 (socket says 172.21.15.81:58160) 2024-05-09T00:12:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f8162ffd700 1 -- 172.21.15.81:0/2003083639 learned_addr learned my addr 172.21.15.81:0/2003083639 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f81637fe700 1 --2- 172.21.15.81:0/2003083639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99bc1f0 0x556cb99bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f8163fff700 1 --2- 172.21.15.81:0/2003083639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99b6ca0 0x556cb99b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f8162ffd700 1 -- 172.21.15.81:0/2003083639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99b6ca0 msgr2=0x556cb99b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f8162ffd700 1 --2- 172.21.15.81:0/2003083639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99b6ca0 0x556cb99b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f8162ffd700 1 -- 172.21.15.81:0/2003083639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99bc1f0 msgr2=0x556cb99bc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f8162ffd700 1 --2- 172.21.15.81:0/2003083639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99bc1f0 0x556cb99bc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f8162ffd700 1 -- 172.21.15.81:0/2003083639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cb97833b0 con 0x556cb99bcb10 2024-05-09T00:12:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f81637fe700 1 --2- 172.21.15.81:0/2003083639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99bc1f0 0x556cb99bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f8162ffd700 1 --2- 172.21.15.81:0/2003083639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99b6760 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f81540a1680 tx=0x7f8154099380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113e24d648d0bcd8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f8159ffb700 1 -- 172.21.15.81:0/2003083639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815409d560 con 0x556cb99bcb10 2024-05-09T00:12:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f8159ffb700 1 -- 172.21.15.81:0/2003083639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81540a1bb0 con 0x556cb99bcb10 2024-05-09T00:12:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.662+0000 7f8159ffb700 1 -- 172.21.15.81:0/2003083639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8154099c00 con 0x556cb99bcb10 2024-05-09T00:12:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.663+0000 7f817604ab80 1 -- 172.21.15.81:0/2003083639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 msgr2=0x556cb99b6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.663+0000 7f817604ab80 1 --2- 172.21.15.81:0/2003083639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99b6760 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f81540a1680 tx=0x7f8154099380 comp rx=0 tx=0).stop 2024-05-09T00:12:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.663+0000 7f817604ab80 1 -- 172.21.15.81:0/2003083639 shutdown_connections 2024-05-09T00:12:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.663+0000 7f817604ab80 1 --2- 172.21.15.81:0/2003083639 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99bc1f0 0x556cb99bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.663+0000 7f817604ab80 1 --2- 172.21.15.81:0/2003083639 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99b6ca0 0x556cb99b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.663+0000 7f817604ab80 1 --2- 172.21.15.81:0/2003083639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99b6760 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.663+0000 7f817604ab80 1 -- 172.21.15.81:0/2003083639 >> 172.21.15.81:0/2003083639 conn(0x556cb9910210 msgr2=0x556cb99acdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.663+0000 7f817604ab80 1 -- 172.21.15.81:0/2003083639 shutdown_connections 2024-05-09T00:12:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.663+0000 7f817604ab80 1 -- 172.21.15.81:0/2003083639 wait complete. 2024-05-09T00:12:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.663+0000 7f817604ab80 1 -- start start 2024-05-09T00:12:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f817604ab80 1 Processor -- start 2024-05-09T00:12:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f817604ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99b6ca0 0x556cb99bfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f817604ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99bc1f0 0x556cb99c03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f817604ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99c0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f817604ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cb989e560 con 0x556cb99bcb10 2024-05-09T00:12:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f817604ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cb989e200 con 0x556cb99b6ca0 2024-05-09T00:12:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f817604ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cb97856a0 con 0x556cb99bc1f0 2024-05-09T00:12:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f817604ab80 10 client.0 _ll_register_callbacks cb 0x556cb98a7b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f8163fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99c0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f8163fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99c0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58162/0 (socket says 172.21.15.81:58162) 2024-05-09T00:12:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f8163fff700 1 -- 172.21.15.81:0/1829055031 learned_addr learned my addr 172.21.15.81:0/1829055031 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f8162ffd700 1 --2- 172.21.15.81:0/1829055031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99bc1f0 0x556cb99c03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f81637fe700 1 --2- 172.21.15.81:0/1829055031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99b6ca0 0x556cb99bfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f8163fff700 1 -- 172.21.15.81:0/1829055031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99bc1f0 msgr2=0x556cb99c03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f8163fff700 1 --2- 172.21.15.81:0/1829055031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99bc1f0 0x556cb99c03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f8163fff700 1 -- 172.21.15.81:0/1829055031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99b6ca0 msgr2=0x556cb99bfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f8163fff700 1 --2- 172.21.15.81:0/1829055031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99b6ca0 0x556cb99bfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f8163fff700 1 -- 172.21.15.81:0/1829055031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81641a46a0 con 0x556cb99bcb10 2024-05-09T00:12:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.664+0000 7f81637fe700 1 --2- 172.21.15.81:0/1829055031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99b6ca0 0x556cb99bfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f8163fff700 1 --2- 172.21.15.81:0/1829055031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99c0920 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f815c009330 tx=0x7f815c009410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e2d0acf058ed681 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f8142ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f8142ffd700 1 -- 172.21.15.81:0/1829055031 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c00e040 con 0x556cb99bcb10 2024-05-09T00:12:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f8142ffd700 1 -- 172.21.15.81:0/1829055031 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f815c003e10 con 0x556cb99bcb10 2024-05-09T00:12:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f817604ab80 1 -- 172.21.15.81:0/1829055031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556cb985b270 con 0x556cb99bcb10 2024-05-09T00:12:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f8142ffd700 1 -- 172.21.15.81:0/1829055031 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f815c0074e0 con 0x556cb99bcb10 2024-05-09T00:12:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f817604ab80 10 client.18171 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f817604ab80 1 -- 172.21.15.81:0/1829055031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556cb972fb60 con 0x556cb99bcb10 2024-05-09T00:12:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f8142ffd700 1 -- 172.21.15.81:0/1829055031 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556cb985b270 con 0x556cb99bcb10 2024-05-09T00:12:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f8142ffd700 1 -- 172.21.15.81:0/1829055031 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f815c022020 con 0x556cb99bcb10 2024-05-09T00:12:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f817604ab80 10 client.18171 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f817604ab80 10 client.18171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f817604ab80 20 client.18171 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f817604ab80 1 --2- 172.21.15.81:0/1829055031 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556cb99d04d0 0x556cb99d28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f817604ab80 4 client.18171 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f817604ab80 1 -- 172.21.15.81:0/1829055031 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556cb9981810 con 0x556cb99d04d0 2024-05-09T00:12:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.665+0000 7f81637fe700 1 --2- 172.21.15.81:0/1829055031 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556cb99d04d0 0x556cb99d28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.666+0000 7f8142ffd700 10 client.18171 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.666+0000 7f81637fe700 1 --2- 172.21.15.81:0/1829055031 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556cb99d04d0 0x556cb99d28f0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd2251de3bd45b9b server_cookie=f47f39d5c76306ca in_seq=0 out_seq=0 2024-05-09T00:12:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.666+0000 7f8142ffd700 1 -- 172.21.15.81:0/1829055031 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556cb9981810 con 0x556cb99d04d0 2024-05-09T00:12:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.666+0000 7f8142ffd700 10 client.18171 handle_command_reply: tid=0 2024-05-09T00:12:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.666+0000 7f817604ab80 1 client.18171 shutdown 2024-05-09T00:12:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.667+0000 7f817604ab80 1 -- 172.21.15.81:0/1829055031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 msgr2=0x556cb99c0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.667+0000 7f817604ab80 1 --2- 172.21.15.81:0/1829055031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99c0920 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f815c009330 tx=0x7f815c009410 comp rx=0 tx=0).stop 2024-05-09T00:12:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.667+0000 7f817604ab80 1 -- 172.21.15.81:0/1829055031 shutdown_connections 2024-05-09T00:12:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.667+0000 7f817604ab80 1 --2- 172.21.15.81:0/1829055031 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556cb99d04d0 0x556cb99d28f0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.667+0000 7f817604ab80 1 --2- 172.21.15.81:0/1829055031 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99b6ca0 0x556cb99bfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.667+0000 7f817604ab80 1 --2- 172.21.15.81:0/1829055031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99c0920 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.667+0000 7f817604ab80 1 --2- 172.21.15.81:0/1829055031 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99bc1f0 0x556cb99c03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.667+0000 7f817604ab80 1 -- 172.21.15.81:0/1829055031 >> 172.21.15.81:0/1829055031 conn(0x556cb9910210 msgr2=0x556cb99ac5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.667+0000 7f8142ffd700 0 client.18171 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.667+0000 7f817604ab80 1 -- 172.21.15.81:0/1829055031 shutdown_connections 2024-05-09T00:12:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.667+0000 7f817604ab80 1 -- 172.21.15.81:0/1829055031 wait complete. 2024-05-09T00:12:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.667+0000 7f817604ab80 20 client.18171 trim_cache size 0 max 16384 2024-05-09T00:12:20.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f817604ab80 1 Processor -- start 2024-05-09T00:12:20.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f817604ab80 1 -- start start 2024-05-09T00:12:20.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f817604ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99b6ca0 0x556cb99bf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f817604ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99bc1f0 0x556cb99bb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f817604ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f817604ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cb99bfcc0 con 0x556cb99bcb10 2024-05-09T00:12:20.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f817604ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cb99c1510 con 0x556cb99bc1f0 2024-05-09T00:12:20.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f817604ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cb99a9dc0 con 0x556cb99b6ca0 2024-05-09T00:12:20.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f8163fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f8163fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99acd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58174/0 (socket says 172.21.15.81:58174) 2024-05-09T00:12:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f8163fff700 1 -- 172.21.15.81:0/4185855749 learned_addr learned my addr 172.21.15.81:0/4185855749 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f8162ffd700 1 --2- 172.21.15.81:0/4185855749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99bc1f0 0x556cb99bb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f81637fe700 1 --2- 172.21.15.81:0/4185855749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99b6ca0 0x556cb99bf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f8163fff700 1 -- 172.21.15.81:0/4185855749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99b6ca0 msgr2=0x556cb99bf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f8163fff700 1 --2- 172.21.15.81:0/4185855749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99b6ca0 0x556cb99bf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f8163fff700 1 -- 172.21.15.81:0/4185855749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99bc1f0 msgr2=0x556cb99bb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f8163fff700 1 --2- 172.21.15.81:0/4185855749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99bc1f0 0x556cb99bb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f8163fff700 1 -- 172.21.15.81:0/4185855749 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cb98c8560 con 0x556cb99bcb10 2024-05-09T00:12:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.684+0000 7f8163fff700 1 --2- 172.21.15.81:0/4185855749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99acd20 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f815c01c490 tx=0x7f815c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f076ceda4efe70 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.685+0000 7f815a7fc700 1 -- 172.21.15.81:0/4185855749 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c00e070 con 0x556cb99bcb10 2024-05-09T00:12:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.685+0000 7f815a7fc700 1 -- 172.21.15.81:0/4185855749 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f815c007960 con 0x556cb99bcb10 2024-05-09T00:12:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.685+0000 7f815a7fc700 1 -- 172.21.15.81:0/4185855749 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c005680 con 0x556cb99bcb10 2024-05-09T00:12:20.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.685+0000 7f817604ab80 1 -- 172.21.15.81:0/4185855749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 msgr2=0x556cb99acd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.685+0000 7f817604ab80 1 --2- 172.21.15.81:0/4185855749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99acd20 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f815c01c490 tx=0x7f815c009bf0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.685+0000 7f817604ab80 1 -- 172.21.15.81:0/4185855749 shutdown_connections 2024-05-09T00:12:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.685+0000 7f817604ab80 1 --2- 172.21.15.81:0/4185855749 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bcb10 0x556cb99acd20 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.685+0000 7f817604ab80 1 --2- 172.21.15.81:0/4185855749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99b6ca0 0x556cb99bf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.685+0000 7f817604ab80 1 --2- 172.21.15.81:0/4185855749 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99bc1f0 0x556cb99bb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.685+0000 7f817604ab80 1 -- 172.21.15.81:0/4185855749 >> 172.21.15.81:0/4185855749 conn(0x556cb9910210 msgr2=0x556cb99baf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.685+0000 7f817604ab80 1 -- 172.21.15.81:0/4185855749 shutdown_connections 2024-05-09T00:12:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.685+0000 7f817604ab80 1 -- 172.21.15.81:0/4185855749 wait complete. 2024-05-09T00:12:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.685+0000 7f817604ab80 1 -- start start 2024-05-09T00:12:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f817604ab80 1 Processor -- start 2024-05-09T00:12:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f817604ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99b6ca0 0x556cb99c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f817604ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bc1f0 0x556cb99c5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f817604ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99bcb10 0x556cb99c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f817604ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cb9a25990 con 0x556cb99bc1f0 2024-05-09T00:12:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f817604ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cb9a25ad0 con 0x556cb99b6ca0 2024-05-09T00:12:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f817604ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cb9a25c90 con 0x556cb99bcb10 2024-05-09T00:12:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f817604ab80 10 client.0 _ll_register_callbacks cb 0x556cb98a7b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f8162ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bc1f0 0x556cb99c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f8162ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bc1f0 0x556cb99c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58184/0 (socket says 172.21.15.81:58184) 2024-05-09T00:12:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f8162ffd700 1 -- 172.21.15.81:0/3736915339 learned_addr learned my addr 172.21.15.81:0/3736915339 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f81637fe700 1 --2- 172.21.15.81:0/3736915339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99b6ca0 0x556cb99c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f8163fff700 1 --2- 172.21.15.81:0/3736915339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99bcb10 0x556cb99c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f8162ffd700 1 -- 172.21.15.81:0/3736915339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99bcb10 msgr2=0x556cb99c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f8162ffd700 1 --2- 172.21.15.81:0/3736915339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99bcb10 0x556cb99c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f8162ffd700 1 -- 172.21.15.81:0/3736915339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99b6ca0 msgr2=0x556cb99c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f8162ffd700 1 --2- 172.21.15.81:0/3736915339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99b6ca0 0x556cb99c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f8162ffd700 1 -- 172.21.15.81:0/3736915339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556cb972fb60 con 0x556cb99bc1f0 2024-05-09T00:12:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f8162ffd700 1 --2- 172.21.15.81:0/3736915339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bc1f0 0x556cb99c5610 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f815400be80 tx=0x7f8154097ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bc6264ecd077ff server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f8142ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.686+0000 7f8142ffd700 1 -- 172.21.15.81:0/3736915339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8154098c20 con 0x556cb99bc1f0 2024-05-09T00:12:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.687+0000 7f8142ffd700 1 -- 172.21.15.81:0/3736915339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f8154098d80 con 0x556cb99bc1f0 2024-05-09T00:12:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.687+0000 7f817604ab80 1 -- 172.21.15.81:0/3736915339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81540a1bb0 con 0x556cb99bc1f0 2024-05-09T00:12:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.687+0000 7f8142ffd700 1 -- 172.21.15.81:0/3736915339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8154099990 con 0x556cb99bc1f0 2024-05-09T00:12:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.687+0000 7f817604ab80 10 client.18177 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.687+0000 7f817604ab80 1 -- 172.21.15.81:0/3736915339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556cb9787cd0 con 0x556cb99bc1f0 2024-05-09T00:12:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.687+0000 7f8142ffd700 1 -- 172.21.15.81:0/3736915339 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81540a1bb0 con 0x556cb99bc1f0 2024-05-09T00:12:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.687+0000 7f8142ffd700 1 -- 172.21.15.81:0/3736915339 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f81540b7d20 con 0x556cb99bc1f0 2024-05-09T00:12:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.687+0000 7f817604ab80 10 client.18177 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.687+0000 7f817604ab80 10 client.18177 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.687+0000 7f817604ab80 20 client.18177 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:20.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.687+0000 7f817604ab80 1 --2- 172.21.15.81:0/3736915339 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556cb9a27060 0x556cb9a29480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.687+0000 7f817604ab80 4 client.18177 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.687+0000 7f817604ab80 1 -- 172.21.15.81:0/3736915339 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556cb98faec0 con 0x556cb9a27060 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.687+0000 7f81637fe700 1 --2- 172.21.15.81:0/3736915339 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556cb9a27060 0x556cb9a29480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f8142ffd700 10 client.18177 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f81637fe700 1 --2- 172.21.15.81:0/3736915339 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556cb9a27060 0x556cb9a29480 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f51324d7a378adc server_cookie=fe3d57e761bab657 in_seq=0 out_seq=0 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f8142ffd700 1 -- 172.21.15.81:0/3736915339 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556cb98faec0 con 0x556cb9a27060 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f8142ffd700 10 client.18177 handle_command_reply: tid=0 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f817604ab80 1 client.18177 shutdown 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f817604ab80 1 -- 172.21.15.81:0/3736915339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bc1f0 msgr2=0x556cb99c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f817604ab80 1 --2- 172.21.15.81:0/3736915339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bc1f0 0x556cb99c5610 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f815400be80 tx=0x7f8154097ce0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f817604ab80 1 -- 172.21.15.81:0/3736915339 shutdown_connections 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f817604ab80 1 --2- 172.21.15.81:0/3736915339 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x556cb9a27060 0x556cb9a29480 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f817604ab80 1 --2- 172.21.15.81:0/3736915339 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556cb99b6ca0 0x556cb99c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f817604ab80 1 --2- 172.21.15.81:0/3736915339 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556cb99bcb10 0x556cb99c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f8142ffd700 0 client.18177 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:20.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f817604ab80 1 --2- 172.21.15.81:0/3736915339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556cb99bc1f0 0x556cb99c5610 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f817604ab80 1 -- 172.21.15.81:0/3736915339 >> 172.21.15.81:0/3736915339 conn(0x556cb9910210 msgr2=0x556cb99c0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:20.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f817604ab80 1 -- 172.21.15.81:0/3736915339 shutdown_connections 2024-05-09T00:12:20.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f817604ab80 1 -- 172.21.15.81:0/3736915339 wait complete. 2024-05-09T00:12:20.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.688+0000 7f817604ab80 20 client.18177 trim_cache size 0 max 16384 2024-05-09T00:12:20.696 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:12:20.696 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:12:20.696 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:12:20.696 INFO:teuthology.orchestra.run.smithi081.stdout: "ff6e14bf-66e1-4981-8bf1-aac3333a8fe7": { 2024-05-09T00:12:20.696 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:12:20.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "ff6e14bf-66e1-4981-8bf1-aac3333a8fe7", 2024-05-09T00:12:20.697 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:12:20.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:12:20.697 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:12:20.697 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:12:20.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.689+0000 7f8169e90700 1 -- 172.21.15.81:0/3732071762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f81500a1290 msgr2=0x7f81500a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.689+0000 7f8169e90700 1 --2- 172.21.15.81:0/3732071762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f81500a1290 0x7f81500a3750 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f814c005950 tx=0x7f814c00b410 comp rx=0 tx=0).stop 2024-05-09T00:12:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.689+0000 7f8169e90700 1 -- 172.21.15.81:0/3732071762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81641062a0 msgr2=0x7f8164197ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.689+0000 7f8169e90700 1 --2- 172.21.15.81:0/3732071762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81641062a0 0x7f8164197ac0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f815400d980 tx=0x7f815400dc90 comp rx=0 tx=0).stop 2024-05-09T00:12:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.689+0000 7f8169e90700 1 -- 172.21.15.81:0/3732071762 shutdown_connections 2024-05-09T00:12:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.689+0000 7f8169e90700 1 --2- 172.21.15.81:0/3732071762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f81500a1290 0x7f81500a3750 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.689+0000 7f8169e90700 1 --2- 172.21.15.81:0/3732071762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8164069740 0x7f8164197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.689+0000 7f8169e90700 1 --2- 172.21.15.81:0/3732071762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f816419be60 0x7f816419c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.689+0000 7f8169e90700 1 --2- 172.21.15.81:0/3732071762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f81641062a0 0x7f8164197ac0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.689+0000 7f8169e90700 1 -- 172.21.15.81:0/3732071762 >> 172.21.15.81:0/3732071762 conn(0x7f8164076f70 msgr2=0x7f81640ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.689+0000 7f8169e90700 1 -- 172.21.15.81:0/3732071762 shutdown_connections 2024-05-09T00:12:20.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:20.689+0000 7f8169e90700 1 -- 172.21.15.81:0/3732071762 wait complete. 2024-05-09T00:12:20.699 INFO:tasks.cephfs.filesystem:scrub status for tag:ff6e14bf-66e1-4981-8bf1-aac3333a8fe7 - {'path': '/', 'tag': 'ff6e14bf-66e1-4981-8bf1-aac3333a8fe7', 'options': 'recursive,force'} 2024-05-09T00:12:21.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:20 smithi081 ceph-mon[42474]: pgmap v290: 97 pgs: 97 active+clean; 4.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-05-09T00:12:21.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:20 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:12:21.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:20 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:12:21.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:20 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:12:21.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:20 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:12:21.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:20 smithi150 ceph-mon[46187]: pgmap v290: 97 pgs: 97 active+clean; 4.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-05-09T00:12:21.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:20 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:12:21.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:20 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:12:21.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:20 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:12:21.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:20 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:12:21.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:20 smithi171 ceph-mon[47351]: pgmap v290: 97 pgs: 97 active+clean; 4.8 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-05-09T00:12:21.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:20 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:12:21.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:20 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:12:21.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:20 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:12:21.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:20 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:12:23.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:22 smithi150 ceph-mon[46187]: pgmap v291: 97 pgs: 97 active+clean; 5.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-05-09T00:12:23.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:22 smithi171 ceph-mon[47351]: pgmap v291: 97 pgs: 97 active+clean; 5.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-05-09T00:12:23.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:22 smithi081 ceph-mon[42474]: pgmap v291: 97 pgs: 97 active+clean; 5.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 55 KiB/s wr, 15 op/s 2024-05-09T00:12:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.718+0000 7f21522f5700 1 -- 172.21.15.81:0/1011925071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214c0682e0 msgr2=0x7f214c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.718+0000 7f21522f5700 1 --2- 172.21.15.81:0/1011925071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214c0682e0 0x7f214c068760 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f213c009990 tx=0x7f213c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.718+0000 7f21522f5700 1 -- 172.21.15.81:0/1011925071 shutdown_connections 2024-05-09T00:12:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.718+0000 7f21522f5700 1 --2- 172.21.15.81:0/1011925071 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f214c068ca0 0x7f214c10dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.718+0000 7f21522f5700 1 --2- 172.21.15.81:0/1011925071 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f214c107000 0x7f214c1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.718+0000 7f21522f5700 1 --2- 172.21.15.81:0/1011925071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214c0682e0 0x7f214c068760 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.718+0000 7f21522f5700 1 -- 172.21.15.81:0/1011925071 >> 172.21.15.81:0/1011925071 conn(0x7f214c076f10 msgr2=0x7f214c077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.718+0000 7f21522f5700 1 -- 172.21.15.81:0/1011925071 shutdown_connections 2024-05-09T00:12:24.718 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.718+0000 7f21522f5700 1 -- 172.21.15.81:0/1011925071 wait complete. 2024-05-09T00:12:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.719+0000 7f21522f5700 1 Processor -- start 2024-05-09T00:12:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.719+0000 7f21522f5700 1 -- start start 2024-05-09T00:12:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.719+0000 7f21522f5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214c0682e0 0x7f214c1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.719+0000 7f21522f5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f214c068ca0 0x7f214c197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.719+0000 7f21522f5700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f214c107000 0x7f214c19bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.719+0000 7f21522f5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c19c1e0 con 0x7f214c0682e0 2024-05-09T00:12:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.719+0000 7f21522f5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c19c350 con 0x7f214c068ca0 2024-05-09T00:12:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.719+0000 7f21522f5700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c19c510 con 0x7f214c107000 2024-05-09T00:12:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.719+0000 7f214bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214c0682e0 0x7f214c1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.719+0000 7f214bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214c0682e0 0x7f214c1972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58202/0 (socket says 172.21.15.81:58202) 2024-05-09T00:12:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.719+0000 7f214bfff700 1 -- 172.21.15.81:0/1571340346 learned_addr learned my addr 172.21.15.81:0/1571340346 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.720+0000 7f214b7fe700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f214c068ca0 0x7f214c197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.719 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.720+0000 7f2150892700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f214c107000 0x7f214c19bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.720+0000 7f214bfff700 1 -- 172.21.15.81:0/1571340346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f214c107000 msgr2=0x7f214c19bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.720+0000 7f214bfff700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f214c107000 0x7f214c19bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.720+0000 7f214bfff700 1 -- 172.21.15.81:0/1571340346 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f214c068ca0 msgr2=0x7f214c197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.720+0000 7f214bfff700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f214c068ca0 0x7f214c197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.720+0000 7f214bfff700 1 -- 172.21.15.81:0/1571340346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c0095f0 con 0x7f214c0682e0 2024-05-09T00:12:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.720+0000 7f2150892700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f214c107000 0x7f214c19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.720+0000 7f214bfff700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214c0682e0 0x7f214c1972c0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f214000d950 tx=0x7f214000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.720+0000 7f21497fa700 1 -- 172.21.15.81:0/1571340346 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140009940 con 0x7f214c0682e0 2024-05-09T00:12:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.720+0000 7f21522f5700 1 -- 172.21.15.81:0/1571340346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c19c7f0 con 0x7f214c0682e0 2024-05-09T00:12:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.720+0000 7f21497fa700 1 -- 172.21.15.81:0/1571340346 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2140010460 con 0x7f214c0682e0 2024-05-09T00:12:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.720+0000 7f21497fa700 1 -- 172.21.15.81:0/1571340346 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214000f620 con 0x7f214c0682e0 2024-05-09T00:12:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.720+0000 7f21522f5700 1 -- 172.21.15.81:0/1571340346 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c1a4030 con 0x7f214c0682e0 2024-05-09T00:12:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.722+0000 7f21497fa700 1 -- 172.21.15.81:0/1571340346 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f21400108d0 con 0x7f214c0682e0 2024-05-09T00:12:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.723+0000 7f21497fa700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f21340a1290 0x7f21340a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.723+0000 7f214b7fe700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f21340a1290 0x7f21340a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.723+0000 7f21497fa700 1 -- 172.21.15.81:0/1571340346 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f21400ccb90 con 0x7f214c0682e0 2024-05-09T00:12:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.723+0000 7f214b7fe700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f21340a1290 0x7f21340a3750 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f213c00b5c0 tx=0x7f213c005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f215e4afb80 1 Processor -- start 2024-05-09T00:12:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f215e4afb80 1 -- start start 2024-05-09T00:12:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f215e4afb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 0x55df353e3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f215e4afb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353e4270 0x55df353ddf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f215e4afb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353de480 0x55df353de8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f215e4afb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df353350f0 con 0x55df353e4270 2024-05-09T00:12:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f215e4afb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df35332ab0 con 0x55df353e3950 2024-05-09T00:12:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f215e4afb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df3532e3a0 con 0x55df353de480 2024-05-09T00:12:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f214b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353e4270 0x55df353ddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f214b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353e4270 0x55df353ddf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58218/0 (socket says 172.21.15.81:58218) 2024-05-09T00:12:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f214b7fe700 1 -- 172.21.15.81:0/2320649736 learned_addr learned my addr 172.21.15.81:0/2320649736 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f214bfff700 1 --2- 172.21.15.81:0/2320649736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 0x55df353e3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f2150892700 1 --2- 172.21.15.81:0/2320649736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353de480 0x55df353de8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f214b7fe700 1 -- 172.21.15.81:0/2320649736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353de480 msgr2=0x55df353de8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f214b7fe700 1 --2- 172.21.15.81:0/2320649736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353de480 0x55df353de8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f214b7fe700 1 -- 172.21.15.81:0/2320649736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 msgr2=0x55df353e3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f214b7fe700 1 --2- 172.21.15.81:0/2320649736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 0x55df353e3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f214b7fe700 1 -- 172.21.15.81:0/2320649736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df351af350 con 0x55df353e4270 2024-05-09T00:12:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f2150892700 1 --2- 172.21.15.81:0/2320649736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353de480 0x55df353de8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.724+0000 7f214b7fe700 1 --2- 172.21.15.81:0/2320649736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353e4270 0x55df353ddf40 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f213c015000 tx=0x7f213c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ba94faa02de9c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.725+0000 7f21327fc700 1 -- 172.21.15.81:0/2320649736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c029070 con 0x55df353e4270 2024-05-09T00:12:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.725+0000 7f21327fc700 1 -- 172.21.15.81:0/2320649736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f213c01e040 con 0x55df353e4270 2024-05-09T00:12:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.725+0000 7f21327fc700 1 -- 172.21.15.81:0/2320649736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c00f860 con 0x55df353e4270 2024-05-09T00:12:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.725+0000 7f215e4afb80 1 -- 172.21.15.81:0/2320649736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353e4270 msgr2=0x55df353ddf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.725+0000 7f215e4afb80 1 --2- 172.21.15.81:0/2320649736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353e4270 0x55df353ddf40 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f213c015000 tx=0x7f213c01f000 comp rx=0 tx=0).stop 2024-05-09T00:12:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.725+0000 7f215e4afb80 1 -- 172.21.15.81:0/2320649736 shutdown_connections 2024-05-09T00:12:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.725+0000 7f215e4afb80 1 --2- 172.21.15.81:0/2320649736 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 0x55df353e3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.725+0000 7f215e4afb80 1 --2- 172.21.15.81:0/2320649736 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353de480 0x55df353de8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.725+0000 7f215e4afb80 1 --2- 172.21.15.81:0/2320649736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353e4270 0x55df353ddf40 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.725+0000 7f215e4afb80 1 -- 172.21.15.81:0/2320649736 >> 172.21.15.81:0/2320649736 conn(0x55df3533c1b0 msgr2=0x55df353d8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.725+0000 7f215e4afb80 1 -- 172.21.15.81:0/2320649736 shutdown_connections 2024-05-09T00:12:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.725+0000 7f215e4afb80 1 -- 172.21.15.81:0/2320649736 wait complete. 2024-05-09T00:12:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.726+0000 7f215e4afb80 1 -- start start 2024-05-09T00:12:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.726+0000 7f215e4afb80 1 Processor -- start 2024-05-09T00:12:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.726+0000 7f215e4afb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353de480 0x55df353ea160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.726+0000 7f215e4afb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353e3950 0x55df353e7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.726+0000 7f215e4afb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e4270 0x55df353e7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.726+0000 7f215e4afb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df352ca500 con 0x55df353de480 2024-05-09T00:12:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.726+0000 7f215e4afb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df352ca1a0 con 0x55df353e4270 2024-05-09T00:12:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.726+0000 7f215e4afb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df351b1640 con 0x55df353e3950 2024-05-09T00:12:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.726+0000 7f215e4afb80 10 client.0 _ll_register_callbacks cb 0x55df352d3ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.726+0000 7f214bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353de480 0x55df353ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f214bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353de480 0x55df353ea160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58224/0 (socket says 172.21.15.81:58224) 2024-05-09T00:12:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f214bfff700 1 -- 172.21.15.81:0/1403158099 learned_addr learned my addr 172.21.15.81:0/1403158099 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f2150892700 1 --2- 172.21.15.81:0/1403158099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e4270 0x55df353e7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f214b7fe700 1 --2- 172.21.15.81:0/1403158099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353e3950 0x55df353e7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f214bfff700 1 -- 172.21.15.81:0/1403158099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353e3950 msgr2=0x55df353e7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f214bfff700 1 --2- 172.21.15.81:0/1403158099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353e3950 0x55df353e7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f214bfff700 1 -- 172.21.15.81:0/1403158099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e4270 msgr2=0x55df353e7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f214bfff700 1 --2- 172.21.15.81:0/1403158099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e4270 0x55df353e7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f214bfff700 1 -- 172.21.15.81:0/1403158099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c10e630 con 0x55df353de480 2024-05-09T00:12:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f214bfff700 1 --2- 172.21.15.81:0/1403158099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353de480 0x55df353ea160 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f214000b2f0 tx=0x7f2140099c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3601b4ecfc144e34 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f212b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f212b7fe700 1 -- 172.21.15.81:0/1403158099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214009a0d0 con 0x55df353de480 2024-05-09T00:12:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f212b7fe700 1 -- 172.21.15.81:0/1403158099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f21400a20f0 con 0x55df353de480 2024-05-09T00:12:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f215e4afb80 1 -- 172.21.15.81:0/1403158099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55df35287210 con 0x55df353de480 2024-05-09T00:12:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f212b7fe700 1 -- 172.21.15.81:0/1403158099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2140099160 con 0x55df353de480 2024-05-09T00:12:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f215e4afb80 10 client.18189 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f215e4afb80 1 -- 172.21.15.81:0/1403158099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55df3515bb00 con 0x55df353de480 2024-05-09T00:12:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.727+0000 7f212b7fe700 1 -- 172.21.15.81:0/1403158099 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21400b8030 con 0x55df353de480 2024-05-09T00:12:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.728+0000 7f212b7fe700 1 -- 172.21.15.81:0/1403158099 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2140095a60 con 0x55df353de480 2024-05-09T00:12:24.732 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.728+0000 7f215e4afb80 10 client.18189 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.728+0000 7f215e4afb80 10 client.18189 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.728+0000 7f215e4afb80 20 client.18189 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.728+0000 7f215e4afb80 1 --2- 172.21.15.81:0/1403158099 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55df353f7ad0 0x55df353f9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.728+0000 7f215e4afb80 4 client.18189 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.728+0000 7f215e4afb80 1 -- 172.21.15.81:0/1403158099 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df353ad7b0 con 0x55df353f7ad0 2024-05-09T00:12:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.728+0000 7f214b7fe700 1 --2- 172.21.15.81:0/1403158099 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55df353f7ad0 0x55df353f9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.728+0000 7f212b7fe700 10 client.18189 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.728+0000 7f214b7fe700 1 --2- 172.21.15.81:0/1403158099 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55df353f7ad0 0x55df353f9ec0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa0d1e31de410c13 server_cookie=f39898d600557bdd in_seq=0 out_seq=0 2024-05-09T00:12:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f212b7fe700 1 -- 172.21.15.81:0/1403158099 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55df353ad7b0 con 0x55df353f7ad0 2024-05-09T00:12:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f212b7fe700 10 client.18189 handle_command_reply: tid=0 2024-05-09T00:12:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f215e4afb80 1 client.18189 shutdown 2024-05-09T00:12:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f215e4afb80 1 -- 172.21.15.81:0/1403158099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353de480 msgr2=0x55df353ea160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f215e4afb80 1 --2- 172.21.15.81:0/1403158099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353de480 0x55df353ea160 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f214000b2f0 tx=0x7f2140099c70 comp rx=0 tx=0).stop 2024-05-09T00:12:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f215e4afb80 1 -- 172.21.15.81:0/1403158099 shutdown_connections 2024-05-09T00:12:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f215e4afb80 1 --2- 172.21.15.81:0/1403158099 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55df353f7ad0 0x55df353f9ec0 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f215e4afb80 1 --2- 172.21.15.81:0/1403158099 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e4270 0x55df353e7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f215e4afb80 1 --2- 172.21.15.81:0/1403158099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353de480 0x55df353ea160 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f215e4afb80 1 --2- 172.21.15.81:0/1403158099 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353e3950 0x55df353e7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f212b7fe700 0 client.18189 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f215e4afb80 1 -- 172.21.15.81:0/1403158099 >> 172.21.15.81:0/1403158099 conn(0x55df3533c1b0 msgr2=0x55df353e24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f215e4afb80 1 -- 172.21.15.81:0/1403158099 shutdown_connections 2024-05-09T00:12:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f215e4afb80 1 -- 172.21.15.81:0/1403158099 wait complete. 2024-05-09T00:12:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.729+0000 7f215e4afb80 20 client.18189 trim_cache size 0 max 16384 2024-05-09T00:12:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.744+0000 7f215e4afb80 1 Processor -- start 2024-05-09T00:12:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.744+0000 7f215e4afb80 1 -- start start 2024-05-09T00:12:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.744+0000 7f215e4afb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353de480 0x55df353d8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.746 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.744+0000 7f215e4afb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 0x55df353de860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.744+0000 7f215e4afb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353e4270 0x55df353dc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.744+0000 7f215e4afb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df353deda0 con 0x55df353de480 2024-05-09T00:12:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.744+0000 7f215e4afb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df353ff0b0 con 0x55df353e3950 2024-05-09T00:12:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.744+0000 7f215e4afb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df353dd1c0 con 0x55df353e4270 2024-05-09T00:12:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.744+0000 7f214bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353de480 0x55df353d8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.745+0000 7f214bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353de480 0x55df353d8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58236/0 (socket says 172.21.15.81:58236) 2024-05-09T00:12:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.745+0000 7f214bfff700 1 -- 172.21.15.81:0/1947747959 learned_addr learned my addr 172.21.15.81:0/1947747959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.745+0000 7f214b7fe700 1 --2- 172.21.15.81:0/1947747959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 0x55df353de860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.745+0000 7f2150892700 1 --2- 172.21.15.81:0/1947747959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353e4270 0x55df353dc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.745+0000 7f214bfff700 1 -- 172.21.15.81:0/1947747959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353e4270 msgr2=0x55df353dc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.745+0000 7f214bfff700 1 --2- 172.21.15.81:0/1947747959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353e4270 0x55df353dc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.745+0000 7f214bfff700 1 -- 172.21.15.81:0/1947747959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 msgr2=0x55df353de860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:24.747 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.745+0000 7f214bfff700 1 --2- 172.21.15.81:0/1947747959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 0x55df353de860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.745+0000 7f214bfff700 1 -- 172.21.15.81:0/1947747959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df352f4500 con 0x55df353de480 2024-05-09T00:12:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.745+0000 7f214b7fe700 1 --2- 172.21.15.81:0/1947747959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 0x55df353de860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.745+0000 7f214bfff700 1 --2- 172.21.15.81:0/1947747959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353de480 0x55df353d8910 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f2140096170 tx=0x7f2140005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6cf49e26abd0bae server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.745+0000 7f2132ffd700 1 -- 172.21.15.81:0/1947747959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140098bd0 con 0x55df353de480 2024-05-09T00:12:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.745+0000 7f2132ffd700 1 -- 172.21.15.81:0/1947747959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21400b8040 con 0x55df353de480 2024-05-09T00:12:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.745+0000 7f2132ffd700 1 -- 172.21.15.81:0/1947747959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2140099160 con 0x55df353de480 2024-05-09T00:12:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.746+0000 7f215e4afb80 1 -- 172.21.15.81:0/1947747959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353de480 msgr2=0x55df353d8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.746+0000 7f215e4afb80 1 --2- 172.21.15.81:0/1947747959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353de480 0x55df353d8910 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f2140096170 tx=0x7f2140005910 comp rx=0 tx=0).stop 2024-05-09T00:12:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.746+0000 7f215e4afb80 1 -- 172.21.15.81:0/1947747959 shutdown_connections 2024-05-09T00:12:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.746+0000 7f215e4afb80 1 --2- 172.21.15.81:0/1947747959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353e4270 0x55df353dc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.746+0000 7f215e4afb80 1 --2- 172.21.15.81:0/1947747959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353de480 0x55df353d8910 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.746+0000 7f215e4afb80 1 --2- 172.21.15.81:0/1947747959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 0x55df353de860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.746+0000 7f215e4afb80 1 -- 172.21.15.81:0/1947747959 >> 172.21.15.81:0/1947747959 conn(0x55df3533c1b0 msgr2=0x55df353da4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:24.748 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.746+0000 7f215e4afb80 1 -- 172.21.15.81:0/1947747959 shutdown_connections 2024-05-09T00:12:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.746+0000 7f215e4afb80 1 -- 172.21.15.81:0/1947747959 wait complete. 2024-05-09T00:12:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.746+0000 7f215e4afb80 1 -- start start 2024-05-09T00:12:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.746+0000 7f215e4afb80 1 Processor -- start 2024-05-09T00:12:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f215e4afb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353de480 0x55df353ef090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f215e4afb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 0x55df353e2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f215e4afb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353e4270 0x55df353e2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f215e4afb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df353e13f0 con 0x55df353e4270 2024-05-09T00:12:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f215e4afb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df353e1560 con 0x55df353e3950 2024-05-09T00:12:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f215e4afb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df353e1720 con 0x55df353de480 2024-05-09T00:12:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f215e4afb80 10 client.0 _ll_register_callbacks cb 0x55df352d3ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f2150892700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353e4270 0x55df353e2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f2150892700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353e4270 0x55df353e2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58248/0 (socket says 172.21.15.81:58248) 2024-05-09T00:12:24.749 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f2150892700 1 -- 172.21.15.81:0/3395776027 learned_addr learned my addr 172.21.15.81:0/3395776027 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f214b7fe700 1 --2- 172.21.15.81:0/3395776027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 0x55df353e2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f214bfff700 1 --2- 172.21.15.81:0/3395776027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353de480 0x55df353ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f2150892700 1 -- 172.21.15.81:0/3395776027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353de480 msgr2=0x55df353ef090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f2150892700 1 --2- 172.21.15.81:0/3395776027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353de480 0x55df353ef090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f2150892700 1 -- 172.21.15.81:0/3395776027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 msgr2=0x55df353e2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f2150892700 1 --2- 172.21.15.81:0/3395776027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 0x55df353e2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f2150892700 1 -- 172.21.15.81:0/3395776027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df3515bb00 con 0x55df353e4270 2024-05-09T00:12:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f214b7fe700 1 --2- 172.21.15.81:0/3395776027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 0x55df353e2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f2150892700 1 --2- 172.21.15.81:0/3395776027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353e4270 0x55df353e2bb0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f2144007b20 tx=0x7f2144007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd51b95e8b7f0871 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f212b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f212b7fe700 1 -- 172.21.15.81:0/3395776027 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144009150 con 0x55df353e4270 2024-05-09T00:12:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f212b7fe700 1 -- 172.21.15.81:0/3395776027 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f2144014940 con 0x55df353e4270 2024-05-09T00:12:24.750 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.747+0000 7f215e4afb80 1 -- 172.21.15.81:0/3395776027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f213c01e040 con 0x55df353e4270 2024-05-09T00:12:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.748+0000 7f212b7fe700 1 -- 172.21.15.81:0/3395776027 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2144014b00 con 0x55df353e4270 2024-05-09T00:12:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.748+0000 7f215e4afb80 10 client.18195 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.748+0000 7f215e4afb80 1 -- 172.21.15.81:0/3395776027 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55df351b3c70 con 0x55df353e4270 2024-05-09T00:12:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.748+0000 7f212b7fe700 1 -- 172.21.15.81:0/3395776027 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f213c01e040 con 0x55df353e4270 2024-05-09T00:12:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.748+0000 7f212b7fe700 1 -- 172.21.15.81:0/3395776027 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2144020410 con 0x55df353e4270 2024-05-09T00:12:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.748+0000 7f215e4afb80 10 client.18195 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.748+0000 7f215e4afb80 10 client.18195 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.748+0000 7f215e4afb80 20 client.18195 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.748+0000 7f215e4afb80 1 --2- 172.21.15.81:0/3395776027 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55df3544eab0 0x55df35450ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.748+0000 7f215e4afb80 4 client.18195 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:12:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.748+0000 7f215e4afb80 1 -- 172.21.15.81:0/3395776027 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55df35326e60 con 0x55df3544eab0 2024-05-09T00:12:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.748+0000 7f214bfff700 1 --2- 172.21.15.81:0/3395776027 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55df3544eab0 0x55df35450ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.749+0000 7f212b7fe700 10 client.18195 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.749+0000 7f214bfff700 1 --2- 172.21.15.81:0/3395776027 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55df3544eab0 0x55df35450ed0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4943cd05df84a77c server_cookie=10058bd17826f125 in_seq=0 out_seq=0 2024-05-09T00:12:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f212b7fe700 1 -- 172.21.15.81:0/3395776027 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55df35326e60 con 0x55df3544eab0 2024-05-09T00:12:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f212b7fe700 10 client.18195 handle_command_reply: tid=0 2024-05-09T00:12:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f215e4afb80 1 client.18195 shutdown 2024-05-09T00:12:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f215e4afb80 1 -- 172.21.15.81:0/3395776027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353e4270 msgr2=0x55df353e2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f215e4afb80 1 --2- 172.21.15.81:0/3395776027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353e4270 0x55df353e2bb0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f2144007b20 tx=0x7f2144007ee0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f215e4afb80 1 -- 172.21.15.81:0/3395776027 shutdown_connections 2024-05-09T00:12:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f215e4afb80 1 --2- 172.21.15.81:0/3395776027 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55df3544eab0 0x55df35450ed0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f215e4afb80 1 --2- 172.21.15.81:0/3395776027 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55df353e4270 0x55df353e2bb0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.761 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f215e4afb80 1 --2- 172.21.15.81:0/3395776027 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55df353de480 0x55df353ef090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f212b7fe700 0 client.18195 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f215e4afb80 1 --2- 172.21.15.81:0/3395776027 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55df353e3950 0x55df353e2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f215e4afb80 1 -- 172.21.15.81:0/3395776027 >> 172.21.15.81:0/3395776027 conn(0x55df3533c1b0 msgr2=0x55df353dc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f215e4afb80 1 -- 172.21.15.81:0/3395776027 shutdown_connections 2024-05-09T00:12:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f215e4afb80 1 -- 172.21.15.81:0/3395776027 wait complete. 2024-05-09T00:12:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.763+0000 7f215e4afb80 20 client.18195 trim_cache size 0 max 16384 2024-05-09T00:12:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:12:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:12:24.762 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:12:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:12:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.764+0000 7f21522f5700 1 -- 172.21.15.81:0/1571340346 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f21340a1290 msgr2=0x7f21340a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.764+0000 7f21522f5700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f21340a1290 0x7f21340a3750 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f213c00b5c0 tx=0x7f213c005960 comp rx=0 tx=0).stop 2024-05-09T00:12:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.764+0000 7f21522f5700 1 -- 172.21.15.81:0/1571340346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214c0682e0 msgr2=0x7f214c1972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.764+0000 7f21522f5700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214c0682e0 0x7f214c1972c0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f214000d950 tx=0x7f214000dc60 comp rx=0 tx=0).stop 2024-05-09T00:12:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.764+0000 7f21522f5700 1 -- 172.21.15.81:0/1571340346 shutdown_connections 2024-05-09T00:12:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.764+0000 7f21522f5700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f21340a1290 0x7f21340a3750 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.764+0000 7f21522f5700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f214c107000 0x7f214c19bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.764+0000 7f21522f5700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f214c0682e0 0x7f214c1972c0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.764+0000 7f21522f5700 1 --2- 172.21.15.81:0/1571340346 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f214c068ca0 0x7f214c197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.764+0000 7f21522f5700 1 -- 172.21.15.81:0/1571340346 >> 172.21.15.81:0/1571340346 conn(0x7f214c076f10 msgr2=0x7f214c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.764+0000 7f21522f5700 1 -- 172.21.15.81:0/1571340346 shutdown_connections 2024-05-09T00:12:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:24.764+0000 7f21522f5700 1 -- 172.21.15.81:0/1571340346 wait complete. 2024-05-09T00:12:25.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:24 smithi150 ceph-mon[46187]: pgmap v292: 97 pgs: 97 active+clean; 5.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-05-09T00:12:25.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:24 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:12:25.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:24 smithi171 ceph-mon[47351]: pgmap v292: 97 pgs: 97 active+clean; 5.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-05-09T00:12:25.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:24 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:12:25.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:24 smithi081 ceph-mon[42474]: pgmap v292: 97 pgs: 97 active+clean; 5.0 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 54 KiB/s wr, 14 op/s 2024-05-09T00:12:25.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:24 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:12:27.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:26 smithi150 ceph-mon[46187]: pgmap v293: 97 pgs: 97 active+clean; 5.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 69 KiB/s wr, 21 op/s 2024-05-09T00:12:27.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:26 smithi171 ceph-mon[47351]: pgmap v293: 97 pgs: 97 active+clean; 5.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 69 KiB/s wr, 21 op/s 2024-05-09T00:12:27.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:26 smithi081 ceph-mon[42474]: pgmap v293: 97 pgs: 97 active+clean; 5.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 69 KiB/s wr, 21 op/s 2024-05-09T00:12:29.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:28 smithi150 ceph-mon[46187]: pgmap v294: 97 pgs: 97 active+clean; 5.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:12:29.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:28 smithi171 ceph-mon[47351]: pgmap v294: 97 pgs: 97 active+clean; 5.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:12:29.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:28 smithi081 ceph-mon[42474]: pgmap v294: 97 pgs: 97 active+clean; 5.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:12:31.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:30 smithi150 ceph-mon[46187]: pgmap v295: 97 pgs: 97 active+clean; 5.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:12:31.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:30 smithi171 ceph-mon[47351]: pgmap v295: 97 pgs: 97 active+clean; 5.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:12:31.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:30 smithi081 ceph-mon[42474]: pgmap v295: 97 pgs: 97 active+clean; 5.2 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:12:33.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:32 smithi150 ceph-mon[46187]: pgmap v296: 97 pgs: 97 active+clean; 5.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 61 KiB/s wr, 18 op/s 2024-05-09T00:12:33.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:32 smithi171 ceph-mon[47351]: pgmap v296: 97 pgs: 97 active+clean; 5.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 61 KiB/s wr, 18 op/s 2024-05-09T00:12:33.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:32 smithi081 ceph-mon[42474]: pgmap v296: 97 pgs: 97 active+clean; 5.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 61 KiB/s wr, 18 op/s 2024-05-09T00:12:35.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:34 smithi150 ceph-mon[46187]: pgmap v297: 97 pgs: 97 active+clean; 5.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:12:35.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:34 smithi171 ceph-mon[47351]: pgmap v297: 97 pgs: 97 active+clean; 5.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:12:35.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:34 smithi081 ceph-mon[42474]: pgmap v297: 97 pgs: 97 active+clean; 5.4 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:12:37.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:36 smithi150 ceph-mon[46187]: pgmap v298: 97 pgs: 97 active+clean; 5.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 19 op/s 2024-05-09T00:12:37.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:36 smithi171 ceph-mon[47351]: pgmap v298: 97 pgs: 97 active+clean; 5.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 19 op/s 2024-05-09T00:12:37.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:36 smithi081 ceph-mon[42474]: pgmap v298: 97 pgs: 97 active+clean; 5.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 61 KiB/s wr, 19 op/s 2024-05-09T00:12:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.881+0000 7f05eff60700 1 -- 172.21.15.81:0/3814308472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e8100ca0 msgr2=0x7f05e8104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.881+0000 7f05eff60700 1 --2- 172.21.15.81:0/3814308472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e8100ca0 0x7f05e8104a50 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f05e4009990 tx=0x7f05e4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.882+0000 7f05eff60700 1 -- 172.21.15.81:0/3814308472 shutdown_connections 2024-05-09T00:12:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.882+0000 7f05eff60700 1 --2- 172.21.15.81:0/3814308472 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05e81002f0 0x7f05e81006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.882+0000 7f05eff60700 1 --2- 172.21.15.81:0/3814308472 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05e8105130 0x7f05e810ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.882+0000 7f05eff60700 1 --2- 172.21.15.81:0/3814308472 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e8100ca0 0x7f05e8104a50 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.882+0000 7f05eff60700 1 -- 172.21.15.81:0/3814308472 >> 172.21.15.81:0/3814308472 conn(0x7f05e8076c00 msgr2=0x7f05e8077010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:37.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.882+0000 7f05eff60700 1 -- 172.21.15.81:0/3814308472 shutdown_connections 2024-05-09T00:12:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.882+0000 7f05eff60700 1 -- 172.21.15.81:0/3814308472 wait complete. 2024-05-09T00:12:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.882+0000 7f05eff60700 1 Processor -- start 2024-05-09T00:12:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.882+0000 7f05eff60700 1 -- start start 2024-05-09T00:12:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05eff60700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05e81002f0 0x7f05e8198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05eff60700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e8105130 0x7f05e8198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05eff60700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05e8198ba0 0x7f05e81a31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05eff60700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e81a3880 con 0x7f05e8105130 2024-05-09T00:12:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05eff60700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e81a39f0 con 0x7f05e81002f0 2024-05-09T00:12:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05eff60700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e81a3bb0 con 0x7f05e8198ba0 2024-05-09T00:12:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05ed4fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e8105130 0x7f05e8198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05ed4fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e8105130 0x7f05e8198660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40130/0 (socket says 172.21.15.81:40130) 2024-05-09T00:12:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05ed4fb700 1 -- 172.21.15.81:0/3586273882 learned_addr learned my addr 172.21.15.81:0/3586273882 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:37.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05ee4fd700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05e8198ba0 0x7f05e81a31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05edcfc700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05e81002f0 0x7f05e8198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05ed4fb700 1 -- 172.21.15.81:0/3586273882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05e8198ba0 msgr2=0x7f05e81a31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05ed4fb700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05e8198ba0 0x7f05e81a31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05ed4fb700 1 -- 172.21.15.81:0/3586273882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05e81002f0 msgr2=0x7f05e8198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05ed4fb700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05e81002f0 0x7f05e8198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05ed4fb700 1 -- 172.21.15.81:0/3586273882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e40095f0 con 0x7f05e8105130 2024-05-09T00:12:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05edcfc700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05e81002f0 0x7f05e8198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05ee4fd700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05e8198ba0 0x7f05e81a31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05ed4fb700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e8105130 0x7f05e8198660 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f05e4006010 tx=0x7f05e4005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05daffd700 1 -- 172.21.15.81:0/3586273882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e401d070 con 0x7f05e8105130 2024-05-09T00:12:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05eff60700 1 -- 172.21.15.81:0/3586273882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e81a3e30 con 0x7f05e8105130 2024-05-09T00:12:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05daffd700 1 -- 172.21.15.81:0/3586273882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05e4022470 con 0x7f05e8105130 2024-05-09T00:12:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05daffd700 1 -- 172.21.15.81:0/3586273882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4017650 con 0x7f05e8105130 2024-05-09T00:12:37.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.883+0000 7f05eff60700 1 -- 172.21.15.81:0/3586273882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e81a41f0 con 0x7f05e8105130 2024-05-09T00:12:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.886+0000 7f05daffd700 1 -- 172.21.15.81:0/3586273882 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f05e40225e0 con 0x7f05e8105130 2024-05-09T00:12:37.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.887+0000 7f05daffd700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f05d40a1290 0x7f05d40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.887+0000 7f05edcfc700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f05d40a1290 0x7f05d40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.887+0000 7f05daffd700 1 -- 172.21.15.81:0/3586273882 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f05e40cdff0 con 0x7f05e8105130 2024-05-09T00:12:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.887+0000 7f05edcfc700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f05d40a1290 0x7f05d40a3750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f05dc005950 tx=0x7f05dc0058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.887+0000 7f05fc11ab80 1 Processor -- start 2024-05-09T00:12:37.885 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05fc11ab80 1 -- start start 2024-05-09T00:12:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05fc11ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55784455c540 0x55784455c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05fc11ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 0x557844560900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05fc11ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557844560e40 0x5578445612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05fc11ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578444af0f0 con 0x557844560e40 2024-05-09T00:12:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05fc11ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578444acab0 con 0x55784455ce60 2024-05-09T00:12:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05fc11ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578444a83a0 con 0x55784455c540 2024-05-09T00:12:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05ee4fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557844560e40 0x5578445612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05ee4fd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557844560e40 0x5578445612a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40144/0 (socket says 172.21.15.81:40144) 2024-05-09T00:12:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05ee4fd700 1 -- 172.21.15.81:0/3434500423 learned_addr learned my addr 172.21.15.81:0/3434500423 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05ed4fb700 1 --2- 172.21.15.81:0/3434500423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 0x557844560900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05edcfc700 1 --2- 172.21.15.81:0/3434500423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55784455c540 0x55784455c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05ee4fd700 1 -- 172.21.15.81:0/3434500423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55784455c540 msgr2=0x55784455c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05ee4fd700 1 --2- 172.21.15.81:0/3434500423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55784455c540 0x55784455c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05ee4fd700 1 -- 172.21.15.81:0/3434500423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 msgr2=0x557844560900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05ee4fd700 1 --2- 172.21.15.81:0/3434500423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 0x557844560900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05ee4fd700 1 -- 172.21.15.81:0/3434500423 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557844329350 con 0x557844560e40 2024-05-09T00:12:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05ed4fb700 1 --2- 172.21.15.81:0/3434500423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 0x557844560900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05edcfc700 1 --2- 172.21.15.81:0/3434500423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55784455c540 0x55784455c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.888+0000 7f05ee4fd700 1 --2- 172.21.15.81:0/3434500423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557844560e40 0x5578445612a0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009440 tx=0x7f05e0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2341d64a61b076da server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.889+0000 7f05d3fff700 1 -- 172.21.15.81:0/3434500423 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e000e070 con 0x557844560e40 2024-05-09T00:12:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.889+0000 7f05d3fff700 1 -- 172.21.15.81:0/3434500423 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05e000f040 con 0x557844560e40 2024-05-09T00:12:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.889+0000 7f05d3fff700 1 -- 172.21.15.81:0/3434500423 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0014a20 con 0x557844560e40 2024-05-09T00:12:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.889+0000 7f05fc11ab80 1 -- 172.21.15.81:0/3434500423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557844560e40 msgr2=0x5578445612a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.889+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/3434500423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557844560e40 0x5578445612a0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009440 tx=0x7f05e0009920 comp rx=0 tx=0).stop 2024-05-09T00:12:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.889+0000 7f05fc11ab80 1 -- 172.21.15.81:0/3434500423 shutdown_connections 2024-05-09T00:12:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.889+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/3434500423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557844560e40 0x5578445612a0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.889+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/3434500423 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55784455c540 0x55784455c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.889+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/3434500423 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 0x557844560900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.889+0000 7f05fc11ab80 1 -- 172.21.15.81:0/3434500423 >> 172.21.15.81:0/3434500423 conn(0x5578444b61b0 msgr2=0x557844552840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.889+0000 7f05fc11ab80 1 -- 172.21.15.81:0/3434500423 shutdown_connections 2024-05-09T00:12:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.889+0000 7f05fc11ab80 1 -- 172.21.15.81:0/3434500423 wait complete. 2024-05-09T00:12:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.890+0000 7f05fc11ab80 1 -- start start 2024-05-09T00:12:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.890+0000 7f05fc11ab80 1 Processor -- start 2024-05-09T00:12:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.890+0000 7f05fc11ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455c540 0x5578445685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.890+0000 7f05fc11ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 0x557844565910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.890+0000 7f05fc11ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557844560e40 0x557844565f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.890+0000 7f05fc11ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557844444500 con 0x55784455c540 2024-05-09T00:12:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.890+0000 7f05fc11ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578444441a0 con 0x55784455ce60 2024-05-09T00:12:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.890+0000 7f05fc11ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784432b640 con 0x557844560e40 2024-05-09T00:12:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.890+0000 7f05fc11ab80 10 client.0 _ll_register_callbacks cb 0x55784444dad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.890+0000 7f05edcfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455c540 0x5578445685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.890+0000 7f05edcfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455c540 0x5578445685d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40156/0 (socket says 172.21.15.81:40156) 2024-05-09T00:12:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.890+0000 7f05edcfc700 1 -- 172.21.15.81:0/3552657158 learned_addr learned my addr 172.21.15.81:0/3552657158 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05edcfc700 1 -- 172.21.15.81:0/3552657158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557844560e40 msgr2=0x557844565f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05ed4fb700 1 --2- 172.21.15.81:0/3552657158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 0x557844565910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05ee4fd700 1 --2- 172.21.15.81:0/3552657158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557844560e40 0x557844565f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05edcfc700 1 --2- 172.21.15.81:0/3552657158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557844560e40 0x557844565f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05edcfc700 1 -- 172.21.15.81:0/3552657158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 msgr2=0x557844565910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05edcfc700 1 --2- 172.21.15.81:0/3552657158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 0x557844565910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05edcfc700 1 -- 172.21.15.81:0/3552657158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e00090f0 con 0x55784455c540 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05edcfc700 1 --2- 172.21.15.81:0/3552657158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455c540 0x5578445685d0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00bf90 tx=0x7f05dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5baa78213ac142cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05d17fa700 1 -- 172.21.15.81:0/3552657158 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc017040 con 0x55784455c540 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05d17fa700 1 -- 172.21.15.81:0/3552657158 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f05dc003a90 con 0x55784455c540 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05fc11ab80 1 -- 172.21.15.81:0/3552657158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557844401210 con 0x55784455c540 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05d17fa700 1 -- 172.21.15.81:0/3552657158 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05dc003c50 con 0x55784455c540 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05fc11ab80 10 client.18207 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05fc11ab80 1 -- 172.21.15.81:0/3552657158 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5578442d5b00 con 0x55784455c540 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.891+0000 7f05d17fa700 1 -- 172.21.15.81:0/3552657158 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557844401210 con 0x55784455c540 2024-05-09T00:12:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.892+0000 7f05d17fa700 1 -- 172.21.15.81:0/3552657158 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f05dc01f430 con 0x55784455c540 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.892+0000 7f05fc11ab80 10 client.18207 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.892+0000 7f05fc11ab80 10 client.18207 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.892+0000 7f05fc11ab80 20 client.18207 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.892+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/3552657158 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557844575fb0 0x5578445783a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.892+0000 7f05fc11ab80 4 client.18207 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.892+0000 7f05fc11ab80 1 -- 172.21.15.81:0/3552657158 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5578445277b0 con 0x557844575fb0 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.892+0000 7f05ed4fb700 1 --2- 172.21.15.81:0/3552657158 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557844575fb0 0x5578445783a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.892+0000 7f05ed4fb700 1 --2- 172.21.15.81:0/3552657158 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557844575fb0 0x5578445783a0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4619652b421f17e server_cookie=8dddc36b7d1cdca3 in_seq=0 out_seq=0 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.892+0000 7f05d17fa700 10 client.18207 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.893+0000 7f05d17fa700 1 -- 172.21.15.81:0/3552657158 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5578445277b0 con 0x557844575fb0 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.893+0000 7f05d17fa700 10 client.18207 handle_command_reply: tid=0 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.893+0000 7f05fc11ab80 1 client.18207 shutdown 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.893+0000 7f05fc11ab80 1 -- 172.21.15.81:0/3552657158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455c540 msgr2=0x5578445685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.893+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/3552657158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455c540 0x5578445685d0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00bf90 tx=0x7f05dc004750 comp rx=0 tx=0).stop 2024-05-09T00:12:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.893+0000 7f05fc11ab80 1 -- 172.21.15.81:0/3552657158 shutdown_connections 2024-05-09T00:12:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.893+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/3552657158 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557844575fb0 0x5578445783a0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.893+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/3552657158 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557844560e40 0x557844565f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.893+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/3552657158 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455c540 0x5578445685d0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.893+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/3552657158 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 0x557844565910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.893+0000 7f05d17fa700 0 client.18207 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.893+0000 7f05fc11ab80 1 -- 172.21.15.81:0/3552657158 >> 172.21.15.81:0/3552657158 conn(0x5578444b61b0 msgr2=0x557844556f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.893+0000 7f05fc11ab80 1 -- 172.21.15.81:0/3552657158 shutdown_connections 2024-05-09T00:12:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.893+0000 7f05fc11ab80 1 -- 172.21.15.81:0/3552657158 wait complete. 2024-05-09T00:12:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.894+0000 7f05fc11ab80 20 client.18207 trim_cache size 0 max 16384 2024-05-09T00:12:37.909 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.910+0000 7f05fc11ab80 1 Processor -- start 2024-05-09T00:12:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.910+0000 7f05fc11ab80 1 -- start start 2024-05-09T00:12:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05fc11ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55784455c540 0x557844552910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05fc11ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455ce60 0x557844562230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05fc11ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557844560e40 0x55784456d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05fc11ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578445534a0 con 0x55784455ce60 2024-05-09T00:12:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05fc11ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784457d5d0 con 0x557844560e40 2024-05-09T00:12:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05fc11ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55784455fab0 con 0x55784455c540 2024-05-09T00:12:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05ed4fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455ce60 0x557844562230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05ed4fb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455ce60 0x557844562230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40172/0 (socket says 172.21.15.81:40172) 2024-05-09T00:12:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05ed4fb700 1 -- 172.21.15.81:0/2592920124 learned_addr learned my addr 172.21.15.81:0/2592920124 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05ee4fd700 1 --2- 172.21.15.81:0/2592920124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557844560e40 0x55784456d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05edcfc700 1 --2- 172.21.15.81:0/2592920124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55784455c540 0x557844552910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.910 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05ed4fb700 1 -- 172.21.15.81:0/2592920124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55784455c540 msgr2=0x557844552910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05ed4fb700 1 --2- 172.21.15.81:0/2592920124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55784455c540 0x557844552910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05ed4fb700 1 -- 172.21.15.81:0/2592920124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557844560e40 msgr2=0x55784456d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05ed4fb700 1 --2- 172.21.15.81:0/2592920124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557844560e40 0x55784456d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05ed4fb700 1 -- 172.21.15.81:0/2592920124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55784446e500 con 0x55784455ce60 2024-05-09T00:12:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05edcfc700 1 --2- 172.21.15.81:0/2592920124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55784455c540 0x557844552910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05ed4fb700 1 --2- 172.21.15.81:0/2592920124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455ce60 0x557844562230 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f05e40059d0 tx=0x7f05e40a1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6127b3c7667a786c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05d8ff9700 1 -- 172.21.15.81:0/2592920124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4083070 con 0x55784455ce60 2024-05-09T00:12:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05d8ff9700 1 -- 172.21.15.81:0/2592920124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05e409ef90 con 0x55784455ce60 2024-05-09T00:12:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.911+0000 7f05d8ff9700 1 -- 172.21.15.81:0/2592920124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e40228e0 con 0x55784455ce60 2024-05-09T00:12:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.912+0000 7f05fc11ab80 1 -- 172.21.15.81:0/2592920124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455ce60 msgr2=0x557844562230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.912+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/2592920124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455ce60 0x557844562230 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f05e40059d0 tx=0x7f05e40a1040 comp rx=0 tx=0).stop 2024-05-09T00:12:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.912+0000 7f05fc11ab80 1 -- 172.21.15.81:0/2592920124 shutdown_connections 2024-05-09T00:12:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.912+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/2592920124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557844560e40 0x55784456d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.911 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.912+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/2592920124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55784455c540 0x557844552910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.912+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/2592920124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455ce60 0x557844562230 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.912+0000 7f05fc11ab80 1 -- 172.21.15.81:0/2592920124 >> 172.21.15.81:0/2592920124 conn(0x5578444b61b0 msgr2=0x557844557700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.912+0000 7f05fc11ab80 1 -- 172.21.15.81:0/2592920124 shutdown_connections 2024-05-09T00:12:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.912+0000 7f05fc11ab80 1 -- 172.21.15.81:0/2592920124 wait complete. 2024-05-09T00:12:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.912+0000 7f05fc11ab80 1 -- start start 2024-05-09T00:12:37.912 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05fc11ab80 1 Processor -- start 2024-05-09T00:12:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05fc11ab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455c540 0x55784456d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05fc11ab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 0x557844568fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05fc11ab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557844560e40 0x557844569700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05fc11ab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557844569e10 con 0x55784455c540 2024-05-09T00:12:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05fc11ab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578445cb4b0 con 0x55784455ce60 2024-05-09T00:12:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05fc11ab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578445cb5f0 con 0x557844560e40 2024-05-09T00:12:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05fc11ab80 10 client.0 _ll_register_callbacks cb 0x55784444dad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05edcfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455c540 0x55784456d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05edcfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455c540 0x55784456d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40174/0 (socket says 172.21.15.81:40174) 2024-05-09T00:12:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05edcfc700 1 -- 172.21.15.81:0/450531048 learned_addr learned my addr 172.21.15.81:0/450531048 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05ed4fb700 1 --2- 172.21.15.81:0/450531048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 0x557844568fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05ee4fd700 1 --2- 172.21.15.81:0/450531048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557844560e40 0x557844569700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05edcfc700 1 -- 172.21.15.81:0/450531048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557844560e40 msgr2=0x557844569700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05edcfc700 1 --2- 172.21.15.81:0/450531048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557844560e40 0x557844569700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05edcfc700 1 -- 172.21.15.81:0/450531048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 msgr2=0x557844568fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.913+0000 7f05edcfc700 1 --2- 172.21.15.81:0/450531048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 0x557844568fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05edcfc700 1 -- 172.21.15.81:0/450531048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e81a41f0 con 0x55784455c540 2024-05-09T00:12:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05edcfc700 1 --2- 172.21.15.81:0/450531048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455c540 0x55784456d500 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f05dc01f890 tx=0x7f05dc020fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6349ae7767e85a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05d17fa700 1 -- 172.21.15.81:0/450531048 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc003a90 con 0x55784455c540 2024-05-09T00:12:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05d17fa700 1 -- 172.21.15.81:0/450531048 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f05dc01f570 con 0x55784455c540 2024-05-09T00:12:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05fc11ab80 1 -- 172.21.15.81:0/450531048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05e000f040 con 0x55784455c540 2024-05-09T00:12:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05d17fa700 1 -- 172.21.15.81:0/450531048 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05dc003bf0 con 0x55784455c540 2024-05-09T00:12:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05fc11ab80 10 client.18213 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05fc11ab80 1 -- 172.21.15.81:0/450531048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55784432dc70 con 0x55784455c540 2024-05-09T00:12:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05d17fa700 1 -- 172.21.15.81:0/450531048 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05e000f040 con 0x55784455c540 2024-05-09T00:12:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05d17fa700 1 -- 172.21.15.81:0/450531048 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f05dc0047c0 con 0x55784455c540 2024-05-09T00:12:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05fc11ab80 10 client.18213 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05fc11ab80 10 client.18213 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05fc11ab80 20 client.18213 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/450531048 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5578445ccdc0 0x5578445cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05fc11ab80 4 client.18213 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:12:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.914+0000 7f05fc11ab80 1 -- 172.21.15.81:0/450531048 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5578444a0e60 con 0x5578445ccdc0 2024-05-09T00:12:37.917 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.915+0000 7f05ed4fb700 1 --2- 172.21.15.81:0/450531048 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5578445ccdc0 0x5578445cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.915+0000 7f05ed4fb700 1 --2- 172.21.15.81:0/450531048 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5578445ccdc0 0x5578445cf1e0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c1cefa7cf02582e server_cookie=ffd4224300de4a91 in_seq=0 out_seq=0 2024-05-09T00:12:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.915+0000 7f05d17fa700 10 client.18213 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.928+0000 7f05d17fa700 1 -- 172.21.15.81:0/450531048 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5578444a0e60 con 0x5578445ccdc0 2024-05-09T00:12:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.928+0000 7f05d17fa700 10 client.18213 handle_command_reply: tid=0 2024-05-09T00:12:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.928+0000 7f05fc11ab80 1 client.18213 shutdown 2024-05-09T00:12:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.928+0000 7f05fc11ab80 1 -- 172.21.15.81:0/450531048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455c540 msgr2=0x55784456d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/450531048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455c540 0x55784456d500 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f05dc01f890 tx=0x7f05dc020fa0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05fc11ab80 1 -- 172.21.15.81:0/450531048 shutdown_connections 2024-05-09T00:12:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/450531048 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5578445ccdc0 0x5578445cf1e0 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/450531048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557844560e40 0x557844569700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05d17fa700 0 client.18213 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/450531048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55784455c540 0x55784456d500 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05fc11ab80 1 --2- 172.21.15.81:0/450531048 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55784455ce60 0x557844568fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05fc11ab80 1 -- 172.21.15.81:0/450531048 >> 172.21.15.81:0/450531048 conn(0x5578444b61b0 msgr2=0x557844563230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05fc11ab80 1 -- 172.21.15.81:0/450531048 shutdown_connections 2024-05-09T00:12:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05fc11ab80 1 -- 172.21.15.81:0/450531048 wait complete. 2024-05-09T00:12:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05fc11ab80 20 client.18213 trim_cache size 0 max 16384 2024-05-09T00:12:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:12:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:12:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:12:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:12:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05eff60700 1 -- 172.21.15.81:0/3586273882 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f05d40a1290 msgr2=0x7f05d40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05eff60700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f05d40a1290 0x7f05d40a3750 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f05dc005950 tx=0x7f05dc0058e0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05eff60700 1 -- 172.21.15.81:0/3586273882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e8105130 msgr2=0x7f05e8198660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05eff60700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e8105130 0x7f05e8198660 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f05e4006010 tx=0x7f05e4005e80 comp rx=0 tx=0).stop 2024-05-09T00:12:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05eff60700 1 -- 172.21.15.81:0/3586273882 shutdown_connections 2024-05-09T00:12:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05eff60700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f05d40a1290 0x7f05d40a3750 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05eff60700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f05e81002f0 0x7f05e8198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05eff60700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f05e8198ba0 0x7f05e81a31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05eff60700 1 --2- 172.21.15.81:0/3586273882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05e8105130 0x7f05e8198660 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.929+0000 7f05eff60700 1 -- 172.21.15.81:0/3586273882 >> 172.21.15.81:0/3586273882 conn(0x7f05e8076c00 msgr2=0x7f05e80fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.930+0000 7f05eff60700 1 -- 172.21.15.81:0/3586273882 shutdown_connections 2024-05-09T00:12:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:37.930+0000 7f05eff60700 1 -- 172.21.15.81:0/3586273882 wait complete. 2024-05-09T00:12:39.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:38 smithi150 ceph-mon[46187]: pgmap v299: 97 pgs: 97 active+clean; 5.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-05-09T00:12:39.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:38 smithi171 ceph-mon[47351]: pgmap v299: 97 pgs: 97 active+clean; 5.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-05-09T00:12:39.372 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:38 smithi081 ceph-mon[42474]: pgmap v299: 97 pgs: 97 active+clean; 5.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-05-09T00:12:41.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:40 smithi150 ceph-mon[46187]: pgmap v300: 97 pgs: 97 active+clean; 5.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-05-09T00:12:41.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:40 smithi171 ceph-mon[47351]: pgmap v300: 97 pgs: 97 active+clean; 5.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-05-09T00:12:41.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:40 smithi081 ceph-mon[42474]: pgmap v300: 97 pgs: 97 active+clean; 5.6 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 39 KiB/s wr, 10 op/s 2024-05-09T00:12:43.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:42 smithi150 ceph-mon[46187]: pgmap v301: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 18 op/s 2024-05-09T00:12:43.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:42 smithi171 ceph-mon[47351]: pgmap v301: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 18 op/s 2024-05-09T00:12:43.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:42 smithi081 ceph-mon[42474]: pgmap v301: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 62 KiB/s wr, 18 op/s 2024-05-09T00:12:45.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:44 smithi150 ceph-mon[46187]: pgmap v302: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-05-09T00:12:45.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:44 smithi171 ceph-mon[47351]: pgmap v302: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-05-09T00:12:45.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:44 smithi081 ceph-mon[42474]: pgmap v302: 97 pgs: 97 active+clean; 1.9 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 13 op/s 2024-05-09T00:12:47.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:46 smithi150 ceph-mon[46187]: pgmap v303: 97 pgs: 97 active+clean; 2.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 63 KiB/s wr, 18 op/s 2024-05-09T00:12:47.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:46 smithi171 ceph-mon[47351]: pgmap v303: 97 pgs: 97 active+clean; 2.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 63 KiB/s wr, 18 op/s 2024-05-09T00:12:47.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:46 smithi081 ceph-mon[42474]: pgmap v303: 97 pgs: 97 active+clean; 2.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 63 KiB/s wr, 18 op/s 2024-05-09T00:12:49.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:48 smithi150 ceph-mon[46187]: pgmap v304: 97 pgs: 97 active+clean; 2.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:12:49.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:48 smithi171 ceph-mon[47351]: pgmap v304: 97 pgs: 97 active+clean; 2.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:12:49.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:48 smithi081 ceph-mon[42474]: pgmap v304: 97 pgs: 97 active+clean; 2.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:12:50.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:12:50.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.843+0000 7f1ff45f6700 1 -- 172.21.15.81:0/3930879514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fec106260 msgr2=0x7f1fec10dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:50.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.843+0000 7f1ff45f6700 1 --2- 172.21.15.81:0/3930879514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fec106260 0x7f1fec10dde0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f1fe400b0a0 tx=0x7f1fe400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.843+0000 7f1ff45f6700 1 -- 172.21.15.81:0/3930879514 shutdown_connections 2024-05-09T00:12:50.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.843+0000 7f1ff45f6700 1 --2- 172.21.15.81:0/3930879514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fec101140 0x7f1fec101520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.843+0000 7f1ff45f6700 1 --2- 172.21.15.81:0/3930879514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fec106260 0x7f1fec10dde0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.843+0000 7f1ff45f6700 1 --2- 172.21.15.81:0/3930879514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fec101af0 0x7f1fec105b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.843+0000 7f1ff45f6700 1 -- 172.21.15.81:0/3930879514 >> 172.21.15.81:0/3930879514 conn(0x7f1fec0fc9e0 msgr2=0x7f1fec0fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:50.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.843+0000 7f1ff45f6700 1 -- 172.21.15.81:0/3930879514 shutdown_connections 2024-05-09T00:12:50.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.843+0000 7f1ff45f6700 1 -- 172.21.15.81:0/3930879514 wait complete. 2024-05-09T00:12:50.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.843+0000 7f1ff45f6700 1 Processor -- start 2024-05-09T00:12:50.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.843+0000 7f1ff45f6700 1 -- start start 2024-05-09T00:12:50.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff45f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fec101140 0x7f1fec0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff45f6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fec106260 0x7f1fec0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff45f6700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fec073d20 0x7f1fec1a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff45f6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec1a5d00 con 0x7f1fec101140 2024-05-09T00:12:50.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff45f6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec1a5e70 con 0x7f1fec106260 2024-05-09T00:12:50.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff45f6700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec1a6030 con 0x7f1fec073d20 2024-05-09T00:12:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff2392700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fec101140 0x7f1fec0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff2392700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fec101140 0x7f1fec0732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55272/0 (socket says 172.21.15.81:55272) 2024-05-09T00:12:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff2392700 1 -- 172.21.15.81:0/851667050 learned_addr learned my addr 172.21.15.81:0/851667050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff2392700 1 -- 172.21.15.81:0/851667050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fec073d20 msgr2=0x7f1fec1a5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff2392700 1 --2- 172.21.15.81:0/851667050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fec073d20 0x7f1fec1a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff2392700 1 -- 172.21.15.81:0/851667050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fec106260 msgr2=0x7f1fec0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff2392700 1 --2- 172.21.15.81:0/851667050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fec106260 0x7f1fec0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff2392700 1 -- 172.21.15.81:0/851667050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe4009d00 con 0x7f1fec101140 2024-05-09T00:12:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff2392700 1 --2- 172.21.15.81:0/851667050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fec101140 0x7f1fec0732a0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800d950 tx=0x7f1fe800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1fe37fe700 1 -- 172.21.15.81:0/851667050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8009b40 con 0x7f1fec101140 2024-05-09T00:12:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff45f6700 1 -- 172.21.15.81:0/851667050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fec1a6310 con 0x7f1fec101140 2024-05-09T00:12:50.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1fe37fe700 1 -- 172.21.15.81:0/851667050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1fe8009ca0 con 0x7f1fec101140 2024-05-09T00:12:50.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1fe37fe700 1 -- 172.21.15.81:0/851667050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800f620 con 0x7f1fec101140 2024-05-09T00:12:50.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.844+0000 7f1ff45f6700 1 -- 172.21.15.81:0/851667050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec1a6870 con 0x7f1fec101140 2024-05-09T00:12:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.847+0000 7f1fe37fe700 1 -- 172.21.15.81:0/851667050 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f1fe8010460 con 0x7f1fec101140 2024-05-09T00:12:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.848+0000 7f1fe37fe700 1 --2- 172.21.15.81:0/851667050 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1fd80a1290 0x7f1fd80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.848+0000 7f1ff1b91700 1 --2- 172.21.15.81:0/851667050 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1fd80a1290 0x7f1fd80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.848+0000 7f1fe37fe700 1 -- 172.21.15.81:0/851667050 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f1fe80cd0c0 con 0x7f1fec101140 2024-05-09T00:12:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.848+0000 7f1ff1b91700 1 --2- 172.21.15.81:0/851667050 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1fd80a1290 0x7f1fd80a3750 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0749d0 tx=0x7f1fdc009620 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:50.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.848+0000 7f20007b0b80 1 Processor -- start 2024-05-09T00:12:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.848+0000 7f20007b0b80 1 -- start start 2024-05-09T00:12:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f20007b0b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a51e00 0x557ec9a521e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f20007b0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a52720 0x557ec9a4c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f20007b0b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a4c890 0x557ec9a4ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f20007b0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec99a3150 con 0x557ec9a52720 2024-05-09T00:12:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f20007b0b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec99a0b10 con 0x557ec9a4c890 2024-05-09T00:12:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f20007b0b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec999c400 con 0x557ec9a51e00 2024-05-09T00:12:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f1ff1b91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a52720 0x557ec9a4c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f1ff1b91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a52720 0x557ec9a4c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55276/0 (socket says 172.21.15.81:55276) 2024-05-09T00:12:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f1ff1b91700 1 -- 172.21.15.81:0/2542134059 learned_addr learned my addr 172.21.15.81:0/2542134059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:50.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f1ff1b91700 1 -- 172.21.15.81:0/2542134059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a51e00 msgr2=0x557ec9a521e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:12:50.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f1ff1b91700 1 --2- 172.21.15.81:0/2542134059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a51e00 0x557ec9a521e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f1ff1b91700 1 -- 172.21.15.81:0/2542134059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a4c890 msgr2=0x557ec9a4ccd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:12:50.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f1ff1b91700 1 --2- 172.21.15.81:0/2542134059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a4c890 0x557ec9a4ccd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f1ff1b91700 1 -- 172.21.15.81:0/2542134059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ec981d3b0 con 0x557ec9a52720 2024-05-09T00:12:50.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f1ff1b91700 1 --2- 172.21.15.81:0/2542134059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a52720 0x557ec9a4c350 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00eb20 tx=0x7f1fdc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9d522352835cb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:50.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f1fe0ff9700 1 -- 172.21.15.81:0/2542134059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc00eee0 con 0x557ec9a52720 2024-05-09T00:12:50.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f1fe0ff9700 1 -- 172.21.15.81:0/2542134059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1fdc025460 con 0x557ec9a52720 2024-05-09T00:12:50.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.849+0000 7f1fe0ff9700 1 -- 172.21.15.81:0/2542134059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc01c680 con 0x557ec9a52720 2024-05-09T00:12:50.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.850+0000 7f20007b0b80 1 -- 172.21.15.81:0/2542134059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a52720 msgr2=0x557ec9a4c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:50.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.850+0000 7f20007b0b80 1 --2- 172.21.15.81:0/2542134059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a52720 0x557ec9a4c350 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00eb20 tx=0x7f1fdc011000 comp rx=0 tx=0).stop 2024-05-09T00:12:50.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.850+0000 7f20007b0b80 1 -- 172.21.15.81:0/2542134059 shutdown_connections 2024-05-09T00:12:50.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.850+0000 7f20007b0b80 1 --2- 172.21.15.81:0/2542134059 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a4c890 0x557ec9a4ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.850+0000 7f20007b0b80 1 --2- 172.21.15.81:0/2542134059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a51e00 0x557ec9a521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.850+0000 7f20007b0b80 1 --2- 172.21.15.81:0/2542134059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a52720 0x557ec9a4c350 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.850+0000 7f20007b0b80 1 -- 172.21.15.81:0/2542134059 >> 172.21.15.81:0/2542134059 conn(0x557ec99aa210 msgr2=0x557ec9a46df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:50.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.850+0000 7f20007b0b80 1 -- 172.21.15.81:0/2542134059 shutdown_connections 2024-05-09T00:12:50.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.850+0000 7f20007b0b80 1 -- 172.21.15.81:0/2542134059 wait complete. 2024-05-09T00:12:50.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.850+0000 7f20007b0b80 1 -- start start 2024-05-09T00:12:50.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f20007b0b80 1 Processor -- start 2024-05-09T00:12:50.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f20007b0b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a4c890 0x557ec9a55b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f20007b0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a51e00 0x557ec9a56040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f20007b0b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a52720 0x557ec9a56580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f20007b0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec9938560 con 0x557ec9a51e00 2024-05-09T00:12:50.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f20007b0b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec9938200 con 0x557ec9a52720 2024-05-09T00:12:50.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f20007b0b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec981f6a0 con 0x557ec9a4c890 2024-05-09T00:12:50.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f20007b0b80 10 client.0 _ll_register_callbacks cb 0x557ec9941b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:50.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f1ff1b91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a51e00 0x557ec9a56040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:50.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f1ff1b91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a51e00 0x557ec9a56040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55286/0 (socket says 172.21.15.81:55286) 2024-05-09T00:12:50.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f1ff1b91700 1 -- 172.21.15.81:0/434762289 learned_addr learned my addr 172.21.15.81:0/434762289 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:50.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f1ff1b91700 1 -- 172.21.15.81:0/434762289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a4c890 msgr2=0x557ec9a55b00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:12:50.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f1ff1b91700 1 --2- 172.21.15.81:0/434762289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a4c890 0x557ec9a55b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f1ff1b91700 1 -- 172.21.15.81:0/434762289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a52720 msgr2=0x557ec9a56580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:12:50.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f1ff1b91700 1 --2- 172.21.15.81:0/434762289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a52720 0x557ec9a56580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f1ff1b91700 1 -- 172.21.15.81:0/434762289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc00e7d0 con 0x557ec9a51e00 2024-05-09T00:12:50.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f1ff1b91700 1 --2- 172.21.15.81:0/434762289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a51e00 0x557ec9a56040 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc025e30 tx=0x7f1fdc025c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21153bddedc64bc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:50.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f1fd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:50.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.851+0000 7f1fd5ffb700 1 -- 172.21.15.81:0/434762289 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc010e10 con 0x557ec9a51e00 2024-05-09T00:12:50.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.852+0000 7f20007b0b80 1 -- 172.21.15.81:0/434762289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ec98f5270 con 0x557ec9a51e00 2024-05-09T00:12:50.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.852+0000 7f1fd5ffb700 1 -- 172.21.15.81:0/434762289 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f1fdc02c070 con 0x557ec9a51e00 2024-05-09T00:12:50.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.852+0000 7f1fd5ffb700 1 -- 172.21.15.81:0/434762289 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fdc004830 con 0x557ec9a51e00 2024-05-09T00:12:50.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.852+0000 7f20007b0b80 10 client.18225 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:50.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.852+0000 7f20007b0b80 1 -- 172.21.15.81:0/434762289 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557ec97c9b60 con 0x557ec9a51e00 2024-05-09T00:12:50.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.852+0000 7f1fd5ffb700 1 -- 172.21.15.81:0/434762289 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1fdc03c080 con 0x557ec9a51e00 2024-05-09T00:12:50.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.852+0000 7f1fd5ffb700 1 -- 172.21.15.81:0/434762289 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1fdc018070 con 0x557ec9a51e00 2024-05-09T00:12:50.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.852+0000 7f20007b0b80 10 client.18225 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:50.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.852+0000 7f20007b0b80 10 client.18225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:50.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.852+0000 7f20007b0b80 20 client.18225 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:50.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.852+0000 7f20007b0b80 1 --2- 172.21.15.81:0/434762289 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557ec9a66190 0x557ec9a685b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.852+0000 7f20007b0b80 4 client.18225 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:50.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.852+0000 7f20007b0b80 1 -- 172.21.15.81:0/434762289 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ec9a1b810 con 0x557ec9a66190 2024-05-09T00:12:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.852+0000 7f1ff2392700 1 --2- 172.21.15.81:0/434762289 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557ec9a66190 0x557ec9a685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.853+0000 7f1fd5ffb700 10 client.18225 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.853+0000 7f1ff2392700 1 --2- 172.21.15.81:0/434762289 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557ec9a66190 0x557ec9a685b0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8357d6ba6a479208 server_cookie=5575058b95aca36 in_seq=0 out_seq=0 2024-05-09T00:12:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.853+0000 7f1fd5ffb700 1 -- 172.21.15.81:0/434762289 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557ec9a1b810 con 0x557ec9a66190 2024-05-09T00:12:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.853+0000 7f1fd5ffb700 10 client.18225 handle_command_reply: tid=0 2024-05-09T00:12:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.854+0000 7f20007b0b80 1 client.18225 shutdown 2024-05-09T00:12:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.854+0000 7f20007b0b80 1 -- 172.21.15.81:0/434762289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a51e00 msgr2=0x557ec9a56040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.854+0000 7f20007b0b80 1 --2- 172.21.15.81:0/434762289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a51e00 0x557ec9a56040 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc025e30 tx=0x7f1fdc025c60 comp rx=0 tx=0).stop 2024-05-09T00:12:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.854+0000 7f20007b0b80 1 -- 172.21.15.81:0/434762289 shutdown_connections 2024-05-09T00:12:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.854+0000 7f20007b0b80 1 --2- 172.21.15.81:0/434762289 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557ec9a66190 0x557ec9a685b0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.854+0000 7f20007b0b80 1 --2- 172.21.15.81:0/434762289 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a52720 0x557ec9a56580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.854+0000 7f20007b0b80 1 --2- 172.21.15.81:0/434762289 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a4c890 0x557ec9a55b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.854+0000 7f20007b0b80 1 --2- 172.21.15.81:0/434762289 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a51e00 0x557ec9a56040 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.854+0000 7f1fd5ffb700 0 client.18225 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.854+0000 7f20007b0b80 1 -- 172.21.15.81:0/434762289 >> 172.21.15.81:0/434762289 conn(0x557ec99aa210 msgr2=0x557ec9a465a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.854+0000 7f20007b0b80 1 -- 172.21.15.81:0/434762289 shutdown_connections 2024-05-09T00:12:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.854+0000 7f20007b0b80 1 -- 172.21.15.81:0/434762289 wait complete. 2024-05-09T00:12:50.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.854+0000 7f20007b0b80 20 client.18225 trim_cache size 0 max 16384 2024-05-09T00:12:50.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.871+0000 7f20007b0b80 1 Processor -- start 2024-05-09T00:12:50.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.871+0000 7f20007b0b80 1 -- start start 2024-05-09T00:12:50.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.871+0000 7f20007b0b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a4c890 0x557ec9a4c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.871+0000 7f20007b0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a51e00 0x557ec9a61c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.871+0000 7f20007b0b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a52720 0x557ec9a46d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.871+0000 7f20007b0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec9a478e0 con 0x557ec9a51e00 2024-05-09T00:12:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.871+0000 7f20007b0b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec9a43dc0 con 0x557ec9a52720 2024-05-09T00:12:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.871+0000 7f20007b0b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec9a487e0 con 0x557ec9a4c890 2024-05-09T00:12:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.871+0000 7f1ff1b91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a51e00 0x557ec9a61c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.871+0000 7f1ff1b91700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a51e00 0x557ec9a61c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55302/0 (socket says 172.21.15.81:55302) 2024-05-09T00:12:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.871+0000 7f1ff1b91700 1 -- 172.21.15.81:0/1412286727 learned_addr learned my addr 172.21.15.81:0/1412286727 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f1ff1b91700 1 -- 172.21.15.81:0/1412286727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a4c890 msgr2=0x557ec9a4c350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:12:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f1ff1b91700 1 --2- 172.21.15.81:0/1412286727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a4c890 0x557ec9a4c350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f1ff1b91700 1 -- 172.21.15.81:0/1412286727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a52720 msgr2=0x557ec9a46d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:12:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f1ff1b91700 1 --2- 172.21.15.81:0/1412286727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a52720 0x557ec9a46d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f1ff1b91700 1 -- 172.21.15.81:0/1412286727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ec9962560 con 0x557ec9a51e00 2024-05-09T00:12:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f1ff1b91700 1 --2- 172.21.15.81:0/1412286727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a51e00 0x557ec9a61c20 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc025a70 tx=0x7f1fdc0094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b207a971e1ef14c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f1fe17fa700 1 -- 172.21.15.81:0/1412286727 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc025cd0 con 0x557ec9a51e00 2024-05-09T00:12:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f1fe17fa700 1 -- 172.21.15.81:0/1412286727 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557ec98f5270 con 0x557ec9a51e00 2024-05-09T00:12:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f1fe17fa700 1 -- 172.21.15.81:0/1412286727 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc02f3d0 con 0x557ec9a51e00 2024-05-09T00:12:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f20007b0b80 1 -- 172.21.15.81:0/1412286727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a51e00 msgr2=0x557ec9a61c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f20007b0b80 1 --2- 172.21.15.81:0/1412286727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a51e00 0x557ec9a61c20 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc025a70 tx=0x7f1fdc0094a0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f20007b0b80 1 -- 172.21.15.81:0/1412286727 shutdown_connections 2024-05-09T00:12:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f20007b0b80 1 --2- 172.21.15.81:0/1412286727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a52720 0x557ec9a46d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f20007b0b80 1 --2- 172.21.15.81:0/1412286727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a4c890 0x557ec9a4c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f20007b0b80 1 --2- 172.21.15.81:0/1412286727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a51e00 0x557ec9a61c20 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f20007b0b80 1 -- 172.21.15.81:0/1412286727 >> 172.21.15.81:0/1412286727 conn(0x557ec99aa210 msgr2=0x557ec9a543d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.872+0000 7f20007b0b80 1 -- 172.21.15.81:0/1412286727 shutdown_connections 2024-05-09T00:12:50.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f20007b0b80 1 -- 172.21.15.81:0/1412286727 wait complete. 2024-05-09T00:12:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f20007b0b80 1 -- start start 2024-05-09T00:12:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f20007b0b80 1 Processor -- start 2024-05-09T00:12:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f20007b0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a4c890 0x557ec9a5b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f20007b0b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a51e00 0x557ec9a5b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f20007b0b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a52720 0x557ec9a5bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f20007b0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec9abb650 con 0x557ec9a4c890 2024-05-09T00:12:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f20007b0b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec9abb790 con 0x557ec9a52720 2024-05-09T00:12:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f20007b0b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ec9abb950 con 0x557ec9a51e00 2024-05-09T00:12:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f20007b0b80 10 client.0 _ll_register_callbacks cb 0x557ec9941b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f1ff2392700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a4c890 0x557ec9a5b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f1ff2392700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a4c890 0x557ec9a5b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55316/0 (socket says 172.21.15.81:55316) 2024-05-09T00:12:50.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f1ff2392700 1 -- 172.21.15.81:0/160943996 learned_addr learned my addr 172.21.15.81:0/160943996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:50.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f1ff2392700 1 -- 172.21.15.81:0/160943996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a51e00 msgr2=0x557ec9a5b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:50.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f1ff2392700 1 --2- 172.21.15.81:0/160943996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a51e00 0x557ec9a5b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f1ff2392700 1 -- 172.21.15.81:0/160943996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a52720 msgr2=0x557ec9a5bbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:12:50.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f1ff2392700 1 --2- 172.21.15.81:0/160943996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a52720 0x557ec9a5bbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.873+0000 7f1ff2392700 1 -- 172.21.15.81:0/160943996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ec97c9b60 con 0x557ec9a4c890 2024-05-09T00:12:50.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f1ff2392700 1 --2- 172.21.15.81:0/160943996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a4c890 0x557ec9a5b150 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009520 tx=0x7f1fe809a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4370839711dd9a6c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:50.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f1fd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:50.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f1fd5ffb700 1 -- 172.21.15.81:0/160943996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe809e050 con 0x557ec9a4c890 2024-05-09T00:12:50.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f1fd5ffb700 1 -- 172.21.15.81:0/160943996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f1fe80a2620 con 0x557ec9a4c890 2024-05-09T00:12:50.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f20007b0b80 1 -- 172.21.15.81:0/160943996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1fdc025460 con 0x557ec9a4c890 2024-05-09T00:12:50.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f1fd5ffb700 1 -- 172.21.15.81:0/160943996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fe80b8340 con 0x557ec9a4c890 2024-05-09T00:12:50.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f20007b0b80 10 client.18231 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:50.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f20007b0b80 1 -- 172.21.15.81:0/160943996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557ec9821cd0 con 0x557ec9a4c890 2024-05-09T00:12:50.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f1fd5ffb700 1 -- 172.21.15.81:0/160943996 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1fdc025460 con 0x557ec9a4c890 2024-05-09T00:12:50.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f1fd5ffb700 1 -- 172.21.15.81:0/160943996 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1fe809a490 con 0x557ec9a4c890 2024-05-09T00:12:50.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f20007b0b80 10 client.18231 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:50.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f20007b0b80 10 client.18231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:50.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f20007b0b80 20 client.18231 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:50.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f20007b0b80 1 --2- 172.21.15.81:0/160943996 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557ec9abd150 0x557ec9abf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:50.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f20007b0b80 4 client.18231 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:12:50.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.874+0000 7f20007b0b80 1 -- 172.21.15.81:0/160943996 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557ec9994ec0 con 0x557ec9abd150 2024-05-09T00:12:50.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.875+0000 7f1ff1b91700 1 --2- 172.21.15.81:0/160943996 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557ec9abd150 0x557ec9abf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:50.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.878+0000 7f1fd5ffb700 10 client.18231 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:50.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.878+0000 7f1ff1b91700 1 --2- 172.21.15.81:0/160943996 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557ec9abd150 0x557ec9abf570 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c876a017a639ab68 server_cookie=4a70dbed452bafd in_seq=0 out_seq=0 2024-05-09T00:12:50.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f1fd5ffb700 1 -- 172.21.15.81:0/160943996 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x557ec9994ec0 con 0x557ec9abd150 2024-05-09T00:12:50.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f1fd5ffb700 10 client.18231 handle_command_reply: tid=0 2024-05-09T00:12:50.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f20007b0b80 1 client.18231 shutdown 2024-05-09T00:12:50.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f20007b0b80 1 -- 172.21.15.81:0/160943996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a4c890 msgr2=0x557ec9a5b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:50.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f20007b0b80 1 --2- 172.21.15.81:0/160943996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a4c890 0x557ec9a5b150 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f1fe8009520 tx=0x7f1fe809a250 comp rx=0 tx=0).stop 2024-05-09T00:12:50.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f20007b0b80 1 -- 172.21.15.81:0/160943996 shutdown_connections 2024-05-09T00:12:50.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f20007b0b80 1 --2- 172.21.15.81:0/160943996 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557ec9abd150 0x557ec9abf570 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f20007b0b80 1 --2- 172.21.15.81:0/160943996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557ec9a52720 0x557ec9a5bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f20007b0b80 1 --2- 172.21.15.81:0/160943996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557ec9a4c890 0x557ec9a5b150 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f1fd5ffb700 0 client.18231 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:50.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f20007b0b80 1 --2- 172.21.15.81:0/160943996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557ec9a51e00 0x557ec9a5b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f20007b0b80 1 -- 172.21.15.81:0/160943996 >> 172.21.15.81:0/160943996 conn(0x557ec99aa210 msgr2=0x557ec9a51470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:50.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f20007b0b80 1 -- 172.21.15.81:0/160943996 shutdown_connections 2024-05-09T00:12:50.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f20007b0b80 1 -- 172.21.15.81:0/160943996 wait complete. 2024-05-09T00:12:50.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f20007b0b80 20 client.18231 trim_cache size 0 max 16384 2024-05-09T00:12:50.882 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:12:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:12:50.882 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:12:50.882 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:12:50.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f1ff45f6700 1 -- 172.21.15.81:0/851667050 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1fd80a1290 msgr2=0x7f1fd80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:50.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f1ff45f6700 1 --2- 172.21.15.81:0/851667050 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1fd80a1290 0x7f1fd80a3750 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0749d0 tx=0x7f1fdc009620 comp rx=0 tx=0).stop 2024-05-09T00:12:50.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f1ff45f6700 1 -- 172.21.15.81:0/851667050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fec101140 msgr2=0x7f1fec0732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:50.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.879+0000 7f1ff45f6700 1 --2- 172.21.15.81:0/851667050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fec101140 0x7f1fec0732a0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800d950 tx=0x7f1fe800dd10 comp rx=0 tx=0).stop 2024-05-09T00:12:50.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.880+0000 7f1ff45f6700 1 -- 172.21.15.81:0/851667050 shutdown_connections 2024-05-09T00:12:50.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.880+0000 7f1ff45f6700 1 --2- 172.21.15.81:0/851667050 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f1fd80a1290 0x7f1fd80a3750 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.880+0000 7f1ff45f6700 1 --2- 172.21.15.81:0/851667050 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fec073d20 0x7f1fec1a5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.880+0000 7f1ff45f6700 1 --2- 172.21.15.81:0/851667050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fec101140 0x7f1fec0732a0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.880+0000 7f1ff45f6700 1 --2- 172.21.15.81:0/851667050 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1fec106260 0x7f1fec0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:50.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.880+0000 7f1ff45f6700 1 -- 172.21.15.81:0/851667050 >> 172.21.15.81:0/851667050 conn(0x7f1fec0fc9e0 msgr2=0x7f1fec0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:50.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.880+0000 7f1ff45f6700 1 -- 172.21.15.81:0/851667050 shutdown_connections 2024-05-09T00:12:50.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:50.880+0000 7f1ff45f6700 1 -- 172.21.15.81:0/851667050 wait complete. 2024-05-09T00:12:50.889 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:12:50.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:12:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.017+0000 7f567428b700 1 -- 172.21.15.81:0/1096264817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c106160 msgr2=0x7f566c10dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.017+0000 7f567428b700 1 --2- 172.21.15.81:0/1096264817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c106160 0x7f566c10dd30 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f566400b0a0 tx=0x7f566400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.017+0000 7f567428b700 1 -- 172.21.15.81:0/1096264817 shutdown_connections 2024-05-09T00:12:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.017+0000 7f567428b700 1 --2- 172.21.15.81:0/1096264817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c106160 0x7f566c10dd30 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.017+0000 7f567428b700 1 --2- 172.21.15.81:0/1096264817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f566c0ff5a0 0x7f566c0ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.017+0000 7f567428b700 1 --2- 172.21.15.81:0/1096264817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f566c0fff50 0x7f566c105a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.017+0000 7f567428b700 1 -- 172.21.15.81:0/1096264817 >> 172.21.15.81:0/1096264817 conn(0x7f566c076270 msgr2=0x7f566c0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.017+0000 7f567428b700 1 -- 172.21.15.81:0/1096264817 shutdown_connections 2024-05-09T00:12:51.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.017+0000 7f567428b700 1 -- 172.21.15.81:0/1096264817 wait complete. 2024-05-09T00:12:51.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.018+0000 7f567428b700 1 Processor -- start 2024-05-09T00:12:51.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.018+0000 7f567428b700 1 -- start start 2024-05-09T00:12:51.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.018+0000 7f567428b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f566c0ff5a0 0x7f566c197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.018+0000 7f567428b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c106160 0x7f566c1978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.018+0000 7f567428b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f566c19bc50 0x7f566c19c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.018+0000 7f567428b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c19c6d0 con 0x7f566c106160 2024-05-09T00:12:51.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.018+0000 7f567428b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c19c840 con 0x7f566c0ff5a0 2024-05-09T00:12:51.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.018+0000 7f567428b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c19ca00 con 0x7f566c19bc50 2024-05-09T00:12:51.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.018+0000 7f5671826700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c106160 0x7f566c1978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.018+0000 7f5671826700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c106160 0x7f566c1978b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55332/0 (socket says 172.21.15.81:55332) 2024-05-09T00:12:51.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.018+0000 7f5671826700 1 -- 172.21.15.81:0/4281112104 learned_addr learned my addr 172.21.15.81:0/4281112104 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.018+0000 7f5672027700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f566c0ff5a0 0x7f566c197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.018+0000 7f5672828700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f566c19bc50 0x7f566c19c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.019+0000 7f5671826700 1 -- 172.21.15.81:0/4281112104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f566c19bc50 msgr2=0x7f566c19c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.019+0000 7f5671826700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f566c19bc50 0x7f566c19c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.019+0000 7f5671826700 1 -- 172.21.15.81:0/4281112104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f566c0ff5a0 msgr2=0x7f566c197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.019+0000 7f5671826700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f566c0ff5a0 0x7f566c197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.019+0000 7f5671826700 1 -- 172.21.15.81:0/4281112104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5664009d00 con 0x7f566c106160 2024-05-09T00:12:51.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.019+0000 7f5672828700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f566c19bc50 0x7f566c19c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:51.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.019+0000 7f5671826700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c106160 0x7f566c1978b0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f565c00c9b0 tx=0x7f565c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.019+0000 7f56637fe700 1 -- 172.21.15.81:0/4281112104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c007aa0 con 0x7f566c106160 2024-05-09T00:12:51.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.019+0000 7f56637fe700 1 -- 172.21.15.81:0/4281112104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f565c007c00 con 0x7f566c106160 2024-05-09T00:12:51.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.019+0000 7f567428b700 1 -- 172.21.15.81:0/4281112104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c1a3f60 con 0x7f566c106160 2024-05-09T00:12:51.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.019+0000 7f56637fe700 1 -- 172.21.15.81:0/4281112104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c018660 con 0x7f566c106160 2024-05-09T00:12:51.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.019+0000 7f567428b700 1 -- 172.21.15.81:0/4281112104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c1a43e0 con 0x7f566c106160 2024-05-09T00:12:51.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.020+0000 7f567428b700 1 -- 172.21.15.81:0/4281112104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566c1093f0 con 0x7f566c106160 2024-05-09T00:12:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.022+0000 7f56637fe700 1 -- 172.21.15.81:0/4281112104 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f565c00f450 con 0x7f566c106160 2024-05-09T00:12:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.022+0000 7f56637fe700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f56580a1290 0x7f56580a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.022+0000 7f5672027700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f56580a1290 0x7f56580a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.022+0000 7f56637fe700 1 -- 172.21.15.81:0/4281112104 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f565c0ccf70 con 0x7f566c106160 2024-05-09T00:12:51.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.023+0000 7f5672027700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f56580a1290 0x7f56580a3750 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5668005950 tx=0x7f566800b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.026+0000 7f56637fe700 1 -- 172.21.15.81:0/4281112104 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f565c096390 con 0x7f566c106160 2024-05-09T00:12:51.038 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.041+0000 7efc0ce5f700 1 -- 172.21.15.81:0/3493531135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc08105e60 msgr2=0x7efc08106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.041+0000 7efc0ce5f700 1 --2- 172.21.15.81:0/3493531135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc08105e60 0x7efc08106240 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009990 tx=0x7efbf8009ca0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.041+0000 7efc0ce5f700 1 -- 172.21.15.81:0/3493531135 shutdown_connections 2024-05-09T00:12:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.041+0000 7efc0ce5f700 1 --2- 172.21.15.81:0/3493531135 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc08100760 0x7efc0810cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.041+0000 7efc0ce5f700 1 --2- 172.21.15.81:0/3493531135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc08105e60 0x7efc08106240 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.041+0000 7efc0ce5f700 1 --2- 172.21.15.81:0/3493531135 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc080ffda0 0x7efc08100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.041+0000 7efc0ce5f700 1 -- 172.21.15.81:0/3493531135 >> 172.21.15.81:0/3493531135 conn(0x7efc08076f10 msgr2=0x7efc08077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.041+0000 7efc0ce5f700 1 -- 172.21.15.81:0/3493531135 shutdown_connections 2024-05-09T00:12:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.041+0000 7efc0ce5f700 1 -- 172.21.15.81:0/3493531135 wait complete. 2024-05-09T00:12:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0ce5f700 1 Processor -- start 2024-05-09T00:12:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0ce5f700 1 -- start start 2024-05-09T00:12:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0ce5f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc080ffda0 0x7efc081980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0ce5f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc08100760 0x7efc08198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0ce5f700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc08105e60 0x7efc081a3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0ce5f700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc08198e60 con 0x7efc080ffda0 2024-05-09T00:12:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0ce5f700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc081a36b0 con 0x7efc08105e60 2024-05-09T00:12:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0ce5f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc081a37f0 con 0x7efc08100760 2024-05-09T00:12:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc080ffda0 0x7efc081980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc080ffda0 0x7efc081980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55346/0 (socket says 172.21.15.81:55346) 2024-05-09T00:12:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0659c700 1 -- 172.21.15.81:0/2607352573 learned_addr learned my addr 172.21.15.81:0/2607352573 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc05d9b700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc08100760 0x7efc08198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc06d9d700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc08105e60 0x7efc081a3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0659c700 1 -- 172.21.15.81:0/2607352573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc08100760 msgr2=0x7efc08198630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0659c700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc08100760 0x7efc08198630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0659c700 1 -- 172.21.15.81:0/2607352573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc08105e60 msgr2=0x7efc081a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0659c700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc08105e60 0x7efc081a3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0659c700 1 -- 172.21.15.81:0/2607352573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf80095f0 con 0x7efc080ffda0 2024-05-09T00:12:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc06d9d700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc08105e60 0x7efc081a3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efc0659c700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc080ffda0 0x7efc081980f0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7efbf80098e0 tx=0x7efbf800f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.042+0000 7efbf77fe700 1 -- 172.21.15.81:0/2607352573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf801d070 con 0x7efc080ffda0 2024-05-09T00:12:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.043+0000 7efbf77fe700 1 -- 172.21.15.81:0/2607352573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efbf800fb90 con 0x7efc080ffda0 2024-05-09T00:12:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.043+0000 7efc0ce5f700 1 -- 172.21.15.81:0/2607352573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc081a39f0 con 0x7efc080ffda0 2024-05-09T00:12:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.043+0000 7efbf77fe700 1 -- 172.21.15.81:0/2607352573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8017650 con 0x7efc080ffda0 2024-05-09T00:12:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.043+0000 7efc0ce5f700 1 -- 172.21.15.81:0/2607352573 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc081a3e70 con 0x7efc080ffda0 2024-05-09T00:12:51.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.045+0000 7efbf77fe700 1 -- 172.21.15.81:0/2607352573 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7efbf800fd00 con 0x7efc080ffda0 2024-05-09T00:12:51.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.046+0000 7efbf77fe700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efbf00a1290 0x7efbf00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.046+0000 7efc05d9b700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efbf00a1290 0x7efbf00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.046+0000 7efbf77fe700 1 -- 172.21.15.81:0/2607352573 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7efbf80cde90 con 0x7efc080ffda0 2024-05-09T00:12:51.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.046+0000 7efc19019b80 1 Processor -- start 2024-05-09T00:12:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc19019b80 1 -- start start 2024-05-09T00:12:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc05d9b700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efbf00a1290 0x7efbf00a3750 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efbfc005ea0 tx=0x7efbfc005e30 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc19019b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3a950 0x565363d3ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc19019b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d34f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc19019b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 0x565363d358a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc19019b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565363c8c0f0 con 0x565363d3b270 2024-05-09T00:12:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc19019b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x565363c89ab0 con 0x565363d3a950 2024-05-09T00:12:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc19019b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x565363c853a0 con 0x565363d35480 2024-05-09T00:12:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc05d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d34f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc05d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d34f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55354/0 (socket says 172.21.15.81:55354) 2024-05-09T00:12:51.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc05d9b700 1 -- 172.21.15.81:0/3568431012 learned_addr learned my addr 172.21.15.81:0/3568431012 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc06d9d700 1 --2- 172.21.15.81:0/3568431012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 0x565363d358a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc0659c700 1 --2- 172.21.15.81:0/3568431012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3a950 0x565363d3ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc05d9b700 1 -- 172.21.15.81:0/3568431012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 msgr2=0x565363d358a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc05d9b700 1 --2- 172.21.15.81:0/3568431012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 0x565363d358a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc05d9b700 1 -- 172.21.15.81:0/3568431012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3a950 msgr2=0x565363d3ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc05d9b700 1 --2- 172.21.15.81:0/3568431012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3a950 0x565363d3ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc05d9b700 1 -- 172.21.15.81:0/3568431012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565363b06350 con 0x565363d3b270 2024-05-09T00:12:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.047+0000 7efc0659c700 1 --2- 172.21.15.81:0/3568431012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3a950 0x565363d3ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.048+0000 7efc05d9b700 1 --2- 172.21.15.81:0/3568431012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d34f40 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7efbfc00a520 tx=0x7efbfc00af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e7c9d8994dd3bc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.048+0000 7efbf4ff9700 1 -- 172.21.15.81:0/3568431012 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc010d80 con 0x565363d3b270 2024-05-09T00:12:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.048+0000 7efbf4ff9700 1 -- 172.21.15.81:0/3568431012 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efbfc01d910 con 0x565363d3b270 2024-05-09T00:12:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.048+0000 7efbf4ff9700 1 -- 172.21.15.81:0/3568431012 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc00f7e0 con 0x565363d3b270 2024-05-09T00:12:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.048+0000 7efc19019b80 1 -- 172.21.15.81:0/3568431012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 msgr2=0x565363d34f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.048+0000 7efc19019b80 1 --2- 172.21.15.81:0/3568431012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d34f40 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7efbfc00a520 tx=0x7efbfc00af90 comp rx=0 tx=0).stop 2024-05-09T00:12:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 -- 172.21.15.81:0/3568431012 shutdown_connections 2024-05-09T00:12:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 --2- 172.21.15.81:0/3568431012 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3a950 0x565363d3ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 --2- 172.21.15.81:0/3568431012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 0x565363d358a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 --2- 172.21.15.81:0/3568431012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d34f40 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 -- 172.21.15.81:0/3568431012 >> 172.21.15.81:0/3568431012 conn(0x565363c931b0 msgr2=0x565363d2f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 -- 172.21.15.81:0/3568431012 shutdown_connections 2024-05-09T00:12:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 -- 172.21.15.81:0/3568431012 wait complete. 2024-05-09T00:12:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 -- start start 2024-05-09T00:12:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 Processor -- start 2024-05-09T00:12:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 0x565363d41210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3a950 0x565363d3e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d3ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565363c21500 con 0x565363d3b270 2024-05-09T00:12:51.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x565363c211a0 con 0x565363d3a950 2024-05-09T00:12:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x565363b08640 con 0x565363d35480 2024-05-09T00:12:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.049+0000 7efc19019b80 10 client.0 _ll_register_callbacks cb 0x565363c2aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efc0659c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 0x565363d41210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efc0659c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 0x565363d41210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:50000/0 (socket says 172.21.15.81:50000) 2024-05-09T00:12:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efc0659c700 1 -- 172.21.15.81:0/2617629343 learned_addr learned my addr 172.21.15.81:0/2617629343 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efc06d9d700 1 --2- 172.21.15.81:0/2617629343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d3ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efc05d9b700 1 --2- 172.21.15.81:0/2617629343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3a950 0x565363d3e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efc0659c700 1 -- 172.21.15.81:0/2617629343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3a950 msgr2=0x565363d3e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efc0659c700 1 --2- 172.21.15.81:0/2617629343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3a950 0x565363d3e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efc0659c700 1 -- 172.21.15.81:0/2617629343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 msgr2=0x565363d3ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efc0659c700 1 --2- 172.21.15.81:0/2617629343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d3ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efc0659c700 1 -- 172.21.15.81:0/2617629343 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc00e9a0 con 0x565363d35480 2024-05-09T00:12:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efc0659c700 1 --2- 172.21.15.81:0/2617629343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 0x565363d41210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efbf809aca0 tx=0x7efbf809a980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13895f7a71919e9a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efbedffb700 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efbedffb700 1 -- 172.21.15.81:0/2617629343 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf809b400 con 0x565363d35480 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efc19019b80 1 -- 172.21.15.81:0/2617629343 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565363bde210 con 0x565363d35480 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efbedffb700 1 -- 172.21.15.81:0/2617629343 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7efbf809edd0 con 0x565363d35480 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efbedffb700 1 -- 172.21.15.81:0/2617629343 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbf80a3390 con 0x565363d35480 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efc19019b80 10 client.26854 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.050+0000 7efc19019b80 1 -- 172.21.15.81:0/2617629343 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x565363ab2b00 con 0x565363d35480 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.051+0000 7efbedffb700 1 -- 172.21.15.81:0/2617629343 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efbf8064080 con 0x565363d35480 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.051+0000 7efbedffb700 1 -- 172.21.15.81:0/2617629343 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7efbf80a2f00 con 0x565363d35480 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.051+0000 7efc19019b80 10 client.26854 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.051+0000 7efc19019b80 10 client.26854 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.051+0000 7efc19019b80 20 client.26854 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.051+0000 7efc19019b80 1 --2- 172.21.15.81:0/2617629343 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x565363d4e720 0x565363d50b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.051+0000 7efc19019b80 4 client.26854 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.051+0000 7efc19019b80 1 -- 172.21.15.81:0/2617629343 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565363d047b0 con 0x565363d4e720 2024-05-09T00:12:51.053 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.051+0000 7efc05d9b700 1 --2- 172.21.15.81:0/2617629343 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x565363d4e720 0x565363d50b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.054 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.051+0000 7efbedffb700 10 client.26854 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:51.054 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.051+0000 7efc05d9b700 1 --2- 172.21.15.81:0/2617629343 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x565363d4e720 0x565363d50b10 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1e720e2f2a7126a server_cookie=e5e3f24d18e52f34 in_seq=0 out_seq=0 2024-05-09T00:12:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.052+0000 7efbedffb700 1 -- 172.21.15.81:0/2617629343 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x565363d047b0 con 0x565363d4e720 2024-05-09T00:12:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.052+0000 7efbedffb700 10 client.26854 handle_command_reply: tid=0 2024-05-09T00:12:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.052+0000 7efc19019b80 1 client.26854 shutdown 2024-05-09T00:12:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.052+0000 7efc19019b80 1 -- 172.21.15.81:0/2617629343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 msgr2=0x565363d41210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.052+0000 7efc19019b80 1 --2- 172.21.15.81:0/2617629343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 0x565363d41210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efbf809aca0 tx=0x7efbf809a980 comp rx=0 tx=0).stop 2024-05-09T00:12:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.052+0000 7efc19019b80 1 -- 172.21.15.81:0/2617629343 shutdown_connections 2024-05-09T00:12:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.052+0000 7efc19019b80 1 --2- 172.21.15.81:0/2617629343 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x565363d4e720 0x565363d50b10 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.052+0000 7efc19019b80 1 --2- 172.21.15.81:0/2617629343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d3ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.052+0000 7efc19019b80 1 --2- 172.21.15.81:0/2617629343 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 0x565363d41210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.052+0000 7efc19019b80 1 --2- 172.21.15.81:0/2617629343 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3a950 0x565363d3e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.052+0000 7efc19019b80 1 -- 172.21.15.81:0/2617629343 >> 172.21.15.81:0/2617629343 conn(0x565363c931b0 msgr2=0x565363d394a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.055 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.052+0000 7efbedffb700 0 client.26854 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:51.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.052+0000 7efc19019b80 1 -- 172.21.15.81:0/2617629343 shutdown_connections 2024-05-09T00:12:51.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.052+0000 7efc19019b80 1 -- 172.21.15.81:0/2617629343 wait complete. 2024-05-09T00:12:51.056 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.053+0000 7efc19019b80 20 client.26854 trim_cache size 0 max 16384 2024-05-09T00:12:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.067+0000 7efc19019b80 1 Processor -- start 2024-05-09T00:12:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.067+0000 7efc19019b80 1 -- start start 2024-05-09T00:12:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.067+0000 7efc19019b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d35480 0x565363d3ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.067+0000 7efc19019b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d3a950 0x565363d2f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efc19019b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d35860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efc19019b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565363d34150 con 0x565363d3b270 2024-05-09T00:12:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efc19019b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x565363d3f450 con 0x565363d35480 2024-05-09T00:12:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efc19019b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x565363d4b010 con 0x565363d3a950 2024-05-09T00:12:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efc06d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d35860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efc06d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d35860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55370/0 (socket says 172.21.15.81:55370) 2024-05-09T00:12:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efc06d9d700 1 -- 172.21.15.81:0/1226333877 learned_addr learned my addr 172.21.15.81:0/1226333877 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efc0659c700 1 --2- 172.21.15.81:0/1226333877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d35480 0x565363d3ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.066 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efc06d9d700 1 -- 172.21.15.81:0/1226333877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d3a950 msgr2=0x565363d2f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efc06d9d700 1 --2- 172.21.15.81:0/1226333877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d3a950 0x565363d2f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efc06d9d700 1 -- 172.21.15.81:0/1226333877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d35480 msgr2=0x565363d3ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efc06d9d700 1 --2- 172.21.15.81:0/1226333877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d35480 0x565363d3ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efc06d9d700 1 -- 172.21.15.81:0/1226333877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565363c4b500 con 0x565363d3b270 2024-05-09T00:12:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efc06d9d700 1 --2- 172.21.15.81:0/1226333877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d35860 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7efc00009d30 tx=0x7efc00009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbfa088e88e5905 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efbf57fa700 1 -- 172.21.15.81:0/1226333877 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00009a10 con 0x565363d3b270 2024-05-09T00:12:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efbf57fa700 1 -- 172.21.15.81:0/1226333877 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc00017930 con 0x565363d3b270 2024-05-09T00:12:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.068+0000 7efbf57fa700 1 -- 172.21.15.81:0/1226333877 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc000168d0 con 0x565363d3b270 2024-05-09T00:12:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.069+0000 7efc19019b80 1 -- 172.21.15.81:0/1226333877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 msgr2=0x565363d35860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.069+0000 7efc19019b80 1 --2- 172.21.15.81:0/1226333877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d35860 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7efc00009d30 tx=0x7efc00009040 comp rx=0 tx=0).stop 2024-05-09T00:12:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.069+0000 7efc19019b80 1 -- 172.21.15.81:0/1226333877 shutdown_connections 2024-05-09T00:12:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.069+0000 7efc19019b80 1 --2- 172.21.15.81:0/1226333877 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d35480 0x565363d3ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.069+0000 7efc19019b80 1 --2- 172.21.15.81:0/1226333877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3b270 0x565363d35860 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.069+0000 7efc19019b80 1 --2- 172.21.15.81:0/1226333877 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d3a950 0x565363d2f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.069+0000 7efc19019b80 1 -- 172.21.15.81:0/1226333877 >> 172.21.15.81:0/1226333877 conn(0x565363c931b0 msgr2=0x565363d39d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.069+0000 7efc19019b80 1 -- 172.21.15.81:0/1226333877 shutdown_connections 2024-05-09T00:12:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.069+0000 7efc19019b80 1 -- 172.21.15.81:0/1226333877 wait complete. 2024-05-09T00:12:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.069+0000 7efc19019b80 1 -- start start 2024-05-09T00:12:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.069+0000 7efc19019b80 1 Processor -- start 2024-05-09T00:12:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc19019b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 0x565363d45c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc19019b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3a950 0x565363d461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc19019b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3b270 0x565363d41e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc19019b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565363d42550 con 0x565363d3a950 2024-05-09T00:12:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc19019b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x565363d426c0 con 0x565363d3b270 2024-05-09T00:12:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc19019b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x565363d42880 con 0x565363d35480 2024-05-09T00:12:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc19019b80 10 client.0 _ll_register_callbacks cb 0x565363c2aad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc05d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3a950 0x565363d461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc05d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3a950 0x565363d461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55386/0 (socket says 172.21.15.81:55386) 2024-05-09T00:12:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc05d9b700 1 -- 172.21.15.81:0/3732452439 learned_addr learned my addr 172.21.15.81:0/3732452439 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc06d9d700 1 --2- 172.21.15.81:0/3732452439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3b270 0x565363d41e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc05d9b700 1 -- 172.21.15.81:0/3732452439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 msgr2=0x565363d45c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc05d9b700 1 --2- 172.21.15.81:0/3732452439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 0x565363d45c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc05d9b700 1 -- 172.21.15.81:0/3732452439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3b270 msgr2=0x565363d41e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc05d9b700 1 --2- 172.21.15.81:0/3732452439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3b270 0x565363d41e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc05d9b700 1 -- 172.21.15.81:0/3732452439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc00011040 con 0x565363d3a950 2024-05-09T00:12:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc05d9b700 1 --2- 172.21.15.81:0/3732452439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3a950 0x565363d461c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x565363d30790 tx=0x7efbfc00e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1fd1207536484f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efbedffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efbedffb700 1 -- 172.21.15.81:0/3732452439 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbfc02d050 con 0x565363d3a950 2024-05-09T00:12:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efbedffb700 1 -- 172.21.15.81:0/3732452439 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7efbfc01d720 con 0x565363d3a950 2024-05-09T00:12:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.070+0000 7efc19019b80 1 -- 172.21.15.81:0/3732452439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efbfc01d910 con 0x565363d3a950 2024-05-09T00:12:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.071+0000 7efbedffb700 1 -- 172.21.15.81:0/3732452439 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbfc01dc80 con 0x565363d3a950 2024-05-09T00:12:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.071+0000 7efc19019b80 10 client.18255 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.071+0000 7efc19019b80 1 -- 172.21.15.81:0/3732452439 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x565363b0ac70 con 0x565363d3a950 2024-05-09T00:12:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.071+0000 7efbedffb700 1 -- 172.21.15.81:0/3732452439 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efbfc01d910 con 0x565363d3a950 2024-05-09T00:12:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.071+0000 7efbedffb700 1 -- 172.21.15.81:0/3732452439 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7efbfc004b20 con 0x565363d3a950 2024-05-09T00:12:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.071+0000 7efc19019b80 10 client.18255 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.071+0000 7efc19019b80 10 client.18255 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.071+0000 7efc19019b80 20 client.18255 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.071+0000 7efc19019b80 1 --2- 172.21.15.81:0/3732452439 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x565363da4e70 0x565363da7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.071+0000 7efc19019b80 4 client.18255 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:12:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.071+0000 7efc19019b80 1 -- 172.21.15.81:0/3732452439 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x565363c7de60 con 0x565363da4e70 2024-05-09T00:12:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.071+0000 7efc0659c700 1 --2- 172.21.15.81:0/3732452439 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x565363da4e70 0x565363da7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.072+0000 7efbedffb700 10 client.18255 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.072+0000 7efc0659c700 1 --2- 172.21.15.81:0/3732452439 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x565363da4e70 0x565363da7290 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b48a3a6eebe1080 server_cookie=dbb62dfb3c346f0f in_seq=0 out_seq=0 2024-05-09T00:12:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.086+0000 7efbedffb700 1 -- 172.21.15.81:0/3732452439 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x565363c7de60 con 0x565363da4e70 2024-05-09T00:12:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.086+0000 7efbedffb700 10 client.18255 handle_command_reply: tid=0 2024-05-09T00:12:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.086+0000 7efc19019b80 1 client.18255 shutdown 2024-05-09T00:12:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.086+0000 7efc19019b80 1 -- 172.21.15.81:0/3732452439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3a950 msgr2=0x565363d461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.086+0000 7efc19019b80 1 --2- 172.21.15.81:0/3732452439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3a950 0x565363d461c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x565363d30790 tx=0x7efbfc00e7e0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc19019b80 1 -- 172.21.15.81:0/3732452439 shutdown_connections 2024-05-09T00:12:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc19019b80 1 --2- 172.21.15.81:0/3732452439 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x565363da4e70 0x565363da7290 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc19019b80 1 --2- 172.21.15.81:0/3732452439 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565363d3b270 0x565363d41e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc19019b80 1 --2- 172.21.15.81:0/3732452439 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565363d35480 0x565363d45c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efbedffb700 0 client.18255 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc19019b80 1 --2- 172.21.15.81:0/3732452439 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565363d3a950 0x565363d461c0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc19019b80 1 -- 172.21.15.81:0/3732452439 >> 172.21.15.81:0/3732452439 conn(0x565363c931b0 msgr2=0x565363d33630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc19019b80 1 -- 172.21.15.81:0/3732452439 shutdown_connections 2024-05-09T00:12:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc19019b80 1 -- 172.21.15.81:0/3732452439 wait complete. 2024-05-09T00:12:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc19019b80 20 client.18255 trim_cache size 0 max 16384 2024-05-09T00:12:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:12:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:12:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:12:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:12:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc0ce5f700 1 -- 172.21.15.81:0/2607352573 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efbf00a1290 msgr2=0x7efbf00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc0ce5f700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efbf00a1290 0x7efbf00a3750 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efbfc005ea0 tx=0x7efbfc005e30 comp rx=0 tx=0).stop 2024-05-09T00:12:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc0ce5f700 1 -- 172.21.15.81:0/2607352573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc080ffda0 msgr2=0x7efc081980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc0ce5f700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc080ffda0 0x7efc081980f0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7efbf80098e0 tx=0x7efbf800f720 comp rx=0 tx=0).stop 2024-05-09T00:12:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc0ce5f700 1 -- 172.21.15.81:0/2607352573 shutdown_connections 2024-05-09T00:12:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc0ce5f700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efbf00a1290 0x7efbf00a3750 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc0ce5f700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efc08105e60 0x7efc081a3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc0ce5f700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc080ffda0 0x7efc081980f0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc0ce5f700 1 --2- 172.21.15.81:0/2607352573 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efc08100760 0x7efc08198630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc0ce5f700 1 -- 172.21.15.81:0/2607352573 >> 172.21.15.81:0/2607352573 conn(0x7efc08076f10 msgr2=0x7efc080fea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.087+0000 7efc0ce5f700 1 -- 172.21.15.81:0/2607352573 shutdown_connections 2024-05-09T00:12:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:12:51.088+0000 7efc0ce5f700 1 -- 172.21.15.81:0/2607352573 wait complete. 2024-05-09T00:12:51.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:50 smithi081 ceph-mon[42474]: pgmap v305: 97 pgs: 97 active+clean; 2.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:12:51.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:50 smithi150 ceph-mon[46187]: pgmap v305: 97 pgs: 97 active+clean; 2.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:12:51.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.281+0000 7f567428b700 1 -- 172.21.15.81:0/4281112104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f566c102650 con 0x7f566c106160 2024-05-09T00:12:51.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.282+0000 7f56637fe700 1 -- 172.21.15.81:0/4281112104 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7f565c0999b0 con 0x7f566c106160 2024-05-09T00:12:51.279 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:12:51.280 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:12:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.284+0000 7f567428b700 1 -- 172.21.15.81:0/4281112104 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f56580a1290 msgr2=0x7f56580a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.284+0000 7f567428b700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f56580a1290 0x7f56580a3750 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5668005950 tx=0x7f566800b410 comp rx=0 tx=0).stop 2024-05-09T00:12:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.284+0000 7f567428b700 1 -- 172.21.15.81:0/4281112104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c106160 msgr2=0x7f566c1978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.284+0000 7f567428b700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c106160 0x7f566c1978b0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f565c00c9b0 tx=0x7f565c00ccc0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.284+0000 7f567428b700 1 -- 172.21.15.81:0/4281112104 shutdown_connections 2024-05-09T00:12:51.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.284+0000 7f567428b700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f56580a1290 0x7f56580a3750 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.284+0000 7f567428b700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f566c0ff5a0 0x7f566c197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.284+0000 7f567428b700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f566c19bc50 0x7f566c19c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.284+0000 7f567428b700 1 --2- 172.21.15.81:0/4281112104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f566c106160 0x7f566c1978b0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.284+0000 7f567428b700 1 -- 172.21.15.81:0/4281112104 >> 172.21.15.81:0/4281112104 conn(0x7f566c076270 msgr2=0x7f566c104240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.285+0000 7f567428b700 1 -- 172.21.15.81:0/4281112104 shutdown_connections 2024-05-09T00:12:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.285+0000 7f567428b700 1 -- 172.21.15.81:0/4281112104 wait complete. 2024-05-09T00:12:51.283 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:12:51.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:12:51.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:50 smithi171 ceph-mon[47351]: pgmap v305: 97 pgs: 97 active+clean; 2.1 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:12:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.421+0000 7f78d48c6700 1 -- 172.21.15.81:0/2501347482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d00ffe10 msgr2=0x7f78d0100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.421+0000 7f78d48c6700 1 --2- 172.21.15.81:0/2501347482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d00ffe10 0x7f78d0100290 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f78c0009990 tx=0x7f78c0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.421+0000 7f78d48c6700 1 -- 172.21.15.81:0/2501347482 shutdown_connections 2024-05-09T00:12:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.421+0000 7f78d48c6700 1 --2- 172.21.15.81:0/2501347482 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78d0105ed0 0x7f78d01062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.421+0000 7f78d48c6700 1 --2- 172.21.15.81:0/2501347482 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d01007d0 0x7f78d010cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.421+0000 7f78d48c6700 1 --2- 172.21.15.81:0/2501347482 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d00ffe10 0x7f78d0100290 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.421+0000 7f78d48c6700 1 -- 172.21.15.81:0/2501347482 >> 172.21.15.81:0/2501347482 conn(0x7f78d0076f10 msgr2=0x7f78d0077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.421+0000 7f78d48c6700 1 -- 172.21.15.81:0/2501347482 shutdown_connections 2024-05-09T00:12:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.421+0000 7f78d48c6700 1 -- 172.21.15.81:0/2501347482 wait complete. 2024-05-09T00:12:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78d48c6700 1 Processor -- start 2024-05-09T00:12:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78d48c6700 1 -- start start 2024-05-09T00:12:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78d48c6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d00ffe10 0x7f78d0101ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78d48c6700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d01007d0 0x7f78d0102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78d48c6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78d0105ed0 0x7f78d0102540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78d48c6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d01a55d0 con 0x7f78d00ffe10 2024-05-09T00:12:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78d48c6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d01a5740 con 0x7f78d0105ed0 2024-05-09T00:12:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78d48c6700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d01a5900 con 0x7f78d01007d0 2024-05-09T00:12:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78ce59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d00ffe10 0x7f78d0101ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78ce59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d00ffe10 0x7f78d0101ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55406/0 (socket says 172.21.15.81:55406) 2024-05-09T00:12:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78ce59c700 1 -- 172.21.15.81:0/1721244903 learned_addr learned my addr 172.21.15.81:0/1721244903 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78ce59c700 1 -- 172.21.15.81:0/1721244903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d01007d0 msgr2=0x7f78d0102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78ce59c700 1 --2- 172.21.15.81:0/1721244903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d01007d0 0x7f78d0102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78ce59c700 1 -- 172.21.15.81:0/1721244903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78d0105ed0 msgr2=0x7f78d0102540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78ce59c700 1 --2- 172.21.15.81:0/1721244903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78d0105ed0 0x7f78d0102540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78ce59c700 1 -- 172.21.15.81:0/1721244903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c00095f0 con 0x7f78d00ffe10 2024-05-09T00:12:51.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.422+0000 7f78ce59c700 1 --2- 172.21.15.81:0/1721244903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d00ffe10 0x7f78d0101ac0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f78c400c9b0 tx=0x7f78c400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.423+0000 7f78bf7fe700 1 -- 172.21.15.81:0/1721244903 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4007b00 con 0x7f78d00ffe10 2024-05-09T00:12:51.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.423+0000 7f78bf7fe700 1 -- 172.21.15.81:0/1721244903 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78c4007c60 con 0x7f78d00ffe10 2024-05-09T00:12:51.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.423+0000 7f78d48c6700 1 -- 172.21.15.81:0/1721244903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d01a5be0 con 0x7f78d00ffe10 2024-05-09T00:12:51.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.423+0000 7f78bf7fe700 1 -- 172.21.15.81:0/1721244903 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4018660 con 0x7f78d00ffe10 2024-05-09T00:12:51.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.423+0000 7f78d48c6700 1 -- 172.21.15.81:0/1721244903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d01a60f0 con 0x7f78d00ffe10 2024-05-09T00:12:51.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.425+0000 7f78bf7fe700 1 -- 172.21.15.81:0/1721244903 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f78c4018880 con 0x7f78d00ffe10 2024-05-09T00:12:51.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.425+0000 7f78bf7fe700 1 --2- 172.21.15.81:0/1721244903 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f78b80a1290 0x7f78b80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.426+0000 7f78cdd9b700 1 --2- 172.21.15.81:0/1721244903 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f78b80a1290 0x7f78b80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.426+0000 7f78bf7fe700 1 -- 172.21.15.81:0/1721244903 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f78c40ccd90 con 0x7f78d00ffe10 2024-05-09T00:12:51.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.426+0000 7f78cdd9b700 1 --2- 172.21.15.81:0/1721244903 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f78b80a1290 0x7f78b80a3750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f78c000b5c0 tx=0x7f78c0005fb0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.426+0000 7f78e0a80b80 1 Processor -- start 2024-05-09T00:12:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78e0a80b80 1 -- start start 2024-05-09T00:12:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78e0a80b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c33e00 0x561e40c341e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78e0a80b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c34720 0x561e40c2e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78e0a80b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c2e890 0x561e40c2ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78e0a80b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e40b85150 con 0x561e40c2e890 2024-05-09T00:12:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78e0a80b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e40b82b10 con 0x561e40c34720 2024-05-09T00:12:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78e0a80b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e40b7e400 con 0x561e40c33e00 2024-05-09T00:12:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78ced9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c2e890 0x561e40c2ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78ced9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c2e890 0x561e40c2ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55418/0 (socket says 172.21.15.81:55418) 2024-05-09T00:12:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78ced9d700 1 -- 172.21.15.81:0/826052297 learned_addr learned my addr 172.21.15.81:0/826052297 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78cdd9b700 1 --2- 172.21.15.81:0/826052297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c34720 0x561e40c2e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78ced9d700 1 -- 172.21.15.81:0/826052297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c33e00 msgr2=0x561e40c341e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78ced9d700 1 --2- 172.21.15.81:0/826052297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c33e00 0x561e40c341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78ced9d700 1 -- 172.21.15.81:0/826052297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c34720 msgr2=0x561e40c2e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78ced9d700 1 --2- 172.21.15.81:0/826052297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c34720 0x561e40c2e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78ced9d700 1 -- 172.21.15.81:0/826052297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e409ff3b0 con 0x561e40c2e890 2024-05-09T00:12:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78ced9d700 1 --2- 172.21.15.81:0/826052297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c2e890 0x561e40c2ecd0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f78c800d190 tx=0x7f78c800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddea2af479aefc4b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78bcff9700 1 -- 172.21.15.81:0/826052297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8013620 con 0x561e40c2e890 2024-05-09T00:12:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78bcff9700 1 -- 172.21.15.81:0/826052297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78c8008b10 con 0x561e40c2e890 2024-05-09T00:12:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.427+0000 7f78bcff9700 1 -- 172.21.15.81:0/826052297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8012a80 con 0x561e40c2e890 2024-05-09T00:12:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.428+0000 7f78e0a80b80 1 -- 172.21.15.81:0/826052297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c2e890 msgr2=0x561e40c2ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.428+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/826052297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c2e890 0x561e40c2ecd0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f78c800d190 tx=0x7f78c800d4a0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.428+0000 7f78e0a80b80 1 -- 172.21.15.81:0/826052297 shutdown_connections 2024-05-09T00:12:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.428+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/826052297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c2e890 0x561e40c2ecd0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.428+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/826052297 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c33e00 0x561e40c341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.428+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/826052297 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c34720 0x561e40c2e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.428+0000 7f78e0a80b80 1 -- 172.21.15.81:0/826052297 >> 172.21.15.81:0/826052297 conn(0x561e40b8c210 msgr2=0x561e40c28df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.428+0000 7f78e0a80b80 1 -- 172.21.15.81:0/826052297 shutdown_connections 2024-05-09T00:12:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.428+0000 7f78e0a80b80 1 -- 172.21.15.81:0/826052297 wait complete. 2024-05-09T00:12:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78e0a80b80 1 -- start start 2024-05-09T00:12:51.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78e0a80b80 1 Processor -- start 2024-05-09T00:12:51.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78e0a80b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c2e890 0x561e40c37c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78e0a80b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c33e00 0x561e40c381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78e0a80b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c34720 0x561e40c38700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78e0a80b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e40b1a560 con 0x561e40c34720 2024-05-09T00:12:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78e0a80b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e40b1a200 con 0x561e40c2e890 2024-05-09T00:12:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78e0a80b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e40a016a0 con 0x561e40c33e00 2024-05-09T00:12:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78e0a80b80 10 client.0 _ll_register_callbacks cb 0x561e40b23b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78ced9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c34720 0x561e40c38700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78ced9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c34720 0x561e40c38700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55426/0 (socket says 172.21.15.81:55426) 2024-05-09T00:12:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78ced9d700 1 -- 172.21.15.81:0/3726732438 learned_addr learned my addr 172.21.15.81:0/3726732438 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78ce59c700 1 --2- 172.21.15.81:0/3726732438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c2e890 0x561e40c37c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78ced9d700 1 -- 172.21.15.81:0/3726732438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c33e00 msgr2=0x561e40c381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78cdd9b700 1 --2- 172.21.15.81:0/3726732438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c33e00 0x561e40c381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78ced9d700 1 --2- 172.21.15.81:0/3726732438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c33e00 0x561e40c381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78ced9d700 1 -- 172.21.15.81:0/3726732438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c2e890 msgr2=0x561e40c37c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78ced9d700 1 --2- 172.21.15.81:0/3726732438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c2e890 0x561e40c37c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78ced9d700 1 -- 172.21.15.81:0/3726732438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c8008c90 con 0x561e40c34720 2024-05-09T00:12:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78ce59c700 1 --2- 172.21.15.81:0/3726732438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c2e890 0x561e40c37c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78ced9d700 1 --2- 172.21.15.81:0/3726732438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c34720 0x561e40c38700 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f78c80125e0 tx=0x7f78c8003a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa259a278cf23f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.429+0000 7f78b5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78b5ffb700 1 -- 172.21.15.81:0/3726732438 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c80128e0 con 0x561e40c34720 2024-05-09T00:12:51.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78b5ffb700 1 -- 172.21.15.81:0/3726732438 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f78c8012a40 con 0x561e40c34720 2024-05-09T00:12:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78e0a80b80 1 -- 172.21.15.81:0/3726732438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e40bfd810 con 0x561e40c34720 2024-05-09T00:12:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78b5ffb700 1 -- 172.21.15.81:0/3726732438 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78c8012c00 con 0x561e40c34720 2024-05-09T00:12:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78e0a80b80 10 client.18267 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78e0a80b80 1 -- 172.21.15.81:0/3726732438 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561e409abb60 con 0x561e40c34720 2024-05-09T00:12:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78b5ffb700 1 -- 172.21.15.81:0/3726732438 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561e40bfd810 con 0x561e40c34720 2024-05-09T00:12:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78b5ffb700 1 -- 172.21.15.81:0/3726732438 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f78c8004040 con 0x561e40c34720 2024-05-09T00:12:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78e0a80b80 10 client.18267 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78e0a80b80 10 client.18267 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:12:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78e0a80b80 20 client.18267 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/3726732438 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561e40c48200 0x561e40c4a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78e0a80b80 4 client.18267 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:51.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78e0a80b80 1 -- 172.21.15.81:0/3726732438 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e40b76ec0 con 0x561e40c48200 2024-05-09T00:12:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.430+0000 7f78ce59c700 1 --2- 172.21.15.81:0/3726732438 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561e40c48200 0x561e40c4a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.431+0000 7f78b5ffb700 10 client.18267 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:12:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.431+0000 7f78ce59c700 1 --2- 172.21.15.81:0/3726732438 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561e40c48200 0x561e40c4a620 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b88ca5b15174844d server_cookie=94be33d65384239f in_seq=0 out_seq=0 2024-05-09T00:12:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.431+0000 7f78b5ffb700 1 -- 172.21.15.81:0/3726732438 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561e40b76ec0 con 0x561e40c48200 2024-05-09T00:12:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.431+0000 7f78b5ffb700 10 client.18267 handle_command_reply: tid=0 2024-05-09T00:12:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.432+0000 7f78e0a80b80 1 client.18267 shutdown 2024-05-09T00:12:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.432+0000 7f78e0a80b80 1 -- 172.21.15.81:0/3726732438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c34720 msgr2=0x561e40c38700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.432+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/3726732438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c34720 0x561e40c38700 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f78c80125e0 tx=0x7f78c8003a00 comp rx=0 tx=0).stop 2024-05-09T00:12:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.432+0000 7f78e0a80b80 1 -- 172.21.15.81:0/3726732438 shutdown_connections 2024-05-09T00:12:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.432+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/3726732438 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561e40c48200 0x561e40c4a620 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.432+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/3726732438 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c2e890 0x561e40c37c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.432+0000 7f78b5ffb700 0 client.18267 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:12:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.432+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/3726732438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c34720 0x561e40c38700 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.432+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/3726732438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c33e00 0x561e40c381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.432+0000 7f78e0a80b80 1 -- 172.21.15.81:0/3726732438 >> 172.21.15.81:0/3726732438 conn(0x561e40b8c210 msgr2=0x561e40c285a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.432+0000 7f78e0a80b80 1 -- 172.21.15.81:0/3726732438 shutdown_connections 2024-05-09T00:12:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.432+0000 7f78e0a80b80 1 -- 172.21.15.81:0/3726732438 wait complete. 2024-05-09T00:12:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.432+0000 7f78e0a80b80 20 client.18267 trim_cache size 0 max 16384 2024-05-09T00:12:51.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.445+0000 7f78e0a80b80 1 Processor -- start 2024-05-09T00:12:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.445+0000 7f78e0a80b80 1 -- start start 2024-05-09T00:12:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.445+0000 7f78e0a80b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c2e890 0x561e40c2e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.445+0000 7f78e0a80b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c33e00 0x561e40c443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.445+0000 7f78e0a80b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c34720 0x561e40c28d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.445+0000 7f78e0a80b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e40b76ec0 con 0x561e40c2e890 2024-05-09T00:12:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.445+0000 7f78e0a80b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e40bfd810 con 0x561e40c34720 2024-05-09T00:12:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.445+0000 7f78e0a80b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e40c44ea0 con 0x561e40c33e00 2024-05-09T00:12:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.445+0000 7f78ce59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c2e890 0x561e40c2e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.445+0000 7f78ce59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c2e890 0x561e40c2e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55432/0 (socket says 172.21.15.81:55432) 2024-05-09T00:12:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.445+0000 7f78ce59c700 1 -- 172.21.15.81:0/2754911692 learned_addr learned my addr 172.21.15.81:0/2754911692 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.446+0000 7f78ce59c700 1 -- 172.21.15.81:0/2754911692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c33e00 msgr2=0x561e40c443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.446+0000 7f78ce59c700 1 --2- 172.21.15.81:0/2754911692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c33e00 0x561e40c443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.446+0000 7f78ce59c700 1 -- 172.21.15.81:0/2754911692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c34720 msgr2=0x561e40c28d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.446+0000 7f78ce59c700 1 --2- 172.21.15.81:0/2754911692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c34720 0x561e40c28d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.446+0000 7f78ce59c700 1 -- 172.21.15.81:0/2754911692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e40b44560 con 0x561e40c2e890 2024-05-09T00:12:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.446+0000 7f78ce59c700 1 --2- 172.21.15.81:0/2754911692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c2e890 0x561e40c2e350 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f78c40074a0 tx=0x7f78c4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a7ab10a302866d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.446+0000 7f78bd7fa700 1 -- 172.21.15.81:0/2754911692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c409dca0 con 0x561e40c2e890 2024-05-09T00:12:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.446+0000 7f78bd7fa700 1 -- 172.21.15.81:0/2754911692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f78c40a22f0 con 0x561e40c2e890 2024-05-09T00:12:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.446+0000 7f78bd7fa700 1 -- 172.21.15.81:0/2754911692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c409a330 con 0x561e40c2e890 2024-05-09T00:12:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 -- 172.21.15.81:0/2754911692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c2e890 msgr2=0x561e40c2e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/2754911692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c2e890 0x561e40c2e350 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f78c40074a0 tx=0x7f78c4000bc0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 -- 172.21.15.81:0/2754911692 shutdown_connections 2024-05-09T00:12:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/2754911692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c34720 0x561e40c28d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/2754911692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c2e890 0x561e40c2e350 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/2754911692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c33e00 0x561e40c443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 -- 172.21.15.81:0/2754911692 >> 172.21.15.81:0/2754911692 conn(0x561e40b8c210 msgr2=0x561e40c25210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 -- 172.21.15.81:0/2754911692 shutdown_connections 2024-05-09T00:12:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 -- 172.21.15.81:0/2754911692 wait complete. 2024-05-09T00:12:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 -- start start 2024-05-09T00:12:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 Processor -- start 2024-05-09T00:12:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c2e890 0x561e40c3f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c33e00 0x561e40c3b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c34720 0x561e40c3b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e40c3bd70 con 0x561e40c34720 2024-05-09T00:12:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e40c3bee0 con 0x561e40c33e00 2024-05-09T00:12:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e40c9d6f0 con 0x561e40c2e890 2024-05-09T00:12:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78e0a80b80 10 client.0 _ll_register_callbacks cb 0x561e40b23b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.447+0000 7f78ced9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c34720 0x561e40c3b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78ced9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c34720 0x561e40c3b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55436/0 (socket says 172.21.15.81:55436) 2024-05-09T00:12:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78ced9d700 1 -- 172.21.15.81:0/2856702714 learned_addr learned my addr 172.21.15.81:0/2856702714 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78ce59c700 1 --2- 172.21.15.81:0/2856702714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c2e890 0x561e40c3f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78ced9d700 1 -- 172.21.15.81:0/2856702714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c2e890 msgr2=0x561e40c3f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78ced9d700 1 --2- 172.21.15.81:0/2856702714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c2e890 0x561e40c3f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78ced9d700 1 -- 172.21.15.81:0/2856702714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c33e00 msgr2=0x561e40c3b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78ced9d700 1 --2- 172.21.15.81:0/2856702714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c33e00 0x561e40c3b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78ced9d700 1 -- 172.21.15.81:0/2856702714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d01a60f0 con 0x561e40c34720 2024-05-09T00:12:51.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78ced9d700 1 --2- 172.21.15.81:0/2856702714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c34720 0x561e40c3b6b0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f78c8002230 tx=0x7f78c8003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f0e070ce7c24e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78b5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:51.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78b5ffb700 1 -- 172.21.15.81:0/2856702714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8008940 con 0x561e40c34720 2024-05-09T00:12:51.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78b5ffb700 1 -- 172.21.15.81:0/2856702714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f78c80046c0 con 0x561e40c34720 2024-05-09T00:12:51.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78e0a80b80 1 -- 172.21.15.81:0/2856702714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e40ad7270 con 0x561e40c34720 2024-05-09T00:12:51.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78b5ffb700 1 -- 172.21.15.81:0/2856702714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78c8008040 con 0x561e40c34720 2024-05-09T00:12:51.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78e0a80b80 10 client.18273 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:51.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78e0a80b80 1 -- 172.21.15.81:0/2856702714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561e40a03cd0 con 0x561e40c34720 2024-05-09T00:12:51.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.448+0000 7f78b5ffb700 1 -- 172.21.15.81:0/2856702714 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561e40ad7270 con 0x561e40c34720 2024-05-09T00:12:51.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.449+0000 7f78b5ffb700 1 -- 172.21.15.81:0/2856702714 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f78c8007480 con 0x561e40c34720 2024-05-09T00:12:51.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.449+0000 7f78e0a80b80 10 client.18273 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:51.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.449+0000 7f78e0a80b80 10 client.18273 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:12:51.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.449+0000 7f78e0a80b80 20 client.18273 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.449+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/2856702714 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561e40c9e8f0 0x561e40ca0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.449+0000 7f78e0a80b80 4 client.18273 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:12:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.449+0000 7f78e0a80b80 1 -- 172.21.15.81:0/2856702714 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561e409cccf0 con 0x561e40c9e8f0 2024-05-09T00:12:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.449+0000 7f78ce59c700 1 --2- 172.21.15.81:0/2856702714 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561e40c9e8f0 0x561e40ca0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.449+0000 7f78ce59c700 1 --2- 172.21.15.81:0/2856702714 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561e40c9e8f0 0x561e40ca0ce0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2dfe79ae83d46c2 server_cookie=e14a837140d08ae4 in_seq=0 out_seq=0 2024-05-09T00:12:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.449+0000 7f78b5ffb700 10 client.18273 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:12:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78b5ffb700 1 -- 172.21.15.81:0/2856702714 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561e409cccf0 con 0x561e40c9e8f0 2024-05-09T00:12:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78b5ffb700 10 client.18273 handle_command_reply: tid=0 2024-05-09T00:12:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78e0a80b80 1 client.18273 shutdown 2024-05-09T00:12:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78e0a80b80 1 -- 172.21.15.81:0/2856702714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c34720 msgr2=0x561e40c3b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/2856702714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c34720 0x561e40c3b6b0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f78c8002230 tx=0x7f78c8003f60 comp rx=0 tx=0).stop 2024-05-09T00:12:51.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78e0a80b80 1 -- 172.21.15.81:0/2856702714 shutdown_connections 2024-05-09T00:12:51.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/2856702714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x561e40c34720 0x561e40c3b6b0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/2856702714 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x561e40c2e890 0x561e40c3f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/2856702714 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x561e40c9e8f0 0x561e40ca0ce0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78e0a80b80 1 --2- 172.21.15.81:0/2856702714 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x561e40c33e00 0x561e40c3b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78e0a80b80 1 -- 172.21.15.81:0/2856702714 >> 172.21.15.81:0/2856702714 conn(0x561e40b8c210 msgr2=0x561e40c443f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78b5ffb700 0 client.18273 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:12:51.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78e0a80b80 1 -- 172.21.15.81:0/2856702714 shutdown_connections 2024-05-09T00:12:51.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78e0a80b80 1 -- 172.21.15.81:0/2856702714 wait complete. 2024-05-09T00:12:51.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78e0a80b80 20 client.18273 trim_cache size 0 max 16384 2024-05-09T00:12:51.456 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:12:51.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78d48c6700 1 -- 172.21.15.81:0/1721244903 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f78b80a1290 msgr2=0x7f78b80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78d48c6700 1 --2- 172.21.15.81:0/1721244903 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f78b80a1290 0x7f78b80a3750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f78c000b5c0 tx=0x7f78c0005fb0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78d48c6700 1 -- 172.21.15.81:0/1721244903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d00ffe10 msgr2=0x7f78d0101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78d48c6700 1 --2- 172.21.15.81:0/1721244903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d00ffe10 0x7f78d0101ac0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f78c400c9b0 tx=0x7f78c400cd70 comp rx=0 tx=0).stop 2024-05-09T00:12:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78d48c6700 1 -- 172.21.15.81:0/1721244903 shutdown_connections 2024-05-09T00:12:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78d48c6700 1 --2- 172.21.15.81:0/1721244903 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f78b80a1290 0x7f78b80a3750 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78d48c6700 1 --2- 172.21.15.81:0/1721244903 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f78d0105ed0 0x7f78d0102540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78d48c6700 1 --2- 172.21.15.81:0/1721244903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78d00ffe10 0x7f78d0101ac0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78d48c6700 1 --2- 172.21.15.81:0/1721244903 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f78d01007d0 0x7f78d0102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.450+0000 7f78d48c6700 1 -- 172.21.15.81:0/1721244903 >> 172.21.15.81:0/1721244903 conn(0x7f78d0076f10 msgr2=0x7f78d00696b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.451+0000 7f78d48c6700 1 -- 172.21.15.81:0/1721244903 shutdown_connections 2024-05-09T00:12:51.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.451+0000 7f78d48c6700 1 -- 172.21.15.81:0/1721244903 wait complete. 2024-05-09T00:12:51.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:12:51.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.587+0000 7ff94cee6700 1 -- 172.21.15.81:0/1863902707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff948069530 msgr2=0x7ff9480699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.587+0000 7ff94cee6700 1 --2- 172.21.15.81:0/1863902707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff948069530 0x7ff9480699b0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7ff938009990 tx=0x7ff938009ca0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.587+0000 7ff94cee6700 1 -- 172.21.15.81:0/1863902707 shutdown_connections 2024-05-09T00:12:51.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.587+0000 7ff94cee6700 1 --2- 172.21.15.81:0/1863902707 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff948105ee0 0x7ff9481062c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.587+0000 7ff94cee6700 1 --2- 172.21.15.81:0/1863902707 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff948069ef0 0x7ff94810dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.587+0000 7ff94cee6700 1 --2- 172.21.15.81:0/1863902707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff948069530 0x7ff9480699b0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.587+0000 7ff94cee6700 1 -- 172.21.15.81:0/1863902707 >> 172.21.15.81:0/1863902707 conn(0x7ff948076f10 msgr2=0x7ff948077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.587+0000 7ff94cee6700 1 -- 172.21.15.81:0/1863902707 shutdown_connections 2024-05-09T00:12:51.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.587+0000 7ff94cee6700 1 -- 172.21.15.81:0/1863902707 wait complete. 2024-05-09T00:12:51.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.588+0000 7ff94cee6700 1 Processor -- start 2024-05-09T00:12:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.588+0000 7ff94cee6700 1 -- start start 2024-05-09T00:12:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.588+0000 7ff94cee6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff948069530 0x7ff948197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.588+0000 7ff94cee6700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff948069ef0 0x7ff948197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.588+0000 7ff94cee6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff948105ee0 0x7ff94819bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.588+0000 7ff94cee6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94819c270 con 0x7ff948069530 2024-05-09T00:12:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.588+0000 7ff94cee6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94819c3e0 con 0x7ff948105ee0 2024-05-09T00:12:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.588+0000 7ff94cee6700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94819c5a0 con 0x7ff948069ef0 2024-05-09T00:12:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.588+0000 7ff94659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff948069530 0x7ff948197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.588+0000 7ff94659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff948069530 0x7ff948197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55448/0 (socket says 172.21.15.81:55448) 2024-05-09T00:12:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.588+0000 7ff94659c700 1 -- 172.21.15.81:0/373001505 learned_addr learned my addr 172.21.15.81:0/373001505 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.588+0000 7ff945d9b700 1 --2- 172.21.15.81:0/373001505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff948069ef0 0x7ff948197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.589+0000 7ff946d9d700 1 --2- 172.21.15.81:0/373001505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff948105ee0 0x7ff94819bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.589+0000 7ff94659c700 1 -- 172.21.15.81:0/373001505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff948069ef0 msgr2=0x7ff948197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.589+0000 7ff94659c700 1 --2- 172.21.15.81:0/373001505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff948069ef0 0x7ff948197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.589+0000 7ff94659c700 1 -- 172.21.15.81:0/373001505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff948105ee0 msgr2=0x7ff94819bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.589+0000 7ff94659c700 1 --2- 172.21.15.81:0/373001505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff948105ee0 0x7ff94819bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.589+0000 7ff94659c700 1 -- 172.21.15.81:0/373001505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9380095f0 con 0x7ff948069530 2024-05-09T00:12:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.589+0000 7ff94659c700 1 --2- 172.21.15.81:0/373001505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff948069530 0x7ff948197350 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00d950 tx=0x7ff93c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.589+0000 7ff9377fe700 1 -- 172.21.15.81:0/373001505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c009940 con 0x7ff948069530 2024-05-09T00:12:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.589+0000 7ff9377fe700 1 -- 172.21.15.81:0/373001505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff93c010460 con 0x7ff948069530 2024-05-09T00:12:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.589+0000 7ff9377fe700 1 -- 172.21.15.81:0/373001505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c00f620 con 0x7ff948069530 2024-05-09T00:12:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.589+0000 7ff94cee6700 1 -- 172.21.15.81:0/373001505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94819c880 con 0x7ff948069530 2024-05-09T00:12:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.589+0000 7ff94cee6700 1 -- 172.21.15.81:0/373001505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9481a40c0 con 0x7ff948069530 2024-05-09T00:12:51.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.591+0000 7ff9377fe700 1 -- 172.21.15.81:0/373001505 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ff93c0108d0 con 0x7ff948069530 2024-05-09T00:12:51.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.592+0000 7ff9377fe700 1 --2- 172.21.15.81:0/373001505 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff9300a1290 0x7ff9300a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.592+0000 7ff945d9b700 1 --2- 172.21.15.81:0/373001505 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff9300a1290 0x7ff9300a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.592+0000 7ff9377fe700 1 -- 172.21.15.81:0/373001505 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7ff93c0ccb90 con 0x7ff948069530 2024-05-09T00:12:51.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.592+0000 7ff945d9b700 1 --2- 172.21.15.81:0/373001505 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff9300a1290 0x7ff9300a3750 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff9380098e0 tx=0x7ff938005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.592+0000 7ff9590a0b80 1 Processor -- start 2024-05-09T00:12:51.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff9590a0b80 1 -- start start 2024-05-09T00:12:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff9590a0b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de5e00 0x555627de61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff9590a0b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de6720 0x555627de0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff9590a0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de0890 0x555627de0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff9590a0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555627d37150 con 0x555627de0890 2024-05-09T00:12:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff9590a0b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555627d34b10 con 0x555627de5e00 2024-05-09T00:12:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff9590a0b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555627d30400 con 0x555627de6720 2024-05-09T00:12:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff946d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de0890 0x555627de0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff946d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de0890 0x555627de0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55458/0 (socket says 172.21.15.81:55458) 2024-05-09T00:12:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff946d9d700 1 -- 172.21.15.81:0/323236993 learned_addr learned my addr 172.21.15.81:0/323236993 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff945d9b700 1 --2- 172.21.15.81:0/323236993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de6720 0x555627de0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff94659c700 1 --2- 172.21.15.81:0/323236993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de5e00 0x555627de61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff946d9d700 1 -- 172.21.15.81:0/323236993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de6720 msgr2=0x555627de0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff946d9d700 1 --2- 172.21.15.81:0/323236993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de6720 0x555627de0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff946d9d700 1 -- 172.21.15.81:0/323236993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de5e00 msgr2=0x555627de61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff946d9d700 1 --2- 172.21.15.81:0/323236993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de5e00 0x555627de61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.593+0000 7ff946d9d700 1 -- 172.21.15.81:0/323236993 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555627bb13b0 con 0x555627de0890 2024-05-09T00:12:51.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.594+0000 7ff946d9d700 1 --2- 172.21.15.81:0/323236993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de0890 0x555627de0cd0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e190 tx=0x7ff94000e4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbee121546155abd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.594+0000 7ff934ff9700 1 -- 172.21.15.81:0/323236993 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940018070 con 0x555627de0890 2024-05-09T00:12:51.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.594+0000 7ff934ff9700 1 -- 172.21.15.81:0/323236993 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff940007c30 con 0x555627de0890 2024-05-09T00:12:51.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.594+0000 7ff934ff9700 1 -- 172.21.15.81:0/323236993 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940014be0 con 0x555627de0890 2024-05-09T00:12:51.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.594+0000 7ff9590a0b80 1 -- 172.21.15.81:0/323236993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de0890 msgr2=0x555627de0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.594+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/323236993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de0890 0x555627de0cd0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7ff94000e190 tx=0x7ff94000e4a0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.594+0000 7ff9590a0b80 1 -- 172.21.15.81:0/323236993 shutdown_connections 2024-05-09T00:12:51.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.594+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/323236993 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de5e00 0x555627de61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.594+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/323236993 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de0890 0x555627de0cd0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.594+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/323236993 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de6720 0x555627de0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.594+0000 7ff9590a0b80 1 -- 172.21.15.81:0/323236993 >> 172.21.15.81:0/323236993 conn(0x555627d3e210 msgr2=0x555627ddadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff9590a0b80 1 -- 172.21.15.81:0/323236993 shutdown_connections 2024-05-09T00:12:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff9590a0b80 1 -- 172.21.15.81:0/323236993 wait complete. 2024-05-09T00:12:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff9590a0b80 1 -- start start 2024-05-09T00:12:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff9590a0b80 1 Processor -- start 2024-05-09T00:12:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff9590a0b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de0890 0x555627de9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff9590a0b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de5e00 0x555627de9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff9590a0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de6720 0x555627dea530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff9590a0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555627ccc560 con 0x555627de6720 2024-05-09T00:12:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff9590a0b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555627ccc200 con 0x555627de5e00 2024-05-09T00:12:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff9590a0b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555627bb36a0 con 0x555627de0890 2024-05-09T00:12:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff9590a0b80 10 client.0 _ll_register_callbacks cb 0x555627cd5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff946d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de6720 0x555627dea530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff946d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de6720 0x555627dea530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55464/0 (socket says 172.21.15.81:55464) 2024-05-09T00:12:51.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff946d9d700 1 -- 172.21.15.81:0/3618650565 learned_addr learned my addr 172.21.15.81:0/3618650565 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff94659c700 1 --2- 172.21.15.81:0/3618650565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de0890 0x555627de9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.595+0000 7ff945d9b700 1 --2- 172.21.15.81:0/3618650565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de5e00 0x555627de9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff946d9d700 1 -- 172.21.15.81:0/3618650565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de0890 msgr2=0x555627de9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff946d9d700 1 --2- 172.21.15.81:0/3618650565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de0890 0x555627de9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff946d9d700 1 -- 172.21.15.81:0/3618650565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de5e00 msgr2=0x555627de9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff946d9d700 1 --2- 172.21.15.81:0/3618650565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de5e00 0x555627de9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff946d9d700 1 -- 172.21.15.81:0/3618650565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94000f040 con 0x555627de6720 2024-05-09T00:12:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff945d9b700 1 --2- 172.21.15.81:0/3618650565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de5e00 0x555627de9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff946d9d700 1 --2- 172.21.15.81:0/3618650565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de6720 0x555627dea530 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7ff94000eff0 tx=0x7ff940004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eab47fd435a4b5c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff92dffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff92dffb700 1 -- 172.21.15.81:0/3618650565 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940018040 con 0x555627de6720 2024-05-09T00:12:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff92dffb700 1 -- 172.21.15.81:0/3618650565 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7ff940014690 con 0x555627de6720 2024-05-09T00:12:51.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3618650565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555627daf810 con 0x555627de6720 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff92dffb700 1 -- 172.21.15.81:0/3618650565 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff940004e20 con 0x555627de6720 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff9590a0b80 10 client.18285 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3618650565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555627b5db60 con 0x555627de6720 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff92dffb700 1 -- 172.21.15.81:0/3618650565 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555627daf810 con 0x555627de6720 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff92dffb700 1 -- 172.21.15.81:0/3618650565 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff940004280 con 0x555627de6720 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff9590a0b80 10 client.18285 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff9590a0b80 10 client.18285 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff9590a0b80 20 client.18285 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3618650565 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x555627dfa110 0x555627dfc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff9590a0b80 4 client.18285 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.596+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3618650565 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555627d28ec0 con 0x555627dfa110 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.597+0000 7ff94659c700 1 --2- 172.21.15.81:0/3618650565 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x555627dfa110 0x555627dfc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.597+0000 7ff94659c700 1 --2- 172.21.15.81:0/3618650565 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x555627dfa110 0x555627dfc500 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8d0b976133d2c142 server_cookie=6ff20d0638a390ce in_seq=0 out_seq=0 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.597+0000 7ff92dffb700 10 client.18285 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:12:51.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff92dffb700 1 -- 172.21.15.81:0/3618650565 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555627d28ec0 con 0x555627dfa110 2024-05-09T00:12:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff92dffb700 10 client.18285 handle_command_reply: tid=0 2024-05-09T00:12:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff9590a0b80 1 client.18285 shutdown 2024-05-09T00:12:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3618650565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de6720 msgr2=0x555627dea530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3618650565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de6720 0x555627dea530 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7ff94000eff0 tx=0x7ff940004ad0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3618650565 shutdown_connections 2024-05-09T00:12:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3618650565 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x555627dfa110 0x555627dfc500 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3618650565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de6720 0x555627dea530 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3618650565 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de0890 0x555627de9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff92dffb700 0 client.18285 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:12:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3618650565 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de5e00 0x555627de9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3618650565 >> 172.21.15.81:0/3618650565 conn(0x555627d3e210 msgr2=0x555627dda5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3618650565 shutdown_connections 2024-05-09T00:12:51.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3618650565 wait complete. 2024-05-09T00:12:51.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.598+0000 7ff9590a0b80 20 client.18285 trim_cache size 0 max 16384 2024-05-09T00:12:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.611+0000 7ff9590a0b80 1 Processor -- start 2024-05-09T00:12:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.611+0000 7ff9590a0b80 1 -- start start 2024-05-09T00:12:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff9590a0b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de0890 0x555627de0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff9590a0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de5e00 0x555627ddad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff9590a0b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de6720 0x555627df1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff9590a0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555627e01710 con 0x555627de5e00 2024-05-09T00:12:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff9590a0b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555627decbf0 con 0x555627de0890 2024-05-09T00:12:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff9590a0b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555627de6520 con 0x555627de6720 2024-05-09T00:12:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff945d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de5e00 0x555627ddad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff945d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de5e00 0x555627ddad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55478/0 (socket says 172.21.15.81:55478) 2024-05-09T00:12:51.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff945d9b700 1 -- 172.21.15.81:0/3841476252 learned_addr learned my addr 172.21.15.81:0/3841476252 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff945d9b700 1 -- 172.21.15.81:0/3841476252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de6720 msgr2=0x555627df1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff945d9b700 1 --2- 172.21.15.81:0/3841476252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de6720 0x555627df1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff945d9b700 1 -- 172.21.15.81:0/3841476252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de0890 msgr2=0x555627de0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff945d9b700 1 --2- 172.21.15.81:0/3841476252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de0890 0x555627de0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff945d9b700 1 -- 172.21.15.81:0/3841476252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555627cf6560 con 0x555627de5e00 2024-05-09T00:12:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff945d9b700 1 --2- 172.21.15.81:0/3841476252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de5e00 0x555627ddad20 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7ff938005b40 tx=0x7ff93801a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b08ff2c8b60fe4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff9357fa700 1 -- 172.21.15.81:0/3841476252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938005480 con 0x555627de5e00 2024-05-09T00:12:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff9357fa700 1 -- 172.21.15.81:0/3841476252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff93801e040 con 0x555627de5e00 2024-05-09T00:12:51.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.612+0000 7ff9357fa700 1 -- 172.21.15.81:0/3841476252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9380236c0 con 0x555627de5e00 2024-05-09T00:12:51.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.613+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3841476252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de5e00 msgr2=0x555627ddad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.613+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3841476252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de5e00 0x555627ddad20 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7ff938005b40 tx=0x7ff93801a070 comp rx=0 tx=0).stop 2024-05-09T00:12:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.613+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3841476252 shutdown_connections 2024-05-09T00:12:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.613+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3841476252 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de0890 0x555627de0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.613+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3841476252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de6720 0x555627df1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.613+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3841476252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de5e00 0x555627ddad20 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.613+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3841476252 >> 172.21.15.81:0/3841476252 conn(0x555627d3e210 msgr2=0x555627de83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.613+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3841476252 shutdown_connections 2024-05-09T00:12:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.613+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3841476252 wait complete. 2024-05-09T00:12:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.613+0000 7ff9590a0b80 1 -- start start 2024-05-09T00:12:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.613+0000 7ff9590a0b80 1 Processor -- start 2024-05-09T00:12:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff9590a0b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de0890 0x555627df1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff9590a0b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de5e00 0x555627df16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff9590a0b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de6720 0x555627de1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff9590a0b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x555627de1fc0 con 0x555627de0890 2024-05-09T00:12:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff9590a0b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x555627de2130 con 0x555627de6720 2024-05-09T00:12:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff9590a0b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x555627de22f0 con 0x555627de5e00 2024-05-09T00:12:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff9590a0b80 10 client.0 _ll_register_callbacks cb 0x555627cd5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff94659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de0890 0x555627df1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff94659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de0890 0x555627df1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55494/0 (socket says 172.21.15.81:55494) 2024-05-09T00:12:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff94659c700 1 -- 172.21.15.81:0/3834053123 learned_addr learned my addr 172.21.15.81:0/3834053123 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff946d9d700 1 --2- 172.21.15.81:0/3834053123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de6720 0x555627de1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff94659c700 1 -- 172.21.15.81:0/3834053123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de5e00 msgr2=0x555627df16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff94659c700 1 --2- 172.21.15.81:0/3834053123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de5e00 0x555627df16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff94659c700 1 -- 172.21.15.81:0/3834053123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de6720 msgr2=0x555627de1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff94659c700 1 --2- 172.21.15.81:0/3834053123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de6720 0x555627de1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff94659c700 1 -- 172.21.15.81:0/3834053123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94810e750 con 0x555627de0890 2024-05-09T00:12:51.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff94659c700 1 --2- 172.21.15.81:0/3834053123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de0890 0x555627df1170 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7ff93c099970 tx=0x7ff93c00d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b936f23ba7d98485 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff92dffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff92dffb700 1 -- 172.21.15.81:0/3834053123 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c014070 con 0x555627de0890 2024-05-09T00:12:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff92dffb700 1 -- 172.21.15.81:0/3834053123 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7ff93c0980d0 con 0x555627de0890 2024-05-09T00:12:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3834053123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555627c89270 con 0x555627de0890 2024-05-09T00:12:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff92dffb700 1 -- 172.21.15.81:0/3834053123 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff93c09a0d0 con 0x555627de0890 2024-05-09T00:12:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff9590a0b80 10 client.18291 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.614+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3834053123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555627bb5cd0 con 0x555627de0890 2024-05-09T00:12:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.615+0000 7ff92dffb700 1 -- 172.21.15.81:0/3834053123 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff93c063080 con 0x555627de0890 2024-05-09T00:12:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.615+0000 7ff92dffb700 1 -- 172.21.15.81:0/3834053123 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff93c05fb20 con 0x555627de0890 2024-05-09T00:12:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.615+0000 7ff9590a0b80 10 client.18291 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.615+0000 7ff9590a0b80 10 client.18291 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:12:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.615+0000 7ff9590a0b80 20 client.18291 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:51.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.615+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3834053123 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x555627e51560 0x555627e53980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.615+0000 7ff9590a0b80 4 client.18291 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:12:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.615+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3834053123 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555627b7ecf0 con 0x555627e51560 2024-05-09T00:12:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.615+0000 7ff945d9b700 1 --2- 172.21.15.81:0/3834053123 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x555627e51560 0x555627e53980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.615+0000 7ff92dffb700 10 client.18291 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:12:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.615+0000 7ff945d9b700 1 --2- 172.21.15.81:0/3834053123 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x555627e51560 0x555627e53980 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=52cd811a1878fb0c server_cookie=5c8043e1dfd1aacf in_seq=0 out_seq=0 2024-05-09T00:12:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff92dffb700 1 -- 172.21.15.81:0/3834053123 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555627b7ecf0 con 0x555627e51560 2024-05-09T00:12:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff92dffb700 10 client.18291 handle_command_reply: tid=0 2024-05-09T00:12:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff9590a0b80 1 client.18291 shutdown 2024-05-09T00:12:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3834053123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de0890 msgr2=0x555627df1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3834053123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de0890 0x555627df1170 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7ff93c099970 tx=0x7ff93c00d8d0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3834053123 shutdown_connections 2024-05-09T00:12:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3834053123 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x555627e51560 0x555627e53980 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3834053123 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x555627de6720 0x555627de1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3834053123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555627de0890 0x555627df1170 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff92dffb700 0 client.18291 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:12:51.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff9590a0b80 1 --2- 172.21.15.81:0/3834053123 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x555627de5e00 0x555627df16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3834053123 >> 172.21.15.81:0/3834053123 conn(0x555627d3e210 msgr2=0x555627deb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3834053123 shutdown_connections 2024-05-09T00:12:51.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff9590a0b80 1 -- 172.21.15.81:0/3834053123 wait complete. 2024-05-09T00:12:51.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff9590a0b80 20 client.18291 trim_cache size 0 max 16384 2024-05-09T00:12:51.620 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:12:51.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff94cee6700 1 -- 172.21.15.81:0/373001505 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff9300a1290 msgr2=0x7ff9300a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff94cee6700 1 --2- 172.21.15.81:0/373001505 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff9300a1290 0x7ff9300a3750 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff9380098e0 tx=0x7ff938005960 comp rx=0 tx=0).stop 2024-05-09T00:12:51.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff94cee6700 1 -- 172.21.15.81:0/373001505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff948069530 msgr2=0x7ff948197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff94cee6700 1 --2- 172.21.15.81:0/373001505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff948069530 0x7ff948197350 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00d950 tx=0x7ff93c00dc60 comp rx=0 tx=0).stop 2024-05-09T00:12:51.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff94cee6700 1 -- 172.21.15.81:0/373001505 shutdown_connections 2024-05-09T00:12:51.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff94cee6700 1 --2- 172.21.15.81:0/373001505 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff9300a1290 0x7ff9300a3750 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff94cee6700 1 --2- 172.21.15.81:0/373001505 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff948105ee0 0x7ff94819bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff94cee6700 1 --2- 172.21.15.81:0/373001505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff948069530 0x7ff948197350 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff94cee6700 1 --2- 172.21.15.81:0/373001505 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff948069ef0 0x7ff948197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.616+0000 7ff94cee6700 1 -- 172.21.15.81:0/373001505 >> 172.21.15.81:0/373001505 conn(0x7ff948076f10 msgr2=0x7ff9480feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.617+0000 7ff94cee6700 1 -- 172.21.15.81:0/373001505 shutdown_connections 2024-05-09T00:12:51.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.617+0000 7ff94cee6700 1 -- 172.21.15.81:0/373001505 wait complete. 2024-05-09T00:12:51.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:12:51.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.751+0000 7fa2340f1700 1 -- 172.21.15.81:0/2931182313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c100a10 msgr2=0x7fa22c104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.751+0000 7fa2340f1700 1 --2- 172.21.15.81:0/2931182313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c100a10 0x7fa22c104a30 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fa228009990 tx=0x7fa228009ca0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.751+0000 7fa2340f1700 1 -- 172.21.15.81:0/2931182313 shutdown_connections 2024-05-09T00:12:51.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.751+0000 7fa2340f1700 1 --2- 172.21.15.81:0/2931182313 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22c105160 0x7fa22c10cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.751+0000 7fa2340f1700 1 --2- 172.21.15.81:0/2931182313 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22c100060 0x7fa22c100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.751+0000 7fa2340f1700 1 --2- 172.21.15.81:0/2931182313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c100a10 0x7fa22c104a30 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.751+0000 7fa2340f1700 1 -- 172.21.15.81:0/2931182313 >> 172.21.15.81:0/2931182313 conn(0x7fa22c076f40 msgr2=0x7fa22c077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.752+0000 7fa2340f1700 1 -- 172.21.15.81:0/2931182313 shutdown_connections 2024-05-09T00:12:51.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.752+0000 7fa2340f1700 1 -- 172.21.15.81:0/2931182313 wait complete. 2024-05-09T00:12:51.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.752+0000 7fa2340f1700 1 Processor -- start 2024-05-09T00:12:51.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.752+0000 7fa2340f1700 1 -- start start 2024-05-09T00:12:51.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa2340f1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22c100060 0x7fa22c196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa2340f1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c105160 0x7fa22c196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa2340f1700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22c19ab10 0x7fa22c19af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa2340f1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c19b590 con 0x7fa22c105160 2024-05-09T00:12:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa2340f1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c19b700 con 0x7fa22c100060 2024-05-09T00:12:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa2340f1700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c19b8c0 con 0x7fa22c19ab10 2024-05-09T00:12:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa23168c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c105160 0x7fa22c196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa23168c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c105160 0x7fa22c196770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55508/0 (socket says 172.21.15.81:55508) 2024-05-09T00:12:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa23168c700 1 -- 172.21.15.81:0/1583791702 learned_addr learned my addr 172.21.15.81:0/1583791702 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa231e8d700 1 --2- 172.21.15.81:0/1583791702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22c100060 0x7fa22c196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa23168c700 1 -- 172.21.15.81:0/1583791702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22c19ab10 msgr2=0x7fa22c19af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa23168c700 1 --2- 172.21.15.81:0/1583791702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22c19ab10 0x7fa22c19af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa23168c700 1 -- 172.21.15.81:0/1583791702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22c100060 msgr2=0x7fa22c196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa23168c700 1 --2- 172.21.15.81:0/1583791702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22c100060 0x7fa22c196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa23168c700 1 -- 172.21.15.81:0/1583791702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2280095f0 con 0x7fa22c105160 2024-05-09T00:12:51.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa23168c700 1 --2- 172.21.15.81:0/1583791702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c105160 0x7fa22c196770 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fa228005770 tx=0x7fa2280057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa222ffd700 1 -- 172.21.15.81:0/1583791702 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22801d070 con 0x7fa22c105160 2024-05-09T00:12:51.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa222ffd700 1 -- 172.21.15.81:0/1583791702 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa228021410 con 0x7fa22c105160 2024-05-09T00:12:51.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa2340f1700 1 -- 172.21.15.81:0/1583791702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22c1a2dc0 con 0x7fa22c105160 2024-05-09T00:12:51.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa222ffd700 1 -- 172.21.15.81:0/1583791702 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228017650 con 0x7fa22c105160 2024-05-09T00:12:51.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.753+0000 7fa2340f1700 1 -- 172.21.15.81:0/1583791702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c1a31e0 con 0x7fa22c105160 2024-05-09T00:12:51.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.756+0000 7fa222ffd700 1 -- 172.21.15.81:0/1583791702 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa22800fac0 con 0x7fa22c105160 2024-05-09T00:12:51.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.756+0000 7fa222ffd700 1 --2- 172.21.15.81:0/1583791702 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa2180a1290 0x7fa2180a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.757+0000 7fa231e8d700 1 --2- 172.21.15.81:0/1583791702 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa2180a1290 0x7fa2180a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.757+0000 7fa222ffd700 1 -- 172.21.15.81:0/1583791702 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fa2280cdf60 con 0x7fa22c105160 2024-05-09T00:12:51.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.757+0000 7fa231e8d700 1 --2- 172.21.15.81:0/1583791702 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa2180a1290 0x7fa2180a3750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00ac50 tx=0x7fa21c00a380 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.757+0000 7fa2402abb80 1 Processor -- start 2024-05-09T00:12:51.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa2402abb80 1 -- start start 2024-05-09T00:12:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa2402abb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8bfe00 0x55627d8c01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa2402abb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8c0720 0x55627d8ba350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa2402abb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8ba890 0x55627d8bacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa2402abb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627d811150 con 0x55627d8ba890 2024-05-09T00:12:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa2402abb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627d80eb10 con 0x55627d8c0720 2024-05-09T00:12:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa2402abb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627d80a400 con 0x55627d8bfe00 2024-05-09T00:12:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa23268e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8ba890 0x55627d8bacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa23268e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8ba890 0x55627d8bacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55518/0 (socket says 172.21.15.81:55518) 2024-05-09T00:12:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa23268e700 1 -- 172.21.15.81:0/2876736359 learned_addr learned my addr 172.21.15.81:0/2876736359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa23168c700 1 --2- 172.21.15.81:0/2876736359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8c0720 0x55627d8ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa231e8d700 1 --2- 172.21.15.81:0/2876736359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8bfe00 0x55627d8c01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa23268e700 1 -- 172.21.15.81:0/2876736359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8bfe00 msgr2=0x55627d8c01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa23268e700 1 --2- 172.21.15.81:0/2876736359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8bfe00 0x55627d8c01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa23268e700 1 -- 172.21.15.81:0/2876736359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8c0720 msgr2=0x55627d8ba350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa23268e700 1 --2- 172.21.15.81:0/2876736359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8c0720 0x55627d8ba350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa23268e700 1 -- 172.21.15.81:0/2876736359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55627d68b3b0 con 0x55627d8ba890 2024-05-09T00:12:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.758+0000 7fa23268e700 1 --2- 172.21.15.81:0/2876736359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8ba890 0x55627d8bacd0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fa22400e380 tx=0x7fa22400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b10eb5f3b5bc90 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.759+0000 7fa217fff700 1 -- 172.21.15.81:0/2876736359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224018070 con 0x55627d8ba890 2024-05-09T00:12:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.759+0000 7fa217fff700 1 -- 172.21.15.81:0/2876736359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa22400ee30 con 0x55627d8ba890 2024-05-09T00:12:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.759+0000 7fa217fff700 1 -- 172.21.15.81:0/2876736359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224010040 con 0x55627d8ba890 2024-05-09T00:12:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.759+0000 7fa2402abb80 1 -- 172.21.15.81:0/2876736359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8ba890 msgr2=0x55627d8bacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.759+0000 7fa2402abb80 1 --2- 172.21.15.81:0/2876736359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8ba890 0x55627d8bacd0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fa22400e380 tx=0x7fa22400b040 comp rx=0 tx=0).stop 2024-05-09T00:12:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.759+0000 7fa2402abb80 1 -- 172.21.15.81:0/2876736359 shutdown_connections 2024-05-09T00:12:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.759+0000 7fa2402abb80 1 --2- 172.21.15.81:0/2876736359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8ba890 0x55627d8bacd0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.759+0000 7fa2402abb80 1 --2- 172.21.15.81:0/2876736359 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8bfe00 0x55627d8c01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.759+0000 7fa2402abb80 1 --2- 172.21.15.81:0/2876736359 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8c0720 0x55627d8ba350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.759+0000 7fa2402abb80 1 -- 172.21.15.81:0/2876736359 >> 172.21.15.81:0/2876736359 conn(0x55627d818210 msgr2=0x55627d8b4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.759+0000 7fa2402abb80 1 -- 172.21.15.81:0/2876736359 shutdown_connections 2024-05-09T00:12:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.759+0000 7fa2402abb80 1 -- 172.21.15.81:0/2876736359 wait complete. 2024-05-09T00:12:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.760+0000 7fa2402abb80 1 -- start start 2024-05-09T00:12:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.760+0000 7fa2402abb80 1 Processor -- start 2024-05-09T00:12:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.760+0000 7fa2402abb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8ba890 0x55627d8c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.760+0000 7fa2402abb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8bfe00 0x55627d8c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.760+0000 7fa2402abb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8c0720 0x55627d8c4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.760+0000 7fa2402abb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627d7a6560 con 0x55627d8ba890 2024-05-09T00:12:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.760+0000 7fa2402abb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627d7a6200 con 0x55627d8bfe00 2024-05-09T00:12:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.760+0000 7fa2402abb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627d68d6a0 con 0x55627d8c0720 2024-05-09T00:12:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.760+0000 7fa2402abb80 10 client.0 _ll_register_callbacks cb 0x55627d7afb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.760+0000 7fa231e8d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8ba890 0x55627d8c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.760+0000 7fa231e8d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8ba890 0x55627d8c3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55522/0 (socket says 172.21.15.81:55522) 2024-05-09T00:12:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.760+0000 7fa231e8d700 1 -- 172.21.15.81:0/2460040895 learned_addr learned my addr 172.21.15.81:0/2460040895 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.760+0000 7fa23268e700 1 --2- 172.21.15.81:0/2460040895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8c0720 0x55627d8c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa23168c700 1 --2- 172.21.15.81:0/2460040895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8bfe00 0x55627d8c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa231e8d700 1 -- 172.21.15.81:0/2460040895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8c0720 msgr2=0x55627d8c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa231e8d700 1 --2- 172.21.15.81:0/2460040895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8c0720 0x55627d8c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa231e8d700 1 -- 172.21.15.81:0/2460040895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8bfe00 msgr2=0x55627d8c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa231e8d700 1 --2- 172.21.15.81:0/2460040895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8bfe00 0x55627d8c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa231e8d700 1 -- 172.21.15.81:0/2460040895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22400e0c0 con 0x55627d8ba890 2024-05-09T00:12:51.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa231e8d700 1 --2- 172.21.15.81:0/2460040895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8ba890 0x55627d8c3ba0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fa21c003930 tx=0x7fa21c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b17c017bc2a8eda server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa2157fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:51.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa2157fa700 1 -- 172.21.15.81:0/2460040895 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c010840 con 0x55627d8ba890 2024-05-09T00:12:51.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa2157fa700 1 -- 172.21.15.81:0/2460040895 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fa21c0109a0 con 0x55627d8ba890 2024-05-09T00:12:51.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa2402abb80 1 -- 172.21.15.81:0/2460040895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55627d763270 con 0x55627d8ba890 2024-05-09T00:12:51.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa2157fa700 1 -- 172.21.15.81:0/2460040895 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa21c010ba0 con 0x55627d8ba890 2024-05-09T00:12:51.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa2402abb80 10 client.18303 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:51.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa2402abb80 1 -- 172.21.15.81:0/2460040895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55627d637b60 con 0x55627d8ba890 2024-05-09T00:12:51.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa2157fa700 1 -- 172.21.15.81:0/2460040895 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55627d763270 con 0x55627d8ba890 2024-05-09T00:12:51.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa2157fa700 1 -- 172.21.15.81:0/2460040895 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa21c01e410 con 0x55627d8ba890 2024-05-09T00:12:51.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa2402abb80 10 client.18303 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa2402abb80 10 client.18303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.761+0000 7fa2402abb80 20 client.18303 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.762+0000 7fa2402abb80 1 --2- 172.21.15.81:0/2460040895 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55627d8d6380 0x55627d8d87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.762+0000 7fa2402abb80 4 client.18303 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.762+0000 7fa2402abb80 1 -- 172.21.15.81:0/2460040895 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55627d889810 con 0x55627d8d6380 2024-05-09T00:12:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.762+0000 7fa23168c700 1 --2- 172.21.15.81:0/2460040895 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55627d8d6380 0x55627d8d87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.762+0000 7fa2157fa700 10 client.18303 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.762+0000 7fa23168c700 1 --2- 172.21.15.81:0/2460040895 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55627d8d6380 0x55627d8d87a0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f54f1af363ac32a6 server_cookie=b28c56e7ed0c9b66 in_seq=0 out_seq=0 2024-05-09T00:12:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2157fa700 1 -- 172.21.15.81:0/2460040895 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55627d889810 con 0x55627d8d6380 2024-05-09T00:12:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2157fa700 10 client.18303 handle_command_reply: tid=0 2024-05-09T00:12:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2402abb80 1 client.18303 shutdown 2024-05-09T00:12:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2402abb80 1 -- 172.21.15.81:0/2460040895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8ba890 msgr2=0x55627d8c3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2402abb80 1 --2- 172.21.15.81:0/2460040895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8ba890 0x55627d8c3ba0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fa21c003930 tx=0x7fa21c0047c0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2402abb80 1 -- 172.21.15.81:0/2460040895 shutdown_connections 2024-05-09T00:12:51.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2402abb80 1 --2- 172.21.15.81:0/2460040895 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55627d8d6380 0x55627d8d87a0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2402abb80 1 --2- 172.21.15.81:0/2460040895 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8c0720 0x55627d8c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2157fa700 0 client.18303 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:51.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2402abb80 1 --2- 172.21.15.81:0/2460040895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8ba890 0x55627d8c3ba0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2402abb80 1 --2- 172.21.15.81:0/2460040895 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8bfe00 0x55627d8c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2402abb80 1 -- 172.21.15.81:0/2460040895 >> 172.21.15.81:0/2460040895 conn(0x55627d818210 msgr2=0x55627d8b45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2402abb80 1 -- 172.21.15.81:0/2460040895 shutdown_connections 2024-05-09T00:12:51.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2402abb80 1 -- 172.21.15.81:0/2460040895 wait complete. 2024-05-09T00:12:51.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.763+0000 7fa2402abb80 20 client.18303 trim_cache size 0 max 16384 2024-05-09T00:12:51.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.776+0000 7fa2402abb80 1 Processor -- start 2024-05-09T00:12:51.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa2402abb80 1 -- start start 2024-05-09T00:12:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa2402abb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8ba890 0x55627d8ba350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa2402abb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8bfe00 0x55627d8d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa2402abb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8c0720 0x55627d8b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa2402abb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627d8b6820 con 0x55627d8bfe00 2024-05-09T00:12:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa2402abb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627d8c6bc0 con 0x55627d8ba890 2024-05-09T00:12:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa2402abb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627d8b1df0 con 0x55627d8c0720 2024-05-09T00:12:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa23168c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8bfe00 0x55627d8d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa23168c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8bfe00 0x55627d8d1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55528/0 (socket says 172.21.15.81:55528) 2024-05-09T00:12:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa23168c700 1 -- 172.21.15.81:0/1696932245 learned_addr learned my addr 172.21.15.81:0/1696932245 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa23268e700 1 --2- 172.21.15.81:0/1696932245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8c0720 0x55627d8b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa231e8d700 1 --2- 172.21.15.81:0/1696932245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8ba890 0x55627d8ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa23168c700 1 -- 172.21.15.81:0/1696932245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8c0720 msgr2=0x55627d8b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa23168c700 1 --2- 172.21.15.81:0/1696932245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8c0720 0x55627d8b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa23168c700 1 -- 172.21.15.81:0/1696932245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8ba890 msgr2=0x55627d8ba350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa23168c700 1 --2- 172.21.15.81:0/1696932245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8ba890 0x55627d8ba350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa23168c700 1 -- 172.21.15.81:0/1696932245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55627d7d0560 con 0x55627d8bfe00 2024-05-09T00:12:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa23168c700 1 --2- 172.21.15.81:0/1696932245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8bfe00 0x55627d8d1cd0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fa22800f740 tx=0x7fa2280a1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6518d672ef242bf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa220ff9700 1 -- 172.21.15.81:0/1696932245 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22809ef00 con 0x55627d8bfe00 2024-05-09T00:12:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa220ff9700 1 -- 172.21.15.81:0/1696932245 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2280a34c0 con 0x55627d8bfe00 2024-05-09T00:12:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.777+0000 7fa220ff9700 1 -- 172.21.15.81:0/1696932245 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2280977e0 con 0x55627d8bfe00 2024-05-09T00:12:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.778+0000 7fa2402abb80 1 -- 172.21.15.81:0/1696932245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8bfe00 msgr2=0x55627d8d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.778+0000 7fa2402abb80 1 --2- 172.21.15.81:0/1696932245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8bfe00 0x55627d8d1cd0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fa22800f740 tx=0x7fa2280a1040 comp rx=0 tx=0).stop 2024-05-09T00:12:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.778+0000 7fa2402abb80 1 -- 172.21.15.81:0/1696932245 shutdown_connections 2024-05-09T00:12:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.778+0000 7fa2402abb80 1 --2- 172.21.15.81:0/1696932245 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8ba890 0x55627d8ba350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.778+0000 7fa2402abb80 1 --2- 172.21.15.81:0/1696932245 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8c0720 0x55627d8b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.778+0000 7fa2402abb80 1 --2- 172.21.15.81:0/1696932245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8bfe00 0x55627d8d1cd0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.778+0000 7fa2402abb80 1 -- 172.21.15.81:0/1696932245 >> 172.21.15.81:0/1696932245 conn(0x55627d818210 msgr2=0x55627d8c4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.778+0000 7fa2402abb80 1 -- 172.21.15.81:0/1696932245 shutdown_connections 2024-05-09T00:12:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.778+0000 7fa2402abb80 1 -- 172.21.15.81:0/1696932245 wait complete. 2024-05-09T00:12:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.778+0000 7fa2402abb80 1 -- start start 2024-05-09T00:12:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.778+0000 7fa2402abb80 1 Processor -- start 2024-05-09T00:12:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa2402abb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8ba890 0x55627d8cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa2402abb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8bfe00 0x55627d8caa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa2402abb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8c0720 0x55627d8caf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa2402abb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627d8cb680 con 0x55627d8bfe00 2024-05-09T00:12:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa2402abb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627d8cb7f0 con 0x55627d8c0720 2024-05-09T00:12:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa2402abb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55627d92b880 con 0x55627d8ba890 2024-05-09T00:12:51.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa2402abb80 10 client.0 _ll_register_callbacks cb 0x55627d7afb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa23168c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8bfe00 0x55627d8caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa23168c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8bfe00 0x55627d8caa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55544/0 (socket says 172.21.15.81:55544) 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa23168c700 1 -- 172.21.15.81:0/365744049 learned_addr learned my addr 172.21.15.81:0/365744049 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa231e8d700 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8ba890 0x55627d8cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa23268e700 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8c0720 0x55627d8caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa23168c700 1 -- 172.21.15.81:0/365744049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8ba890 msgr2=0x55627d8cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa23168c700 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8ba890 0x55627d8cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa23168c700 1 -- 172.21.15.81:0/365744049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8c0720 msgr2=0x55627d8caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa23168c700 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8c0720 0x55627d8caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa23168c700 1 -- 172.21.15.81:0/365744049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c1a31e0 con 0x55627d8bfe00 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa231e8d700 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8ba890 0x55627d8cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa23268e700 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8c0720 0x55627d8caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa23168c700 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8bfe00 0x55627d8caa30 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fa22809b060 tx=0x7fa22809efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96febc880052092 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.779+0000 7fa2157fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:51.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa2157fa700 1 -- 172.21.15.81:0/365744049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228099530 con 0x55627d8bfe00 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa2157fa700 1 -- 172.21.15.81:0/365744049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fa2280977e0 con 0x55627d8bfe00 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa2402abb80 1 -- 172.21.15.81:0/365744049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa22400ee30 con 0x55627d8bfe00 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa2157fa700 1 -- 172.21.15.81:0/365744049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2280b9250 con 0x55627d8bfe00 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa2402abb80 10 client.18309 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa2402abb80 1 -- 172.21.15.81:0/365744049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55627d68fcd0 con 0x55627d8bfe00 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa2157fa700 1 -- 172.21.15.81:0/365744049 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa22400ee30 con 0x55627d8bfe00 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa2157fa700 1 -- 172.21.15.81:0/365744049 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa22809a5c0 con 0x55627d8bfe00 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa2402abb80 10 client.18309 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa2402abb80 10 client.18309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa2402abb80 20 client.18309 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa2402abb80 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55627d92cb30 0x55627d92ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa2402abb80 4 client.18309 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa2402abb80 1 -- 172.21.15.81:0/365744049 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55627d802ec0 con 0x55627d92cb30 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.780+0000 7fa231e8d700 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55627d92cb30 0x55627d92ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:51.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2157fa700 10 client.18309 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:51.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa231e8d700 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55627d92cb30 0x55627d92ef50 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eab83cfda07b1cad server_cookie=8cf9b4f907cc1720 in_seq=0 out_seq=0 2024-05-09T00:12:51.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2157fa700 1 -- 172.21.15.81:0/365744049 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55627d802ec0 con 0x55627d92cb30 2024-05-09T00:12:51.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2157fa700 10 client.18309 handle_command_reply: tid=0 2024-05-09T00:12:51.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2402abb80 1 client.18309 shutdown 2024-05-09T00:12:51.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2402abb80 1 -- 172.21.15.81:0/365744049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8bfe00 msgr2=0x55627d8caa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2402abb80 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8bfe00 0x55627d8caa30 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fa22809b060 tx=0x7fa22809efb0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2402abb80 1 -- 172.21.15.81:0/365744049 shutdown_connections 2024-05-09T00:12:51.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2402abb80 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55627d92cb30 0x55627d92ef50 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2402abb80 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55627d8c0720 0x55627d8caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2157fa700 0 client.18309 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:51.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2402abb80 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55627d8ba890 0x55627d8cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2402abb80 1 --2- 172.21.15.81:0/365744049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55627d8bfe00 0x55627d8caa30 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2402abb80 1 -- 172.21.15.81:0/365744049 >> 172.21.15.81:0/365744049 conn(0x55627d818210 msgr2=0x55627d8c4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2402abb80 1 -- 172.21.15.81:0/365744049 shutdown_connections 2024-05-09T00:12:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2402abb80 1 -- 172.21.15.81:0/365744049 wait complete. 2024-05-09T00:12:51.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.781+0000 7fa2402abb80 20 client.18309 trim_cache size 0 max 16384 2024-05-09T00:12:51.786 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:12:51.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.782+0000 7fa2340f1700 1 -- 172.21.15.81:0/1583791702 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa2180a1290 msgr2=0x7fa2180a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.782+0000 7fa2340f1700 1 --2- 172.21.15.81:0/1583791702 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa2180a1290 0x7fa2180a3750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa21c00ac50 tx=0x7fa21c00a380 comp rx=0 tx=0).stop 2024-05-09T00:12:51.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.782+0000 7fa2340f1700 1 -- 172.21.15.81:0/1583791702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c105160 msgr2=0x7fa22c196770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:51.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.782+0000 7fa2340f1700 1 --2- 172.21.15.81:0/1583791702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c105160 0x7fa22c196770 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fa228005770 tx=0x7fa2280057a0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.782+0000 7fa2340f1700 1 -- 172.21.15.81:0/1583791702 shutdown_connections 2024-05-09T00:12:51.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.782+0000 7fa2340f1700 1 --2- 172.21.15.81:0/1583791702 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa2180a1290 0x7fa2180a3750 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.782+0000 7fa2340f1700 1 --2- 172.21.15.81:0/1583791702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa22c100060 0x7fa22c196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.782+0000 7fa2340f1700 1 --2- 172.21.15.81:0/1583791702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa22c19ab10 0x7fa22c19af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.782+0000 7fa2340f1700 1 --2- 172.21.15.81:0/1583791702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa22c105160 0x7fa22c196770 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:51.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.782+0000 7fa2340f1700 1 -- 172.21.15.81:0/1583791702 >> 172.21.15.81:0/1583791702 conn(0x7fa22c076f40 msgr2=0x7fa22c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:51.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.782+0000 7fa2340f1700 1 -- 172.21.15.81:0/1583791702 shutdown_connections 2024-05-09T00:12:51.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:51.782+0000 7fa2340f1700 1 -- 172.21.15.81:0/1583791702 wait complete. 2024-05-09T00:12:52.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:51 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/4281112104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:12:52.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:51 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/4281112104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:12:52.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:51 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/4281112104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:12:52.792 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:12:52.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:12:52.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.935+0000 7f3051c63700 1 -- 172.21.15.81:0/358496932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304c100060 msgr2=0x7f304c100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:52.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.935+0000 7f3051c63700 1 --2- 172.21.15.81:0/358496932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304c100060 0x7f304c100440 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f3034009990 tx=0x7f3034009ca0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.935+0000 7f3051c63700 1 -- 172.21.15.81:0/358496932 shutdown_connections 2024-05-09T00:12:52.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.935+0000 7f3051c63700 1 --2- 172.21.15.81:0/358496932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f304c105160 0x7f304c10cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.935+0000 7f3051c63700 1 --2- 172.21.15.81:0/358496932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304c100060 0x7f304c100440 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.935+0000 7f3051c63700 1 --2- 172.21.15.81:0/358496932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f304c100a10 0x7f304c104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.935+0000 7f3051c63700 1 -- 172.21.15.81:0/358496932 >> 172.21.15.81:0/358496932 conn(0x7f304c076f40 msgr2=0x7f304c077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:52.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.935+0000 7f3051c63700 1 -- 172.21.15.81:0/358496932 shutdown_connections 2024-05-09T00:12:52.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.935+0000 7f3051c63700 1 -- 172.21.15.81:0/358496932 wait complete. 2024-05-09T00:12:52.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.936+0000 7f3051c63700 1 Processor -- start 2024-05-09T00:12:52.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.936+0000 7f3051c63700 1 -- start start 2024-05-09T00:12:52.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.936+0000 7f3051c63700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f304c100060 0x7f304c197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.936+0000 7f3051c63700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f304c105160 0x7f304c1979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.936+0000 7f3051c63700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304c19bd40 0x7f304c19c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.936+0000 7f3051c63700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c19c7c0 con 0x7f304c19bd40 2024-05-09T00:12:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.936+0000 7f3051c63700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c19c930 con 0x7f304c105160 2024-05-09T00:12:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.936+0000 7f3051c63700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c19caf0 con 0x7f304c100060 2024-05-09T00:12:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.936+0000 7f304bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304c19bd40 0x7f304c19c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.936+0000 7f304bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304c19bd40 0x7f304c19c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55550/0 (socket says 172.21.15.81:55550) 2024-05-09T00:12:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.936+0000 7f304bfff700 1 -- 172.21.15.81:0/4266881925 learned_addr learned my addr 172.21.15.81:0/4266881925 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.936+0000 7f304b7fe700 1 --2- 172.21.15.81:0/4266881925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f304c100060 0x7f304c197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.936+0000 7f304affd700 1 --2- 172.21.15.81:0/4266881925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f304c105160 0x7f304c1979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.937+0000 7f304bfff700 1 -- 172.21.15.81:0/4266881925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f304c100060 msgr2=0x7f304c197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.937+0000 7f304bfff700 1 --2- 172.21.15.81:0/4266881925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f304c100060 0x7f304c197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.937+0000 7f304bfff700 1 -- 172.21.15.81:0/4266881925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f304c105160 msgr2=0x7f304c1979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.937+0000 7f304bfff700 1 --2- 172.21.15.81:0/4266881925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f304c105160 0x7f304c1979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.937+0000 7f304bfff700 1 -- 172.21.15.81:0/4266881925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30340095f0 con 0x7f304c19bd40 2024-05-09T00:12:52.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.937+0000 7f304bfff700 1 --2- 172.21.15.81:0/4266881925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304c19bd40 0x7f304c19c1c0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f3044007ee0 tx=0x7f304400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:52.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.939+0000 7f3048ff9700 1 -- 172.21.15.81:0/4266881925 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044017070 con 0x7f304c19bd40 2024-05-09T00:12:52.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.939+0000 7f3048ff9700 1 -- 172.21.15.81:0/4266881925 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f304400f040 con 0x7f304c19bd40 2024-05-09T00:12:52.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.939+0000 7f3051c63700 1 -- 172.21.15.81:0/4266881925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c1a4050 con 0x7f304c19bd40 2024-05-09T00:12:52.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.939+0000 7f3048ff9700 1 -- 172.21.15.81:0/4266881925 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044005580 con 0x7f304c19bd40 2024-05-09T00:12:52.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.939+0000 7f3051c63700 1 -- 172.21.15.81:0/4266881925 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c1a4530 con 0x7f304c19bd40 2024-05-09T00:12:52.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.941+0000 7f3048ff9700 1 -- 172.21.15.81:0/4266881925 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f30440056e0 con 0x7f304c19bd40 2024-05-09T00:12:52.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.941+0000 7f3048ff9700 1 --2- 172.21.15.81:0/4266881925 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f30380a1310 0x7f30380a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.941+0000 7f304b7fe700 1 --2- 172.21.15.81:0/4266881925 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f30380a1310 0x7f30380a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.941+0000 7f3048ff9700 1 -- 172.21.15.81:0/4266881925 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f30440cc370 con 0x7f304c19bd40 2024-05-09T00:12:52.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.942+0000 7f304b7fe700 1 --2- 172.21.15.81:0/4266881925 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f30380a1310 0x7f30380a37d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f303400b5c0 tx=0x7f3034005fd0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.942+0000 7f305de1db80 1 Processor -- start 2024-05-09T00:12:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.942+0000 7f305de1db80 1 -- start start 2024-05-09T00:12:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.942+0000 7f305de1db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477b4e80 0x55f2477b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.942+0000 7f305de1db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477b57a0 0x55f2477af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.942+0000 7f305de1db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477af910 0x55f2477afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.942+0000 7f305de1db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2477061d0 con 0x55f2477af910 2024-05-09T00:12:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f305de1db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f247703b90 con 0x55f2477b4e80 2024-05-09T00:12:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f305de1db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2476ff480 con 0x55f2477b57a0 2024-05-09T00:12:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f304bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477af910 0x55f2477afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f304bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477af910 0x55f2477afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55552/0 (socket says 172.21.15.81:55552) 2024-05-09T00:12:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f304bfff700 1 -- 172.21.15.81:0/2660850409 learned_addr learned my addr 172.21.15.81:0/2660850409 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f304b7fe700 1 --2- 172.21.15.81:0/2660850409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477b4e80 0x55f2477b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f304affd700 1 --2- 172.21.15.81:0/2660850409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477b57a0 0x55f2477af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f304bfff700 1 -- 172.21.15.81:0/2660850409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477b57a0 msgr2=0x55f2477af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f304bfff700 1 --2- 172.21.15.81:0/2660850409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477b57a0 0x55f2477af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f304bfff700 1 -- 172.21.15.81:0/2660850409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477b4e80 msgr2=0x55f2477b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f304bfff700 1 --2- 172.21.15.81:0/2660850409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477b4e80 0x55f2477b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f304bfff700 1 -- 172.21.15.81:0/2660850409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f247580430 con 0x55f2477af910 2024-05-09T00:12:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f304bfff700 1 --2- 172.21.15.81:0/2660850409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477af910 0x55f2477afd50 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f3044096810 tx=0x7f304400dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5170376ff6cfb082 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f3041ffb700 1 -- 172.21.15.81:0/2660850409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044005990 con 0x55f2477af910 2024-05-09T00:12:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f3041ffb700 1 -- 172.21.15.81:0/2660850409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3044005af0 con 0x55f2477af910 2024-05-09T00:12:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.943+0000 7f3041ffb700 1 -- 172.21.15.81:0/2660850409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440a16b0 con 0x55f2477af910 2024-05-09T00:12:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.944+0000 7f305de1db80 1 -- 172.21.15.81:0/2660850409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477af910 msgr2=0x55f2477afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.944+0000 7f305de1db80 1 --2- 172.21.15.81:0/2660850409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477af910 0x55f2477afd50 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f3044096810 tx=0x7f304400dc70 comp rx=0 tx=0).stop 2024-05-09T00:12:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.944+0000 7f305de1db80 1 -- 172.21.15.81:0/2660850409 shutdown_connections 2024-05-09T00:12:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.944+0000 7f305de1db80 1 --2- 172.21.15.81:0/2660850409 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477b4e80 0x55f2477b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.944+0000 7f305de1db80 1 --2- 172.21.15.81:0/2660850409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477af910 0x55f2477afd50 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.944+0000 7f305de1db80 1 --2- 172.21.15.81:0/2660850409 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477b57a0 0x55f2477af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.944+0000 7f305de1db80 1 -- 172.21.15.81:0/2660850409 >> 172.21.15.81:0/2660850409 conn(0x55f24770d290 msgr2=0x55f2477a9e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.944+0000 7f305de1db80 1 -- 172.21.15.81:0/2660850409 shutdown_connections 2024-05-09T00:12:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.944+0000 7f305de1db80 1 -- 172.21.15.81:0/2660850409 wait complete. 2024-05-09T00:12:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.944+0000 7f305de1db80 1 -- start start 2024-05-09T00:12:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f305de1db80 1 Processor -- start 2024-05-09T00:12:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f305de1db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477af910 0x55f2477b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f305de1db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477b4e80 0x55f2477b9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f305de1db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477b57a0 0x55f2477b9590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f305de1db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24769b5e0 con 0x55f2477b57a0 2024-05-09T00:12:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f305de1db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24769b280 con 0x55f2477af910 2024-05-09T00:12:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f305de1db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f247582720 con 0x55f2477b4e80 2024-05-09T00:12:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f305de1db80 10 client.0 _ll_register_callbacks cb 0x55f2476a4bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f304bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477b57a0 0x55f2477b9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f304bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477b57a0 0x55f2477b9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55564/0 (socket says 172.21.15.81:55564) 2024-05-09T00:12:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f304bfff700 1 -- 172.21.15.81:0/2253092003 learned_addr learned my addr 172.21.15.81:0/2253092003 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f304b7fe700 1 --2- 172.21.15.81:0/2253092003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477af910 0x55f2477b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f304affd700 1 --2- 172.21.15.81:0/2253092003 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477b4e80 0x55f2477b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f304bfff700 1 -- 172.21.15.81:0/2253092003 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477b4e80 msgr2=0x55f2477b9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f304bfff700 1 --2- 172.21.15.81:0/2253092003 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477b4e80 0x55f2477b9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f304bfff700 1 -- 172.21.15.81:0/2253092003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477af910 msgr2=0x55f2477b8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f304bfff700 1 --2- 172.21.15.81:0/2253092003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477af910 0x55f2477b8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f304bfff700 1 -- 172.21.15.81:0/2253092003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c1a4530 con 0x55f2477b57a0 2024-05-09T00:12:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.945+0000 7f304bfff700 1 --2- 172.21.15.81:0/2253092003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477b57a0 0x55f2477b9590 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f3044004f50 tx=0x7f30440a19f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85634da1df70698c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f302affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f302affd700 1 -- 172.21.15.81:0/2253092003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440a1640 con 0x55f2477b57a0 2024-05-09T00:12:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f302affd700 1 -- 172.21.15.81:0/2253092003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f3044083b10 con 0x55f2477b57a0 2024-05-09T00:12:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f305de1db80 1 -- 172.21.15.81:0/2253092003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f2476582f0 con 0x55f2477b57a0 2024-05-09T00:12:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f302affd700 1 -- 172.21.15.81:0/2253092003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3044083cd0 con 0x55f2477b57a0 2024-05-09T00:12:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f305de1db80 10 client.18321 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f305de1db80 1 -- 172.21.15.81:0/2253092003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f24752cbe0 con 0x55f2477b57a0 2024-05-09T00:12:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f302affd700 1 -- 172.21.15.81:0/2253092003 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f2476582f0 con 0x55f2477b57a0 2024-05-09T00:12:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f302affd700 1 -- 172.21.15.81:0/2253092003 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f30440b6070 con 0x55f2477b57a0 2024-05-09T00:12:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f305de1db80 10 client.18321 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f305de1db80 10 client.18321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f305de1db80 20 client.18321 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f305de1db80 1 --2- 172.21.15.81:0/2253092003 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2477c8f60 0x55f2477cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f305de1db80 4 client.18321 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f305de1db80 1 -- 172.21.15.81:0/2253092003 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f24777e890 con 0x55f2477c8f60 2024-05-09T00:12:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.946+0000 7f304b7fe700 1 --2- 172.21.15.81:0/2253092003 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2477c8f60 0x55f2477cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.947+0000 7f302affd700 10 client.18321 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.947+0000 7f304b7fe700 1 --2- 172.21.15.81:0/2253092003 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2477c8f60 0x55f2477cb380 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efb3a25c3605ca9a server_cookie=c049231f82209b55 in_seq=0 out_seq=0 2024-05-09T00:12:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f302affd700 1 -- 172.21.15.81:0/2253092003 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f24777e890 con 0x55f2477c8f60 2024-05-09T00:12:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f302affd700 10 client.18321 handle_command_reply: tid=0 2024-05-09T00:12:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f305de1db80 1 client.18321 shutdown 2024-05-09T00:12:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f305de1db80 1 -- 172.21.15.81:0/2253092003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477b57a0 msgr2=0x55f2477b9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f305de1db80 1 --2- 172.21.15.81:0/2253092003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477b57a0 0x55f2477b9590 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f3044004f50 tx=0x7f30440a19f0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f305de1db80 1 -- 172.21.15.81:0/2253092003 shutdown_connections 2024-05-09T00:12:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f305de1db80 1 --2- 172.21.15.81:0/2253092003 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2477c8f60 0x55f2477cb380 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f305de1db80 1 --2- 172.21.15.81:0/2253092003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477af910 0x55f2477b8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f302affd700 0 client.18321 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f305de1db80 1 --2- 172.21.15.81:0/2253092003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477b57a0 0x55f2477b9590 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f305de1db80 1 --2- 172.21.15.81:0/2253092003 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477b4e80 0x55f2477b9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f305de1db80 1 -- 172.21.15.81:0/2253092003 >> 172.21.15.81:0/2253092003 conn(0x55f24770d290 msgr2=0x55f2477a9620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f305de1db80 1 -- 172.21.15.81:0/2253092003 shutdown_connections 2024-05-09T00:12:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f305de1db80 1 -- 172.21.15.81:0/2253092003 wait complete. 2024-05-09T00:12:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.948+0000 7f305de1db80 20 client.18321 trim_cache size 0 max 16384 2024-05-09T00:12:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.965+0000 7f305de1db80 1 Processor -- start 2024-05-09T00:12:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.965+0000 7f305de1db80 1 -- start start 2024-05-09T00:12:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f305de1db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477af910 0x55f2477af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f305de1db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477b4e80 0x55f2477b4310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f305de1db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477b57a0 0x55f2477a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f305de1db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2477a6e40 con 0x55f2477af910 2024-05-09T00:12:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f305de1db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2477abed0 con 0x55f2477b57a0 2024-05-09T00:12:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f305de1db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2477d0550 con 0x55f2477b4e80 2024-05-09T00:12:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f304b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477af910 0x55f2477af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f304b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477af910 0x55f2477af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55570/0 (socket says 172.21.15.81:55570) 2024-05-09T00:12:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f304b7fe700 1 -- 172.21.15.81:0/3749696537 learned_addr learned my addr 172.21.15.81:0/3749696537 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f304b7fe700 1 -- 172.21.15.81:0/3749696537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477b4e80 msgr2=0x55f2477b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f304b7fe700 1 --2- 172.21.15.81:0/3749696537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477b4e80 0x55f2477b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f304b7fe700 1 -- 172.21.15.81:0/3749696537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477b57a0 msgr2=0x55f2477a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f304b7fe700 1 --2- 172.21.15.81:0/3749696537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477b57a0 0x55f2477a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f304b7fe700 1 -- 172.21.15.81:0/3749696537 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2477affc0 con 0x55f2477af910 2024-05-09T00:12:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f304b7fe700 1 --2- 172.21.15.81:0/3749696537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477af910 0x55f2477af3d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f3034009990 tx=0x7f3034020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96304cca216c38d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f30427fc700 1 -- 172.21.15.81:0/3749696537 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303400bad0 con 0x55f2477af910 2024-05-09T00:12:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f30427fc700 1 -- 172.21.15.81:0/3749696537 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f303401e040 con 0x55f2477af910 2024-05-09T00:12:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.966+0000 7f30427fc700 1 -- 172.21.15.81:0/3749696537 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3034004760 con 0x55f2477af910 2024-05-09T00:12:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.967+0000 7f305de1db80 1 -- 172.21.15.81:0/3749696537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477af910 msgr2=0x55f2477af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.967+0000 7f305de1db80 1 --2- 172.21.15.81:0/3749696537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477af910 0x55f2477af3d0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f3034009990 tx=0x7f3034020000 comp rx=0 tx=0).stop 2024-05-09T00:12:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.967+0000 7f305de1db80 1 -- 172.21.15.81:0/3749696537 shutdown_connections 2024-05-09T00:12:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.967+0000 7f305de1db80 1 --2- 172.21.15.81:0/3749696537 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477b57a0 0x55f2477a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.967+0000 7f305de1db80 1 --2- 172.21.15.81:0/3749696537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477af910 0x55f2477af3d0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.967+0000 7f305de1db80 1 --2- 172.21.15.81:0/3749696537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477b4e80 0x55f2477b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.967+0000 7f305de1db80 1 -- 172.21.15.81:0/3749696537 >> 172.21.15.81:0/3749696537 conn(0x55f24770d290 msgr2=0x55f2477b3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.967+0000 7f305de1db80 1 -- 172.21.15.81:0/3749696537 shutdown_connections 2024-05-09T00:12:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.967+0000 7f305de1db80 1 -- 172.21.15.81:0/3749696537 wait complete. 2024-05-09T00:12:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.967+0000 7f305de1db80 1 -- start start 2024-05-09T00:12:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f305de1db80 1 Processor -- start 2024-05-09T00:12:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f305de1db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477af910 0x55f2477bee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f305de1db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477b4e80 0x55f2477bf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f305de1db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477b57a0 0x55f2477bf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f305de1db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24781f560 con 0x55f2477b4e80 2024-05-09T00:12:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f305de1db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24781f6d0 con 0x55f2477b57a0 2024-05-09T00:12:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f305de1db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f24781f890 con 0x55f2477af910 2024-05-09T00:12:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f305de1db80 10 client.0 _ll_register_callbacks cb 0x55f2476a4bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f304affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477b4e80 0x55f2477bf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f304affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477b4e80 0x55f2477bf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55574/0 (socket says 172.21.15.81:55574) 2024-05-09T00:12:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f304affd700 1 -- 172.21.15.81:0/2017383251 learned_addr learned my addr 172.21.15.81:0/2017383251 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f304bfff700 1 --2- 172.21.15.81:0/2017383251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477b57a0 0x55f2477bf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f304b7fe700 1 --2- 172.21.15.81:0/2017383251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477af910 0x55f2477bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f304affd700 1 -- 172.21.15.81:0/2017383251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477af910 msgr2=0x55f2477bee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f304affd700 1 --2- 172.21.15.81:0/2017383251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477af910 0x55f2477bee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f304affd700 1 -- 172.21.15.81:0/2017383251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477b57a0 msgr2=0x55f2477bf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f304affd700 1 --2- 172.21.15.81:0/2017383251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477b57a0 0x55f2477bf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f304affd700 1 -- 172.21.15.81:0/2017383251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c067ff0 con 0x55f2477b4e80 2024-05-09T00:12:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f304b7fe700 1 --2- 172.21.15.81:0/2017383251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477af910 0x55f2477bee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f304affd700 1 --2- 172.21.15.81:0/2017383251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477b4e80 0x55f2477bf380 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f303c005950 tx=0x7f303c00bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca032998033ee5b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.968+0000 7f302affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f302affd700 1 -- 172.21.15.81:0/2017383251 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c017070 con 0x55f2477b4e80 2024-05-09T00:12:52.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f302affd700 1 -- 172.21.15.81:0/2017383251 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f303c003bf0 con 0x55f2477b4e80 2024-05-09T00:12:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f305de1db80 1 -- 172.21.15.81:0/2017383251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3044005af0 con 0x55f2477b4e80 2024-05-09T00:12:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f302affd700 1 -- 172.21.15.81:0/2017383251 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f303c003db0 con 0x55f2477b4e80 2024-05-09T00:12:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f305de1db80 10 client.18327 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f305de1db80 1 -- 172.21.15.81:0/2017383251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55f2477a6560 con 0x55f2477b4e80 2024-05-09T00:12:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f302affd700 1 -- 172.21.15.81:0/2017383251 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3044005af0 con 0x55f2477b4e80 2024-05-09T00:12:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f302affd700 1 -- 172.21.15.81:0/2017383251 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f303c012570 con 0x55f2477b4e80 2024-05-09T00:12:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f305de1db80 10 client.18327 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f305de1db80 10 client.18327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f305de1db80 20 client.18327 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f305de1db80 1 --2- 172.21.15.81:0/2017383251 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2478211b0 0x55f2478235d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f305de1db80 4 client.18327 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:12:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f305de1db80 1 -- 172.21.15.81:0/2017383251 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55f2476f7f40 con 0x55f2478211b0 2024-05-09T00:12:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.969+0000 7f304b7fe700 1 --2- 172.21.15.81:0/2017383251 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2478211b0 0x55f2478235d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:52.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.970+0000 7f304b7fe700 1 --2- 172.21.15.81:0/2017383251 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2478211b0 0x55f2478235d0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d33fea54c570e6b server_cookie=41fd96835753d527 in_seq=0 out_seq=0 2024-05-09T00:12:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.970+0000 7f302affd700 10 client.18327 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f302affd700 1 -- 172.21.15.81:0/2017383251 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f2476f7f40 con 0x55f2478211b0 2024-05-09T00:12:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f302affd700 10 client.18327 handle_command_reply: tid=0 2024-05-09T00:12:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f305de1db80 1 client.18327 shutdown 2024-05-09T00:12:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f305de1db80 1 -- 172.21.15.81:0/2017383251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477b4e80 msgr2=0x55f2477bf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f305de1db80 1 --2- 172.21.15.81:0/2017383251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477b4e80 0x55f2477bf380 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f303c005950 tx=0x7f303c00bd20 comp rx=0 tx=0).stop 2024-05-09T00:12:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f305de1db80 1 -- 172.21.15.81:0/2017383251 shutdown_connections 2024-05-09T00:12:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f305de1db80 1 --2- 172.21.15.81:0/2017383251 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55f2478211b0 0x55f2478235d0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f305de1db80 1 --2- 172.21.15.81:0/2017383251 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55f2477b57a0 0x55f2477bf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f305de1db80 1 --2- 172.21.15.81:0/2017383251 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55f2477af910 0x55f2477bee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f302affd700 0 client.18327 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f305de1db80 1 --2- 172.21.15.81:0/2017383251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55f2477b4e80 0x55f2477bf380 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f305de1db80 1 -- 172.21.15.81:0/2017383251 >> 172.21.15.81:0/2017383251 conn(0x55f24770d290 msgr2=0x55f2477b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:52.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f305de1db80 1 -- 172.21.15.81:0/2017383251 shutdown_connections 2024-05-09T00:12:52.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f305de1db80 1 -- 172.21.15.81:0/2017383251 wait complete. 2024-05-09T00:12:52.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.971+0000 7f305de1db80 20 client.18327 trim_cache size 0 max 16384 2024-05-09T00:12:52.977 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:12:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:12:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "651ec184-475e-44e2-9127-783be6124700", 2024-05-09T00:12:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:12:52.977 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:12:52.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.972+0000 7f3051c63700 1 -- 172.21.15.81:0/4266881925 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f30380a1310 msgr2=0x7f30380a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:52.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.972+0000 7f3051c63700 1 --2- 172.21.15.81:0/4266881925 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f30380a1310 0x7f30380a37d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f303400b5c0 tx=0x7f3034005fd0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.972+0000 7f3051c63700 1 -- 172.21.15.81:0/4266881925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304c19bd40 msgr2=0x7f304c19c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:52.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.972+0000 7f3051c63700 1 --2- 172.21.15.81:0/4266881925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304c19bd40 0x7f304c19c1c0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f3044007ee0 tx=0x7f304400d3b0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.972+0000 7f3051c63700 1 -- 172.21.15.81:0/4266881925 shutdown_connections 2024-05-09T00:12:52.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.972+0000 7f3051c63700 1 --2- 172.21.15.81:0/4266881925 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f30380a1310 0x7f30380a37d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.972+0000 7f3051c63700 1 --2- 172.21.15.81:0/4266881925 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f304c19bd40 0x7f304c19c1c0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.972+0000 7f3051c63700 1 --2- 172.21.15.81:0/4266881925 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f304c100060 0x7f304c197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.972+0000 7f3051c63700 1 --2- 172.21.15.81:0/4266881925 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f304c105160 0x7f304c1979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:52.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.972+0000 7f3051c63700 1 -- 172.21.15.81:0/4266881925 >> 172.21.15.81:0/4266881925 conn(0x7f304c076f40 msgr2=0x7f304c0fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:52.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.972+0000 7f3051c63700 1 -- 172.21.15.81:0/4266881925 shutdown_connections 2024-05-09T00:12:52.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:52.972+0000 7f3051c63700 1 -- 172.21.15.81:0/4266881925 wait complete. 2024-05-09T00:12:52.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:12:53.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.107+0000 7f75979c9700 1 -- 172.21.15.81:0/820189896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590100a10 msgr2=0x7f7590104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:53.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.107+0000 7f75979c9700 1 --2- 172.21.15.81:0/820189896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590100a10 0x7f7590104a50 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f7580009990 tx=0x7f7580009ca0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.107+0000 7f75979c9700 1 -- 172.21.15.81:0/820189896 shutdown_connections 2024-05-09T00:12:53.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.107+0000 7f75979c9700 1 --2- 172.21.15.81:0/820189896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7590100060 0x7f7590100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.107+0000 7f75979c9700 1 --2- 172.21.15.81:0/820189896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7590105180 0x7f759010cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.107+0000 7f75979c9700 1 --2- 172.21.15.81:0/820189896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590100a10 0x7f7590104a50 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.107+0000 7f75979c9700 1 -- 172.21.15.81:0/820189896 >> 172.21.15.81:0/820189896 conn(0x7f7590076f70 msgr2=0x7f7590077380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:53.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.108+0000 7f75979c9700 1 -- 172.21.15.81:0/820189896 shutdown_connections 2024-05-09T00:12:53.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.108+0000 7f75979c9700 1 -- 172.21.15.81:0/820189896 wait complete. 2024-05-09T00:12:53.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.108+0000 7f75979c9700 1 Processor -- start 2024-05-09T00:12:53.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.108+0000 7f75979c9700 1 -- start start 2024-05-09T00:12:53.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.108+0000 7f75979c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590100060 0x7f7590196060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.108+0000 7f75979c9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7590105180 0x7f75901965a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.108+0000 7f75979c9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7590196ae0 0x7f75901a56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.108+0000 7f75979c9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75901a5c20 con 0x7f7590100060 2024-05-09T00:12:53.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.108+0000 7f75979c9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75901a5d60 con 0x7f7590105180 2024-05-09T00:12:53.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.108+0000 7f75979c9700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75901a5ea0 con 0x7f7590196ae0 2024-05-09T00:12:53.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.108+0000 7f7595765700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590100060 0x7f7590196060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.108+0000 7f7595765700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590100060 0x7f7590196060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55594/0 (socket says 172.21.15.81:55594) 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.108+0000 7f7595765700 1 -- 172.21.15.81:0/727897193 learned_addr learned my addr 172.21.15.81:0/727897193 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.109+0000 7f7594f64700 1 --2- 172.21.15.81:0/727897193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7590105180 0x7f75901965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.109+0000 7f7595f66700 1 --2- 172.21.15.81:0/727897193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7590196ae0 0x7f75901a56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.109+0000 7f7595765700 1 -- 172.21.15.81:0/727897193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7590196ae0 msgr2=0x7f75901a56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.109+0000 7f7595765700 1 --2- 172.21.15.81:0/727897193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7590196ae0 0x7f75901a56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.109+0000 7f7595765700 1 -- 172.21.15.81:0/727897193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7590105180 msgr2=0x7f75901965a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.109+0000 7f7595765700 1 --2- 172.21.15.81:0/727897193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7590105180 0x7f75901965a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.109+0000 7f7595765700 1 -- 172.21.15.81:0/727897193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75800095f0 con 0x7f7590100060 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.109+0000 7f7595765700 1 --2- 172.21.15.81:0/727897193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590100060 0x7f7590196060 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f758c00d950 tx=0x7f758c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.109+0000 7f75867fc700 1 -- 172.21.15.81:0/727897193 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00f890 con 0x7f7590100060 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.109+0000 7f75979c9700 1 -- 172.21.15.81:0/727897193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75901a6180 con 0x7f7590100060 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.109+0000 7f75867fc700 1 -- 172.21.15.81:0/727897193 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f758c010460 con 0x7f7590100060 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.109+0000 7f75867fc700 1 -- 172.21.15.81:0/727897193 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00e610 con 0x7f7590100060 2024-05-09T00:12:53.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.109+0000 7f75979c9700 1 -- 172.21.15.81:0/727897193 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75901a66b0 con 0x7f7590100060 2024-05-09T00:12:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.111+0000 7f75867fc700 1 -- 172.21.15.81:0/727897193 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f758c0108d0 con 0x7f7590100060 2024-05-09T00:12:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.112+0000 7f75867fc700 1 --2- 172.21.15.81:0/727897193 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f757c0a1310 0x7f757c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.112+0000 7f7594f64700 1 --2- 172.21.15.81:0/727897193 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f757c0a1310 0x7f757c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.112+0000 7f75867fc700 1 -- 172.21.15.81:0/727897193 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f758c0ccb40 con 0x7f7590100060 2024-05-09T00:12:53.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.112+0000 7f7594f64700 1 --2- 172.21.15.81:0/727897193 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f757c0a1310 0x7f757c0a37d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f758000b5c0 tx=0x7f7580005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f75a3b83b80 1 Processor -- start 2024-05-09T00:12:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f75a3b83b80 1 -- start start 2024-05-09T00:12:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f75a3b83b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c3be00 0x55e526c3c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f75a3b83b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3c720 0x55e526c36350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f75a3b83b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c36890 0x55e526c36cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f75a3b83b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526b8d150 con 0x55e526c3c720 2024-05-09T00:12:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f75a3b83b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526b8ab10 con 0x55e526c36890 2024-05-09T00:12:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f75a3b83b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526b86400 con 0x55e526c3be00 2024-05-09T00:12:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f7594f64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3c720 0x55e526c36350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f7594f64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3c720 0x55e526c36350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55610/0 (socket says 172.21.15.81:55610) 2024-05-09T00:12:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f7594f64700 1 -- 172.21.15.81:0/3785437455 learned_addr learned my addr 172.21.15.81:0/3785437455 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f7595765700 1 --2- 172.21.15.81:0/3785437455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c3be00 0x55e526c3c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f7594f64700 1 -- 172.21.15.81:0/3785437455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c3be00 msgr2=0x55e526c3c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:53.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f7594f64700 1 --2- 172.21.15.81:0/3785437455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c3be00 0x55e526c3c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f7594f64700 1 -- 172.21.15.81:0/3785437455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c36890 msgr2=0x55e526c36cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:53.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f7595f66700 1 --2- 172.21.15.81:0/3785437455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c36890 0x55e526c36cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f7594f64700 1 --2- 172.21.15.81:0/3785437455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c36890 0x55e526c36cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f7594f64700 1 -- 172.21.15.81:0/3785437455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e526a073b0 con 0x55e526c3c720 2024-05-09T00:12:53.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.113+0000 7f7595f66700 1 --2- 172.21.15.81:0/3785437455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c36890 0x55e526c36cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:12:53.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.114+0000 7f7594f64700 1 --2- 172.21.15.81:0/3785437455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3c720 0x55e526c36350 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f7580015000 tx=0x7f7580020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11102ccc3599aa1f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:53.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.114+0000 7f757b7fe700 1 -- 172.21.15.81:0/3785437455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758000be00 con 0x55e526c3c720 2024-05-09T00:12:53.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.114+0000 7f757b7fe700 1 -- 172.21.15.81:0/3785437455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f758001e040 con 0x55e526c3c720 2024-05-09T00:12:53.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.114+0000 7f757b7fe700 1 -- 172.21.15.81:0/3785437455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758000f680 con 0x55e526c3c720 2024-05-09T00:12:53.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.114+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3785437455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3c720 msgr2=0x55e526c36350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:53.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.114+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/3785437455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3c720 0x55e526c36350 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f7580015000 tx=0x7f7580020000 comp rx=0 tx=0).stop 2024-05-09T00:12:53.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.114+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3785437455 shutdown_connections 2024-05-09T00:12:53.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.114+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/3785437455 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c36890 0x55e526c36cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.114+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/3785437455 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c3be00 0x55e526c3c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.114+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/3785437455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3c720 0x55e526c36350 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.114+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3785437455 >> 172.21.15.81:0/3785437455 conn(0x55e526b94210 msgr2=0x55e526c30df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.115+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3785437455 shutdown_connections 2024-05-09T00:12:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.115+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3785437455 wait complete. 2024-05-09T00:12:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.115+0000 7f75a3b83b80 1 -- start start 2024-05-09T00:12:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.115+0000 7f75a3b83b80 1 Processor -- start 2024-05-09T00:12:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.115+0000 7f75a3b83b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c36890 0x55e526c3fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.115+0000 7f75a3b83b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3be00 0x55e526c3ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.115+0000 7f75a3b83b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c3c720 0x55e526c404d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.115+0000 7f75a3b83b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526b22560 con 0x55e526c3be00 2024-05-09T00:12:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.115+0000 7f75a3b83b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526b22200 con 0x55e526c3c720 2024-05-09T00:12:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.115+0000 7f75a3b83b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526a096a0 con 0x55e526c36890 2024-05-09T00:12:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.115+0000 7f75a3b83b80 10 client.0 _ll_register_callbacks cb 0x55e526b2bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:53.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.115+0000 7f7594f64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3be00 0x55e526c3ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.115+0000 7f7594f64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3be00 0x55e526c3ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55620/0 (socket says 172.21.15.81:55620) 2024-05-09T00:12:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.115+0000 7f7594f64700 1 -- 172.21.15.81:0/3221959397 learned_addr learned my addr 172.21.15.81:0/3221959397 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:53.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f7595765700 1 --2- 172.21.15.81:0/3221959397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c36890 0x55e526c3fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f7594f64700 1 -- 172.21.15.81:0/3221959397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c36890 msgr2=0x55e526c3fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f7594f64700 1 --2- 172.21.15.81:0/3221959397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c36890 0x55e526c3fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f7594f64700 1 -- 172.21.15.81:0/3221959397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c3c720 msgr2=0x55e526c404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f7594f64700 1 --2- 172.21.15.81:0/3221959397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c3c720 0x55e526c404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f7594f64700 1 -- 172.21.15.81:0/3221959397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759010d570 con 0x55e526c3be00 2024-05-09T00:12:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f7595765700 1 --2- 172.21.15.81:0/3221959397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c36890 0x55e526c3fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:12:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f7594f64700 1 --2- 172.21.15.81:0/3221959397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3be00 0x55e526c3ff90 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f7580032040 tx=0x7f7580005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112389c523c5f52d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f7578ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f7578ff9700 1 -- 172.21.15.81:0/3221959397 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758000fd50 con 0x55e526c3be00 2024-05-09T00:12:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f7578ff9700 1 -- 172.21.15.81:0/3221959397 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f7580004500 con 0x55e526c3be00 2024-05-09T00:12:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3221959397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e526adf270 con 0x55e526c3be00 2024-05-09T00:12:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f7578ff9700 1 -- 172.21.15.81:0/3221959397 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75800046c0 con 0x55e526c3be00 2024-05-09T00:12:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f75a3b83b80 10 client.18339 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:53.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3221959397 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e5269b3b60 con 0x55e526c3be00 2024-05-09T00:12:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f7578ff9700 1 -- 172.21.15.81:0/3221959397 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7580046080 con 0x55e526c3be00 2024-05-09T00:12:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f7578ff9700 1 -- 172.21.15.81:0/3221959397 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7580042a20 con 0x55e526c3be00 2024-05-09T00:12:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f75a3b83b80 10 client.18339 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.116+0000 7f75a3b83b80 10 client.18339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.117+0000 7f75a3b83b80 20 client.18339 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.117+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/3221959397 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e526c4fcd0 0x55e526c520f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.117+0000 7f75a3b83b80 4 client.18339 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:12:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.117+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3221959397 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e526c05810 con 0x55e526c4fcd0 2024-05-09T00:12:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.117+0000 7f7595765700 1 --2- 172.21.15.81:0/3221959397 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e526c4fcd0 0x55e526c520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.117+0000 7f7595765700 1 --2- 172.21.15.81:0/3221959397 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e526c4fcd0 0x55e526c520f0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbc8c82f067cb865 server_cookie=8ffcdc2b83c44650 in_seq=0 out_seq=0 2024-05-09T00:12:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.117+0000 7f7578ff9700 10 client.18339 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f7578ff9700 1 -- 172.21.15.81:0/3221959397 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e526c05810 con 0x55e526c4fcd0 2024-05-09T00:12:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f7578ff9700 10 client.18339 handle_command_reply: tid=0 2024-05-09T00:12:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f75a3b83b80 1 client.18339 shutdown 2024-05-09T00:12:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3221959397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3be00 msgr2=0x55e526c3ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/3221959397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3be00 0x55e526c3ff90 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f7580032040 tx=0x7f7580005790 comp rx=0 tx=0).stop 2024-05-09T00:12:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3221959397 shutdown_connections 2024-05-09T00:12:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/3221959397 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e526c4fcd0 0x55e526c520f0 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/3221959397 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c3c720 0x55e526c404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/3221959397 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c36890 0x55e526c3fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f7578ff9700 0 client.18339 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/3221959397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3be00 0x55e526c3ff90 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3221959397 >> 172.21.15.81:0/3221959397 conn(0x55e526b94210 msgr2=0x55e526c305a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3221959397 shutdown_connections 2024-05-09T00:12:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3221959397 wait complete. 2024-05-09T00:12:53.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.118+0000 7f75a3b83b80 20 client.18339 trim_cache size 0 max 16384 2024-05-09T00:12:53.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:52 smithi081 ceph-mon[42474]: pgmap v306: 97 pgs: 97 active+clean; 2.2 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-05-09T00:12:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.135+0000 7f75a3b83b80 1 Processor -- start 2024-05-09T00:12:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.135+0000 7f75a3b83b80 1 -- start start 2024-05-09T00:12:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.135+0000 7f75a3b83b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c36890 0x55e526c30d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.135+0000 7f75a3b83b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c3be00 0x55e526c40350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.135+0000 7f75a3b83b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c3c720 0x55e526c47140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.135+0000 7f75a3b83b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526c42c40 con 0x55e526c36890 2024-05-09T00:12:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.135+0000 7f75a3b83b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526c31ae0 con 0x55e526c3c720 2024-05-09T00:12:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.135+0000 7f75a3b83b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526c57300 con 0x55e526c3be00 2024-05-09T00:12:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.135+0000 7f7595765700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c36890 0x55e526c30d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.135+0000 7f7595765700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c36890 0x55e526c30d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55626/0 (socket says 172.21.15.81:55626) 2024-05-09T00:12:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.135+0000 7f7595765700 1 -- 172.21.15.81:0/3775897583 learned_addr learned my addr 172.21.15.81:0/3775897583 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.136+0000 7f7595765700 1 -- 172.21.15.81:0/3775897583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c3be00 msgr2=0x55e526c40350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.136+0000 7f7595765700 1 --2- 172.21.15.81:0/3775897583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c3be00 0x55e526c40350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.136+0000 7f7595765700 1 -- 172.21.15.81:0/3775897583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c3c720 msgr2=0x55e526c47140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.136+0000 7f7595765700 1 --2- 172.21.15.81:0/3775897583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c3c720 0x55e526c47140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.136+0000 7f7595765700 1 -- 172.21.15.81:0/3775897583 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e526b4c560 con 0x55e526c36890 2024-05-09T00:12:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.136+0000 7f7595765700 1 --2- 172.21.15.81:0/3775897583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c36890 0x55e526c30d20 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f758c099b50 tx=0x7f758c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da7cfff71f44b9d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.136+0000 7f757bfff700 1 -- 172.21.15.81:0/3775897583 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c097f60 con 0x55e526c36890 2024-05-09T00:12:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.136+0000 7f757bfff700 1 -- 172.21.15.81:0/3775897583 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f758c0ca480 con 0x55e526c36890 2024-05-09T00:12:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.136+0000 7f757bfff700 1 -- 172.21.15.81:0/3775897583 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c099310 con 0x55e526c36890 2024-05-09T00:12:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.136+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3775897583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c36890 msgr2=0x55e526c30d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.136+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/3775897583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c36890 0x55e526c30d20 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f758c099b50 tx=0x7f758c000bc0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3775897583 shutdown_connections 2024-05-09T00:12:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/3775897583 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c3c720 0x55e526c47140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/3775897583 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c36890 0x55e526c30d20 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/3775897583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c3be00 0x55e526c40350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3775897583 >> 172.21.15.81:0/3775897583 conn(0x55e526b94210 msgr2=0x55e526c2d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3775897583 shutdown_connections 2024-05-09T00:12:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 -- 172.21.15.81:0/3775897583 wait complete. 2024-05-09T00:12:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 -- start start 2024-05-09T00:12:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 Processor -- start 2024-05-09T00:12:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c36890 0x55e526c9f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3be00 0x55e526c9fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c3c720 0x55e526c9d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526c9d700 con 0x55e526c3be00 2024-05-09T00:12:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526c9d870 con 0x55e526c3c720 2024-05-09T00:12:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e526c9da30 con 0x55e526c36890 2024-05-09T00:12:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f75a3b83b80 10 client.0 _ll_register_callbacks cb 0x55e526b2bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:12:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.137+0000 7f7594f64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3be00 0x55e526c9fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7594f64700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3be00 0x55e526c9fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55642/0 (socket says 172.21.15.81:55642) 2024-05-09T00:12:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7594f64700 1 -- 172.21.15.81:0/1098107717 learned_addr learned my addr 172.21.15.81:0/1098107717 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:12:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7595765700 1 --2- 172.21.15.81:0/1098107717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c36890 0x55e526c9f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7595f66700 1 --2- 172.21.15.81:0/1098107717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c3c720 0x55e526c9d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7594f64700 1 -- 172.21.15.81:0/1098107717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c36890 msgr2=0x55e526c9f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7594f64700 1 --2- 172.21.15.81:0/1098107717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c36890 0x55e526c9f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7594f64700 1 -- 172.21.15.81:0/1098107717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c3c720 msgr2=0x55e526c9d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7594f64700 1 --2- 172.21.15.81:0/1098107717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c3c720 0x55e526c9d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7594f64700 1 -- 172.21.15.81:0/1098107717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75901a66b0 con 0x55e526c3be00 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7594f64700 1 --2- 172.21.15.81:0/1098107717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3be00 0x55e526c9fa40 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f7580005340 tx=0x7f7580004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e28692885b4ac1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7578ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7578ff9700 1 -- 172.21.15.81:0/1098107717 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7580049070 con 0x55e526c3be00 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7578ff9700 1 -- 172.21.15.81:0/1098107717 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f7580010eb0 con 0x55e526c3be00 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f75a3b83b80 1 -- 172.21.15.81:0/1098107717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f758001e040 con 0x55e526c3be00 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7578ff9700 1 -- 172.21.15.81:0/1098107717 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f75800059d0 con 0x55e526c3be00 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f75a3b83b80 10 client.18345 fetch_fsmap learned FSMap version 26 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f75a3b83b80 1 -- 172.21.15.81:0/1098107717 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e526a0bcd0 con 0x55e526c3be00 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.138+0000 7f7578ff9700 1 -- 172.21.15.81:0/1098107717 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f758001e040 con 0x55e526c3be00 2024-05-09T00:12:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f7578ff9700 1 -- 172.21.15.81:0/1098107717 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f758004c020 con 0x55e526c3be00 2024-05-09T00:12:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f75a3b83b80 10 client.18345 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:12:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f75a3b83b80 10 client.18345 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:12:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f75a3b83b80 20 client.18345 populate_metadata read hostname 'smithi081' 2024-05-09T00:12:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/1098107717 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e526ca70f0 0x55e526ca9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:12:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f75a3b83b80 4 client.18345 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:12:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f75a3b83b80 1 -- 172.21.15.81:0/1098107717 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e526b7eec0 con 0x55e526ca70f0 2024-05-09T00:12:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f7595765700 1 --2- 172.21.15.81:0/1098107717 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e526ca70f0 0x55e526ca9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:12:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f7578ff9700 10 client.18345 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f7595765700 1 --2- 172.21.15.81:0/1098107717 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e526ca70f0 0x55e526ca9510 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=128658451a012799 server_cookie=e3ab7ae68f7935cc in_seq=0 out_seq=0 2024-05-09T00:12:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f7578ff9700 1 -- 172.21.15.81:0/1098107717 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e526b7eec0 con 0x55e526ca70f0 2024-05-09T00:12:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f7578ff9700 10 client.18345 handle_command_reply: tid=0 2024-05-09T00:12:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f75a3b83b80 1 client.18345 shutdown 2024-05-09T00:12:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f75a3b83b80 1 -- 172.21.15.81:0/1098107717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3be00 msgr2=0x55e526c9fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.139+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/1098107717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3be00 0x55e526c9fa40 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f7580005340 tx=0x7f7580004830 comp rx=0 tx=0).stop 2024-05-09T00:12:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75a3b83b80 1 -- 172.21.15.81:0/1098107717 shutdown_connections 2024-05-09T00:12:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/1098107717 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55e526ca70f0 0x55e526ca9510 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/1098107717 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55e526c3c720 0x55e526c9d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f7578ff9700 0 client.18345 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:12:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/1098107717 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55e526c36890 0x55e526c9f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75a3b83b80 1 --2- 172.21.15.81:0/1098107717 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55e526c3be00 0x55e526c9fa40 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75a3b83b80 1 -- 172.21.15.81:0/1098107717 >> 172.21.15.81:0/1098107717 conn(0x55e526b94210 msgr2=0x55e526c39c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75a3b83b80 1 -- 172.21.15.81:0/1098107717 shutdown_connections 2024-05-09T00:12:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75a3b83b80 1 -- 172.21.15.81:0/1098107717 wait complete. 2024-05-09T00:12:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75a3b83b80 20 client.18345 trim_cache size 0 max 16384 2024-05-09T00:12:53.143 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:12:53.144 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:12:53.144 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:12:53.144 INFO:teuthology.orchestra.run.smithi081.stdout: "651ec184-475e-44e2-9127-783be6124700": { 2024-05-09T00:12:53.144 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:12:53.144 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "651ec184-475e-44e2-9127-783be6124700", 2024-05-09T00:12:53.144 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:12:53.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:12:53.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:12:53.144 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:12:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75979c9700 1 -- 172.21.15.81:0/727897193 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f757c0a1310 msgr2=0x7f757c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75979c9700 1 --2- 172.21.15.81:0/727897193 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f757c0a1310 0x7f757c0a37d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f758000b5c0 tx=0x7f7580005960 comp rx=0 tx=0).stop 2024-05-09T00:12:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75979c9700 1 -- 172.21.15.81:0/727897193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590100060 msgr2=0x7f7590196060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:12:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75979c9700 1 --2- 172.21.15.81:0/727897193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590100060 0x7f7590196060 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f758c00d950 tx=0x7f758c00dc60 comp rx=0 tx=0).stop 2024-05-09T00:12:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75979c9700 1 -- 172.21.15.81:0/727897193 shutdown_connections 2024-05-09T00:12:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75979c9700 1 --2- 172.21.15.81:0/727897193 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f757c0a1310 0x7f757c0a37d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75979c9700 1 --2- 172.21.15.81:0/727897193 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7590196ae0 0x7f75901a56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75979c9700 1 --2- 172.21.15.81:0/727897193 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7590100060 0x7f7590196060 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75979c9700 1 --2- 172.21.15.81:0/727897193 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7590105180 0x7f75901965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:12:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75979c9700 1 -- 172.21.15.81:0/727897193 >> 172.21.15.81:0/727897193 conn(0x7f7590076f70 msgr2=0x7f7590106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:12:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75979c9700 1 -- 172.21.15.81:0/727897193 shutdown_connections 2024-05-09T00:12:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:12:53.140+0000 7f75979c9700 1 -- 172.21.15.81:0/727897193 wait complete. 2024-05-09T00:12:53.149 INFO:tasks.cephfs.filesystem:scrub status for tag:651ec184-475e-44e2-9127-783be6124700 - {'path': '/', 'tag': '651ec184-475e-44e2-9127-783be6124700', 'options': 'recursive,force'} 2024-05-09T00:12:53.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:52 smithi150 ceph-mon[46187]: pgmap v306: 97 pgs: 97 active+clean; 2.2 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-05-09T00:12:53.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:52 smithi171 ceph-mon[47351]: pgmap v306: 97 pgs: 97 active+clean; 2.2 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-05-09T00:12:54.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:53 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:12:54.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:53 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:12:54.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:53 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:12:54.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:53 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:12:54.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:53 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:12:54.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:53 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:12:54.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:53 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:12:54.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:53 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:12:54.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:53 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:12:54.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:53 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:12:54.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:53 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:12:54.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:53 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:12:55.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:54 smithi150 ceph-mon[46187]: pgmap v307: 97 pgs: 97 active+clean; 2.2 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-09T00:12:55.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:54 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:12:55.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:54 smithi171 ceph-mon[47351]: pgmap v307: 97 pgs: 97 active+clean; 2.2 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-09T00:12:55.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:54 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:12:55.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:54 smithi081 ceph-mon[42474]: pgmap v307: 97 pgs: 97 active+clean; 2.2 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 35 KiB/s wr, 9 op/s 2024-05-09T00:12:55.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:54 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:12:57.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:56 smithi150 ceph-mon[46187]: pgmap v308: 97 pgs: 97 active+clean; 2.5 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:12:57.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:56 smithi171 ceph-mon[47351]: pgmap v308: 97 pgs: 97 active+clean; 2.5 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:12:57.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:56 smithi081 ceph-mon[42474]: pgmap v308: 97 pgs: 97 active+clean; 2.5 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:12:57.492 INFO:tasks.workunit.client.0.smithi081.stdout:437/600: open fd = 3 2024-05-09T00:12:57.493 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.493 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.493 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.493 INFO:tasks.workunit.client.0.smithi081.stdout:438/600: open fd = 3 2024-05-09T00:12:57.493 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.493 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.493 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.493 INFO:tasks.workunit.client.0.smithi081.stdout:439/600: open fd = 3 2024-05-09T00:12:57.493 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.493 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.493 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.493 INFO:tasks.workunit.client.0.smithi081.stdout:440/600: open fd = 3 2024-05-09T00:12:57.493 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.493 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.494 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.494 INFO:tasks.workunit.client.0.smithi081.stdout:441/600: open fd = 3 2024-05-09T00:12:57.494 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.494 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.494 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.494 INFO:tasks.workunit.client.0.smithi081.stdout:442/600: open fd = 3 2024-05-09T00:12:57.494 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.494 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.494 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.494 INFO:tasks.workunit.client.0.smithi081.stdout:443/600: open fd = 3 2024-05-09T00:12:57.494 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.494 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.494 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.494 INFO:tasks.workunit.client.0.smithi081.stdout:444/600: open fd = 3 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:445/600: open fd = 3 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:446/600: open fd = 3 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:447/600: open fd = 3 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.495 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:448/600: open fd = 3 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:449/600: open fd = 3 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:450/600: open fd = 3 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:451/600: open fd = 3 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.496 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:452/600: open fd = 3 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:453/600: open fd = 3 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:454/600: open fd = 3 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:455/600: open fd = 3 2024-05-09T00:12:57.497 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:456/600: open fd = 3 2024-05-09T00:12:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:457/600: open fd = 3 2024-05-09T00:12:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:458/600: open fd = 3 2024-05-09T00:12:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.498 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:459/600: open fd = 3 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:460/600: open fd = 3 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:461/600: open fd = 3 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:462/600: open fd = 3 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.499 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.500 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.500 INFO:tasks.workunit.client.0.smithi081.stdout:463/600: open fd = 3 2024-05-09T00:12:57.500 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.500 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.500 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.500 INFO:tasks.workunit.client.0.smithi081.stdout:464/600: open fd = 3 2024-05-09T00:12:57.500 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.500 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.500 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.500 INFO:tasks.workunit.client.0.smithi081.stdout:465/600: open fd = 3 2024-05-09T00:12:57.500 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.500 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.500 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.500 INFO:tasks.workunit.client.0.smithi081.stdout:466/600: open fd = 3 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:467/600: open fd = 3 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:468/600: open fd = 3 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:469/600: open fd = 3 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.501 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.502 INFO:tasks.workunit.client.0.smithi081.stdout:470/600: open fd = 3 2024-05-09T00:12:57.502 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.502 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.502 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.502 INFO:tasks.workunit.client.0.smithi081.stdout:471/600: open fd = 3 2024-05-09T00:12:57.502 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.502 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.502 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.502 INFO:tasks.workunit.client.0.smithi081.stdout:472/600: open fd = 3 2024-05-09T00:12:57.502 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.502 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.502 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.502 INFO:tasks.workunit.client.0.smithi081.stdout:473/600: open fd = 3 2024-05-09T00:12:57.502 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:474/600: open fd = 3 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:475/600: open fd = 3 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:476/600: open fd = 3 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.503 INFO:tasks.workunit.client.0.smithi081.stdout:477/600: open fd = 3 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:478/600: open fd = 3 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:479/600: open fd = 3 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:480/600: open fd = 3 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.504 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:481/600: open fd = 3 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:482/600: open fd = 3 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:483/600: open fd = 3 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:484/600: open fd = 3 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.505 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.506 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.506 INFO:tasks.workunit.client.0.smithi081.stdout:485/600: open fd = 3 2024-05-09T00:12:57.506 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.506 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.506 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.506 INFO:tasks.workunit.client.0.smithi081.stdout:486/600: open fd = 3 2024-05-09T00:12:57.506 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.506 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.506 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.506 INFO:tasks.workunit.client.0.smithi081.stdout:487/600: open fd = 3 2024-05-09T00:12:57.506 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.506 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.506 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.506 INFO:tasks.workunit.client.0.smithi081.stdout:488/600: open fd = 3 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:489/600: open fd = 3 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:490/600: open fd = 3 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:491/600: open fd = 3 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.507 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.508 INFO:tasks.workunit.client.0.smithi081.stdout:492/600: open fd = 3 2024-05-09T00:12:57.508 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.508 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.508 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.508 INFO:tasks.workunit.client.0.smithi081.stdout:493/600: open fd = 3 2024-05-09T00:12:57.508 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.508 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.508 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.508 INFO:tasks.workunit.client.0.smithi081.stdout:494/600: open fd = 3 2024-05-09T00:12:57.508 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.508 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.508 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.508 INFO:tasks.workunit.client.0.smithi081.stdout:495/600: open fd = 3 2024-05-09T00:12:57.508 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:496/600: open fd = 3 2024-05-09T00:12:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:497/600: open fd = 3 2024-05-09T00:12:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:498/600: open fd = 3 2024-05-09T00:12:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:12:57.509 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:12:59.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:12:58 smithi150 ceph-mon[46187]: pgmap v309: 97 pgs: 97 active+clean; 2.5 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:12:59.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:12:58 smithi171 ceph-mon[47351]: pgmap v309: 97 pgs: 97 active+clean; 2.5 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:12:59.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:12:58 smithi081 ceph-mon[42474]: pgmap v309: 97 pgs: 97 active+clean; 2.5 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:13:01.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:00 smithi150 ceph-mon[46187]: pgmap v310: 97 pgs: 97 active+clean; 2.5 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:13:01.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:00 smithi171 ceph-mon[47351]: pgmap v310: 97 pgs: 97 active+clean; 2.5 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:13:01.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:00 smithi081 ceph-mon[42474]: pgmap v310: 97 pgs: 97 active+clean; 2.5 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:13:03.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:02 smithi150 ceph-mon[46187]: pgmap v311: 97 pgs: 97 active+clean; 2.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 18 op/s 2024-05-09T00:13:03.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:02 smithi171 ceph-mon[47351]: pgmap v311: 97 pgs: 97 active+clean; 2.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 18 op/s 2024-05-09T00:13:03.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:02 smithi081 ceph-mon[42474]: pgmap v311: 97 pgs: 97 active+clean; 2.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 58 KiB/s wr, 18 op/s 2024-05-09T00:13:04.205 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.204+0000 7ffb8fb7b700 1 -- 172.21.15.81:0/35672692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb88105df0 msgr2=0x7ffb88069190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:04.205 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.204+0000 7ffb8fb7b700 1 --2- 172.21.15.81:0/35672692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb88105df0 0x7ffb88069190 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009990 tx=0x7ffb78009ca0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.205 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.204+0000 7ffb8fb7b700 1 -- 172.21.15.81:0/35672692 shutdown_connections 2024-05-09T00:13:04.205 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.204+0000 7ffb8fb7b700 1 --2- 172.21.15.81:0/35672692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb881038f0 0x7ffb88103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.205 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.204+0000 7ffb8fb7b700 1 --2- 172.21.15.81:0/35672692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb88105df0 0x7ffb88069190 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.205 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.204+0000 7ffb8fb7b700 1 --2- 172.21.15.81:0/35672692 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb880696d0 0x7ffb88069b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.205 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.204+0000 7ffb8fb7b700 1 -- 172.21.15.81:0/35672692 >> 172.21.15.81:0/35672692 conn(0x7ffb88076f40 msgr2=0x7ffb88077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:04.205 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.204+0000 7ffb8fb7b700 1 -- 172.21.15.81:0/35672692 shutdown_connections 2024-05-09T00:13:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.204+0000 7ffb8fb7b700 1 -- 172.21.15.81:0/35672692 wait complete. 2024-05-09T00:13:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8fb7b700 1 Processor -- start 2024-05-09T00:13:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8fb7b700 1 -- start start 2024-05-09T00:13:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8fb7b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb880696d0 0x7ffb881a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8fb7b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb881038f0 0x7ffb881a3c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8fb7b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb88105df0 0x7ffb8819d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8fb7b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8819dee0 con 0x7ffb881038f0 2024-05-09T00:13:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8fb7b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8819e050 con 0x7ffb88105df0 2024-05-09T00:13:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8fb7b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8819e210 con 0x7ffb880696d0 2024-05-09T00:13:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8d116700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb881038f0 0x7ffb881a3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8d116700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb881038f0 0x7ffb881a3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59190/0 (socket says 172.21.15.81:59190) 2024-05-09T00:13:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8d116700 1 -- 172.21.15.81:0/904119703 learned_addr learned my addr 172.21.15.81:0/904119703 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8e118700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb88105df0 0x7ffb8819d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8d917700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb880696d0 0x7ffb881a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8d116700 1 -- 172.21.15.81:0/904119703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb880696d0 msgr2=0x7ffb881a36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8d116700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb880696d0 0x7ffb881a36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8d116700 1 -- 172.21.15.81:0/904119703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb88105df0 msgr2=0x7ffb8819d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8d116700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb88105df0 0x7ffb8819d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8d116700 1 -- 172.21.15.81:0/904119703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb780095f0 con 0x7ffb881038f0 2024-05-09T00:13:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8e118700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb88105df0 0x7ffb8819d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.205+0000 7ffb8d116700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb881038f0 0x7ffb881a3c30 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400d950 tx=0x7ffb8400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:04.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.206+0000 7ffb7effd700 1 -- 172.21.15.81:0/904119703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb84009b40 con 0x7ffb881038f0 2024-05-09T00:13:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.206+0000 7ffb8fb7b700 1 -- 172.21.15.81:0/904119703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8819e4f0 con 0x7ffb881038f0 2024-05-09T00:13:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.206+0000 7ffb7effd700 1 -- 172.21.15.81:0/904119703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb84009ca0 con 0x7ffb881038f0 2024-05-09T00:13:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.206+0000 7ffb7effd700 1 -- 172.21.15.81:0/904119703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8400f620 con 0x7ffb881038f0 2024-05-09T00:13:04.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.206+0000 7ffb8fb7b700 1 -- 172.21.15.81:0/904119703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb881aa6e0 con 0x7ffb881038f0 2024-05-09T00:13:04.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.208+0000 7ffb7effd700 1 -- 172.21.15.81:0/904119703 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ffb84010460 con 0x7ffb881038f0 2024-05-09T00:13:04.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.208+0000 7ffb7effd700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffb740a1290 0x7ffb740a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.208+0000 7ffb8d917700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffb740a1290 0x7ffb740a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.208+0000 7ffb7effd700 1 -- 172.21.15.81:0/904119703 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7ffb840cd100 con 0x7ffb881038f0 2024-05-09T00:13:04.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.209+0000 7ffb8d917700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffb740a1290 0x7ffb740a3750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800b5c0 tx=0x7ffb7801a040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:04.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.209+0000 7ffb9bd35b80 1 Processor -- start 2024-05-09T00:13:04.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb9bd35b80 1 -- start start 2024-05-09T00:13:04.216 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb9bd35b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08638950 0x559c08638d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb9bd35b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c08632f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb9bd35b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08633480 0x559c086338a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb9bd35b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c0858a0f0 con 0x559c08639270 2024-05-09T00:13:04.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb9bd35b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c08587ab0 con 0x559c08638950 2024-05-09T00:13:04.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb9bd35b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c085833a0 con 0x559c08633480 2024-05-09T00:13:04.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb8d116700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c08632f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb8d116700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c08632f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59204/0 (socket says 172.21.15.81:59204) 2024-05-09T00:13:04.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb8d116700 1 -- 172.21.15.81:0/2254867294 learned_addr learned my addr 172.21.15.81:0/2254867294 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:04.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb8d917700 1 --2- 172.21.15.81:0/2254867294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08638950 0x559c08638d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb8e118700 1 --2- 172.21.15.81:0/2254867294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08633480 0x559c086338a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb8d116700 1 -- 172.21.15.81:0/2254867294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08633480 msgr2=0x559c086338a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:04.217 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb8d116700 1 --2- 172.21.15.81:0/2254867294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08633480 0x559c086338a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb8d116700 1 -- 172.21.15.81:0/2254867294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08638950 msgr2=0x559c08638d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:04.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb8d116700 1 --2- 172.21.15.81:0/2254867294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08638950 0x559c08638d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb8d116700 1 -- 172.21.15.81:0/2254867294 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c08404350 con 0x559c08639270 2024-05-09T00:13:04.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb8d917700 1 --2- 172.21.15.81:0/2254867294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08638950 0x559c08638d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:04.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.210+0000 7ffb8d116700 1 --2- 172.21.15.81:0/2254867294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c08632f40 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7ffb840a2130 tx=0x7ffb8409a0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5f584d47bf8eaf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:04.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.211+0000 7ffb73fff700 1 -- 172.21.15.81:0/2254867294 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8409e010 con 0x559c08639270 2024-05-09T00:13:04.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.211+0000 7ffb73fff700 1 -- 172.21.15.81:0/2254867294 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb840a2660 con 0x559c08639270 2024-05-09T00:13:04.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.211+0000 7ffb73fff700 1 -- 172.21.15.81:0/2254867294 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8409a440 con 0x559c08639270 2024-05-09T00:13:04.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.211+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/2254867294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 msgr2=0x559c08632f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:04.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.211+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/2254867294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c08632f40 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7ffb840a2130 tx=0x7ffb8409a0c0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.211+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/2254867294 shutdown_connections 2024-05-09T00:13:04.218 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.211+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/2254867294 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08638950 0x559c08638d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.219 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.211+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/2254867294 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08633480 0x559c086338a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.219 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.211+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/2254867294 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c08632f40 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.219 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.211+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/2254867294 >> 172.21.15.81:0/2254867294 conn(0x559c085911b0 msgr2=0x559c0862d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:04.219 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.211+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/2254867294 shutdown_connections 2024-05-09T00:13:04.219 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.211+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/2254867294 wait complete. 2024-05-09T00:13:04.219 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.212+0000 7ffb9bd35b80 1 -- start start 2024-05-09T00:13:04.219 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.212+0000 7ffb9bd35b80 1 Processor -- start 2024-05-09T00:13:04.219 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.212+0000 7ffb9bd35b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08633480 0x559c0863c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.219 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.212+0000 7ffb9bd35b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08638950 0x559c0863cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.219 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.212+0000 7ffb9bd35b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08639270 0x559c0863d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.219 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.212+0000 7ffb9bd35b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c0851f500 con 0x559c08638950 2024-05-09T00:13:04.219 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.212+0000 7ffb9bd35b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c0851f1a0 con 0x559c08633480 2024-05-09T00:13:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.212+0000 7ffb9bd35b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c08406640 con 0x559c08639270 2024-05-09T00:13:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.212+0000 7ffb9bd35b80 10 client.0 _ll_register_callbacks cb 0x559c08528ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.212+0000 7ffb8d116700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08638950 0x559c0863cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb8d116700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08638950 0x559c0863cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59206/0 (socket says 172.21.15.81:59206) 2024-05-09T00:13:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb8d116700 1 -- 172.21.15.81:0/2070013214 learned_addr learned my addr 172.21.15.81:0/2070013214 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb8d917700 1 --2- 172.21.15.81:0/2070013214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08633480 0x559c0863c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb8e118700 1 --2- 172.21.15.81:0/2070013214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08639270 0x559c0863d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb8d116700 1 -- 172.21.15.81:0/2070013214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08639270 msgr2=0x559c0863d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb8d116700 1 --2- 172.21.15.81:0/2070013214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08639270 0x559c0863d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb8d116700 1 -- 172.21.15.81:0/2070013214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08633480 msgr2=0x559c0863c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb8d116700 1 --2- 172.21.15.81:0/2070013214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08633480 0x559c0863c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.220 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb8d116700 1 -- 172.21.15.81:0/2070013214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb881aa6e0 con 0x559c08638950 2024-05-09T00:13:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb8e118700 1 --2- 172.21.15.81:0/2070013214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08639270 0x559c0863d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb8d116700 1 --2- 172.21.15.81:0/2070013214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08638950 0x559c0863cb30 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7ffb840cd3e0 tx=0x7ffb8409a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b0eb43018a03a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb717fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb717fa700 1 -- 172.21.15.81:0/2070013214 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb84010710 con 0x559c08638950 2024-05-09T00:13:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb717fa700 1 -- 172.21.15.81:0/2070013214 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7ffb84063020 con 0x559c08638950 2024-05-09T00:13:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/2070013214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c084dc210 con 0x559c08638950 2024-05-09T00:13:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb717fa700 1 -- 172.21.15.81:0/2070013214 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb84010870 con 0x559c08638950 2024-05-09T00:13:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb9bd35b80 10 client.18357 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/2070013214 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559c083b0b00 con 0x559c08638950 2024-05-09T00:13:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.213+0000 7ffb717fa700 1 -- 172.21.15.81:0/2070013214 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb8407f020 con 0x559c08638950 2024-05-09T00:13:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.214+0000 7ffb717fa700 1 -- 172.21.15.81:0/2070013214 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ffb840a21d0 con 0x559c08638950 2024-05-09T00:13:04.221 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.214+0000 7ffb9bd35b80 10 client.18357 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.214+0000 7ffb9bd35b80 10 client.18357 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.214+0000 7ffb9bd35b80 20 client.18357 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.214+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/2070013214 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559c0864c7f0 0x559c0864ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.214+0000 7ffb9bd35b80 4 client.18357 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.214+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/2070013214 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c086027b0 con 0x559c0864c7f0 2024-05-09T00:13:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.214+0000 7ffb8d917700 1 --2- 172.21.15.81:0/2070013214 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559c0864c7f0 0x559c0864ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.215+0000 7ffb717fa700 10 client.18357 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.215+0000 7ffb8d917700 1 --2- 172.21.15.81:0/2070013214 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559c0864c7f0 0x559c0864ec10 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=297a60a69cd5d179 server_cookie=7dad10d4e3a5a5ba in_seq=0 out_seq=0 2024-05-09T00:13:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.215+0000 7ffb717fa700 1 -- 172.21.15.81:0/2070013214 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559c086027b0 con 0x559c0864c7f0 2024-05-09T00:13:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.215+0000 7ffb717fa700 10 client.18357 handle_command_reply: tid=0 2024-05-09T00:13:04.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.215+0000 7ffb9bd35b80 1 client.18357 shutdown 2024-05-09T00:13:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.215+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/2070013214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08638950 msgr2=0x559c0863cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.215+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/2070013214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08638950 0x559c0863cb30 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7ffb840cd3e0 tx=0x7ffb8409a2a0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.216+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/2070013214 shutdown_connections 2024-05-09T00:13:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.216+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/2070013214 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559c0864c7f0 0x559c0864ec10 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.216+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/2070013214 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08633480 0x559c0863c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.216+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/2070013214 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08639270 0x559c0863d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.216+0000 7ffb717fa700 0 client.18357 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.216+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/2070013214 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08638950 0x559c0863cb30 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.216+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/2070013214 >> 172.21.15.81:0/2070013214 conn(0x559c085911b0 msgr2=0x559c086374a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.216+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/2070013214 shutdown_connections 2024-05-09T00:13:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.216+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/2070013214 wait complete. 2024-05-09T00:13:04.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.216+0000 7ffb9bd35b80 20 client.18357 trim_cache size 0 max 16384 2024-05-09T00:13:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb9bd35b80 1 Processor -- start 2024-05-09T00:13:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb9bd35b80 1 -- start start 2024-05-09T00:13:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb9bd35b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08633480 0x559c08648cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb9bd35b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08638950 0x559c0862d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb9bd35b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c08633860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb9bd35b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c08653dc0 con 0x559c08639270 2024-05-09T00:13:04.235 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb9bd35b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c08638540 con 0x559c08638950 2024-05-09T00:13:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb9bd35b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c0862e930 con 0x559c08633480 2024-05-09T00:13:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb8e118700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c08633860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb8e118700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c08633860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59208/0 (socket says 172.21.15.81:59208) 2024-05-09T00:13:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb8e118700 1 -- 172.21.15.81:0/4153172732 learned_addr learned my addr 172.21.15.81:0/4153172732 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb8d116700 1 --2- 172.21.15.81:0/4153172732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08638950 0x559c0862d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb8e118700 1 -- 172.21.15.81:0/4153172732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08633480 msgr2=0x559c08648cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb8d917700 1 --2- 172.21.15.81:0/4153172732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08633480 0x559c08648cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb8e118700 1 --2- 172.21.15.81:0/4153172732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08633480 0x559c08648cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb8e118700 1 -- 172.21.15.81:0/4153172732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08638950 msgr2=0x559c0862d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb8e118700 1 --2- 172.21.15.81:0/4153172732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08638950 0x559c0862d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb8e118700 1 -- 172.21.15.81:0/4153172732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c08549500 con 0x559c08639270 2024-05-09T00:13:04.236 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb8d116700 1 --2- 172.21.15.81:0/4153172732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08638950 0x559c0862d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.231+0000 7ffb8e118700 1 --2- 172.21.15.81:0/4153172732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c08633860 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009f40 tx=0x7ffb80009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3abbf5232c65ce server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.232+0000 7ffb7cda4700 1 -- 172.21.15.81:0/4153172732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80015410 con 0x559c08639270 2024-05-09T00:13:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.232+0000 7ffb7cda4700 1 -- 172.21.15.81:0/4153172732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb80010050 con 0x559c08639270 2024-05-09T00:13:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.232+0000 7ffb7cda4700 1 -- 172.21.15.81:0/4153172732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80014760 con 0x559c08639270 2024-05-09T00:13:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.232+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/4153172732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 msgr2=0x559c08633860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.232+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/4153172732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c08633860 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009f40 tx=0x7ffb80009f70 comp rx=0 tx=0).stop 2024-05-09T00:13:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.232+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/4153172732 shutdown_connections 2024-05-09T00:13:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.232+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/4153172732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c08633860 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.232+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/4153172732 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08633480 0x559c08648cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.232+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/4153172732 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08638950 0x559c0862d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.232+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/4153172732 >> 172.21.15.81:0/4153172732 conn(0x559c085911b0 msgr2=0x559c0863ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:04.237 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.232+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/4153172732 shutdown_connections 2024-05-09T00:13:04.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.232+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/4153172732 wait complete. 2024-05-09T00:13:04.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb9bd35b80 1 -- start start 2024-05-09T00:13:04.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb9bd35b80 1 Processor -- start 2024-05-09T00:13:04.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb9bd35b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08633480 0x559c08643f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb9bd35b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08638950 0x559c08641b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb9bd35b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c086420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb9bd35b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c086427b0 con 0x559c08639270 2024-05-09T00:13:04.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb9bd35b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c08642920 con 0x559c08633480 2024-05-09T00:13:04.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb9bd35b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c086a1cb0 con 0x559c08638950 2024-05-09T00:13:04.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb9bd35b80 10 client.0 _ll_register_callbacks cb 0x559c08528ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:04.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb8e118700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c086420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.238 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb8e118700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c086420a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59216/0 (socket says 172.21.15.81:59216) 2024-05-09T00:13:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb8e118700 1 -- 172.21.15.81:0/4209941024 learned_addr learned my addr 172.21.15.81:0/4209941024 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb8d116700 1 --2- 172.21.15.81:0/4209941024 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08638950 0x559c08641b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb8d917700 1 --2- 172.21.15.81:0/4209941024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08633480 0x559c08643f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.233+0000 7ffb8e118700 1 -- 172.21.15.81:0/4209941024 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08638950 msgr2=0x559c08641b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb8e118700 1 --2- 172.21.15.81:0/4209941024 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08638950 0x559c08641b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb8e118700 1 -- 172.21.15.81:0/4209941024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08633480 msgr2=0x559c08643f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb8e118700 1 --2- 172.21.15.81:0/4209941024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08633480 0x559c08643f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb8e118700 1 -- 172.21.15.81:0/4209941024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb80009b70 con 0x559c08639270 2024-05-09T00:13:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb8d917700 1 --2- 172.21.15.81:0/4209941024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08633480 0x559c08643f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb8e118700 1 --2- 172.21.15.81:0/4209941024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c086420a0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7ffb80015f70 tx=0x7ffb800156a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9db5931781bbb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb717fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:04.239 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb717fa700 1 -- 172.21.15.81:0/4209941024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8002a480 con 0x559c08639270 2024-05-09T00:13:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb717fa700 1 -- 172.21.15.81:0/4209941024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8572+0+0 (secure 0 0 0) 0x7ffb80025070 con 0x559c08639270 2024-05-09T00:13:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/4209941024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffb840a2660 con 0x559c08639270 2024-05-09T00:13:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb717fa700 1 -- 172.21.15.81:0/4209941024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb8002a5e0 con 0x559c08639270 2024-05-09T00:13:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb9bd35b80 10 client.18363 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/4209941024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559c08408c70 con 0x559c08639270 2024-05-09T00:13:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb717fa700 1 -- 172.21.15.81:0/4209941024 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffb840a2660 con 0x559c08639270 2024-05-09T00:13:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb717fa700 1 -- 172.21.15.81:0/4209941024 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ffb8001f930 con 0x559c08639270 2024-05-09T00:13:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb9bd35b80 10 client.18363 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb9bd35b80 10 client.18363 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:04.240 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb9bd35b80 20 client.18363 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:04.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/4209941024 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559c086a3460 0x559c086a5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:04.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb9bd35b80 4 client.18363 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:13:04.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.234+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/4209941024 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559c0857be60 con 0x559c086a3460 2024-05-09T00:13:04.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.235+0000 7ffb8d917700 1 --2- 172.21.15.81:0/4209941024 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559c086a3460 0x559c086a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:04.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.235+0000 7ffb717fa700 10 client.18363 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:04.241 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.235+0000 7ffb8d917700 1 --2- 172.21.15.81:0/4209941024 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559c086a3460 0x559c086a5880 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68c0456f2b1d92c7 server_cookie=8806b46d40464594 in_seq=0 out_seq=0 2024-05-09T00:13:04.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.250+0000 7ffb717fa700 1 -- 172.21.15.81:0/4209941024 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559c0857be60 con 0x559c086a3460 2024-05-09T00:13:04.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.250+0000 7ffb717fa700 10 client.18363 handle_command_reply: tid=0 2024-05-09T00:13:04.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.250+0000 7ffb9bd35b80 1 client.18363 shutdown 2024-05-09T00:13:04.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/4209941024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 msgr2=0x559c086420a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:04.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/4209941024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c086420a0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7ffb80015f70 tx=0x7ffb800156a0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/4209941024 shutdown_connections 2024-05-09T00:13:04.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/4209941024 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x559c086a3460 0x559c086a5880 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/4209941024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x559c08633480 0x559c08643f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.250 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/4209941024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c08639270 0x559c086420a0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb9bd35b80 1 --2- 172.21.15.81:0/4209941024 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x559c08638950 0x559c08641b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb717fa700 0 client.18363 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:04.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/4209941024 >> 172.21.15.81:0/4209941024 conn(0x559c085911b0 msgr2=0x559c08631630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:04.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/4209941024 shutdown_connections 2024-05-09T00:13:04.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb9bd35b80 1 -- 172.21.15.81:0/4209941024 wait complete. 2024-05-09T00:13:04.251 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb9bd35b80 20 client.18363 trim_cache size 0 max 16384 2024-05-09T00:13:04.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:13:04.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:13:04.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:13:04.254 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:13:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb8fb7b700 1 -- 172.21.15.81:0/904119703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffb740a1290 msgr2=0x7ffb740a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb8fb7b700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffb740a1290 0x7ffb740a3750 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800b5c0 tx=0x7ffb7801a040 comp rx=0 tx=0).stop 2024-05-09T00:13:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb8fb7b700 1 -- 172.21.15.81:0/904119703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb881038f0 msgr2=0x7ffb881a3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb8fb7b700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb881038f0 0x7ffb881a3c30 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400d950 tx=0x7ffb8400dd10 comp rx=0 tx=0).stop 2024-05-09T00:13:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb8fb7b700 1 -- 172.21.15.81:0/904119703 shutdown_connections 2024-05-09T00:13:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.251+0000 7ffb8fb7b700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ffb740a1290 0x7ffb740a3750 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.252+0000 7ffb8fb7b700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ffb88105df0 0x7ffb8819d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.252+0000 7ffb8fb7b700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb880696d0 0x7ffb881a36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.255 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.252+0000 7ffb8fb7b700 1 --2- 172.21.15.81:0/904119703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb881038f0 0x7ffb881a3c30 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.252+0000 7ffb8fb7b700 1 -- 172.21.15.81:0/904119703 >> 172.21.15.81:0/904119703 conn(0x7ffb88076f40 msgr2=0x7ffb880fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.252+0000 7ffb8fb7b700 1 -- 172.21.15.81:0/904119703 shutdown_connections 2024-05-09T00:13:04.256 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:04.252+0000 7ffb8fb7b700 1 -- 172.21.15.81:0/904119703 wait complete. 2024-05-09T00:13:05.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:04 smithi150 ceph-mon[46187]: pgmap v312: 97 pgs: 97 active+clean; 2.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:13:05.305 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:04 smithi171 ceph-mon[47351]: pgmap v312: 97 pgs: 97 active+clean; 2.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:13:05.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:04 smithi081 ceph-mon[42474]: pgmap v312: 97 pgs: 97 active+clean; 2.7 MiB data, 435 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 13 op/s 2024-05-09T00:13:06.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:05 smithi150 ceph-mon[46187]: osdmap e90: 12 total, 12 up, 12 in 2024-05-09T00:13:06.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:05 smithi171 ceph-mon[47351]: osdmap e90: 12 total, 12 up, 12 in 2024-05-09T00:13:06.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:05 smithi081 ceph-mon[42474]: osdmap e90: 12 total, 12 up, 12 in 2024-05-09T00:13:07.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:06 smithi150 ceph-mon[46187]: pgmap v314: 97 pgs: 97 active+clean; 3.0 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:13:07.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:06 smithi171 ceph-mon[47351]: pgmap v314: 97 pgs: 97 active+clean; 3.0 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:13:07.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:06 smithi081 ceph-mon[42474]: pgmap v314: 97 pgs: 97 active+clean; 3.0 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:13:09.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:08 smithi150 ceph-mon[46187]: pgmap v315: 97 pgs: 97 active+clean; 3.0 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:13:09.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:08 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:13:09.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:08 smithi171 ceph-mon[47351]: pgmap v315: 97 pgs: 97 active+clean; 3.0 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:13:09.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:08 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:13:09.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:08 smithi081 ceph-mon[42474]: pgmap v315: 97 pgs: 97 active+clean; 3.0 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:13:09.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:08 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:13:11.018 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: pgmap v316: 97 pgs: 97 active+clean; 3.0 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:13:11.018 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.019 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.019 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.019 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.019 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.019 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.019 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.019 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.019 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.019 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.019 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.019 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.019 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.019 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.019 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.020 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.021 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:13:11.021 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:13:11.021 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: pgmap v316: 97 pgs: 97 active+clean; 3.0 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:13:11.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.058 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.058 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.058 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.058 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.058 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.058 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.058 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.058 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.058 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.058 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.058 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.058 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.058 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.059 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.059 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.059 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.059 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.059 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:13:11.059 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:13:11.059 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: pgmap v316: 97 pgs: 97 active+clean; 3.0 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:13:11.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.126 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.126 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.126 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-09T00:13:11.126 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:13:11.126 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:13:11.126 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:13:12.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:11 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi171 to 182.5M 2024-05-09T00:13:12.018 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:11 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi081 to 182.5M 2024-05-09T00:13:12.018 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:11 smithi150 ceph-mon[46187]: Unable to set osd_memory_target on smithi171 to 191374131: error parsing value: Value '191374131' is below minimum 939524096 2024-05-09T00:13:12.018 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:11 smithi150 ceph-mon[46187]: Unable to set osd_memory_target on smithi081 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2024-05-09T00:13:12.018 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:11 smithi150 ceph-mon[46187]: Adjusting osd_memory_target on smithi150 to 182.5M 2024-05-09T00:13:12.018 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:11 smithi150 ceph-mon[46187]: Unable to set osd_memory_target on smithi150 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-05-09T00:13:12.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:11 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi171 to 182.5M 2024-05-09T00:13:12.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:11 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi081 to 182.5M 2024-05-09T00:13:12.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:11 smithi171 ceph-mon[47351]: Unable to set osd_memory_target on smithi171 to 191374131: error parsing value: Value '191374131' is below minimum 939524096 2024-05-09T00:13:12.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:11 smithi171 ceph-mon[47351]: Unable to set osd_memory_target on smithi081 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2024-05-09T00:13:12.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:11 smithi171 ceph-mon[47351]: Adjusting osd_memory_target on smithi150 to 182.5M 2024-05-09T00:13:12.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:11 smithi171 ceph-mon[47351]: Unable to set osd_memory_target on smithi150 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-05-09T00:13:12.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:11 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi171 to 182.5M 2024-05-09T00:13:12.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:11 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi081 to 182.5M 2024-05-09T00:13:12.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:11 smithi081 ceph-mon[42474]: Unable to set osd_memory_target on smithi171 to 191374131: error parsing value: Value '191374131' is below minimum 939524096 2024-05-09T00:13:12.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:11 smithi081 ceph-mon[42474]: Unable to set osd_memory_target on smithi081 to 191371980: error parsing value: Value '191371980' is below minimum 939524096 2024-05-09T00:13:12.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:11 smithi081 ceph-mon[42474]: Adjusting osd_memory_target on smithi150 to 182.5M 2024-05-09T00:13:12.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:11 smithi081 ceph-mon[42474]: Unable to set osd_memory_target on smithi150 to 191374848: error parsing value: Value '191374848' is below minimum 939524096 2024-05-09T00:13:13.017 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:12 smithi150 ceph-mon[46187]: pgmap v317: 97 pgs: 97 active+clean; 3.2 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:13:13.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:12 smithi171 ceph-mon[47351]: pgmap v317: 97 pgs: 97 active+clean; 3.2 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:13:13.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:12 smithi081 ceph-mon[42474]: pgmap v317: 97 pgs: 97 active+clean; 3.2 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 107 KiB/s wr, 35 op/s 2024-05-09T00:13:14.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:13 smithi171 ceph-mon[47351]: osdmap e91: 12 total, 12 up, 12 in 2024-05-09T00:13:14.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:13 smithi081 ceph-mon[42474]: osdmap e91: 12 total, 12 up, 12 in 2024-05-09T00:13:14.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:13 smithi150 ceph-mon[46187]: osdmap e91: 12 total, 12 up, 12 in 2024-05-09T00:13:15.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:14 smithi171 ceph-mon[47351]: pgmap v319: 97 pgs: 97 active+clean; 3.2 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-09T00:13:15.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:14 smithi081 ceph-mon[42474]: pgmap v319: 97 pgs: 97 active+clean; 3.2 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-09T00:13:15.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:14 smithi150 ceph-mon[46187]: pgmap v319: 97 pgs: 97 active+clean; 3.2 MiB data, 436 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 26 KiB/s wr, 7 op/s 2024-05-09T00:13:17.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:16 smithi171 ceph-mon[47351]: pgmap v320: 97 pgs: 97 active+clean; 3.3 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-05-09T00:13:17.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:16 smithi081 ceph-mon[42474]: pgmap v320: 97 pgs: 97 active+clean; 3.3 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-05-09T00:13:17.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:16 smithi150 ceph-mon[46187]: pgmap v320: 97 pgs: 97 active+clean; 3.3 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-05-09T00:13:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.371+0000 7f6ce17c5700 1 -- 172.21.15.81:0/3516985017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cdc108450 msgr2=0x7f6cdc10ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.371+0000 7f6ce17c5700 1 --2- 172.21.15.81:0/3516985017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cdc108450 0x7f6cdc10ffd0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4009990 tx=0x7f6cd4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.371+0000 7f6ce17c5700 1 -- 172.21.15.81:0/3516985017 shutdown_connections 2024-05-09T00:13:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.371+0000 7f6ce17c5700 1 --2- 172.21.15.81:0/3516985017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cdc108450 0x7f6cdc10ffd0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.371+0000 7f6ce17c5700 1 --2- 172.21.15.81:0/3516985017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cdc103330 0x7f6cdc103710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.371+0000 7f6ce17c5700 1 --2- 172.21.15.81:0/3516985017 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cdc103ce0 0x7f6cdc107d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.371+0000 7f6ce17c5700 1 -- 172.21.15.81:0/3516985017 >> 172.21.15.81:0/3516985017 conn(0x7f6cdc0feb50 msgr2=0x7f6cdc100f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.371+0000 7f6ce17c5700 1 -- 172.21.15.81:0/3516985017 shutdown_connections 2024-05-09T00:13:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.371+0000 7f6ce17c5700 1 -- 172.21.15.81:0/3516985017 wait complete. 2024-05-09T00:13:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.372+0000 7f6ce17c5700 1 Processor -- start 2024-05-09T00:13:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.372+0000 7f6ce17c5700 1 -- start start 2024-05-09T00:13:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.372+0000 7f6ce17c5700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cdc103330 0x7f6cdc1995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.372+0000 7f6ce17c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cdc108450 0x7f6cdc199ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.372+0000 7f6ce17c5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cdc19de80 0x7f6cdc19e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.372+0000 7f6ce17c5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc19e900 con 0x7f6cdc108450 2024-05-09T00:13:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6ce17c5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc19ea70 con 0x7f6cdc19de80 2024-05-09T00:13:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6ce17c5700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cdc19ec30 con 0x7f6cdc103330 2024-05-09T00:13:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cda7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cdc108450 0x7f6cdc199ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cda7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cdc108450 0x7f6cdc199ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46276/0 (socket says 172.21.15.81:46276) 2024-05-09T00:13:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cda7fc700 1 -- 172.21.15.81:0/1414275710 learned_addr learned my addr 172.21.15.81:0/1414275710 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cdc103330 0x7f6cdc1995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cdb7fe700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cdc19de80 0x7f6cdc19e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cda7fc700 1 -- 172.21.15.81:0/1414275710 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cdc103330 msgr2=0x7f6cdc1995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cda7fc700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cdc103330 0x7f6cdc1995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cda7fc700 1 -- 172.21.15.81:0/1414275710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cdc19de80 msgr2=0x7f6cdc19e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cda7fc700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cdc19de80 0x7f6cdc19e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cda7fc700 1 -- 172.21.15.81:0/1414275710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd40095f0 con 0x7f6cdc108450 2024-05-09T00:13:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cdb7fe700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cdc19de80 0x7f6cdc19e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cda7fc700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cdc108450 0x7f6cdc199ae0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400b500 tx=0x7f6cc400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cd3fff700 1 -- 172.21.15.81:0/1414275710 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4011830 con 0x7f6cdc108450 2024-05-09T00:13:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cd3fff700 1 -- 172.21.15.81:0/1414275710 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6cc4011e50 con 0x7f6cdc108450 2024-05-09T00:13:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6ce17c5700 1 -- 172.21.15.81:0/1414275710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cdc1a6190 con 0x7f6cdc108450 2024-05-09T00:13:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6cd3fff700 1 -- 172.21.15.81:0/1414275710 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc400f2e0 con 0x7f6cdc108450 2024-05-09T00:13:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.373+0000 7f6ce17c5700 1 -- 172.21.15.81:0/1414275710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cdc1a6670 con 0x7f6cdc108450 2024-05-09T00:13:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.375+0000 7f6cd3fff700 1 -- 172.21.15.81:0/1414275710 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6cc40105a0 con 0x7f6cdc108450 2024-05-09T00:13:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.376+0000 7f6cd3fff700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6cc80a1290 0x7f6cc80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.376+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6cc80a1290 0x7f6cc80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.376+0000 7f6cd3fff700 1 -- 172.21.15.81:0/1414275710 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f6cc40cc660 con 0x7f6cdc108450 2024-05-09T00:13:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.376+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6cc80a1290 0x7f6cc80a3750 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009550 tx=0x7f6ccc0091b0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.377+0000 7f6ced97fb80 1 Processor -- start 2024-05-09T00:13:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.377+0000 7f6ced97fb80 1 -- start start 2024-05-09T00:13:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.377+0000 7f6ced97fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e81950 0x55ae18e81d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.377+0000 7f6ced97fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e82270 0x55ae18e7bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.377+0000 7f6ced97fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e7c480 0x55ae18e7c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.377+0000 7f6ced97fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae18dd30f0 con 0x55ae18e82270 2024-05-09T00:13:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.377+0000 7f6ced97fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae18dd0ab0 con 0x55ae18e81950 2024-05-09T00:13:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.377+0000 7f6ced97fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae18dcc3a0 con 0x55ae18e7c480 2024-05-09T00:13:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.378+0000 7f6cda7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e82270 0x55ae18e7bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.378+0000 7f6cda7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e82270 0x55ae18e7bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46280/0 (socket says 172.21.15.81:46280) 2024-05-09T00:13:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.378+0000 7f6cda7fc700 1 -- 172.21.15.81:0/3407841290 learned_addr learned my addr 172.21.15.81:0/3407841290 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.378+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/3407841290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e81950 0x55ae18e81d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.378+0000 7f6cda7fc700 1 -- 172.21.15.81:0/3407841290 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e7c480 msgr2=0x55ae18e7c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.378+0000 7f6cda7fc700 1 --2- 172.21.15.81:0/3407841290 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e7c480 0x55ae18e7c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.378+0000 7f6cda7fc700 1 -- 172.21.15.81:0/3407841290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e81950 msgr2=0x55ae18e81d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.378+0000 7f6cda7fc700 1 --2- 172.21.15.81:0/3407841290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e81950 0x55ae18e81d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.378+0000 7f6cda7fc700 1 -- 172.21.15.81:0/3407841290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae18c4d350 con 0x55ae18e82270 2024-05-09T00:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.378+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/3407841290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e81950 0x55ae18e81d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.378+0000 7f6cda7fc700 1 --2- 172.21.15.81:0/3407841290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e82270 0x55ae18e7bf40 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40997e0 tx=0x7f6cc4099460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cce01585e3e64ef server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.378+0000 7f6cd17fa700 1 -- 172.21.15.81:0/3407841290 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc409d680 con 0x55ae18e82270 2024-05-09T00:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.378+0000 7f6cd17fa700 1 -- 172.21.15.81:0/3407841290 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6cc40a1cd0 con 0x55ae18e82270 2024-05-09T00:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.378+0000 7f6cd17fa700 1 -- 172.21.15.81:0/3407841290 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4098f40 con 0x55ae18e82270 2024-05-09T00:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.379+0000 7f6ced97fb80 1 -- 172.21.15.81:0/3407841290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e82270 msgr2=0x55ae18e7bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.379+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/3407841290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e82270 0x55ae18e7bf40 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40997e0 tx=0x7f6cc4099460 comp rx=0 tx=0).stop 2024-05-09T00:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.379+0000 7f6ced97fb80 1 -- 172.21.15.81:0/3407841290 shutdown_connections 2024-05-09T00:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.379+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/3407841290 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e81950 0x55ae18e81d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.379+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/3407841290 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e7c480 0x55ae18e7c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.379+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/3407841290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e82270 0x55ae18e7bf40 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.379+0000 7f6ced97fb80 1 -- 172.21.15.81:0/3407841290 >> 172.21.15.81:0/3407841290 conn(0x55ae18dda1b0 msgr2=0x55ae18e76840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.379+0000 7f6ced97fb80 1 -- 172.21.15.81:0/3407841290 shutdown_connections 2024-05-09T00:13:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.379+0000 7f6ced97fb80 1 -- 172.21.15.81:0/3407841290 wait complete. 2024-05-09T00:13:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.379+0000 7f6ced97fb80 1 -- start start 2024-05-09T00:13:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.379+0000 7f6ced97fb80 1 Processor -- start 2024-05-09T00:13:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6ced97fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e7c480 0x55ae18e855f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6ced97fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e81950 0x55ae18e85b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6ced97fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 0x55ae18e86070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6ced97fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae18d68500 con 0x55ae18e81950 2024-05-09T00:13:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6ced97fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae18d681a0 con 0x55ae18e7c480 2024-05-09T00:13:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6ced97fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae18c4f640 con 0x55ae18e82270 2024-05-09T00:13:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6ced97fb80 10 client.0 _ll_register_callbacks cb 0x55ae18d71ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cda7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e81950 0x55ae18e85b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cda7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e81950 0x55ae18e85b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46286/0 (socket says 172.21.15.81:46286) 2024-05-09T00:13:17.384 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cda7fc700 1 -- 172.21.15.81:0/4043824153 learned_addr learned my addr 172.21.15.81:0/4043824153 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e7c480 0x55ae18e855f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cdb7fe700 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 0x55ae18e86070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cda7fc700 1 -- 172.21.15.81:0/4043824153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 msgr2=0x55ae18e86070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cda7fc700 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 0x55ae18e86070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cda7fc700 1 -- 172.21.15.81:0/4043824153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e7c480 msgr2=0x55ae18e855f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cda7fc700 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e7c480 0x55ae18e855f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cda7fc700 1 -- 172.21.15.81:0/4043824153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cdc1a6670 con 0x55ae18e81950 2024-05-09T00:13:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cdb7fe700 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 0x55ae18e86070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e7c480 0x55ae18e855f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cda7fc700 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e81950 0x55ae18e85b30 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40a17a0 tx=0x7f6cc4004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5a5405011cafb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cc27fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cc27fc700 1 -- 172.21.15.81:0/4043824153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4098f50 con 0x55ae18e81950 2024-05-09T00:13:17.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6cc27fc700 1 -- 172.21.15.81:0/4043824153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f6cc40b7e40 con 0x55ae18e81950 2024-05-09T00:13:17.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.380+0000 7f6ced97fb80 1 -- 172.21.15.81:0/4043824153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ae18d25210 con 0x55ae18e81950 2024-05-09T00:13:17.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.381+0000 7f6cc27fc700 1 -- 172.21.15.81:0/4043824153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cc4099ab0 con 0x55ae18e81950 2024-05-09T00:13:17.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.381+0000 7f6ced97fb80 10 client.18375 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:17.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.381+0000 7f6ced97fb80 1 -- 172.21.15.81:0/4043824153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ae18bf9b00 con 0x55ae18e81950 2024-05-09T00:13:17.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.381+0000 7f6cc27fc700 1 -- 172.21.15.81:0/4043824153 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ae18d25210 con 0x55ae18e81950 2024-05-09T00:13:17.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.381+0000 7f6cc27fc700 1 -- 172.21.15.81:0/4043824153 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6cc40b9140 con 0x55ae18e81950 2024-05-09T00:13:17.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.381+0000 7f6ced97fb80 10 client.18375 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:17.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.381+0000 7f6ced97fb80 10 client.18375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:17.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.381+0000 7f6ced97fb80 20 client.18375 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:17.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.381+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ae18e95990 0x55ae18e97db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.381+0000 7f6ced97fb80 4 client.18375 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:17.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.381+0000 7f6ced97fb80 1 -- 172.21.15.81:0/4043824153 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ae18e4b7b0 con 0x55ae18e95990 2024-05-09T00:13:17.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.381+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ae18e95990 0x55ae18e97db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ae18e95990 0x55ae18e97db0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af70e490fb9b0610 server_cookie=221e41f658809967 in_seq=0 out_seq=0 2024-05-09T00:13:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6cc27fc700 10 client.18375 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6cc27fc700 1 -- 172.21.15.81:0/4043824153 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ae18e4b7b0 con 0x55ae18e95990 2024-05-09T00:13:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6cc27fc700 10 client.18375 handle_command_reply: tid=0 2024-05-09T00:13:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6ced97fb80 1 client.18375 shutdown 2024-05-09T00:13:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6ced97fb80 1 -- 172.21.15.81:0/4043824153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e81950 msgr2=0x55ae18e85b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e81950 0x55ae18e85b30 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40a17a0 tx=0x7f6cc4004860 comp rx=0 tx=0).stop 2024-05-09T00:13:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6ced97fb80 1 -- 172.21.15.81:0/4043824153 shutdown_connections 2024-05-09T00:13:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ae18e95990 0x55ae18e97db0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e7c480 0x55ae18e855f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6cc27fc700 0 client.18375 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 0x55ae18e86070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/4043824153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e81950 0x55ae18e85b30 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6ced97fb80 1 -- 172.21.15.81:0/4043824153 >> 172.21.15.81:0/4043824153 conn(0x55ae18dda1b0 msgr2=0x55ae18e804a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:17.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.382+0000 7f6ced97fb80 1 -- 172.21.15.81:0/4043824153 shutdown_connections 2024-05-09T00:13:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.383+0000 7f6ced97fb80 1 -- 172.21.15.81:0/4043824153 wait complete. 2024-05-09T00:13:17.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.383+0000 7f6ced97fb80 20 client.18375 trim_cache size 0 max 16384 2024-05-09T00:13:17.396 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.397+0000 7f6ced97fb80 1 Processor -- start 2024-05-09T00:13:17.396 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.397+0000 7f6ced97fb80 1 -- start start 2024-05-09T00:13:17.396 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6ced97fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e7c480 0x55ae18e76910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.396 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6ced97fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e81950 0x55ae18e7c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.396 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6ced97fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 0x55ae18e780f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6ced97fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae18e886e0 con 0x55ae18e7c480 2024-05-09T00:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6ced97fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae18e98410 con 0x55ae18e81950 2024-05-09T00:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6ced97fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae18e83b40 con 0x55ae18e82270 2024-05-09T00:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6cdaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e7c480 0x55ae18e76910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6cdaffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e7c480 0x55ae18e76910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46298/0 (socket says 172.21.15.81:46298) 2024-05-09T00:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6cdaffd700 1 -- 172.21.15.81:0/1533250710 learned_addr learned my addr 172.21.15.81:0/1533250710 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6cdb7fe700 1 --2- 172.21.15.81:0/1533250710 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 0x55ae18e780f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6cda7fc700 1 --2- 172.21.15.81:0/1533250710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e81950 0x55ae18e7c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6cdaffd700 1 -- 172.21.15.81:0/1533250710 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 msgr2=0x55ae18e780f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/1533250710 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 0x55ae18e780f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6cdaffd700 1 -- 172.21.15.81:0/1533250710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e81950 msgr2=0x55ae18e7c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/1533250710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e81950 0x55ae18e7c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6cdaffd700 1 -- 172.21.15.81:0/1533250710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae18d92500 con 0x55ae18e7c480 2024-05-09T00:13:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6cda7fc700 1 --2- 172.21.15.81:0/1533250710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e81950 0x55ae18e7c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:17.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.398+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/1533250710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e7c480 0x55ae18e76910 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x55ae18e98680 tx=0x7f6ccc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886ed011a483710c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:17.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.399+0000 7f6cd1ffb700 1 -- 172.21.15.81:0/1533250710 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc027070 con 0x55ae18e7c480 2024-05-09T00:13:17.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.399+0000 7f6cd1ffb700 1 -- 172.21.15.81:0/1533250710 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ccc00f040 con 0x55ae18e7c480 2024-05-09T00:13:17.398 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.399+0000 7f6cd1ffb700 1 -- 172.21.15.81:0/1533250710 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc015440 con 0x55ae18e7c480 2024-05-09T00:13:17.401 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.399+0000 7f6ced97fb80 1 -- 172.21.15.81:0/1533250710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e7c480 msgr2=0x55ae18e76910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.401 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.399+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/1533250710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e7c480 0x55ae18e76910 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x55ae18e98680 tx=0x7f6ccc013000 comp rx=0 tx=0).stop 2024-05-09T00:13:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.399+0000 7f6ced97fb80 1 -- 172.21.15.81:0/1533250710 shutdown_connections 2024-05-09T00:13:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.399+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/1533250710 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 0x55ae18e780f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.399+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/1533250710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e7c480 0x55ae18e76910 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.399+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/1533250710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e81950 0x55ae18e7c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.399+0000 7f6ced97fb80 1 -- 172.21.15.81:0/1533250710 >> 172.21.15.81:0/1533250710 conn(0x55ae18dda1b0 msgr2=0x55ae18e9c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.399+0000 7f6ced97fb80 1 -- 172.21.15.81:0/1533250710 shutdown_connections 2024-05-09T00:13:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.399+0000 7f6ced97fb80 1 -- 172.21.15.81:0/1533250710 wait complete. 2024-05-09T00:13:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6ced97fb80 1 -- start start 2024-05-09T00:13:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6ced97fb80 1 Processor -- start 2024-05-09T00:13:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6ced97fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e7c480 0x55ae18e8d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6ced97fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e81950 0x55ae18e8abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6ced97fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 0x55ae18e8b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6ced97fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae18e8b9f0 con 0x55ae18e81950 2024-05-09T00:13:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6ced97fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae18eeae50 con 0x55ae18e7c480 2024-05-09T00:13:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6ced97fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae18eeaf90 con 0x55ae18e82270 2024-05-09T00:13:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6ced97fb80 10 client.0 _ll_register_callbacks cb 0x55ae18d71ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6cda7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e81950 0x55ae18e8abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6cda7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e81950 0x55ae18e8abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46306/0 (socket says 172.21.15.81:46306) 2024-05-09T00:13:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6cda7fc700 1 -- 172.21.15.81:0/481257130 learned_addr learned my addr 172.21.15.81:0/481257130 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/481257130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e7c480 0x55ae18e8d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6cdb7fe700 1 --2- 172.21.15.81:0/481257130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 0x55ae18e8b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6cda7fc700 1 -- 172.21.15.81:0/481257130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 msgr2=0x55ae18e8b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6cda7fc700 1 --2- 172.21.15.81:0/481257130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 0x55ae18e8b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6cda7fc700 1 -- 172.21.15.81:0/481257130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e7c480 msgr2=0x55ae18e8d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6cda7fc700 1 --2- 172.21.15.81:0/481257130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e7c480 0x55ae18e8d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6cda7fc700 1 -- 172.21.15.81:0/481257130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ccc0046d0 con 0x55ae18e81950 2024-05-09T00:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.400+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/481257130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e7c480 0x55ae18e8d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6cda7fc700 1 --2- 172.21.15.81:0/481257130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e81950 0x55ae18e8abc0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400bc10 tx=0x7f6cc40992e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d041a441ccaa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6cc27fc700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6cc27fc700 1 -- 172.21.15.81:0/481257130 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc409d3b0 con 0x55ae18e81950 2024-05-09T00:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6cc27fc700 1 -- 172.21.15.81:0/481257130 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f6cc40b7e40 con 0x55ae18e81950 2024-05-09T00:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6ced97fb80 1 -- 172.21.15.81:0/481257130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6cc40a1cd0 con 0x55ae18e81950 2024-05-09T00:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6cc27fc700 1 -- 172.21.15.81:0/481257130 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6cc4095850 con 0x55ae18e81950 2024-05-09T00:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6ced97fb80 10 client.18381 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6ced97fb80 1 -- 172.21.15.81:0/481257130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ae18c51c70 con 0x55ae18e81950 2024-05-09T00:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6cc27fc700 1 -- 172.21.15.81:0/481257130 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6cc40a1cd0 con 0x55ae18e81950 2024-05-09T00:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6cc27fc700 1 -- 172.21.15.81:0/481257130 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6cc40a1920 con 0x55ae18e81950 2024-05-09T00:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6ced97fb80 10 client.18381 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6ced97fb80 10 client.18381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:17.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6ced97fb80 20 client.18381 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:17.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/481257130 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ae18eec140 0x55ae18eee530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:17.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6ced97fb80 4 client.18381 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:13:17.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.401+0000 7f6ced97fb80 1 -- 172.21.15.81:0/481257130 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ae18dc4e60 con 0x55ae18eec140 2024-05-09T00:13:17.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.402+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/481257130 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ae18eec140 0x55ae18eee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:17.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.402+0000 7f6cc27fc700 10 client.18381 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:17.405 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.402+0000 7f6cdaffd700 1 --2- 172.21.15.81:0/481257130 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ae18eec140 0x55ae18eee530 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fd66082675d1cb8 server_cookie=6150852a556ca834 in_seq=0 out_seq=0 2024-05-09T00:13:17.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6cc27fc700 1 -- 172.21.15.81:0/481257130 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ae18dc4e60 con 0x55ae18eec140 2024-05-09T00:13:17.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6cc27fc700 10 client.18381 handle_command_reply: tid=0 2024-05-09T00:13:17.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6ced97fb80 1 client.18381 shutdown 2024-05-09T00:13:17.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6ced97fb80 1 -- 172.21.15.81:0/481257130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e81950 msgr2=0x55ae18e8abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/481257130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e81950 0x55ae18e8abc0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400bc10 tx=0x7f6cc40992e0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6ced97fb80 1 -- 172.21.15.81:0/481257130 shutdown_connections 2024-05-09T00:13:17.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/481257130 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ae18eec140 0x55ae18eee530 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.414 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/481257130 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ae18e7c480 0x55ae18e8d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.415 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/481257130 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ae18e82270 0x55ae18e8b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.415 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6ced97fb80 1 --2- 172.21.15.81:0/481257130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ae18e81950 0x55ae18e8abc0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.415 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6cc27fc700 0 client.18381 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:17.415 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6ced97fb80 1 -- 172.21.15.81:0/481257130 >> 172.21.15.81:0/481257130 conn(0x55ae18dda1b0 msgr2=0x55ae18e780f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:17.415 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6ced97fb80 1 -- 172.21.15.81:0/481257130 shutdown_connections 2024-05-09T00:13:17.415 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6ced97fb80 1 -- 172.21.15.81:0/481257130 wait complete. 2024-05-09T00:13:17.415 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.416+0000 7f6ced97fb80 20 client.18381 trim_cache size 0 max 16384 2024-05-09T00:13:17.415 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:13:17.415 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:13:17.415 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:13:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:13:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.417+0000 7f6ce17c5700 1 -- 172.21.15.81:0/1414275710 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6cc80a1290 msgr2=0x7f6cc80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.417+0000 7f6ce17c5700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6cc80a1290 0x7f6cc80a3750 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc009550 tx=0x7f6ccc0091b0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.416 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.417+0000 7f6ce17c5700 1 -- 172.21.15.81:0/1414275710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cdc108450 msgr2=0x7f6cdc199ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.417+0000 7f6ce17c5700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cdc108450 0x7f6cdc199ae0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400b500 tx=0x7f6cc400b810 comp rx=0 tx=0).stop 2024-05-09T00:13:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.417+0000 7f6ce17c5700 1 -- 172.21.15.81:0/1414275710 shutdown_connections 2024-05-09T00:13:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.417+0000 7f6ce17c5700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6cc80a1290 0x7f6cc80a3750 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.417+0000 7f6ce17c5700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6cdc19de80 0x7f6cdc19e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.417+0000 7f6ce17c5700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6cdc103330 0x7f6cdc1995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.417+0000 7f6ce17c5700 1 --2- 172.21.15.81:0/1414275710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6cdc108450 0x7f6cdc199ae0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.417+0000 7f6ce17c5700 1 -- 172.21.15.81:0/1414275710 >> 172.21.15.81:0/1414275710 conn(0x7f6cdc0feb50 msgr2=0x7f6cdc100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.417+0000 7f6ce17c5700 1 -- 172.21.15.81:0/1414275710 shutdown_connections 2024-05-09T00:13:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:17.417+0000 7f6ce17c5700 1 -- 172.21.15.81:0/1414275710 wait complete. 2024-05-09T00:13:19.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:18 smithi171 ceph-mon[47351]: pgmap v321: 97 pgs: 97 active+clean; 3.3 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-05-09T00:13:19.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:18 smithi081 ceph-mon[42474]: pgmap v321: 97 pgs: 97 active+clean; 3.3 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-05-09T00:13:19.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:18 smithi150 ceph-mon[46187]: pgmap v321: 97 pgs: 97 active+clean; 3.3 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-05-09T00:13:21.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:20 smithi171 ceph-mon[47351]: pgmap v322: 97 pgs: 97 active+clean; 3.3 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-05-09T00:13:21.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:20 smithi081 ceph-mon[42474]: pgmap v322: 97 pgs: 97 active+clean; 3.3 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-05-09T00:13:21.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:20 smithi150 ceph-mon[46187]: pgmap v322: 97 pgs: 97 active+clean; 3.3 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 41 KiB/s wr, 11 op/s 2024-05-09T00:13:23.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:22 smithi171 ceph-mon[47351]: pgmap v323: 97 pgs: 97 active+clean; 3.6 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 49 KiB/s wr, 14 op/s 2024-05-09T00:13:23.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:22 smithi081 ceph-mon[42474]: pgmap v323: 97 pgs: 97 active+clean; 3.6 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 49 KiB/s wr, 14 op/s 2024-05-09T00:13:23.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:13:23.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:22 smithi150 ceph-mon[46187]: pgmap v323: 97 pgs: 97 active+clean; 3.6 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 49 KiB/s wr, 14 op/s 2024-05-09T00:13:23.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.292+0000 7f45fc57d700 1 -- 172.21.15.81:0/1977496788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f4100a10 msgr2=0x7f45f4104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.292+0000 7f45fc57d700 1 --2- 172.21.15.81:0/1977496788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f4100a10 0x7f45f4104a40 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009990 tx=0x7f45f0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.292+0000 7f45fc57d700 1 -- 172.21.15.81:0/1977496788 shutdown_connections 2024-05-09T00:13:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.292+0000 7f45fc57d700 1 --2- 172.21.15.81:0/1977496788 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45f4100060 0x7f45f4100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.292+0000 7f45fc57d700 1 --2- 172.21.15.81:0/1977496788 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45f4105170 0x7f45f410ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.292+0000 7f45fc57d700 1 --2- 172.21.15.81:0/1977496788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f4100a10 0x7f45f4104a40 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.292+0000 7f45fc57d700 1 -- 172.21.15.81:0/1977496788 >> 172.21.15.81:0/1977496788 conn(0x7f45f4076f30 msgr2=0x7f45f4077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.292+0000 7f45fc57d700 1 -- 172.21.15.81:0/1977496788 shutdown_connections 2024-05-09T00:13:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.292+0000 7f45fc57d700 1 -- 172.21.15.81:0/1977496788 wait complete. 2024-05-09T00:13:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.293+0000 7f45fc57d700 1 Processor -- start 2024-05-09T00:13:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.293+0000 7f45fc57d700 1 -- start start 2024-05-09T00:13:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.293+0000 7f45fc57d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45f4100060 0x7f45f4199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.293+0000 7f45fc57d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f4105170 0x7f45f4199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.293+0000 7f45fc57d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45f419def0 0x7f45f419e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.293+0000 7f45fc57d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f419e970 con 0x7f45f4105170 2024-05-09T00:13:23.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.293+0000 7f45fc57d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f419eae0 con 0x7f45f419def0 2024-05-09T00:13:23.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.293+0000 7f45fc57d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f419eca0 con 0x7f45f4100060 2024-05-09T00:13:23.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.293+0000 7f45f9b18700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f4105170 0x7f45f4199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.293+0000 7f45f9b18700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f4105170 0x7f45f4199b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46330/0 (socket says 172.21.15.81:46330) 2024-05-09T00:13:23.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.293+0000 7f45f9b18700 1 -- 172.21.15.81:0/1843306997 learned_addr learned my addr 172.21.15.81:0/1843306997 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:23.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.293+0000 7f45fa319700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45f4100060 0x7f45f4199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.294+0000 7f45fab1a700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45f419def0 0x7f45f419e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.294+0000 7f45f9b18700 1 -- 172.21.15.81:0/1843306997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45f4100060 msgr2=0x7f45f4199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.294+0000 7f45f9b18700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45f4100060 0x7f45f4199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.294+0000 7f45f9b18700 1 -- 172.21.15.81:0/1843306997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45f419def0 msgr2=0x7f45f419e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.294+0000 7f45f9b18700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45f419def0 0x7f45f419e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.294+0000 7f45f9b18700 1 -- 172.21.15.81:0/1843306997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f00095f0 con 0x7f45f4105170 2024-05-09T00:13:23.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.294+0000 7f45fab1a700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45f419def0 0x7f45f419e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:23.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.294+0000 7f45f9b18700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f4105170 0x7f45f4199b50 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f45f00059d0 tx=0x7f45f0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.294+0000 7f45eb7fe700 1 -- 172.21.15.81:0/1843306997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f001d070 con 0x7f45f4105170 2024-05-09T00:13:23.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.294+0000 7f45eb7fe700 1 -- 172.21.15.81:0/1843306997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45f000fb30 con 0x7f45f4105170 2024-05-09T00:13:23.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.294+0000 7f45fc57d700 1 -- 172.21.15.81:0/1843306997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f41a61a0 con 0x7f45f4105170 2024-05-09T00:13:23.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.294+0000 7f45eb7fe700 1 -- 172.21.15.81:0/1843306997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f0022bf0 con 0x7f45f4105170 2024-05-09T00:13:23.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.294+0000 7f45fc57d700 1 -- 172.21.15.81:0/1843306997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f41a65c0 con 0x7f45f4105170 2024-05-09T00:13:23.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.296+0000 7f45eb7fe700 1 -- 172.21.15.81:0/1843306997 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f45f000fca0 con 0x7f45f4105170 2024-05-09T00:13:23.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.297+0000 7f45eb7fe700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f45e00a1290 0x7f45e00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.297+0000 7f45fa319700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f45e00a1290 0x7f45e00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.297+0000 7f45eb7fe700 1 -- 172.21.15.81:0/1843306997 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f45f00ce160 con 0x7f45f4105170 2024-05-09T00:13:23.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.297+0000 7f45fa319700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f45e00a1290 0x7f45e00a3750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f45e4005950 tx=0x7f45e400b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.298+0000 7f4608737b80 1 Processor -- start 2024-05-09T00:13:23.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.298+0000 7f4608737b80 1 -- start start 2024-05-09T00:13:23.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.298+0000 7f4608737b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a47843c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.298+0000 7f4608737b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a47843c720 0x55a478436350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.298+0000 7f4608737b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a478436890 0x55a478436cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.298+0000 7f4608737b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47838d150 con 0x55a47843be00 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.298+0000 7f4608737b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47838ab10 con 0x55a478436890 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.298+0000 7f4608737b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a478386400 con 0x55a47843c720 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.299+0000 7f45fa319700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a47843c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.299+0000 7f45fa319700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a47843c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46346/0 (socket says 172.21.15.81:46346) 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.299+0000 7f45fa319700 1 -- 172.21.15.81:0/445255169 learned_addr learned my addr 172.21.15.81:0/445255169 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.299+0000 7f45f9b18700 1 --2- 172.21.15.81:0/445255169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a47843c720 0x55a478436350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.299+0000 7f45fa319700 1 -- 172.21.15.81:0/445255169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a47843c720 msgr2=0x55a478436350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.299+0000 7f45fa319700 1 --2- 172.21.15.81:0/445255169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a47843c720 0x55a478436350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.299+0000 7f45fa319700 1 -- 172.21.15.81:0/445255169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a478436890 msgr2=0x55a478436cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.299+0000 7f45fa319700 1 --2- 172.21.15.81:0/445255169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a478436890 0x55a478436cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.299+0000 7f45fa319700 1 -- 172.21.15.81:0/445255169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4782073b0 con 0x55a47843be00 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.299+0000 7f45f9b18700 1 --2- 172.21.15.81:0/445255169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a47843c720 0x55a478436350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.299+0000 7f45fa319700 1 --2- 172.21.15.81:0/445255169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a47843c1e0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f45e4010fa0 tx=0x7f45e4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565c51db34945b22 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.299+0000 7f45e8ff9700 1 -- 172.21.15.81:0/445255169 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e401e620 con 0x55a47843be00 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.299+0000 7f45e8ff9700 1 -- 172.21.15.81:0/445255169 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45e4015070 con 0x55a47843be00 2024-05-09T00:13:23.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.299+0000 7f45e8ff9700 1 -- 172.21.15.81:0/445255169 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e401ca20 con 0x55a47843be00 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.300+0000 7f4608737b80 1 -- 172.21.15.81:0/445255169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 msgr2=0x55a47843c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.300+0000 7f4608737b80 1 --2- 172.21.15.81:0/445255169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a47843c1e0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f45e4010fa0 tx=0x7f45e4013000 comp rx=0 tx=0).stop 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.300+0000 7f4608737b80 1 -- 172.21.15.81:0/445255169 shutdown_connections 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.300+0000 7f4608737b80 1 --2- 172.21.15.81:0/445255169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a478436890 0x55a478436cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.300+0000 7f4608737b80 1 --2- 172.21.15.81:0/445255169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a47843c1e0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.300+0000 7f4608737b80 1 --2- 172.21.15.81:0/445255169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a47843c720 0x55a478436350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.300+0000 7f4608737b80 1 -- 172.21.15.81:0/445255169 >> 172.21.15.81:0/445255169 conn(0x55a478394210 msgr2=0x55a478430df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.300+0000 7f4608737b80 1 -- 172.21.15.81:0/445255169 shutdown_connections 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.300+0000 7f4608737b80 1 -- 172.21.15.81:0/445255169 wait complete. 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.300+0000 7f4608737b80 1 -- start start 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.300+0000 7f4608737b80 1 Processor -- start 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f4608737b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a478436890 0x55a47843fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f4608737b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a478440010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f4608737b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a47843c720 0x55a478440550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f4608737b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a478322560 con 0x55a47843be00 2024-05-09T00:13:23.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f4608737b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a478322200 con 0x55a47843c720 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f4608737b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4782096a0 con 0x55a478436890 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f4608737b80 10 client.0 _ll_register_callbacks cb 0x55a47832bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45f9b18700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a478440010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45f9b18700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a478440010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46362/0 (socket says 172.21.15.81:46362) 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45f9b18700 1 -- 172.21.15.81:0/3550267988 learned_addr learned my addr 172.21.15.81:0/3550267988 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45fa319700 1 --2- 172.21.15.81:0/3550267988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a478436890 0x55a47843fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45fab1a700 1 --2- 172.21.15.81:0/3550267988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a47843c720 0x55a478440550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45f9b18700 1 -- 172.21.15.81:0/3550267988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a478436890 msgr2=0x55a47843fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45f9b18700 1 --2- 172.21.15.81:0/3550267988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a478436890 0x55a47843fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45f9b18700 1 -- 172.21.15.81:0/3550267988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a47843c720 msgr2=0x55a478440550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45f9b18700 1 --2- 172.21.15.81:0/3550267988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a47843c720 0x55a478440550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45f9b18700 1 -- 172.21.15.81:0/3550267988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e4010c50 con 0x55a47843be00 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45fab1a700 1 --2- 172.21.15.81:0/3550267988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a47843c720 0x55a478440550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45f9b18700 1 --2- 172.21.15.81:0/3550267988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a478440010 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f45f0097770 tx=0x7f45f009b270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bba1cb6e083c31 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45ddffb700 1 -- 172.21.15.81:0/3550267988 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f009a960 con 0x55a47843be00 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f45ddffb700 1 -- 172.21.15.81:0/3550267988 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f45f00a3660 con 0x55a47843be00 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.301+0000 7f4608737b80 1 -- 172.21.15.81:0/3550267988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4782df270 con 0x55a47843be00 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.302+0000 7f45ddffb700 1 -- 172.21.15.81:0/3550267988 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45f00a31d0 con 0x55a47843be00 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.302+0000 7f4608737b80 10 client.18393 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.302+0000 7f4608737b80 1 -- 172.21.15.81:0/3550267988 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a4781b3b60 con 0x55a47843be00 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.302+0000 7f45ddffb700 1 -- 172.21.15.81:0/3550267988 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a4782df270 con 0x55a47843be00 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.302+0000 7f45ddffb700 1 -- 172.21.15.81:0/3550267988 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f45f0097060 con 0x55a47843be00 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.302+0000 7f4608737b80 10 client.18393 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.302+0000 7f4608737b80 10 client.18393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.302+0000 7f4608737b80 20 client.18393 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.302+0000 7f4608737b80 1 --2- 172.21.15.81:0/3550267988 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a47844fd70 0x55a478452190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.302+0000 7f4608737b80 4 client.18393 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.302+0000 7f4608737b80 1 -- 172.21.15.81:0/3550267988 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a478405810 con 0x55a47844fd70 2024-05-09T00:13:23.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.302+0000 7f45fa319700 1 --2- 172.21.15.81:0/3550267988 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a47844fd70 0x55a478452190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.303+0000 7f45ddffb700 10 client.18393 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.303+0000 7f45fa319700 1 --2- 172.21.15.81:0/3550267988 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a47844fd70 0x55a478452190 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df065e40ba16fdb server_cookie=3125121c2cfdcfc in_seq=0 out_seq=0 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.303+0000 7f45ddffb700 1 -- 172.21.15.81:0/3550267988 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a478405810 con 0x55a47844fd70 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.303+0000 7f45ddffb700 10 client.18393 handle_command_reply: tid=0 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.303+0000 7f4608737b80 1 client.18393 shutdown 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.303+0000 7f4608737b80 1 -- 172.21.15.81:0/3550267988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 msgr2=0x55a478440010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.303+0000 7f4608737b80 1 --2- 172.21.15.81:0/3550267988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a478440010 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f45f0097770 tx=0x7f45f009b270 comp rx=0 tx=0).stop 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.303+0000 7f4608737b80 1 -- 172.21.15.81:0/3550267988 shutdown_connections 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.303+0000 7f4608737b80 1 --2- 172.21.15.81:0/3550267988 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a47844fd70 0x55a478452190 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.303+0000 7f4608737b80 1 --2- 172.21.15.81:0/3550267988 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a47843c720 0x55a478440550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.303+0000 7f4608737b80 1 --2- 172.21.15.81:0/3550267988 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a478436890 0x55a47843fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.303+0000 7f45ddffb700 0 client.18393 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.303+0000 7f4608737b80 1 --2- 172.21.15.81:0/3550267988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a478440010 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.304+0000 7f4608737b80 1 -- 172.21.15.81:0/3550267988 >> 172.21.15.81:0/3550267988 conn(0x55a478394210 msgr2=0x55a4784305a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.304+0000 7f4608737b80 1 -- 172.21.15.81:0/3550267988 shutdown_connections 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.304+0000 7f4608737b80 1 -- 172.21.15.81:0/3550267988 wait complete. 2024-05-09T00:13:23.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.304+0000 7f4608737b80 20 client.18393 trim_cache size 0 max 16384 2024-05-09T00:13:23.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f4608737b80 1 Processor -- start 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f4608737b80 1 -- start start 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f4608737b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a478436890 0x55a47843b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f4608737b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a478430d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f4608737b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a47843c720 0x55a478447160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f4608737b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a478432640 con 0x55a47843be00 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f4608737b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47842ddc0 con 0x55a47843c720 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f4608737b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4784573a0 con 0x55a478436890 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f45f9b18700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a478430d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f45f9b18700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a478430d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46372/0 (socket says 172.21.15.81:46372) 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f45f9b18700 1 -- 172.21.15.81:0/897262535 learned_addr learned my addr 172.21.15.81:0/897262535 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f45fab1a700 1 --2- 172.21.15.81:0/897262535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a47843c720 0x55a478447160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f45fa319700 1 --2- 172.21.15.81:0/897262535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a478436890 0x55a47843b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f45f9b18700 1 -- 172.21.15.81:0/897262535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a478436890 msgr2=0x55a47843b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f45f9b18700 1 --2- 172.21.15.81:0/897262535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a478436890 0x55a47843b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f45f9b18700 1 -- 172.21.15.81:0/897262535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a47843c720 msgr2=0x55a478447160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f45f9b18700 1 --2- 172.21.15.81:0/897262535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a47843c720 0x55a478447160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f45f9b18700 1 -- 172.21.15.81:0/897262535 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a47834c560 con 0x55a47843be00 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f45fab1a700 1 --2- 172.21.15.81:0/897262535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a47843c720 0x55a478447160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.321+0000 7f45f9b18700 1 --2- 172.21.15.81:0/897262535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a478430d20 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f45f009b430 tx=0x7f45f0099820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49402b9282d9e195 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.322+0000 7f45e97fa700 1 -- 172.21.15.81:0/897262535 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f00a3660 con 0x55a47843be00 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.322+0000 7f45e97fa700 1 -- 172.21.15.81:0/897262535 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45f0097060 con 0x55a47843be00 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.322+0000 7f45e97fa700 1 -- 172.21.15.81:0/897262535 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f009a960 con 0x55a47843be00 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.322+0000 7f4608737b80 1 -- 172.21.15.81:0/897262535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 msgr2=0x55a478430d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.322+0000 7f4608737b80 1 --2- 172.21.15.81:0/897262535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a478430d20 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f45f009b430 tx=0x7f45f0099820 comp rx=0 tx=0).stop 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.322+0000 7f4608737b80 1 -- 172.21.15.81:0/897262535 shutdown_connections 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.322+0000 7f4608737b80 1 --2- 172.21.15.81:0/897262535 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a47843c720 0x55a478447160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.322+0000 7f4608737b80 1 --2- 172.21.15.81:0/897262535 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a478436890 0x55a47843b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.322+0000 7f4608737b80 1 --2- 172.21.15.81:0/897262535 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843be00 0x55a478430d20 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.322+0000 7f4608737b80 1 -- 172.21.15.81:0/897262535 >> 172.21.15.81:0/897262535 conn(0x55a478394210 msgr2=0x55a47843ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.322+0000 7f4608737b80 1 -- 172.21.15.81:0/897262535 shutdown_connections 2024-05-09T00:13:23.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.322+0000 7f4608737b80 1 -- 172.21.15.81:0/897262535 wait complete. 2024-05-09T00:13:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.322+0000 7f4608737b80 1 -- start start 2024-05-09T00:13:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f4608737b80 1 Processor -- start 2024-05-09T00:13:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f4608737b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a478436890 0x55a478443140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f4608737b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a47843be00 0x55a478443680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f4608737b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843c720 0x55a478443bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f4608737b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4784a53c0 con 0x55a47843c720 2024-05-09T00:13:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f4608737b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4784a5530 con 0x55a478436890 2024-05-09T00:13:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f4608737b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4784a56f0 con 0x55a47843be00 2024-05-09T00:13:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f4608737b80 10 client.0 _ll_register_callbacks cb 0x55a47832bb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f45fab1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843c720 0x55a478443bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f45fab1a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843c720 0x55a478443bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46386/0 (socket says 172.21.15.81:46386) 2024-05-09T00:13:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f45fab1a700 1 -- 172.21.15.81:0/3021698661 learned_addr learned my addr 172.21.15.81:0/3021698661 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f45fa319700 1 --2- 172.21.15.81:0/3021698661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a478436890 0x55a478443140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f45f9b18700 1 --2- 172.21.15.81:0/3021698661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a47843be00 0x55a478443680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f45fab1a700 1 -- 172.21.15.81:0/3021698661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a47843be00 msgr2=0x55a478443680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f45fab1a700 1 --2- 172.21.15.81:0/3021698661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a47843be00 0x55a478443680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f45fab1a700 1 -- 172.21.15.81:0/3021698661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a478436890 msgr2=0x55a478443140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f45fab1a700 1 --2- 172.21.15.81:0/3021698661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a478436890 0x55a478443140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f45fab1a700 1 -- 172.21.15.81:0/3021698661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a4781b3b60 con 0x55a47843c720 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f45fab1a700 1 --2- 172.21.15.81:0/3021698661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843c720 0x55a478443bc0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f45ec007810 tx=0x7f45ec007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2806aa717b2605aa server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.323+0000 7f45ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f45ddffb700 1 -- 172.21.15.81:0/3021698661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ec017870 con 0x55a47843c720 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f45ddffb700 1 -- 172.21.15.81:0/3021698661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f45ec0179d0 con 0x55a47843c720 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f4608737b80 1 -- 172.21.15.81:0/3021698661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45e4015070 con 0x55a47843c720 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f45ddffb700 1 -- 172.21.15.81:0/3021698661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45ec017b90 con 0x55a47843c720 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f4608737b80 10 client.18399 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f4608737b80 1 -- 172.21.15.81:0/3021698661 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a47820bcd0 con 0x55a47843c720 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f45ddffb700 1 -- 172.21.15.81:0/3021698661 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45e4015070 con 0x55a47843c720 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f45ddffb700 1 -- 172.21.15.81:0/3021698661 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f45ec0163c0 con 0x55a47843c720 2024-05-09T00:13:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f4608737b80 10 client.18399 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f4608737b80 10 client.18399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f4608737b80 20 client.18399 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f4608737b80 1 --2- 172.21.15.81:0/3021698661 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a47844fd70 0x55a4784a8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f4608737b80 4 client.18399 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f4608737b80 1 -- 172.21.15.81:0/3021698661 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a47837eec0 con 0x55a47844fd70 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.324+0000 7f45fa319700 1 --2- 172.21.15.81:0/3021698661 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a47844fd70 0x55a4784a8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f45ddffb700 10 client.18399 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f45fa319700 1 --2- 172.21.15.81:0/3021698661 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a47844fd70 0x55a4784a8fc0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fefc84de6d001b81 server_cookie=f8716dc0dbf74dc4 in_seq=0 out_seq=0 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f45ddffb700 1 -- 172.21.15.81:0/3021698661 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a47837eec0 con 0x55a47844fd70 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f45ddffb700 10 client.18399 handle_command_reply: tid=0 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f4608737b80 1 client.18399 shutdown 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f4608737b80 1 -- 172.21.15.81:0/3021698661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843c720 msgr2=0x55a478443bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f4608737b80 1 --2- 172.21.15.81:0/3021698661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843c720 0x55a478443bc0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f45ec007810 tx=0x7f45ec007b20 comp rx=0 tx=0).stop 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f4608737b80 1 -- 172.21.15.81:0/3021698661 shutdown_connections 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f4608737b80 1 --2- 172.21.15.81:0/3021698661 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a47844fd70 0x55a4784a8fc0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f4608737b80 1 --2- 172.21.15.81:0/3021698661 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a478436890 0x55a478443140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f4608737b80 1 --2- 172.21.15.81:0/3021698661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a47843c720 0x55a478443bc0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f45ddffb700 0 client.18399 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:23.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f4608737b80 1 --2- 172.21.15.81:0/3021698661 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a47843be00 0x55a478443680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f4608737b80 1 -- 172.21.15.81:0/3021698661 >> 172.21.15.81:0/3021698661 conn(0x55a478394210 msgr2=0x55a47843cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f4608737b80 1 -- 172.21.15.81:0/3021698661 shutdown_connections 2024-05-09T00:13:23.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f4608737b80 1 -- 172.21.15.81:0/3021698661 wait complete. 2024-05-09T00:13:23.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.325+0000 7f4608737b80 20 client.18399 trim_cache size 0 max 16384 2024-05-09T00:13:23.329 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:13:23.329 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:13:23.329 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:13:23.329 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:13:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.326+0000 7f45fc57d700 1 -- 172.21.15.81:0/1843306997 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f45e00a1290 msgr2=0x7f45e00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.326+0000 7f45fc57d700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f45e00a1290 0x7f45e00a3750 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f45e4005950 tx=0x7f45e400b410 comp rx=0 tx=0).stop 2024-05-09T00:13:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.326+0000 7f45fc57d700 1 -- 172.21.15.81:0/1843306997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f4105170 msgr2=0x7f45f4199b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.326+0000 7f45fc57d700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f4105170 0x7f45f4199b50 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f45f00059d0 tx=0x7f45f0009580 comp rx=0 tx=0).stop 2024-05-09T00:13:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.326+0000 7f45fc57d700 1 -- 172.21.15.81:0/1843306997 shutdown_connections 2024-05-09T00:13:23.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.326+0000 7f45fc57d700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f45e00a1290 0x7f45e00a3750 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.326+0000 7f45fc57d700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f45f419def0 0x7f45f419e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.326+0000 7f45fc57d700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f45f4100060 0x7f45f4199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.326+0000 7f45fc57d700 1 --2- 172.21.15.81:0/1843306997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45f4105170 0x7f45f4199b50 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.326+0000 7f45fc57d700 1 -- 172.21.15.81:0/1843306997 >> 172.21.15.81:0/1843306997 conn(0x7f45f4076f30 msgr2=0x7f45f40ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.326+0000 7f45fc57d700 1 -- 172.21.15.81:0/1843306997 shutdown_connections 2024-05-09T00:13:23.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.326+0000 7f45fc57d700 1 -- 172.21.15.81:0/1843306997 wait complete. 2024-05-09T00:13:23.335 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:13:23.335 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:23.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.459+0000 7ff247228700 1 -- 172.21.15.81:0/3687095422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2400fff40 msgr2=0x7ff240100320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.459+0000 7ff247228700 1 --2- 172.21.15.81:0/3687095422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2400fff40 0x7ff240100320 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7ff234009990 tx=0x7ff234009ca0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 -- 172.21.15.81:0/3687095422 shutdown_connections 2024-05-09T00:13:23.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 --2- 172.21.15.81:0/3687095422 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff240105060 0x7ff24010cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 --2- 172.21.15.81:0/3687095422 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2400fff40 0x7ff240100320 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 --2- 172.21.15.81:0/3687095422 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff2401008f0 0x7ff240104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 -- 172.21.15.81:0/3687095422 >> 172.21.15.81:0/3687095422 conn(0x7ff2400fb7e0 msgr2=0x7ff2400fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 -- 172.21.15.81:0/3687095422 shutdown_connections 2024-05-09T00:13:23.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 -- 172.21.15.81:0/3687095422 wait complete. 2024-05-09T00:13:23.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 Processor -- start 2024-05-09T00:13:23.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 -- start start 2024-05-09T00:13:23.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2400fff40 0x7ff2401019d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff240105060 0x7ff240101f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff240102450 0x7ff2401a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2401a5ac0 con 0x7ff240102450 2024-05-09T00:13:23.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2401a5c30 con 0x7ff2400fff40 2024-05-09T00:13:23.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff247228700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2401a5df0 con 0x7ff240105060 2024-05-09T00:13:23.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff2457c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff240102450 0x7ff2401a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff2457c5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff240102450 0x7ff2401a54f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46404/0 (socket says 172.21.15.81:46404) 2024-05-09T00:13:23.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.460+0000 7ff2457c5700 1 -- 172.21.15.81:0/460542589 learned_addr learned my addr 172.21.15.81:0/460542589 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:23.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.461+0000 7ff23ffff700 1 --2- 172.21.15.81:0/460542589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff240105060 0x7ff240101f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.461+0000 7ff244fc4700 1 --2- 172.21.15.81:0/460542589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2400fff40 0x7ff2401019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.461+0000 7ff2457c5700 1 -- 172.21.15.81:0/460542589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff240105060 msgr2=0x7ff240101f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.461+0000 7ff2457c5700 1 --2- 172.21.15.81:0/460542589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff240105060 0x7ff240101f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.461+0000 7ff2457c5700 1 -- 172.21.15.81:0/460542589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2400fff40 msgr2=0x7ff2401019d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.461+0000 7ff2457c5700 1 --2- 172.21.15.81:0/460542589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2400fff40 0x7ff2401019d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.461+0000 7ff2457c5700 1 -- 172.21.15.81:0/460542589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2340095f0 con 0x7ff240102450 2024-05-09T00:13:23.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.461+0000 7ff2457c5700 1 --2- 172.21.15.81:0/460542589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff240102450 0x7ff2401a54f0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7ff238007ee0 tx=0x7ff23800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.461+0000 7ff23dffb700 1 -- 172.21.15.81:0/460542589 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff238017070 con 0x7ff240102450 2024-05-09T00:13:23.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.461+0000 7ff23dffb700 1 -- 172.21.15.81:0/460542589 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff23800f040 con 0x7ff240102450 2024-05-09T00:13:23.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.461+0000 7ff247228700 1 -- 172.21.15.81:0/460542589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2401a60d0 con 0x7ff240102450 2024-05-09T00:13:23.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.461+0000 7ff23dffb700 1 -- 172.21.15.81:0/460542589 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff238005740 con 0x7ff240102450 2024-05-09T00:13:23.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.461+0000 7ff247228700 1 -- 172.21.15.81:0/460542589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2401a6590 con 0x7ff240102450 2024-05-09T00:13:23.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.462+0000 7ff247228700 1 -- 172.21.15.81:0/460542589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff240109290 con 0x7ff240102450 2024-05-09T00:13:23.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.463+0000 7ff23dffb700 1 -- 172.21.15.81:0/460542589 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7ff2380058a0 con 0x7ff240102450 2024-05-09T00:13:23.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.463+0000 7ff23dffb700 1 --2- 172.21.15.81:0/460542589 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2300a1290 0x7ff2300a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.464+0000 7ff244fc4700 1 --2- 172.21.15.81:0/460542589 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2300a1290 0x7ff2300a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.464+0000 7ff23dffb700 1 -- 172.21.15.81:0/460542589 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7ff2380cc560 con 0x7ff240102450 2024-05-09T00:13:23.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.464+0000 7ff244fc4700 1 --2- 172.21.15.81:0/460542589 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2300a1290 0x7ff2300a3750 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff2340095c0 tx=0x7ff234009530 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.468+0000 7ff23dffb700 1 -- 172.21.15.81:0/460542589 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff238095980 con 0x7ff240102450 2024-05-09T00:13:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.712+0000 7ff247228700 1 -- 172.21.15.81:0/460542589 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff240101410 con 0x7ff240102450 2024-05-09T00:13:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.713+0000 7ff23dffb700 1 -- 172.21.15.81:0/460542589 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7ff238098fa0 con 0x7ff240102450 2024-05-09T00:13:23.711 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:13:23.711 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:13:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.715+0000 7ff247228700 1 -- 172.21.15.81:0/460542589 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2300a1290 msgr2=0x7ff2300a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.715+0000 7ff247228700 1 --2- 172.21.15.81:0/460542589 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2300a1290 0x7ff2300a3750 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff2340095c0 tx=0x7ff234009530 comp rx=0 tx=0).stop 2024-05-09T00:13:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.715+0000 7ff247228700 1 -- 172.21.15.81:0/460542589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff240102450 msgr2=0x7ff2401a54f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.715+0000 7ff247228700 1 --2- 172.21.15.81:0/460542589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff240102450 0x7ff2401a54f0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7ff238007ee0 tx=0x7ff23800d3b0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.715+0000 7ff247228700 1 -- 172.21.15.81:0/460542589 shutdown_connections 2024-05-09T00:13:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.715+0000 7ff247228700 1 --2- 172.21.15.81:0/460542589 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7ff2300a1290 0x7ff2300a3750 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.715+0000 7ff247228700 1 --2- 172.21.15.81:0/460542589 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7ff2400fff40 0x7ff2401019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.715+0000 7ff247228700 1 --2- 172.21.15.81:0/460542589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff240102450 0x7ff2401a54f0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.715+0000 7ff247228700 1 --2- 172.21.15.81:0/460542589 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff240105060 0x7ff240101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.715+0000 7ff247228700 1 -- 172.21.15.81:0/460542589 >> 172.21.15.81:0/460542589 conn(0x7ff2400fb7e0 msgr2=0x7ff240068450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.715+0000 7ff247228700 1 -- 172.21.15.81:0/460542589 shutdown_connections 2024-05-09T00:13:23.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.715+0000 7ff247228700 1 -- 172.21.15.81:0/460542589 wait complete. 2024-05-09T00:13:23.714 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:13:23.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:13:23.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.852+0000 7fb88202c700 1 -- 172.21.15.81:0/1538773604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb87c106280 msgr2=0x7fb87c10de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.852+0000 7fb88202c700 1 --2- 172.21.15.81:0/1538773604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb87c106280 0x7fb87c10de00 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fb87400b0a0 tx=0x7fb87400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.852+0000 7fb88202c700 1 -- 172.21.15.81:0/1538773604 shutdown_connections 2024-05-09T00:13:23.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.852+0000 7fb88202c700 1 --2- 172.21.15.81:0/1538773604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb87c106280 0x7fb87c10de00 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.852+0000 7fb88202c700 1 --2- 172.21.15.81:0/1538773604 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c101160 0x7fb87c101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.852+0000 7fb88202c700 1 --2- 172.21.15.81:0/1538773604 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb87c101b10 0x7fb87c105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.852+0000 7fb88202c700 1 -- 172.21.15.81:0/1538773604 >> 172.21.15.81:0/1538773604 conn(0x7fb87c0fc9e0 msgr2=0x7fb87c0fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.852+0000 7fb88202c700 1 -- 172.21.15.81:0/1538773604 shutdown_connections 2024-05-09T00:13:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.852+0000 7fb88202c700 1 -- 172.21.15.81:0/1538773604 wait complete. 2024-05-09T00:13:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.853+0000 7fb88202c700 1 Processor -- start 2024-05-09T00:13:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.853+0000 7fb88202c700 1 -- start start 2024-05-09T00:13:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.853+0000 7fb88202c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb87c101160 0x7fb87c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.853+0000 7fb88202c700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb87c106280 0x7fb87c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.853+0000 7fb88202c700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c073d20 0x7fb87c1a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.853+0000 7fb88202c700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c1a5cc0 con 0x7fb87c101160 2024-05-09T00:13:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.853+0000 7fb88202c700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c1a5e30 con 0x7fb87c106280 2024-05-09T00:13:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.853+0000 7fb88202c700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb87c1a5ff0 con 0x7fb87c073d20 2024-05-09T00:13:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.853+0000 7fb87b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb87c101160 0x7fb87c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.853+0000 7fb87b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb87c101160 0x7fb87c0732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46416/0 (socket says 172.21.15.81:46416) 2024-05-09T00:13:23.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.853+0000 7fb87b7fe700 1 -- 172.21.15.81:0/1125225447 learned_addr learned my addr 172.21.15.81:0/1125225447 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:23.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.854+0000 7fb87bfff700 1 --2- 172.21.15.81:0/1125225447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c073d20 0x7fb87c1a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.854+0000 7fb87affd700 1 --2- 172.21.15.81:0/1125225447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb87c106280 0x7fb87c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.854+0000 7fb87b7fe700 1 -- 172.21.15.81:0/1125225447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c073d20 msgr2=0x7fb87c1a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.854+0000 7fb87b7fe700 1 --2- 172.21.15.81:0/1125225447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c073d20 0x7fb87c1a56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.854+0000 7fb87b7fe700 1 -- 172.21.15.81:0/1125225447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb87c106280 msgr2=0x7fb87c0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.854+0000 7fb87b7fe700 1 --2- 172.21.15.81:0/1125225447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb87c106280 0x7fb87c0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.854+0000 7fb87b7fe700 1 -- 172.21.15.81:0/1125225447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb874009d00 con 0x7fb87c101160 2024-05-09T00:13:23.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.854+0000 7fb87b7fe700 1 --2- 172.21.15.81:0/1125225447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb87c101160 0x7fb87c0732a0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fb86400d950 tx=0x7fb86400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.854+0000 7fb878ff9700 1 -- 172.21.15.81:0/1125225447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400f890 con 0x7fb87c101160 2024-05-09T00:13:23.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.854+0000 7fb878ff9700 1 -- 172.21.15.81:0/1125225447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb864010460 con 0x7fb87c101160 2024-05-09T00:13:23.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.854+0000 7fb88202c700 1 -- 172.21.15.81:0/1125225447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb87c1a62d0 con 0x7fb87c101160 2024-05-09T00:13:23.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.854+0000 7fb878ff9700 1 -- 172.21.15.81:0/1125225447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400e610 con 0x7fb87c101160 2024-05-09T00:13:23.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.854+0000 7fb88202c700 1 -- 172.21.15.81:0/1125225447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87c1a67e0 con 0x7fb87c101160 2024-05-09T00:13:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.857+0000 7fb878ff9700 1 -- 172.21.15.81:0/1125225447 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fb8640108d0 con 0x7fb87c101160 2024-05-09T00:13:23.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.857+0000 7fb878ff9700 1 --2- 172.21.15.81:0/1125225447 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb8680a1290 0x7fb8680a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.858+0000 7fb878ff9700 1 -- 172.21.15.81:0/1125225447 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fb8640ccb40 con 0x7fb87c101160 2024-05-09T00:13:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.858+0000 7fb87affd700 1 --2- 172.21.15.81:0/1125225447 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb8680a1290 0x7fb8680a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.858+0000 7fb88e1e6b80 1 Processor -- start 2024-05-09T00:13:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.858+0000 7fb87affd700 1 --2- 172.21.15.81:0/1125225447 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb8680a1290 0x7fb8680a3750 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0749d0 tx=0x7fb86c00b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.858+0000 7fb88e1e6b80 1 -- start start 2024-05-09T00:13:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.858+0000 7fb88e1e6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec5e00 0x5638c5ec61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.858+0000 7fb88e1e6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec6720 0x5638c5ec0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.858+0000 7fb88e1e6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 0x5638c5ec0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.858+0000 7fb88e1e6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638c5e17150 con 0x5638c5ec6720 2024-05-09T00:13:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.858+0000 7fb88e1e6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638c5e14b10 con 0x5638c5ec5e00 2024-05-09T00:13:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.858+0000 7fb88e1e6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638c5e10400 con 0x5638c5ec0890 2024-05-09T00:13:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.858+0000 7fb87affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec6720 0x5638c5ec0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.858+0000 7fb87affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec6720 0x5638c5ec0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46428/0 (socket says 172.21.15.81:46428) 2024-05-09T00:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.858+0000 7fb87affd700 1 -- 172.21.15.81:0/1900123185 learned_addr learned my addr 172.21.15.81:0/1900123185 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.859+0000 7fb87b7fe700 1 --2- 172.21.15.81:0/1900123185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec5e00 0x5638c5ec61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.859+0000 7fb87bfff700 1 --2- 172.21.15.81:0/1900123185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 0x5638c5ec0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.859+0000 7fb87affd700 1 -- 172.21.15.81:0/1900123185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 msgr2=0x5638c5ec0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.859+0000 7fb87affd700 1 --2- 172.21.15.81:0/1900123185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 0x5638c5ec0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.859+0000 7fb87affd700 1 -- 172.21.15.81:0/1900123185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec5e00 msgr2=0x5638c5ec61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.859+0000 7fb87affd700 1 --2- 172.21.15.81:0/1900123185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec5e00 0x5638c5ec61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.859+0000 7fb87affd700 1 -- 172.21.15.81:0/1900123185 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638c5c913b0 con 0x5638c5ec6720 2024-05-09T00:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.859+0000 7fb87affd700 1 --2- 172.21.15.81:0/1900123185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec6720 0x5638c5ec0350 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fb86c010dc0 tx=0x7fb86c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6362872e279c95 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.859+0000 7fb871ffb700 1 -- 172.21.15.81:0/1900123185 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c01e420 con 0x5638c5ec6720 2024-05-09T00:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.859+0000 7fb871ffb700 1 -- 172.21.15.81:0/1900123185 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb86c015070 con 0x5638c5ec6720 2024-05-09T00:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.859+0000 7fb871ffb700 1 -- 172.21.15.81:0/1900123185 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c01c930 con 0x5638c5ec6720 2024-05-09T00:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.860+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/1900123185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec6720 msgr2=0x5638c5ec0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.860+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/1900123185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec6720 0x5638c5ec0350 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fb86c010dc0 tx=0x7fb86c013000 comp rx=0 tx=0).stop 2024-05-09T00:13:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.860+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/1900123185 shutdown_connections 2024-05-09T00:13:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.860+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/1900123185 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec5e00 0x5638c5ec61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.860+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/1900123185 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 0x5638c5ec0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.860+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/1900123185 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec6720 0x5638c5ec0350 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.860+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/1900123185 >> 172.21.15.81:0/1900123185 conn(0x5638c5e1e210 msgr2=0x5638c5ebadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.860+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/1900123185 shutdown_connections 2024-05-09T00:13:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.860+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/1900123185 wait complete. 2024-05-09T00:13:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.860+0000 7fb88e1e6b80 1 -- start start 2024-05-09T00:13:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.860+0000 7fb88e1e6b80 1 Processor -- start 2024-05-09T00:13:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb88e1e6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 0x5638c5ec9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb88e1e6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec5e00 0x5638c5ec9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb88e1e6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 0x5638c5eca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb88e1e6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638c5dac560 con 0x5638c5ec5e00 2024-05-09T00:13:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb88e1e6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638c5dac200 con 0x5638c5ec6720 2024-05-09T00:13:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb88e1e6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638c5c936a0 con 0x5638c5ec0890 2024-05-09T00:13:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb88e1e6b80 10 client.0 _ll_register_callbacks cb 0x5638c5db5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb87affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec5e00 0x5638c5ec9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb87affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec5e00 0x5638c5ec9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46432/0 (socket says 172.21.15.81:46432) 2024-05-09T00:13:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb87affd700 1 -- 172.21.15.81:0/1838513388 learned_addr learned my addr 172.21.15.81:0/1838513388 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb87bfff700 1 --2- 172.21.15.81:0/1838513388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 0x5638c5eca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb87b7fe700 1 --2- 172.21.15.81:0/1838513388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 0x5638c5ec9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb87affd700 1 -- 172.21.15.81:0/1838513388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 msgr2=0x5638c5ec9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb87affd700 1 --2- 172.21.15.81:0/1838513388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 0x5638c5ec9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb87affd700 1 -- 172.21.15.81:0/1838513388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 msgr2=0x5638c5eca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb87affd700 1 --2- 172.21.15.81:0/1838513388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 0x5638c5eca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb87affd700 1 -- 172.21.15.81:0/1838513388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c010aa0 con 0x5638c5ec5e00 2024-05-09T00:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb87affd700 1 --2- 172.21.15.81:0/1838513388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec5e00 0x5638c5ec9f90 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00b6c0 tx=0x7fb86c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aaf0fc1ebab8329 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb85affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb85affd700 1 -- 172.21.15.81:0/1838513388 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c02d070 con 0x5638c5ec5e00 2024-05-09T00:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb85affd700 1 -- 172.21.15.81:0/1838513388 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fb86c017070 con 0x5638c5ec5e00 2024-05-09T00:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.861+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/1838513388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5638c5d69270 con 0x5638c5ec5e00 2024-05-09T00:13:23.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.862+0000 7fb85affd700 1 -- 172.21.15.81:0/1838513388 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb86c0052d0 con 0x5638c5ec5e00 2024-05-09T00:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.862+0000 7fb88e1e6b80 10 client.18417 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.862+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/1838513388 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5638c5c3db60 con 0x5638c5ec5e00 2024-05-09T00:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.862+0000 7fb85affd700 1 -- 172.21.15.81:0/1838513388 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb86c03d020 con 0x5638c5ec5e00 2024-05-09T00:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.862+0000 7fb85affd700 1 -- 172.21.15.81:0/1838513388 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb86c01e4b0 con 0x5638c5ec5e00 2024-05-09T00:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.862+0000 7fb88e1e6b80 10 client.18417 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.862+0000 7fb88e1e6b80 10 client.18417 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.862+0000 7fb88e1e6b80 20 client.18417 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.862+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/1838513388 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5638c5eda110 0x5638c5edc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.862+0000 7fb88e1e6b80 4 client.18417 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.862+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/1838513388 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638c5e8f810 con 0x5638c5eda110 2024-05-09T00:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.862+0000 7fb87b7fe700 1 --2- 172.21.15.81:0/1838513388 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5638c5eda110 0x5638c5edc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb85affd700 10 client.18417 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb87b7fe700 1 --2- 172.21.15.81:0/1838513388 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5638c5eda110 0x5638c5edc530 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=db78a0efab3cc6fd server_cookie=9c6db8c9dd493464 in_seq=0 out_seq=0 2024-05-09T00:13:23.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb85affd700 1 -- 172.21.15.81:0/1838513388 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5638c5e8f810 con 0x5638c5eda110 2024-05-09T00:13:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb85affd700 10 client.18417 handle_command_reply: tid=0 2024-05-09T00:13:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb88e1e6b80 1 client.18417 shutdown 2024-05-09T00:13:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/1838513388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec5e00 msgr2=0x5638c5ec9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/1838513388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec5e00 0x5638c5ec9f90 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00b6c0 tx=0x7fb86c00ba50 comp rx=0 tx=0).stop 2024-05-09T00:13:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/1838513388 shutdown_connections 2024-05-09T00:13:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/1838513388 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5638c5eda110 0x5638c5edc530 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/1838513388 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 0x5638c5eca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/1838513388 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 0x5638c5ec9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/1838513388 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec5e00 0x5638c5ec9f90 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb85affd700 0 client.18417 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:13:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/1838513388 >> 172.21.15.81:0/1838513388 conn(0x5638c5e1e210 msgr2=0x5638c5eba5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.863+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/1838513388 shutdown_connections 2024-05-09T00:13:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.864+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/1838513388 wait complete. 2024-05-09T00:13:23.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.864+0000 7fb88e1e6b80 20 client.18417 trim_cache size 0 max 16384 2024-05-09T00:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb88e1e6b80 1 Processor -- start 2024-05-09T00:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb88e1e6b80 1 -- start start 2024-05-09T00:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb88e1e6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec0890 0x5638c5ec0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb88e1e6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec5e00 0x5638c5ed5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb88e1e6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 0x5638c5ebad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb88e1e6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638c5eb7dc0 con 0x5638c5ec0890 2024-05-09T00:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb88e1e6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638c5ee1700 con 0x5638c5ec6720 2024-05-09T00:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb88e1e6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638c5eb5800 con 0x5638c5ec5e00 2024-05-09T00:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb87b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec0890 0x5638c5ec0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb87b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec0890 0x5638c5ec0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46448/0 (socket says 172.21.15.81:46448) 2024-05-09T00:13:23.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb87b7fe700 1 -- 172.21.15.81:0/689659273 learned_addr learned my addr 172.21.15.81:0/689659273 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb87bfff700 1 --2- 172.21.15.81:0/689659273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 0x5638c5ebad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb87affd700 1 --2- 172.21.15.81:0/689659273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec5e00 0x5638c5ed5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb87b7fe700 1 -- 172.21.15.81:0/689659273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec5e00 msgr2=0x5638c5ed5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb87b7fe700 1 --2- 172.21.15.81:0/689659273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec5e00 0x5638c5ed5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb87b7fe700 1 -- 172.21.15.81:0/689659273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 msgr2=0x5638c5ebad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb87b7fe700 1 --2- 172.21.15.81:0/689659273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 0x5638c5ebad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb87b7fe700 1 -- 172.21.15.81:0/689659273 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638c5dd6560 con 0x5638c5ec0890 2024-05-09T00:13:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb87b7fe700 1 --2- 172.21.15.81:0/689659273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec0890 0x5638c5ec0350 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fb8640998c0 tx=0x7fb86409d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311a856443edb238 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.877+0000 7fb8727fc700 1 -- 172.21.15.81:0/689659273 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864097dc0 con 0x5638c5ec0890 2024-05-09T00:13:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.878+0000 7fb8727fc700 1 -- 172.21.15.81:0/689659273 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8640962d0 con 0x5638c5ec0890 2024-05-09T00:13:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.878+0000 7fb8727fc700 1 -- 172.21.15.81:0/689659273 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8640992f0 con 0x5638c5ec0890 2024-05-09T00:13:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.878+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/689659273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec0890 msgr2=0x5638c5ec0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.878+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/689659273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec0890 0x5638c5ec0350 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fb8640998c0 tx=0x7fb86409d9f0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.878+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/689659273 shutdown_connections 2024-05-09T00:13:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.878+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/689659273 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 0x5638c5ebad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.878+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/689659273 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec0890 0x5638c5ec0350 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.878+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/689659273 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec5e00 0x5638c5ed5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.878+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/689659273 >> 172.21.15.81:0/689659273 conn(0x5638c5e1e210 msgr2=0x5638c5ec0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.878+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/689659273 shutdown_connections 2024-05-09T00:13:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.878+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/689659273 wait complete. 2024-05-09T00:13:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.878+0000 7fb88e1e6b80 1 -- start start 2024-05-09T00:13:23.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb88e1e6b80 1 Processor -- start 2024-05-09T00:13:23.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb88e1e6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 0x5638c5f24750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb88e1e6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec5e00 0x5638c5f24c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb88e1e6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 0x5638c5f2f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb88e1e6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638c5f253a0 con 0x5638c5ec5e00 2024-05-09T00:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb88e1e6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638c5f2fb20 con 0x5638c5ec6720 2024-05-09T00:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb88e1e6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638c5f2fc90 con 0x5638c5ec0890 2024-05-09T00:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb88e1e6b80 10 client.0 _ll_register_callbacks cb 0x5638c5db5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb87affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec5e00 0x5638c5f24c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb87affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec5e00 0x5638c5f24c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46464/0 (socket says 172.21.15.81:46464) 2024-05-09T00:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb87affd700 1 -- 172.21.15.81:0/911289111 learned_addr learned my addr 172.21.15.81:0/911289111 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb87bfff700 1 --2- 172.21.15.81:0/911289111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 0x5638c5f2f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb87b7fe700 1 --2- 172.21.15.81:0/911289111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 0x5638c5f24750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb87affd700 1 -- 172.21.15.81:0/911289111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 msgr2=0x5638c5f24750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb87affd700 1 --2- 172.21.15.81:0/911289111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 0x5638c5f24750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb87affd700 1 -- 172.21.15.81:0/911289111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 msgr2=0x5638c5f2f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb87affd700 1 --2- 172.21.15.81:0/911289111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 0x5638c5f2f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb87affd700 1 -- 172.21.15.81:0/911289111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb87c1a67e0 con 0x5638c5ec5e00 2024-05-09T00:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb87affd700 1 --2- 172.21.15.81:0/911289111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec5e00 0x5638c5f24c90 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fb86c005950 tx=0x7fb86c005580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a87d96e2f95117 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.879+0000 7fb85affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb85affd700 1 -- 172.21.15.81:0/911289111 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86c02d070 con 0x5638c5ec5e00 2024-05-09T00:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb85affd700 1 -- 172.21.15.81:0/911289111 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fb86c017040 con 0x5638c5ec5e00 2024-05-09T00:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/911289111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb86c015070 con 0x5638c5ec5e00 2024-05-09T00:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb85affd700 1 -- 172.21.15.81:0/911289111 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb86c011ab0 con 0x5638c5ec5e00 2024-05-09T00:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb88e1e6b80 10 client.18423 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/911289111 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5638c5c95cd0 con 0x5638c5ec5e00 2024-05-09T00:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb85affd700 1 -- 172.21.15.81:0/911289111 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb86c015070 con 0x5638c5ec5e00 2024-05-09T00:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb85affd700 1 -- 172.21.15.81:0/911289111 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fb86c0316c0 con 0x5638c5ec5e00 2024-05-09T00:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb88e1e6b80 10 client.18423 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:23.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb88e1e6b80 10 client.18423 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb88e1e6b80 20 client.18423 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/911289111 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5638c5f30f80 0x5638c5f333a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb88e1e6b80 4 client.18423 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/911289111 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5638c5e08ec0 con 0x5638c5f30f80 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.880+0000 7fb87b7fe700 1 --2- 172.21.15.81:0/911289111 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5638c5f30f80 0x5638c5f333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb85affd700 10 client.18423 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb87b7fe700 1 --2- 172.21.15.81:0/911289111 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5638c5f30f80 0x5638c5f333a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b5221b17cfbbe3ed server_cookie=3244fae5d454ef59 in_seq=0 out_seq=0 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb85affd700 1 -- 172.21.15.81:0/911289111 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5638c5e08ec0 con 0x5638c5f30f80 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb85affd700 10 client.18423 handle_command_reply: tid=0 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb88e1e6b80 1 client.18423 shutdown 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/911289111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec5e00 msgr2=0x5638c5f24c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/911289111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec5e00 0x5638c5f24c90 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fb86c005950 tx=0x7fb86c005580 comp rx=0 tx=0).stop 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/911289111 shutdown_connections 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/911289111 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5638c5f30f80 0x5638c5f333a0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/911289111 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5638c5ec6720 0x5638c5f2f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb85affd700 0 client.18423 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:13:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/911289111 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5638c5ec0890 0x5638c5f24750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb88e1e6b80 1 --2- 172.21.15.81:0/911289111 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5638c5ec5e00 0x5638c5f24c90 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/911289111 >> 172.21.15.81:0/911289111 conn(0x5638c5e1e210 msgr2=0x5638c5ec3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/911289111 shutdown_connections 2024-05-09T00:13:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb88e1e6b80 1 -- 172.21.15.81:0/911289111 wait complete. 2024-05-09T00:13:23.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.881+0000 7fb88e1e6b80 20 client.18423 trim_cache size 0 max 16384 2024-05-09T00:13:23.885 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:13:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.882+0000 7fb88202c700 1 -- 172.21.15.81:0/1125225447 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb8680a1290 msgr2=0x7fb8680a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.882+0000 7fb88202c700 1 --2- 172.21.15.81:0/1125225447 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb8680a1290 0x7fb8680a3750 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb87c0749d0 tx=0x7fb86c00b410 comp rx=0 tx=0).stop 2024-05-09T00:13:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.882+0000 7fb88202c700 1 -- 172.21.15.81:0/1125225447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb87c101160 msgr2=0x7fb87c0732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.882+0000 7fb88202c700 1 --2- 172.21.15.81:0/1125225447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb87c101160 0x7fb87c0732a0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fb86400d950 tx=0x7fb86400dc60 comp rx=0 tx=0).stop 2024-05-09T00:13:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.882+0000 7fb88202c700 1 -- 172.21.15.81:0/1125225447 shutdown_connections 2024-05-09T00:13:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.882+0000 7fb88202c700 1 --2- 172.21.15.81:0/1125225447 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb8680a1290 0x7fb8680a3750 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.882+0000 7fb88202c700 1 --2- 172.21.15.81:0/1125225447 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb87c073d20 0x7fb87c1a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.882+0000 7fb88202c700 1 --2- 172.21.15.81:0/1125225447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb87c101160 0x7fb87c0732a0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.882+0000 7fb88202c700 1 --2- 172.21.15.81:0/1125225447 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb87c106280 0x7fb87c0737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.882+0000 7fb88202c700 1 -- 172.21.15.81:0/1125225447 >> 172.21.15.81:0/1125225447 conn(0x7fb87c0fc9e0 msgr2=0x7fb87c0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.882+0000 7fb88202c700 1 -- 172.21.15.81:0/1125225447 shutdown_connections 2024-05-09T00:13:23.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:23.882+0000 7fb88202c700 1 -- 172.21.15.81:0/1125225447 wait complete. 2024-05-09T00:13:23.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:13:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.017+0000 7faf3d762700 1 -- 172.21.15.81:0/342622907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf38101170 msgr2=0x7faf38101550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.017+0000 7faf3d762700 1 --2- 172.21.15.81:0/342622907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf38101170 0x7faf38101550 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7faf28009990 tx=0x7faf28009ca0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.017+0000 7faf3d762700 1 -- 172.21.15.81:0/342622907 shutdown_connections 2024-05-09T00:13:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.017+0000 7faf3d762700 1 --2- 172.21.15.81:0/342622907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf38106290 0x7faf3810de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.017+0000 7faf3d762700 1 --2- 172.21.15.81:0/342622907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf38101170 0x7faf38101550 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.017+0000 7faf3d762700 1 --2- 172.21.15.81:0/342622907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf38101b20 0x7faf38105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.017+0000 7faf3d762700 1 -- 172.21.15.81:0/342622907 >> 172.21.15.81:0/342622907 conn(0x7faf380fc9d0 msgr2=0x7faf380fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.017+0000 7faf3d762700 1 -- 172.21.15.81:0/342622907 shutdown_connections 2024-05-09T00:13:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.017+0000 7faf3d762700 1 -- 172.21.15.81:0/342622907 wait complete. 2024-05-09T00:13:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf3d762700 1 Processor -- start 2024-05-09T00:13:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf3d762700 1 -- start start 2024-05-09T00:13:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf3d762700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf38101170 0x7faf38197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf3d762700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf38106290 0x7faf381979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf3d762700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf3819bd00 0x7faf3819c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf3d762700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3819c780 con 0x7faf38106290 2024-05-09T00:13:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf3d762700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3819c8f0 con 0x7faf3819bd00 2024-05-09T00:13:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf3d762700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3819cab0 con 0x7faf38101170 2024-05-09T00:13:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf367fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf38106290 0x7faf381979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf367fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf38106290 0x7faf381979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46490/0 (socket says 172.21.15.81:46490) 2024-05-09T00:13:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf367fc700 1 -- 172.21.15.81:0/1125116641 learned_addr learned my addr 172.21.15.81:0/1125116641 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf36ffd700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf38101170 0x7faf38197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf377fe700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf3819bd00 0x7faf3819c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf367fc700 1 -- 172.21.15.81:0/1125116641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf38101170 msgr2=0x7faf38197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf367fc700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf38101170 0x7faf38197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf367fc700 1 -- 172.21.15.81:0/1125116641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf3819bd00 msgr2=0x7faf3819c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf367fc700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf3819bd00 0x7faf3819c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf367fc700 1 -- 172.21.15.81:0/1125116641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf280095f0 con 0x7faf38106290 2024-05-09T00:13:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.018+0000 7faf377fe700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf3819bd00 0x7faf3819c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.019+0000 7faf367fc700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf38106290 0x7faf381979b0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00d950 tx=0x7faf2c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.019+0000 7faf1ffff700 1 -- 172.21.15.81:0/1125116641 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c004220 con 0x7faf38106290 2024-05-09T00:13:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.019+0000 7faf1ffff700 1 -- 172.21.15.81:0/1125116641 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf2c007620 con 0x7faf38106290 2024-05-09T00:13:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.019+0000 7faf3d762700 1 -- 172.21.15.81:0/1125116641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf381a3fb0 con 0x7faf38106290 2024-05-09T00:13:24.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.019+0000 7faf1ffff700 1 -- 172.21.15.81:0/1125116641 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c005690 con 0x7faf38106290 2024-05-09T00:13:24.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.019+0000 7faf3d762700 1 -- 172.21.15.81:0/1125116641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf381a4490 con 0x7faf38106290 2024-05-09T00:13:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.021+0000 7faf1ffff700 1 -- 172.21.15.81:0/1125116641 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7faf2c00b750 con 0x7faf38106290 2024-05-09T00:13:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.022+0000 7faf1ffff700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf200a1290 0x7faf200a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.022+0000 7faf36ffd700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf200a1290 0x7faf200a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.022+0000 7faf1ffff700 1 -- 172.21.15.81:0/1125116641 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7faf2c0ccb70 con 0x7faf38106290 2024-05-09T00:13:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.022+0000 7faf36ffd700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf200a1290 0x7faf200a3750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faf2800b5c0 tx=0x7faf28005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.022+0000 7faf4991cb80 1 Processor -- start 2024-05-09T00:13:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.022+0000 7faf4991cb80 1 -- start start 2024-05-09T00:13:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.022+0000 7faf4991cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 0x5646c9a1e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.022+0000 7faf4991cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a1e720 0x5646c9a18350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.022+0000 7faf4991cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a18890 0x5646c9a18cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf4991cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c996f150 con 0x5646c9a18890 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf4991cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c996cb10 con 0x5646c9a1de00 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf4991cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c9968400 con 0x5646c9a1e720 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a18890 0x5646c9a18cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a18890 0x5646c9a18cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46492/0 (socket says 172.21.15.81:46492) 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf377fe700 1 -- 172.21.15.81:0/3468621907 learned_addr learned my addr 172.21.15.81:0/3468621907 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf36ffd700 1 --2- 172.21.15.81:0/3468621907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 0x5646c9a1e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf367fc700 1 --2- 172.21.15.81:0/3468621907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a1e720 0x5646c9a18350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf377fe700 1 -- 172.21.15.81:0/3468621907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a1e720 msgr2=0x5646c9a18350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf377fe700 1 --2- 172.21.15.81:0/3468621907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a1e720 0x5646c9a18350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf377fe700 1 -- 172.21.15.81:0/3468621907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 msgr2=0x5646c9a1e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf377fe700 1 --2- 172.21.15.81:0/3468621907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 0x5646c9a1e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf377fe700 1 -- 172.21.15.81:0/3468621907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646c97e93b0 con 0x5646c9a18890 2024-05-09T00:13:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf367fc700 1 --2- 172.21.15.81:0/3468621907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a1e720 0x5646c9a18350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf377fe700 1 --2- 172.21.15.81:0/3468621907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a18890 0x5646c9a18cd0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7faf3000c450 tx=0x7faf3000c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67dc04c39c28de server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf1d7fa700 1 -- 172.21.15.81:0/3468621907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011070 con 0x5646c9a18890 2024-05-09T00:13:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf1d7fa700 1 -- 172.21.15.81:0/3468621907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf30009b20 con 0x5646c9a18890 2024-05-09T00:13:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.023+0000 7faf1d7fa700 1 -- 172.21.15.81:0/3468621907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf300153c0 con 0x5646c9a18890 2024-05-09T00:13:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.024+0000 7faf4991cb80 1 -- 172.21.15.81:0/3468621907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a18890 msgr2=0x5646c9a18cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.024+0000 7faf4991cb80 1 --2- 172.21.15.81:0/3468621907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a18890 0x5646c9a18cd0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7faf3000c450 tx=0x7faf3000c480 comp rx=0 tx=0).stop 2024-05-09T00:13:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.024+0000 7faf4991cb80 1 -- 172.21.15.81:0/3468621907 shutdown_connections 2024-05-09T00:13:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.024+0000 7faf4991cb80 1 --2- 172.21.15.81:0/3468621907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 0x5646c9a1e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.024+0000 7faf4991cb80 1 --2- 172.21.15.81:0/3468621907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a18890 0x5646c9a18cd0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.024+0000 7faf4991cb80 1 --2- 172.21.15.81:0/3468621907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a1e720 0x5646c9a18350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.024+0000 7faf4991cb80 1 -- 172.21.15.81:0/3468621907 >> 172.21.15.81:0/3468621907 conn(0x5646c9976210 msgr2=0x5646c9a12df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.024+0000 7faf4991cb80 1 -- 172.21.15.81:0/3468621907 shutdown_connections 2024-05-09T00:13:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.024+0000 7faf4991cb80 1 -- 172.21.15.81:0/3468621907 wait complete. 2024-05-09T00:13:24.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.024+0000 7faf4991cb80 1 -- start start 2024-05-09T00:13:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.024+0000 7faf4991cb80 1 Processor -- start 2024-05-09T00:13:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf4991cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a18890 0x5646c9a21b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf4991cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 0x5646c9a22060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf4991cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1e720 0x5646c9a225a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf4991cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c9904560 con 0x5646c9a1e720 2024-05-09T00:13:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf4991cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c9904200 con 0x5646c9a1de00 2024-05-09T00:13:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf4991cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c97eb6a0 con 0x5646c9a18890 2024-05-09T00:13:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf4991cb80 10 client.0 _ll_register_callbacks cb 0x5646c990db30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1e720 0x5646c9a225a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1e720 0x5646c9a225a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46506/0 (socket says 172.21.15.81:46506) 2024-05-09T00:13:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf377fe700 1 -- 172.21.15.81:0/2839506662 learned_addr learned my addr 172.21.15.81:0/2839506662 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf367fc700 1 --2- 172.21.15.81:0/2839506662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 0x5646c9a22060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf36ffd700 1 --2- 172.21.15.81:0/2839506662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a18890 0x5646c9a21b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf377fe700 1 -- 172.21.15.81:0/2839506662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a18890 msgr2=0x5646c9a21b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf377fe700 1 --2- 172.21.15.81:0/2839506662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a18890 0x5646c9a21b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf377fe700 1 -- 172.21.15.81:0/2839506662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 msgr2=0x5646c9a22060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf377fe700 1 --2- 172.21.15.81:0/2839506662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 0x5646c9a22060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf377fe700 1 -- 172.21.15.81:0/2839506662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf30009ca0 con 0x5646c9a1e720 2024-05-09T00:13:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf367fc700 1 --2- 172.21.15.81:0/2839506662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 0x5646c9a22060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf377fe700 1 --2- 172.21.15.81:0/2839506662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1e720 0x5646c9a225a0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7faf3000c420 tx=0x7faf3000a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b4e39360c10bbd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf1aff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf1aff5700 1 -- 172.21.15.81:0/2839506662 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30011040 con 0x5646c9a1e720 2024-05-09T00:13:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf1aff5700 1 -- 172.21.15.81:0/2839506662 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7faf30006e40 con 0x5646c9a1e720 2024-05-09T00:13:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.025+0000 7faf4991cb80 1 -- 172.21.15.81:0/2839506662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646c99e7810 con 0x5646c9a1e720 2024-05-09T00:13:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.026+0000 7faf1aff5700 1 -- 172.21.15.81:0/2839506662 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf300094f0 con 0x5646c9a1e720 2024-05-09T00:13:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.026+0000 7faf4991cb80 10 client.18435 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.026+0000 7faf4991cb80 1 -- 172.21.15.81:0/2839506662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5646c9795b60 con 0x5646c9a1e720 2024-05-09T00:13:24.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.026+0000 7faf1aff5700 1 -- 172.21.15.81:0/2839506662 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5646c99e7810 con 0x5646c9a1e720 2024-05-09T00:13:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.026+0000 7faf1aff5700 1 -- 172.21.15.81:0/2839506662 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faf3001e960 con 0x5646c9a1e720 2024-05-09T00:13:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.026+0000 7faf4991cb80 10 client.18435 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.026+0000 7faf4991cb80 10 client.18435 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:13:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.026+0000 7faf4991cb80 20 client.18435 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.026+0000 7faf4991cb80 1 --2- 172.21.15.81:0/2839506662 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5646c9a32110 0x5646c9a34530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.026+0000 7faf4991cb80 4 client.18435 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.026+0000 7faf4991cb80 1 -- 172.21.15.81:0/2839506662 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646c9960ec0 con 0x5646c9a32110 2024-05-09T00:13:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.026+0000 7faf36ffd700 1 --2- 172.21.15.81:0/2839506662 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5646c9a32110 0x5646c9a34530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.027+0000 7faf1aff5700 10 client.18435 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:13:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.027+0000 7faf36ffd700 1 --2- 172.21.15.81:0/2839506662 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5646c9a32110 0x5646c9a34530 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c88931412bdfddfa server_cookie=e437ab7274d6e2d4 in_seq=0 out_seq=0 2024-05-09T00:13:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.027+0000 7faf1aff5700 1 -- 172.21.15.81:0/2839506662 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5646c9960ec0 con 0x5646c9a32110 2024-05-09T00:13:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.027+0000 7faf1aff5700 10 client.18435 handle_command_reply: tid=0 2024-05-09T00:13:24.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.027+0000 7faf4991cb80 1 client.18435 shutdown 2024-05-09T00:13:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.027+0000 7faf4991cb80 1 -- 172.21.15.81:0/2839506662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1e720 msgr2=0x5646c9a225a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.027+0000 7faf4991cb80 1 --2- 172.21.15.81:0/2839506662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1e720 0x5646c9a225a0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7faf3000c420 tx=0x7faf3000a6e0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.027+0000 7faf4991cb80 1 -- 172.21.15.81:0/2839506662 shutdown_connections 2024-05-09T00:13:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.027+0000 7faf4991cb80 1 --2- 172.21.15.81:0/2839506662 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5646c9a32110 0x5646c9a34530 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.027+0000 7faf4991cb80 1 --2- 172.21.15.81:0/2839506662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1e720 0x5646c9a225a0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.027+0000 7faf4991cb80 1 --2- 172.21.15.81:0/2839506662 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a18890 0x5646c9a21b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.027+0000 7faf1aff5700 0 client.18435 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:13:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.027+0000 7faf4991cb80 1 --2- 172.21.15.81:0/2839506662 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 0x5646c9a22060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.027+0000 7faf4991cb80 1 -- 172.21.15.81:0/2839506662 >> 172.21.15.81:0/2839506662 conn(0x5646c9976210 msgr2=0x5646c9a125a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.028+0000 7faf4991cb80 1 -- 172.21.15.81:0/2839506662 shutdown_connections 2024-05-09T00:13:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.028+0000 7faf4991cb80 1 -- 172.21.15.81:0/2839506662 wait complete. 2024-05-09T00:13:24.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.028+0000 7faf4991cb80 20 client.18435 trim_cache size 0 max 16384 2024-05-09T00:13:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf4991cb80 1 Processor -- start 2024-05-09T00:13:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf4991cb80 1 -- start start 2024-05-09T00:13:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf4991cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a18890 0x5646c9a18350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf4991cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 0x5646c9a2dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf4991cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1e720 0x5646c9a12d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf4991cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c9a246d0 con 0x5646c9a1e720 2024-05-09T00:13:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf4991cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c9a2edd0 con 0x5646c9a1de00 2024-05-09T00:13:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf4991cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c9a397c0 con 0x5646c9a18890 2024-05-09T00:13:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1e720 0x5646c9a12d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf377fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1e720 0x5646c9a12d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46510/0 (socket says 172.21.15.81:46510) 2024-05-09T00:13:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf377fe700 1 -- 172.21.15.81:0/4088368134 learned_addr learned my addr 172.21.15.81:0/4088368134 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf367fc700 1 --2- 172.21.15.81:0/4088368134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 0x5646c9a2dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf36ffd700 1 --2- 172.21.15.81:0/4088368134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a18890 0x5646c9a18350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf377fe700 1 -- 172.21.15.81:0/4088368134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a18890 msgr2=0x5646c9a18350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf377fe700 1 --2- 172.21.15.81:0/4088368134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a18890 0x5646c9a18350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf377fe700 1 -- 172.21.15.81:0/4088368134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 msgr2=0x5646c9a2dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf377fe700 1 --2- 172.21.15.81:0/4088368134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 0x5646c9a2dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf377fe700 1 -- 172.21.15.81:0/4088368134 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5646c992e560 con 0x5646c9a1e720 2024-05-09T00:13:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.041+0000 7faf377fe700 1 --2- 172.21.15.81:0/4088368134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1e720 0x5646c9a12d20 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7faf30002230 tx=0x7faf30009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16af2be8b21b4546 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.042+0000 7faf1dffb700 1 -- 172.21.15.81:0/4088368134 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf300153c0 con 0x5646c9a1e720 2024-05-09T00:13:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.042+0000 7faf1dffb700 1 -- 172.21.15.81:0/4088368134 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf30009960 con 0x5646c9a1e720 2024-05-09T00:13:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.042+0000 7faf1dffb700 1 -- 172.21.15.81:0/4088368134 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30016920 con 0x5646c9a1e720 2024-05-09T00:13:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.042+0000 7faf4991cb80 1 -- 172.21.15.81:0/4088368134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1e720 msgr2=0x5646c9a12d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.042+0000 7faf4991cb80 1 --2- 172.21.15.81:0/4088368134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1e720 0x5646c9a12d20 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7faf30002230 tx=0x7faf30009f70 comp rx=0 tx=0).stop 2024-05-09T00:13:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.042+0000 7faf4991cb80 1 -- 172.21.15.81:0/4088368134 shutdown_connections 2024-05-09T00:13:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.042+0000 7faf4991cb80 1 --2- 172.21.15.81:0/4088368134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1e720 0x5646c9a12d20 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.042+0000 7faf4991cb80 1 --2- 172.21.15.81:0/4088368134 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a18890 0x5646c9a18350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.042+0000 7faf4991cb80 1 --2- 172.21.15.81:0/4088368134 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a1de00 0x5646c9a2dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.042+0000 7faf4991cb80 1 -- 172.21.15.81:0/4088368134 >> 172.21.15.81:0/4088368134 conn(0x5646c9976210 msgr2=0x5646c9a0f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.042+0000 7faf4991cb80 1 -- 172.21.15.81:0/4088368134 shutdown_connections 2024-05-09T00:13:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.042+0000 7faf4991cb80 1 -- 172.21.15.81:0/4088368134 wait complete. 2024-05-09T00:13:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.042+0000 7faf4991cb80 1 -- start start 2024-05-09T00:13:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf4991cb80 1 Processor -- start 2024-05-09T00:13:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf4991cb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a18890 0x5646c9a29560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf4991cb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1de00 0x5646c9a27150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf4991cb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a1e720 0x5646c9a276f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf4991cb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c9a27e00 con 0x5646c9a1de00 2024-05-09T00:13:24.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf4991cb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c9a27f70 con 0x5646c9a18890 2024-05-09T00:13:24.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf4991cb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646c9a87610 con 0x5646c9a1e720 2024-05-09T00:13:24.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf4991cb80 10 client.0 _ll_register_callbacks cb 0x5646c990db30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:24.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf367fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1de00 0x5646c9a27150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf367fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1de00 0x5646c9a27150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46520/0 (socket says 172.21.15.81:46520) 2024-05-09T00:13:24.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf367fc700 1 -- 172.21.15.81:0/4029024672 learned_addr learned my addr 172.21.15.81:0/4029024672 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:24.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf36ffd700 1 --2- 172.21.15.81:0/4029024672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a18890 0x5646c9a29560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf377fe700 1 --2- 172.21.15.81:0/4029024672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a1e720 0x5646c9a276f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf367fc700 1 -- 172.21.15.81:0/4029024672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a1e720 msgr2=0x5646c9a276f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf367fc700 1 --2- 172.21.15.81:0/4029024672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a1e720 0x5646c9a276f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf367fc700 1 -- 172.21.15.81:0/4029024672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a18890 msgr2=0x5646c9a29560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf367fc700 1 --2- 172.21.15.81:0/4029024672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a18890 0x5646c9a29560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf367fc700 1 -- 172.21.15.81:0/4029024672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5646c9795b60 con 0x5646c9a1de00 2024-05-09T00:13:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf367fc700 1 --2- 172.21.15.81:0/4029024672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1de00 0x5646c9a27150 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0998f0 tx=0x7faf2c099bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491a47421410b0a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf1aff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf1aff5700 1 -- 172.21.15.81:0/4029024672 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c097f90 con 0x5646c9a1de00 2024-05-09T00:13:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf1aff5700 1 -- 172.21.15.81:0/4029024672 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7faf2c099e50 con 0x5646c9a1de00 2024-05-09T00:13:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.043+0000 7faf4991cb80 1 -- 172.21.15.81:0/4029024672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646c98c1270 con 0x5646c9a1de00 2024-05-09T00:13:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.044+0000 7faf1aff5700 1 -- 172.21.15.81:0/4029024672 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf2c09a010 con 0x5646c9a1de00 2024-05-09T00:13:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.044+0000 7faf4991cb80 10 client.18441 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.044+0000 7faf4991cb80 1 -- 172.21.15.81:0/4029024672 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5646c97edcd0 con 0x5646c9a1de00 2024-05-09T00:13:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.044+0000 7faf1aff5700 1 -- 172.21.15.81:0/4029024672 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5646c98c1270 con 0x5646c9a1de00 2024-05-09T00:13:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.044+0000 7faf1aff5700 1 -- 172.21.15.81:0/4029024672 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faf2c0a1ce0 con 0x5646c9a1de00 2024-05-09T00:13:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.044+0000 7faf4991cb80 10 client.18441 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.044+0000 7faf4991cb80 10 client.18441 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.044+0000 7faf4991cb80 20 client.18441 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.044+0000 7faf4991cb80 1 --2- 172.21.15.81:0/4029024672 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5646c9a88de0 0x5646c9a8b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.044+0000 7faf4991cb80 4 client.18441 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.044+0000 7faf4991cb80 1 -- 172.21.15.81:0/4029024672 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5646c97b6cf0 con 0x5646c9a88de0 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.044+0000 7faf36ffd700 1 --2- 172.21.15.81:0/4029024672 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5646c9a88de0 0x5646c9a8b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf36ffd700 1 --2- 172.21.15.81:0/4029024672 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5646c9a88de0 0x5646c9a8b200 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7ab0daa57703aa6f server_cookie=d99e35115ce6bb45 in_seq=0 out_seq=0 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf1aff5700 10 client.18441 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf1aff5700 1 -- 172.21.15.81:0/4029024672 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5646c97b6cf0 con 0x5646c9a88de0 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf1aff5700 10 client.18441 handle_command_reply: tid=0 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf4991cb80 1 client.18441 shutdown 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf4991cb80 1 -- 172.21.15.81:0/4029024672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1de00 msgr2=0x5646c9a27150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf4991cb80 1 --2- 172.21.15.81:0/4029024672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1de00 0x5646c9a27150 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0998f0 tx=0x7faf2c099bf0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf4991cb80 1 -- 172.21.15.81:0/4029024672 shutdown_connections 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf4991cb80 1 --2- 172.21.15.81:0/4029024672 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x5646c9a88de0 0x5646c9a8b200 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf4991cb80 1 --2- 172.21.15.81:0/4029024672 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5646c9a18890 0x5646c9a29560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf4991cb80 1 --2- 172.21.15.81:0/4029024672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5646c9a1e720 0x5646c9a276f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf1aff5700 0 client.18441 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:13:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf4991cb80 1 --2- 172.21.15.81:0/4029024672 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5646c9a1de00 0x5646c9a27150 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf4991cb80 1 -- 172.21.15.81:0/4029024672 >> 172.21.15.81:0/4029024672 conn(0x5646c9976210 msgr2=0x5646c9a20390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf4991cb80 1 -- 172.21.15.81:0/4029024672 shutdown_connections 2024-05-09T00:13:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf4991cb80 1 -- 172.21.15.81:0/4029024672 wait complete. 2024-05-09T00:13:24.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf4991cb80 20 client.18441 trim_cache size 0 max 16384 2024-05-09T00:13:24.049 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:13:24.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf3d762700 1 -- 172.21.15.81:0/1125116641 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf200a1290 msgr2=0x7faf200a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf3d762700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf200a1290 0x7faf200a3750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7faf2800b5c0 tx=0x7faf28005960 comp rx=0 tx=0).stop 2024-05-09T00:13:24.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf3d762700 1 -- 172.21.15.81:0/1125116641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf38106290 msgr2=0x7faf381979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf3d762700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf38106290 0x7faf381979b0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7faf2c00d950 tx=0x7faf2c00dc60 comp rx=0 tx=0).stop 2024-05-09T00:13:24.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf3d762700 1 -- 172.21.15.81:0/1125116641 shutdown_connections 2024-05-09T00:13:24.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf3d762700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faf200a1290 0x7faf200a3750 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf3d762700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faf3819bd00 0x7faf3819c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf3d762700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faf38101170 0x7faf38197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.045+0000 7faf3d762700 1 --2- 172.21.15.81:0/1125116641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faf38106290 0x7faf381979b0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.046+0000 7faf3d762700 1 -- 172.21.15.81:0/1125116641 >> 172.21.15.81:0/1125116641 conn(0x7faf380fc9d0 msgr2=0x7faf380fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:24.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.046+0000 7faf3d762700 1 -- 172.21.15.81:0/1125116641 shutdown_connections 2024-05-09T00:13:24.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.046+0000 7faf3d762700 1 -- 172.21.15.81:0/1125116641 wait complete. 2024-05-09T00:13:24.054 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:23 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/460542589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:13:24.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:13:24.055 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:23 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/460542589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:13:24.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.181+0000 7fcfedcea700 1 -- 172.21.15.81:0/400492821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe8105160 msgr2=0x7fcfe810cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.181+0000 7fcfedcea700 1 --2- 172.21.15.81:0/400492821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe8105160 0x7fcfe810cce0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000b0a0 tx=0x7fcfe000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.181+0000 7fcfedcea700 1 -- 172.21.15.81:0/400492821 shutdown_connections 2024-05-09T00:13:24.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.181+0000 7fcfedcea700 1 --2- 172.21.15.81:0/400492821 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfe8100060 0x7fcfe8100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.181+0000 7fcfedcea700 1 --2- 172.21.15.81:0/400492821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe8105160 0x7fcfe810cce0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.181+0000 7fcfedcea700 1 --2- 172.21.15.81:0/400492821 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe8100a10 0x7fcfe8104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.181+0000 7fcfedcea700 1 -- 172.21.15.81:0/400492821 >> 172.21.15.81:0/400492821 conn(0x7fcfe8076f40 msgr2=0x7fcfe8077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:24.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.181+0000 7fcfedcea700 1 -- 172.21.15.81:0/400492821 shutdown_connections 2024-05-09T00:13:24.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.181+0000 7fcfedcea700 1 -- 172.21.15.81:0/400492821 wait complete. 2024-05-09T00:13:24.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.181+0000 7fcfedcea700 1 Processor -- start 2024-05-09T00:13:24.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfedcea700 1 -- start start 2024-05-09T00:13:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfedcea700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe8100060 0x7fcfe8101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfedcea700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfe8105160 0x7fcfe8102010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfedcea700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe8102550 0x7fcfe81a56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfedcea700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe81a5d10 con 0x7fcfe8100060 2024-05-09T00:13:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfedcea700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe81a5e80 con 0x7fcfe8105160 2024-05-09T00:13:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfedcea700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe81a6040 con 0x7fcfe8102550 2024-05-09T00:13:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe8100060 0x7fcfe8101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe8100060 0x7fcfe8101ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46538/0 (socket says 172.21.15.81:46538) 2024-05-09T00:13:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfe77fe700 1 -- 172.21.15.81:0/1534211582 learned_addr learned my addr 172.21.15.81:0/1534211582 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfe6ffd700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfe8105160 0x7fcfe8102010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfe7fff700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe8102550 0x7fcfe81a56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfe77fe700 1 -- 172.21.15.81:0/1534211582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe8102550 msgr2=0x7fcfe81a56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfe77fe700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe8102550 0x7fcfe81a56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfe77fe700 1 -- 172.21.15.81:0/1534211582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfe8105160 msgr2=0x7fcfe8102010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfe77fe700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfe8105160 0x7fcfe8102010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfe77fe700 1 -- 172.21.15.81:0/1534211582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe0009d00 con 0x7fcfe8100060 2024-05-09T00:13:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfe7fff700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe8102550 0x7fcfe81a56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.182+0000 7fcfe77fe700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe8100060 0x7fcfe8101ad0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00d980 tx=0x7fcfdc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.183+0000 7fcfe4ff9700 1 -- 172.21.15.81:0/1534211582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc004220 con 0x7fcfe8100060 2024-05-09T00:13:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.183+0000 7fcfe4ff9700 1 -- 172.21.15.81:0/1534211582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfdc007640 con 0x7fcfe8100060 2024-05-09T00:13:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.183+0000 7fcfe4ff9700 1 -- 172.21.15.81:0/1534211582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc005610 con 0x7fcfe8100060 2024-05-09T00:13:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.183+0000 7fcfedcea700 1 -- 172.21.15.81:0/1534211582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe81a6320 con 0x7fcfe8100060 2024-05-09T00:13:24.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.183+0000 7fcfedcea700 1 -- 172.21.15.81:0/1534211582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe81a6830 con 0x7fcfe8100060 2024-05-09T00:13:24.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.185+0000 7fcfe4ff9700 1 -- 172.21.15.81:0/1534211582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fcfdc004750 con 0x7fcfe8100060 2024-05-09T00:13:24.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.185+0000 7fcfe4ff9700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcfd00a1310 0x7fcfd00a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.185+0000 7fcfe6ffd700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcfd00a1310 0x7fcfd00a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.185+0000 7fcfe4ff9700 1 -- 172.21.15.81:0/1534211582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fcfdc0ccaf0 con 0x7fcfe8100060 2024-05-09T00:13:24.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.186+0000 7fcfe6ffd700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcfd00a1310 0x7fcfd00a37d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8103200 tx=0x7fcfd8009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.186+0000 7fcff9ea4b80 1 Processor -- start 2024-05-09T00:13:24.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.186+0000 7fcff9ea4b80 1 -- start start 2024-05-09T00:13:24.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.186+0000 7fcff9ea4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e9e00 0x55fda23ea1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.186+0000 7fcff9ea4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23ea720 0x55fda23e4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.186+0000 7fcff9ea4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23e4890 0x55fda23e4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.186+0000 7fcff9ea4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fda233b150 con 0x55fda23ea720 2024-05-09T00:13:24.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.186+0000 7fcff9ea4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fda2338b10 con 0x55fda23e9e00 2024-05-09T00:13:24.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.187+0000 7fcff9ea4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fda2334400 con 0x55fda23e4890 2024-05-09T00:13:24.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.187+0000 7fcfe6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23ea720 0x55fda23e4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.187+0000 7fcfe6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23ea720 0x55fda23e4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46554/0 (socket says 172.21.15.81:46554) 2024-05-09T00:13:24.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.187+0000 7fcfe6ffd700 1 -- 172.21.15.81:0/3581382024 learned_addr learned my addr 172.21.15.81:0/3581382024 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:24.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.187+0000 7fcfe6ffd700 1 -- 172.21.15.81:0/3581382024 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23e4890 msgr2=0x55fda23e4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.187+0000 7fcfe6ffd700 1 --2- 172.21.15.81:0/3581382024 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23e4890 0x55fda23e4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.187+0000 7fcfe6ffd700 1 -- 172.21.15.81:0/3581382024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e9e00 msgr2=0x55fda23ea1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.187+0000 7fcfe6ffd700 1 --2- 172.21.15.81:0/3581382024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e9e00 0x55fda23ea1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.187+0000 7fcfe6ffd700 1 -- 172.21.15.81:0/3581382024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fda21b53b0 con 0x55fda23ea720 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.187+0000 7fcfe6ffd700 1 --2- 172.21.15.81:0/3581382024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23ea720 0x55fda23e4350 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8011cd0 tx=0x7fcfd8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18633c0c546a1bc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.187+0000 7fcfcdffb700 1 -- 172.21.15.81:0/3581382024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8004030 con 0x55fda23ea720 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.187+0000 7fcfcdffb700 1 -- 172.21.15.81:0/3581382024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfd800e8f0 con 0x55fda23ea720 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.187+0000 7fcfcdffb700 1 -- 172.21.15.81:0/3581382024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8003b90 con 0x55fda23ea720 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.188+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/3581382024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23ea720 msgr2=0x55fda23e4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.188+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/3581382024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23ea720 0x55fda23e4350 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8011cd0 tx=0x7fcfd8014000 comp rx=0 tx=0).stop 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.188+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/3581382024 shutdown_connections 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.188+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/3581382024 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e9e00 0x55fda23ea1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.188+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/3581382024 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23e4890 0x55fda23e4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.188+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/3581382024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23ea720 0x55fda23e4350 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.188+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/3581382024 >> 172.21.15.81:0/3581382024 conn(0x55fda2342210 msgr2=0x55fda23dedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.188+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/3581382024 shutdown_connections 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.188+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/3581382024 wait complete. 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.188+0000 7fcff9ea4b80 1 -- start start 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcff9ea4b80 1 Processor -- start 2024-05-09T00:13:24.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcff9ea4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e4890 0x55fda23edbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcff9ea4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23e9e00 0x55fda23ee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcff9ea4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23ea720 0x55fda23ee630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcff9ea4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fda22d0560 con 0x55fda23e9e00 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcff9ea4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fda22d0200 con 0x55fda23e4890 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcff9ea4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fda21b76a0 con 0x55fda23ea720 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcfe6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23e9e00 0x55fda23ee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcff9ea4b80 10 client.0 _ll_register_callbacks cb 0x55fda22d9b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcfe6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23e9e00 0x55fda23ee0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46562/0 (socket says 172.21.15.81:46562) 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcfe6ffd700 1 -- 172.21.15.81:0/1819948810 learned_addr learned my addr 172.21.15.81:0/1819948810 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcfe7fff700 1 --2- 172.21.15.81:0/1819948810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23ea720 0x55fda23ee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcfe77fe700 1 --2- 172.21.15.81:0/1819948810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e4890 0x55fda23edbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcfe6ffd700 1 -- 172.21.15.81:0/1819948810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23ea720 msgr2=0x55fda23ee630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcfe6ffd700 1 --2- 172.21.15.81:0/1819948810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23ea720 0x55fda23ee630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcfe6ffd700 1 -- 172.21.15.81:0/1819948810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e4890 msgr2=0x55fda23edbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcfe6ffd700 1 --2- 172.21.15.81:0/1819948810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e4890 0x55fda23edbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcfe6ffd700 1 -- 172.21.15.81:0/1819948810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd8017070 con 0x55fda23e9e00 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.189+0000 7fcfe77fe700 1 --2- 172.21.15.81:0/1819948810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e4890 0x55fda23edbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcfe6ffd700 1 --2- 172.21.15.81:0/1819948810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23e9e00 0x55fda23ee0f0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009340 tx=0x7fcfd80036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c159aabac8d196 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcfc6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcfc6ffd700 1 -- 172.21.15.81:0/1819948810 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd802b070 con 0x55fda23e9e00 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/1819948810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fda228d270 con 0x55fda23e9e00 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcfc6ffd700 1 -- 172.21.15.81:0/1819948810 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fcfd801ea90 con 0x55fda23e9e00 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcfc6ffd700 1 -- 172.21.15.81:0/1819948810 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfd801ec50 con 0x55fda23e9e00 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcff9ea4b80 10 client.18453 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/1819948810 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fda2161b60 con 0x55fda23e9e00 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcfc6ffd700 1 -- 172.21.15.81:0/1819948810 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfd803c080 con 0x55fda23e9e00 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcfc6ffd700 1 -- 172.21.15.81:0/1819948810 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcfd8004a50 con 0x55fda23e9e00 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcff9ea4b80 10 client.18453 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcff9ea4b80 10 client.18453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:24.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcff9ea4b80 20 client.18453 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/1819948810 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fda23fe1d0 0x55fda24005f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcff9ea4b80 4 client.18453 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.190+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/1819948810 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fda23b3810 con 0x55fda23fe1d0 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.191+0000 7fcfe77fe700 1 --2- 172.21.15.81:0/1819948810 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fda23fe1d0 0x55fda24005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.191+0000 7fcfc6ffd700 10 client.18453 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.191+0000 7fcfe77fe700 1 --2- 172.21.15.81:0/1819948810 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fda23fe1d0 0x55fda24005f0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c74ab41755c3308f server_cookie=b2867f3bedff3fa8 in_seq=0 out_seq=0 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcfc6ffd700 1 -- 172.21.15.81:0/1819948810 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fda23b3810 con 0x55fda23fe1d0 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcfc6ffd700 10 client.18453 handle_command_reply: tid=0 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcff9ea4b80 1 client.18453 shutdown 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/1819948810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23e9e00 msgr2=0x55fda23ee0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/1819948810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23e9e00 0x55fda23ee0f0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009340 tx=0x7fcfd80036f0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/1819948810 shutdown_connections 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/1819948810 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fda23fe1d0 0x55fda24005f0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/1819948810 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e4890 0x55fda23edbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/1819948810 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23ea720 0x55fda23ee630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcfc6ffd700 0 client.18453 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:24.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/1819948810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23e9e00 0x55fda23ee0f0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/1819948810 >> 172.21.15.81:0/1819948810 conn(0x55fda2342210 msgr2=0x55fda23de5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:24.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/1819948810 shutdown_connections 2024-05-09T00:13:24.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/1819948810 wait complete. 2024-05-09T00:13:24.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.192+0000 7fcff9ea4b80 20 client.18453 trim_cache size 0 max 16384 2024-05-09T00:13:24.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcff9ea4b80 1 Processor -- start 2024-05-09T00:13:24.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcff9ea4b80 1 -- start start 2024-05-09T00:13:24.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcff9ea4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23e4890 0x55fda23e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcff9ea4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e9e00 0x55fda23f9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcff9ea4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23ea720 0x55fda23db210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcff9ea4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fda23dbdc0 con 0x55fda23e4890 2024-05-09T00:13:24.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcff9ea4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fda24057c0 con 0x55fda23e9e00 2024-05-09T00:13:24.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcff9ea4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fda23db750 con 0x55fda23ea720 2024-05-09T00:13:24.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23e4890 0x55fda23e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcfe77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23e4890 0x55fda23e4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46570/0 (socket says 172.21.15.81:46570) 2024-05-09T00:13:24.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcfe77fe700 1 -- 172.21.15.81:0/1878672910 learned_addr learned my addr 172.21.15.81:0/1878672910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcfe6ffd700 1 --2- 172.21.15.81:0/1878672910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e9e00 0x55fda23f9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcfe7fff700 1 --2- 172.21.15.81:0/1878672910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23ea720 0x55fda23db210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcfe77fe700 1 -- 172.21.15.81:0/1878672910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23ea720 msgr2=0x55fda23db210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcfe77fe700 1 --2- 172.21.15.81:0/1878672910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23ea720 0x55fda23db210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcfe77fe700 1 -- 172.21.15.81:0/1878672910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e9e00 msgr2=0x55fda23f9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcfe77fe700 1 --2- 172.21.15.81:0/1878672910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e9e00 0x55fda23f9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.205+0000 7fcfe77fe700 1 -- 172.21.15.81:0/1878672910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fda22fa560 con 0x55fda23e4890 2024-05-09T00:13:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.206+0000 7fcfe77fe700 1 --2- 172.21.15.81:0/1878672910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23e4890 0x55fda23e4c70 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0998d0 tx=0x7fcfdc005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7f6e46b244f6e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.206+0000 7fcfce7fc700 1 -- 172.21.15.81:0/1878672910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc0a2050 con 0x55fda23e4890 2024-05-09T00:13:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.206+0000 7fcfce7fc700 1 -- 172.21.15.81:0/1878672910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfdc014070 con 0x55fda23e4890 2024-05-09T00:13:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.206+0000 7fcfce7fc700 1 -- 172.21.15.81:0/1878672910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc09ae40 con 0x55fda23e4890 2024-05-09T00:13:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.206+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/1878672910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23e4890 msgr2=0x55fda23e4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.206+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/1878672910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23e4890 0x55fda23e4c70 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0998d0 tx=0x7fcfdc005770 comp rx=0 tx=0).stop 2024-05-09T00:13:24.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.206+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/1878672910 shutdown_connections 2024-05-09T00:13:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.206+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/1878672910 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23ea720 0x55fda23db210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.206+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/1878672910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23e4890 0x55fda23e4c70 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.206+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/1878672910 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e9e00 0x55fda23f9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.206+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/1878672910 >> 172.21.15.81:0/1878672910 conn(0x55fda2342210 msgr2=0x55fda23ed440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.206+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/1878672910 shutdown_connections 2024-05-09T00:13:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.206+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/1878672910 wait complete. 2024-05-09T00:13:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.207+0000 7fcff9ea4b80 1 -- start start 2024-05-09T00:13:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.207+0000 7fcff9ea4b80 1 Processor -- start 2024-05-09T00:13:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.207+0000 7fcff9ea4b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e4890 0x55fda23f3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.207+0000 7fcff9ea4b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23e9e00 0x55fda23f3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.207+0000 7fcff9ea4b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23ea720 0x55fda2453690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.207+0000 7fcff9ea4b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fda23f3fa0 con 0x55fda23ea720 2024-05-09T00:13:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.207+0000 7fcff9ea4b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fda2453bd0 con 0x55fda23e4890 2024-05-09T00:13:24.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.207+0000 7fcff9ea4b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fda2453d40 con 0x55fda23e9e00 2024-05-09T00:13:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.207+0000 7fcff9ea4b80 10 client.0 _ll_register_callbacks cb 0x55fda22d9b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.207+0000 7fcfe7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23ea720 0x55fda2453690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.207+0000 7fcfe7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23ea720 0x55fda2453690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46584/0 (socket says 172.21.15.81:46584) 2024-05-09T00:13:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.207+0000 7fcfe7fff700 1 -- 172.21.15.81:0/2465251358 learned_addr learned my addr 172.21.15.81:0/2465251358 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.207+0000 7fcfe6ffd700 1 --2- 172.21.15.81:0/2465251358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23e9e00 0x55fda23f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.207+0000 7fcfe77fe700 1 --2- 172.21.15.81:0/2465251358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e4890 0x55fda23f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcfe7fff700 1 -- 172.21.15.81:0/2465251358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23e9e00 msgr2=0x55fda23f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcfe7fff700 1 --2- 172.21.15.81:0/2465251358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23e9e00 0x55fda23f3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcfe7fff700 1 -- 172.21.15.81:0/2465251358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e4890 msgr2=0x55fda23f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcfe7fff700 1 --2- 172.21.15.81:0/2465251358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e4890 0x55fda23f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcfe7fff700 1 -- 172.21.15.81:0/2465251358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe81a6830 con 0x55fda23ea720 2024-05-09T00:13:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcfe77fe700 1 --2- 172.21.15.81:0/2465251358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e4890 0x55fda23f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:24.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcfe7fff700 1 --2- 172.21.15.81:0/2465251358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23ea720 0x55fda2453690 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0015000 tx=0x7fcfe00074e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e6ec3913a2d43d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcfc6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcfc6ffd700 1 -- 172.21.15.81:0/2465251358 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe000e040 con 0x55fda23ea720 2024-05-09T00:13:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcfc6ffd700 1 -- 172.21.15.81:0/2465251358 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fcfe000ba50 con 0x55fda23ea720 2024-05-09T00:13:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/2465251358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfd800e8f0 con 0x55fda23ea720 2024-05-09T00:13:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcfc6ffd700 1 -- 172.21.15.81:0/2465251358 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfe000bc30 con 0x55fda23ea720 2024-05-09T00:13:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcff9ea4b80 10 client.18459 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/2465251358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fda21b9cd0 con 0x55fda23ea720 2024-05-09T00:13:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcfc6ffd700 1 -- 172.21.15.81:0/2465251358 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfe0031020 con 0x55fda23ea720 2024-05-09T00:13:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcfc6ffd700 1 -- 172.21.15.81:0/2465251358 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcfe000b0d0 con 0x55fda23ea720 2024-05-09T00:13:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcff9ea4b80 10 client.18459 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcff9ea4b80 10 client.18459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcff9ea4b80 20 client.18459 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/2465251358 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fda2455540 0x55fda2457960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:24.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcff9ea4b80 4 client.18459 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.208+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/2465251358 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fda232cec0 con 0x55fda2455540 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.209+0000 7fcfe77fe700 1 --2- 172.21.15.81:0/2465251358 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fda2455540 0x55fda2457960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.209+0000 7fcfe77fe700 1 --2- 172.21.15.81:0/2465251358 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fda2455540 0x55fda2457960 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=294b3d9e704898f9 server_cookie=2f25ea0d07bb026b in_seq=0 out_seq=0 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.209+0000 7fcfc6ffd700 10 client.18459 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.209+0000 7fcfc6ffd700 1 -- 172.21.15.81:0/2465251358 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fda232cec0 con 0x55fda2455540 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.209+0000 7fcfc6ffd700 10 client.18459 handle_command_reply: tid=0 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.209+0000 7fcff9ea4b80 1 client.18459 shutdown 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.209+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/2465251358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23ea720 msgr2=0x55fda2453690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.209+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/2465251358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23ea720 0x55fda2453690 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0015000 tx=0x7fcfe00074e0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.209+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/2465251358 shutdown_connections 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.209+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/2465251358 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fda2455540 0x55fda2457960 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.209+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/2465251358 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fda23e4890 0x55fda23f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.209+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/2465251358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fda23ea720 0x55fda2453690 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.209+0000 7fcfc6ffd700 0 client.18459 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:24.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.209+0000 7fcff9ea4b80 1 --2- 172.21.15.81:0/2465251358 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fda23e9e00 0x55fda23f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/2465251358 >> 172.21.15.81:0/2465251358 conn(0x55fda2342210 msgr2=0x55fda23e8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:24.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/2465251358 shutdown_connections 2024-05-09T00:13:24.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcff9ea4b80 1 -- 172.21.15.81:0/2465251358 wait complete. 2024-05-09T00:13:24.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcff9ea4b80 20 client.18459 trim_cache size 0 max 16384 2024-05-09T00:13:24.214 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:13:24.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcfedcea700 1 -- 172.21.15.81:0/1534211582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcfd00a1310 msgr2=0x7fcfd00a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcfedcea700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcfd00a1310 0x7fcfd00a37d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8103200 tx=0x7fcfd8009260 comp rx=0 tx=0).stop 2024-05-09T00:13:24.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcfedcea700 1 -- 172.21.15.81:0/1534211582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe8100060 msgr2=0x7fcfe8101ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:24.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcfedcea700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe8100060 0x7fcfe8101ad0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00d980 tx=0x7fcfdc00dc90 comp rx=0 tx=0).stop 2024-05-09T00:13:24.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcfedcea700 1 -- 172.21.15.81:0/1534211582 shutdown_connections 2024-05-09T00:13:24.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcfedcea700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fcfd00a1310 0x7fcfd00a37d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcfedcea700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe8102550 0x7fcfe81a56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcfedcea700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe8100060 0x7fcfe8101ad0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcfedcea700 1 --2- 172.21.15.81:0/1534211582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fcfe8105160 0x7fcfe8102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:24.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcfedcea700 1 -- 172.21.15.81:0/1534211582 >> 172.21.15.81:0/1534211582 conn(0x7fcfe8076f40 msgr2=0x7fcfe8068370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:24.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcfedcea700 1 -- 172.21.15.81:0/1534211582 shutdown_connections 2024-05-09T00:13:24.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:24.210+0000 7fcfedcea700 1 -- 172.21.15.81:0/1534211582 wait complete. 2024-05-09T00:13:24.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:23 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/460542589' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:13:25.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:24 smithi171 ceph-mon[47351]: pgmap v324: 97 pgs: 97 active+clean; 3.6 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 48 KiB/s wr, 14 op/s 2024-05-09T00:13:25.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:24 smithi081 ceph-mon[42474]: pgmap v324: 97 pgs: 97 active+clean; 3.6 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 48 KiB/s wr, 14 op/s 2024-05-09T00:13:25.220 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:13:25.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:13:25.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:24 smithi150 ceph-mon[46187]: pgmap v324: 97 pgs: 97 active+clean; 3.6 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 48 KiB/s wr, 14 op/s 2024-05-09T00:13:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.363+0000 7fbecd92d700 1 -- 172.21.15.81:0/306474948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec81062a0 msgr2=0x7fbec810de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.363+0000 7fbecd92d700 1 --2- 172.21.15.81:0/306474948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec81062a0 0x7fbec810de20 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fbec000b0a0 tx=0x7fbec000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.363+0000 7fbecd92d700 1 -- 172.21.15.81:0/306474948 shutdown_connections 2024-05-09T00:13:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.363+0000 7fbecd92d700 1 --2- 172.21.15.81:0/306474948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec81062a0 0x7fbec810de20 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.363+0000 7fbecd92d700 1 --2- 172.21.15.81:0/306474948 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbec8069420 0x7fbec8069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.363+0000 7fbecd92d700 1 --2- 172.21.15.81:0/306474948 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec8069dd0 0x7fbec8105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.363+0000 7fbecd92d700 1 -- 172.21.15.81:0/306474948 >> 172.21.15.81:0/306474948 conn(0x7fbec8076ba0 msgr2=0x7fbec8076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:25.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.363+0000 7fbecd92d700 1 -- 172.21.15.81:0/306474948 shutdown_connections 2024-05-09T00:13:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.363+0000 7fbecd92d700 1 -- 172.21.15.81:0/306474948 wait complete. 2024-05-09T00:13:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.363+0000 7fbecd92d700 1 Processor -- start 2024-05-09T00:13:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbecd92d700 1 -- start start 2024-05-09T00:13:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbecd92d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec8069420 0x7fbec8197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbecd92d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec81062a0 0x7fbec8197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbecd92d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbec819bde0 0x7fbec819c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbecd92d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec819c860 con 0x7fbec81062a0 2024-05-09T00:13:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbecd92d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec819c9d0 con 0x7fbec8069420 2024-05-09T00:13:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbecd92d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec819cb90 con 0x7fbec819bde0 2024-05-09T00:13:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbec67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec81062a0 0x7fbec8197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbec67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec81062a0 0x7fbec8197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46600/0 (socket says 172.21.15.81:46600) 2024-05-09T00:13:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbec67fc700 1 -- 172.21.15.81:0/154195675 learned_addr learned my addr 172.21.15.81:0/154195675 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/154195675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec8069420 0x7fbec8197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbec67fc700 1 -- 172.21.15.81:0/154195675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbec819bde0 msgr2=0x7fbec819c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbec67fc700 1 --2- 172.21.15.81:0/154195675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbec819bde0 0x7fbec819c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbec67fc700 1 -- 172.21.15.81:0/154195675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec8069420 msgr2=0x7fbec8197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbec67fc700 1 --2- 172.21.15.81:0/154195675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec8069420 0x7fbec8197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbec67fc700 1 -- 172.21.15.81:0/154195675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec0009d00 con 0x7fbec81062a0 2024-05-09T00:13:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbec67fc700 1 --2- 172.21.15.81:0/154195675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec81062a0 0x7fbec8197a40 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800e970 tx=0x7fbeb800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.364+0000 7fbecc92b700 1 -- 172.21.15.81:0/154195675 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8009790 con 0x7fbec81062a0 2024-05-09T00:13:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.365+0000 7fbecd92d700 1 -- 172.21.15.81:0/154195675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec81a40f0 con 0x7fbec81062a0 2024-05-09T00:13:25.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.365+0000 7fbecc92b700 1 -- 172.21.15.81:0/154195675 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbeb8004cf0 con 0x7fbec81062a0 2024-05-09T00:13:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.365+0000 7fbecc92b700 1 -- 172.21.15.81:0/154195675 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8005680 con 0x7fbec81062a0 2024-05-09T00:13:25.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.365+0000 7fbecd92d700 1 -- 172.21.15.81:0/154195675 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec81a4620 con 0x7fbec81062a0 2024-05-09T00:13:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.367+0000 7fbecc92b700 1 -- 172.21.15.81:0/154195675 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fbeb8004750 con 0x7fbec81062a0 2024-05-09T00:13:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.368+0000 7fbecc92b700 1 --2- 172.21.15.81:0/154195675 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbeb00a1290 0x7fbeb00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.368+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/154195675 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbeb00a1290 0x7fbeb00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.368+0000 7fbecc92b700 1 -- 172.21.15.81:0/154195675 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fbeb8014070 con 0x7fbec81062a0 2024-05-09T00:13:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.368+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/154195675 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbeb00a1290 0x7fbeb00a3750 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbebc005fd0 tx=0x7fbebc00a560 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:25.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.368+0000 7fbed9ae7b80 1 Processor -- start 2024-05-09T00:13:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbed9ae7b80 1 -- start start 2024-05-09T00:13:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbed9ae7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f45e80 0x5569b4f46260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbed9ae7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 0x5569b4f403d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbed9ae7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f40910 0x5569b4f40d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbed9ae7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b4e971d0 con 0x5569b4f45e80 2024-05-09T00:13:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbed9ae7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b4e94b90 con 0x5569b4f467a0 2024-05-09T00:13:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbed9ae7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b4e90480 con 0x5569b4f40910 2024-05-09T00:13:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbec6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f45e80 0x5569b4f46260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbec6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f45e80 0x5569b4f46260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46612/0 (socket says 172.21.15.81:46612) 2024-05-09T00:13:25.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbec6ffd700 1 -- 172.21.15.81:0/3671443803 learned_addr learned my addr 172.21.15.81:0/3671443803 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbec6ffd700 1 -- 172.21.15.81:0/3671443803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f40910 msgr2=0x5569b4f40d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/3671443803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f40910 0x5569b4f40d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbec6ffd700 1 -- 172.21.15.81:0/3671443803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 msgr2=0x5569b4f403d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbec67fc700 1 --2- 172.21.15.81:0/3671443803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 0x5569b4f403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/3671443803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 0x5569b4f403d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbec6ffd700 1 -- 172.21.15.81:0/3671443803 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569b4d11430 con 0x5569b4f45e80 2024-05-09T00:13:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.369+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/3671443803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f45e80 0x5569b4f46260 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00ec80 tx=0x7fbebc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d917ae0c5eec2449 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.370+0000 7fbeadffb700 1 -- 172.21.15.81:0/3671443803 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc010cd0 con 0x5569b4f45e80 2024-05-09T00:13:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.370+0000 7fbeadffb700 1 -- 172.21.15.81:0/3671443803 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbebc010e30 con 0x5569b4f45e80 2024-05-09T00:13:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.370+0000 7fbeadffb700 1 -- 172.21.15.81:0/3671443803 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc00f7e0 con 0x5569b4f45e80 2024-05-09T00:13:25.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.370+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/3671443803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f45e80 msgr2=0x5569b4f46260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.370+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/3671443803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f45e80 0x5569b4f46260 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00ec80 tx=0x7fbebc011000 comp rx=0 tx=0).stop 2024-05-09T00:13:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.370+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/3671443803 shutdown_connections 2024-05-09T00:13:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.370+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/3671443803 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f40910 0x5569b4f40d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.370+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/3671443803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f45e80 0x5569b4f46260 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.370+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/3671443803 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 0x5569b4f403d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.370+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/3671443803 >> 172.21.15.81:0/3671443803 conn(0x5569b4e9e290 msgr2=0x5569b4f3ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.370+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/3671443803 shutdown_connections 2024-05-09T00:13:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.370+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/3671443803 wait complete. 2024-05-09T00:13:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.371+0000 7fbed9ae7b80 1 -- start start 2024-05-09T00:13:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.371+0000 7fbed9ae7b80 1 Processor -- start 2024-05-09T00:13:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.371+0000 7fbed9ae7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f40910 0x5569b4f49c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.371+0000 7fbed9ae7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f45e80 0x5569b4f4a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.371+0000 7fbed9ae7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f467a0 0x5569b4f4a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.371+0000 7fbed9ae7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b4e2c5e0 con 0x5569b4f467a0 2024-05-09T00:13:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.371+0000 7fbed9ae7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b4e2c280 con 0x5569b4f40910 2024-05-09T00:13:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.371+0000 7fbed9ae7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b4d13720 con 0x5569b4f45e80 2024-05-09T00:13:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.371+0000 7fbed9ae7b80 10 client.0 _ll_register_callbacks cb 0x5569b4e35bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.371+0000 7fbec77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f467a0 0x5569b4f4a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbec77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f467a0 0x5569b4f4a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46622/0 (socket says 172.21.15.81:46622) 2024-05-09T00:13:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbec77fe700 1 -- 172.21.15.81:0/3001185379 learned_addr learned my addr 172.21.15.81:0/3001185379 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbec67fc700 1 --2- 172.21.15.81:0/3001185379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f45e80 0x5569b4f4a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/3001185379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f40910 0x5569b4f49c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbec77fe700 1 -- 172.21.15.81:0/3001185379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f45e80 msgr2=0x5569b4f4a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbec77fe700 1 --2- 172.21.15.81:0/3001185379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f45e80 0x5569b4f4a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbec77fe700 1 -- 172.21.15.81:0/3001185379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f40910 msgr2=0x5569b4f49c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbec77fe700 1 --2- 172.21.15.81:0/3001185379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f40910 0x5569b4f49c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbec77fe700 1 -- 172.21.15.81:0/3001185379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc00e930 con 0x5569b4f467a0 2024-05-09T00:13:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/3001185379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f40910 0x5569b4f49c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbec77fe700 1 --2- 172.21.15.81:0/3001185379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f467a0 0x5569b4f4a6b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fbec0008e40 tx=0x7fbec0008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff5893b62334ee50 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbea6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbea6ffd700 1 -- 172.21.15.81:0/3001185379 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec000e040 con 0x5569b4f467a0 2024-05-09T00:13:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbea6ffd700 1 -- 172.21.15.81:0/3001185379 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fbec00074e0 con 0x5569b4f467a0 2024-05-09T00:13:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/3001185379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5569b4de92f0 con 0x5569b4f467a0 2024-05-09T00:13:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbea6ffd700 1 -- 172.21.15.81:0/3001185379 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbec00076a0 con 0x5569b4f467a0 2024-05-09T00:13:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbed9ae7b80 10 client.18471 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:25.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/3001185379 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5569b4cbdbe0 con 0x5569b4f467a0 2024-05-09T00:13:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.372+0000 7fbea6ffd700 1 -- 172.21.15.81:0/3001185379 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5569b4de92f0 con 0x5569b4f467a0 2024-05-09T00:13:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.373+0000 7fbea6ffd700 1 -- 172.21.15.81:0/3001185379 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbec0024060 con 0x5569b4f467a0 2024-05-09T00:13:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.373+0000 7fbed9ae7b80 10 client.18471 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.373+0000 7fbed9ae7b80 10 client.18471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.373+0000 7fbed9ae7b80 20 client.18471 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.373+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/3001185379 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5569b4f5a320 0x5569b4f5c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.373+0000 7fbed9ae7b80 4 client.18471 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.373+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/3001185379 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5569b4f0f890 con 0x5569b4f5a320 2024-05-09T00:13:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.373+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/3001185379 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5569b4f5a320 0x5569b4f5c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.373+0000 7fbea6ffd700 10 client.18471 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.373+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/3001185379 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5569b4f5a320 0x5569b4f5c740 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6774e238b7c2d3d server_cookie=2406e546f15243c7 in_seq=0 out_seq=0 2024-05-09T00:13:25.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbea6ffd700 1 -- 172.21.15.81:0/3001185379 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5569b4f0f890 con 0x5569b4f5a320 2024-05-09T00:13:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbea6ffd700 10 client.18471 handle_command_reply: tid=0 2024-05-09T00:13:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbed9ae7b80 1 client.18471 shutdown 2024-05-09T00:13:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/3001185379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f467a0 msgr2=0x5569b4f4a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/3001185379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f467a0 0x5569b4f4a6b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fbec0008e40 tx=0x7fbec0008e70 comp rx=0 tx=0).stop 2024-05-09T00:13:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/3001185379 shutdown_connections 2024-05-09T00:13:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/3001185379 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5569b4f5a320 0x5569b4f5c740 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/3001185379 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f40910 0x5569b4f49c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/3001185379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f467a0 0x5569b4f4a6b0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/3001185379 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f45e80 0x5569b4f4a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbea6ffd700 0 client.18471 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/3001185379 >> 172.21.15.81:0/3001185379 conn(0x5569b4e9e290 msgr2=0x5569b4f3a620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:25.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/3001185379 shutdown_connections 2024-05-09T00:13:25.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/3001185379 wait complete. 2024-05-09T00:13:25.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.374+0000 7fbed9ae7b80 20 client.18471 trim_cache size 0 max 16384 2024-05-09T00:13:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbed9ae7b80 1 Processor -- start 2024-05-09T00:13:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbed9ae7b80 1 -- start start 2024-05-09T00:13:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbed9ae7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f40910 0x5569b4f45450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbed9ae7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f45e80 0x5569b4f3ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbed9ae7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 0x5569b4f46c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbed9ae7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b4de92f0 con 0x5569b4f40910 2024-05-09T00:13:25.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbed9ae7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b4f3c830 con 0x5569b4f467a0 2024-05-09T00:13:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbed9ae7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b4f3bd60 con 0x5569b4f45e80 2024-05-09T00:13:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbec6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f40910 0x5569b4f45450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbec6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f40910 0x5569b4f45450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46632/0 (socket says 172.21.15.81:46632) 2024-05-09T00:13:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbec6ffd700 1 -- 172.21.15.81:0/475614665 learned_addr learned my addr 172.21.15.81:0/475614665 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbec67fc700 1 --2- 172.21.15.81:0/475614665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f45e80 0x5569b4f3ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbec6ffd700 1 -- 172.21.15.81:0/475614665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f45e80 msgr2=0x5569b4f3ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/475614665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f45e80 0x5569b4f3ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbec6ffd700 1 -- 172.21.15.81:0/475614665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 msgr2=0x5569b4f46c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbec77fe700 1 --2- 172.21.15.81:0/475614665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 0x5569b4f46c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/475614665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 0x5569b4f46c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbec6ffd700 1 -- 172.21.15.81:0/475614665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569b4e565e0 con 0x5569b4f40910 2024-05-09T00:13:25.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbec77fe700 1 --2- 172.21.15.81:0/475614665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 0x5569b4f46c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/475614665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f40910 0x5569b4f45450 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00ec20 tx=0x7fbebc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ac21e26d1b1a18 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.393+0000 7fbeae7fc700 1 -- 172.21.15.81:0/475614665 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0053c0 con 0x5569b4f40910 2024-05-09T00:13:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.394+0000 7fbeae7fc700 1 -- 172.21.15.81:0/475614665 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbebc02e040 con 0x5569b4f40910 2024-05-09T00:13:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.394+0000 7fbeae7fc700 1 -- 172.21.15.81:0/475614665 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0352d0 con 0x5569b4f40910 2024-05-09T00:13:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.394+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/475614665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f40910 msgr2=0x5569b4f45450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.394+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/475614665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f40910 0x5569b4f45450 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fbebc00ec20 tx=0x7fbebc014000 comp rx=0 tx=0).stop 2024-05-09T00:13:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.394+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/475614665 shutdown_connections 2024-05-09T00:13:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.394+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/475614665 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 0x5569b4f46c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.394+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/475614665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f40910 0x5569b4f45450 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.394+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/475614665 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f45e80 0x5569b4f3ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.394+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/475614665 >> 172.21.15.81:0/475614665 conn(0x5569b4e9e290 msgr2=0x5569b4f44d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.394+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/475614665 shutdown_connections 2024-05-09T00:13:25.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.394+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/475614665 wait complete. 2024-05-09T00:13:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.394+0000 7fbed9ae7b80 1 -- start start 2024-05-09T00:13:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbed9ae7b80 1 Processor -- start 2024-05-09T00:13:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbed9ae7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f40910 0x5569b4f4fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbed9ae7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f45e80 0x5569b4f50350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbed9ae7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 0x5569b4f50890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbed9ae7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b4fb0830 con 0x5569b4f45e80 2024-05-09T00:13:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbed9ae7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b4fb0970 con 0x5569b4f467a0 2024-05-09T00:13:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbed9ae7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b4fb0b00 con 0x5569b4f40910 2024-05-09T00:13:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbed9ae7b80 10 client.0 _ll_register_callbacks cb 0x5569b4e35bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbec67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f45e80 0x5569b4f50350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbec6ffd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f40910 0x5569b4f4fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbec6ffd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f40910 0x5569b4f4fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.81:47322/0 (socket says 172.21.15.81:47322) 2024-05-09T00:13:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbec6ffd700 1 -- 172.21.15.81:0/1833796344 learned_addr learned my addr 172.21.15.81:0/1833796344 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbec67fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f45e80 0x5569b4f50350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46638/0 (socket says 172.21.15.81:46638) 2024-05-09T00:13:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbec77fe700 1 --2- 172.21.15.81:0/1833796344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 0x5569b4f50890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbec6ffd700 1 -- 172.21.15.81:0/1833796344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 msgr2=0x5569b4f50890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/1833796344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 0x5569b4f50890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbec6ffd700 1 -- 172.21.15.81:0/1833796344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f45e80 msgr2=0x5569b4f50350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/1833796344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f45e80 0x5569b4f50350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbec6ffd700 1 -- 172.21.15.81:0/1833796344 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569b4d11430 con 0x5569b4f40910 2024-05-09T00:13:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.395+0000 7fbec67fc700 1 --2- 172.21.15.81:0/1833796344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f45e80 0x5569b4f50350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:13:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbec6ffd700 1 --2- 172.21.15.81:0/1833796344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f40910 0x5569b4f4fe10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbebc010c60 tx=0x7fbebc004e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7afc4c6aa80be6a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbea6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.171:3300/0 2024-05-09T00:13:25.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbea6ffd700 1 -- 172.21.15.81:0/1833796344 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc0051c0 con 0x5569b4f40910 2024-05-09T00:13:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbea6ffd700 1 -- 172.21.15.81:0/1833796344 <== mon.1 v2:172.21.15.171:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fbebc005320 con 0x5569b4f40910 2024-05-09T00:13:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/1833796344 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbebc010e30 con 0x5569b4f40910 2024-05-09T00:13:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbea6ffd700 1 -- 172.21.15.81:0/1833796344 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbebc0054e0 con 0x5569b4f40910 2024-05-09T00:13:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbed9ae7b80 10 client.26989 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/1833796344 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5569b4d15d50 con 0x5569b4f40910 2024-05-09T00:13:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbea6ffd700 1 -- 172.21.15.81:0/1833796344 <== mon.1 v2:172.21.15.171:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbebc010e30 con 0x5569b4f40910 2024-05-09T00:13:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbea6ffd700 1 -- 172.21.15.81:0/1833796344 <== mon.1 v2:172.21.15.171:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbebc01d4e0 con 0x5569b4f40910 2024-05-09T00:13:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbed9ae7b80 10 client.26989 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbed9ae7b80 10 client.26989 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbed9ae7b80 20 client.26989 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/1833796344 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5569b4fb1e40 0x5569b4fb4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbed9ae7b80 4 client.26989 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:13:25.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.396+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/1833796344 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5569b4e88f40 con 0x5569b4fb1e40 2024-05-09T00:13:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.397+0000 7fbec67fc700 1 --2- 172.21.15.81:0/1833796344 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5569b4fb1e40 0x5569b4fb4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.397+0000 7fbec67fc700 1 --2- 172.21.15.81:0/1833796344 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5569b4fb1e40 0x5569b4fb4260 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84acf29d5a26cc04 server_cookie=ed9598793a47c3d0 in_seq=0 out_seq=0 2024-05-09T00:13:25.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.397+0000 7fbea6ffd700 10 client.26989 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:25.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbea6ffd700 1 -- 172.21.15.81:0/1833796344 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5569b4e88f40 con 0x5569b4fb1e40 2024-05-09T00:13:25.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbea6ffd700 10 client.26989 handle_command_reply: tid=0 2024-05-09T00:13:25.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbed9ae7b80 1 client.26989 shutdown 2024-05-09T00:13:25.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/1833796344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f40910 msgr2=0x5569b4f4fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/1833796344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f40910 0x5569b4f4fe10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbebc010c60 tx=0x7fbebc004e60 comp rx=0 tx=0).stop 2024-05-09T00:13:25.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/1833796344 shutdown_connections 2024-05-09T00:13:25.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/1833796344 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5569b4fb1e40 0x5569b4fb4260 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/1833796344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5569b4f467a0 0x5569b4f50890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/1833796344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5569b4f40910 0x5569b4f4fe10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbed9ae7b80 1 --2- 172.21.15.81:0/1833796344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5569b4f45e80 0x5569b4f50350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbea6ffd700 0 client.26989 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:25.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/1833796344 >> 172.21.15.81:0/1833796344 conn(0x5569b4e9e290 msgr2=0x5569b4f48980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:25.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/1833796344 shutdown_connections 2024-05-09T00:13:25.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbed9ae7b80 1 -- 172.21.15.81:0/1833796344 wait complete. 2024-05-09T00:13:25.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbed9ae7b80 20 client.26989 trim_cache size 0 max 16384 2024-05-09T00:13:25.403 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:13:25.403 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:13:25.404 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "13ceecb2-3e50-404e-a7eb-01d07f8f1f5f", 2024-05-09T00:13:25.404 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:13:25.404 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:13:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbecd92d700 1 -- 172.21.15.81:0/154195675 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbeb00a1290 msgr2=0x7fbeb00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbecd92d700 1 --2- 172.21.15.81:0/154195675 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbeb00a1290 0x7fbeb00a3750 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbebc005fd0 tx=0x7fbebc00a560 comp rx=0 tx=0).stop 2024-05-09T00:13:25.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbecd92d700 1 -- 172.21.15.81:0/154195675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec81062a0 msgr2=0x7fbec8197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbecd92d700 1 --2- 172.21.15.81:0/154195675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec81062a0 0x7fbec8197a40 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800e970 tx=0x7fbeb800ed30 comp rx=0 tx=0).stop 2024-05-09T00:13:25.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.399+0000 7fbecd92d700 1 -- 172.21.15.81:0/154195675 shutdown_connections 2024-05-09T00:13:25.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.400+0000 7fbecd92d700 1 --2- 172.21.15.81:0/154195675 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fbeb00a1290 0x7fbeb00a3750 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.400+0000 7fbecd92d700 1 --2- 172.21.15.81:0/154195675 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fbec8069420 0x7fbec8197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.400+0000 7fbecd92d700 1 --2- 172.21.15.81:0/154195675 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbec819bde0 0x7fbec819c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.400+0000 7fbecd92d700 1 --2- 172.21.15.81:0/154195675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbec81062a0 0x7fbec8197a40 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.400+0000 7fbecd92d700 1 -- 172.21.15.81:0/154195675 >> 172.21.15.81:0/154195675 conn(0x7fbec8076ba0 msgr2=0x7fbec80ff870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:25.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.400+0000 7fbecd92d700 1 -- 172.21.15.81:0/154195675 shutdown_connections 2024-05-09T00:13:25.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.400+0000 7fbecd92d700 1 -- 172.21.15.81:0/154195675 wait complete. 2024-05-09T00:13:25.409 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:13:25.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.535+0000 7f47007a9700 1 -- 172.21.15.81:0/3949581738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46f8105160 msgr2=0x7f46f810cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.535+0000 7f47007a9700 1 --2- 172.21.15.81:0/3949581738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46f8105160 0x7f46f810cce0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f46f000b0a0 tx=0x7f46f000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.535+0000 7f47007a9700 1 -- 172.21.15.81:0/3949581738 shutdown_connections 2024-05-09T00:13:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.535+0000 7f47007a9700 1 --2- 172.21.15.81:0/3949581738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46f8105160 0x7f46f810cce0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.535+0000 7f47007a9700 1 --2- 172.21.15.81:0/3949581738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46f8100060 0x7f46f8100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.535+0000 7f47007a9700 1 --2- 172.21.15.81:0/3949581738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46f8100a10 0x7f46f8104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.535+0000 7f47007a9700 1 -- 172.21.15.81:0/3949581738 >> 172.21.15.81:0/3949581738 conn(0x7f46f8076f40 msgr2=0x7f46f8077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.535+0000 7f47007a9700 1 -- 172.21.15.81:0/3949581738 shutdown_connections 2024-05-09T00:13:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.535+0000 7f47007a9700 1 -- 172.21.15.81:0/3949581738 wait complete. 2024-05-09T00:13:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f47007a9700 1 Processor -- start 2024-05-09T00:13:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f47007a9700 1 -- start start 2024-05-09T00:13:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f47007a9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46f8100060 0x7f46f8198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f47007a9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46f8105160 0x7f46f8198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f47007a9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46f8198d90 0x7f46f81a3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f47007a9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f81a3a30 con 0x7f46f8105160 2024-05-09T00:13:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f47007a9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f81a3ba0 con 0x7f46f8198d90 2024-05-09T00:13:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f47007a9700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f81a3d60 con 0x7f46f8100060 2024-05-09T00:13:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f46fdd44700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46f8105160 0x7f46f8198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f46fdd44700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46f8105160 0x7f46f8198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46666/0 (socket says 172.21.15.81:46666) 2024-05-09T00:13:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f46fdd44700 1 -- 172.21.15.81:0/1357782466 learned_addr learned my addr 172.21.15.81:0/1357782466 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f46fe545700 1 --2- 172.21.15.81:0/1357782466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46f8100060 0x7f46f8198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f46fed46700 1 --2- 172.21.15.81:0/1357782466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46f8198d90 0x7f46f81a3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f46fdd44700 1 -- 172.21.15.81:0/1357782466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46f8100060 msgr2=0x7f46f8198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f46fdd44700 1 --2- 172.21.15.81:0/1357782466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46f8100060 0x7f46f8198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f46fdd44700 1 -- 172.21.15.81:0/1357782466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46f8198d90 msgr2=0x7f46f81a3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f46fdd44700 1 --2- 172.21.15.81:0/1357782466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46f8198d90 0x7f46f81a3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.536+0000 7f46fdd44700 1 -- 172.21.15.81:0/1357782466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f0009d00 con 0x7f46f8105160 2024-05-09T00:13:25.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.537+0000 7f46fdd44700 1 --2- 172.21.15.81:0/1357782466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46f8105160 0x7f46f8198850 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f46f400d980 tx=0x7f46f400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:25.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.537+0000 7f46eb7fe700 1 -- 172.21.15.81:0/1357782466 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4009930 con 0x7f46f8105160 2024-05-09T00:13:25.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.537+0000 7f46eb7fe700 1 -- 172.21.15.81:0/1357782466 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46f4010460 con 0x7f46f8105160 2024-05-09T00:13:25.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.537+0000 7f46eb7fe700 1 -- 172.21.15.81:0/1357782466 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f400f620 con 0x7f46f8105160 2024-05-09T00:13:25.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.537+0000 7f47007a9700 1 -- 172.21.15.81:0/1357782466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f81a3fe0 con 0x7f46f8105160 2024-05-09T00:13:25.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.537+0000 7f47007a9700 1 -- 172.21.15.81:0/1357782466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f81a44c0 con 0x7f46f8105160 2024-05-09T00:13:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.539+0000 7f46eb7fe700 1 -- 172.21.15.81:0/1357782466 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f46f40108d0 con 0x7f46f8105160 2024-05-09T00:13:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.539+0000 7f46eb7fe700 1 --2- 172.21.15.81:0/1357782466 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f46e40a1310 0x7f46e40a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.539+0000 7f46eb7fe700 1 -- 172.21.15.81:0/1357782466 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f46f40cc6c0 con 0x7f46f8105160 2024-05-09T00:13:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.540+0000 7f46fe545700 1 --2- 172.21.15.81:0/1357782466 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f46e40a1310 0x7f46e40a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.540+0000 7f46fe545700 1 --2- 172.21.15.81:0/1357782466 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f46e40a1310 0x7f46e40a37d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f46ec005950 tx=0x7f46ec00b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.540+0000 7f470c963b80 1 Processor -- start 2024-05-09T00:13:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.540+0000 7f470c963b80 1 -- start start 2024-05-09T00:13:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f470c963b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e45e00 0x55a0e0e461e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f470c963b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e46720 0x55a0e0e40350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f470c963b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e40890 0x55a0e0e40cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f470c963b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e0d97150 con 0x55a0e0e45e00 2024-05-09T00:13:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f470c963b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e0d94b10 con 0x55a0e0e46720 2024-05-09T00:13:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f470c963b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e0d90400 con 0x55a0e0e40890 2024-05-09T00:13:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f46fe545700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e45e00 0x55a0e0e461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f46fe545700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e45e00 0x55a0e0e461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46668/0 (socket says 172.21.15.81:46668) 2024-05-09T00:13:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f46fe545700 1 -- 172.21.15.81:0/2021808648 learned_addr learned my addr 172.21.15.81:0/2021808648 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f46fdd44700 1 --2- 172.21.15.81:0/2021808648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e46720 0x55a0e0e40350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f46fed46700 1 --2- 172.21.15.81:0/2021808648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e40890 0x55a0e0e40cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f46fe545700 1 -- 172.21.15.81:0/2021808648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e40890 msgr2=0x55a0e0e40cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f46fe545700 1 --2- 172.21.15.81:0/2021808648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e40890 0x55a0e0e40cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f46fe545700 1 -- 172.21.15.81:0/2021808648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e46720 msgr2=0x55a0e0e40350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f46fe545700 1 --2- 172.21.15.81:0/2021808648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e46720 0x55a0e0e40350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f46fe545700 1 -- 172.21.15.81:0/2021808648 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0e0c113b0 con 0x55a0e0e45e00 2024-05-09T00:13:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f46fe545700 1 --2- 172.21.15.81:0/2021808648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e45e00 0x55a0e0e461e0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f46ec010fa0 tx=0x7f46ec013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7040daaca2a736c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f46e8ff9700 1 -- 172.21.15.81:0/2021808648 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec01e620 con 0x55a0e0e45e00 2024-05-09T00:13:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f46e8ff9700 1 -- 172.21.15.81:0/2021808648 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46ec015070 con 0x55a0e0e45e00 2024-05-09T00:13:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.541+0000 7f46e8ff9700 1 -- 172.21.15.81:0/2021808648 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec01ca20 con 0x55a0e0e45e00 2024-05-09T00:13:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.542+0000 7f470c963b80 1 -- 172.21.15.81:0/2021808648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e45e00 msgr2=0x55a0e0e461e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.542+0000 7f470c963b80 1 --2- 172.21.15.81:0/2021808648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e45e00 0x55a0e0e461e0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f46ec010fa0 tx=0x7f46ec013000 comp rx=0 tx=0).stop 2024-05-09T00:13:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.542+0000 7f470c963b80 1 -- 172.21.15.81:0/2021808648 shutdown_connections 2024-05-09T00:13:25.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.542+0000 7f470c963b80 1 --2- 172.21.15.81:0/2021808648 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e40890 0x55a0e0e40cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.542+0000 7f470c963b80 1 --2- 172.21.15.81:0/2021808648 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e45e00 0x55a0e0e461e0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.542+0000 7f470c963b80 1 --2- 172.21.15.81:0/2021808648 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e46720 0x55a0e0e40350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.542+0000 7f470c963b80 1 -- 172.21.15.81:0/2021808648 >> 172.21.15.81:0/2021808648 conn(0x55a0e0d9e210 msgr2=0x55a0e0e3adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:25.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.542+0000 7f470c963b80 1 -- 172.21.15.81:0/2021808648 shutdown_connections 2024-05-09T00:13:25.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.542+0000 7f470c963b80 1 -- 172.21.15.81:0/2021808648 wait complete. 2024-05-09T00:13:25.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.542+0000 7f470c963b80 1 -- start start 2024-05-09T00:13:25.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f470c963b80 1 Processor -- start 2024-05-09T00:13:25.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f470c963b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e40890 0x55a0e0e49a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f470c963b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e45e00 0x55a0e0e49f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f470c963b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e46720 0x55a0e0e4a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f470c963b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e0d2c560 con 0x55a0e0e40890 2024-05-09T00:13:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f470c963b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e0d2c200 con 0x55a0e0e45e00 2024-05-09T00:13:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f470c963b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e0c136a0 con 0x55a0e0e46720 2024-05-09T00:13:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f470c963b80 10 client.0 _ll_register_callbacks cb 0x55a0e0d35b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f46fe545700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e40890 0x55a0e0e49a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f46fe545700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e40890 0x55a0e0e49a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46674/0 (socket says 172.21.15.81:46674) 2024-05-09T00:13:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f46fe545700 1 -- 172.21.15.81:0/3338617009 learned_addr learned my addr 172.21.15.81:0/3338617009 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f46fdd44700 1 --2- 172.21.15.81:0/3338617009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e45e00 0x55a0e0e49f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f46fed46700 1 --2- 172.21.15.81:0/3338617009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e46720 0x55a0e0e4a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f46fe545700 1 -- 172.21.15.81:0/3338617009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e46720 msgr2=0x55a0e0e4a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f46fe545700 1 --2- 172.21.15.81:0/3338617009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e46720 0x55a0e0e4a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f46fe545700 1 -- 172.21.15.81:0/3338617009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e45e00 msgr2=0x55a0e0e49f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f46fe545700 1 --2- 172.21.15.81:0/3338617009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e45e00 0x55a0e0e49f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f46fe545700 1 -- 172.21.15.81:0/3338617009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec010c50 con 0x55a0e0e40890 2024-05-09T00:13:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f46fe545700 1 --2- 172.21.15.81:0/3338617009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e40890 0x55a0e0e49a00 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f46ec010a40 tx=0x7f46ec01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99211700328b9a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.543+0000 7f46e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f46e1ffb700 1 -- 172.21.15.81:0/3338617009 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ec02c070 con 0x55a0e0e40890 2024-05-09T00:13:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f46e1ffb700 1 -- 172.21.15.81:0/3338617009 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f46ec017070 con 0x55a0e0e40890 2024-05-09T00:13:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f470c963b80 1 -- 172.21.15.81:0/3338617009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a0e0ce9270 con 0x55a0e0e40890 2024-05-09T00:13:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f46e1ffb700 1 -- 172.21.15.81:0/3338617009 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46ec01cd50 con 0x55a0e0e40890 2024-05-09T00:13:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f470c963b80 10 client.18489 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f470c963b80 1 -- 172.21.15.81:0/3338617009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a0e0bbdb60 con 0x55a0e0e40890 2024-05-09T00:13:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f46e1ffb700 1 -- 172.21.15.81:0/3338617009 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46ec03e020 con 0x55a0e0e40890 2024-05-09T00:13:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f46e1ffb700 1 -- 172.21.15.81:0/3338617009 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f46ec0263f0 con 0x55a0e0e40890 2024-05-09T00:13:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f470c963b80 10 client.18489 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f470c963b80 10 client.18489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f470c963b80 20 client.18489 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:25.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f470c963b80 1 --2- 172.21.15.81:0/3338617009 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a0e0e5a070 0x55a0e0e5c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f470c963b80 4 client.18489 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f470c963b80 1 -- 172.21.15.81:0/3338617009 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a0e0e0f810 con 0x55a0e0e5a070 2024-05-09T00:13:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.544+0000 7f46fdd44700 1 --2- 172.21.15.81:0/3338617009 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a0e0e5a070 0x55a0e0e5c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.545+0000 7f46fdd44700 1 --2- 172.21.15.81:0/3338617009 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a0e0e5a070 0x55a0e0e5c460 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23e944f6bfb8bae3 server_cookie=4c35e04c195b0ebd in_seq=0 out_seq=0 2024-05-09T00:13:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.545+0000 7f46e1ffb700 10 client.18489 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.545+0000 7f46e1ffb700 1 -- 172.21.15.81:0/3338617009 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a0e0e0f810 con 0x55a0e0e5a070 2024-05-09T00:13:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.545+0000 7f46e1ffb700 10 client.18489 handle_command_reply: tid=0 2024-05-09T00:13:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.546+0000 7f470c963b80 1 client.18489 shutdown 2024-05-09T00:13:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.546+0000 7f470c963b80 1 -- 172.21.15.81:0/3338617009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e40890 msgr2=0x55a0e0e49a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.546+0000 7f470c963b80 1 --2- 172.21.15.81:0/3338617009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e40890 0x55a0e0e49a00 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f46ec010a40 tx=0x7f46ec01c8e0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.546+0000 7f470c963b80 1 -- 172.21.15.81:0/3338617009 shutdown_connections 2024-05-09T00:13:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.546+0000 7f470c963b80 1 --2- 172.21.15.81:0/3338617009 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a0e0e5a070 0x55a0e0e5c460 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.546+0000 7f470c963b80 1 --2- 172.21.15.81:0/3338617009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e46720 0x55a0e0e4a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.546+0000 7f470c963b80 1 --2- 172.21.15.81:0/3338617009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e40890 0x55a0e0e49a00 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.546+0000 7f46e1ffb700 0 client.18489 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:25.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.546+0000 7f470c963b80 1 --2- 172.21.15.81:0/3338617009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e45e00 0x55a0e0e49f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.546+0000 7f470c963b80 1 -- 172.21.15.81:0/3338617009 >> 172.21.15.81:0/3338617009 conn(0x55a0e0d9e210 msgr2=0x55a0e0e3a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:25.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.546+0000 7f470c963b80 1 -- 172.21.15.81:0/3338617009 shutdown_connections 2024-05-09T00:13:25.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.546+0000 7f470c963b80 1 -- 172.21.15.81:0/3338617009 wait complete. 2024-05-09T00:13:25.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.546+0000 7f470c963b80 20 client.18489 trim_cache size 0 max 16384 2024-05-09T00:13:25.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f470c963b80 1 Processor -- start 2024-05-09T00:13:25.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f470c963b80 1 -- start start 2024-05-09T00:13:25.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f470c963b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e40890 0x55a0e0e40350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f470c963b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e45e00 0x55a0e0e3ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f470c963b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e46720 0x55a0e0e4a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f470c963b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e0e4cd10 con 0x55a0e0e46720 2024-05-09T00:13:25.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f470c963b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e0e3bf80 con 0x55a0e0e40890 2024-05-09T00:13:25.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f470c963b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e0e461e0 con 0x55a0e0e45e00 2024-05-09T00:13:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f46fed46700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e46720 0x55a0e0e4a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f46fe545700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e40890 0x55a0e0e40350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f46fed46700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e46720 0x55a0e0e4a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46682/0 (socket says 172.21.15.81:46682) 2024-05-09T00:13:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f46fed46700 1 -- 172.21.15.81:0/414010451 learned_addr learned my addr 172.21.15.81:0/414010451 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f46fdd44700 1 --2- 172.21.15.81:0/414010451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e45e00 0x55a0e0e3ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f46fed46700 1 -- 172.21.15.81:0/414010451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e45e00 msgr2=0x55a0e0e3ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f46fed46700 1 --2- 172.21.15.81:0/414010451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e45e00 0x55a0e0e3ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f46fed46700 1 -- 172.21.15.81:0/414010451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e40890 msgr2=0x55a0e0e40350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f46fed46700 1 --2- 172.21.15.81:0/414010451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e40890 0x55a0e0e40350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f46fed46700 1 -- 172.21.15.81:0/414010451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0e0d56560 con 0x55a0e0e46720 2024-05-09T00:13:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.563+0000 7f46fdd44700 1 --2- 172.21.15.81:0/414010451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e45e00 0x55a0e0e3ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.564+0000 7f46fed46700 1 --2- 172.21.15.81:0/414010451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e46720 0x55a0e0e4a2a0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009c40 tx=0x7f46f0009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26fe86ca848d4155 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.564+0000 7f46e97fa700 1 -- 172.21.15.81:0/414010451 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f000e040 con 0x55a0e0e46720 2024-05-09T00:13:25.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.564+0000 7f46e97fa700 1 -- 172.21.15.81:0/414010451 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46f0007de0 con 0x55a0e0e46720 2024-05-09T00:13:25.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.564+0000 7f46e97fa700 1 -- 172.21.15.81:0/414010451 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f0005040 con 0x55a0e0e46720 2024-05-09T00:13:25.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.564+0000 7f470c963b80 1 -- 172.21.15.81:0/414010451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e46720 msgr2=0x55a0e0e4a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.564+0000 7f470c963b80 1 --2- 172.21.15.81:0/414010451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e46720 0x55a0e0e4a2a0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009c40 tx=0x7f46f0009c70 comp rx=0 tx=0).stop 2024-05-09T00:13:25.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.564+0000 7f470c963b80 1 -- 172.21.15.81:0/414010451 shutdown_connections 2024-05-09T00:13:25.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.564+0000 7f470c963b80 1 --2- 172.21.15.81:0/414010451 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e40890 0x55a0e0e40350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.564+0000 7f470c963b80 1 --2- 172.21.15.81:0/414010451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e46720 0x55a0e0e4a2a0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.564+0000 7f470c963b80 1 --2- 172.21.15.81:0/414010451 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e45e00 0x55a0e0e3ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.564+0000 7f470c963b80 1 -- 172.21.15.81:0/414010451 >> 172.21.15.81:0/414010451 conn(0x55a0e0d9e210 msgr2=0x55a0e0e482d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:25.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.564+0000 7f470c963b80 1 -- 172.21.15.81:0/414010451 shutdown_connections 2024-05-09T00:13:25.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.564+0000 7f470c963b80 1 -- 172.21.15.81:0/414010451 wait complete. 2024-05-09T00:13:25.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f470c963b80 1 -- start start 2024-05-09T00:13:25.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f470c963b80 1 Processor -- start 2024-05-09T00:13:25.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f470c963b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e40890 0x55a0e0e51400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f470c963b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e45e00 0x55a0e0e4f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f470c963b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e46720 0x55a0e0e4fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f470c963b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e0e50380 con 0x55a0e0e46720 2024-05-09T00:13:25.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f470c963b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e0e504f0 con 0x55a0e0e40890 2024-05-09T00:13:25.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f470c963b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0e0e506b0 con 0x55a0e0e45e00 2024-05-09T00:13:25.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f470c963b80 10 client.0 _ll_register_callbacks cb 0x55a0e0d35b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:25.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f46fed46700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e46720 0x55a0e0e4fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f46fdd44700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e45e00 0x55a0e0e4f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f46fed46700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e46720 0x55a0e0e4fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46692/0 (socket says 172.21.15.81:46692) 2024-05-09T00:13:25.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f46fed46700 1 -- 172.21.15.81:0/1473891234 learned_addr learned my addr 172.21.15.81:0/1473891234 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:25.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f46fe545700 1 --2- 172.21.15.81:0/1473891234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e40890 0x55a0e0e51400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f46fed46700 1 -- 172.21.15.81:0/1473891234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e45e00 msgr2=0x55a0e0e4f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f46fed46700 1 --2- 172.21.15.81:0/1473891234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e45e00 0x55a0e0e4f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f46fed46700 1 -- 172.21.15.81:0/1473891234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e40890 msgr2=0x55a0e0e51400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:25.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f46fed46700 1 --2- 172.21.15.81:0/1473891234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e40890 0x55a0e0e51400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.565+0000 7f46fed46700 1 -- 172.21.15.81:0/1473891234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f810d550 con 0x55a0e0e46720 2024-05-09T00:13:25.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f46fed46700 1 --2- 172.21.15.81:0/1473891234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e46720 0x55a0e0e4fdb0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009c10 tx=0x7f46f0004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f15e0658e600cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:25.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f46e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:25.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f46e1ffb700 1 -- 172.21.15.81:0/1473891234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f000e070 con 0x55a0e0e46720 2024-05-09T00:13:25.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f46e1ffb700 1 -- 172.21.15.81:0/1473891234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f46f00090d0 con 0x55a0e0e46720 2024-05-09T00:13:25.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f470c963b80 1 -- 172.21.15.81:0/1473891234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46ec015070 con 0x55a0e0e46720 2024-05-09T00:13:25.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f46e1ffb700 1 -- 172.21.15.81:0/1473891234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46f0009290 con 0x55a0e0e46720 2024-05-09T00:13:25.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f470c963b80 10 client.18495 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:25.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f470c963b80 1 -- 172.21.15.81:0/1473891234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a0e0c15cd0 con 0x55a0e0e46720 2024-05-09T00:13:25.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f46e1ffb700 1 -- 172.21.15.81:0/1473891234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46ec015070 con 0x55a0e0e46720 2024-05-09T00:13:25.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f46e1ffb700 1 -- 172.21.15.81:0/1473891234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f46f0024030 con 0x55a0e0e46720 2024-05-09T00:13:25.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f470c963b80 10 client.18495 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:25.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f470c963b80 10 client.18495 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:25.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f470c963b80 20 client.18495 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:25.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f470c963b80 1 --2- 172.21.15.81:0/1473891234 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a0e0eb17c0 0x55a0e0eb3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:25.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f470c963b80 4 client.18495 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:13:25.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.566+0000 7f470c963b80 1 -- 172.21.15.81:0/1473891234 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a0e0d88ec0 con 0x55a0e0eb17c0 2024-05-09T00:13:25.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f46fe545700 1 --2- 172.21.15.81:0/1473891234 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a0e0eb17c0 0x55a0e0eb3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:25.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f46e1ffb700 10 client.18495 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:25.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f46fe545700 1 --2- 172.21.15.81:0/1473891234 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a0e0eb17c0 0x55a0e0eb3bb0 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b6b26118175bc66 server_cookie=9db74e44640c1a9f in_seq=0 out_seq=0 2024-05-09T00:13:25.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f46e1ffb700 1 -- 172.21.15.81:0/1473891234 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a0e0d88ec0 con 0x55a0e0eb17c0 2024-05-09T00:13:25.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f46e1ffb700 10 client.18495 handle_command_reply: tid=0 2024-05-09T00:13:25.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f470c963b80 1 client.18495 shutdown 2024-05-09T00:13:25.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f470c963b80 1 -- 172.21.15.81:0/1473891234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e46720 msgr2=0x55a0e0e4fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f470c963b80 1 --2- 172.21.15.81:0/1473891234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e46720 0x55a0e0e4fdb0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009c10 tx=0x7f46f0004c80 comp rx=0 tx=0).stop 2024-05-09T00:13:25.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f470c963b80 1 -- 172.21.15.81:0/1473891234 shutdown_connections 2024-05-09T00:13:25.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f470c963b80 1 --2- 172.21.15.81:0/1473891234 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55a0e0eb17c0 0x55a0e0eb3bb0 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f470c963b80 1 --2- 172.21.15.81:0/1473891234 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55a0e0e40890 0x55a0e0e51400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f46e1ffb700 0 client.18495 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:25.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f470c963b80 1 --2- 172.21.15.81:0/1473891234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e0e46720 0x55a0e0e4fdb0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f470c963b80 1 --2- 172.21.15.81:0/1473891234 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55a0e0e45e00 0x55a0e0e4f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f470c963b80 1 -- 172.21.15.81:0/1473891234 >> 172.21.15.81:0/1473891234 conn(0x55a0e0d9e210 msgr2=0x55a0e0e46b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:25.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f470c963b80 1 -- 172.21.15.81:0/1473891234 shutdown_connections 2024-05-09T00:13:25.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f470c963b80 1 -- 172.21.15.81:0/1473891234 wait complete. 2024-05-09T00:13:25.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.567+0000 7f470c963b80 20 client.18495 trim_cache size 0 max 16384 2024-05-09T00:13:25.573 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:13:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:13:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:13:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: "13ceecb2-3e50-404e-a7eb-01d07f8f1f5f": { 2024-05-09T00:13:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:13:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "13ceecb2-3e50-404e-a7eb-01d07f8f1f5f", 2024-05-09T00:13:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:13:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:13:25.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:13:25.573 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:13:25.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.568+0000 7f47007a9700 1 -- 172.21.15.81:0/1357782466 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f46e40a1310 msgr2=0x7f46e40a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.568+0000 7f47007a9700 1 --2- 172.21.15.81:0/1357782466 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f46e40a1310 0x7f46e40a37d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f46ec005950 tx=0x7f46ec00b410 comp rx=0 tx=0).stop 2024-05-09T00:13:25.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.568+0000 7f47007a9700 1 -- 172.21.15.81:0/1357782466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46f8105160 msgr2=0x7f46f8198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:25.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.568+0000 7f47007a9700 1 --2- 172.21.15.81:0/1357782466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46f8105160 0x7f46f8198850 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f46f400d980 tx=0x7f46f400dc90 comp rx=0 tx=0).stop 2024-05-09T00:13:25.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.568+0000 7f47007a9700 1 -- 172.21.15.81:0/1357782466 shutdown_connections 2024-05-09T00:13:25.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.568+0000 7f47007a9700 1 --2- 172.21.15.81:0/1357782466 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f46e40a1310 0x7f46e40a37d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.568+0000 7f47007a9700 1 --2- 172.21.15.81:0/1357782466 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f46f8198d90 0x7f46f81a3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.568+0000 7f47007a9700 1 --2- 172.21.15.81:0/1357782466 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46f8100060 0x7f46f8198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.568+0000 7f47007a9700 1 --2- 172.21.15.81:0/1357782466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46f8105160 0x7f46f8198850 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.568+0000 7f47007a9700 1 -- 172.21.15.81:0/1357782466 >> 172.21.15.81:0/1357782466 conn(0x7f46f8076f40 msgr2=0x7f46f80fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.568+0000 7f47007a9700 1 -- 172.21.15.81:0/1357782466 shutdown_connections 2024-05-09T00:13:25.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:25.568+0000 7f47007a9700 1 -- 172.21.15.81:0/1357782466 wait complete. 2024-05-09T00:13:25.577 INFO:tasks.cephfs.filesystem:scrub status for tag:13ceecb2-3e50-404e-a7eb-01d07f8f1f5f - {'path': '/', 'tag': '13ceecb2-3e50-404e-a7eb-01d07f8f1f5f', 'options': 'recursive,force'} 2024-05-09T00:13:25.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:25 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:13:25.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:25 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:13:25.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:25 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:13:25.873 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:25 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:13:26.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:25 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:13:26.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:25 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:13:26.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:25 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:13:26.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:25 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:13:26.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:25 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:13:26.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:25 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:13:26.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:25 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:13:26.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:25 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:13:27.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:26 smithi171 ceph-mon[47351]: pgmap v325: 97 pgs: 97 active+clean; 3.8 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-05-09T00:13:27.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:26 smithi081 ceph-mon[42474]: pgmap v325: 97 pgs: 97 active+clean; 3.8 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-05-09T00:13:27.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:26 smithi150 ceph-mon[46187]: pgmap v325: 97 pgs: 97 active+clean; 3.8 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 59 KiB/s wr, 17 op/s 2024-05-09T00:13:29.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:28 smithi081 ceph-mon[42474]: pgmap v326: 97 pgs: 97 active+clean; 3.8 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:29.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:28 smithi150 ceph-mon[46187]: pgmap v326: 97 pgs: 97 active+clean; 3.8 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:29.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:28 smithi171 ceph-mon[47351]: pgmap v326: 97 pgs: 97 active+clean; 3.8 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:30.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:29 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:13:30.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:29 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:13:30.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:29 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:13:30.534 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.535+0000 7f5538253700 1 -- 172.21.15.81:0/2140828157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55300682e0 msgr2=0x7f5530068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.535+0000 7f5538253700 1 --2- 172.21.15.81:0/2140828157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55300682e0 0x7f5530068760 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f552c009990 tx=0x7f552c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.535+0000 7f5538253700 1 -- 172.21.15.81:0/2140828157 shutdown_connections 2024-05-09T00:13:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.535+0000 7f5538253700 1 --2- 172.21.15.81:0/2140828157 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f5530107000 0x7f55301073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.535+0000 7f5538253700 1 --2- 172.21.15.81:0/2140828157 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5530068ca0 0x7f553010dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.535+0000 7f5538253700 1 --2- 172.21.15.81:0/2140828157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55300682e0 0x7f5530068760 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.535+0000 7f5538253700 1 -- 172.21.15.81:0/2140828157 >> 172.21.15.81:0/2140828157 conn(0x7f5530076f10 msgr2=0x7f5530077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.535+0000 7f5538253700 1 -- 172.21.15.81:0/2140828157 shutdown_connections 2024-05-09T00:13:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.535+0000 7f5538253700 1 -- 172.21.15.81:0/2140828157 wait complete. 2024-05-09T00:13:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f5538253700 1 Processor -- start 2024-05-09T00:13:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f5538253700 1 -- start start 2024-05-09T00:13:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f5538253700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55300682e0 0x7f55301972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f5538253700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5530068ca0 0x7f55301977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f5538253700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5530107000 0x7f553019bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f5538253700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553019c1c0 con 0x7f5530068ca0 2024-05-09T00:13:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f5538253700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553019c330 con 0x7f55300682e0 2024-05-09T00:13:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f5538253700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553019c4f0 con 0x7f5530107000 2024-05-09T00:13:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f55357ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5530068ca0 0x7f55301977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f55357ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5530068ca0 0x7f55301977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35568/0 (socket says 172.21.15.81:35568) 2024-05-09T00:13:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f55357ee700 1 -- 172.21.15.81:0/2244006432 learned_addr learned my addr 172.21.15.81:0/2244006432 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f5535fef700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55300682e0 0x7f55301972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f55367f0700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5530107000 0x7f553019bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f55357ee700 1 -- 172.21.15.81:0/2244006432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5530107000 msgr2=0x7f553019bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f55357ee700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5530107000 0x7f553019bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f55357ee700 1 -- 172.21.15.81:0/2244006432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55300682e0 msgr2=0x7f55301972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f55357ee700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55300682e0 0x7f55301972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f55357ee700 1 -- 172.21.15.81:0/2244006432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552c0095f0 con 0x7f5530068ca0 2024-05-09T00:13:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f55367f0700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5530107000 0x7f553019bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f5535fef700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55300682e0 0x7f55301972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.536+0000 7f55357ee700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5530068ca0 0x7f55301977e0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f552c000c00 tx=0x7f552c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.537+0000 7f5522ffd700 1 -- 172.21.15.81:0/2244006432 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c01d070 con 0x7f5530068ca0 2024-05-09T00:13:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.537+0000 7f5522ffd700 1 -- 172.21.15.81:0/2244006432 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f552c022470 con 0x7f5530068ca0 2024-05-09T00:13:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.537+0000 7f5538253700 1 -- 172.21.15.81:0/2244006432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553019c770 con 0x7f5530068ca0 2024-05-09T00:13:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.537+0000 7f5522ffd700 1 -- 172.21.15.81:0/2244006432 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c017650 con 0x7f5530068ca0 2024-05-09T00:13:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.537+0000 7f5538253700 1 -- 172.21.15.81:0/2244006432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55301a4010 con 0x7f5530068ca0 2024-05-09T00:13:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.539+0000 7f5522ffd700 1 -- 172.21.15.81:0/2244006432 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f552c0225e0 con 0x7f5530068ca0 2024-05-09T00:13:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.539+0000 7f5522ffd700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f551c0a1310 0x7f551c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.539+0000 7f5535fef700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f551c0a1310 0x7f551c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.539+0000 7f5522ffd700 1 -- 172.21.15.81:0/2244006432 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f552c0ce0f0 con 0x7f5530068ca0 2024-05-09T00:13:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.540+0000 7f5535fef700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f551c0a1310 0x7f551c0a37d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f552400bc10 tx=0x7f552400b5f0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.540+0000 7f554440db80 1 Processor -- start 2024-05-09T00:13:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f554440db80 1 -- start start 2024-05-09T00:13:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f554440db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a2950 0x56261a2a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f554440db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a2a3270 0x56261a29cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f554440db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a29d480 0x56261a29d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f554440db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56261a1f40f0 con 0x56261a2a3270 2024-05-09T00:13:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f554440db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56261a1f1ab0 con 0x56261a29d480 2024-05-09T00:13:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f554440db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56261a1ed3a0 con 0x56261a2a2950 2024-05-09T00:13:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f55357ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a2a3270 0x56261a29cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f55357ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a2a3270 0x56261a29cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35582/0 (socket says 172.21.15.81:35582) 2024-05-09T00:13:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f55357ee700 1 -- 172.21.15.81:0/3108519244 learned_addr learned my addr 172.21.15.81:0/3108519244 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f55367f0700 1 --2- 172.21.15.81:0/3108519244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a29d480 0x56261a29d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f5535fef700 1 --2- 172.21.15.81:0/3108519244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a2950 0x56261a2a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f55357ee700 1 -- 172.21.15.81:0/3108519244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a2950 msgr2=0x56261a2a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f55357ee700 1 --2- 172.21.15.81:0/3108519244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a2950 0x56261a2a2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f55357ee700 1 -- 172.21.15.81:0/3108519244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a29d480 msgr2=0x56261a29d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f55357ee700 1 --2- 172.21.15.81:0/3108519244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a29d480 0x56261a29d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f55357ee700 1 -- 172.21.15.81:0/3108519244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56261a06e350 con 0x56261a2a3270 2024-05-09T00:13:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f55367f0700 1 --2- 172.21.15.81:0/3108519244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a29d480 0x56261a29d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f55357ee700 1 --2- 172.21.15.81:0/3108519244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a2a3270 0x56261a29cf40 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f552c00b2e0 tx=0x7f552c022c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0bbb52264125dc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.541+0000 7f551bfff700 1 -- 172.21.15.81:0/3108519244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c09f130 con 0x56261a2a3270 2024-05-09T00:13:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.542+0000 7f551bfff700 1 -- 172.21.15.81:0/3108519244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f552c0b0070 con 0x56261a2a3270 2024-05-09T00:13:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.542+0000 7f551bfff700 1 -- 172.21.15.81:0/3108519244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c09b830 con 0x56261a2a3270 2024-05-09T00:13:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.542+0000 7f554440db80 1 -- 172.21.15.81:0/3108519244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a2a3270 msgr2=0x56261a29cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:30.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.542+0000 7f554440db80 1 --2- 172.21.15.81:0/3108519244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a2a3270 0x56261a29cf40 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f552c00b2e0 tx=0x7f552c022c60 comp rx=0 tx=0).stop 2024-05-09T00:13:30.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.542+0000 7f554440db80 1 -- 172.21.15.81:0/3108519244 shutdown_connections 2024-05-09T00:13:30.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.542+0000 7f554440db80 1 --2- 172.21.15.81:0/3108519244 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a29d480 0x56261a29d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.542+0000 7f554440db80 1 --2- 172.21.15.81:0/3108519244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a2950 0x56261a2a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.542+0000 7f554440db80 1 --2- 172.21.15.81:0/3108519244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a2a3270 0x56261a29cf40 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.542+0000 7f554440db80 1 -- 172.21.15.81:0/3108519244 >> 172.21.15.81:0/3108519244 conn(0x56261a1fb1b0 msgr2=0x56261a297840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:30.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.542+0000 7f554440db80 1 -- 172.21.15.81:0/3108519244 shutdown_connections 2024-05-09T00:13:30.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.542+0000 7f554440db80 1 -- 172.21.15.81:0/3108519244 wait complete. 2024-05-09T00:13:30.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.543+0000 7f554440db80 1 -- start start 2024-05-09T00:13:30.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.543+0000 7f554440db80 1 Processor -- start 2024-05-09T00:13:30.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.543+0000 7f554440db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a29d480 0x56261a2a6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.547 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.543+0000 7f554440db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a2950 0x56261a2a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.543+0000 7f554440db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a3270 0x56261a2a7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.543+0000 7f554440db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56261a189500 con 0x56261a29d480 2024-05-09T00:13:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.543+0000 7f554440db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56261a1891a0 con 0x56261a2a2950 2024-05-09T00:13:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.543+0000 7f554440db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56261a070640 con 0x56261a2a3270 2024-05-09T00:13:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.543+0000 7f554440db80 10 client.0 _ll_register_callbacks cb 0x56261a192ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.543+0000 7f5535fef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a29d480 0x56261a2a6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.543+0000 7f5535fef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a29d480 0x56261a2a6590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35586/0 (socket says 172.21.15.81:35586) 2024-05-09T00:13:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.543+0000 7f5535fef700 1 -- 172.21.15.81:0/1289397647 learned_addr learned my addr 172.21.15.81:0/1289397647 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f5535fef700 1 -- 172.21.15.81:0/1289397647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a3270 msgr2=0x56261a2a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f55367f0700 1 --2- 172.21.15.81:0/1289397647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a3270 0x56261a2a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f55357ee700 1 --2- 172.21.15.81:0/1289397647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a2950 0x56261a2a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.548 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f5535fef700 1 --2- 172.21.15.81:0/1289397647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a3270 0x56261a2a7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f5535fef700 1 -- 172.21.15.81:0/1289397647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a2950 msgr2=0x56261a2a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f5535fef700 1 --2- 172.21.15.81:0/1289397647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a2950 0x56261a2a6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f5535fef700 1 -- 172.21.15.81:0/1289397647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55301a4010 con 0x56261a29d480 2024-05-09T00:13:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f5535fef700 1 --2- 172.21.15.81:0/1289397647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a29d480 0x56261a2a6590 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f552400ffa0 tx=0x7f5524004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ac07080155845b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f55197fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f55197fa700 1 -- 172.21.15.81:0/1289397647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552401f630 con 0x56261a29d480 2024-05-09T00:13:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f55197fa700 1 -- 172.21.15.81:0/1289397647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f552401f790 con 0x56261a29d480 2024-05-09T00:13:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f554440db80 1 -- 172.21.15.81:0/1289397647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56261a146210 con 0x56261a29d480 2024-05-09T00:13:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f55197fa700 1 -- 172.21.15.81:0/1289397647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f552401f990 con 0x56261a29d480 2024-05-09T00:13:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f554440db80 10 client.18507 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f554440db80 1 -- 172.21.15.81:0/1289397647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56261a01ab00 con 0x56261a29d480 2024-05-09T00:13:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.544+0000 7f55197fa700 1 -- 172.21.15.81:0/1289397647 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56261a146210 con 0x56261a29d480 2024-05-09T00:13:30.549 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.545+0000 7f55197fa700 1 -- 172.21.15.81:0/1289397647 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5524025020 con 0x56261a29d480 2024-05-09T00:13:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.545+0000 7f554440db80 10 client.18507 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.545+0000 7f554440db80 10 client.18507 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.545+0000 7f554440db80 20 client.18507 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.545+0000 7f554440db80 1 --2- 172.21.15.81:0/1289397647 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56261a2b6960 0x56261a2b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.545+0000 7f554440db80 4 client.18507 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.545+0000 7f554440db80 1 -- 172.21.15.81:0/1289397647 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56261a26c7b0 con 0x56261a2b6960 2024-05-09T00:13:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.545+0000 7f55357ee700 1 --2- 172.21.15.81:0/1289397647 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56261a2b6960 0x56261a2b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.545+0000 7f55197fa700 10 client.18507 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.545+0000 7f55357ee700 1 --2- 172.21.15.81:0/1289397647 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56261a2b6960 0x56261a2b8d80 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=890e232ada1741e9 server_cookie=59d86ca3b829bcd in_seq=0 out_seq=0 2024-05-09T00:13:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.546+0000 7f55197fa700 1 -- 172.21.15.81:0/1289397647 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56261a26c7b0 con 0x56261a2b6960 2024-05-09T00:13:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.546+0000 7f55197fa700 10 client.18507 handle_command_reply: tid=0 2024-05-09T00:13:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.546+0000 7f554440db80 1 client.18507 shutdown 2024-05-09T00:13:30.550 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.546+0000 7f554440db80 1 -- 172.21.15.81:0/1289397647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a29d480 msgr2=0x56261a2a6590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.546+0000 7f554440db80 1 --2- 172.21.15.81:0/1289397647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a29d480 0x56261a2a6590 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f552400ffa0 tx=0x7f5524004750 comp rx=0 tx=0).stop 2024-05-09T00:13:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.546+0000 7f554440db80 1 -- 172.21.15.81:0/1289397647 shutdown_connections 2024-05-09T00:13:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.546+0000 7f554440db80 1 --2- 172.21.15.81:0/1289397647 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56261a2b6960 0x56261a2b8d80 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.546+0000 7f554440db80 1 --2- 172.21.15.81:0/1289397647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a3270 0x56261a2a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.546+0000 7f554440db80 1 --2- 172.21.15.81:0/1289397647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a29d480 0x56261a2a6590 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.546+0000 7f55197fa700 0 client.18507 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.546+0000 7f554440db80 1 --2- 172.21.15.81:0/1289397647 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a2950 0x56261a2a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.546+0000 7f554440db80 1 -- 172.21.15.81:0/1289397647 >> 172.21.15.81:0/1289397647 conn(0x56261a1fb1b0 msgr2=0x56261a2a14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.546+0000 7f554440db80 1 -- 172.21.15.81:0/1289397647 shutdown_connections 2024-05-09T00:13:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.546+0000 7f554440db80 1 -- 172.21.15.81:0/1289397647 wait complete. 2024-05-09T00:13:30.551 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.547+0000 7f554440db80 20 client.18507 trim_cache size 0 max 16384 2024-05-09T00:13:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.561+0000 7f554440db80 1 Processor -- start 2024-05-09T00:13:30.564 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.561+0000 7f554440db80 1 -- start start 2024-05-09T00:13:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f554440db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a29d480 0x56261a2b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f554440db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a2950 0x56261a297910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f554440db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a3270 0x56261a29d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f554440db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56261a2983a0 con 0x56261a29d480 2024-05-09T00:13:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f554440db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56261a29dda0 con 0x56261a2a3270 2024-05-09T00:13:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f554440db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56261a298a60 con 0x56261a2a2950 2024-05-09T00:13:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f5535fef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a29d480 0x56261a2b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f5535fef700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a29d480 0x56261a2b8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35588/0 (socket says 172.21.15.81:35588) 2024-05-09T00:13:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f5535fef700 1 -- 172.21.15.81:0/4172344907 learned_addr learned my addr 172.21.15.81:0/4172344907 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f55367f0700 1 --2- 172.21.15.81:0/4172344907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a3270 0x56261a29d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f55357ee700 1 --2- 172.21.15.81:0/4172344907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a2950 0x56261a297910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f5535fef700 1 -- 172.21.15.81:0/4172344907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a2950 msgr2=0x56261a297910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:30.565 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f5535fef700 1 --2- 172.21.15.81:0/4172344907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a2950 0x56261a297910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f5535fef700 1 -- 172.21.15.81:0/4172344907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a3270 msgr2=0x56261a29d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f5535fef700 1 --2- 172.21.15.81:0/4172344907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a3270 0x56261a29d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f5535fef700 1 -- 172.21.15.81:0/4172344907 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56261a1b3500 con 0x56261a29d480 2024-05-09T00:13:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f55357ee700 1 --2- 172.21.15.81:0/4172344907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a2950 0x56261a297910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f5535fef700 1 --2- 172.21.15.81:0/4172344907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a29d480 0x56261a2b8d50 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f5524003800 tx=0x7f5524011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f137e3acd3ad2093 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f5520ff9700 1 -- 172.21.15.81:0/4172344907 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524011b60 con 0x56261a29d480 2024-05-09T00:13:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f5520ff9700 1 -- 172.21.15.81:0/4172344907 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5524003af0 con 0x56261a29d480 2024-05-09T00:13:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.562+0000 7f5520ff9700 1 -- 172.21.15.81:0/4172344907 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552401f8f0 con 0x56261a29d480 2024-05-09T00:13:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.563+0000 7f554440db80 1 -- 172.21.15.81:0/4172344907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a29d480 msgr2=0x56261a2b8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.563+0000 7f554440db80 1 --2- 172.21.15.81:0/4172344907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a29d480 0x56261a2b8d50 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f5524003800 tx=0x7f5524011f20 comp rx=0 tx=0).stop 2024-05-09T00:13:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.563+0000 7f554440db80 1 -- 172.21.15.81:0/4172344907 shutdown_connections 2024-05-09T00:13:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.563+0000 7f554440db80 1 --2- 172.21.15.81:0/4172344907 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a3270 0x56261a29d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.566 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.563+0000 7f554440db80 1 --2- 172.21.15.81:0/4172344907 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a29d480 0x56261a2b8d50 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.563+0000 7f554440db80 1 --2- 172.21.15.81:0/4172344907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a2a2950 0x56261a297910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.563+0000 7f554440db80 1 -- 172.21.15.81:0/4172344907 >> 172.21.15.81:0/4172344907 conn(0x56261a1fb1b0 msgr2=0x56261a299320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.563+0000 7f554440db80 1 -- 172.21.15.81:0/4172344907 shutdown_connections 2024-05-09T00:13:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.563+0000 7f554440db80 1 -- 172.21.15.81:0/4172344907 wait complete. 2024-05-09T00:13:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.563+0000 7f554440db80 1 -- start start 2024-05-09T00:13:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.563+0000 7f554440db80 1 Processor -- start 2024-05-09T00:13:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f554440db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a29d480 0x56261a2adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f554440db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a2a2950 0x56261a2a9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f554440db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a3270 0x56261a2a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f554440db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56261a2ae260 con 0x56261a2a2950 2024-05-09T00:13:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f554440db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56261a2aa3a0 con 0x56261a2a3270 2024-05-09T00:13:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f554440db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56261a2aa560 con 0x56261a29d480 2024-05-09T00:13:30.567 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f554440db80 10 client.0 _ll_register_callbacks cb 0x56261a192ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f55357ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a2a2950 0x56261a2a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f55357ee700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a2a2950 0x56261a2a9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35602/0 (socket says 172.21.15.81:35602) 2024-05-09T00:13:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f55357ee700 1 -- 172.21.15.81:0/3115746239 learned_addr learned my addr 172.21.15.81:0/3115746239 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f55367f0700 1 --2- 172.21.15.81:0/3115746239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a3270 0x56261a2a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f5535fef700 1 --2- 172.21.15.81:0/3115746239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a29d480 0x56261a2adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f55357ee700 1 -- 172.21.15.81:0/3115746239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a29d480 msgr2=0x56261a2adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f55357ee700 1 --2- 172.21.15.81:0/3115746239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a29d480 0x56261a2adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f55357ee700 1 -- 172.21.15.81:0/3115746239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a3270 msgr2=0x56261a2a9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f55357ee700 1 --2- 172.21.15.81:0/3115746239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a3270 0x56261a2a9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f55357ee700 1 -- 172.21.15.81:0/3115746239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56261a01ab00 con 0x56261a2a2950 2024-05-09T00:13:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f5535fef700 1 --2- 172.21.15.81:0/3115746239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a29d480 0x56261a2adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f55357ee700 1 --2- 172.21.15.81:0/3115746239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a2a2950 0x56261a2a9920 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f552c097d70 tx=0x7f552c005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6171687333745c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f55197fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:30.568 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f55197fa700 1 -- 172.21.15.81:0/3115746239 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c07fea0 con 0x56261a2a2950 2024-05-09T00:13:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f55197fa700 1 -- 172.21.15.81:0/3115746239 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f552c09f130 con 0x56261a2a2950 2024-05-09T00:13:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f554440db80 1 -- 172.21.15.81:0/3115746239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f552c0b0070 con 0x56261a2a2950 2024-05-09T00:13:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f55197fa700 1 -- 172.21.15.81:0/3115746239 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f552c0a3770 con 0x56261a2a2950 2024-05-09T00:13:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.564+0000 7f554440db80 10 client.18513 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.565+0000 7f554440db80 1 -- 172.21.15.81:0/3115746239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56261a072c70 con 0x56261a2a2950 2024-05-09T00:13:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.565+0000 7f55197fa700 1 -- 172.21.15.81:0/3115746239 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f552c0b0070 con 0x56261a2a2950 2024-05-09T00:13:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.565+0000 7f55197fa700 1 -- 172.21.15.81:0/3115746239 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f552c0a3260 con 0x56261a2a2950 2024-05-09T00:13:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.565+0000 7f554440db80 10 client.18513 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.565+0000 7f554440db80 10 client.18513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.565+0000 7f554440db80 20 client.18513 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.565+0000 7f554440db80 1 --2- 172.21.15.81:0/3115746239 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56261a30ce30 0x56261a30f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.565+0000 7f554440db80 4 client.18513 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:13:30.569 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.565+0000 7f554440db80 1 -- 172.21.15.81:0/3115746239 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56261a1e5e60 con 0x56261a30ce30 2024-05-09T00:13:30.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.565+0000 7f5535fef700 1 --2- 172.21.15.81:0/3115746239 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56261a30ce30 0x56261a30f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:30.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.565+0000 7f55197fa700 10 client.18513 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:30.570 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.565+0000 7f5535fef700 1 --2- 172.21.15.81:0/3115746239 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56261a30ce30 0x56261a30f250 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0397eb3dc777dfc server_cookie=681703875d76cd09 in_seq=0 out_seq=0 2024-05-09T00:13:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.578+0000 7f55197fa700 1 -- 172.21.15.81:0/3115746239 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56261a1e5e60 con 0x56261a30ce30 2024-05-09T00:13:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.578+0000 7f55197fa700 10 client.18513 handle_command_reply: tid=0 2024-05-09T00:13:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.578+0000 7f554440db80 1 client.18513 shutdown 2024-05-09T00:13:30.576 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.578+0000 7f554440db80 1 -- 172.21.15.81:0/3115746239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a2a2950 msgr2=0x56261a2a9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.578+0000 7f554440db80 1 --2- 172.21.15.81:0/3115746239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a2a2950 0x56261a2a9920 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f552c097d70 tx=0x7f552c005a90 comp rx=0 tx=0).stop 2024-05-09T00:13:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.578+0000 7f554440db80 1 -- 172.21.15.81:0/3115746239 shutdown_connections 2024-05-09T00:13:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.578+0000 7f554440db80 1 --2- 172.21.15.81:0/3115746239 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56261a30ce30 0x56261a30f250 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.578+0000 7f554440db80 1 --2- 172.21.15.81:0/3115746239 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56261a2a3270 0x56261a2a9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.578+0000 7f554440db80 1 --2- 172.21.15.81:0/3115746239 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56261a29d480 0x56261a2adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.578+0000 7f55197fa700 0 client.18513 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.578+0000 7f554440db80 1 --2- 172.21.15.81:0/3115746239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56261a2a2950 0x56261a2a9920 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.578+0000 7f554440db80 1 -- 172.21.15.81:0/3115746239 >> 172.21.15.81:0/3115746239 conn(0x56261a1fb1b0 msgr2=0x56261a2a6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f554440db80 1 -- 172.21.15.81:0/3115746239 shutdown_connections 2024-05-09T00:13:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f554440db80 1 -- 172.21.15.81:0/3115746239 wait complete. 2024-05-09T00:13:30.577 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f554440db80 20 client.18513 trim_cache size 0 max 16384 2024-05-09T00:13:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:13:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:13:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:13:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:13:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f5538253700 1 -- 172.21.15.81:0/2244006432 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f551c0a1310 msgr2=0x7f551c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f5538253700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f551c0a1310 0x7f551c0a37d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f552400bc10 tx=0x7f552400b5f0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f5538253700 1 -- 172.21.15.81:0/2244006432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5530068ca0 msgr2=0x7f55301977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f5538253700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5530068ca0 0x7f55301977e0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f552c000c00 tx=0x7f552c005ef0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f5538253700 1 -- 172.21.15.81:0/2244006432 shutdown_connections 2024-05-09T00:13:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f5538253700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f551c0a1310 0x7f551c0a37d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f5538253700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f55300682e0 0x7f55301972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f5538253700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5530107000 0x7f553019bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f5538253700 1 --2- 172.21.15.81:0/2244006432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5530068ca0 0x7f55301977e0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f5538253700 1 -- 172.21.15.81:0/2244006432 >> 172.21.15.81:0/2244006432 conn(0x7f5530076f10 msgr2=0x7f55300fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f5538253700 1 -- 172.21.15.81:0/2244006432 shutdown_connections 2024-05-09T00:13:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:30.579+0000 7f5538253700 1 -- 172.21.15.81:0/2244006432 wait complete. 2024-05-09T00:13:31.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:30 smithi081 ceph-mon[42474]: pgmap v327: 97 pgs: 97 active+clean; 3.8 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:31.270 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:30 smithi150 ceph-mon[46187]: pgmap v327: 97 pgs: 97 active+clean; 3.8 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:31.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:30 smithi171 ceph-mon[47351]: pgmap v327: 97 pgs: 97 active+clean; 3.8 MiB data, 437 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:33.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:32 smithi081 ceph-mon[42474]: pgmap v328: 97 pgs: 97 active+clean; 4.0 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:13:33.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:32 smithi150 ceph-mon[46187]: pgmap v328: 97 pgs: 97 active+clean; 4.0 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:13:33.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:32 smithi171 ceph-mon[47351]: pgmap v328: 97 pgs: 97 active+clean; 4.0 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:13:35.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:34 smithi081 ceph-mon[42474]: pgmap v329: 97 pgs: 97 active+clean; 4.0 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-05-09T00:13:35.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:34 smithi150 ceph-mon[46187]: pgmap v329: 97 pgs: 97 active+clean; 4.0 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-05-09T00:13:35.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:34 smithi171 ceph-mon[47351]: pgmap v329: 97 pgs: 97 active+clean; 4.0 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-05-09T00:13:37.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:36 smithi081 ceph-mon[42474]: pgmap v330: 97 pgs: 97 active+clean; 4.2 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:13:37.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:36 smithi150 ceph-mon[46187]: pgmap v330: 97 pgs: 97 active+clean; 4.2 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:13:37.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:36 smithi171 ceph-mon[47351]: pgmap v330: 97 pgs: 97 active+clean; 4.2 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:13:39.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:38 smithi081 ceph-mon[42474]: pgmap v331: 97 pgs: 97 active+clean; 4.2 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:13:39.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:38 smithi150 ceph-mon[46187]: pgmap v331: 97 pgs: 97 active+clean; 4.2 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:13:39.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:38 smithi171 ceph-mon[47351]: pgmap v331: 97 pgs: 97 active+clean; 4.2 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:13:41.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:40 smithi081 ceph-mon[42474]: pgmap v332: 97 pgs: 97 active+clean; 4.2 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:13:41.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:40 smithi150 ceph-mon[46187]: pgmap v332: 97 pgs: 97 active+clean; 4.2 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:13:41.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:40 smithi171 ceph-mon[47351]: pgmap v332: 97 pgs: 97 active+clean; 4.2 MiB data, 442 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 41 KiB/s wr, 13 op/s 2024-05-09T00:13:43.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:42 smithi081 ceph-mon[42474]: pgmap v333: 97 pgs: 97 active+clean; 4.4 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:13:43.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:42 smithi150 ceph-mon[46187]: pgmap v333: 97 pgs: 97 active+clean; 4.4 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:13:43.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:42 smithi171 ceph-mon[47351]: pgmap v333: 97 pgs: 97 active+clean; 4.4 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:13:43.696 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.696+0000 7fdcfeec1700 1 -- 172.21.15.81:0/1696016328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf80682e0 msgr2=0x7fdcf8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.696+0000 7fdcfeec1700 1 --2- 172.21.15.81:0/1696016328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf80682e0 0x7fdcf8068760 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009990 tx=0x7fdce4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.696+0000 7fdcfeec1700 1 -- 172.21.15.81:0/1696016328 shutdown_connections 2024-05-09T00:13:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.696+0000 7fdcfeec1700 1 --2- 172.21.15.81:0/1696016328 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf8107000 0x7fdcf81073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.696+0000 7fdcfeec1700 1 --2- 172.21.15.81:0/1696016328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf8068ca0 0x7fdcf810dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.696+0000 7fdcfeec1700 1 --2- 172.21.15.81:0/1696016328 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf80682e0 0x7fdcf8068760 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.696+0000 7fdcfeec1700 1 -- 172.21.15.81:0/1696016328 >> 172.21.15.81:0/1696016328 conn(0x7fdcf8076f10 msgr2=0x7fdcf8077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.696+0000 7fdcfeec1700 1 -- 172.21.15.81:0/1696016328 shutdown_connections 2024-05-09T00:13:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.696+0000 7fdcfeec1700 1 -- 172.21.15.81:0/1696016328 wait complete. 2024-05-09T00:13:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.697+0000 7fdcfeec1700 1 Processor -- start 2024-05-09T00:13:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.697+0000 7fdcfeec1700 1 -- start start 2024-05-09T00:13:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.697+0000 7fdcfeec1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf80682e0 0x7fdcf8197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.697+0000 7fdcfeec1700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf8068ca0 0x7fdcf8197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.697 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.697+0000 7fdcfeec1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf8107000 0x7fdcf819bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.697+0000 7fdcfeec1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf819c250 con 0x7fdcf8107000 2024-05-09T00:13:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.697+0000 7fdcfeec1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf819c3c0 con 0x7fdcf80682e0 2024-05-09T00:13:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.697+0000 7fdcfeec1700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf819c580 con 0x7fdcf8068ca0 2024-05-09T00:13:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.697+0000 7fdcfd45e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf8107000 0x7fdcf819bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.698+0000 7fdcfd45e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf8107000 0x7fdcf819bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60038/0 (socket says 172.21.15.81:60038) 2024-05-09T00:13:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.698+0000 7fdcfd45e700 1 -- 172.21.15.81:0/3125161039 learned_addr learned my addr 172.21.15.81:0/3125161039 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.698+0000 7fdcfcc5d700 1 --2- 172.21.15.81:0/3125161039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf80682e0 0x7fdcf8197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.698+0000 7fdcf7fff700 1 --2- 172.21.15.81:0/3125161039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf8068ca0 0x7fdcf8197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.698+0000 7fdcfd45e700 1 -- 172.21.15.81:0/3125161039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf8068ca0 msgr2=0x7fdcf8197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.698+0000 7fdcfd45e700 1 --2- 172.21.15.81:0/3125161039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf8068ca0 0x7fdcf8197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.698+0000 7fdcfd45e700 1 -- 172.21.15.81:0/3125161039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf80682e0 msgr2=0x7fdcf8197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.698+0000 7fdcfd45e700 1 --2- 172.21.15.81:0/3125161039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf80682e0 0x7fdcf8197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.698 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.698+0000 7fdcfd45e700 1 -- 172.21.15.81:0/3125161039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce40095f0 con 0x7fdcf8107000 2024-05-09T00:13:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.698+0000 7fdcfd45e700 1 --2- 172.21.15.81:0/3125161039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf8107000 0x7fdcf819bc10 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000b970 tx=0x7fdcf000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.698+0000 7fdcf5ffb700 1 -- 172.21.15.81:0/3125161039 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf000d860 con 0x7fdcf8107000 2024-05-09T00:13:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.698+0000 7fdcf5ffb700 1 -- 172.21.15.81:0/3125161039 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcf000de80 con 0x7fdcf8107000 2024-05-09T00:13:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.698+0000 7fdcfeec1700 1 -- 172.21.15.81:0/3125161039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf819c860 con 0x7fdcf8107000 2024-05-09T00:13:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.698+0000 7fdcf5ffb700 1 -- 172.21.15.81:0/3125161039 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0017400 con 0x7fdcf8107000 2024-05-09T00:13:43.699 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.699+0000 7fdcfeec1700 1 -- 172.21.15.81:0/3125161039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf81a40a0 con 0x7fdcf8107000 2024-05-09T00:13:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.701+0000 7fdcf5ffb700 1 -- 172.21.15.81:0/3125161039 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fdcf000e630 con 0x7fdcf8107000 2024-05-09T00:13:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.701+0000 7fdcf5ffb700 1 --2- 172.21.15.81:0/3125161039 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fdce80a1290 0x7fdce80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.701+0000 7fdcf5ffb700 1 -- 172.21.15.81:0/3125161039 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fdcf0006e40 con 0x7fdcf8107000 2024-05-09T00:13:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.701+0000 7fdcfcc5d700 1 --2- 172.21.15.81:0/3125161039 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fdce80a1290 0x7fdce80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.702+0000 7fdcfcc5d700 1 --2- 172.21.15.81:0/3125161039 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fdce80a1290 0x7fdce80a3750 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdcec005950 tx=0x7fdcec00b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.702+0000 7fdd0b07bb80 1 Processor -- start 2024-05-09T00:13:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.702+0000 7fdd0b07bb80 1 -- start start 2024-05-09T00:13:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdd0b07bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565268004950 0x565268004d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdd0b07bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565268005270 0x565267ffef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdd0b07bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565267fff480 0x565267fff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdd0b07bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565267f560f0 con 0x565267fff480 2024-05-09T00:13:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdd0b07bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x565267f53ab0 con 0x565268005270 2024-05-09T00:13:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdd0b07bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x565267f4f3a0 con 0x565268004950 2024-05-09T00:13:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdcfd45e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565267fff480 0x565267fff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdcfd45e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565267fff480 0x565267fff8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60052/0 (socket says 172.21.15.81:60052) 2024-05-09T00:13:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdcfd45e700 1 -- 172.21.15.81:0/1897542096 learned_addr learned my addr 172.21.15.81:0/1897542096 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdcfd45e700 1 -- 172.21.15.81:0/1897542096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565268004950 msgr2=0x565268004d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdcfd45e700 1 --2- 172.21.15.81:0/1897542096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565268004950 0x565268004d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdcfd45e700 1 -- 172.21.15.81:0/1897542096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565268005270 msgr2=0x565267ffef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdcfd45e700 1 --2- 172.21.15.81:0/1897542096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565268005270 0x565267ffef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdcfd45e700 1 -- 172.21.15.81:0/1897542096 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565267dd0350 con 0x565267fff480 2024-05-09T00:13:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdcfd45e700 1 --2- 172.21.15.81:0/1897542096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565267fff480 0x565267fff8a0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0095f30 tx=0x7fdcf000ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edfa8f4401c0370 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdce2ffd700 1 -- 172.21.15.81:0/1897542096 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0099a30 con 0x565267fff480 2024-05-09T00:13:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdce2ffd700 1 -- 172.21.15.81:0/1897542096 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcf009d860 con 0x565267fff480 2024-05-09T00:13:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.703+0000 7fdce2ffd700 1 -- 172.21.15.81:0/1897542096 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0099ed0 con 0x565267fff480 2024-05-09T00:13:43.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.704+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/1897542096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565267fff480 msgr2=0x565267fff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:43.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.704+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/1897542096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565267fff480 0x565267fff8a0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0095f30 tx=0x7fdcf000ea30 comp rx=0 tx=0).stop 2024-05-09T00:13:43.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.704+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/1897542096 shutdown_connections 2024-05-09T00:13:43.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.704+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/1897542096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565267fff480 0x565267fff8a0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.704+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/1897542096 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565268004950 0x565268004d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.704+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/1897542096 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565268005270 0x565267ffef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.704+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/1897542096 >> 172.21.15.81:0/1897542096 conn(0x565267f5d1b0 msgr2=0x565267ff9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:43.708 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.704+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/1897542096 shutdown_connections 2024-05-09T00:13:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.704+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/1897542096 wait complete. 2024-05-09T00:13:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.704+0000 7fdd0b07bb80 1 -- start start 2024-05-09T00:13:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.705+0000 7fdd0b07bb80 1 Processor -- start 2024-05-09T00:13:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.705+0000 7fdd0b07bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565267fff480 0x565268008550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.705+0000 7fdd0b07bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565268004950 0x565268008a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.705+0000 7fdd0b07bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268005270 0x565268008fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.705+0000 7fdd0b07bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565267eeb500 con 0x565268005270 2024-05-09T00:13:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.705+0000 7fdd0b07bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x565267eeb1a0 con 0x565268004950 2024-05-09T00:13:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.705+0000 7fdd0b07bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x565267dd2640 con 0x565267fff480 2024-05-09T00:13:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.705+0000 7fdd0b07bb80 10 client.0 _ll_register_callbacks cb 0x565267ef4ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.705+0000 7fdcfd45e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268005270 0x565268008fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.705+0000 7fdcfd45e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268005270 0x565268008fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60054/0 (socket says 172.21.15.81:60054) 2024-05-09T00:13:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.705+0000 7fdcfd45e700 1 -- 172.21.15.81:0/1057933855 learned_addr learned my addr 172.21.15.81:0/1057933855 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdcfcc5d700 1 --2- 172.21.15.81:0/1057933855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565267fff480 0x565268008550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdcfd45e700 1 -- 172.21.15.81:0/1057933855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565267fff480 msgr2=0x565268008550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdcfd45e700 1 --2- 172.21.15.81:0/1057933855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565267fff480 0x565268008550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdcfd45e700 1 -- 172.21.15.81:0/1057933855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565268004950 msgr2=0x565268008a90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:13:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdcfd45e700 1 --2- 172.21.15.81:0/1057933855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565268004950 0x565268008a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdcfd45e700 1 -- 172.21.15.81:0/1057933855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf81a40a0 con 0x565268005270 2024-05-09T00:13:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdcfd45e700 1 --2- 172.21.15.81:0/1057933855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268005270 0x565268008fd0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00a1980 tx=0x7fdcf0099ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98ece11b6be996 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdcd7fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdcd7fff700 1 -- 172.21.15.81:0/1057933855 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00b2230 con 0x565268005270 2024-05-09T00:13:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdcd7fff700 1 -- 172.21.15.81:0/1057933855 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fdcf00b2390 con 0x565268005270 2024-05-09T00:13:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/1057933855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565267ea8210 con 0x565268005270 2024-05-09T00:13:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdcd7fff700 1 -- 172.21.15.81:0/1057933855 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcf0098f20 con 0x565268005270 2024-05-09T00:13:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdd0b07bb80 10 client.18525 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/1057933855 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x565267d7cb00 con 0x565268005270 2024-05-09T00:13:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdcd7fff700 1 -- 172.21.15.81:0/1057933855 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x565267ea8210 con 0x565268005270 2024-05-09T00:13:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdcd7fff700 1 -- 172.21.15.81:0/1057933855 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdcf00a1a20 con 0x565268005270 2024-05-09T00:13:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdd0b07bb80 10 client.18525 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdd0b07bb80 10 client.18525 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdd0b07bb80 20 client.18525 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/1057933855 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5652680187c0 0x56526801abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdd0b07bb80 4 client.18525 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.706+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/1057933855 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565267fce7b0 con 0x5652680187c0 2024-05-09T00:13:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.707+0000 7fdcfcc5d700 1 --2- 172.21.15.81:0/1057933855 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5652680187c0 0x56526801abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.707+0000 7fdcd7fff700 10 client.18525 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.707+0000 7fdcfcc5d700 1 --2- 172.21.15.81:0/1057933855 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5652680187c0 0x56526801abb0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a832c35298a26711 server_cookie=57d381a91e7e5689 in_seq=0 out_seq=0 2024-05-09T00:13:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdcd7fff700 1 -- 172.21.15.81:0/1057933855 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x565267fce7b0 con 0x5652680187c0 2024-05-09T00:13:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdcd7fff700 10 client.18525 handle_command_reply: tid=0 2024-05-09T00:13:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdd0b07bb80 1 client.18525 shutdown 2024-05-09T00:13:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/1057933855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268005270 msgr2=0x565268008fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/1057933855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268005270 0x565268008fd0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00a1980 tx=0x7fdcf0099ae0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/1057933855 shutdown_connections 2024-05-09T00:13:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/1057933855 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5652680187c0 0x56526801abb0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/1057933855 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268005270 0x565268008fd0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/1057933855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565267fff480 0x565268008550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdcd7fff700 0 client.18525 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/1057933855 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565268004950 0x565268008a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/1057933855 >> 172.21.15.81:0/1057933855 conn(0x565267f5d1b0 msgr2=0x5652680034c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/1057933855 shutdown_connections 2024-05-09T00:13:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/1057933855 wait complete. 2024-05-09T00:13:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.708+0000 7fdd0b07bb80 20 client.18525 trim_cache size 0 max 16384 2024-05-09T00:13:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.723+0000 7fdd0b07bb80 1 Processor -- start 2024-05-09T00:13:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.723+0000 7fdd0b07bb80 1 -- start start 2024-05-09T00:13:43.725 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.723+0000 7fdd0b07bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565267fff480 0x565267ffb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.723+0000 7fdd0b07bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565268004950 0x565267fff860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.723+0000 7fdd0b07bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268005270 0x565267ff9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.723+0000 7fdd0b07bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565267ffa930 con 0x565268005270 2024-05-09T00:13:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.723+0000 7fdd0b07bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56526801fd90 con 0x565267fff480 2024-05-09T00:13:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.723+0000 7fdd0b07bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x565268004580 con 0x565268004950 2024-05-09T00:13:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.724+0000 7fdcfd45e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268005270 0x565267ff9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.724+0000 7fdcfd45e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268005270 0x565267ff9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60064/0 (socket says 172.21.15.81:60064) 2024-05-09T00:13:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.724+0000 7fdcfd45e700 1 -- 172.21.15.81:0/169804344 learned_addr learned my addr 172.21.15.81:0/169804344 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.724+0000 7fdcfcc5d700 1 --2- 172.21.15.81:0/169804344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565267fff480 0x565267ffb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.724+0000 7fdcfd45e700 1 -- 172.21.15.81:0/169804344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565268004950 msgr2=0x565267fff860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.724+0000 7fdcfd45e700 1 --2- 172.21.15.81:0/169804344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565268004950 0x565267fff860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.724+0000 7fdcfd45e700 1 -- 172.21.15.81:0/169804344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565267fff480 msgr2=0x565267ffb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.724+0000 7fdcfd45e700 1 --2- 172.21.15.81:0/169804344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565267fff480 0x565267ffb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.724+0000 7fdcfd45e700 1 -- 172.21.15.81:0/169804344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565267f15500 con 0x565268005270 2024-05-09T00:13:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.724+0000 7fdcfcc5d700 1 --2- 172.21.15.81:0/169804344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565267fff480 0x565267ffb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.724+0000 7fdcfd45e700 1 --2- 172.21.15.81:0/169804344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268005270 0x565267ff9910 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00964a0 tx=0x7fdcf001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a5f4e3bc4986fd server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.724+0000 7fdce37fe700 1 -- 172.21.15.81:0/169804344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00958c0 con 0x565268005270 2024-05-09T00:13:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.724+0000 7fdce37fe700 1 -- 172.21.15.81:0/169804344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcf009a770 con 0x565268005270 2024-05-09T00:13:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.724+0000 7fdce37fe700 1 -- 172.21.15.81:0/169804344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf00653c0 con 0x565268005270 2024-05-09T00:13:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.725+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/169804344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268005270 msgr2=0x565267ff9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.725+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/169804344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268005270 0x565267ff9910 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00964a0 tx=0x7fdcf001b000 comp rx=0 tx=0).stop 2024-05-09T00:13:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.725+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/169804344 shutdown_connections 2024-05-09T00:13:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.725+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/169804344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565267fff480 0x565267ffb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.725+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/169804344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268005270 0x565267ff9910 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.725+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/169804344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565268004950 0x565267fff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.727 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.725+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/169804344 >> 172.21.15.81:0/169804344 conn(0x565267f5d1b0 msgr2=0x565267ffe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.725+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/169804344 shutdown_connections 2024-05-09T00:13:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.725+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/169804344 wait complete. 2024-05-09T00:13:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.725+0000 7fdd0b07bb80 1 -- start start 2024-05-09T00:13:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.725+0000 7fdd0b07bb80 1 Processor -- start 2024-05-09T00:13:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.725+0000 7fdd0b07bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565267fff480 0x56526800fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.725+0000 7fdd0b07bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268004950 0x565268010120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdd0b07bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565268005270 0x5652680025f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdd0b07bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x565268002d00 con 0x565268004950 2024-05-09T00:13:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdd0b07bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x565268002e70 con 0x565268005270 2024-05-09T00:13:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdd0b07bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x565268003030 con 0x565267fff480 2024-05-09T00:13:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdd0b07bb80 10 client.0 _ll_register_callbacks cb 0x565267ef4ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdcf7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268004950 0x565268010120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdcf7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268004950 0x565268010120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60078/0 (socket says 172.21.15.81:60078) 2024-05-09T00:13:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdcf7fff700 1 -- 172.21.15.81:0/403579136 learned_addr learned my addr 172.21.15.81:0/403579136 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdcfcc5d700 1 --2- 172.21.15.81:0/403579136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565267fff480 0x56526800fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdcf7fff700 1 -- 172.21.15.81:0/403579136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565267fff480 msgr2=0x56526800fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdcf7fff700 1 --2- 172.21.15.81:0/403579136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565267fff480 0x56526800fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdcf7fff700 1 -- 172.21.15.81:0/403579136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565268005270 msgr2=0x5652680025f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdcf7fff700 1 --2- 172.21.15.81:0/403579136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565268005270 0x5652680025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdcf7fff700 1 -- 172.21.15.81:0/403579136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565267d7cb00 con 0x565268004950 2024-05-09T00:13:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdcf7fff700 1 --2- 172.21.15.81:0/403579136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268004950 0x565268010120 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009990 tx=0x7fdce4005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a7dde281136bec server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdcd7fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdcd7fff700 1 -- 172.21.15.81:0/403579136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce401d070 con 0x565268004950 2024-05-09T00:13:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdcd7fff700 1 -- 172.21.15.81:0/403579136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fdce4005580 con 0x565268004950 2024-05-09T00:13:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/403579136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdcf009d860 con 0x565268004950 2024-05-09T00:13:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdcd7fff700 1 -- 172.21.15.81:0/403579136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdce4004710 con 0x565268004950 2024-05-09T00:13:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdd0b07bb80 10 client.18531 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.726+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/403579136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x565267dd4c70 con 0x565268004950 2024-05-09T00:13:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.727+0000 7fdcd7fff700 1 -- 172.21.15.81:0/403579136 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdcf009d860 con 0x565268004950 2024-05-09T00:13:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.727+0000 7fdcd7fff700 1 -- 172.21.15.81:0/403579136 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdce400f8d0 con 0x565268004950 2024-05-09T00:13:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.727+0000 7fdd0b07bb80 10 client.18531 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.727+0000 7fdd0b07bb80 10 client.18531 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.727+0000 7fdd0b07bb80 20 client.18531 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.727+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/403579136 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56526806f1e0 0x565268071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.727+0000 7fdd0b07bb80 4 client.18531 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:13:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.727+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/403579136 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x565267f47e60 con 0x56526806f1e0 2024-05-09T00:13:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.728+0000 7fdcfcc5d700 1 --2- 172.21.15.81:0/403579136 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56526806f1e0 0x565268071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:43.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.728+0000 7fdcfcc5d700 1 --2- 172.21.15.81:0/403579136 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56526806f1e0 0x565268071600 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8032a084f6c882d7 server_cookie=f79e8f92b75189a0 in_seq=0 out_seq=0 2024-05-09T00:13:43.731 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.728+0000 7fdcd7fff700 10 client.18531 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdcd7fff700 1 -- 172.21.15.81:0/403579136 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x565267f47e60 con 0x56526806f1e0 2024-05-09T00:13:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdcd7fff700 10 client.18531 handle_command_reply: tid=0 2024-05-09T00:13:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdd0b07bb80 1 client.18531 shutdown 2024-05-09T00:13:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/403579136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268004950 msgr2=0x565268010120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/403579136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268004950 0x565268010120 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009990 tx=0x7fdce4005c70 comp rx=0 tx=0).stop 2024-05-09T00:13:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/403579136 shutdown_connections 2024-05-09T00:13:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/403579136 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56526806f1e0 0x565268071600 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/403579136 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x565268005270 0x5652680025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/403579136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x565267fff480 0x56526800fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdcd7fff700 0 client.18531 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdd0b07bb80 1 --2- 172.21.15.81:0/403579136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x565268004950 0x565268010120 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/403579136 >> 172.21.15.81:0/403579136 conn(0x565267f5d1b0 msgr2=0x565268006e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/403579136 shutdown_connections 2024-05-09T00:13:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdd0b07bb80 1 -- 172.21.15.81:0/403579136 wait complete. 2024-05-09T00:13:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.743+0000 7fdd0b07bb80 20 client.18531 trim_cache size 0 max 16384 2024-05-09T00:13:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:13:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:13:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:13:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:13:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.744+0000 7fdcfeec1700 1 -- 172.21.15.81:0/3125161039 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fdce80a1290 msgr2=0x7fdce80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.744+0000 7fdcfeec1700 1 --2- 172.21.15.81:0/3125161039 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fdce80a1290 0x7fdce80a3750 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdcec005950 tx=0x7fdcec00b410 comp rx=0 tx=0).stop 2024-05-09T00:13:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.744+0000 7fdcfeec1700 1 -- 172.21.15.81:0/3125161039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf8107000 msgr2=0x7fdcf819bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.744+0000 7fdcfeec1700 1 --2- 172.21.15.81:0/3125161039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf8107000 0x7fdcf819bc10 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000b970 tx=0x7fdcf000bc80 comp rx=0 tx=0).stop 2024-05-09T00:13:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.744+0000 7fdcfeec1700 1 -- 172.21.15.81:0/3125161039 shutdown_connections 2024-05-09T00:13:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.744+0000 7fdcfeec1700 1 --2- 172.21.15.81:0/3125161039 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fdce80a1290 0x7fdce80a3750 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.744+0000 7fdcfeec1700 1 --2- 172.21.15.81:0/3125161039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdcf80682e0 0x7fdcf8197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.744+0000 7fdcfeec1700 1 --2- 172.21.15.81:0/3125161039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcf8107000 0x7fdcf819bc10 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.744+0000 7fdcfeec1700 1 --2- 172.21.15.81:0/3125161039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdcf8068ca0 0x7fdcf8197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.744+0000 7fdcfeec1700 1 -- 172.21.15.81:0/3125161039 >> 172.21.15.81:0/3125161039 conn(0x7fdcf8076f10 msgr2=0x7fdcf80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.744+0000 7fdcfeec1700 1 -- 172.21.15.81:0/3125161039 shutdown_connections 2024-05-09T00:13:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:43.744+0000 7fdcfeec1700 1 -- 172.21.15.81:0/3125161039 wait complete. 2024-05-09T00:13:45.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:44 smithi081 ceph-mon[42474]: pgmap v334: 97 pgs: 97 active+clean; 4.4 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:45.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:44 smithi150 ceph-mon[46187]: pgmap v334: 97 pgs: 97 active+clean; 4.4 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:45.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:44 smithi171 ceph-mon[47351]: pgmap v334: 97 pgs: 97 active+clean; 4.4 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:47.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:46 smithi081 ceph-mon[42474]: pgmap v335: 97 pgs: 97 active+clean; 4.6 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-05-09T00:13:47.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:46 smithi150 ceph-mon[46187]: pgmap v335: 97 pgs: 97 active+clean; 4.6 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-05-09T00:13:47.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:46 smithi171 ceph-mon[47351]: pgmap v335: 97 pgs: 97 active+clean; 4.6 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-05-09T00:13:49.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:48 smithi081 ceph-mon[42474]: pgmap v336: 97 pgs: 97 active+clean; 4.6 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:49.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:48 smithi150 ceph-mon[46187]: pgmap v336: 97 pgs: 97 active+clean; 4.6 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:49.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:48 smithi171 ceph-mon[47351]: pgmap v336: 97 pgs: 97 active+clean; 4.6 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:51.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:50 smithi081 ceph-mon[42474]: pgmap v337: 97 pgs: 97 active+clean; 4.6 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:51.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:50 smithi150 ceph-mon[46187]: pgmap v337: 97 pgs: 97 active+clean; 4.6 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:51.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:50 smithi171 ceph-mon[47351]: pgmap v337: 97 pgs: 97 active+clean; 4.6 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:53.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:52 smithi081 ceph-mon[42474]: pgmap v338: 97 pgs: 97 active+clean; 4.8 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 62 KiB/s wr, 17 op/s 2024-05-09T00:13:53.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:52 smithi150 ceph-mon[46187]: pgmap v338: 97 pgs: 97 active+clean; 4.8 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 62 KiB/s wr, 17 op/s 2024-05-09T00:13:53.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:52 smithi171 ceph-mon[47351]: pgmap v338: 97 pgs: 97 active+clean; 4.8 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 62 KiB/s wr, 17 op/s 2024-05-09T00:13:55.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:54 smithi081 ceph-mon[42474]: pgmap v339: 97 pgs: 97 active+clean; 4.8 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:55.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:54 smithi150 ceph-mon[46187]: pgmap v339: 97 pgs: 97 active+clean; 4.8 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:55.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:54 smithi171 ceph-mon[47351]: pgmap v339: 97 pgs: 97 active+clean; 4.8 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:13:55.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:13:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.718+0000 7f0227ab3700 1 -- 172.21.15.81:0/1000026532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02200682e0 msgr2=0x7f02200686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.718+0000 7f0227ab3700 1 --2- 172.21.15.81:0/1000026532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02200682e0 0x7f02200686c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f021c0099c0 tx=0x7f021c009cd0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.718+0000 7f0227ab3700 1 -- 172.21.15.81:0/1000026532 shutdown_connections 2024-05-09T00:13:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.718+0000 7f0227ab3700 1 --2- 172.21.15.81:0/1000026532 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0220106290 0x7f022010de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.718+0000 7f0227ab3700 1 --2- 172.21.15.81:0/1000026532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02200682e0 0x7f02200686c0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.718+0000 7f0227ab3700 1 --2- 172.21.15.81:0/1000026532 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0220068c90 0x7f0220105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.718+0000 7f0227ab3700 1 -- 172.21.15.81:0/1000026532 >> 172.21.15.81:0/1000026532 conn(0x7f0220076f40 msgr2=0x7f0220077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.718+0000 7f0227ab3700 1 -- 172.21.15.81:0/1000026532 shutdown_connections 2024-05-09T00:13:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.718+0000 7f0227ab3700 1 -- 172.21.15.81:0/1000026532 wait complete. 2024-05-09T00:13:55.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.718+0000 7f0227ab3700 1 Processor -- start 2024-05-09T00:13:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0227ab3700 1 -- start start 2024-05-09T00:13:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0227ab3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02200682e0 0x7f02200ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0227ab3700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0220106290 0x7f02201003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0227ab3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02201008e0 0x7f02201a55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0227ab3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02201a5ba0 con 0x7f02201008e0 2024-05-09T00:13:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0227ab3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02201a5d10 con 0x7f02200682e0 2024-05-09T00:13:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0227ab3700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02201a5ed0 con 0x7f0220106290 2024-05-09T00:13:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0226050700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02201008e0 0x7f02201a55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0226050700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02201008e0 0x7f02201a55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47220/0 (socket says 172.21.15.81:47220) 2024-05-09T00:13:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0226050700 1 -- 172.21.15.81:0/246947327 learned_addr learned my addr 172.21.15.81:0/246947327 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f022504e700 1 --2- 172.21.15.81:0/246947327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0220106290 0x7f02201003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0226050700 1 -- 172.21.15.81:0/246947327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0220106290 msgr2=0x7f02201003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0226050700 1 --2- 172.21.15.81:0/246947327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0220106290 0x7f02201003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0226050700 1 -- 172.21.15.81:0/246947327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02200682e0 msgr2=0x7f02200ffe60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-09T00:13:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0226050700 1 --2- 172.21.15.81:0/246947327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02200682e0 0x7f02200ffe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0226050700 1 -- 172.21.15.81:0/246947327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0095f0 con 0x7f02201008e0 2024-05-09T00:13:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0226050700 1 --2- 172.21.15.81:0/246947327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02201008e0 0x7f02201a55d0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f021800b970 tx=0x7f021800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0216ffd700 1 -- 172.21.15.81:0/246947327 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021800c9b0 con 0x7f02201008e0 2024-05-09T00:13:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0216ffd700 1 -- 172.21.15.81:0/246947327 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0218014440 con 0x7f02201008e0 2024-05-09T00:13:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0216ffd700 1 -- 172.21.15.81:0/246947327 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02180075d0 con 0x7f02201008e0 2024-05-09T00:13:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.719+0000 7f0227ab3700 1 -- 172.21.15.81:0/246947327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02201a61b0 con 0x7f02201008e0 2024-05-09T00:13:55.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.720+0000 7f0227ab3700 1 -- 172.21.15.81:0/246947327 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02201a6670 con 0x7f02201008e0 2024-05-09T00:13:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.722+0000 7f0216ffd700 1 -- 172.21.15.81:0/246947327 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f02180145b0 con 0x7f02201008e0 2024-05-09T00:13:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.722+0000 7f0216ffd700 1 --2- 172.21.15.81:0/246947327 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f020c0a1290 0x7f020c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.722+0000 7f022584f700 1 --2- 172.21.15.81:0/246947327 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f020c0a1290 0x7f020c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.722+0000 7f0216ffd700 1 -- 172.21.15.81:0/246947327 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f0218006e40 con 0x7f02201008e0 2024-05-09T00:13:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.723+0000 7f022584f700 1 --2- 172.21.15.81:0/246947327 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f020c0a1290 0x7f020c0a3750 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f021c0098e0 tx=0x7f021c00b540 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.723+0000 7f0233c6db80 1 Processor -- start 2024-05-09T00:13:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0233c6db80 1 -- start start 2024-05-09T00:13:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0233c6db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e423e00 0x55b42e4241e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0233c6db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e424720 0x55b42e41e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0233c6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e41e890 0x55b42e41ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0233c6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42e375150 con 0x55b42e41e890 2024-05-09T00:13:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0233c6db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42e372b10 con 0x55b42e424720 2024-05-09T00:13:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0233c6db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42e36e400 con 0x55b42e423e00 2024-05-09T00:13:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0226050700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e41e890 0x55b42e41ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0226050700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e41e890 0x55b42e41ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47234/0 (socket says 172.21.15.81:47234) 2024-05-09T00:13:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0226050700 1 -- 172.21.15.81:0/3939073624 learned_addr learned my addr 172.21.15.81:0/3939073624 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:55.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f022584f700 1 --2- 172.21.15.81:0/3939073624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e423e00 0x55b42e4241e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0226050700 1 -- 172.21.15.81:0/3939073624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e423e00 msgr2=0x55b42e4241e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0226050700 1 --2- 172.21.15.81:0/3939073624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e423e00 0x55b42e4241e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0226050700 1 -- 172.21.15.81:0/3939073624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e424720 msgr2=0x55b42e41e350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-09T00:13:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0226050700 1 --2- 172.21.15.81:0/3939073624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e424720 0x55b42e41e350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0226050700 1 -- 172.21.15.81:0/3939073624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b42e1ef3b0 con 0x55b42e41e890 2024-05-09T00:13:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f0226050700 1 --2- 172.21.15.81:0/3939073624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e41e890 0x55b42e41ecd0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f0218095aa0 tx=0x7f0218098f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11de2077d50f621 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.724+0000 7f020bfff700 1 -- 172.21.15.81:0/3939073624 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02180b9070 con 0x55b42e41e890 2024-05-09T00:13:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.725+0000 7f020bfff700 1 -- 172.21.15.81:0/3939073624 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f021809d3d0 con 0x55b42e41e890 2024-05-09T00:13:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.725+0000 7f020bfff700 1 -- 172.21.15.81:0/3939073624 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218099800 con 0x55b42e41e890 2024-05-09T00:13:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.725+0000 7f0233c6db80 1 -- 172.21.15.81:0/3939073624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e41e890 msgr2=0x55b42e41ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.725+0000 7f0233c6db80 1 --2- 172.21.15.81:0/3939073624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e41e890 0x55b42e41ecd0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f0218095aa0 tx=0x7f0218098f00 comp rx=0 tx=0).stop 2024-05-09T00:13:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.725+0000 7f0233c6db80 1 -- 172.21.15.81:0/3939073624 shutdown_connections 2024-05-09T00:13:55.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.725+0000 7f0233c6db80 1 --2- 172.21.15.81:0/3939073624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e41e890 0x55b42e41ecd0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.725+0000 7f0233c6db80 1 --2- 172.21.15.81:0/3939073624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e423e00 0x55b42e4241e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.725+0000 7f0233c6db80 1 --2- 172.21.15.81:0/3939073624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e424720 0x55b42e41e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.725+0000 7f0233c6db80 1 -- 172.21.15.81:0/3939073624 >> 172.21.15.81:0/3939073624 conn(0x55b42e37c210 msgr2=0x55b42e418df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:55.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.725+0000 7f0233c6db80 1 -- 172.21.15.81:0/3939073624 shutdown_connections 2024-05-09T00:13:55.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.725+0000 7f0233c6db80 1 -- 172.21.15.81:0/3939073624 wait complete. 2024-05-09T00:13:55.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.726+0000 7f0233c6db80 1 -- start start 2024-05-09T00:13:55.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.726+0000 7f0233c6db80 1 Processor -- start 2024-05-09T00:13:55.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.726+0000 7f0233c6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e41e890 0x55b42e427c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.726+0000 7f0233c6db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e423e00 0x55b42e428190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.726+0000 7f0233c6db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e424720 0x55b42e4286d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.726+0000 7f0233c6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42e30a560 con 0x55b42e41e890 2024-05-09T00:13:55.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.726+0000 7f0233c6db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42e30a200 con 0x55b42e423e00 2024-05-09T00:13:55.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.726+0000 7f0233c6db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42e1f16a0 con 0x55b42e424720 2024-05-09T00:13:55.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.726+0000 7f0233c6db80 10 client.0 _ll_register_callbacks cb 0x55b42e313b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:55.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.726+0000 7f022584f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e41e890 0x55b42e427c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.726+0000 7f022584f700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e41e890 0x55b42e427c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47244/0 (socket says 172.21.15.81:47244) 2024-05-09T00:13:55.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.726+0000 7f022584f700 1 -- 172.21.15.81:0/1075499817 learned_addr learned my addr 172.21.15.81:0/1075499817 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:55.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.726+0000 7f0226050700 1 --2- 172.21.15.81:0/1075499817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e424720 0x55b42e4286d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.726+0000 7f022504e700 1 --2- 172.21.15.81:0/1075499817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e423e00 0x55b42e428190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f022584f700 1 -- 172.21.15.81:0/1075499817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e424720 msgr2=0x55b42e4286d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:55.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f022584f700 1 --2- 172.21.15.81:0/1075499817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e424720 0x55b42e4286d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f022584f700 1 -- 172.21.15.81:0/1075499817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e423e00 msgr2=0x55b42e428190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:55.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f022584f700 1 --2- 172.21.15.81:0/1075499817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e423e00 0x55b42e428190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f022584f700 1 -- 172.21.15.81:0/1075499817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02201a6670 con 0x55b42e41e890 2024-05-09T00:13:55.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f022584f700 1 --2- 172.21.15.81:0/1075499817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e41e890 0x55b42e427c50 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f021c015000 tx=0x7f021c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93c973a6cea67ca server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:55.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f02097fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:55.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f02097fa700 1 -- 172.21.15.81:0/1075499817 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c01d070 con 0x55b42e41e890 2024-05-09T00:13:55.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f02097fa700 1 -- 172.21.15.81:0/1075499817 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f021c004930 con 0x55b42e41e890 2024-05-09T00:13:55.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f0233c6db80 1 -- 172.21.15.81:0/1075499817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b42e2c7270 con 0x55b42e41e890 2024-05-09T00:13:55.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f02097fa700 1 -- 172.21.15.81:0/1075499817 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f021c005260 con 0x55b42e41e890 2024-05-09T00:13:55.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f0233c6db80 10 client.18543 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:55.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f0233c6db80 1 -- 172.21.15.81:0/1075499817 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b42e19bb60 con 0x55b42e41e890 2024-05-09T00:13:55.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f02097fa700 1 -- 172.21.15.81:0/1075499817 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f021c03b020 con 0x55b42e41e890 2024-05-09T00:13:55.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f02097fa700 1 -- 172.21.15.81:0/1075499817 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f021c00f460 con 0x55b42e41e890 2024-05-09T00:13:55.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f0233c6db80 10 client.18543 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:55.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f0233c6db80 10 client.18543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:55.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f0233c6db80 20 client.18543 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:55.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f0233c6db80 1 --2- 172.21.15.81:0/1075499817 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b42e438370 0x55b42e43a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f0233c6db80 4 client.18543 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:55.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.727+0000 7f0233c6db80 1 -- 172.21.15.81:0/1075499817 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b42e3ed810 con 0x55b42e438370 2024-05-09T00:13:55.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.728+0000 7f022504e700 1 --2- 172.21.15.81:0/1075499817 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b42e438370 0x55b42e43a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.728+0000 7f022504e700 1 --2- 172.21.15.81:0/1075499817 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b42e438370 0x55b42e43a790 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d196c87ebe356d0 server_cookie=5947d8eb92c698c0 in_seq=0 out_seq=0 2024-05-09T00:13:55.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.728+0000 7f02097fa700 10 client.18543 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f02097fa700 1 -- 172.21.15.81:0/1075499817 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b42e3ed810 con 0x55b42e438370 2024-05-09T00:13:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f02097fa700 10 client.18543 handle_command_reply: tid=0 2024-05-09T00:13:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f0233c6db80 1 client.18543 shutdown 2024-05-09T00:13:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f0233c6db80 1 -- 172.21.15.81:0/1075499817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e41e890 msgr2=0x55b42e427c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f0233c6db80 1 --2- 172.21.15.81:0/1075499817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e41e890 0x55b42e427c50 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f021c015000 tx=0x7f021c009cd0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f0233c6db80 1 -- 172.21.15.81:0/1075499817 shutdown_connections 2024-05-09T00:13:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f0233c6db80 1 --2- 172.21.15.81:0/1075499817 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b42e438370 0x55b42e43a790 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f0233c6db80 1 --2- 172.21.15.81:0/1075499817 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e424720 0x55b42e4286d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f02097fa700 0 client.18543 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f0233c6db80 1 --2- 172.21.15.81:0/1075499817 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e41e890 0x55b42e427c50 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f0233c6db80 1 --2- 172.21.15.81:0/1075499817 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e423e00 0x55b42e428190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f0233c6db80 1 -- 172.21.15.81:0/1075499817 >> 172.21.15.81:0/1075499817 conn(0x55b42e37c210 msgr2=0x55b42e4185a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f0233c6db80 1 -- 172.21.15.81:0/1075499817 shutdown_connections 2024-05-09T00:13:55.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f0233c6db80 1 -- 172.21.15.81:0/1075499817 wait complete. 2024-05-09T00:13:55.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.729+0000 7f0233c6db80 20 client.18543 trim_cache size 0 max 16384 2024-05-09T00:13:55.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.746+0000 7f0233c6db80 1 Processor -- start 2024-05-09T00:13:55.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.746+0000 7f0233c6db80 1 -- start start 2024-05-09T00:13:55.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f0233c6db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e41e890 0x55b42e41e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f0233c6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e423e00 0x55b42e434390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f0233c6db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e424720 0x55b42e418d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f0233c6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42e43f9a0 con 0x55b42e423e00 2024-05-09T00:13:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f0233c6db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42e425bc0 con 0x55b42e41e890 2024-05-09T00:13:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f0233c6db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42e413a90 con 0x55b42e424720 2024-05-09T00:13:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f022504e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e423e00 0x55b42e434390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f022504e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e423e00 0x55b42e434390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47258/0 (socket says 172.21.15.81:47258) 2024-05-09T00:13:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f022504e700 1 -- 172.21.15.81:0/2553209996 learned_addr learned my addr 172.21.15.81:0/2553209996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f0226050700 1 --2- 172.21.15.81:0/2553209996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e424720 0x55b42e418d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f022584f700 1 --2- 172.21.15.81:0/2553209996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e41e890 0x55b42e41e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f022504e700 1 -- 172.21.15.81:0/2553209996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e424720 msgr2=0x55b42e418d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f022504e700 1 --2- 172.21.15.81:0/2553209996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e424720 0x55b42e418d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f022504e700 1 -- 172.21.15.81:0/2553209996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e41e890 msgr2=0x55b42e41e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f022504e700 1 --2- 172.21.15.81:0/2553209996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e41e890 0x55b42e41e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f022504e700 1 -- 172.21.15.81:0/2553209996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b42e334560 con 0x55b42e423e00 2024-05-09T00:13:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f022584f700 1 --2- 172.21.15.81:0/2553209996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e41e890 0x55b42e41e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:55.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f022504e700 1 --2- 172.21.15.81:0/2553209996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e423e00 0x55b42e434390 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f0210000c00 tx=0x7f021000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21db264eedf3e437 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f0214da4700 1 -- 172.21.15.81:0/2553209996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210016040 con 0x55b42e423e00 2024-05-09T00:13:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f0214da4700 1 -- 172.21.15.81:0/2553209996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f021001c070 con 0x55b42e423e00 2024-05-09T00:13:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.747+0000 7f0214da4700 1 -- 172.21.15.81:0/2553209996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210018510 con 0x55b42e423e00 2024-05-09T00:13:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.748+0000 7f0233c6db80 1 -- 172.21.15.81:0/2553209996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e423e00 msgr2=0x55b42e434390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.748+0000 7f0233c6db80 1 --2- 172.21.15.81:0/2553209996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e423e00 0x55b42e434390 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f0210000c00 tx=0x7f021000c2d0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.748+0000 7f0233c6db80 1 -- 172.21.15.81:0/2553209996 shutdown_connections 2024-05-09T00:13:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.748+0000 7f0233c6db80 1 --2- 172.21.15.81:0/2553209996 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e41e890 0x55b42e41e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.748+0000 7f0233c6db80 1 --2- 172.21.15.81:0/2553209996 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e424720 0x55b42e418d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.748+0000 7f0233c6db80 1 --2- 172.21.15.81:0/2553209996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e423e00 0x55b42e434390 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.748+0000 7f0233c6db80 1 -- 172.21.15.81:0/2553209996 >> 172.21.15.81:0/2553209996 conn(0x55b42e37c210 msgr2=0x55b42e415210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.748+0000 7f0233c6db80 1 -- 172.21.15.81:0/2553209996 shutdown_connections 2024-05-09T00:13:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.748+0000 7f0233c6db80 1 -- 172.21.15.81:0/2553209996 wait complete. 2024-05-09T00:13:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.748+0000 7f0233c6db80 1 -- start start 2024-05-09T00:13:55.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.748+0000 7f0233c6db80 1 Processor -- start 2024-05-09T00:13:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0233c6db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e41e890 0x55b42e42d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0233c6db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e423e00 0x55b42e42d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0233c6db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e424720 0x55b42e42db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0233c6db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42e48d910 con 0x55b42e424720 2024-05-09T00:13:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0233c6db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42e48da50 con 0x55b42e423e00 2024-05-09T00:13:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0233c6db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b42e48db90 con 0x55b42e41e890 2024-05-09T00:13:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0233c6db80 10 client.0 _ll_register_callbacks cb 0x55b42e313b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0226050700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e424720 0x55b42e42db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0226050700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e424720 0x55b42e42db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47272/0 (socket says 172.21.15.81:47272) 2024-05-09T00:13:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0226050700 1 -- 172.21.15.81:0/1367384897 learned_addr learned my addr 172.21.15.81:0/1367384897 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f022504e700 1 --2- 172.21.15.81:0/1367384897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e423e00 0x55b42e42d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f022584f700 1 --2- 172.21.15.81:0/1367384897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e41e890 0x55b42e42d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0226050700 1 -- 172.21.15.81:0/1367384897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e41e890 msgr2=0x55b42e42d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0226050700 1 --2- 172.21.15.81:0/1367384897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e41e890 0x55b42e42d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0226050700 1 -- 172.21.15.81:0/1367384897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e423e00 msgr2=0x55b42e42d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0226050700 1 --2- 172.21.15.81:0/1367384897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e423e00 0x55b42e42d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0226050700 1 -- 172.21.15.81:0/1367384897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021000cbd0 con 0x55b42e424720 2024-05-09T00:13:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f0226050700 1 --2- 172.21.15.81:0/1367384897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e424720 0x55b42e42db70 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f02180ca0d0 tx=0x7f0218099720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf519af08fe2ee1a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f02097fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f02097fa700 1 -- 172.21.15.81:0/1367384897 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0218098a90 con 0x55b42e424720 2024-05-09T00:13:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.749+0000 7f02097fa700 1 -- 172.21.15.81:0/1367384897 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f0218098bf0 con 0x55b42e424720 2024-05-09T00:13:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.750+0000 7f0233c6db80 1 -- 172.21.15.81:0/1367384897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f021809d3d0 con 0x55b42e424720 2024-05-09T00:13:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.750+0000 7f02097fa700 1 -- 172.21.15.81:0/1367384897 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0218099800 con 0x55b42e424720 2024-05-09T00:13:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.750+0000 7f0233c6db80 10 client.18549 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.750+0000 7f0233c6db80 1 -- 172.21.15.81:0/1367384897 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b42e1f3cd0 con 0x55b42e424720 2024-05-09T00:13:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.750+0000 7f02097fa700 1 -- 172.21.15.81:0/1367384897 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f021809d3d0 con 0x55b42e424720 2024-05-09T00:13:55.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.750+0000 7f02097fa700 1 -- 172.21.15.81:0/1367384897 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f02180b7b90 con 0x55b42e424720 2024-05-09T00:13:55.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.750+0000 7f0233c6db80 10 client.18549 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:55.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.750+0000 7f0233c6db80 10 client.18549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:55.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.750+0000 7f0233c6db80 20 client.18549 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:55.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.750+0000 7f0233c6db80 1 --2- 172.21.15.81:0/1367384897 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b42e48efc0 0x55b42e4913e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.750+0000 7f0233c6db80 4 client.18549 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:13:55.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.750+0000 7f0233c6db80 1 -- 172.21.15.81:0/1367384897 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b42e366ec0 con 0x55b42e48efc0 2024-05-09T00:13:55.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.750+0000 7f022584f700 1 --2- 172.21.15.81:0/1367384897 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b42e48efc0 0x55b42e4913e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f02097fa700 10 client.18549 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:55.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f022584f700 1 --2- 172.21.15.81:0/1367384897 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b42e48efc0 0x55b42e4913e0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ceb4688e91aa8935 server_cookie=58e2f349541a5185 in_seq=0 out_seq=0 2024-05-09T00:13:55.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f02097fa700 1 -- 172.21.15.81:0/1367384897 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b42e366ec0 con 0x55b42e48efc0 2024-05-09T00:13:55.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f02097fa700 10 client.18549 handle_command_reply: tid=0 2024-05-09T00:13:55.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f0233c6db80 1 client.18549 shutdown 2024-05-09T00:13:55.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f0233c6db80 1 -- 172.21.15.81:0/1367384897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e424720 msgr2=0x55b42e42db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:55.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f0233c6db80 1 --2- 172.21.15.81:0/1367384897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e424720 0x55b42e42db70 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f02180ca0d0 tx=0x7f0218099720 comp rx=0 tx=0).stop 2024-05-09T00:13:55.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f0233c6db80 1 -- 172.21.15.81:0/1367384897 shutdown_connections 2024-05-09T00:13:55.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f0233c6db80 1 --2- 172.21.15.81:0/1367384897 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b42e48efc0 0x55b42e4913e0 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f0233c6db80 1 --2- 172.21.15.81:0/1367384897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b42e424720 0x55b42e42db70 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f0233c6db80 1 --2- 172.21.15.81:0/1367384897 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b42e41e890 0x55b42e42d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f0233c6db80 1 --2- 172.21.15.81:0/1367384897 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b42e423e00 0x55b42e42d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f02097fa700 0 client.18549 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:55.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f0233c6db80 1 -- 172.21.15.81:0/1367384897 >> 172.21.15.81:0/1367384897 conn(0x55b42e37c210 msgr2=0x55b42e415210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:55.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f0233c6db80 1 -- 172.21.15.81:0/1367384897 shutdown_connections 2024-05-09T00:13:55.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f0233c6db80 1 -- 172.21.15.81:0/1367384897 wait complete. 2024-05-09T00:13:55.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.751+0000 7f0233c6db80 20 client.18549 trim_cache size 0 max 16384 2024-05-09T00:13:55.758 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:13:55.758 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:13:55.758 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:13:55.758 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:13:55.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.752+0000 7f0227ab3700 1 -- 172.21.15.81:0/246947327 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f020c0a1290 msgr2=0x7f020c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:55.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.752+0000 7f0227ab3700 1 --2- 172.21.15.81:0/246947327 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f020c0a1290 0x7f020c0a3750 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f021c0098e0 tx=0x7f021c00b540 comp rx=0 tx=0).stop 2024-05-09T00:13:55.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.752+0000 7f0227ab3700 1 -- 172.21.15.81:0/246947327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02201008e0 msgr2=0x7f02201a55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:55.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.752+0000 7f0227ab3700 1 --2- 172.21.15.81:0/246947327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02201008e0 0x7f02201a55d0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f021800b970 tx=0x7f021800bd30 comp rx=0 tx=0).stop 2024-05-09T00:13:55.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.752+0000 7f0227ab3700 1 -- 172.21.15.81:0/246947327 shutdown_connections 2024-05-09T00:13:55.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.752+0000 7f0227ab3700 1 --2- 172.21.15.81:0/246947327 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f020c0a1290 0x7f020c0a3750 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.752+0000 7f0227ab3700 1 --2- 172.21.15.81:0/246947327 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f02200682e0 0x7f02200ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.752+0000 7f0227ab3700 1 --2- 172.21.15.81:0/246947327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02201008e0 0x7f02201a55d0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.752+0000 7f0227ab3700 1 --2- 172.21.15.81:0/246947327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0220106290 0x7f02201003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.752+0000 7f0227ab3700 1 -- 172.21.15.81:0/246947327 >> 172.21.15.81:0/246947327 conn(0x7f0220076f40 msgr2=0x7f02200fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.752+0000 7f0227ab3700 1 -- 172.21.15.81:0/246947327 shutdown_connections 2024-05-09T00:13:55.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.752+0000 7f0227ab3700 1 -- 172.21.15.81:0/246947327 wait complete. 2024-05-09T00:13:55.762 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:13:55.762 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:13:55.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.887+0000 7f079cdcd700 1 -- 172.21.15.81:0/682507044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0798101060 msgr2=0x7f0798101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:55.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.887+0000 7f079cdcd700 1 --2- 172.21.15.81:0/682507044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0798101060 0x7f0798101440 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f0788009990 tx=0x7f0788009ca0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.887+0000 7f079cdcd700 1 -- 172.21.15.81:0/682507044 shutdown_connections 2024-05-09T00:13:55.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.887+0000 7f079cdcd700 1 --2- 172.21.15.81:0/682507044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0798106180 0x7f079810dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.887+0000 7f079cdcd700 1 --2- 172.21.15.81:0/682507044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0798101060 0x7f0798101440 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.887+0000 7f079cdcd700 1 --2- 172.21.15.81:0/682507044 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0798101a10 0x7f0798105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.887+0000 7f079cdcd700 1 -- 172.21.15.81:0/682507044 >> 172.21.15.81:0/682507044 conn(0x7f0798078360 msgr2=0x7f0798078770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:55.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.887+0000 7f079cdcd700 1 -- 172.21.15.81:0/682507044 shutdown_connections 2024-05-09T00:13:55.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.887+0000 7f079cdcd700 1 -- 172.21.15.81:0/682507044 wait complete. 2024-05-09T00:13:55.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f079cdcd700 1 Processor -- start 2024-05-09T00:13:55.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f079cdcd700 1 -- start start 2024-05-09T00:13:55.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f079cdcd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0798101060 0x7f07981972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f079cdcd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0798106180 0x7f0798197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f079cdcd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f079819bbd0 0x7f079819c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f079cdcd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079819c650 con 0x7f0798106180 2024-05-09T00:13:55.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f079cdcd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079819c7c0 con 0x7f0798101060 2024-05-09T00:13:55.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f079cdcd700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079819c980 con 0x7f079819bbd0 2024-05-09T00:13:55.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f0795d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0798106180 0x7f0798197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f0795d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0798106180 0x7f0798197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47278/0 (socket says 172.21.15.81:47278) 2024-05-09T00:13:55.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f0795d9b700 1 -- 172.21.15.81:0/126981857 learned_addr learned my addr 172.21.15.81:0/126981857 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:55.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f079659c700 1 --2- 172.21.15.81:0/126981857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0798101060 0x7f07981972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f0796d9d700 1 --2- 172.21.15.81:0/126981857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f079819bbd0 0x7f079819c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f0795d9b700 1 -- 172.21.15.81:0/126981857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f079819bbd0 msgr2=0x7f079819c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:55.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f0795d9b700 1 --2- 172.21.15.81:0/126981857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f079819bbd0 0x7f079819c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f0795d9b700 1 -- 172.21.15.81:0/126981857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0798101060 msgr2=0x7f07981972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:55.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.888+0000 7f0795d9b700 1 --2- 172.21.15.81:0/126981857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0798101060 0x7f07981972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:55.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.889+0000 7f0795d9b700 1 -- 172.21.15.81:0/126981857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880095f0 con 0x7f0798106180 2024-05-09T00:13:55.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.889+0000 7f0795d9b700 1 --2- 172.21.15.81:0/126981857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0798106180 0x7f0798197830 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f078000d980 tx=0x7f078000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:55.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.889+0000 7f078f7fe700 1 -- 172.21.15.81:0/126981857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078000f890 con 0x7f0798106180 2024-05-09T00:13:55.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.889+0000 7f078f7fe700 1 -- 172.21.15.81:0/126981857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0780010460 con 0x7f0798106180 2024-05-09T00:13:55.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.889+0000 7f079cdcd700 1 -- 172.21.15.81:0/126981857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07981a3ee0 con 0x7f0798106180 2024-05-09T00:13:55.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.889+0000 7f078f7fe700 1 -- 172.21.15.81:0/126981857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078000e610 con 0x7f0798106180 2024-05-09T00:13:55.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.889+0000 7f079cdcd700 1 -- 172.21.15.81:0/126981857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07981a4360 con 0x7f0798106180 2024-05-09T00:13:55.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.890+0000 7f079cdcd700 1 -- 172.21.15.81:0/126981857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07981093f0 con 0x7f0798106180 2024-05-09T00:13:55.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.891+0000 7f078f7fe700 1 -- 172.21.15.81:0/126981857 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f07800105d0 con 0x7f0798106180 2024-05-09T00:13:55.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.891+0000 7f078f7fe700 1 --2- 172.21.15.81:0/126981857 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f07840a1290 0x7f07840a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:55.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.892+0000 7f079659c700 1 --2- 172.21.15.81:0/126981857 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f07840a1290 0x7f07840a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:55.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.892+0000 7f078f7fe700 1 -- 172.21.15.81:0/126981857 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f07800cc700 con 0x7f0798106180 2024-05-09T00:13:55.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.892+0000 7f079659c700 1 --2- 172.21.15.81:0/126981857 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f07840a1290 0x7f07840a3750 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f078800b5c0 tx=0x7f0788005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:55.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:55.895+0000 7f078f7fe700 1 -- 172.21.15.81:0/126981857 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0780095b20 con 0x7f0798106180 2024-05-09T00:13:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.140+0000 7f079cdcd700 1 -- 172.21.15.81:0/126981857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0798102530 con 0x7f0798106180 2024-05-09T00:13:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.140+0000 7f078f7fe700 1 -- 172.21.15.81:0/126981857 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7f0780020090 con 0x7f0798106180 2024-05-09T00:13:56.139 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:13:56.139 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:13:56.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.142+0000 7f079cdcd700 1 -- 172.21.15.81:0/126981857 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f07840a1290 msgr2=0x7f07840a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.142+0000 7f079cdcd700 1 --2- 172.21.15.81:0/126981857 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f07840a1290 0x7f07840a3750 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f078800b5c0 tx=0x7f0788005960 comp rx=0 tx=0).stop 2024-05-09T00:13:56.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.142+0000 7f079cdcd700 1 -- 172.21.15.81:0/126981857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0798106180 msgr2=0x7f0798197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.142+0000 7f079cdcd700 1 --2- 172.21.15.81:0/126981857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0798106180 0x7f0798197830 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f078000d980 tx=0x7f078000dc90 comp rx=0 tx=0).stop 2024-05-09T00:13:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.142+0000 7f079cdcd700 1 -- 172.21.15.81:0/126981857 shutdown_connections 2024-05-09T00:13:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.142+0000 7f079cdcd700 1 --2- 172.21.15.81:0/126981857 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f07840a1290 0x7f07840a3750 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.142+0000 7f079cdcd700 1 --2- 172.21.15.81:0/126981857 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0798101060 0x7f07981972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.142+0000 7f079cdcd700 1 --2- 172.21.15.81:0/126981857 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f079819bbd0 0x7f079819c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.142+0000 7f079cdcd700 1 --2- 172.21.15.81:0/126981857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0798106180 0x7f0798197830 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.142+0000 7f079cdcd700 1 -- 172.21.15.81:0/126981857 >> 172.21.15.81:0/126981857 conn(0x7f0798078360 msgr2=0x7f07980ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.143+0000 7f079cdcd700 1 -- 172.21.15.81:0/126981857 shutdown_connections 2024-05-09T00:13:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.143+0000 7f079cdcd700 1 -- 172.21.15.81:0/126981857 wait complete. 2024-05-09T00:13:56.142 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:13:56.153 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:13:56.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.279+0000 7f0a87ea6700 1 -- 172.21.15.81:0/2084565744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a800ffb40 msgr2=0x7f0a800fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.279+0000 7f0a87ea6700 1 --2- 172.21.15.81:0/2084565744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a800ffb40 0x7f0a800fff20 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f0a700099c0 tx=0x7f0a70009cd0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.279+0000 7f0a87ea6700 1 -- 172.21.15.81:0/2084565744 shutdown_connections 2024-05-09T00:13:56.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.279+0000 7f0a87ea6700 1 --2- 172.21.15.81:0/2084565744 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a80106350 0x7f0a8010de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.279+0000 7f0a87ea6700 1 --2- 172.21.15.81:0/2084565744 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a800ffb40 0x7f0a800fff20 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.279+0000 7f0a87ea6700 1 --2- 172.21.15.81:0/2084565744 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a801004f0 0x7f0a80105c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.279+0000 7f0a87ea6700 1 -- 172.21.15.81:0/2084565744 >> 172.21.15.81:0/2084565744 conn(0x7f0a80075070 msgr2=0x7f0a80075480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.279+0000 7f0a87ea6700 1 -- 172.21.15.81:0/2084565744 shutdown_connections 2024-05-09T00:13:56.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.279+0000 7f0a87ea6700 1 -- 172.21.15.81:0/2084565744 wait complete. 2024-05-09T00:13:56.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.279+0000 7f0a87ea6700 1 Processor -- start 2024-05-09T00:13:56.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.279+0000 7f0a87ea6700 1 -- start start 2024-05-09T00:13:56.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a87ea6700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a800ffb40 0x7f0a80100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a87ea6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a80106350 0x7f0a80100ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a87ea6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a80101530 0x7f0a801a5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a87ea6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a801a5b20 con 0x7f0a80101530 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a87ea6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a801a5c90 con 0x7f0a80106350 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a87ea6700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a801a5e50 con 0x7f0a800ffb40 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a86443700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a80101530 0x7f0a801a5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a86443700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a80101530 0x7f0a801a5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47284/0 (socket says 172.21.15.81:47284) 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a86443700 1 -- 172.21.15.81:0/2226127635 learned_addr learned my addr 172.21.15.81:0/2226127635 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a85c42700 1 --2- 172.21.15.81:0/2226127635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a800ffb40 0x7f0a80100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a86443700 1 -- 172.21.15.81:0/2226127635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a800ffb40 msgr2=0x7f0a80100ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a86443700 1 --2- 172.21.15.81:0/2226127635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a800ffb40 0x7f0a80100ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a86443700 1 -- 172.21.15.81:0/2226127635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a80106350 msgr2=0x7f0a80100ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a86443700 1 --2- 172.21.15.81:0/2226127635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a80106350 0x7f0a80100ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a86443700 1 -- 172.21.15.81:0/2226127635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a700095f0 con 0x7f0a80101530 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a86443700 1 --2- 172.21.15.81:0/2226127635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a80101530 0x7f0a801a5550 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800ada0 tx=0x7f0a7800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a76ffd700 1 -- 172.21.15.81:0/2226127635 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7800f070 con 0x7f0a80101530 2024-05-09T00:13:56.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a76ffd700 1 -- 172.21.15.81:0/2226127635 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a78007b30 con 0x7f0a80101530 2024-05-09T00:13:56.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a87ea6700 1 -- 172.21.15.81:0/2226127635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a801a6130 con 0x7f0a80101530 2024-05-09T00:13:56.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a76ffd700 1 -- 172.21.15.81:0/2226127635 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a780053e0 con 0x7f0a80101530 2024-05-09T00:13:56.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.280+0000 7f0a87ea6700 1 -- 172.21.15.81:0/2226127635 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a801a6640 con 0x7f0a80101530 2024-05-09T00:13:56.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.282+0000 7f0a76ffd700 1 -- 172.21.15.81:0/2226127635 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f0a7800c980 con 0x7f0a80101530 2024-05-09T00:13:56.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.283+0000 7f0a76ffd700 1 --2- 172.21.15.81:0/2226127635 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a6c0a1310 0x7f0a6c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.283+0000 7f0a85c42700 1 --2- 172.21.15.81:0/2226127635 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a6c0a1310 0x7f0a6c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.283+0000 7f0a76ffd700 1 -- 172.21.15.81:0/2226127635 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f0a780cc2e0 con 0x7f0a80101530 2024-05-09T00:13:56.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.284+0000 7f0a85c42700 1 --2- 172.21.15.81:0/2226127635 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a6c0a1310 0x7f0a6c0a37d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0a70000c00 tx=0x7f0a70005fb0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.284+0000 7f0a94060b80 1 Processor -- start 2024-05-09T00:13:56.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.284+0000 7f0a94060b80 1 -- start start 2024-05-09T00:13:56.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.284+0000 7f0a94060b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 0x56211e8dc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.284+0000 7f0a94060b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dc720 0x56211e8d6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.284+0000 7f0a94060b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8d6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.284+0000 7f0a94060b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211e82d150 con 0x56211e8d6890 2024-05-09T00:13:56.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.284+0000 7f0a94060b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211e82ab10 con 0x56211e8dc720 2024-05-09T00:13:56.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a94060b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211e826400 con 0x56211e8dbe00 2024-05-09T00:13:56.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a86443700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8d6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a86443700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8d6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47300/0 (socket says 172.21.15.81:47300) 2024-05-09T00:13:56.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a86443700 1 -- 172.21.15.81:0/4220778425 learned_addr learned my addr 172.21.15.81:0/4220778425 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a85c42700 1 --2- 172.21.15.81:0/4220778425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 0x56211e8dc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a86443700 1 -- 172.21.15.81:0/4220778425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 msgr2=0x56211e8dc1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a85441700 1 --2- 172.21.15.81:0/4220778425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dc720 0x56211e8d6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a86443700 1 --2- 172.21.15.81:0/4220778425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 0x56211e8dc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a86443700 1 -- 172.21.15.81:0/4220778425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dc720 msgr2=0x56211e8d6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a86443700 1 --2- 172.21.15.81:0/4220778425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dc720 0x56211e8d6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a86443700 1 -- 172.21.15.81:0/4220778425 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56211e6a73b0 con 0x56211e8d6890 2024-05-09T00:13:56.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a86443700 1 --2- 172.21.15.81:0/4220778425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8d6cd0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f0a78095e60 tx=0x7f0a78098d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0c3b4427df9bf0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a6bfff700 1 -- 172.21.15.81:0/4220778425 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a780840f0 con 0x56211e8d6890 2024-05-09T00:13:56.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a6bfff700 1 -- 172.21.15.81:0/4220778425 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a7809f040 con 0x56211e8d6890 2024-05-09T00:13:56.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.285+0000 7f0a6bfff700 1 -- 172.21.15.81:0/4220778425 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a78095b00 con 0x56211e8d6890 2024-05-09T00:13:56.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.286+0000 7f0a94060b80 1 -- 172.21.15.81:0/4220778425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 msgr2=0x56211e8d6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.286+0000 7f0a94060b80 1 --2- 172.21.15.81:0/4220778425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8d6cd0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f0a78095e60 tx=0x7f0a78098d50 comp rx=0 tx=0).stop 2024-05-09T00:13:56.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.286+0000 7f0a94060b80 1 -- 172.21.15.81:0/4220778425 shutdown_connections 2024-05-09T00:13:56.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.286+0000 7f0a94060b80 1 --2- 172.21.15.81:0/4220778425 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8d6cd0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.286+0000 7f0a94060b80 1 --2- 172.21.15.81:0/4220778425 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 0x56211e8dc1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.286+0000 7f0a94060b80 1 --2- 172.21.15.81:0/4220778425 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dc720 0x56211e8d6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.286+0000 7f0a94060b80 1 -- 172.21.15.81:0/4220778425 >> 172.21.15.81:0/4220778425 conn(0x56211e834210 msgr2=0x56211e8d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.286+0000 7f0a94060b80 1 -- 172.21.15.81:0/4220778425 shutdown_connections 2024-05-09T00:13:56.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.286+0000 7f0a94060b80 1 -- 172.21.15.81:0/4220778425 wait complete. 2024-05-09T00:13:56.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.286+0000 7f0a94060b80 1 -- start start 2024-05-09T00:13:56.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.286+0000 7f0a94060b80 1 Processor -- start 2024-05-09T00:13:56.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a94060b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8dfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a94060b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 0x56211e8e0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a94060b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dc720 0x56211e8e0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a94060b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211e7c2560 con 0x56211e8d6890 2024-05-09T00:13:56.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a94060b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211e7c2200 con 0x56211e8dc720 2024-05-09T00:13:56.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a94060b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211e6a96a0 con 0x56211e8dbe00 2024-05-09T00:13:56.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a94060b80 10 client.0 _ll_register_callbacks cb 0x56211e7cbb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:56.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a85c42700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8dfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a85c42700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8dfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47312/0 (socket says 172.21.15.81:47312) 2024-05-09T00:13:56.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a85c42700 1 -- 172.21.15.81:0/4196180437 learned_addr learned my addr 172.21.15.81:0/4196180437 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a85441700 1 --2- 172.21.15.81:0/4196180437 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 0x56211e8e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a86443700 1 --2- 172.21.15.81:0/4196180437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dc720 0x56211e8e0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a85c42700 1 -- 172.21.15.81:0/4196180437 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 msgr2=0x56211e8e0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a85c42700 1 --2- 172.21.15.81:0/4196180437 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 0x56211e8e0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a85c42700 1 -- 172.21.15.81:0/4196180437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dc720 msgr2=0x56211e8e0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a85c42700 1 --2- 172.21.15.81:0/4196180437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dc720 0x56211e8e0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a85c42700 1 -- 172.21.15.81:0/4196180437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a801a6640 con 0x56211e8d6890 2024-05-09T00:13:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a86443700 1 --2- 172.21.15.81:0/4196180437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dc720 0x56211e8e0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a85c42700 1 --2- 172.21.15.81:0/4196180437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8dfbc0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000be60 tx=0x7f0a7001a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec7b9a219ba31b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.287+0000 7f0a697fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a697fa700 1 -- 172.21.15.81:0/4196180437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7002f610 con 0x56211e8d6890 2024-05-09T00:13:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a697fa700 1 -- 172.21.15.81:0/4196180437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f0a7002f770 con 0x56211e8d6890 2024-05-09T00:13:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a94060b80 1 -- 172.21.15.81:0/4196180437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56211e77f270 con 0x56211e8d6890 2024-05-09T00:13:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a697fa700 1 -- 172.21.15.81:0/4196180437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a7002f930 con 0x56211e8d6890 2024-05-09T00:13:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a94060b80 10 client.18567 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:56.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a94060b80 1 -- 172.21.15.81:0/4196180437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56211e653b60 con 0x56211e8d6890 2024-05-09T00:13:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a697fa700 1 -- 172.21.15.81:0/4196180437 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a7003c020 con 0x56211e8d6890 2024-05-09T00:13:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a697fa700 1 -- 172.21.15.81:0/4196180437 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0a70024b30 con 0x56211e8d6890 2024-05-09T00:13:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a94060b80 10 client.18567 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a94060b80 10 client.18567 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:13:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a94060b80 20 client.18567 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a94060b80 1 --2- 172.21.15.81:0/4196180437 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56211e8f01d0 0x56211e8f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a94060b80 4 client.18567 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a94060b80 1 -- 172.21.15.81:0/4196180437 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56211e8a5810 con 0x56211e8f01d0 2024-05-09T00:13:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.288+0000 7f0a85441700 1 --2- 172.21.15.81:0/4196180437 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56211e8f01d0 0x56211e8f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.289+0000 7f0a697fa700 10 client.18567 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:13:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.289+0000 7f0a85441700 1 --2- 172.21.15.81:0/4196180437 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56211e8f01d0 0x56211e8f25f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=86d00d1b6edbb5a server_cookie=d628c0764247b1eb in_seq=0 out_seq=0 2024-05-09T00:13:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.289+0000 7f0a697fa700 1 -- 172.21.15.81:0/4196180437 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56211e8a5810 con 0x56211e8f01d0 2024-05-09T00:13:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.289+0000 7f0a697fa700 10 client.18567 handle_command_reply: tid=0 2024-05-09T00:13:56.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.290+0000 7f0a94060b80 1 client.18567 shutdown 2024-05-09T00:13:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.290+0000 7f0a94060b80 1 -- 172.21.15.81:0/4196180437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 msgr2=0x56211e8dfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.290+0000 7f0a94060b80 1 --2- 172.21.15.81:0/4196180437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8dfbc0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000be60 tx=0x7f0a7001a050 comp rx=0 tx=0).stop 2024-05-09T00:13:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.290+0000 7f0a94060b80 1 -- 172.21.15.81:0/4196180437 shutdown_connections 2024-05-09T00:13:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.290+0000 7f0a94060b80 1 --2- 172.21.15.81:0/4196180437 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56211e8f01d0 0x56211e8f25f0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.290+0000 7f0a94060b80 1 --2- 172.21.15.81:0/4196180437 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dc720 0x56211e8e0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.290+0000 7f0a94060b80 1 --2- 172.21.15.81:0/4196180437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8dfbc0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.290+0000 7f0a94060b80 1 --2- 172.21.15.81:0/4196180437 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 0x56211e8e0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.290+0000 7f0a697fa700 0 client.18567 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:13:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.290+0000 7f0a94060b80 1 -- 172.21.15.81:0/4196180437 >> 172.21.15.81:0/4196180437 conn(0x56211e834210 msgr2=0x56211e8d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.290+0000 7f0a94060b80 1 -- 172.21.15.81:0/4196180437 shutdown_connections 2024-05-09T00:13:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.290+0000 7f0a94060b80 1 -- 172.21.15.81:0/4196180437 wait complete. 2024-05-09T00:13:56.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.290+0000 7f0a94060b80 20 client.18567 trim_cache size 0 max 16384 2024-05-09T00:13:56.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.303+0000 7f0a94060b80 1 Processor -- start 2024-05-09T00:13:56.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.303+0000 7f0a94060b80 1 -- start start 2024-05-09T00:13:56.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.303+0000 7f0a94060b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8d6890 0x56211e8d6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.303+0000 7f0a94060b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 0x56211e8db3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.303+0000 7f0a94060b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8dc720 0x56211e8d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.303+0000 7f0a94060b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211e8d2890 con 0x56211e8dc720 2024-05-09T00:13:56.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.303+0000 7f0a94060b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211e8e11c0 con 0x56211e8d6890 2024-05-09T00:13:56.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.303+0000 7f0a94060b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211e8ddbc0 con 0x56211e8dbe00 2024-05-09T00:13:56.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.303+0000 7f0a86443700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8dc720 0x56211e8d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.303+0000 7f0a86443700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8dc720 0x56211e8d0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47322/0 (socket says 172.21.15.81:47322) 2024-05-09T00:13:56.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.303+0000 7f0a86443700 1 -- 172.21.15.81:0/2191757169 learned_addr learned my addr 172.21.15.81:0/2191757169 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.303+0000 7f0a85441700 1 --2- 172.21.15.81:0/2191757169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 0x56211e8db3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.303+0000 7f0a85c42700 1 --2- 172.21.15.81:0/2191757169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8d6890 0x56211e8d6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a86443700 1 -- 172.21.15.81:0/2191757169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 msgr2=0x56211e8db3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a86443700 1 --2- 172.21.15.81:0/2191757169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 0x56211e8db3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a86443700 1 -- 172.21.15.81:0/2191757169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8d6890 msgr2=0x56211e8d6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a86443700 1 --2- 172.21.15.81:0/2191757169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8d6890 0x56211e8d6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a86443700 1 -- 172.21.15.81:0/2191757169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56211e7ec560 con 0x56211e8dc720 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a86443700 1 --2- 172.21.15.81:0/2191757169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8dc720 0x56211e8d0d20 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f0a780a12b0 tx=0x7f0a7800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21cb638cd8bd9a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a74ff9700 1 -- 172.21.15.81:0/2191757169 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7800a1d0 con 0x56211e8dc720 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a74ff9700 1 -- 172.21.15.81:0/2191757169 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a7809d220 con 0x56211e8dc720 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a74ff9700 1 -- 172.21.15.81:0/2191757169 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7800cc30 con 0x56211e8dc720 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a94060b80 1 -- 172.21.15.81:0/2191757169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8dc720 msgr2=0x56211e8d0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a94060b80 1 --2- 172.21.15.81:0/2191757169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8dc720 0x56211e8d0d20 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f0a780a12b0 tx=0x7f0a7800c8a0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a94060b80 1 -- 172.21.15.81:0/2191757169 shutdown_connections 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a94060b80 1 --2- 172.21.15.81:0/2191757169 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8d6890 0x56211e8d6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a94060b80 1 --2- 172.21.15.81:0/2191757169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8dc720 0x56211e8d0d20 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a94060b80 1 --2- 172.21.15.81:0/2191757169 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dbe00 0x56211e8db3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a94060b80 1 -- 172.21.15.81:0/2191757169 >> 172.21.15.81:0/2191757169 conn(0x56211e834210 msgr2=0x56211e8dacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.304+0000 7f0a94060b80 1 -- 172.21.15.81:0/2191757169 shutdown_connections 2024-05-09T00:13:56.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a94060b80 1 -- 172.21.15.81:0/2191757169 wait complete. 2024-05-09T00:13:56.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a94060b80 1 -- start start 2024-05-09T00:13:56.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a94060b80 1 Processor -- start 2024-05-09T00:13:56.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a94060b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8e5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a94060b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dbe00 0x56211e8e5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a94060b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dc720 0x56211e9456d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a94060b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211e945c10 con 0x56211e8d6890 2024-05-09T00:13:56.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a94060b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211e945d80 con 0x56211e8dbe00 2024-05-09T00:13:56.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a94060b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56211e945f40 con 0x56211e8dc720 2024-05-09T00:13:56.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a94060b80 10 client.0 _ll_register_callbacks cb 0x56211e7cbb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:56.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a85c42700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8e5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a85c42700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8e5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47330/0 (socket says 172.21.15.81:47330) 2024-05-09T00:13:56.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a85c42700 1 -- 172.21.15.81:0/1167931218 learned_addr learned my addr 172.21.15.81:0/1167931218 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a85441700 1 --2- 172.21.15.81:0/1167931218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dbe00 0x56211e8e5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.305+0000 7f0a86443700 1 --2- 172.21.15.81:0/1167931218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dc720 0x56211e9456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a85c42700 1 -- 172.21.15.81:0/1167931218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dc720 msgr2=0x56211e9456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a85c42700 1 --2- 172.21.15.81:0/1167931218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dc720 0x56211e9456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a85c42700 1 -- 172.21.15.81:0/1167931218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dbe00 msgr2=0x56211e8e5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a85c42700 1 --2- 172.21.15.81:0/1167931218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dbe00 0x56211e8e5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a85c42700 1 -- 172.21.15.81:0/1167931218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56211e6a73b0 con 0x56211e8d6890 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a85c42700 1 --2- 172.21.15.81:0/1167931218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8e5500 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f0a70005850 tx=0x7f0a70018b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ad2bec1788cd14 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a697fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a697fa700 1 -- 172.21.15.81:0/1167931218 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a70024820 con 0x56211e8d6890 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a697fa700 1 -- 172.21.15.81:0/1167931218 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f0a7003d080 con 0x56211e8d6890 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a94060b80 1 -- 172.21.15.81:0/1167931218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a7809f040 con 0x56211e8d6890 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a697fa700 1 -- 172.21.15.81:0/1167931218 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a700052f0 con 0x56211e8d6890 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a94060b80 10 client.18573 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:56.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a94060b80 1 -- 172.21.15.81:0/1167931218 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56211e6abcd0 con 0x56211e8d6890 2024-05-09T00:13:56.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a697fa700 1 -- 172.21.15.81:0/1167931218 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a7809f040 con 0x56211e8d6890 2024-05-09T00:13:56.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a697fa700 1 -- 172.21.15.81:0/1167931218 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0a7003f070 con 0x56211e8d6890 2024-05-09T00:13:56.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a94060b80 10 client.18573 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:56.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a94060b80 10 client.18573 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:13:56.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a94060b80 20 client.18573 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:56.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a94060b80 1 --2- 172.21.15.81:0/1167931218 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56211e9472b0 0x56211e9496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a94060b80 4 client.18573 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:13:56.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.306+0000 7f0a94060b80 1 -- 172.21.15.81:0/1167931218 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56211e81eec0 con 0x56211e9472b0 2024-05-09T00:13:56.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.307+0000 7f0a85441700 1 --2- 172.21.15.81:0/1167931218 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56211e9472b0 0x56211e9496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.307+0000 7f0a85441700 1 --2- 172.21.15.81:0/1167931218 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56211e9472b0 0x56211e9496a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fd6ea1cfdecc0c38 server_cookie=73f8827eb09e74ea in_seq=0 out_seq=0 2024-05-09T00:13:56.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.307+0000 7f0a697fa700 10 client.18573 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:13:56.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.307+0000 7f0a697fa700 1 -- 172.21.15.81:0/1167931218 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56211e81eec0 con 0x56211e9472b0 2024-05-09T00:13:56.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.307+0000 7f0a697fa700 10 client.18573 handle_command_reply: tid=0 2024-05-09T00:13:56.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.307+0000 7f0a94060b80 1 client.18573 shutdown 2024-05-09T00:13:56.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.307+0000 7f0a94060b80 1 -- 172.21.15.81:0/1167931218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 msgr2=0x56211e8e5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.307+0000 7f0a94060b80 1 --2- 172.21.15.81:0/1167931218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8e5500 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f0a70005850 tx=0x7f0a70018b90 comp rx=0 tx=0).stop 2024-05-09T00:13:56.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.307+0000 7f0a94060b80 1 -- 172.21.15.81:0/1167931218 shutdown_connections 2024-05-09T00:13:56.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.307+0000 7f0a94060b80 1 --2- 172.21.15.81:0/1167931218 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56211e8dc720 0x56211e9456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.307+0000 7f0a94060b80 1 --2- 172.21.15.81:0/1167931218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56211e8d6890 0x56211e8e5500 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a94060b80 1 --2- 172.21.15.81:0/1167931218 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x56211e9472b0 0x56211e9496a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a94060b80 1 --2- 172.21.15.81:0/1167931218 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56211e8dbe00 0x56211e8e5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a697fa700 0 client.18573 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:13:56.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a94060b80 1 -- 172.21.15.81:0/1167931218 >> 172.21.15.81:0/1167931218 conn(0x56211e834210 msgr2=0x56211e8dcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a94060b80 1 -- 172.21.15.81:0/1167931218 shutdown_connections 2024-05-09T00:13:56.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a94060b80 1 -- 172.21.15.81:0/1167931218 wait complete. 2024-05-09T00:13:56.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a94060b80 20 client.18573 trim_cache size 0 max 16384 2024-05-09T00:13:56.314 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:13:56.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a87ea6700 1 -- 172.21.15.81:0/2226127635 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a6c0a1310 msgr2=0x7f0a6c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a87ea6700 1 --2- 172.21.15.81:0/2226127635 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a6c0a1310 0x7f0a6c0a37d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0a70000c00 tx=0x7f0a70005fb0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a87ea6700 1 -- 172.21.15.81:0/2226127635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a80101530 msgr2=0x7f0a801a5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a87ea6700 1 --2- 172.21.15.81:0/2226127635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a80101530 0x7f0a801a5550 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f0a7800ada0 tx=0x7f0a7800c330 comp rx=0 tx=0).stop 2024-05-09T00:13:56.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a87ea6700 1 -- 172.21.15.81:0/2226127635 shutdown_connections 2024-05-09T00:13:56.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a87ea6700 1 --2- 172.21.15.81:0/2226127635 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f0a6c0a1310 0x7f0a6c0a37d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a87ea6700 1 --2- 172.21.15.81:0/2226127635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a80101530 0x7f0a801a5550 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a87ea6700 1 --2- 172.21.15.81:0/2226127635 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a800ffb40 0x7f0a80100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a87ea6700 1 --2- 172.21.15.81:0/2226127635 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f0a80106350 0x7f0a80100ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a87ea6700 1 -- 172.21.15.81:0/2226127635 >> 172.21.15.81:0/2226127635 conn(0x7f0a80075070 msgr2=0x7f0a800fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a87ea6700 1 -- 172.21.15.81:0/2226127635 shutdown_connections 2024-05-09T00:13:56.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.308+0000 7f0a87ea6700 1 -- 172.21.15.81:0/2226127635 wait complete. 2024-05-09T00:13:56.318 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:13:56.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.443+0000 7f4d9dad9700 1 -- 172.21.15.81:0/415904491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d98100a10 msgr2=0x7f4d98104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.443+0000 7f4d9dad9700 1 --2- 172.21.15.81:0/415904491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d98100a10 0x7f4d98104a30 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009990 tx=0x7f4d8c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.443+0000 7f4d9dad9700 1 -- 172.21.15.81:0/415904491 shutdown_connections 2024-05-09T00:13:56.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.443+0000 7f4d9dad9700 1 --2- 172.21.15.81:0/415904491 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d98105160 0x7f4d9810cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.443+0000 7f4d9dad9700 1 --2- 172.21.15.81:0/415904491 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d98100060 0x7f4d98100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.443+0000 7f4d9dad9700 1 --2- 172.21.15.81:0/415904491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d98100a10 0x7f4d98104a30 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.443+0000 7f4d9dad9700 1 -- 172.21.15.81:0/415904491 >> 172.21.15.81:0/415904491 conn(0x7f4d98076f40 msgr2=0x7f4d98077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.443+0000 7f4d9dad9700 1 -- 172.21.15.81:0/415904491 shutdown_connections 2024-05-09T00:13:56.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.443+0000 7f4d9dad9700 1 -- 172.21.15.81:0/415904491 wait complete. 2024-05-09T00:13:56.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.444+0000 7f4d9dad9700 1 Processor -- start 2024-05-09T00:13:56.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.444+0000 7f4d9dad9700 1 -- start start 2024-05-09T00:13:56.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.444+0000 7f4d9dad9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d98100060 0x7f4d98101ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.444+0000 7f4d9dad9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d98105160 0x7f4d98102010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.444+0000 7f4d9dad9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d98102550 0x7f4d981a5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.444+0000 7f4d9dad9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d981a5c00 con 0x7f4d98102550 2024-05-09T00:13:56.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.444+0000 7f4d9dad9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d981a5d70 con 0x7f4d98100060 2024-05-09T00:13:56.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.444+0000 7f4d9dad9700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d981a5f30 con 0x7f4d98105160 2024-05-09T00:13:56.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d97fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d98102550 0x7f4d981a5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d97fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d98102550 0x7f4d981a5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47350/0 (socket says 172.21.15.81:47350) 2024-05-09T00:13:56.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d97fff700 1 -- 172.21.15.81:0/3415221557 learned_addr learned my addr 172.21.15.81:0/3415221557 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d96ffd700 1 --2- 172.21.15.81:0/3415221557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d98105160 0x7f4d98102010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d977fe700 1 --2- 172.21.15.81:0/3415221557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d98100060 0x7f4d98101ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d97fff700 1 -- 172.21.15.81:0/3415221557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d98105160 msgr2=0x7f4d98102010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d97fff700 1 --2- 172.21.15.81:0/3415221557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d98105160 0x7f4d98102010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d97fff700 1 -- 172.21.15.81:0/3415221557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d98100060 msgr2=0x7f4d98101ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d97fff700 1 --2- 172.21.15.81:0/3415221557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d98100060 0x7f4d98101ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d97fff700 1 -- 172.21.15.81:0/3415221557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c0095f0 con 0x7f4d98102550 2024-05-09T00:13:56.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d97fff700 1 --2- 172.21.15.81:0/3415221557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d98102550 0x7f4d981a5630 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f4d90007ee0 tx=0x7f4d9000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d94ff9700 1 -- 172.21.15.81:0/3415221557 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000ddd0 con 0x7f4d98102550 2024-05-09T00:13:56.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d94ff9700 1 -- 172.21.15.81:0/3415221557 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d9000f040 con 0x7f4d98102550 2024-05-09T00:13:56.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d94ff9700 1 -- 172.21.15.81:0/3415221557 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d900048e0 con 0x7f4d98102550 2024-05-09T00:13:56.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d9dad9700 1 -- 172.21.15.81:0/3415221557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d981a6210 con 0x7f4d98102550 2024-05-09T00:13:56.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.445+0000 7f4d9dad9700 1 -- 172.21.15.81:0/3415221557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d981a66f0 con 0x7f4d98102550 2024-05-09T00:13:56.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.447+0000 7f4d94ff9700 1 -- 172.21.15.81:0/3415221557 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4d90003a00 con 0x7f4d98102550 2024-05-09T00:13:56.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.448+0000 7f4d94ff9700 1 --2- 172.21.15.81:0/3415221557 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4d800a1310 0x7f4d800a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.448+0000 7f4d977fe700 1 --2- 172.21.15.81:0/3415221557 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4d800a1310 0x7f4d800a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.448+0000 7f4d94ff9700 1 -- 172.21.15.81:0/3415221557 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f4d900cc570 con 0x7f4d98102550 2024-05-09T00:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.448+0000 7f4d977fe700 1 --2- 172.21.15.81:0/3415221557 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4d800a1310 0x7f4d800a37d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4d88005950 tx=0x7f4d880058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.448+0000 7f4da9c93b80 1 Processor -- start 2024-05-09T00:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4da9c93b80 1 -- start start 2024-05-09T00:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4da9c93b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa9e00 0x558c9faaa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4da9c93b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faaa720 0x558c9faa4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4da9c93b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa4890 0x558c9faa4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4da9c93b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9f9fb150 con 0x558c9faa9e00 2024-05-09T00:13:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4da9c93b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9f9f8b10 con 0x558c9faa4890 2024-05-09T00:13:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4da9c93b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9f9f4400 con 0x558c9faaa720 2024-05-09T00:13:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4d977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa9e00 0x558c9faaa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4d977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa9e00 0x558c9faaa1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47366/0 (socket says 172.21.15.81:47366) 2024-05-09T00:13:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4d977fe700 1 -- 172.21.15.81:0/1105147399 learned_addr learned my addr 172.21.15.81:0/1105147399 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4d97fff700 1 --2- 172.21.15.81:0/1105147399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa4890 0x558c9faa4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4d977fe700 1 -- 172.21.15.81:0/1105147399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faaa720 msgr2=0x558c9faa4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4d977fe700 1 --2- 172.21.15.81:0/1105147399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faaa720 0x558c9faa4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4d977fe700 1 -- 172.21.15.81:0/1105147399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa4890 msgr2=0x558c9faa4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4d977fe700 1 --2- 172.21.15.81:0/1105147399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa4890 0x558c9faa4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4d977fe700 1 -- 172.21.15.81:0/1105147399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c9f8753b0 con 0x558c9faa9e00 2024-05-09T00:13:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4d97fff700 1 --2- 172.21.15.81:0/1105147399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa4890 0x558c9faa4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4d977fe700 1 --2- 172.21.15.81:0/1105147399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa9e00 0x558c9faaa1e0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800fd70 tx=0x7f4d88012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27aa67322a111670 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4d7dffb700 1 -- 172.21.15.81:0/1105147399 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d88011c60 con 0x558c9faa9e00 2024-05-09T00:13:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4d7dffb700 1 -- 172.21.15.81:0/1105147399 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d88011dc0 con 0x558c9faa9e00 2024-05-09T00:13:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.449+0000 7f4d7dffb700 1 -- 172.21.15.81:0/1105147399 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8801d780 con 0x558c9faa9e00 2024-05-09T00:13:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.450+0000 7f4da9c93b80 1 -- 172.21.15.81:0/1105147399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa9e00 msgr2=0x558c9faaa1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.450+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/1105147399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa9e00 0x558c9faaa1e0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800fd70 tx=0x7f4d88012000 comp rx=0 tx=0).stop 2024-05-09T00:13:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.450+0000 7f4da9c93b80 1 -- 172.21.15.81:0/1105147399 shutdown_connections 2024-05-09T00:13:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.450+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/1105147399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa4890 0x558c9faa4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.450+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/1105147399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa9e00 0x558c9faaa1e0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.450+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/1105147399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faaa720 0x558c9faa4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.450+0000 7f4da9c93b80 1 -- 172.21.15.81:0/1105147399 >> 172.21.15.81:0/1105147399 conn(0x558c9fa02210 msgr2=0x558c9fa9edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.450+0000 7f4da9c93b80 1 -- 172.21.15.81:0/1105147399 shutdown_connections 2024-05-09T00:13:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.450+0000 7f4da9c93b80 1 -- 172.21.15.81:0/1105147399 wait complete. 2024-05-09T00:13:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.450+0000 7f4da9c93b80 1 -- start start 2024-05-09T00:13:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4da9c93b80 1 Processor -- start 2024-05-09T00:13:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4da9c93b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faa4890 0x558c9faadb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4da9c93b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa9e00 0x558c9faae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4da9c93b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faaa720 0x558c9faae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4da9c93b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9f990560 con 0x558c9faa9e00 2024-05-09T00:13:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4da9c93b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9f990200 con 0x558c9faaa720 2024-05-09T00:13:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4da9c93b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9f8776a0 con 0x558c9faa4890 2024-05-09T00:13:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4da9c93b80 10 client.0 _ll_register_callbacks cb 0x558c9f999b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4d96ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa9e00 0x558c9faae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4d96ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa9e00 0x558c9faae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47380/0 (socket says 172.21.15.81:47380) 2024-05-09T00:13:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4d96ffd700 1 -- 172.21.15.81:0/2491764175 learned_addr learned my addr 172.21.15.81:0/2491764175 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4d977fe700 1 --2- 172.21.15.81:0/2491764175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faa4890 0x558c9faadb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4d97fff700 1 --2- 172.21.15.81:0/2491764175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faaa720 0x558c9faae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4d96ffd700 1 -- 172.21.15.81:0/2491764175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faa4890 msgr2=0x558c9faadb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4d96ffd700 1 --2- 172.21.15.81:0/2491764175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faa4890 0x558c9faadb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4d96ffd700 1 -- 172.21.15.81:0/2491764175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faaa720 msgr2=0x558c9faae5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4d96ffd700 1 --2- 172.21.15.81:0/2491764175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faaa720 0x558c9faae5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4d96ffd700 1 -- 172.21.15.81:0/2491764175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8800fa20 con 0x558c9faa9e00 2024-05-09T00:13:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.451+0000 7f4d977fe700 1 --2- 172.21.15.81:0/2491764175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faa4890 0x558c9faadb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4d96ffd700 1 --2- 172.21.15.81:0/2491764175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa9e00 0x558c9faae070 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f4d9806a6d0 tx=0x7f4d8c009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d94002da9178ca server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4d76ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4d76ffd700 1 -- 172.21.15.81:0/2491764175 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c01d070 con 0x558c9faa9e00 2024-05-09T00:13:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4da9c93b80 1 -- 172.21.15.81:0/2491764175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c9f94d270 con 0x558c9faa9e00 2024-05-09T00:13:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4d76ffd700 1 -- 172.21.15.81:0/2491764175 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f4d8c00bb80 con 0x558c9faa9e00 2024-05-09T00:13:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4d76ffd700 1 -- 172.21.15.81:0/2491764175 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d8c00bd40 con 0x558c9faa9e00 2024-05-09T00:13:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4da9c93b80 10 client.18585 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4da9c93b80 1 -- 172.21.15.81:0/2491764175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558c9f821b60 con 0x558c9faa9e00 2024-05-09T00:13:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4d76ffd700 1 -- 172.21.15.81:0/2491764175 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558c9f94d270 con 0x558c9faa9e00 2024-05-09T00:13:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4d76ffd700 1 -- 172.21.15.81:0/2491764175 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4d8c00f580 con 0x558c9faa9e00 2024-05-09T00:13:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4da9c93b80 10 client.18585 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4da9c93b80 10 client.18585 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:13:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4da9c93b80 20 client.18585 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/2491764175 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x558c9fabe270 0x558c9fac0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4da9c93b80 4 client.18585 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.452+0000 7f4da9c93b80 1 -- 172.21.15.81:0/2491764175 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c9fa73810 con 0x558c9fabe270 2024-05-09T00:13:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.453+0000 7f4d977fe700 1 --2- 172.21.15.81:0/2491764175 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x558c9fabe270 0x558c9fac0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.453+0000 7f4d977fe700 1 --2- 172.21.15.81:0/2491764175 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x558c9fabe270 0x558c9fac0690 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e03576ca2b416c82 server_cookie=8a4a8bed9f29548c in_seq=0 out_seq=0 2024-05-09T00:13:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.453+0000 7f4d76ffd700 10 client.18585 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:13:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4d76ffd700 1 -- 172.21.15.81:0/2491764175 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558c9fa73810 con 0x558c9fabe270 2024-05-09T00:13:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4d76ffd700 10 client.18585 handle_command_reply: tid=0 2024-05-09T00:13:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4da9c93b80 1 client.18585 shutdown 2024-05-09T00:13:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4da9c93b80 1 -- 172.21.15.81:0/2491764175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa9e00 msgr2=0x558c9faae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/2491764175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa9e00 0x558c9faae070 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f4d9806a6d0 tx=0x7f4d8c009ee0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4da9c93b80 1 -- 172.21.15.81:0/2491764175 shutdown_connections 2024-05-09T00:13:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/2491764175 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x558c9fabe270 0x558c9fac0690 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/2491764175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faaa720 0x558c9faae5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/2491764175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faa4890 0x558c9faadb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4d76ffd700 0 client.18585 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:13:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/2491764175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa9e00 0x558c9faae070 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4da9c93b80 1 -- 172.21.15.81:0/2491764175 >> 172.21.15.81:0/2491764175 conn(0x558c9fa02210 msgr2=0x558c9fa9e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4da9c93b80 1 -- 172.21.15.81:0/2491764175 shutdown_connections 2024-05-09T00:13:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4da9c93b80 1 -- 172.21.15.81:0/2491764175 wait complete. 2024-05-09T00:13:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.454+0000 7f4da9c93b80 20 client.18585 trim_cache size 0 max 16384 2024-05-09T00:13:56.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.467+0000 7f4da9c93b80 1 Processor -- start 2024-05-09T00:13:56.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.467+0000 7f4da9c93b80 1 -- start start 2024-05-09T00:13:56.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.467+0000 7f4da9c93b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa4890 0x558c9faa4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.467+0000 7f4da9c93b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faa9e00 0x558c9fa9ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.467+0000 7f4da9c93b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faaa720 0x558c9faae410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.467+0000 7f4da9c93b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9fabae00 con 0x558c9faaa720 2024-05-09T00:13:56.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4da9c93b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9fa9bdc0 con 0x558c9faa4890 2024-05-09T00:13:56.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4da9c93b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9fac58a0 con 0x558c9faa9e00 2024-05-09T00:13:56.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4d97fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faaa720 0x558c9faae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4d97fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faaa720 0x558c9faae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47396/0 (socket says 172.21.15.81:47396) 2024-05-09T00:13:56.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4d97fff700 1 -- 172.21.15.81:0/3860468351 learned_addr learned my addr 172.21.15.81:0/3860468351 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4d977fe700 1 --2- 172.21.15.81:0/3860468351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa4890 0x558c9faa4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4d97fff700 1 -- 172.21.15.81:0/3860468351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faa9e00 msgr2=0x558c9fa9ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4d97fff700 1 --2- 172.21.15.81:0/3860468351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faa9e00 0x558c9fa9ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4d97fff700 1 -- 172.21.15.81:0/3860468351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa4890 msgr2=0x558c9faa4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4d97fff700 1 --2- 172.21.15.81:0/3860468351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa4890 0x558c9faa4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4d97fff700 1 -- 172.21.15.81:0/3860468351 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c9f9ba560 con 0x558c9faaa720 2024-05-09T00:13:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4d97fff700 1 --2- 172.21.15.81:0/3860468351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faaa720 0x558c9faae410 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f4d900992f0 tx=0x7f4d90095a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc36533e54506d87 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4d7e7fc700 1 -- 172.21.15.81:0/3860468351 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d900b9070 con 0x558c9faaa720 2024-05-09T00:13:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4d7e7fc700 1 -- 172.21.15.81:0/3860468351 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d90099cf0 con 0x558c9faaa720 2024-05-09T00:13:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.468+0000 7f4d7e7fc700 1 -- 172.21.15.81:0/3860468351 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9009d170 con 0x558c9faaa720 2024-05-09T00:13:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 -- 172.21.15.81:0/3860468351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faaa720 msgr2=0x558c9faae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/3860468351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faaa720 0x558c9faae410 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f4d900992f0 tx=0x7f4d90095a50 comp rx=0 tx=0).stop 2024-05-09T00:13:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 -- 172.21.15.81:0/3860468351 shutdown_connections 2024-05-09T00:13:56.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/3860468351 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa4890 0x558c9faa4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/3860468351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faaa720 0x558c9faae410 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/3860468351 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faa9e00 0x558c9fa9ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 -- 172.21.15.81:0/3860468351 >> 172.21.15.81:0/3860468351 conn(0x558c9fa02210 msgr2=0x558c9fa9b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 -- 172.21.15.81:0/3860468351 shutdown_connections 2024-05-09T00:13:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 -- 172.21.15.81:0/3860468351 wait complete. 2024-05-09T00:13:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 -- start start 2024-05-09T00:13:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 Processor -- start 2024-05-09T00:13:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa4890 0x558c9fb08700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa9e00 0x558c9fb08c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faaa720 0x558c9fb09180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9fb138b0 con 0x558c9faa4890 2024-05-09T00:13:56.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9fb13a20 con 0x558c9faa9e00 2024-05-09T00:13:56.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c9fb13be0 con 0x558c9faaa720 2024-05-09T00:13:56.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4da9c93b80 10 client.0 _ll_register_callbacks cb 0x558c9f999b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:56.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.469+0000 7f4d977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa4890 0x558c9fb08700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d977fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa4890 0x558c9fb08700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47408/0 (socket says 172.21.15.81:47408) 2024-05-09T00:13:56.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d977fe700 1 -- 172.21.15.81:0/3041759681 learned_addr learned my addr 172.21.15.81:0/3041759681 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d96ffd700 1 --2- 172.21.15.81:0/3041759681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa9e00 0x558c9fb08c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d977fe700 1 -- 172.21.15.81:0/3041759681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faaa720 msgr2=0x558c9fb09180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d977fe700 1 --2- 172.21.15.81:0/3041759681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faaa720 0x558c9fb09180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d977fe700 1 -- 172.21.15.81:0/3041759681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa9e00 msgr2=0x558c9fb08c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d977fe700 1 --2- 172.21.15.81:0/3041759681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa9e00 0x558c9fb08c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d977fe700 1 -- 172.21.15.81:0/3041759681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d981a66f0 con 0x558c9faa4890 2024-05-09T00:13:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d96ffd700 1 --2- 172.21.15.81:0/3041759681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa9e00 0x558c9fb08c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d977fe700 1 --2- 172.21.15.81:0/3041759681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa4890 0x558c9fb08700 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800f6f0 tx=0x7f4d88005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce638cfa9a1489c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d76ffd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d76ffd700 1 -- 172.21.15.81:0/3041759681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d880054d0 con 0x558c9faa4890 2024-05-09T00:13:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d76ffd700 1 -- 172.21.15.81:0/3041759681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f4d88005630 con 0x558c9faa4890 2024-05-09T00:13:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4da9c93b80 1 -- 172.21.15.81:0/3041759681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d88011dc0 con 0x558c9faa4890 2024-05-09T00:13:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d76ffd700 1 -- 172.21.15.81:0/3041759681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d88004710 con 0x558c9faa4890 2024-05-09T00:13:56.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4da9c93b80 10 client.18591 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4da9c93b80 1 -- 172.21.15.81:0/3041759681 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x558c9f879cd0 con 0x558c9faa4890 2024-05-09T00:13:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.470+0000 7f4d76ffd700 1 -- 172.21.15.81:0/3041759681 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d88044020 con 0x558c9faa4890 2024-05-09T00:13:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.471+0000 7f4d76ffd700 1 -- 172.21.15.81:0/3041759681 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4d88036500 con 0x558c9faa4890 2024-05-09T00:13:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.471+0000 7f4da9c93b80 10 client.18591 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.471+0000 7f4da9c93b80 10 client.18591 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:13:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.471+0000 7f4da9c93b80 20 client.18591 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.471+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/3041759681 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x558c9fb15370 0x558c9fb17790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.471+0000 7f4da9c93b80 4 client.18591 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:13:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.471+0000 7f4da9c93b80 1 -- 172.21.15.81:0/3041759681 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558c9f9ecec0 con 0x558c9fb15370 2024-05-09T00:13:56.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.471+0000 7f4d96ffd700 1 --2- 172.21.15.81:0/3041759681 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x558c9fb15370 0x558c9fb17790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.471+0000 7f4d96ffd700 1 --2- 172.21.15.81:0/3041759681 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x558c9fb15370 0x558c9fb17790 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=30bec23b34890b5a server_cookie=e0fbe58a6f49b0cd in_seq=0 out_seq=0 2024-05-09T00:13:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4d76ffd700 10 client.18591 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:13:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4d76ffd700 1 -- 172.21.15.81:0/3041759681 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558c9f9ecec0 con 0x558c9fb15370 2024-05-09T00:13:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4d76ffd700 10 client.18591 handle_command_reply: tid=0 2024-05-09T00:13:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4da9c93b80 1 client.18591 shutdown 2024-05-09T00:13:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4da9c93b80 1 -- 172.21.15.81:0/3041759681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa4890 msgr2=0x558c9fb08700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/3041759681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa4890 0x558c9fb08700 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f4d8800f6f0 tx=0x7f4d88005bb0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4da9c93b80 1 -- 172.21.15.81:0/3041759681 shutdown_connections 2024-05-09T00:13:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/3041759681 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x558c9fb15370 0x558c9fb17790 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/3041759681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x558c9faaa720 0x558c9fb09180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4d76ffd700 0 client.18591 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:13:56.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/3041759681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558c9faa4890 0x558c9fb08700 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4da9c93b80 1 --2- 172.21.15.81:0/3041759681 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x558c9faa9e00 0x558c9fb08c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4da9c93b80 1 -- 172.21.15.81:0/3041759681 >> 172.21.15.81:0/3041759681 conn(0x558c9fa02210 msgr2=0x558c9faa7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4da9c93b80 1 -- 172.21.15.81:0/3041759681 shutdown_connections 2024-05-09T00:13:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4da9c93b80 1 -- 172.21.15.81:0/3041759681 wait complete. 2024-05-09T00:13:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.472+0000 7f4da9c93b80 20 client.18591 trim_cache size 0 max 16384 2024-05-09T00:13:56.480 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:13:56.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.473+0000 7f4d9dad9700 1 -- 172.21.15.81:0/3415221557 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4d800a1310 msgr2=0x7f4d800a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.473+0000 7f4d9dad9700 1 --2- 172.21.15.81:0/3415221557 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4d800a1310 0x7f4d800a37d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4d88005950 tx=0x7f4d880058e0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.473+0000 7f4d9dad9700 1 -- 172.21.15.81:0/3415221557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d98102550 msgr2=0x7f4d981a5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.473+0000 7f4d9dad9700 1 --2- 172.21.15.81:0/3415221557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d98102550 0x7f4d981a5630 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f4d90007ee0 tx=0x7f4d9000d3b0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.473+0000 7f4d9dad9700 1 -- 172.21.15.81:0/3415221557 shutdown_connections 2024-05-09T00:13:56.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.473+0000 7f4d9dad9700 1 --2- 172.21.15.81:0/3415221557 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4d800a1310 0x7f4d800a37d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.473+0000 7f4d9dad9700 1 --2- 172.21.15.81:0/3415221557 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4d98100060 0x7f4d98101ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.473+0000 7f4d9dad9700 1 --2- 172.21.15.81:0/3415221557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d98102550 0x7f4d981a5630 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.473+0000 7f4d9dad9700 1 --2- 172.21.15.81:0/3415221557 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4d98105160 0x7f4d98102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.473+0000 7f4d9dad9700 1 -- 172.21.15.81:0/3415221557 >> 172.21.15.81:0/3415221557 conn(0x7f4d98076f40 msgr2=0x7f4d98103df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.473+0000 7f4d9dad9700 1 -- 172.21.15.81:0/3415221557 shutdown_connections 2024-05-09T00:13:56.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.473+0000 7f4d9dad9700 1 -- 172.21.15.81:0/3415221557 wait complete. 2024-05-09T00:13:56.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:13:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.609+0000 7efcbc313700 1 -- 172.21.15.81:0/2517060219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb4101b10 msgr2=0x7efcb4105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.609+0000 7efcbc313700 1 --2- 172.21.15.81:0/2517060219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb4101b10 0x7efcb4105b50 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009990 tx=0x7efcb0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.609+0000 7efcbc313700 1 -- 172.21.15.81:0/2517060219 shutdown_connections 2024-05-09T00:13:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.609+0000 7efcbc313700 1 --2- 172.21.15.81:0/2517060219 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb4106280 0x7efcb410de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.609+0000 7efcbc313700 1 --2- 172.21.15.81:0/2517060219 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcb4101160 0x7efcb4101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.609+0000 7efcbc313700 1 --2- 172.21.15.81:0/2517060219 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb4101b10 0x7efcb4105b50 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.609+0000 7efcbc313700 1 -- 172.21.15.81:0/2517060219 >> 172.21.15.81:0/2517060219 conn(0x7efcb40fc9c0 msgr2=0x7efcb40fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.609+0000 7efcbc313700 1 -- 172.21.15.81:0/2517060219 shutdown_connections 2024-05-09T00:13:56.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.609+0000 7efcbc313700 1 -- 172.21.15.81:0/2517060219 wait complete. 2024-05-09T00:13:56.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.610+0000 7efcbc313700 1 Processor -- start 2024-05-09T00:13:56.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.610+0000 7efcbc313700 1 -- start start 2024-05-09T00:13:56.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.610+0000 7efcbc313700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb4101160 0x7efcb4197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.610+0000 7efcbc313700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb4106280 0x7efcb4197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.610+0000 7efcbc313700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcb419bd10 0x7efcb419c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.610+0000 7efcbc313700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb419c790 con 0x7efcb4101160 2024-05-09T00:13:56.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.610+0000 7efcbc313700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb419c900 con 0x7efcb4106280 2024-05-09T00:13:56.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.610+0000 7efcbc313700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb419cac0 con 0x7efcb419bd10 2024-05-09T00:13:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.610+0000 7efcba0af700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb4101160 0x7efcb4197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.610+0000 7efcba0af700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb4101160 0x7efcb4197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47424/0 (socket says 172.21.15.81:47424) 2024-05-09T00:13:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.610+0000 7efcba0af700 1 -- 172.21.15.81:0/893911644 learned_addr learned my addr 172.21.15.81:0/893911644 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.610+0000 7efcb98ae700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb4106280 0x7efcb4197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.611+0000 7efcba8b0700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcb419bd10 0x7efcb419c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.611+0000 7efcba0af700 1 -- 172.21.15.81:0/893911644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcb419bd10 msgr2=0x7efcb419c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.611+0000 7efcba0af700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcb419bd10 0x7efcb419c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.611+0000 7efcba0af700 1 -- 172.21.15.81:0/893911644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb4106280 msgr2=0x7efcb4197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.611+0000 7efcba0af700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb4106280 0x7efcb4197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.611+0000 7efcba0af700 1 -- 172.21.15.81:0/893911644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb00095f0 con 0x7efcb4101160 2024-05-09T00:13:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.611+0000 7efcba8b0700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcb419bd10 0x7efcb419c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.611+0000 7efcba0af700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb4101160 0x7efcb4197430 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7efca400c920 tx=0x7efca400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.611+0000 7efcab7fe700 1 -- 172.21.15.81:0/893911644 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca4007b00 con 0x7efcb4101160 2024-05-09T00:13:56.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.611+0000 7efcbc313700 1 -- 172.21.15.81:0/893911644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb41a3fc0 con 0x7efcb4101160 2024-05-09T00:13:56.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.611+0000 7efcab7fe700 1 -- 172.21.15.81:0/893911644 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efca4004cf0 con 0x7efcb4101160 2024-05-09T00:13:56.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.611+0000 7efcab7fe700 1 -- 172.21.15.81:0/893911644 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca4005520 con 0x7efcb4101160 2024-05-09T00:13:56.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.611+0000 7efcbc313700 1 -- 172.21.15.81:0/893911644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb41a44a0 con 0x7efcb4101160 2024-05-09T00:13:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.613+0000 7efcab7fe700 1 -- 172.21.15.81:0/893911644 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7efca4004750 con 0x7efcb4101160 2024-05-09T00:13:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.614+0000 7efcab7fe700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efca00a1290 0x7efca00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.614+0000 7efcb98ae700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efca00a1290 0x7efca00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.614+0000 7efcab7fe700 1 -- 172.21.15.81:0/893911644 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7efca40cc9c0 con 0x7efcb4101160 2024-05-09T00:13:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.614+0000 7efcb98ae700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efca00a1290 0x7efca00a3750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efcb0006010 tx=0x7efcb000b540 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.614+0000 7efcc84cdb80 1 Processor -- start 2024-05-09T00:13:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcc84cdb80 1 -- start start 2024-05-09T00:13:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcc84cdb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee96e00 0x5650bee971e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcc84cdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee97720 0x5650bee91350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcc84cdb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee91890 0x5650bee91cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcc84cdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bede8150 con 0x5650bee97720 2024-05-09T00:13:56.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcc84cdb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bede5b10 con 0x5650bee91890 2024-05-09T00:13:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcc84cdb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bede1400 con 0x5650bee96e00 2024-05-09T00:13:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcb98ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee97720 0x5650bee91350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcb98ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee97720 0x5650bee91350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47428/0 (socket says 172.21.15.81:47428) 2024-05-09T00:13:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcb98ae700 1 -- 172.21.15.81:0/3806774399 learned_addr learned my addr 172.21.15.81:0/3806774399 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcba0af700 1 --2- 172.21.15.81:0/3806774399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee96e00 0x5650bee971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcba8b0700 1 --2- 172.21.15.81:0/3806774399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee91890 0x5650bee91cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcb98ae700 1 -- 172.21.15.81:0/3806774399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee96e00 msgr2=0x5650bee971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcb98ae700 1 --2- 172.21.15.81:0/3806774399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee96e00 0x5650bee971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcb98ae700 1 -- 172.21.15.81:0/3806774399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee91890 msgr2=0x5650bee91cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcb98ae700 1 --2- 172.21.15.81:0/3806774399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee91890 0x5650bee91cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.615+0000 7efcb98ae700 1 -- 172.21.15.81:0/3806774399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650bec623b0 con 0x5650bee97720 2024-05-09T00:13:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.616+0000 7efcb98ae700 1 --2- 172.21.15.81:0/3806774399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee97720 0x5650bee91350 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7efcb0005500 tx=0x7efcb001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e37a278344342f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.616+0000 7efca8da4700 1 -- 172.21.15.81:0/3806774399 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb002b070 con 0x5650bee97720 2024-05-09T00:13:56.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.616+0000 7efca8da4700 1 -- 172.21.15.81:0/3806774399 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efcb001e040 con 0x5650bee97720 2024-05-09T00:13:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.616+0000 7efca8da4700 1 -- 172.21.15.81:0/3806774399 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb0004cb0 con 0x5650bee97720 2024-05-09T00:13:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.616+0000 7efcc84cdb80 1 -- 172.21.15.81:0/3806774399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee97720 msgr2=0x5650bee91350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.616+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/3806774399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee97720 0x5650bee91350 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7efcb0005500 tx=0x7efcb001f000 comp rx=0 tx=0).stop 2024-05-09T00:13:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.616+0000 7efcc84cdb80 1 -- 172.21.15.81:0/3806774399 shutdown_connections 2024-05-09T00:13:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/3806774399 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee91890 0x5650bee91cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/3806774399 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee96e00 0x5650bee971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/3806774399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee97720 0x5650bee91350 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 1 -- 172.21.15.81:0/3806774399 >> 172.21.15.81:0/3806774399 conn(0x5650bedef210 msgr2=0x5650bee8bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 1 -- 172.21.15.81:0/3806774399 shutdown_connections 2024-05-09T00:13:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 1 -- 172.21.15.81:0/3806774399 wait complete. 2024-05-09T00:13:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 1 -- start start 2024-05-09T00:13:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 1 Processor -- start 2024-05-09T00:13:56.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee91890 0x5650bee9ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee96e00 0x5650bee9b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee97720 0x5650bee9b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bed7d560 con 0x5650bee91890 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bed7d200 con 0x5650bee96e00 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bec646a0 con 0x5650bee97720 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcc84cdb80 10 client.0 _ll_register_callbacks cb 0x5650bed86b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcba0af700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee91890 0x5650bee9ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcba0af700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee91890 0x5650bee9ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47430/0 (socket says 172.21.15.81:47430) 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.617+0000 7efcba0af700 1 -- 172.21.15.81:0/2461362412 learned_addr learned my addr 172.21.15.81:0/2461362412 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcba8b0700 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee97720 0x5650bee9b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcba0af700 1 -- 172.21.15.81:0/2461362412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee97720 msgr2=0x5650bee9b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcba0af700 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee97720 0x5650bee9b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcb98ae700 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee96e00 0x5650bee9b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcba0af700 1 -- 172.21.15.81:0/2461362412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee96e00 msgr2=0x5650bee9b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcba0af700 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee96e00 0x5650bee9b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcba0af700 1 -- 172.21.15.81:0/2461362412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb410e670 con 0x5650bee91890 2024-05-09T00:13:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcba8b0700 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee97720 0x5650bee9b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcb98ae700 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee96e00 0x5650bee9b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcba0af700 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee91890 0x5650bee9ab60 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7efca4095fa0 tx=0x7efca409a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68aab27d9aaf847 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efc9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efc9dffb700 1 -- 172.21.15.81:0/2461362412 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efca409d8d0 con 0x5650bee91890 2024-05-09T00:13:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efc9dffb700 1 -- 172.21.15.81:0/2461362412 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7efca40a1f20 con 0x5650bee91890 2024-05-09T00:13:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcc84cdb80 1 -- 172.21.15.81:0/2461362412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5650bed3a270 con 0x5650bee91890 2024-05-09T00:13:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efc9dffb700 1 -- 172.21.15.81:0/2461362412 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efca40b2200 con 0x5650bee91890 2024-05-09T00:13:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcc84cdb80 10 client.18603 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcc84cdb80 1 -- 172.21.15.81:0/2461362412 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5650bec0eb60 con 0x5650bee91890 2024-05-09T00:13:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efc9dffb700 1 -- 172.21.15.81:0/2461362412 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5650bed3a270 con 0x5650bee91890 2024-05-09T00:13:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efc9dffb700 1 -- 172.21.15.81:0/2461362412 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7efca4098f90 con 0x5650bee91890 2024-05-09T00:13:56.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcc84cdb80 10 client.18603 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:56.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcc84cdb80 10 client.18603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:56.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcc84cdb80 20 client.18603 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:56.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5650beeaaf90 0x5650beead3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcc84cdb80 4 client.18603 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:56.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.618+0000 7efcc84cdb80 1 -- 172.21.15.81:0/2461362412 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5650bee60810 con 0x5650beeaaf90 2024-05-09T00:13:56.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.619+0000 7efcb98ae700 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5650beeaaf90 0x5650beead3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.619+0000 7efc9dffb700 10 client.18603 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:56.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.619+0000 7efcb98ae700 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5650beeaaf90 0x5650beead3b0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba7ff9b6e5c9a064 server_cookie=2df91c66438b19f0 in_seq=0 out_seq=0 2024-05-09T00:13:56.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efc9dffb700 1 -- 172.21.15.81:0/2461362412 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5650bee60810 con 0x5650beeaaf90 2024-05-09T00:13:56.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efc9dffb700 10 client.18603 handle_command_reply: tid=0 2024-05-09T00:13:56.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efcc84cdb80 1 client.18603 shutdown 2024-05-09T00:13:56.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efcc84cdb80 1 -- 172.21.15.81:0/2461362412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee91890 msgr2=0x5650bee9ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee91890 0x5650bee9ab60 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7efca4095fa0 tx=0x7efca409a1a0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efcc84cdb80 1 -- 172.21.15.81:0/2461362412 shutdown_connections 2024-05-09T00:13:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5650beeaaf90 0x5650beead3b0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee97720 0x5650bee9b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee91890 0x5650bee9ab60 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/2461362412 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee96e00 0x5650bee9b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efc9dffb700 0 client.18603 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efcc84cdb80 1 -- 172.21.15.81:0/2461362412 >> 172.21.15.81:0/2461362412 conn(0x5650bedef210 msgr2=0x5650bee8b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efcc84cdb80 1 -- 172.21.15.81:0/2461362412 shutdown_connections 2024-05-09T00:13:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efcc84cdb80 1 -- 172.21.15.81:0/2461362412 wait complete. 2024-05-09T00:13:56.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.620+0000 7efcc84cdb80 20 client.18603 trim_cache size 0 max 16384 2024-05-09T00:13:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.633+0000 7efcc84cdb80 1 Processor -- start 2024-05-09T00:13:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.633+0000 7efcc84cdb80 1 -- start start 2024-05-09T00:13:56.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.633+0000 7efcc84cdb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee91890 0x5650bee91350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.633+0000 7efcc84cdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee96e00 0x5650bee8bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.633+0000 7efcc84cdb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee97720 0x5650bee9b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.633+0000 7efcc84cdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bee84120 con 0x5650bee96e00 2024-05-09T00:13:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.633+0000 7efcc84cdb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bee60810 con 0x5650bee97720 2024-05-09T00:13:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.633+0000 7efcc84cdb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bed3a270 con 0x5650bee91890 2024-05-09T00:13:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.634+0000 7efcb98ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee96e00 0x5650bee8bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.634+0000 7efcb98ae700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee96e00 0x5650bee8bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47446/0 (socket says 172.21.15.81:47446) 2024-05-09T00:13:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.634+0000 7efcb98ae700 1 -- 172.21.15.81:0/2343308727 learned_addr learned my addr 172.21.15.81:0/2343308727 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.634+0000 7efcba0af700 1 --2- 172.21.15.81:0/2343308727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee91890 0x5650bee91350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.634+0000 7efcba8b0700 1 --2- 172.21.15.81:0/2343308727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee97720 0x5650bee9b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.634+0000 7efcb98ae700 1 -- 172.21.15.81:0/2343308727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee91890 msgr2=0x5650bee91350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.634+0000 7efcb98ae700 1 --2- 172.21.15.81:0/2343308727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee91890 0x5650bee91350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.634+0000 7efcb98ae700 1 -- 172.21.15.81:0/2343308727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee97720 msgr2=0x5650bee9b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.634+0000 7efcb98ae700 1 --2- 172.21.15.81:0/2343308727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee97720 0x5650bee9b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.634+0000 7efcb98ae700 1 -- 172.21.15.81:0/2343308727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650beda7560 con 0x5650bee96e00 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.634+0000 7efcb98ae700 1 --2- 172.21.15.81:0/2343308727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee96e00 0x5650bee8bd20 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7efcb0004860 tx=0x7efcb00047f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dc537d3069c344 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.634+0000 7efca95a5700 1 -- 172.21.15.81:0/2343308727 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb002b040 con 0x5650bee96e00 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.634+0000 7efca95a5700 1 -- 172.21.15.81:0/2343308727 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efcb0038360 con 0x5650bee96e00 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.634+0000 7efca95a5700 1 -- 172.21.15.81:0/2343308727 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb000bb60 con 0x5650bee96e00 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 -- 172.21.15.81:0/2343308727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee96e00 msgr2=0x5650bee8bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/2343308727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee96e00 0x5650bee8bd20 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7efcb0004860 tx=0x7efcb00047f0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 -- 172.21.15.81:0/2343308727 shutdown_connections 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/2343308727 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee97720 0x5650bee9b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/2343308727 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee91890 0x5650bee91350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/2343308727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee96e00 0x5650bee8bd20 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 -- 172.21.15.81:0/2343308727 >> 172.21.15.81:0/2343308727 conn(0x5650bedef210 msgr2=0x5650bee99430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 -- 172.21.15.81:0/2343308727 shutdown_connections 2024-05-09T00:13:56.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 -- 172.21.15.81:0/2343308727 wait complete. 2024-05-09T00:13:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 -- start start 2024-05-09T00:13:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 Processor -- start 2024-05-09T00:13:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee91890 0x5650beea23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee96e00 0x5650beea0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee97720 0x5650beea05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650beea0cb0 con 0x5650bee97720 2024-05-09T00:13:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650beea0e20 con 0x5650bee91890 2024-05-09T00:13:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650bef004b0 con 0x5650bee96e00 2024-05-09T00:13:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.635+0000 7efcc84cdb80 10 client.0 _ll_register_callbacks cb 0x5650bed86b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efcba8b0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee97720 0x5650beea05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efcba8b0700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee97720 0x5650beea05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47454/0 (socket says 172.21.15.81:47454) 2024-05-09T00:13:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efcba8b0700 1 -- 172.21.15.81:0/4071861946 learned_addr learned my addr 172.21.15.81:0/4071861946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efcba0af700 1 --2- 172.21.15.81:0/4071861946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee91890 0x5650beea23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efcb98ae700 1 --2- 172.21.15.81:0/4071861946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee96e00 0x5650beea0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efcba8b0700 1 -- 172.21.15.81:0/4071861946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee96e00 msgr2=0x5650beea0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efcba8b0700 1 --2- 172.21.15.81:0/4071861946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee96e00 0x5650beea0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efcba8b0700 1 -- 172.21.15.81:0/4071861946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee91890 msgr2=0x5650beea23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efcba8b0700 1 --2- 172.21.15.81:0/4071861946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee91890 0x5650beea23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efcba8b0700 1 -- 172.21.15.81:0/4071861946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5650bec623b0 con 0x5650bee97720 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efcba8b0700 1 --2- 172.21.15.81:0/4071861946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee97720 0x5650beea05d0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7efcac012ef0 tx=0x7efcac012f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e04df9c4bd7f53 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efc9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efc9dffb700 1 -- 172.21.15.81:0/4071861946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac0109d0 con 0x5650bee97720 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efc9dffb700 1 -- 172.21.15.81:0/4071861946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7efcac006e40 con 0x5650bee97720 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efcc84cdb80 1 -- 172.21.15.81:0/4071861946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efcb001e040 con 0x5650bee97720 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efc9dffb700 1 -- 172.21.15.81:0/4071861946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcac010b30 con 0x5650bee97720 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efcc84cdb80 10 client.18609 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.636+0000 7efcc84cdb80 1 -- 172.21.15.81:0/4071861946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5650bec66cd0 con 0x5650bee97720 2024-05-09T00:13:56.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.637+0000 7efc9dffb700 1 -- 172.21.15.81:0/4071861946 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efcac028020 con 0x5650bee97720 2024-05-09T00:13:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.637+0000 7efc9dffb700 1 -- 172.21.15.81:0/4071861946 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7efcac01b430 con 0x5650bee97720 2024-05-09T00:13:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.637+0000 7efcc84cdb80 10 client.18609 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.637+0000 7efcc84cdb80 10 client.18609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.637+0000 7efcc84cdb80 20 client.18609 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.637+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/4071861946 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5650bef01cf0 0x5650bef04110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.637+0000 7efcc84cdb80 4 client.18609 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:13:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.637+0000 7efcc84cdb80 1 -- 172.21.15.81:0/4071861946 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5650bedd9ec0 con 0x5650bef01cf0 2024-05-09T00:13:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.637+0000 7efcba0af700 1 --2- 172.21.15.81:0/4071861946 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5650bef01cf0 0x5650bef04110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efc9dffb700 10 client.18609 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcba0af700 1 --2- 172.21.15.81:0/4071861946 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5650bef01cf0 0x5650bef04110 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d720bc1b6fbbdf9b server_cookie=e79c14d0d1c8757a in_seq=0 out_seq=0 2024-05-09T00:13:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efc9dffb700 1 -- 172.21.15.81:0/4071861946 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5650bedd9ec0 con 0x5650bef01cf0 2024-05-09T00:13:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efc9dffb700 10 client.18609 handle_command_reply: tid=0 2024-05-09T00:13:56.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcc84cdb80 1 client.18609 shutdown 2024-05-09T00:13:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcc84cdb80 1 -- 172.21.15.81:0/4071861946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee97720 msgr2=0x5650beea05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/4071861946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee97720 0x5650beea05d0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7efcac012ef0 tx=0x7efcac012f20 comp rx=0 tx=0).stop 2024-05-09T00:13:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcc84cdb80 1 -- 172.21.15.81:0/4071861946 shutdown_connections 2024-05-09T00:13:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/4071861946 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5650bef01cf0 0x5650bef04110 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/4071861946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5650bee91890 0x5650beea23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efc9dffb700 0 client.18609 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/4071861946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650bee97720 0x5650beea05d0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcc84cdb80 1 --2- 172.21.15.81:0/4071861946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5650bee96e00 0x5650beea0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcc84cdb80 1 -- 172.21.15.81:0/4071861946 >> 172.21.15.81:0/4071861946 conn(0x5650bedef210 msgr2=0x5650bee95c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcc84cdb80 1 -- 172.21.15.81:0/4071861946 shutdown_connections 2024-05-09T00:13:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcc84cdb80 1 -- 172.21.15.81:0/4071861946 wait complete. 2024-05-09T00:13:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcc84cdb80 20 client.18609 trim_cache size 0 max 16384 2024-05-09T00:13:56.646 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:13:56.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcbc313700 1 -- 172.21.15.81:0/893911644 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efca00a1290 msgr2=0x7efca00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcbc313700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efca00a1290 0x7efca00a3750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efcb0006010 tx=0x7efcb000b540 comp rx=0 tx=0).stop 2024-05-09T00:13:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcbc313700 1 -- 172.21.15.81:0/893911644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb4101160 msgr2=0x7efcb4197430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.638+0000 7efcbc313700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb4101160 0x7efcb4197430 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7efca400c920 tx=0x7efca400cce0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.639+0000 7efcbc313700 1 -- 172.21.15.81:0/893911644 shutdown_connections 2024-05-09T00:13:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.639+0000 7efcbc313700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efca00a1290 0x7efca00a3750 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.639+0000 7efcbc313700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efcb419bd10 0x7efcb419c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.639+0000 7efcbc313700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcb4101160 0x7efcb4197430 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.639+0000 7efcbc313700 1 --2- 172.21.15.81:0/893911644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efcb4106280 0x7efcb4197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.639+0000 7efcbc313700 1 -- 172.21.15.81:0/893911644 >> 172.21.15.81:0/893911644 conn(0x7efcb40fc9c0 msgr2=0x7efcb40fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.639+0000 7efcbc313700 1 -- 172.21.15.81:0/893911644 shutdown_connections 2024-05-09T00:13:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:56.639+0000 7efcbc313700 1 -- 172.21.15.81:0/893911644 wait complete. 2024-05-09T00:13:56.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.850+0000 7f2ce67ed700 1 -- 172.21.15.81:0/3223299659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce0104d80 msgr2=0x7f2ce0105160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.850+0000 7f2ce67ed700 1 --2- 172.21.15.81:0/3223299659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce0104d80 0x7f2ce0105160 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009990 tx=0x7f2cd0009ca0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.850+0000 7f2ce67ed700 1 -- 172.21.15.81:0/3223299659 shutdown_connections 2024-05-09T00:13:56.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.850+0000 7f2ce67ed700 1 --2- 172.21.15.81:0/3223299659 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ce0100ee0 0x7f2ce010cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.850+0000 7f2ce67ed700 1 --2- 172.21.15.81:0/3223299659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce0104d80 0x7f2ce0105160 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.850+0000 7f2ce67ed700 1 --2- 172.21.15.81:0/3223299659 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ce0100520 0x7f2ce01009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.851 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.850+0000 7f2ce67ed700 1 -- 172.21.15.81:0/3223299659 >> 172.21.15.81:0/3223299659 conn(0x7f2ce00763a0 msgr2=0x7f2ce00fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.850+0000 7f2ce67ed700 1 -- 172.21.15.81:0/3223299659 shutdown_connections 2024-05-09T00:13:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.850+0000 7f2ce67ed700 1 -- 172.21.15.81:0/3223299659 wait complete. 2024-05-09T00:13:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.850+0000 7f2ce67ed700 1 Processor -- start 2024-05-09T00:13:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.850+0000 7f2ce67ed700 1 -- start start 2024-05-09T00:13:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2ce67ed700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ce0100520 0x7f2ce0198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2ce67ed700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce0100ee0 0x7f2ce01986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2ce67ed700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ce0104d80 0x7f2ce01a3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2ce67ed700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce0198f20 con 0x7f2ce0100ee0 2024-05-09T00:13:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2ce67ed700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce01a3750 con 0x7f2ce0104d80 2024-05-09T00:13:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2ce67ed700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce01a3890 con 0x7f2ce0100520 2024-05-09T00:13:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2cdf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce0100ee0 0x7f2ce01986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2cdf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce0100ee0 0x7f2ce01986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47472/0 (socket says 172.21.15.81:47472) 2024-05-09T00:13:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2cdf7fe700 1 -- 172.21.15.81:0/3846918944 learned_addr learned my addr 172.21.15.81:0/3846918944 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2cdffff700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ce0100520 0x7f2ce0198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2ce4d8a700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ce0104d80 0x7f2ce01a3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2cdf7fe700 1 -- 172.21.15.81:0/3846918944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ce0100520 msgr2=0x7f2ce0198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2cdf7fe700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ce0100520 0x7f2ce0198190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2cdf7fe700 1 -- 172.21.15.81:0/3846918944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ce0104d80 msgr2=0x7f2ce01a3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2cdf7fe700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ce0104d80 0x7f2ce01a3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2cdf7fe700 1 -- 172.21.15.81:0/3846918944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd00095f0 con 0x7f2ce0100ee0 2024-05-09T00:13:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2ce4d8a700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ce0104d80 0x7f2ce01a3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:56.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2cdf7fe700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce0100ee0 0x7f2ce01986d0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800c9e0 tx=0x7f2cc800cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.851+0000 7f2cdd7fa700 1 -- 172.21.15.81:0/3846918944 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8007ac0 con 0x7f2ce0100ee0 2024-05-09T00:13:56.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.852+0000 7f2cdd7fa700 1 -- 172.21.15.81:0/3846918944 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cc8007c20 con 0x7f2ce0100ee0 2024-05-09T00:13:56.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.852+0000 7f2ce67ed700 1 -- 172.21.15.81:0/3846918944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce01a3af0 con 0x7f2ce0100ee0 2024-05-09T00:13:56.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.852+0000 7f2cdd7fa700 1 -- 172.21.15.81:0/3846918944 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc8018660 con 0x7f2ce0100ee0 2024-05-09T00:13:56.854 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.852+0000 7f2ce67ed700 1 -- 172.21.15.81:0/3846918944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce01a4000 con 0x7f2ce0100ee0 2024-05-09T00:13:56.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.854+0000 7f2cdd7fa700 1 -- 172.21.15.81:0/3846918944 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f2cc800f450 con 0x7f2ce0100ee0 2024-05-09T00:13:56.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.854+0000 7f2cdd7fa700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2ccc0a1290 0x7f2ccc0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.854+0000 7f2cdffff700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2ccc0a1290 0x7f2ccc0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.854+0000 7f2cdd7fa700 1 -- 172.21.15.81:0/3846918944 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f2cc80ccd20 con 0x7f2ce0100ee0 2024-05-09T00:13:56.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.855+0000 7f2cdffff700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2ccc0a1290 0x7f2ccc0a3750 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0006010 tx=0x7f2cd001a040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.856+0000 7f2cf29a7b80 1 Processor -- start 2024-05-09T00:13:56.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.856+0000 7f2cf29a7b80 1 -- start start 2024-05-09T00:13:56.857 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.856+0000 7f2cf29a7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71e950 0x56438c71ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.856+0000 7f2cf29a7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c71f270 0x56438c718f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.856+0000 7f2cf29a7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c719480 0x56438c7198a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.856+0000 7f2cf29a7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438c6700f0 con 0x56438c71e950 2024-05-09T00:13:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.856+0000 7f2cf29a7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438c66dab0 con 0x56438c71f270 2024-05-09T00:13:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.856+0000 7f2cf29a7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438c6693a0 con 0x56438c719480 2024-05-09T00:13:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.856+0000 7f2cdffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71e950 0x56438c71ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.856+0000 7f2cdffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71e950 0x56438c71ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47480/0 (socket says 172.21.15.81:47480) 2024-05-09T00:13:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.856+0000 7f2cdffff700 1 -- 172.21.15.81:0/974400630 learned_addr learned my addr 172.21.15.81:0/974400630 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.856+0000 7f2cdf7fe700 1 --2- 172.21.15.81:0/974400630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c71f270 0x56438c718f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.856+0000 7f2ce4d8a700 1 --2- 172.21.15.81:0/974400630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c719480 0x56438c7198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.857+0000 7f2cdffff700 1 -- 172.21.15.81:0/974400630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c719480 msgr2=0x56438c7198a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.857+0000 7f2cdffff700 1 --2- 172.21.15.81:0/974400630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c719480 0x56438c7198a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.857+0000 7f2cdffff700 1 -- 172.21.15.81:0/974400630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c71f270 msgr2=0x56438c718f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.857+0000 7f2cdffff700 1 --2- 172.21.15.81:0/974400630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c71f270 0x56438c718f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.857+0000 7f2cdffff700 1 -- 172.21.15.81:0/974400630 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56438c4ea350 con 0x56438c71e950 2024-05-09T00:13:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.857+0000 7f2cdffff700 1 --2- 172.21.15.81:0/974400630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71e950 0x56438c71ed30 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000b930 tx=0x7f2cd001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cd731cfb4bc568 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.857+0000 7f2cd67fc700 1 -- 172.21.15.81:0/974400630 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd001d040 con 0x56438c71e950 2024-05-09T00:13:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.857+0000 7f2cd67fc700 1 -- 172.21.15.81:0/974400630 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cd0029040 con 0x56438c71e950 2024-05-09T00:13:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.857+0000 7f2cd67fc700 1 -- 172.21.15.81:0/974400630 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd0023e90 con 0x56438c71e950 2024-05-09T00:13:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.858+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/974400630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71e950 msgr2=0x56438c71ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.858+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/974400630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71e950 0x56438c71ed30 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f2cd000b930 tx=0x7f2cd001e000 comp rx=0 tx=0).stop 2024-05-09T00:13:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.858+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/974400630 shutdown_connections 2024-05-09T00:13:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.858+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/974400630 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c719480 0x56438c7198a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.858+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/974400630 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71e950 0x56438c71ed30 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.858+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/974400630 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c71f270 0x56438c718f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.858+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/974400630 >> 172.21.15.81:0/974400630 conn(0x56438c6771b0 msgr2=0x56438c713840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.858+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/974400630 shutdown_connections 2024-05-09T00:13:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.858+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/974400630 wait complete. 2024-05-09T00:13:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.858+0000 7f2cf29a7b80 1 -- start start 2024-05-09T00:13:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cf29a7b80 1 Processor -- start 2024-05-09T00:13:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cf29a7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c719480 0x56438c725240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cf29a7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71e950 0x56438c722530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cf29a7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c71f270 0x56438c722c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cf29a7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438c605500 con 0x56438c71e950 2024-05-09T00:13:56.864 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cf29a7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438c6051a0 con 0x56438c719480 2024-05-09T00:13:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cf29a7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438c4ec640 con 0x56438c71f270 2024-05-09T00:13:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cf29a7b80 10 client.0 _ll_register_callbacks cb 0x56438c60ead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cdf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71e950 0x56438c722530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cdf7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71e950 0x56438c722530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47482/0 (socket says 172.21.15.81:47482) 2024-05-09T00:13:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cdf7fe700 1 -- 172.21.15.81:0/1248061315 learned_addr learned my addr 172.21.15.81:0/1248061315 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cdffff700 1 --2- 172.21.15.81:0/1248061315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c719480 0x56438c725240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2ce4d8a700 1 --2- 172.21.15.81:0/1248061315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c71f270 0x56438c722c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cdf7fe700 1 -- 172.21.15.81:0/1248061315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c71f270 msgr2=0x56438c722c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cdf7fe700 1 --2- 172.21.15.81:0/1248061315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c71f270 0x56438c722c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cdf7fe700 1 -- 172.21.15.81:0/1248061315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c719480 msgr2=0x56438c725240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cdf7fe700 1 --2- 172.21.15.81:0/1248061315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c719480 0x56438c725240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.865 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.859+0000 7f2cdf7fe700 1 -- 172.21.15.81:0/1248061315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce010d5f0 con 0x56438c71e950 2024-05-09T00:13:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cdf7fe700 1 --2- 172.21.15.81:0/1248061315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71e950 0x56438c722530 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8096300 tx=0x7f2cc809a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8f3476f341d536 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cbf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cbf7fe700 1 -- 172.21.15.81:0/1248061315 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc80a2280 con 0x56438c71e950 2024-05-09T00:13:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cbf7fe700 1 -- 172.21.15.81:0/1248061315 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f2cc809a060 con 0x56438c71e950 2024-05-09T00:13:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1248061315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56438c5c2210 con 0x56438c71e950 2024-05-09T00:13:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cbf7fe700 1 -- 172.21.15.81:0/1248061315 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cc809a220 con 0x56438c71e950 2024-05-09T00:13:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cf29a7b80 10 client.18621 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1248061315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56438c496b00 con 0x56438c71e950 2024-05-09T00:13:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cbf7fe700 1 -- 172.21.15.81:0/1248061315 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cc8063080 con 0x56438c71e950 2024-05-09T00:13:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cbf7fe700 1 -- 172.21.15.81:0/1248061315 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2cc80a1f40 con 0x56438c71e950 2024-05-09T00:13:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cf29a7b80 10 client.18621 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cf29a7b80 10 client.18621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cf29a7b80 20 client.18621 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:56.866 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/1248061315 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56438c732a00 0x56438c734e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cf29a7b80 4 client.18621 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1248061315 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56438c6e87b0 con 0x56438c732a00 2024-05-09T00:13:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.860+0000 7f2cdffff700 1 --2- 172.21.15.81:0/1248061315 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56438c732a00 0x56438c734e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.861+0000 7f2cdffff700 1 --2- 172.21.15.81:0/1248061315 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56438c732a00 0x56438c734e20 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af14576c84a08ba4 server_cookie=4548daedcf181ed1 in_seq=0 out_seq=0 2024-05-09T00:13:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.861+0000 7f2cbf7fe700 10 client.18621 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.861+0000 7f2cbf7fe700 1 -- 172.21.15.81:0/1248061315 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56438c6e87b0 con 0x56438c732a00 2024-05-09T00:13:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.861+0000 7f2cbf7fe700 10 client.18621 handle_command_reply: tid=0 2024-05-09T00:13:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.861+0000 7f2cf29a7b80 1 client.18621 shutdown 2024-05-09T00:13:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.862+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1248061315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71e950 msgr2=0x56438c722530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.862+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/1248061315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71e950 0x56438c722530 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8096300 tx=0x7f2cc809a640 comp rx=0 tx=0).stop 2024-05-09T00:13:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.862+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1248061315 shutdown_connections 2024-05-09T00:13:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.862+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/1248061315 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56438c732a00 0x56438c734e20 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.867 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.862+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/1248061315 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c719480 0x56438c725240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.862+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/1248061315 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c71f270 0x56438c722c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.862+0000 7f2cbf7fe700 0 client.18621 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.862+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/1248061315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71e950 0x56438c722530 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.862+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1248061315 >> 172.21.15.81:0/1248061315 conn(0x56438c6771b0 msgr2=0x56438c717f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.862+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1248061315 shutdown_connections 2024-05-09T00:13:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.862+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1248061315 wait complete. 2024-05-09T00:13:56.868 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.862+0000 7f2cf29a7b80 20 client.18621 trim_cache size 0 max 16384 2024-05-09T00:13:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.876+0000 7f2cf29a7b80 1 Processor -- start 2024-05-09T00:13:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2cf29a7b80 1 -- start start 2024-05-09T00:13:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2cf29a7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c719480 0x56438c7224f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2cf29a7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c71e950 0x56438c713910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2cf29a7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71f270 0x56438c719860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2cf29a7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438c719e10 con 0x56438c71f270 2024-05-09T00:13:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2cf29a7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438c715370 con 0x56438c71e950 2024-05-09T00:13:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2cf29a7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438c73a040 con 0x56438c719480 2024-05-09T00:13:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2ce4d8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71f270 0x56438c719860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.880 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2ce4d8a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71f270 0x56438c719860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47484/0 (socket says 172.21.15.81:47484) 2024-05-09T00:13:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2ce4d8a700 1 -- 172.21.15.81:0/3711009184 learned_addr learned my addr 172.21.15.81:0/3711009184 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2ce4d8a700 1 -- 172.21.15.81:0/3711009184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c719480 msgr2=0x56438c7224f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2ce4d8a700 1 --2- 172.21.15.81:0/3711009184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c719480 0x56438c7224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2ce4d8a700 1 -- 172.21.15.81:0/3711009184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c71e950 msgr2=0x56438c713910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2ce4d8a700 1 --2- 172.21.15.81:0/3711009184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c71e950 0x56438c713910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2ce4d8a700 1 -- 172.21.15.81:0/3711009184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56438c62f500 con 0x56438c71f270 2024-05-09T00:13:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2ce4d8a700 1 --2- 172.21.15.81:0/3711009184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71f270 0x56438c719860 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8008890 tx=0x7f2cd80088c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8862fbfa1391640 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2cd6ffd700 1 -- 172.21.15.81:0/3711009184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8008410 con 0x56438c71f270 2024-05-09T00:13:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2cd6ffd700 1 -- 172.21.15.81:0/3711009184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cd8010040 con 0x56438c71f270 2024-05-09T00:13:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.877+0000 7f2cd6ffd700 1 -- 172.21.15.81:0/3711009184 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8016cb0 con 0x56438c71f270 2024-05-09T00:13:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.878+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/3711009184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71f270 msgr2=0x56438c719860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.878+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/3711009184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71f270 0x56438c719860 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8008890 tx=0x7f2cd80088c0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.878+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/3711009184 shutdown_connections 2024-05-09T00:13:56.881 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.878+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/3711009184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c71f270 0x56438c719860 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.878+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/3711009184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c719480 0x56438c7224f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.878+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/3711009184 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c71e950 0x56438c713910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.878+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/3711009184 >> 172.21.15.81:0/3711009184 conn(0x56438c6771b0 msgr2=0x56438c721dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.878+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/3711009184 shutdown_connections 2024-05-09T00:13:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.878+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/3711009184 wait complete. 2024-05-09T00:13:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.878+0000 7f2cf29a7b80 1 -- start start 2024-05-09T00:13:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cf29a7b80 1 Processor -- start 2024-05-09T00:13:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cf29a7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c719480 0x56438c729900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cf29a7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c71e950 0x56438c729e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cf29a7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c71f270 0x56438c727fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cf29a7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438c7285f0 con 0x56438c719480 2024-05-09T00:13:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cf29a7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438c728760 con 0x56438c71f270 2024-05-09T00:13:56.882 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cf29a7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x56438c728920 con 0x56438c71e950 2024-05-09T00:13:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cf29a7b80 10 client.0 _ll_register_callbacks cb 0x56438c60ead0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cdffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c719480 0x56438c729900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cdffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c719480 0x56438c729900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47490/0 (socket says 172.21.15.81:47490) 2024-05-09T00:13:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cdffff700 1 -- 172.21.15.81:0/1313004613 learned_addr learned my addr 172.21.15.81:0/1313004613 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cdffff700 1 -- 172.21.15.81:0/1313004613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c71e950 msgr2=0x56438c729e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cdf7fe700 1 --2- 172.21.15.81:0/1313004613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c71e950 0x56438c729e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cdffff700 1 --2- 172.21.15.81:0/1313004613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c71e950 0x56438c729e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cdffff700 1 -- 172.21.15.81:0/1313004613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c71f270 msgr2=0x56438c727fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cdffff700 1 --2- 172.21.15.81:0/1313004613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c71f270 0x56438c727fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cdffff700 1 -- 172.21.15.81:0/1313004613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd8008570 con 0x56438c719480 2024-05-09T00:13:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cdf7fe700 1 --2- 172.21.15.81:0/1313004613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c71e950 0x56438c729e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cdffff700 1 --2- 172.21.15.81:0/1313004613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c719480 0x56438c729900 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009990 tx=0x7f2cd0003750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db52f03256e6b78f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:56.883 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cbf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cbf7fe700 1 -- 172.21.15.81:0/1313004613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd003d070 con 0x56438c719480 2024-05-09T00:13:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cbf7fe700 1 -- 172.21.15.81:0/1313004613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f2cd0040b80 con 0x56438c719480 2024-05-09T00:13:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.879+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1313004613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2cd0029040 con 0x56438c719480 2024-05-09T00:13:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.880+0000 7f2cbf7fe700 1 -- 172.21.15.81:0/1313004613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cd001d040 con 0x56438c719480 2024-05-09T00:13:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.880+0000 7f2cf29a7b80 10 client.18627 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.880+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1313004613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56438c4eec70 con 0x56438c719480 2024-05-09T00:13:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.880+0000 7f2cbf7fe700 1 -- 172.21.15.81:0/1313004613 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cd004f020 con 0x56438c719480 2024-05-09T00:13:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.880+0000 7f2cbf7fe700 1 -- 172.21.15.81:0/1313004613 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2cd002c070 con 0x56438c719480 2024-05-09T00:13:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.880+0000 7f2cf29a7b80 10 client.18627 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.880+0000 7f2cf29a7b80 10 client.18627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.880+0000 7f2cf29a7b80 20 client.18627 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.880+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/1313004613 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56438c78e150 0x56438c790570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.880+0000 7f2cf29a7b80 4 client.18627 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:13:56.884 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.880+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1313004613 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56438c661e60 con 0x56438c78e150 2024-05-09T00:13:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.880+0000 7f2cdf7fe700 1 --2- 172.21.15.81:0/1313004613 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56438c78e150 0x56438c790570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.881+0000 7f2cdf7fe700 1 --2- 172.21.15.81:0/1313004613 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56438c78e150 0x56438c790570 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be26ee69e343f8e1 server_cookie=33690eee9f031479 in_seq=0 out_seq=0 2024-05-09T00:13:56.885 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.881+0000 7f2cbf7fe700 10 client.18627 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.896+0000 7f2cbf7fe700 1 -- 172.21.15.81:0/1313004613 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56438c661e60 con 0x56438c78e150 2024-05-09T00:13:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.896+0000 7f2cbf7fe700 10 client.18627 handle_command_reply: tid=0 2024-05-09T00:13:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.896+0000 7f2cf29a7b80 1 client.18627 shutdown 2024-05-09T00:13:56.895 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.896+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1313004613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c719480 msgr2=0x56438c729900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.896+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/1313004613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c719480 0x56438c729900 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0009990 tx=0x7f2cd0003750 comp rx=0 tx=0).stop 2024-05-09T00:13:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.896+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1313004613 shutdown_connections 2024-05-09T00:13:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.896+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/1313004613 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x56438c78e150 0x56438c790570 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.896+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/1313004613 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x56438c71f270 0x56438c727fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.896+0000 7f2cbf7fe700 0 client.18627 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.896+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/1313004613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56438c719480 0x56438c729900 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.896+0000 7f2cf29a7b80 1 --2- 172.21.15.81:0/1313004613 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x56438c71e950 0x56438c729e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.896+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1313004613 >> 172.21.15.81:0/1313004613 conn(0x56438c6771b0 msgr2=0x56438c72e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.896+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1313004613 shutdown_connections 2024-05-09T00:13:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.896+0000 7f2cf29a7b80 1 -- 172.21.15.81:0/1313004613 wait complete. 2024-05-09T00:13:56.896 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.897+0000 7f2cf29a7b80 20 client.18627 trim_cache size 0 max 16384 2024-05-09T00:13:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:13:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:13:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:13:56.897 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:13:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.897+0000 7f2ce67ed700 1 -- 172.21.15.81:0/3846918944 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2ccc0a1290 msgr2=0x7f2ccc0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.897+0000 7f2ce67ed700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2ccc0a1290 0x7f2ccc0a3750 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2cd0006010 tx=0x7f2cd001a040 comp rx=0 tx=0).stop 2024-05-09T00:13:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.897+0000 7f2ce67ed700 1 -- 172.21.15.81:0/3846918944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce0100ee0 msgr2=0x7f2ce01986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.897+0000 7f2ce67ed700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce0100ee0 0x7f2ce01986d0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f2cc800c9e0 tx=0x7f2cc800cda0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.897+0000 7f2ce67ed700 1 -- 172.21.15.81:0/3846918944 shutdown_connections 2024-05-09T00:13:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.897+0000 7f2ce67ed700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f2ccc0a1290 0x7f2ccc0a3750 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.898 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.897+0000 7f2ce67ed700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2ce0104d80 0x7f2ce01a3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.897+0000 7f2ce67ed700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ce0100520 0x7f2ce0198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.897+0000 7f2ce67ed700 1 --2- 172.21.15.81:0/3846918944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ce0100ee0 0x7f2ce01986d0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.897+0000 7f2ce67ed700 1 -- 172.21.15.81:0/3846918944 >> 172.21.15.81:0/3846918944 conn(0x7f2ce00763a0 msgr2=0x7f2ce0102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.897+0000 7f2ce67ed700 1 -- 172.21.15.81:0/3846918944 shutdown_connections 2024-05-09T00:13:56.899 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:13:56.897+0000 7f2ce67ed700 1 -- 172.21.15.81:0/3846918944 wait complete. 2024-05-09T00:13:57.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:56 smithi081 ceph-mon[42474]: pgmap v340: 97 pgs: 97 active+clean; 5.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 16 op/s 2024-05-09T00:13:57.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:56 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/126981857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:13:57.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:56 smithi150 ceph-mon[46187]: pgmap v340: 97 pgs: 97 active+clean; 5.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 16 op/s 2024-05-09T00:13:57.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:56 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/126981857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:13:57.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:56 smithi171 ceph-mon[47351]: pgmap v340: 97 pgs: 97 active+clean; 5.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 56 KiB/s wr, 16 op/s 2024-05-09T00:13:57.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:56 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/126981857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:13:57.649 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:13:57.650 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:13:57.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.790+0000 7fa30ba1d700 1 -- 172.21.15.81:0/224489337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa304100ab0 msgr2=0x7fa30410ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.790+0000 7fa30ba1d700 1 --2- 172.21.15.81:0/224489337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa304100ab0 0x7fa30410ccc0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00b0d0 tx=0x7fa2fc00b3e0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.790+0000 7fa30ba1d700 1 -- 172.21.15.81:0/224489337 shutdown_connections 2024-05-09T00:13:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.790+0000 7fa30ba1d700 1 --2- 172.21.15.81:0/224489337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa304100ab0 0x7fa30410ccc0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.790+0000 7fa30ba1d700 1 --2- 172.21.15.81:0/224489337 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa304105f90 0x7fa304106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.790+0000 7fa30ba1d700 1 --2- 172.21.15.81:0/224489337 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa3041000f0 0x7fa304100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.790+0000 7fa30ba1d700 1 -- 172.21.15.81:0/224489337 >> 172.21.15.81:0/224489337 conn(0x7fa304076ba0 msgr2=0x7fa304076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.790+0000 7fa30ba1d700 1 -- 172.21.15.81:0/224489337 shutdown_connections 2024-05-09T00:13:57.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.790+0000 7fa30ba1d700 1 -- 172.21.15.81:0/224489337 wait complete. 2024-05-09T00:13:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.791+0000 7fa30ba1d700 1 Processor -- start 2024-05-09T00:13:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.791+0000 7fa30ba1d700 1 -- start start 2024-05-09T00:13:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.791+0000 7fa30ba1d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3041000f0 0x7fa304198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.791+0000 7fa30ba1d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa304100ab0 0x7fa304198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.791+0000 7fa30ba1d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa304105f90 0x7fa3041a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.791+0000 7fa30ba1d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa304199030 con 0x7fa3041000f0 2024-05-09T00:13:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.791+0000 7fa30ba1d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3041a37f0 con 0x7fa304105f90 2024-05-09T00:13:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.791+0000 7fa30ba1d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3041a3930 con 0x7fa304100ab0 2024-05-09T00:13:57.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.791+0000 7fa3097b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3041000f0 0x7fa304198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.791+0000 7fa3097b9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3041000f0 0x7fa304198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60398/0 (socket says 172.21.15.81:60398) 2024-05-09T00:13:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.791+0000 7fa3097b9700 1 -- 172.21.15.81:0/27458801 learned_addr learned my addr 172.21.15.81:0/27458801 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.792+0000 7fa308fb8700 1 --2- 172.21.15.81:0/27458801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa304100ab0 0x7fa304198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.792+0000 7fa3097b9700 1 -- 172.21.15.81:0/27458801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa304100ab0 msgr2=0x7fa304198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.792+0000 7fa3097b9700 1 --2- 172.21.15.81:0/27458801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa304100ab0 0x7fa304198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.792+0000 7fa309fba700 1 --2- 172.21.15.81:0/27458801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa304105f90 0x7fa3041a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.792+0000 7fa3097b9700 1 -- 172.21.15.81:0/27458801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa304105f90 msgr2=0x7fa3041a32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.792+0000 7fa3097b9700 1 --2- 172.21.15.81:0/27458801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa304105f90 0x7fa3041a32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.792+0000 7fa3097b9700 1 -- 172.21.15.81:0/27458801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc009d00 con 0x7fa3041000f0 2024-05-09T00:13:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.792+0000 7fa3097b9700 1 --2- 172.21.15.81:0/27458801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3041000f0 0x7fa304198230 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800d950 tx=0x7fa2f800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.792+0000 7fa2f67fc700 1 -- 172.21.15.81:0/27458801 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8009b40 con 0x7fa3041000f0 2024-05-09T00:13:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.792+0000 7fa2f67fc700 1 -- 172.21.15.81:0/27458801 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2f800de30 con 0x7fa3041000f0 2024-05-09T00:13:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.792+0000 7fa30ba1d700 1 -- 172.21.15.81:0/27458801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3041a3c10 con 0x7fa3041000f0 2024-05-09T00:13:57.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.792+0000 7fa2f67fc700 1 -- 172.21.15.81:0/27458801 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8005610 con 0x7fa3041000f0 2024-05-09T00:13:57.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.792+0000 7fa30ba1d700 1 -- 172.21.15.81:0/27458801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3041a40d0 con 0x7fa3041000f0 2024-05-09T00:13:57.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.794+0000 7fa2f67fc700 1 -- 172.21.15.81:0/27458801 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa2f8004750 con 0x7fa3041000f0 2024-05-09T00:13:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.795+0000 7fa2f67fc700 1 --2- 172.21.15.81:0/27458801 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa2f00a1290 0x7fa2f00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.795+0000 7fa308fb8700 1 --2- 172.21.15.81:0/27458801 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa2f00a1290 0x7fa2f00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.795+0000 7fa2f67fc700 1 -- 172.21.15.81:0/27458801 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fa2f80cccf0 con 0x7fa3041000f0 2024-05-09T00:13:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.795+0000 7fa308fb8700 1 --2- 172.21.15.81:0/27458801 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa2f00a1290 0x7fa2f00a3750 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa300005950 tx=0x7fa3000058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa317bd7b80 1 Processor -- start 2024-05-09T00:13:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa317bd7b80 1 -- start start 2024-05-09T00:13:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa317bd7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671290 0x55c2df671670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa317bd7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df671bb0 0x55c2df66b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa317bd7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df66bd20 0x55c2df66c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa317bd7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2df5be1d0 con 0x55c2df66bd20 2024-05-09T00:13:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa317bd7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2df5bbb90 con 0x55c2df671290 2024-05-09T00:13:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa317bd7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2df5b7480 con 0x55c2df671bb0 2024-05-09T00:13:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa309fba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df66bd20 0x55c2df66c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa309fba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df66bd20 0x55c2df66c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60408/0 (socket says 172.21.15.81:60408) 2024-05-09T00:13:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa309fba700 1 -- 172.21.15.81:0/2132546145 learned_addr learned my addr 172.21.15.81:0/2132546145 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa3097b9700 1 --2- 172.21.15.81:0/2132546145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671290 0x55c2df671670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa308fb8700 1 --2- 172.21.15.81:0/2132546145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df671bb0 0x55c2df66b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa309fba700 1 -- 172.21.15.81:0/2132546145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df671bb0 msgr2=0x55c2df66b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa309fba700 1 --2- 172.21.15.81:0/2132546145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df671bb0 0x55c2df66b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa309fba700 1 -- 172.21.15.81:0/2132546145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671290 msgr2=0x55c2df671670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa309fba700 1 --2- 172.21.15.81:0/2132546145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671290 0x55c2df671670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa309fba700 1 -- 172.21.15.81:0/2132546145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2df438430 con 0x55c2df66bd20 2024-05-09T00:13:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa308fb8700 1 --2- 172.21.15.81:0/2132546145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df671bb0 0x55c2df66b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa3097b9700 1 --2- 172.21.15.81:0/2132546145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671290 0x55c2df671670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.796+0000 7fa309fba700 1 --2- 172.21.15.81:0/2132546145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df66bd20 0x55c2df66c160 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009c40 tx=0x7fa2fc009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f507cb1ed1356170 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.797+0000 7fa2ef7fe700 1 -- 172.21.15.81:0/2132546145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc00e070 con 0x55c2df66bd20 2024-05-09T00:13:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.797+0000 7fa2ef7fe700 1 -- 172.21.15.81:0/2132546145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2fc007b70 con 0x55c2df66bd20 2024-05-09T00:13:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.797+0000 7fa2ef7fe700 1 -- 172.21.15.81:0/2132546145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc007740 con 0x55c2df66bd20 2024-05-09T00:13:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.797+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2132546145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df66bd20 msgr2=0x55c2df66c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.797+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/2132546145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df66bd20 0x55c2df66c160 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009c40 tx=0x7fa2fc009c70 comp rx=0 tx=0).stop 2024-05-09T00:13:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.797+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2132546145 shutdown_connections 2024-05-09T00:13:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.797+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/2132546145 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671290 0x55c2df671670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.797+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/2132546145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df66bd20 0x55c2df66c160 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.797+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/2132546145 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df671bb0 0x55c2df66b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.797+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2132546145 >> 172.21.15.81:0/2132546145 conn(0x55c2df5c5290 msgr2=0x55c2df661e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.797+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2132546145 shutdown_connections 2024-05-09T00:13:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.797+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2132546145 wait complete. 2024-05-09T00:13:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.798+0000 7fa317bd7b80 1 -- start start 2024-05-09T00:13:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.798+0000 7fa317bd7b80 1 Processor -- start 2024-05-09T00:13:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.798+0000 7fa317bd7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df66bd20 0x55c2df677af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.798+0000 7fa317bd7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671290 0x55c2df674de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.798+0000 7fa317bd7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671bb0 0x55c2df675380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.798+0000 7fa317bd7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2df5535e0 con 0x55c2df671290 2024-05-09T00:13:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.798+0000 7fa317bd7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2df553280 con 0x55c2df671bb0 2024-05-09T00:13:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.798+0000 7fa317bd7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2df43a720 con 0x55c2df66bd20 2024-05-09T00:13:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.798+0000 7fa317bd7b80 10 client.0 _ll_register_callbacks cb 0x55c2df55cbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.798+0000 7fa308fb8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671290 0x55c2df674de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.798+0000 7fa308fb8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671290 0x55c2df674de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60410/0 (socket says 172.21.15.81:60410) 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.798+0000 7fa308fb8700 1 -- 172.21.15.81:0/3172456983 learned_addr learned my addr 172.21.15.81:0/3172456983 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.798+0000 7fa3097b9700 1 --2- 172.21.15.81:0/3172456983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df66bd20 0x55c2df677af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa309fba700 1 --2- 172.21.15.81:0/3172456983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671bb0 0x55c2df675380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa308fb8700 1 -- 172.21.15.81:0/3172456983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df66bd20 msgr2=0x55c2df677af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa308fb8700 1 --2- 172.21.15.81:0/3172456983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df66bd20 0x55c2df677af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa308fb8700 1 -- 172.21.15.81:0/3172456983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671bb0 msgr2=0x55c2df675380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa308fb8700 1 --2- 172.21.15.81:0/3172456983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671bb0 0x55c2df675380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa308fb8700 1 -- 172.21.15.81:0/3172456983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30410d550 con 0x55c2df671290 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa308fb8700 1 --2- 172.21.15.81:0/3172456983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671290 0x55c2df674de0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa30000fe40 tx=0x7fa300004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c3f8277ca4aa2b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa2ecff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa2ecff9700 1 -- 172.21.15.81:0/3172456983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30001e620 con 0x55c2df671290 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa2ecff9700 1 -- 172.21.15.81:0/3172456983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fa30001e780 con 0x55c2df671290 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa317bd7b80 1 -- 172.21.15.81:0/3172456983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2df5102f0 con 0x55c2df671290 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa2ecff9700 1 -- 172.21.15.81:0/3172456983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa300011e70 con 0x55c2df671290 2024-05-09T00:13:57.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa317bd7b80 10 client.18639 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa317bd7b80 1 -- 172.21.15.81:0/3172456983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c2df3e4be0 con 0x55c2df671290 2024-05-09T00:13:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa2ecff9700 1 -- 172.21.15.81:0/3172456983 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c2df5102f0 con 0x55c2df671290 2024-05-09T00:13:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa2ecff9700 1 -- 172.21.15.81:0/3172456983 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa300024020 con 0x55c2df671290 2024-05-09T00:13:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa317bd7b80 10 client.18639 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa317bd7b80 10 client.18639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.799+0000 7fa317bd7b80 20 client.18639 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.800+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/3172456983 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2df685510 0x55c2df687930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.800+0000 7fa317bd7b80 4 client.18639 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.800+0000 7fa317bd7b80 1 -- 172.21.15.81:0/3172456983 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c2df636890 con 0x55c2df685510 2024-05-09T00:13:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.800+0000 7fa3097b9700 1 --2- 172.21.15.81:0/3172456983 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2df685510 0x55c2df687930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.800+0000 7fa3097b9700 1 --2- 172.21.15.81:0/3172456983 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2df685510 0x55c2df687930 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=588537e1c21c2eba server_cookie=ce23a3d053246fb5 in_seq=0 out_seq=0 2024-05-09T00:13:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.800+0000 7fa2ecff9700 10 client.18639 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:57.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa2ecff9700 1 -- 172.21.15.81:0/3172456983 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c2df636890 con 0x55c2df685510 2024-05-09T00:13:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa2ecff9700 10 client.18639 handle_command_reply: tid=0 2024-05-09T00:13:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa317bd7b80 1 client.18639 shutdown 2024-05-09T00:13:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa317bd7b80 1 -- 172.21.15.81:0/3172456983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671290 msgr2=0x55c2df674de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/3172456983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671290 0x55c2df674de0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa30000fe40 tx=0x7fa300004750 comp rx=0 tx=0).stop 2024-05-09T00:13:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa317bd7b80 1 -- 172.21.15.81:0/3172456983 shutdown_connections 2024-05-09T00:13:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/3172456983 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2df685510 0x55c2df687930 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/3172456983 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671bb0 0x55c2df675380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa2ecff9700 0 client.18639 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/3172456983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df66bd20 0x55c2df677af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/3172456983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671290 0x55c2df674de0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa317bd7b80 1 -- 172.21.15.81:0/3172456983 >> 172.21.15.81:0/3172456983 conn(0x55c2df5c5290 msgr2=0x55c2df661620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa317bd7b80 1 -- 172.21.15.81:0/3172456983 shutdown_connections 2024-05-09T00:13:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa317bd7b80 1 -- 172.21.15.81:0/3172456983 wait complete. 2024-05-09T00:13:57.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.801+0000 7fa317bd7b80 20 client.18639 trim_cache size 0 max 16384 2024-05-09T00:13:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.818+0000 7fa317bd7b80 1 Processor -- start 2024-05-09T00:13:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.818+0000 7fa317bd7b80 1 -- start start 2024-05-09T00:13:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa317bd7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df66bd20 0x55c2df661da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa317bd7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df671290 0x55c2df677620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa317bd7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671bb0 0x55c2df6736b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa317bd7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2df6763e0 con 0x55c2df671bb0 2024-05-09T00:13:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa317bd7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2df663910 con 0x55c2df66bd20 2024-05-09T00:13:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa317bd7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2df681950 con 0x55c2df671290 2024-05-09T00:13:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa309fba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671bb0 0x55c2df6736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa309fba700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671bb0 0x55c2df6736b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60426/0 (socket says 172.21.15.81:60426) 2024-05-09T00:13:57.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa309fba700 1 -- 172.21.15.81:0/2745316054 learned_addr learned my addr 172.21.15.81:0/2745316054 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa309fba700 1 -- 172.21.15.81:0/2745316054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df671290 msgr2=0x55c2df677620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa308fb8700 1 --2- 172.21.15.81:0/2745316054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df671290 0x55c2df677620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa309fba700 1 --2- 172.21.15.81:0/2745316054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df671290 0x55c2df677620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa309fba700 1 -- 172.21.15.81:0/2745316054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df66bd20 msgr2=0x55c2df661da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa309fba700 1 --2- 172.21.15.81:0/2745316054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df66bd20 0x55c2df661da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa309fba700 1 -- 172.21.15.81:0/2745316054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2df65e560 con 0x55c2df671bb0 2024-05-09T00:13:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa308fb8700 1 --2- 172.21.15.81:0/2745316054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df671290 0x55c2df677620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa309fba700 1 --2- 172.21.15.81:0/2745316054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671bb0 0x55c2df6736b0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00b420 tx=0x7fa2fc00b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47959d1fc0a7d9a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa2effff700 1 -- 172.21.15.81:0/2745316054 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc00e050 con 0x55c2df671bb0 2024-05-09T00:13:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa2effff700 1 -- 172.21.15.81:0/2745316054 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2fc007d60 con 0x55c2df671bb0 2024-05-09T00:13:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.819+0000 7fa2effff700 1 -- 172.21.15.81:0/2745316054 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc007820 con 0x55c2df671bb0 2024-05-09T00:13:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.820+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2745316054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671bb0 msgr2=0x55c2df6736b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.820+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/2745316054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671bb0 0x55c2df6736b0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00b420 tx=0x7fa2fc00b7e0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.820+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2745316054 shutdown_connections 2024-05-09T00:13:57.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.820+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/2745316054 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df66bd20 0x55c2df661da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.820+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/2745316054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671bb0 0x55c2df6736b0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.820+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/2745316054 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df671290 0x55c2df677620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.820+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2745316054 >> 172.21.15.81:0/2745316054 conn(0x55c2df5c5290 msgr2=0x55c2df66efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:57.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.820+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2745316054 shutdown_connections 2024-05-09T00:13:57.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.820+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2745316054 wait complete. 2024-05-09T00:13:57.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.820+0000 7fa317bd7b80 1 -- start start 2024-05-09T00:13:57.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.820+0000 7fa317bd7b80 1 Processor -- start 2024-05-09T00:13:57.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa317bd7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df66bd20 0x55c2df67c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa317bd7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671290 0x55c2df67cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa317bd7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671bb0 0x55c2df67a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa317bd7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2df67ab10 con 0x55c2df671290 2024-05-09T00:13:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa317bd7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2df67ac80 con 0x55c2df671bb0 2024-05-09T00:13:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa317bd7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2df67ae40 con 0x55c2df66bd20 2024-05-09T00:13:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa317bd7b80 10 client.0 _ll_register_callbacks cb 0x55c2df55cbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa308fb8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671290 0x55c2df67cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa308fb8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671290 0x55c2df67cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60438/0 (socket says 172.21.15.81:60438) 2024-05-09T00:13:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa308fb8700 1 -- 172.21.15.81:0/2621282932 learned_addr learned my addr 172.21.15.81:0/2621282932 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa3097b9700 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df66bd20 0x55c2df67c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa309fba700 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671bb0 0x55c2df67a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa308fb8700 1 -- 172.21.15.81:0/2621282932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df66bd20 msgr2=0x55c2df67c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa308fb8700 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df66bd20 0x55c2df67c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa308fb8700 1 -- 172.21.15.81:0/2621282932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671bb0 msgr2=0x55c2df67a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa308fb8700 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671bb0 0x55c2df67a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa308fb8700 1 -- 172.21.15.81:0/2621282932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2df438430 con 0x55c2df671290 2024-05-09T00:13:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa309fba700 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671bb0 0x55c2df67a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa3097b9700 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df66bd20 0x55c2df67c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:13:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa308fb8700 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671290 0x55c2df67cb30 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fa300005bf0 tx=0x7fa30000ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f7b97895880041 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa2ecff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa2ecff9700 1 -- 172.21.15.81:0/2621282932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300005240 con 0x55c2df671290 2024-05-09T00:13:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa2ecff9700 1 -- 172.21.15.81:0/2621282932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fa300026cd0 con 0x55c2df671290 2024-05-09T00:13:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2621282932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2fc007b70 con 0x55c2df671290 2024-05-09T00:13:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa2ecff9700 1 -- 172.21.15.81:0/2621282932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa300011ab0 con 0x55c2df671290 2024-05-09T00:13:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa317bd7b80 10 client.18645 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:57.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.821+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2621282932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55c2df57d5e0 con 0x55c2df671290 2024-05-09T00:13:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.822+0000 7fa2ecff9700 1 -- 172.21.15.81:0/2621282932 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa300042080 con 0x55c2df671290 2024-05-09T00:13:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.822+0000 7fa2ecff9700 1 -- 172.21.15.81:0/2621282932 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa300011440 con 0x55c2df671290 2024-05-09T00:13:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.822+0000 7fa317bd7b80 10 client.18645 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.822+0000 7fa317bd7b80 10 client.18645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.822+0000 7fa317bd7b80 20 client.18645 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.822+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2df6dda20 0x55c2df6dfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.822+0000 7fa317bd7b80 4 client.18645 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:13:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.822+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2621282932 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c2df5aff40 con 0x55c2df6dda20 2024-05-09T00:13:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.822+0000 7fa3097b9700 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2df6dda20 0x55c2df6dfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.823+0000 7fa2ecff9700 10 client.18645 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.823+0000 7fa3097b9700 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2df6dda20 0x55c2df6dfe40 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=158802e2d2cda54 server_cookie=37aa5a2ac362cdd4 in_seq=0 out_seq=0 2024-05-09T00:13:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa2ecff9700 1 -- 172.21.15.81:0/2621282932 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c2df5aff40 con 0x55c2df6dda20 2024-05-09T00:13:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa2ecff9700 10 client.18645 handle_command_reply: tid=0 2024-05-09T00:13:57.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa317bd7b80 1 client.18645 shutdown 2024-05-09T00:13:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2621282932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671290 msgr2=0x55c2df67cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671290 0x55c2df67cb30 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fa300005bf0 tx=0x7fa30000ff20 comp rx=0 tx=0).stop 2024-05-09T00:13:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2621282932 shutdown_connections 2024-05-09T00:13:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55c2df6dda20 0x55c2df6dfe40 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55c2df671bb0 0x55c2df67a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55c2df66bd20 0x55c2df67c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa2ecff9700 0 client.18645 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa317bd7b80 1 --2- 172.21.15.81:0/2621282932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55c2df671290 0x55c2df67cb30 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2621282932 >> 172.21.15.81:0/2621282932 conn(0x55c2df5c5290 msgr2=0x55c2df6735f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2621282932 shutdown_connections 2024-05-09T00:13:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa317bd7b80 1 -- 172.21.15.81:0/2621282932 wait complete. 2024-05-09T00:13:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa317bd7b80 20 client.18645 trim_cache size 0 max 16384 2024-05-09T00:13:57.829 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:13:57.829 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:13:57.829 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "92854d74-3ce9-4d2a-904c-bea246c0213f", 2024-05-09T00:13:57.829 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:13:57.829 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:13:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa30ba1d700 1 -- 172.21.15.81:0/27458801 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa2f00a1290 msgr2=0x7fa2f00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa30ba1d700 1 --2- 172.21.15.81:0/27458801 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa2f00a1290 0x7fa2f00a3750 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa300005950 tx=0x7fa3000058e0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa30ba1d700 1 -- 172.21.15.81:0/27458801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3041000f0 msgr2=0x7fa304198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa30ba1d700 1 --2- 172.21.15.81:0/27458801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3041000f0 0x7fa304198230 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800d950 tx=0x7fa2f800dd10 comp rx=0 tx=0).stop 2024-05-09T00:13:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.824+0000 7fa30ba1d700 1 -- 172.21.15.81:0/27458801 shutdown_connections 2024-05-09T00:13:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.825+0000 7fa30ba1d700 1 --2- 172.21.15.81:0/27458801 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa2f00a1290 0x7fa2f00a3750 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.825+0000 7fa30ba1d700 1 --2- 172.21.15.81:0/27458801 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa304105f90 0x7fa3041a32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.825+0000 7fa30ba1d700 1 --2- 172.21.15.81:0/27458801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3041000f0 0x7fa304198230 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.825+0000 7fa30ba1d700 1 --2- 172.21.15.81:0/27458801 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa304100ab0 0x7fa304198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.825+0000 7fa30ba1d700 1 -- 172.21.15.81:0/27458801 >> 172.21.15.81:0/27458801 conn(0x7fa304076ba0 msgr2=0x7fa3040fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.825+0000 7fa30ba1d700 1 -- 172.21.15.81:0/27458801 shutdown_connections 2024-05-09T00:13:57.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.825+0000 7fa30ba1d700 1 -- 172.21.15.81:0/27458801 wait complete. 2024-05-09T00:13:57.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:13:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.960+0000 7f94ecf04700 1 -- 172.21.15.81:0/2442778282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e8100060 msgr2=0x7f94e8100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.960+0000 7f94ecf04700 1 --2- 172.21.15.81:0/2442778282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e8100060 0x7f94e8100440 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009990 tx=0x7f94d8009ca0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.960+0000 7f94ecf04700 1 -- 172.21.15.81:0/2442778282 shutdown_connections 2024-05-09T00:13:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.960+0000 7f94ecf04700 1 --2- 172.21.15.81:0/2442778282 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e8105180 0x7f94e810cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.960+0000 7f94ecf04700 1 --2- 172.21.15.81:0/2442778282 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e8100060 0x7f94e8100440 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.960+0000 7f94ecf04700 1 --2- 172.21.15.81:0/2442778282 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94e8100a10 0x7f94e8104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.960+0000 7f94ecf04700 1 -- 172.21.15.81:0/2442778282 >> 172.21.15.81:0/2442778282 conn(0x7f94e8076f40 msgr2=0x7f94e8077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.960+0000 7f94ecf04700 1 -- 172.21.15.81:0/2442778282 shutdown_connections 2024-05-09T00:13:57.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.960+0000 7f94ecf04700 1 -- 172.21.15.81:0/2442778282 wait complete. 2024-05-09T00:13:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94ecf04700 1 Processor -- start 2024-05-09T00:13:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94ecf04700 1 -- start start 2024-05-09T00:13:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94ecf04700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94e8100060 0x7f94e81962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94ecf04700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e8105180 0x7f94e8196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94ecf04700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e819ab60 0x7f94e819afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94ecf04700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e819b5e0 con 0x7f94e819ab60 2024-05-09T00:13:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94ecf04700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e819b750 con 0x7f94e8105180 2024-05-09T00:13:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94ecf04700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e819b910 con 0x7f94e8100060 2024-05-09T00:13:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94e6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e819ab60 0x7f94e819afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94e6d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e819ab60 0x7f94e819afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60468/0 (socket says 172.21.15.81:60468) 2024-05-09T00:13:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94e6d9d700 1 -- 172.21.15.81:0/3607090776 learned_addr learned my addr 172.21.15.81:0/3607090776 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94e659c700 1 --2- 172.21.15.81:0/3607090776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94e8100060 0x7f94e81962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94e5d9b700 1 --2- 172.21.15.81:0/3607090776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e8105180 0x7f94e8196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94e6d9d700 1 -- 172.21.15.81:0/3607090776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94e8100060 msgr2=0x7f94e81962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94e6d9d700 1 --2- 172.21.15.81:0/3607090776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94e8100060 0x7f94e81962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94e6d9d700 1 -- 172.21.15.81:0/3607090776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e8105180 msgr2=0x7f94e8196810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.961+0000 7f94e6d9d700 1 --2- 172.21.15.81:0/3607090776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e8105180 0x7f94e8196810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.962+0000 7f94e6d9d700 1 -- 172.21.15.81:0/3607090776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d80095f0 con 0x7f94e819ab60 2024-05-09T00:13:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.962+0000 7f94e6d9d700 1 --2- 172.21.15.81:0/3607090776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e819ab60 0x7f94e819afe0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f94e0007ee0 tx=0x7f94e000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.962+0000 7f94df7fe700 1 -- 172.21.15.81:0/3607090776 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e0017070 con 0x7f94e819ab60 2024-05-09T00:13:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.962+0000 7f94df7fe700 1 -- 172.21.15.81:0/3607090776 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94e000f040 con 0x7f94e819ab60 2024-05-09T00:13:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.962+0000 7f94ecf04700 1 -- 172.21.15.81:0/3607090776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e81a2e70 con 0x7f94e819ab60 2024-05-09T00:13:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.962+0000 7f94df7fe700 1 -- 172.21.15.81:0/3607090776 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e0005580 con 0x7f94e819ab60 2024-05-09T00:13:57.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.962+0000 7f94ecf04700 1 -- 172.21.15.81:0/3607090776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e81a3300 con 0x7f94e819ab60 2024-05-09T00:13:57.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.964+0000 7f94df7fe700 1 -- 172.21.15.81:0/3607090776 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f94e000db20 con 0x7f94e819ab60 2024-05-09T00:13:57.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.965+0000 7f94df7fe700 1 --2- 172.21.15.81:0/3607090776 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f94d40a1290 0x7f94d40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.965+0000 7f94df7fe700 1 -- 172.21.15.81:0/3607090776 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f94e00cc450 con 0x7f94e819ab60 2024-05-09T00:13:57.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.965+0000 7f94e659c700 1 --2- 172.21.15.81:0/3607090776 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f94d40a1290 0x7f94d40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.965+0000 7f94e659c700 1 --2- 172.21.15.81:0/3607090776 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f94d40a1290 0x7f94d40a3750 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f94d8006010 tx=0x7f94d800b540 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.965+0000 7f94f90beb80 1 Processor -- start 2024-05-09T00:13:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94f90beb80 1 -- start start 2024-05-09T00:13:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94f90beb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10060 0x55fef9a10440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94f90beb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a10980 0x55fef9a1b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94f90beb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a1b860 0x55fef9a1dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94f90beb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef9966150 con 0x55fef9a10060 2024-05-09T00:13:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94f90beb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef9963b10 con 0x55fef9a10980 2024-05-09T00:13:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94f90beb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef995f400 con 0x55fef9a1b860 2024-05-09T00:13:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94e659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10060 0x55fef9a10440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94e659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10060 0x55fef9a10440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60470/0 (socket says 172.21.15.81:60470) 2024-05-09T00:13:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94e659c700 1 -- 172.21.15.81:0/2853826814 learned_addr learned my addr 172.21.15.81:0/2853826814 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94e5d9b700 1 --2- 172.21.15.81:0/2853826814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a10980 0x55fef9a1b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94e6d9d700 1 --2- 172.21.15.81:0/2853826814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a1b860 0x55fef9a1dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94e659c700 1 -- 172.21.15.81:0/2853826814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a1b860 msgr2=0x55fef9a1dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94e659c700 1 --2- 172.21.15.81:0/2853826814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a1b860 0x55fef9a1dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94e659c700 1 -- 172.21.15.81:0/2853826814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a10980 msgr2=0x55fef9a1b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94e659c700 1 --2- 172.21.15.81:0/2853826814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a10980 0x55fef9a1b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94e659c700 1 -- 172.21.15.81:0/2853826814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fef97e03b0 con 0x55fef9a10060 2024-05-09T00:13:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94e6d9d700 1 --2- 172.21.15.81:0/2853826814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a1b860 0x55fef9a1dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:13:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.966+0000 7f94e659c700 1 --2- 172.21.15.81:0/2853826814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10060 0x55fef9a10440 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f94d8005400 tx=0x7f94d8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bcaeb8f5f6ea44 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.967+0000 7f94dcff9700 1 -- 172.21.15.81:0/2853826814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d800be00 con 0x55fef9a10060 2024-05-09T00:13:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.967+0000 7f94dcff9700 1 -- 172.21.15.81:0/2853826814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94d801e040 con 0x55fef9a10060 2024-05-09T00:13:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.967+0000 7f94dcff9700 1 -- 172.21.15.81:0/2853826814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d800f7e0 con 0x55fef9a10060 2024-05-09T00:13:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.967+0000 7f94f90beb80 1 -- 172.21.15.81:0/2853826814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10060 msgr2=0x55fef9a10440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.967+0000 7f94f90beb80 1 --2- 172.21.15.81:0/2853826814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10060 0x55fef9a10440 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f94d8005400 tx=0x7f94d8020000 comp rx=0 tx=0).stop 2024-05-09T00:13:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.967+0000 7f94f90beb80 1 -- 172.21.15.81:0/2853826814 shutdown_connections 2024-05-09T00:13:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.967+0000 7f94f90beb80 1 --2- 172.21.15.81:0/2853826814 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a1b860 0x55fef9a1dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.967+0000 7f94f90beb80 1 --2- 172.21.15.81:0/2853826814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10060 0x55fef9a10440 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.967+0000 7f94f90beb80 1 --2- 172.21.15.81:0/2853826814 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a10980 0x55fef9a1b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.967+0000 7f94f90beb80 1 -- 172.21.15.81:0/2853826814 >> 172.21.15.81:0/2853826814 conn(0x55fef996d210 msgr2=0x55fef9a0c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.967+0000 7f94f90beb80 1 -- 172.21.15.81:0/2853826814 shutdown_connections 2024-05-09T00:13:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.967+0000 7f94f90beb80 1 -- 172.21.15.81:0/2853826814 wait complete. 2024-05-09T00:13:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94f90beb80 1 -- start start 2024-05-09T00:13:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94f90beb80 1 Processor -- start 2024-05-09T00:13:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94f90beb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a10060 0x55fef9a18670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94f90beb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10980 0x55fef9a18bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94f90beb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a1b860 0x55fef9a190f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94f90beb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef98fb560 con 0x55fef9a10980 2024-05-09T00:13:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94f90beb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef98fb200 con 0x55fef9a1b860 2024-05-09T00:13:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94f90beb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef97e26a0 con 0x55fef9a10060 2024-05-09T00:13:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94f90beb80 10 client.0 _ll_register_callbacks cb 0x55fef9904b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:57.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94e5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10980 0x55fef9a18bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94e5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10980 0x55fef9a18bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60472/0 (socket says 172.21.15.81:60472) 2024-05-09T00:13:57.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94e5d9b700 1 -- 172.21.15.81:0/1605594562 learned_addr learned my addr 172.21.15.81:0/1605594562 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:57.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94e659c700 1 --2- 172.21.15.81:0/1605594562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a10060 0x55fef9a18670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94e6d9d700 1 --2- 172.21.15.81:0/1605594562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a1b860 0x55fef9a190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94e5d9b700 1 -- 172.21.15.81:0/1605594562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a10060 msgr2=0x55fef9a18670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94e5d9b700 1 --2- 172.21.15.81:0/1605594562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a10060 0x55fef9a18670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94e5d9b700 1 -- 172.21.15.81:0/1605594562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a1b860 msgr2=0x55fef9a190f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94e5d9b700 1 --2- 172.21.15.81:0/1605594562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a1b860 0x55fef9a190f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.968+0000 7f94e5d9b700 1 -- 172.21.15.81:0/1605594562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e810d570 con 0x55fef9a10980 2024-05-09T00:13:57.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94e5d9b700 1 --2- 172.21.15.81:0/1605594562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10980 0x55fef9a18bb0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f94d0012840 tx=0x7f94d0012b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1055f11d3339dbca server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:57.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:57.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94cdffb700 1 -- 172.21.15.81:0/1605594562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0004520 con 0x55fef9a10980 2024-05-09T00:13:57.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94cdffb700 1 -- 172.21.15.81:0/1605594562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f94d0003680 con 0x55fef9a10980 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94f90beb80 1 -- 172.21.15.81:0/1605594562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fef98b8270 con 0x55fef9a10980 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94cdffb700 1 -- 172.21.15.81:0/1605594562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94d0003880 con 0x55fef9a10980 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94f90beb80 10 client.18657 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94f90beb80 1 -- 172.21.15.81:0/1605594562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fef978cb60 con 0x55fef9a10980 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94cdffb700 1 -- 172.21.15.81:0/1605594562 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94d0027020 con 0x55fef9a10980 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94cdffb700 1 -- 172.21.15.81:0/1605594562 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f94d0010c10 con 0x55fef9a10980 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94f90beb80 10 client.18657 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94f90beb80 10 client.18657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94f90beb80 20 client.18657 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94f90beb80 1 --2- 172.21.15.81:0/1605594562 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fef9a2b540 0x55fef9a2d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94f90beb80 4 client.18657 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.969+0000 7f94f90beb80 1 -- 172.21.15.81:0/1605594562 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fef99de810 con 0x55fef9a2b540 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.970+0000 7f94e659c700 1 --2- 172.21.15.81:0/1605594562 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fef9a2b540 0x55fef9a2d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.970+0000 7f94cdffb700 10 client.18657 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.970+0000 7f94e659c700 1 --2- 172.21.15.81:0/1605594562 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fef9a2b540 0x55fef9a2d960 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48fb519033639515 server_cookie=c37fa39f53a301fb in_seq=0 out_seq=0 2024-05-09T00:13:57.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94cdffb700 1 -- 172.21.15.81:0/1605594562 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fef99de810 con 0x55fef9a2b540 2024-05-09T00:13:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94cdffb700 10 client.18657 handle_command_reply: tid=0 2024-05-09T00:13:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94f90beb80 1 client.18657 shutdown 2024-05-09T00:13:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94f90beb80 1 -- 172.21.15.81:0/1605594562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10980 msgr2=0x55fef9a18bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94f90beb80 1 --2- 172.21.15.81:0/1605594562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10980 0x55fef9a18bb0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f94d0012840 tx=0x7f94d0012b50 comp rx=0 tx=0).stop 2024-05-09T00:13:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94f90beb80 1 -- 172.21.15.81:0/1605594562 shutdown_connections 2024-05-09T00:13:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94f90beb80 1 --2- 172.21.15.81:0/1605594562 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fef9a2b540 0x55fef9a2d960 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94f90beb80 1 --2- 172.21.15.81:0/1605594562 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a1b860 0x55fef9a190f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94f90beb80 1 --2- 172.21.15.81:0/1605594562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a10060 0x55fef9a18670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94cdffb700 0 client.18657 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94f90beb80 1 --2- 172.21.15.81:0/1605594562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10980 0x55fef9a18bb0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94f90beb80 1 -- 172.21.15.81:0/1605594562 >> 172.21.15.81:0/1605594562 conn(0x55fef996d210 msgr2=0x55fef9a12080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94f90beb80 1 -- 172.21.15.81:0/1605594562 shutdown_connections 2024-05-09T00:13:57.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94f90beb80 1 -- 172.21.15.81:0/1605594562 wait complete. 2024-05-09T00:13:57.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.971+0000 7f94f90beb80 20 client.18657 trim_cache size 0 max 16384 2024-05-09T00:13:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.988+0000 7f94f90beb80 1 Processor -- start 2024-05-09T00:13:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.988+0000 7f94f90beb80 1 -- start start 2024-05-09T00:13:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.988+0000 7f94f90beb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10060 0x55fef9a1dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.988+0000 7f94f90beb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a10980 0x55fef9a223f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.988+0000 7f94f90beb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a1b860 0x55fef9a22930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.988+0000 7f94f90beb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef9a11b00 con 0x55fef9a10060 2024-05-09T00:13:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.988+0000 7f94f90beb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef9a10d60 con 0x55fef9a1b860 2024-05-09T00:13:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.988+0000 7f94f90beb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef9a11010 con 0x55fef9a10980 2024-05-09T00:13:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.988+0000 7f94e659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10060 0x55fef9a1dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.988+0000 7f94e659c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10060 0x55fef9a1dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60488/0 (socket says 172.21.15.81:60488) 2024-05-09T00:13:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.988+0000 7f94e659c700 1 -- 172.21.15.81:0/2156370866 learned_addr learned my addr 172.21.15.81:0/2156370866 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.989+0000 7f94e6d9d700 1 --2- 172.21.15.81:0/2156370866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a1b860 0x55fef9a22930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.989+0000 7f94e659c700 1 -- 172.21.15.81:0/2156370866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a10980 msgr2=0x55fef9a223f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.989+0000 7f94e659c700 1 --2- 172.21.15.81:0/2156370866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a10980 0x55fef9a223f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.989+0000 7f94e659c700 1 -- 172.21.15.81:0/2156370866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a1b860 msgr2=0x55fef9a22930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.989+0000 7f94e659c700 1 --2- 172.21.15.81:0/2156370866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a1b860 0x55fef9a22930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.989+0000 7f94e659c700 1 -- 172.21.15.81:0/2156370866 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fef9925560 con 0x55fef9a10060 2024-05-09T00:13:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.989+0000 7f94e659c700 1 --2- 172.21.15.81:0/2156370866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10060 0x55fef9a1dc50 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f94d8005400 tx=0x7f94d801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345e82fb80594837 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.989+0000 7f94dd7fa700 1 -- 172.21.15.81:0/2156370866 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d800bd00 con 0x55fef9a10060 2024-05-09T00:13:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.989+0000 7f94dd7fa700 1 -- 172.21.15.81:0/2156370866 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94d800be60 con 0x55fef9a10060 2024-05-09T00:13:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.989+0000 7f94dd7fa700 1 -- 172.21.15.81:0/2156370866 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d803c660 con 0x55fef9a10060 2024-05-09T00:13:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 -- 172.21.15.81:0/2156370866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10060 msgr2=0x55fef9a1dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 --2- 172.21.15.81:0/2156370866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10060 0x55fef9a1dc50 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f94d8005400 tx=0x7f94d801a040 comp rx=0 tx=0).stop 2024-05-09T00:13:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 -- 172.21.15.81:0/2156370866 shutdown_connections 2024-05-09T00:13:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 --2- 172.21.15.81:0/2156370866 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a1b860 0x55fef9a22930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 --2- 172.21.15.81:0/2156370866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10060 0x55fef9a1dc50 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 --2- 172.21.15.81:0/2156370866 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a10980 0x55fef9a223f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 -- 172.21.15.81:0/2156370866 >> 172.21.15.81:0/2156370866 conn(0x55fef996d210 msgr2=0x55fef9a13900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 -- 172.21.15.81:0/2156370866 shutdown_connections 2024-05-09T00:13:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 -- 172.21.15.81:0/2156370866 wait complete. 2024-05-09T00:13:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 -- start start 2024-05-09T00:13:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 Processor -- start 2024-05-09T00:13:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a10060 0x55fef9a22780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10980 0x55fef9a1e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a1b860 0x55fef9a1e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef9a1f020 con 0x55fef9a10980 2024-05-09T00:13:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef9a1f190 con 0x55fef9a10060 2024-05-09T00:13:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fef9a82e30 con 0x55fef9a1b860 2024-05-09T00:13:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94f90beb80 10 client.0 _ll_register_callbacks cb 0x55fef9904b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:13:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94e5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10980 0x55fef9a1e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94e5d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10980 0x55fef9a1e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60490/0 (socket says 172.21.15.81:60490) 2024-05-09T00:13:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.990+0000 7f94e5d9b700 1 -- 172.21.15.81:0/3573958856 learned_addr learned my addr 172.21.15.81:0/3573958856 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:13:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94e659c700 1 --2- 172.21.15.81:0/3573958856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a10060 0x55fef9a22780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94e5d9b700 1 -- 172.21.15.81:0/3573958856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a1b860 msgr2=0x55fef9a1e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94e5d9b700 1 --2- 172.21.15.81:0/3573958856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a1b860 0x55fef9a1e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94e5d9b700 1 -- 172.21.15.81:0/3573958856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a10060 msgr2=0x55fef9a22780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:13:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94e5d9b700 1 --2- 172.21.15.81:0/3573958856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a10060 0x55fef9a22780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94e5d9b700 1 -- 172.21.15.81:0/3573958856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fef97e03b0 con 0x55fef9a10980 2024-05-09T00:13:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94e5d9b700 1 --2- 172.21.15.81:0/3573958856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10980 0x55fef9a1e3c0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f94d0004020 tx=0x7f94d000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bc2abcdc436a9b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:13:57.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94cdffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:13:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94cdffb700 1 -- 172.21.15.81:0/3573958856 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d00057b0 con 0x55fef9a10980 2024-05-09T00:13:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94cdffb700 1 -- 172.21.15.81:0/3573958856 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f94d0000e40 con 0x55fef9a10980 2024-05-09T00:13:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94f90beb80 1 -- 172.21.15.81:0/3573958856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f94d801e040 con 0x55fef9a10980 2024-05-09T00:13:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94cdffb700 1 -- 172.21.15.81:0/3573958856 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94d0003680 con 0x55fef9a10980 2024-05-09T00:13:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94f90beb80 10 client.18663 fetch_fsmap learned FSMap version 26 2024-05-09T00:13:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94f90beb80 1 -- 172.21.15.81:0/3573958856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fef97e4cd0 con 0x55fef9a10980 2024-05-09T00:13:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.991+0000 7f94cdffb700 1 -- 172.21.15.81:0/3573958856 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94d0038080 con 0x55fef9a10980 2024-05-09T00:13:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.992+0000 7f94cdffb700 1 -- 172.21.15.81:0/3573958856 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f94d00108d0 con 0x55fef9a10980 2024-05-09T00:13:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.992+0000 7f94f90beb80 10 client.18663 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:13:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.992+0000 7f94f90beb80 10 client.18663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:13:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.992+0000 7f94f90beb80 20 client.18663 populate_metadata read hostname 'smithi081' 2024-05-09T00:13:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.992+0000 7f94f90beb80 1 --2- 172.21.15.81:0/3573958856 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fef9a845b0 0x55fef9a869d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:13:57.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.992+0000 7f94f90beb80 4 client.18663 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.992+0000 7f94f90beb80 1 -- 172.21.15.81:0/3573958856 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fef9957ec0 con 0x55fef9a845b0 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.992+0000 7f94e659c700 1 --2- 172.21.15.81:0/3573958856 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fef9a845b0 0x55fef9a869d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.992+0000 7f94e659c700 1 --2- 172.21.15.81:0/3573958856 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fef9a845b0 0x55fef9a869d0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e30361c65a09a5b server_cookie=871829366a15235f in_seq=0 out_seq=0 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.992+0000 7f94cdffb700 10 client.18663 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.992+0000 7f94cdffb700 1 -- 172.21.15.81:0/3573958856 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55fef9957ec0 con 0x55fef9a845b0 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.992+0000 7f94cdffb700 10 client.18663 handle_command_reply: tid=0 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.992+0000 7f94f90beb80 1 client.18663 shutdown 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94f90beb80 1 -- 172.21.15.81:0/3573958856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10980 msgr2=0x55fef9a1e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94f90beb80 1 --2- 172.21.15.81:0/3573958856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10980 0x55fef9a1e3c0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f94d0004020 tx=0x7f94d000a710 comp rx=0 tx=0).stop 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94f90beb80 1 -- 172.21.15.81:0/3573958856 shutdown_connections 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94f90beb80 1 --2- 172.21.15.81:0/3573958856 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55fef9a845b0 0x55fef9a869d0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94f90beb80 1 --2- 172.21.15.81:0/3573958856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55fef9a10060 0x55fef9a22780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94cdffb700 0 client.18663 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94f90beb80 1 --2- 172.21.15.81:0/3573958856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55fef9a1b860 0x55fef9a1e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94f90beb80 1 --2- 172.21.15.81:0/3573958856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fef9a10980 0x55fef9a1e3c0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:57.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94f90beb80 1 -- 172.21.15.81:0/3573958856 >> 172.21.15.81:0/3573958856 conn(0x55fef996d210 msgr2=0x55fef9a0c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:57.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94f90beb80 1 -- 172.21.15.81:0/3573958856 shutdown_connections 2024-05-09T00:13:57.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94f90beb80 1 -- 172.21.15.81:0/3573958856 wait complete. 2024-05-09T00:13:57.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94f90beb80 20 client.18663 trim_cache size 0 max 16384 2024-05-09T00:13:57.998 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:13:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:13:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:13:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "92854d74-3ce9-4d2a-904c-bea246c0213f": { 2024-05-09T00:13:57.998 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:13:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "92854d74-3ce9-4d2a-904c-bea246c0213f", 2024-05-09T00:13:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:13:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:13:57.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:13:57.999 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:13:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94ecf04700 1 -- 172.21.15.81:0/3607090776 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f94d40a1290 msgr2=0x7f94d40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94ecf04700 1 --2- 172.21.15.81:0/3607090776 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f94d40a1290 0x7f94d40a3750 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f94d8006010 tx=0x7f94d800b540 comp rx=0 tx=0).stop 2024-05-09T00:13:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94ecf04700 1 -- 172.21.15.81:0/3607090776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e819ab60 msgr2=0x7f94e819afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:13:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94ecf04700 1 --2- 172.21.15.81:0/3607090776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e819ab60 0x7f94e819afe0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f94e0007ee0 tx=0x7f94e000d3b0 comp rx=0 tx=0).stop 2024-05-09T00:13:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94ecf04700 1 -- 172.21.15.81:0/3607090776 shutdown_connections 2024-05-09T00:13:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94ecf04700 1 --2- 172.21.15.81:0/3607090776 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f94d40a1290 0x7f94d40a3750 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94ecf04700 1 --2- 172.21.15.81:0/3607090776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94e819ab60 0x7f94e819afe0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94ecf04700 1 --2- 172.21.15.81:0/3607090776 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f94e8100060 0x7f94e81962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94ecf04700 1 --2- 172.21.15.81:0/3607090776 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f94e8105180 0x7f94e8196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:13:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94ecf04700 1 -- 172.21.15.81:0/3607090776 >> 172.21.15.81:0/3607090776 conn(0x7f94e8076f40 msgr2=0x7f94e8106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:13:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94ecf04700 1 -- 172.21.15.81:0/3607090776 shutdown_connections 2024-05-09T00:13:58.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:13:57.993+0000 7f94ecf04700 1 -- 172.21.15.81:0/3607090776 wait complete. 2024-05-09T00:13:58.004 INFO:tasks.cephfs.filesystem:scrub status for tag:92854d74-3ce9-4d2a-904c-bea246c0213f - {'path': '/', 'tag': '92854d74-3ce9-4d2a-904c-bea246c0213f', 'options': 'recursive,force'} 2024-05-09T00:13:59.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:58 smithi081 ceph-mon[42474]: pgmap v341: 97 pgs: 97 active+clean; 5.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-09T00:13:59.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:58 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:13:59.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:58 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:13:59.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:58 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:13:59.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:58 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:13:59.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:58 smithi150 ceph-mon[46187]: pgmap v341: 97 pgs: 97 active+clean; 5.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-09T00:13:59.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:58 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:13:59.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:58 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:13:59.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:58 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:13:59.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:58 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:13:59.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:58 smithi171 ceph-mon[47351]: pgmap v341: 97 pgs: 97 active+clean; 5.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-09T00:13:59.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:58 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:13:59.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:58 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:13:59.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:58 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:13:59.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:58 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:14:00.016 INFO:tasks.workunit.client.0.smithi081.stdout:499/600: open fd = 3 2024-05-09T00:14:00.017 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.017 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.017 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.017 INFO:tasks.workunit.client.0.smithi081.stdout:500/600: open fd = 3 2024-05-09T00:14:00.017 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.017 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.017 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.017 INFO:tasks.workunit.client.0.smithi081.stdout:501/600: open fd = 3 2024-05-09T00:14:00.017 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.017 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.017 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.017 INFO:tasks.workunit.client.0.smithi081.stdout:502/600: open fd = 3 2024-05-09T00:14:00.017 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.017 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:503/600: open fd = 3 2024-05-09T00:14:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:504/600: open fd = 3 2024-05-09T00:14:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:505/600: open fd = 3 2024-05-09T00:14:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.018 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:506/600: open fd = 3 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:507/600: open fd = 3 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:508/600: open fd = 3 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:509/600: open fd = 3 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.019 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:510/600: open fd = 3 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:511/600: open fd = 3 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:512/600: open fd = 3 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:513/600: open fd = 3 2024-05-09T00:14:00.020 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:514/600: open fd = 3 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:515/600: open fd = 3 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:516/600: open fd = 3 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.021 INFO:tasks.workunit.client.0.smithi081.stdout:517/600: open fd = 3 2024-05-09T00:14:00.022 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.022 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.022 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.022 INFO:tasks.workunit.client.0.smithi081.stdout:518/600: open fd = 3 2024-05-09T00:14:00.022 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.022 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.022 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.022 INFO:tasks.workunit.client.0.smithi081.stdout:519/600: open fd = 3 2024-05-09T00:14:00.022 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.022 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.022 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.022 INFO:tasks.workunit.client.0.smithi081.stdout:520/600: open fd = 3 2024-05-09T00:14:00.022 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.022 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:521/600: open fd = 3 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:522/600: open fd = 3 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:523/600: open fd = 3 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:524/600: open fd = 3 2024-05-09T00:14:00.023 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:525/600: open fd = 3 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:526/600: open fd = 3 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:527/600: open fd = 3 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:528/600: open fd = 3 2024-05-09T00:14:00.024 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:529/600: open fd = 3 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:530/600: open fd = 3 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:531/600: open fd = 3 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.025 INFO:tasks.workunit.client.0.smithi081.stdout:532/600: open fd = 3 2024-05-09T00:14:00.026 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.026 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.026 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.026 INFO:tasks.workunit.client.0.smithi081.stdout:533/600: open fd = 3 2024-05-09T00:14:00.026 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.026 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.026 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.026 INFO:tasks.workunit.client.0.smithi081.stdout:534/600: open fd = 3 2024-05-09T00:14:00.026 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.026 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.026 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.026 INFO:tasks.workunit.client.0.smithi081.stdout:535/600: open fd = 3 2024-05-09T00:14:00.026 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.026 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:536/600: open fd = 3 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:537/600: open fd = 3 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:538/600: open fd = 3 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:539/600: open fd = 3 2024-05-09T00:14:00.027 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:540/600: open fd = 3 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:541/600: open fd = 3 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:542/600: open fd = 3 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.028 INFO:tasks.workunit.client.0.smithi081.stdout:543/600: open fd = 3 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:544/600: open fd = 3 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:545/600: open fd = 3 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:546/600: open fd = 3 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.029 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.030 INFO:tasks.workunit.client.0.smithi081.stdout:547/600: open fd = 3 2024-05-09T00:14:00.030 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.030 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.030 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.030 INFO:tasks.workunit.client.0.smithi081.stdout:548/600: open fd = 3 2024-05-09T00:14:00.030 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.030 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.030 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.030 INFO:tasks.workunit.client.0.smithi081.stdout:549/600: open fd = 3 2024-05-09T00:14:00.030 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.030 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.030 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.030 INFO:tasks.workunit.client.0.smithi081.stdout:550/600: open fd = 3 2024-05-09T00:14:00.030 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:551/600: open fd = 3 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:552/600: open fd = 3 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:553/600: open fd = 3 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.031 INFO:tasks.workunit.client.0.smithi081.stdout:554/600: open fd = 3 2024-05-09T00:14:00.032 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.032 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.032 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.032 INFO:tasks.workunit.client.0.smithi081.stdout:555/600: open fd = 3 2024-05-09T00:14:00.034 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.034 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.034 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.034 INFO:tasks.workunit.client.0.smithi081.stdout:556/600: open fd = 3 2024-05-09T00:14:00.034 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.034 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.034 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.034 INFO:tasks.workunit.client.0.smithi081.stdout:557/600: open fd = 3 2024-05-09T00:14:00.034 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.035 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.035 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.035 INFO:tasks.workunit.client.0.smithi081.stdout:558/600: open fd = 3 2024-05-09T00:14:00.035 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.035 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.035 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.035 INFO:tasks.workunit.client.0.smithi081.stdout:559/600: open fd = 3 2024-05-09T00:14:00.035 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.035 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.036 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.036 INFO:tasks.workunit.client.0.smithi081.stdout:560/600: open fd = 3 2024-05-09T00:14:00.036 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.036 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:00.036 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:00.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:13:59 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:14:00.267 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:13:59 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:14:00.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:13:59 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:14:01.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:00 smithi081 ceph-mon[42474]: pgmap v342: 97 pgs: 97 active+clean; 5.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-09T00:14:01.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:00 smithi150 ceph-mon[46187]: pgmap v342: 97 pgs: 97 active+clean; 5.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-09T00:14:01.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:00 smithi171 ceph-mon[47351]: pgmap v342: 97 pgs: 97 active+clean; 5.0 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 32 KiB/s wr, 9 op/s 2024-05-09T00:14:03.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:02 smithi081 ceph-mon[42474]: pgmap v343: 97 pgs: 97 active+clean; 5.2 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 18 op/s 2024-05-09T00:14:03.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:02 smithi150 ceph-mon[46187]: pgmap v343: 97 pgs: 97 active+clean; 5.2 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 18 op/s 2024-05-09T00:14:03.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:02 smithi171 ceph-mon[47351]: pgmap v343: 97 pgs: 97 active+clean; 5.2 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 57 KiB/s wr, 18 op/s 2024-05-09T00:14:05.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:04 smithi081 ceph-mon[42474]: pgmap v344: 97 pgs: 97 active+clean; 5.2 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-05-09T00:14:05.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:04 smithi150 ceph-mon[46187]: pgmap v344: 97 pgs: 97 active+clean; 5.2 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-05-09T00:14:05.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:04 smithi171 ceph-mon[47351]: pgmap v344: 97 pgs: 97 active+clean; 5.2 MiB data, 448 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 39 KiB/s wr, 13 op/s 2024-05-09T00:14:06.270 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:05 smithi150 ceph-mon[46187]: osdmap e92: 12 total, 12 up, 12 in 2024-05-09T00:14:06.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:05 smithi171 ceph-mon[47351]: osdmap e92: 12 total, 12 up, 12 in 2024-05-09T00:14:06.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:05 smithi081 ceph-mon[42474]: osdmap e92: 12 total, 12 up, 12 in 2024-05-09T00:14:07.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:06 smithi150 ceph-mon[46187]: pgmap v346: 97 pgs: 97 active+clean; 5.5 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 110 KiB/s wr, 37 op/s 2024-05-09T00:14:07.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:06 smithi171 ceph-mon[47351]: pgmap v346: 97 pgs: 97 active+clean; 5.5 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 110 KiB/s wr, 37 op/s 2024-05-09T00:14:07.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:06 smithi081 ceph-mon[42474]: pgmap v346: 97 pgs: 97 active+clean; 5.5 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 110 KiB/s wr, 37 op/s 2024-05-09T00:14:09.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:08 smithi150 ceph-mon[46187]: pgmap v347: 97 pgs: 97 active+clean; 5.5 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 110 KiB/s wr, 37 op/s 2024-05-09T00:14:09.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:08 smithi171 ceph-mon[47351]: pgmap v347: 97 pgs: 97 active+clean; 5.5 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 110 KiB/s wr, 37 op/s 2024-05-09T00:14:09.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:08 smithi081 ceph-mon[42474]: pgmap v347: 97 pgs: 97 active+clean; 5.5 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 110 KiB/s wr, 37 op/s 2024-05-09T00:14:10.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.017+0000 7faa1e85e700 1 -- 172.21.15.81:0/1853230536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18106230 msgr2=0x7faa1810ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:10.015 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.017+0000 7faa1e85e700 1 --2- 172.21.15.81:0/1853230536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18106230 0x7faa1810ddb0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7faa1000b0a0 tx=0x7faa1000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.017+0000 7faa1e85e700 1 -- 172.21.15.81:0/1853230536 shutdown_connections 2024-05-09T00:14:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.017+0000 7faa1e85e700 1 --2- 172.21.15.81:0/1853230536 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa18101110 0x7faa181014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.017+0000 7faa1e85e700 1 --2- 172.21.15.81:0/1853230536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18106230 0x7faa1810ddb0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.017+0000 7faa1e85e700 1 --2- 172.21.15.81:0/1853230536 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa18101ac0 0x7faa18105b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.017+0000 7faa1e85e700 1 -- 172.21.15.81:0/1853230536 >> 172.21.15.81:0/1853230536 conn(0x7faa180fc9b0 msgr2=0x7faa180fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.017+0000 7faa1e85e700 1 -- 172.21.15.81:0/1853230536 shutdown_connections 2024-05-09T00:14:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.017+0000 7faa1e85e700 1 -- 172.21.15.81:0/1853230536 wait complete. 2024-05-09T00:14:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.018+0000 7faa1e85e700 1 Processor -- start 2024-05-09T00:14:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.018+0000 7faa1e85e700 1 -- start start 2024-05-09T00:14:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa1e85e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18101110 0x7faa18197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa1e85e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa18106230 0x7faa18197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa1e85e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa1819bda0 0x7faa1819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa1e85e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1819c820 con 0x7faa18101110 2024-05-09T00:14:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa1e85e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1819c990 con 0x7faa18106230 2024-05-09T00:14:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa1e85e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1819cb50 con 0x7faa1819bda0 2024-05-09T00:14:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa17fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18101110 0x7faa18197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa17fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18101110 0x7faa18197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50310/0 (socket says 172.21.15.81:50310) 2024-05-09T00:14:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa17fff700 1 -- 172.21.15.81:0/3473376928 learned_addr learned my addr 172.21.15.81:0/3473376928 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa177fe700 1 --2- 172.21.15.81:0/3473376928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa18106230 0x7faa18197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa1cdfb700 1 --2- 172.21.15.81:0/3473376928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa1819bda0 0x7faa1819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa17fff700 1 -- 172.21.15.81:0/3473376928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa1819bda0 msgr2=0x7faa1819c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa17fff700 1 --2- 172.21.15.81:0/3473376928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa1819bda0 0x7faa1819c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa17fff700 1 -- 172.21.15.81:0/3473376928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa18106230 msgr2=0x7faa18197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa17fff700 1 --2- 172.21.15.81:0/3473376928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa18106230 0x7faa18197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa17fff700 1 -- 172.21.15.81:0/3473376928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa10009d00 con 0x7faa18101110 2024-05-09T00:14:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa17fff700 1 --2- 172.21.15.81:0/3473376928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18101110 0x7faa18197510 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7faa0000d980 tx=0x7faa0000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.019+0000 7faa157fa700 1 -- 172.21.15.81:0/3473376928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00004220 con 0x7faa18101110 2024-05-09T00:14:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.020+0000 7faa1e85e700 1 -- 172.21.15.81:0/3473376928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa181a40b0 con 0x7faa18101110 2024-05-09T00:14:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.020+0000 7faa157fa700 1 -- 172.21.15.81:0/3473376928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa00007640 con 0x7faa18101110 2024-05-09T00:14:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.020+0000 7faa157fa700 1 -- 172.21.15.81:0/3473376928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00005610 con 0x7faa18101110 2024-05-09T00:14:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.020+0000 7faa1e85e700 1 -- 172.21.15.81:0/3473376928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa181a4590 con 0x7faa18101110 2024-05-09T00:14:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.022+0000 7faa157fa700 1 -- 172.21.15.81:0/3473376928 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7faa00004750 con 0x7faa18101110 2024-05-09T00:14:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.022+0000 7faa157fa700 1 --2- 172.21.15.81:0/3473376928 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faa040a1290 0x7faa040a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.023+0000 7faa177fe700 1 --2- 172.21.15.81:0/3473376928 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faa040a1290 0x7faa040a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.023+0000 7faa157fa700 1 -- 172.21.15.81:0/3473376928 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8616+0+0 (secure 0 0 0) 0x7faa000ccbe0 con 0x7faa18101110 2024-05-09T00:14:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.023+0000 7faa177fe700 1 --2- 172.21.15.81:0/3473376928 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faa040a1290 0x7faa040a3750 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faa18198a10 tx=0x7faa0800b3c0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.023+0000 7faa2aa18b80 1 Processor -- start 2024-05-09T00:14:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa2aa18b80 1 -- start start 2024-05-09T00:14:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa2aa18b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e42950 0x55d366e42d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa2aa18b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366e3cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa2aa18b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e3d480 0x55d366e3d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa2aa18b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d366d940f0 con 0x55d366e43270 2024-05-09T00:14:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa2aa18b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d366d91ab0 con 0x55d366e3d480 2024-05-09T00:14:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa2aa18b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d366d8d3a0 con 0x55d366e42950 2024-05-09T00:14:10.027 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366e3cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa177fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366e3cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50326/0 (socket says 172.21.15.81:50326) 2024-05-09T00:14:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa177fe700 1 -- 172.21.15.81:0/4136727584 learned_addr learned my addr 172.21.15.81:0/4136727584 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa17fff700 1 --2- 172.21.15.81:0/4136727584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e42950 0x55d366e42d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa177fe700 1 -- 172.21.15.81:0/4136727584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e42950 msgr2=0x55d366e42d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa177fe700 1 --2- 172.21.15.81:0/4136727584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e42950 0x55d366e42d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa177fe700 1 -- 172.21.15.81:0/4136727584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e3d480 msgr2=0x55d366e3d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa177fe700 1 --2- 172.21.15.81:0/4136727584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e3d480 0x55d366e3d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa177fe700 1 -- 172.21.15.81:0/4136727584 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d366c0e350 con 0x55d366e43270 2024-05-09T00:14:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa177fe700 1 --2- 172.21.15.81:0/4136727584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366e3cf40 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7faa08003a30 tx=0x7faa08013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd35153adb3dc7a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa0e7fc700 1 -- 172.21.15.81:0/4136727584 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa080118d0 con 0x55d366e43270 2024-05-09T00:14:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa0e7fc700 1 -- 172.21.15.81:0/4136727584 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa08015070 con 0x55d366e43270 2024-05-09T00:14:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.024+0000 7faa0e7fc700 1 -- 172.21.15.81:0/4136727584 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa08005280 con 0x55d366e43270 2024-05-09T00:14:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.025+0000 7faa2aa18b80 1 -- 172.21.15.81:0/4136727584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 msgr2=0x55d366e3cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.025+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/4136727584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366e3cf40 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7faa08003a30 tx=0x7faa08013000 comp rx=0 tx=0).stop 2024-05-09T00:14:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.025+0000 7faa2aa18b80 1 -- 172.21.15.81:0/4136727584 shutdown_connections 2024-05-09T00:14:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.025+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/4136727584 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e3d480 0x55d366e3d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.025+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/4136727584 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e42950 0x55d366e42d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.025+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/4136727584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366e3cf40 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.025+0000 7faa2aa18b80 1 -- 172.21.15.81:0/4136727584 >> 172.21.15.81:0/4136727584 conn(0x55d366d9b1b0 msgr2=0x55d366e37840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.025+0000 7faa2aa18b80 1 -- 172.21.15.81:0/4136727584 shutdown_connections 2024-05-09T00:14:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.025+0000 7faa2aa18b80 1 -- 172.21.15.81:0/4136727584 wait complete. 2024-05-09T00:14:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.026+0000 7faa2aa18b80 1 -- start start 2024-05-09T00:14:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.026+0000 7faa2aa18b80 1 Processor -- start 2024-05-09T00:14:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.026+0000 7faa2aa18b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e3d480 0x55d366e491a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.026+0000 7faa2aa18b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e42950 0x55d366e46530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.026+0000 7faa2aa18b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366e46b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.026+0000 7faa2aa18b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d366d29500 con 0x55d366e43270 2024-05-09T00:14:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.026+0000 7faa2aa18b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d366d291a0 con 0x55d366e42950 2024-05-09T00:14:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.026+0000 7faa2aa18b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d366c10640 con 0x55d366e3d480 2024-05-09T00:14:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.026+0000 7faa2aa18b80 10 client.0 _ll_register_callbacks cb 0x55d366d32ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.026+0000 7faa1cdfb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366e46b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.026+0000 7faa1cdfb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366e46b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50342/0 (socket says 172.21.15.81:50342) 2024-05-09T00:14:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.026+0000 7faa1cdfb700 1 -- 172.21.15.81:0/4024679670 learned_addr learned my addr 172.21.15.81:0/4024679670 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.026+0000 7faa17fff700 1 --2- 172.21.15.81:0/4024679670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e3d480 0x55d366e491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.026+0000 7faa177fe700 1 --2- 172.21.15.81:0/4024679670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e42950 0x55d366e46530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa1cdfb700 1 -- 172.21.15.81:0/4024679670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e3d480 msgr2=0x55d366e491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa1cdfb700 1 --2- 172.21.15.81:0/4024679670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e3d480 0x55d366e491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa1cdfb700 1 -- 172.21.15.81:0/4024679670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e42950 msgr2=0x55d366e46530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa1cdfb700 1 --2- 172.21.15.81:0/4024679670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e42950 0x55d366e46530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa1cdfb700 1 -- 172.21.15.81:0/4024679670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa080036e0 con 0x55d366e43270 2024-05-09T00:14:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa1cdfb700 1 --2- 172.21.15.81:0/4024679670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366e46b90 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7faa10015000 tx=0x7faa10009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7883c70a452c9a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7fa9f77fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7fa9f77fe700 1 -- 172.21.15.81:0/4024679670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1000e050 con 0x55d366e43270 2024-05-09T00:14:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa2aa18b80 1 -- 172.21.15.81:0/4024679670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d366ce6210 con 0x55d366e43270 2024-05-09T00:14:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7fa9f77fe700 1 -- 172.21.15.81:0/4024679670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8616+0+0 (secure 0 0 0) 0x7faa100074e0 con 0x55d366e43270 2024-05-09T00:14:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7fa9f77fe700 1 -- 172.21.15.81:0/4024679670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa10004e60 con 0x55d366e43270 2024-05-09T00:14:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa2aa18b80 10 client.18675 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa2aa18b80 1 -- 172.21.15.81:0/4024679670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d366bbab00 con 0x55d366e43270 2024-05-09T00:14:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7fa9f77fe700 1 -- 172.21.15.81:0/4024679670 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d366ce6210 con 0x55d366e43270 2024-05-09T00:14:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7fa9f77fe700 1 -- 172.21.15.81:0/4024679670 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faa1000b0d0 con 0x55d366e43270 2024-05-09T00:14:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa2aa18b80 10 client.18675 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa2aa18b80 10 client.18675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:14:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa2aa18b80 20 client.18675 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/4024679670 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d366e56b70 0x55d366e58f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa2aa18b80 4 client.18675 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:14:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.027+0000 7faa2aa18b80 1 -- 172.21.15.81:0/4024679670 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d366e0c7b0 con 0x55d366e56b70 2024-05-09T00:14:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.028+0000 7faa17fff700 1 --2- 172.21.15.81:0/4024679670 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d366e56b70 0x55d366e58f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.028+0000 7fa9f77fe700 10 client.18675 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.028+0000 7faa17fff700 1 --2- 172.21.15.81:0/4024679670 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d366e56b70 0x55d366e58f90 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb5ad0b0a10db389 server_cookie=5db7e40bb0db7633 in_seq=0 out_seq=0 2024-05-09T00:14:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7fa9f77fe700 1 -- 172.21.15.81:0/4024679670 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d366e0c7b0 con 0x55d366e56b70 2024-05-09T00:14:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7fa9f77fe700 10 client.18675 handle_command_reply: tid=0 2024-05-09T00:14:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7faa2aa18b80 1 client.18675 shutdown 2024-05-09T00:14:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7faa2aa18b80 1 -- 172.21.15.81:0/4024679670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 msgr2=0x55d366e46b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/4024679670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366e46b90 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7faa10015000 tx=0x7faa10009300 comp rx=0 tx=0).stop 2024-05-09T00:14:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7faa2aa18b80 1 -- 172.21.15.81:0/4024679670 shutdown_connections 2024-05-09T00:14:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/4024679670 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d366e56b70 0x55d366e58f90 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/4024679670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366e46b90 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7fa9f77fe700 0 client.18675 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/4024679670 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e3d480 0x55d366e491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/4024679670 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e42950 0x55d366e46530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7faa2aa18b80 1 -- 172.21.15.81:0/4024679670 >> 172.21.15.81:0/4024679670 conn(0x55d366d9b1b0 msgr2=0x55d366e414a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7faa2aa18b80 1 -- 172.21.15.81:0/4024679670 shutdown_connections 2024-05-09T00:14:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7faa2aa18b80 1 -- 172.21.15.81:0/4024679670 wait complete. 2024-05-09T00:14:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.029+0000 7faa2aa18b80 20 client.18675 trim_cache size 0 max 16384 2024-05-09T00:14:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa2aa18b80 1 Processor -- start 2024-05-09T00:14:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa2aa18b80 1 -- start start 2024-05-09T00:14:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa2aa18b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e3d480 0x55d366e46aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa2aa18b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e42950 0x55d366e37910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa2aa18b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e43270 0x55d366e44e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa2aa18b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d366e327c0 con 0x55d366e3d480 2024-05-09T00:14:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa2aa18b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d366e474a0 con 0x55d366e42950 2024-05-09T00:14:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa2aa18b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d366e42390 con 0x55d366e43270 2024-05-09T00:14:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa17fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e3d480 0x55d366e46aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa17fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e3d480 0x55d366e46aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50352/0 (socket says 172.21.15.81:50352) 2024-05-09T00:14:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa17fff700 1 -- 172.21.15.81:0/485539148 learned_addr learned my addr 172.21.15.81:0/485539148 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa177fe700 1 --2- 172.21.15.81:0/485539148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e42950 0x55d366e37910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa17fff700 1 -- 172.21.15.81:0/485539148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e43270 msgr2=0x55d366e44e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa17fff700 1 --2- 172.21.15.81:0/485539148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e43270 0x55d366e44e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa17fff700 1 -- 172.21.15.81:0/485539148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e42950 msgr2=0x55d366e37910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa17fff700 1 --2- 172.21.15.81:0/485539148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e42950 0x55d366e37910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.044+0000 7faa17fff700 1 -- 172.21.15.81:0/485539148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d366d53500 con 0x55d366e3d480 2024-05-09T00:14:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.045+0000 7faa17fff700 1 --2- 172.21.15.81:0/485539148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e3d480 0x55d366e46aa0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7faa00099bc0 tx=0x7faa0001c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548ab3e76a28d4bc server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.045+0000 7faa0effd700 1 -- 172.21.15.81:0/485539148 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00022df0 con 0x55d366e3d480 2024-05-09T00:14:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.045+0000 7faa0effd700 1 -- 172.21.15.81:0/485539148 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa000b1070 con 0x55d366e3d480 2024-05-09T00:14:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.045+0000 7faa0effd700 1 -- 172.21.15.81:0/485539148 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00099120 con 0x55d366e3d480 2024-05-09T00:14:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.045+0000 7faa2aa18b80 1 -- 172.21.15.81:0/485539148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e3d480 msgr2=0x55d366e46aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.045+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/485539148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e3d480 0x55d366e46aa0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7faa00099bc0 tx=0x7faa0001c040 comp rx=0 tx=0).stop 2024-05-09T00:14:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.045+0000 7faa2aa18b80 1 -- 172.21.15.81:0/485539148 shutdown_connections 2024-05-09T00:14:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.045+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/485539148 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e43270 0x55d366e44e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.045+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/485539148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e3d480 0x55d366e46aa0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.045+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/485539148 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e42950 0x55d366e37910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.045+0000 7faa2aa18b80 1 -- 172.21.15.81:0/485539148 >> 172.21.15.81:0/485539148 conn(0x55d366d9b1b0 msgr2=0x55d366e526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.045+0000 7faa2aa18b80 1 -- 172.21.15.81:0/485539148 shutdown_connections 2024-05-09T00:14:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.045+0000 7faa2aa18b80 1 -- 172.21.15.81:0/485539148 wait complete. 2024-05-09T00:14:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.046+0000 7faa2aa18b80 1 -- start start 2024-05-09T00:14:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.046+0000 7faa2aa18b80 1 Processor -- start 2024-05-09T00:14:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.046+0000 7faa2aa18b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e3d480 0x55d366e4bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.046+0000 7faa2aa18b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e42950 0x55d366e4c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.046+0000 7faa2aa18b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366eac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.046+0000 7faa2aa18b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d366e4ca10 con 0x55d366e43270 2024-05-09T00:14:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.046+0000 7faa2aa18b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d366eac5b0 con 0x55d366e3d480 2024-05-09T00:14:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.046+0000 7faa2aa18b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d366eac6f0 con 0x55d366e42950 2024-05-09T00:14:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.046+0000 7faa2aa18b80 10 client.0 _ll_register_callbacks cb 0x55d366d32ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.046+0000 7faa1cdfb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366eac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.046+0000 7faa1cdfb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366eac070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50354/0 (socket says 172.21.15.81:50354) 2024-05-09T00:14:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa1cdfb700 1 -- 172.21.15.81:0/3403364978 learned_addr learned my addr 172.21.15.81:0/3403364978 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa177fe700 1 --2- 172.21.15.81:0/3403364978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e42950 0x55d366e4c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa17fff700 1 --2- 172.21.15.81:0/3403364978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e3d480 0x55d366e4bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa1cdfb700 1 -- 172.21.15.81:0/3403364978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e42950 msgr2=0x55d366e4c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa1cdfb700 1 --2- 172.21.15.81:0/3403364978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e42950 0x55d366e4c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa1cdfb700 1 -- 172.21.15.81:0/3403364978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e3d480 msgr2=0x55d366e4bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa1cdfb700 1 --2- 172.21.15.81:0/3403364978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e3d480 0x55d366e4bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa1cdfb700 1 -- 172.21.15.81:0/3403364978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa181a4590 con 0x55d366e43270 2024-05-09T00:14:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa1cdfb700 1 --2- 172.21.15.81:0/3403364978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366eac070 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7faa10005bb0 tx=0x7faa10009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab61eb85a5d62213 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7fa9f77fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7fa9f77fe700 1 -- 172.21.15.81:0/3403364978 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1000e040 con 0x55d366e43270 2024-05-09T00:14:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7fa9f77fe700 1 -- 172.21.15.81:0/3403364978 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8616+0+0 (secure 0 0 0) 0x7faa100074a0 con 0x55d366e43270 2024-05-09T00:14:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa2aa18b80 1 -- 172.21.15.81:0/3403364978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa08015070 con 0x55d366e43270 2024-05-09T00:14:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7fa9f77fe700 1 -- 172.21.15.81:0/3403364978 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa1000b2c0 con 0x55d366e43270 2024-05-09T00:14:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa2aa18b80 10 client.18681 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa2aa18b80 1 -- 172.21.15.81:0/3403364978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d366c12c70 con 0x55d366e43270 2024-05-09T00:14:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7fa9f77fe700 1 -- 172.21.15.81:0/3403364978 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa1003c020 con 0x55d366e43270 2024-05-09T00:14:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7fa9f77fe700 1 -- 172.21.15.81:0/3403364978 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faa10026440 con 0x55d366e43270 2024-05-09T00:14:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa2aa18b80 10 client.18681 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa2aa18b80 10 client.18681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:14:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.047+0000 7faa2aa18b80 20 client.18681 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.048+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/3403364978 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d366ead9d0 0x55d366eafdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.048+0000 7faa2aa18b80 4 client.18681 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:14:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.048+0000 7faa2aa18b80 1 -- 172.21.15.81:0/3403364978 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d366d85e60 con 0x55d366ead9d0 2024-05-09T00:14:10.051 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.048+0000 7faa17fff700 1 --2- 172.21.15.81:0/3403364978 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d366ead9d0 0x55d366eafdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.048+0000 7faa17fff700 1 --2- 172.21.15.81:0/3403364978 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d366ead9d0 0x55d366eafdc0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63f3a53a91fdeb2 server_cookie=5c03e902195f0735 in_seq=0 out_seq=0 2024-05-09T00:14:10.052 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.048+0000 7fa9f77fe700 10 client.18681 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7fa9f77fe700 1 -- 172.21.15.81:0/3403364978 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d366d85e60 con 0x55d366ead9d0 2024-05-09T00:14:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7fa9f77fe700 10 client.18681 handle_command_reply: tid=0 2024-05-09T00:14:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7faa2aa18b80 1 client.18681 shutdown 2024-05-09T00:14:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7faa2aa18b80 1 -- 172.21.15.81:0/3403364978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 msgr2=0x55d366eac070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:10.059 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/3403364978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366eac070 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7faa10005bb0 tx=0x7faa10009650 comp rx=0 tx=0).stop 2024-05-09T00:14:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7faa2aa18b80 1 -- 172.21.15.81:0/3403364978 shutdown_connections 2024-05-09T00:14:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/3403364978 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55d366ead9d0 0x55d366eafdc0 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/3403364978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55d366e3d480 0x55d366e4bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/3403364978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55d366e43270 0x55d366eac070 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7faa2aa18b80 1 --2- 172.21.15.81:0/3403364978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55d366e42950 0x55d366e4c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7faa2aa18b80 1 -- 172.21.15.81:0/3403364978 >> 172.21.15.81:0/3403364978 conn(0x55d366d9b1b0 msgr2=0x55d366e526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7fa9f77fe700 0 client.18681 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7faa2aa18b80 1 -- 172.21.15.81:0/3403364978 shutdown_connections 2024-05-09T00:14:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7faa2aa18b80 1 -- 172.21.15.81:0/3403364978 wait complete. 2024-05-09T00:14:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.061+0000 7faa2aa18b80 20 client.18681 trim_cache size 0 max 16384 2024-05-09T00:14:10.060 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:14:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:14:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:14:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:14:10.061 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.062+0000 7faa1e85e700 1 -- 172.21.15.81:0/3473376928 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faa040a1290 msgr2=0x7faa040a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.062+0000 7faa1e85e700 1 --2- 172.21.15.81:0/3473376928 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faa040a1290 0x7faa040a3750 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7faa18198a10 tx=0x7faa0800b3c0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.062+0000 7faa1e85e700 1 -- 172.21.15.81:0/3473376928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18101110 msgr2=0x7faa18197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.062+0000 7faa1e85e700 1 --2- 172.21.15.81:0/3473376928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18101110 0x7faa18197510 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7faa0000d980 tx=0x7faa0000dc90 comp rx=0 tx=0).stop 2024-05-09T00:14:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.062+0000 7faa1e85e700 1 -- 172.21.15.81:0/3473376928 shutdown_connections 2024-05-09T00:14:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.062+0000 7faa1e85e700 1 --2- 172.21.15.81:0/3473376928 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7faa040a1290 0x7faa040a3750 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.062+0000 7faa1e85e700 1 --2- 172.21.15.81:0/3473376928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa1819bda0 0x7faa1819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.062+0000 7faa1e85e700 1 --2- 172.21.15.81:0/3473376928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa18101110 0x7faa18197510 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.062+0000 7faa1e85e700 1 --2- 172.21.15.81:0/3473376928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7faa18106230 0x7faa18197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.062+0000 7faa1e85e700 1 -- 172.21.15.81:0/3473376928 >> 172.21.15.81:0/3473376928 conn(0x7faa180fc9b0 msgr2=0x7faa180fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:10.062 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.062+0000 7faa1e85e700 1 -- 172.21.15.81:0/3473376928 shutdown_connections 2024-05-09T00:14:10.063 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:10.062+0000 7faa1e85e700 1 -- 172.21.15.81:0/3473376928 wait complete. 2024-05-09T00:14:11.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:10 smithi150 ceph-mon[46187]: pgmap v348: 97 pgs: 97 active+clean; 5.5 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 110 KiB/s wr, 37 op/s 2024-05-09T00:14:11.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:14:11.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:11.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:10 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:14:11.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:10 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:14:11.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:10 smithi171 ceph-mon[47351]: pgmap v348: 97 pgs: 97 active+clean; 5.5 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 110 KiB/s wr, 37 op/s 2024-05-09T00:14:11.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:14:11.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:11.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:10 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:14:11.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:10 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:14:11.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:10 smithi081 ceph-mon[42474]: pgmap v348: 97 pgs: 97 active+clean; 5.5 MiB data, 449 MiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 110 KiB/s wr, 37 op/s 2024-05-09T00:14:11.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:14:11.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:14:11.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:10 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:14:11.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:10 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:14:13.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:12 smithi150 ceph-mon[46187]: pgmap v349: 97 pgs: 97 active+clean; 5.7 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 100 KiB/s wr, 33 op/s 2024-05-09T00:14:13.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:12 smithi150 ceph-mon[46187]: osdmap e93: 12 total, 12 up, 12 in 2024-05-09T00:14:13.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:12 smithi171 ceph-mon[47351]: pgmap v349: 97 pgs: 97 active+clean; 5.7 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 100 KiB/s wr, 33 op/s 2024-05-09T00:14:13.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:12 smithi171 ceph-mon[47351]: osdmap e93: 12 total, 12 up, 12 in 2024-05-09T00:14:13.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:12 smithi081 ceph-mon[42474]: pgmap v349: 97 pgs: 97 active+clean; 5.7 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 100 KiB/s wr, 33 op/s 2024-05-09T00:14:13.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:12 smithi081 ceph-mon[42474]: osdmap e93: 12 total, 12 up, 12 in 2024-05-09T00:14:15.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:14 smithi150 ceph-mon[46187]: pgmap v351: 97 pgs: 97 active+clean; 5.7 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 123 KiB/s wr, 40 op/s 2024-05-09T00:14:15.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:14 smithi171 ceph-mon[47351]: pgmap v351: 97 pgs: 97 active+clean; 5.7 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 123 KiB/s wr, 40 op/s 2024-05-09T00:14:15.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:14 smithi081 ceph-mon[42474]: pgmap v351: 97 pgs: 97 active+clean; 5.7 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 123 KiB/s wr, 40 op/s 2024-05-09T00:14:17.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:16 smithi150 ceph-mon[46187]: pgmap v352: 97 pgs: 97 active+clean; 1.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-05-09T00:14:17.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:16 smithi171 ceph-mon[47351]: pgmap v352: 97 pgs: 97 active+clean; 1.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-05-09T00:14:17.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:16 smithi081 ceph-mon[42474]: pgmap v352: 97 pgs: 97 active+clean; 1.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-05-09T00:14:19.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:18 smithi150 ceph-mon[46187]: pgmap v353: 97 pgs: 97 active+clean; 1.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-05-09T00:14:19.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:18 smithi171 ceph-mon[47351]: pgmap v353: 97 pgs: 97 active+clean; 1.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-05-09T00:14:19.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:18 smithi081 ceph-mon[42474]: pgmap v353: 97 pgs: 97 active+clean; 1.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-05-09T00:14:21.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:20 smithi150 ceph-mon[46187]: pgmap v354: 97 pgs: 97 active+clean; 1.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-05-09T00:14:21.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:20 smithi171 ceph-mon[47351]: pgmap v354: 97 pgs: 97 active+clean; 1.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-05-09T00:14:21.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:20 smithi081 ceph-mon[42474]: pgmap v354: 97 pgs: 97 active+clean; 1.9 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-05-09T00:14:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.180+0000 7f24567a3700 1 -- 172.21.15.81:0/1608707407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450105e60 msgr2=0x7f2450106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.180+0000 7f24567a3700 1 --2- 172.21.15.81:0/1608707407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450105e60 0x7f2450106240 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f2440009990 tx=0x7f2440009ca0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.180+0000 7f24567a3700 1 -- 172.21.15.81:0/1608707407 shutdown_connections 2024-05-09T00:14:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.180+0000 7f24567a3700 1 --2- 172.21.15.81:0/1608707407 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2450100760 0x7f245010cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.180+0000 7f24567a3700 1 --2- 172.21.15.81:0/1608707407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450105e60 0x7f2450106240 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.180+0000 7f24567a3700 1 --2- 172.21.15.81:0/1608707407 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f24500ffda0 0x7f2450100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.180+0000 7f24567a3700 1 -- 172.21.15.81:0/1608707407 >> 172.21.15.81:0/1608707407 conn(0x7f2450076f10 msgr2=0x7f2450077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.180+0000 7f24567a3700 1 -- 172.21.15.81:0/1608707407 shutdown_connections 2024-05-09T00:14:23.180 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.180+0000 7f24567a3700 1 -- 172.21.15.81:0/1608707407 wait complete. 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f24567a3700 1 Processor -- start 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f24567a3700 1 -- start start 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f24567a3700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24500ffda0 0x7f24501980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f24567a3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2450100760 0x7f2450198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f24567a3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450105e60 0x7f24501a3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f24567a3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2450198e80 con 0x7f2450105e60 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f24567a3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24501a3690 con 0x7f2450100760 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f24567a3700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24501a37d0 con 0x7f24500ffda0 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f2454d40700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450105e60 0x7f24501a3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f2454d40700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450105e60 0x7f24501a3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32998/0 (socket says 172.21.15.81:32998) 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f2454d40700 1 -- 172.21.15.81:0/107673797 learned_addr learned my addr 172.21.15.81:0/107673797 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f2447fff700 1 --2- 172.21.15.81:0/107673797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2450100760 0x7f2450198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f244ffff700 1 --2- 172.21.15.81:0/107673797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24500ffda0 0x7f24501980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f2454d40700 1 -- 172.21.15.81:0/107673797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24500ffda0 msgr2=0x7f24501980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:23.181 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f2454d40700 1 --2- 172.21.15.81:0/107673797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24500ffda0 0x7f24501980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f2454d40700 1 -- 172.21.15.81:0/107673797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2450100760 msgr2=0x7f2450198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f2454d40700 1 --2- 172.21.15.81:0/107673797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2450100760 0x7f2450198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f2454d40700 1 -- 172.21.15.81:0/107673797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24400095f0 con 0x7f2450105e60 2024-05-09T00:14:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.181+0000 7f2454d40700 1 --2- 172.21.15.81:0/107673797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450105e60 0x7f24501a3150 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f2448007ee0 tx=0x7f244800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.182+0000 7f244dffb700 1 -- 172.21.15.81:0/107673797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448017070 con 0x7f2450105e60 2024-05-09T00:14:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.182+0000 7f244dffb700 1 -- 172.21.15.81:0/107673797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f244800f040 con 0x7f2450105e60 2024-05-09T00:14:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.182+0000 7f24567a3700 1 -- 172.21.15.81:0/107673797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24501a3a60 con 0x7f2450105e60 2024-05-09T00:14:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.182+0000 7f244dffb700 1 -- 172.21.15.81:0/107673797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448005740 con 0x7f2450105e60 2024-05-09T00:14:23.182 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.182+0000 7f24567a3700 1 -- 172.21.15.81:0/107673797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24501a3f70 con 0x7f2450105e60 2024-05-09T00:14:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.184+0000 7f244dffb700 1 -- 172.21.15.81:0/107673797 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f244800dc60 con 0x7f2450105e60 2024-05-09T00:14:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.185+0000 7f244dffb700 1 --2- 172.21.15.81:0/107673797 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f243c0a1310 0x7f243c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.185+0000 7f244dffb700 1 -- 172.21.15.81:0/107673797 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f24480cc490 con 0x7f2450105e60 2024-05-09T00:14:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.185+0000 7f244ffff700 1 --2- 172.21.15.81:0/107673797 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f243c0a1310 0x7f243c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.185+0000 7f244ffff700 1 --2- 172.21.15.81:0/107673797 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f243c0a1310 0x7f243c0a37d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2440005850 tx=0x7f244001a040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f246295db80 1 Processor -- start 2024-05-09T00:14:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f246295db80 1 -- start start 2024-05-09T00:14:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f246295db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76540 0x55b863f76920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.185 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f246295db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f76e60 0x55b863f7a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f246295db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f7ae40 0x55b863f7b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f246295db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b863ec90f0 con 0x55b863f76540 2024-05-09T00:14:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f246295db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b863ec6ab0 con 0x55b863f7ae40 2024-05-09T00:14:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f246295db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b863ec23a0 con 0x55b863f76e60 2024-05-09T00:14:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f244ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76540 0x55b863f76920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f244ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76540 0x55b863f76920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33012/0 (socket says 172.21.15.81:33012) 2024-05-09T00:14:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f244ffff700 1 -- 172.21.15.81:0/99746105 learned_addr learned my addr 172.21.15.81:0/99746105 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f2454d40700 1 --2- 172.21.15.81:0/99746105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f7ae40 0x55b863f7b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f2447fff700 1 --2- 172.21.15.81:0/99746105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f76e60 0x55b863f7a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f244ffff700 1 -- 172.21.15.81:0/99746105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f76e60 msgr2=0x55b863f7a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f244ffff700 1 --2- 172.21.15.81:0/99746105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f76e60 0x55b863f7a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f244ffff700 1 -- 172.21.15.81:0/99746105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f7ae40 msgr2=0x55b863f7b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f244ffff700 1 --2- 172.21.15.81:0/99746105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f7ae40 0x55b863f7b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.186 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f244ffff700 1 -- 172.21.15.81:0/99746105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b863d43350 con 0x55b863f76540 2024-05-09T00:14:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f2447fff700 1 --2- 172.21.15.81:0/99746105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f76e60 0x55b863f7a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.186+0000 7f244ffff700 1 --2- 172.21.15.81:0/99746105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76540 0x55b863f76920 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f244000b7d0 tx=0x7f244001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c149275dce4d9047 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.187+0000 7f24467fc700 1 -- 172.21.15.81:0/99746105 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244002a070 con 0x55b863f76540 2024-05-09T00:14:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.187+0000 7f24467fc700 1 -- 172.21.15.81:0/99746105 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f244000bae0 con 0x55b863f76540 2024-05-09T00:14:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.187+0000 7f24467fc700 1 -- 172.21.15.81:0/99746105 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244001d040 con 0x55b863f76540 2024-05-09T00:14:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.187+0000 7f246295db80 1 -- 172.21.15.81:0/99746105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76540 msgr2=0x55b863f76920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.187+0000 7f246295db80 1 --2- 172.21.15.81:0/99746105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76540 0x55b863f76920 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f244000b7d0 tx=0x7f244001e000 comp rx=0 tx=0).stop 2024-05-09T00:14:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.187+0000 7f246295db80 1 -- 172.21.15.81:0/99746105 shutdown_connections 2024-05-09T00:14:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.187+0000 7f246295db80 1 --2- 172.21.15.81:0/99746105 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f7ae40 0x55b863f7b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.187+0000 7f246295db80 1 --2- 172.21.15.81:0/99746105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76540 0x55b863f76920 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.187+0000 7f246295db80 1 --2- 172.21.15.81:0/99746105 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f76e60 0x55b863f7a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.187+0000 7f246295db80 1 -- 172.21.15.81:0/99746105 >> 172.21.15.81:0/99746105 conn(0x55b863ed01b0 msgr2=0x55b863f6c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.187+0000 7f246295db80 1 -- 172.21.15.81:0/99746105 shutdown_connections 2024-05-09T00:14:23.187 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.187+0000 7f246295db80 1 -- 172.21.15.81:0/99746105 wait complete. 2024-05-09T00:14:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.188+0000 7f246295db80 1 -- start start 2024-05-09T00:14:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.188+0000 7f246295db80 1 Processor -- start 2024-05-09T00:14:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.188+0000 7f246295db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f76540 0x55b863f825e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.188+0000 7f246295db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76e60 0x55b863f7f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.188+0000 7f246295db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f7ae40 0x55b863f7ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.191 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.188+0000 7f246295db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b863e5e500 con 0x55b863f76e60 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.188+0000 7f246295db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b863e5e1a0 con 0x55b863f76540 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.188+0000 7f246295db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b863d45640 con 0x55b863f7ae40 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.188+0000 7f246295db80 10 client.0 _ll_register_callbacks cb 0x55b863e67ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.188+0000 7f2447fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76e60 0x55b863f7f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.188+0000 7f2447fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76e60 0x55b863f7f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33022/0 (socket says 172.21.15.81:33022) 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.188+0000 7f2447fff700 1 -- 172.21.15.81:0/1110221914 learned_addr learned my addr 172.21.15.81:0/1110221914 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.188+0000 7f244ffff700 1 --2- 172.21.15.81:0/1110221914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f76540 0x55b863f825e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f2454d40700 1 --2- 172.21.15.81:0/1110221914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f7ae40 0x55b863f7ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f2447fff700 1 -- 172.21.15.81:0/1110221914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f7ae40 msgr2=0x55b863f7ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f2447fff700 1 --2- 172.21.15.81:0/1110221914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f7ae40 0x55b863f7ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f2447fff700 1 -- 172.21.15.81:0/1110221914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f76540 msgr2=0x55b863f825e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f2447fff700 1 --2- 172.21.15.81:0/1110221914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f76540 0x55b863f825e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f2447fff700 1 -- 172.21.15.81:0/1110221914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245010d4f0 con 0x55b863f76e60 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f2447fff700 1 --2- 172.21.15.81:0/1110221914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76e60 0x55b863f7f8d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f243800bb40 tx=0x7f243800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0ec56c574f697f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:23.192 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f242f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f242f7fe700 1 -- 172.21.15.81:0/1110221914 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438004110 con 0x55b863f76e60 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f242f7fe700 1 -- 172.21.15.81:0/1110221914 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f243801b440 con 0x55b863f76e60 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f246295db80 1 -- 172.21.15.81:0/1110221914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b863e1b210 con 0x55b863f76e60 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f242f7fe700 1 -- 172.21.15.81:0/1110221914 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f243801b600 con 0x55b863f76e60 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f246295db80 10 client.18693 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f246295db80 1 -- 172.21.15.81:0/1110221914 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b863cefb00 con 0x55b863f76e60 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f242f7fe700 1 -- 172.21.15.81:0/1110221914 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b863e1b210 con 0x55b863f76e60 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f242f7fe700 1 -- 172.21.15.81:0/1110221914 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2438011930 con 0x55b863f76e60 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.189+0000 7f246295db80 10 client.18693 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.190+0000 7f246295db80 10 client.18693 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.190+0000 7f246295db80 20 client.18693 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.190+0000 7f246295db80 1 --2- 172.21.15.81:0/1110221914 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b863f8ff70 0x55b863f92390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.190+0000 7f246295db80 4 client.18693 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.190+0000 7f246295db80 1 -- 172.21.15.81:0/1110221914 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b863f417b0 con 0x55b863f8ff70 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.190+0000 7f244ffff700 1 --2- 172.21.15.81:0/1110221914 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b863f8ff70 0x55b863f92390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.193 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.190+0000 7f244ffff700 1 --2- 172.21.15.81:0/1110221914 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b863f8ff70 0x55b863f92390 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e4b0ca7c92c5359 server_cookie=a79e0367cf6dab8a in_seq=0 out_seq=0 2024-05-09T00:14:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.190+0000 7f242f7fe700 10 client.18693 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f242f7fe700 1 -- 172.21.15.81:0/1110221914 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b863f417b0 con 0x55b863f8ff70 2024-05-09T00:14:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f242f7fe700 10 client.18693 handle_command_reply: tid=0 2024-05-09T00:14:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f246295db80 1 client.18693 shutdown 2024-05-09T00:14:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f246295db80 1 -- 172.21.15.81:0/1110221914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76e60 msgr2=0x55b863f7f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f246295db80 1 --2- 172.21.15.81:0/1110221914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76e60 0x55b863f7f8d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f243800bb40 tx=0x7f243800be50 comp rx=0 tx=0).stop 2024-05-09T00:14:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f246295db80 1 -- 172.21.15.81:0/1110221914 shutdown_connections 2024-05-09T00:14:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f246295db80 1 --2- 172.21.15.81:0/1110221914 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b863f8ff70 0x55b863f92390 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f246295db80 1 --2- 172.21.15.81:0/1110221914 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f76540 0x55b863f825e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f246295db80 1 --2- 172.21.15.81:0/1110221914 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f7ae40 0x55b863f7ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f242f7fe700 0 client.18693 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f246295db80 1 --2- 172.21.15.81:0/1110221914 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76e60 0x55b863f7f8d0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f246295db80 1 -- 172.21.15.81:0/1110221914 >> 172.21.15.81:0/1110221914 conn(0x55b863ed01b0 msgr2=0x55b863f70f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:23.194 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f246295db80 1 -- 172.21.15.81:0/1110221914 shutdown_connections 2024-05-09T00:14:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f246295db80 1 -- 172.21.15.81:0/1110221914 wait complete. 2024-05-09T00:14:23.195 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.191+0000 7f246295db80 20 client.18693 trim_cache size 0 max 16384 2024-05-09T00:14:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.206+0000 7f246295db80 1 Processor -- start 2024-05-09T00:14:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.206+0000 7f246295db80 1 -- start start 2024-05-09T00:14:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.206+0000 7f246295db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f76540 0x55b863f6c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.206+0000 7f246295db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76e60 0x55b863f7c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.206+0000 7f246295db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f7ae40 0x55b863f86f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.206+0000 7f246295db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b863f677c0 con 0x55b863f76e60 2024-05-09T00:14:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.206+0000 7f246295db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b863f699b0 con 0x55b863f76540 2024-05-09T00:14:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.206+0000 7f246295db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b863f8d670 con 0x55b863f7ae40 2024-05-09T00:14:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.207+0000 7f2447fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76e60 0x55b863f7c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.206 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.207+0000 7f2447fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76e60 0x55b863f7c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33034/0 (socket says 172.21.15.81:33034) 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.207+0000 7f2447fff700 1 -- 172.21.15.81:0/982435039 learned_addr learned my addr 172.21.15.81:0/982435039 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.207+0000 7f244ffff700 1 --2- 172.21.15.81:0/982435039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f76540 0x55b863f6c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.207+0000 7f2454d40700 1 --2- 172.21.15.81:0/982435039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f7ae40 0x55b863f86f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.207+0000 7f2447fff700 1 -- 172.21.15.81:0/982435039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f7ae40 msgr2=0x55b863f86f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.207+0000 7f2447fff700 1 --2- 172.21.15.81:0/982435039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f7ae40 0x55b863f86f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.207+0000 7f2447fff700 1 -- 172.21.15.81:0/982435039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f76540 msgr2=0x55b863f6c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.207+0000 7f2447fff700 1 --2- 172.21.15.81:0/982435039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f76540 0x55b863f6c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.207+0000 7f2447fff700 1 -- 172.21.15.81:0/982435039 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b863e88500 con 0x55b863f76e60 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.207+0000 7f2447fff700 1 --2- 172.21.15.81:0/982435039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76e60 0x55b863f7c230 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f2438000c00 tx=0x7f2438004170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf19f454858af0c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.207+0000 7f2446ffd700 1 -- 172.21.15.81:0/982435039 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438011440 con 0x55b863f76e60 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.207+0000 7f2446ffd700 1 -- 172.21.15.81:0/982435039 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2438011a60 con 0x55b863f76e60 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.207+0000 7f2446ffd700 1 -- 172.21.15.81:0/982435039 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438004640 con 0x55b863f76e60 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.208+0000 7f246295db80 1 -- 172.21.15.81:0/982435039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76e60 msgr2=0x55b863f7c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.208+0000 7f246295db80 1 --2- 172.21.15.81:0/982435039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76e60 0x55b863f7c230 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f2438000c00 tx=0x7f2438004170 comp rx=0 tx=0).stop 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.208+0000 7f246295db80 1 -- 172.21.15.81:0/982435039 shutdown_connections 2024-05-09T00:14:23.207 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.208+0000 7f246295db80 1 --2- 172.21.15.81:0/982435039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f76540 0x55b863f6c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.208+0000 7f246295db80 1 --2- 172.21.15.81:0/982435039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f7ae40 0x55b863f86f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.208+0000 7f246295db80 1 --2- 172.21.15.81:0/982435039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76e60 0x55b863f7c230 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.208+0000 7f246295db80 1 -- 172.21.15.81:0/982435039 >> 172.21.15.81:0/982435039 conn(0x55b863ed01b0 msgr2=0x55b863f70f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.208+0000 7f246295db80 1 -- 172.21.15.81:0/982435039 shutdown_connections 2024-05-09T00:14:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.208+0000 7f246295db80 1 -- 172.21.15.81:0/982435039 wait complete. 2024-05-09T00:14:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.208+0000 7f246295db80 1 -- start start 2024-05-09T00:14:23.208 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.208+0000 7f246295db80 1 Processor -- start 2024-05-09T00:14:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f246295db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76540 0x55b863f82f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f246295db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f76e60 0x55b863f83490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f246295db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f7ae40 0x55b863f839d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f246295db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b863fe5590 con 0x55b863f76540 2024-05-09T00:14:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f246295db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b863fe5700 con 0x55b863f7ae40 2024-05-09T00:14:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f246295db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b863fe58c0 con 0x55b863f76e60 2024-05-09T00:14:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f246295db80 10 client.0 _ll_register_callbacks cb 0x55b863e67ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f244ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76540 0x55b863f82f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f244ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76540 0x55b863f82f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33044/0 (socket says 172.21.15.81:33044) 2024-05-09T00:14:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f244ffff700 1 -- 172.21.15.81:0/4010697353 learned_addr learned my addr 172.21.15.81:0/4010697353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f2454d40700 1 --2- 172.21.15.81:0/4010697353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f7ae40 0x55b863f839d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f2447fff700 1 --2- 172.21.15.81:0/4010697353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f76e60 0x55b863f83490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f244ffff700 1 -- 172.21.15.81:0/4010697353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f76e60 msgr2=0x55b863f83490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f244ffff700 1 --2- 172.21.15.81:0/4010697353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f76e60 0x55b863f83490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f244ffff700 1 -- 172.21.15.81:0/4010697353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f7ae40 msgr2=0x55b863f839d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:23.211 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f244ffff700 1 --2- 172.21.15.81:0/4010697353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f7ae40 0x55b863f839d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f244ffff700 1 -- 172.21.15.81:0/4010697353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b863cefb00 con 0x55b863f76540 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f2454d40700 1 --2- 172.21.15.81:0/4010697353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f7ae40 0x55b863f839d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f244ffff700 1 --2- 172.21.15.81:0/4010697353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76540 0x55b863f82f50 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f2440009ce0 tx=0x7f2440005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6582b36eb99b19cf server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f242f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f242f7fe700 1 -- 172.21.15.81:0/4010697353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244001d040 con 0x55b863f76540 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f242f7fe700 1 -- 172.21.15.81:0/4010697353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f244003be40 con 0x55b863f76540 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.209+0000 7f246295db80 1 -- 172.21.15.81:0/4010697353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f244000bae0 con 0x55b863f76540 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.210+0000 7f242f7fe700 1 -- 172.21.15.81:0/4010697353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f244002a040 con 0x55b863f76540 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.210+0000 7f246295db80 10 client.18699 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.210+0000 7f246295db80 1 -- 172.21.15.81:0/4010697353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b863d47c70 con 0x55b863f76540 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.210+0000 7f242f7fe700 1 -- 172.21.15.81:0/4010697353 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f244000bae0 con 0x55b863f76540 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.210+0000 7f242f7fe700 1 -- 172.21.15.81:0/4010697353 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f244000f580 con 0x55b863f76540 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.210+0000 7f246295db80 10 client.18699 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.210+0000 7f246295db80 10 client.18699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.210+0000 7f246295db80 20 client.18699 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:23.212 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.210+0000 7f246295db80 1 --2- 172.21.15.81:0/4010697353 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b863fe6c40 0x55b863fe9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.210+0000 7f246295db80 4 client.18699 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:14:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.210+0000 7f246295db80 1 -- 172.21.15.81:0/4010697353 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b863ebae60 con 0x55b863fe6c40 2024-05-09T00:14:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.210+0000 7f2447fff700 1 --2- 172.21.15.81:0/4010697353 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b863fe6c40 0x55b863fe9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.210+0000 7f242f7fe700 10 client.18699 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:23.213 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.210+0000 7f2447fff700 1 --2- 172.21.15.81:0/4010697353 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b863fe6c40 0x55b863fe9060 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67b2b7e76dc65208 server_cookie=3fbca8f0f6fced57 in_seq=0 out_seq=0 2024-05-09T00:14:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f242f7fe700 1 -- 172.21.15.81:0/4010697353 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b863ebae60 con 0x55b863fe6c40 2024-05-09T00:14:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f242f7fe700 10 client.18699 handle_command_reply: tid=0 2024-05-09T00:14:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f246295db80 1 client.18699 shutdown 2024-05-09T00:14:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f246295db80 1 -- 172.21.15.81:0/4010697353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76540 msgr2=0x55b863f82f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f246295db80 1 --2- 172.21.15.81:0/4010697353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76540 0x55b863f82f50 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f2440009ce0 tx=0x7f2440005990 comp rx=0 tx=0).stop 2024-05-09T00:14:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f246295db80 1 -- 172.21.15.81:0/4010697353 shutdown_connections 2024-05-09T00:14:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f246295db80 1 --2- 172.21.15.81:0/4010697353 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b863fe6c40 0x55b863fe9060 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f246295db80 1 --2- 172.21.15.81:0/4010697353 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b863f7ae40 0x55b863f839d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f246295db80 1 --2- 172.21.15.81:0/4010697353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b863f76540 0x55b863f82f50 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f242f7fe700 0 client.18699 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f246295db80 1 --2- 172.21.15.81:0/4010697353 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b863f76e60 0x55b863f83490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f246295db80 1 -- 172.21.15.81:0/4010697353 >> 172.21.15.81:0/4010697353 conn(0x55b863ed01b0 msgr2=0x55b863f7d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f246295db80 1 -- 172.21.15.81:0/4010697353 shutdown_connections 2024-05-09T00:14:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f246295db80 1 -- 172.21.15.81:0/4010697353 wait complete. 2024-05-09T00:14:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.223+0000 7f246295db80 20 client.18699 trim_cache size 0 max 16384 2024-05-09T00:14:23.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:14:23.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:14:23.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:14:23.224 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:14:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.224+0000 7f24567a3700 1 -- 172.21.15.81:0/107673797 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f243c0a1310 msgr2=0x7f243c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.224+0000 7f24567a3700 1 --2- 172.21.15.81:0/107673797 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f243c0a1310 0x7f243c0a37d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2440005850 tx=0x7f244001a040 comp rx=0 tx=0).stop 2024-05-09T00:14:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.224+0000 7f24567a3700 1 -- 172.21.15.81:0/107673797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450105e60 msgr2=0x7f24501a3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.224+0000 7f24567a3700 1 --2- 172.21.15.81:0/107673797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450105e60 0x7f24501a3150 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f2448007ee0 tx=0x7f244800d3b0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.224+0000 7f24567a3700 1 -- 172.21.15.81:0/107673797 shutdown_connections 2024-05-09T00:14:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.224+0000 7f24567a3700 1 --2- 172.21.15.81:0/107673797 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f243c0a1310 0x7f243c0a37d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.224+0000 7f24567a3700 1 --2- 172.21.15.81:0/107673797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2450105e60 0x7f24501a3150 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.224+0000 7f24567a3700 1 --2- 172.21.15.81:0/107673797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f24500ffda0 0x7f24501980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.224+0000 7f24567a3700 1 --2- 172.21.15.81:0/107673797 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f2450100760 0x7f2450198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:23.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.224+0000 7f24567a3700 1 -- 172.21.15.81:0/107673797 >> 172.21.15.81:0/107673797 conn(0x7f2450076f10 msgr2=0x7f24500feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:23.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.224+0000 7f24567a3700 1 -- 172.21.15.81:0/107673797 shutdown_connections 2024-05-09T00:14:23.226 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:23.224+0000 7f24567a3700 1 -- 172.21.15.81:0/107673797 wait complete. 2024-05-09T00:14:23.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:22 smithi150 ceph-mon[46187]: pgmap v355: 97 pgs: 97 active+clean; 2.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-05-09T00:14:23.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:22 smithi171 ceph-mon[47351]: pgmap v355: 97 pgs: 97 active+clean; 2.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-05-09T00:14:23.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:22 smithi081 ceph-mon[42474]: pgmap v355: 97 pgs: 97 active+clean; 2.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-05-09T00:14:25.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:24 smithi150 ceph-mon[46187]: pgmap v356: 97 pgs: 97 active+clean; 2.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 52 KiB/s wr, 14 op/s 2024-05-09T00:14:25.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:24 smithi171 ceph-mon[47351]: pgmap v356: 97 pgs: 97 active+clean; 2.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 52 KiB/s wr, 14 op/s 2024-05-09T00:14:25.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:24 smithi081 ceph-mon[42474]: pgmap v356: 97 pgs: 97 active+clean; 2.1 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 52 KiB/s wr, 14 op/s 2024-05-09T00:14:27.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:26 smithi150 ceph-mon[46187]: pgmap v357: 97 pgs: 97 active+clean; 2.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-05-09T00:14:27.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:26 smithi171 ceph-mon[47351]: pgmap v357: 97 pgs: 97 active+clean; 2.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-05-09T00:14:27.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:26 smithi081 ceph-mon[42474]: pgmap v357: 97 pgs: 97 active+clean; 2.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 67 KiB/s wr, 20 op/s 2024-05-09T00:14:28.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:14:28.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.146+0000 7fe717620700 1 -- 172.21.15.81:0/316395139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe710105e60 msgr2=0x7fe7100691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.146+0000 7fe717620700 1 --2- 172.21.15.81:0/316395139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe710105e60 0x7fe7100691b0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fe70000b0a0 tx=0x7fe70000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.146+0000 7fe717620700 1 -- 172.21.15.81:0/316395139 shutdown_connections 2024-05-09T00:14:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.146+0000 7fe717620700 1 --2- 172.21.15.81:0/316395139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe710103960 0x7fe710103de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.146+0000 7fe717620700 1 --2- 172.21.15.81:0/316395139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe710105e60 0x7fe7100691b0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.146+0000 7fe717620700 1 --2- 172.21.15.81:0/316395139 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe7101062d0 0x7fe7100696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.146+0000 7fe717620700 1 -- 172.21.15.81:0/316395139 >> 172.21.15.81:0/316395139 conn(0x7fe710076ba0 msgr2=0x7fe710076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.146+0000 7fe717620700 1 -- 172.21.15.81:0/316395139 shutdown_connections 2024-05-09T00:14:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.146+0000 7fe717620700 1 -- 172.21.15.81:0/316395139 wait complete. 2024-05-09T00:14:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe717620700 1 Processor -- start 2024-05-09T00:14:28.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe717620700 1 -- start start 2024-05-09T00:14:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe717620700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe710103960 0x7fe7101a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe717620700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe710105e60 0x7fe7101a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe717620700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7101062d0 0x7fe71019d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe717620700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71019df20 con 0x7fe7101062d0 2024-05-09T00:14:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe717620700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71019e090 con 0x7fe710103960 2024-05-09T00:14:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe717620700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe71019e250 con 0x7fe710105e60 2024-05-09T00:14:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe715bbd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7101062d0 0x7fe71019d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe714bbb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe710105e60 0x7fe7101a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe715bbd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7101062d0 0x7fe71019d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39214/0 (socket says 172.21.15.81:39214) 2024-05-09T00:14:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe715bbd700 1 -- 172.21.15.81:0/2879269089 learned_addr learned my addr 172.21.15.81:0/2879269089 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe7153bc700 1 --2- 172.21.15.81:0/2879269089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe710103960 0x7fe7101a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe715bbd700 1 -- 172.21.15.81:0/2879269089 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe710105e60 msgr2=0x7fe7101a3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe715bbd700 1 --2- 172.21.15.81:0/2879269089 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe710105e60 0x7fe7101a3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe715bbd700 1 -- 172.21.15.81:0/2879269089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe710103960 msgr2=0x7fe7101a36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe715bbd700 1 --2- 172.21.15.81:0/2879269089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe710103960 0x7fe7101a36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe715bbd700 1 -- 172.21.15.81:0/2879269089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe700009d00 con 0x7fe7101062d0 2024-05-09T00:14:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.147+0000 7fe7153bc700 1 --2- 172.21.15.81:0/2879269089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe710103960 0x7fe7101a36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.148+0000 7fe715bbd700 1 --2- 172.21.15.81:0/2879269089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7101062d0 0x7fe71019d750 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fe70800c900 tx=0x7fe70800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.148+0000 7fe70e7fc700 1 -- 172.21.15.81:0/2879269089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708007b00 con 0x7fe7101062d0 2024-05-09T00:14:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.148+0000 7fe70e7fc700 1 -- 172.21.15.81:0/2879269089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe70800ce50 con 0x7fe7101062d0 2024-05-09T00:14:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.148+0000 7fe717620700 1 -- 172.21.15.81:0/2879269089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe71019e530 con 0x7fe7101062d0 2024-05-09T00:14:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.148+0000 7fe70e7fc700 1 -- 172.21.15.81:0/2879269089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708018660 con 0x7fe7101062d0 2024-05-09T00:14:28.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.148+0000 7fe717620700 1 -- 172.21.15.81:0/2879269089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7101aa630 con 0x7fe7101062d0 2024-05-09T00:14:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.150+0000 7fe70e7fc700 1 -- 172.21.15.81:0/2879269089 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe70800f450 con 0x7fe7101062d0 2024-05-09T00:14:28.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.150+0000 7fe70e7fc700 1 --2- 172.21.15.81:0/2879269089 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6f80a1310 0x7fe6f80a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.150+0000 7fe7153bc700 1 --2- 172.21.15.81:0/2879269089 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6f80a1310 0x7fe6f80a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.151+0000 7fe70e7fc700 1 -- 172.21.15.81:0/2879269089 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe7080cccd0 con 0x7fe7101062d0 2024-05-09T00:14:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.151+0000 7fe7153bc700 1 --2- 172.21.15.81:0/2879269089 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6f80a1310 0x7fe6f80a37d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe70000b830 tx=0x7fe7000090d0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe7237dab80 1 Processor -- start 2024-05-09T00:14:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe7237dab80 1 -- start start 2024-05-09T00:14:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe7237dab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6bde00 0x55b27e6be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe7237dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6be720 0x55b27e6b8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe7237dab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6b8890 0x55b27e6b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe7237dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27e60f150 con 0x55b27e6be720 2024-05-09T00:14:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe7237dab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27e60cb10 con 0x55b27e6b8890 2024-05-09T00:14:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe7237dab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27e608400 con 0x55b27e6bde00 2024-05-09T00:14:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe714bbb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6be720 0x55b27e6b8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe714bbb700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6be720 0x55b27e6b8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39218/0 (socket says 172.21.15.81:39218) 2024-05-09T00:14:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe714bbb700 1 -- 172.21.15.81:0/810222230 learned_addr learned my addr 172.21.15.81:0/810222230 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe715bbd700 1 --2- 172.21.15.81:0/810222230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6b8890 0x55b27e6b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe7153bc700 1 --2- 172.21.15.81:0/810222230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6bde00 0x55b27e6be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe714bbb700 1 -- 172.21.15.81:0/810222230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6bde00 msgr2=0x55b27e6be1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe714bbb700 1 --2- 172.21.15.81:0/810222230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6bde00 0x55b27e6be1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe714bbb700 1 -- 172.21.15.81:0/810222230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6b8890 msgr2=0x55b27e6b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe714bbb700 1 --2- 172.21.15.81:0/810222230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6b8890 0x55b27e6b8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.152+0000 7fe714bbb700 1 -- 172.21.15.81:0/810222230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b27e4893b0 con 0x55b27e6be720 2024-05-09T00:14:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.153+0000 7fe714bbb700 1 --2- 172.21.15.81:0/810222230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6be720 0x55b27e6b8350 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fe70400bc70 tx=0x7fe70400bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fc0426c6fe3e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.153+0000 7fe6f77fe700 1 -- 172.21.15.81:0/810222230 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704010be0 con 0x55b27e6be720 2024-05-09T00:14:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.153+0000 7fe6f77fe700 1 -- 172.21.15.81:0/810222230 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe704015070 con 0x55b27e6be720 2024-05-09T00:14:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.153+0000 7fe6f77fe700 1 -- 172.21.15.81:0/810222230 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704005020 con 0x55b27e6be720 2024-05-09T00:14:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.153+0000 7fe7237dab80 1 -- 172.21.15.81:0/810222230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6be720 msgr2=0x55b27e6b8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.153+0000 7fe7237dab80 1 --2- 172.21.15.81:0/810222230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6be720 0x55b27e6b8350 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fe70400bc70 tx=0x7fe70400bf80 comp rx=0 tx=0).stop 2024-05-09T00:14:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.153+0000 7fe7237dab80 1 -- 172.21.15.81:0/810222230 shutdown_connections 2024-05-09T00:14:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.153+0000 7fe7237dab80 1 --2- 172.21.15.81:0/810222230 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6b8890 0x55b27e6b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.153+0000 7fe7237dab80 1 --2- 172.21.15.81:0/810222230 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6bde00 0x55b27e6be1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.153+0000 7fe7237dab80 1 --2- 172.21.15.81:0/810222230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6be720 0x55b27e6b8350 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7237dab80 1 -- 172.21.15.81:0/810222230 >> 172.21.15.81:0/810222230 conn(0x55b27e616210 msgr2=0x55b27e6b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7237dab80 1 -- 172.21.15.81:0/810222230 shutdown_connections 2024-05-09T00:14:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7237dab80 1 -- 172.21.15.81:0/810222230 wait complete. 2024-05-09T00:14:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7237dab80 1 -- start start 2024-05-09T00:14:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7237dab80 1 Processor -- start 2024-05-09T00:14:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7237dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6b8890 0x55b27e6c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7237dab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6bde00 0x55b27e6c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7237dab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6be720 0x55b27e6c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7237dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27e5a4560 con 0x55b27e6b8890 2024-05-09T00:14:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7237dab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27e5a4200 con 0x55b27e6bde00 2024-05-09T00:14:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7237dab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27e48b6a0 con 0x55b27e6be720 2024-05-09T00:14:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7237dab80 10 client.0 _ll_register_callbacks cb 0x55b27e5adb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7153bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6b8890 0x55b27e6c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7153bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6b8890 0x55b27e6c1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39230/0 (socket says 172.21.15.81:39230) 2024-05-09T00:14:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.154+0000 7fe7153bc700 1 -- 172.21.15.81:0/1797593657 learned_addr learned my addr 172.21.15.81:0/1797593657 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe715bbd700 1 --2- 172.21.15.81:0/1797593657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6be720 0x55b27e6c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe714bbb700 1 --2- 172.21.15.81:0/1797593657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6bde00 0x55b27e6c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe7153bc700 1 -- 172.21.15.81:0/1797593657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6be720 msgr2=0x55b27e6c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe7153bc700 1 --2- 172.21.15.81:0/1797593657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6be720 0x55b27e6c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe7153bc700 1 -- 172.21.15.81:0/1797593657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6bde00 msgr2=0x55b27e6c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe7153bc700 1 --2- 172.21.15.81:0/1797593657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6bde00 0x55b27e6c1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe7153bc700 1 -- 172.21.15.81:0/1797593657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70400b8a0 con 0x55b27e6b8890 2024-05-09T00:14:28.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe715bbd700 1 --2- 172.21.15.81:0/1797593657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6be720 0x55b27e6c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe7153bc700 1 --2- 172.21.15.81:0/1797593657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6b8890 0x55b27e6c1ab0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fe700007760 tx=0x7fe7000099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1c006a14511a5f server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe6f4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe6f4ff9700 1 -- 172.21.15.81:0/1797593657 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700005550 con 0x55b27e6b8890 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe6f4ff9700 1 -- 172.21.15.81:0/1797593657 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe700023070 con 0x55b27e6b8890 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe7237dab80 1 -- 172.21.15.81:0/1797593657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b27e561270 con 0x55b27e6b8890 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe6f4ff9700 1 -- 172.21.15.81:0/1797593657 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7000056b0 con 0x55b27e6b8890 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe7237dab80 10 client.18711 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe7237dab80 1 -- 172.21.15.81:0/1797593657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b27e435b60 con 0x55b27e6b8890 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.155+0000 7fe6f4ff9700 1 -- 172.21.15.81:0/1797593657 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b27e561270 con 0x55b27e6b8890 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.156+0000 7fe6f4ff9700 1 -- 172.21.15.81:0/1797593657 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe700029400 con 0x55b27e6b8890 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.156+0000 7fe7237dab80 10 client.18711 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.156+0000 7fe7237dab80 10 client.18711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.156+0000 7fe7237dab80 20 client.18711 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.156+0000 7fe7237dab80 1 --2- 172.21.15.81:0/1797593657 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b27e6d2070 0x55b27e6d4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.156+0000 7fe7237dab80 4 client.18711 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:14:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.156+0000 7fe7237dab80 1 -- 172.21.15.81:0/1797593657 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b27e687810 con 0x55b27e6d2070 2024-05-09T00:14:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.156+0000 7fe714bbb700 1 --2- 172.21.15.81:0/1797593657 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b27e6d2070 0x55b27e6d4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.156+0000 7fe714bbb700 1 --2- 172.21.15.81:0/1797593657 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b27e6d2070 0x55b27e6d4490 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7733189f9a607f1e server_cookie=bd94c19d6c165fae in_seq=0 out_seq=0 2024-05-09T00:14:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.156+0000 7fe6f4ff9700 10 client.18711 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe6f4ff9700 1 -- 172.21.15.81:0/1797593657 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b27e687810 con 0x55b27e6d2070 2024-05-09T00:14:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe6f4ff9700 10 client.18711 handle_command_reply: tid=0 2024-05-09T00:14:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe7237dab80 1 client.18711 shutdown 2024-05-09T00:14:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe7237dab80 1 -- 172.21.15.81:0/1797593657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6b8890 msgr2=0x55b27e6c1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe7237dab80 1 --2- 172.21.15.81:0/1797593657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6b8890 0x55b27e6c1ab0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fe700007760 tx=0x7fe7000099e0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe7237dab80 1 -- 172.21.15.81:0/1797593657 shutdown_connections 2024-05-09T00:14:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe7237dab80 1 --2- 172.21.15.81:0/1797593657 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b27e6d2070 0x55b27e6d4490 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe7237dab80 1 --2- 172.21.15.81:0/1797593657 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6be720 0x55b27e6c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe6f4ff9700 0 client.18711 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe7237dab80 1 --2- 172.21.15.81:0/1797593657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6b8890 0x55b27e6c1ab0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe7237dab80 1 --2- 172.21.15.81:0/1797593657 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6bde00 0x55b27e6c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe7237dab80 1 -- 172.21.15.81:0/1797593657 >> 172.21.15.81:0/1797593657 conn(0x55b27e616210 msgr2=0x55b27e6b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe7237dab80 1 -- 172.21.15.81:0/1797593657 shutdown_connections 2024-05-09T00:14:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe7237dab80 1 -- 172.21.15.81:0/1797593657 wait complete. 2024-05-09T00:14:28.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.157+0000 7fe7237dab80 20 client.18711 trim_cache size 0 max 16384 2024-05-09T00:14:28.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe7237dab80 1 Processor -- start 2024-05-09T00:14:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe7237dab80 1 -- start start 2024-05-09T00:14:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe7237dab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6b8890 0x55b27e6b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe7237dab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6bde00 0x55b27e6bcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe7237dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6be720 0x55b27e6bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe7237dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27e6afdc0 con 0x55b27e6be720 2024-05-09T00:14:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe7237dab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27e6b4e50 con 0x55b27e6b8890 2024-05-09T00:14:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe7237dab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27e6b4640 con 0x55b27e6bde00 2024-05-09T00:14:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe715bbd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6be720 0x55b27e6bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe715bbd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6be720 0x55b27e6bd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39240/0 (socket says 172.21.15.81:39240) 2024-05-09T00:14:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe715bbd700 1 -- 172.21.15.81:0/3902363959 learned_addr learned my addr 172.21.15.81:0/3902363959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe7153bc700 1 --2- 172.21.15.81:0/3902363959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6b8890 0x55b27e6b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe714bbb700 1 --2- 172.21.15.81:0/3902363959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6bde00 0x55b27e6bcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe715bbd700 1 -- 172.21.15.81:0/3902363959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6bde00 msgr2=0x55b27e6bcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe715bbd700 1 --2- 172.21.15.81:0/3902363959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6bde00 0x55b27e6bcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe715bbd700 1 -- 172.21.15.81:0/3902363959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6b8890 msgr2=0x55b27e6b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe715bbd700 1 --2- 172.21.15.81:0/3902363959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6b8890 0x55b27e6b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.175+0000 7fe715bbd700 1 -- 172.21.15.81:0/3902363959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b27e5ce560 con 0x55b27e6be720 2024-05-09T00:14:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.176+0000 7fe715bbd700 1 --2- 172.21.15.81:0/3902363959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6be720 0x55b27e6bd0e0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe70800ffd0 tx=0x7fe708007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915ef4a59ca5c8ff server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.176+0000 7fe6f7fff700 1 -- 172.21.15.81:0/3902363959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70809db80 con 0x55b27e6be720 2024-05-09T00:14:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.176+0000 7fe6f7fff700 1 -- 172.21.15.81:0/3902363959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7080a21d0 con 0x55b27e6be720 2024-05-09T00:14:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.176+0000 7fe6f7fff700 1 -- 172.21.15.81:0/3902363959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708099fb0 con 0x55b27e6be720 2024-05-09T00:14:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.176+0000 7fe7237dab80 1 -- 172.21.15.81:0/3902363959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6be720 msgr2=0x55b27e6bd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.176+0000 7fe7237dab80 1 --2- 172.21.15.81:0/3902363959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6be720 0x55b27e6bd0e0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe70800ffd0 tx=0x7fe708007ce0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.176+0000 7fe7237dab80 1 -- 172.21.15.81:0/3902363959 shutdown_connections 2024-05-09T00:14:28.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.176+0000 7fe7237dab80 1 --2- 172.21.15.81:0/3902363959 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6b8890 0x55b27e6b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.176+0000 7fe7237dab80 1 --2- 172.21.15.81:0/3902363959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6be720 0x55b27e6bd0e0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.176+0000 7fe7237dab80 1 --2- 172.21.15.81:0/3902363959 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6bde00 0x55b27e6bcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.176+0000 7fe7237dab80 1 -- 172.21.15.81:0/3902363959 >> 172.21.15.81:0/3902363959 conn(0x55b27e616210 msgr2=0x55b27e6c23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.176+0000 7fe7237dab80 1 -- 172.21.15.81:0/3902363959 shutdown_connections 2024-05-09T00:14:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.176+0000 7fe7237dab80 1 -- 172.21.15.81:0/3902363959 wait complete. 2024-05-09T00:14:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.177+0000 7fe7237dab80 1 -- start start 2024-05-09T00:14:28.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.177+0000 7fe7237dab80 1 Processor -- start 2024-05-09T00:14:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.177+0000 7fe7237dab80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6b8890 0x55b27e6c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.177+0000 7fe7237dab80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6bde00 0x55b27e6c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.177+0000 7fe7237dab80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6be720 0x55b27e6c7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.177+0000 7fe7237dab80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27e6c7e60 con 0x55b27e6b8890 2024-05-09T00:14:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.177+0000 7fe7237dab80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27e6c7fd0 con 0x55b27e6be720 2024-05-09T00:14:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.177+0000 7fe7237dab80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27e6c8190 con 0x55b27e6bde00 2024-05-09T00:14:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.177+0000 7fe7237dab80 10 client.0 _ll_register_callbacks cb 0x55b27e5adb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.177+0000 7fe7153bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6b8890 0x55b27e6c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.177+0000 7fe7153bc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6b8890 0x55b27e6c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39248/0 (socket says 172.21.15.81:39248) 2024-05-09T00:14:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.177+0000 7fe7153bc700 1 -- 172.21.15.81:0/2782418264 learned_addr learned my addr 172.21.15.81:0/2782418264 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe715bbd700 1 --2- 172.21.15.81:0/2782418264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6be720 0x55b27e6c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7153bc700 1 -- 172.21.15.81:0/2782418264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6bde00 msgr2=0x55b27e6c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7153bc700 1 --2- 172.21.15.81:0/2782418264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6bde00 0x55b27e6c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7153bc700 1 -- 172.21.15.81:0/2782418264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6be720 msgr2=0x55b27e6c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7153bc700 1 --2- 172.21.15.81:0/2782418264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6be720 0x55b27e6c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7153bc700 1 -- 172.21.15.81:0/2782418264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7101aa630 con 0x55b27e6b8890 2024-05-09T00:14:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe715bbd700 1 --2- 172.21.15.81:0/2782418264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6be720 0x55b27e6c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7153bc700 1 --2- 172.21.15.81:0/2782418264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6b8890 0x55b27e6c9170 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe7000297b0 tx=0x7fe7000294b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1bc9f8986726 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe6f4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe6f4ff9700 1 -- 172.21.15.81:0/2782418264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700005820 con 0x55b27e6b8890 2024-05-09T00:14:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe6f4ff9700 1 -- 172.21.15.81:0/2782418264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe700023040 con 0x55b27e6b8890 2024-05-09T00:14:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7237dab80 1 -- 172.21.15.81:0/2782418264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe704015070 con 0x55b27e6b8890 2024-05-09T00:14:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe6f4ff9700 1 -- 172.21.15.81:0/2782418264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe700005980 con 0x55b27e6b8890 2024-05-09T00:14:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7237dab80 10 client.18717 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7237dab80 1 -- 172.21.15.81:0/2782418264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b27e48dcd0 con 0x55b27e6b8890 2024-05-09T00:14:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe6f4ff9700 1 -- 172.21.15.81:0/2782418264 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe704015070 con 0x55b27e6b8890 2024-05-09T00:14:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe6f4ff9700 1 -- 172.21.15.81:0/2782418264 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe700045070 con 0x55b27e6b8890 2024-05-09T00:14:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7237dab80 10 client.18717 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7237dab80 10 client.18717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:14:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7237dab80 20 client.18717 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7237dab80 1 --2- 172.21.15.81:0/2782418264 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b27e729440 0x55b27e72b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7237dab80 4 client.18717 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:14:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.178+0000 7fe7237dab80 1 -- 172.21.15.81:0/2782418264 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b27e600ec0 con 0x55b27e729440 2024-05-09T00:14:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe714bbb700 1 --2- 172.21.15.81:0/2782418264 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b27e729440 0x55b27e72b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe6f4ff9700 10 client.18717 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe714bbb700 1 --2- 172.21.15.81:0/2782418264 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b27e729440 0x55b27e72b860 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48cac213cbed6566 server_cookie=f6def01771513ca8 in_seq=0 out_seq=0 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe6f4ff9700 1 -- 172.21.15.81:0/2782418264 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b27e600ec0 con 0x55b27e729440 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe6f4ff9700 10 client.18717 handle_command_reply: tid=0 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe7237dab80 1 client.18717 shutdown 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe7237dab80 1 -- 172.21.15.81:0/2782418264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6b8890 msgr2=0x55b27e6c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe7237dab80 1 --2- 172.21.15.81:0/2782418264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6b8890 0x55b27e6c9170 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe7000297b0 tx=0x7fe7000294b0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe7237dab80 1 -- 172.21.15.81:0/2782418264 shutdown_connections 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe7237dab80 1 --2- 172.21.15.81:0/2782418264 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b27e729440 0x55b27e72b860 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe7237dab80 1 --2- 172.21.15.81:0/2782418264 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b27e6be720 0x55b27e6c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe6f4ff9700 0 client.18717 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe7237dab80 1 --2- 172.21.15.81:0/2782418264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b27e6b8890 0x55b27e6c9170 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe7237dab80 1 --2- 172.21.15.81:0/2782418264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b27e6bde00 0x55b27e6c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.179+0000 7fe7237dab80 1 -- 172.21.15.81:0/2782418264 >> 172.21.15.81:0/2782418264 conn(0x55b27e616210 msgr2=0x55b27e6bcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe7237dab80 1 -- 172.21.15.81:0/2782418264 shutdown_connections 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe7237dab80 1 -- 172.21.15.81:0/2782418264 wait complete. 2024-05-09T00:14:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe7237dab80 20 client.18717 trim_cache size 0 max 16384 2024-05-09T00:14:28.185 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:14:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:14:28.185 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:14:28.185 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:14:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe717620700 1 -- 172.21.15.81:0/2879269089 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6f80a1310 msgr2=0x7fe6f80a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe717620700 1 --2- 172.21.15.81:0/2879269089 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6f80a1310 0x7fe6f80a37d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe70000b830 tx=0x7fe7000090d0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe717620700 1 -- 172.21.15.81:0/2879269089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7101062d0 msgr2=0x7fe71019d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe717620700 1 --2- 172.21.15.81:0/2879269089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7101062d0 0x7fe71019d750 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fe70800c900 tx=0x7fe70800cc10 comp rx=0 tx=0).stop 2024-05-09T00:14:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe717620700 1 -- 172.21.15.81:0/2879269089 shutdown_connections 2024-05-09T00:14:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe717620700 1 --2- 172.21.15.81:0/2879269089 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe6f80a1310 0x7fe6f80a37d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe717620700 1 --2- 172.21.15.81:0/2879269089 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe710103960 0x7fe7101a36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe717620700 1 --2- 172.21.15.81:0/2879269089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7101062d0 0x7fe71019d750 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe717620700 1 --2- 172.21.15.81:0/2879269089 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe710105e60 0x7fe7101a3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe717620700 1 -- 172.21.15.81:0/2879269089 >> 172.21.15.81:0/2879269089 conn(0x7fe710076ba0 msgr2=0x7fe7101027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe717620700 1 -- 172.21.15.81:0/2879269089 shutdown_connections 2024-05-09T00:14:28.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.180+0000 7fe717620700 1 -- 172.21.15.81:0/2879269089 wait complete. 2024-05-09T00:14:28.190 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:14:28.190 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:14:28.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.315+0000 7fe8552ab700 1 -- 172.21.15.81:0/3768764884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe850100900 msgr2=0x7fe850104940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.315+0000 7fe8552ab700 1 --2- 172.21.15.81:0/3768764884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe850100900 0x7fe850104940 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fe844009990 tx=0x7fe844009ca0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.315+0000 7fe8552ab700 1 -- 172.21.15.81:0/3768764884 shutdown_connections 2024-05-09T00:14:28.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.315+0000 7fe8552ab700 1 --2- 172.21.15.81:0/3768764884 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe8500fff50 0x7fe850100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.315+0000 7fe8552ab700 1 --2- 172.21.15.81:0/3768764884 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe850105070 0x7fe85010cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.315+0000 7fe8552ab700 1 --2- 172.21.15.81:0/3768764884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe850100900 0x7fe850104940 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.315+0000 7fe8552ab700 1 -- 172.21.15.81:0/3768764884 >> 172.21.15.81:0/3768764884 conn(0x7fe8500fb7b0 msgr2=0x7fe8500fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.315+0000 7fe8552ab700 1 -- 172.21.15.81:0/3768764884 shutdown_connections 2024-05-09T00:14:28.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.315+0000 7fe8552ab700 1 -- 172.21.15.81:0/3768764884 wait complete. 2024-05-09T00:14:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.316+0000 7fe8552ab700 1 Processor -- start 2024-05-09T00:14:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.316+0000 7fe8552ab700 1 -- start start 2024-05-09T00:14:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.316+0000 7fe8552ab700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8500fff50 0x7fe850198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.316+0000 7fe8552ab700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe850105070 0x7fe850198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.316+0000 7fe8552ab700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe850198b80 0x7fe8501a3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.316+0000 7fe8552ab700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8501a3860 con 0x7fe850198b80 2024-05-09T00:14:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.316+0000 7fe8552ab700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8501a39d0 con 0x7fe850105070 2024-05-09T00:14:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.316+0000 7fe8552ab700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8501a3b90 con 0x7fe8500fff50 2024-05-09T00:14:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.316+0000 7fe84f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe850198b80 0x7fe8501a3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.316+0000 7fe84f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe850198b80 0x7fe8501a3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39270/0 (socket says 172.21.15.81:39270) 2024-05-09T00:14:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.316+0000 7fe84f7fe700 1 -- 172.21.15.81:0/2534886693 learned_addr learned my addr 172.21.15.81:0/2534886693 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.316+0000 7fe84e7fc700 1 --2- 172.21.15.81:0/2534886693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe850105070 0x7fe850198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.316+0000 7fe84effd700 1 --2- 172.21.15.81:0/2534886693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8500fff50 0x7fe850198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.317+0000 7fe84f7fe700 1 -- 172.21.15.81:0/2534886693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8500fff50 msgr2=0x7fe850198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.317+0000 7fe84f7fe700 1 --2- 172.21.15.81:0/2534886693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8500fff50 0x7fe850198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.317+0000 7fe84f7fe700 1 -- 172.21.15.81:0/2534886693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe850105070 msgr2=0x7fe850198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.317+0000 7fe84f7fe700 1 --2- 172.21.15.81:0/2534886693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe850105070 0x7fe850198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.317+0000 7fe84f7fe700 1 -- 172.21.15.81:0/2534886693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8440095f0 con 0x7fe850198b80 2024-05-09T00:14:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.317+0000 7fe84f7fe700 1 --2- 172.21.15.81:0/2534886693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe850198b80 0x7fe8501a3180 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fe848007ee0 tx=0x7fe84800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.317+0000 7fe837fff700 1 -- 172.21.15.81:0/2534886693 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848017070 con 0x7fe850198b80 2024-05-09T00:14:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.317+0000 7fe8552ab700 1 -- 172.21.15.81:0/2534886693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8501a3e70 con 0x7fe850198b80 2024-05-09T00:14:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.317+0000 7fe837fff700 1 -- 172.21.15.81:0/2534886693 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe84800f040 con 0x7fe850198b80 2024-05-09T00:14:28.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.317+0000 7fe837fff700 1 -- 172.21.15.81:0/2534886693 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848005580 con 0x7fe850198b80 2024-05-09T00:14:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.317+0000 7fe8552ab700 1 -- 172.21.15.81:0/2534886693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8501a42a0 con 0x7fe850198b80 2024-05-09T00:14:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.318+0000 7fe8552ab700 1 -- 172.21.15.81:0/2534886693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe850108340 con 0x7fe850198b80 2024-05-09T00:14:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.319+0000 7fe837fff700 1 -- 172.21.15.81:0/2534886693 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe84800db20 con 0x7fe850198b80 2024-05-09T00:14:28.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.320+0000 7fe837fff700 1 --2- 172.21.15.81:0/2534886693 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe8380a1290 0x7fe8380a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.320+0000 7fe837fff700 1 -- 172.21.15.81:0/2534886693 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe8480cc980 con 0x7fe850198b80 2024-05-09T00:14:28.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.320+0000 7fe84effd700 1 --2- 172.21.15.81:0/2534886693 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe8380a1290 0x7fe8380a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.320+0000 7fe84effd700 1 --2- 172.21.15.81:0/2534886693 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe8380a1290 0x7fe8380a3750 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe84000ac50 tx=0x7fe84000a380 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.323+0000 7fe837fff700 1 -- 172.21.15.81:0/2534886693 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe848095da0 con 0x7fe850198b80 2024-05-09T00:14:28.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.565+0000 7fe8552ab700 1 -- 172.21.15.81:0/2534886693 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe850069a80 con 0x7fe850198b80 2024-05-09T00:14:28.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.565+0000 7fe837fff700 1 -- 172.21.15.81:0/2534886693 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7fe8480993c0 con 0x7fe850198b80 2024-05-09T00:14:28.563 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:14:28.563 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:14:28.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.567+0000 7fe8552ab700 1 -- 172.21.15.81:0/2534886693 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe8380a1290 msgr2=0x7fe8380a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.567+0000 7fe8552ab700 1 --2- 172.21.15.81:0/2534886693 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe8380a1290 0x7fe8380a3750 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe84000ac50 tx=0x7fe84000a380 comp rx=0 tx=0).stop 2024-05-09T00:14:28.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.567+0000 7fe8552ab700 1 -- 172.21.15.81:0/2534886693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe850198b80 msgr2=0x7fe8501a3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.567+0000 7fe8552ab700 1 --2- 172.21.15.81:0/2534886693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe850198b80 0x7fe8501a3180 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fe848007ee0 tx=0x7fe84800d3b0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.568+0000 7fe8552ab700 1 -- 172.21.15.81:0/2534886693 shutdown_connections 2024-05-09T00:14:28.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.568+0000 7fe8552ab700 1 --2- 172.21.15.81:0/2534886693 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe8380a1290 0x7fe8380a3750 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.568+0000 7fe8552ab700 1 --2- 172.21.15.81:0/2534886693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe850198b80 0x7fe8501a3180 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.568+0000 7fe8552ab700 1 --2- 172.21.15.81:0/2534886693 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe8500fff50 0x7fe850198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.568+0000 7fe8552ab700 1 --2- 172.21.15.81:0/2534886693 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe850105070 0x7fe850198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.568+0000 7fe8552ab700 1 -- 172.21.15.81:0/2534886693 >> 172.21.15.81:0/2534886693 conn(0x7fe8500fb7b0 msgr2=0x7fe8500fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.568+0000 7fe8552ab700 1 -- 172.21.15.81:0/2534886693 shutdown_connections 2024-05-09T00:14:28.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.568+0000 7fe8552ab700 1 -- 172.21.15.81:0/2534886693 wait complete. 2024-05-09T00:14:28.567 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:14:28.577 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:14:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.703+0000 7f1890dfc700 1 -- 172.21.15.81:0/3746739039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f188c100060 msgr2=0x7f188c100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.703+0000 7f1890dfc700 1 --2- 172.21.15.81:0/3746739039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f188c100060 0x7f188c100440 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f188400b0a0 tx=0x7f188400b3b0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.703+0000 7f1890dfc700 1 -- 172.21.15.81:0/3746739039 shutdown_connections 2024-05-09T00:14:28.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.703+0000 7f1890dfc700 1 --2- 172.21.15.81:0/3746739039 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f188c105160 0x7f188c10cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.703+0000 7f1890dfc700 1 --2- 172.21.15.81:0/3746739039 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f188c100060 0x7f188c100440 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.703+0000 7f1890dfc700 1 --2- 172.21.15.81:0/3746739039 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f188c100a10 0x7f188c104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.703+0000 7f1890dfc700 1 -- 172.21.15.81:0/3746739039 >> 172.21.15.81:0/3746739039 conn(0x7f188c076f40 msgr2=0x7f188c077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.703+0000 7f1890dfc700 1 -- 172.21.15.81:0/3746739039 shutdown_connections 2024-05-09T00:14:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.703+0000 7f1890dfc700 1 -- 172.21.15.81:0/3746739039 wait complete. 2024-05-09T00:14:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.704+0000 7f1890dfc700 1 Processor -- start 2024-05-09T00:14:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.704+0000 7f1890dfc700 1 -- start start 2024-05-09T00:14:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.704+0000 7f1890dfc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f188c100060 0x7f188c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.704+0000 7f1890dfc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f188c105160 0x7f188c198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.704+0000 7f1890dfc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f188c198dc0 0x7f188c1a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.704+0000 7f1890dfc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c1a3aa0 con 0x7f188c198dc0 2024-05-09T00:14:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.704+0000 7f1890dfc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c1a3c10 con 0x7f188c100060 2024-05-09T00:14:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.704+0000 7f1890dfc700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c1a3dd0 con 0x7f188c105160 2024-05-09T00:14:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f188ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f188c198dc0 0x7f188c1a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f188ad9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f188c198dc0 0x7f188c1a33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39282/0 (socket says 172.21.15.81:39282) 2024-05-09T00:14:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f188ad9d700 1 -- 172.21.15.81:0/3028433702 learned_addr learned my addr 172.21.15.81:0/3028433702 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f1889d9b700 1 --2- 172.21.15.81:0/3028433702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f188c105160 0x7f188c198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f188a59c700 1 --2- 172.21.15.81:0/3028433702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f188c100060 0x7f188c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f188ad9d700 1 -- 172.21.15.81:0/3028433702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f188c105160 msgr2=0x7f188c198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f188ad9d700 1 --2- 172.21.15.81:0/3028433702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f188c105160 0x7f188c198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f188ad9d700 1 -- 172.21.15.81:0/3028433702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f188c100060 msgr2=0x7f188c198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f188ad9d700 1 --2- 172.21.15.81:0/3028433702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f188c100060 0x7f188c198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f188ad9d700 1 -- 172.21.15.81:0/3028433702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1884009d00 con 0x7f188c198dc0 2024-05-09T00:14:28.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f188ad9d700 1 --2- 172.21.15.81:0/3028433702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f188c198dc0 0x7f188c1a33c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f187c00d980 tx=0x7f187c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f18837fe700 1 -- 172.21.15.81:0/3028433702 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c004a30 con 0x7f188c198dc0 2024-05-09T00:14:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f18837fe700 1 -- 172.21.15.81:0/3028433702 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f187c00b5c0 con 0x7f188c198dc0 2024-05-09T00:14:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f18837fe700 1 -- 172.21.15.81:0/3028433702 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c009b50 con 0x7f188c198dc0 2024-05-09T00:14:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f1890dfc700 1 -- 172.21.15.81:0/3028433702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188c1a40b0 con 0x7f188c198dc0 2024-05-09T00:14:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.705+0000 7f1890dfc700 1 -- 172.21.15.81:0/3028433702 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188c1a45c0 con 0x7f188c198dc0 2024-05-09T00:14:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.707+0000 7f18837fe700 1 -- 172.21.15.81:0/3028433702 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f187c009cb0 con 0x7f188c198dc0 2024-05-09T00:14:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.708+0000 7f18837fe700 1 --2- 172.21.15.81:0/3028433702 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f18780a1310 0x7f18780a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.708+0000 7f188a59c700 1 --2- 172.21.15.81:0/3028433702 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f18780a1310 0x7f18780a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.708+0000 7f18837fe700 1 -- 172.21.15.81:0/3028433702 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f187c0cca80 con 0x7f188c198dc0 2024-05-09T00:14:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.708+0000 7f188a59c700 1 --2- 172.21.15.81:0/3028433702 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f18780a1310 0x7f18780a37d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1884000f80 tx=0x7f188400b7b0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f189cfb6b80 1 Processor -- start 2024-05-09T00:14:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f189cfb6b80 1 -- start start 2024-05-09T00:14:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f189cfb6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f189cfb6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59cc720 0x5630b59c6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f189cfb6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59c6890 0x5630b59c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f189cfb6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b591d150 con 0x5630b59cbe00 2024-05-09T00:14:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f189cfb6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b591ab10 con 0x5630b59c6890 2024-05-09T00:14:28.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f189cfb6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b5916400 con 0x5630b59cc720 2024-05-09T00:14:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f188a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f188a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39286/0 (socket says 172.21.15.81:39286) 2024-05-09T00:14:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f188a59c700 1 -- 172.21.15.81:0/571636075 learned_addr learned my addr 172.21.15.81:0/571636075 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f1889d9b700 1 --2- 172.21.15.81:0/571636075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59cc720 0x5630b59c6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f188a59c700 1 -- 172.21.15.81:0/571636075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59cc720 msgr2=0x5630b59c6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f188a59c700 1 --2- 172.21.15.81:0/571636075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59cc720 0x5630b59c6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f188a59c700 1 -- 172.21.15.81:0/571636075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59c6890 msgr2=0x5630b59c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.709+0000 7f188ad9d700 1 --2- 172.21.15.81:0/571636075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59c6890 0x5630b59c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.710+0000 7f188a59c700 1 --2- 172.21.15.81:0/571636075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59c6890 0x5630b59c6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.710+0000 7f188a59c700 1 -- 172.21.15.81:0/571636075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630b57973b0 con 0x5630b59cbe00 2024-05-09T00:14:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.710+0000 7f188a59c700 1 --2- 172.21.15.81:0/571636075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59cc1e0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f1884009200 tx=0x7f188401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89db41c50c0b2ae5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.710+0000 7f1880ff9700 1 -- 172.21.15.81:0/571636075 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1884004e90 con 0x5630b59cbe00 2024-05-09T00:14:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.710+0000 7f1880ff9700 1 -- 172.21.15.81:0/571636075 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1884007960 con 0x5630b59cbe00 2024-05-09T00:14:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.710+0000 7f1880ff9700 1 -- 172.21.15.81:0/571636075 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188401b430 con 0x5630b59cbe00 2024-05-09T00:14:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 -- 172.21.15.81:0/571636075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 msgr2=0x5630b59cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/571636075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59cc1e0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f1884009200 tx=0x7f188401b000 comp rx=0 tx=0).stop 2024-05-09T00:14:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 -- 172.21.15.81:0/571636075 shutdown_connections 2024-05-09T00:14:28.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/571636075 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59c6890 0x5630b59c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/571636075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59cc1e0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/571636075 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59cc720 0x5630b59c6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 -- 172.21.15.81:0/571636075 >> 172.21.15.81:0/571636075 conn(0x5630b5924210 msgr2=0x5630b59c0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 -- 172.21.15.81:0/571636075 shutdown_connections 2024-05-09T00:14:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 -- 172.21.15.81:0/571636075 wait complete. 2024-05-09T00:14:28.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 -- start start 2024-05-09T00:14:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 Processor -- start 2024-05-09T00:14:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59c6890 0x5630b59cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cc720 0x5630b59d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b58b2560 con 0x5630b59cbe00 2024-05-09T00:14:28.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b58b2200 con 0x5630b59cc720 2024-05-09T00:14:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b57996a0 con 0x5630b59c6890 2024-05-09T00:14:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f189cfb6b80 10 client.0 _ll_register_callbacks cb 0x5630b58bbb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f1889d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f1889d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59d00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39288/0 (socket says 172.21.15.81:39288) 2024-05-09T00:14:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.711+0000 7f1889d9b700 1 -- 172.21.15.81:0/2371048689 learned_addr learned my addr 172.21.15.81:0/2371048689 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f188ad9d700 1 --2- 172.21.15.81:0/2371048689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cc720 0x5630b59d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f1889d9b700 1 -- 172.21.15.81:0/2371048689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59c6890 msgr2=0x5630b59cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f1889d9b700 1 --2- 172.21.15.81:0/2371048689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59c6890 0x5630b59cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f1889d9b700 1 -- 172.21.15.81:0/2371048689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cc720 msgr2=0x5630b59d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f1889d9b700 1 --2- 172.21.15.81:0/2371048689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cc720 0x5630b59d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f1889d9b700 1 -- 172.21.15.81:0/2371048689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188c10d550 con 0x5630b59cbe00 2024-05-09T00:14:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f1889d9b700 1 --2- 172.21.15.81:0/2371048689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59d00a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f187400b810 tx=0x7f187400bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9513fcf853a1a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f1871ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:28.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f1871ffb700 1 -- 172.21.15.81:0/2371048689 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874003d90 con 0x5630b59cbe00 2024-05-09T00:14:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f1871ffb700 1 -- 172.21.15.81:0/2371048689 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f1874003ef0 con 0x5630b59cbe00 2024-05-09T00:14:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f189cfb6b80 1 -- 172.21.15.81:0/2371048689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5630b586f270 con 0x5630b59cbe00 2024-05-09T00:14:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f1871ffb700 1 -- 172.21.15.81:0/2371048689 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f187401b440 con 0x5630b59cbe00 2024-05-09T00:14:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f189cfb6b80 10 client.18735 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f189cfb6b80 1 -- 172.21.15.81:0/2371048689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5630b5743b60 con 0x5630b59cbe00 2024-05-09T00:14:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f1871ffb700 1 -- 172.21.15.81:0/2371048689 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5630b586f270 con 0x5630b59cbe00 2024-05-09T00:14:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f1871ffb700 1 -- 172.21.15.81:0/2371048689 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1874011810 con 0x5630b59cbe00 2024-05-09T00:14:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f189cfb6b80 10 client.18735 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.712+0000 7f189cfb6b80 10 client.18735 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:14:28.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.713+0000 7f189cfb6b80 20 client.18735 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.713+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/2371048689 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5630b59e02f0 0x5630b59e2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.713+0000 7f189cfb6b80 4 client.18735 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:14:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.713+0000 7f189cfb6b80 1 -- 172.21.15.81:0/2371048689 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630b5995810 con 0x5630b59e02f0 2024-05-09T00:14:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.713+0000 7f188a59c700 1 --2- 172.21.15.81:0/2371048689 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5630b59e02f0 0x5630b59e2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.713+0000 7f188a59c700 1 --2- 172.21.15.81:0/2371048689 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5630b59e02f0 0x5630b59e2710 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=98b3beb81e92004 server_cookie=d0e2182013b849f in_seq=0 out_seq=0 2024-05-09T00:14:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.713+0000 7f1871ffb700 10 client.18735 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:14:28.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f1871ffb700 1 -- 172.21.15.81:0/2371048689 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5630b5995810 con 0x5630b59e02f0 2024-05-09T00:14:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f1871ffb700 10 client.18735 handle_command_reply: tid=0 2024-05-09T00:14:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f189cfb6b80 1 client.18735 shutdown 2024-05-09T00:14:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f189cfb6b80 1 -- 172.21.15.81:0/2371048689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 msgr2=0x5630b59d00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/2371048689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59d00a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f187400b810 tx=0x7f187400bbd0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f189cfb6b80 1 -- 172.21.15.81:0/2371048689 shutdown_connections 2024-05-09T00:14:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/2371048689 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5630b59e02f0 0x5630b59e2710 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/2371048689 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cc720 0x5630b59d05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/2371048689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59c6890 0x5630b59cfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/2371048689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59d00a0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f189cfb6b80 1 -- 172.21.15.81:0/2371048689 >> 172.21.15.81:0/2371048689 conn(0x5630b5924210 msgr2=0x5630b59c05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f1871ffb700 0 client.18735 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:14:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f189cfb6b80 1 -- 172.21.15.81:0/2371048689 shutdown_connections 2024-05-09T00:14:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f189cfb6b80 1 -- 172.21.15.81:0/2371048689 wait complete. 2024-05-09T00:14:28.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.714+0000 7f189cfb6b80 20 client.18735 trim_cache size 0 max 16384 2024-05-09T00:14:28.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.727+0000 7f189cfb6b80 1 Processor -- start 2024-05-09T00:14:28.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.727+0000 7f189cfb6b80 1 -- start start 2024-05-09T00:14:28.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.727+0000 7f189cfb6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59c6890 0x5630b59dc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.727+0000 7f189cfb6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59bd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.727+0000 7f189cfb6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cc720 0x5630b59c0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.727+0000 7f189cfb6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b59bb800 con 0x5630b59cbe00 2024-05-09T00:14:28.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.727+0000 7f189cfb6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b59e78c0 con 0x5630b59cc720 2024-05-09T00:14:28.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.727+0000 7f189cfb6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b59cdb10 con 0x5630b59c6890 2024-05-09T00:14:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.728+0000 7f1889d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59bd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.728+0000 7f1889d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59bd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39300/0 (socket says 172.21.15.81:39300) 2024-05-09T00:14:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.728+0000 7f1889d9b700 1 -- 172.21.15.81:0/601934496 learned_addr learned my addr 172.21.15.81:0/601934496 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.728+0000 7f188ad9d700 1 --2- 172.21.15.81:0/601934496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cc720 0x5630b59c0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.728+0000 7f188a59c700 1 --2- 172.21.15.81:0/601934496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59c6890 0x5630b59dc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.728+0000 7f1889d9b700 1 -- 172.21.15.81:0/601934496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59c6890 msgr2=0x5630b59dc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.728+0000 7f1889d9b700 1 --2- 172.21.15.81:0/601934496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59c6890 0x5630b59dc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.728+0000 7f1889d9b700 1 -- 172.21.15.81:0/601934496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cc720 msgr2=0x5630b59c0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.728+0000 7f1889d9b700 1 --2- 172.21.15.81:0/601934496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cc720 0x5630b59c0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.728+0000 7f1889d9b700 1 -- 172.21.15.81:0/601934496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630b58dc560 con 0x5630b59cbe00 2024-05-09T00:14:28.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.728+0000 7f1889d9b700 1 --2- 172.21.15.81:0/601934496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59bd210 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f187400c010 tx=0x7f1874005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28370d38cbae6861 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.728+0000 7f18817fa700 1 -- 172.21.15.81:0/601934496 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874003d90 con 0x5630b59cbe00 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.728+0000 7f18817fa700 1 -- 172.21.15.81:0/601934496 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1874011900 con 0x5630b59cbe00 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.728+0000 7f18817fa700 1 -- 172.21.15.81:0/601934496 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874010ca0 con 0x5630b59cbe00 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 -- 172.21.15.81:0/601934496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 msgr2=0x5630b59bd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/601934496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59bd210 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f187400c010 tx=0x7f1874005ce0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 -- 172.21.15.81:0/601934496 shutdown_connections 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/601934496 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cc720 0x5630b59c0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/601934496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59c6890 0x5630b59dc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/601934496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59cbe00 0x5630b59bd210 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 -- 172.21.15.81:0/601934496 >> 172.21.15.81:0/601934496 conn(0x5630b5924210 msgr2=0x5630b59cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 -- 172.21.15.81:0/601934496 shutdown_connections 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 -- 172.21.15.81:0/601934496 wait complete. 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 -- start start 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 Processor -- start 2024-05-09T00:14:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59c6890 0x5630b59d7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cbe00 0x5630b59d7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59cc720 0x5630b59d50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b59d5670 con 0x5630b59c6890 2024-05-09T00:14:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b59d57b0 con 0x5630b59cbe00 2024-05-09T00:14:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b59d5970 con 0x5630b59cc720 2024-05-09T00:14:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f189cfb6b80 10 client.0 _ll_register_callbacks cb 0x5630b58bbb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f188a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59c6890 0x5630b59d7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f188a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59c6890 0x5630b59d7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39314/0 (socket says 172.21.15.81:39314) 2024-05-09T00:14:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.729+0000 7f188a59c700 1 -- 172.21.15.81:0/599522246 learned_addr learned my addr 172.21.15.81:0/599522246 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f1889d9b700 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cbe00 0x5630b59d7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f188ad9d700 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59cc720 0x5630b59d50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f188a59c700 1 -- 172.21.15.81:0/599522246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59cc720 msgr2=0x5630b59d50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f188a59c700 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59cc720 0x5630b59d50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f188a59c700 1 -- 172.21.15.81:0/599522246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cbe00 msgr2=0x5630b59d7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f188a59c700 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cbe00 0x5630b59d7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f188a59c700 1 -- 172.21.15.81:0/599522246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630b5743b60 con 0x5630b59c6890 2024-05-09T00:14:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f1889d9b700 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cbe00 0x5630b59d7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f188ad9d700 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59cc720 0x5630b59d50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f188a59c700 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59c6890 0x5630b59d7110 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f1884009fd0 tx=0x7f18840099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6cc04efbd9cec9 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f1871ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f1871ffb700 1 -- 172.21.15.81:0/599522246 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1884005660 con 0x5630b59c6890 2024-05-09T00:14:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f1871ffb700 1 -- 172.21.15.81:0/599522246 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f1884035e40 con 0x5630b59c6890 2024-05-09T00:14:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f189cfb6b80 1 -- 172.21.15.81:0/599522246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1884007960 con 0x5630b59c6890 2024-05-09T00:14:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f1871ffb700 1 -- 172.21.15.81:0/599522246 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18840057c0 con 0x5630b59c6890 2024-05-09T00:14:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f189cfb6b80 10 client.18741 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f189cfb6b80 1 -- 172.21.15.81:0/599522246 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5630b579bcd0 con 0x5630b59c6890 2024-05-09T00:14:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.730+0000 7f1871ffb700 1 -- 172.21.15.81:0/599522246 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1884007960 con 0x5630b59c6890 2024-05-09T00:14:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.731+0000 7f1871ffb700 1 -- 172.21.15.81:0/599522246 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1884035530 con 0x5630b59c6890 2024-05-09T00:14:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.731+0000 7f189cfb6b80 10 client.18741 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.731+0000 7f189cfb6b80 10 client.18741 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:14:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.731+0000 7f189cfb6b80 20 client.18741 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.731+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5630b5a36340 0x5630b5a38730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.731+0000 7f189cfb6b80 4 client.18741 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:14:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.731+0000 7f189cfb6b80 1 -- 172.21.15.81:0/599522246 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5630b590eec0 con 0x5630b5a36340 2024-05-09T00:14:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.731+0000 7f1889d9b700 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5630b5a36340 0x5630b5a38730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.731+0000 7f1889d9b700 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5630b5a36340 0x5630b5a38730 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=360a56aa69570784 server_cookie=fda4ea8db5b64d5c in_seq=0 out_seq=0 2024-05-09T00:14:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.731+0000 7f1871ffb700 10 client.18741 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:14:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.731+0000 7f1871ffb700 1 -- 172.21.15.81:0/599522246 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5630b590eec0 con 0x5630b5a36340 2024-05-09T00:14:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.731+0000 7f1871ffb700 10 client.18741 handle_command_reply: tid=0 2024-05-09T00:14:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.731+0000 7f189cfb6b80 1 client.18741 shutdown 2024-05-09T00:14:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f189cfb6b80 1 -- 172.21.15.81:0/599522246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59c6890 msgr2=0x5630b59d7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59c6890 0x5630b59d7110 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f1884009fd0 tx=0x7f18840099e0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f189cfb6b80 1 -- 172.21.15.81:0/599522246 shutdown_connections 2024-05-09T00:14:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5630b59cc720 0x5630b59d50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5630b59c6890 0x5630b59d7110 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5630b5a36340 0x5630b5a38730 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f189cfb6b80 1 --2- 172.21.15.81:0/599522246 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5630b59cbe00 0x5630b59d7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f1871ffb700 0 client.18741 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:14:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f189cfb6b80 1 -- 172.21.15.81:0/599522246 >> 172.21.15.81:0/599522246 conn(0x5630b5924210 msgr2=0x5630b59ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f189cfb6b80 1 -- 172.21.15.81:0/599522246 shutdown_connections 2024-05-09T00:14:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f189cfb6b80 1 -- 172.21.15.81:0/599522246 wait complete. 2024-05-09T00:14:28.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f189cfb6b80 20 client.18741 trim_cache size 0 max 16384 2024-05-09T00:14:28.748 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:14:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f1890dfc700 1 -- 172.21.15.81:0/3028433702 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f18780a1310 msgr2=0x7f18780a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f1890dfc700 1 --2- 172.21.15.81:0/3028433702 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f18780a1310 0x7f18780a37d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1884000f80 tx=0x7f188400b7b0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f1890dfc700 1 -- 172.21.15.81:0/3028433702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f188c198dc0 msgr2=0x7f188c1a33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f1890dfc700 1 --2- 172.21.15.81:0/3028433702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f188c198dc0 0x7f188c1a33c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f187c00d980 tx=0x7f187c00dc90 comp rx=0 tx=0).stop 2024-05-09T00:14:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f1890dfc700 1 -- 172.21.15.81:0/3028433702 shutdown_connections 2024-05-09T00:14:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f1890dfc700 1 --2- 172.21.15.81:0/3028433702 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f18780a1310 0x7f18780a37d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f1890dfc700 1 --2- 172.21.15.81:0/3028433702 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f188c100060 0x7f188c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f1890dfc700 1 --2- 172.21.15.81:0/3028433702 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f188c198dc0 0x7f188c1a33c0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f1890dfc700 1 --2- 172.21.15.81:0/3028433702 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f188c105160 0x7f188c198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f1890dfc700 1 -- 172.21.15.81:0/3028433702 >> 172.21.15.81:0/3028433702 conn(0x7f188c076f40 msgr2=0x7f188c0fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f1890dfc700 1 -- 172.21.15.81:0/3028433702 shutdown_connections 2024-05-09T00:14:28.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.732+0000 7f1890dfc700 1 -- 172.21.15.81:0/3028433702 wait complete. 2024-05-09T00:14:28.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:14:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.876+0000 7f8fc075a700 1 -- 172.21.15.81:0/1512339038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb8100a10 msgr2=0x7f8fb8104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.876+0000 7f8fc075a700 1 --2- 172.21.15.81:0/1512339038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb8100a10 0x7f8fb8104a30 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8009990 tx=0x7f8fa8009ca0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 -- 172.21.15.81:0/1512339038 shutdown_connections 2024-05-09T00:14:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 --2- 172.21.15.81:0/1512339038 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb8105160 0x7f8fb810cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 --2- 172.21.15.81:0/1512339038 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8fb8100060 0x7f8fb8100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 --2- 172.21.15.81:0/1512339038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb8100a10 0x7f8fb8104a30 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 -- 172.21.15.81:0/1512339038 >> 172.21.15.81:0/1512339038 conn(0x7f8fb8076f40 msgr2=0x7f8fb8077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 -- 172.21.15.81:0/1512339038 shutdown_connections 2024-05-09T00:14:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 -- 172.21.15.81:0/1512339038 wait complete. 2024-05-09T00:14:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 Processor -- start 2024-05-09T00:14:28.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 -- start start 2024-05-09T00:14:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb8100060 0x7f8fb8198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb8105160 0x7f8fb8198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8fb8198cd0 0x7f8fb81a3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb81a3990 con 0x7f8fb8105160 2024-05-09T00:14:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb81a3b00 con 0x7f8fb8100060 2024-05-09T00:14:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fc075a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb81a3cc0 con 0x7f8fb8198cd0 2024-05-09T00:14:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fbdcf5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb8105160 0x7f8fb8198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fbdcf5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb8105160 0x7f8fb8198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39336/0 (socket says 172.21.15.81:39336) 2024-05-09T00:14:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.877+0000 7f8fbdcf5700 1 -- 172.21.15.81:0/543844687 learned_addr learned my addr 172.21.15.81:0/543844687 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.878+0000 7f8fbe4f6700 1 --2- 172.21.15.81:0/543844687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb8100060 0x7f8fb8198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.878+0000 7f8fbecf7700 1 --2- 172.21.15.81:0/543844687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8fb8198cd0 0x7f8fb81a3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.878+0000 7f8fbdcf5700 1 -- 172.21.15.81:0/543844687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8fb8198cd0 msgr2=0x7f8fb81a3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.878+0000 7f8fbdcf5700 1 --2- 172.21.15.81:0/543844687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8fb8198cd0 0x7f8fb81a3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.878+0000 7f8fbdcf5700 1 -- 172.21.15.81:0/543844687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb8100060 msgr2=0x7f8fb8198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.878+0000 7f8fbdcf5700 1 --2- 172.21.15.81:0/543844687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb8100060 0x7f8fb8198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.878+0000 7f8fbdcf5700 1 -- 172.21.15.81:0/543844687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa80095f0 con 0x7f8fb8105160 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.878+0000 7f8fbdcf5700 1 --2- 172.21.15.81:0/543844687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb8105160 0x7f8fb8198740 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8000c00 tx=0x7f8fa80036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.878+0000 7f8faf7fe700 1 -- 172.21.15.81:0/543844687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa801d070 con 0x7f8fb8105160 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.878+0000 7f8faf7fe700 1 -- 172.21.15.81:0/543844687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fa800fb30 con 0x7f8fb8105160 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.878+0000 7f8fc075a700 1 -- 172.21.15.81:0/543844687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb81a3f40 con 0x7f8fb8105160 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.878+0000 7f8faf7fe700 1 -- 172.21.15.81:0/543844687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8022bf0 con 0x7f8fb8105160 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.878+0000 7f8fc075a700 1 -- 172.21.15.81:0/543844687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb81a4300 con 0x7f8fb8105160 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.880+0000 7f8faf7fe700 1 -- 172.21.15.81:0/543844687 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f8fa800fca0 con 0x7f8fb8105160 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.881+0000 7f8faf7fe700 1 --2- 172.21.15.81:0/543844687 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8fa40a1290 0x7f8fa40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.881+0000 7f8fbe4f6700 1 --2- 172.21.15.81:0/543844687 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8fa40a1290 0x7f8fa40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.881+0000 7f8faf7fe700 1 -- 172.21.15.81:0/543844687 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f8fa80ce310 con 0x7f8fb8105160 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.882+0000 7f8fbe4f6700 1 --2- 172.21.15.81:0/543844687 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8fa40a1290 0x7f8fa40a3750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4005950 tx=0x7f8fb40058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.882+0000 7f8fcc914b80 1 Processor -- start 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.882+0000 7f8fcc914b80 1 -- start start 2024-05-09T00:14:28.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.882+0000 7f8fcc914b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36101e00 0x556d361021e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.882+0000 7f8fcc914b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36102720 0x556d360fc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.882+0000 7f8fcc914b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d360fc890 0x556d360fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.882+0000 7f8fcc914b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d36053150 con 0x556d36101e00 2024-05-09T00:14:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.882+0000 7f8fcc914b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d36050b10 con 0x556d36102720 2024-05-09T00:14:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.882+0000 7f8fcc914b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3604c400 con 0x556d360fc890 2024-05-09T00:14:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8fbe4f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36101e00 0x556d361021e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8fbe4f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36101e00 0x556d361021e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39352/0 (socket says 172.21.15.81:39352) 2024-05-09T00:14:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8fbe4f6700 1 -- 172.21.15.81:0/152372256 learned_addr learned my addr 172.21.15.81:0/152372256 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8fbdcf5700 1 --2- 172.21.15.81:0/152372256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36102720 0x556d360fc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8fbecf7700 1 --2- 172.21.15.81:0/152372256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d360fc890 0x556d360fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8fbe4f6700 1 -- 172.21.15.81:0/152372256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d360fc890 msgr2=0x556d360fccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8fbe4f6700 1 --2- 172.21.15.81:0/152372256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d360fc890 0x556d360fccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8fbe4f6700 1 -- 172.21.15.81:0/152372256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36102720 msgr2=0x556d360fc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8fbe4f6700 1 --2- 172.21.15.81:0/152372256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36102720 0x556d360fc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8fbe4f6700 1 -- 172.21.15.81:0/152372256 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d35ecd3b0 con 0x556d36101e00 2024-05-09T00:14:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8fbdcf5700 1 --2- 172.21.15.81:0/152372256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36102720 0x556d360fc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:28.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8fbe4f6700 1 --2- 172.21.15.81:0/152372256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36101e00 0x556d361021e0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400fd70 tx=0x7f8fb4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2896c1e160cb1c9e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8facff9700 1 -- 172.21.15.81:0/152372256 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4011c60 con 0x556d36101e00 2024-05-09T00:14:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8facff9700 1 -- 172.21.15.81:0/152372256 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fb4011dc0 con 0x556d36101e00 2024-05-09T00:14:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.883+0000 7f8facff9700 1 -- 172.21.15.81:0/152372256 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb401d7c0 con 0x556d36101e00 2024-05-09T00:14:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.884+0000 7f8fcc914b80 1 -- 172.21.15.81:0/152372256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36101e00 msgr2=0x556d361021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.884+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/152372256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36101e00 0x556d361021e0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400fd70 tx=0x7f8fb4012000 comp rx=0 tx=0).stop 2024-05-09T00:14:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.884+0000 7f8fcc914b80 1 -- 172.21.15.81:0/152372256 shutdown_connections 2024-05-09T00:14:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.884+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/152372256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d360fc890 0x556d360fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.884+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/152372256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36101e00 0x556d361021e0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.884+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/152372256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36102720 0x556d360fc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.884+0000 7f8fcc914b80 1 -- 172.21.15.81:0/152372256 >> 172.21.15.81:0/152372256 conn(0x556d3605a210 msgr2=0x556d360f6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.884+0000 7f8fcc914b80 1 -- 172.21.15.81:0/152372256 shutdown_connections 2024-05-09T00:14:28.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.884+0000 7f8fcc914b80 1 -- 172.21.15.81:0/152372256 wait complete. 2024-05-09T00:14:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.884+0000 7f8fcc914b80 1 -- start start 2024-05-09T00:14:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.884+0000 7f8fcc914b80 1 Processor -- start 2024-05-09T00:14:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fcc914b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d360fc890 0x556d36105b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fcc914b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d36101e00 0x556d36106040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fcc914b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36102720 0x556d36106580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fcc914b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d35fe8560 con 0x556d360fc890 2024-05-09T00:14:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fcc914b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d35fe8200 con 0x556d36102720 2024-05-09T00:14:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fcc914b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d35ecf6a0 con 0x556d36101e00 2024-05-09T00:14:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fcc914b80 10 client.0 _ll_register_callbacks cb 0x556d35ff1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fbe4f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d360fc890 0x556d36105b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fbe4f6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d360fc890 0x556d36105b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39368/0 (socket says 172.21.15.81:39368) 2024-05-09T00:14:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fbe4f6700 1 -- 172.21.15.81:0/2313384154 learned_addr learned my addr 172.21.15.81:0/2313384154 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fbdcf5700 1 --2- 172.21.15.81:0/2313384154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d36101e00 0x556d36106040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fbecf7700 1 --2- 172.21.15.81:0/2313384154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36102720 0x556d36106580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fbe4f6700 1 -- 172.21.15.81:0/2313384154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d36101e00 msgr2=0x556d36106040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fbe4f6700 1 --2- 172.21.15.81:0/2313384154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d36101e00 0x556d36106040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fbe4f6700 1 -- 172.21.15.81:0/2313384154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36102720 msgr2=0x556d36106580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fbe4f6700 1 --2- 172.21.15.81:0/2313384154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36102720 0x556d36106580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fbe4f6700 1 -- 172.21.15.81:0/2313384154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb400fa20 con 0x556d360fc890 2024-05-09T00:14:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fbecf7700 1 --2- 172.21.15.81:0/2313384154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36102720 0x556d36106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fbe4f6700 1 --2- 172.21.15.81:0/2313384154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d360fc890 0x556d36105b00 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400fd40 tx=0x7f8fb400ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ea05e58caade6a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.885+0000 7f8fa1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fa1ffb700 1 -- 172.21.15.81:0/2313384154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb402e070 con 0x556d360fc890 2024-05-09T00:14:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fa1ffb700 1 -- 172.21.15.81:0/2313384154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f8fb40053b0 con 0x556d360fc890 2024-05-09T00:14:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fcc914b80 1 -- 172.21.15.81:0/2313384154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556d35fa5270 con 0x556d360fc890 2024-05-09T00:14:28.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fa1ffb700 1 -- 172.21.15.81:0/2313384154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fb4005570 con 0x556d360fc890 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fcc914b80 10 client.18753 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fcc914b80 1 -- 172.21.15.81:0/2313384154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556d35e79b60 con 0x556d360fc890 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fa1ffb700 1 -- 172.21.15.81:0/2313384154 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fb403f020 con 0x556d360fc890 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fa1ffb700 1 -- 172.21.15.81:0/2313384154 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8fb401e820 con 0x556d360fc890 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fcc914b80 10 client.18753 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fcc914b80 10 client.18753 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fcc914b80 20 client.18753 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/2313384154 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x556d36116120 0x556d36118540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fcc914b80 4 client.18753 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fcc914b80 1 -- 172.21.15.81:0/2313384154 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556d360cb810 con 0x556d36116120 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.886+0000 7f8fbdcf5700 1 --2- 172.21.15.81:0/2313384154 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x556d36116120 0x556d36118540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.887+0000 7f8fa1ffb700 10 client.18753 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.887+0000 7f8fbdcf5700 1 --2- 172.21.15.81:0/2313384154 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x556d36116120 0x556d36118540 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72443919f0f28cf8 server_cookie=875644be441f6f49 in_seq=0 out_seq=0 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.887+0000 7f8fa1ffb700 1 -- 172.21.15.81:0/2313384154 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556d360cb810 con 0x556d36116120 2024-05-09T00:14:28.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.887+0000 7f8fa1ffb700 10 client.18753 handle_command_reply: tid=0 2024-05-09T00:14:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.887+0000 7f8fcc914b80 1 client.18753 shutdown 2024-05-09T00:14:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.888+0000 7f8fcc914b80 1 -- 172.21.15.81:0/2313384154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d360fc890 msgr2=0x556d36105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.888+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/2313384154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d360fc890 0x556d36105b00 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400fd40 tx=0x7f8fb400ffd0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.888+0000 7f8fcc914b80 1 -- 172.21.15.81:0/2313384154 shutdown_connections 2024-05-09T00:14:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.888+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/2313384154 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x556d36116120 0x556d36118540 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.888+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/2313384154 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36102720 0x556d36106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.888+0000 7f8fa1ffb700 0 client.18753 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:14:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.888+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/2313384154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d360fc890 0x556d36105b00 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.888+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/2313384154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d36101e00 0x556d36106040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.888+0000 7f8fcc914b80 1 -- 172.21.15.81:0/2313384154 >> 172.21.15.81:0/2313384154 conn(0x556d3605a210 msgr2=0x556d360f65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.888+0000 7f8fcc914b80 1 -- 172.21.15.81:0/2313384154 shutdown_connections 2024-05-09T00:14:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.888+0000 7f8fcc914b80 1 -- 172.21.15.81:0/2313384154 wait complete. 2024-05-09T00:14:28.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.888+0000 7f8fcc914b80 20 client.18753 trim_cache size 0 max 16384 2024-05-09T00:14:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fcc914b80 1 Processor -- start 2024-05-09T00:14:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fcc914b80 1 -- start start 2024-05-09T00:14:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fcc914b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d360fc890 0x556d361122c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fcc914b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d36101e00 0x556d360f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fcc914b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36102720 0x556d361063a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fcc914b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d360f7cf0 con 0x556d36102720 2024-05-09T00:14:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fcc914b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3611d780 con 0x556d360fc890 2024-05-09T00:14:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fcc914b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d360f1830 con 0x556d36101e00 2024-05-09T00:14:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fbecf7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36102720 0x556d361063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fbecf7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36102720 0x556d361063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39378/0 (socket says 172.21.15.81:39378) 2024-05-09T00:14:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fbecf7700 1 -- 172.21.15.81:0/1620957401 learned_addr learned my addr 172.21.15.81:0/1620957401 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fbe4f6700 1 --2- 172.21.15.81:0/1620957401 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d360fc890 0x556d361122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fbdcf5700 1 --2- 172.21.15.81:0/1620957401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d36101e00 0x556d360f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fbecf7700 1 -- 172.21.15.81:0/1620957401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d36101e00 msgr2=0x556d360f6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fbecf7700 1 --2- 172.21.15.81:0/1620957401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d36101e00 0x556d360f6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fbecf7700 1 -- 172.21.15.81:0/1620957401 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d360fc890 msgr2=0x556d361122c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fbecf7700 1 --2- 172.21.15.81:0/1620957401 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d360fc890 0x556d361122c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fbecf7700 1 -- 172.21.15.81:0/1620957401 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d36012560 con 0x556d36102720 2024-05-09T00:14:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fbecf7700 1 --2- 172.21.15.81:0/1620957401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36102720 0x556d361063a0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009bd0 tx=0x7f8fb0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3faaa6f6baf6a99 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.901+0000 7f8fad7fa700 1 -- 172.21.15.81:0/1620957401 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0007c60 con 0x556d36102720 2024-05-09T00:14:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.902+0000 7f8fad7fa700 1 -- 172.21.15.81:0/1620957401 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fb000f030 con 0x556d36102720 2024-05-09T00:14:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.902+0000 7f8fad7fa700 1 -- 172.21.15.81:0/1620957401 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb00046e0 con 0x556d36102720 2024-05-09T00:14:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.902+0000 7f8fcc914b80 1 -- 172.21.15.81:0/1620957401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36102720 msgr2=0x556d361063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.902+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/1620957401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36102720 0x556d361063a0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0009bd0 tx=0x7f8fb0009040 comp rx=0 tx=0).stop 2024-05-09T00:14:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.902+0000 7f8fcc914b80 1 -- 172.21.15.81:0/1620957401 shutdown_connections 2024-05-09T00:14:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.902+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/1620957401 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d360fc890 0x556d361122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.902+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/1620957401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36102720 0x556d361063a0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.902+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/1620957401 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d36101e00 0x556d360f6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.902+0000 7f8fcc914b80 1 -- 172.21.15.81:0/1620957401 >> 172.21.15.81:0/1620957401 conn(0x556d3605a210 msgr2=0x556d360f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.902+0000 7f8fcc914b80 1 -- 172.21.15.81:0/1620957401 shutdown_connections 2024-05-09T00:14:28.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.902+0000 7f8fcc914b80 1 -- 172.21.15.81:0/1620957401 wait complete. 2024-05-09T00:14:28.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.902+0000 7f8fcc914b80 1 -- start start 2024-05-09T00:14:28.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.902+0000 7f8fcc914b80 1 Processor -- start 2024-05-09T00:14:28.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fcc914b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d360fc890 0x556d3610d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fcc914b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36101e00 0x556d3610b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fcc914b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36102720 0x556d3610b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fcc914b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3610bde0 con 0x556d36102720 2024-05-09T00:14:28.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fcc914b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3610bf50 con 0x556d36101e00 2024-05-09T00:14:28.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fcc914b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d3616b620 con 0x556d360fc890 2024-05-09T00:14:28.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fcc914b80 10 client.0 _ll_register_callbacks cb 0x556d35ff1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:28.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fbecf7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36102720 0x556d3610b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fbecf7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36102720 0x556d3610b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39386/0 (socket says 172.21.15.81:39386) 2024-05-09T00:14:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fbecf7700 1 -- 172.21.15.81:0/1055323628 learned_addr learned my addr 172.21.15.81:0/1055323628 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fbe4f6700 1 --2- 172.21.15.81:0/1055323628 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d360fc890 0x556d3610d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fbdcf5700 1 --2- 172.21.15.81:0/1055323628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36101e00 0x556d3610b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fbecf7700 1 -- 172.21.15.81:0/1055323628 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d360fc890 msgr2=0x556d3610d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fbecf7700 1 --2- 172.21.15.81:0/1055323628 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d360fc890 0x556d3610d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fbecf7700 1 -- 172.21.15.81:0/1055323628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36101e00 msgr2=0x556d3610b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fbecf7700 1 --2- 172.21.15.81:0/1055323628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36101e00 0x556d3610b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fbecf7700 1 -- 172.21.15.81:0/1055323628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb0009800 con 0x556d36102720 2024-05-09T00:14:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fbecf7700 1 --2- 172.21.15.81:0/1055323628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36102720 0x556d3610b6d0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00094c0 tx=0x7f8fb0004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9d469fcc9bbe35 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fa1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fa1ffb700 1 -- 172.21.15.81:0/1055323628 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb00048b0 con 0x556d36102720 2024-05-09T00:14:28.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fa1ffb700 1 -- 172.21.15.81:0/1055323628 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f8fb0003c10 con 0x556d36102720 2024-05-09T00:14:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.903+0000 7f8fcc914b80 1 -- 172.21.15.81:0/1055323628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8fb4011dc0 con 0x556d36102720 2024-05-09T00:14:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.904+0000 7f8fa1ffb700 1 -- 172.21.15.81:0/1055323628 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fb0003df0 con 0x556d36102720 2024-05-09T00:14:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.904+0000 7f8fcc914b80 10 client.18759 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.904+0000 7f8fcc914b80 1 -- 172.21.15.81:0/1055323628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556d35ed1cd0 con 0x556d36102720 2024-05-09T00:14:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.904+0000 7f8fa1ffb700 1 -- 172.21.15.81:0/1055323628 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fb4011dc0 con 0x556d36102720 2024-05-09T00:14:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.904+0000 7f8fa1ffb700 1 -- 172.21.15.81:0/1055323628 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8fb0014070 con 0x556d36102720 2024-05-09T00:14:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.904+0000 7f8fcc914b80 10 client.18759 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.904+0000 7f8fcc914b80 10 client.18759 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:14:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.904+0000 7f8fcc914b80 20 client.18759 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.904+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/1055323628 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x556d3616cd00 0x556d3616f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.904+0000 7f8fcc914b80 4 client.18759 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:14:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.904+0000 7f8fcc914b80 1 -- 172.21.15.81:0/1055323628 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556d36044ec0 con 0x556d3616cd00 2024-05-09T00:14:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.904+0000 7f8fbe4f6700 1 --2- 172.21.15.81:0/1055323628 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x556d3616cd00 0x556d3616f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fa1ffb700 10 client.18759 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:14:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fbe4f6700 1 --2- 172.21.15.81:0/1055323628 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x556d3616cd00 0x556d3616f120 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a05e251d08374312 server_cookie=4ae7b1acb6e5f4cb in_seq=0 out_seq=0 2024-05-09T00:14:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fa1ffb700 1 -- 172.21.15.81:0/1055323628 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556d36044ec0 con 0x556d3616cd00 2024-05-09T00:14:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fa1ffb700 10 client.18759 handle_command_reply: tid=0 2024-05-09T00:14:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fcc914b80 1 client.18759 shutdown 2024-05-09T00:14:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fcc914b80 1 -- 172.21.15.81:0/1055323628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36102720 msgr2=0x556d3610b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/1055323628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36102720 0x556d3610b6d0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00094c0 tx=0x7f8fb0004610 comp rx=0 tx=0).stop 2024-05-09T00:14:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fcc914b80 1 -- 172.21.15.81:0/1055323628 shutdown_connections 2024-05-09T00:14:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/1055323628 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x556d3616cd00 0x556d3616f120 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/1055323628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x556d36102720 0x556d3610b6d0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/1055323628 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x556d360fc890 0x556d3610d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fcc914b80 1 --2- 172.21.15.81:0/1055323628 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x556d36101e00 0x556d3610b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fa1ffb700 0 client.18759 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:14:28.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fcc914b80 1 -- 172.21.15.81:0/1055323628 >> 172.21.15.81:0/1055323628 conn(0x556d3605a210 msgr2=0x556d360f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fcc914b80 1 -- 172.21.15.81:0/1055323628 shutdown_connections 2024-05-09T00:14:28.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fcc914b80 1 -- 172.21.15.81:0/1055323628 wait complete. 2024-05-09T00:14:28.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.905+0000 7f8fcc914b80 20 client.18759 trim_cache size 0 max 16384 2024-05-09T00:14:28.911 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:14:28.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.906+0000 7f8fc075a700 1 -- 172.21.15.81:0/543844687 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8fa40a1290 msgr2=0x7f8fa40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.906+0000 7f8fc075a700 1 --2- 172.21.15.81:0/543844687 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8fa40a1290 0x7f8fa40a3750 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4005950 tx=0x7f8fb40058e0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.906+0000 7f8fc075a700 1 -- 172.21.15.81:0/543844687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb8105160 msgr2=0x7f8fb8198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.906+0000 7f8fc075a700 1 --2- 172.21.15.81:0/543844687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb8105160 0x7f8fb8198740 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8000c00 tx=0x7f8fa80036f0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.906+0000 7f8fc075a700 1 -- 172.21.15.81:0/543844687 shutdown_connections 2024-05-09T00:14:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.906+0000 7f8fc075a700 1 --2- 172.21.15.81:0/543844687 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f8fa40a1290 0x7f8fa40a3750 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.906+0000 7f8fc075a700 1 --2- 172.21.15.81:0/543844687 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8fb8100060 0x7f8fb8198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.906+0000 7f8fc075a700 1 --2- 172.21.15.81:0/543844687 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8fb8198cd0 0x7f8fb81a3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.906+0000 7f8fc075a700 1 --2- 172.21.15.81:0/543844687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8fb8105160 0x7f8fb8198740 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.906+0000 7f8fc075a700 1 -- 172.21.15.81:0/543844687 >> 172.21.15.81:0/543844687 conn(0x7f8fb8076f40 msgr2=0x7f8fb80fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.906+0000 7f8fc075a700 1 -- 172.21.15.81:0/543844687 shutdown_connections 2024-05-09T00:14:28.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:28.906+0000 7f8fc075a700 1 -- 172.21.15.81:0/543844687 wait complete. 2024-05-09T00:14:28.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:14:29.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.042+0000 7fe9efadd700 1 -- 172.21.15.81:0/2909061863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e8100a10 msgr2=0x7fe9e8104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:29.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.042+0000 7fe9efadd700 1 --2- 172.21.15.81:0/2909061863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e8100a10 0x7fe9e8104a40 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009990 tx=0x7fe9e4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.042+0000 7fe9efadd700 1 -- 172.21.15.81:0/2909061863 shutdown_connections 2024-05-09T00:14:29.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.042+0000 7fe9efadd700 1 --2- 172.21.15.81:0/2909061863 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9e8105170 0x7fe9e810ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.042+0000 7fe9efadd700 1 --2- 172.21.15.81:0/2909061863 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e8100060 0x7fe9e8100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.042+0000 7fe9efadd700 1 --2- 172.21.15.81:0/2909061863 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e8100a10 0x7fe9e8104a40 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.042+0000 7fe9efadd700 1 -- 172.21.15.81:0/2909061863 >> 172.21.15.81:0/2909061863 conn(0x7fe9e8076f30 msgr2=0x7fe9e8077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.042+0000 7fe9efadd700 1 -- 172.21.15.81:0/2909061863 shutdown_connections 2024-05-09T00:14:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.042+0000 7fe9efadd700 1 -- 172.21.15.81:0/2909061863 wait complete. 2024-05-09T00:14:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.043+0000 7fe9efadd700 1 Processor -- start 2024-05-09T00:14:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.043+0000 7fe9efadd700 1 -- start start 2024-05-09T00:14:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.043+0000 7fe9efadd700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9e8100060 0x7fe9e8197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.043+0000 7fe9efadd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e8105170 0x7fe9e8197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.043+0000 7fe9efadd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e819be30 0x7fe9e819c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.043+0000 7fe9efadd700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e819c8b0 con 0x7fe9e8105170 2024-05-09T00:14:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.043+0000 7fe9efadd700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e819ca20 con 0x7fe9e8100060 2024-05-09T00:14:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.043+0000 7fe9efadd700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e819cbe0 con 0x7fe9e819be30 2024-05-09T00:14:29.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.043+0000 7fe9ed078700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e8105170 0x7fe9e8197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.043+0000 7fe9ed078700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e8105170 0x7fe9e8197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39402/0 (socket says 172.21.15.81:39402) 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.043+0000 7fe9ed078700 1 -- 172.21.15.81:0/4269544003 learned_addr learned my addr 172.21.15.81:0/4269544003 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.044+0000 7fe9ee07a700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e819be30 0x7fe9e819c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.044+0000 7fe9ed078700 1 -- 172.21.15.81:0/4269544003 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e819be30 msgr2=0x7fe9e819c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.044+0000 7fe9ed078700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e819be30 0x7fe9e819c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.044+0000 7fe9ed078700 1 -- 172.21.15.81:0/4269544003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9e8100060 msgr2=0x7fe9e8197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.044+0000 7fe9ed879700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9e8100060 0x7fe9e8197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.044+0000 7fe9ed078700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9e8100060 0x7fe9e8197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.044+0000 7fe9ed078700 1 -- 172.21.15.81:0/4269544003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e40095f0 con 0x7fe9e8105170 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.044+0000 7fe9ed879700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9e8100060 0x7fe9e8197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.044+0000 7fe9ed078700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e8105170 0x7fe9e8197a90 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4000c00 tx=0x7fe9e40036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.044+0000 7fe9daffd700 1 -- 172.21.15.81:0/4269544003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e401d070 con 0x7fe9e8105170 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.044+0000 7fe9daffd700 1 -- 172.21.15.81:0/4269544003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe9e400fb30 con 0x7fe9e8105170 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.044+0000 7fe9efadd700 1 -- 172.21.15.81:0/4269544003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e81a40e0 con 0x7fe9e8105170 2024-05-09T00:14:29.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.044+0000 7fe9daffd700 1 -- 172.21.15.81:0/4269544003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4022bf0 con 0x7fe9e8105170 2024-05-09T00:14:29.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.044+0000 7fe9efadd700 1 -- 172.21.15.81:0/4269544003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e81a4560 con 0x7fe9e8105170 2024-05-09T00:14:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.046+0000 7fe9daffd700 1 -- 172.21.15.81:0/4269544003 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe9e400fca0 con 0x7fe9e8105170 2024-05-09T00:14:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.046+0000 7fe9daffd700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe9d40a1310 0x7fe9d40a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.047+0000 7fe9daffd700 1 -- 172.21.15.81:0/4269544003 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe9e40ce270 con 0x7fe9e8105170 2024-05-09T00:14:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.047+0000 7fe9ed879700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe9d40a1310 0x7fe9d40a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.047+0000 7fe9ed879700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe9d40a1310 0x7fe9d40a37d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc005fd0 tx=0x7fe9dc005dc0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.047+0000 7fe9fbc97b80 1 Processor -- start 2024-05-09T00:14:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9fbc97b80 1 -- start start 2024-05-09T00:14:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9fbc97b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2de00 0x562511f2e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9fbc97b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2e720 0x562511f28350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9fbc97b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f28890 0x562511f28cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9fbc97b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562511e7f150 con 0x562511f2e720 2024-05-09T00:14:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9fbc97b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562511e7cb10 con 0x562511f28890 2024-05-09T00:14:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9fbc97b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x562511e78400 con 0x562511f2de00 2024-05-09T00:14:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9ed078700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2e720 0x562511f28350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9ed078700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2e720 0x562511f28350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39408/0 (socket says 172.21.15.81:39408) 2024-05-09T00:14:29.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9ed078700 1 -- 172.21.15.81:0/1921931928 learned_addr learned my addr 172.21.15.81:0/1921931928 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:29.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9ee07a700 1 --2- 172.21.15.81:0/1921931928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f28890 0x562511f28cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9ed879700 1 --2- 172.21.15.81:0/1921931928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2de00 0x562511f2e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9ed078700 1 -- 172.21.15.81:0/1921931928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2de00 msgr2=0x562511f2e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:29.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9ed078700 1 --2- 172.21.15.81:0/1921931928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2de00 0x562511f2e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9ed078700 1 -- 172.21.15.81:0/1921931928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f28890 msgr2=0x562511f28cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:29.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9ed078700 1 --2- 172.21.15.81:0/1921931928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f28890 0x562511f28cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9ed078700 1 -- 172.21.15.81:0/1921931928 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562511cf93b0 con 0x562511f2e720 2024-05-09T00:14:29.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9ee07a700 1 --2- 172.21.15.81:0/1921931928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f28890 0x562511f28cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:29.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.048+0000 7fe9ed078700 1 --2- 172.21.15.81:0/1921931928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2e720 0x562511f28350 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fe9e409b0e0 tx=0x7fe9e4022650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebdc29bbd72e5f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:29.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.049+0000 7fe9d3fff700 1 -- 172.21.15.81:0/1921931928 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e40a1040 con 0x562511f2e720 2024-05-09T00:14:29.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.049+0000 7fe9d3fff700 1 -- 172.21.15.81:0/1921931928 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe9e409f210 con 0x562511f2e720 2024-05-09T00:14:29.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.049+0000 7fe9d3fff700 1 -- 172.21.15.81:0/1921931928 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e409b840 con 0x562511f2e720 2024-05-09T00:14:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.049+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/1921931928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2e720 msgr2=0x562511f28350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.049+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/1921931928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2e720 0x562511f28350 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fe9e409b0e0 tx=0x7fe9e4022650 comp rx=0 tx=0).stop 2024-05-09T00:14:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.049+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/1921931928 shutdown_connections 2024-05-09T00:14:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.049+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/1921931928 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f28890 0x562511f28cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.049+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/1921931928 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2de00 0x562511f2e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.049+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/1921931928 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2e720 0x562511f28350 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.049+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/1921931928 >> 172.21.15.81:0/1921931928 conn(0x562511e86210 msgr2=0x562511f22df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.049+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/1921931928 shutdown_connections 2024-05-09T00:14:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.049+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/1921931928 wait complete. 2024-05-09T00:14:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.050+0000 7fe9fbc97b80 1 -- start start 2024-05-09T00:14:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.050+0000 7fe9fbc97b80 1 Processor -- start 2024-05-09T00:14:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.050+0000 7fe9fbc97b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f28890 0x562511f346e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.050+0000 7fe9fbc97b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f2de00 0x562511f31960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.050+0000 7fe9fbc97b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2e720 0x562511f320a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.050+0000 7fe9fbc97b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562511e14560 con 0x562511f28890 2024-05-09T00:14:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.050+0000 7fe9fbc97b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562511e14200 con 0x562511f2de00 2024-05-09T00:14:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.050+0000 7fe9fbc97b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x562511cfb6a0 con 0x562511f2e720 2024-05-09T00:14:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.050+0000 7fe9fbc97b80 10 client.0 _ll_register_callbacks cb 0x562511e1db30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.050+0000 7fe9ed879700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f28890 0x562511f346e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.050+0000 7fe9ed879700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f28890 0x562511f346e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39414/0 (socket says 172.21.15.81:39414) 2024-05-09T00:14:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.050+0000 7fe9ed879700 1 -- 172.21.15.81:0/4111066494 learned_addr learned my addr 172.21.15.81:0/4111066494 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.050+0000 7fe9ee07a700 1 --2- 172.21.15.81:0/4111066494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2e720 0x562511f320a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.050+0000 7fe9ed078700 1 --2- 172.21.15.81:0/4111066494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f2de00 0x562511f31960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9ed879700 1 -- 172.21.15.81:0/4111066494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2e720 msgr2=0x562511f320a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9ed879700 1 --2- 172.21.15.81:0/4111066494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2e720 0x562511f320a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9ed879700 1 -- 172.21.15.81:0/4111066494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f2de00 msgr2=0x562511f31960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9ed879700 1 --2- 172.21.15.81:0/4111066494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f2de00 0x562511f31960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9ed879700 1 -- 172.21.15.81:0/4111066494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e81a4560 con 0x562511f28890 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9ed879700 1 --2- 172.21.15.81:0/4111066494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f28890 0x562511f346e0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00f7a0 tx=0x7fe9dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4386fb259813cb server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9d17fa700 1 -- 172.21.15.81:0/4111066494 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc01d630 con 0x562511f28890 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9d17fa700 1 -- 172.21.15.81:0/4111066494 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe9dc01d790 con 0x562511f28890 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/4111066494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562511dd1270 con 0x562511f28890 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9d17fa700 1 -- 172.21.15.81:0/4111066494 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9dc01d950 con 0x562511f28890 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9fbc97b80 10 client.18771 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/4111066494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562511ca5b60 con 0x562511f28890 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9d17fa700 1 -- 172.21.15.81:0/4111066494 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562511dd1270 con 0x562511f28890 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9d17fa700 1 -- 172.21.15.81:0/4111066494 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe9dc023020 con 0x562511f28890 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9fbc97b80 10 client.18771 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:29.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9fbc97b80 10 client.18771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:14:29.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9fbc97b80 20 client.18771 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:29.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/4111066494 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562511f41e90 0x562511f442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9fbc97b80 4 client.18771 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:14:29.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.051+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/4111066494 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562511ef7810 con 0x562511f41e90 2024-05-09T00:14:29.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.052+0000 7fe9ed078700 1 --2- 172.21.15.81:0/4111066494 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562511f41e90 0x562511f442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.052+0000 7fe9ed078700 1 --2- 172.21.15.81:0/4111066494 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562511f41e90 0x562511f442b0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e1d8074cd4467f5 server_cookie=4b9178c348da057a in_seq=0 out_seq=0 2024-05-09T00:14:29.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.052+0000 7fe9d17fa700 10 client.18771 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:29.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9d17fa700 1 -- 172.21.15.81:0/4111066494 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562511ef7810 con 0x562511f41e90 2024-05-09T00:14:29.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9d17fa700 10 client.18771 handle_command_reply: tid=0 2024-05-09T00:14:29.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9fbc97b80 1 client.18771 shutdown 2024-05-09T00:14:29.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/4111066494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f28890 msgr2=0x562511f346e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:29.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/4111066494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f28890 0x562511f346e0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00f7a0 tx=0x7fe9dc004750 comp rx=0 tx=0).stop 2024-05-09T00:14:29.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/4111066494 shutdown_connections 2024-05-09T00:14:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/4111066494 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562511f41e90 0x562511f442b0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/4111066494 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2e720 0x562511f320a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/4111066494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f28890 0x562511f346e0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9d17fa700 0 client.18771 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/4111066494 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f2de00 0x562511f31960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/4111066494 >> 172.21.15.81:0/4111066494 conn(0x562511e86210 msgr2=0x562511f225a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/4111066494 shutdown_connections 2024-05-09T00:14:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/4111066494 wait complete. 2024-05-09T00:14:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.053+0000 7fe9fbc97b80 20 client.18771 trim_cache size 0 max 16384 2024-05-09T00:14:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.066+0000 7fe9fbc97b80 1 Processor -- start 2024-05-09T00:14:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.066+0000 7fe9fbc97b80 1 -- start start 2024-05-09T00:14:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.066+0000 7fe9fbc97b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f28890 0x562511f31900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.066+0000 7fe9fbc97b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2de00 0x562511f22d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.066+0000 7fe9fbc97b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f2e720 0x562511f34210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.066+0000 7fe9fbc97b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562511f494b0 con 0x562511f2de00 2024-05-09T00:14:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.066+0000 7fe9fbc97b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562511f1d800 con 0x562511f2e720 2024-05-09T00:14:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.066+0000 7fe9fbc97b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x562511f32680 con 0x562511f28890 2024-05-09T00:14:29.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.066+0000 7fe9ed078700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2de00 0x562511f22d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.066+0000 7fe9ed078700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2de00 0x562511f22d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39416/0 (socket says 172.21.15.81:39416) 2024-05-09T00:14:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.066+0000 7fe9ed078700 1 -- 172.21.15.81:0/3595726174 learned_addr learned my addr 172.21.15.81:0/3595726174 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.067+0000 7fe9ed879700 1 --2- 172.21.15.81:0/3595726174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f28890 0x562511f31900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.067+0000 7fe9ee07a700 1 --2- 172.21.15.81:0/3595726174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f2e720 0x562511f34210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.067+0000 7fe9ed078700 1 -- 172.21.15.81:0/3595726174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f28890 msgr2=0x562511f31900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.067+0000 7fe9ed078700 1 --2- 172.21.15.81:0/3595726174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f28890 0x562511f31900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.067+0000 7fe9ed078700 1 -- 172.21.15.81:0/3595726174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f2e720 msgr2=0x562511f34210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.067+0000 7fe9ed078700 1 --2- 172.21.15.81:0/3595726174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f2e720 0x562511f34210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.067+0000 7fe9ed078700 1 -- 172.21.15.81:0/3595726174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562511e3e560 con 0x562511f2de00 2024-05-09T00:14:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.067+0000 7fe9ee07a700 1 --2- 172.21.15.81:0/3595726174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f2e720 0x562511f34210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.067+0000 7fe9ed078700 1 --2- 172.21.15.81:0/3595726174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2de00 0x562511f22d20 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c010 tx=0x7fe9e4009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d731512670f7f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.067+0000 7fe9d8da4700 1 -- 172.21.15.81:0/3595726174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e40a1040 con 0x562511f2de00 2024-05-09T00:14:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.067+0000 7fe9d8da4700 1 -- 172.21.15.81:0/3595726174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe9e40a37d0 con 0x562511f2de00 2024-05-09T00:14:29.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.067+0000 7fe9d8da4700 1 -- 172.21.15.81:0/3595726174 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e409aba0 con 0x562511f2de00 2024-05-09T00:14:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/3595726174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2de00 msgr2=0x562511f22d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/3595726174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2de00 0x562511f22d20 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fe9e400c010 tx=0x7fe9e4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/3595726174 shutdown_connections 2024-05-09T00:14:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/3595726174 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f2e720 0x562511f34210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/3595726174 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f28890 0x562511f31900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/3595726174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2de00 0x562511f22d20 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/3595726174 >> 172.21.15.81:0/3595726174 conn(0x562511e86210 msgr2=0x562511f311f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/3595726174 shutdown_connections 2024-05-09T00:14:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/3595726174 wait complete. 2024-05-09T00:14:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 -- start start 2024-05-09T00:14:29.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 Processor -- start 2024-05-09T00:14:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f28890 0x562511f39220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2de00 0x562511f29930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2e720 0x562511f29eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x562511f2a5c0 con 0x562511f2de00 2024-05-09T00:14:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x562511f2a730 con 0x562511f28890 2024-05-09T00:14:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x562511f2a8f0 con 0x562511f2e720 2024-05-09T00:14:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.068+0000 7fe9fbc97b80 10 client.0 _ll_register_callbacks cb 0x562511e1db30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9ed078700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2de00 0x562511f29930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9ed078700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2de00 0x562511f29930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39418/0 (socket says 172.21.15.81:39418) 2024-05-09T00:14:29.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9ed078700 1 -- 172.21.15.81:0/3466698275 learned_addr learned my addr 172.21.15.81:0/3466698275 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9ee07a700 1 --2- 172.21.15.81:0/3466698275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2e720 0x562511f29eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9ed078700 1 -- 172.21.15.81:0/3466698275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2e720 msgr2=0x562511f29eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9ed078700 1 --2- 172.21.15.81:0/3466698275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2e720 0x562511f29eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9ed879700 1 --2- 172.21.15.81:0/3466698275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f28890 0x562511f39220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9ed078700 1 -- 172.21.15.81:0/3466698275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f28890 msgr2=0x562511f39220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9ed078700 1 --2- 172.21.15.81:0/3466698275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f28890 0x562511f39220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9ed078700 1 -- 172.21.15.81:0/3466698275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562511cf93b0 con 0x562511f2de00 2024-05-09T00:14:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9ed879700 1 --2- 172.21.15.81:0/3466698275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f28890 0x562511f39220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:29.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9ed078700 1 --2- 172.21.15.81:0/3466698275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2de00 0x562511f29930 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fe9e40cbf10 tx=0x7fe9e4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826e1aad0b7c8e57 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9d17fa700 1 -- 172.21.15.81:0/3466698275 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e40a1040 con 0x562511f2de00 2024-05-09T00:14:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9d17fa700 1 -- 172.21.15.81:0/3466698275 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe9e4084be0 con 0x562511f2de00 2024-05-09T00:14:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/3466698275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe9e409f210 con 0x562511f2de00 2024-05-09T00:14:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9d17fa700 1 -- 172.21.15.81:0/3466698275 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9e409b640 con 0x562511f2de00 2024-05-09T00:14:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9fbc97b80 10 client.18777 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/3466698275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562511cfdcd0 con 0x562511f2de00 2024-05-09T00:14:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9d17fa700 1 -- 172.21.15.81:0/3466698275 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe9e409f210 con 0x562511f2de00 2024-05-09T00:14:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.069+0000 7fe9d17fa700 1 -- 172.21.15.81:0/3466698275 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe9e40a3460 con 0x562511f2de00 2024-05-09T00:14:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.070+0000 7fe9fbc97b80 10 client.18777 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:29.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.070+0000 7fe9fbc97b80 10 client.18777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:14:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.070+0000 7fe9fbc97b80 20 client.18777 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.070+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/3466698275 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562511f986b0 0x562511f9aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.070+0000 7fe9fbc97b80 4 client.18777 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:14:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.070+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/3466698275 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562511e70ec0 con 0x562511f986b0 2024-05-09T00:14:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.070+0000 7fe9ed879700 1 --2- 172.21.15.81:0/3466698275 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562511f986b0 0x562511f9aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.070+0000 7fe9ed879700 1 --2- 172.21.15.81:0/3466698275 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562511f986b0 0x562511f9aaa0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c55c3a6f3e930c04 server_cookie=f960458fd9709d8f in_seq=0 out_seq=0 2024-05-09T00:14:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.070+0000 7fe9d17fa700 10 client.18777 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.070+0000 7fe9d17fa700 1 -- 172.21.15.81:0/3466698275 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562511e70ec0 con 0x562511f986b0 2024-05-09T00:14:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.070+0000 7fe9d17fa700 10 client.18777 handle_command_reply: tid=0 2024-05-09T00:14:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.070+0000 7fe9fbc97b80 1 client.18777 shutdown 2024-05-09T00:14:29.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/3466698275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2de00 msgr2=0x562511f29930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/3466698275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2de00 0x562511f29930 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fe9e40cbf10 tx=0x7fe9e4009310 comp rx=0 tx=0).stop 2024-05-09T00:14:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/3466698275 shutdown_connections 2024-05-09T00:14:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/3466698275 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x562511f986b0 0x562511f9aaa0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/3466698275 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x562511f28890 0x562511f39220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/3466698275 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x562511f2e720 0x562511f29eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9fbc97b80 1 --2- 172.21.15.81:0/3466698275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562511f2de00 0x562511f29930 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9d17fa700 0 client.18777 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/3466698275 >> 172.21.15.81:0/3466698275 conn(0x562511e86210 msgr2=0x562511f2d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/3466698275 shutdown_connections 2024-05-09T00:14:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9fbc97b80 1 -- 172.21.15.81:0/3466698275 wait complete. 2024-05-09T00:14:29.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9fbc97b80 20 client.18777 trim_cache size 0 max 16384 2024-05-09T00:14:29.077 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:14:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9efadd700 1 -- 172.21.15.81:0/4269544003 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe9d40a1310 msgr2=0x7fe9d40a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9efadd700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe9d40a1310 0x7fe9d40a37d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc005fd0 tx=0x7fe9dc005dc0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9efadd700 1 -- 172.21.15.81:0/4269544003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e8105170 msgr2=0x7fe9e8197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9efadd700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e8105170 0x7fe9e8197a90 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4000c00 tx=0x7fe9e40036f0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9efadd700 1 -- 172.21.15.81:0/4269544003 shutdown_connections 2024-05-09T00:14:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9efadd700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe9d40a1310 0x7fe9d40a37d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9efadd700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe9e8100060 0x7fe9e8197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9efadd700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe9e819be30 0x7fe9e819c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9efadd700 1 --2- 172.21.15.81:0/4269544003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9e8105170 0x7fe9e8197a90 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9efadd700 1 -- 172.21.15.81:0/4269544003 >> 172.21.15.81:0/4269544003 conn(0x7fe9e8076f30 msgr2=0x7fe9e80696f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9efadd700 1 -- 172.21.15.81:0/4269544003 shutdown_connections 2024-05-09T00:14:29.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:29.071+0000 7fe9efadd700 1 -- 172.21.15.81:0/4269544003 wait complete. 2024-05-09T00:14:29.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:28 smithi150 ceph-mon[46187]: pgmap v358: 97 pgs: 97 active+clean; 2.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:14:29.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:28 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2534886693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:14:29.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:28 smithi171 ceph-mon[47351]: pgmap v358: 97 pgs: 97 active+clean; 2.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:14:29.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:28 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2534886693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:14:29.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:28 smithi081 ceph-mon[42474]: pgmap v358: 97 pgs: 97 active+clean; 2.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:14:29.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:28 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2534886693' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:14:30.081 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-09T00:14:30.081 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-05-09T00:14:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.223+0000 7fa43ef63700 1 -- 172.21.15.81:0/1734126738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa438068c90 msgr2=0x7fa438105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.223+0000 7fa43ef63700 1 --2- 172.21.15.81:0/1734126738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa438068c90 0x7fa438105b60 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fa4240099c0 tx=0x7fa424009cd0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.223+0000 7fa43ef63700 1 -- 172.21.15.81:0/1734126738 shutdown_connections 2024-05-09T00:14:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.223+0000 7fa43ef63700 1 --2- 172.21.15.81:0/1734126738 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380682e0 0x7fa4380686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.223+0000 7fa43ef63700 1 --2- 172.21.15.81:0/1734126738 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa438106290 0x7fa43810de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.223+0000 7fa43ef63700 1 --2- 172.21.15.81:0/1734126738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa438068c90 0x7fa438105b60 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.223+0000 7fa43ef63700 1 -- 172.21.15.81:0/1734126738 >> 172.21.15.81:0/1734126738 conn(0x7fa438076f40 msgr2=0x7fa438077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.223+0000 7fa43ef63700 1 -- 172.21.15.81:0/1734126738 shutdown_connections 2024-05-09T00:14:30.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.223+0000 7fa43ef63700 1 -- 172.21.15.81:0/1734126738 wait complete. 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43ef63700 1 Processor -- start 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43ef63700 1 -- start start 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43ef63700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380682e0 0x7fa438197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43ef63700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa438106290 0x7fa4381978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43ef63700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43819bc70 0x7fa43819c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43ef63700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43819c6f0 con 0x7fa43819bc70 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43ef63700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43819c860 con 0x7fa4380682e0 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43ef63700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43819ca20 con 0x7fa438106290 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43d500700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43819bc70 0x7fa43819c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43d500700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43819bc70 0x7fa43819c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39436/0 (socket says 172.21.15.81:39436) 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43d500700 1 -- 172.21.15.81:0/701574331 learned_addr learned my addr 172.21.15.81:0/701574331 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43ccff700 1 --2- 172.21.15.81:0/701574331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380682e0 0x7fa438197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa437fff700 1 --2- 172.21.15.81:0/701574331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa438106290 0x7fa4381978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43d500700 1 -- 172.21.15.81:0/701574331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa438106290 msgr2=0x7fa4381978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43d500700 1 --2- 172.21.15.81:0/701574331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa438106290 0x7fa4381978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43d500700 1 -- 172.21.15.81:0/701574331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380682e0 msgr2=0x7fa438197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43d500700 1 --2- 172.21.15.81:0/701574331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380682e0 0x7fa438197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43d500700 1 -- 172.21.15.81:0/701574331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4240095f0 con 0x7fa43819bc70 2024-05-09T00:14:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.224+0000 7fa43d500700 1 --2- 172.21.15.81:0/701574331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43819bc70 0x7fa43819c0f0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fa430007ee0 tx=0x7fa43000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.225+0000 7fa435ffb700 1 -- 172.21.15.81:0/701574331 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430017070 con 0x7fa43819bc70 2024-05-09T00:14:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.225+0000 7fa435ffb700 1 -- 172.21.15.81:0/701574331 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa43000f040 con 0x7fa43819bc70 2024-05-09T00:14:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.225+0000 7fa43ef63700 1 -- 172.21.15.81:0/701574331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4381a3f80 con 0x7fa43819bc70 2024-05-09T00:14:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.225+0000 7fa435ffb700 1 -- 172.21.15.81:0/701574331 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430005580 con 0x7fa43819bc70 2024-05-09T00:14:30.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.225+0000 7fa43ef63700 1 -- 172.21.15.81:0/701574331 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4381a43b0 con 0x7fa43819bc70 2024-05-09T00:14:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.227+0000 7fa435ffb700 1 -- 172.21.15.81:0/701574331 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa43000db20 con 0x7fa43819bc70 2024-05-09T00:14:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.228+0000 7fa435ffb700 1 --2- 172.21.15.81:0/701574331 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa4280a1290 0x7fa4280a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.228+0000 7fa435ffb700 1 -- 172.21.15.81:0/701574331 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fa4300cc3e0 con 0x7fa43819bc70 2024-05-09T00:14:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.228+0000 7fa43ccff700 1 --2- 172.21.15.81:0/701574331 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa4280a1290 0x7fa4280a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.228+0000 7fa43ccff700 1 --2- 172.21.15.81:0/701574331 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa4280a1290 0x7fa4280a3750 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005950 tx=0x7fa42c00b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.228+0000 7fa44b11db80 1 Processor -- start 2024-05-09T00:14:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa44b11db80 1 -- start start 2024-05-09T00:14:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa44b11db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf8270 0x55b137cf8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa44b11db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8b90 0x55b137cf27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa44b11db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf2d20 0x55b137cf3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa44b11db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b137c451d0 con 0x55b137cf8270 2024-05-09T00:14:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa44b11db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b137c42b90 con 0x55b137cf8b90 2024-05-09T00:14:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa44b11db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b137c3e480 con 0x55b137cf2d20 2024-05-09T00:14:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa43ccff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf8270 0x55b137cf8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa43ccff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf8270 0x55b137cf8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39440/0 (socket says 172.21.15.81:39440) 2024-05-09T00:14:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa43ccff700 1 -- 172.21.15.81:0/1033598179 learned_addr learned my addr 172.21.15.81:0/1033598179 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:30.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa437fff700 1 --2- 172.21.15.81:0/1033598179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8b90 0x55b137cf27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa43ccff700 1 -- 172.21.15.81:0/1033598179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf2d20 msgr2=0x55b137cf3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa43ccff700 1 --2- 172.21.15.81:0/1033598179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf2d20 0x55b137cf3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa43ccff700 1 -- 172.21.15.81:0/1033598179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8b90 msgr2=0x55b137cf27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa43ccff700 1 --2- 172.21.15.81:0/1033598179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8b90 0x55b137cf27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa43ccff700 1 -- 172.21.15.81:0/1033598179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b137abf430 con 0x55b137cf8270 2024-05-09T00:14:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa43ccff700 1 --2- 172.21.15.81:0/1033598179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf8270 0x55b137cf8650 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fa42c010fa0 tx=0x7fa42c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f08b1542b4f165 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa422ffd700 1 -- 172.21.15.81:0/1033598179 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c01e620 con 0x55b137cf8270 2024-05-09T00:14:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa422ffd700 1 -- 172.21.15.81:0/1033598179 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa42c015070 con 0x55b137cf8270 2024-05-09T00:14:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.229+0000 7fa422ffd700 1 -- 172.21.15.81:0/1033598179 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c01c980 con 0x55b137cf8270 2024-05-09T00:14:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.230+0000 7fa44b11db80 1 -- 172.21.15.81:0/1033598179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf8270 msgr2=0x55b137cf8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.230+0000 7fa44b11db80 1 --2- 172.21.15.81:0/1033598179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf8270 0x55b137cf8650 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fa42c010fa0 tx=0x7fa42c013000 comp rx=0 tx=0).stop 2024-05-09T00:14:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.230+0000 7fa44b11db80 1 -- 172.21.15.81:0/1033598179 shutdown_connections 2024-05-09T00:14:30.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.230+0000 7fa44b11db80 1 --2- 172.21.15.81:0/1033598179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf2d20 0x55b137cf3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.230+0000 7fa44b11db80 1 --2- 172.21.15.81:0/1033598179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf8270 0x55b137cf8650 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.230+0000 7fa44b11db80 1 --2- 172.21.15.81:0/1033598179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8b90 0x55b137cf27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.230+0000 7fa44b11db80 1 -- 172.21.15.81:0/1033598179 >> 172.21.15.81:0/1033598179 conn(0x55b137c4c290 msgr2=0x55b137ce8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.230+0000 7fa44b11db80 1 -- 172.21.15.81:0/1033598179 shutdown_connections 2024-05-09T00:14:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.230+0000 7fa44b11db80 1 -- 172.21.15.81:0/1033598179 wait complete. 2024-05-09T00:14:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa44b11db80 1 -- start start 2024-05-09T00:14:30.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa44b11db80 1 Processor -- start 2024-05-09T00:14:30.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa44b11db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf2d20 0x55b137cfc000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa44b11db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8270 0x55b137cfc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa44b11db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf8b90 0x55b137cfca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa44b11db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b137bda5e0 con 0x55b137cf2d20 2024-05-09T00:14:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa44b11db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b137bda280 con 0x55b137cf8270 2024-05-09T00:14:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa44b11db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b137ac1720 con 0x55b137cf8b90 2024-05-09T00:14:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa44b11db80 10 client.0 _ll_register_callbacks cb 0x55b137be3bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa43ccff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf2d20 0x55b137cfc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa43ccff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf2d20 0x55b137cfc000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39442/0 (socket says 172.21.15.81:39442) 2024-05-09T00:14:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa43ccff700 1 -- 172.21.15.81:0/3285355127 learned_addr learned my addr 172.21.15.81:0/3285355127 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa43d500700 1 --2- 172.21.15.81:0/3285355127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf8b90 0x55b137cfca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa437fff700 1 --2- 172.21.15.81:0/3285355127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8270 0x55b137cfc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa43ccff700 1 -- 172.21.15.81:0/3285355127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf8b90 msgr2=0x55b137cfca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa43ccff700 1 --2- 172.21.15.81:0/3285355127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf8b90 0x55b137cfca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa43ccff700 1 -- 172.21.15.81:0/3285355127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8270 msgr2=0x55b137cfc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa43ccff700 1 --2- 172.21.15.81:0/3285355127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8270 0x55b137cfc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.231+0000 7fa43ccff700 1 -- 172.21.15.81:0/3285355127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c010c50 con 0x55b137cf2d20 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa43ccff700 1 --2- 172.21.15.81:0/3285355127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf2d20 0x55b137cfc000 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005d90 tx=0x7fa42c005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f246fe205ca551b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa417fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa417fff700 1 -- 172.21.15.81:0/3285355127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c02d070 con 0x55b137cf2d20 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa417fff700 1 -- 172.21.15.81:0/3285355127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fa42c017070 con 0x55b137cf2d20 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa44b11db80 1 -- 172.21.15.81:0/3285355127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b137b972f0 con 0x55b137cf2d20 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa417fff700 1 -- 172.21.15.81:0/3285355127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa42c00be60 con 0x55b137cf2d20 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa44b11db80 10 client.18789 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa44b11db80 1 -- 172.21.15.81:0/3285355127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b137a6bbe0 con 0x55b137cf2d20 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa417fff700 1 -- 172.21.15.81:0/3285355127 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa42c03e020 con 0x55b137cf2d20 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa417fff700 1 -- 172.21.15.81:0/3285355127 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa42c01c8f0 con 0x55b137cf2d20 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa44b11db80 10 client.18789 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa44b11db80 10 client.18789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa44b11db80 20 client.18789 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:30.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa44b11db80 1 --2- 172.21.15.81:0/3285355127 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b137d0c5c0 0x55b137d0e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa44b11db80 4 client.18789 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:14:30.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.232+0000 7fa44b11db80 1 -- 172.21.15.81:0/3285355127 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b137cbd890 con 0x55b137d0c5c0 2024-05-09T00:14:30.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.233+0000 7fa437fff700 1 --2- 172.21.15.81:0/3285355127 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b137d0c5c0 0x55b137d0e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.233+0000 7fa417fff700 10 client.18789 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:30.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.233+0000 7fa437fff700 1 --2- 172.21.15.81:0/3285355127 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b137d0c5c0 0x55b137d0e9e0 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1419bb7ffa630945 server_cookie=c11ab5bc7cbb548e in_seq=0 out_seq=0 2024-05-09T00:14:30.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa417fff700 1 -- 172.21.15.81:0/3285355127 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b137cbd890 con 0x55b137d0c5c0 2024-05-09T00:14:30.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa417fff700 10 client.18789 handle_command_reply: tid=0 2024-05-09T00:14:30.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa44b11db80 1 client.18789 shutdown 2024-05-09T00:14:30.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa44b11db80 1 -- 172.21.15.81:0/3285355127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf2d20 msgr2=0x55b137cfc000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa44b11db80 1 --2- 172.21.15.81:0/3285355127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf2d20 0x55b137cfc000 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005d90 tx=0x7fa42c005270 comp rx=0 tx=0).stop 2024-05-09T00:14:30.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa44b11db80 1 -- 172.21.15.81:0/3285355127 shutdown_connections 2024-05-09T00:14:30.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa44b11db80 1 --2- 172.21.15.81:0/3285355127 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b137d0c5c0 0x55b137d0e9e0 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa44b11db80 1 --2- 172.21.15.81:0/3285355127 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf8b90 0x55b137cfca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa44b11db80 1 --2- 172.21.15.81:0/3285355127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf2d20 0x55b137cfc000 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa417fff700 0 client.18789 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:30.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa44b11db80 1 --2- 172.21.15.81:0/3285355127 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8270 0x55b137cfc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa44b11db80 1 -- 172.21.15.81:0/3285355127 >> 172.21.15.81:0/3285355127 conn(0x55b137c4c290 msgr2=0x55b137ce8620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:30.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa44b11db80 1 -- 172.21.15.81:0/3285355127 shutdown_connections 2024-05-09T00:14:30.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa44b11db80 1 -- 172.21.15.81:0/3285355127 wait complete. 2024-05-09T00:14:30.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.234+0000 7fa44b11db80 20 client.18789 trim_cache size 0 max 16384 2024-05-09T00:14:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa44b11db80 1 Processor -- start 2024-05-09T00:14:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa44b11db80 1 -- start start 2024-05-09T00:14:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa44b11db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf2d20 0x55b137cf7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa44b11db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf8270 0x55b137ce8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa44b11db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8b90 0x55b137cfc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa44b11db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b137cfd650 con 0x55b137cf8270 2024-05-09T00:14:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa44b11db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b137cea6f0 con 0x55b137cf8b90 2024-05-09T00:14:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa44b11db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b137ce5e90 con 0x55b137cf2d20 2024-05-09T00:14:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa437fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf8270 0x55b137ce8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa437fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf8270 0x55b137ce8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39456/0 (socket says 172.21.15.81:39456) 2024-05-09T00:14:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa437fff700 1 -- 172.21.15.81:0/2296211390 learned_addr learned my addr 172.21.15.81:0/2296211390 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:30.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa43ccff700 1 --2- 172.21.15.81:0/2296211390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf2d20 0x55b137cf7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa437fff700 1 -- 172.21.15.81:0/2296211390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf2d20 msgr2=0x55b137cf7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa437fff700 1 --2- 172.21.15.81:0/2296211390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf2d20 0x55b137cf7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa437fff700 1 -- 172.21.15.81:0/2296211390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8b90 msgr2=0x55b137cfc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa43d500700 1 --2- 172.21.15.81:0/2296211390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8b90 0x55b137cfc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa437fff700 1 --2- 172.21.15.81:0/2296211390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8b90 0x55b137cfc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa437fff700 1 -- 172.21.15.81:0/2296211390 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b137c045e0 con 0x55b137cf8270 2024-05-09T00:14:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa43ccff700 1 --2- 172.21.15.81:0/2296211390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf2d20 0x55b137cf7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.252+0000 7fa437fff700 1 --2- 172.21.15.81:0/2296211390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf8270 0x55b137ce8da0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fa424009990 tx=0x7fa424005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52f9df17d99a779 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.253+0000 7fa4237fe700 1 -- 172.21.15.81:0/2296211390 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42401d040 con 0x55b137cf8270 2024-05-09T00:14:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.253+0000 7fa4237fe700 1 -- 172.21.15.81:0/2296211390 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa42401e040 con 0x55b137cf8270 2024-05-09T00:14:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.253+0000 7fa4237fe700 1 -- 172.21.15.81:0/2296211390 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42400ba70 con 0x55b137cf8270 2024-05-09T00:14:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.253+0000 7fa44b11db80 1 -- 172.21.15.81:0/2296211390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf8270 msgr2=0x55b137ce8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.253+0000 7fa44b11db80 1 --2- 172.21.15.81:0/2296211390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf8270 0x55b137ce8da0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fa424009990 tx=0x7fa424005a90 comp rx=0 tx=0).stop 2024-05-09T00:14:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.253+0000 7fa44b11db80 1 -- 172.21.15.81:0/2296211390 shutdown_connections 2024-05-09T00:14:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.253+0000 7fa44b11db80 1 --2- 172.21.15.81:0/2296211390 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8b90 0x55b137cfc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.253+0000 7fa44b11db80 1 --2- 172.21.15.81:0/2296211390 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf2d20 0x55b137cf7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.253+0000 7fa44b11db80 1 --2- 172.21.15.81:0/2296211390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf8270 0x55b137ce8da0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.253+0000 7fa44b11db80 1 -- 172.21.15.81:0/2296211390 >> 172.21.15.81:0/2296211390 conn(0x55b137c4c290 msgr2=0x55b137cf7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.253+0000 7fa44b11db80 1 -- 172.21.15.81:0/2296211390 shutdown_connections 2024-05-09T00:14:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.253+0000 7fa44b11db80 1 -- 172.21.15.81:0/2296211390 wait complete. 2024-05-09T00:14:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa44b11db80 1 -- start start 2024-05-09T00:14:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa44b11db80 1 Processor -- start 2024-05-09T00:14:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa44b11db80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf2d20 0x55b137d021a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa44b11db80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8270 0x55b137d026e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa44b11db80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf8b90 0x55b137d02c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa44b11db80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b137d62b60 con 0x55b137cf2d20 2024-05-09T00:14:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa44b11db80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b137d62cd0 con 0x55b137cf8270 2024-05-09T00:14:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa44b11db80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b137d62e90 con 0x55b137cf8b90 2024-05-09T00:14:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa44b11db80 10 client.0 _ll_register_callbacks cb 0x55b137be3bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa43ccff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf2d20 0x55b137d021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa43ccff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf2d20 0x55b137d021a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39466/0 (socket says 172.21.15.81:39466) 2024-05-09T00:14:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa43ccff700 1 -- 172.21.15.81:0/3511615016 learned_addr learned my addr 172.21.15.81:0/3511615016 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa43d500700 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf8b90 0x55b137d02c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa437fff700 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8270 0x55b137d026e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa43ccff700 1 -- 172.21.15.81:0/3511615016 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf8b90 msgr2=0x55b137d02c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa43ccff700 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf8b90 0x55b137d02c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa43ccff700 1 -- 172.21.15.81:0/3511615016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8270 msgr2=0x55b137d026e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa43ccff700 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8270 0x55b137d026e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa43ccff700 1 -- 172.21.15.81:0/3511615016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43810e650 con 0x55b137cf2d20 2024-05-09T00:14:30.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa437fff700 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8270 0x55b137d026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.254+0000 7fa43d500700 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf8b90 0x55b137d02c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa43ccff700 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf2d20 0x55b137d021a0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005850 tx=0x7fa42c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6bc78f1e48ec72 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa417fff700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa417fff700 1 -- 172.21.15.81:0/3511615016 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c02d030 con 0x55b137cf2d20 2024-05-09T00:14:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa417fff700 1 -- 172.21.15.81:0/3511615016 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fa42c02e070 con 0x55b137cf2d20 2024-05-09T00:14:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa44b11db80 1 -- 172.21.15.81:0/3511615016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa42c015070 con 0x55b137cf2d20 2024-05-09T00:14:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa417fff700 1 -- 172.21.15.81:0/3511615016 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa42c0052e0 con 0x55b137cf2d20 2024-05-09T00:14:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa44b11db80 10 client.18795 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa44b11db80 1 -- 172.21.15.81:0/3511615016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55b137ac3d50 con 0x55b137cf2d20 2024-05-09T00:14:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa417fff700 1 -- 172.21.15.81:0/3511615016 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa42c015070 con 0x55b137cf2d20 2024-05-09T00:14:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa417fff700 1 -- 172.21.15.81:0/3511615016 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa42c0048b0 con 0x55b137cf2d20 2024-05-09T00:14:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa44b11db80 10 client.18795 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa44b11db80 10 client.18795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:14:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa44b11db80 20 client.18795 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa44b11db80 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b137d64270 0x55b137d66690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa44b11db80 4 client.18795 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-09T00:14:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.255+0000 7fa44b11db80 1 -- 172.21.15.81:0/3511615016 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b137c36f40 con 0x55b137d64270 2024-05-09T00:14:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.256+0000 7fa437fff700 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b137d64270 0x55b137d66690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.256+0000 7fa417fff700 10 client.18795 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.256+0000 7fa437fff700 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b137d64270 0x55b137d66690 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fc9a4607f6799b6 server_cookie=be68505eeb4aa8f6 in_seq=0 out_seq=0 2024-05-09T00:14:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa417fff700 1 -- 172.21.15.81:0/3511615016 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b137c36f40 con 0x55b137d64270 2024-05-09T00:14:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa417fff700 10 client.18795 handle_command_reply: tid=0 2024-05-09T00:14:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa44b11db80 1 client.18795 shutdown 2024-05-09T00:14:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa44b11db80 1 -- 172.21.15.81:0/3511615016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf2d20 msgr2=0x55b137d021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa44b11db80 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf2d20 0x55b137d021a0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005850 tx=0x7fa42c01c950 comp rx=0 tx=0).stop 2024-05-09T00:14:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa44b11db80 1 -- 172.21.15.81:0/3511615016 shutdown_connections 2024-05-09T00:14:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa44b11db80 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55b137d64270 0x55b137d66690 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa44b11db80 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55b137cf8b90 0x55b137d02c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa44b11db80 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55b137cf2d20 0x55b137d021a0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa417fff700 0 client.18795 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa44b11db80 1 --2- 172.21.15.81:0/3511615016 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55b137cf8270 0x55b137d026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa44b11db80 1 -- 172.21.15.81:0/3511615016 >> 172.21.15.81:0/3511615016 conn(0x55b137c4c290 msgr2=0x55b137cedc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa44b11db80 1 -- 172.21.15.81:0/3511615016 shutdown_connections 2024-05-09T00:14:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa44b11db80 1 -- 172.21.15.81:0/3511615016 wait complete. 2024-05-09T00:14:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.257+0000 7fa44b11db80 20 client.18795 trim_cache size 0 max 16384 2024-05-09T00:14:30.263 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:14:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "return_code": 0, 2024-05-09T00:14:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "scrub_tag": "6d11be94-7bc7-4b5a-9200-c41cd38577a4", 2024-05-09T00:14:30.264 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": "asynchronous" 2024-05-09T00:14:30.264 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:14:30.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.258+0000 7fa43ef63700 1 -- 172.21.15.81:0/701574331 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa4280a1290 msgr2=0x7fa4280a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.258+0000 7fa43ef63700 1 --2- 172.21.15.81:0/701574331 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa4280a1290 0x7fa4280a3750 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa42c005950 tx=0x7fa42c00b410 comp rx=0 tx=0).stop 2024-05-09T00:14:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.258+0000 7fa43ef63700 1 -- 172.21.15.81:0/701574331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43819bc70 msgr2=0x7fa43819c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.258+0000 7fa43ef63700 1 --2- 172.21.15.81:0/701574331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43819bc70 0x7fa43819c0f0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fa430007ee0 tx=0x7fa43000d3b0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.258+0000 7fa43ef63700 1 -- 172.21.15.81:0/701574331 shutdown_connections 2024-05-09T00:14:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.258+0000 7fa43ef63700 1 --2- 172.21.15.81:0/701574331 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa4280a1290 0x7fa4280a3750 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.258+0000 7fa43ef63700 1 --2- 172.21.15.81:0/701574331 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa4380682e0 0x7fa438197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.258+0000 7fa43ef63700 1 --2- 172.21.15.81:0/701574331 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa43819bc70 0x7fa43819c0f0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.258+0000 7fa43ef63700 1 --2- 172.21.15.81:0/701574331 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa438106290 0x7fa4381978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.258+0000 7fa43ef63700 1 -- 172.21.15.81:0/701574331 >> 172.21.15.81:0/701574331 conn(0x7fa438076f40 msgr2=0x7fa4380fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.258+0000 7fa43ef63700 1 -- 172.21.15.81:0/701574331 shutdown_connections 2024-05-09T00:14:30.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.258+0000 7fa43ef63700 1 -- 172.21.15.81:0/701574331 wait complete. 2024-05-09T00:14:30.268 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:14:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.395+0000 7fc1115e9700 1 -- 172.21.15.81:0/2196451217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc10c100a10 msgr2=0x7fc10c104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.395+0000 7fc1115e9700 1 --2- 172.21.15.81:0/2196451217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc10c100a10 0x7fc10c104a30 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fc100009990 tx=0x7fc100009ca0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.395+0000 7fc1115e9700 1 -- 172.21.15.81:0/2196451217 shutdown_connections 2024-05-09T00:14:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.395+0000 7fc1115e9700 1 --2- 172.21.15.81:0/2196451217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc10c105160 0x7fc10c10cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.395+0000 7fc1115e9700 1 --2- 172.21.15.81:0/2196451217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc10c100060 0x7fc10c100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.395+0000 7fc1115e9700 1 --2- 172.21.15.81:0/2196451217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc10c100a10 0x7fc10c104a30 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.395+0000 7fc1115e9700 1 -- 172.21.15.81:0/2196451217 >> 172.21.15.81:0/2196451217 conn(0x7fc10c076f40 msgr2=0x7fc10c077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.395+0000 7fc1115e9700 1 -- 172.21.15.81:0/2196451217 shutdown_connections 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.395+0000 7fc1115e9700 1 -- 172.21.15.81:0/2196451217 wait complete. 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc1115e9700 1 Processor -- start 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc1115e9700 1 -- start start 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc1115e9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc10c100060 0x7fc10c1962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc1115e9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc10c105160 0x7fc10c196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc1115e9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc10c19abb0 0x7fc10c19b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc1115e9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c19b630 con 0x7fc10c19abb0 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc1115e9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c19b7a0 con 0x7fc10c100060 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc1115e9700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c19b960 con 0x7fc10c105160 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc10b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc10c19abb0 0x7fc10c19b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc10b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc10c19abb0 0x7fc10c19b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39492/0 (socket says 172.21.15.81:39492) 2024-05-09T00:14:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc10b7fe700 1 -- 172.21.15.81:0/4189535778 learned_addr learned my addr 172.21.15.81:0/4189535778 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc10a7fc700 1 --2- 172.21.15.81:0/4189535778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc10c105160 0x7fc10c196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc10affd700 1 --2- 172.21.15.81:0/4189535778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc10c100060 0x7fc10c1962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc10b7fe700 1 -- 172.21.15.81:0/4189535778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc10c105160 msgr2=0x7fc10c196810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc10b7fe700 1 --2- 172.21.15.81:0/4189535778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc10c105160 0x7fc10c196810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc10b7fe700 1 -- 172.21.15.81:0/4189535778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc10c100060 msgr2=0x7fc10c1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc10b7fe700 1 --2- 172.21.15.81:0/4189535778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc10c100060 0x7fc10c1962d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.396+0000 7fc10b7fe700 1 -- 172.21.15.81:0/4189535778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc104009c40 con 0x7fc10c19abb0 2024-05-09T00:14:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.397+0000 7fc10b7fe700 1 --2- 172.21.15.81:0/4189535778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc10c19abb0 0x7fc10c19b030 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fc10400c370 tx=0x7fc10400c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.397+0000 7fc0f3fff700 1 -- 172.21.15.81:0/4189535778 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104017070 con 0x7fc10c19abb0 2024-05-09T00:14:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.397+0000 7fc1115e9700 1 -- 172.21.15.81:0/4189535778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1000095f0 con 0x7fc10c19abb0 2024-05-09T00:14:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.397+0000 7fc0f3fff700 1 -- 172.21.15.81:0/4189535778 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc10400f040 con 0x7fc10c19abb0 2024-05-09T00:14:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.397+0000 7fc0f3fff700 1 -- 172.21.15.81:0/4189535778 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10400e050 con 0x7fc10c19abb0 2024-05-09T00:14:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.397+0000 7fc1115e9700 1 -- 172.21.15.81:0/4189535778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10c1a31b0 con 0x7fc10c19abb0 2024-05-09T00:14:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.399+0000 7fc0f3fff700 1 -- 172.21.15.81:0/4189535778 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc10400cb60 con 0x7fc10c19abb0 2024-05-09T00:14:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.400+0000 7fc0f3fff700 1 --2- 172.21.15.81:0/4189535778 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc0f40a1310 0x7fc0f40a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.400+0000 7fc10affd700 1 --2- 172.21.15.81:0/4189535778 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc0f40a1310 0x7fc0f40a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.400+0000 7fc0f3fff700 1 -- 172.21.15.81:0/4189535778 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fc1040cc620 con 0x7fc10c19abb0 2024-05-09T00:14:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.400+0000 7fc10affd700 1 --2- 172.21.15.81:0/4189535778 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc0f40a1310 0x7fc0f40a37d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc005950 tx=0x7fc0fc00b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:30.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.400+0000 7fc11d7a3b80 1 Processor -- start 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.400+0000 7fc11d7a3b80 1 -- start start 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.400+0000 7fc11d7a3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee49334f40 0x55ee49333350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.400+0000 7fc11d7a3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee49333d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.400+0000 7fc11d7a3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee493419d0 0x55ee49343dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.400+0000 7fc11d7a3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4928a150 con 0x55ee49334f40 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.400+0000 7fc11d7a3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee49287b10 con 0x55ee493419d0 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.400+0000 7fc11d7a3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee49283400 con 0x55ee49333890 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.401+0000 7fc10affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee49334f40 0x55ee49333350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.401+0000 7fc10affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee49334f40 0x55ee49333350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39494/0 (socket says 172.21.15.81:39494) 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.401+0000 7fc10affd700 1 -- 172.21.15.81:0/3751834225 learned_addr learned my addr 172.21.15.81:0/3751834225 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.401+0000 7fc10b7fe700 1 --2- 172.21.15.81:0/3751834225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee493419d0 0x55ee49343dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.401+0000 7fc10a7fc700 1 --2- 172.21.15.81:0/3751834225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee49333d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.401+0000 7fc10affd700 1 -- 172.21.15.81:0/3751834225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 msgr2=0x55ee49333d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.401+0000 7fc10affd700 1 --2- 172.21.15.81:0/3751834225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee49333d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.401+0000 7fc10affd700 1 -- 172.21.15.81:0/3751834225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee493419d0 msgr2=0x55ee49343dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.401+0000 7fc10affd700 1 --2- 172.21.15.81:0/3751834225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee493419d0 0x55ee49343dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.401+0000 7fc10affd700 1 -- 172.21.15.81:0/3751834225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee491043b0 con 0x55ee49334f40 2024-05-09T00:14:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.401+0000 7fc10affd700 1 --2- 172.21.15.81:0/3751834225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee49334f40 0x55ee49333350 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc010fa0 tx=0x7fc0fc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2af16111f2920 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.401+0000 7fc0f17fa700 1 -- 172.21.15.81:0/3751834225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc01e620 con 0x55ee49334f40 2024-05-09T00:14:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.401+0000 7fc0f17fa700 1 -- 172.21.15.81:0/3751834225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0fc015070 con 0x55ee49334f40 2024-05-09T00:14:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.401+0000 7fc0f17fa700 1 -- 172.21.15.81:0/3751834225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc01ca20 con 0x55ee49334f40 2024-05-09T00:14:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.402+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/3751834225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee49334f40 msgr2=0x55ee49333350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.402+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/3751834225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee49334f40 0x55ee49333350 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc010fa0 tx=0x7fc0fc013000 comp rx=0 tx=0).stop 2024-05-09T00:14:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.402+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/3751834225 shutdown_connections 2024-05-09T00:14:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.402+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/3751834225 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee493419d0 0x55ee49343dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.402+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/3751834225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee49334f40 0x55ee49333350 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.402+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/3751834225 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee49333d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.402+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/3751834225 >> 172.21.15.81:0/3751834225 conn(0x55ee49291210 msgr2=0x55ee4932ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.402+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/3751834225 shutdown_connections 2024-05-09T00:14:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.402+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/3751834225 wait complete. 2024-05-09T00:14:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.402+0000 7fc11d7a3b80 1 -- start start 2024-05-09T00:14:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.402+0000 7fc11d7a3b80 1 Processor -- start 2024-05-09T00:14:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc11d7a3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee49341410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc11d7a3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee49334f40 0x55ee4933e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc11d7a3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee493419d0 0x55ee4933edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc11d7a3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4921f560 con 0x55ee493419d0 2024-05-09T00:14:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc11d7a3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4921f200 con 0x55ee49334f40 2024-05-09T00:14:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc11d7a3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee491066a0 con 0x55ee49333890 2024-05-09T00:14:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc11d7a3b80 10 client.0 _ll_register_callbacks cb 0x55ee49228b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc10b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee493419d0 0x55ee4933edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc10b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee493419d0 0x55ee4933edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39496/0 (socket says 172.21.15.81:39496) 2024-05-09T00:14:30.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc10b7fe700 1 -- 172.21.15.81:0/2464978870 learned_addr learned my addr 172.21.15.81:0/2464978870 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc10a7fc700 1 --2- 172.21.15.81:0/2464978870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee49334f40 0x55ee4933e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc10affd700 1 --2- 172.21.15.81:0/2464978870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee49341410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc10b7fe700 1 -- 172.21.15.81:0/2464978870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 msgr2=0x55ee49341410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc10b7fe700 1 --2- 172.21.15.81:0/2464978870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee49341410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc10b7fe700 1 -- 172.21.15.81:0/2464978870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee49334f40 msgr2=0x55ee4933e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc10b7fe700 1 --2- 172.21.15.81:0/2464978870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee49334f40 0x55ee4933e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc10b7fe700 1 -- 172.21.15.81:0/2464978870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0fc010c50 con 0x55ee493419d0 2024-05-09T00:14:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc10affd700 1 --2- 172.21.15.81:0/2464978870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee49341410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc10b7fe700 1 --2- 172.21.15.81:0/2464978870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee493419d0 0x55ee4933edd0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fc104096110 tx=0x7fc1040992e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c818de76910a4f7e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.403+0000 7fc0eeff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc0eeff5700 1 -- 172.21.15.81:0/2464978870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104082ea0 con 0x55ee493419d0 2024-05-09T00:14:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc0eeff5700 1 -- 172.21.15.81:0/2464978870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fc1040996a0 con 0x55ee493419d0 2024-05-09T00:14:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/2464978870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee491dc270 con 0x55ee493419d0 2024-05-09T00:14:30.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc0eeff5700 1 -- 172.21.15.81:0/2464978870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc10409d4d0 con 0x55ee493419d0 2024-05-09T00:14:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc11d7a3b80 10 client.18807 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/2464978870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ee490b0b60 con 0x55ee493419d0 2024-05-09T00:14:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc0eeff5700 1 -- 172.21.15.81:0/2464978870 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ee491dc270 con 0x55ee493419d0 2024-05-09T00:14:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc0eeff5700 1 -- 172.21.15.81:0/2464978870 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc1040192c0 con 0x55ee493419d0 2024-05-09T00:14:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc11d7a3b80 10 client.18807 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc11d7a3b80 10 client.18807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:14:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc11d7a3b80 20 client.18807 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/2464978870 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ee49351530 0x55ee49353920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc11d7a3b80 4 client.18807 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:14:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/2464978870 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee49302810 con 0x55ee49351530 2024-05-09T00:14:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.404+0000 7fc10affd700 1 --2- 172.21.15.81:0/2464978870 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ee49351530 0x55ee49353920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.405+0000 7fc10affd700 1 --2- 172.21.15.81:0/2464978870 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ee49351530 0x55ee49353920 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f3db8f53d7d8993 server_cookie=a3131e736c1e5ab4 in_seq=0 out_seq=0 2024-05-09T00:14:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.405+0000 7fc0eeff5700 10 client.18807 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:30.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.405+0000 7fc0eeff5700 1 -- 172.21.15.81:0/2464978870 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ee49302810 con 0x55ee49351530 2024-05-09T00:14:30.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.405+0000 7fc0eeff5700 10 client.18807 handle_command_reply: tid=0 2024-05-09T00:14:30.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.405+0000 7fc11d7a3b80 1 client.18807 shutdown 2024-05-09T00:14:30.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.405+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/2464978870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee493419d0 msgr2=0x55ee4933edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.405+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/2464978870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee493419d0 0x55ee4933edd0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7fc104096110 tx=0x7fc1040992e0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.405+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/2464978870 shutdown_connections 2024-05-09T00:14:30.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.406+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/2464978870 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ee49351530 0x55ee49353920 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.406+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/2464978870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee493419d0 0x55ee4933edd0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.406+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/2464978870 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee49341410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.406+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/2464978870 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee49334f40 0x55ee4933e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.406+0000 7fc0eeff5700 0 client.18807 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:30.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.406+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/2464978870 >> 172.21.15.81:0/2464978870 conn(0x55ee49291210 msgr2=0x55ee4932d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:30.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.406+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/2464978870 shutdown_connections 2024-05-09T00:14:30.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.406+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/2464978870 wait complete. 2024-05-09T00:14:30.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.406+0000 7fc11d7a3b80 20 client.18807 trim_cache size 0 max 16384 2024-05-09T00:14:30.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc11d7a3b80 1 Processor -- start 2024-05-09T00:14:30.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc11d7a3b80 1 -- start start 2024-05-09T00:14:30.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc11d7a3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee4932dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc11d7a3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee49334f40 0x55ee49333c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc11d7a3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee493419d0 0x55ee49332d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc11d7a3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4932eec0 con 0x55ee49334f40 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc11d7a3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4932adf0 con 0x55ee493419d0 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc11d7a3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee49358b60 con 0x55ee49333890 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc10a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee49334f40 0x55ee49333c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc10a7fc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee49334f40 0x55ee49333c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39498/0 (socket says 172.21.15.81:39498) 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc10a7fc700 1 -- 172.21.15.81:0/4206148188 learned_addr learned my addr 172.21.15.81:0/4206148188 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc10b7fe700 1 --2- 172.21.15.81:0/4206148188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee493419d0 0x55ee49332d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc10affd700 1 --2- 172.21.15.81:0/4206148188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee4932dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc10a7fc700 1 -- 172.21.15.81:0/4206148188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 msgr2=0x55ee4932dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc10a7fc700 1 --2- 172.21.15.81:0/4206148188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee4932dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc10a7fc700 1 -- 172.21.15.81:0/4206148188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee493419d0 msgr2=0x55ee49332d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc10a7fc700 1 --2- 172.21.15.81:0/4206148188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee493419d0 0x55ee49332d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc10a7fc700 1 -- 172.21.15.81:0/4206148188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee49249560 con 0x55ee49334f40 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.423+0000 7fc10a7fc700 1 --2- 172.21.15.81:0/4206148188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee49334f40 0x55ee49333c70 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fc100009990 tx=0x7fc100005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402daaa1eb878e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.424+0000 7fc0f1ffb700 1 -- 172.21.15.81:0/4206148188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100005590 con 0x55ee49334f40 2024-05-09T00:14:30.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.424+0000 7fc0f1ffb700 1 -- 172.21.15.81:0/4206148188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc10001e070 con 0x55ee49334f40 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.424+0000 7fc0f1ffb700 1 -- 172.21.15.81:0/4206148188 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100004a20 con 0x55ee49334f40 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.424+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/4206148188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee49334f40 msgr2=0x55ee49333c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.424+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/4206148188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee49334f40 0x55ee49333c70 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fc100009990 tx=0x7fc100005960 comp rx=0 tx=0).stop 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.424+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/4206148188 shutdown_connections 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.424+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/4206148188 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee493419d0 0x55ee49332d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.424+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/4206148188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee4932dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.424+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/4206148188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee49334f40 0x55ee49333c70 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.424+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/4206148188 >> 172.21.15.81:0/4206148188 conn(0x55ee49291210 msgr2=0x55ee4932f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.424+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/4206148188 shutdown_connections 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.424+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/4206148188 wait complete. 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc11d7a3b80 1 -- start start 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc11d7a3b80 1 Processor -- start 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc11d7a3b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee49348870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc11d7a3b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee49334f40 0x55ee49346cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc11d7a3b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee493419d0 0x55ee493471f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc11d7a3b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee49347810 con 0x55ee493419d0 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc11d7a3b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee49347950 con 0x55ee49334f40 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc11d7a3b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee49347b10 con 0x55ee49333890 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc11d7a3b80 10 client.0 _ll_register_callbacks cb 0x55ee49228b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc10b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee493419d0 0x55ee493471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc10b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee493419d0 0x55ee493471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39506/0 (socket says 172.21.15.81:39506) 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc10b7fe700 1 -- 172.21.15.81:0/432560986 learned_addr learned my addr 172.21.15.81:0/432560986 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc10a7fc700 1 --2- 172.21.15.81:0/432560986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee49334f40 0x55ee49346cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc10affd700 1 --2- 172.21.15.81:0/432560986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee49348870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc10b7fe700 1 -- 172.21.15.81:0/432560986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 msgr2=0x55ee49348870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc10b7fe700 1 --2- 172.21.15.81:0/432560986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee49348870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc10b7fe700 1 -- 172.21.15.81:0/432560986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee49334f40 msgr2=0x55ee49346cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc10b7fe700 1 --2- 172.21.15.81:0/432560986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee49334f40 0x55ee49346cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.425+0000 7fc10b7fe700 1 -- 172.21.15.81:0/432560986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10c10d550 con 0x55ee493419d0 2024-05-09T00:14:30.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc10b7fe700 1 --2- 172.21.15.81:0/432560986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee493419d0 0x55ee493471f0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fc10400c9d0 tx=0x7fc104003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e598234db80e9a8b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc0eeff5700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc0eeff5700 1 -- 172.21.15.81:0/432560986 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104082ea0 con 0x55ee493419d0 2024-05-09T00:14:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc0eeff5700 1 -- 172.21.15.81:0/432560986 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fc1040996a0 con 0x55ee493419d0 2024-05-09T00:14:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/432560986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc0fc015070 con 0x55ee493419d0 2024-05-09T00:14:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc0eeff5700 1 -- 172.21.15.81:0/432560986 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc104099aa0 con 0x55ee493419d0 2024-05-09T00:14:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc11d7a3b80 10 client.18813 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/432560986 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55ee49108cd0 con 0x55ee493419d0 2024-05-09T00:14:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc0eeff5700 1 -- 172.21.15.81:0/432560986 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0fc015070 con 0x55ee493419d0 2024-05-09T00:14:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc0eeff5700 1 -- 172.21.15.81:0/432560986 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc10409d120 con 0x55ee493419d0 2024-05-09T00:14:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc11d7a3b80 10 client.18813 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc11d7a3b80 10 client.18813 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:14:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc11d7a3b80 20 client.18813 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:30.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/432560986 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ee493a8b30 0x55ee493aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc11d7a3b80 4 client.18813 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:14:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/432560986 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ee4927bec0 con 0x55ee493a8b30 2024-05-09T00:14:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.426+0000 7fc10affd700 1 --2- 172.21.15.81:0/432560986 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ee493a8b30 0x55ee493aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc10affd700 1 --2- 172.21.15.81:0/432560986 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ee493a8b30 0x55ee493aaf20 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a321d6297861d905 server_cookie=75f61f418b254ead in_seq=0 out_seq=0 2024-05-09T00:14:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc0eeff5700 10 client.18813 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc0eeff5700 1 -- 172.21.15.81:0/432560986 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ee4927bec0 con 0x55ee493a8b30 2024-05-09T00:14:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc0eeff5700 10 client.18813 handle_command_reply: tid=0 2024-05-09T00:14:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc11d7a3b80 1 client.18813 shutdown 2024-05-09T00:14:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/432560986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee493419d0 msgr2=0x55ee493471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/432560986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee493419d0 0x55ee493471f0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fc10400c9d0 tx=0x7fc104003cd0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/432560986 shutdown_connections 2024-05-09T00:14:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/432560986 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x55ee493a8b30 0x55ee493aaf20 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/432560986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55ee493419d0 0x55ee493471f0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc0eeff5700 0 client.18813 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/432560986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55ee49333890 0x55ee49348870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc11d7a3b80 1 --2- 172.21.15.81:0/432560986 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55ee49334f40 0x55ee49346cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/432560986 >> 172.21.15.81:0/432560986 conn(0x55ee49291210 msgr2=0x55ee49333c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/432560986 shutdown_connections 2024-05-09T00:14:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.427+0000 7fc11d7a3b80 1 -- 172.21.15.81:0/432560986 wait complete. 2024-05-09T00:14:30.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.428+0000 7fc11d7a3b80 20 client.18813 trim_cache size 0 max 16384 2024-05-09T00:14:30.432 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:14:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-09T00:14:30.432 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": { 2024-05-09T00:14:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "6d11be94-7bc7-4b5a-9200-c41cd38577a4": { 2024-05-09T00:14:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/", 2024-05-09T00:14:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "tag": "6d11be94-7bc7-4b5a-9200-c41cd38577a4", 2024-05-09T00:14:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: "options": "recursive,force" 2024-05-09T00:14:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:14:30.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:14:30.433 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:14:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.428+0000 7fc1115e9700 1 -- 172.21.15.81:0/4189535778 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc0f40a1310 msgr2=0x7fc0f40a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.428+0000 7fc1115e9700 1 --2- 172.21.15.81:0/4189535778 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc0f40a1310 0x7fc0f40a37d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc005950 tx=0x7fc0fc00b410 comp rx=0 tx=0).stop 2024-05-09T00:14:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.428+0000 7fc1115e9700 1 -- 172.21.15.81:0/4189535778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc10c19abb0 msgr2=0x7fc10c19b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.428+0000 7fc1115e9700 1 --2- 172.21.15.81:0/4189535778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc10c19abb0 0x7fc10c19b030 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fc10400c370 tx=0x7fc10400c680 comp rx=0 tx=0).stop 2024-05-09T00:14:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.428+0000 7fc1115e9700 1 -- 172.21.15.81:0/4189535778 shutdown_connections 2024-05-09T00:14:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.428+0000 7fc1115e9700 1 --2- 172.21.15.81:0/4189535778 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc0f40a1310 0x7fc0f40a37d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.428+0000 7fc1115e9700 1 --2- 172.21.15.81:0/4189535778 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc10c100060 0x7fc10c1962d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.428+0000 7fc1115e9700 1 --2- 172.21.15.81:0/4189535778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc10c19abb0 0x7fc10c19b030 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.428+0000 7fc1115e9700 1 --2- 172.21.15.81:0/4189535778 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc10c105160 0x7fc10c196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.428+0000 7fc1115e9700 1 -- 172.21.15.81:0/4189535778 >> 172.21.15.81:0/4189535778 conn(0x7fc10c076f40 msgr2=0x7fc10c0fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:30.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.428+0000 7fc1115e9700 1 -- 172.21.15.81:0/4189535778 shutdown_connections 2024-05-09T00:14:30.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:30.428+0000 7fc1115e9700 1 -- 172.21.15.81:0/4189535778 wait complete. 2024-05-09T00:14:30.438 INFO:tasks.cephfs.filesystem:scrub status for tag:6d11be94-7bc7-4b5a-9200-c41cd38577a4 - {'path': '/', 'tag': '6d11be94-7bc7-4b5a-9200-c41cd38577a4', 'options': 'recursive,force'} 2024-05-09T00:14:31.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:30 smithi150 ceph-mon[46187]: pgmap v359: 97 pgs: 97 active+clean; 2.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:14:31.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:30 smithi150 ceph-mon[46187]: scrub queued for path: / 2024-05-09T00:14:31.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:30 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:14:31.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:30 smithi150 ceph-mon[46187]: scrub summary: active paths [/] 2024-05-09T00:14:31.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:30 smithi150 ceph-mon[46187]: scrub summary: idle+waiting paths [/] 2024-05-09T00:14:31.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:30 smithi171 ceph-mon[47351]: pgmap v359: 97 pgs: 97 active+clean; 2.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:14:31.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:30 smithi171 ceph-mon[47351]: scrub queued for path: / 2024-05-09T00:14:31.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:30 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:14:31.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:30 smithi171 ceph-mon[47351]: scrub summary: active paths [/] 2024-05-09T00:14:31.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:30 smithi171 ceph-mon[47351]: scrub summary: idle+waiting paths [/] 2024-05-09T00:14:31.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:30 smithi081 ceph-mon[42474]: pgmap v359: 97 pgs: 97 active+clean; 2.4 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 43 KiB/s wr, 12 op/s 2024-05-09T00:14:31.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:30 smithi081 ceph-mon[42474]: scrub queued for path: / 2024-05-09T00:14:31.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:30 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:14:31.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:30 smithi081 ceph-mon[42474]: scrub summary: active paths [/] 2024-05-09T00:14:31.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:30 smithi081 ceph-mon[42474]: scrub summary: idle+waiting paths [/] 2024-05-09T00:14:33.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:32 smithi150 ceph-mon[46187]: pgmap v360: 97 pgs: 97 active+clean; 2.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 62 KiB/s wr, 17 op/s 2024-05-09T00:14:33.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:32 smithi171 ceph-mon[47351]: pgmap v360: 97 pgs: 97 active+clean; 2.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 62 KiB/s wr, 17 op/s 2024-05-09T00:14:33.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:32 smithi081 ceph-mon[42474]: pgmap v360: 97 pgs: 97 active+clean; 2.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 62 KiB/s wr, 17 op/s 2024-05-09T00:14:35.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:34 smithi150 ceph-mon[46187]: pgmap v361: 97 pgs: 97 active+clean; 2.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-05-09T00:14:35.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:34 smithi150 ceph-mon[46187]: scrub summary: idle 2024-05-09T00:14:35.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:34 smithi171 ceph-mon[47351]: pgmap v361: 97 pgs: 97 active+clean; 2.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-05-09T00:14:35.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:34 smithi171 ceph-mon[47351]: scrub summary: idle 2024-05-09T00:14:35.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:34 smithi081 ceph-mon[42474]: pgmap v361: 97 pgs: 97 active+clean; 2.6 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 42 KiB/s wr, 12 op/s 2024-05-09T00:14:35.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:34 smithi081 ceph-mon[42474]: scrub summary: idle 2024-05-09T00:14:36.340 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.341+0000 7f338663d700 1 -- 172.21.15.81:0/2104880460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3380105130 msgr2=0x7f338010ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:36.340 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.341+0000 7f338663d700 1 --2- 172.21.15.81:0/2104880460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3380105130 0x7f338010ccc0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f337800b0a0 tx=0x7f337800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.340 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.342+0000 7f338663d700 1 -- 172.21.15.81:0/2104880460 shutdown_connections 2024-05-09T00:14:36.341 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.342+0000 7f338663d700 1 --2- 172.21.15.81:0/2104880460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3380105130 0x7f338010ccc0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.341 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.342+0000 7f338663d700 1 --2- 172.21.15.81:0/2104880460 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33801002f0 0x7f33801006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.341 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.342+0000 7f338663d700 1 --2- 172.21.15.81:0/2104880460 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f3380100ca0 0x7f3380104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.341 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.342+0000 7f338663d700 1 -- 172.21.15.81:0/2104880460 >> 172.21.15.81:0/2104880460 conn(0x7f3380076c00 msgr2=0x7f3380077010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:36.341 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.342+0000 7f338663d700 1 -- 172.21.15.81:0/2104880460 shutdown_connections 2024-05-09T00:14:36.341 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.342+0000 7f338663d700 1 -- 172.21.15.81:0/2104880460 wait complete. 2024-05-09T00:14:36.341 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.342+0000 7f338663d700 1 Processor -- start 2024-05-09T00:14:36.341 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.342+0000 7f338663d700 1 -- start start 2024-05-09T00:14:36.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f338663d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33801002f0 0x7f33801973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f338663d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3380105130 0x7f3380197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f338663d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f338019bcc0 0x7f338019c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f338663d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338019c740 con 0x7f3380105130 2024-05-09T00:14:36.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f338663d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338019c8b0 con 0x7f33801002f0 2024-05-09T00:14:36.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f338663d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338019ca70 con 0x7f338019bcc0 2024-05-09T00:14:36.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f337f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3380105130 0x7f3380197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f337f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3380105130 0x7f3380197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39518/0 (socket says 172.21.15.81:39518) 2024-05-09T00:14:36.343 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f337f7fe700 1 -- 172.21.15.81:0/1822507540 learned_addr learned my addr 172.21.15.81:0/1822507540 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:36.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f3384bda700 1 --2- 172.21.15.81:0/1822507540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f338019bcc0 0x7f338019c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f337ffff700 1 --2- 172.21.15.81:0/1822507540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33801002f0 0x7f33801973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f337f7fe700 1 -- 172.21.15.81:0/1822507540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f338019bcc0 msgr2=0x7f338019c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:36.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f337f7fe700 1 --2- 172.21.15.81:0/1822507540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f338019bcc0 0x7f338019c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f337f7fe700 1 -- 172.21.15.81:0/1822507540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33801002f0 msgr2=0x7f33801973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:36.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f337f7fe700 1 --2- 172.21.15.81:0/1822507540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33801002f0 0x7f33801973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.343+0000 7f337f7fe700 1 -- 172.21.15.81:0/1822507540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3378009d00 con 0x7f3380105130 2024-05-09T00:14:36.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.344+0000 7f337f7fe700 1 --2- 172.21.15.81:0/1822507540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3380105130 0x7f3380197920 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f337400d950 tx=0x7f337400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:36.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.344+0000 7f337d7fa700 1 -- 172.21.15.81:0/1822507540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337400f890 con 0x7f3380105130 2024-05-09T00:14:36.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.344+0000 7f338663d700 1 -- 172.21.15.81:0/1822507540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33801a3fd0 con 0x7f3380105130 2024-05-09T00:14:36.344 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.344+0000 7f337d7fa700 1 -- 172.21.15.81:0/1822507540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3374010460 con 0x7f3380105130 2024-05-09T00:14:36.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.344+0000 7f337d7fa700 1 -- 172.21.15.81:0/1822507540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337400e610 con 0x7f3380105130 2024-05-09T00:14:36.345 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.344+0000 7f338663d700 1 -- 172.21.15.81:0/1822507540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33801a4450 con 0x7f3380105130 2024-05-09T00:14:36.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.347+0000 7f337d7fa700 1 -- 172.21.15.81:0/1822507540 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f337400e770 con 0x7f3380105130 2024-05-09T00:14:36.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.347+0000 7f337d7fa700 1 --2- 172.21.15.81:0/1822507540 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f33680a1290 0x7f33680a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.347+0000 7f337ffff700 1 --2- 172.21.15.81:0/1822507540 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f33680a1290 0x7f33680a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.352 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.347+0000 7f337d7fa700 1 -- 172.21.15.81:0/1822507540 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f33740cc7e0 con 0x7f3380105130 2024-05-09T00:14:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f337ffff700 1 --2- 172.21.15.81:0/1822507540 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f33680a1290 0x7f33680a3750 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3370009c60 tx=0x7f3370009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f33927f7b80 1 Processor -- start 2024-05-09T00:14:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f33927f7b80 1 -- start start 2024-05-09T00:14:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f33927f7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 0x557dae107d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f33927f7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae101f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f33927f7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 0x557dae1028a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f33927f7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dae0590f0 con 0x557dae108270 2024-05-09T00:14:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f33927f7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dae056ab0 con 0x557dae102480 2024-05-09T00:14:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f33927f7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dae0523a0 con 0x557dae107950 2024-05-09T00:14:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f337f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f337f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae101f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39532/0 (socket says 172.21.15.81:39532) 2024-05-09T00:14:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f337f7fe700 1 -- 172.21.15.81:0/2198897909 learned_addr learned my addr 172.21.15.81:0/2198897909 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:36.353 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f337ffff700 1 --2- 172.21.15.81:0/2198897909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 0x557dae107d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f3384bda700 1 --2- 172.21.15.81:0/2198897909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 0x557dae1028a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f337f7fe700 1 -- 172.21.15.81:0/2198897909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 msgr2=0x557dae107d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.348+0000 7f337f7fe700 1 --2- 172.21.15.81:0/2198897909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 0x557dae107d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.349+0000 7f337f7fe700 1 -- 172.21.15.81:0/2198897909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 msgr2=0x557dae1028a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.349+0000 7f337f7fe700 1 --2- 172.21.15.81:0/2198897909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 0x557dae1028a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.349+0000 7f337f7fe700 1 -- 172.21.15.81:0/2198897909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557daded3350 con 0x557dae108270 2024-05-09T00:14:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.349+0000 7f337f7fe700 1 --2- 172.21.15.81:0/2198897909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae101f40 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f33740a1810 tx=0x7f3374099fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695b9db7d63231db server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.349+0000 7f33667fc700 1 -- 172.21.15.81:0/2198897909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33740a1d40 con 0x557dae108270 2024-05-09T00:14:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.349+0000 7f33667fc700 1 -- 172.21.15.81:0/2198897909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3374097c60 con 0x557dae108270 2024-05-09T00:14:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.349+0000 7f33667fc700 1 -- 172.21.15.81:0/2198897909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374098db0 con 0x557dae108270 2024-05-09T00:14:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.350+0000 7f33927f7b80 1 -- 172.21.15.81:0/2198897909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 msgr2=0x557dae101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.350+0000 7f33927f7b80 1 --2- 172.21.15.81:0/2198897909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae101f40 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f33740a1810 tx=0x7f3374099fc0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.354 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.350+0000 7f33927f7b80 1 -- 172.21.15.81:0/2198897909 shutdown_connections 2024-05-09T00:14:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.350+0000 7f33927f7b80 1 --2- 172.21.15.81:0/2198897909 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 0x557dae1028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.350+0000 7f33927f7b80 1 --2- 172.21.15.81:0/2198897909 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 0x557dae107d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.350+0000 7f33927f7b80 1 --2- 172.21.15.81:0/2198897909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae101f40 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.350+0000 7f33927f7b80 1 -- 172.21.15.81:0/2198897909 >> 172.21.15.81:0/2198897909 conn(0x557dae0601b0 msgr2=0x557dae0fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.350+0000 7f33927f7b80 1 -- 172.21.15.81:0/2198897909 shutdown_connections 2024-05-09T00:14:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.350+0000 7f33927f7b80 1 -- 172.21.15.81:0/2198897909 wait complete. 2024-05-09T00:14:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.350+0000 7f33927f7b80 1 -- start start 2024-05-09T00:14:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.350+0000 7f33927f7b80 1 Processor -- start 2024-05-09T00:14:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.350+0000 7f33927f7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 0x557dae10b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f33927f7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 0x557dae10bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f33927f7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae10c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.355 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f33927f7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dadfee500 con 0x557dae108270 2024-05-09T00:14:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f33927f7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dadfee1a0 con 0x557dae102480 2024-05-09T00:14:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f33927f7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557daded5640 con 0x557dae107950 2024-05-09T00:14:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f33927f7b80 10 client.0 _ll_register_callbacks cb 0x557dadff7ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f3384bda700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae10c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f3384bda700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae10c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39544/0 (socket says 172.21.15.81:39544) 2024-05-09T00:14:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f3384bda700 1 -- 172.21.15.81:0/961807743 learned_addr learned my addr 172.21.15.81:0/961807743 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f337f7fe700 1 --2- 172.21.15.81:0/961807743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 0x557dae10bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f337ffff700 1 --2- 172.21.15.81:0/961807743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 0x557dae10b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f3384bda700 1 -- 172.21.15.81:0/961807743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 msgr2=0x557dae10bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f3384bda700 1 --2- 172.21.15.81:0/961807743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 0x557dae10bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f3384bda700 1 -- 172.21.15.81:0/961807743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 msgr2=0x557dae10b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f3384bda700 1 --2- 172.21.15.81:0/961807743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 0x557dae10b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f3384bda700 1 -- 172.21.15.81:0/961807743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33801a4450 con 0x557dae108270 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f3384bda700 1 --2- 172.21.15.81:0/961807743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae10c0f0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f337800bae0 tx=0x7f337800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d1d8826474095e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f335f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f335f7fe700 1 -- 172.21.15.81:0/961807743 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337800e040 con 0x557dae108270 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f335f7fe700 1 -- 172.21.15.81:0/961807743 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f3378003c00 con 0x557dae108270 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f33927f7b80 1 -- 172.21.15.81:0/961807743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557dadfab210 con 0x557dae108270 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f335f7fe700 1 -- 172.21.15.81:0/961807743 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3378003dc0 con 0x557dae108270 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.351+0000 7f33927f7b80 10 client.18825 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.352+0000 7f33927f7b80 1 -- 172.21.15.81:0/961807743 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557dade7fb00 con 0x557dae108270 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.352+0000 7f335f7fe700 1 -- 172.21.15.81:0/961807743 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557dadfab210 con 0x557dae108270 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.352+0000 7f335f7fe700 1 -- 172.21.15.81:0/961807743 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3378023020 con 0x557dae108270 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.352+0000 7f33927f7b80 10 client.18825 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.352+0000 7f33927f7b80 10 client.18825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.352+0000 7f33927f7b80 20 client.18825 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.352+0000 7f33927f7b80 1 --2- 172.21.15.81:0/961807743 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557dae11bb90 0x557dae11dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.352+0000 7f33927f7b80 4 client.18825 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:14:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.352+0000 7f33927f7b80 1 -- 172.21.15.81:0/961807743 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557dae0d17b0 con 0x557dae11bb90 2024-05-09T00:14:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.352+0000 7f337ffff700 1 --2- 172.21.15.81:0/961807743 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557dae11bb90 0x557dae11dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.353+0000 7f335f7fe700 10 client.18825 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.353+0000 7f337ffff700 1 --2- 172.21.15.81:0/961807743 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557dae11bb90 0x557dae11dfb0 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=404d60df2ef16604 server_cookie=d600d42848d2c18 in_seq=0 out_seq=0 2024-05-09T00:14:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.353+0000 7f335f7fe700 1 -- 172.21.15.81:0/961807743 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557dae0d17b0 con 0x557dae11bb90 2024-05-09T00:14:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.353+0000 7f335f7fe700 10 client.18825 handle_command_reply: tid=0 2024-05-09T00:14:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.353+0000 7f33927f7b80 1 client.18825 shutdown 2024-05-09T00:14:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.353+0000 7f33927f7b80 1 -- 172.21.15.81:0/961807743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 msgr2=0x557dae10c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.353+0000 7f33927f7b80 1 --2- 172.21.15.81:0/961807743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae10c0f0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f337800bae0 tx=0x7f337800bb10 comp rx=0 tx=0).stop 2024-05-09T00:14:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.353+0000 7f33927f7b80 1 -- 172.21.15.81:0/961807743 shutdown_connections 2024-05-09T00:14:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.353+0000 7f33927f7b80 1 --2- 172.21.15.81:0/961807743 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557dae11bb90 0x557dae11dfb0 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.353+0000 7f33927f7b80 1 --2- 172.21.15.81:0/961807743 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 0x557dae10b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.353+0000 7f335f7fe700 0 client.18825 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.353+0000 7f33927f7b80 1 --2- 172.21.15.81:0/961807743 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae10c0f0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.353+0000 7f33927f7b80 1 --2- 172.21.15.81:0/961807743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 0x557dae10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.354+0000 7f33927f7b80 1 -- 172.21.15.81:0/961807743 >> 172.21.15.81:0/961807743 conn(0x557dae0601b0 msgr2=0x557dae105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.354+0000 7f33927f7b80 1 -- 172.21.15.81:0/961807743 shutdown_connections 2024-05-09T00:14:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.354+0000 7f33927f7b80 1 -- 172.21.15.81:0/961807743 wait complete. 2024-05-09T00:14:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.354+0000 7f33927f7b80 20 client.18825 trim_cache size 0 max 16384 2024-05-09T00:14:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.368+0000 7f33927f7b80 1 Processor -- start 2024-05-09T00:14:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f33927f7b80 1 -- start start 2024-05-09T00:14:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f33927f7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae102480 0x557dae0fff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f33927f7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae107950 0x557dae0fc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f33927f7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae108270 0x557dae101dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f33927f7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dae10cbd0 con 0x557dae102480 2024-05-09T00:14:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f33927f7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dae0fe4d0 con 0x557dae107950 2024-05-09T00:14:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f33927f7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dae1096a0 con 0x557dae108270 2024-05-09T00:14:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f337ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae102480 0x557dae0fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f337ffff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae102480 0x557dae0fff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39554/0 (socket says 172.21.15.81:39554) 2024-05-09T00:14:36.371 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f337ffff700 1 -- 172.21.15.81:0/3830224767 learned_addr learned my addr 172.21.15.81:0/3830224767 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f337ffff700 1 -- 172.21.15.81:0/3830224767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae108270 msgr2=0x557dae101dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f337ffff700 1 --2- 172.21.15.81:0/3830224767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae108270 0x557dae101dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f337ffff700 1 -- 172.21.15.81:0/3830224767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae107950 msgr2=0x557dae0fc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f337ffff700 1 --2- 172.21.15.81:0/3830224767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae107950 0x557dae0fc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f337ffff700 1 -- 172.21.15.81:0/3830224767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dae018500 con 0x557dae102480 2024-05-09T00:14:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f337ffff700 1 --2- 172.21.15.81:0/3830224767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae102480 0x557dae0fff30 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x557dae11e880 tx=0x7f3370014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04da87b73ad4c5b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f3366ffd700 1 -- 172.21.15.81:0/3830224767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3370022030 con 0x557dae102480 2024-05-09T00:14:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f3366ffd700 1 -- 172.21.15.81:0/3830224767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3370023040 con 0x557dae102480 2024-05-09T00:14:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.369+0000 7f3366ffd700 1 -- 172.21.15.81:0/3830224767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337001d410 con 0x557dae102480 2024-05-09T00:14:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.370+0000 7f33927f7b80 1 -- 172.21.15.81:0/3830224767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae102480 msgr2=0x557dae0fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.370+0000 7f33927f7b80 1 --2- 172.21.15.81:0/3830224767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae102480 0x557dae0fff30 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x557dae11e880 tx=0x7f3370014000 comp rx=0 tx=0).stop 2024-05-09T00:14:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.370+0000 7f33927f7b80 1 -- 172.21.15.81:0/3830224767 shutdown_connections 2024-05-09T00:14:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.370+0000 7f33927f7b80 1 --2- 172.21.15.81:0/3830224767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae108270 0x557dae101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.370+0000 7f33927f7b80 1 --2- 172.21.15.81:0/3830224767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae102480 0x557dae0fff30 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.370+0000 7f33927f7b80 1 --2- 172.21.15.81:0/3830224767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae107950 0x557dae0fc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.370+0000 7f33927f7b80 1 -- 172.21.15.81:0/3830224767 >> 172.21.15.81:0/3830224767 conn(0x557dae0601b0 msgr2=0x557dae1016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.370+0000 7f33927f7b80 1 -- 172.21.15.81:0/3830224767 shutdown_connections 2024-05-09T00:14:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.370+0000 7f33927f7b80 1 -- 172.21.15.81:0/3830224767 wait complete. 2024-05-09T00:14:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.370+0000 7f33927f7b80 1 -- start start 2024-05-09T00:14:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f33927f7b80 1 Processor -- start 2024-05-09T00:14:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f33927f7b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 0x557dae10ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f33927f7b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 0x557dae10f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f33927f7b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae175450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f33927f7b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dae175990 con 0x557dae108270 2024-05-09T00:14:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f33927f7b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dae175ad0 con 0x557dae102480 2024-05-09T00:14:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f33927f7b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dae175c90 con 0x557dae107950 2024-05-09T00:14:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f33927f7b80 10 client.0 _ll_register_callbacks cb 0x557dadff7ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:14:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f3384bda700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae175450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f3384bda700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae175450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39558/0 (socket says 172.21.15.81:39558) 2024-05-09T00:14:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f3384bda700 1 -- 172.21.15.81:0/1272121754 learned_addr learned my addr 172.21.15.81:0/1272121754 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f337f7fe700 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 0x557dae10f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f337ffff700 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 0x557dae10ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f3384bda700 1 -- 172.21.15.81:0/1272121754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 msgr2=0x557dae10f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f3384bda700 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 0x557dae10f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f3384bda700 1 -- 172.21.15.81:0/1272121754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 msgr2=0x557dae10ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:14:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f3384bda700 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 0x557dae10ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f3384bda700 1 -- 172.21.15.81:0/1272121754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3370017070 con 0x557dae108270 2024-05-09T00:14:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f337ffff700 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 0x557dae10ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:14:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.371+0000 7f337f7fe700 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 0x557dae10f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:14:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f3384bda700 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae175450 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f337800b060 tx=0x7f33780060f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1e2af7f0b8b58d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f335f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:14:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f335f7fe700 1 -- 172.21.15.81:0/1272121754 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337800e040 con 0x557dae108270 2024-05-09T00:14:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f335f7fe700 1 -- 172.21.15.81:0/1272121754 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f3378003a00 con 0x557dae108270 2024-05-09T00:14:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f33927f7b80 1 -- 172.21.15.81:0/1272121754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3374097c60 con 0x557dae108270 2024-05-09T00:14:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f335f7fe700 1 -- 172.21.15.81:0/1272121754 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f337801d660 con 0x557dae108270 2024-05-09T00:14:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f33927f7b80 10 client.18831 fetch_fsmap learned FSMap version 26 2024-05-09T00:14:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f33927f7b80 1 -- 172.21.15.81:0/1272121754 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x557daded7c70 con 0x557dae108270 2024-05-09T00:14:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f335f7fe700 1 -- 172.21.15.81:0/1272121754 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3374097c60 con 0x557dae108270 2024-05-09T00:14:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f335f7fe700 1 -- 172.21.15.81:0/1272121754 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3378019040 con 0x557dae108270 2024-05-09T00:14:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f33927f7b80 10 client.18831 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:14:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f33927f7b80 10 client.18831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-09T00:14:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f33927f7b80 20 client.18831 populate_metadata read hostname 'smithi081' 2024-05-09T00:14:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f33927f7b80 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557dae177140 0x557dae179560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f33927f7b80 4 client.18831 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-09T00:14:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.372+0000 7f33927f7b80 1 -- 172.21.15.81:0/1272121754 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557dae04ae60 con 0x557dae177140 2024-05-09T00:14:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.373+0000 7f337ffff700 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557dae177140 0x557dae179560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.373+0000 7f337ffff700 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557dae177140 0x557dae179560 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c04ad1985ee4b3ab server_cookie=84547d1b7c738fbb in_seq=0 out_seq=0 2024-05-09T00:14:36.377 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.373+0000 7f335f7fe700 10 client.18831 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.386+0000 7f335f7fe700 1 -- 172.21.15.81:0/1272121754 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557dae04ae60 con 0x557dae177140 2024-05-09T00:14:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.387+0000 7f335f7fe700 10 client.18831 handle_command_reply: tid=0 2024-05-09T00:14:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.387+0000 7f33927f7b80 1 client.18831 shutdown 2024-05-09T00:14:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.387+0000 7f33927f7b80 1 -- 172.21.15.81:0/1272121754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 msgr2=0x557dae175450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.387+0000 7f33927f7b80 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae175450 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f337800b060 tx=0x7f33780060f0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.385 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.387+0000 7f33927f7b80 1 -- 172.21.15.81:0/1272121754 shutdown_connections 2024-05-09T00:14:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.387+0000 7f33927f7b80 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x557dae177140 0x557dae179560 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.387+0000 7f33927f7b80 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x557dae102480 0x557dae10ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.387+0000 7f33927f7b80 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x557dae108270 0x557dae175450 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.387+0000 7f335f7fe700 0 client.18831 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:14:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.387+0000 7f33927f7b80 1 --2- 172.21.15.81:0/1272121754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x557dae107950 0x557dae10f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.387+0000 7f33927f7b80 1 -- 172.21.15.81:0/1272121754 >> 172.21.15.81:0/1272121754 conn(0x557dae0601b0 msgr2=0x557dae10bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.387+0000 7f33927f7b80 1 -- 172.21.15.81:0/1272121754 shutdown_connections 2024-05-09T00:14:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.387+0000 7f33927f7b80 1 -- 172.21.15.81:0/1272121754 wait complete. 2024-05-09T00:14:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.387+0000 7f33927f7b80 20 client.18831 trim_cache size 0 max 16384 2024-05-09T00:14:36.386 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:{ 2024-05-09T00:14:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "message": "", 2024-05-09T00:14:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout: "return_code": 0 2024-05-09T00:14:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stdout:} 2024-05-09T00:14:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.388+0000 7f338663d700 1 -- 172.21.15.81:0/1822507540 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f33680a1290 msgr2=0x7f33680a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:36.387 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.388+0000 7f338663d700 1 --2- 172.21.15.81:0/1822507540 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f33680a1290 0x7f33680a3750 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3370009c60 tx=0x7f3370009260 comp rx=0 tx=0).stop 2024-05-09T00:14:36.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.388+0000 7f338663d700 1 -- 172.21.15.81:0/1822507540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3380105130 msgr2=0x7f3380197920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:36.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.388+0000 7f338663d700 1 --2- 172.21.15.81:0/1822507540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3380105130 0x7f3380197920 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f337400d950 tx=0x7f337400dc60 comp rx=0 tx=0).stop 2024-05-09T00:14:36.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.388+0000 7f338663d700 1 -- 172.21.15.81:0/1822507540 shutdown_connections 2024-05-09T00:14:36.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.388+0000 7f338663d700 1 --2- 172.21.15.81:0/1822507540 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f33680a1290 0x7f33680a3750 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.388+0000 7f338663d700 1 --2- 172.21.15.81:0/1822507540 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f33801002f0 0x7f33801973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.388+0000 7f338663d700 1 --2- 172.21.15.81:0/1822507540 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f338019bcc0 0x7f338019c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.388+0000 7f338663d700 1 --2- 172.21.15.81:0/1822507540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3380105130 0x7f3380197920 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:36.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.388+0000 7f338663d700 1 -- 172.21.15.81:0/1822507540 >> 172.21.15.81:0/1822507540 conn(0x7f3380076c00 msgr2=0x7f3380069970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:36.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.388+0000 7f338663d700 1 -- 172.21.15.81:0/1822507540 shutdown_connections 2024-05-09T00:14:36.388 INFO:teuthology.task.background_exec.ubuntu@smithi081.front.sepia.ceph.com.smithi081.stderr:2024-05-09T00:14:36.388+0000 7f338663d700 1 -- 172.21.15.81:0/1822507540 wait complete. 2024-05-09T00:14:37.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:36 smithi150 ceph-mon[46187]: pgmap v362: 97 pgs: 97 active+clean; 2.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-05-09T00:14:37.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:36 smithi171 ceph-mon[47351]: pgmap v362: 97 pgs: 97 active+clean; 2.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-05-09T00:14:37.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:36 smithi081 ceph-mon[42474]: pgmap v362: 97 pgs: 97 active+clean; 2.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 59 KiB/s wr, 18 op/s 2024-05-09T00:14:39.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:38 smithi150 ceph-mon[46187]: pgmap v363: 97 pgs: 97 active+clean; 2.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-05-09T00:14:39.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:38 smithi171 ceph-mon[47351]: pgmap v363: 97 pgs: 97 active+clean; 2.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-05-09T00:14:39.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:38 smithi081 ceph-mon[42474]: pgmap v363: 97 pgs: 97 active+clean; 2.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-05-09T00:14:40.367 INFO:tasks.workunit.client.0.smithi081.stdout:561/600: open fd = 3 2024-05-09T00:14:40.367 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.367 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.367 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.368 INFO:tasks.workunit.client.0.smithi081.stdout:562/600: open fd = 3 2024-05-09T00:14:40.368 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.368 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.368 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.368 INFO:tasks.workunit.client.0.smithi081.stdout:563/600: open fd = 3 2024-05-09T00:14:40.368 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.368 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.368 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.368 INFO:tasks.workunit.client.0.smithi081.stdout:564/600: open fd = 3 2024-05-09T00:14:40.368 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.368 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.368 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.368 INFO:tasks.workunit.client.0.smithi081.stdout:565/600: open fd = 3 2024-05-09T00:14:40.368 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.369 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.369 INFO:tasks.workunit.client.0.smithi081.stdout:566/600: open fd = 3 2024-05-09T00:14:40.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.369 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.369 INFO:tasks.workunit.client.0.smithi081.stdout:567/600: open fd = 3 2024-05-09T00:14:40.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.369 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.369 INFO:tasks.workunit.client.0.smithi081.stdout:568/600: open fd = 3 2024-05-09T00:14:40.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.369 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.369 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.370 INFO:tasks.workunit.client.0.smithi081.stdout:569/600: open fd = 3 2024-05-09T00:14:40.370 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.370 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.370 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.370 INFO:tasks.workunit.client.0.smithi081.stdout:570/600: open fd = 3 2024-05-09T00:14:40.370 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.370 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.370 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.370 INFO:tasks.workunit.client.0.smithi081.stdout:571/600: open fd = 3 2024-05-09T00:14:40.370 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.370 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.370 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.370 INFO:tasks.workunit.client.0.smithi081.stdout:572/600: open fd = 3 2024-05-09T00:14:40.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.371 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.371 INFO:tasks.workunit.client.0.smithi081.stdout:573/600: open fd = 3 2024-05-09T00:14:40.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.371 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.371 INFO:tasks.workunit.client.0.smithi081.stdout:574/600: open fd = 3 2024-05-09T00:14:40.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.371 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.371 INFO:tasks.workunit.client.0.smithi081.stdout:575/600: open fd = 3 2024-05-09T00:14:40.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.371 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.372 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.372 INFO:tasks.workunit.client.0.smithi081.stdout:576/600: open fd = 3 2024-05-09T00:14:40.372 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.372 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.372 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.372 INFO:tasks.workunit.client.0.smithi081.stdout:577/600: open fd = 3 2024-05-09T00:14:40.372 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.372 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.372 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.372 INFO:tasks.workunit.client.0.smithi081.stdout:578/600: open fd = 3 2024-05-09T00:14:40.372 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.372 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.372 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.372 INFO:tasks.workunit.client.0.smithi081.stdout:579/600: open fd = 3 2024-05-09T00:14:40.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.373 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.373 INFO:tasks.workunit.client.0.smithi081.stdout:580/600: open fd = 3 2024-05-09T00:14:40.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.373 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.373 INFO:tasks.workunit.client.0.smithi081.stdout:581/600: open fd = 3 2024-05-09T00:14:40.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.373 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.373 INFO:tasks.workunit.client.0.smithi081.stdout:582/600: open fd = 3 2024-05-09T00:14:40.373 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.374 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.374 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.374 INFO:tasks.workunit.client.0.smithi081.stdout:583/600: open fd = 3 2024-05-09T00:14:40.374 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.374 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.374 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.374 INFO:tasks.workunit.client.0.smithi081.stdout:584/600: open fd = 3 2024-05-09T00:14:40.374 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.374 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.374 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.374 INFO:tasks.workunit.client.0.smithi081.stdout:585/600: open fd = 3 2024-05-09T00:14:40.374 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.374 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.374 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:586/600: open fd = 3 2024-05-09T00:14:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:587/600: open fd = 3 2024-05-09T00:14:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:588/600: open fd = 3 2024-05-09T00:14:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:589/600: open fd = 3 2024-05-09T00:14:40.375 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:590/600: open fd = 3 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:591/600: open fd = 3 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:592/600: open fd = 3 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.376 INFO:tasks.workunit.client.0.smithi081.stdout:593/600: open fd = 3 2024-05-09T00:14:40.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.377 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.377 INFO:tasks.workunit.client.0.smithi081.stdout:594/600: open fd = 3 2024-05-09T00:14:40.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.377 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.377 INFO:tasks.workunit.client.0.smithi081.stdout:595/600: open fd = 3 2024-05-09T00:14:40.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.377 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.377 INFO:tasks.workunit.client.0.smithi081.stdout:596/600: open fd = 3 2024-05-09T00:14:40.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.377 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.378 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.378 INFO:tasks.workunit.client.0.smithi081.stdout:597/600: open fd = 3 2024-05-09T00:14:40.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.378 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.378 INFO:tasks.workunit.client.0.smithi081.stdout:598/600: open fd = 3 2024-05-09T00:14:40.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.378 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.378 INFO:tasks.workunit.client.0.smithi081.stdout:599/600: open fd = 3 2024-05-09T00:14:40.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.378 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.378 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.379 INFO:tasks.workunit.client.0.smithi081.stdout:600/600: open fd = 3 2024-05-09T00:14:40.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.379 INFO:tasks.workunit.client.0.smithi081.stdout:write ret = 32 2024-05-09T00:14:40.379 INFO:tasks.workunit.client.0.smithi081.stdout:pread ret = 64 2024-05-09T00:14:40.379 INFO:tasks.workunit.client.0.smithi081.stderr:+ echo OK 2024-05-09T00:14:40.380 INFO:tasks.workunit.client.0.smithi081.stdout:OK 2024-05-09T00:14:40.380 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-09T00:14:40.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-09T00:14:40.425 INFO:tasks.workunit:Stopping ['fs/test_o_trunc.sh'] on client.0... 2024-05-09T00:14:40.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-09T00:14:40.744 DEBUG:teuthology.parallel:result is None 2024-05-09T00:14:40.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T00:14:40.781 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-09T00:14:40.781 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-05-09T00:14:40.793 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi081.front.sepia.ceph.com 2024-05-09T00:14:40.830 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-05-09T00:14:40.840 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-05-09T00:14:40.840 INFO:teuthology.task.exec:Executing custom commands... 2024-05-09T00:14:40.840 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi081.front.sepia.ceph.com 2024-05-09T00:14:40.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-05-09T00:14:40.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-05-09T00:14:40.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-05-09T00:14:41.040 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:40 smithi081 ceph-mon[42474]: pgmap v364: 97 pgs: 97 active+clean; 2.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-05-09T00:14:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.144+0000 7fc7fa487700 1 -- 172.21.15.81:0/3057421217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7f4101110 msgr2=0x7fc7f41014f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:41.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.144+0000 7fc7fa487700 1 --2- 172.21.15.81:0/3057421217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7f4101110 0x7fc7f41014f0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009990 tx=0x7fc7e4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.144+0000 7fc7fa487700 1 -- 172.21.15.81:0/3057421217 shutdown_connections 2024-05-09T00:14:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.144+0000 7fc7fa487700 1 --2- 172.21.15.81:0/3057421217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7f4106230 0x7fc7f410ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.144+0000 7fc7fa487700 1 --2- 172.21.15.81:0/3057421217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7f4101110 0x7fc7f41014f0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.144+0000 7fc7fa487700 1 --2- 172.21.15.81:0/3057421217 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7f4101ac0 0x7fc7f4105b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.144+0000 7fc7fa487700 1 -- 172.21.15.81:0/3057421217 >> 172.21.15.81:0/3057421217 conn(0x7fc7f40fc950 msgr2=0x7fc7f40fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.144+0000 7fc7fa487700 1 -- 172.21.15.81:0/3057421217 shutdown_connections 2024-05-09T00:14:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.144+0000 7fc7fa487700 1 -- 172.21.15.81:0/3057421217 wait complete. 2024-05-09T00:14:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.145+0000 7fc7fa487700 1 Processor -- start 2024-05-09T00:14:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.145+0000 7fc7fa487700 1 -- start start 2024-05-09T00:14:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.145+0000 7fc7fa487700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7f4101110 0x7fc7f41972f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.145+0000 7fc7fa487700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7f4106230 0x7fc7f4197830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.145+0000 7fc7fa487700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7f419bbd0 0x7fc7f419c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:41.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.145+0000 7fc7fa487700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f419c650 con 0x7fc7f4106230 2024-05-09T00:14:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.145+0000 7fc7fa487700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f419c7c0 con 0x7fc7f419bbd0 2024-05-09T00:14:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.145+0000 7fc7fa487700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f419c980 con 0x7fc7f4101110 2024-05-09T00:14:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.145+0000 7fc7f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7f4106230 0x7fc7f4197830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.145+0000 7fc7f37fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7f4106230 0x7fc7f4197830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60024/0 (socket says 172.21.15.81:60024) 2024-05-09T00:14:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.145+0000 7fc7f37fe700 1 -- 172.21.15.81:0/383843582 learned_addr learned my addr 172.21.15.81:0/383843582 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.146+0000 7fc7f3fff700 1 --2- 172.21.15.81:0/383843582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7f4101110 0x7fc7f41972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.146+0000 7fc7f8a24700 1 --2- 172.21.15.81:0/383843582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7f419bbd0 0x7fc7f419c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.146+0000 7fc7f37fe700 1 -- 172.21.15.81:0/383843582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7f4101110 msgr2=0x7fc7f41972f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.146+0000 7fc7f37fe700 1 --2- 172.21.15.81:0/383843582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7f4101110 0x7fc7f41972f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.146+0000 7fc7f37fe700 1 -- 172.21.15.81:0/383843582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7f419bbd0 msgr2=0x7fc7f419c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.146+0000 7fc7f37fe700 1 --2- 172.21.15.81:0/383843582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7f419bbd0 0x7fc7f419c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.146+0000 7fc7f37fe700 1 -- 172.21.15.81:0/383843582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e40095f0 con 0x7fc7f4106230 2024-05-09T00:14:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.146+0000 7fc7f37fe700 1 --2- 172.21.15.81:0/383843582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7f4106230 0x7fc7f4197830 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800d980 tx=0x7fc7e800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.146+0000 7fc7f17fa700 1 -- 172.21.15.81:0/383843582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8009b40 con 0x7fc7f4106230 2024-05-09T00:14:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.146+0000 7fc7f17fa700 1 -- 172.21.15.81:0/383843582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7e800de60 con 0x7fc7f4106230 2024-05-09T00:14:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.146+0000 7fc7fa487700 1 -- 172.21.15.81:0/383843582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f41a3ee0 con 0x7fc7f4106230 2024-05-09T00:14:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.146+0000 7fc7f17fa700 1 -- 172.21.15.81:0/383843582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800f620 con 0x7fc7f4106230 2024-05-09T00:14:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.146+0000 7fc7fa487700 1 -- 172.21.15.81:0/383843582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f41a4360 con 0x7fc7f4106230 2024-05-09T00:14:41.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.147+0000 7fc7fa487700 1 -- 172.21.15.81:0/383843582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f41094a0 con 0x7fc7f4106230 2024-05-09T00:14:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.148+0000 7fc7f17fa700 1 -- 172.21.15.81:0/383843582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc7e8010460 con 0x7fc7f4106230 2024-05-09T00:14:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.149+0000 7fc7f17fa700 1 --2- 172.21.15.81:0/383843582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc7dc0a1290 0x7fc7dc0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.149+0000 7fc7f3fff700 1 --2- 172.21.15.81:0/383843582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc7dc0a1290 0x7fc7dc0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.149+0000 7fc7f17fa700 1 -- 172.21.15.81:0/383843582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fc7e80cc8c0 con 0x7fc7f4106230 2024-05-09T00:14:41.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.150+0000 7fc7f3fff700 1 --2- 172.21.15.81:0/383843582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc7dc0a1290 0x7fc7dc0a3750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4003730 tx=0x7fc7e4003680 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:41.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.153+0000 7fc7f17fa700 1 -- 172.21.15.81:0/383843582 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc7e8095ce0 con 0x7fc7f4106230 2024-05-09T00:14:41.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:40 smithi150 ceph-mon[46187]: pgmap v364: 97 pgs: 97 active+clean; 2.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-05-09T00:14:41.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:40 smithi171 ceph-mon[47351]: pgmap v364: 97 pgs: 97 active+clean; 2.7 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 KiB/s wr, 11 op/s 2024-05-09T00:14:41.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.374+0000 7fc7fa487700 1 -- 172.21.15.81:0/383843582 --> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7f4101ac0 con 0x7fc7dc0a1290 2024-05-09T00:14:41.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.382+0000 7fc7f17fa700 1 -- 172.21.15.81:0/383843582 <== mgr.15285 v2:172.21.15.81:6800/2111088526 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+350 (secure 0 0 0) 0x7fc7f4101ac0 con 0x7fc7dc0a1290 2024-05-09T00:14:41.380 INFO:teuthology.orchestra.run.smithi081.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-05-09T00:00:00", "created": "2024-05-09T00:03:08", "first": "2024-05-09T00:04:00", "last": "2024-05-09T00:14:00", "last_pruned": "2024-05-09T00:14:00", "created_count": 11, "pruned_count": 5, "active": true} 2024-05-09T00:14:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.384+0000 7fc7fa487700 1 -- 172.21.15.81:0/383843582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc7dc0a1290 msgr2=0x7fc7dc0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:41.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.384+0000 7fc7fa487700 1 --2- 172.21.15.81:0/383843582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc7dc0a1290 0x7fc7dc0a3750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4003730 tx=0x7fc7e4003680 comp rx=0 tx=0).stop 2024-05-09T00:14:41.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.384+0000 7fc7fa487700 1 -- 172.21.15.81:0/383843582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7f4106230 msgr2=0x7fc7f4197830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:41.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.384+0000 7fc7fa487700 1 --2- 172.21.15.81:0/383843582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7f4106230 0x7fc7f4197830 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800d980 tx=0x7fc7e800dd40 comp rx=0 tx=0).stop 2024-05-09T00:14:41.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.384+0000 7fc7fa487700 1 -- 172.21.15.81:0/383843582 shutdown_connections 2024-05-09T00:14:41.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.384+0000 7fc7fa487700 1 --2- 172.21.15.81:0/383843582 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fc7dc0a1290 0x7fc7dc0a3750 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.384+0000 7fc7fa487700 1 --2- 172.21.15.81:0/383843582 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fc7f419bbd0 0x7fc7f419c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.384+0000 7fc7fa487700 1 --2- 172.21.15.81:0/383843582 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7f4101110 0x7fc7f41972f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.384+0000 7fc7fa487700 1 --2- 172.21.15.81:0/383843582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7f4106230 0x7fc7f4197830 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.385+0000 7fc7fa487700 1 -- 172.21.15.81:0/383843582 >> 172.21.15.81:0/383843582 conn(0x7fc7f40fc950 msgr2=0x7fc7f40fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:41.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.385+0000 7fc7fa487700 1 -- 172.21.15.81:0/383843582 shutdown_connections 2024-05-09T00:14:41.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.385+0000 7fc7fa487700 1 -- 172.21.15.81:0/383843582 wait complete. 2024-05-09T00:14:41.395 DEBUG:teuthology.orchestra.run.smithi081:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-05-09T00:14:41.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.561+0000 7f144fb76700 1 -- 172.21.15.81:0/3780227202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448073370 msgr2=0x7f1448073750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:41.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.561+0000 7f144fb76700 1 --2- 172.21.15.81:0/3780227202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448073370 0x7f1448073750 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f1438009990 tx=0x7f1438009ca0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.561+0000 7f144fb76700 1 -- 172.21.15.81:0/3780227202 shutdown_connections 2024-05-09T00:14:41.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.561+0000 7f144fb76700 1 --2- 172.21.15.81:0/3780227202 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f144810d740 0x7f144810fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.561+0000 7f144fb76700 1 --2- 172.21.15.81:0/3780227202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448073370 0x7f1448073750 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.561+0000 7f144fb76700 1 --2- 172.21.15.81:0/3780227202 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1448073c90 0x7f144810d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.561+0000 7f144fb76700 1 -- 172.21.15.81:0/3780227202 >> 172.21.15.81:0/3780227202 conn(0x7f14480fc950 msgr2=0x7f14480fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.561+0000 7f144fb76700 1 -- 172.21.15.81:0/3780227202 shutdown_connections 2024-05-09T00:14:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.561+0000 7f144fb76700 1 -- 172.21.15.81:0/3780227202 wait complete. 2024-05-09T00:14:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.561+0000 7f144fb76700 1 Processor -- start 2024-05-09T00:14:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144fb76700 1 -- start start 2024-05-09T00:14:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144fb76700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1448073370 0x7f1448199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144fb76700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448073c90 0x7f1448199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144fb76700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f144810d740 0x7f144819de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144fb76700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144819e470 con 0x7f1448073c90 2024-05-09T00:14:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144fb76700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144819e5e0 con 0x7f1448073370 2024-05-09T00:14:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144fb76700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144819e7a0 con 0x7f144810d740 2024-05-09T00:14:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144d111700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448073c90 0x7f1448199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144d111700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448073c90 0x7f1448199a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60042/0 (socket says 172.21.15.81:60042) 2024-05-09T00:14:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144d111700 1 -- 172.21.15.81:0/463816703 learned_addr learned my addr 172.21.15.81:0/463816703 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:14:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144d912700 1 --2- 172.21.15.81:0/463816703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1448073370 0x7f1448199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144e113700 1 --2- 172.21.15.81:0/463816703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f144810d740 0x7f144819de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144d111700 1 -- 172.21.15.81:0/463816703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f144810d740 msgr2=0x7f144819de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144d111700 1 --2- 172.21.15.81:0/463816703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f144810d740 0x7f144819de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144d111700 1 -- 172.21.15.81:0/463816703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1448073370 msgr2=0x7f1448199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144d111700 1 --2- 172.21.15.81:0/463816703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1448073370 0x7f1448199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144d111700 1 -- 172.21.15.81:0/463816703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14380095f0 con 0x7f1448073c90 2024-05-09T00:14:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144d111700 1 --2- 172.21.15.81:0/463816703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448073c90 0x7f1448199a90 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f144400d950 tx=0x7f144400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:41.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f143effd700 1 -- 172.21.15.81:0/463816703 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144400f890 con 0x7f1448073c90 2024-05-09T00:14:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f143effd700 1 -- 172.21.15.81:0/463816703 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1444010460 con 0x7f1448073c90 2024-05-09T00:14:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f143effd700 1 -- 172.21.15.81:0/463816703 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144400e610 con 0x7f1448073c90 2024-05-09T00:14:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.562+0000 7f144fb76700 1 -- 172.21.15.81:0/463816703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144819ea80 con 0x7f1448073c90 2024-05-09T00:14:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.563+0000 7f144fb76700 1 -- 172.21.15.81:0/463816703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14481a62c0 con 0x7f1448073c90 2024-05-09T00:14:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.563+0000 7f144fb76700 1 -- 172.21.15.81:0/463816703 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1448108950 con 0x7f1448073c90 2024-05-09T00:14:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.564+0000 7f143effd700 1 -- 172.21.15.81:0/463816703 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f14440108d0 con 0x7f1448073c90 2024-05-09T00:14:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.565+0000 7f143effd700 1 --2- 172.21.15.81:0/463816703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14340a1310 0x7f14340a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:14:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.565+0000 7f144d912700 1 --2- 172.21.15.81:0/463816703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14340a1310 0x7f14340a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:14:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.565+0000 7f143effd700 1 -- 172.21.15.81:0/463816703 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f14440ccb00 con 0x7f1448073c90 2024-05-09T00:14:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.565+0000 7f144d912700 1 --2- 172.21.15.81:0/463816703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14340a1310 0x7f14340a37d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f143800b5c0 tx=0x7f1438005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:14:41.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.569+0000 7f143effd700 1 -- 172.21.15.81:0/463816703 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f14440cee60 con 0x7f1448073c90 2024-05-09T00:14:41.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.793+0000 7f144fb76700 1 -- 172.21.15.81:0/463816703 --> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f144819a8c0 con 0x7f14340a1310 2024-05-09T00:14:41.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.800+0000 7f143effd700 1 -- 172.21.15.81:0/463816703 <== mgr.15285 v2:172.21.15.81:6800/2111088526 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f144819a8c0 con 0x7f14340a1310 2024-05-09T00:14:41.798 INFO:teuthology.orchestra.run.smithi081.stdout:/ 1m 6m3h 2024-05-09T00:14:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.802+0000 7f144fb76700 1 -- 172.21.15.81:0/463816703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14340a1310 msgr2=0x7f14340a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.802+0000 7f144fb76700 1 --2- 172.21.15.81:0/463816703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14340a1310 0x7f14340a37d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f143800b5c0 tx=0x7f1438005960 comp rx=0 tx=0).stop 2024-05-09T00:14:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.802+0000 7f144fb76700 1 -- 172.21.15.81:0/463816703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448073c90 msgr2=0x7f1448199a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:14:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.802+0000 7f144fb76700 1 --2- 172.21.15.81:0/463816703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448073c90 0x7f1448199a90 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f144400d950 tx=0x7f144400dc60 comp rx=0 tx=0).stop 2024-05-09T00:14:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.802+0000 7f144fb76700 1 -- 172.21.15.81:0/463816703 shutdown_connections 2024-05-09T00:14:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.802+0000 7f144fb76700 1 --2- 172.21.15.81:0/463816703 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f14340a1310 0x7f14340a37d0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.802+0000 7f144fb76700 1 --2- 172.21.15.81:0/463816703 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f1448073370 0x7f1448199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.802+0000 7f144fb76700 1 --2- 172.21.15.81:0/463816703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f144810d740 0x7f144819de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.802+0000 7f144fb76700 1 --2- 172.21.15.81:0/463816703 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1448073c90 0x7f1448199a90 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:14:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.802+0000 7f144fb76700 1 -- 172.21.15.81:0/463816703 >> 172.21.15.81:0/463816703 conn(0x7f14480fc950 msgr2=0x7f14480fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:14:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.802+0000 7f144fb76700 1 -- 172.21.15.81:0/463816703 shutdown_connections 2024-05-09T00:14:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:14:41.802+0000 7f144fb76700 1 -- 172.21.15.81:0/463816703 wait complete. 2024-05-09T00:14:41.812 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-05-09T00:14:41.823 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-05-09T00:14:43.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:42 smithi150 ceph-mon[46187]: pgmap v365: 97 pgs: 97 active+clean; 3.0 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:14:43.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:42 smithi150 ceph-mon[46187]: from='client.18837 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:43.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:42 smithi150 ceph-mon[46187]: from='client.18843 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:43.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:42 smithi171 ceph-mon[47351]: pgmap v365: 97 pgs: 97 active+clean; 3.0 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:14:43.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:42 smithi171 ceph-mon[47351]: from='client.18837 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:43.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:42 smithi171 ceph-mon[47351]: from='client.18843 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:43.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:42 smithi081 ceph-mon[42474]: pgmap v365: 97 pgs: 97 active+clean; 3.0 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 60 KiB/s wr, 18 op/s 2024-05-09T00:14:43.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:42 smithi081 ceph-mon[42474]: from='client.18837 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:43.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:42 smithi081 ceph-mon[42474]: from='client.18843 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-09T00:14:45.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:44 smithi150 ceph-mon[46187]: pgmap v366: 97 pgs: 97 active+clean; 3.0 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:14:45.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:44 smithi171 ceph-mon[47351]: pgmap v366: 97 pgs: 97 active+clean; 3.0 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:14:45.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:44 smithi081 ceph-mon[42474]: pgmap v366: 97 pgs: 97 active+clean; 3.0 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 13 op/s 2024-05-09T00:14:47.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:46 smithi150 ceph-mon[46187]: pgmap v367: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-05-09T00:14:47.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:46 smithi171 ceph-mon[47351]: pgmap v367: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-05-09T00:14:47.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:46 smithi081 ceph-mon[42474]: pgmap v367: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 47 KiB/s wr, 19 op/s 2024-05-09T00:14:49.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:48 smithi150 ceph-mon[46187]: pgmap v368: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-05-09T00:14:49.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:48 smithi171 ceph-mon[47351]: pgmap v368: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-05-09T00:14:49.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:48 smithi081 ceph-mon[42474]: pgmap v368: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-05-09T00:14:51.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:50 smithi150 ceph-mon[46187]: pgmap v369: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-05-09T00:14:51.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:50 smithi171 ceph-mon[47351]: pgmap v369: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-05-09T00:14:51.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:50 smithi081 ceph-mon[42474]: pgmap v369: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-05-09T00:14:53.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:52 smithi150 ceph-mon[46187]: pgmap v370: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-05-09T00:14:53.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:52 smithi171 ceph-mon[47351]: pgmap v370: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-05-09T00:14:53.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:52 smithi081 ceph-mon[42474]: pgmap v370: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 33 KiB/s wr, 17 op/s 2024-05-09T00:14:55.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:54 smithi150 ceph-mon[46187]: pgmap v371: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 9 op/s 2024-05-09T00:14:55.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:54 smithi171 ceph-mon[47351]: pgmap v371: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 9 op/s 2024-05-09T00:14:55.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:54 smithi081 ceph-mon[42474]: pgmap v371: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 9 op/s 2024-05-09T00:14:57.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:56 smithi150 ceph-mon[46187]: pgmap v372: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 12 op/s 2024-05-09T00:14:57.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:56 smithi171 ceph-mon[47351]: pgmap v372: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 12 op/s 2024-05-09T00:14:57.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:56 smithi081 ceph-mon[42474]: pgmap v372: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 KiB/s wr, 12 op/s 2024-05-09T00:14:59.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:14:58 smithi150 ceph-mon[46187]: pgmap v373: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.3 KiB/s wr, 6 op/s 2024-05-09T00:14:59.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:14:58 smithi171 ceph-mon[47351]: pgmap v373: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.3 KiB/s wr, 6 op/s 2024-05-09T00:14:59.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:14:58 smithi081 ceph-mon[42474]: pgmap v373: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.3 KiB/s wr, 6 op/s 2024-05-09T00:15:00.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2024-05-09T00:15:00.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.571+0000 7fedbe8f3700 1 -- 172.21.15.81:0/1301517006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb8105160 msgr2=0x7fedb810cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.571+0000 7fedbe8f3700 1 --2- 172.21.15.81:0/1301517006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb8105160 0x7fedb810cce0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fedb000b0a0 tx=0x7fedb000b3b0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.571+0000 7fedbe8f3700 1 -- 172.21.15.81:0/1301517006 shutdown_connections 2024-05-09T00:15:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.571+0000 7fedbe8f3700 1 --2- 172.21.15.81:0/1301517006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb8105160 0x7fedb810cce0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.571+0000 7fedbe8f3700 1 --2- 172.21.15.81:0/1301517006 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb8100060 0x7fedb8100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.571+0000 7fedbe8f3700 1 --2- 172.21.15.81:0/1301517006 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedb8100a10 0x7fedb8104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.571+0000 7fedbe8f3700 1 -- 172.21.15.81:0/1301517006 >> 172.21.15.81:0/1301517006 conn(0x7fedb8076f40 msgr2=0x7fedb8077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.571+0000 7fedbe8f3700 1 -- 172.21.15.81:0/1301517006 shutdown_connections 2024-05-09T00:15:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.571+0000 7fedbe8f3700 1 -- 172.21.15.81:0/1301517006 wait complete. 2024-05-09T00:15:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedbe8f3700 1 Processor -- start 2024-05-09T00:15:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedbe8f3700 1 -- start start 2024-05-09T00:15:00.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedbe8f3700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedb8100060 0x7fedb8198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedbe8f3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb8105160 0x7fedb81987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedbe8f3700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb8198d10 0x7fedb81a3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedbe8f3700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb81a39b0 con 0x7fedb8105160 2024-05-09T00:15:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedbe8f3700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb81a3b20 con 0x7fedb8100060 2024-05-09T00:15:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedbe8f3700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb81a3ce0 con 0x7fedb8198d10 2024-05-09T00:15:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb8105160 0x7fedb81987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb8105160 0x7fedb81987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46806/0 (socket says 172.21.15.81:46806) 2024-05-09T00:15:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedb77fe700 1 -- 172.21.15.81:0/2372737026 learned_addr learned my addr 172.21.15.81:0/2372737026 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedb7fff700 1 --2- 172.21.15.81:0/2372737026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedb8100060 0x7fedb8198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedbce90700 1 --2- 172.21.15.81:0/2372737026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb8198d10 0x7fedb81a3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedb77fe700 1 -- 172.21.15.81:0/2372737026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb8198d10 msgr2=0x7fedb81a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedb77fe700 1 --2- 172.21.15.81:0/2372737026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb8198d10 0x7fedb81a3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedb77fe700 1 -- 172.21.15.81:0/2372737026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedb8100060 msgr2=0x7fedb8198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.572+0000 7fedb77fe700 1 --2- 172.21.15.81:0/2372737026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedb8100060 0x7fedb8198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.573+0000 7fedb77fe700 1 -- 172.21.15.81:0/2372737026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb0009d00 con 0x7fedb8105160 2024-05-09T00:15:00.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.573+0000 7fedb77fe700 1 --2- 172.21.15.81:0/2372737026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb8105160 0x7fedb81987d0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fedac00c8f0 tx=0x7fedac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:00.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.573+0000 7fedb57fa700 1 -- 172.21.15.81:0/2372737026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac007b00 con 0x7fedb8105160 2024-05-09T00:15:00.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.573+0000 7fedb57fa700 1 -- 172.21.15.81:0/2372737026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fedac007c60 con 0x7fedb8105160 2024-05-09T00:15:00.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.573+0000 7fedbe8f3700 1 -- 172.21.15.81:0/2372737026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb81a3fc0 con 0x7fedb8105160 2024-05-09T00:15:00.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.573+0000 7fedb57fa700 1 -- 172.21.15.81:0/2372737026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac018660 con 0x7fedb8105160 2024-05-09T00:15:00.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.573+0000 7fedbe8f3700 1 -- 172.21.15.81:0/2372737026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb81a44c0 con 0x7fedb8105160 2024-05-09T00:15:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.575+0000 7fedb57fa700 1 -- 172.21.15.81:0/2372737026 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fedac00f450 con 0x7fedb8105160 2024-05-09T00:15:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.575+0000 7fedb57fa700 1 --2- 172.21.15.81:0/2372737026 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7feda00a1310 0x7feda00a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.576+0000 7fedb7fff700 1 --2- 172.21.15.81:0/2372737026 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7feda00a1310 0x7feda00a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.576+0000 7fedb57fa700 1 -- 172.21.15.81:0/2372737026 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fedac0ccbe0 con 0x7fedb8105160 2024-05-09T00:15:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.576+0000 7fedb7fff700 1 --2- 172.21.15.81:0/2372737026 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7feda00a1310 0x7feda00a37d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feda8005fd0 tx=0x7feda8005e30 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.576+0000 7fedcaaadb80 1 Processor -- start 2024-05-09T00:15:00.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedcaaadb80 1 -- start start 2024-05-09T00:15:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedcaaadb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae30a1f0 0x5626ae30a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedcaaadb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 0x5626ae304760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedcaaadb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae304ca0 0x5626ae305100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedcaaadb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ae257150 con 0x5626ae30a1f0 2024-05-09T00:15:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedcaaadb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ae254b10 con 0x5626ae30ab10 2024-05-09T00:15:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedcaaadb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ae250400 con 0x5626ae304ca0 2024-05-09T00:15:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae30a1f0 0x5626ae30a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae30a1f0 0x5626ae30a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46814/0 (socket says 172.21.15.81:46814) 2024-05-09T00:15:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedb7fff700 1 -- 172.21.15.81:0/2325313344 learned_addr learned my addr 172.21.15.81:0/2325313344 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedbce90700 1 --2- 172.21.15.81:0/2325313344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae304ca0 0x5626ae305100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedb77fe700 1 --2- 172.21.15.81:0/2325313344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 0x5626ae304760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedb7fff700 1 -- 172.21.15.81:0/2325313344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae304ca0 msgr2=0x5626ae305100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:00.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedb7fff700 1 --2- 172.21.15.81:0/2325313344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae304ca0 0x5626ae305100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedb7fff700 1 -- 172.21.15.81:0/2325313344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 msgr2=0x5626ae304760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedb7fff700 1 --2- 172.21.15.81:0/2325313344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 0x5626ae304760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedb7fff700 1 -- 172.21.15.81:0/2325313344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626ae0d13b0 con 0x5626ae30a1f0 2024-05-09T00:15:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedb77fe700 1 --2- 172.21.15.81:0/2325313344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 0x5626ae304760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.577+0000 7fedb7fff700 1 --2- 172.21.15.81:0/2325313344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae30a1f0 0x5626ae30a5d0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7feda800ecd0 tx=0x7feda8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede52321853a1257 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.578+0000 7fed9e7fc700 1 -- 172.21.15.81:0/2325313344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8010d80 con 0x5626ae30a1f0 2024-05-09T00:15:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.578+0000 7fed9e7fc700 1 -- 172.21.15.81:0/2325313344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feda801d910 con 0x5626ae30a1f0 2024-05-09T00:15:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.578+0000 7fed9e7fc700 1 -- 172.21.15.81:0/2325313344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda800f920 con 0x5626ae30a1f0 2024-05-09T00:15:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.578+0000 7fedcaaadb80 1 -- 172.21.15.81:0/2325313344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae30a1f0 msgr2=0x5626ae30a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.578+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/2325313344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae30a1f0 0x5626ae30a5d0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7feda800ecd0 tx=0x7feda8011000 comp rx=0 tx=0).stop 2024-05-09T00:15:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.578+0000 7fedcaaadb80 1 -- 172.21.15.81:0/2325313344 shutdown_connections 2024-05-09T00:15:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.578+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/2325313344 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae304ca0 0x5626ae305100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.578+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/2325313344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae30a1f0 0x5626ae30a5d0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.578+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/2325313344 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 0x5626ae304760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.578+0000 7fedcaaadb80 1 -- 172.21.15.81:0/2325313344 >> 172.21.15.81:0/2325313344 conn(0x5626ae25e210 msgr2=0x5626ae2fadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.578+0000 7fedcaaadb80 1 -- 172.21.15.81:0/2325313344 shutdown_connections 2024-05-09T00:15:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.578+0000 7fedcaaadb80 1 -- 172.21.15.81:0/2325313344 wait complete. 2024-05-09T00:15:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedcaaadb80 1 -- start start 2024-05-09T00:15:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedcaaadb80 1 Processor -- start 2024-05-09T00:15:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedcaaadb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae304ca0 0x5626ae30def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedcaaadb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30a1f0 0x5626ae30e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedcaaadb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 0x5626ae30e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedcaaadb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ae1ec560 con 0x5626ae304ca0 2024-05-09T00:15:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedcaaadb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ae1ec200 con 0x5626ae30ab10 2024-05-09T00:15:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedcaaadb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ae0d36a0 con 0x5626ae30a1f0 2024-05-09T00:15:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedcaaadb80 10 client.0 _ll_register_callbacks cb 0x5626ae1f5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:15:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae304ca0 0x5626ae30def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae304ca0 0x5626ae30def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46818/0 (socket says 172.21.15.81:46818) 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedb7fff700 1 -- 172.21.15.81:0/3307325624 learned_addr learned my addr 172.21.15.81:0/3307325624 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedb77fe700 1 --2- 172.21.15.81:0/3307325624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30a1f0 0x5626ae30e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedbce90700 1 --2- 172.21.15.81:0/3307325624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 0x5626ae30e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedb7fff700 1 -- 172.21.15.81:0/3307325624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30a1f0 msgr2=0x5626ae30e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedb7fff700 1 --2- 172.21.15.81:0/3307325624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30a1f0 0x5626ae30e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedb7fff700 1 -- 172.21.15.81:0/3307325624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 msgr2=0x5626ae30e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedb7fff700 1 --2- 172.21.15.81:0/3307325624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 0x5626ae30e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedb7fff700 1 -- 172.21.15.81:0/3307325624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda800e980 con 0x5626ae304ca0 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.579+0000 7fedbce90700 1 --2- 172.21.15.81:0/3307325624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 0x5626ae30e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fedb7fff700 1 --2- 172.21.15.81:0/3307325624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae304ca0 0x5626ae30def0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7feda801d680 tx=0x7feda801d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f3897e57c493f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fed977fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fed977fe700 1 -- 172.21.15.81:0/3307325624 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda802d070 con 0x5626ae304ca0 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fed977fe700 1 -- 172.21.15.81:0/3307325624 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7feda801dc90 con 0x5626ae304ca0 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fedcaaadb80 1 -- 172.21.15.81:0/3307325624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626ae1a9270 con 0x5626ae304ca0 2024-05-09T00:15:00.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fed977fe700 1 -- 172.21.15.81:0/3307325624 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7feda801de50 con 0x5626ae304ca0 2024-05-09T00:15:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fedcaaadb80 10 client.18855 fetch_fsmap learned FSMap version 26 2024-05-09T00:15:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fedcaaadb80 1 -- 172.21.15.81:0/3307325624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5626ae07db60 con 0x5626ae304ca0 2024-05-09T00:15:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fed977fe700 1 -- 172.21.15.81:0/3307325624 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feda803d080 con 0x5626ae304ca0 2024-05-09T00:15:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fed977fe700 1 -- 172.21.15.81:0/3307325624 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7feda8004b70 con 0x5626ae304ca0 2024-05-09T00:15:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fedcaaadb80 10 client.18855 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:15:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fedcaaadb80 10 client.18855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:15:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fedcaaadb80 20 client.18855 populate_metadata read hostname 'smithi081' 2024-05-09T00:15:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/3307325624 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5626ae31e470 0x5626ae320890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fedcaaadb80 4 client.18855 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:15:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.580+0000 7fedcaaadb80 1 -- 172.21.15.81:0/3307325624 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626ae2cf810 con 0x5626ae31e470 2024-05-09T00:15:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.581+0000 7fedb77fe700 1 --2- 172.21.15.81:0/3307325624 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5626ae31e470 0x5626ae320890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.581+0000 7fed977fe700 10 client.18855 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:15:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.581+0000 7fedb77fe700 1 --2- 172.21.15.81:0/3307325624 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5626ae31e470 0x5626ae320890 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46c94235731014e server_cookie=64d52498b7584d41 in_seq=0 out_seq=0 2024-05-09T00:15:00.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fed977fe700 1 -- 172.21.15.81:0/3307325624 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5626ae2cf810 con 0x5626ae31e470 2024-05-09T00:15:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fed977fe700 10 client.18855 handle_command_reply: tid=0 2024-05-09T00:15:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fedcaaadb80 1 client.18855 shutdown 2024-05-09T00:15:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fedcaaadb80 1 -- 172.21.15.81:0/3307325624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae304ca0 msgr2=0x5626ae30def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/3307325624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae304ca0 0x5626ae30def0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7feda801d680 tx=0x7feda801d6b0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fedcaaadb80 1 -- 172.21.15.81:0/3307325624 shutdown_connections 2024-05-09T00:15:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/3307325624 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5626ae31e470 0x5626ae320890 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/3307325624 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 0x5626ae30e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fed977fe700 0 client.18855 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:15:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/3307325624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae304ca0 0x5626ae30def0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/3307325624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30a1f0 0x5626ae30e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fedcaaadb80 1 -- 172.21.15.81:0/3307325624 >> 172.21.15.81:0/3307325624 conn(0x5626ae25e210 msgr2=0x5626ae2fa5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fedcaaadb80 1 -- 172.21.15.81:0/3307325624 shutdown_connections 2024-05-09T00:15:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fedcaaadb80 1 -- 172.21.15.81:0/3307325624 wait complete. 2024-05-09T00:15:00.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.582+0000 7fedcaaadb80 20 client.18855 trim_cache size 0 max 16384 2024-05-09T00:15:00.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.599+0000 7fedcaaadb80 1 Processor -- start 2024-05-09T00:15:00.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.599+0000 7fedcaaadb80 1 -- start start 2024-05-09T00:15:00.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedcaaadb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae304ca0 0x5626ae2fc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedcaaadb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30a1f0 0x5626ae2fad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedcaaadb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 0x5626ae30e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedcaaadb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ae30f4f0 con 0x5626ae304ca0 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedcaaadb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ae325a80 con 0x5626ae30ab10 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedcaaadb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ae2f5800 con 0x5626ae30a1f0 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae304ca0 0x5626ae2fc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedb7fff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae304ca0 0x5626ae2fc9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46834/0 (socket says 172.21.15.81:46834) 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedb7fff700 1 -- 172.21.15.81:0/3086303508 learned_addr learned my addr 172.21.15.81:0/3086303508 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedb7fff700 1 -- 172.21.15.81:0/3086303508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30a1f0 msgr2=0x5626ae2fad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedb77fe700 1 --2- 172.21.15.81:0/3086303508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30a1f0 0x5626ae2fad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedb7fff700 1 --2- 172.21.15.81:0/3086303508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30a1f0 0x5626ae2fad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedb7fff700 1 -- 172.21.15.81:0/3086303508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 msgr2=0x5626ae30e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedb7fff700 1 --2- 172.21.15.81:0/3086303508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 0x5626ae30e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedb7fff700 1 -- 172.21.15.81:0/3086303508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626ae216560 con 0x5626ae304ca0 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fedb7fff700 1 --2- 172.21.15.81:0/3086303508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae304ca0 0x5626ae2fc9d0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7feda800f4c0 tx=0x7feda801d7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c6dc2b4627f617 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fed9effd700 1 -- 172.21.15.81:0/3086303508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda802d040 con 0x5626ae304ca0 2024-05-09T00:15:00.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fed9effd700 1 -- 172.21.15.81:0/3086303508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5626ae1a9270 con 0x5626ae304ca0 2024-05-09T00:15:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.600+0000 7fed9effd700 1 -- 172.21.15.81:0/3086303508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda800fc00 con 0x5626ae304ca0 2024-05-09T00:15:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.601+0000 7fedcaaadb80 1 -- 172.21.15.81:0/3086303508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae304ca0 msgr2=0x5626ae2fc9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.601+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/3086303508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae304ca0 0x5626ae2fc9d0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7feda800f4c0 tx=0x7feda801d7d0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.601+0000 7fedcaaadb80 1 -- 172.21.15.81:0/3086303508 shutdown_connections 2024-05-09T00:15:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.601+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/3086303508 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae30ab10 0x5626ae30e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.601+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/3086303508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae304ca0 0x5626ae2fc9d0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.601+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/3086303508 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30a1f0 0x5626ae2fad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.601+0000 7fedcaaadb80 1 -- 172.21.15.81:0/3086303508 >> 172.21.15.81:0/3086303508 conn(0x5626ae25e210 msgr2=0x5626ae3050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.601+0000 7fedcaaadb80 1 -- 172.21.15.81:0/3086303508 shutdown_connections 2024-05-09T00:15:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.601+0000 7fedcaaadb80 1 -- 172.21.15.81:0/3086303508 wait complete. 2024-05-09T00:15:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.601+0000 7fedcaaadb80 1 -- start start 2024-05-09T00:15:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedcaaadb80 1 Processor -- start 2024-05-09T00:15:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedcaaadb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae304ca0 0x5626ae3159d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedcaaadb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae30a1f0 0x5626ae311530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedcaaadb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30ab10 0x5626ae311b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedcaaadb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ae312230 con 0x5626ae30a1f0 2024-05-09T00:15:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedcaaadb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ae3123a0 con 0x5626ae304ca0 2024-05-09T00:15:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedcaaadb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ae373970 con 0x5626ae30ab10 2024-05-09T00:15:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedcaaadb80 10 client.0 _ll_register_callbacks cb 0x5626ae1f5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:15:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae30a1f0 0x5626ae311530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedb77fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae30a1f0 0x5626ae311530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46836/0 (socket says 172.21.15.81:46836) 2024-05-09T00:15:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedb77fe700 1 -- 172.21.15.81:0/43742911 learned_addr learned my addr 172.21.15.81:0/43742911 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedb7fff700 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae304ca0 0x5626ae3159d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedbce90700 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30ab10 0x5626ae311b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedb77fe700 1 -- 172.21.15.81:0/43742911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30ab10 msgr2=0x5626ae311b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedb77fe700 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30ab10 0x5626ae311b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedb77fe700 1 -- 172.21.15.81:0/43742911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae304ca0 msgr2=0x5626ae3159d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedb77fe700 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae304ca0 0x5626ae3159d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedb77fe700 1 -- 172.21.15.81:0/43742911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626ae07db60 con 0x5626ae30a1f0 2024-05-09T00:15:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedb7fff700 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae304ca0 0x5626ae3159d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:15:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.602+0000 7fedbce90700 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30ab10 0x5626ae311b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fedb77fe700 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae30a1f0 0x5626ae311530 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fedac00fbb0 tx=0x7fedac09a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c6f3c444431f0a server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fed977fe700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:15:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fed977fe700 1 -- 172.21.15.81:0/43742911 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0ca720 con 0x5626ae30a1f0 2024-05-09T00:15:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fed977fe700 1 -- 172.21.15.81:0/43742911 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fedac09da90 con 0x5626ae30a1f0 2024-05-09T00:15:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fedcaaadb80 1 -- 172.21.15.81:0/43742911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feda801d910 con 0x5626ae30a1f0 2024-05-09T00:15:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fed977fe700 1 -- 172.21.15.81:0/43742911 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedac0a20e0 con 0x5626ae30a1f0 2024-05-09T00:15:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fedcaaadb80 10 client.18861 fetch_fsmap learned FSMap version 26 2024-05-09T00:15:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fedcaaadb80 1 -- 172.21.15.81:0/43742911 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5626ae0d5cd0 con 0x5626ae30a1f0 2024-05-09T00:15:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fed977fe700 1 -- 172.21.15.81:0/43742911 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feda801d910 con 0x5626ae30a1f0 2024-05-09T00:15:00.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fed977fe700 1 -- 172.21.15.81:0/43742911 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fedac099150 con 0x5626ae30a1f0 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fedcaaadb80 10 client.18861 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fedcaaadb80 10 client.18861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fedcaaadb80 20 client.18861 populate_metadata read hostname 'smithi081' 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5626ae3750c0 0x5626ae3774b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fedcaaadb80 4 client.18861 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fedcaaadb80 1 -- 172.21.15.81:0/43742911 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5626ae248ec0 con 0x5626ae3750c0 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.603+0000 7fedb7fff700 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5626ae3750c0 0x5626ae3774b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fed977fe700 10 client.18861 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fedb7fff700 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5626ae3750c0 0x5626ae3774b0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14ccc01b497df170 server_cookie=4441b7b95c041316 in_seq=0 out_seq=0 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fed977fe700 1 -- 172.21.15.81:0/43742911 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5626ae248ec0 con 0x5626ae3750c0 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fed977fe700 10 client.18861 handle_command_reply: tid=0 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fedcaaadb80 1 client.18861 shutdown 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fedcaaadb80 1 -- 172.21.15.81:0/43742911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae30a1f0 msgr2=0x5626ae311530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae30a1f0 0x5626ae311530 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fedac00fbb0 tx=0x7fedac09a410 comp rx=0 tx=0).stop 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fedcaaadb80 1 -- 172.21.15.81:0/43742911 shutdown_connections 2024-05-09T00:15:00.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x5626ae3750c0 0x5626ae3774b0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5626ae304ca0 0x5626ae3159d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5626ae30ab10 0x5626ae311b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fedcaaadb80 1 --2- 172.21.15.81:0/43742911 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5626ae30a1f0 0x5626ae311530 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fed977fe700 0 client.18861 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:15:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fedcaaadb80 1 -- 172.21.15.81:0/43742911 >> 172.21.15.81:0/43742911 conn(0x5626ae25e210 msgr2=0x5626ae30e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fedcaaadb80 1 -- 172.21.15.81:0/43742911 shutdown_connections 2024-05-09T00:15:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fedcaaadb80 1 -- 172.21.15.81:0/43742911 wait complete. 2024-05-09T00:15:00.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.604+0000 7fedcaaadb80 20 client.18861 trim_cache size 0 max 16384 2024-05-09T00:15:00.609 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:15:00.609 INFO:teuthology.orchestra.run.smithi081.stdout: "status": "no active scrubs running", 2024-05-09T00:15:00.609 INFO:teuthology.orchestra.run.smithi081.stdout: "scrubs": {} 2024-05-09T00:15:00.610 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:15:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.605+0000 7fedbe8f3700 1 -- 172.21.15.81:0/2372737026 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7feda00a1310 msgr2=0x7feda00a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.605+0000 7fedbe8f3700 1 --2- 172.21.15.81:0/2372737026 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7feda00a1310 0x7feda00a37d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7feda8005fd0 tx=0x7feda8005e30 comp rx=0 tx=0).stop 2024-05-09T00:15:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.605+0000 7fedbe8f3700 1 -- 172.21.15.81:0/2372737026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb8105160 msgr2=0x7fedb81987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.605+0000 7fedbe8f3700 1 --2- 172.21.15.81:0/2372737026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb8105160 0x7fedb81987d0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fedac00c8f0 tx=0x7fedac00ccb0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.605+0000 7fedbe8f3700 1 -- 172.21.15.81:0/2372737026 shutdown_connections 2024-05-09T00:15:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.605+0000 7fedbe8f3700 1 --2- 172.21.15.81:0/2372737026 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7feda00a1310 0x7feda00a37d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.605+0000 7fedbe8f3700 1 --2- 172.21.15.81:0/2372737026 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fedb8100060 0x7fedb8198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.605+0000 7fedbe8f3700 1 --2- 172.21.15.81:0/2372737026 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb8198d10 0x7fedb81a3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.605+0000 7fedbe8f3700 1 --2- 172.21.15.81:0/2372737026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedb8105160 0x7fedb81987d0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.605+0000 7fedbe8f3700 1 -- 172.21.15.81:0/2372737026 >> 172.21.15.81:0/2372737026 conn(0x7fedb8076f40 msgr2=0x7fedb80fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.605+0000 7fedbe8f3700 1 -- 172.21.15.81:0/2372737026 shutdown_connections 2024-05-09T00:15:00.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.605+0000 7fedbe8f3700 1 -- 172.21.15.81:0/2372737026 wait complete. 2024-05-09T00:15:00.615 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-09T00:15:00.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:00.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.741+0000 7efdb01c9700 1 -- 172.21.15.81:0/954708426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda81008f0 msgr2=0x7efda8104930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.741+0000 7efdb01c9700 1 --2- 172.21.15.81:0/954708426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda81008f0 0x7efda8104930 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7efda4009990 tx=0x7efda4009ca0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.741+0000 7efdb01c9700 1 -- 172.21.15.81:0/954708426 shutdown_connections 2024-05-09T00:15:00.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.741+0000 7efdb01c9700 1 --2- 172.21.15.81:0/954708426 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda8105060 0x7efda810cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.741+0000 7efdb01c9700 1 --2- 172.21.15.81:0/954708426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efda80fff40 0x7efda8100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.741+0000 7efdb01c9700 1 --2- 172.21.15.81:0/954708426 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda81008f0 0x7efda8104930 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.741+0000 7efdb01c9700 1 -- 172.21.15.81:0/954708426 >> 172.21.15.81:0/954708426 conn(0x7efda80fb7e0 msgr2=0x7efda80fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:00.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.741+0000 7efdb01c9700 1 -- 172.21.15.81:0/954708426 shutdown_connections 2024-05-09T00:15:00.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.741+0000 7efdb01c9700 1 -- 172.21.15.81:0/954708426 wait complete. 2024-05-09T00:15:00.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.741+0000 7efdb01c9700 1 Processor -- start 2024-05-09T00:15:00.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.741+0000 7efdb01c9700 1 -- start start 2024-05-09T00:15:00.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdb01c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80fff40 0x7efda8199410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdb01c9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efda8105060 0x7efda8199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdb01c9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda819dcf0 0x7efda819e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdb01c9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda819e770 con 0x7efda80fff40 2024-05-09T00:15:00.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdb01c9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda819e8e0 con 0x7efda819dcf0 2024-05-09T00:15:00.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdb01c9700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda819eaa0 con 0x7efda8105060 2024-05-09T00:15:00.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdadf65700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80fff40 0x7efda8199410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdadf65700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80fff40 0x7efda8199410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46866/0 (socket says 172.21.15.81:46866) 2024-05-09T00:15:00.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdadf65700 1 -- 172.21.15.81:0/1065072881 learned_addr learned my addr 172.21.15.81:0/1065072881 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:00.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdad764700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efda8105060 0x7efda8199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdae766700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda819dcf0 0x7efda819e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdadf65700 1 -- 172.21.15.81:0/1065072881 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efda8105060 msgr2=0x7efda8199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdadf65700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efda8105060 0x7efda8199950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdadf65700 1 -- 172.21.15.81:0/1065072881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda819dcf0 msgr2=0x7efda819e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdadf65700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda819dcf0 0x7efda819e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdadf65700 1 -- 172.21.15.81:0/1065072881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda40095f0 con 0x7efda80fff40 2024-05-09T00:15:00.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdae766700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda819dcf0 0x7efda819e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:00.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdadf65700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80fff40 0x7efda8199410 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7efd9800c9b0 tx=0x7efd9800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:00.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efd9effd700 1 -- 172.21.15.81:0/1065072881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98007b00 con 0x7efda80fff40 2024-05-09T00:15:00.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efd9effd700 1 -- 172.21.15.81:0/1065072881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efd98007c60 con 0x7efda80fff40 2024-05-09T00:15:00.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdb01c9700 1 -- 172.21.15.81:0/1065072881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda81a5fa0 con 0x7efda80fff40 2024-05-09T00:15:00.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efd9effd700 1 -- 172.21.15.81:0/1065072881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd98018660 con 0x7efda80fff40 2024-05-09T00:15:00.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.742+0000 7efdb01c9700 1 -- 172.21.15.81:0/1065072881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda81a6480 con 0x7efda80fff40 2024-05-09T00:15:00.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.743+0000 7efdb01c9700 1 -- 172.21.15.81:0/1065072881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda81030a0 con 0x7efda80fff40 2024-05-09T00:15:00.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.744+0000 7efd9effd700 1 -- 172.21.15.81:0/1065072881 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7efd98018880 con 0x7efda80fff40 2024-05-09T00:15:00.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.745+0000 7efd9effd700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efd940a1290 0x7efd940a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:00.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.745+0000 7efd9effd700 1 -- 172.21.15.81:0/1065072881 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7efd980cd030 con 0x7efda80fff40 2024-05-09T00:15:00.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.745+0000 7efdad764700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efd940a1290 0x7efd940a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:00.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.745+0000 7efdad764700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efd940a1290 0x7efd940a3750 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efda4000c00 tx=0x7efda4005fb0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:00.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.749+0000 7efd9effd700 1 -- 172.21.15.81:0/1065072881 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efd980964e0 con 0x7efda80fff40 2024-05-09T00:15:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.991+0000 7efdb01c9700 1 -- 172.21.15.81:0/1065072881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efda819a7b0 con 0x7efda80fff40 2024-05-09T00:15:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.991+0000 7efd9effd700 1 -- 172.21.15.81:0/1065072881 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7efd98099b00 con 0x7efda80fff40 2024-05-09T00:15:00.990 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:15:00.990 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:15:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.994+0000 7efdb01c9700 1 -- 172.21.15.81:0/1065072881 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efd940a1290 msgr2=0x7efd940a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.994+0000 7efdb01c9700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efd940a1290 0x7efd940a3750 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efda4000c00 tx=0x7efda4005fb0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.994+0000 7efdb01c9700 1 -- 172.21.15.81:0/1065072881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80fff40 msgr2=0x7efda8199410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.994+0000 7efdb01c9700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80fff40 0x7efda8199410 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7efd9800c9b0 tx=0x7efd9800cd70 comp rx=0 tx=0).stop 2024-05-09T00:15:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.994+0000 7efdb01c9700 1 -- 172.21.15.81:0/1065072881 shutdown_connections 2024-05-09T00:15:00.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.994+0000 7efdb01c9700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7efd940a1290 0x7efd940a3750 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.994+0000 7efdb01c9700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7efda819dcf0 0x7efda819e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.994+0000 7efdb01c9700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efda80fff40 0x7efda8199410 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.994+0000 7efdb01c9700 1 --2- 172.21.15.81:0/1065072881 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efda8105060 0x7efda8199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.994+0000 7efdb01c9700 1 -- 172.21.15.81:0/1065072881 >> 172.21.15.81:0/1065072881 conn(0x7efda80fb7e0 msgr2=0x7efda810bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.994+0000 7efdb01c9700 1 -- 172.21.15.81:0/1065072881 shutdown_connections 2024-05-09T00:15:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:00.994+0000 7efdb01c9700 1 -- 172.21.15.81:0/1065072881 wait complete. 2024-05-09T00:15:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:15:01.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-05-09T00:15:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.132+0000 7fec37bb5700 1 -- 172.21.15.81:0/1171926429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec300682e0 msgr2=0x7fec300686c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.132+0000 7fec37bb5700 1 --2- 172.21.15.81:0/1171926429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec300682e0 0x7fec300686c0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fec200099c0 tx=0x7fec20009cd0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 -- 172.21.15.81:0/1171926429 shutdown_connections 2024-05-09T00:15:01.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 --2- 172.21.15.81:0/1171926429 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec30106290 0x7fec3010de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 --2- 172.21.15.81:0/1171926429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec300682e0 0x7fec300686c0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 --2- 172.21.15.81:0/1171926429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec30068c90 0x7fec30105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 -- 172.21.15.81:0/1171926429 >> 172.21.15.81:0/1171926429 conn(0x7fec30076f40 msgr2=0x7fec30077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 -- 172.21.15.81:0/1171926429 shutdown_connections 2024-05-09T00:15:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 -- 172.21.15.81:0/1171926429 wait complete. 2024-05-09T00:15:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 Processor -- start 2024-05-09T00:15:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 -- start start 2024-05-09T00:15:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec300682e0 0x7fec300ffe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec30106290 0x7fec301003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec301008e0 0x7fec301a55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec301a5bc0 con 0x7fec300682e0 2024-05-09T00:15:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec301a5d00 con 0x7fec301008e0 2024-05-09T00:15:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.133+0000 7fec37bb5700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec301a5ec0 con 0x7fec30106290 2024-05-09T00:15:01.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec35951700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec300682e0 0x7fec300ffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec35951700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec300682e0 0x7fec300ffe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46876/0 (socket says 172.21.15.81:46876) 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec35951700 1 -- 172.21.15.81:0/3568604979 learned_addr learned my addr 172.21.15.81:0/3568604979 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec35150700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec30106290 0x7fec301003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec36152700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec301008e0 0x7fec301a55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec35951700 1 -- 172.21.15.81:0/3568604979 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec30106290 msgr2=0x7fec301003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec35951700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec30106290 0x7fec301003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec35951700 1 -- 172.21.15.81:0/3568604979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec301008e0 msgr2=0x7fec301a55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec35951700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec301008e0 0x7fec301a55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec35951700 1 -- 172.21.15.81:0/3568604979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec200095f0 con 0x7fec300682e0 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec35150700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec30106290 0x7fec301003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec35951700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec300682e0 0x7fec300ffe60 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fec2000b580 tx=0x7fec20005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec26ffd700 1 -- 172.21.15.81:0/3568604979 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2001d070 con 0x7fec300682e0 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec26ffd700 1 -- 172.21.15.81:0/3568604979 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec2000fc30 con 0x7fec300682e0 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec26ffd700 1 -- 172.21.15.81:0/3568604979 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec20022d90 con 0x7fec300682e0 2024-05-09T00:15:01.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec37bb5700 1 -- 172.21.15.81:0/3568604979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec301a6140 con 0x7fec300682e0 2024-05-09T00:15:01.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.134+0000 7fec37bb5700 1 -- 172.21.15.81:0/3568604979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec301a6560 con 0x7fec300682e0 2024-05-09T00:15:01.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.136+0000 7fec26ffd700 1 -- 172.21.15.81:0/3568604979 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fec20022470 con 0x7fec300682e0 2024-05-09T00:15:01.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.137+0000 7fec26ffd700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fec1c0a1310 0x7fec1c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.137+0000 7fec35150700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fec1c0a1310 0x7fec1c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.137+0000 7fec26ffd700 1 -- 172.21.15.81:0/3568604979 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fec200cde70 con 0x7fec300682e0 2024-05-09T00:15:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.137+0000 7fec35150700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fec1c0a1310 0x7fec1c0a37d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fec300ffa40 tx=0x7fec2c005f50 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.138+0000 7fec43d6fb80 1 Processor -- start 2024-05-09T00:15:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.138+0000 7fec43d6fb80 1 -- start start 2024-05-09T00:15:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.138+0000 7fec43d6fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d8e00 0x5577101d91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.138+0000 7fec43d6fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d9720 0x5577101d3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.138+0000 7fec43d6fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101d3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.138+0000 7fec43d6fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55771012a150 con 0x5577101d3890 2024-05-09T00:15:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.138+0000 7fec43d6fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x557710127b10 con 0x5577101d9720 2024-05-09T00:15:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.138+0000 7fec43d6fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x557710123400 con 0x5577101d8e00 2024-05-09T00:15:01.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.138+0000 7fec36152700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101d3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.138+0000 7fec36152700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101d3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46892/0 (socket says 172.21.15.81:46892) 2024-05-09T00:15:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.138+0000 7fec36152700 1 -- 172.21.15.81:0/403801804 learned_addr learned my addr 172.21.15.81:0/403801804 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.138+0000 7fec35150700 1 --2- 172.21.15.81:0/403801804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d9720 0x5577101d3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.138+0000 7fec35951700 1 --2- 172.21.15.81:0/403801804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d8e00 0x5577101d91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.139+0000 7fec36152700 1 -- 172.21.15.81:0/403801804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d8e00 msgr2=0x5577101d91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.139+0000 7fec36152700 1 --2- 172.21.15.81:0/403801804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d8e00 0x5577101d91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.139+0000 7fec36152700 1 -- 172.21.15.81:0/403801804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d9720 msgr2=0x5577101d3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.139+0000 7fec36152700 1 --2- 172.21.15.81:0/403801804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d9720 0x5577101d3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.139+0000 7fec36152700 1 -- 172.21.15.81:0/403801804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55770ffa43b0 con 0x5577101d3890 2024-05-09T00:15:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.139+0000 7fec35150700 1 --2- 172.21.15.81:0/403801804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d9720 0x5577101d3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:15:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.139+0000 7fec36152700 1 --2- 172.21.15.81:0/403801804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101d3cd0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fec28009d20 tx=0x7fec280077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8006b72871e043d server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.139+0000 7fec1bfff700 1 -- 172.21.15.81:0/403801804 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28018070 con 0x5577101d3890 2024-05-09T00:15:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.139+0000 7fec1bfff700 1 -- 172.21.15.81:0/403801804 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec2800f050 con 0x5577101d3890 2024-05-09T00:15:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.139+0000 7fec1bfff700 1 -- 172.21.15.81:0/403801804 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28005aa0 con 0x5577101d3890 2024-05-09T00:15:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.140+0000 7fec43d6fb80 1 -- 172.21.15.81:0/403801804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 msgr2=0x5577101d3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.140+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/403801804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101d3cd0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7fec28009d20 tx=0x7fec280077e0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.140+0000 7fec43d6fb80 1 -- 172.21.15.81:0/403801804 shutdown_connections 2024-05-09T00:15:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.140+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/403801804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101d3cd0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.140+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/403801804 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d8e00 0x5577101d91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.140+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/403801804 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d9720 0x5577101d3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.140+0000 7fec43d6fb80 1 -- 172.21.15.81:0/403801804 >> 172.21.15.81:0/403801804 conn(0x557710131210 msgr2=0x5577101cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.140+0000 7fec43d6fb80 1 -- 172.21.15.81:0/403801804 shutdown_connections 2024-05-09T00:15:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.140+0000 7fec43d6fb80 1 -- 172.21.15.81:0/403801804 wait complete. 2024-05-09T00:15:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.140+0000 7fec43d6fb80 1 -- start start 2024-05-09T00:15:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.140+0000 7fec43d6fb80 1 Processor -- start 2024-05-09T00:15:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.140+0000 7fec43d6fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d3890 0x5577101df780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec43d6fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d8e00 0x5577101dca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec43d6fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d9720 0x5577101dd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec43d6fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577100bf560 con 0x5577101d8e00 2024-05-09T00:15:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec43d6fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577100bf200 con 0x5577101d3890 2024-05-09T00:15:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec43d6fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55770ffa66a0 con 0x5577101d9720 2024-05-09T00:15:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec43d6fb80 10 client.0 _ll_register_callbacks cb 0x5577100c8b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:15:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec35150700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d8e00 0x5577101dca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec35150700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d8e00 0x5577101dca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46898/0 (socket says 172.21.15.81:46898) 2024-05-09T00:15:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec35150700 1 -- 172.21.15.81:0/1365544365 learned_addr learned my addr 172.21.15.81:0/1365544365 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec36152700 1 --2- 172.21.15.81:0/1365544365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d9720 0x5577101dd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec35951700 1 --2- 172.21.15.81:0/1365544365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d3890 0x5577101df780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec35150700 1 -- 172.21.15.81:0/1365544365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d9720 msgr2=0x5577101dd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec35150700 1 --2- 172.21.15.81:0/1365544365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d9720 0x5577101dd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec35150700 1 -- 172.21.15.81:0/1365544365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d3890 msgr2=0x5577101df780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec35150700 1 --2- 172.21.15.81:0/1365544365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d3890 0x5577101df780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec35150700 1 -- 172.21.15.81:0/1365544365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec28009980 con 0x5577101d8e00 2024-05-09T00:15:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec36152700 1 --2- 172.21.15.81:0/1365544365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d9720 0x5577101dd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:15:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec35150700 1 --2- 172.21.15.81:0/1365544365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d8e00 0x5577101dca00 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fec3006a6d0 tx=0x7fec2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40231bba8191f20 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec197fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:15:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec197fa700 1 -- 172.21.15.81:0/1365544365 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c004a30 con 0x5577101d8e00 2024-05-09T00:15:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec197fa700 1 -- 172.21.15.81:0/1365544365 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fec2c004b90 con 0x5577101d8e00 2024-05-09T00:15:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec43d6fb80 1 -- 172.21.15.81:0/1365544365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55771007c270 con 0x5577101d8e00 2024-05-09T00:15:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec197fa700 1 -- 172.21.15.81:0/1365544365 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec2c004d50 con 0x5577101d8e00 2024-05-09T00:15:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec43d6fb80 10 client.18879 fetch_fsmap learned FSMap version 26 2024-05-09T00:15:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.141+0000 7fec43d6fb80 1 -- 172.21.15.81:0/1365544365 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55770ff50b60 con 0x5577101d8e00 2024-05-09T00:15:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.142+0000 7fec197fa700 1 -- 172.21.15.81:0/1365544365 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55771007c270 con 0x5577101d8e00 2024-05-09T00:15:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.142+0000 7fec197fa700 1 -- 172.21.15.81:0/1365544365 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fec2c024030 con 0x5577101d8e00 2024-05-09T00:15:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.142+0000 7fec43d6fb80 10 client.18879 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:15:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.142+0000 7fec43d6fb80 10 client.18879 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:15:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.142+0000 7fec43d6fb80 20 client.18879 populate_metadata read hostname 'smithi081' 2024-05-09T00:15:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.142+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/1365544365 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5577101ed1c0 0x5577101ef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.142+0000 7fec43d6fb80 4 client.18879 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:15:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.142+0000 7fec43d6fb80 1 -- 172.21.15.81:0/1365544365 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5577101a2810 con 0x5577101ed1c0 2024-05-09T00:15:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.142+0000 7fec35951700 1 --2- 172.21.15.81:0/1365544365 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5577101ed1c0 0x5577101ef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.142+0000 7fec197fa700 10 client.18879 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.142+0000 7fec35951700 1 --2- 172.21.15.81:0/1365544365 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5577101ed1c0 0x5577101ef5e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6c4ee96c3043748f server_cookie=4d7e193fed606296 in_seq=0 out_seq=0 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec197fa700 1 -- 172.21.15.81:0/1365544365 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5577101a2810 con 0x5577101ed1c0 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec197fa700 10 client.18879 handle_command_reply: tid=0 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec43d6fb80 1 client.18879 shutdown 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec43d6fb80 1 -- 172.21.15.81:0/1365544365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d8e00 msgr2=0x5577101dca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/1365544365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d8e00 0x5577101dca00 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fec3006a6d0 tx=0x7fec2c004750 comp rx=0 tx=0).stop 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec43d6fb80 1 -- 172.21.15.81:0/1365544365 shutdown_connections 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/1365544365 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x5577101ed1c0 0x5577101ef5e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/1365544365 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d3890 0x5577101df780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/1365544365 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d9720 0x5577101dd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec197fa700 0 client.18879 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/1365544365 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d8e00 0x5577101dca00 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec43d6fb80 1 -- 172.21.15.81:0/1365544365 >> 172.21.15.81:0/1365544365 conn(0x557710131210 msgr2=0x5577101cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec43d6fb80 1 -- 172.21.15.81:0/1365544365 shutdown_connections 2024-05-09T00:15:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec43d6fb80 1 -- 172.21.15.81:0/1365544365 wait complete. 2024-05-09T00:15:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.143+0000 7fec43d6fb80 20 client.18879 trim_cache size 0 max 16384 2024-05-09T00:15:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec43d6fb80 1 Processor -- start 2024-05-09T00:15:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec43d6fb80 1 -- start start 2024-05-09T00:15:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec43d6fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec43d6fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d8e00 0x5577101df2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec43d6fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d9720 0x5577101e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec43d6fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577101f47d0 con 0x5577101d3890 2024-05-09T00:15:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec43d6fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577101daf50 con 0x5577101d8e00 2024-05-09T00:15:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec43d6fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577101c6040 con 0x5577101d9720 2024-05-09T00:15:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec35951700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec35951700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101cdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46910/0 (socket says 172.21.15.81:46910) 2024-05-09T00:15:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec35951700 1 -- 172.21.15.81:0/807940069 learned_addr learned my addr 172.21.15.81:0/807940069 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec35150700 1 --2- 172.21.15.81:0/807940069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d8e00 0x5577101df2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec35951700 1 -- 172.21.15.81:0/807940069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d9720 msgr2=0x5577101e8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec35951700 1 --2- 172.21.15.81:0/807940069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d9720 0x5577101e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec35951700 1 -- 172.21.15.81:0/807940069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d8e00 msgr2=0x5577101df2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec35951700 1 --2- 172.21.15.81:0/807940069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d8e00 0x5577101df2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec35951700 1 -- 172.21.15.81:0/807940069 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577100e9560 con 0x5577101d3890 2024-05-09T00:15:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec35150700 1 --2- 172.21.15.81:0/807940069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d8e00 0x5577101df2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec35951700 1 --2- 172.21.15.81:0/807940069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101cdd20 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fec20000c00 tx=0x7fec20022810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bc872f4bb03175 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec24da4700 1 -- 172.21.15.81:0/807940069 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2009af80 con 0x5577101d3890 2024-05-09T00:15:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec24da4700 1 -- 172.21.15.81:0/807940069 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec2009edb0 con 0x5577101d3890 2024-05-09T00:15:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.157+0000 7fec24da4700 1 -- 172.21.15.81:0/807940069 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2009b1e0 con 0x5577101d3890 2024-05-09T00:15:01.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.158+0000 7fec43d6fb80 1 -- 172.21.15.81:0/807940069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 msgr2=0x5577101cdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.158+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/807940069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101cdd20 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fec20000c00 tx=0x7fec20022810 comp rx=0 tx=0).stop 2024-05-09T00:15:01.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.158+0000 7fec43d6fb80 1 -- 172.21.15.81:0/807940069 shutdown_connections 2024-05-09T00:15:01.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.158+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/807940069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d9720 0x5577101e8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.158+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/807940069 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101cdd20 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.158+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/807940069 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d8e00 0x5577101df2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.158+0000 7fec43d6fb80 1 -- 172.21.15.81:0/807940069 >> 172.21.15.81:0/807940069 conn(0x557710131210 msgr2=0x5577101d6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.158+0000 7fec43d6fb80 1 -- 172.21.15.81:0/807940069 shutdown_connections 2024-05-09T00:15:01.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.158+0000 7fec43d6fb80 1 -- 172.21.15.81:0/807940069 wait complete. 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.158+0000 7fec43d6fb80 1 -- start start 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.158+0000 7fec43d6fb80 1 Processor -- start 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec43d6fb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101d5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec43d6fb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d8e00 0x5577101d6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec43d6fb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d9720 0x5577101d49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec43d6fb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577101e4720 con 0x5577101d3890 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec43d6fb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577101e4890 con 0x5577101d9720 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec43d6fb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577101e4a50 con 0x5577101d8e00 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec43d6fb80 10 client.0 _ll_register_callbacks cb 0x5577100c8b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec35951700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec35951700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101d5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46912/0 (socket says 172.21.15.81:46912) 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec35951700 1 -- 172.21.15.81:0/3473319531 learned_addr learned my addr 172.21.15.81:0/3473319531 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec35150700 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d8e00 0x5577101d6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec36152700 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d9720 0x5577101d49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec35951700 1 -- 172.21.15.81:0/3473319531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d8e00 msgr2=0x5577101d6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec35951700 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d8e00 0x5577101d6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec35951700 1 -- 172.21.15.81:0/3473319531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d9720 msgr2=0x5577101d49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec35951700 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d9720 0x5577101d49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec35951700 1 -- 172.21.15.81:0/3473319531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec301a6560 con 0x5577101d3890 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec35150700 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d8e00 0x5577101d6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec36152700 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d9720 0x5577101d49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec35951700 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101d5b00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fec2000ff50 tx=0x7fec20009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b82ef51b485f95 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec197fa700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec197fa700 1 -- 172.21.15.81:0/3473319531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2001aea0 con 0x5577101d3890 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec197fa700 1 -- 172.21.15.81:0/3473319531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fec2009af80 con 0x5577101d3890 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec43d6fb80 1 -- 172.21.15.81:0/3473319531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fec2800f050 con 0x5577101d3890 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.159+0000 7fec197fa700 1 -- 172.21.15.81:0/3473319531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec2009a470 con 0x5577101d3890 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.160+0000 7fec43d6fb80 10 client.18885 fetch_fsmap learned FSMap version 26 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.160+0000 7fec43d6fb80 1 -- 172.21.15.81:0/3473319531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55770ffa8cd0 con 0x5577101d3890 2024-05-09T00:15:01.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.160+0000 7fec197fa700 1 -- 172.21.15.81:0/3473319531 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec2800f050 con 0x5577101d3890 2024-05-09T00:15:01.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.160+0000 7fec197fa700 1 -- 172.21.15.81:0/3473319531 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fec200b0d90 con 0x5577101d3890 2024-05-09T00:15:01.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.160+0000 7fec43d6fb80 10 client.18885 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:15:01.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.160+0000 7fec43d6fb80 10 client.18885 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-05-09T00:15:01.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.160+0000 7fec43d6fb80 20 client.18885 populate_metadata read hostname 'smithi081' 2024-05-09T00:15:01.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.160+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x557710243cd0 0x5577102460f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.160+0000 7fec43d6fb80 4 client.18885 mds_command: new command op to 24476 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:15:01.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.160+0000 7fec43d6fb80 1 -- 172.21.15.81:0/3473319531 --> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55771011bec0 con 0x557710243cd0 2024-05-09T00:15:01.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.160+0000 7fec35150700 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x557710243cd0 0x5577102460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec35150700 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x557710243cd0 0x5577102460f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9a9842d69a74fe1 server_cookie=319786cf5fc9dca6 in_seq=0 out_seq=0 2024-05-09T00:15:01.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec197fa700 10 client.18885 ms_handle_connect on v2:172.21.15.150:6836/2308594773 2024-05-09T00:15:01.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec197fa700 1 -- 172.21.15.81:0/3473319531 <== mds.2 v2:172.21.15.150:6836/2308594773 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55771011bec0 con 0x557710243cd0 2024-05-09T00:15:01.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec197fa700 10 client.18885 handle_command_reply: tid=0 2024-05-09T00:15:01.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec43d6fb80 1 client.18885 shutdown 2024-05-09T00:15:01.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec43d6fb80 1 -- 172.21.15.81:0/3473319531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 msgr2=0x5577101d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101d5b00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fec2000ff50 tx=0x7fec20009cd0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec43d6fb80 1 -- 172.21.15.81:0/3473319531 shutdown_connections 2024-05-09T00:15:01.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.150:6836/2308594773,v1:172.21.15.150:6837/2308594773] conn(0x557710243cd0 0x5577102460f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5577101d9720 0x5577101d49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5577101d3890 0x5577101d5b00 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec43d6fb80 1 --2- 172.21.15.81:0/3473319531 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x5577101d8e00 0x5577101d6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec197fa700 0 client.18885 ms_handle_reset on v2:172.21.15.150:6836/2308594773 2024-05-09T00:15:01.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec43d6fb80 1 -- 172.21.15.81:0/3473319531 >> 172.21.15.81:0/3473319531 conn(0x557710131210 msgr2=0x5577101e8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec43d6fb80 1 -- 172.21.15.81:0/3473319531 shutdown_connections 2024-05-09T00:15:01.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec43d6fb80 1 -- 172.21.15.81:0/3473319531 wait complete. 2024-05-09T00:15:01.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.161+0000 7fec43d6fb80 20 client.18885 trim_cache size 0 max 16384 2024-05-09T00:15:01.166 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:15:01.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.162+0000 7fec37bb5700 1 -- 172.21.15.81:0/3568604979 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fec1c0a1310 msgr2=0x7fec1c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.162+0000 7fec37bb5700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fec1c0a1310 0x7fec1c0a37d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fec300ffa40 tx=0x7fec2c005f50 comp rx=0 tx=0).stop 2024-05-09T00:15:01.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.162+0000 7fec37bb5700 1 -- 172.21.15.81:0/3568604979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec300682e0 msgr2=0x7fec300ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.162+0000 7fec37bb5700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec300682e0 0x7fec300ffe60 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fec2000b580 tx=0x7fec20005e80 comp rx=0 tx=0).stop 2024-05-09T00:15:01.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.162+0000 7fec37bb5700 1 -- 172.21.15.81:0/3568604979 shutdown_connections 2024-05-09T00:15:01.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.162+0000 7fec37bb5700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fec1c0a1310 0x7fec1c0a37d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.162+0000 7fec37bb5700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fec301008e0 0x7fec301a55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.162+0000 7fec37bb5700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec300682e0 0x7fec300ffe60 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.162+0000 7fec37bb5700 1 --2- 172.21.15.81:0/3568604979 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fec30106290 0x7fec301003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.162+0000 7fec37bb5700 1 -- 172.21.15.81:0/3568604979 >> 172.21.15.81:0/3568604979 conn(0x7fec30076f40 msgr2=0x7fec300fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.162+0000 7fec37bb5700 1 -- 172.21.15.81:0/3568604979 shutdown_connections 2024-05-09T00:15:01.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.162+0000 7fec37bb5700 1 -- 172.21.15.81:0/3568604979 wait complete. 2024-05-09T00:15:01.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-05-09T00:15:01.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:00 smithi150 ceph-mon[46187]: pgmap v374: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.3 KiB/s wr, 6 op/s 2024-05-09T00:15:01.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.299+0000 7fdb91ce1700 1 -- 172.21.15.81:0/1779009950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c105160 msgr2=0x7fdb8c10cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.299+0000 7fdb91ce1700 1 --2- 172.21.15.81:0/1779009950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c105160 0x7fdb8c10cce0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400b1a0 tx=0x7fdb8400b4b0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.299+0000 7fdb91ce1700 1 -- 172.21.15.81:0/1779009950 shutdown_connections 2024-05-09T00:15:01.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.299+0000 7fdb91ce1700 1 --2- 172.21.15.81:0/1779009950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c105160 0x7fdb8c10cce0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.299+0000 7fdb91ce1700 1 --2- 172.21.15.81:0/1779009950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb8c100060 0x7fdb8c100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.299+0000 7fdb91ce1700 1 --2- 172.21.15.81:0/1779009950 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb8c100a10 0x7fdb8c104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.299+0000 7fdb91ce1700 1 -- 172.21.15.81:0/1779009950 >> 172.21.15.81:0/1779009950 conn(0x7fdb8c076f40 msgr2=0x7fdb8c077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.299+0000 7fdb91ce1700 1 -- 172.21.15.81:0/1779009950 shutdown_connections 2024-05-09T00:15:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.299+0000 7fdb91ce1700 1 -- 172.21.15.81:0/1779009950 wait complete. 2024-05-09T00:15:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.299+0000 7fdb91ce1700 1 Processor -- start 2024-05-09T00:15:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb91ce1700 1 -- start start 2024-05-09T00:15:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb91ce1700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c100060 0x7fdb8c1951a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb91ce1700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb8c105160 0x7fdb8c1956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb91ce1700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb8c199a80 0x7fdb8c199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb91ce1700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c19a500 con 0x7fdb8c100060 2024-05-09T00:15:01.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb91ce1700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c19a670 con 0x7fdb8c199a80 2024-05-09T00:15:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb91ce1700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8c19a830 con 0x7fdb8c105160 2024-05-09T00:15:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb8b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c100060 0x7fdb8c1951a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb8b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c100060 0x7fdb8c1951a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46940/0 (socket says 172.21.15.81:46940) 2024-05-09T00:15:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb8b7fe700 1 -- 172.21.15.81:0/2033042762 learned_addr learned my addr 172.21.15.81:0/2033042762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb8affd700 1 --2- 172.21.15.81:0/2033042762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb8c105160 0x7fdb8c1956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb8bfff700 1 --2- 172.21.15.81:0/2033042762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb8c199a80 0x7fdb8c199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb8b7fe700 1 -- 172.21.15.81:0/2033042762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb8c105160 msgr2=0x7fdb8c1956e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/2033042762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb8c105160 0x7fdb8c1956e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb8b7fe700 1 -- 172.21.15.81:0/2033042762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb8c199a80 msgr2=0x7fdb8c199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/2033042762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb8c199a80 0x7fdb8c199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb8b7fe700 1 -- 172.21.15.81:0/2033042762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb84009d00 con 0x7fdb8c100060 2024-05-09T00:15:01.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.300+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/2033042762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c100060 0x7fdb8c1951a0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400c920 tx=0x7fdb7400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.301+0000 7fdb88ff9700 1 -- 172.21.15.81:0/2033042762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74007b00 con 0x7fdb8c100060 2024-05-09T00:15:01.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.301+0000 7fdb91ce1700 1 -- 172.21.15.81:0/2033042762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb8c1a1d90 con 0x7fdb8c100060 2024-05-09T00:15:01.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.301+0000 7fdb88ff9700 1 -- 172.21.15.81:0/2033042762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb7400ce70 con 0x7fdb8c100060 2024-05-09T00:15:01.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.301+0000 7fdb88ff9700 1 -- 172.21.15.81:0/2033042762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74005460 con 0x7fdb8c100060 2024-05-09T00:15:01.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.301+0000 7fdb91ce1700 1 -- 172.21.15.81:0/2033042762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8c1a2210 con 0x7fdb8c100060 2024-05-09T00:15:01.309 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:00 smithi171 ceph-mon[47351]: pgmap v374: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.3 KiB/s wr, 6 op/s 2024-05-09T00:15:01.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.303+0000 7fdb88ff9700 1 -- 172.21.15.81:0/2033042762 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fdb74004750 con 0x7fdb8c100060 2024-05-09T00:15:01.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.303+0000 7fdb88ff9700 1 --2- 172.21.15.81:0/2033042762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fdb780a1290 0x7fdb780a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.303+0000 7fdb8affd700 1 --2- 172.21.15.81:0/2033042762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fdb780a1290 0x7fdb780a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.303+0000 7fdb88ff9700 1 -- 172.21.15.81:0/2033042762 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fdb740cc960 con 0x7fdb8c100060 2024-05-09T00:15:01.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.304+0000 7fdb8affd700 1 --2- 172.21.15.81:0/2033042762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fdb780a1290 0x7fdb780a3750 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c1966f0 tx=0x7fdb7c0073d0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.304+0000 7fdb9de9bb80 1 Processor -- start 2024-05-09T00:15:01.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.304+0000 7fdb9de9bb80 1 -- start start 2024-05-09T00:15:01.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.304+0000 7fdb9de9bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee5e00 0x55dbc9ee61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.304+0000 7fdb9de9bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee6720 0x55dbc9ee0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.304+0000 7fdb9de9bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.304+0000 7fdb9de9bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9e37150 con 0x55dbc9ee0890 2024-05-09T00:15:01.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.304+0000 7fdb9de9bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9e34b10 con 0x55dbc9ee6720 2024-05-09T00:15:01.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.304+0000 7fdb9de9bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9e30400 con 0x55dbc9ee5e00 2024-05-09T00:15:01.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.304+0000 7fdb8bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.304+0000 7fdb8bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46948/0 (socket says 172.21.15.81:46948) 2024-05-09T00:15:01.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.304+0000 7fdb8bfff700 1 -- 172.21.15.81:0/336846946 learned_addr learned my addr 172.21.15.81:0/336846946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.305+0000 7fdb8affd700 1 --2- 172.21.15.81:0/336846946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee6720 0x55dbc9ee0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.305+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/336846946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee5e00 0x55dbc9ee61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.305+0000 7fdb8bfff700 1 -- 172.21.15.81:0/336846946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee5e00 msgr2=0x55dbc9ee61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.305+0000 7fdb8bfff700 1 --2- 172.21.15.81:0/336846946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee5e00 0x55dbc9ee61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.305+0000 7fdb8bfff700 1 -- 172.21.15.81:0/336846946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee6720 msgr2=0x55dbc9ee0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.305+0000 7fdb8bfff700 1 --2- 172.21.15.81:0/336846946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee6720 0x55dbc9ee0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.305+0000 7fdb8bfff700 1 -- 172.21.15.81:0/336846946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbc9cb13b0 con 0x55dbc9ee0890 2024-05-09T00:15:01.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.305+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/336846946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee5e00 0x55dbc9ee61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:01.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.305+0000 7fdb8bfff700 1 --2- 172.21.15.81:0/336846946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee0cd0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009730 tx=0x7fdb84009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c5c68bbfc8d6b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.305+0000 7fdb81ffb700 1 -- 172.21.15.81:0/336846946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8401e070 con 0x55dbc9ee0890 2024-05-09T00:15:01.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.305+0000 7fdb81ffb700 1 -- 172.21.15.81:0/336846946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb8400bd30 con 0x55dbc9ee0890 2024-05-09T00:15:01.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.305+0000 7fdb81ffb700 1 -- 172.21.15.81:0/336846946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb84003c60 con 0x55dbc9ee0890 2024-05-09T00:15:01.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.306+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/336846946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee0890 msgr2=0x55dbc9ee0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.306+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/336846946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee0cd0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7fdb84009730 tx=0x7fdb84009760 comp rx=0 tx=0).stop 2024-05-09T00:15:01.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.306+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/336846946 shutdown_connections 2024-05-09T00:15:01.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.306+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/336846946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee0cd0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.306+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/336846946 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee5e00 0x55dbc9ee61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.306+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/336846946 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee6720 0x55dbc9ee0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.306+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/336846946 >> 172.21.15.81:0/336846946 conn(0x55dbc9e3e210 msgr2=0x55dbc9edadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.306+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/336846946 shutdown_connections 2024-05-09T00:15:01.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.306+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/336846946 wait complete. 2024-05-09T00:15:01.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.306+0000 7fdb9de9bb80 1 -- start start 2024-05-09T00:15:01.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.306+0000 7fdb9de9bb80 1 Processor -- start 2024-05-09T00:15:01.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb9de9bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb9de9bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee5e00 0x55dbc9eea010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb9de9bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee6720 0x55dbc9eea550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb9de9bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9dcc560 con 0x55dbc9ee6720 2024-05-09T00:15:01.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb9de9bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9dcc200 con 0x55dbc9ee5e00 2024-05-09T00:15:01.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb9de9bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9cb36a0 con 0x55dbc9ee0890 2024-05-09T00:15:01.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb9de9bb80 10 client.0 _ll_register_callbacks cb 0x55dbc9dd5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:15:01.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb8bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee6720 0x55dbc9eea550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb8bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee6720 0x55dbc9eea550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46952/0 (socket says 172.21.15.81:46952) 2024-05-09T00:15:01.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb8bfff700 1 -- 172.21.15.81:0/874321431 learned_addr learned my addr 172.21.15.81:0/874321431 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb8affd700 1 --2- 172.21.15.81:0/874321431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee5e00 0x55dbc9eea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/874321431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb8bfff700 1 -- 172.21.15.81:0/874321431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee0890 msgr2=0x55dbc9ee9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb8bfff700 1 --2- 172.21.15.81:0/874321431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb8bfff700 1 -- 172.21.15.81:0/874321431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee5e00 msgr2=0x55dbc9eea010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb8bfff700 1 --2- 172.21.15.81:0/874321431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee5e00 0x55dbc9eea010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb8bfff700 1 -- 172.21.15.81:0/874321431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8c10d550 con 0x55dbc9ee6720 2024-05-09T00:15:01.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/874321431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:01.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb8bfff700 1 --2- 172.21.15.81:0/874321431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee6720 0x55dbc9eea550 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fdb840077b0 tx=0x7fdb84009180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d47570fd858c57 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb6affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:15:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.307+0000 7fdb6affd700 1 -- 172.21.15.81:0/874321431 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8401e040 con 0x55dbc9ee6720 2024-05-09T00:15:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.308+0000 7fdb6affd700 1 -- 172.21.15.81:0/874321431 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fdb84003e10 con 0x55dbc9ee6720 2024-05-09T00:15:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.308+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/874321431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dbc9d89270 con 0x55dbc9ee6720 2024-05-09T00:15:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.308+0000 7fdb6affd700 1 -- 172.21.15.81:0/874321431 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb840078b0 con 0x55dbc9ee6720 2024-05-09T00:15:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.308+0000 7fdb9de9bb80 10 client.18897 fetch_fsmap learned FSMap version 26 2024-05-09T00:15:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.308+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/874321431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55dbc9c5db60 con 0x55dbc9ee6720 2024-05-09T00:15:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.308+0000 7fdb6affd700 1 -- 172.21.15.81:0/874321431 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb84038020 con 0x55dbc9ee6720 2024-05-09T00:15:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.308+0000 7fdb6affd700 1 -- 172.21.15.81:0/874321431 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdb840051b0 con 0x55dbc9ee6720 2024-05-09T00:15:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.308+0000 7fdb9de9bb80 10 client.18897 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:15:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.308+0000 7fdb9de9bb80 10 client.18897 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:15:01.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.308+0000 7fdb9de9bb80 20 client.18897 populate_metadata read hostname 'smithi081' 2024-05-09T00:15:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.308+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/874321431 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55dbc9ef9c00 0x55dbc9efbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.308+0000 7fdb9de9bb80 4 client.18897 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:15:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.308+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/874321431 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dbc9eaf810 con 0x55dbc9ef9c00 2024-05-09T00:15:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.308+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/874321431 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55dbc9ef9c00 0x55dbc9efbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.309+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/874321431 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55dbc9ef9c00 0x55dbc9efbff0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9983a7ea3efdf24c server_cookie=edfaa6900db39bde in_seq=0 out_seq=0 2024-05-09T00:15:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.309+0000 7fdb6affd700 10 client.18897 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:15:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.309+0000 7fdb6affd700 1 -- 172.21.15.81:0/874321431 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dbc9eaf810 con 0x55dbc9ef9c00 2024-05-09T00:15:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.309+0000 7fdb6affd700 10 client.18897 handle_command_reply: tid=0 2024-05-09T00:15:01.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.309+0000 7fdb9de9bb80 1 client.18897 shutdown 2024-05-09T00:15:01.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.309+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/874321431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee6720 msgr2=0x55dbc9eea550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.309+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/874321431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee6720 0x55dbc9eea550 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7fdb840077b0 tx=0x7fdb84009180 comp rx=0 tx=0).stop 2024-05-09T00:15:01.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.310+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/874321431 shutdown_connections 2024-05-09T00:15:01.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.310+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/874321431 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55dbc9ef9c00 0x55dbc9efbff0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.310+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/874321431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee6720 0x55dbc9eea550 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.310+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/874321431 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.310+0000 7fdb6affd700 0 client.18897 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:15:01.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.310+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/874321431 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee5e00 0x55dbc9eea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.310+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/874321431 >> 172.21.15.81:0/874321431 conn(0x55dbc9e3e210 msgr2=0x55dbc9eda5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.310+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/874321431 shutdown_connections 2024-05-09T00:15:01.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.310+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/874321431 wait complete. 2024-05-09T00:15:01.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.310+0000 7fdb9de9bb80 20 client.18897 trim_cache size 0 max 16384 2024-05-09T00:15:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb9de9bb80 1 Processor -- start 2024-05-09T00:15:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb9de9bb80 1 -- start start 2024-05-09T00:15:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb9de9bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb9de9bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee5e00 0x55dbc9edad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb9de9bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee6720 0x55dbc9eea370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb9de9bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9f011c0 con 0x55dbc9ee0890 2024-05-09T00:15:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb9de9bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9ed5800 con 0x55dbc9ee6720 2024-05-09T00:15:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb9de9bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9ed3080 con 0x55dbc9ee5e00 2024-05-09T00:15:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb8b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb8b7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46966/0 (socket says 172.21.15.81:46966) 2024-05-09T00:15:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb8b7fe700 1 -- 172.21.15.81:0/2030194978 learned_addr learned my addr 172.21.15.81:0/2030194978 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb8affd700 1 --2- 172.21.15.81:0/2030194978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee5e00 0x55dbc9edad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb8b7fe700 1 -- 172.21.15.81:0/2030194978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee5e00 msgr2=0x55dbc9edad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/2030194978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee5e00 0x55dbc9edad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb8b7fe700 1 -- 172.21.15.81:0/2030194978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee6720 msgr2=0x55dbc9eea370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/2030194978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee6720 0x55dbc9eea370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.323+0000 7fdb8b7fe700 1 -- 172.21.15.81:0/2030194978 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dbc9df6560 con 0x55dbc9ee0890 2024-05-09T00:15:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.324+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/2030194978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee0350 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400a6b0 tx=0x7fdb74007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250ce33b4e01895b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.324+0000 7fdb827fc700 1 -- 172.21.15.81:0/2030194978 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7409d870 con 0x55dbc9ee0890 2024-05-09T00:15:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.324+0000 7fdb827fc700 1 -- 172.21.15.81:0/2030194978 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb740a1ec0 con 0x55dbc9ee0890 2024-05-09T00:15:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.324+0000 7fdb827fc700 1 -- 172.21.15.81:0/2030194978 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb74096150 con 0x55dbc9ee0890 2024-05-09T00:15:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.324+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/2030194978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee0890 msgr2=0x55dbc9ee0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.324+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/2030194978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee0350 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400a6b0 tx=0x7fdb74007610 comp rx=0 tx=0).stop 2024-05-09T00:15:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.324+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/2030194978 shutdown_connections 2024-05-09T00:15:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.324+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/2030194978 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee6720 0x55dbc9eea370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.324+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/2030194978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee0890 0x55dbc9ee0350 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.324+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/2030194978 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee5e00 0x55dbc9edad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.324+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/2030194978 >> 172.21.15.81:0/2030194978 conn(0x55dbc9e3e210 msgr2=0x55dbc9ee0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.324+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/2030194978 shutdown_connections 2024-05-09T00:15:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.324+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/2030194978 wait complete. 2024-05-09T00:15:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb9de9bb80 1 -- start start 2024-05-09T00:15:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb9de9bb80 1 Processor -- start 2024-05-09T00:15:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb9de9bb80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee0890 0x55dbc9ef1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb9de9bb80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee5e00 0x55dbc9eee830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb9de9bb80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee6720 0x55dbc9eeed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb9de9bb80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9eef340 con 0x55dbc9ee5e00 2024-05-09T00:15:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb9de9bb80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9eef4b0 con 0x55dbc9ee0890 2024-05-09T00:15:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb9de9bb80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dbc9eef670 con 0x55dbc9ee6720 2024-05-09T00:15:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb9de9bb80 10 client.0 _ll_register_callbacks cb 0x55dbc9dd5b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:15:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb8affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee5e00 0x55dbc9eee830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb8affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee5e00 0x55dbc9eee830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46972/0 (socket says 172.21.15.81:46972) 2024-05-09T00:15:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb8affd700 1 -- 172.21.15.81:0/2584738009 learned_addr learned my addr 172.21.15.81:0/2584738009 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/2584738009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee0890 0x55dbc9ef1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb8bfff700 1 --2- 172.21.15.81:0/2584738009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee6720 0x55dbc9eeed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb8affd700 1 -- 172.21.15.81:0/2584738009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee6720 msgr2=0x55dbc9eeed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb8affd700 1 --2- 172.21.15.81:0/2584738009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee6720 0x55dbc9eeed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb8affd700 1 -- 172.21.15.81:0/2584738009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee0890 msgr2=0x55dbc9ef1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.325+0000 7fdb8affd700 1 --2- 172.21.15.81:0/2584738009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee0890 0x55dbc9ef1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb8affd700 1 -- 172.21.15.81:0/2584738009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb8c1a2210 con 0x55dbc9ee5e00 2024-05-09T00:15:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb8affd700 1 --2- 172.21.15.81:0/2584738009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee5e00 0x55dbc9eee830 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x55dbc9ee6b80 tx=0x7fdb7c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ce8b88bf1d31b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb6affd700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:15:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb6affd700 1 -- 172.21.15.81:0/2584738009 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c010e60 con 0x55dbc9ee5e00 2024-05-09T00:15:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb6affd700 1 -- 172.21.15.81:0/2584738009 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fdb7c017070 con 0x55dbc9ee5e00 2024-05-09T00:15:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/2584738009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb8400bd30 con 0x55dbc9ee5e00 2024-05-09T00:15:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb6affd700 1 -- 172.21.15.81:0/2584738009 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb7c004050 con 0x55dbc9ee5e00 2024-05-09T00:15:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb9de9bb80 10 client.18903 fetch_fsmap learned FSMap version 26 2024-05-09T00:15:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/2584738009 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55dbc9cb5cd0 con 0x55dbc9ee5e00 2024-05-09T00:15:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb6affd700 1 -- 172.21.15.81:0/2584738009 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb8400bd30 con 0x55dbc9ee5e00 2024-05-09T00:15:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb6affd700 1 -- 172.21.15.81:0/2584738009 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdb7c011440 con 0x55dbc9ee5e00 2024-05-09T00:15:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb9de9bb80 10 client.18903 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:15:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb9de9bb80 10 client.18903 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-09T00:15:01.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb9de9bb80 20 client.18903 populate_metadata read hostname 'smithi081' 2024-05-09T00:15:01.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/2584738009 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55dbc9f507e0 0x55dbc9f52c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb9de9bb80 4 client.18903 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:15:01.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.326+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/2584738009 --> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55dbc9e28ec0 con 0x55dbc9f507e0 2024-05-09T00:15:01.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/2584738009 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55dbc9f507e0 0x55dbc9f52c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb6affd700 10 client.18903 ms_handle_connect on v2:172.21.15.171:6838/932961693 2024-05-09T00:15:01.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb8b7fe700 1 --2- 172.21.15.81:0/2584738009 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55dbc9f507e0 0x55dbc9f52c00 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=17176c82a94cc035 server_cookie=3a13a15fd541849f in_seq=0 out_seq=0 2024-05-09T00:15:01.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb6affd700 1 -- 172.21.15.81:0/2584738009 <== mds.1 v2:172.21.15.171:6838/932961693 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55dbc9e28ec0 con 0x55dbc9f507e0 2024-05-09T00:15:01.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb6affd700 10 client.18903 handle_command_reply: tid=0 2024-05-09T00:15:01.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb9de9bb80 1 client.18903 shutdown 2024-05-09T00:15:01.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/2584738009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee5e00 msgr2=0x55dbc9eee830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/2584738009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee5e00 0x55dbc9eee830 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x55dbc9ee6b80 tx=0x7fdb7c0047c0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/2584738009 shutdown_connections 2024-05-09T00:15:01.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/2584738009 >> [v2:172.21.15.171:6838/932961693,v1:172.21.15.171:6839/932961693] conn(0x55dbc9f507e0 0x55dbc9f52c00 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/2584738009 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55dbc9ee0890 0x55dbc9ef1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/2584738009 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dbc9ee6720 0x55dbc9eeed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb6affd700 0 client.18903 ms_handle_reset on v2:172.21.15.171:6838/932961693 2024-05-09T00:15:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb9de9bb80 1 --2- 172.21.15.81:0/2584738009 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55dbc9ee5e00 0x55dbc9eee830 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.327+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/2584738009 >> 172.21.15.81:0/2584738009 conn(0x55dbc9e3e210 msgr2=0x55dbc9eea280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/2584738009 shutdown_connections 2024-05-09T00:15:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb9de9bb80 1 -- 172.21.15.81:0/2584738009 wait complete. 2024-05-09T00:15:01.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb9de9bb80 20 client.18903 trim_cache size 0 max 16384 2024-05-09T00:15:01.333 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:15:01.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb91ce1700 1 -- 172.21.15.81:0/2033042762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fdb780a1290 msgr2=0x7fdb780a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb91ce1700 1 --2- 172.21.15.81:0/2033042762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fdb780a1290 0x7fdb780a3750 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c1966f0 tx=0x7fdb7c0073d0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb91ce1700 1 -- 172.21.15.81:0/2033042762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c100060 msgr2=0x7fdb8c1951a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb91ce1700 1 --2- 172.21.15.81:0/2033042762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c100060 0x7fdb8c1951a0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400c920 tx=0x7fdb7400cc30 comp rx=0 tx=0).stop 2024-05-09T00:15:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb91ce1700 1 -- 172.21.15.81:0/2033042762 shutdown_connections 2024-05-09T00:15:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb91ce1700 1 --2- 172.21.15.81:0/2033042762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fdb780a1290 0x7fdb780a3750 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb91ce1700 1 --2- 172.21.15.81:0/2033042762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fdb8c199a80 0x7fdb8c199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb91ce1700 1 --2- 172.21.15.81:0/2033042762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdb8c100060 0x7fdb8c1951a0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb91ce1700 1 --2- 172.21.15.81:0/2033042762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdb8c105160 0x7fdb8c1956e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb91ce1700 1 -- 172.21.15.81:0/2033042762 >> 172.21.15.81:0/2033042762 conn(0x7fdb8c076f40 msgr2=0x7fdb8c0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb91ce1700 1 -- 172.21.15.81:0/2033042762 shutdown_connections 2024-05-09T00:15:01.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.328+0000 7fdb91ce1700 1 -- 172.21.15.81:0/2033042762 wait complete. 2024-05-09T00:15:01.337 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:00 smithi081 ceph-mon[42474]: pgmap v374: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.3 KiB/s wr, 6 op/s 2024-05-09T00:15:01.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-05-09T00:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.465+0000 7f320028e700 1 -- 172.21.15.81:0/656420856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f8100ab0 msgr2=0x7f31f810ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.465+0000 7f320028e700 1 --2- 172.21.15.81:0/656420856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f8100ab0 0x7f31f810ccc0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f31f000b0d0 tx=0x7f31f000b3e0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 -- 172.21.15.81:0/656420856 shutdown_connections 2024-05-09T00:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 --2- 172.21.15.81:0/656420856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f8100ab0 0x7f31f810ccc0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 --2- 172.21.15.81:0/656420856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f8105f90 0x7f31f8106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 --2- 172.21.15.81:0/656420856 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31f81000f0 0x7f31f8100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 -- 172.21.15.81:0/656420856 >> 172.21.15.81:0/656420856 conn(0x7f31f8076ba0 msgr2=0x7f31f8076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 -- 172.21.15.81:0/656420856 shutdown_connections 2024-05-09T00:15:01.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 -- 172.21.15.81:0/656420856 wait complete. 2024-05-09T00:15:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 Processor -- start 2024-05-09T00:15:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 -- start start 2024-05-09T00:15:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31f81000f0 0x7f31f8196330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f8100ab0 0x7f31f8196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f8105f90 0x7f31f819ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f819b250 con 0x7f31f8100ab0 2024-05-09T00:15:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f819b3c0 con 0x7f31f81000f0 2024-05-09T00:15:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.466+0000 7f320028e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f819b580 con 0x7f31f8105f90 2024-05-09T00:15:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f31fd829700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f8100ab0 0x7f31f8196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f31fd829700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f8100ab0 0x7f31f8196870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46998/0 (socket says 172.21.15.81:46998) 2024-05-09T00:15:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f31fd829700 1 -- 172.21.15.81:0/2274914644 learned_addr learned my addr 172.21.15.81:0/2274914644 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f31fe82b700 1 --2- 172.21.15.81:0/2274914644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f8105f90 0x7f31f819ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f31fd829700 1 -- 172.21.15.81:0/2274914644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f8105f90 msgr2=0x7f31f819ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f31fd829700 1 --2- 172.21.15.81:0/2274914644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f8105f90 0x7f31f819ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f31fd829700 1 -- 172.21.15.81:0/2274914644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31f81000f0 msgr2=0x7f31f8196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f31fd829700 1 --2- 172.21.15.81:0/2274914644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31f81000f0 0x7f31f8196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f31fd829700 1 -- 172.21.15.81:0/2274914644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f0009d00 con 0x7f31f8100ab0 2024-05-09T00:15:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f31fd829700 1 --2- 172.21.15.81:0/2274914644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f8100ab0 0x7f31f8196870 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f31e800c9b0 tx=0x7f31e800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f31ef7fe700 1 -- 172.21.15.81:0/2274914644 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8007b00 con 0x7f31f8100ab0 2024-05-09T00:15:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f31ef7fe700 1 -- 172.21.15.81:0/2274914644 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31e8007c60 con 0x7f31f8100ab0 2024-05-09T00:15:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f320028e700 1 -- 172.21.15.81:0/2274914644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f819b860 con 0x7f31f8100ab0 2024-05-09T00:15:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f31ef7fe700 1 -- 172.21.15.81:0/2274914644 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8018660 con 0x7f31f8100ab0 2024-05-09T00:15:01.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.467+0000 7f320028e700 1 -- 172.21.15.81:0/2274914644 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f81a30a0 con 0x7f31f8100ab0 2024-05-09T00:15:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.469+0000 7f31ef7fe700 1 -- 172.21.15.81:0/2274914644 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f31e800f450 con 0x7f31f8100ab0 2024-05-09T00:15:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.470+0000 7f31ef7fe700 1 --2- 172.21.15.81:0/2274914644 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f31e40a1390 0x7f31e40a3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.470+0000 7f31fe02a700 1 --2- 172.21.15.81:0/2274914644 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f31e40a1390 0x7f31e40a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.470+0000 7f31ef7fe700 1 -- 172.21.15.81:0/2274914644 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f31e80cccb0 con 0x7f31f8100ab0 2024-05-09T00:15:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.470+0000 7f31fe02a700 1 --2- 172.21.15.81:0/2274914644 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f31e40a1390 0x7f31e40a3850 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f31f4005950 tx=0x7f31f40058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.471+0000 7f320c448b80 1 Processor -- start 2024-05-09T00:15:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.471+0000 7f320c448b80 1 -- start start 2024-05-09T00:15:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.471+0000 7f320c448b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 0x564a946831e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.471+0000 7f320c448b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a94683720 0x564a9467d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.471+0000 7f320c448b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a9467d890 0x564a9467dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.471+0000 7f320c448b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a945d4150 con 0x564a9467d890 2024-05-09T00:15:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.471+0000 7f320c448b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a945d1b10 con 0x564a94682e00 2024-05-09T00:15:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.471+0000 7f320c448b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a945cd400 con 0x564a94683720 2024-05-09T00:15:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.471+0000 7f31fe82b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a9467d890 0x564a9467dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.471+0000 7f31fe82b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a9467d890 0x564a9467dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47002/0 (socket says 172.21.15.81:47002) 2024-05-09T00:15:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.471+0000 7f31fe82b700 1 -- 172.21.15.81:0/1416849124 learned_addr learned my addr 172.21.15.81:0/1416849124 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.471+0000 7f31fe02a700 1 --2- 172.21.15.81:0/1416849124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 0x564a946831e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.471+0000 7f31fd829700 1 --2- 172.21.15.81:0/1416849124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a94683720 0x564a9467d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.472+0000 7f31fe82b700 1 -- 172.21.15.81:0/1416849124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a94683720 msgr2=0x564a9467d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.472+0000 7f31fe82b700 1 --2- 172.21.15.81:0/1416849124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a94683720 0x564a9467d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.472+0000 7f31fe82b700 1 -- 172.21.15.81:0/1416849124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 msgr2=0x564a946831e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.472+0000 7f31fe82b700 1 --2- 172.21.15.81:0/1416849124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 0x564a946831e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.472+0000 7f31fe82b700 1 -- 172.21.15.81:0/1416849124 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a9444e3b0 con 0x564a9467d890 2024-05-09T00:15:01.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.472+0000 7f31fe82b700 1 --2- 172.21.15.81:0/1416849124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a9467d890 0x564a9467dcd0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f31f0005b80 tx=0x7f31f00092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36274d84c408324b server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.472+0000 7f31ecda4700 1 -- 172.21.15.81:0/1416849124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000e040 con 0x564a9467d890 2024-05-09T00:15:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.472+0000 7f31ecda4700 1 -- 172.21.15.81:0/1416849124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31f0009b80 con 0x564a9467d890 2024-05-09T00:15:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.472+0000 7f31ecda4700 1 -- 172.21.15.81:0/1416849124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0003c60 con 0x564a9467d890 2024-05-09T00:15:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 -- 172.21.15.81:0/1416849124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a9467d890 msgr2=0x564a9467dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 --2- 172.21.15.81:0/1416849124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a9467d890 0x564a9467dcd0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f31f0005b80 tx=0x7f31f00092e0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 -- 172.21.15.81:0/1416849124 shutdown_connections 2024-05-09T00:15:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 --2- 172.21.15.81:0/1416849124 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 0x564a946831e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 --2- 172.21.15.81:0/1416849124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a9467d890 0x564a9467dcd0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 --2- 172.21.15.81:0/1416849124 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a94683720 0x564a9467d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 -- 172.21.15.81:0/1416849124 >> 172.21.15.81:0/1416849124 conn(0x564a945db210 msgr2=0x564a94677df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 -- 172.21.15.81:0/1416849124 shutdown_connections 2024-05-09T00:15:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 -- 172.21.15.81:0/1416849124 wait complete. 2024-05-09T00:15:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 -- start start 2024-05-09T00:15:01.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 Processor -- start 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a9467d890 0x564a946896f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 0x564a94686af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a94683720 0x564a94687170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a94569560 con 0x564a9467d890 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a94569200 con 0x564a94682e00 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a944506a0 con 0x564a94683720 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.473+0000 7f320c448b80 10 client.0 _ll_register_callbacks cb 0x564a94572b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31fe02a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a9467d890 0x564a946896f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31fe02a700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a9467d890 0x564a946896f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47014/0 (socket says 172.21.15.81:47014) 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31fe02a700 1 -- 172.21.15.81:0/2188074090 learned_addr learned my addr 172.21.15.81:0/2188074090 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31fe82b700 1 --2- 172.21.15.81:0/2188074090 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a94683720 0x564a94687170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31fd829700 1 --2- 172.21.15.81:0/2188074090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 0x564a94686af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31fe02a700 1 -- 172.21.15.81:0/2188074090 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a94683720 msgr2=0x564a94687170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31fe02a700 1 --2- 172.21.15.81:0/2188074090 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a94683720 0x564a94687170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31fe02a700 1 -- 172.21.15.81:0/2188074090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 msgr2=0x564a94686af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31fe02a700 1 --2- 172.21.15.81:0/2188074090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 0x564a94686af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31fe02a700 1 -- 172.21.15.81:0/2188074090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f810d550 con 0x564a9467d890 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31fd829700 1 --2- 172.21.15.81:0/2188074090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 0x564a94686af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31fe02a700 1 --2- 172.21.15.81:0/2188074090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a9467d890 0x564a946896f0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f31f401d6e0 tx=0x7f31f4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe32041a9292d7af server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31e1ffb700 1 -- 172.21.15.81:0/2188074090 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4010840 con 0x564a9467d890 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f320c448b80 1 -- 172.21.15.81:0/2188074090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a9464c810 con 0x564a9467d890 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31e1ffb700 1 -- 172.21.15.81:0/2188074090 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f31f40109a0 con 0x564a9467d890 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f31e1ffb700 1 -- 172.21.15.81:0/2188074090 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31f400eea0 con 0x564a9467d890 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f320c448b80 10 client.18915 fetch_fsmap learned FSMap version 26 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.474+0000 7f320c448b80 1 -- 172.21.15.81:0/2188074090 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564a943fab60 con 0x564a9467d890 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.475+0000 7f31e1ffb700 1 -- 172.21.15.81:0/2188074090 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564a9464c810 con 0x564a9467d890 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.475+0000 7f31e1ffb700 1 -- 172.21.15.81:0/2188074090 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f31f4018050 con 0x564a9467d890 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.475+0000 7f320c448b80 10 client.18915 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:15:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.475+0000 7f320c448b80 10 client.18915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.475+0000 7f320c448b80 20 client.18915 populate_metadata read hostname 'smithi081' 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.475+0000 7f320c448b80 1 --2- 172.21.15.81:0/2188074090 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a94697190 0x564a946995b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.475+0000 7f320c448b80 4 client.18915 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.475+0000 7f320c448b80 1 -- 172.21.15.81:0/2188074090 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a945c5ec0 con 0x564a94697190 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.475+0000 7f31fd829700 1 --2- 172.21.15.81:0/2188074090 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a94697190 0x564a946995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f31fd829700 1 --2- 172.21.15.81:0/2188074090 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a94697190 0x564a946995b0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e26bdcd0a5304028 server_cookie=dede668e3ac805ca in_seq=0 out_seq=0 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f31e1ffb700 10 client.18915 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f31e1ffb700 1 -- 172.21.15.81:0/2188074090 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564a945c5ec0 con 0x564a94697190 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f31e1ffb700 10 client.18915 handle_command_reply: tid=0 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f320c448b80 1 client.18915 shutdown 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f320c448b80 1 -- 172.21.15.81:0/2188074090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a9467d890 msgr2=0x564a946896f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f320c448b80 1 --2- 172.21.15.81:0/2188074090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a9467d890 0x564a946896f0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f31f401d6e0 tx=0x7f31f4004750 comp rx=0 tx=0).stop 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f320c448b80 1 -- 172.21.15.81:0/2188074090 shutdown_connections 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f320c448b80 1 --2- 172.21.15.81:0/2188074090 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a94697190 0x564a946995b0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f320c448b80 1 --2- 172.21.15.81:0/2188074090 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a94683720 0x564a94687170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f320c448b80 1 --2- 172.21.15.81:0/2188074090 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a9467d890 0x564a946896f0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f320c448b80 1 --2- 172.21.15.81:0/2188074090 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 0x564a94686af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f31e1ffb700 0 client.18915 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:15:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f320c448b80 1 -- 172.21.15.81:0/2188074090 >> 172.21.15.81:0/2188074090 conn(0x564a945db210 msgr2=0x564a946775a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f320c448b80 1 -- 172.21.15.81:0/2188074090 shutdown_connections 2024-05-09T00:15:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.476+0000 7f320c448b80 1 -- 172.21.15.81:0/2188074090 wait complete. 2024-05-09T00:15:01.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.477+0000 7f320c448b80 20 client.18915 trim_cache size 0 max 16384 2024-05-09T00:15:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f320c448b80 1 Processor -- start 2024-05-09T00:15:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f320c448b80 1 -- start start 2024-05-09T00:15:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f320c448b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a9467d890 0x564a9467d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f320c448b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 0x564a94677d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f320c448b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a94683720 0x564a94692bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f320c448b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9469e7c0 con 0x564a94683720 2024-05-09T00:15:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f320c448b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a94684b10 con 0x564a94682e00 2024-05-09T00:15:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f320c448b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a94678260 con 0x564a9467d890 2024-05-09T00:15:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f31fe82b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a94683720 0x564a94692bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f31fe82b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a94683720 0x564a94692bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47026/0 (socket says 172.21.15.81:47026) 2024-05-09T00:15:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f31fe82b700 1 -- 172.21.15.81:0/3401924222 learned_addr learned my addr 172.21.15.81:0/3401924222 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f31fe02a700 1 --2- 172.21.15.81:0/3401924222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a9467d890 0x564a9467d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f31fd829700 1 --2- 172.21.15.81:0/3401924222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 0x564a94677d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f31fe82b700 1 -- 172.21.15.81:0/3401924222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a9467d890 msgr2=0x564a9467d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f31fe82b700 1 --2- 172.21.15.81:0/3401924222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a9467d890 0x564a9467d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f31fe82b700 1 -- 172.21.15.81:0/3401924222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 msgr2=0x564a94677d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f31fe82b700 1 --2- 172.21.15.81:0/3401924222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 0x564a94677d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f31fe82b700 1 -- 172.21.15.81:0/3401924222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a94593560 con 0x564a94683720 2024-05-09T00:15:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.490+0000 7f31fd829700 1 --2- 172.21.15.81:0/3401924222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 0x564a94677d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:15:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.491+0000 7f31fe82b700 1 --2- 172.21.15.81:0/3401924222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a94683720 0x564a94692bc0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f31f000b420 tx=0x7f31f0006090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb82c0821c72d2c server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.491+0000 7f31ed5a5700 1 -- 172.21.15.81:0/3401924222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000e040 con 0x564a94683720 2024-05-09T00:15:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.491+0000 7f31ed5a5700 1 -- 172.21.15.81:0/3401924222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31f0007e00 con 0x564a94683720 2024-05-09T00:15:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.491+0000 7f31ed5a5700 1 -- 172.21.15.81:0/3401924222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0007900 con 0x564a94683720 2024-05-09T00:15:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.491+0000 7f320c448b80 1 -- 172.21.15.81:0/3401924222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a94683720 msgr2=0x564a94692bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.491+0000 7f320c448b80 1 --2- 172.21.15.81:0/3401924222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a94683720 0x564a94692bc0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f31f000b420 tx=0x7f31f0006090 comp rx=0 tx=0).stop 2024-05-09T00:15:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.491+0000 7f320c448b80 1 -- 172.21.15.81:0/3401924222 shutdown_connections 2024-05-09T00:15:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.491+0000 7f320c448b80 1 --2- 172.21.15.81:0/3401924222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a94683720 0x564a94692bc0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.491+0000 7f320c448b80 1 --2- 172.21.15.81:0/3401924222 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a9467d890 0x564a9467d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.491+0000 7f320c448b80 1 --2- 172.21.15.81:0/3401924222 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94682e00 0x564a94677d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.491+0000 7f320c448b80 1 -- 172.21.15.81:0/3401924222 >> 172.21.15.81:0/3401924222 conn(0x564a945db210 msgr2=0x564a94680cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.491+0000 7f320c448b80 1 -- 172.21.15.81:0/3401924222 shutdown_connections 2024-05-09T00:15:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.491+0000 7f320c448b80 1 -- 172.21.15.81:0/3401924222 wait complete. 2024-05-09T00:15:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.492+0000 7f320c448b80 1 -- start start 2024-05-09T00:15:01.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.492+0000 7f320c448b80 1 Processor -- start 2024-05-09T00:15:01.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.492+0000 7f320c448b80 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a9467d890 0x564a9468e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.492+0000 7f320c448b80 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a94682e00 0x564a9468c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.492+0000 7f320c448b80 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94683720 0x564a9468c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.492+0000 7f320c448b80 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9468cd60 con 0x564a94682e00 2024-05-09T00:15:01.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.492+0000 7f320c448b80 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a9468ced0 con 0x564a94683720 2024-05-09T00:15:01.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.492+0000 7f320c448b80 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a946ec6b0 con 0x564a9467d890 2024-05-09T00:15:01.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.492+0000 7f320c448b80 10 client.0 _ll_register_callbacks cb 0x564a94572b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-09T00:15:01.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.492+0000 7f31fd829700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a94682e00 0x564a9468c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.492+0000 7f31fe02a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a9467d890 0x564a9468e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.492+0000 7f31fd829700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a94682e00 0x564a9468c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47038/0 (socket says 172.21.15.81:47038) 2024-05-09T00:15:01.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.492+0000 7f31fd829700 1 -- 172.21.15.81:0/1198640524 learned_addr learned my addr 172.21.15.81:0/1198640524 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:01.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.492+0000 7f31fe82b700 1 --2- 172.21.15.81:0/1198640524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94683720 0x564a9468c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f31fd829700 1 -- 172.21.15.81:0/1198640524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a9467d890 msgr2=0x564a9468e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f31fd829700 1 --2- 172.21.15.81:0/1198640524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a9467d890 0x564a9468e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f31fd829700 1 -- 172.21.15.81:0/1198640524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94683720 msgr2=0x564a9468c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-09T00:15:01.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f31fd829700 1 --2- 172.21.15.81:0/1198640524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94683720 0x564a9468c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f31fd829700 1 -- 172.21.15.81:0/1198640524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a9444e3b0 con 0x564a94682e00 2024-05-09T00:15:01.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f31fe02a700 1 --2- 172.21.15.81:0/1198640524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a9467d890 0x564a9468e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-09T00:15:01.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f31fd829700 1 --2- 172.21.15.81:0/1198640524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a94682e00 0x564a9468c0f0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f31e800afd0 tx=0x7f31e800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ea7b88e901e96e server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:01.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f31e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-05-09T00:15:01.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f31e1ffb700 1 -- 172.21.15.81:0/1198640524 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e80a21b0 con 0x564a94682e00 2024-05-09T00:15:01.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f31e1ffb700 1 -- 172.21.15.81:0/1198640524 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f31e80ca5f0 con 0x564a94682e00 2024-05-09T00:15:01.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f320c448b80 1 -- 172.21.15.81:0/1198640524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a94526270 con 0x564a94682e00 2024-05-09T00:15:01.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f31e1ffb700 1 -- 172.21.15.81:0/1198640524 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31e80ca7b0 con 0x564a94682e00 2024-05-09T00:15:01.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f320c448b80 10 client.18921 fetch_fsmap learned FSMap version 26 2024-05-09T00:15:01.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f320c448b80 1 -- 172.21.15.81:0/1198640524 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564a94452cd0 con 0x564a94682e00 2024-05-09T00:15:01.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f31e1ffb700 1 -- 172.21.15.81:0/1198640524 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564a94526270 con 0x564a94682e00 2024-05-09T00:15:01.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f31e1ffb700 1 -- 172.21.15.81:0/1198640524 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f31e809a020 con 0x564a94682e00 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f320c448b80 10 client.18921 fetch_fsmap finished waiting for FSMap version 26 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f320c448b80 10 client.18921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f320c448b80 20 client.18921 populate_metadata read hostname 'smithi081' 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f320c448b80 1 --2- 172.21.15.81:0/1198640524 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a946edd90 0x564a946f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f320c448b80 4 client.18921 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.493+0000 7f320c448b80 1 -- 172.21.15.81:0/1198640524 --> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564a9441bcf0 con 0x564a946edd90 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f31fe02a700 1 --2- 172.21.15.81:0/1198640524 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a946edd90 0x564a946f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f31fe02a700 1 --2- 172.21.15.81:0/1198640524 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a946edd90 0x564a946f01b0 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4ecc47c34ffec63 server_cookie=234728e19c7ddd2b in_seq=0 out_seq=0 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f31e1ffb700 10 client.18921 ms_handle_connect on v2:172.21.15.150:6838/1233365858 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f31e1ffb700 1 -- 172.21.15.81:0/1198640524 <== mds.0 v2:172.21.15.150:6838/1233365858 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564a9441bcf0 con 0x564a946edd90 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f31e1ffb700 10 client.18921 handle_command_reply: tid=0 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f320c448b80 1 client.18921 shutdown 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f320c448b80 1 -- 172.21.15.81:0/1198640524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a94682e00 msgr2=0x564a9468c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f320c448b80 1 --2- 172.21.15.81:0/1198640524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a94682e00 0x564a9468c0f0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f31e800afd0 tx=0x7f31e800c930 comp rx=0 tx=0).stop 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f320c448b80 1 -- 172.21.15.81:0/1198640524 shutdown_connections 2024-05-09T00:15:01.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f320c448b80 1 --2- 172.21.15.81:0/1198640524 >> [v2:172.21.15.150:6838/1233365858,v1:172.21.15.150:6839/1233365858] conn(0x564a946edd90 0x564a946f01b0 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f320c448b80 1 --2- 172.21.15.81:0/1198640524 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x564a94683720 0x564a9468c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f320c448b80 1 --2- 172.21.15.81:0/1198640524 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564a9467d890 0x564a9468e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f31e1ffb700 0 client.18921 ms_handle_reset on v2:172.21.15.150:6838/1233365858 2024-05-09T00:15:01.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f320c448b80 1 --2- 172.21.15.81:0/1198640524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x564a94682e00 0x564a9468c0f0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f320c448b80 1 -- 172.21.15.81:0/1198640524 >> 172.21.15.81:0/1198640524 conn(0x564a945db210 msgr2=0x564a94692bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f320c448b80 1 -- 172.21.15.81:0/1198640524 shutdown_connections 2024-05-09T00:15:01.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f320c448b80 1 -- 172.21.15.81:0/1198640524 wait complete. 2024-05-09T00:15:01.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.494+0000 7f320c448b80 20 client.18921 trim_cache size 0 max 16384 2024-05-09T00:15:01.500 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-05-09T00:15:01.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.495+0000 7f320028e700 1 -- 172.21.15.81:0/2274914644 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f31e40a1390 msgr2=0x7f31e40a3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.495+0000 7f320028e700 1 --2- 172.21.15.81:0/2274914644 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f31e40a1390 0x7f31e40a3850 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f31f4005950 tx=0x7f31f40058e0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.495+0000 7f320028e700 1 -- 172.21.15.81:0/2274914644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f8100ab0 msgr2=0x7f31f8196870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:01.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.495+0000 7f320028e700 1 --2- 172.21.15.81:0/2274914644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f8100ab0 0x7f31f8196870 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f31e800c9b0 tx=0x7f31e800ccc0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.495+0000 7f320028e700 1 -- 172.21.15.81:0/2274914644 shutdown_connections 2024-05-09T00:15:01.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.495+0000 7f320028e700 1 --2- 172.21.15.81:0/2274914644 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f31e40a1390 0x7f31e40a3850 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.495+0000 7f320028e700 1 --2- 172.21.15.81:0/2274914644 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f31f81000f0 0x7f31f8196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.495+0000 7f320028e700 1 --2- 172.21.15.81:0/2274914644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f31f8105f90 0x7f31f819ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.495+0000 7f320028e700 1 --2- 172.21.15.81:0/2274914644 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31f8100ab0 0x7f31f8196870 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:01.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.495+0000 7f320028e700 1 -- 172.21.15.81:0/2274914644 >> 172.21.15.81:0/2274914644 conn(0x7f31f8076ba0 msgr2=0x7f31f80fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:01.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.495+0000 7f320028e700 1 -- 172.21.15.81:0/2274914644 shutdown_connections 2024-05-09T00:15:01.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:01.495+0000 7f320028e700 1 -- 172.21.15.81:0/2274914644 wait complete. 2024-05-09T00:15:02.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:01 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1065072881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:15:02.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:01 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1065072881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:15:02.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:01 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1065072881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:15:02.506 INFO:tasks.fwd_scrub.fs.[cephfs]:end scrubbing fs: cephfs 2024-05-09T00:15:02.506 INFO:tasks.fwd_scrub:done joining 2024-05-09T00:15:02.507 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-09T00:15:02.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:15:02.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.656+0000 7fe2d6416700 1 -- 172.21.15.81:0/4049584651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d010d740 msgr2=0x7fe2d010fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.656+0000 7fe2d6416700 1 --2- 172.21.15.81:0/4049584651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d010d740 0x7fe2d010fb30 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800b0a0 tx=0x7fe2c800b3b0 comp rx=0 tx=0).stop 2024-05-09T00:15:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.656+0000 7fe2d6416700 1 -- 172.21.15.81:0/4049584651 shutdown_connections 2024-05-09T00:15:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.656+0000 7fe2d6416700 1 --2- 172.21.15.81:0/4049584651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d010d740 0x7fe2d010fb30 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.656+0000 7fe2d6416700 1 --2- 172.21.15.81:0/4049584651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2d00ffb90 0x7fe2d00fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.656+0000 7fe2d6416700 1 --2- 172.21.15.81:0/4049584651 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d0100540 0x7fe2d010d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.656+0000 7fe2d6416700 1 -- 172.21.15.81:0/4049584651 >> 172.21.15.81:0/4049584651 conn(0x7fe2d00fb810 msgr2=0x7fe2d00fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.656+0000 7fe2d6416700 1 -- 172.21.15.81:0/4049584651 shutdown_connections 2024-05-09T00:15:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.656+0000 7fe2d6416700 1 -- 172.21.15.81:0/4049584651 wait complete. 2024-05-09T00:15:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d6416700 1 Processor -- start 2024-05-09T00:15:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d6416700 1 -- start start 2024-05-09T00:15:02.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d6416700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d00ffb90 0x7fe2d01995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:02.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d6416700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2d0100540 0x7fe2d0199b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:02.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d6416700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d010d740 0x7fe2d019dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:02.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d6416700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d019e4e0 con 0x7fe2d010d740 2024-05-09T00:15:02.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d6416700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d019e650 con 0x7fe2d00ffb90 2024-05-09T00:15:02.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d6416700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d019e810 con 0x7fe2d0100540 2024-05-09T00:15:02.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d49b3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d010d740 0x7fe2d019dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:02.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d49b3700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d010d740 0x7fe2d019dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47066/0 (socket says 172.21.15.81:47066) 2024-05-09T00:15:02.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d49b3700 1 -- 172.21.15.81:0/4096652175 learned_addr learned my addr 172.21.15.81:0/4096652175 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2cf7fe700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2d0100540 0x7fe2d0199b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2cffff700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d00ffb90 0x7fe2d01995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d49b3700 1 -- 172.21.15.81:0/4096652175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2d0100540 msgr2=0x7fe2d0199b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d49b3700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2d0100540 0x7fe2d0199b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d49b3700 1 -- 172.21.15.81:0/4096652175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d00ffb90 msgr2=0x7fe2d01995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d49b3700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d00ffb90 0x7fe2d01995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2d49b3700 1 -- 172.21.15.81:0/4096652175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c8009d00 con 0x7fe2d010d740 2024-05-09T00:15:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.657+0000 7fe2cffff700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d00ffb90 0x7fe2d01995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:15:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.658+0000 7fe2d49b3700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d010d740 0x7fe2d019dea0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800b070 tx=0x7fe2c8007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.658+0000 7fe2cd7fa700 1 -- 172.21.15.81:0/4096652175 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c800e040 con 0x7fe2d010d740 2024-05-09T00:15:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.658+0000 7fe2cd7fa700 1 -- 172.21.15.81:0/4096652175 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe2c800be40 con 0x7fe2d010d740 2024-05-09T00:15:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.658+0000 7fe2cd7fa700 1 -- 172.21.15.81:0/4096652175 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c80052a0 con 0x7fe2d010d740 2024-05-09T00:15:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.658+0000 7fe2d6416700 1 -- 172.21.15.81:0/4096652175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d019ea90 con 0x7fe2d010d740 2024-05-09T00:15:02.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.658+0000 7fe2d6416700 1 -- 172.21.15.81:0/4096652175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d01a6330 con 0x7fe2d010d740 2024-05-09T00:15:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.659+0000 7fe2d6416700 1 -- 172.21.15.81:0/4096652175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d0108960 con 0x7fe2d010d740 2024-05-09T00:15:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.660+0000 7fe2cd7fa700 1 -- 172.21.15.81:0/4096652175 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe2c801d470 con 0x7fe2d010d740 2024-05-09T00:15:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.660+0000 7fe2cd7fa700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe2b80a1290 0x7fe2b80a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.661+0000 7fe2cffff700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe2b80a1290 0x7fe2b80a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.661+0000 7fe2cd7fa700 1 -- 172.21.15.81:0/4096652175 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe2c80cea20 con 0x7fe2d010d740 2024-05-09T00:15:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.661+0000 7fe2cffff700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe2b80a1290 0x7fe2b80a3750 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400bc10 tx=0x7fe2c400b5f0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.664+0000 7fe2cd7fa700 1 -- 172.21.15.81:0/4096652175 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe2c8097e70 con 0x7fe2d010d740 2024-05-09T00:15:02.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.862+0000 7fe2d6416700 1 -- 172.21.15.81:0/4096652175 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2d019ec80 con 0x7fe2d010d740 2024-05-09T00:15:02.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.863+0000 7fe2cd7fa700 1 -- 172.21.15.81:0/4096652175 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+23093 (secure 0 0 0) 0x7fe2c809b490 con 0x7fe2d010d740 2024-05-09T00:15:02.862 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:15:02.862 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":93,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:14:12.784539+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":92,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/907969237":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/589390516":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/1458411552":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1755507053":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/3633496844":"2024-05-10T00:02:58.862694+0000","172.21.15.81:6801/1458411552":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/1903231103":"2024-05-10T00:02:58.862694+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:15:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.865+0000 7fe2d6416700 1 -- 172.21.15.81:0/4096652175 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe2b80a1290 msgr2=0x7fe2b80a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:02.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.865+0000 7fe2d6416700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe2b80a1290 0x7fe2b80a3750 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400bc10 tx=0x7fe2c400b5f0 comp rx=0 tx=0).stop 2024-05-09T00:15:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.865+0000 7fe2d6416700 1 -- 172.21.15.81:0/4096652175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d010d740 msgr2=0x7fe2d019dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.865+0000 7fe2d6416700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d010d740 0x7fe2d019dea0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fe2c800b070 tx=0x7fe2c8007930 comp rx=0 tx=0).stop 2024-05-09T00:15:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.865+0000 7fe2d6416700 1 -- 172.21.15.81:0/4096652175 shutdown_connections 2024-05-09T00:15:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.865+0000 7fe2d6416700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe2b80a1290 0x7fe2b80a3750 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.865+0000 7fe2d6416700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe2d00ffb90 0x7fe2d01995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.865+0000 7fe2d6416700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2d010d740 0x7fe2d019dea0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.865+0000 7fe2d6416700 1 --2- 172.21.15.81:0/4096652175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2d0100540 0x7fe2d0199b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.865+0000 7fe2d6416700 1 -- 172.21.15.81:0/4096652175 >> 172.21.15.81:0/4096652175 conn(0x7fe2d00fb810 msgr2=0x7fe2d00fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.866+0000 7fe2d6416700 1 -- 172.21.15.81:0/4096652175 shutdown_connections 2024-05-09T00:15:02.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:02.866+0000 7fe2d6416700 1 -- 172.21.15.81:0/4096652175 wait complete. 2024-05-09T00:15:02.876 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:58:34.523249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T00:01:43.149260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T00:01:44.182730+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 92, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:15:02.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:15:03.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.005+0000 7f7999e59700 1 -- 172.21.15.81:0/4015028901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7994100060 msgr2=0x7f7994100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.005+0000 7f7999e59700 1 --2- 172.21.15.81:0/4015028901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7994100060 0x7f7994100440 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f797c009990 tx=0x7f797c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.005+0000 7f7999e59700 1 -- 172.21.15.81:0/4015028901 shutdown_connections 2024-05-09T00:15:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.005+0000 7f7999e59700 1 --2- 172.21.15.81:0/4015028901 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7994105160 0x7f799410cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.005+0000 7f7999e59700 1 --2- 172.21.15.81:0/4015028901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7994100060 0x7f7994100440 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.005+0000 7f7999e59700 1 --2- 172.21.15.81:0/4015028901 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7994100a10 0x7f7994104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.005+0000 7f7999e59700 1 -- 172.21.15.81:0/4015028901 >> 172.21.15.81:0/4015028901 conn(0x7f7994076f40 msgr2=0x7f7994077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.005+0000 7f7999e59700 1 -- 172.21.15.81:0/4015028901 shutdown_connections 2024-05-09T00:15:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.005+0000 7f7999e59700 1 -- 172.21.15.81:0/4015028901 wait complete. 2024-05-09T00:15:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f7999e59700 1 Processor -- start 2024-05-09T00:15:03.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f7999e59700 1 -- start start 2024-05-09T00:15:03.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f7999e59700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7994100060 0x7f79941981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f7999e59700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7994105160 0x7f7994198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f7999e59700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7994198c70 0x7f79941a3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f7999e59700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79941a3950 con 0x7f7994100060 2024-05-09T00:15:03.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f7999e59700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79941a3ac0 con 0x7f7994105160 2024-05-09T00:15:03.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f7999e59700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79941a3c80 con 0x7f7994198c70 2024-05-09T00:15:03.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f79937fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7994100060 0x7f79941981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f79937fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7994100060 0x7f79941981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47082/0 (socket says 172.21.15.81:47082) 2024-05-09T00:15:03.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f79937fe700 1 -- 172.21.15.81:0/109127878 learned_addr learned my addr 172.21.15.81:0/109127878 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:03.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f7993fff700 1 --2- 172.21.15.81:0/109127878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7994198c70 0x7f79941a3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f7992ffd700 1 --2- 172.21.15.81:0/109127878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7994105160 0x7f7994198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f79937fe700 1 -- 172.21.15.81:0/109127878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7994198c70 msgr2=0x7f79941a3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f79937fe700 1 --2- 172.21.15.81:0/109127878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7994198c70 0x7f79941a3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f79937fe700 1 -- 172.21.15.81:0/109127878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7994105160 msgr2=0x7f7994198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.006+0000 7f79937fe700 1 --2- 172.21.15.81:0/109127878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7994105160 0x7f7994198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.007+0000 7f79937fe700 1 -- 172.21.15.81:0/109127878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c0095f0 con 0x7f7994100060 2024-05-09T00:15:03.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.007+0000 7f79937fe700 1 --2- 172.21.15.81:0/109127878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7994100060 0x7f79941981f0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f797c004760 tx=0x7f797c004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:03.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.007+0000 7f7990ff9700 1 -- 172.21.15.81:0/109127878 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c01d070 con 0x7f7994100060 2024-05-09T00:15:03.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.007+0000 7f7990ff9700 1 -- 172.21.15.81:0/109127878 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f797c00fb30 con 0x7f7994100060 2024-05-09T00:15:03.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.007+0000 7f7999e59700 1 -- 172.21.15.81:0/109127878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79941a3f00 con 0x7f7994100060 2024-05-09T00:15:03.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.007+0000 7f7990ff9700 1 -- 172.21.15.81:0/109127878 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c022db0 con 0x7f7994100060 2024-05-09T00:15:03.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.007+0000 7f7999e59700 1 -- 172.21.15.81:0/109127878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79941a4320 con 0x7f7994100060 2024-05-09T00:15:03.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.008+0000 7f798a7fc700 1 -- 172.21.15.81:0/109127878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79780052f0 con 0x7f7994100060 2024-05-09T00:15:03.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.009+0000 7f7990ff9700 1 -- 172.21.15.81:0/109127878 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f797c00fca0 con 0x7f7994100060 2024-05-09T00:15:03.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.009+0000 7f7990ff9700 1 --2- 172.21.15.81:0/109127878 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f79800a1310 0x7f79800a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.010+0000 7f7992ffd700 1 --2- 172.21.15.81:0/109127878 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f79800a1310 0x7f79800a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.010+0000 7f7990ff9700 1 -- 172.21.15.81:0/109127878 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f797c0cdf50 con 0x7f7994100060 2024-05-09T00:15:03.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.010+0000 7f7992ffd700 1 --2- 172.21.15.81:0/109127878 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f79800a1310 0x7f79800a37d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7994068800 tx=0x7f798400b410 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:03.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.014+0000 7f7990ff9700 1 -- 172.21.15.81:0/109127878 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f797c0974c0 con 0x7f7994100060 2024-05-09T00:15:03.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.211+0000 7f798a7fc700 1 -- 172.21.15.81:0/109127878 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7978005b20 con 0x7f7994100060 2024-05-09T00:15:03.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.211+0000 7f7990ff9700 1 -- 172.21.15.81:0/109127878 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7f797c0270a0 con 0x7f7994100060 2024-05-09T00:15:03.210 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-09T00:15:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.213+0000 7f798a7fc700 1 -- 172.21.15.81:0/109127878 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f79800a1310 msgr2=0x7f79800a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.213+0000 7f798a7fc700 1 --2- 172.21.15.81:0/109127878 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f79800a1310 0x7f79800a37d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7994068800 tx=0x7f798400b410 comp rx=0 tx=0).stop 2024-05-09T00:15:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.213+0000 7f798a7fc700 1 -- 172.21.15.81:0/109127878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7994100060 msgr2=0x7f79941981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.213+0000 7f798a7fc700 1 --2- 172.21.15.81:0/109127878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7994100060 0x7f79941981f0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f797c004760 tx=0x7f797c004790 comp rx=0 tx=0).stop 2024-05-09T00:15:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.213+0000 7f798a7fc700 1 -- 172.21.15.81:0/109127878 shutdown_connections 2024-05-09T00:15:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.213+0000 7f798a7fc700 1 --2- 172.21.15.81:0/109127878 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f79800a1310 0x7f79800a37d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.213+0000 7f798a7fc700 1 --2- 172.21.15.81:0/109127878 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7994198c70 0x7f79941a3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.213+0000 7f798a7fc700 1 --2- 172.21.15.81:0/109127878 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7994100060 0x7f79941981f0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.213+0000 7f798a7fc700 1 --2- 172.21.15.81:0/109127878 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7994105160 0x7f7994198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.213+0000 7f798a7fc700 1 -- 172.21.15.81:0/109127878 >> 172.21.15.81:0/109127878 conn(0x7f7994076f40 msgr2=0x7f79940fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.214+0000 7f798a7fc700 1 -- 172.21.15.81:0/109127878 shutdown_connections 2024-05-09T00:15:03.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.214+0000 7f798a7fc700 1 -- 172.21.15.81:0/109127878 wait complete. 2024-05-09T00:15:03.223 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:02 smithi081 ceph-mon[42474]: pgmap v375: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2024-05-09T00:15:03.223 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:02 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/4096652175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:15:03.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T00:15:03.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:02 smithi150 ceph-mon[46187]: pgmap v375: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2024-05-09T00:15:03.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:02 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/4096652175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:15:03.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:02 smithi171 ceph-mon[47351]: pgmap v375: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.3 KiB/s wr, 8 op/s 2024-05-09T00:15:03.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:02 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/4096652175' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:15:03.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.352+0000 7fac1b926700 1 -- 172.21.15.81:0/1665142262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac14100060 msgr2=0x7fac14100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.352+0000 7fac1b926700 1 --2- 172.21.15.81:0/1665142262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac14100060 0x7fac14100440 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fac10009990 tx=0x7fac10009ca0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.352+0000 7fac1b926700 1 -- 172.21.15.81:0/1665142262 shutdown_connections 2024-05-09T00:15:03.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.352+0000 7fac1b926700 1 --2- 172.21.15.81:0/1665142262 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac14105180 0x7fac1410cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.352+0000 7fac1b926700 1 --2- 172.21.15.81:0/1665142262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac14100060 0x7fac14100440 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.352+0000 7fac1b926700 1 --2- 172.21.15.81:0/1665142262 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac14100a10 0x7fac14104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.352+0000 7fac1b926700 1 -- 172.21.15.81:0/1665142262 >> 172.21.15.81:0/1665142262 conn(0x7fac14076f70 msgr2=0x7fac14077380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:03.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.352+0000 7fac1b926700 1 -- 172.21.15.81:0/1665142262 shutdown_connections 2024-05-09T00:15:03.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.352+0000 7fac1b926700 1 -- 172.21.15.81:0/1665142262 wait complete. 2024-05-09T00:15:03.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.352+0000 7fac1b926700 1 Processor -- start 2024-05-09T00:15:03.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.352+0000 7fac1b926700 1 -- start start 2024-05-09T00:15:03.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac1b926700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac14100060 0x7fac14198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac1b926700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac14105180 0x7fac14198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac1b926700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac14198cb0 0x7fac141a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac1b926700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac141a3950 con 0x7fac14100060 2024-05-09T00:15:03.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac1b926700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac141a3ac0 con 0x7fac14198cb0 2024-05-09T00:15:03.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac1b926700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac141a3c80 con 0x7fac14105180 2024-05-09T00:15:03.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac196c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac14100060 0x7fac14198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac196c2700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac14100060 0x7fac14198230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47090/0 (socket says 172.21.15.81:47090) 2024-05-09T00:15:03.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac196c2700 1 -- 172.21.15.81:0/192928171 learned_addr learned my addr 172.21.15.81:0/192928171 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:03.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac18ec1700 1 --2- 172.21.15.81:0/192928171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac14105180 0x7fac14198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac19ec3700 1 --2- 172.21.15.81:0/192928171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac14198cb0 0x7fac141a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac196c2700 1 -- 172.21.15.81:0/192928171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac14105180 msgr2=0x7fac14198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac196c2700 1 --2- 172.21.15.81:0/192928171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac14105180 0x7fac14198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac196c2700 1 -- 172.21.15.81:0/192928171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac14198cb0 msgr2=0x7fac141a32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac196c2700 1 --2- 172.21.15.81:0/192928171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac14198cb0 0x7fac141a32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac196c2700 1 -- 172.21.15.81:0/192928171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac100095f0 con 0x7fac14100060 2024-05-09T00:15:03.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac196c2700 1 --2- 172.21.15.81:0/192928171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac14100060 0x7fac14198230 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fac10004760 tx=0x7fac10004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:03.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac0a7fc700 1 -- 172.21.15.81:0/192928171 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1001d070 con 0x7fac14100060 2024-05-09T00:15:03.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac0a7fc700 1 -- 172.21.15.81:0/192928171 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac1000fbf0 con 0x7fac14100060 2024-05-09T00:15:03.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac1b926700 1 -- 172.21.15.81:0/192928171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac141a3f00 con 0x7fac14100060 2024-05-09T00:15:03.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac0a7fc700 1 -- 172.21.15.81:0/192928171 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10022d50 con 0x7fac14100060 2024-05-09T00:15:03.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.353+0000 7fac1b926700 1 -- 172.21.15.81:0/192928171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac141a4320 con 0x7fac14100060 2024-05-09T00:15:03.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.354+0000 7fac1b926700 1 -- 172.21.15.81:0/192928171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac141083f0 con 0x7fac14100060 2024-05-09T00:15:03.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.356+0000 7fac0a7fc700 1 -- 172.21.15.81:0/192928171 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fac10022470 con 0x7fac14100060 2024-05-09T00:15:03.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.357+0000 7fac0a7fc700 1 --2- 172.21.15.81:0/192928171 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fac000a1310 0x7fac000a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.357+0000 7fac18ec1700 1 --2- 172.21.15.81:0/192928171 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fac000a1310 0x7fac000a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.357+0000 7fac0a7fc700 1 -- 172.21.15.81:0/192928171 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fac100cde70 con 0x7fac14100060 2024-05-09T00:15:03.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.357+0000 7fac18ec1700 1 --2- 172.21.15.81:0/192928171 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fac000a1310 0x7fac000a37d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fac14069c40 tx=0x7fac040073d0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:03.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.360+0000 7fac0a7fc700 1 -- 172.21.15.81:0/192928171 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fac1005dd60 con 0x7fac14100060 2024-05-09T00:15:03.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.556+0000 7fac1b926700 1 -- 172.21.15.81:0/192928171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fac140699f0 con 0x7fac14100060 2024-05-09T00:15:03.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.556+0000 7fac0a7fc700 1 -- 172.21.15.81:0/192928171 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7fac100972c0 con 0x7fac14100060 2024-05-09T00:15:03.555 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-09T00:15:03.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.559+0000 7fac1b926700 1 -- 172.21.15.81:0/192928171 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fac000a1310 msgr2=0x7fac000a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.559+0000 7fac1b926700 1 --2- 172.21.15.81:0/192928171 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fac000a1310 0x7fac000a37d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fac14069c40 tx=0x7fac040073d0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.559+0000 7fac1b926700 1 -- 172.21.15.81:0/192928171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac14100060 msgr2=0x7fac14198230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.559+0000 7fac1b926700 1 --2- 172.21.15.81:0/192928171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac14100060 0x7fac14198230 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fac10004760 tx=0x7fac10004790 comp rx=0 tx=0).stop 2024-05-09T00:15:03.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.559+0000 7fac1b926700 1 -- 172.21.15.81:0/192928171 shutdown_connections 2024-05-09T00:15:03.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.559+0000 7fac1b926700 1 --2- 172.21.15.81:0/192928171 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fac000a1310 0x7fac000a37d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.559+0000 7fac1b926700 1 --2- 172.21.15.81:0/192928171 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fac14198cb0 0x7fac141a32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.559+0000 7fac1b926700 1 --2- 172.21.15.81:0/192928171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac14100060 0x7fac14198230 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.559+0000 7fac1b926700 1 --2- 172.21.15.81:0/192928171 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac14105180 0x7fac14198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.559+0000 7fac1b926700 1 -- 172.21.15.81:0/192928171 >> 172.21.15.81:0/192928171 conn(0x7fac14076f70 msgr2=0x7fac14106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:03.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.559+0000 7fac1b926700 1 -- 172.21.15.81:0/192928171 shutdown_connections 2024-05-09T00:15:03.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.559+0000 7fac1b926700 1 -- 172.21.15.81:0/192928171 wait complete. 2024-05-09T00:15:03.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T00:15:03.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.696+0000 7f4458187700 1 -- 172.21.15.81:0/3977019256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4450100a10 msgr2=0x7f4450104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.696+0000 7f4458187700 1 --2- 172.21.15.81:0/3977019256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4450100a10 0x7f4450104a40 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f444c009990 tx=0x7f444c009ca0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.696+0000 7f4458187700 1 -- 172.21.15.81:0/3977019256 shutdown_connections 2024-05-09T00:15:03.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.696+0000 7f4458187700 1 --2- 172.21.15.81:0/3977019256 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4450105170 0x7f445010ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.696+0000 7f4458187700 1 --2- 172.21.15.81:0/3977019256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4450100060 0x7f4450100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.696+0000 7f4458187700 1 --2- 172.21.15.81:0/3977019256 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4450100a10 0x7f4450104a40 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.696+0000 7f4458187700 1 -- 172.21.15.81:0/3977019256 >> 172.21.15.81:0/3977019256 conn(0x7f4450076f30 msgr2=0x7f4450077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.696+0000 7f4458187700 1 -- 172.21.15.81:0/3977019256 shutdown_connections 2024-05-09T00:15:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.696+0000 7f4458187700 1 -- 172.21.15.81:0/3977019256 wait complete. 2024-05-09T00:15:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4458187700 1 Processor -- start 2024-05-09T00:15:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4458187700 1 -- start start 2024-05-09T00:15:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4458187700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4450100060 0x7f44501982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4458187700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4450105170 0x7f44501987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4458187700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4450198d20 0x7f44501a3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4458187700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44501a39c0 con 0x7f4450198d20 2024-05-09T00:15:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4458187700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44501a3b30 con 0x7f4450105170 2024-05-09T00:15:03.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4458187700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44501a3cf0 con 0x7f4450100060 2024-05-09T00:15:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4456724700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4450198d20 0x7f44501a3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4456724700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4450198d20 0x7f44501a3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47100/0 (socket says 172.21.15.81:47100) 2024-05-09T00:15:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4456724700 1 -- 172.21.15.81:0/2707737984 learned_addr learned my addr 172.21.15.81:0/2707737984 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4455f23700 1 --2- 172.21.15.81:0/2707737984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4450100060 0x7f44501982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4455722700 1 --2- 172.21.15.81:0/2707737984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4450105170 0x7f44501987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4456724700 1 -- 172.21.15.81:0/2707737984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4450100060 msgr2=0x7f44501982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4456724700 1 --2- 172.21.15.81:0/2707737984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4450100060 0x7f44501982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4456724700 1 -- 172.21.15.81:0/2707737984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4450105170 msgr2=0x7f44501987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4456724700 1 --2- 172.21.15.81:0/2707737984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4450105170 0x7f44501987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.697+0000 7f4456724700 1 -- 172.21.15.81:0/2707737984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0095f0 con 0x7f4450198d20 2024-05-09T00:15:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.698+0000 7f4456724700 1 --2- 172.21.15.81:0/2707737984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4450198d20 0x7f44501a3320 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f4448007ee0 tx=0x7f444800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.698+0000 7f4442ffd700 1 -- 172.21.15.81:0/2707737984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444800ddd0 con 0x7f4450198d20 2024-05-09T00:15:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.698+0000 7f4442ffd700 1 -- 172.21.15.81:0/2707737984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f444800f040 con 0x7f4450198d20 2024-05-09T00:15:03.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.698+0000 7f4458187700 1 -- 172.21.15.81:0/2707737984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44501a3fd0 con 0x7f4450198d20 2024-05-09T00:15:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.698+0000 7f4442ffd700 1 -- 172.21.15.81:0/2707737984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44480048e0 con 0x7f4450198d20 2024-05-09T00:15:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.698+0000 7f4458187700 1 -- 172.21.15.81:0/2707737984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44501a4460 con 0x7f4450198d20 2024-05-09T00:15:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.699+0000 7f4458187700 1 -- 172.21.15.81:0/2707737984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4450108440 con 0x7f4450198d20 2024-05-09T00:15:03.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.700+0000 7f4442ffd700 1 -- 172.21.15.81:0/2707737984 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4448003a00 con 0x7f4450198d20 2024-05-09T00:15:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.701+0000 7f4442ffd700 1 --2- 172.21.15.81:0/2707737984 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f443c0a1290 0x7f443c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.701+0000 7f4455f23700 1 --2- 172.21.15.81:0/2707737984 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f443c0a1290 0x7f443c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.701+0000 7f4442ffd700 1 -- 172.21.15.81:0/2707737984 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f44480cce30 con 0x7f4450198d20 2024-05-09T00:15:03.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.701+0000 7f4455f23700 1 --2- 172.21.15.81:0/2707737984 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f443c0a1290 0x7f443c0a3750 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4444009c60 tx=0x7f4444009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:03.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.704+0000 7f4442ffd700 1 -- 172.21.15.81:0/2707737984 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f44480961f0 con 0x7f4450198d20 2024-05-09T00:15:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.904+0000 7f4458187700 1 -- 172.21.15.81:0/2707737984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4450069790 con 0x7f4450198d20 2024-05-09T00:15:03.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.904+0000 7f4442ffd700 1 -- 172.21.15.81:0/2707737984 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44480230a0 con 0x7f4450198d20 2024-05-09T00:15:03.902 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-09T00:15:03.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.906+0000 7f4458187700 1 -- 172.21.15.81:0/2707737984 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f443c0a1290 msgr2=0x7f443c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.906+0000 7f4458187700 1 --2- 172.21.15.81:0/2707737984 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f443c0a1290 0x7f443c0a3750 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4444009c60 tx=0x7f4444009260 comp rx=0 tx=0).stop 2024-05-09T00:15:03.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.906+0000 7f4458187700 1 -- 172.21.15.81:0/2707737984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4450198d20 msgr2=0x7f44501a3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:03.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.906+0000 7f4458187700 1 --2- 172.21.15.81:0/2707737984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4450198d20 0x7f44501a3320 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f4448007ee0 tx=0x7f444800d3b0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.906+0000 7f4458187700 1 -- 172.21.15.81:0/2707737984 shutdown_connections 2024-05-09T00:15:03.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.906+0000 7f4458187700 1 --2- 172.21.15.81:0/2707737984 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f443c0a1290 0x7f443c0a3750 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.906+0000 7f4458187700 1 --2- 172.21.15.81:0/2707737984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4450198d20 0x7f44501a3320 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.906+0000 7f4458187700 1 --2- 172.21.15.81:0/2707737984 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4450100060 0x7f44501982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.906+0000 7f4458187700 1 --2- 172.21.15.81:0/2707737984 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4450105170 0x7f44501987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:03.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.906+0000 7f4458187700 1 -- 172.21.15.81:0/2707737984 >> 172.21.15.81:0/2707737984 conn(0x7f4450076f30 msgr2=0x7f44500fe0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:03.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.906+0000 7f4458187700 1 -- 172.21.15.81:0/2707737984 shutdown_connections 2024-05-09T00:15:03.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:03.906+0000 7f4458187700 1 -- 172.21.15.81:0/2707737984 wait complete. 2024-05-09T00:15:03.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-09T00:15:04.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.043+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/2009824514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa29c101070 msgr2=0x7fa29c101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:04.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.043+0000 7fa2a2e5b700 1 --2- 172.21.15.81:0/2009824514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa29c101070 0x7fa29c101450 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fa290009990 tx=0x7fa290009ca0 comp rx=0 tx=0).stop 2024-05-09T00:15:04.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.043+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/2009824514 shutdown_connections 2024-05-09T00:15:04.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.043+0000 7fa2a2e5b700 1 --2- 172.21.15.81:0/2009824514 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa29c106190 0x7fa29c10dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:04.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.043+0000 7fa2a2e5b700 1 --2- 172.21.15.81:0/2009824514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa29c101070 0x7fa29c101450 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:04.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.043+0000 7fa2a2e5b700 1 --2- 172.21.15.81:0/2009824514 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa29c101a20 0x7fa29c105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:04.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.043+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/2009824514 >> 172.21.15.81:0/2009824514 conn(0x7fa29c0fc950 msgr2=0x7fa29c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:04.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.043+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/2009824514 shutdown_connections 2024-05-09T00:15:04.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.043+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/2009824514 wait complete. 2024-05-09T00:15:04.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.043+0000 7fa2a2e5b700 1 Processor -- start 2024-05-09T00:15:04.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.043+0000 7fa2a2e5b700 1 -- start start 2024-05-09T00:15:04.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa2a2e5b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa29c101070 0x7fa29c197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:04.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa2a2e5b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa29c106190 0x7fa29c197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:04.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa2a2e5b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa29c19bbe0 0x7fa29c19c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:04.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa2a2e5b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c19c660 con 0x7fa29c106190 2024-05-09T00:15:04.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa2a2e5b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c19c7d0 con 0x7fa29c101070 2024-05-09T00:15:04.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa2a2e5b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c19c990 con 0x7fa29c19bbe0 2024-05-09T00:15:04.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa29bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa29c106190 0x7fa29c197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:04.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa29bfff700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa29c106190 0x7fa29c197890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47120/0 (socket says 172.21.15.81:47120) 2024-05-09T00:15:04.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa29bfff700 1 -- 172.21.15.81:0/1885429571 learned_addr learned my addr 172.21.15.81:0/1885429571 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:04.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa2a0bf7700 1 --2- 172.21.15.81:0/1885429571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa29c101070 0x7fa29c197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:04.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa2a13f8700 1 --2- 172.21.15.81:0/1885429571 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa29c19bbe0 0x7fa29c19c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa29bfff700 1 -- 172.21.15.81:0/1885429571 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa29c19bbe0 msgr2=0x7fa29c19c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa29bfff700 1 --2- 172.21.15.81:0/1885429571 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa29c19bbe0 0x7fa29c19c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa29bfff700 1 -- 172.21.15.81:0/1885429571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa29c101070 msgr2=0x7fa29c197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa29bfff700 1 --2- 172.21.15.81:0/1885429571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa29c101070 0x7fa29c197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa29bfff700 1 -- 172.21.15.81:0/1885429571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900095f0 con 0x7fa29c106190 2024-05-09T00:15:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa29bfff700 1 --2- 172.21.15.81:0/1885429571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa29c106190 0x7fa29c197890 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fa28800d980 tx=0x7fa28800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa299ffb700 1 -- 172.21.15.81:0/1885429571 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288009930 con 0x7fa29c106190 2024-05-09T00:15:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa299ffb700 1 -- 172.21.15.81:0/1885429571 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa288010460 con 0x7fa29c106190 2024-05-09T00:15:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/1885429571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c1a3ef0 con 0x7fa29c106190 2024-05-09T00:15:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.044+0000 7fa299ffb700 1 -- 172.21.15.81:0/1885429571 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28800f620 con 0x7fa29c106190 2024-05-09T00:15:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.045+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/1885429571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c1a4370 con 0x7fa29c106190 2024-05-09T00:15:04.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.045+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/1885429571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c109400 con 0x7fa29c106190 2024-05-09T00:15:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.046+0000 7fa299ffb700 1 -- 172.21.15.81:0/1885429571 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa2880108d0 con 0x7fa29c106190 2024-05-09T00:15:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.047+0000 7fa299ffb700 1 --2- 172.21.15.81:0/1885429571 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa28c0a1290 0x7fa28c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.047+0000 7fa2a0bf7700 1 --2- 172.21.15.81:0/1885429571 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa28c0a1290 0x7fa28c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.047+0000 7fa299ffb700 1 -- 172.21.15.81:0/1885429571 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fa2880cc800 con 0x7fa29c106190 2024-05-09T00:15:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.047+0000 7fa2a0bf7700 1 --2- 172.21.15.81:0/1885429571 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa28c0a1290 0x7fa28c0a3750 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa29000b5c0 tx=0x7fa290005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:04.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.051+0000 7fa299ffb700 1 -- 172.21.15.81:0/1885429571 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa288095bc0 con 0x7fa29c106190 2024-05-09T00:15:04.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:03 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/109127878' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:15:04.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:03 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/192928171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:15:04.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:03 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2707737984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:15:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.307+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/1885429571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fa29c102540 con 0x7fa29c106190 2024-05-09T00:15:04.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:03 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/109127878' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:15:04.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:03 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/192928171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:15:04.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:03 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2707737984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:15:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.315+0000 7fa299ffb700 1 -- 172.21.15.81:0/1885429571 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) v1 ==== 81+0+733940 (secure 0 0 0) 0x7fa2880991e0 con 0x7fa29c106190 2024-05-09T00:15:04.323 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:15:04.324 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:15:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 25, 2024-05-09T00:15:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "active_gid": 15285, 2024-05-09T00:15:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "active_name": "x", 2024-05-09T00:15:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "active_addrs": { 2024-05-09T00:15:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-09T00:15:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-09T00:15:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6800", 2024-05-09T00:15:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2111088526 2024-05-09T00:15:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-05-09T00:15:04.325 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6801", 2024-05-09T00:15:04.325 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2111088526 2024-05-09T00:15:04.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-09T00:15:04.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.325 INFO:teuthology.orchestra.run.smithi081.stdout: "active_addr": "172.21.15.81:6801/2111088526", 2024-05-09T00:15:04.325 INFO:teuthology.orchestra.run.smithi081.stdout: "active_change": "2024-05-09T00:02:58.862911+0000", 2024-05-09T00:15:04.325 INFO:teuthology.orchestra.run.smithi081.stdout: "active_mgr_features": 4540138322906710015, 2024-05-09T00:15:04.325 INFO:teuthology.orchestra.run.smithi081.stdout: "available": true, 2024-05-09T00:15:04.325 INFO:teuthology.orchestra.run.smithi081.stdout: "standbys": [ 2024-05-09T00:15:04.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.325 INFO:teuthology.orchestra.run.smithi081.stdout: "gid": 24845, 2024-05-09T00:15:04.325 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "y", 2024-05-09T00:15:04.325 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_features": 4540138322906710015, 2024-05-09T00:15:04.326 INFO:teuthology.orchestra.run.smithi081.stdout: "available_modules": [ 2024-05-09T00:15:04.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.326 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "alerts", 2024-05-09T00:15:04.326 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.326 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.326 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.326 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:04.326 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:04.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.326 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.326 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.326 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:04.326 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.326 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.327 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.327 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How frequently to reexamine health status", 2024-05-09T00:15:04.327 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.327 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.327 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.327 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.327 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.327 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.327 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.327 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.327 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.328 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.328 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.328 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.328 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.328 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.328 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.328 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.328 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.328 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.328 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.328 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.328 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.328 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.329 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.329 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.329 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.329 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.329 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.329 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.329 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.329 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.329 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.329 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.329 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.329 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.330 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.330 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.330 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.330 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.330 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.330 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.330 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.330 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.330 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.331 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.331 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.331 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.331 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.331 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.331 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.331 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.331 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.331 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.331 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.331 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.331 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.332 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.332 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.332 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.332 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.332 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.332 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.332 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.332 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.332 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.332 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.332 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_destination": { 2024-05-09T00:15:04.333 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_destination", 2024-05-09T00:15:04.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.333 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.333 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.333 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.333 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.333 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.333 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.333 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email address to send alerts to", 2024-05-09T00:15:04.333 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.333 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.333 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.334 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_from_name": { 2024-05-09T00:15:04.334 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_from_name", 2024-05-09T00:15:04.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.334 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.334 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.334 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "Ceph", 2024-05-09T00:15:04.334 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.334 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.335 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.335 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email From: name", 2024-05-09T00:15:04.335 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.335 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.335 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.335 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_host": { 2024-05-09T00:15:04.335 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_host", 2024-05-09T00:15:04.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.335 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.335 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.336 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.336 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.336 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.336 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.336 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP server", 2024-05-09T00:15:04.336 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.336 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.336 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.336 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_password": { 2024-05-09T00:15:04.336 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_password", 2024-05-09T00:15:04.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Password to authenticate with", 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_port": { 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_port", 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.337 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.338 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.338 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "465", 2024-05-09T00:15:04.338 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.338 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.338 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.338 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP port", 2024-05-09T00:15:04.338 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.338 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.338 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.338 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_sender": { 2024-05-09T00:15:04.338 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_sender", 2024-05-09T00:15:04.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.339 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.339 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.339 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.339 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.339 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.339 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.339 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP envelope sender", 2024-05-09T00:15:04.339 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.339 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.339 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.339 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_ssl": { 2024-05-09T00:15:04.340 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_ssl", 2024-05-09T00:15:04.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.340 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.340 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.340 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.340 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.340 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.340 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.340 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-09T00:15:04.340 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.340 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.340 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.341 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_user": { 2024-05-09T00:15:04.341 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_user", 2024-05-09T00:15:04.341 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.341 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.341 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.341 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.341 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.341 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.341 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.341 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "User to authenticate as", 2024-05-09T00:15:04.341 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.341 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.342 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.342 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.342 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.342 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "balancer", 2024-05-09T00:15:04.342 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.342 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.342 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.342 INFO:teuthology.orchestra.run.smithi081.stdout: "active": { 2024-05-09T00:15:04.342 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "active", 2024-05-09T00:15:04.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.343 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.343 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.343 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.343 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.343 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.343 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.343 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically balance PGs across cluster", 2024-05-09T00:15:04.343 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.343 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.343 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.343 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_time": { 2024-05-09T00:15:04.343 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_time", 2024-05-09T00:15:04.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.344 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.344 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.344 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0000", 2024-05-09T00:15:04.344 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.344 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.344 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.344 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "beginning time of day to automatically balance", 2024-05-09T00:15:04.344 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T00:15:04.344 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.344 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.344 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_weekday": { 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_weekday", 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_max_iterations": { 2024-05-09T00:15:04.345 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_max_iterations", 2024-05-09T00:15:04.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:04.346 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.346 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.346 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "25", 2024-05-09T00:15:04.346 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-05-09T00:15:04.346 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "250", 2024-05-09T00:15:04.346 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.346 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-09T00:15:04.346 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.346 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.346 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.347 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_metrics": { 2024-05-09T00:15:04.347 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_metrics", 2024-05-09T00:15:04.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.347 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.347 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.347 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "pgs,objects,bytes", 2024-05-09T00:15:04.347 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.347 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.347 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.347 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-09T00:15:04.347 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-09T00:15:04.347 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.347 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.348 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_step": { 2024-05-09T00:15:04.348 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_step", 2024-05-09T00:15:04.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:04.348 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.348 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.348 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.5", 2024-05-09T00:15:04.348 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0.001", 2024-05-09T00:15:04.348 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "0.999", 2024-05-09T00:15:04.348 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.348 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "aggressiveness of optimization", 2024-05-09T00:15:04.348 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-09T00:15:04.348 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.348 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "end_time": { 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_time", 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2359", 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ending time of day to automatically balance", 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.349 INFO:teuthology.orchestra.run.smithi081.stdout: "end_weekday": { 2024-05-09T00:15:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_weekday", 2024-05-09T00:15:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-05-09T00:15:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-05-09T00:15:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-09T00:15:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T00:15:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.350 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.351 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.351 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.351 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.351 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.351 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.351 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.351 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.351 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.351 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.351 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.351 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.352 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.352 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.352 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.352 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.352 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.352 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.352 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.352 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.352 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.352 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.352 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.352 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.353 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.353 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.353 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.353 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.353 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.353 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.353 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.353 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.353 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.353 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.354 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.354 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.354 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.354 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.354 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.354 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.354 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.354 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.354 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.354 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.354 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.355 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.355 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.355 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.355 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.355 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.355 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.355 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.355 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.355 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.355 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.355 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.356 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.356 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.356 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.356 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.356 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.356 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.356 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.356 INFO:teuthology.orchestra.run.smithi081.stdout: "min_score": { 2024-05-09T00:15:04.356 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_score", 2024-05-09T00:15:04.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:04.356 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.356 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.357 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:04.357 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.357 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.357 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.357 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-09T00:15:04.357 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.357 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.357 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.357 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-05-09T00:15:04.357 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-05-09T00:15:04.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.357 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "upmap", 2024-05-09T00:15:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-compat", 2024-05-09T00:15:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: "none", 2024-05-09T00:15:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap" 2024-05-09T00:15:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Balancer mode", 2024-05-09T00:15:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_ids": { 2024-05-09T00:15:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_ids", 2024-05-09T00:15:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-09T00:15:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.359 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-09T00:15:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.360 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_deviation": { 2024-05-09T00:15:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_deviation", 2024-05-09T00:15:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-05-09T00:15:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-05-09T00:15:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-09T00:15:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-09T00:15:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.361 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.362 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_optimizations": { 2024-05-09T00:15:04.362 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_optimizations", 2024-05-09T00:15:04.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:04.362 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.362 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.362 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.362 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.362 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.362 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.362 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-09T00:15:04.362 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.363 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.363 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.363 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.363 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.363 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm", 2024-05-09T00:15:04.363 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.363 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.363 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.363 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_down_multiplier": { 2024-05-09T00:15:04.363 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_down_multiplier", 2024-05-09T00:15:04.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:04.364 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.364 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.364 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-05-09T00:15:04.364 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.364 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.364 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.364 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-09T00:15:04.364 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.364 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.364 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.364 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_refresh_rate": { 2024-05-09T00:15:04.365 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_refresh_rate", 2024-05-09T00:15:04.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.365 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.365 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.365 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "20", 2024-05-09T00:15:04.365 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.365 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.365 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.365 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-09T00:15:04.365 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.366 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.366 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.366 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_starting_port": { 2024-05-09T00:15:04.366 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_starting_port", 2024-05-09T00:15:04.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.366 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.366 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.367 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4721", 2024-05-09T00:15:04.367 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.367 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.367 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.367 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-09T00:15:04.367 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.367 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.367 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_ptrace": { 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_ptrace", 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.369 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_interval": { 2024-05-09T00:15:04.369 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_interval", 2024-05-09T00:15:04.369 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.369 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.369 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.369 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:04.369 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.369 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.369 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.369 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-09T00:15:04.369 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.369 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.369 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.370 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_memory_target_ratio": { 2024-05-09T00:15:04.370 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_memory_target_ratio", 2024-05-09T00:15:04.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:04.370 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.370 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.370 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.7", 2024-05-09T00:15:04.370 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.370 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.370 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.370 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-09T00:15:04.370 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.370 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.370 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: "cgroups_split": { 2024-05-09T00:15:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cgroups_split", 2024-05-09T00:15:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-09T00:15:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.371 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.372 INFO:teuthology.orchestra.run.smithi081.stdout: "config_checks_enabled": { 2024-05-09T00:15:04.372 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_checks_enabled", 2024-05-09T00:15:04.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.372 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.372 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.372 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.372 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.372 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.372 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.372 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-09T00:15:04.372 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.372 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.373 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.373 INFO:teuthology.orchestra.run.smithi081.stdout: "config_dashboard": { 2024-05-09T00:15:04.373 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_dashboard", 2024-05-09T00:15:04.373 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.373 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.373 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.373 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.373 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.373 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.373 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.373 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-09T00:15:04.373 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.373 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.374 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.374 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_alertmanager": { 2024-05-09T00:15:04.374 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_alertmanager", 2024-05-09T00:15:04.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.374 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.374 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.374 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-09T00:15:04.374 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.374 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.374 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.374 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-05-09T00:15:04.374 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.375 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.375 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.375 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_base": { 2024-05-09T00:15:04.375 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_base", 2024-05-09T00:15:04.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.375 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.375 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.375 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-09T00:15:04.375 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.375 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.375 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.375 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Container image name, without the tag", 2024-05-09T00:15:04.375 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.376 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.376 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.376 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_elasticsearch": { 2024-05-09T00:15:04.376 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_elasticsearch", 2024-05-09T00:15:04.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.376 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.376 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.376 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-09T00:15:04.376 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.376 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.376 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.376 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "elasticsearch container image", 2024-05-09T00:15:04.377 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.377 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.377 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.377 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_grafana": { 2024-05-09T00:15:04.377 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_grafana", 2024-05-09T00:15:04.377 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.377 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.377 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.377 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-05-09T00:15:04.377 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.377 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.377 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.377 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-05-09T00:15:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_haproxy": { 2024-05-09T00:15:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_haproxy", 2024-05-09T00:15:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-09T00:15:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.378 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "HAproxy container image", 2024-05-09T00:15:04.379 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.379 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.379 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.379 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_agent": { 2024-05-09T00:15:04.379 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_agent", 2024-05-09T00:15:04.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.379 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.379 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.379 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-09T00:15:04.379 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.379 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.379 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.380 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger agent container image", 2024-05-09T00:15:04.380 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.380 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.380 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.380 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_collector": { 2024-05-09T00:15:04.380 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_collector", 2024-05-09T00:15:04.380 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.380 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.380 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.380 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-09T00:15:04.380 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.381 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.381 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.381 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger collector container image", 2024-05-09T00:15:04.381 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.381 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.381 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.381 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_query": { 2024-05-09T00:15:04.381 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_query", 2024-05-09T00:15:04.381 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.381 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.382 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.382 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-09T00:15:04.382 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.382 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.382 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.382 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger query container image", 2024-05-09T00:15:04.382 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.382 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.382 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.382 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_keepalived": { 2024-05-09T00:15:04.382 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_keepalived", 2024-05-09T00:15:04.382 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.382 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.383 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.383 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-09T00:15:04.383 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.383 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.383 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.383 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Keepalived container image", 2024-05-09T00:15:04.383 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.383 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.383 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.383 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_loki": { 2024-05-09T00:15:04.383 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_loki", 2024-05-09T00:15:04.383 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.384 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.384 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.384 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-09T00:15:04.384 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.384 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.384 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.384 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Loki container image", 2024-05-09T00:15:04.384 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.384 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.384 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.384 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_node_exporter": { 2024-05-09T00:15:04.384 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_node_exporter", 2024-05-09T00:15:04.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-09T00:15:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-05-09T00:15:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nvmeof": { 2024-05-09T00:15:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nvmeof", 2024-05-09T00:15:04.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.386 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.386 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.386 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-05-09T00:15:04.386 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.386 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.386 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.386 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nvme-of container image", 2024-05-09T00:15:04.386 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.386 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.386 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.386 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_prometheus": { 2024-05-09T00:15:04.386 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_prometheus", 2024-05-09T00:15:04.387 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.387 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.387 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.387 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-09T00:15:04.387 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.387 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.387 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.387 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-05-09T00:15:04.387 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.387 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.387 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.387 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_promtail": { 2024-05-09T00:15:04.388 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_promtail", 2024-05-09T00:15:04.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.388 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.388 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.388 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-09T00:15:04.388 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.388 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.388 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.388 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Promtail container image", 2024-05-09T00:15:04.388 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.388 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.388 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.388 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_snmp_gateway": { 2024-05-09T00:15:04.389 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_snmp_gateway", 2024-05-09T00:15:04.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.389 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.389 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.389 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-09T00:15:04.389 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.389 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.389 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.389 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SNMP Gateway container image", 2024-05-09T00:15:04.389 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.389 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.389 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.390 INFO:teuthology.orchestra.run.smithi081.stdout: "container_init": { 2024-05-09T00:15:04.390 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_init", 2024-05-09T00:15:04.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.390 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.390 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.390 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.390 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.390 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.390 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.391 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Run podman/docker with `--init`", 2024-05-09T00:15:04.391 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.391 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.391 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.391 INFO:teuthology.orchestra.run.smithi081.stdout: "daemon_cache_timeout": { 2024-05-09T00:15:04.391 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "daemon_cache_timeout", 2024-05-09T00:15:04.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.391 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.391 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.391 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:04.391 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.391 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.392 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.392 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-09T00:15:04.392 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.392 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.392 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.392 INFO:teuthology.orchestra.run.smithi081.stdout: "default_cephadm_command_timeout": { 2024-05-09T00:15:04.392 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_cephadm_command_timeout", 2024-05-09T00:15:04.392 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.392 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.392 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.392 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "900", 2024-05-09T00:15:04.392 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.393 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.393 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.393 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-09T00:15:04.393 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.393 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.393 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.393 INFO:teuthology.orchestra.run.smithi081.stdout: "default_registry": { 2024-05-09T00:15:04.393 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_registry", 2024-05-09T00:15:04.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.393 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.393 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.393 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io", 2024-05-09T00:15:04.393 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.394 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.394 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.394 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-09T00:15:04.394 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.394 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.394 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.394 INFO:teuthology.orchestra.run.smithi081.stdout: "device_cache_timeout": { 2024-05-09T00:15:04.394 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_cache_timeout", 2024-05-09T00:15:04.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.394 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.394 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.394 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1800", 2024-05-09T00:15:04.395 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.395 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.395 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.395 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache device inventory", 2024-05-09T00:15:04.395 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.395 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.395 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.395 INFO:teuthology.orchestra.run.smithi081.stdout: "device_enhanced_scan": { 2024-05-09T00:15:04.395 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_enhanced_scan", 2024-05-09T00:15:04.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.395 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.395 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.395 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.396 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.396 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.396 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.396 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-09T00:15:04.396 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.396 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.396 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.396 INFO:teuthology.orchestra.run.smithi081.stdout: "facts_cache_timeout": { 2024-05-09T00:15:04.396 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "facts_cache_timeout", 2024-05-09T00:15:04.396 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.396 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.396 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.396 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:04.397 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.397 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.397 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.397 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache host facts data", 2024-05-09T00:15:04.397 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.397 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.397 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.397 INFO:teuthology.orchestra.run.smithi081.stdout: "host_check_interval": { 2024-05-09T00:15:04.397 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "host_check_interval", 2024-05-09T00:15:04.397 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.397 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.397 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.398 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:04.398 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.398 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.398 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.398 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to perform a host check", 2024-05-09T00:15:04.398 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.398 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.398 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.398 INFO:teuthology.orchestra.run.smithi081.stdout: "hw_monitoring": { 2024-05-09T00:15:04.398 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hw_monitoring", 2024-05-09T00:15:04.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.398 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.399 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.399 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.399 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.399 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.399 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.399 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-09T00:15:04.399 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.399 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.399 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.399 INFO:teuthology.orchestra.run.smithi081.stdout: "inventory_list_all": { 2024-05-09T00:15:04.399 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "inventory_list_all", 2024-05-09T00:15:04.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.399 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-09T00:15:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.401 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.401 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.401 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.401 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.401 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.401 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.401 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.401 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.401 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.401 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.401 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.401 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.401 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.401 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.402 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.402 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.402 INFO:teuthology.orchestra.run.smithi081.stdout: "log_refresh_metadata": { 2024-05-09T00:15:04.402 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_refresh_metadata", 2024-05-09T00:15:04.402 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.402 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.402 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.402 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.402 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.402 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.402 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.402 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-09T00:15:04.403 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.404 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.405 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.405 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.405 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.405 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.405 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.405 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.405 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.405 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.405 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.405 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.405 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.405 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.406 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.406 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.406 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.406 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.406 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.406 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.406 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-09T00:15:04.406 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-09T00:15:04.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.406 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.406 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.406 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "*", 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.407 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: "max_count_per_host": { 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_count_per_host", 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.408 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.409 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of daemons per service per host", 2024-05-09T00:15:04.409 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.409 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.409 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.409 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd_draining_count": { 2024-05-09T00:15:04.409 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_osd_draining_count", 2024-05-09T00:15:04.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.409 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.409 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.409 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.409 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.410 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.410 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.410 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-09T00:15:04.410 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.410 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.410 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.410 INFO:teuthology.orchestra.run.smithi081.stdout: "migration_current": { 2024-05-09T00:15:04.410 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "migration_current", 2024-05-09T00:15:04.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.410 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.410 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.410 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.410 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "internal - do not modify", 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "root", 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.411 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.412 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.412 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm-package", 2024-05-09T00:15:04.412 INFO:teuthology.orchestra.run.smithi081.stdout: "root" 2024-05-09T00:15:04.412 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.412 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "mode for remote execution of cephadm", 2024-05-09T00:15:04.412 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.412 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.412 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.412 INFO:teuthology.orchestra.run.smithi081.stdout: "oob_default_addr": { 2024-05-09T00:15:04.412 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "oob_default_addr", 2024-05-09T00:15:04.412 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.412 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "169.254.1.1", 2024-05-09T00:15:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-09T00:15:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: "prometheus_alerts_path": { 2024-05-09T00:15:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus_alerts_path", 2024-05-09T00:15:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.413 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.414 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.414 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-09T00:15:04.414 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.414 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.414 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.414 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-09T00:15:04.414 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.414 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.414 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.414 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_insecure": { 2024-05-09T00:15:04.414 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_insecure", 2024-05-09T00:15:04.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.414 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.415 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.415 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.415 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.415 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.415 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.415 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-09T00:15:04.415 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.415 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.415 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.415 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_password": { 2024-05-09T00:15:04.415 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_password", 2024-05-09T00:15:04.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.416 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.416 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.416 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.416 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.416 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.416 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.416 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-09T00:15:04.416 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.416 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.417 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.417 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_url": { 2024-05-09T00:15:04.417 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_url", 2024-05-09T00:15:04.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.417 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.417 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.417 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.417 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-09T00:15:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_username": { 2024-05-09T00:15:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_username", 2024-05-09T00:15:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.418 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-09T00:15:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "secure_monitoring_stack": { 2024-05-09T00:15:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secure_monitoring_stack", 2024-05-09T00:15:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.419 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-09T00:15:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "service_discovery_port": { 2024-05-09T00:15:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "service_discovery_port", 2024-05-09T00:15:04.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8765", 2024-05-09T00:15:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "cephadm service discovery port", 2024-05-09T00:15:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_config_file": { 2024-05-09T00:15:04.421 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_config_file", 2024-05-09T00:15:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-09T00:15:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "use_agent": { 2024-05-09T00:15:04.422 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_agent", 2024-05-09T00:15:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-09T00:15:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "use_repo_digest": { 2024-05-09T00:15:04.423 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_repo_digest", 2024-05-09T00:15:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-09T00:15:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.424 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_failed_host_check": { 2024-05-09T00:15:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_failed_host_check", 2024-05-09T00:15:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if the host check fails", 2024-05-09T00:15:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.425 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_daemons": { 2024-05-09T00:15:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_daemons", 2024-05-09T00:15:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-09T00:15:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_hosts": { 2024-05-09T00:15:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_hosts", 2024-05-09T00:15:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-09T00:15:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crash", 2024-05-09T00:15:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.428 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.430 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.431 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.432 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "retain_interval": { 2024-05-09T00:15:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retain_interval", 2024-05-09T00:15:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.433 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "31536000", 2024-05-09T00:15:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-09T00:15:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_recent_interval": { 2024-05-09T00:15:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_recent_interval", 2024-05-09T00:15:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.434 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1209600", 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dashboard", 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.435 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-09T00:15:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-09T00:15:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.436 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_HOST": { 2024-05-09T00:15:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-09T00:15:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.437 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-09T00:15:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-09T00:15:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.438 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_ENABLED": { 2024-05-09T00:15:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_ENABLED", 2024-05-09T00:15:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.439 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.440 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "ENABLE_BROWSABLE_API": { 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.441 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-09T00:15:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-09T00:15:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.442 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.443 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.444 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.445 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-09T00:15:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-09T00:15:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.446 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-09T00:15:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-09T00:15:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.447 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-09T00:15:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-09T00:15:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.448 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-09T00:15:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-09T00:15:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.449 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_PASSWORD": { 2024-05-09T00:15:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-09T00:15:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-05-09T00:15:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-09T00:15:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-09T00:15:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.451 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_URL": { 2024-05-09T00:15:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_URL", 2024-05-09T00:15:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.452 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_USERNAME": { 2024-05-09T00:15:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-09T00:15:04.453 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-05-09T00:15:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-09T00:15:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-09T00:15:04.454 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-09T00:15:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-09T00:15:04.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-09T00:15:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-09T00:15:04.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.457 INFO:teuthology.orchestra.run.smithi081.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-09T00:15:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-09T00:15:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_HOST": { 2024-05-09T00:15:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-09T00:15:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.459 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-09T00:15:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-09T00:15:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.460 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-09T00:15:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-09T00:15:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.461 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-09T00:15:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-09T00:15:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.462 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-09T00:15:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-09T00:15:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.463 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-09T00:15:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-09T00:15:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-09T00:15:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-09T00:15:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.465 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-09T00:15:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-09T00:15:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.466 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-09T00:15:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-09T00:15:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.467 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_ENABLED": { 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-09T00:15:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-09T00:15:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.469 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-09T00:15:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-09T00:15:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-09T00:15:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.471 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-09T00:15:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-09T00:15:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8", 2024-05-09T00:15:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.472 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-09T00:15:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-09T00:15:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "45", 2024-05-09T00:15:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.473 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ACCESS_KEY": { 2024-05-09T00:15:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-09T00:15:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.474 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-09T00:15:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-09T00:15:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-05-09T00:15:04.475 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SECRET_KEY": { 2024-05-09T00:15:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-09T00:15:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.476 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SSL_VERIFY": { 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.477 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "UNSAFE_TLS_v1_2": { 2024-05-09T00:15:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-09T00:15:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.478 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.479 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.480 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.481 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "cross_origin_url": { 2024-05-09T00:15:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cross_origin_url", 2024-05-09T00:15:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.482 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "crt_file": { 2024-05-09T00:15:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crt_file", 2024-05-09T00:15:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.483 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "debug": { 2024-05-09T00:15:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "debug", 2024-05-09T00:15:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.484 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable/disable debug options", 2024-05-09T00:15:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "jwt_token_ttl": { 2024-05-09T00:15:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "jwt_token_ttl", 2024-05-09T00:15:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.485 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "28800", 2024-05-09T00:15:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-05-09T00:15:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-05-09T00:15:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.486 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.487 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.488 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.491 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.492 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "motd": { 2024-05-09T00:15:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "motd", 2024-05-09T00:15:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "The message of the day", 2024-05-09T00:15:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_resolve_ip_addr": { 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "redirect_resolve_ip_addr", 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.495 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-05-09T00:15:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-05-09T00:15:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-05-09T00:15:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.496 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8080", 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-05-09T00:15:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-05-09T00:15:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.498 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl_server_port": { 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl_server_port", 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8443", 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-05-09T00:15:04.499 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "redirect", 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect" 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.500 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-05-09T00:15:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-05-09T00:15:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-05-09T00:15:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-05-09T00:15:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-05-09T00:15:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.501 INFO:teuthology.orchestra.run.smithi081.stdout: "url_prefix": { 2024-05-09T00:15:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url_prefix", 2024-05-09T00:15:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.502 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-05-09T00:15:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_monitoring": { 2024-05-09T00:15:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_monitoring", 2024-05-09T00:15:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "monitor device health metrics", 2024-05-09T00:15:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.504 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.505 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.506 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.507 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "mark_out_threshold": { 2024-05-09T00:15:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mark_out_threshold", 2024-05-09T00:15:04.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2419200", 2024-05-09T00:15:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-09T00:15:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.510 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": { 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_name", 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "device_health_metrics", 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "retention_period": { 2024-05-09T00:15:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retention_period", 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15552000", 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain device health metrics", 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_frequency": { 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_frequency", 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.512 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-05-09T00:15:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-09T00:15:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "self_heal": { 2024-05-09T00:15:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "self_heal", 2024-05-09T00:15:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.513 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-09T00:15:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.514 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and check device health", 2024-05-09T00:15:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_threshold": { 2024-05-09T00:15:04.515 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_threshold", 2024-05-09T00:15:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7257600", 2024-05-09T00:15:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-09T00:15:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "diskprediction_local", 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.517 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.518 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.519 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "predict_interval": { 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predict_interval", 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.523 INFO:teuthology.orchestra.run.smithi081.stdout: "predictor_model": { 2024-05-09T00:15:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predictor_model", 2024-05-09T00:15:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "prophetstor", 2024-05-09T00:15:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.524 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "influx", 2024-05-09T00:15:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": false, 2024-05-09T00:15:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "influxdb python module not found", 2024-05-09T00:15:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "batch_size": { 2024-05-09T00:15:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "batch_size", 2024-05-09T00:15:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5000", 2024-05-09T00:15:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.526 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-09T00:15:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "database": { 2024-05-09T00:15:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "database", 2024-05-09T00:15:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "ceph", 2024-05-09T00:15:04.527 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-09T00:15:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": { 2024-05-09T00:15:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hostname", 2024-05-09T00:15:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.528 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server hostname", 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "30", 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "5", 2024-05-09T00:15:04.529 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-09T00:15:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.530 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.531 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.532 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.533 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.534 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "password": { 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "password", 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "password of InfluxDB server user", 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "port": { 2024-05-09T00:15:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "port", 2024-05-09T00:15:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8086", 2024-05-09T00:15:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server port", 2024-05-09T00:15:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.536 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "false", 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "threads": { 2024-05-09T00:15:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threads", 2024-05-09T00:15:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-05-09T00:15:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-05-09T00:15:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "32", 2024-05-09T00:15:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-09T00:15:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "username": { 2024-05-09T00:15:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "username", 2024-05-09T00:15:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "username of InfluxDB server user", 2024-05-09T00:15:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.539 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "verify_ssl": { 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "verify_ssl", 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "true", 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "insights", 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.542 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.543 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.544 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.545 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.546 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "iostat", 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.547 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.548 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.550 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.551 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "k8sevents", 2024-05-09T00:15:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.552 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_event_retention_days": { 2024-05-09T00:15:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ceph_event_retention_days", 2024-05-09T00:15:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-05-09T00:15:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-09T00:15:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "config_check_secs": { 2024-05-09T00:15:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_check_secs", 2024-05-09T00:15:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "10", 2024-05-09T00:15:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-09T00:15:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.555 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.556 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.557 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.558 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "localpool", 2024-05-09T00:15:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "failure_domain": { 2024-05-09T00:15:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "failure_domain", 2024-05-09T00:15:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.560 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "host", 2024-05-09T00:15:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "failure domain for any created local pool", 2024-05-09T00:15:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-09T00:15:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.564 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.565 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.566 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": { 2024-05-09T00:15:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_size", 2024-05-09T00:15:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default min_size for any created local pool", 2024-05-09T00:15:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-09T00:15:04.567 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "num_rep": { 2024-05-09T00:15:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "num_rep", 2024-05-09T00:15:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-05-09T00:15:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.568 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default replica count for any created local pool", 2024-05-09T00:15:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": { 2024-05-09T00:15:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_num", 2024-05-09T00:15:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "128", 2024-05-09T00:15:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.569 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default pg_num for any created local pool", 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "prefix": { 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prefix", 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name prefix for any created local pool", 2024-05-09T00:15:04.570 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "subtree": { 2024-05-09T00:15:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subtree", 2024-05-09T00:15:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "rack", 2024-05-09T00:15:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-09T00:15:04.571 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-09T00:15:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mds_autoscaler", 2024-05-09T00:15:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.573 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.574 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirroring", 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.578 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.579 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.581 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.582 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "nfs", 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.583 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.585 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.586 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.587 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-05-09T00:15:04.588 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "fail_fs": { 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fail_fs", 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.590 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.592 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.594 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator": { 2024-05-09T00:15:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-05-09T00:15:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.595 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-05-09T00:15:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: "rook", 2024-05-09T00:15:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: "test_orchestrator" 2024-05-09T00:15:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Orchestrator backend", 2024-05-09T00:15:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_perf_query", 2024-05-09T00:15:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.597 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.598 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.603 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.604 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_support", 2024-05-09T00:15:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.605 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.606 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.607 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.609 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.610 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_autoscaler", 2024-05-09T00:15:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.611 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.613 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.614 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.615 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.616 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.616 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.616 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.616 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.616 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.616 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.616 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.616 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.616 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.616 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.616 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.616 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.617 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.617 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:04.617 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:04.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.617 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.617 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:04.617 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.617 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.617 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.617 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.617 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.618 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.618 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.618 INFO:teuthology.orchestra.run.smithi081.stdout: "threshold": { 2024-05-09T00:15:04.618 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threshold", 2024-05-09T00:15:04.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:04.618 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.618 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.618 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-05-09T00:15:04.618 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1.0", 2024-05-09T00:15:04.618 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "scaling threshold", 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "progress", 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_pg_recovery_event": { 2024-05-09T00:15:04.619 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_pg_recovery_event", 2024-05-09T00:15:04.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.620 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.620 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.620 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.620 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.620 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.620 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-09T00:15:04.620 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.620 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.620 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.620 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-05-09T00:15:04.621 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-05-09T00:15:04.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.621 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.621 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.621 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.621 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.621 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.621 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.621 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.621 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.621 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.621 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.622 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.622 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.622 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.622 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.622 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.622 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.622 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.622 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.622 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.622 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.622 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.622 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.623 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.623 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.623 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.623 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.623 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.623 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.623 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.624 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.624 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.624 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.624 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.624 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.624 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.624 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.624 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.625 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.625 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.625 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.625 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.625 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.626 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.626 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.626 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.626 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.626 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.626 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.626 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.626 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.627 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.627 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.627 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.627 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.627 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.627 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.627 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.627 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.628 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.628 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.628 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.628 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.628 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.628 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.628 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.628 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.628 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.628 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.629 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.629 INFO:teuthology.orchestra.run.smithi081.stdout: "max_completed_events": { 2024-05-09T00:15:04.629 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_completed_events", 2024-05-09T00:15:04.629 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.629 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.629 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.629 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "50", 2024-05-09T00:15:04.629 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.629 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.629 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.630 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "number of past completed events to remember", 2024-05-09T00:15:04.630 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.630 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.630 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.630 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:04.630 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:04.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.630 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.630 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-05-09T00:15:04.630 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.631 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.631 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.631 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long the module is going to sleep", 2024-05-09T00:15:04.631 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.631 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.631 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.631 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus", 2024-05-09T00:15:04.631 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.631 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.631 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.632 INFO:teuthology.orchestra.run.smithi081.stdout: "cache": { 2024-05-09T00:15:04.632 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cache", 2024-05-09T00:15:04.632 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.632 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.632 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.632 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.632 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.632 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.632 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.632 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.632 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.633 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.633 INFO:teuthology.orchestra.run.smithi081.stdout: "exclude_perf_counters": { 2024-05-09T00:15:04.633 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "exclude_perf_counters", 2024-05-09T00:15:04.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.633 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.633 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.633 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.633 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.634 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.634 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-09T00:15:04.634 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-09T00:15:04.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.634 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.634 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.634 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.635 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.635 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.635 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.635 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.635 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.635 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.635 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.635 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.636 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.636 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.636 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.636 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.636 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.636 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.636 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.636 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.637 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.637 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.637 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.637 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.637 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.637 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.637 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.638 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.638 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.638 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.638 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.638 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.638 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.638 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.639 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.639 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.639 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.639 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.639 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.639 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.639 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.639 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.639 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.640 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.640 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.640 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.640 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.640 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.640 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.640 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.640 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.640 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.640 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.641 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.641 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.641 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.641 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.641 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.641 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.641 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.641 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.641 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools": { 2024-05-09T00:15:04.641 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools", 2024-05-09T00:15:04.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.641 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.641 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-09T00:15:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-09T00:15:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.643 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "300", 2024-05-09T00:15:04.643 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.643 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.643 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.643 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.643 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.643 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.644 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_interval": { 2024-05-09T00:15:04.644 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_interval", 2024-05-09T00:15:04.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:04.644 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.644 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.644 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15.0", 2024-05-09T00:15:04.644 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.644 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.644 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.644 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.644 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.644 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.644 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.645 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-05-09T00:15:04.645 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-05-09T00:15:04.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.645 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.645 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.645 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-05-09T00:15:04.645 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.645 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.645 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.645 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-09T00:15:04.645 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.645 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.646 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.646 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-05-09T00:15:04.646 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-05-09T00:15:04.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.646 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.646 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.646 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "9283", 2024-05-09T00:15:04.646 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.646 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.646 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.647 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-09T00:15:04.647 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.647 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.647 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.647 INFO:teuthology.orchestra.run.smithi081.stdout: "stale_cache_strategy": { 2024-05-09T00:15:04.647 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stale_cache_strategy", 2024-05-09T00:15:04.647 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.647 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.647 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "log", 2024-05-09T00:15:04.647 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.647 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.648 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.648 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.648 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.648 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.648 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.648 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-05-09T00:15:04.648 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-05-09T00:15:04.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.648 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.648 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.648 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "default", 2024-05-09T00:15:04.648 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.648 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.649 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.649 INFO:teuthology.orchestra.run.smithi081.stdout: "default", 2024-05-09T00:15:04.649 INFO:teuthology.orchestra.run.smithi081.stdout: "error" 2024-05-09T00:15:04.649 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.649 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.649 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.649 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.649 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.649 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-05-09T00:15:04.649 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-05-09T00:15:04.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.649 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.649 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.650 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-05-09T00:15:04.650 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-05-09T00:15:04.650 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-05-09T00:15:04.650 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.650 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.650 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.650 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.650 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-05-09T00:15:04.651 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.651 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.651 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.651 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.651 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.651 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.651 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.651 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.651 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.651 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.651 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.651 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.652 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.653 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.653 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.653 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.653 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.653 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.653 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.653 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.653 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.653 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.653 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.654 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.654 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.654 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.654 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.654 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.654 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.654 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.654 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.655 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.655 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.655 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.655 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.655 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.655 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.655 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.655 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.655 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.656 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.656 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.656 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.656 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.656 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.656 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.657 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.657 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.657 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.657 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.657 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.657 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.657 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_snap_create": { 2024-05-09T00:15:04.658 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_snap_create", 2024-05-09T00:15:04.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.658 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.658 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.658 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.658 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.658 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.658 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.659 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.659 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.659 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.659 INFO:teuthology.orchestra.run.smithi081.stdout: "mirror_snapshot_schedule": { 2024-05-09T00:15:04.659 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirror_snapshot_schedule", 2024-05-09T00:15:04.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.659 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.659 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.660 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.660 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.660 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.660 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.660 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.660 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.660 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.660 INFO:teuthology.orchestra.run.smithi081.stdout: "trash_purge_schedule": { 2024-05-09T00:15:04.660 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "trash_purge_schedule", 2024-05-09T00:15:04.660 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.660 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "restful", 2024-05-09T00:15:04.661 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.662 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.662 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.662 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_auth": { 2024-05-09T00:15:04.662 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_auth", 2024-05-09T00:15:04.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.662 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.662 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.662 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.662 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.662 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.662 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.662 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.662 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.662 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.663 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.664 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.664 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.664 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.664 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.664 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.664 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.664 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.664 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.664 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.664 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.665 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.666 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.666 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.666 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.666 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.666 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.666 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.666 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.666 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.666 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.666 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.667 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.667 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.667 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.667 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.667 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.667 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.667 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.667 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.667 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.667 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.667 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.667 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.668 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.669 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.669 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.669 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.669 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.669 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-05-09T00:15:04.669 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-05-09T00:15:04.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.669 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.669 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.669 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.669 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.669 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.670 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.670 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.670 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.670 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.670 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.670 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-05-09T00:15:04.670 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-05-09T00:15:04.670 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.670 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.670 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.670 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw", 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.671 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.672 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.673 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.673 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.673 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.673 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.673 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.673 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.673 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.673 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.673 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.673 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.674 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.674 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.674 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.674 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.674 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.674 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.674 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.674 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.674 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.674 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.674 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.675 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.675 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.675 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.675 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.675 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.675 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.675 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.675 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.675 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.675 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.676 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.676 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.676 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.676 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.676 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.676 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.676 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.676 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.676 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.676 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.676 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.677 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.677 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.677 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.677 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.677 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rook", 2024-05-09T00:15:04.677 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.677 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.677 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.678 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.678 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.678 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.678 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.678 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.678 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.678 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.678 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.678 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.678 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.678 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.678 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.678 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.679 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.679 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.679 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.679 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.679 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.679 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.679 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.679 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.679 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.680 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.681 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.681 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.681 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.681 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.681 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.681 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.681 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.681 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.681 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.681 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.681 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.681 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.681 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.682 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.682 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.682 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.682 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.682 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.682 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.682 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.682 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.682 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.682 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.683 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.683 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.683 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.683 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_class": { 2024-05-09T00:15:04.683 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "storage_class", 2024-05-09T00:15:04.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.683 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.683 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.683 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "local", 2024-05-09T00:15:04.683 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.683 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.684 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.684 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-09T00:15:04.684 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.684 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.684 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.684 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "selftest", 2024-05-09T00:15:04.684 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.685 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.685 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.685 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.685 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.685 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.685 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.685 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.685 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.686 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.686 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.686 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.686 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.686 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.686 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.686 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.686 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.686 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.687 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.687 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.687 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.687 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.687 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.687 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.687 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.687 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.688 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.688 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.688 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.688 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.688 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.688 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.688 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.688 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.688 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.688 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.688 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.688 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.688 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.689 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.689 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.689 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.689 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.689 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.689 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.689 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.689 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.689 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.689 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.689 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.689 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.689 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.689 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.690 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.690 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.690 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.690 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.690 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.690 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.690 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.690 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.690 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.690 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.690 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.691 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.691 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.691 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.691 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.691 INFO:teuthology.orchestra.run.smithi081.stdout: "roption1": { 2024-05-09T00:15:04.691 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption1", 2024-05-09T00:15:04.691 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.691 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.691 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.691 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.691 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.691 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.691 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.692 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.692 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.692 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.692 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.692 INFO:teuthology.orchestra.run.smithi081.stdout: "roption2": { 2024-05-09T00:15:04.692 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption2", 2024-05-09T00:15:04.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.692 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.692 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.692 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "xyz", 2024-05-09T00:15:04.692 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.692 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption1": { 2024-05-09T00:15:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption1", 2024-05-09T00:15:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.693 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.694 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.694 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.694 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.694 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.694 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.694 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption2": { 2024-05-09T00:15:04.694 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption2", 2024-05-09T00:15:04.694 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.694 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.694 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.694 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.694 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.694 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.695 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.695 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.695 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.695 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.695 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.695 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.695 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption3": { 2024-05-09T00:15:04.695 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption3", 2024-05-09T00:15:04.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:04.695 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.695 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.695 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.695 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.695 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.696 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.696 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.696 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.696 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.696 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.696 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption4": { 2024-05-09T00:15:04.696 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption4", 2024-05-09T00:15:04.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.696 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.696 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.696 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.696 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.697 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.697 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.697 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.697 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.697 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.697 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.697 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption5": { 2024-05-09T00:15:04.697 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption5", 2024-05-09T00:15:04.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.697 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.697 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption6": { 2024-05-09T00:15:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption6", 2024-05-09T00:15:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.699 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.699 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.699 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.699 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.699 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.699 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.699 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.699 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption7": { 2024-05-09T00:15:04.699 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption7", 2024-05-09T00:15:04.699 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.699 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.699 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.700 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.700 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-05-09T00:15:04.700 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "42", 2024-05-09T00:15:04.700 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.700 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.700 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.700 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.700 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.700 INFO:teuthology.orchestra.run.smithi081.stdout: "testkey": { 2024-05-09T00:15:04.700 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testkey", 2024-05-09T00:15:04.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.700 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: "testlkey": { 2024-05-09T00:15:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testlkey", 2024-05-09T00:15:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.701 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.702 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.702 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.702 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.702 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.702 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.702 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.702 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.702 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.702 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.702 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.702 INFO:teuthology.orchestra.run.smithi081.stdout: "testnewline": { 2024-05-09T00:15:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testnewline", 2024-05-09T00:15:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.704 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-05-09T00:15:04.704 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.704 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.704 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.704 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_m_granularity": { 2024-05-09T00:15:04.704 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_m_granularity", 2024-05-09T00:15:04.704 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.704 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.704 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.704 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.704 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.705 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.705 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.705 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow minute scheduled snapshots", 2024-05-09T00:15:04.705 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.705 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.705 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.705 INFO:teuthology.orchestra.run.smithi081.stdout: "dump_on_update": { 2024-05-09T00:15:04.705 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dump_on_update", 2024-05-09T00:15:04.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.705 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.705 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.705 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.705 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.706 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.706 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.706 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "dump database to debug log on update", 2024-05-09T00:15:04.706 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.706 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.706 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.706 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.706 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.706 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.706 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.707 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.707 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.707 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.707 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.707 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.707 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.707 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.707 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.707 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.707 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.707 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.707 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.708 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.708 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.708 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.708 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.708 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.708 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.708 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.708 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.708 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.708 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.708 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.708 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.709 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.709 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.709 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.709 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.709 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.709 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.709 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.710 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.710 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.710 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.710 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.710 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.710 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.710 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.710 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.711 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.711 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.711 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.711 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.711 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.711 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.711 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.712 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.712 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.712 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.712 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.712 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.712 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.712 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.713 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.713 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.713 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stats", 2024-05-09T00:15:04.713 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.713 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.713 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.714 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.714 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.714 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.714 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.714 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.714 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.715 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.715 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.715 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.715 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.715 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.715 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.715 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.715 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.715 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.716 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.716 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.716 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.716 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.716 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.716 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.716 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.717 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.717 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.717 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.717 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.717 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.717 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.717 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.717 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.718 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.718 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.718 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.718 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.718 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.718 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.718 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.718 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.719 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.719 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.719 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.719 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.719 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.719 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.719 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.719 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.719 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.719 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.720 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.720 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.720 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.720 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.720 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.720 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.720 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.720 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.720 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.720 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.720 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.720 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.720 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.721 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.721 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "status", 2024-05-09T00:15:04.721 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.721 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.721 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.721 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.721 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.721 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.723 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.725 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.725 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.725 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.725 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.725 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.725 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.725 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.725 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.725 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.725 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.725 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.725 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.726 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.726 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.726 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.726 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.726 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.726 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.726 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.726 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telegraf", 2024-05-09T00:15:04.726 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.726 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.727 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.727 INFO:teuthology.orchestra.run.smithi081.stdout: "address": { 2024-05-09T00:15:04.727 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "address", 2024-05-09T00:15:04.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.727 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.727 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-09T00:15:04.727 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.727 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.727 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.727 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.727 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.727 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.728 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:04.728 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:04.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.728 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.728 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.728 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15", 2024-05-09T00:15:04.728 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.728 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.728 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.728 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.728 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.729 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.729 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.729 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.729 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.729 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.729 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.729 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.729 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.729 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.729 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.729 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.730 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.730 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.730 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.730 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.730 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.730 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.730 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.730 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.730 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.731 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.731 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.731 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.731 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.731 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.731 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.731 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.731 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.731 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.731 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.732 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telemetry", 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.734 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_basic": { 2024-05-09T00:15:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_basic", 2024-05-09T00:15:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-09T00:15:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.735 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_crash": { 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_crash", 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_device": { 2024-05-09T00:15:04.736 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_device", 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_ident": { 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_ident", 2024-05-09T00:15:04.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-09T00:15:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_perf": { 2024-05-09T00:15:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_perf", 2024-05-09T00:15:04.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: "contact": { 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "contact", 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.739 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: "description": { 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "description", 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.740 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.741 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.741 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.741 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.741 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.741 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.741 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.741 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.741 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.741 INFO:teuthology.orchestra.run.smithi081.stdout: "device_url": { 2024-05-09T00:15:04.741 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_url", 2024-05-09T00:15:04.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.741 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.741 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.742 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.743 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.743 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.743 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.743 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.743 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.743 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.743 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.743 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:04.743 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:04.743 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.743 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.743 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.743 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "24", 2024-05-09T00:15:04.744 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "8", 2024-05-09T00:15:04.744 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.744 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.744 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.744 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.744 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.744 INFO:teuthology.orchestra.run.smithi081.stdout: "last_opt_revision": { 2024-05-09T00:15:04.744 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "last_opt_revision", 2024-05-09T00:15:04.744 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.744 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.744 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.744 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1", 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard": { 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard", 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.745 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.746 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.746 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.746 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.746 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.746 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.746 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.746 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard_description": { 2024-05-09T00:15:04.746 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard_description", 2024-05-09T00:15:04.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.746 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.746 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.746 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.747 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.748 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.749 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.750 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.750 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.750 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.750 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.750 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.750 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.750 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.750 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.750 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.750 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.750 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.750 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.750 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.750 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.751 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: "organization": { 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "organization", 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: "proxy": { 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "proxy", 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.753 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: "url": { 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url", 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.754 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test_orchestrator", 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.755 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.756 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.756 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.756 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.756 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.756 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.756 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.756 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.756 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.756 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.756 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.756 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.756 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.756 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.756 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.757 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.758 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.758 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.758 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.758 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.758 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.758 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.758 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.758 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.758 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.758 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.758 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.758 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.758 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.758 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.759 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.759 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.759 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.759 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.759 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.759 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.759 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.759 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.759 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.759 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.759 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.761 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.762 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.762 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.762 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.762 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.762 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.762 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.762 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.762 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.762 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.763 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.765 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.765 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.765 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.765 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.765 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.765 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.765 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.765 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.765 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_clones": { 2024-05-09T00:15:04.765 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_clones", 2024-05-09T00:15:04.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.765 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.765 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4", 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_delay": { 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_delay", 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.766 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_no_wait": { 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_no_wait", 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.767 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.768 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.768 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.768 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-09T00:15:04.768 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.768 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.768 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.768 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix", 2024-05-09T00:15:04.768 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.768 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.768 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: "discovery_interval": { 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "discovery_interval", 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "100", 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.769 INFO:teuthology.orchestra.run.smithi081.stdout: "identifier": { 2024-05-09T00:15:04.770 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "identifier", 2024-05-09T00:15:04.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.770 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.770 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.770 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.770 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.770 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.770 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.770 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.770 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.770 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.770 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.771 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:04.771 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:04.771 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.771 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.771 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:04.771 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.771 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.771 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.771 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.771 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.771 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.772 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.773 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.773 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.773 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.773 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.773 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.773 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.773 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.773 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.773 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.773 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.773 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.773 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.774 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_host": { 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_host", 2024-05-09T00:15:04.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.777 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.777 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.777 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.777 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.777 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.777 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.777 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.777 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.777 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.777 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.777 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_port": { 2024-05-09T00:15:04.777 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_port", 2024-05-09T00:15:04.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.778 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.778 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.778 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10051", 2024-05-09T00:15:04.778 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.778 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.778 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.778 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.778 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.778 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.778 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_sender": { 2024-05-09T00:15:04.778 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_sender", 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.779 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-09T00:15:04.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.780 INFO:teuthology.orchestra.run.smithi081.stdout: "gid": 24901, 2024-05-09T00:15:04.780 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "z", 2024-05-09T00:15:04.780 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_features": 4540138322906710015, 2024-05-09T00:15:04.780 INFO:teuthology.orchestra.run.smithi081.stdout: "available_modules": [ 2024-05-09T00:15:04.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.780 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "alerts", 2024-05-09T00:15:04.780 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.780 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.780 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.780 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:04.780 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:04.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How frequently to reexamine health status", 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.781 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.782 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.782 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.782 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.782 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.782 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.782 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.782 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.782 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.782 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.782 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.782 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.782 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.782 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.783 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.784 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.786 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_destination": { 2024-05-09T00:15:04.787 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_destination", 2024-05-09T00:15:04.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.787 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.787 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.787 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.787 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.787 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.787 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.787 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email address to send alerts to", 2024-05-09T00:15:04.787 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.787 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.787 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_from_name": { 2024-05-09T00:15:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_from_name", 2024-05-09T00:15:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "Ceph", 2024-05-09T00:15:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email From: name", 2024-05-09T00:15:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_host": { 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_host", 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP server", 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.789 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_password": { 2024-05-09T00:15:04.790 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_password", 2024-05-09T00:15:04.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.790 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.790 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.790 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.790 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.790 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.790 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.790 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Password to authenticate with", 2024-05-09T00:15:04.790 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.790 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.790 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.790 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_port": { 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_port", 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "465", 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP port", 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_sender": { 2024-05-09T00:15:04.791 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_sender", 2024-05-09T00:15:04.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.792 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.792 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.792 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.792 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.792 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.792 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP envelope sender", 2024-05-09T00:15:04.792 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.792 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.792 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.792 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_ssl": { 2024-05-09T00:15:04.792 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_ssl", 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_user": { 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_user", 2024-05-09T00:15:04.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.794 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.794 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.794 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.794 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.794 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.794 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.794 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "User to authenticate as", 2024-05-09T00:15:04.794 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.794 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.794 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.795 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.795 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "balancer", 2024-05-09T00:15:04.795 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.795 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.795 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.795 INFO:teuthology.orchestra.run.smithi081.stdout: "active": { 2024-05-09T00:15:04.795 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "active", 2024-05-09T00:15:04.795 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.795 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.795 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.795 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.795 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.795 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.795 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically balance PGs across cluster", 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_time": { 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_time", 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0000", 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.796 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "beginning time of day to automatically balance", 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_weekday": { 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_weekday", 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-09T00:15:04.797 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_max_iterations": { 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_max_iterations", 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "25", 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "250", 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_metrics": { 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_metrics", 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "pgs,objects,bytes", 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.799 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_step": { 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_step", 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.5", 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0.001", 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "0.999", 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "aggressiveness of optimization", 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "end_time": { 2024-05-09T00:15:04.800 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_time", 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2359", 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ending time of day to automatically balance", 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "end_weekday": { 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_weekday", 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.802 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.804 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.805 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.806 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.806 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.806 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.806 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.806 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.806 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.806 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.806 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.806 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.806 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.806 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.806 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.806 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: "min_score": { 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_score", 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.807 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-05-09T00:15:04.808 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-05-09T00:15:04.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.808 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.808 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.808 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "upmap", 2024-05-09T00:15:04.808 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.808 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.808 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.808 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-compat", 2024-05-09T00:15:04.808 INFO:teuthology.orchestra.run.smithi081.stdout: "none", 2024-05-09T00:15:04.808 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap" 2024-05-09T00:15:04.808 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.808 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Balancer mode", 2024-05-09T00:15:04.808 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_ids": { 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_ids", 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.809 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.810 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_deviation": { 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_deviation", 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_optimizations": { 2024-05-09T00:15:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_optimizations", 2024-05-09T00:15:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-09T00:15:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm", 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_down_multiplier": { 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_down_multiplier", 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.813 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-09T00:15:04.814 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.814 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.814 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.814 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_refresh_rate": { 2024-05-09T00:15:04.814 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_refresh_rate", 2024-05-09T00:15:04.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.814 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.814 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "20", 2024-05-09T00:15:04.814 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.814 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.814 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_starting_port": { 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_starting_port", 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4721", 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.815 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-09T00:15:04.816 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.816 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.816 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.816 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.816 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_ptrace": { 2024-05-09T00:15:04.816 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_ptrace", 2024-05-09T00:15:04.816 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.816 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.816 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.816 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.816 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.816 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.816 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-09T00:15:04.817 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-09T00:15:04.817 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.817 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.817 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_interval": { 2024-05-09T00:15:04.817 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_interval", 2024-05-09T00:15:04.817 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.817 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.817 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.817 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:04.817 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.817 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.817 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.817 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_memory_target_ratio": { 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_memory_target_ratio", 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.7", 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-09T00:15:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: "cgroups_split": { 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cgroups_split", 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.819 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.820 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.820 INFO:teuthology.orchestra.run.smithi081.stdout: "config_checks_enabled": { 2024-05-09T00:15:04.820 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_checks_enabled", 2024-05-09T00:15:04.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.820 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.820 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.820 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.820 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.820 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.820 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.820 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-09T00:15:04.820 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: "config_dashboard": { 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_dashboard", 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.821 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_alertmanager": { 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_alertmanager", 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.822 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_base": { 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_base", 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Container image name, without the tag", 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_elasticsearch": { 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_elasticsearch", 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "elasticsearch container image", 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.824 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_grafana": { 2024-05-09T00:15:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_grafana", 2024-05-09T00:15:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-05-09T00:15:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-05-09T00:15:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.825 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_haproxy": { 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_haproxy", 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "HAproxy container image", 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_agent": { 2024-05-09T00:15:04.826 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_agent", 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger agent container image", 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_collector": { 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_collector", 2024-05-09T00:15:04.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger collector container image", 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_query": { 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_query", 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.828 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger query container image", 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_keepalived": { 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_keepalived", 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.829 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Keepalived container image", 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_loki": { 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_loki", 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.830 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-09T00:15:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Loki container image", 2024-05-09T00:15:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_node_exporter": { 2024-05-09T00:15:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_node_exporter", 2024-05-09T00:15:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.831 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nvmeof": { 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nvmeof", 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-05-09T00:15:04.832 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.833 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.833 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.833 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nvme-of container image", 2024-05-09T00:15:04.833 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.833 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.833 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.833 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_prometheus": { 2024-05-09T00:15:04.833 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_prometheus", 2024-05-09T00:15:04.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.833 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.833 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.833 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-09T00:15:04.833 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.834 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.834 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.834 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-05-09T00:15:04.834 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.834 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.834 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.834 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_promtail": { 2024-05-09T00:15:04.834 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_promtail", 2024-05-09T00:15:04.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.834 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.834 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.834 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-09T00:15:04.834 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.835 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.835 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.835 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Promtail container image", 2024-05-09T00:15:04.835 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.835 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.835 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.835 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_snmp_gateway": { 2024-05-09T00:15:04.835 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_snmp_gateway", 2024-05-09T00:15:04.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.835 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.835 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.835 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-09T00:15:04.835 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.836 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.836 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.836 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SNMP Gateway container image", 2024-05-09T00:15:04.836 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.836 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.836 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.836 INFO:teuthology.orchestra.run.smithi081.stdout: "container_init": { 2024-05-09T00:15:04.836 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_init", 2024-05-09T00:15:04.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.836 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.836 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.836 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.836 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Run podman/docker with `--init`", 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: "daemon_cache_timeout": { 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "daemon_cache_timeout", 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.837 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: "default_cephadm_command_timeout": { 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_cephadm_command_timeout", 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "900", 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.838 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-09T00:15:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: "default_registry": { 2024-05-09T00:15:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_registry", 2024-05-09T00:15:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io", 2024-05-09T00:15:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: "device_cache_timeout": { 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_cache_timeout", 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1800", 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.840 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache device inventory", 2024-05-09T00:15:04.841 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.841 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.841 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.841 INFO:teuthology.orchestra.run.smithi081.stdout: "device_enhanced_scan": { 2024-05-09T00:15:04.841 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_enhanced_scan", 2024-05-09T00:15:04.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.841 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.841 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.841 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.841 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.841 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.841 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: "facts_cache_timeout": { 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "facts_cache_timeout", 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.842 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache host facts data", 2024-05-09T00:15:04.843 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.843 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.843 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.843 INFO:teuthology.orchestra.run.smithi081.stdout: "host_check_interval": { 2024-05-09T00:15:04.843 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "host_check_interval", 2024-05-09T00:15:04.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.843 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.843 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.843 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:04.843 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.843 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.843 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.844 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to perform a host check", 2024-05-09T00:15:04.844 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.844 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.844 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.844 INFO:teuthology.orchestra.run.smithi081.stdout: "hw_monitoring": { 2024-05-09T00:15:04.844 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hw_monitoring", 2024-05-09T00:15:04.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.844 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.844 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.844 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.844 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.844 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.844 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: "inventory_list_all": { 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "inventory_list_all", 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.845 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-09T00:15:04.846 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.846 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.846 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.846 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.846 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.846 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.846 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.846 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.846 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.846 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: "log_refresh_metadata": { 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_refresh_metadata", 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.847 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.848 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.848 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.851 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.851 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.851 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.851 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-09T00:15:04.851 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.851 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.851 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.852 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.853 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.854 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.854 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.854 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.854 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.854 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.854 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.854 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.854 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.854 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.854 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.854 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.854 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.855 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-09T00:15:04.856 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.856 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.856 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.856 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-09T00:15:04.856 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-09T00:15:04.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.856 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.856 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "*", 2024-05-09T00:15:04.856 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.856 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.856 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.856 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: "max_count_per_host": { 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_count_per_host", 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of daemons per service per host", 2024-05-09T00:15:04.857 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.858 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.858 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.858 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd_draining_count": { 2024-05-09T00:15:04.858 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_osd_draining_count", 2024-05-09T00:15:04.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.858 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.858 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.858 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.858 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.858 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.858 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.859 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-09T00:15:04.859 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.859 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.859 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.859 INFO:teuthology.orchestra.run.smithi081.stdout: "migration_current": { 2024-05-09T00:15:04.859 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "migration_current", 2024-05-09T00:15:04.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.859 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.859 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.859 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.859 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.859 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.859 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "internal - do not modify", 2024-05-09T00:15:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-05-09T00:15:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-05-09T00:15:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "root", 2024-05-09T00:15:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm-package", 2024-05-09T00:15:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: "root" 2024-05-09T00:15:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "mode for remote execution of cephadm", 2024-05-09T00:15:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: "oob_default_addr": { 2024-05-09T00:15:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "oob_default_addr", 2024-05-09T00:15:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.861 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "169.254.1.1", 2024-05-09T00:15:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-09T00:15:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: "prometheus_alerts_path": { 2024-05-09T00:15:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus_alerts_path", 2024-05-09T00:15:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.862 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_insecure": { 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_insecure", 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.863 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-09T00:15:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_password": { 2024-05-09T00:15:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_password", 2024-05-09T00:15:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.864 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-09T00:15:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_url": { 2024-05-09T00:15:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_url", 2024-05-09T00:15:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.865 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-09T00:15:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_username": { 2024-05-09T00:15:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_username", 2024-05-09T00:15:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.866 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-09T00:15:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: "secure_monitoring_stack": { 2024-05-09T00:15:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secure_monitoring_stack", 2024-05-09T00:15:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.867 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: "service_discovery_port": { 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "service_discovery_port", 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8765", 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.868 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "cephadm service discovery port", 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_config_file": { 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_config_file", 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.869 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: "use_agent": { 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_agent", 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.870 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-09T00:15:04.871 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.871 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.871 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.871 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.871 INFO:teuthology.orchestra.run.smithi081.stdout: "use_repo_digest": { 2024-05-09T00:15:04.871 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_repo_digest", 2024-05-09T00:15:04.871 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.871 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.871 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.871 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.871 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.871 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.871 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_failed_host_check": { 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_failed_host_check", 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if the host check fails", 2024-05-09T00:15:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_daemons": { 2024-05-09T00:15:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_daemons", 2024-05-09T00:15:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.873 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-09T00:15:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_hosts": { 2024-05-09T00:15:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_hosts", 2024-05-09T00:15:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.874 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crash", 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.875 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.876 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.878 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.879 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "retain_interval": { 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retain_interval", 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "31536000", 2024-05-09T00:15:04.880 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-09T00:15:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_recent_interval": { 2024-05-09T00:15:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_recent_interval", 2024-05-09T00:15:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1209600", 2024-05-09T00:15:04.881 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-09T00:15:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dashboard", 2024-05-09T00:15:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.882 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-09T00:15:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-09T00:15:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_HOST": { 2024-05-09T00:15:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-09T00:15:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.884 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-09T00:15:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-09T00:15:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_ENABLED": { 2024-05-09T00:15:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_ENABLED", 2024-05-09T00:15:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.886 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.887 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "ENABLE_BROWSABLE_API": { 2024-05-09T00:15:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-09T00:15:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.888 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-09T00:15:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-09T00:15:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.889 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-09T00:15:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-09T00:15:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.892 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-09T00:15:04.893 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-09T00:15:04.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.895 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.895 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.895 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.895 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.895 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.895 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.895 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.895 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.895 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.895 INFO:teuthology.orchestra.run.smithi081.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-09T00:15:04.895 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-09T00:15:04.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.896 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.896 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.896 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.896 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.896 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.896 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.896 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.896 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.896 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.896 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.896 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_PASSWORD": { 2024-05-09T00:15:04.896 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-09T00:15:04.896 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-05-09T00:15:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-09T00:15:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-09T00:15:04.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_URL": { 2024-05-09T00:15:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_URL", 2024-05-09T00:15:04.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_USERNAME": { 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.899 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.900 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-09T00:15:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-09T00:15:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.901 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-09T00:15:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-09T00:15:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.902 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-09T00:15:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-09T00:15:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.903 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_HOST": { 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.904 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.905 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.906 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.907 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-09T00:15:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-09T00:15:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.909 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-09T00:15:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-09T00:15:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.911 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.912 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_ENABLED": { 2024-05-09T00:15:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-09T00:15:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.913 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.914 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-09T00:15:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-09T00:15:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.915 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8", 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.916 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-09T00:15:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-09T00:15:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "45", 2024-05-09T00:15:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.917 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ACCESS_KEY": { 2024-05-09T00:15:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-09T00:15:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.918 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-09T00:15:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-09T00:15:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-05-09T00:15:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.919 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SECRET_KEY": { 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SSL_VERIFY": { 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.921 INFO:teuthology.orchestra.run.smithi081.stdout: "UNSAFE_TLS_v1_2": { 2024-05-09T00:15:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-09T00:15:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.922 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-09T00:15:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-09T00:15:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.923 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-09T00:15:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-09T00:15:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.924 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-09T00:15:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-09T00:15:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-05-09T00:15:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.925 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "cross_origin_url": { 2024-05-09T00:15:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cross_origin_url", 2024-05-09T00:15:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.926 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "crt_file": { 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crt_file", 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.927 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "debug": { 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "debug", 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable/disable debug options", 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "jwt_token_ttl": { 2024-05-09T00:15:04.928 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "jwt_token_ttl", 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "28800", 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.929 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.930 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.931 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.933 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.934 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "motd": { 2024-05-09T00:15:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "motd", 2024-05-09T00:15:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.935 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "The message of the day", 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_resolve_ip_addr": { 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "redirect_resolve_ip_addr", 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.936 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.937 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-05-09T00:15:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-05-09T00:15:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-05-09T00:15:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.938 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8080", 2024-05-09T00:15:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-05-09T00:15:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-05-09T00:15:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.939 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl_server_port": { 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl_server_port", 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8443", 2024-05-09T00:15:04.940 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-05-09T00:15:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-05-09T00:15:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "redirect", 2024-05-09T00:15:04.941 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect" 2024-05-09T00:15:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-05-09T00:15:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-05-09T00:15:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.942 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "url_prefix": { 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url_prefix", 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.943 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.944 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_monitoring": { 2024-05-09T00:15:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_monitoring", 2024-05-09T00:15:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "monitor device health metrics", 2024-05-09T00:15:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.945 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.946 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.947 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.948 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.949 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.950 INFO:teuthology.orchestra.run.smithi081.stdout: "mark_out_threshold": { 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mark_out_threshold", 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2419200", 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": { 2024-05-09T00:15:04.951 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_name", 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "device_health_metrics", 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "retention_period": { 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retention_period", 2024-05-09T00:15:04.952 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15552000", 2024-05-09T00:15:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain device health metrics", 2024-05-09T00:15:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_frequency": { 2024-05-09T00:15:04.953 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_frequency", 2024-05-09T00:15:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-05-09T00:15:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-09T00:15:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.954 INFO:teuthology.orchestra.run.smithi081.stdout: "self_heal": { 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "self_heal", 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:04.955 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and check device health", 2024-05-09T00:15:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.956 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_threshold": { 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_threshold", 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7257600", 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "diskprediction_local", 2024-05-09T00:15:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.958 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.959 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.960 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.961 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.962 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "predict_interval": { 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predict_interval", 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.963 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "predictor_model": { 2024-05-09T00:15:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predictor_model", 2024-05-09T00:15:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "prophetstor", 2024-05-09T00:15:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.964 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.965 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "influx", 2024-05-09T00:15:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": false, 2024-05-09T00:15:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "influxdb python module not found", 2024-05-09T00:15:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "batch_size": { 2024-05-09T00:15:04.966 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "batch_size", 2024-05-09T00:15:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5000", 2024-05-09T00:15:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-09T00:15:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "database": { 2024-05-09T00:15:04.967 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "database", 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "ceph", 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": { 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hostname", 2024-05-09T00:15:04.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server hostname", 2024-05-09T00:15:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:04.969 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "30", 2024-05-09T00:15:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "5", 2024-05-09T00:15:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-09T00:15:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.971 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.972 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.973 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.974 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "password": { 2024-05-09T00:15:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "password", 2024-05-09T00:15:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.975 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "password of InfluxDB server user", 2024-05-09T00:15:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "port": { 2024-05-09T00:15:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "port", 2024-05-09T00:15:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.976 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8086", 2024-05-09T00:15:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server port", 2024-05-09T00:15:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-05-09T00:15:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-05-09T00:15:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.977 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "false", 2024-05-09T00:15:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T00:15:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "threads": { 2024-05-09T00:15:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threads", 2024-05-09T00:15:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.978 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-05-09T00:15:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-05-09T00:15:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "32", 2024-05-09T00:15:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-09T00:15:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "username": { 2024-05-09T00:15:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "username", 2024-05-09T00:15:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "username of InfluxDB server user", 2024-05-09T00:15:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "verify_ssl": { 2024-05-09T00:15:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "verify_ssl", 2024-05-09T00:15:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.980 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "true", 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "insights", 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.981 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.982 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.983 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.984 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.985 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.985 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.985 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.985 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.985 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.985 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.985 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.985 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.985 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.985 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.985 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.985 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.985 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.985 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "iostat", 2024-05-09T00:15:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.988 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.988 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.988 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.988 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.988 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.988 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.988 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.988 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.988 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.988 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.988 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.988 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.988 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.989 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.989 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.989 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.989 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.989 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.989 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.989 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.989 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.989 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.989 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.989 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.989 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.989 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.990 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.990 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.990 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.990 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.990 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.990 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.990 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.990 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.990 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.990 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.990 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.990 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.990 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.991 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.991 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.991 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.991 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.991 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.991 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.991 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.991 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.991 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.991 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.991 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.991 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "k8sevents", 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:04.992 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_event_retention_days": { 2024-05-09T00:15:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ceph_event_retention_days", 2024-05-09T00:15:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-05-09T00:15:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-09T00:15:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.993 INFO:teuthology.orchestra.run.smithi081.stdout: "config_check_secs": { 2024-05-09T00:15:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_check_secs", 2024-05-09T00:15:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "10", 2024-05-09T00:15:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-09T00:15:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:04.995 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:04.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.995 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.995 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.995 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:04.995 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.995 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.995 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.995 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.995 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.995 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.995 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.995 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.995 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.996 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:04.997 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:04.998 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:04.998 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:04.998 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:04.998 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:04.998 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:04.998 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:04.998 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.998 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.998 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.998 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.998 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:04.998 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:04.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:04.999 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "localpool", 2024-05-09T00:15:05.000 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.000 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.000 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.000 INFO:teuthology.orchestra.run.smithi081.stdout: "failure_domain": { 2024-05-09T00:15:05.000 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "failure_domain", 2024-05-09T00:15:05.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.000 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.000 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.000 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "host", 2024-05-09T00:15:05.000 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.000 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.000 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.000 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "failure domain for any created local pool", 2024-05-09T00:15:05.000 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-09T00:15:05.001 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.001 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.001 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.001 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.001 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.001 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.001 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.001 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.001 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.001 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.001 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.001 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.002 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.002 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.002 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.002 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.002 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.002 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.002 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.002 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.002 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.002 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.002 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.002 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.003 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.003 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.003 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.003 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.003 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.003 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.003 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.003 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.003 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.003 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.003 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.003 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.004 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.004 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.004 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.004 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.004 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.004 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.004 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.004 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.004 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.004 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.004 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.004 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.004 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.004 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.005 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.005 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.005 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.005 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.005 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.005 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.006 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.006 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.006 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.006 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.006 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.006 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.006 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.006 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.006 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": { 2024-05-09T00:15:05.006 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_size", 2024-05-09T00:15:05.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.006 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.007 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.007 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.007 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.007 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.007 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default min_size for any created local pool", 2024-05-09T00:15:05.007 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-09T00:15:05.007 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.007 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.007 INFO:teuthology.orchestra.run.smithi081.stdout: "num_rep": { 2024-05-09T00:15:05.007 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "num_rep", 2024-05-09T00:15:05.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.007 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.007 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.008 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-05-09T00:15:05.008 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.008 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.008 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.008 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default replica count for any created local pool", 2024-05-09T00:15:05.008 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.008 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.008 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.008 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": { 2024-05-09T00:15:05.008 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_num", 2024-05-09T00:15:05.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.008 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.009 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.009 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "128", 2024-05-09T00:15:05.009 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.009 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.009 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.009 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default pg_num for any created local pool", 2024-05-09T00:15:05.009 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.009 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.009 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.009 INFO:teuthology.orchestra.run.smithi081.stdout: "prefix": { 2024-05-09T00:15:05.009 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prefix", 2024-05-09T00:15:05.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.009 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.010 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.010 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.010 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.010 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.010 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name prefix for any created local pool", 2024-05-09T00:15:05.010 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.010 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.010 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.010 INFO:teuthology.orchestra.run.smithi081.stdout: "subtree": { 2024-05-09T00:15:05.010 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subtree", 2024-05-09T00:15:05.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.010 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.011 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.011 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "rack", 2024-05-09T00:15:05.011 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.011 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.011 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.011 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-09T00:15:05.011 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-09T00:15:05.011 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.011 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.011 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mds_autoscaler", 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.012 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.013 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.014 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.014 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.014 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.014 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.014 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.014 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.014 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.014 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.014 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.014 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.014 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.014 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.015 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.015 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.015 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.015 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.015 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.015 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.015 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.015 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.015 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.015 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.015 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.016 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.016 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.016 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.016 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.016 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.016 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.016 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.016 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.016 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.016 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.016 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.017 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.017 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.017 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.017 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.017 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.017 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.017 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.017 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.017 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirroring", 2024-05-09T00:15:05.017 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.017 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.017 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.018 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.018 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.018 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.018 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.018 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.018 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.018 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.018 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.018 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.018 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.018 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.018 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.018 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.019 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.019 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.019 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.019 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.019 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.019 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.019 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.019 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.019 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.019 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.019 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.019 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.020 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "nfs", 2024-05-09T00:15:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.023 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.025 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.026 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.027 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "fail_fs": { 2024-05-09T00:15:05.028 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fail_fs", 2024-05-09T00:15:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-09T00:15:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.029 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.030 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.031 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.032 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.034 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.034 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.034 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.034 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.034 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.034 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.034 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.034 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.034 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.034 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.034 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.034 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator": { 2024-05-09T00:15:05.035 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-05-09T00:15:05.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.035 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.035 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.035 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.035 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.035 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.035 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.035 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-05-09T00:15:05.035 INFO:teuthology.orchestra.run.smithi081.stdout: "rook", 2024-05-09T00:15:05.035 INFO:teuthology.orchestra.run.smithi081.stdout: "test_orchestrator" 2024-05-09T00:15:05.035 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.035 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Orchestrator backend", 2024-05-09T00:15:05.035 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_perf_query", 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.036 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.037 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.038 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.038 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.038 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.038 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.038 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.038 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.038 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.038 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.038 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.038 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.038 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.038 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.039 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.039 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.039 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.039 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.039 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.039 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.039 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.039 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.039 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.039 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.039 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.039 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.040 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_support", 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.041 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.042 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.043 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.043 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.043 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.043 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.043 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.043 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.043 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.043 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.043 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.043 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.043 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.043 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.044 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.044 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.044 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.044 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.044 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.044 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.044 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.044 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.044 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.044 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.044 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.047 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_autoscaler", 2024-05-09T00:15:05.047 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.047 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.047 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.047 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.047 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.047 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.047 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.047 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.047 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.047 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.048 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.050 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.050 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.050 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.050 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.050 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.050 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.050 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.050 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.050 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.050 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.050 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.050 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.050 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.051 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.052 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.052 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.052 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.052 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:05.052 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:05.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.052 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.052 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.052 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:05.052 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.052 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.052 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.053 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.053 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.053 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.053 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.053 INFO:teuthology.orchestra.run.smithi081.stdout: "threshold": { 2024-05-09T00:15:05.053 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threshold", 2024-05-09T00:15:05.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:05.053 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.053 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-05-09T00:15:05.053 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1.0", 2024-05-09T00:15:05.053 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.053 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.054 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "scaling threshold", 2024-05-09T00:15:05.054 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-09T00:15:05.054 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.054 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.054 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.054 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "progress", 2024-05-09T00:15:05.054 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.054 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.054 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.054 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_pg_recovery_event": { 2024-05-09T00:15:05.054 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_pg_recovery_event", 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.055 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.056 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.056 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.056 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.056 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.056 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.056 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.056 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.056 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.056 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.056 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.056 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.056 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.056 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.057 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.057 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.057 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.057 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.057 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.057 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.057 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.057 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.057 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.057 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.057 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.057 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.057 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.058 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.058 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.058 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.058 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.058 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.058 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.058 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.058 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.058 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.058 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.059 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.059 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.059 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.059 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.059 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.059 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.059 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.059 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.059 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.059 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.059 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.059 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.059 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.061 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.061 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.061 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.061 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.061 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.061 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.061 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.061 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.061 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.061 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.061 INFO:teuthology.orchestra.run.smithi081.stdout: "max_completed_events": { 2024-05-09T00:15:05.061 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_completed_events", 2024-05-09T00:15:05.061 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.062 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.062 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "50", 2024-05-09T00:15:05.062 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.062 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.062 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.062 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "number of past completed events to remember", 2024-05-09T00:15:05.062 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.062 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.062 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.062 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:05.062 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long the module is going to sleep", 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus", 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "cache": { 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cache", 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.064 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.065 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.065 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.065 INFO:teuthology.orchestra.run.smithi081.stdout: "exclude_perf_counters": { 2024-05-09T00:15:05.065 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "exclude_perf_counters", 2024-05-09T00:15:05.065 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.065 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.065 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.065 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.065 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.065 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.065 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.065 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-09T00:15:05.065 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.066 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools": { 2024-05-09T00:15:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools", 2024-05-09T00:15:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "300", 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_interval": { 2024-05-09T00:15:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_interval", 2024-05-09T00:15:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15.0", 2024-05-09T00:15:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-05-09T00:15:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-05-09T00:15:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-05-09T00:15:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-09T00:15:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.074 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-05-09T00:15:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-05-09T00:15:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "9283", 2024-05-09T00:15:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-09T00:15:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.075 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "stale_cache_strategy": { 2024-05-09T00:15:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stale_cache_strategy", 2024-05-09T00:15:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "log", 2024-05-09T00:15:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.076 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "default", 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "default", 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "error" 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.077 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-05-09T00:15:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-05-09T00:15:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-05-09T00:15:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-05-09T00:15:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-05-09T00:15:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.078 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.079 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.080 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.080 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.080 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.080 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.080 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.080 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.080 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.080 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.080 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.080 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.080 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.080 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.080 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.080 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.081 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.081 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.081 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.081 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.081 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.081 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.081 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.081 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.081 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.081 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.081 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.081 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.081 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.083 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.083 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.083 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.083 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.083 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.083 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.083 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.083 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.083 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.083 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.083 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.083 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.084 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.084 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.084 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.084 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.084 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.084 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.084 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.084 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.084 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.084 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_snap_create": { 2024-05-09T00:15:05.084 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_snap_create", 2024-05-09T00:15:05.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.084 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: "mirror_snapshot_schedule": { 2024-05-09T00:15:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirror_snapshot_schedule", 2024-05-09T00:15:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.086 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.086 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.086 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.086 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.086 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.086 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.086 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.086 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.086 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.086 INFO:teuthology.orchestra.run.smithi081.stdout: "trash_purge_schedule": { 2024-05-09T00:15:05.086 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "trash_purge_schedule", 2024-05-09T00:15:05.086 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.086 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.087 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.087 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.087 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.087 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.087 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.087 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.087 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.087 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.087 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "restful", 2024-05-09T00:15:05.088 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.088 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.088 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.088 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_auth": { 2024-05-09T00:15:05.088 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_auth", 2024-05-09T00:15:05.088 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.088 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.088 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.088 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.088 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.088 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.088 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.088 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.088 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-05-09T00:15:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-05-09T00:15:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.090 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.091 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.091 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.091 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.091 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.091 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.091 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.091 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.091 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.091 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.091 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.091 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.091 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.092 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.093 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.094 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.094 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.094 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.094 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.094 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.094 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.094 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.094 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.094 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.094 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.094 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.095 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.096 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.096 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.096 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-05-09T00:15:05.096 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-05-09T00:15:05.096 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.096 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.096 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.096 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.096 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.096 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.096 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw", 2024-05-09T00:15:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.097 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.098 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.098 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.098 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.098 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.098 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.098 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.098 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.098 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.098 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.098 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.098 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.098 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.099 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.099 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.099 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.099 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.099 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.099 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.099 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.099 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.099 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.099 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.099 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.099 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.100 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.100 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.100 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.100 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.100 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.100 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.100 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.100 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.100 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.100 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.100 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.100 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.100 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rook", 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.103 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.104 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.105 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.105 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.105 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.105 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.105 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.105 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.105 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.105 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.105 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.105 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.105 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.105 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.106 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.106 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.106 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.106 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.106 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.106 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.106 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.106 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.106 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.106 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.106 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.106 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.106 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.106 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.107 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_class": { 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "storage_class", 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "local", 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.108 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.109 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "selftest", 2024-05-09T00:15:05.109 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.109 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.109 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.109 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.109 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.109 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.109 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.109 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.109 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.110 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.111 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.111 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.111 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.111 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.111 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.111 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.111 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.111 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.111 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.111 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.111 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.112 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.112 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.112 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.112 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.112 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.112 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.112 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.112 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.112 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.112 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.112 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.112 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.114 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.114 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.114 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.114 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.114 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.114 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.114 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.114 INFO:teuthology.orchestra.run.smithi081.stdout: "roption1": { 2024-05-09T00:15:05.114 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption1", 2024-05-09T00:15:05.114 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.114 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.114 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.114 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: "roption2": { 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption2", 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "xyz", 2024-05-09T00:15:05.115 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.116 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.116 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.116 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.116 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.116 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.116 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.116 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption1": { 2024-05-09T00:15:05.116 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption1", 2024-05-09T00:15:05.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.116 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.116 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.116 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.116 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption2": { 2024-05-09T00:15:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption2", 2024-05-09T00:15:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.117 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.118 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.118 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.118 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.118 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.118 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.118 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.118 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption3": { 2024-05-09T00:15:05.118 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption3", 2024-05-09T00:15:05.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:05.118 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.118 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.118 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption4": { 2024-05-09T00:15:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption4", 2024-05-09T00:15:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.120 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.120 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.120 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.120 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.120 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.120 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.120 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.120 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption5": { 2024-05-09T00:15:05.120 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption5", 2024-05-09T00:15:05.120 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.120 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.120 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.120 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption6": { 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption6", 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.121 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.122 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.122 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.122 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.122 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.122 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.122 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption7": { 2024-05-09T00:15:05.122 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption7", 2024-05-09T00:15:05.122 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.122 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.122 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.122 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.122 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-05-09T00:15:05.122 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "42", 2024-05-09T00:15:05.123 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.123 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.123 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.123 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.123 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.123 INFO:teuthology.orchestra.run.smithi081.stdout: "testkey": { 2024-05-09T00:15:05.123 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testkey", 2024-05-09T00:15:05.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.123 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.123 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.123 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.123 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.123 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.124 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.124 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.124 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.124 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.124 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.124 INFO:teuthology.orchestra.run.smithi081.stdout: "testlkey": { 2024-05-09T00:15:05.124 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testlkey", 2024-05-09T00:15:05.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.124 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.124 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.124 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.124 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.124 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.125 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.125 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.125 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.125 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.125 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.125 INFO:teuthology.orchestra.run.smithi081.stdout: "testnewline": { 2024-05-09T00:15:05.125 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testnewline", 2024-05-09T00:15:05.125 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.125 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.125 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.125 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.125 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.125 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.126 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.126 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.126 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.126 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.126 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.126 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.126 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.126 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-05-09T00:15:05.126 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.126 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.126 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.126 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_m_granularity": { 2024-05-09T00:15:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_m_granularity", 2024-05-09T00:15:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow minute scheduled snapshots", 2024-05-09T00:15:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.127 INFO:teuthology.orchestra.run.smithi081.stdout: "dump_on_update": { 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dump_on_update", 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "dump database to debug log on update", 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.128 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.129 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.130 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.131 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.132 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stats", 2024-05-09T00:15:05.133 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.134 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.135 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.136 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.137 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "status", 2024-05-09T00:15:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.139 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.140 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.141 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.142 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.143 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telegraf", 2024-05-09T00:15:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.144 INFO:teuthology.orchestra.run.smithi081.stdout: "address": { 2024-05-09T00:15:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "address", 2024-05-09T00:15:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-09T00:15:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15", 2024-05-09T00:15:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.147 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.148 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.149 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.151 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telemetry", 2024-05-09T00:15:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_basic": { 2024-05-09T00:15:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_basic", 2024-05-09T00:15:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-09T00:15:05.152 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_crash": { 2024-05-09T00:15:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_crash", 2024-05-09T00:15:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.153 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-09T00:15:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_device": { 2024-05-09T00:15:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_device", 2024-05-09T00:15:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.154 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-09T00:15:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_ident": { 2024-05-09T00:15:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_ident", 2024-05-09T00:15:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.155 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_perf": { 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_perf", 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-09T00:15:05.156 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "contact": { 2024-05-09T00:15:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "contact", 2024-05-09T00:15:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.157 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "description": { 2024-05-09T00:15:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "description", 2024-05-09T00:15:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.158 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "device_url": { 2024-05-09T00:15:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_url", 2024-05-09T00:15:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-09T00:15:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-05-09T00:15:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-05-09T00:15:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.160 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "24", 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "8", 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.161 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "last_opt_revision": { 2024-05-09T00:15:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "last_opt_revision", 2024-05-09T00:15:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1", 2024-05-09T00:15:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.162 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard": { 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard", 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard_description": { 2024-05-09T00:15:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard_description", 2024-05-09T00:15:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.164 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.165 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.166 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.167 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.168 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.169 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "organization": { 2024-05-09T00:15:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "organization", 2024-05-09T00:15:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.170 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "proxy": { 2024-05-09T00:15:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "proxy", 2024-05-09T00:15:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.171 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "url": { 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url", 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.172 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test_orchestrator", 2024-05-09T00:15:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.173 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.174 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.176 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.177 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-05-09T00:15:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.178 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.179 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.180 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.181 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.182 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.183 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_clones": { 2024-05-09T00:15:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_clones", 2024-05-09T00:15:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4", 2024-05-09T00:15:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-09T00:15:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.184 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_delay": { 2024-05-09T00:15:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_delay", 2024-05-09T00:15:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-09T00:15:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.185 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_no_wait": { 2024-05-09T00:15:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_no_wait", 2024-05-09T00:15:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-09T00:15:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.186 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix", 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "discovery_interval": { 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "discovery_interval", 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.187 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "100", 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "identifier": { 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "identifier", 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.189 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.190 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.192 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.194 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_host": { 2024-05-09T00:15:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_host", 2024-05-09T00:15:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.195 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_port": { 2024-05-09T00:15:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_port", 2024-05-09T00:15:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10051", 2024-05-09T00:15:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.196 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_sender": { 2024-05-09T00:15:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_sender", 2024-05-09T00:15:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-09T00:15:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.197 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-09T00:15:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "modules": [ 2024-05-09T00:15:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-05-09T00:15:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "dashboard", 2024-05-09T00:15:05.198 INFO:teuthology.orchestra.run.smithi081.stdout: "iostat", 2024-05-09T00:15:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "nfs", 2024-05-09T00:15:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "restful", 2024-05-09T00:15:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "snap_schedule" 2024-05-09T00:15:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "available_modules": [ 2024-05-09T00:15:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "alerts", 2024-05-09T00:15:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.199 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How frequently to reexamine health status", 2024-05-09T00:15:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.200 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.201 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.202 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.203 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.204 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_destination": { 2024-05-09T00:15:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_destination", 2024-05-09T00:15:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.205 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email address to send alerts to", 2024-05-09T00:15:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_from_name": { 2024-05-09T00:15:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_from_name", 2024-05-09T00:15:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.206 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "Ceph", 2024-05-09T00:15:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email From: name", 2024-05-09T00:15:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_host": { 2024-05-09T00:15:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_host", 2024-05-09T00:15:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.207 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP server", 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_password": { 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_password", 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.208 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Password to authenticate with", 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_port": { 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_port", 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.209 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "465", 2024-05-09T00:15:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP port", 2024-05-09T00:15:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_sender": { 2024-05-09T00:15:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_sender", 2024-05-09T00:15:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.210 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP envelope sender", 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_ssl": { 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_ssl", 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.211 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-09T00:15:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_user": { 2024-05-09T00:15:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_user", 2024-05-09T00:15:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "User to authenticate as", 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "balancer", 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.213 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "active": { 2024-05-09T00:15:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "active", 2024-05-09T00:15:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically balance PGs across cluster", 2024-05-09T00:15:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.214 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_time": { 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_time", 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0000", 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "beginning time of day to automatically balance", 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_weekday": { 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_weekday", 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.216 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_max_iterations": { 2024-05-09T00:15:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_max_iterations", 2024-05-09T00:15:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "25", 2024-05-09T00:15:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-05-09T00:15:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "250", 2024-05-09T00:15:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-09T00:15:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.217 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_metrics": { 2024-05-09T00:15:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_metrics", 2024-05-09T00:15:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "pgs,objects,bytes", 2024-05-09T00:15:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-09T00:15:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-09T00:15:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.218 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_step": { 2024-05-09T00:15:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_step", 2024-05-09T00:15:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.5", 2024-05-09T00:15:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0.001", 2024-05-09T00:15:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "0.999", 2024-05-09T00:15:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "aggressiveness of optimization", 2024-05-09T00:15:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-09T00:15:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.219 INFO:teuthology.orchestra.run.smithi081.stdout: "end_time": { 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_time", 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2359", 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ending time of day to automatically balance", 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "end_weekday": { 2024-05-09T00:15:05.220 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_weekday", 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.221 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.222 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.224 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.225 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "min_score": { 2024-05-09T00:15:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_score", 2024-05-09T00:15:05.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.227 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "upmap", 2024-05-09T00:15:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-compat", 2024-05-09T00:15:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "none", 2024-05-09T00:15:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap" 2024-05-09T00:15:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Balancer mode", 2024-05-09T00:15:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_ids": { 2024-05-09T00:15:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_ids", 2024-05-09T00:15:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-09T00:15:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-09T00:15:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.230 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_deviation": { 2024-05-09T00:15:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_deviation", 2024-05-09T00:15:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-05-09T00:15:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-05-09T00:15:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-09T00:15:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-09T00:15:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.231 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_optimizations": { 2024-05-09T00:15:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_optimizations", 2024-05-09T00:15:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-09T00:15:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.232 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm", 2024-05-09T00:15:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_down_multiplier": { 2024-05-09T00:15:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_down_multiplier", 2024-05-09T00:15:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.233 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-05-09T00:15:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-09T00:15:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_refresh_rate": { 2024-05-09T00:15:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_refresh_rate", 2024-05-09T00:15:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.234 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "20", 2024-05-09T00:15:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-09T00:15:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_starting_port": { 2024-05-09T00:15:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_starting_port", 2024-05-09T00:15:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.235 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4721", 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_ptrace": { 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_ptrace", 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.236 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-09T00:15:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-09T00:15:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_interval": { 2024-05-09T00:15:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_interval", 2024-05-09T00:15:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:05.237 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.238 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.238 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.238 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-09T00:15:05.238 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.238 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.238 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.238 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_memory_target_ratio": { 2024-05-09T00:15:05.238 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_memory_target_ratio", 2024-05-09T00:15:05.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:05.238 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.238 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.238 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.7", 2024-05-09T00:15:05.238 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.239 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.239 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.239 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-09T00:15:05.239 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.239 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.239 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.239 INFO:teuthology.orchestra.run.smithi081.stdout: "cgroups_split": { 2024-05-09T00:15:05.239 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cgroups_split", 2024-05-09T00:15:05.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.239 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.239 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "config_checks_enabled": { 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_checks_enabled", 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.240 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-09T00:15:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "config_dashboard": { 2024-05-09T00:15:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_dashboard", 2024-05-09T00:15:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.241 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-09T00:15:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_alertmanager": { 2024-05-09T00:15:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_alertmanager", 2024-05-09T00:15:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.242 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-09T00:15:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-05-09T00:15:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_base": { 2024-05-09T00:15:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_base", 2024-05-09T00:15:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.243 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-09T00:15:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Container image name, without the tag", 2024-05-09T00:15:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_elasticsearch": { 2024-05-09T00:15:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_elasticsearch", 2024-05-09T00:15:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-09T00:15:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "elasticsearch container image", 2024-05-09T00:15:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_grafana": { 2024-05-09T00:15:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_grafana", 2024-05-09T00:15:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.245 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-05-09T00:15:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-05-09T00:15:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_haproxy": { 2024-05-09T00:15:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_haproxy", 2024-05-09T00:15:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.246 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "HAproxy container image", 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_agent": { 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_agent", 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-09T00:15:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger agent container image", 2024-05-09T00:15:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_collector": { 2024-05-09T00:15:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_collector", 2024-05-09T00:15:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.248 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-09T00:15:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger collector container image", 2024-05-09T00:15:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_query": { 2024-05-09T00:15:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_query", 2024-05-09T00:15:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.249 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-09T00:15:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger query container image", 2024-05-09T00:15:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_keepalived": { 2024-05-09T00:15:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_keepalived", 2024-05-09T00:15:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.250 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-09T00:15:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Keepalived container image", 2024-05-09T00:15:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_loki": { 2024-05-09T00:15:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_loki", 2024-05-09T00:15:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.251 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Loki container image", 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_node_exporter": { 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_node_exporter", 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-09T00:15:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-05-09T00:15:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nvmeof": { 2024-05-09T00:15:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nvmeof", 2024-05-09T00:15:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.253 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-05-09T00:15:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nvme-of container image", 2024-05-09T00:15:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_prometheus": { 2024-05-09T00:15:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_prometheus", 2024-05-09T00:15:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.254 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_promtail": { 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_promtail", 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-09T00:15:05.255 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Promtail container image", 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_snmp_gateway": { 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_snmp_gateway", 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.256 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SNMP Gateway container image", 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: "container_init": { 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_init", 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.257 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.258 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Run podman/docker with `--init`", 2024-05-09T00:15:05.258 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.258 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.258 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.258 INFO:teuthology.orchestra.run.smithi081.stdout: "daemon_cache_timeout": { 2024-05-09T00:15:05.258 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "daemon_cache_timeout", 2024-05-09T00:15:05.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.258 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.258 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.258 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:05.258 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.258 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.258 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.259 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-09T00:15:05.259 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.259 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.259 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.259 INFO:teuthology.orchestra.run.smithi081.stdout: "default_cephadm_command_timeout": { 2024-05-09T00:15:05.259 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_cephadm_command_timeout", 2024-05-09T00:15:05.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.259 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.259 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.259 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "900", 2024-05-09T00:15:05.259 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.259 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.259 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: "default_registry": { 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_registry", 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io", 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.260 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-09T00:15:05.261 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.261 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.261 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.261 INFO:teuthology.orchestra.run.smithi081.stdout: "device_cache_timeout": { 2024-05-09T00:15:05.261 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_cache_timeout", 2024-05-09T00:15:05.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.261 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.261 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.261 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1800", 2024-05-09T00:15:05.261 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.261 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.261 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.261 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache device inventory", 2024-05-09T00:15:05.262 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.262 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.262 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.262 INFO:teuthology.orchestra.run.smithi081.stdout: "device_enhanced_scan": { 2024-05-09T00:15:05.262 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_enhanced_scan", 2024-05-09T00:15:05.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.262 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.262 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.262 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.262 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.262 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.262 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.262 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: "facts_cache_timeout": { 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "facts_cache_timeout", 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache host facts data", 2024-05-09T00:15:05.263 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: "host_check_interval": { 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "host_check_interval", 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to perform a host check", 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.264 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.265 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.265 INFO:teuthology.orchestra.run.smithi081.stdout: "hw_monitoring": { 2024-05-09T00:15:05.265 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hw_monitoring", 2024-05-09T00:15:05.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.265 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.265 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.265 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.265 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.265 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.265 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.265 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-09T00:15:05.265 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.265 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: "inventory_list_all": { 2024-05-09T00:15:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "inventory_list_all", 2024-05-09T00:15:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-09T00:15:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.266 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.267 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.268 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.268 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.268 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.268 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.268 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.268 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.268 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.268 INFO:teuthology.orchestra.run.smithi081.stdout: "log_refresh_metadata": { 2024-05-09T00:15:05.268 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_refresh_metadata", 2024-05-09T00:15:05.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.268 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.268 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.268 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.269 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.269 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.269 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.269 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-09T00:15:05.269 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.269 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.269 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.269 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.269 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.269 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.269 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.269 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-09T00:15:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.271 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.271 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.271 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.271 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.271 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.271 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.271 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.271 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.271 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.271 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.271 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.271 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.271 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.271 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.272 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.272 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.272 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.272 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.272 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.272 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.272 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.272 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.272 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.272 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.272 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.272 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.272 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.274 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-09T00:15:05.274 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-09T00:15:05.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.274 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.274 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.274 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "*", 2024-05-09T00:15:05.274 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.274 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.274 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.274 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-09T00:15:05.274 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.274 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.274 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: "max_count_per_host": { 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_count_per_host", 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of daemons per service per host", 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.275 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd_draining_count": { 2024-05-09T00:15:05.276 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_osd_draining_count", 2024-05-09T00:15:05.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.276 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.276 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.276 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:05.276 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.276 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.276 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.276 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-09T00:15:05.276 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.276 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.276 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.276 INFO:teuthology.orchestra.run.smithi081.stdout: "migration_current": { 2024-05-09T00:15:05.277 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "migration_current", 2024-05-09T00:15:05.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.277 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.277 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.277 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.277 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.277 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.277 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.277 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "internal - do not modify", 2024-05-09T00:15:05.277 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.277 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.277 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.277 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "root", 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm-package", 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: "root" 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "mode for remote execution of cephadm", 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.278 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.279 INFO:teuthology.orchestra.run.smithi081.stdout: "oob_default_addr": { 2024-05-09T00:15:05.279 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "oob_default_addr", 2024-05-09T00:15:05.279 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.279 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.279 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.279 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "169.254.1.1", 2024-05-09T00:15:05.279 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.279 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.279 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.279 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-09T00:15:05.279 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.279 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.279 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.280 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.280 INFO:teuthology.orchestra.run.smithi081.stdout: "prometheus_alerts_path": { 2024-05-09T00:15:05.280 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus_alerts_path", 2024-05-09T00:15:05.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.280 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.280 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.280 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-09T00:15:05.280 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.280 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.280 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.280 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-09T00:15:05.280 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.280 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.280 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_insecure": { 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_insecure", 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.282 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_password": { 2024-05-09T00:15:05.282 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_password", 2024-05-09T00:15:05.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.282 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.282 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.282 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.282 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.282 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.282 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.282 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-09T00:15:05.282 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.282 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.283 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.283 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.283 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_url": { 2024-05-09T00:15:05.283 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_url", 2024-05-09T00:15:05.283 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.283 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.283 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.283 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.283 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.283 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.283 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.283 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-09T00:15:05.283 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.283 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_username": { 2024-05-09T00:15:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_username", 2024-05-09T00:15:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-09T00:15:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.284 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.285 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.285 INFO:teuthology.orchestra.run.smithi081.stdout: "secure_monitoring_stack": { 2024-05-09T00:15:05.285 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secure_monitoring_stack", 2024-05-09T00:15:05.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.285 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.285 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.285 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.286 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.286 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.286 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.286 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-09T00:15:05.286 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.286 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.286 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.286 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.287 INFO:teuthology.orchestra.run.smithi081.stdout: "service_discovery_port": { 2024-05-09T00:15:05.287 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "service_discovery_port", 2024-05-09T00:15:05.287 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.287 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.287 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.287 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8765", 2024-05-09T00:15:05.287 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.287 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.287 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.287 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "cephadm service discovery port", 2024-05-09T00:15:05.287 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.287 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.287 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.288 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_config_file": { 2024-05-09T00:15:05.288 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_config_file", 2024-05-09T00:15:05.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.288 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.288 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.288 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.288 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.288 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.288 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.288 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-09T00:15:05.288 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.288 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.288 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: "use_agent": { 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_agent", 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.290 INFO:teuthology.orchestra.run.smithi081.stdout: "use_repo_digest": { 2024-05-09T00:15:05.290 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_repo_digest", 2024-05-09T00:15:05.290 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.290 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.290 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.290 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.290 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.290 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.290 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.290 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-09T00:15:05.290 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.290 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.291 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_failed_host_check": { 2024-05-09T00:15:05.291 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_failed_host_check", 2024-05-09T00:15:05.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.291 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.291 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.291 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.291 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.291 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.291 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.291 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if the host check fails", 2024-05-09T00:15:05.291 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.291 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_daemons": { 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_daemons", 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.292 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.293 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_hosts": { 2024-05-09T00:15:05.293 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_hosts", 2024-05-09T00:15:05.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.293 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.293 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.293 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.293 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.293 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.293 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-09T00:15:05.293 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.293 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.293 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.294 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.294 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.294 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crash", 2024-05-09T00:15:05.294 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.294 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.294 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.294 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.294 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.294 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.294 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.295 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.296 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.297 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.297 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.297 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.297 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.297 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.297 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.297 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.297 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.297 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.297 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.297 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.297 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.297 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.297 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.299 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.299 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.299 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.299 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.299 INFO:teuthology.orchestra.run.smithi081.stdout: "retain_interval": { 2024-05-09T00:15:05.299 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retain_interval", 2024-05-09T00:15:05.299 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.299 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.299 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.299 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "31536000", 2024-05-09T00:15:05.299 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.299 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.299 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.299 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_recent_interval": { 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_recent_interval", 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1209600", 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-09T00:15:05.300 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dashboard", 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.301 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_HOST": { 2024-05-09T00:15:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-09T00:15:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.302 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_ENABLED": { 2024-05-09T00:15:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_ENABLED", 2024-05-09T00:15:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.305 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.305 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.305 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.305 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.305 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.305 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.305 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-09T00:15:05.305 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-09T00:15:05.305 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.305 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.305 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.305 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.305 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.306 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.306 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.306 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.306 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.306 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.306 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.306 INFO:teuthology.orchestra.run.smithi081.stdout: "ENABLE_BROWSABLE_API": { 2024-05-09T00:15:05.306 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-09T00:15:05.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.306 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.306 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.306 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.306 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.308 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.309 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.310 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.310 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.310 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.310 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-09T00:15:05.310 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-09T00:15:05.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.310 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.310 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.310 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.310 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.310 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.310 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.311 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.311 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.311 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.311 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.311 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-09T00:15:05.311 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-09T00:15:05.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.311 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.311 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.311 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.311 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.311 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.311 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.312 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.312 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.312 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.312 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.312 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-09T00:15:05.312 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-09T00:15:05.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.312 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.312 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.312 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.312 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.312 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.312 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.313 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.314 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.314 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.314 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.314 INFO:teuthology.orchestra.run.smithi081.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-09T00:15:05.314 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-09T00:15:05.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.314 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.314 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.314 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.314 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.314 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.314 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.315 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.315 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.315 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.315 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.315 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_PASSWORD": { 2024-05-09T00:15:05.315 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-09T00:15:05.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.315 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.315 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.315 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-05-09T00:15:05.315 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.316 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.316 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.316 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.316 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.316 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.316 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.316 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-09T00:15:05.316 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-09T00:15:05.316 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.316 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.316 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.316 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_URL": { 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_URL", 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.317 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.318 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.318 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.318 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.318 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.318 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.318 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.318 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_USERNAME": { 2024-05-09T00:15:05.318 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-09T00:15:05.318 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.318 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.318 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.318 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-05-09T00:15:05.319 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.319 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.319 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.319 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.319 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.319 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.319 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.319 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-09T00:15:05.319 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-09T00:15:05.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.319 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.319 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.319 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-09T00:15:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-09T00:15:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.320 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-09T00:15:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-09T00:15:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.321 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.322 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_HOST": { 2024-05-09T00:15:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-09T00:15:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-09T00:15:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-09T00:15:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.324 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-09T00:15:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-09T00:15:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.325 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-09T00:15:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-09T00:15:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.326 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-09T00:15:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-09T00:15:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.327 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-09T00:15:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-09T00:15:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.328 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-09T00:15:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-09T00:15:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.329 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-09T00:15:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-09T00:15:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.330 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-09T00:15:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-09T00:15:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.331 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_ENABLED": { 2024-05-09T00:15:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-09T00:15:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.332 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-09T00:15:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-09T00:15:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-09T00:15:05.333 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.334 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.334 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.334 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.334 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.334 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.334 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.334 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-09T00:15:05.334 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-09T00:15:05.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.334 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.334 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.334 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:05.335 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.335 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.335 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.335 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.335 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.335 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.335 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.335 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-09T00:15:05.335 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-09T00:15:05.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.335 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.335 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.335 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8", 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "45", 2024-05-09T00:15:05.336 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ACCESS_KEY": { 2024-05-09T00:15:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-09T00:15:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.337 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.338 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.338 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.338 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.338 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.338 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.338 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.338 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-09T00:15:05.338 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-09T00:15:05.338 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.338 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.338 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.338 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-05-09T00:15:05.338 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SECRET_KEY": { 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.339 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SSL_VERIFY": { 2024-05-09T00:15:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-09T00:15:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.340 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: "UNSAFE_TLS_v1_2": { 2024-05-09T00:15:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-09T00:15:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.341 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.342 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.342 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.342 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.342 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.342 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.342 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-09T00:15:05.342 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-09T00:15:05.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.342 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.342 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.342 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:05.342 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.343 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.344 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.345 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.345 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.345 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.345 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.345 INFO:teuthology.orchestra.run.smithi081.stdout: "cross_origin_url": { 2024-05-09T00:15:05.345 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cross_origin_url", 2024-05-09T00:15:05.345 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.345 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.345 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.345 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.345 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.345 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.345 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.346 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.346 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.346 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.346 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.346 INFO:teuthology.orchestra.run.smithi081.stdout: "crt_file": { 2024-05-09T00:15:05.346 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crt_file", 2024-05-09T00:15:05.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.346 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.346 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.346 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.346 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: "debug": { 2024-05-09T00:15:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "debug", 2024-05-09T00:15:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable/disable debug options", 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: "jwt_token_ttl": { 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "jwt_token_ttl", 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "28800", 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.348 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-05-09T00:15:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-05-09T00:15:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.350 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.350 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.350 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.350 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.350 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.350 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.350 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.350 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.350 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.350 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.350 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.351 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.352 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.352 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.352 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.352 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.352 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.352 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.352 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.352 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.352 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.352 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.352 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.352 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.353 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.354 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.354 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.354 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.354 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.354 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.354 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.354 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.354 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.354 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.354 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.354 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.354 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.355 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.355 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.355 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.355 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.355 INFO:teuthology.orchestra.run.smithi081.stdout: "motd": { 2024-05-09T00:15:05.355 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "motd", 2024-05-09T00:15:05.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.355 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.355 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.355 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.355 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.355 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.355 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.356 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "The message of the day", 2024-05-09T00:15:05.356 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.356 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.356 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.356 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_resolve_ip_addr": { 2024-05-09T00:15:05.356 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "redirect_resolve_ip_addr", 2024-05-09T00:15:05.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.356 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.356 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.356 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.356 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.356 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.356 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.357 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.357 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.357 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.357 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.357 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-05-09T00:15:05.357 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-05-09T00:15:05.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.357 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.357 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.357 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-05-09T00:15:05.357 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.357 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.357 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.358 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.358 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.358 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.358 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.358 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-05-09T00:15:05.358 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-05-09T00:15:05.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.358 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.358 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.358 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8080", 2024-05-09T00:15:05.358 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.358 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.358 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.359 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.359 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.359 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.359 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.359 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-05-09T00:15:05.359 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-05-09T00:15:05.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.359 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.359 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.359 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.359 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.359 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.359 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl_server_port": { 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl_server_port", 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8443", 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.360 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.361 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.361 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.361 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-05-09T00:15:05.361 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-05-09T00:15:05.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.361 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.361 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.361 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "redirect", 2024-05-09T00:15:05.361 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.361 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.361 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.361 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.361 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect" 2024-05-09T00:15:05.362 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.362 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.362 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.362 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.362 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.362 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-05-09T00:15:05.362 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-05-09T00:15:05.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.362 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.362 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.362 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-05-09T00:15:05.362 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-05-09T00:15:05.363 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-05-09T00:15:05.363 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.363 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.363 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.363 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.363 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.363 INFO:teuthology.orchestra.run.smithi081.stdout: "url_prefix": { 2024-05-09T00:15:05.363 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url_prefix", 2024-05-09T00:15:05.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.363 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.363 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.363 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.363 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.364 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_monitoring": { 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_monitoring", 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "monitor device health metrics", 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.365 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.366 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.366 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.366 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.366 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.366 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.366 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.366 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.366 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.366 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.366 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.366 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.366 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.366 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.367 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.367 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.367 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.367 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.367 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.367 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.367 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.367 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.367 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.367 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.367 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.367 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.368 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.369 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.370 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.370 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.370 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.370 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.370 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.370 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.370 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.370 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.370 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.370 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.370 INFO:teuthology.orchestra.run.smithi081.stdout: "mark_out_threshold": { 2024-05-09T00:15:05.370 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mark_out_threshold", 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2419200", 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": { 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_name", 2024-05-09T00:15:05.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "device_health_metrics", 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: "retention_period": { 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retention_period", 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.372 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.373 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.373 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15552000", 2024-05-09T00:15:05.373 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.373 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.373 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.373 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain device health metrics", 2024-05-09T00:15:05.373 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.373 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.373 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.373 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_frequency": { 2024-05-09T00:15:05.373 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_frequency", 2024-05-09T00:15:05.373 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.373 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-05-09T00:15:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-09T00:15:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: "self_heal": { 2024-05-09T00:15:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "self_heal", 2024-05-09T00:15:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.374 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.375 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and check device health", 2024-05-09T00:15:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_threshold": { 2024-05-09T00:15:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_threshold", 2024-05-09T00:15:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.376 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7257600", 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "diskprediction_local", 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.377 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.378 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.378 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.378 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.378 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.378 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.378 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.378 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.378 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.378 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.378 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.378 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.378 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.378 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.379 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.379 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.379 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.379 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.379 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.379 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.379 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.379 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.379 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.379 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.379 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.379 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.380 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.382 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "predict_interval": { 2024-05-09T00:15:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predict_interval", 2024-05-09T00:15:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-05-09T00:15:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.383 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "predictor_model": { 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predictor_model", 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "prophetstor", 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.384 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-05-09T00:15:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.385 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "influx", 2024-05-09T00:15:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": false, 2024-05-09T00:15:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "influxdb python module not found", 2024-05-09T00:15:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: "batch_size": { 2024-05-09T00:15:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "batch_size", 2024-05-09T00:15:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.386 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5000", 2024-05-09T00:15:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-09T00:15:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "database": { 2024-05-09T00:15:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "database", 2024-05-09T00:15:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.387 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "ceph", 2024-05-09T00:15:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-09T00:15:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": { 2024-05-09T00:15:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hostname", 2024-05-09T00:15:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.388 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server hostname", 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.389 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "30", 2024-05-09T00:15:05.390 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "5", 2024-05-09T00:15:05.390 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.390 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.390 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-09T00:15:05.390 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.390 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.390 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.390 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.390 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.390 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.390 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.390 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.393 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.394 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.395 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.395 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.395 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.395 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.395 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.395 INFO:teuthology.orchestra.run.smithi081.stdout: "password": { 2024-05-09T00:15:05.395 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "password", 2024-05-09T00:15:05.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.395 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.396 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.396 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.396 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.396 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.396 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.396 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "password of InfluxDB server user", 2024-05-09T00:15:05.396 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.396 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.396 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.396 INFO:teuthology.orchestra.run.smithi081.stdout: "port": { 2024-05-09T00:15:05.396 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "port", 2024-05-09T00:15:05.396 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.396 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8086", 2024-05-09T00:15:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server port", 2024-05-09T00:15:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-05-09T00:15:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-05-09T00:15:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.397 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "false", 2024-05-09T00:15:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T00:15:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "threads": { 2024-05-09T00:15:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threads", 2024-05-09T00:15:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.398 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-05-09T00:15:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-05-09T00:15:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "32", 2024-05-09T00:15:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-09T00:15:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "username": { 2024-05-09T00:15:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "username", 2024-05-09T00:15:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.399 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "username of InfluxDB server user", 2024-05-09T00:15:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "verify_ssl": { 2024-05-09T00:15:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "verify_ssl", 2024-05-09T00:15:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.400 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "true", 2024-05-09T00:15:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-09T00:15:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.401 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "insights", 2024-05-09T00:15:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.402 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.403 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.405 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.406 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "iostat", 2024-05-09T00:15:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.407 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.409 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.410 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.411 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.412 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.412 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.412 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.412 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.412 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.412 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.412 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "k8sevents", 2024-05-09T00:15:05.412 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.412 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.412 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.413 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_event_retention_days": { 2024-05-09T00:15:05.413 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ceph_event_retention_days", 2024-05-09T00:15:05.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.413 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.413 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.413 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-05-09T00:15:05.413 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.413 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.413 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.413 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-09T00:15:05.413 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.413 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.413 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: "config_check_secs": { 2024-05-09T00:15:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_check_secs", 2024-05-09T00:15:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "10", 2024-05-09T00:15:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-09T00:15:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.415 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.415 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.415 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.415 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.415 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.415 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.415 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.415 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.415 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.415 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.415 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.415 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.415 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.416 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.416 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.416 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.416 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.416 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.416 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.416 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.416 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.416 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.416 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.416 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.416 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.417 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.418 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.418 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.418 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.418 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.418 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.418 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.418 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.418 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.418 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.418 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.418 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.418 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "localpool", 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: "failure_domain": { 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "failure_domain", 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "host", 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.420 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "failure domain for any created local pool", 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.421 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.422 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.422 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.422 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.422 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.422 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.422 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.422 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.422 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.422 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.422 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.422 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.422 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.423 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.424 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": { 2024-05-09T00:15:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_size", 2024-05-09T00:15:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default min_size for any created local pool", 2024-05-09T00:15:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-09T00:15:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: "num_rep": { 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "num_rep", 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default replica count for any created local pool", 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": { 2024-05-09T00:15:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_num", 2024-05-09T00:15:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "128", 2024-05-09T00:15:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default pg_num for any created local pool", 2024-05-09T00:15:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: "prefix": { 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prefix", 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name prefix for any created local pool", 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: "subtree": { 2024-05-09T00:15:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subtree", 2024-05-09T00:15:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "rack", 2024-05-09T00:15:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-09T00:15:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-09T00:15:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mds_autoscaler", 2024-05-09T00:15:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirroring", 2024-05-09T00:15:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.440 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "nfs", 2024-05-09T00:15:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.442 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.443 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.444 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.445 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.445 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.445 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.445 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.445 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.445 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.445 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.445 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.445 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.445 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.445 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.445 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.445 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.445 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.446 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.446 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.446 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.446 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.446 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.446 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.446 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.446 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.446 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.446 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.446 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.446 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: "fail_fs": { 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fail_fs", 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.447 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.448 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.448 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.448 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-09T00:15:05.448 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.448 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.448 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.448 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.448 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.448 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.448 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.448 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.448 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.449 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.450 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.450 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.450 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.450 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.450 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.450 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.450 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.450 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.450 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.450 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.450 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.450 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.451 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.452 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator": { 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "rook", 2024-05-09T00:15:05.453 INFO:teuthology.orchestra.run.smithi081.stdout: "test_orchestrator" 2024-05-09T00:15:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Orchestrator backend", 2024-05-09T00:15:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_perf_query", 2024-05-09T00:15:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.454 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.455 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.456 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.457 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.458 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.459 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_support", 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.460 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.463 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.464 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_autoscaler", 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.465 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.466 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.467 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.468 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.469 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.470 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "threshold": { 2024-05-09T00:15:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threshold", 2024-05-09T00:15:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.471 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1.0", 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "scaling threshold", 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "progress", 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.472 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_pg_recovery_event": { 2024-05-09T00:15:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_pg_recovery_event", 2024-05-09T00:15:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-09T00:15:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.473 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-05-09T00:15:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-05-09T00:15:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.474 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.475 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.476 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.477 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "max_completed_events": { 2024-05-09T00:15:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_completed_events", 2024-05-09T00:15:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "50", 2024-05-09T00:15:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "number of past completed events to remember", 2024-05-09T00:15:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.480 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-05-09T00:15:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-05-09T00:15:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-05-09T00:15:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long the module is going to sleep", 2024-05-09T00:15:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.481 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus", 2024-05-09T00:15:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "cache": { 2024-05-09T00:15:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cache", 2024-05-09T00:15:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.482 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "exclude_perf_counters": { 2024-05-09T00:15:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "exclude_perf_counters", 2024-05-09T00:15:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.483 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-09T00:15:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-09T00:15:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.484 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.486 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.487 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.488 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools": { 2024-05-09T00:15:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools", 2024-05-09T00:15:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.489 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-09T00:15:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-09T00:15:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "300", 2024-05-09T00:15:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.490 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_interval": { 2024-05-09T00:15:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_interval", 2024-05-09T00:15:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15.0", 2024-05-09T00:15:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.491 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-05-09T00:15:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-05-09T00:15:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-05-09T00:15:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.492 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-09T00:15:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-05-09T00:15:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-05-09T00:15:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "9283", 2024-05-09T00:15:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.493 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-09T00:15:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "stale_cache_strategy": { 2024-05-09T00:15:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stale_cache_strategy", 2024-05-09T00:15:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "log", 2024-05-09T00:15:05.494 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "default", 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.495 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "default", 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "error" 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-05-09T00:15:05.496 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-05-09T00:15:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-05-09T00:15:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-05-09T00:15:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.497 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.498 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.499 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.502 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_snap_create": { 2024-05-09T00:15:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_snap_create", 2024-05-09T00:15:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-05-09T00:15:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.503 INFO:teuthology.orchestra.run.smithi081.stdout: "mirror_snapshot_schedule": { 2024-05-09T00:15:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirror_snapshot_schedule", 2024-05-09T00:15:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.504 INFO:teuthology.orchestra.run.smithi081.stdout: "trash_purge_schedule": { 2024-05-09T00:15:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "trash_purge_schedule", 2024-05-09T00:15:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.505 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "restful", 2024-05-09T00:15:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_auth": { 2024-05-09T00:15:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_auth", 2024-05-09T00:15:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.506 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.507 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.508 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.509 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.510 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.512 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-05-09T00:15:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-05-09T00:15:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.513 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-05-09T00:15:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-05-09T00:15:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.514 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw", 2024-05-09T00:15:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.515 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.517 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.518 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.519 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rook", 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.520 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.521 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.522 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.523 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.524 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_class": { 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "storage_class", 2024-05-09T00:15:05.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "local", 2024-05-09T00:15:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-09T00:15:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "selftest", 2024-05-09T00:15:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.527 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.528 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.529 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.530 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.531 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "roption1": { 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption1", 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.532 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "roption2": { 2024-05-09T00:15:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption2", 2024-05-09T00:15:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "xyz", 2024-05-09T00:15:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.533 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption1": { 2024-05-09T00:15:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption1", 2024-05-09T00:15:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.534 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption2": { 2024-05-09T00:15:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption2", 2024-05-09T00:15:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.535 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption3": { 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption3", 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.536 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption4": { 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption4", 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.537 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption5": { 2024-05-09T00:15:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption5", 2024-05-09T00:15:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.538 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption6": { 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption6", 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption7": { 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption7", 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "42", 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.540 INFO:teuthology.orchestra.run.smithi081.stdout: "testkey": { 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testkey", 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "testlkey": { 2024-05-09T00:15:05.541 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testlkey", 2024-05-09T00:15:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "testnewline": { 2024-05-09T00:15:05.542 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testnewline", 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-05-09T00:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_m_granularity": { 2024-05-09T00:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_m_granularity", 2024-05-09T00:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.544 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow minute scheduled snapshots", 2024-05-09T00:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "dump_on_update": { 2024-05-09T00:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dump_on_update", 2024-05-09T00:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.545 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "dump database to debug log on update", 2024-05-09T00:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.546 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.548 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.549 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.550 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stats", 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.551 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.552 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.553 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.554 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.555 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "status", 2024-05-09T00:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.556 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.557 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.558 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.559 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.560 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telegraf", 2024-05-09T00:15:05.561 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "address": { 2024-05-09T00:15:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "address", 2024-05-09T00:15:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-09T00:15:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15", 2024-05-09T00:15:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.565 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.565 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.565 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.565 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.565 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.565 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.565 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.565 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.565 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.565 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.565 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.566 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.566 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.566 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.566 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.566 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.566 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.566 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.566 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.566 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.566 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.567 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.567 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.567 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.567 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.567 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.567 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.567 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.567 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.567 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.567 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.567 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.567 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.567 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.567 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.568 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.568 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.568 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.568 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.568 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.568 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.568 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.568 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.568 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.568 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.568 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telemetry", 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_basic": { 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_basic", 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.569 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.570 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.570 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.570 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.570 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.570 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-09T00:15:05.570 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.570 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.570 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.570 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_crash": { 2024-05-09T00:15:05.570 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_crash", 2024-05-09T00:15:05.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.570 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.570 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.571 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.571 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.571 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.571 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.571 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-09T00:15:05.571 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.571 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.571 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_device": { 2024-05-09T00:15:05.571 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_device", 2024-05-09T00:15:05.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.571 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_ident": { 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_ident", 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.572 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_perf": { 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_perf", 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.573 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.574 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.574 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-09T00:15:05.574 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.574 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.574 INFO:teuthology.orchestra.run.smithi081.stdout: "contact": { 2024-05-09T00:15:05.574 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "contact", 2024-05-09T00:15:05.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.574 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.574 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.574 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.575 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.575 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.575 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.575 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.575 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.575 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.575 INFO:teuthology.orchestra.run.smithi081.stdout: "description": { 2024-05-09T00:15:05.575 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "description", 2024-05-09T00:15:05.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.575 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.575 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.575 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "device_url": { 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_url", 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.576 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.577 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.577 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.577 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.577 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.577 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-05-09T00:15:05.577 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-05-09T00:15:05.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.577 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.577 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.577 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.577 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.577 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "24", 2024-05-09T00:15:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "8", 2024-05-09T00:15:05.578 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.579 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.579 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.579 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.579 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.579 INFO:teuthology.orchestra.run.smithi081.stdout: "last_opt_revision": { 2024-05-09T00:15:05.579 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "last_opt_revision", 2024-05-09T00:15:05.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.579 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.579 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.579 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1", 2024-05-09T00:15:05.579 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.579 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard": { 2024-05-09T00:15:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard", 2024-05-09T00:15:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.580 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard_description": { 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard_description", 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.581 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.582 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.582 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.582 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.582 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.582 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.582 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.582 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.582 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.582 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.582 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.583 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.584 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.584 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.584 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.584 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.584 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.584 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.584 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.584 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.584 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.584 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.585 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.585 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.585 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.585 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.585 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.585 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.585 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.585 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.585 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.585 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.585 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.585 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.586 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.586 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.586 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.586 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.586 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.586 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.586 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.586 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.586 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.586 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.587 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.587 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.587 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.587 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.587 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.587 INFO:teuthology.orchestra.run.smithi081.stdout: "organization": { 2024-05-09T00:15:05.587 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "organization", 2024-05-09T00:15:05.587 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.587 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.587 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.587 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.587 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.587 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.588 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.588 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.588 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.588 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.588 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.588 INFO:teuthology.orchestra.run.smithi081.stdout: "proxy": { 2024-05-09T00:15:05.588 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "proxy", 2024-05-09T00:15:05.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.588 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.588 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.588 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.588 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "url": { 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url", 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.589 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test_orchestrator", 2024-05-09T00:15:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.591 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.592 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.593 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.594 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.594 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.594 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.594 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.594 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.594 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.594 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.594 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.594 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.594 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.594 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.595 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.595 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.595 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.595 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.595 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.595 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.595 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-05-09T00:15:05.595 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.595 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.595 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.596 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.597 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.598 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.598 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.598 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.598 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.598 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.598 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.598 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.598 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.598 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.598 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.598 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.599 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.600 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.600 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.600 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.600 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.600 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.600 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.600 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.600 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.600 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.600 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.600 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.601 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_clones": { 2024-05-09T00:15:05.601 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_clones", 2024-05-09T00:15:05.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.601 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.601 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4", 2024-05-09T00:15:05.601 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.601 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.601 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.601 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-09T00:15:05.601 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.601 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.601 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_delay": { 2024-05-09T00:15:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_delay", 2024-05-09T00:15:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-05-09T00:15:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-09T00:15:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.603 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_no_wait": { 2024-05-09T00:15:05.603 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_no_wait", 2024-05-09T00:15:05.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.603 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.603 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.603 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-05-09T00:15:05.603 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.603 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.603 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.603 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-09T00:15:05.603 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.603 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix", 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: "discovery_interval": { 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "discovery_interval", 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "100", 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.604 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.605 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.605 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.605 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.605 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.605 INFO:teuthology.orchestra.run.smithi081.stdout: "identifier": { 2024-05-09T00:15:05.605 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "identifier", 2024-05-09T00:15:05.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.605 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.605 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.605 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.605 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.605 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.605 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-05-09T00:15:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-05-09T00:15:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-05-09T00:15:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-05-09T00:15:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.606 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.607 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.607 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.607 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.607 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.607 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-05-09T00:15:05.607 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-05-09T00:15:05.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.607 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.607 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.607 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.607 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.607 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.607 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-05-09T00:15:05.608 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-05-09T00:15:05.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.610 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.610 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.610 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-05-09T00:15:05.610 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.610 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.610 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-05-09T00:15:05.610 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-05-09T00:15:05.610 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-05-09T00:15:05.610 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-05-09T00:15:05.610 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-05-09T00:15:05.610 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-05-09T00:15:05.610 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-05-09T00:15:05.610 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.610 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.611 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.611 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.611 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.611 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-05-09T00:15:05.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-05-09T00:15:05.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-05-09T00:15:05.611 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.611 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-05-09T00:15:05.611 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-05-09T00:15:05.611 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.611 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.611 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.611 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_host": { 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_host", 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.612 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.613 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.613 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_port": { 2024-05-09T00:15:05.613 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_port", 2024-05-09T00:15:05.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-05-09T00:15:05.613 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.613 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10051", 2024-05-09T00:15:05.613 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.613 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.613 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.613 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.613 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_sender": { 2024-05-09T00:15:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_sender", 2024-05-09T00:15:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-05-09T00:15:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-05-09T00:15:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-05-09T00:15:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-09T00:15:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-05-09T00:15:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-05-09T00:15:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-05-09T00:15:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-05-09T00:15:05.614 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: "services": { 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: "dashboard": "https://172.21.15.81:8443/" 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: "always_on_modules": { 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus": [ 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-05-09T00:15:05.615 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific": [ 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-05-09T00:15:05.616 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy": [ 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-05-09T00:15:05.617 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-05-09T00:15:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-05-09T00:15:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: "reef": [ 2024-05-09T00:15:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-05-09T00:15:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-05-09T00:15:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-05-09T00:15:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-05-09T00:15:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-05-09T00:15:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-05-09T00:15:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-05-09T00:15:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-05-09T00:15:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-05-09T00:15:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-05-09T00:15:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-09T00:15:05.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.619 INFO:teuthology.orchestra.run.smithi081.stdout: "last_failure_osd_epoch": 82, 2024-05-09T00:15:05.619 INFO:teuthology.orchestra.run.smithi081.stdout: "active_clients": [ 2024-05-09T00:15:05.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.619 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-05-09T00:15:05.619 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-09T00:15:05.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.619 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-09T00:15:05.619 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-05-09T00:15:05.619 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2493797821 2024-05-09T00:15:05.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.619 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-09T00:15:05.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.619 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "libcephsqlite", 2024-05-09T00:15:05.620 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-09T00:15:05.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-09T00:15:05.620 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-05-09T00:15:05.620 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3181731607 2024-05-09T00:15:05.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.620 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-09T00:15:05.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.620 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-05-09T00:15:05.620 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-09T00:15:05.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-09T00:15:05.620 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 537671991 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3362891503 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-05-09T00:15:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-09T00:15:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-09T00:15:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-05-09T00:15:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2846148379 2024-05-09T00:15:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-09T00:15:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-05-09T00:15:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-05-09T00:15:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-05-09T00:15:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-05-09T00:15:05.623 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:0", 2024-05-09T00:15:05.623 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 703326033 2024-05-09T00:15:05.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.623 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-09T00:15:05.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:05.623 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-05-09T00:15:05.623 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:15:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.320+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/1885429571 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa28c0a1290 msgr2=0x7fa28c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.320+0000 7fa2a2e5b700 1 --2- 172.21.15.81:0/1885429571 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa28c0a1290 0x7fa28c0a3750 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa29000b5c0 tx=0x7fa290005960 comp rx=0 tx=0).stop 2024-05-09T00:15:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.320+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/1885429571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa29c106190 msgr2=0x7fa29c197890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.320+0000 7fa2a2e5b700 1 --2- 172.21.15.81:0/1885429571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa29c106190 0x7fa29c197890 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fa28800d980 tx=0x7fa28800dc90 comp rx=0 tx=0).stop 2024-05-09T00:15:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.320+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/1885429571 shutdown_connections 2024-05-09T00:15:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.320+0000 7fa2a2e5b700 1 --2- 172.21.15.81:0/1885429571 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fa28c0a1290 0x7fa28c0a3750 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.320+0000 7fa2a2e5b700 1 --2- 172.21.15.81:0/1885429571 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fa29c101070 0x7fa29c197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.320+0000 7fa2a2e5b700 1 --2- 172.21.15.81:0/1885429571 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa29c19bbe0 0x7fa29c19c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.320+0000 7fa2a2e5b700 1 --2- 172.21.15.81:0/1885429571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa29c106190 0x7fa29c197890 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.320+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/1885429571 >> 172.21.15.81:0/1885429571 conn(0x7fa29c0fc950 msgr2=0x7fa29c0fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.320+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/1885429571 shutdown_connections 2024-05-09T00:15:05.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:04.320+0000 7fa2a2e5b700 1 -- 172.21.15.81:0/1885429571 wait complete. 2024-05-09T00:15:05.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:03 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/109127878' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:15:05.625 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:03 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/192928171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:15:05.626 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:03 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2707737984' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:15:05.626 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:04 smithi171 ceph-mon[47351]: pgmap v376: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-09T00:15:05.626 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:04 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1885429571' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-09T00:15:05.626 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:04 smithi150 ceph-mon[46187]: pgmap v376: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-09T00:15:05.626 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:04 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1885429571' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-09T00:15:05.670 DEBUG:tasks.check_counter:Getting stats from a 2024-05-09T00:15:05.671 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-09T00:15:05.671 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:04 smithi081 ceph-mon[42474]: pgmap v376: 97 pgs: 97 active+clean; 3.1 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-09T00:15:05.671 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:04 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1885429571' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-09T00:15:05.903 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:15:07.007 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:15:07.007 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T00:15:07.007 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 0, 2024-05-09T00:15:07.007 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2, 2024-05-09T00:15:07.008 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 0, 2024-05-09T00:15:07.008 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 0, 2024-05-09T00:15:07.008 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-05-09T00:15:07.008 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 0, 2024-05-09T00:15:07.008 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.001495976, 2024-05-09T00:15:07.008 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000000000, 2024-05-09T00:15:07.008 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.000296015, 2024-05-09T00:15:07.008 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T00:15:07.008 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:07.008 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:07.008 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:07.008 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:07.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:07.009 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:07.009 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:07.009 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:07.009 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:07.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:07.009 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T00:15:07.009 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T00:15:07.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:07.009 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T00:15:07.009 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 227, 2024-05-09T00:15:07.009 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 217, 2024-05-09T00:15:07.009 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1425024, 2024-05-09T00:15:07.009 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 123888, 2024-05-09T00:15:07.009 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 2, 2024-05-09T00:15:07.010 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-05-09T00:15:07.010 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.043147114, 2024-05-09T00:15:07.010 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.014892098, 2024-05-09T00:15:07.010 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.031013162, 2024-05-09T00:15:07.010 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.004761409, 2024-05-09T00:15:07.010 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:07.010 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 216, 2024-05-09T00:15:07.010 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.010685922, 2024-05-09T00:15:07.010 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000049471 2024-05-09T00:15:07.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:07.010 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:07.010 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:07.010 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:07.010 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1425024, 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 123888 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 6, 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 168, 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 3360, 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 182192, 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.013979239, 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.009369555, 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.002093290, 2024-05-09T00:15:07.011 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T00:15:07.012 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:07.012 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 166, 2024-05-09T00:15:07.012 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.018437854, 2024-05-09T00:15:07.012 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000111071 2024-05-09T00:15:07.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:07.012 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:07.012 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:07.012 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:07.012 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:07.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:07.012 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-05-09T00:15:07.012 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 182192 2024-05-09T00:15:07.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:07.012 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-05-09T00:15:07.013 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 0, 2024-05-09T00:15:07.013 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-05-09T00:15:07.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:07.013 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-05-09T00:15:07.013 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-05-09T00:15:07.013 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-05-09T00:15:07.013 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T00:15:07.013 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-05-09T00:15:07.013 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T00:15:07.013 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-05-09T00:15:07.013 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T00:15:07.013 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T00:15:07.013 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T00:15:07.013 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T00:15:07.014 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T00:15:07.014 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-05-09T00:15:07.014 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T00:15:07.014 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T00:15:07.014 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-05-09T00:15:07.014 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-05-09T00:15:07.014 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-05-09T00:15:07.014 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-05-09T00:15:07.014 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T00:15:07.014 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T00:15:07.014 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T00:15:07.014 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T00:15:07.014 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T00:15:07.014 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-05-09T00:15:07.015 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-05-09T00:15:07.015 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-05-09T00:15:07.015 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T00:15:07.015 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T00:15:07.015 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-05-09T00:15:07.015 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-05-09T00:15:07.015 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-05-09T00:15:07.015 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-05-09T00:15:07.015 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T00:15:07.015 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-05-09T00:15:07.015 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T00:15:07.015 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-05-09T00:15:07.015 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 148977, 2024-05-09T00:15:07.015 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 30, 2024-05-09T00:15:07.016 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-05-09T00:15:07.016 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-05-09T00:15:07.016 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-05-09T00:15:07.016 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-05-09T00:15:07.016 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-05-09T00:15:07.016 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-05-09T00:15:07.016 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-05-09T00:15:07.016 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-05-09T00:15:07.016 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 0, 2024-05-09T00:15:07.016 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 0, 2024-05-09T00:15:07.016 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T00:15:07.016 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-05-09T00:15:07.016 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-05-09T00:15:07.016 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-05-09T00:15:07.017 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 928, 2024-05-09T00:15:07.017 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 2, 2024-05-09T00:15:07.017 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-05-09T00:15:07.017 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-05-09T00:15:07.017 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-05-09T00:15:07.017 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-05-09T00:15:07.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:07.017 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T00:15:07.017 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-05-09T00:15:07.017 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-05-09T00:15:07.017 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-05-09T00:15:07.017 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 229, 2024-05-09T00:15:07.017 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 1392978, 2024-05-09T00:15:07.017 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:07.018 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 229, 2024-05-09T00:15:07.018 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-05-09T00:15:07.018 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-05-09T00:15:07.018 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 229, 2024-05-09T00:15:07.018 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1392978, 2024-05-09T00:15:07.018 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-05-09T00:15:07.018 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:07.018 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:07.018 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:07.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:07.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:07.018 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:15:07.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:06 smithi081 ceph-mon[42474]: pgmap v377: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 46 KiB/s wr, 25 op/s 2024-05-09T00:15:07.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:06 smithi150 ceph-mon[46187]: pgmap v377: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 46 KiB/s wr, 25 op/s 2024-05-09T00:15:07.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:06 smithi171 ceph-mon[47351]: pgmap v377: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 46 KiB/s wr, 25 op/s 2024-05-09T00:15:07.378 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-05-09T00:15:07.378 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-05-09T00:15:07.379 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-05-09T00:15:07.379 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-05-09T00:15:07.379 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-05-09T00:15:07.379 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-05-09T00:15:07.379 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-05-09T00:15:07.379 DEBUG:tasks.check_counter:Getting stats from d 2024-05-09T00:15:07.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-09T00:15:07.601 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 0, 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2, 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 0, 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 0, 2024-05-09T00:15:08.556 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 0, 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.001199952, 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000000000, 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.000204262, 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:08.557 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:08.558 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:08.558 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:08.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:08.558 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T00:15:08.558 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T00:15:08.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:08.558 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T00:15:08.558 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 2, 2024-05-09T00:15:08.558 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 169, 2024-05-09T00:15:08.558 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 320, 2024-05-09T00:15:08.558 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 182272, 2024-05-09T00:15:08.558 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-05-09T00:15:08.558 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-05-09T00:15:08.559 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.014041341, 2024-05-09T00:15:08.559 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.009686935, 2024-05-09T00:15:08.559 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.001724294, 2024-05-09T00:15:08.559 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T00:15:08.559 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:08.559 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 166, 2024-05-09T00:15:08.559 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.015048336, 2024-05-09T00:15:08.559 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000090652 2024-05-09T00:15:08.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:08.559 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:08.559 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:08.559 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 182272 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 234, 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 222, 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1428880, 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 126112, 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 2, 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.041588716, 2024-05-09T00:15:08.560 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.013848885, 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.030569811, 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.004696153, 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 222, 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.015035567, 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000067727 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:08.561 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1428880, 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 126112 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 0, 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T00:15:08.562 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-05-09T00:15:08.563 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T00:15:08.563 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T00:15:08.563 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T00:15:08.563 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T00:15:08.563 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T00:15:08.563 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-05-09T00:15:08.563 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T00:15:08.563 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T00:15:08.563 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-05-09T00:15:08.563 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-05-09T00:15:08.563 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-05-09T00:15:08.564 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-05-09T00:15:08.565 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T00:15:08.565 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-05-09T00:15:08.565 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T00:15:08.565 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-05-09T00:15:08.565 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 149017, 2024-05-09T00:15:08.565 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 31, 2024-05-09T00:15:08.565 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-05-09T00:15:08.565 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-05-09T00:15:08.565 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-05-09T00:15:08.565 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-05-09T00:15:08.565 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-05-09T00:15:08.565 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-05-09T00:15:08.565 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-05-09T00:15:08.565 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-05-09T00:15:08.566 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 0, 2024-05-09T00:15:08.566 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 0, 2024-05-09T00:15:08.566 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T00:15:08.566 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-05-09T00:15:08.566 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-05-09T00:15:08.566 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-05-09T00:15:08.566 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 928, 2024-05-09T00:15:08.566 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 2, 2024-05-09T00:15:08.566 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-05-09T00:15:08.566 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-05-09T00:15:08.566 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-05-09T00:15:08.566 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-05-09T00:15:08.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:08.566 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 232, 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 1393368, 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 232, 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 232, 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1393368, 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:08.567 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:08.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:08.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:08.568 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:15:08.918 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-09T00:15:08.918 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-09T00:15:08.918 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-05-09T00:15:08.919 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-05-09T00:15:08.919 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-05-09T00:15:08.919 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-05-09T00:15:08.919 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-05-09T00:15:08.919 DEBUG:tasks.check_counter:Getting stats from g 2024-05-09T00:15:08.919 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-09T00:15:09.142 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:15:09.258 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:08 smithi081 ceph-mon[42474]: pgmap v378: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-09T00:15:09.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:08 smithi150 ceph-mon[46187]: pgmap v378: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-09T00:15:09.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:09 smithi171 ceph-mon[47351]: pgmap v378: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-09T00:15:10.085 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:15:10.085 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T00:15:10.086 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 228, 2024-05-09T00:15:10.086 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 218, 2024-05-09T00:15:10.086 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1425296, 2024-05-09T00:15:10.086 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 124480, 2024-05-09T00:15:10.086 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-05-09T00:15:10.086 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 0, 2024-05-09T00:15:10.086 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.041285743, 2024-05-09T00:15:10.086 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.013608051, 2024-05-09T00:15:10.086 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.028669358, 2024-05-09T00:15:10.086 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.004741666, 2024-05-09T00:15:10.086 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:10.086 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 217, 2024-05-09T00:15:10.086 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.011994958, 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000055276 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1425296, 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 124480 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 2, 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 168, 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 320, 2024-05-09T00:15:10.087 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 182096, 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.013913476, 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.009385621, 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.001971803, 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 165, 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.011806447, 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000071554 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:10.088 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 182096 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 4, 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 4, 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 3040, 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 448, 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 2, 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.000752901, 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000046470, 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.000666446, 2024-05-09T00:15:10.089 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T00:15:10.090 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:10.090 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 3, 2024-05-09T00:15:10.090 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000896765, 2024-05-09T00:15:10.090 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000298921 2024-05-09T00:15:10.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:10.090 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:10.090 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:10.090 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:10.090 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:10.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:10.090 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-05-09T00:15:10.090 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 448 2024-05-09T00:15:10.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:10.091 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-05-09T00:15:10.091 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 0, 2024-05-09T00:15:10.091 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-05-09T00:15:10.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:10.091 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-05-09T00:15:10.091 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-05-09T00:15:10.091 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-05-09T00:15:10.091 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T00:15:10.091 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-05-09T00:15:10.091 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T00:15:10.091 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-05-09T00:15:10.091 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T00:15:10.091 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T00:15:10.091 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-05-09T00:15:10.092 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 148955, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 30, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-05-09T00:15:10.093 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 0, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 0, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 928, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 2, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-05-09T00:15:10.094 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 230, 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 1393108, 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 230, 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 230, 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1393108, 2024-05-09T00:15:10.095 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-05-09T00:15:10.096 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:10.096 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:10.096 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:10.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:10.096 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:10.096 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:15:10.469 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-05-09T00:15:10.469 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-05-09T00:15:10.469 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-05-09T00:15:10.469 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-05-09T00:15:10.469 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-05-09T00:15:10.469 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-05-09T00:15:10.469 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-05-09T00:15:10.469 DEBUG:tasks.check_counter:Getting stats from j 2024-05-09T00:15:10.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-09T00:15:10.692 INFO:teuthology.orchestra.run.smithi081.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.a/config 2024-05-09T00:15:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:11 smithi081 ceph-mon[42474]: pgmap v379: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-09T00:15:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:11 smithi081 ceph-mon[42474]: osdmap e94: 12 total, 12 up, 12 in 2024-05-09T00:15:11.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:11 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:15:11.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:11 smithi150 ceph-mon[46187]: pgmap v379: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-09T00:15:11.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:11 smithi150 ceph-mon[46187]: osdmap e94: 12 total, 12 up, 12 in 2024-05-09T00:15:11.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:11 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:15:11.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:11 smithi171 ceph-mon[47351]: pgmap v379: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-09T00:15:11.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:11 smithi171 ceph-mon[47351]: osdmap e94: 12 total, 12 up, 12 in 2024-05-09T00:15:11.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:11 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-09T00:15:11.628 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-05-09T00:15:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T00:15:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 0, 2024-05-09T00:15:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 2, 2024-05-09T00:15:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 0, 2024-05-09T00:15:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 0, 2024-05-09T00:15:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 4, 2024-05-09T00:15:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 0, 2024-05-09T00:15:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.001239095, 2024-05-09T00:15:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.000000000, 2024-05-09T00:15:11.629 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.000311572, 2024-05-09T00:15:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T00:15:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:11.630 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T00:15:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T00:15:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T00:15:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 236, 2024-05-09T00:15:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 224, 2024-05-09T00:15:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 1429424, 2024-05-09T00:15:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 127296, 2024-05-09T00:15:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 2, 2024-05-09T00:15:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 1, 2024-05-09T00:15:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.043596514, 2024-05-09T00:15:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.015293464, 2024-05-09T00:15:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.030433159, 2024-05-09T00:15:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.004822703, 2024-05-09T00:15:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 224, 2024-05-09T00:15:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.012733833, 2024-05-09T00:15:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000056847 2024-05-09T00:15:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 1429424, 2024-05-09T00:15:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 127296 2024-05-09T00:15:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T00:15:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_messages": 2, 2024-05-09T00:15:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages": 170, 2024-05-09T00:15:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_bytes": 320, 2024-05-09T00:15:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_bytes": 182448, 2024-05-09T00:15:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_created_connections": 5, 2024-05-09T00:15:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_active_connections": 3, 2024-05-09T00:15:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_total_time": 0.014620099, 2024-05-09T00:15:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_send_time": 0.010267877, 2024-05-09T00:15:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_recv_time": 0.001560997, 2024-05-09T00:15:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T00:15:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 167, 2024-05-09T00:15:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.014708591, 2024-05-09T00:15:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000088075 2024-05-09T00:15:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-09T00:15:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "msgr_send_encrypted_bytes": 182448 2024-05-09T00:15:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "cct": { 2024-05-09T00:15:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "total_workers": 0, 2024-05-09T00:15:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "unhealthy_workers": 0 2024-05-09T00:15:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "mempool": { 2024-05-09T00:15:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_bytes": 0, 2024-05-09T00:15:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "bloom_filter_items": 0, 2024-05-09T00:15:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T00:15:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_alloc_items": 0, 2024-05-09T00:15:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T00:15:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_data_items": 0, 2024-05-09T00:15:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T00:15:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T00:15:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T00:15:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T00:15:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T00:15:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_other_items": 0, 2024-05-09T00:15:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T00:15:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T00:15:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_bytes": 0, 2024-05-09T00:15:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_extent_items": 0, 2024-05-09T00:15:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_bytes": 0, 2024-05-09T00:15:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_blob_items": 0, 2024-05-09T00:15:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T00:15:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T00:15:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T00:15:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T00:15:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T00:15:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_fsck_items": 0, 2024-05-09T00:15:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_bytes": 0, 2024-05-09T00:15:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_txc_items": 0, 2024-05-09T00:15:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T00:15:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T00:15:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_bytes": 0, 2024-05-09T00:15:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "bluestore_writing_items": 0, 2024-05-09T00:15:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_bytes": 0, 2024-05-09T00:15:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_items": 0, 2024-05-09T00:15:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T00:15:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_reader_items": 0, 2024-05-09T00:15:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T00:15:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "bluefs_file_writer_items": 0, 2024-05-09T00:15:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_bytes": 149007, 2024-05-09T00:15:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_anon_items": 30, 2024-05-09T00:15:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_bytes": 0, 2024-05-09T00:15:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "buffer_meta_items": 0, 2024-05-09T00:15:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_bytes": 0, 2024-05-09T00:15:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_items": 0, 2024-05-09T00:15:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_bytes": 0, 2024-05-09T00:15:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_mapbl_items": 0, 2024-05-09T00:15:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_bytes": 0, 2024-05-09T00:15:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_pglog_items": 0, 2024-05-09T00:15:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_bytes": 0, 2024-05-09T00:15:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_items": 0, 2024-05-09T00:15:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T00:15:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_mapping_items": 0, 2024-05-09T00:15:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_bytes": 0, 2024-05-09T00:15:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "pgmap_items": 0, 2024-05-09T00:15:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_bytes": 928, 2024-05-09T00:15:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_co_items": 2, 2024-05-09T00:15:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_bytes": 0, 2024-05-09T00:15:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_1_items": 0, 2024-05-09T00:15:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_bytes": 0, 2024-05-09T00:15:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "unittest_2_items": 0 2024-05-09T00:15:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-05-09T00:15:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T00:15:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "val": 0, 2024-05-09T00:15:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "max": 104857600, 2024-05-09T00:15:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "get_started": 0, 2024-05-09T00:15:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "get": 234, 2024-05-09T00:15:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "get_sum": 1393628, 2024-05-09T00:15:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "get_or_fail_success": 234, 2024-05-09T00:15:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "take": 0, 2024-05-09T00:15:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "take_sum": 0, 2024-05-09T00:15:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "put": 234, 2024-05-09T00:15:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "put_sum": 1393628, 2024-05-09T00:15:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "wait": { 2024-05-09T00:15:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "avgcount": 0, 2024-05-09T00:15:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "sum": 0.000000000, 2024-05-09T00:15:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "avgtime": 0.000000000 2024-05-09T00:15:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-05-09T00:15:11.641 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-05-09T00:15:11.993 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-09T00:15:11.993 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-09T00:15:11.993 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-05-09T00:15:11.994 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-05-09T00:15:11.994 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-05-09T00:15:11.994 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-05-09T00:15:11.994 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-05-09T00:15:11.994 DEBUG:tasks.check_counter:Getting stats from b 2024-05-09T00:15:11.994 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-09T00:15:12.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:12 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:15:12.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:12 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:15:12.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:12 smithi081 ceph-mon[42474]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:15:12.232 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T00:15:12.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:12 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:15:12.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:12 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:15:12.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:12 smithi150 ceph-mon[46187]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:15:12.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:12 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-09T00:15:12.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:12 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-09T00:15:12.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:12 smithi171 ceph-mon[47351]: from='mgr.15285 ' entity='mgr.x' 2024-05-09T00:15:13.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:13 smithi150 ceph-mon[46187]: pgmap v381: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-09T00:15:13.269 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-05-09T00:15:13.269 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T00:15:13.269 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 4161, 2024-05-09T00:15:13.270 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 3306, 2024-05-09T00:15:13.270 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 1312275, 2024-05-09T00:15:13.270 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 16557199, 2024-05-09T00:15:13.270 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 282, 2024-05-09T00:15:13.270 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 7, 2024-05-09T00:15:13.270 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.462809287, 2024-05-09T00:15:13.270 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.119834902, 2024-05-09T00:15:13.270 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.179806009, 2024-05-09T00:15:13.270 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.122007380, 2024-05-09T00:15:13.271 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:13.271 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 3300, 2024-05-09T00:15:13.271 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 1.078209560, 2024-05-09T00:15:13.271 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000326730 2024-05-09T00:15:13.271 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.271 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:13.271 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 1618, 2024-05-09T00:15:13.271 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000285071, 2024-05-09T00:15:13.271 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000176 2024-05-09T00:15:13.271 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.271 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 486272, 2024-05-09T00:15:13.271 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 142336 2024-05-09T00:15:13.271 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.272 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T00:15:13.272 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 2206, 2024-05-09T00:15:13.272 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 2771, 2024-05-09T00:15:13.272 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 2047519, 2024-05-09T00:15:13.272 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 7784135, 2024-05-09T00:15:13.272 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 20, 2024-05-09T00:15:13.272 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 6, 2024-05-09T00:15:13.272 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.251542051, 2024-05-09T00:15:13.272 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.098646785, 2024-05-09T00:15:13.272 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.105501365, 2024-05-09T00:15:13.272 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.049213907, 2024-05-09T00:15:13.272 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:13.272 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2774, 2024-05-09T00:15:13.272 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 1.367087965, 2024-05-09T00:15:13.273 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000492821 2024-05-09T00:15:13.273 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.273 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:13.273 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 1992, 2024-05-09T00:15:13.273 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000491373, 2024-05-09T00:15:13.273 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000246 2024-05-09T00:15:13.273 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.273 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 1488832, 2024-05-09T00:15:13.273 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 508480 2024-05-09T00:15:13.273 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.273 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T00:15:13.273 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 3855, 2024-05-09T00:15:13.274 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 5941, 2024-05-09T00:15:13.274 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 1339791, 2024-05-09T00:15:13.274 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 6921097, 2024-05-09T00:15:13.274 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 15, 2024-05-09T00:15:13.274 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 6, 2024-05-09T00:15:13.274 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.501236575, 2024-05-09T00:15:13.274 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.187999095, 2024-05-09T00:15:13.274 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.213370433, 2024-05-09T00:15:13.274 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.099897090, 2024-05-09T00:15:13.274 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:13.274 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 5938, 2024-05-09T00:15:13.274 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.265993140, 2024-05-09T00:15:13.274 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000044795 2024-05-09T00:15:13.275 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.275 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:13.275 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 6772, 2024-05-09T00:15:13.275 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.001656080, 2024-05-09T00:15:13.275 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000244 2024-05-09T00:15:13.275 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.275 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 807520, 2024-05-09T00:15:13.275 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 1618336 2024-05-09T00:15:13.275 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.275 INFO:teuthology.orchestra.run.smithi150.stdout: "cct": { 2024-05-09T00:15:13.275 INFO:teuthology.orchestra.run.smithi150.stdout: "total_workers": 1, 2024-05-09T00:15:13.275 INFO:teuthology.orchestra.run.smithi150.stdout: "unhealthy_workers": 0 2024-05-09T00:15:13.275 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.276 INFO:teuthology.orchestra.run.smithi150.stdout: "finisher-MDSRank": { 2024-05-09T00:15:13.276 INFO:teuthology.orchestra.run.smithi150.stdout: "queue_len": 0, 2024-05-09T00:15:13.276 INFO:teuthology.orchestra.run.smithi150.stdout: "complete_latency": { 2024-05-09T00:15:13.276 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 6265, 2024-05-09T00:15:13.276 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 1.944054778, 2024-05-09T00:15:13.276 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000310304 2024-05-09T00:15:13.276 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:13.276 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.276 INFO:teuthology.orchestra.run.smithi150.stdout: "finisher-PurgeQueue": { 2024-05-09T00:15:13.276 INFO:teuthology.orchestra.run.smithi150.stdout: "queue_len": 0, 2024-05-09T00:15:13.276 INFO:teuthology.orchestra.run.smithi150.stdout: "complete_latency": { 2024-05-09T00:15:13.276 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 16, 2024-05-09T00:15:13.276 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000349015, 2024-05-09T00:15:13.276 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000021813 2024-05-09T00:15:13.277 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:13.277 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.277 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-05-09T00:15:13.277 INFO:teuthology.orchestra.run.smithi150.stdout: "request": 781, 2024-05-09T00:15:13.277 INFO:teuthology.orchestra.run.smithi150.stdout: "reply": 781, 2024-05-09T00:15:13.277 INFO:teuthology.orchestra.run.smithi150.stdout: "reply_latency": { 2024-05-09T00:15:13.277 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 781, 2024-05-09T00:15:13.277 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 6.359907372, 2024-05-09T00:15:13.277 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.008143287 2024-05-09T00:15:13.277 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.277 INFO:teuthology.orchestra.run.smithi150.stdout: "slow_reply": 0, 2024-05-09T00:15:13.277 INFO:teuthology.orchestra.run.smithi150.stdout: "forward": 0, 2024-05-09T00:15:13.277 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_fetch_complete": 0, 2024-05-09T00:15:13.277 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_fetch_keys": 0, 2024-05-09T00:15:13.278 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_commit": 350, 2024-05-09T00:15:13.278 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_split": 0, 2024-05-09T00:15:13.278 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_merge": 0, 2024-05-09T00:15:13.278 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes": 41, 2024-05-09T00:15:13.278 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_top": 13, 2024-05-09T00:15:13.278 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_bottom": 28, 2024-05-09T00:15:13.278 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_pin_tail": 0, 2024-05-09T00:15:13.278 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_pinned": 22, 2024-05-09T00:15:13.278 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_expired": 0, 2024-05-09T00:15:13.278 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_with_caps": 3, 2024-05-09T00:15:13.278 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": 3, 2024-05-09T00:15:13.278 INFO:teuthology.orchestra.run.smithi150.stdout: "subtrees": 2, 2024-05-09T00:15:13.278 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse": 845, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_hit": 834, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_forward": 0, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_discover": 0, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_dir_fetch": 0, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_remote_ino": 0, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_lock": 0, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "load_cent": 0, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "q": 0, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "exported": 0, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "exported_inodes": 0, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "imported": 0, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "imported_inodes": 0, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_dir_fetch": 0, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_backtrace_fetch": 301, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_peer_discover": 0, 2024-05-09T00:15:13.279 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rfiles": 4, 2024-05-09T00:15:13.280 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rbytes": 234, 2024-05-09T00:15:13.280 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rsnaps": 6, 2024-05-09T00:15:13.280 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_backtrace_fetch": 301, 2024-05-09T00:15:13.280 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_set_tag": 0, 2024-05-09T00:15:13.280 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T00:15:13.280 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_inotable_repaired": 0, 2024-05-09T00:15:13.280 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dir_inodes": 194, 2024-05-09T00:15:13.280 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dir_base_inodes": 22, 2024-05-09T00:15:13.280 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dirfrag_rstats": 172, 2024-05-09T00:15:13.280 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_file_inodes": 107, 2024-05-09T00:15:13.280 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_inode_file_caps": 0, 2024-05-09T00:15:13.280 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_revoke": 617, 2024-05-09T00:15:13.280 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_grant": 612, 2024-05-09T00:15:13.280 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_trunc": 599, 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_caps": 733, 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_caps_dirty": 712, 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_cap_release": 2, 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "process_request_cap_release": 621 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_cache": { 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_update": 6, 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_update_receipt": 0, 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_try_discover": 0, 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_send_discover": 0, 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_handle_discover": 16, 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays": 2, 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays_delayed": 0, 2024-05-09T00:15:13.281 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays_enqueuing": 0, 2024-05-09T00:15:13.282 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_created": 3, 2024-05-09T00:15:13.282 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_enqueued": 1, 2024-05-09T00:15:13.282 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_reintegrated": 0, 2024-05-09T00:15:13.282 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_migrated": 0, 2024-05-09T00:15:13.282 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_processing": 0, 2024-05-09T00:15:13.282 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_enqueued": 0, 2024-05-09T00:15:13.282 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_prioritized": 0, 2024-05-09T00:15:13.282 INFO:teuthology.orchestra.run.smithi150.stdout: "recovery_started": 0, 2024-05-09T00:15:13.282 INFO:teuthology.orchestra.run.smithi150.stdout: "recovery_completed": 0, 2024-05-09T00:15:13.282 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_enqueue_scrub": 22, 2024-05-09T00:15:13.282 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_exportdir": 0, 2024-05-09T00:15:13.282 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_flush": 0, 2024-05-09T00:15:13.282 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_fragmentdir": 0, 2024-05-09T00:15:13.283 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_fragstats": 0, 2024-05-09T00:15:13.283 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_inodestats": 0 2024-05-09T00:15:13.283 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.283 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_log": { 2024-05-09T00:15:13.283 INFO:teuthology.orchestra.run.smithi150.stdout: "evadd": 2580, 2024-05-09T00:15:13.283 INFO:teuthology.orchestra.run.smithi150.stdout: "evex": 2542, 2024-05-09T00:15:13.283 INFO:teuthology.orchestra.run.smithi150.stdout: "evtrm": 2542, 2024-05-09T00:15:13.283 INFO:teuthology.orchestra.run.smithi150.stdout: "ev": 38, 2024-05-09T00:15:13.283 INFO:teuthology.orchestra.run.smithi150.stdout: "evexg": 0, 2024-05-09T00:15:13.283 INFO:teuthology.orchestra.run.smithi150.stdout: "evexd": 56, 2024-05-09T00:15:13.283 INFO:teuthology.orchestra.run.smithi150.stdout: "segadd": 58, 2024-05-09T00:15:13.283 INFO:teuthology.orchestra.run.smithi150.stdout: "segex": 57, 2024-05-09T00:15:13.283 INFO:teuthology.orchestra.run.smithi150.stdout: "segtrm": 57, 2024-05-09T00:15:13.283 INFO:teuthology.orchestra.run.smithi150.stdout: "seg": 2, 2024-05-09T00:15:13.284 INFO:teuthology.orchestra.run.smithi150.stdout: "segexg": 0, 2024-05-09T00:15:13.284 INFO:teuthology.orchestra.run.smithi150.stdout: "segexd": 1, 2024-05-09T00:15:13.284 INFO:teuthology.orchestra.run.smithi150.stdout: "expos": 26800133, 2024-05-09T00:15:13.284 INFO:teuthology.orchestra.run.smithi150.stdout: "wrpos": 27092723, 2024-05-09T00:15:13.284 INFO:teuthology.orchestra.run.smithi150.stdout: "rdpos": 0, 2024-05-09T00:15:13.284 INFO:teuthology.orchestra.run.smithi150.stdout: "jlat": { 2024-05-09T00:15:13.284 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2512, 2024-05-09T00:15:13.284 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 5.392446078, 2024-05-09T00:15:13.284 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.002146674 2024-05-09T00:15:13.284 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.284 INFO:teuthology.orchestra.run.smithi150.stdout: "replayed": 0 2024-05-09T00:15:13.284 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.284 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_mem": { 2024-05-09T00:15:13.284 INFO:teuthology.orchestra.run.smithi150.stdout: "ino": 35, 2024-05-09T00:15:13.285 INFO:teuthology.orchestra.run.smithi150.stdout: "ino+": 58, 2024-05-09T00:15:13.285 INFO:teuthology.orchestra.run.smithi150.stdout: "ino-": 23, 2024-05-09T00:15:13.285 INFO:teuthology.orchestra.run.smithi150.stdout: "dir": 20, 2024-05-09T00:15:13.285 INFO:teuthology.orchestra.run.smithi150.stdout: "dir+": 20, 2024-05-09T00:15:13.285 INFO:teuthology.orchestra.run.smithi150.stdout: "dir-": 0, 2024-05-09T00:15:13.285 INFO:teuthology.orchestra.run.smithi150.stdout: "dn": 41, 2024-05-09T00:15:13.285 INFO:teuthology.orchestra.run.smithi150.stdout: "dn+": 42, 2024-05-09T00:15:13.285 INFO:teuthology.orchestra.run.smithi150.stdout: "dn-": 1, 2024-05-09T00:15:13.285 INFO:teuthology.orchestra.run.smithi150.stdout: "cap": 3, 2024-05-09T00:15:13.285 INFO:teuthology.orchestra.run.smithi150.stdout: "cap+": 20, 2024-05-09T00:15:13.286 INFO:teuthology.orchestra.run.smithi150.stdout: "cap-": 17, 2024-05-09T00:15:13.286 INFO:teuthology.orchestra.run.smithi150.stdout: "rss": 53420, 2024-05-09T00:15:13.286 INFO:teuthology.orchestra.run.smithi150.stdout: "heap": 207156 2024-05-09T00:15:13.286 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.286 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_server": { 2024-05-09T00:15:13.286 INFO:teuthology.orchestra.run.smithi150.stdout: "dispatch_client_request": 2041, 2024-05-09T00:15:13.286 INFO:teuthology.orchestra.run.smithi150.stdout: "dispatch_server_request": 1, 2024-05-09T00:15:13.286 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_request": 781, 2024-05-09T00:15:13.286 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_session": 36, 2024-05-09T00:15:13.286 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_peer_request": 2, 2024-05-09T00:15:13.287 INFO:teuthology.orchestra.run.smithi150.stdout: "req_create_latency": { 2024-05-09T00:15:13.287 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 5, 2024-05-09T00:15:13.287 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.003731676, 2024-05-09T00:15:13.287 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000746335 2024-05-09T00:15:13.287 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.287 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getattr_latency": { 2024-05-09T00:15:13.287 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 120, 2024-05-09T00:15:13.287 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 2.867604295, 2024-05-09T00:15:13.287 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.023896702 2024-05-09T00:15:13.287 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.287 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getfilelock_latency": { 2024-05-09T00:15:13.287 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.287 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.287 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.288 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.288 INFO:teuthology.orchestra.run.smithi150.stdout: "req_link_latency": { 2024-05-09T00:15:13.288 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.288 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.288 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.288 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.288 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookup_latency": { 2024-05-09T00:15:13.288 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2, 2024-05-09T00:15:13.288 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000387960, 2024-05-09T00:15:13.288 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000193980 2024-05-09T00:15:13.288 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.288 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookuphash_latency": { 2024-05-09T00:15:13.288 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.288 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupino_latency": { 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 1, 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000307393, 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000307393 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupname_latency": { 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupparent_latency": { 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.289 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.290 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.290 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.290 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupsnap_latency": { 2024-05-09T00:15:13.290 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.290 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.290 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.290 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.290 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lssnap_latency": { 2024-05-09T00:15:13.290 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 12, 2024-05-09T00:15:13.290 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.002285941, 2024-05-09T00:15:13.290 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000190495 2024-05-09T00:15:13.290 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.290 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mkdir_latency": { 2024-05-09T00:15:13.290 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 8, 2024-05-09T00:15:13.291 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.012466068, 2024-05-09T00:15:13.291 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.001558258 2024-05-09T00:15:13.291 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.291 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mknod_latency": { 2024-05-09T00:15:13.291 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.291 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.291 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.291 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.291 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mksnap_latency": { 2024-05-09T00:15:13.291 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 12, 2024-05-09T00:15:13.291 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.059737327, 2024-05-09T00:15:13.291 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.004978110 2024-05-09T00:15:13.291 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.292 INFO:teuthology.orchestra.run.smithi150.stdout: "req_open_latency": { 2024-05-09T00:15:13.292 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.292 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.292 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.292 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.292 INFO:teuthology.orchestra.run.smithi150.stdout: "req_readdir_latency": { 2024-05-09T00:15:13.292 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2, 2024-05-09T00:15:13.292 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.004159927, 2024-05-09T00:15:13.292 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.002079963 2024-05-09T00:15:13.292 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.292 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rename_latency": { 2024-05-09T00:15:13.292 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2, 2024-05-09T00:15:13.292 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.002310690, 2024-05-09T00:15:13.292 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.001155345 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: "req_renamesnap_latency": { 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: "req_snapdiff_latency": { 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmdir_latency": { 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2, 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.012365745, 2024-05-09T00:15:13.293 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.006182872 2024-05-09T00:15:13.294 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.294 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmsnap_latency": { 2024-05-09T00:15:13.294 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 6, 2024-05-09T00:15:13.294 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.027053803, 2024-05-09T00:15:13.294 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.004508967 2024-05-09T00:15:13.294 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.294 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmxattr_latency": { 2024-05-09T00:15:13.294 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.294 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.294 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.294 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.294 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setattr_latency": { 2024-05-09T00:15:13.294 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 600, 2024-05-09T00:15:13.294 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 3.345391785, 2024-05-09T00:15:13.295 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.005575652 2024-05-09T00:15:13.295 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.295 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setdirlayout_latency": { 2024-05-09T00:15:13.295 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.295 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.295 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.295 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.295 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setfilelock_latency": { 2024-05-09T00:15:13.295 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.295 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.295 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.295 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.295 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setlayout_latency": { 2024-05-09T00:15:13.295 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.296 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.296 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.296 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.296 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setxattr_latency": { 2024-05-09T00:15:13.296 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 8, 2024-05-09T00:15:13.296 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.020041416, 2024-05-09T00:15:13.296 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.002505177 2024-05-09T00:15:13.296 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.296 INFO:teuthology.orchestra.run.smithi150.stdout: "req_symlink_latency": { 2024-05-09T00:15:13.296 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.296 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.296 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.296 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.296 INFO:teuthology.orchestra.run.smithi150.stdout: "req_unlink_latency": { 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 1, 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.002063346, 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.002063346 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: "cap_revoke_eviction": 0, 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: "cap_acquisition_throttle": 0, 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getvxattr_latency": { 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_sessions": { 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: "session_count": 2, 2024-05-09T00:15:13.297 INFO:teuthology.orchestra.run.smithi150.stdout: "session_add": 6, 2024-05-09T00:15:13.298 INFO:teuthology.orchestra.run.smithi150.stdout: "session_remove": 4, 2024-05-09T00:15:13.298 INFO:teuthology.orchestra.run.smithi150.stdout: "sessions_open": 2, 2024-05-09T00:15:13.298 INFO:teuthology.orchestra.run.smithi150.stdout: "sessions_stale": 0, 2024-05-09T00:15:13.298 INFO:teuthology.orchestra.run.smithi150.stdout: "total_load": 99, 2024-05-09T00:15:13.298 INFO:teuthology.orchestra.run.smithi150.stdout: "average_load": 49, 2024-05-09T00:15:13.298 INFO:teuthology.orchestra.run.smithi150.stdout: "avg_session_uptime": 701, 2024-05-09T00:15:13.298 INFO:teuthology.orchestra.run.smithi150.stdout: "mdthresh_evicted": 0 2024-05-09T00:15:13.298 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.298 INFO:teuthology.orchestra.run.smithi150.stdout: "mempool": { 2024-05-09T00:15:13.298 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_bytes": 0, 2024-05-09T00:15:13.298 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_items": 0, 2024-05-09T00:15:13.298 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T00:15:13.299 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_items": 0, 2024-05-09T00:15:13.299 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T00:15:13.299 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_items": 0, 2024-05-09T00:15:13.299 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T00:15:13.299 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T00:15:13.299 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T00:15:13.299 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T00:15:13.299 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T00:15:13.299 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_items": 0, 2024-05-09T00:15:13.299 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T00:15:13.299 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T00:15:13.299 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_bytes": 0, 2024-05-09T00:15:13.299 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_items": 0, 2024-05-09T00:15:13.299 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_bytes": 0, 2024-05-09T00:15:13.300 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_items": 0, 2024-05-09T00:15:13.300 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T00:15:13.300 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T00:15:13.300 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T00:15:13.300 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T00:15:13.300 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T00:15:13.300 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_items": 0, 2024-05-09T00:15:13.300 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_bytes": 0, 2024-05-09T00:15:13.300 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_items": 0, 2024-05-09T00:15:13.300 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T00:15:13.300 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T00:15:13.300 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_bytes": 0, 2024-05-09T00:15:13.300 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_items": 0, 2024-05-09T00:15:13.300 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_bytes": 0, 2024-05-09T00:15:13.301 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_items": 0, 2024-05-09T00:15:13.301 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T00:15:13.301 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_items": 0, 2024-05-09T00:15:13.301 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T00:15:13.301 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_items": 0, 2024-05-09T00:15:13.301 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_bytes": 331565, 2024-05-09T00:15:13.301 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 135, 2024-05-09T00:15:13.301 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, 2024-05-09T00:15:13.301 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2024-05-09T00:15:13.301 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_bytes": 0, 2024-05-09T00:15:13.301 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_items": 0, 2024-05-09T00:15:13.301 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_bytes": 0, 2024-05-09T00:15:13.301 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_items": 0, 2024-05-09T00:15:13.301 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_bytes": 0, 2024-05-09T00:15:13.302 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_items": 0, 2024-05-09T00:15:13.302 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_bytes": 8272, 2024-05-09T00:15:13.302 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_items": 190, 2024-05-09T00:15:13.302 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T00:15:13.302 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_items": 0, 2024-05-09T00:15:13.302 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_bytes": 0, 2024-05-09T00:15:13.302 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_items": 0, 2024-05-09T00:15:13.302 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_bytes": 169811, 2024-05-09T00:15:13.302 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_items": 1332, 2024-05-09T00:15:13.302 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_bytes": 0, 2024-05-09T00:15:13.302 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_items": 0, 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_bytes": 0, 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_items": 0 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: "objecter": { 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: "op_active": 0, 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: "op_laggy": 0, 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: "op_send": 4658, 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: "op_send_bytes": 24041963, 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: "op_resend": 37, 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: "op_reply": 4658, 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: "op_latency": { 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 4658, 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 25.909493823, 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.005562364 2024-05-09T00:15:13.303 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.304 INFO:teuthology.orchestra.run.smithi150.stdout: "op_inflight": 0, 2024-05-09T00:15:13.304 INFO:teuthology.orchestra.run.smithi150.stdout: "oplen_avg": { 2024-05-09T00:15:13.304 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 4658, 2024-05-09T00:15:13.304 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 5396 2024-05-09T00:15:13.304 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.304 INFO:teuthology.orchestra.run.smithi150.stdout: "op": 4658, 2024-05-09T00:15:13.304 INFO:teuthology.orchestra.run.smithi150.stdout: "op_r": 346, 2024-05-09T00:15:13.304 INFO:teuthology.orchestra.run.smithi150.stdout: "op_w": 4312, 2024-05-09T00:15:13.304 INFO:teuthology.orchestra.run.smithi150.stdout: "op_rmw": 0, 2024-05-09T00:15:13.304 INFO:teuthology.orchestra.run.smithi150.stdout: "op_pg": 0, 2024-05-09T00:15:13.304 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_stat": 330, 2024-05-09T00:15:13.304 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_create": 25, 2024-05-09T00:15:13.304 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_read": 23, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_write": 2513, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_writefull": 181, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_writesame": 0, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_append": 0, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_zero": 0, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_truncate": 0, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_delete": 523, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_mapext": 0, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_sparse_read": 0, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_clonerange": 0, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_getxattr": 323, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_setxattr": 50, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_cmpxattr": 0, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_rmxattr": 0, 2024-05-09T00:15:13.305 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_resetxattrs": 0, 2024-05-09T00:15:13.306 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_call": 0, 2024-05-09T00:15:13.306 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_watch": 0, 2024-05-09T00:15:13.306 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_notify": 0, 2024-05-09T00:15:13.306 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T00:15:13.306 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_pgls": 0, 2024-05-09T00:15:13.306 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_pgls_filter": 0, 2024-05-09T00:15:13.306 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_other": 599, 2024-05-09T00:15:13.306 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_active": 0, 2024-05-09T00:15:13.306 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_send": 0, 2024-05-09T00:15:13.306 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_resend": 0, 2024-05-09T00:15:13.306 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_ping": 0, 2024-05-09T00:15:13.306 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_active": 0, 2024-05-09T00:15:13.306 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_send": 0, 2024-05-09T00:15:13.306 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_resend": 0, 2024-05-09T00:15:13.307 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_active": 0, 2024-05-09T00:15:13.307 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_send": 0, 2024-05-09T00:15:13.307 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_resend": 0, 2024-05-09T00:15:13.307 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_active": 0, 2024-05-09T00:15:13.307 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_send": 0, 2024-05-09T00:15:13.307 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_resend": 0, 2024-05-09T00:15:13.307 INFO:teuthology.orchestra.run.smithi150.stdout: "command_active": 0, 2024-05-09T00:15:13.307 INFO:teuthology.orchestra.run.smithi150.stdout: "command_send": 0, 2024-05-09T00:15:13.307 INFO:teuthology.orchestra.run.smithi150.stdout: "command_resend": 0, 2024-05-09T00:15:13.307 INFO:teuthology.orchestra.run.smithi150.stdout: "map_epoch": 94, 2024-05-09T00:15:13.307 INFO:teuthology.orchestra.run.smithi150.stdout: "map_full": 0, 2024-05-09T00:15:13.307 INFO:teuthology.orchestra.run.smithi150.stdout: "map_inc": 16, 2024-05-09T00:15:13.307 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_sessions": 12, 2024-05-09T00:15:13.307 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_session_open": 12, 2024-05-09T00:15:13.308 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_session_close": 0, 2024-05-09T00:15:13.308 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_laggy": 0, 2024-05-09T00:15:13.308 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_wr": 819, 2024-05-09T00:15:13.308 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_rd": 0, 2024-05-09T00:15:13.308 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_del": 10 2024-05-09T00:15:13.308 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.308 INFO:teuthology.orchestra.run.smithi150.stdout: "oft": { 2024-05-09T00:15:13.308 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_objs": 1, 2024-05-09T00:15:13.308 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_kv_pairs": 0, 2024-05-09T00:15:13.308 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_updates": 0, 2024-05-09T00:15:13.308 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_removes": 0 2024-05-09T00:15:13.309 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.309 INFO:teuthology.orchestra.run.smithi150.stdout: "osd-slow-ops": { 2024-05-09T00:15:13.309 INFO:teuthology.orchestra.run.smithi150.stdout: "slow_ops_count": 0 2024-05-09T00:15:13.309 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.309 INFO:teuthology.orchestra.run.smithi150.stdout: "purge_queue": { 2024-05-09T00:15:13.309 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_ops": 0, 2024-05-09T00:15:13.309 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_ops_high_water": 1, 2024-05-09T00:15:13.309 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing": 0, 2024-05-09T00:15:13.309 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_high_water": 1, 2024-05-09T00:15:13.309 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executed": 1, 2024-05-09T00:15:13.310 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_item_in_journal": 0 2024-05-09T00:15:13.310 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.310 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T00:15:13.310 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:13.310 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-05-09T00:15:13.310 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:13.310 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 10218, 2024-05-09T00:15:13.310 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 3615539, 2024-05-09T00:15:13.310 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:13.310 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 10218, 2024-05-09T00:15:13.310 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-05-09T00:15:13.310 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-05-09T00:15:13.310 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 10218, 2024-05-09T00:15:13.310 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 3615539, 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-objecter_bytes": { 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:13.311 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 4658, 2024-05-09T00:15:13.312 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 24042112, 2024-05-09T00:15:13.312 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 4658, 2024-05-09T00:15:13.312 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 24042112, 2024-05-09T00:15:13.312 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:13.312 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.312 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.312 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.312 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:13.312 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.312 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-objecter_ops": { 2024-05-09T00:15:13.312 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:13.312 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1024, 2024-05-09T00:15:13.312 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:13.312 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 4658, 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 4658, 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 4658, 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 4658, 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-write_buf_throttle": { 2024-05-09T00:15:13.313 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:13.314 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 3758096384, 2024-05-09T00:15:13.314 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:13.314 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 1, 2024-05-09T00:15:13.314 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 149, 2024-05-09T00:15:13.314 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:13.314 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 1, 2024-05-09T00:15:13.314 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-05-09T00:15:13.314 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-05-09T00:15:13.314 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 1, 2024-05-09T00:15:13.314 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 149, 2024-05-09T00:15:13.314 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:13.314 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.314 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.315 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.315 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:13.315 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:13.315 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-write_buf_throttle-0x562d573920a0": { 2024-05-09T00:15:13.315 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 112, 2024-05-09T00:15:13.315 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 3758096384, 2024-05-09T00:15:13.315 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:13.315 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 2580, 2024-05-09T00:15:13.315 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 22898419, 2024-05-09T00:15:13.315 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:13.315 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 2580, 2024-05-09T00:15:13.315 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-05-09T00:15:13.315 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-05-09T00:15:13.315 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 2512, 2024-05-09T00:15:13.316 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 22898307, 2024-05-09T00:15:13.316 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:13.316 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:13.316 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:13.316 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:13.316 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:13.316 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:13.316 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-05-09T00:15:13.316 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:13 smithi171 ceph-mon[47351]: pgmap v381: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-09T00:15:13.373 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:13 smithi081 ceph-mon[42474]: pgmap v381: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-09T00:15:13.622 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-05-09T00:15:13.622 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-05-09T00:15:13.622 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=6 2024-05-09T00:15:13.622 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-05-09T00:15:13.622 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-05-09T00:15:13.622 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=12 2024-05-09T00:15:13.622 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=6 2024-05-09T00:15:13.622 DEBUG:tasks.check_counter:Getting stats from e 2024-05-09T00:15:13.622 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-09T00:15:13.844 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T00:15:14.809 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-05-09T00:15:14.809 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T00:15:14.809 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 2352, 2024-05-09T00:15:14.809 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 2353, 2024-05-09T00:15:14.809 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 666427, 2024-05-09T00:15:14.809 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 731168, 2024-05-09T00:15:14.809 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 6, 2024-05-09T00:15:14.809 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 2, 2024-05-09T00:15:14.809 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.188890679, 2024-05-09T00:15:14.809 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.057460653, 2024-05-09T00:15:14.810 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.047487525, 2024-05-09T00:15:14.810 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.067623095, 2024-05-09T00:15:14.810 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:14.810 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2351, 2024-05-09T00:15:14.810 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.078831548, 2024-05-09T00:15:14.810 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000033531 2024-05-09T00:15:14.810 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.810 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:14.810 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.810 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.810 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.810 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.810 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T00:15:14.811 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T00:15:14.811 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.811 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T00:15:14.811 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 8, 2024-05-09T00:15:14.811 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 173, 2024-05-09T00:15:14.811 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 3916, 2024-05-09T00:15:14.811 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 450604, 2024-05-09T00:15:14.811 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 6, 2024-05-09T00:15:14.811 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 4, 2024-05-09T00:15:14.811 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.010699840, 2024-05-09T00:15:14.811 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.006430318, 2024-05-09T00:15:14.811 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.002441219, 2024-05-09T00:15:14.811 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000071645, 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 171, 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.014888332, 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000087066 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 449920 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T00:15:14.812 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 255, 2024-05-09T00:15:14.813 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 242, 2024-05-09T00:15:14.813 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 1459772, 2024-05-09T00:15:14.813 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 130055, 2024-05-09T00:15:14.813 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 3, 2024-05-09T00:15:14.813 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 2, 2024-05-09T00:15:14.813 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.048580710, 2024-05-09T00:15:14.813 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.014942893, 2024-05-09T00:15:14.813 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.035541447, 2024-05-09T00:15:14.813 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.006234239, 2024-05-09T00:15:14.813 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:14.813 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 241, 2024-05-09T00:15:14.813 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.015119417, 2024-05-09T00:15:14.813 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000062736 2024-05-09T00:15:14.814 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.814 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:14.814 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.814 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.814 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.814 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.814 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 1459504, 2024-05-09T00:15:14.814 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 129744 2024-05-09T00:15:14.814 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.814 INFO:teuthology.orchestra.run.smithi150.stdout: "cct": { 2024-05-09T00:15:14.814 INFO:teuthology.orchestra.run.smithi150.stdout: "total_workers": 1, 2024-05-09T00:15:14.814 INFO:teuthology.orchestra.run.smithi150.stdout: "unhealthy_workers": 0 2024-05-09T00:15:14.815 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.815 INFO:teuthology.orchestra.run.smithi150.stdout: "finisher-MDSRank": { 2024-05-09T00:15:14.815 INFO:teuthology.orchestra.run.smithi150.stdout: "queue_len": 0, 2024-05-09T00:15:14.815 INFO:teuthology.orchestra.run.smithi150.stdout: "complete_latency": { 2024-05-09T00:15:14.815 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 3953, 2024-05-09T00:15:14.815 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.096670958, 2024-05-09T00:15:14.815 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000024455 2024-05-09T00:15:14.815 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:14.815 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.815 INFO:teuthology.orchestra.run.smithi150.stdout: "finisher-PurgeQueue": { 2024-05-09T00:15:14.815 INFO:teuthology.orchestra.run.smithi150.stdout: "queue_len": 0, 2024-05-09T00:15:14.815 INFO:teuthology.orchestra.run.smithi150.stdout: "complete_latency": { 2024-05-09T00:15:14.815 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.815 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.816 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.816 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:14.816 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.816 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-05-09T00:15:14.816 INFO:teuthology.orchestra.run.smithi150.stdout: "request": 0, 2024-05-09T00:15:14.816 INFO:teuthology.orchestra.run.smithi150.stdout: "reply": 0, 2024-05-09T00:15:14.816 INFO:teuthology.orchestra.run.smithi150.stdout: "reply_latency": { 2024-05-09T00:15:14.816 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.816 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.816 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.816 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.816 INFO:teuthology.orchestra.run.smithi150.stdout: "slow_reply": 0, 2024-05-09T00:15:14.816 INFO:teuthology.orchestra.run.smithi150.stdout: "forward": 0, 2024-05-09T00:15:14.816 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_fetch_complete": 0, 2024-05-09T00:15:14.817 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_fetch_keys": 0, 2024-05-09T00:15:14.817 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_commit": 0, 2024-05-09T00:15:14.817 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_split": 0, 2024-05-09T00:15:14.817 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_merge": 0, 2024-05-09T00:15:14.817 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes": 0, 2024-05-09T00:15:14.817 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_top": 0, 2024-05-09T00:15:14.817 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_bottom": 0, 2024-05-09T00:15:14.817 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_pin_tail": 0, 2024-05-09T00:15:14.817 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_pinned": 0, 2024-05-09T00:15:14.817 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_expired": 0, 2024-05-09T00:15:14.817 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_with_caps": 0, 2024-05-09T00:15:14.817 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": 0, 2024-05-09T00:15:14.817 INFO:teuthology.orchestra.run.smithi150.stdout: "subtrees": 1, 2024-05-09T00:15:14.817 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse": 0, 2024-05-09T00:15:14.818 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_hit": 0, 2024-05-09T00:15:14.818 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_forward": 0, 2024-05-09T00:15:14.818 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_discover": 0, 2024-05-09T00:15:14.818 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_dir_fetch": 0, 2024-05-09T00:15:14.818 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_remote_ino": 0, 2024-05-09T00:15:14.818 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_lock": 0, 2024-05-09T00:15:14.818 INFO:teuthology.orchestra.run.smithi150.stdout: "load_cent": 0, 2024-05-09T00:15:14.818 INFO:teuthology.orchestra.run.smithi150.stdout: "q": 0, 2024-05-09T00:15:14.818 INFO:teuthology.orchestra.run.smithi150.stdout: "exported": 0, 2024-05-09T00:15:14.818 INFO:teuthology.orchestra.run.smithi150.stdout: "exported_inodes": 0, 2024-05-09T00:15:14.818 INFO:teuthology.orchestra.run.smithi150.stdout: "imported": 0, 2024-05-09T00:15:14.818 INFO:teuthology.orchestra.run.smithi150.stdout: "imported_inodes": 0, 2024-05-09T00:15:14.818 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_dir_fetch": 0, 2024-05-09T00:15:14.818 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_backtrace_fetch": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_peer_discover": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rfiles": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rbytes": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rsnaps": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_set_tag": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_inotable_repaired": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dir_inodes": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_file_inodes": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_inode_file_caps": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_revoke": 0, 2024-05-09T00:15:14.819 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_grant": 0, 2024-05-09T00:15:14.820 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T00:15:14.820 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T00:15:14.820 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T00:15:14.820 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_caps": 0, 2024-05-09T00:15:14.820 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_caps_dirty": 0, 2024-05-09T00:15:14.820 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_cap_release": 0, 2024-05-09T00:15:14.820 INFO:teuthology.orchestra.run.smithi150.stdout: "process_request_cap_release": 0 2024-05-09T00:15:14.820 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.820 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_cache": { 2024-05-09T00:15:14.820 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_update": 0, 2024-05-09T00:15:14.820 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_update_receipt": 0, 2024-05-09T00:15:14.820 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_try_discover": 0, 2024-05-09T00:15:14.820 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_send_discover": 0, 2024-05-09T00:15:14.820 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_handle_discover": 0, 2024-05-09T00:15:14.821 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays": 0, 2024-05-09T00:15:14.821 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays_delayed": 0, 2024-05-09T00:15:14.821 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays_enqueuing": 0, 2024-05-09T00:15:14.821 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_created": 0, 2024-05-09T00:15:14.821 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_enqueued": 0, 2024-05-09T00:15:14.821 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_reintegrated": 0, 2024-05-09T00:15:14.821 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_migrated": 0, 2024-05-09T00:15:14.821 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_processing": 0, 2024-05-09T00:15:14.821 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_enqueued": 0, 2024-05-09T00:15:14.821 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_prioritized": 0, 2024-05-09T00:15:14.821 INFO:teuthology.orchestra.run.smithi150.stdout: "recovery_started": 0, 2024-05-09T00:15:14.821 INFO:teuthology.orchestra.run.smithi150.stdout: "recovery_completed": 0, 2024-05-09T00:15:14.821 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T00:15:14.822 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_exportdir": 0, 2024-05-09T00:15:14.822 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_flush": 0, 2024-05-09T00:15:14.822 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_fragmentdir": 0, 2024-05-09T00:15:14.822 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_fragstats": 0, 2024-05-09T00:15:14.822 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_inodestats": 0 2024-05-09T00:15:14.822 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.822 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_log": { 2024-05-09T00:15:14.822 INFO:teuthology.orchestra.run.smithi150.stdout: "evadd": 0, 2024-05-09T00:15:14.822 INFO:teuthology.orchestra.run.smithi150.stdout: "evex": 0, 2024-05-09T00:15:14.822 INFO:teuthology.orchestra.run.smithi150.stdout: "evtrm": 0, 2024-05-09T00:15:14.822 INFO:teuthology.orchestra.run.smithi150.stdout: "ev": 6, 2024-05-09T00:15:14.822 INFO:teuthology.orchestra.run.smithi150.stdout: "evexg": 0, 2024-05-09T00:15:14.822 INFO:teuthology.orchestra.run.smithi150.stdout: "evexd": 0, 2024-05-09T00:15:14.822 INFO:teuthology.orchestra.run.smithi150.stdout: "segadd": 0, 2024-05-09T00:15:14.823 INFO:teuthology.orchestra.run.smithi150.stdout: "segex": 0, 2024-05-09T00:15:14.823 INFO:teuthology.orchestra.run.smithi150.stdout: "segtrm": 0, 2024-05-09T00:15:14.823 INFO:teuthology.orchestra.run.smithi150.stdout: "seg": 1, 2024-05-09T00:15:14.823 INFO:teuthology.orchestra.run.smithi150.stdout: "segexg": 0, 2024-05-09T00:15:14.823 INFO:teuthology.orchestra.run.smithi150.stdout: "segexd": 0, 2024-05-09T00:15:14.823 INFO:teuthology.orchestra.run.smithi150.stdout: "expos": 4194304, 2024-05-09T00:15:14.823 INFO:teuthology.orchestra.run.smithi150.stdout: "wrpos": 4196226, 2024-05-09T00:15:14.823 INFO:teuthology.orchestra.run.smithi150.stdout: "rdpos": 4196085, 2024-05-09T00:15:14.823 INFO:teuthology.orchestra.run.smithi150.stdout: "jlat": { 2024-05-09T00:15:14.823 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.823 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.823 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.823 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.823 INFO:teuthology.orchestra.run.smithi150.stdout: "replayed": 6 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_mem": { 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: "ino": 3, 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: "ino+": 3, 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: "ino-": 0, 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: "dir": 1, 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: "dir+": 1, 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: "dir-": 0, 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: "dn": 0, 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: "dn+": 0, 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: "dn-": 0, 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: "cap": 0, 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: "cap+": 0, 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: "cap-": 0, 2024-05-09T00:15:14.824 INFO:teuthology.orchestra.run.smithi150.stdout: "rss": 47280, 2024-05-09T00:15:14.825 INFO:teuthology.orchestra.run.smithi150.stdout: "heap": 207156 2024-05-09T00:15:14.825 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.825 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_server": { 2024-05-09T00:15:14.825 INFO:teuthology.orchestra.run.smithi150.stdout: "dispatch_client_request": 0, 2024-05-09T00:15:14.825 INFO:teuthology.orchestra.run.smithi150.stdout: "dispatch_server_request": 0, 2024-05-09T00:15:14.825 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_request": 0, 2024-05-09T00:15:14.825 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_session": 0, 2024-05-09T00:15:14.825 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_peer_request": 0, 2024-05-09T00:15:14.825 INFO:teuthology.orchestra.run.smithi150.stdout: "req_create_latency": { 2024-05-09T00:15:14.825 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.825 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.825 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.825 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getattr_latency": { 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getfilelock_latency": { 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: "req_link_latency": { 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.826 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.827 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookup_latency": { 2024-05-09T00:15:14.827 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.827 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.827 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.827 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.827 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookuphash_latency": { 2024-05-09T00:15:14.827 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.827 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.827 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.827 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.827 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupino_latency": { 2024-05-09T00:15:14.827 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.827 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.828 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.828 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.828 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupname_latency": { 2024-05-09T00:15:14.828 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.828 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.828 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.828 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.828 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupparent_latency": { 2024-05-09T00:15:14.828 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.828 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.828 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.828 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.828 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupsnap_latency": { 2024-05-09T00:15:14.828 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.829 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.829 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.829 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.829 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lssnap_latency": { 2024-05-09T00:15:14.829 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.829 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.829 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.829 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.829 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mkdir_latency": { 2024-05-09T00:15:14.829 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.829 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.829 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.829 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.829 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mknod_latency": { 2024-05-09T00:15:14.830 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.830 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.830 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.830 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.830 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mksnap_latency": { 2024-05-09T00:15:14.830 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.830 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.830 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.830 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.830 INFO:teuthology.orchestra.run.smithi150.stdout: "req_open_latency": { 2024-05-09T00:15:14.830 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.830 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.830 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.830 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.831 INFO:teuthology.orchestra.run.smithi150.stdout: "req_readdir_latency": { 2024-05-09T00:15:14.831 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.831 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.831 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.831 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.831 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rename_latency": { 2024-05-09T00:15:14.831 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.831 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.831 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.831 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.831 INFO:teuthology.orchestra.run.smithi150.stdout: "req_renamesnap_latency": { 2024-05-09T00:15:14.831 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.831 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.832 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.832 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.832 INFO:teuthology.orchestra.run.smithi150.stdout: "req_snapdiff_latency": { 2024-05-09T00:15:14.832 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.832 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.832 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.832 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.832 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmdir_latency": { 2024-05-09T00:15:14.832 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.832 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.832 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.832 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.832 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmsnap_latency": { 2024-05-09T00:15:14.832 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.833 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.833 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.833 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.833 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmxattr_latency": { 2024-05-09T00:15:14.833 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.833 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.833 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.833 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.833 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setattr_latency": { 2024-05-09T00:15:14.833 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.833 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.833 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.834 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.834 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setdirlayout_latency": { 2024-05-09T00:15:14.834 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.834 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.834 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.834 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.834 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setfilelock_latency": { 2024-05-09T00:15:14.834 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.834 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.834 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.834 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.834 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setlayout_latency": { 2024-05-09T00:15:14.834 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.835 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.835 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.835 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.835 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setxattr_latency": { 2024-05-09T00:15:14.835 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.835 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.835 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.835 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.835 INFO:teuthology.orchestra.run.smithi150.stdout: "req_symlink_latency": { 2024-05-09T00:15:14.835 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.835 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.835 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.835 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.835 INFO:teuthology.orchestra.run.smithi150.stdout: "req_unlink_latency": { 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: "cap_revoke_eviction": 0, 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: "cap_acquisition_throttle": 0, 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getvxattr_latency": { 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_sessions": { 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: "session_count": 1, 2024-05-09T00:15:14.836 INFO:teuthology.orchestra.run.smithi150.stdout: "session_add": 3, 2024-05-09T00:15:14.837 INFO:teuthology.orchestra.run.smithi150.stdout: "session_remove": 2, 2024-05-09T00:15:14.837 INFO:teuthology.orchestra.run.smithi150.stdout: "sessions_open": 2, 2024-05-09T00:15:14.837 INFO:teuthology.orchestra.run.smithi150.stdout: "sessions_stale": 0, 2024-05-09T00:15:14.837 INFO:teuthology.orchestra.run.smithi150.stdout: "total_load": 0, 2024-05-09T00:15:14.837 INFO:teuthology.orchestra.run.smithi150.stdout: "average_load": 0, 2024-05-09T00:15:14.837 INFO:teuthology.orchestra.run.smithi150.stdout: "avg_session_uptime": 6157, 2024-05-09T00:15:14.837 INFO:teuthology.orchestra.run.smithi150.stdout: "mdthresh_evicted": 0 2024-05-09T00:15:14.837 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.837 INFO:teuthology.orchestra.run.smithi150.stdout: "mempool": { 2024-05-09T00:15:14.837 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_bytes": 0, 2024-05-09T00:15:14.837 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_items": 0, 2024-05-09T00:15:14.837 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T00:15:14.837 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_items": 0, 2024-05-09T00:15:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T00:15:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_items": 0, 2024-05-09T00:15:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T00:15:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T00:15:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T00:15:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T00:15:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T00:15:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_items": 0, 2024-05-09T00:15:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T00:15:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T00:15:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_bytes": 0, 2024-05-09T00:15:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_items": 0, 2024-05-09T00:15:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_bytes": 0, 2024-05-09T00:15:14.838 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_items": 0, 2024-05-09T00:15:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T00:15:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T00:15:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T00:15:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T00:15:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T00:15:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_items": 0, 2024-05-09T00:15:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_bytes": 0, 2024-05-09T00:15:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_items": 0, 2024-05-09T00:15:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T00:15:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T00:15:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_bytes": 0, 2024-05-09T00:15:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_items": 0, 2024-05-09T00:15:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_bytes": 0, 2024-05-09T00:15:14.839 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_items": 0, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_items": 0, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_items": 0, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_bytes": 181330, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 48, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_bytes": 0, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_items": 0, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_bytes": 0, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_items": 0, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_bytes": 0, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_items": 0, 2024-05-09T00:15:14.840 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_bytes": 8392, 2024-05-09T00:15:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_items": 193, 2024-05-09T00:15:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T00:15:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_items": 0, 2024-05-09T00:15:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_bytes": 0, 2024-05-09T00:15:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_items": 0, 2024-05-09T00:15:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_bytes": 8320, 2024-05-09T00:15:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_items": 13, 2024-05-09T00:15:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_bytes": 0, 2024-05-09T00:15:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_items": 0, 2024-05-09T00:15:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_bytes": 0, 2024-05-09T00:15:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_items": 0 2024-05-09T00:15:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "objecter": { 2024-05-09T00:15:14.841 INFO:teuthology.orchestra.run.smithi150.stdout: "op_active": 0, 2024-05-09T00:15:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "op_laggy": 0, 2024-05-09T00:15:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "op_send": 2354, 2024-05-09T00:15:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "op_send_bytes": 21, 2024-05-09T00:15:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "op_resend": 3, 2024-05-09T00:15:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "op_reply": 2354, 2024-05-09T00:15:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "op_latency": { 2024-05-09T00:15:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2354, 2024-05-09T00:15:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 1.980961230, 2024-05-09T00:15:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000841529 2024-05-09T00:15:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "op_inflight": 0, 2024-05-09T00:15:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "oplen_avg": { 2024-05-09T00:15:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2354, 2024-05-09T00:15:14.842 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 2355 2024-05-09T00:15:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "op": 2354, 2024-05-09T00:15:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "op_r": 2354, 2024-05-09T00:15:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "op_w": 0, 2024-05-09T00:15:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "op_rmw": 0, 2024-05-09T00:15:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "op_pg": 0, 2024-05-09T00:15:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_stat": 1540, 2024-05-09T00:15:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_create": 0, 2024-05-09T00:15:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_read": 812, 2024-05-09T00:15:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_write": 0, 2024-05-09T00:15:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_writefull": 0, 2024-05-09T00:15:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_writesame": 0, 2024-05-09T00:15:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_append": 0, 2024-05-09T00:15:14.843 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_zero": 0, 2024-05-09T00:15:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_truncate": 0, 2024-05-09T00:15:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_delete": 0, 2024-05-09T00:15:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_mapext": 0, 2024-05-09T00:15:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_sparse_read": 0, 2024-05-09T00:15:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_clonerange": 0, 2024-05-09T00:15:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_getxattr": 1, 2024-05-09T00:15:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_setxattr": 0, 2024-05-09T00:15:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_cmpxattr": 0, 2024-05-09T00:15:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_rmxattr": 0, 2024-05-09T00:15:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_resetxattrs": 0, 2024-05-09T00:15:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_call": 0, 2024-05-09T00:15:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_watch": 0, 2024-05-09T00:15:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_notify": 0, 2024-05-09T00:15:14.844 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T00:15:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_pgls": 0, 2024-05-09T00:15:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_pgls_filter": 0, 2024-05-09T00:15:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_other": 0, 2024-05-09T00:15:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_active": 0, 2024-05-09T00:15:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_send": 0, 2024-05-09T00:15:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_resend": 0, 2024-05-09T00:15:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_ping": 0, 2024-05-09T00:15:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_active": 0, 2024-05-09T00:15:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_send": 0, 2024-05-09T00:15:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_resend": 0, 2024-05-09T00:15:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_active": 0, 2024-05-09T00:15:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_send": 0, 2024-05-09T00:15:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_resend": 0, 2024-05-09T00:15:14.845 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_active": 0, 2024-05-09T00:15:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_send": 0, 2024-05-09T00:15:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_resend": 0, 2024-05-09T00:15:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "command_active": 0, 2024-05-09T00:15:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "command_send": 0, 2024-05-09T00:15:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "command_resend": 0, 2024-05-09T00:15:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "map_epoch": 94, 2024-05-09T00:15:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "map_full": 0, 2024-05-09T00:15:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "map_inc": 15, 2024-05-09T00:15:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_sessions": 4, 2024-05-09T00:15:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_session_open": 4, 2024-05-09T00:15:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_session_close": 0, 2024-05-09T00:15:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_laggy": 0, 2024-05-09T00:15:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_wr": 0, 2024-05-09T00:15:14.846 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_rd": 2, 2024-05-09T00:15:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_del": 0 2024-05-09T00:15:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "oft": { 2024-05-09T00:15:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_objs": 0, 2024-05-09T00:15:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_kv_pairs": 0, 2024-05-09T00:15:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_updates": 0, 2024-05-09T00:15:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_removes": 0 2024-05-09T00:15:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "osd-slow-ops": { 2024-05-09T00:15:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "slow_ops_count": 0 2024-05-09T00:15:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "purge_queue": { 2024-05-09T00:15:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_ops": 0, 2024-05-09T00:15:14.847 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_ops_high_water": 0, 2024-05-09T00:15:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing": 0, 2024-05-09T00:15:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_high_water": 0, 2024-05-09T00:15:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executed": 0, 2024-05-09T00:15:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_item_in_journal": 0 2024-05-09T00:15:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T00:15:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-05-09T00:15:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 2611, 2024-05-09T00:15:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 1879080, 2024-05-09T00:15:14.848 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 2611, 2024-05-09T00:15:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-05-09T00:15:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-05-09T00:15:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 2611, 2024-05-09T00:15:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 1879080, 2024-05-09T00:15:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:14.849 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-objecter_bytes": { 2024-05-09T00:15:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-05-09T00:15:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-05-09T00:15:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-05-09T00:15:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 2354, 2024-05-09T00:15:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 1927, 2024-05-09T00:15:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 2354, 2024-05-09T00:15:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 1927, 2024-05-09T00:15:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:14.850 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-objecter_ops": { 2024-05-09T00:15:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1024, 2024-05-09T00:15:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-05-09T00:15:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-05-09T00:15:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:14.851 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 2354, 2024-05-09T00:15:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 2354, 2024-05-09T00:15:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 2354, 2024-05-09T00:15:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 2354, 2024-05-09T00:15:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-write_buf_throttle": { 2024-05-09T00:15:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 3758096384, 2024-05-09T00:15:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:14.852 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-05-09T00:15:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-05-09T00:15:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-05-09T00:15:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-05-09T00:15:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 0, 2024-05-09T00:15:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 0, 2024-05-09T00:15:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:14.853 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-write_buf_throttle-0x563cfca825a0": { 2024-05-09T00:15:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 3758096384, 2024-05-09T00:15:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-05-09T00:15:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-05-09T00:15:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-05-09T00:15:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-05-09T00:15:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 0, 2024-05-09T00:15:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 0, 2024-05-09T00:15:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:14.854 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:14.855 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:14.855 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:14.855 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:14.855 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-05-09T00:15:15.171 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-05-09T00:15:15.171 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-05-09T00:15:15.171 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-05-09T00:15:15.171 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-05-09T00:15:15.171 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-05-09T00:15:15.171 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-05-09T00:15:15.172 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-05-09T00:15:15.172 DEBUG:tasks.check_counter:Getting stats from h 2024-05-09T00:15:15.172 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-09T00:15:15.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:15 smithi150 ceph-mon[46187]: pgmap v382: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-09T00:15:15.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:15 smithi171 ceph-mon[47351]: pgmap v382: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-09T00:15:15.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:15 smithi081 ceph-mon[42474]: pgmap v382: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-09T00:15:15.395 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T00:15:16.373 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-05-09T00:15:16.373 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T00:15:16.374 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 29, 2024-05-09T00:15:16.374 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 179, 2024-05-09T00:15:16.374 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 6857, 2024-05-09T00:15:16.374 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 413225, 2024-05-09T00:15:16.374 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 15, 2024-05-09T00:15:16.374 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 2, 2024-05-09T00:15:16.374 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.016751032, 2024-05-09T00:15:16.374 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.006257616, 2024-05-09T00:15:16.374 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.003835079, 2024-05-09T00:15:16.374 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000500257, 2024-05-09T00:15:16.374 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:16.374 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 177, 2024-05-09T00:15:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.026651070, 2024-05-09T00:15:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000150571 2024-05-09T00:15:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 6, 2024-05-09T00:15:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000479, 2024-05-09T00:15:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000079 2024-05-09T00:15:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T00:15:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 343760 2024-05-09T00:15:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T00:15:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 69, 2024-05-09T00:15:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 88, 2024-05-09T00:15:16.376 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 15530, 2024-05-09T00:15:16.376 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 509049, 2024-05-09T00:15:16.376 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 49, 2024-05-09T00:15:16.376 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 7, 2024-05-09T00:15:16.376 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.020688150, 2024-05-09T00:15:16.376 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.002484069, 2024-05-09T00:15:16.376 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.016082040, 2024-05-09T00:15:16.376 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000407002, 2024-05-09T00:15:16.376 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:16.376 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 86, 2024-05-09T00:15:16.376 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.013438967, 2024-05-09T00:15:16.376 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000156267 2024-05-09T00:15:16.376 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.376 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:16.377 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 57, 2024-05-09T00:15:16.377 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000006382, 2024-05-09T00:15:16.377 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000111 2024-05-09T00:15:16.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.377 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 5376, 2024-05-09T00:15:16.377 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 110752 2024-05-09T00:15:16.377 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.377 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T00:15:16.377 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 1565, 2024-05-09T00:15:16.377 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 1149, 2024-05-09T00:15:16.377 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 1816319, 2024-05-09T00:15:16.377 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 447682, 2024-05-09T00:15:16.377 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 8, 2024-05-09T00:15:16.377 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 5, 2024-05-09T00:15:16.378 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.152869244, 2024-05-09T00:15:16.378 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.064084452, 2024-05-09T00:15:16.378 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.096238236, 2024-05-09T00:15:16.378 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.010287660, 2024-05-09T00:15:16.378 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:16.378 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 1148, 2024-05-09T00:15:16.378 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.054900997, 2024-05-09T00:15:16.378 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000047823 2024-05-09T00:15:16.378 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.378 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:16.378 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2081, 2024-05-09T00:15:16.378 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000465284, 2024-05-09T00:15:16.378 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000223 2024-05-09T00:15:16.378 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 1471632, 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 147040 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: "cct": { 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: "total_workers": 1, 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: "unhealthy_workers": 0 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: "finisher-MDSRank": { 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: "queue_len": 0, 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: "complete_latency": { 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 51, 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.001642735, 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000032210 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:16.379 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.380 INFO:teuthology.orchestra.run.smithi150.stdout: "finisher-PurgeQueue": { 2024-05-09T00:15:16.380 INFO:teuthology.orchestra.run.smithi150.stdout: "queue_len": 0, 2024-05-09T00:15:16.380 INFO:teuthology.orchestra.run.smithi150.stdout: "complete_latency": { 2024-05-09T00:15:16.380 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2, 2024-05-09T00:15:16.380 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000012449, 2024-05-09T00:15:16.380 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000006224 2024-05-09T00:15:16.380 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:16.380 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.380 INFO:teuthology.orchestra.run.smithi150.stdout: "mds": { 2024-05-09T00:15:16.380 INFO:teuthology.orchestra.run.smithi150.stdout: "request": 10, 2024-05-09T00:15:16.380 INFO:teuthology.orchestra.run.smithi150.stdout: "reply": 6, 2024-05-09T00:15:16.380 INFO:teuthology.orchestra.run.smithi150.stdout: "reply_latency": { 2024-05-09T00:15:16.380 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 6, 2024-05-09T00:15:16.380 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.002779439, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000463239 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "slow_reply": 0, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "forward": 4, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_fetch_complete": 0, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_fetch_keys": 0, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_commit": 11, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_split": 0, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_merge": 0, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes": 16, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_top": 0, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_bottom": 16, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_pin_tail": 0, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_pinned": 13, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_expired": 5, 2024-05-09T00:15:16.381 INFO:teuthology.orchestra.run.smithi150.stdout: "inodes_with_caps": 1, 2024-05-09T00:15:16.382 INFO:teuthology.orchestra.run.smithi150.stdout: "caps": 1, 2024-05-09T00:15:16.382 INFO:teuthology.orchestra.run.smithi150.stdout: "subtrees": 3, 2024-05-09T00:15:16.382 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse": 21, 2024-05-09T00:15:16.382 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_hit": 13, 2024-05-09T00:15:16.382 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_forward": 1, 2024-05-09T00:15:16.382 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_discover": 4, 2024-05-09T00:15:16.382 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_dir_fetch": 0, 2024-05-09T00:15:16.382 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_remote_ino": 0, 2024-05-09T00:15:16.382 INFO:teuthology.orchestra.run.smithi150.stdout: "traverse_lock": 0, 2024-05-09T00:15:16.382 INFO:teuthology.orchestra.run.smithi150.stdout: "load_cent": 0, 2024-05-09T00:15:16.382 INFO:teuthology.orchestra.run.smithi150.stdout: "q": 0, 2024-05-09T00:15:16.382 INFO:teuthology.orchestra.run.smithi150.stdout: "exported": 0, 2024-05-09T00:15:16.382 INFO:teuthology.orchestra.run.smithi150.stdout: "exported_inodes": 0, 2024-05-09T00:15:16.382 INFO:teuthology.orchestra.run.smithi150.stdout: "imported": 0, 2024-05-09T00:15:16.383 INFO:teuthology.orchestra.run.smithi150.stdout: "imported_inodes": 0, 2024-05-09T00:15:16.383 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_dir_fetch": 0, 2024-05-09T00:15:16.383 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_backtrace_fetch": 0, 2024-05-09T00:15:16.383 INFO:teuthology.orchestra.run.smithi150.stdout: "openino_peer_discover": 0, 2024-05-09T00:15:16.383 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rfiles": 4, 2024-05-09T00:15:16.383 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rbytes": 234, 2024-05-09T00:15:16.383 INFO:teuthology.orchestra.run.smithi150.stdout: "root_rsnaps": 6, 2024-05-09T00:15:16.383 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T00:15:16.383 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_set_tag": 0, 2024-05-09T00:15:16.383 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T00:15:16.383 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_inotable_repaired": 0, 2024-05-09T00:15:16.383 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dir_inodes": 0, 2024-05-09T00:15:16.383 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T00:15:16.383 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: "scrub_file_inodes": 0, 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_inode_file_caps": 0, 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_revoke": 0, 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_grant": 0, 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_caps": 0, 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_caps_dirty": 0, 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_cap_release": 0, 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: "process_request_cap_release": 0 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_cache": { 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_update": 0, 2024-05-09T00:15:16.384 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_update_receipt": 9, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_try_discover": 6, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_send_discover": 8, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "dir_handle_discover": 0, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays": 0, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays_delayed": 0, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "num_strays_enqueuing": 0, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_created": 0, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_enqueued": 0, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_reintegrated": 0, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "strays_migrated": 0, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_processing": 0, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_enqueued": 0, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "num_recovering_prioritized": 0, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "recovery_started": 0, 2024-05-09T00:15:16.385 INFO:teuthology.orchestra.run.smithi150.stdout: "recovery_completed": 0, 2024-05-09T00:15:16.386 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T00:15:16.386 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_exportdir": 0, 2024-05-09T00:15:16.386 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_flush": 0, 2024-05-09T00:15:16.386 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_fragmentdir": 0, 2024-05-09T00:15:16.386 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_fragstats": 0, 2024-05-09T00:15:16.386 INFO:teuthology.orchestra.run.smithi150.stdout: "ireq_inodestats": 0 2024-05-09T00:15:16.386 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.386 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_log": { 2024-05-09T00:15:16.386 INFO:teuthology.orchestra.run.smithi150.stdout: "evadd": 4, 2024-05-09T00:15:16.386 INFO:teuthology.orchestra.run.smithi150.stdout: "evex": 0, 2024-05-09T00:15:16.386 INFO:teuthology.orchestra.run.smithi150.stdout: "evtrm": 0, 2024-05-09T00:15:16.386 INFO:teuthology.orchestra.run.smithi150.stdout: "ev": 4, 2024-05-09T00:15:16.386 INFO:teuthology.orchestra.run.smithi150.stdout: "evexg": 0, 2024-05-09T00:15:16.386 INFO:teuthology.orchestra.run.smithi150.stdout: "evexd": 0, 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: "segadd": 1, 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: "segex": 0, 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: "segtrm": 0, 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: "seg": 1, 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: "segexg": 0, 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: "segexd": 0, 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: "expos": 4194304, 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: "wrpos": 4195771, 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: "rdpos": 0, 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: "jlat": { 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 4, 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.006688393, 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.001672098 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.387 INFO:teuthology.orchestra.run.smithi150.stdout: "replayed": 0 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_mem": { 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "ino": 20, 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "ino+": 22, 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "ino-": 2, 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "dir": 19, 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "dir+": 21, 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "dir-": 2, 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "dn": 16, 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "dn+": 21, 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "dn-": 5, 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "cap": 1, 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "cap+": 3, 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "cap-": 2, 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "rss": 48488, 2024-05-09T00:15:16.388 INFO:teuthology.orchestra.run.smithi150.stdout: "heap": 198964 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_server": { 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: "dispatch_client_request": 14, 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: "dispatch_server_request": 0, 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_request": 10, 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_client_session": 13, 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: "handle_peer_request": 1, 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: "req_create_latency": { 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getattr_latency": { 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 4, 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.002292980, 2024-05-09T00:15:16.389 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000573245 2024-05-09T00:15:16.390 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.390 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getfilelock_latency": { 2024-05-09T00:15:16.390 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.390 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.390 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.390 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.390 INFO:teuthology.orchestra.run.smithi150.stdout: "req_link_latency": { 2024-05-09T00:15:16.390 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.390 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.390 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.390 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.390 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookup_latency": { 2024-05-09T00:15:16.390 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 2, 2024-05-09T00:15:16.390 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000486459, 2024-05-09T00:15:16.391 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000243229 2024-05-09T00:15:16.391 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.391 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookuphash_latency": { 2024-05-09T00:15:16.391 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.391 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.391 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.391 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.391 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupino_latency": { 2024-05-09T00:15:16.391 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.391 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.391 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.391 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.391 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupname_latency": { 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupparent_latency": { 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lookupsnap_latency": { 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.392 INFO:teuthology.orchestra.run.smithi150.stdout: "req_lssnap_latency": { 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mkdir_latency": { 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mknod_latency": { 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.393 INFO:teuthology.orchestra.run.smithi150.stdout: "req_mksnap_latency": { 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: "req_open_latency": { 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: "req_readdir_latency": { 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.394 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rename_latency": { 2024-05-09T00:15:16.395 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.395 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.395 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.395 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.395 INFO:teuthology.orchestra.run.smithi150.stdout: "req_renamesnap_latency": { 2024-05-09T00:15:16.395 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.395 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.395 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.395 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.395 INFO:teuthology.orchestra.run.smithi150.stdout: "req_snapdiff_latency": { 2024-05-09T00:15:16.395 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.395 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.395 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmdir_latency": { 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmsnap_latency": { 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: "req_rmxattr_latency": { 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.396 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setattr_latency": { 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setdirlayout_latency": { 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setfilelock_latency": { 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.397 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.398 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.398 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setlayout_latency": { 2024-05-09T00:15:16.398 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.398 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.398 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.398 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.398 INFO:teuthology.orchestra.run.smithi150.stdout: "req_setxattr_latency": { 2024-05-09T00:15:16.398 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.398 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.398 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.398 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.398 INFO:teuthology.orchestra.run.smithi150.stdout: "req_symlink_latency": { 2024-05-09T00:15:16.398 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "req_unlink_latency": { 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "cap_revoke_eviction": 0, 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "cap_acquisition_throttle": 0, 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "req_getvxattr_latency": { 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:16.399 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_sessions": { 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "session_count": 1, 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "session_add": 2, 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "session_remove": 1, 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "sessions_open": 1, 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "sessions_stale": 0, 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "total_load": 4, 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "average_load": 2, 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "avg_session_uptime": 672, 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "mdthresh_evicted": 0 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "mempool": { 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_bytes": 0, 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_items": 0, 2024-05-09T00:15:16.400 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T00:15:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_items": 0, 2024-05-09T00:15:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T00:15:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_items": 0, 2024-05-09T00:15:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T00:15:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T00:15:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T00:15:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T00:15:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T00:15:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_items": 0, 2024-05-09T00:15:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T00:15:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T00:15:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_bytes": 0, 2024-05-09T00:15:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_items": 0, 2024-05-09T00:15:16.401 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_bytes": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_items": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_items": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_bytes": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_items": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_bytes": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_items": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_bytes": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_items": 0, 2024-05-09T00:15:16.402 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T00:15:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_items": 0, 2024-05-09T00:15:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T00:15:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_items": 0, 2024-05-09T00:15:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_bytes": 256535, 2024-05-09T00:15:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 98, 2024-05-09T00:15:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 176, 2024-05-09T00:15:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 2, 2024-05-09T00:15:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_bytes": 0, 2024-05-09T00:15:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_items": 0, 2024-05-09T00:15:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_bytes": 0, 2024-05-09T00:15:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_items": 0, 2024-05-09T00:15:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_bytes": 0, 2024-05-09T00:15:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_items": 0, 2024-05-09T00:15:16.403 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_bytes": 8392, 2024-05-09T00:15:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_items": 193, 2024-05-09T00:15:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T00:15:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_items": 0, 2024-05-09T00:15:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_bytes": 0, 2024-05-09T00:15:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_items": 0, 2024-05-09T00:15:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_bytes": 85469, 2024-05-09T00:15:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_items": 340, 2024-05-09T00:15:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_bytes": 0, 2024-05-09T00:15:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_items": 0, 2024-05-09T00:15:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_bytes": 0, 2024-05-09T00:15:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_items": 0 2024-05-09T00:15:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.404 INFO:teuthology.orchestra.run.smithi150.stdout: "objecter": { 2024-05-09T00:15:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "op_active": 0, 2024-05-09T00:15:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "op_laggy": 0, 2024-05-09T00:15:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "op_send": 43, 2024-05-09T00:15:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "op_send_bytes": 12004, 2024-05-09T00:15:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "op_resend": 27, 2024-05-09T00:15:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "op_reply": 43, 2024-05-09T00:15:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "op_latency": { 2024-05-09T00:15:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 43, 2024-05-09T00:15:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.207995939, 2024-05-09T00:15:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.004837114 2024-05-09T00:15:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "op_inflight": 0, 2024-05-09T00:15:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "oplen_avg": { 2024-05-09T00:15:16.405 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 43, 2024-05-09T00:15:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 67 2024-05-09T00:15:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "op": 43, 2024-05-09T00:15:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "op_r": 0, 2024-05-09T00:15:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "op_w": 43, 2024-05-09T00:15:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "op_rmw": 0, 2024-05-09T00:15:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "op_pg": 0, 2024-05-09T00:15:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_stat": 0, 2024-05-09T00:15:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_create": 10, 2024-05-09T00:15:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_read": 0, 2024-05-09T00:15:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_write": 4, 2024-05-09T00:15:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_writefull": 8, 2024-05-09T00:15:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_writesame": 0, 2024-05-09T00:15:16.406 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_append": 0, 2024-05-09T00:15:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_zero": 0, 2024-05-09T00:15:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_truncate": 0, 2024-05-09T00:15:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_delete": 6, 2024-05-09T00:15:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_mapext": 0, 2024-05-09T00:15:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_sparse_read": 0, 2024-05-09T00:15:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_clonerange": 0, 2024-05-09T00:15:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_getxattr": 0, 2024-05-09T00:15:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_setxattr": 20, 2024-05-09T00:15:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_cmpxattr": 0, 2024-05-09T00:15:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_rmxattr": 0, 2024-05-09T00:15:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_resetxattrs": 0, 2024-05-09T00:15:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_call": 0, 2024-05-09T00:15:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_watch": 0, 2024-05-09T00:15:16.407 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_notify": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_pgls": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_pgls_filter": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "osdop_other": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_active": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_send": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_resend": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "linger_ping": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_active": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_send": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "poolop_resend": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_active": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_send": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "poolstat_resend": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_active": 0, 2024-05-09T00:15:16.408 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_send": 0, 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "statfs_resend": 0, 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "command_active": 0, 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "command_send": 0, 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "command_resend": 0, 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "map_epoch": 94, 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "map_full": 0, 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "map_inc": 15, 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_sessions": 9, 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_session_open": 9, 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_session_close": 0, 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_laggy": 0, 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_wr": 17, 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_rd": 0, 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_del": 2 2024-05-09T00:15:16.409 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "oft": { 2024-05-09T00:15:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_objs": 1, 2024-05-09T00:15:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_kv_pairs": 0, 2024-05-09T00:15:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_updates": 0, 2024-05-09T00:15:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "omap_total_removes": 0 2024-05-09T00:15:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "osd-slow-ops": { 2024-05-09T00:15:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "slow_ops_count": 0 2024-05-09T00:15:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "purge_queue": { 2024-05-09T00:15:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_ops": 0, 2024-05-09T00:15:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_ops_high_water": 0, 2024-05-09T00:15:16.410 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing": 0, 2024-05-09T00:15:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executing_high_water": 0, 2024-05-09T00:15:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_executed": 0, 2024-05-09T00:15:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "pq_item_in_journal": 0 2024-05-09T00:15:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T00:15:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-05-09T00:15:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 1659, 2024-05-09T00:15:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 1671142, 2024-05-09T00:15:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 1659, 2024-05-09T00:15:16.411 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-05-09T00:15:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-05-09T00:15:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 1659, 2024-05-09T00:15:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 1671142, 2024-05-09T00:15:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-objecter_bytes": { 2024-05-09T00:15:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-05-09T00:15:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:16.412 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 43, 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 12004, 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 43, 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 12004, 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-objecter_ops": { 2024-05-09T00:15:16.413 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 1024, 2024-05-09T00:15:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-05-09T00:15:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-05-09T00:15:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 43, 2024-05-09T00:15:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 43, 2024-05-09T00:15:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 43, 2024-05-09T00:15:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 43, 2024-05-09T00:15:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.414 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-write_buf_throttle": { 2024-05-09T00:15:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 3758096384, 2024-05-09T00:15:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 0, 2024-05-09T00:15:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 0, 2024-05-09T00:15:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-05-09T00:15:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-05-09T00:15:16.415 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 0, 2024-05-09T00:15:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 0, 2024-05-09T00:15:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-write_buf_throttle-0x5596ebe760a0": { 2024-05-09T00:15:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 3758096384, 2024-05-09T00:15:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 4, 2024-05-09T00:15:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 1467, 2024-05-09T00:15:16.416 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 4, 2024-05-09T00:15:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-05-09T00:15:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-05-09T00:15:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 4, 2024-05-09T00:15:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 1467, 2024-05-09T00:15:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:16.417 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:16.417 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-05-09T00:15:16.746 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-05-09T00:15:16.746 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-05-09T00:15:16.746 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-05-09T00:15:16.746 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=9 2024-05-09T00:15:16.746 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-05-09T00:15:16.746 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-05-09T00:15:16.747 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-05-09T00:15:16.747 DEBUG:tasks.check_counter:Getting stats from k 2024-05-09T00:15:16.747 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-09T00:15:16.969 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.b/config 2024-05-09T00:15:17.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:17 smithi150 ceph-mon[46187]: pgmap v383: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-09T00:15:17.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:17 smithi171 ceph-mon[47351]: pgmap v383: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-09T00:15:17.374 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:17 smithi081 ceph-mon[42474]: pgmap v383: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-09T00:15:17.918 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2024-05-09T00:15:17.918 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T00:15:17.918 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 0, 2024-05-09T00:15:17.918 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 2, 2024-05-09T00:15:17.918 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 0, 2024-05-09T00:15:17.918 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 0, 2024-05-09T00:15:17.918 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 4, 2024-05-09T00:15:17.918 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 0, 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.001415035, 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.000000000, 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.000411580, 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:17.919 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 234, 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 224, 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 1426928, 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 128048, 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 2, 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 1, 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.046577328, 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.014753656, 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.032565996, 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.006133969, 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:17.920 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 223, 2024-05-09T00:15:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.012688351, 2024-05-09T00:15:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000056898 2024-05-09T00:15:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 1426928, 2024-05-09T00:15:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 128048 2024-05-09T00:15:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T00:15:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_messages": 6, 2024-05-09T00:15:17.921 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages": 173, 2024-05-09T00:15:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_bytes": 3360, 2024-05-09T00:15:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_bytes": 183072, 2024-05-09T00:15:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_created_connections": 5, 2024-05-09T00:15:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_active_connections": 3, 2024-05-09T00:15:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_total_time": 0.012151237, 2024-05-09T00:15:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_send_time": 0.007640923, 2024-05-09T00:15:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_recv_time": 0.002104327, 2024-05-09T00:15:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T00:15:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 171, 2024-05-09T00:15:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.020404713, 2024-05-09T00:15:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000119325 2024-05-09T00:15:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:17.922 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "msgr_send_encrypted_bytes": 183072 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "cct": { 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "total_workers": 0, 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "unhealthy_workers": 0 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "mempool": { 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_bytes": 0, 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "bloom_filter_items": 0, 2024-05-09T00:15:17.923 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_alloc_items": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_data_items": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_other_items": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_bytes": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_extent_items": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_bytes": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_blob_items": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T00:15:17.924 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_fsck_items": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_bytes": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_txc_items": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_bytes": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluestore_writing_items": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_bytes": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_items": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_reader_items": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T00:15:17.925 INFO:teuthology.orchestra.run.smithi150.stdout: "bluefs_file_writer_items": 0, 2024-05-09T00:15:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_bytes": 149017, 2024-05-09T00:15:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_anon_items": 31, 2024-05-09T00:15:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_bytes": 0, 2024-05-09T00:15:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "buffer_meta_items": 0, 2024-05-09T00:15:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_bytes": 0, 2024-05-09T00:15:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_items": 0, 2024-05-09T00:15:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_bytes": 0, 2024-05-09T00:15:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_mapbl_items": 0, 2024-05-09T00:15:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_bytes": 0, 2024-05-09T00:15:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_pglog_items": 0, 2024-05-09T00:15:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_bytes": 0, 2024-05-09T00:15:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_items": 0, 2024-05-09T00:15:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T00:15:17.926 INFO:teuthology.orchestra.run.smithi150.stdout: "osdmap_mapping_items": 0, 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_bytes": 0, 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "pgmap_items": 0, 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_bytes": 928, 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_co_items": 2, 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_bytes": 0, 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_1_items": 0, 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_bytes": 0, 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "unittest_2_items": 0 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "val": 0, 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "max": 104857600, 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "get_started": 0, 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "get": 236, 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "get_sum": 1393888, 2024-05-09T00:15:17.927 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: "get_or_fail_success": 236, 2024-05-09T00:15:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: "take": 0, 2024-05-09T00:15:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: "take_sum": 0, 2024-05-09T00:15:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: "put": 236, 2024-05-09T00:15:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: "put_sum": 1393888, 2024-05-09T00:15:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: "wait": { 2024-05-09T00:15:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: "avgcount": 0, 2024-05-09T00:15:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: "sum": 0.000000000, 2024-05-09T00:15:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: "avgtime": 0.000000000 2024-05-09T00:15:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:17.928 INFO:teuthology.orchestra.run.smithi150.stdout: } 2024-05-09T00:15:17.928 INFO:teuthology.orchestra.run.smithi150.stdout:} 2024-05-09T00:15:18.297 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-05-09T00:15:18.297 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-05-09T00:15:18.297 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-05-09T00:15:18.297 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-05-09T00:15:18.297 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-05-09T00:15:18.297 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-05-09T00:15:18.297 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-05-09T00:15:18.297 DEBUG:tasks.check_counter:Getting stats from c 2024-05-09T00:15:18.297 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-09T00:15:18.547 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:15:19.056 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:18 smithi171 ceph-mon[47351]: pgmap v384: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-09T00:15:19.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:18 smithi171 ceph-mon[47351]: osdmap e95: 12 total, 12 up, 12 in 2024-05-09T00:15:19.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:18 smithi081 ceph-mon[42474]: pgmap v384: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-09T00:15:19.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:18 smithi081 ceph-mon[42474]: osdmap e95: 12 total, 12 up, 12 in 2024-05-09T00:15:19.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:18 smithi150 ceph-mon[46187]: pgmap v384: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 307 B/s wr, 6 op/s 2024-05-09T00:15:19.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:18 smithi150 ceph-mon[46187]: osdmap e95: 12 total, 12 up, 12 in 2024-05-09T00:15:19.701 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-05-09T00:15:19.701 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T00:15:19.701 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 639, 2024-05-09T00:15:19.701 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 639, 2024-05-09T00:15:19.701 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 6283758, 2024-05-09T00:15:19.701 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 197940, 2024-05-09T00:15:19.702 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 7, 2024-05-09T00:15:19.702 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 3, 2024-05-09T00:15:19.702 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.063899589, 2024-05-09T00:15:19.702 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.019461694, 2024-05-09T00:15:19.702 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.019398824, 2024-05-09T00:15:19.702 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.018181500, 2024-05-09T00:15:19.702 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:19.702 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 638, 2024-05-09T00:15:19.702 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.025927511, 2024-05-09T00:15:19.702 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000040638 2024-05-09T00:15:19.702 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.702 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:19.702 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.702 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.703 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.703 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.703 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-05-09T00:15:19.703 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 448 2024-05-09T00:15:19.703 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.703 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T00:15:19.703 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 1620, 2024-05-09T00:15:19.703 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 1755, 2024-05-09T00:15:19.703 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 12959892, 2024-05-09T00:15:19.703 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 819602, 2024-05-09T00:15:19.703 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 5, 2024-05-09T00:15:19.703 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 4, 2024-05-09T00:15:19.703 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.181221530, 2024-05-09T00:15:19.703 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.054708909, 2024-05-09T00:15:19.704 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.054982380, 2024-05-09T00:15:19.704 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.054330609, 2024-05-09T00:15:19.704 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:19.704 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1753, 2024-05-09T00:15:19.704 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.075204335, 2024-05-09T00:15:19.704 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000042900 2024-05-09T00:15:19.704 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.704 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:19.704 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.704 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.704 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.704 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.704 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-09T00:15:19.704 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 316032 2024-05-09T00:15:19.705 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.705 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T00:15:19.705 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 559, 2024-05-09T00:15:19.705 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 557, 2024-05-09T00:15:19.705 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 4632102, 2024-05-09T00:15:19.705 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 216888, 2024-05-09T00:15:19.705 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 4, 2024-05-09T00:15:19.705 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 3, 2024-05-09T00:15:19.705 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.069650894, 2024-05-09T00:15:19.705 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.022137959, 2024-05-09T00:15:19.705 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.025840166, 2024-05-09T00:15:19.705 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.016434422, 2024-05-09T00:15:19.705 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:19.705 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 556, 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.025388590, 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000045662 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 346752, 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 104608 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-05-09T00:15:19.706 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.707 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-05-09T00:15:19.707 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-05-09T00:15:19.707 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-05-09T00:15:19.707 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 4501, 2024-05-09T00:15:19.707 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.132622676, 2024-05-09T00:15:19.707 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000029465 2024-05-09T00:15:19.707 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:19.707 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.707 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-05-09T00:15:19.707 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-05-09T00:15:19.707 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-05-09T00:15:19.707 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.707 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.707 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.708 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:19.708 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.708 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-05-09T00:15:19.708 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 0, 2024-05-09T00:15:19.708 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 0, 2024-05-09T00:15:19.708 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-05-09T00:15:19.708 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.708 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.708 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.708 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.709 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-05-09T00:15:19.709 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 0, 2024-05-09T00:15:19.709 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-05-09T00:15:19.709 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-05-09T00:15:19.709 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 0, 2024-05-09T00:15:19.709 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 0, 2024-05-09T00:15:19.709 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 0, 2024-05-09T00:15:19.710 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 23, 2024-05-09T00:15:19.710 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 7, 2024-05-09T00:15:19.710 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 16, 2024-05-09T00:15:19.710 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 0, 2024-05-09T00:15:19.710 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 13, 2024-05-09T00:15:19.710 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 0, 2024-05-09T00:15:19.710 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 0, 2024-05-09T00:15:19.710 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 0, 2024-05-09T00:15:19.711 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 2, 2024-05-09T00:15:19.711 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 0, 2024-05-09T00:15:19.711 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 0, 2024-05-09T00:15:19.711 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 0, 2024-05-09T00:15:19.711 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 0, 2024-05-09T00:15:19.711 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-05-09T00:15:19.712 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 0, 2024-05-09T00:15:19.712 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 0, 2024-05-09T00:15:19.712 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-05-09T00:15:19.712 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-05-09T00:15:19.712 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 0, 2024-05-09T00:15:19.712 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 0, 2024-05-09T00:15:19.712 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 0, 2024-05-09T00:15:19.713 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 0, 2024-05-09T00:15:19.713 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-05-09T00:15:19.713 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 0, 2024-05-09T00:15:19.713 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 0, 2024-05-09T00:15:19.713 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 4, 2024-05-09T00:15:19.713 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 234, 2024-05-09T00:15:19.713 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 6, 2024-05-09T00:15:19.714 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T00:15:19.714 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-05-09T00:15:19.714 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T00:15:19.714 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-05-09T00:15:19.714 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 0, 2024-05-09T00:15:19.714 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T00:15:19.714 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T00:15:19.715 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 0, 2024-05-09T00:15:19.715 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 0, 2024-05-09T00:15:19.715 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 0, 2024-05-09T00:15:19.715 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 0, 2024-05-09T00:15:19.715 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T00:15:19.715 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T00:15:19.715 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T00:15:19.716 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 0, 2024-05-09T00:15:19.716 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 0, 2024-05-09T00:15:19.716 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 0, 2024-05-09T00:15:19.716 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 0 2024-05-09T00:15:19.716 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.716 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-05-09T00:15:19.716 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 0, 2024-05-09T00:15:19.717 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 0, 2024-05-09T00:15:19.717 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 0, 2024-05-09T00:15:19.717 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 0, 2024-05-09T00:15:19.717 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 0, 2024-05-09T00:15:19.717 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 0, 2024-05-09T00:15:19.717 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-05-09T00:15:19.718 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-05-09T00:15:19.718 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 0, 2024-05-09T00:15:19.718 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 0, 2024-05-09T00:15:19.718 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 0, 2024-05-09T00:15:19.718 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 0, 2024-05-09T00:15:19.718 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-05-09T00:15:19.718 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-05-09T00:15:19.719 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-05-09T00:15:19.719 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-05-09T00:15:19.719 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-05-09T00:15:19.719 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T00:15:19.719 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 0, 2024-05-09T00:15:19.719 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-05-09T00:15:19.719 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 0, 2024-05-09T00:15:19.719 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-05-09T00:15:19.719 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-05-09T00:15:19.719 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.719 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 0, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 0, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 0, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 2531, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 0, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 0, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 0, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 0, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 2, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 0, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 26800133, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 27092723, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 27092611, 2024-05-09T00:15:19.720 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-05-09T00:15:19.721 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.721 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.721 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.721 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.721 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 2531 2024-05-09T00:15:19.721 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.721 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-05-09T00:15:19.721 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 20, 2024-05-09T00:15:19.721 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 21, 2024-05-09T00:15:19.721 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 1, 2024-05-09T00:15:19.721 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 9, 2024-05-09T00:15:19.721 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 9, 2024-05-09T00:15:19.721 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 0, 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 23, 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 23, 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 0, 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 0, 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 0, 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 0, 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 51048, 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 207156 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 0, 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 0, 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 0, 2024-05-09T00:15:19.722 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 0, 2024-05-09T00:15:19.723 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 0, 2024-05-09T00:15:19.723 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-05-09T00:15:19.723 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.723 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.723 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.723 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.723 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-05-09T00:15:19.723 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.723 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.723 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.723 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.723 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-05-09T00:15:19.723 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-05-09T00:15:19.724 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.725 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.726 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-05-09T00:15:19.726 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.726 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.726 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.726 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.726 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-05-09T00:15:19.726 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.726 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.726 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.726 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.726 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-05-09T00:15:19.726 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-05-09T00:15:19.727 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-05-09T00:15:19.728 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.729 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.729 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.729 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.729 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-05-09T00:15:19.729 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.729 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.729 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.729 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.729 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-05-09T00:15:19.729 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.729 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.729 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.729 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.729 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-05-09T00:15:19.730 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.730 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.730 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.730 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.730 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-05-09T00:15:19.730 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.730 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.730 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.730 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.730 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-05-09T00:15:19.730 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.730 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.730 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.730 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.731 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-05-09T00:15:19.731 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.731 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.731 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.731 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.731 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-05-09T00:15:19.731 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.731 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.731 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.731 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.731 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-05-09T00:15:19.731 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.731 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.731 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.732 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.733 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.733 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-05-09T00:15:19.733 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.733 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.733 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.733 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.733 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-05-09T00:15:19.733 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-05-09T00:15:19.733 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-05-09T00:15:19.733 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.733 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.733 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.733 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:19.733 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.734 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-05-09T00:15:19.734 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 2, 2024-05-09T00:15:19.734 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 5, 2024-05-09T00:15:19.734 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 3, 2024-05-09T00:15:19.734 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 0, 2024-05-09T00:15:19.734 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-05-09T00:15:19.734 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 0, 2024-05-09T00:15:19.734 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 0, 2024-05-09T00:15:19.734 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 4282, 2024-05-09T00:15:19.734 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-05-09T00:15:19.734 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.734 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-05-09T00:15:19.734 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-05-09T00:15:19.735 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-05-09T00:15:19.736 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-05-09T00:15:19.737 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-05-09T00:15:19.737 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T00:15:19.737 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-05-09T00:15:19.737 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T00:15:19.737 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-05-09T00:15:19.737 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 207183, 2024-05-09T00:15:19.737 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 85, 2024-05-09T00:15:19.737 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 0, 2024-05-09T00:15:19.737 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 0, 2024-05-09T00:15:19.737 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-05-09T00:15:19.737 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-05-09T00:15:19.737 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-05-09T00:15:19.737 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-05-09T00:15:19.737 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-05-09T00:15:19.738 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-05-09T00:15:19.738 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 8392, 2024-05-09T00:15:19.738 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 193, 2024-05-09T00:15:19.738 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T00:15:19.738 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-05-09T00:15:19.738 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-05-09T00:15:19.738 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-05-09T00:15:19.738 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 107895, 2024-05-09T00:15:19.738 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 885, 2024-05-09T00:15:19.738 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-05-09T00:15:19.739 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-05-09T00:15:19.739 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-05-09T00:15:19.739 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-05-09T00:15:19.739 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.739 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-05-09T00:15:19.739 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-05-09T00:15:19.739 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-05-09T00:15:19.739 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 2615, 2024-05-09T00:15:19.739 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 26, 2024-05-09T00:15:19.739 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 4, 2024-05-09T00:15:19.739 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 2615, 2024-05-09T00:15:19.739 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-05-09T00:15:19.739 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2615, 2024-05-09T00:15:19.739 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 1.431971841, 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000547599 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2615, 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 2616 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 2615, 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 2615, 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 0, 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 1324, 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 0, 2024-05-09T00:15:19.740 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 1288, 2024-05-09T00:15:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 0, 2024-05-09T00:15:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 0, 2024-05-09T00:15:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-05-09T00:15:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-05-09T00:15:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-05-09T00:15:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 0, 2024-05-09T00:15:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 0, 2024-05-09T00:15:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-05-09T00:15:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-05-09T00:15:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-05-09T00:15:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 2, 2024-05-09T00:15:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 0, 2024-05-09T00:15:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-05-09T00:15:19.741 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-05-09T00:15:19.742 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-05-09T00:15:19.742 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-05-09T00:15:19.742 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-05-09T00:15:19.742 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-05-09T00:15:19.742 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T00:15:19.742 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-05-09T00:15:19.742 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-05-09T00:15:19.742 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 0, 2024-05-09T00:15:19.742 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-05-09T00:15:19.742 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-05-09T00:15:19.742 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-05-09T00:15:19.742 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-05-09T00:15:19.742 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 95, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 12, 2024-05-09T00:15:19.743 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 7, 2024-05-09T00:15:19.744 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 7, 2024-05-09T00:15:19.744 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-05-09T00:15:19.744 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-05-09T00:15:19.744 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 0, 2024-05-09T00:15:19.744 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 2, 2024-05-09T00:15:19.744 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 0 2024-05-09T00:15:19.744 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.744 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-05-09T00:15:19.744 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 0, 2024-05-09T00:15:19.744 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-05-09T00:15:19.745 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-05-09T00:15:19.745 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-05-09T00:15:19.745 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.745 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-05-09T00:15:19.745 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 0 2024-05-09T00:15:19.745 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.745 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-05-09T00:15:19.745 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-05-09T00:15:19.745 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 0, 2024-05-09T00:15:19.745 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-05-09T00:15:19.745 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 0, 2024-05-09T00:15:19.745 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 0, 2024-05-09T00:15:19.745 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-05-09T00:15:19.745 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.746 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T00:15:19.746 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:19.746 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-09T00:15:19.746 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:19.746 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 2814, 2024-05-09T00:15:19.746 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 23609322, 2024-05-09T00:15:19.746 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:19.746 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 2814, 2024-05-09T00:15:19.746 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-09T00:15:19.746 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-09T00:15:19.746 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2814, 2024-05-09T00:15:19.747 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 23609322, 2024-05-09T00:15:19.747 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:19.747 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.747 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.747 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.747 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:19.747 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.747 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-05-09T00:15:19.747 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:19.747 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-09T00:15:19.747 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:19.748 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-09T00:15:19.748 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-09T00:15:19.748 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:19.748 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:19.748 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 2615, 2024-05-09T00:15:19.748 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 22808314, 2024-05-09T00:15:19.748 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2615, 2024-05-09T00:15:19.748 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 22808314, 2024-05-09T00:15:19.748 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:19.748 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.748 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.748 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.748 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:19.748 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.749 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-05-09T00:15:19.749 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:19.749 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-05-09T00:15:19.749 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:19.749 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-09T00:15:19.749 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-09T00:15:19.749 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:19.749 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:19.749 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 2615, 2024-05-09T00:15:19.749 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 2615, 2024-05-09T00:15:19.749 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2615, 2024-05-09T00:15:19.750 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 2615, 2024-05-09T00:15:19.750 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:19.750 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.750 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.750 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.750 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:19.750 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.750 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-05-09T00:15:19.750 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:19.750 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-05-09T00:15:19.750 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:19.751 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-09T00:15:19.751 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-09T00:15:19.751 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:19.751 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:19.751 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-09T00:15:19.751 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-09T00:15:19.751 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-05-09T00:15:19.751 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-05-09T00:15:19.751 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:19.751 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.751 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.751 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x5564c193c5a0": { 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-05-09T00:15:19.752 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:19.753 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:19.753 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:19.753 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:19.753 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:19.753 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:19.753 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-05-09T00:15:20.053 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-05-09T00:15:20.053 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-05-09T00:15:20.053 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-05-09T00:15:20.053 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-05-09T00:15:20.053 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-05-09T00:15:20.053 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-05-09T00:15:20.053 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-05-09T00:15:20.053 DEBUG:tasks.check_counter:Getting stats from f 2024-05-09T00:15:20.054 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-09T00:15:20.276 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:15:21.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:20 smithi171 ceph-mon[47351]: pgmap v386: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 225 B/s wr, 3 op/s 2024-05-09T00:15:21.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:20 smithi081 ceph-mon[42474]: pgmap v386: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 225 B/s wr, 3 op/s 2024-05-09T00:15:21.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:20 smithi150 ceph-mon[46187]: pgmap v386: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 225 B/s wr, 3 op/s 2024-05-09T00:15:21.314 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-05-09T00:15:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T00:15:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 817, 2024-05-09T00:15:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 819, 2024-05-09T00:15:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 216096, 2024-05-09T00:15:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 254151, 2024-05-09T00:15:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 6, 2024-05-09T00:15:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 2, 2024-05-09T00:15:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.082283300, 2024-05-09T00:15:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.024780936, 2024-05-09T00:15:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.022291410, 2024-05-09T00:15:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.025301732, 2024-05-09T00:15:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 817, 2024-05-09T00:15:21.315 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.034825470, 2024-05-09T00:15:21.316 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000042626 2024-05-09T00:15:21.316 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.316 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:21.316 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.316 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.316 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.316 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.316 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T00:15:21.316 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T00:15:21.316 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.316 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T00:15:21.316 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 745, 2024-05-09T00:15:21.316 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 914, 2024-05-09T00:15:21.317 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 183120, 2024-05-09T00:15:21.317 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 684038, 2024-05-09T00:15:21.317 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 7, 2024-05-09T00:15:21.317 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 5, 2024-05-09T00:15:21.317 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.089971893, 2024-05-09T00:15:21.317 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.027022643, 2024-05-09T00:15:21.317 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.020941935, 2024-05-09T00:15:21.317 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.031927460, 2024-05-09T00:15:21.317 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:21.317 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 911, 2024-05-09T00:15:21.317 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.044121173, 2024-05-09T00:15:21.317 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000048431 2024-05-09T00:15:21.317 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.318 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:21.318 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.318 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.318 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.318 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.318 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-09T00:15:21.318 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 452960 2024-05-09T00:15:21.318 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.318 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T00:15:21.318 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 1071, 2024-05-09T00:15:21.318 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 1056, 2024-05-09T00:15:21.318 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 1735712, 2024-05-09T00:15:21.318 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 383446, 2024-05-09T00:15:21.318 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 3, 2024-05-09T00:15:21.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 2, 2024-05-09T00:15:21.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.149275617, 2024-05-09T00:15:21.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.044704993, 2024-05-09T00:15:21.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.060733939, 2024-05-09T00:15:21.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.040338391, 2024-05-09T00:15:21.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:21.319 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1056, 2024-05-09T00:15:21.319 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.071012507, 2024-05-09T00:15:21.319 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000067246 2024-05-09T00:15:21.319 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.319 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:21.319 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.319 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.319 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.320 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.320 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 1463552, 2024-05-09T00:15:21.320 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 131536 2024-05-09T00:15:21.320 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.320 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-05-09T00:15:21.320 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-05-09T00:15:21.320 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-05-09T00:15:21.320 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.320 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-05-09T00:15:21.320 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-05-09T00:15:21.320 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-05-09T00:15:21.320 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 3907, 2024-05-09T00:15:21.320 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.127123753, 2024-05-09T00:15:21.321 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000032537 2024-05-09T00:15:21.321 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:21.321 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.321 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-05-09T00:15:21.321 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-05-09T00:15:21.321 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-05-09T00:15:21.321 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.321 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.321 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.321 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:21.321 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.321 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-05-09T00:15:21.321 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 0, 2024-05-09T00:15:21.321 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 0, 2024-05-09T00:15:21.322 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-05-09T00:15:21.322 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.322 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.322 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.322 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.322 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-05-09T00:15:21.322 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 0, 2024-05-09T00:15:21.322 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-05-09T00:15:21.322 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-05-09T00:15:21.322 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 0, 2024-05-09T00:15:21.322 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 0, 2024-05-09T00:15:21.322 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 0, 2024-05-09T00:15:21.322 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 0, 2024-05-09T00:15:21.322 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 0, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 0, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 0, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 0, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 0, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 0, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 0, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 1, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 0, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 0, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 0, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 0, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 0, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 0, 2024-05-09T00:15:21.323 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-05-09T00:15:21.324 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 0, 2024-05-09T00:15:21.325 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T00:15:21.325 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T00:15:21.325 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 0, 2024-05-09T00:15:21.325 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 0, 2024-05-09T00:15:21.325 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 0, 2024-05-09T00:15:21.325 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 0, 2024-05-09T00:15:21.325 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T00:15:21.325 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T00:15:21.325 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T00:15:21.325 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 0, 2024-05-09T00:15:21.325 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 0, 2024-05-09T00:15:21.325 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 0, 2024-05-09T00:15:21.325 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 0 2024-05-09T00:15:21.325 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.326 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-05-09T00:15:21.326 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 0, 2024-05-09T00:15:21.326 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 0, 2024-05-09T00:15:21.326 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 0, 2024-05-09T00:15:21.326 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 0, 2024-05-09T00:15:21.326 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 0, 2024-05-09T00:15:21.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 0, 2024-05-09T00:15:21.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-05-09T00:15:21.326 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-05-09T00:15:21.326 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 0, 2024-05-09T00:15:21.326 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 0, 2024-05-09T00:15:21.326 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 0, 2024-05-09T00:15:21.326 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 0, 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 0, 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 0, 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 0, 2024-05-09T00:15:21.327 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 0, 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 0, 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 4, 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 0, 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 0, 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 0, 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 0, 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 1, 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 0, 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 4194304, 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 4195771, 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 4195630, 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-05-09T00:15:21.328 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 4 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 3, 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 3, 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 0, 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 1, 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 1, 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 0, 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 0, 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 0, 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 0, 2024-05-09T00:15:21.329 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 0, 2024-05-09T00:15:21.330 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 0, 2024-05-09T00:15:21.330 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 0, 2024-05-09T00:15:21.330 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 50052, 2024-05-09T00:15:21.330 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 207156 2024-05-09T00:15:21.330 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.330 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-05-09T00:15:21.330 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 0, 2024-05-09T00:15:21.330 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 0, 2024-05-09T00:15:21.330 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 0, 2024-05-09T00:15:21.330 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 0, 2024-05-09T00:15:21.330 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 0, 2024-05-09T00:15:21.330 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-05-09T00:15:21.330 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.330 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.331 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.332 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.333 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.334 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.334 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.334 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-05-09T00:15:21.334 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.334 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.334 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.334 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.334 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-05-09T00:15:21.334 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.334 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.334 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.334 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.334 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-05-09T00:15:21.334 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.335 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-05-09T00:15:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-05-09T00:15:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-05-09T00:15:21.336 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-05-09T00:15:21.337 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.338 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.338 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.338 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.338 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-05-09T00:15:21.338 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.338 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.338 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.338 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.338 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-05-09T00:15:21.338 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.338 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.338 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.338 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.339 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.340 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.341 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.341 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:21.341 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.341 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-05-09T00:15:21.341 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 1, 2024-05-09T00:15:21.341 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 2, 2024-05-09T00:15:21.341 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 1, 2024-05-09T00:15:21.341 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 2, 2024-05-09T00:15:21.341 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-05-09T00:15:21.341 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 0, 2024-05-09T00:15:21.341 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 0, 2024-05-09T00:15:21.341 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 3483, 2024-05-09T00:15:21.341 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-05-09T00:15:21.341 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.342 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-05-09T00:15:21.342 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-05-09T00:15:21.342 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-05-09T00:15:21.342 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T00:15:21.342 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-05-09T00:15:21.342 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T00:15:21.342 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-05-09T00:15:21.342 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T00:15:21.342 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T00:15:21.342 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T00:15:21.342 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T00:15:21.342 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T00:15:21.342 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-05-09T00:15:21.343 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 189393, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 51, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 0, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 0, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-05-09T00:15:21.344 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-05-09T00:15:21.345 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-05-09T00:15:21.345 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-05-09T00:15:21.345 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-05-09T00:15:21.345 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-05-09T00:15:21.345 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 8272, 2024-05-09T00:15:21.345 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 190, 2024-05-09T00:15:21.345 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T00:15:21.345 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-05-09T00:15:21.345 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-05-09T00:15:21.345 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-05-09T00:15:21.345 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 8320, 2024-05-09T00:15:21.345 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 13, 2024-05-09T00:15:21.345 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-05-09T00:15:21.346 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-05-09T00:15:21.346 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-05-09T00:15:21.346 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-05-09T00:15:21.346 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.346 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-05-09T00:15:21.346 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-05-09T00:15:21.346 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-05-09T00:15:21.346 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 2370, 2024-05-09T00:15:21.346 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 21, 2024-05-09T00:15:21.346 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 3, 2024-05-09T00:15:21.346 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 2370, 2024-05-09T00:15:21.346 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-05-09T00:15:21.346 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2370, 2024-05-09T00:15:21.346 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 1.304974384, 2024-05-09T00:15:21.347 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000550622 2024-05-09T00:15:21.347 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.347 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-05-09T00:15:21.347 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-05-09T00:15:21.347 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2370, 2024-05-09T00:15:21.347 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 2371 2024-05-09T00:15:21.347 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.347 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 2370, 2024-05-09T00:15:21.347 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 2370, 2024-05-09T00:15:21.347 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 0, 2024-05-09T00:15:21.347 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-05-09T00:15:21.347 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-05-09T00:15:21.347 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 1551, 2024-05-09T00:15:21.347 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 0, 2024-05-09T00:15:21.348 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 817, 2024-05-09T00:15:21.348 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 0, 2024-05-09T00:15:21.348 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 0, 2024-05-09T00:15:21.348 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-05-09T00:15:21.348 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-05-09T00:15:21.348 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-05-09T00:15:21.348 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 0, 2024-05-09T00:15:21.348 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 0, 2024-05-09T00:15:21.348 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-05-09T00:15:21.348 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-05-09T00:15:21.348 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-05-09T00:15:21.348 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 1, 2024-05-09T00:15:21.348 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 0, 2024-05-09T00:15:21.349 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-05-09T00:15:21.349 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-05-09T00:15:21.349 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-05-09T00:15:21.349 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-05-09T00:15:21.349 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-05-09T00:15:21.349 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-05-09T00:15:21.349 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T00:15:21.349 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-05-09T00:15:21.349 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-05-09T00:15:21.349 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 0, 2024-05-09T00:15:21.349 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-05-09T00:15:21.349 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-05-09T00:15:21.349 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-05-09T00:15:21.349 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 95, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-05-09T00:15:21.350 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 16, 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 5, 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 5, 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 0, 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 2, 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 0 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 0, 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-05-09T00:15:21.351 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 0 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 0, 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 0, 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 0, 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 2629, 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 1882127, 2024-05-09T00:15:21.352 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 2629, 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2629, 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 1882127, 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-09T00:15:21.353 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 2370, 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 1472, 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2370, 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 1472, 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.354 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-05-09T00:15:21.355 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:21.355 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-05-09T00:15:21.355 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:21.355 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-09T00:15:21.355 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-09T00:15:21.355 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:21.355 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:21.355 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 2370, 2024-05-09T00:15:21.355 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 2370, 2024-05-09T00:15:21.355 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 2370, 2024-05-09T00:15:21.355 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 2370, 2024-05-09T00:15:21.355 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:21.355 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.355 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-05-09T00:15:21.356 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x55af986d65a0": { 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:21.357 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-09T00:15:21.358 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-09T00:15:21.358 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-05-09T00:15:21.358 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-05-09T00:15:21.358 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:21.358 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:21.358 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:21.358 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:21.358 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:21.358 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:21.358 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-05-09T00:15:21.693 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-05-09T00:15:21.693 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-05-09T00:15:21.694 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-05-09T00:15:21.694 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-05-09T00:15:21.694 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-05-09T00:15:21.694 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-05-09T00:15:21.694 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-05-09T00:15:21.694 DEBUG:tasks.check_counter:Getting stats from i 2024-05-09T00:15:21.694 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-09T00:15:21.918 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:15:22.938 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-05-09T00:15:22.939 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T00:15:22.939 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 39, 2024-05-09T00:15:22.939 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 190, 2024-05-09T00:15:22.939 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 11801, 2024-05-09T00:15:22.939 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 398105, 2024-05-09T00:15:22.939 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 14, 2024-05-09T00:15:22.939 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 4, 2024-05-09T00:15:22.939 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.017539647, 2024-05-09T00:15:22.939 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.006555315, 2024-05-09T00:15:22.939 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.004191437, 2024-05-09T00:15:22.939 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.000488150, 2024-05-09T00:15:22.939 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 187, 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.026953476, 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000144136 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 16, 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000001868, 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000116 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 4976, 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 347376 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 1564, 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 1103, 2024-05-09T00:15:22.940 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 1821211, 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 442577, 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 6, 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 4, 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.136990392, 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.050107612, 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.091564156, 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.011706171, 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1104, 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.059323367, 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000053734 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2043, 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000461475, 2024-05-09T00:15:22.941 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000225 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 1472272, 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 134336 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 76, 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 133, 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 14235, 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 558688, 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 53, 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 8, 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.032271409, 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.006165991, 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.023100944, 2024-05-09T00:15:22.942 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.000432108, 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 130, 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.013495674, 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000103812 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 116, 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000016992, 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000146 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 5072, 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 124112 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-05-09T00:15:22.943 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 1, 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-MDSRank": { 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 41, 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.001967092, 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000047977 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: "finisher-PurgeQueue": { 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: "queue_len": 0, 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: "complete_latency": { 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2, 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000014108, 2024-05-09T00:15:22.944 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000007054 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: "mds": { 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: "request": 10, 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: "reply": 5, 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: "reply_latency": { 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 5, 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.001055739, 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000211147 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_reply": 0, 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: "forward": 5, 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_complete": 0, 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_fetch_keys": 0, 2024-05-09T00:15:22.945 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_commit": 11, 2024-05-09T00:15:22.946 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_split": 0, 2024-05-09T00:15:22.946 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_merge": 0, 2024-05-09T00:15:22.946 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes": 16, 2024-05-09T00:15:22.946 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_top": 0, 2024-05-09T00:15:22.946 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_bottom": 16, 2024-05-09T00:15:22.946 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pin_tail": 0, 2024-05-09T00:15:22.946 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_pinned": 13, 2024-05-09T00:15:22.946 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_expired": 4, 2024-05-09T00:15:22.946 INFO:teuthology.orchestra.run.smithi171.stdout: "inodes_with_caps": 1, 2024-05-09T00:15:22.946 INFO:teuthology.orchestra.run.smithi171.stdout: "caps": 1, 2024-05-09T00:15:22.946 INFO:teuthology.orchestra.run.smithi171.stdout: "subtrees": 3, 2024-05-09T00:15:22.946 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse": 18, 2024-05-09T00:15:22.946 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_hit": 11, 2024-05-09T00:15:22.946 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_forward": 1, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_discover": 4, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_dir_fetch": 0, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_remote_ino": 0, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "traverse_lock": 0, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "load_cent": 0, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "q": 0, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "exported": 0, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "exported_inodes": 0, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "imported": 0, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "imported_inodes": 0, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_dir_fetch": 0, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_backtrace_fetch": 0, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "openino_peer_discover": 0, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rfiles": 4, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rbytes": 234, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "root_rsnaps": 6, 2024-05-09T00:15:22.947 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_fetch": 0, 2024-05-09T00:15:22.948 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_set_tag": 0, 2024-05-09T00:15:22.948 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_backtrace_repaired": 0, 2024-05-09T00:15:22.948 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_inotable_repaired": 0, 2024-05-09T00:15:22.948 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_inodes": 0, 2024-05-09T00:15:22.948 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dir_base_inodes": 0, 2024-05-09T00:15:22.948 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_dirfrag_rstats": 0, 2024-05-09T00:15:22.948 INFO:teuthology.orchestra.run.smithi171.stdout: "scrub_file_inodes": 0, 2024-05-09T00:15:22.948 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_inode_file_caps": 0, 2024-05-09T00:15:22.948 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_revoke": 0, 2024-05-09T00:15:22.948 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_grant": 0, 2024-05-09T00:15:22.948 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_trunc": 0, 2024-05-09T00:15:22.948 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-09T00:15:22.948 INFO:teuthology.orchestra.run.smithi171.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-09T00:15:22.948 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps": 0, 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_caps_dirty": 0, 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_cap_release": 0, 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "process_request_cap_release": 2 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_cache": { 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update": 0, 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_update_receipt": 9, 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_try_discover": 6, 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_send_discover": 8, 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "dir_handle_discover": 0, 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays": 0, 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_delayed": 0, 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "num_strays_enqueuing": 0, 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_created": 0, 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_enqueued": 0, 2024-05-09T00:15:22.949 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_reintegrated": 0, 2024-05-09T00:15:22.950 INFO:teuthology.orchestra.run.smithi171.stdout: "strays_migrated": 0, 2024-05-09T00:15:22.950 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_processing": 0, 2024-05-09T00:15:22.950 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_enqueued": 0, 2024-05-09T00:15:22.950 INFO:teuthology.orchestra.run.smithi171.stdout: "num_recovering_prioritized": 0, 2024-05-09T00:15:22.950 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_started": 0, 2024-05-09T00:15:22.950 INFO:teuthology.orchestra.run.smithi171.stdout: "recovery_completed": 0, 2024-05-09T00:15:22.950 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_enqueue_scrub": 0, 2024-05-09T00:15:22.950 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_exportdir": 0, 2024-05-09T00:15:22.950 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_flush": 0, 2024-05-09T00:15:22.950 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragmentdir": 0, 2024-05-09T00:15:22.950 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_fragstats": 0, 2024-05-09T00:15:22.950 INFO:teuthology.orchestra.run.smithi171.stdout: "ireq_inodestats": 0 2024-05-09T00:15:22.950 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.950 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_log": { 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "evadd": 6, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "evex": 0, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "evtrm": 0, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "ev": 6, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "evexg": 0, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "evexd": 0, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "segadd": 1, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "segex": 0, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "segtrm": 0, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "seg": 1, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "segexg": 0, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "segexd": 0, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "expos": 4194304, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "wrpos": 4196226, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "rdpos": 0, 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "jlat": { 2024-05-09T00:15:22.951 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 6, 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.018503265, 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.003083877 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: "replayed": 0 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_mem": { 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: "ino": 20, 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: "ino+": 22, 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: "ino-": 2, 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: "dir": 19, 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: "dir+": 22, 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: "dir-": 3, 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: "dn": 16, 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: "dn+": 20, 2024-05-09T00:15:22.952 INFO:teuthology.orchestra.run.smithi171.stdout: "dn-": 4, 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: "cap": 1, 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: "cap+": 5, 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: "cap-": 4, 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: "rss": 48704, 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: "heap": 198964 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_server": { 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_client_request": 11, 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: "dispatch_server_request": 0, 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_request": 10, 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_client_session": 17, 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: "handle_peer_request": 0, 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: "req_create_latency": { 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.953 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.954 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.954 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.954 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getattr_latency": { 2024-05-09T00:15:22.954 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2, 2024-05-09T00:15:22.954 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000392848, 2024-05-09T00:15:22.954 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000196424 2024-05-09T00:15:22.954 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.954 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getfilelock_latency": { 2024-05-09T00:15:22.954 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.954 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.954 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.954 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.954 INFO:teuthology.orchestra.run.smithi171.stdout: "req_link_latency": { 2024-05-09T00:15:22.954 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.955 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.955 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.955 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.955 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookup_latency": { 2024-05-09T00:15:22.955 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 2, 2024-05-09T00:15:22.955 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000367730, 2024-05-09T00:15:22.955 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000183865 2024-05-09T00:15:22.955 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.955 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookuphash_latency": { 2024-05-09T00:15:22.955 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.955 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.955 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.955 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.955 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupino_latency": { 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 1, 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000295161, 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000295161 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupname_latency": { 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupparent_latency": { 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.956 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lookupsnap_latency": { 2024-05-09T00:15:22.957 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.957 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.957 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.957 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.957 INFO:teuthology.orchestra.run.smithi171.stdout: "req_lssnap_latency": { 2024-05-09T00:15:22.957 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.957 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.957 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.957 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.957 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mkdir_latency": { 2024-05-09T00:15:22.957 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.957 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.957 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.957 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.958 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mknod_latency": { 2024-05-09T00:15:22.958 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.958 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.958 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.958 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.958 INFO:teuthology.orchestra.run.smithi171.stdout: "req_mksnap_latency": { 2024-05-09T00:15:22.958 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.958 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.958 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.958 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.958 INFO:teuthology.orchestra.run.smithi171.stdout: "req_open_latency": { 2024-05-09T00:15:22.958 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.958 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.959 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.959 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.959 INFO:teuthology.orchestra.run.smithi171.stdout: "req_readdir_latency": { 2024-05-09T00:15:22.959 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.959 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.959 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.959 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.959 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rename_latency": { 2024-05-09T00:15:22.959 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.959 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.959 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.959 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.959 INFO:teuthology.orchestra.run.smithi171.stdout: "req_renamesnap_latency": { 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: "req_snapdiff_latency": { 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmdir_latency": { 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.960 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmsnap_latency": { 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: "req_rmxattr_latency": { 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setattr_latency": { 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.961 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setdirlayout_latency": { 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setfilelock_latency": { 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setlayout_latency": { 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.962 INFO:teuthology.orchestra.run.smithi171.stdout: "req_setxattr_latency": { 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: "req_symlink_latency": { 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: "req_unlink_latency": { 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.963 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_revoke_eviction": 0, 2024-05-09T00:15:22.964 INFO:teuthology.orchestra.run.smithi171.stdout: "cap_acquisition_throttle": 0, 2024-05-09T00:15:22.964 INFO:teuthology.orchestra.run.smithi171.stdout: "req_getvxattr_latency": { 2024-05-09T00:15:22.964 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.964 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.964 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.964 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:22.964 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.964 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_sessions": { 2024-05-09T00:15:22.964 INFO:teuthology.orchestra.run.smithi171.stdout: "session_count": 1, 2024-05-09T00:15:22.964 INFO:teuthology.orchestra.run.smithi171.stdout: "session_add": 3, 2024-05-09T00:15:22.964 INFO:teuthology.orchestra.run.smithi171.stdout: "session_remove": 2, 2024-05-09T00:15:22.964 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_open": 1, 2024-05-09T00:15:22.964 INFO:teuthology.orchestra.run.smithi171.stdout: "sessions_stale": 0, 2024-05-09T00:15:22.964 INFO:teuthology.orchestra.run.smithi171.stdout: "total_load": 4, 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "average_load": 2, 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "avg_session_uptime": 743, 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "mdthresh_evicted": 0 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T00:15:22.965 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T00:15:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-05-09T00:15:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T00:15:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T00:15:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-05-09T00:15:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-05-09T00:15:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-05-09T00:15:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-05-09T00:15:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T00:15:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T00:15:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T00:15:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T00:15:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T00:15:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-05-09T00:15:22.966 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 248855, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 98, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 176, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 2, 2024-05-09T00:15:22.967 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-05-09T00:15:22.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-05-09T00:15:22.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-05-09T00:15:22.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-05-09T00:15:22.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-05-09T00:15:22.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-05-09T00:15:22.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 8272, 2024-05-09T00:15:22.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 190, 2024-05-09T00:15:22.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T00:15:22.968 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-05-09T00:15:22.968 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-05-09T00:15:22.968 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-05-09T00:15:22.968 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 85501, 2024-05-09T00:15:22.968 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 344, 2024-05-09T00:15:22.968 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-05-09T00:15:22.969 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-05-09T00:15:22.969 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-05-09T00:15:22.969 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-05-09T00:15:22.969 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.969 INFO:teuthology.orchestra.run.smithi171.stdout: "objecter": { 2024-05-09T00:15:22.969 INFO:teuthology.orchestra.run.smithi171.stdout: "op_active": 0, 2024-05-09T00:15:22.969 INFO:teuthology.orchestra.run.smithi171.stdout: "op_laggy": 0, 2024-05-09T00:15:22.969 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send": 44, 2024-05-09T00:15:22.969 INFO:teuthology.orchestra.run.smithi171.stdout: "op_send_bytes": 12449, 2024-05-09T00:15:22.969 INFO:teuthology.orchestra.run.smithi171.stdout: "op_resend": 27, 2024-05-09T00:15:22.969 INFO:teuthology.orchestra.run.smithi171.stdout: "op_reply": 44, 2024-05-09T00:15:22.969 INFO:teuthology.orchestra.run.smithi171.stdout: "op_latency": { 2024-05-09T00:15:22.969 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 44, 2024-05-09T00:15:22.969 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.263994846, 2024-05-09T00:15:22.970 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.005999882 2024-05-09T00:15:22.970 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.970 INFO:teuthology.orchestra.run.smithi171.stdout: "op_inflight": 0, 2024-05-09T00:15:22.970 INFO:teuthology.orchestra.run.smithi171.stdout: "oplen_avg": { 2024-05-09T00:15:22.970 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 44, 2024-05-09T00:15:22.970 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 68 2024-05-09T00:15:22.970 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.970 INFO:teuthology.orchestra.run.smithi171.stdout: "op": 44, 2024-05-09T00:15:22.970 INFO:teuthology.orchestra.run.smithi171.stdout: "op_r": 0, 2024-05-09T00:15:22.970 INFO:teuthology.orchestra.run.smithi171.stdout: "op_w": 44, 2024-05-09T00:15:22.970 INFO:teuthology.orchestra.run.smithi171.stdout: "op_rmw": 0, 2024-05-09T00:15:22.970 INFO:teuthology.orchestra.run.smithi171.stdout: "op_pg": 0, 2024-05-09T00:15:22.970 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_stat": 0, 2024-05-09T00:15:22.970 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_create": 10, 2024-05-09T00:15:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_read": 0, 2024-05-09T00:15:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_write": 6, 2024-05-09T00:15:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writefull": 7, 2024-05-09T00:15:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_writesame": 0, 2024-05-09T00:15:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_append": 0, 2024-05-09T00:15:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_zero": 0, 2024-05-09T00:15:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_truncate": 0, 2024-05-09T00:15:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_delete": 6, 2024-05-09T00:15:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_mapext": 0, 2024-05-09T00:15:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_sparse_read": 0, 2024-05-09T00:15:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_clonerange": 0, 2024-05-09T00:15:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_getxattr": 0, 2024-05-09T00:15:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_setxattr": 20, 2024-05-09T00:15:22.971 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_cmpxattr": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_rmxattr": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_resetxattrs": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_call": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_watch": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_notify": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_src_cmpxattr": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_pgls_filter": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "osdop_other": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_active": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_send": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_resend": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "linger_ping": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_active": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_send": 0, 2024-05-09T00:15:22.972 INFO:teuthology.orchestra.run.smithi171.stdout: "poolop_resend": 0, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_active": 0, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_send": 0, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "poolstat_resend": 0, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_active": 0, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_send": 0, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "statfs_resend": 0, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "command_active": 0, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "command_send": 0, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "command_resend": 0, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "map_epoch": 95, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "map_full": 0, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "map_inc": 16, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_sessions": 9, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_open": 9, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_session_close": 0, 2024-05-09T00:15:22.973 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_laggy": 0, 2024-05-09T00:15:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_wr": 17, 2024-05-09T00:15:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_rd": 0, 2024-05-09T00:15:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_del": 2 2024-05-09T00:15:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: "oft": { 2024-05-09T00:15:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_objs": 1, 2024-05-09T00:15:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_kv_pairs": 0, 2024-05-09T00:15:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_updates": 0, 2024-05-09T00:15:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: "omap_total_removes": 0 2024-05-09T00:15:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: "osd-slow-ops": { 2024-05-09T00:15:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: "slow_ops_count": 0 2024-05-09T00:15:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: "purge_queue": { 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops": 0, 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_ops_high_water": 0, 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing": 0, 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executing_high_water": 0, 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_executed": 0, 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "pq_item_in_journal": 0 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 1675, 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 1677912, 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 1675, 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-09T00:15:22.975 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 1675, 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 1677912, 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_bytes": { 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-09T00:15:22.976 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 44, 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 12449, 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 44, 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 12449, 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-objecter_ops": { 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 1024, 2024-05-09T00:15:22.977 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:22.978 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-09T00:15:22.978 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-09T00:15:22.978 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:22.978 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:22.978 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 44, 2024-05-09T00:15:22.978 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 44, 2024-05-09T00:15:22.978 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 44, 2024-05-09T00:15:22.978 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 44, 2024-05-09T00:15:22.978 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:22.978 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.978 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.978 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.978 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:22.978 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle": { 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 0, 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 0, 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 0, 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 0, 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 0, 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.979 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.980 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.980 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:22.980 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:22.980 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-write_buf_throttle-0x55c08604e0a0": { 2024-05-09T00:15:22.980 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:22.980 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 3758096384, 2024-05-09T00:15:22.980 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:22.980 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 6, 2024-05-09T00:15:22.980 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 1922, 2024-05-09T00:15:22.980 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:22.980 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 6, 2024-05-09T00:15:22.980 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-09T00:15:22.980 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-09T00:15:22.980 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 6, 2024-05-09T00:15:22.981 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 1922, 2024-05-09T00:15:22.981 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:22.981 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:22.981 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:22.981 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:22.981 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:22.981 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:22.981 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-05-09T00:15:23.057 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:22 smithi171 ceph-mon[47351]: pgmap v387: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-09T00:15:23.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:22 smithi081 ceph-mon[42474]: pgmap v387: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-09T00:15:23.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:22 smithi150 ceph-mon[46187]: pgmap v387: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-09T00:15:23.377 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-05-09T00:15:23.377 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-05-09T00:15:23.377 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-05-09T00:15:23.377 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=9 2024-05-09T00:15:23.377 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-05-09T00:15:23.377 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-05-09T00:15:23.377 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-05-09T00:15:23.378 DEBUG:tasks.check_counter:Getting stats from l 2024-05-09T00:15:23.378 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-09T00:15:23.600 INFO:teuthology.orchestra.run.smithi171.stderr:Inferring config /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/mon.c/config 2024-05-09T00:15:24.670 INFO:teuthology.orchestra.run.smithi171.stdout:{ 2024-05-09T00:15:24.670 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-0": { 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 0, 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 2, 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 0, 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 0, 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 4, 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 0, 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.001538439, 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.000000000, 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.000372607, 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:24.671 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 0 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-1": { 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 2, 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 173, 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 320, 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 182976, 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 5, 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 3, 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.011220719, 2024-05-09T00:15:24.672 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.007019400, 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.001632408, 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 170, 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.018393665, 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000108198 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 182976 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:24.673 INFO:teuthology.orchestra.run.smithi171.stdout: "AsyncMessenger::Worker-2": { 2024-05-09T00:15:24.674 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_messages": 240, 2024-05-09T00:15:24.674 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages": 228, 2024-05-09T00:15:24.674 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_bytes": 1430512, 2024-05-09T00:15:24.674 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_bytes": 129680, 2024-05-09T00:15:24.674 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_created_connections": 2, 2024-05-09T00:15:24.674 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_active_connections": 1, 2024-05-09T00:15:24.674 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_total_time": 0.046841671, 2024-05-09T00:15:24.674 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_send_time": 0.014600438, 2024-05-09T00:15:24.674 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_recv_time": 0.033434466, 2024-05-09T00:15:24.674 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_running_fast_dispatch_time": 0.006202700, 2024-05-09T00:15:24.674 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_messages_queue_lat": { 2024-05-09T00:15:24.674 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 228, 2024-05-09T00:15:24.674 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.014599550, 2024-05-09T00:15:24.674 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000064033 2024-05-09T00:15:24.675 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:24.675 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_handle_ack_lat": { 2024-05-09T00:15:24.675 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:24.675 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:24.675 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:24.675 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:24.675 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_recv_encrypted_bytes": 1430512, 2024-05-09T00:15:24.675 INFO:teuthology.orchestra.run.smithi171.stdout: "msgr_send_encrypted_bytes": 129680 2024-05-09T00:15:24.675 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:24.675 INFO:teuthology.orchestra.run.smithi171.stdout: "cct": { 2024-05-09T00:15:24.675 INFO:teuthology.orchestra.run.smithi171.stdout: "total_workers": 0, 2024-05-09T00:15:24.675 INFO:teuthology.orchestra.run.smithi171.stdout: "unhealthy_workers": 0 2024-05-09T00:15:24.675 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:24.675 INFO:teuthology.orchestra.run.smithi171.stdout: "mempool": { 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_bytes": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bloom_filter_items": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_bytes": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_alloc_items": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_bytes": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_data_items": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_onode_items": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_meta_items": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_bytes": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_other_items": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_cache_buffer_items": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_bytes": 0, 2024-05-09T00:15:24.676 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_extent_items": 0, 2024-05-09T00:15:24.677 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_bytes": 0, 2024-05-09T00:15:24.677 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_blob_items": 0, 2024-05-09T00:15:24.677 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-09T00:15:24.677 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_shared_blob_items": 0, 2024-05-09T00:15:24.677 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-09T00:15:24.677 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_inline_bl_items": 0, 2024-05-09T00:15:24.677 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_bytes": 0, 2024-05-09T00:15:24.677 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_fsck_items": 0, 2024-05-09T00:15:24.677 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_bytes": 0, 2024-05-09T00:15:24.677 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_txc_items": 0, 2024-05-09T00:15:24.677 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-09T00:15:24.677 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_deferred_items": 0, 2024-05-09T00:15:24.677 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_bytes": 0, 2024-05-09T00:15:24.677 INFO:teuthology.orchestra.run.smithi171.stdout: "bluestore_writing_items": 0, 2024-05-09T00:15:24.678 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_bytes": 0, 2024-05-09T00:15:24.678 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_items": 0, 2024-05-09T00:15:24.678 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_bytes": 0, 2024-05-09T00:15:24.678 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_reader_items": 0, 2024-05-09T00:15:24.678 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_bytes": 0, 2024-05-09T00:15:24.678 INFO:teuthology.orchestra.run.smithi171.stdout: "bluefs_file_writer_items": 0, 2024-05-09T00:15:24.678 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_bytes": 149017, 2024-05-09T00:15:24.678 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_anon_items": 31, 2024-05-09T00:15:24.678 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_bytes": 0, 2024-05-09T00:15:24.678 INFO:teuthology.orchestra.run.smithi171.stdout: "buffer_meta_items": 0, 2024-05-09T00:15:24.678 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_bytes": 0, 2024-05-09T00:15:24.678 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_items": 0, 2024-05-09T00:15:24.678 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_bytes": 0, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_mapbl_items": 0, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_bytes": 0, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "osd_pglog_items": 0, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_bytes": 0, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_items": 0, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_bytes": 0, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "osdmap_mapping_items": 0, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_bytes": 0, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "pgmap_items": 0, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_bytes": 928, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "mds_co_items": 2, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_bytes": 0, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_1_items": 0, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_bytes": 0, 2024-05-09T00:15:24.679 INFO:teuthology.orchestra.run.smithi171.stdout: "unittest_2_items": 0 2024-05-09T00:15:24.680 INFO:teuthology.orchestra.run.smithi171.stdout: }, 2024-05-09T00:15:24.680 INFO:teuthology.orchestra.run.smithi171.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-09T00:15:24.680 INFO:teuthology.orchestra.run.smithi171.stdout: "val": 0, 2024-05-09T00:15:24.680 INFO:teuthology.orchestra.run.smithi171.stdout: "max": 104857600, 2024-05-09T00:15:24.680 INFO:teuthology.orchestra.run.smithi171.stdout: "get_started": 0, 2024-05-09T00:15:24.680 INFO:teuthology.orchestra.run.smithi171.stdout: "get": 238, 2024-05-09T00:15:24.680 INFO:teuthology.orchestra.run.smithi171.stdout: "get_sum": 1394148, 2024-05-09T00:15:24.680 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_fail": 0, 2024-05-09T00:15:24.680 INFO:teuthology.orchestra.run.smithi171.stdout: "get_or_fail_success": 238, 2024-05-09T00:15:24.680 INFO:teuthology.orchestra.run.smithi171.stdout: "take": 0, 2024-05-09T00:15:24.680 INFO:teuthology.orchestra.run.smithi171.stdout: "take_sum": 0, 2024-05-09T00:15:24.680 INFO:teuthology.orchestra.run.smithi171.stdout: "put": 238, 2024-05-09T00:15:24.680 INFO:teuthology.orchestra.run.smithi171.stdout: "put_sum": 1394148, 2024-05-09T00:15:24.680 INFO:teuthology.orchestra.run.smithi171.stdout: "wait": { 2024-05-09T00:15:24.681 INFO:teuthology.orchestra.run.smithi171.stdout: "avgcount": 0, 2024-05-09T00:15:24.681 INFO:teuthology.orchestra.run.smithi171.stdout: "sum": 0.000000000, 2024-05-09T00:15:24.681 INFO:teuthology.orchestra.run.smithi171.stdout: "avgtime": 0.000000000 2024-05-09T00:15:24.681 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:24.681 INFO:teuthology.orchestra.run.smithi171.stdout: } 2024-05-09T00:15:24.681 INFO:teuthology.orchestra.run.smithi171.stdout:} 2024-05-09T00:15:25.018 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:24 smithi171 ceph-mon[47351]: pgmap v388: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-09T00:15:25.074 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-05-09T00:15:25.075 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-05-09T00:15:25.075 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-05-09T00:15:25.075 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-05-09T00:15:25.075 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-05-09T00:15:25.075 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-05-09T00:15:25.075 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-05-09T00:15:25.075 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-09T00:15:25.086 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-09T00:15:25.086 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-09T00:15:25.086 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:15:25.109 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-05-09T00:15:25.109 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-09T00:15:25.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:24 smithi081 ceph-mon[42474]: pgmap v388: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-09T00:15:25.144 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:15:25.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:24 smithi150 ceph-mon[46187]: pgmap v388: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-09T00:15:25.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.321+0000 7f7d0a64b700 1 -- 172.21.15.81:0/3187711424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d04105070 msgr2=0x7f7d0410cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.321+0000 7f7d0a64b700 1 --2- 172.21.15.81:0/3187711424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d04105070 0x7f7d0410cbf0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc00b0a0 tx=0x7f7cfc00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.321+0000 7f7d0a64b700 1 -- 172.21.15.81:0/3187711424 shutdown_connections 2024-05-09T00:15:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.321+0000 7f7d0a64b700 1 --2- 172.21.15.81:0/3187711424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d04105070 0x7f7d0410cbf0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.321+0000 7f7d0a64b700 1 --2- 172.21.15.81:0/3187711424 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d040fff50 0x7f7d04100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.321+0000 7f7d0a64b700 1 --2- 172.21.15.81:0/3187711424 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d04100900 0x7f7d04104940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.321+0000 7f7d0a64b700 1 -- 172.21.15.81:0/3187711424 >> 172.21.15.81:0/3187711424 conn(0x7f7d040fb810 msgr2=0x7f7d040fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.322+0000 7f7d0a64b700 1 -- 172.21.15.81:0/3187711424 shutdown_connections 2024-05-09T00:15:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.322+0000 7f7d0a64b700 1 -- 172.21.15.81:0/3187711424 wait complete. 2024-05-09T00:15:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.322+0000 7f7d0a64b700 1 Processor -- start 2024-05-09T00:15:25.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.322+0000 7f7d0a64b700 1 -- start start 2024-05-09T00:15:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d0a64b700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d040fff50 0x7f7d041951c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d0a64b700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d04105070 0x7f7d04195700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d0a64b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d04199aa0 0x7f7d04199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:25.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d0a64b700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0419a520 con 0x7f7d04199aa0 2024-05-09T00:15:25.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d0a64b700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0419a690 con 0x7f7d040fff50 2024-05-09T00:15:25.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d0a64b700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0419a850 con 0x7f7d04105070 2024-05-09T00:15:25.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d08be8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d04199aa0 0x7f7d04199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:25.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d08be8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d04199aa0 0x7f7d04199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47484/0 (socket says 172.21.15.81:47484) 2024-05-09T00:15:25.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d08be8700 1 -- 172.21.15.81:0/2282079860 learned_addr learned my addr 172.21.15.81:0/2282079860 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:25.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d037fe700 1 --2- 172.21.15.81:0/2282079860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d04105070 0x7f7d04195700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:25.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d03fff700 1 --2- 172.21.15.81:0/2282079860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d040fff50 0x7f7d041951c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:25.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d08be8700 1 -- 172.21.15.81:0/2282079860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d04105070 msgr2=0x7f7d04195700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d08be8700 1 --2- 172.21.15.81:0/2282079860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d04105070 0x7f7d04195700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d08be8700 1 -- 172.21.15.81:0/2282079860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d040fff50 msgr2=0x7f7d041951c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d08be8700 1 --2- 172.21.15.81:0/2282079860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d040fff50 0x7f7d041951c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d08be8700 1 -- 172.21.15.81:0/2282079860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc009d00 con 0x7f7d04199aa0 2024-05-09T00:15:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.323+0000 7f7d08be8700 1 --2- 172.21.15.81:0/2282079860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d04199aa0 0x7f7d04199f20 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc01e040 tx=0x7f7cfc009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.324+0000 7f7d017fa700 1 -- 172.21.15.81:0/2282079860 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00bc50 con 0x7f7d04199aa0 2024-05-09T00:15:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.324+0000 7f7d017fa700 1 -- 172.21.15.81:0/2282079860 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7cfc004e20 con 0x7f7d04199aa0 2024-05-09T00:15:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.324+0000 7f7d0a64b700 1 -- 172.21.15.81:0/2282079860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d041a1d50 con 0x7f7d04199aa0 2024-05-09T00:15:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.324+0000 7f7d017fa700 1 -- 172.21.15.81:0/2282079860 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc025900 con 0x7f7d04199aa0 2024-05-09T00:15:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.324+0000 7f7d0a64b700 1 -- 172.21.15.81:0/2282079860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d041a21d0 con 0x7f7d04199aa0 2024-05-09T00:15:25.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.324+0000 7f7d0a64b700 1 -- 172.21.15.81:0/2282079860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d04108340 con 0x7f7d04199aa0 2024-05-09T00:15:25.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.326+0000 7f7d017fa700 1 -- 172.21.15.81:0/2282079860 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f7cfc0148d0 con 0x7f7d04199aa0 2024-05-09T00:15:25.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.326+0000 7f7d017fa700 1 --2- 172.21.15.81:0/2282079860 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7cec0a1290 0x7f7cec0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:25.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.326+0000 7f7d03fff700 1 --2- 172.21.15.81:0/2282079860 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7cec0a1290 0x7f7cec0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:25.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.326+0000 7f7d017fa700 1 -- 172.21.15.81:0/2282079860 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f7cfc0d6d50 con 0x7f7d04199aa0 2024-05-09T00:15:25.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.327+0000 7f7d03fff700 1 --2- 172.21.15.81:0/2282079860 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7cec0a1290 0x7f7cec0a3750 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400f660 tx=0x7f7cf4011040 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:25.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.330+0000 7f7d017fa700 1 -- 172.21.15.81:0/2282079860 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7cfc0a0310 con 0x7f7d04199aa0 2024-05-09T00:15:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.531+0000 7f7d0a64b700 1 -- 172.21.15.81:0/2282079860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d04101420 con 0x7f7d04199aa0 2024-05-09T00:15:25.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.532+0000 7f7d017fa700 1 -- 172.21.15.81:0/2282079860 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+23093 (secure 0 0 0) 0x7f7cfc0a3930 con 0x7f7d04199aa0 2024-05-09T00:15:25.531 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:15:25.531 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":95,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:15:17.800854+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":94,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/907969237":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/589390516":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/1458411552":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1755507053":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/3633496844":"2024-05-10T00:02:58.862694+0000","172.21.15.81:6801/1458411552":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/1903231103":"2024-05-10T00:02:58.862694+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:15:25.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.534+0000 7f7d0a64b700 1 -- 172.21.15.81:0/2282079860 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7cec0a1290 msgr2=0x7f7cec0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.534+0000 7f7d0a64b700 1 --2- 172.21.15.81:0/2282079860 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7cec0a1290 0x7f7cec0a3750 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400f660 tx=0x7f7cf4011040 comp rx=0 tx=0).stop 2024-05-09T00:15:25.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.534+0000 7f7d0a64b700 1 -- 172.21.15.81:0/2282079860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d04199aa0 msgr2=0x7f7d04199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.534+0000 7f7d0a64b700 1 --2- 172.21.15.81:0/2282079860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d04199aa0 0x7f7d04199f20 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc01e040 tx=0x7f7cfc009590 comp rx=0 tx=0).stop 2024-05-09T00:15:25.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.535+0000 7f7d0a64b700 1 -- 172.21.15.81:0/2282079860 shutdown_connections 2024-05-09T00:15:25.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.535+0000 7f7d0a64b700 1 --2- 172.21.15.81:0/2282079860 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7cec0a1290 0x7f7cec0a3750 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.535+0000 7f7d0a64b700 1 --2- 172.21.15.81:0/2282079860 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7d040fff50 0x7f7d041951c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.535+0000 7f7d0a64b700 1 --2- 172.21.15.81:0/2282079860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d04199aa0 0x7f7d04199f20 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.535+0000 7f7d0a64b700 1 --2- 172.21.15.81:0/2282079860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7d04105070 0x7f7d04195700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.535+0000 7f7d0a64b700 1 -- 172.21.15.81:0/2282079860 >> 172.21.15.81:0/2282079860 conn(0x7f7d040fb810 msgr2=0x7f7d040fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.535+0000 7f7d0a64b700 1 -- 172.21.15.81:0/2282079860 shutdown_connections 2024-05-09T00:15:25.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.535+0000 7f7d0a64b700 1 -- 172.21.15.81:0/2282079860 wait complete. 2024-05-09T00:15:25.546 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T23:58:34.523249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-09T00:01:43.149260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-09T00:01:44.182730+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '94', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 19, 'snap_epoch': 94, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-09T00:15:25.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-09T00:15:25.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.675+0000 7f481b8af700 1 -- 172.21.15.81:0/803209035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4814106280 msgr2=0x7f481410de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.675+0000 7f481b8af700 1 --2- 172.21.15.81:0/803209035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4814106280 0x7f481410de00 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f480c00b0a0 tx=0x7f480c00b3b0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.675+0000 7f481b8af700 1 -- 172.21.15.81:0/803209035 shutdown_connections 2024-05-09T00:15:25.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.675+0000 7f481b8af700 1 --2- 172.21.15.81:0/803209035 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4814106280 0x7f481410de00 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.675+0000 7f481b8af700 1 --2- 172.21.15.81:0/803209035 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4814101160 0x7f4814101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.675+0000 7f481b8af700 1 --2- 172.21.15.81:0/803209035 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4814101b10 0x7f4814105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.675+0000 7f481b8af700 1 -- 172.21.15.81:0/803209035 >> 172.21.15.81:0/803209035 conn(0x7f48140fc9e0 msgr2=0x7f48140fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:25.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.675+0000 7f481b8af700 1 -- 172.21.15.81:0/803209035 shutdown_connections 2024-05-09T00:15:25.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.675+0000 7f481b8af700 1 -- 172.21.15.81:0/803209035 wait complete. 2024-05-09T00:15:25.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f481b8af700 1 Processor -- start 2024-05-09T00:15:25.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f481b8af700 1 -- start start 2024-05-09T00:15:25.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f481b8af700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4814101160 0x7f4814199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:25.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f481b8af700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4814106280 0x7f4814199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:25.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f481b8af700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f481419cfa0 0x7f481419d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:25.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f481b8af700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481419d990 con 0x7f481419cfa0 2024-05-09T00:15:25.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f481b8af700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481419db00 con 0x7f4814101160 2024-05-09T00:15:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f481b8af700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481419dcc0 con 0x7f4814106280 2024-05-09T00:15:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f4819e4c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f481419cfa0 0x7f481419d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f4819e4c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f481419cfa0 0x7f481419d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47494/0 (socket says 172.21.15.81:47494) 2024-05-09T00:15:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f4819e4c700 1 -- 172.21.15.81:0/2464247767 learned_addr learned my addr 172.21.15.81:0/2464247767 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f4818e4a700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4814106280 0x7f4814199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f481964b700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4814101160 0x7f4814199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f4819e4c700 1 -- 172.21.15.81:0/2464247767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4814106280 msgr2=0x7f4814199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f4819e4c700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4814106280 0x7f4814199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f4819e4c700 1 -- 172.21.15.81:0/2464247767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4814101160 msgr2=0x7f4814199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f4819e4c700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4814101160 0x7f4814199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f4819e4c700 1 -- 172.21.15.81:0/2464247767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c009d00 con 0x7f481419cfa0 2024-05-09T00:15:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f481964b700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4814101160 0x7f4814199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:25.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f4819e4c700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f481419cfa0 0x7f481419d450 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f480c006130 tx=0x7f480c009170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:25.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.676+0000 7f480a7fc700 1 -- 172.21.15.81:0/2464247767 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c00e040 con 0x7f481419cfa0 2024-05-09T00:15:25.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.677+0000 7f481b8af700 1 -- 172.21.15.81:0/2464247767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48141a6330 con 0x7f481419cfa0 2024-05-09T00:15:25.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.677+0000 7f480a7fc700 1 -- 172.21.15.81:0/2464247767 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f480c004e40 con 0x7f481419cfa0 2024-05-09T00:15:25.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.677+0000 7f480a7fc700 1 -- 172.21.15.81:0/2464247767 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c01b7d0 con 0x7f481419cfa0 2024-05-09T00:15:25.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.677+0000 7f481b8af700 1 -- 172.21.15.81:0/2464247767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48141a67b0 con 0x7f481419cfa0 2024-05-09T00:15:25.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.678+0000 7f481b8af700 1 -- 172.21.15.81:0/2464247767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4814102630 con 0x7f481419cfa0 2024-05-09T00:15:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.679+0000 7f480a7fc700 1 -- 172.21.15.81:0/2464247767 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f480c01da40 con 0x7f481419cfa0 2024-05-09T00:15:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.679+0000 7f480a7fc700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f48000a12c0 0x7f48000a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.679+0000 7f481964b700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f48000a12c0 0x7f48000a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.679+0000 7f480a7fc700 1 -- 172.21.15.81:0/2464247767 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f480c0ce900 con 0x7f481419cfa0 2024-05-09T00:15:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.680+0000 7f481964b700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f48000a12c0 0x7f48000a3780 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4804005fd0 tx=0x7f4804005e20 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:25.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.683+0000 7f480a7fc700 1 -- 172.21.15.81:0/2464247767 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f480c097db0 con 0x7f481419cfa0 2024-05-09T00:15:25.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.880+0000 7f481b8af700 1 -- 172.21.15.81:0/2464247767 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f481419aa70 con 0x7f481419cfa0 2024-05-09T00:15:25.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.881+0000 7f480a7fc700 1 -- 172.21.15.81:0/2464247767 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f480c02e380 con 0x7f481419cfa0 2024-05-09T00:15:25.879 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-05-09T00:15:25.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.883+0000 7f481b8af700 1 -- 172.21.15.81:0/2464247767 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f48000a12c0 msgr2=0x7f48000a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.883+0000 7f481b8af700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f48000a12c0 0x7f48000a3780 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4804005fd0 tx=0x7f4804005e20 comp rx=0 tx=0).stop 2024-05-09T00:15:25.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.883+0000 7f481b8af700 1 -- 172.21.15.81:0/2464247767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f481419cfa0 msgr2=0x7f481419d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:25.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.883+0000 7f481b8af700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f481419cfa0 0x7f481419d450 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f480c006130 tx=0x7f480c009170 comp rx=0 tx=0).stop 2024-05-09T00:15:25.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.883+0000 7f481b8af700 1 -- 172.21.15.81:0/2464247767 shutdown_connections 2024-05-09T00:15:25.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.883+0000 7f481b8af700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f48000a12c0 0x7f48000a3780 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.883+0000 7f481b8af700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4814101160 0x7f4814199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.883+0000 7f481b8af700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f481419cfa0 0x7f481419d450 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.883+0000 7f481b8af700 1 --2- 172.21.15.81:0/2464247767 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4814106280 0x7f4814199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:25.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.883+0000 7f481b8af700 1 -- 172.21.15.81:0/2464247767 >> 172.21.15.81:0/2464247767 conn(0x7f48140fc9e0 msgr2=0x7f48140fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:25.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.883+0000 7f481b8af700 1 -- 172.21.15.81:0/2464247767 shutdown_connections 2024-05-09T00:15:25.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:25.883+0000 7f481b8af700 1 -- 172.21.15.81:0/2464247767 wait complete. 2024-05-09T00:15:25.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-09T00:15:26.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.021+0000 7fd89919e700 1 -- 172.21.15.81:0/760874212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8941008d0 msgr2=0x7fd894104910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.021+0000 7fd89919e700 1 --2- 172.21.15.81:0/760874212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8941008d0 0x7fd894104910 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fd884009990 tx=0x7fd884009ca0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.021+0000 7fd89919e700 1 -- 172.21.15.81:0/760874212 shutdown_connections 2024-05-09T00:15:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.021+0000 7fd89919e700 1 --2- 172.21.15.81:0/760874212 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd894105040 0x7fd89410cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.021+0000 7fd89919e700 1 --2- 172.21.15.81:0/760874212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8940fff20 0x7fd894100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.021+0000 7fd89919e700 1 --2- 172.21.15.81:0/760874212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8941008d0 0x7fd894104910 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.021+0000 7fd89919e700 1 -- 172.21.15.81:0/760874212 >> 172.21.15.81:0/760874212 conn(0x7fd8940fb7a0 msgr2=0x7fd8940fdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.021+0000 7fd89919e700 1 -- 172.21.15.81:0/760874212 shutdown_connections 2024-05-09T00:15:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.021+0000 7fd89919e700 1 -- 172.21.15.81:0/760874212 wait complete. 2024-05-09T00:15:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd89919e700 1 Processor -- start 2024-05-09T00:15:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd89919e700 1 -- start start 2024-05-09T00:15:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd89919e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8940fff20 0x7fd894197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd89919e700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd894105040 0x7fd894197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd89919e700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd89419bbc0 0x7fd89419c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd89919e700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89419c640 con 0x7fd894105040 2024-05-09T00:15:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd89919e700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89419c7b0 con 0x7fd89419bbc0 2024-05-09T00:15:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd89919e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89419c970 con 0x7fd8940fff20 2024-05-09T00:15:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd8937fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd894105040 0x7fd894197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd8937fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd894105040 0x7fd894197870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47504/0 (socket says 172.21.15.81:47504) 2024-05-09T00:15:26.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd8937fe700 1 -- 172.21.15.81:0/1137473790 learned_addr learned my addr 172.21.15.81:0/1137473790 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd893fff700 1 --2- 172.21.15.81:0/1137473790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8940fff20 0x7fd894197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd89899d700 1 --2- 172.21.15.81:0/1137473790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd89419bbc0 0x7fd89419c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd8937fe700 1 -- 172.21.15.81:0/1137473790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8940fff20 msgr2=0x7fd894197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd8937fe700 1 --2- 172.21.15.81:0/1137473790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8940fff20 0x7fd894197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd8937fe700 1 -- 172.21.15.81:0/1137473790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd89419bbc0 msgr2=0x7fd89419c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd8937fe700 1 --2- 172.21.15.81:0/1137473790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd89419bbc0 0x7fd89419c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.022+0000 7fd8937fe700 1 -- 172.21.15.81:0/1137473790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8840095f0 con 0x7fd894105040 2024-05-09T00:15:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.023+0000 7fd8937fe700 1 --2- 172.21.15.81:0/1137473790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd894105040 0x7fd894197870 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fd8840059d0 tx=0x7fd884004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.023+0000 7fd8917fa700 1 -- 172.21.15.81:0/1137473790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88401d070 con 0x7fd894105040 2024-05-09T00:15:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.023+0000 7fd8917fa700 1 -- 172.21.15.81:0/1137473790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd884022470 con 0x7fd894105040 2024-05-09T00:15:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.023+0000 7fd89919e700 1 -- 172.21.15.81:0/1137473790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8941a3e70 con 0x7fd894105040 2024-05-09T00:15:26.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.023+0000 7fd8917fa700 1 -- 172.21.15.81:0/1137473790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd884017650 con 0x7fd894105040 2024-05-09T00:15:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.023+0000 7fd89919e700 1 -- 172.21.15.81:0/1137473790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8941a4230 con 0x7fd894105040 2024-05-09T00:15:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.024+0000 7fd89919e700 1 -- 172.21.15.81:0/1137473790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd894109320 con 0x7fd894105040 2024-05-09T00:15:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.025+0000 7fd8917fa700 1 -- 172.21.15.81:0/1137473790 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fd8840225e0 con 0x7fd894105040 2024-05-09T00:15:26.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.025+0000 7fd8917fa700 1 --2- 172.21.15.81:0/1137473790 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd87c0a1310 0x7fd87c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.025+0000 7fd893fff700 1 --2- 172.21.15.81:0/1137473790 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd87c0a1310 0x7fd87c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.025+0000 7fd8917fa700 1 -- 172.21.15.81:0/1137473790 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fd8840ce0b0 con 0x7fd894105040 2024-05-09T00:15:26.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.026+0000 7fd893fff700 1 --2- 172.21.15.81:0/1137473790 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd87c0a1310 0x7fd87c0a37d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd888009c60 tx=0x7fd888009260 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:26.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.030+0000 7fd8917fa700 1 -- 172.21.15.81:0/1137473790 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd884097500 con 0x7fd894105040 2024-05-09T00:15:26.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:25 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2282079860' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:15:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.228+0000 7fd89919e700 1 -- 172.21.15.81:0/1137473790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8941985e0 con 0x7fd894105040 2024-05-09T00:15:26.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.228+0000 7fd8917fa700 1 -- 172.21.15.81:0/1137473790 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd88409ab20 con 0x7fd894105040 2024-05-09T00:15:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-05-09T00:15:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.230+0000 7fd89919e700 1 -- 172.21.15.81:0/1137473790 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd87c0a1310 msgr2=0x7fd87c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.230+0000 7fd89919e700 1 --2- 172.21.15.81:0/1137473790 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd87c0a1310 0x7fd87c0a37d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd888009c60 tx=0x7fd888009260 comp rx=0 tx=0).stop 2024-05-09T00:15:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.230+0000 7fd89919e700 1 -- 172.21.15.81:0/1137473790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd894105040 msgr2=0x7fd894197870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.230+0000 7fd89919e700 1 --2- 172.21.15.81:0/1137473790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd894105040 0x7fd894197870 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7fd8840059d0 tx=0x7fd884004730 comp rx=0 tx=0).stop 2024-05-09T00:15:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.230+0000 7fd89919e700 1 -- 172.21.15.81:0/1137473790 shutdown_connections 2024-05-09T00:15:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.230+0000 7fd89919e700 1 --2- 172.21.15.81:0/1137473790 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fd87c0a1310 0x7fd87c0a37d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.230+0000 7fd89919e700 1 --2- 172.21.15.81:0/1137473790 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fd89419bbc0 0x7fd89419c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.230+0000 7fd89919e700 1 --2- 172.21.15.81:0/1137473790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd8940fff20 0x7fd894197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.230+0000 7fd89919e700 1 --2- 172.21.15.81:0/1137473790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd894105040 0x7fd894197870 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.230+0000 7fd89919e700 1 -- 172.21.15.81:0/1137473790 >> 172.21.15.81:0/1137473790 conn(0x7fd8940fb7a0 msgr2=0x7fd894069440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.230+0000 7fd89919e700 1 -- 172.21.15.81:0/1137473790 shutdown_connections 2024-05-09T00:15:26.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.230+0000 7fd89919e700 1 -- 172.21.15.81:0/1137473790 wait complete. 2024-05-09T00:15:26.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-09T00:15:26.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:25 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2282079860' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:15:26.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:25 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2282079860' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:15:26.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.369+0000 7f992c7a7700 1 -- 172.21.15.81:0/56258754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9924106290 msgr2=0x7f992410de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.369+0000 7f992c7a7700 1 --2- 172.21.15.81:0/56258754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9924106290 0x7f992410de10 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f991c00b0d0 tx=0x7f991c00b3e0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.369+0000 7f992c7a7700 1 -- 172.21.15.81:0/56258754 shutdown_connections 2024-05-09T00:15:26.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.369+0000 7f992c7a7700 1 --2- 172.21.15.81:0/56258754 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f99240682e0 0x7f99240686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.369+0000 7f992c7a7700 1 --2- 172.21.15.81:0/56258754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9924106290 0x7f992410de10 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.369+0000 7f992c7a7700 1 --2- 172.21.15.81:0/56258754 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9924068c90 0x7f9924105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.369+0000 7f992c7a7700 1 -- 172.21.15.81:0/56258754 >> 172.21.15.81:0/56258754 conn(0x7f9924076f40 msgr2=0x7f9924077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:26.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.369+0000 7f992c7a7700 1 -- 172.21.15.81:0/56258754 shutdown_connections 2024-05-09T00:15:26.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.369+0000 7f992c7a7700 1 -- 172.21.15.81:0/56258754 wait complete. 2024-05-09T00:15:26.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992c7a7700 1 Processor -- start 2024-05-09T00:15:26.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992c7a7700 1 -- start start 2024-05-09T00:15:26.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992c7a7700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99240682e0 0x7f99241974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:26.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992c7a7700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9924106290 0x7f9924197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:26.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992c7a7700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992419bdd0 0x7f992419c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:26.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992c7a7700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992419c850 con 0x7f992419bdd0 2024-05-09T00:15:26.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992c7a7700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992419c9c0 con 0x7f9924106290 2024-05-09T00:15:26.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992c7a7700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992419cb80 con 0x7f99240682e0 2024-05-09T00:15:26.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992ad44700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992419bdd0 0x7f992419c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:26.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992ad44700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992419bdd0 0x7f992419c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47524/0 (socket says 172.21.15.81:47524) 2024-05-09T00:15:26.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992ad44700 1 -- 172.21.15.81:0/926103338 learned_addr learned my addr 172.21.15.81:0/926103338 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:26.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f9929d42700 1 --2- 172.21.15.81:0/926103338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9924106290 0x7f9924197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:26.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992a543700 1 --2- 172.21.15.81:0/926103338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99240682e0 0x7f99241974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:26.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992ad44700 1 -- 172.21.15.81:0/926103338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99240682e0 msgr2=0x7f99241974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992ad44700 1 --2- 172.21.15.81:0/926103338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99240682e0 0x7f99241974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992ad44700 1 -- 172.21.15.81:0/926103338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9924106290 msgr2=0x7f9924197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992ad44700 1 --2- 172.21.15.81:0/926103338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9924106290 0x7f9924197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.370+0000 7f992ad44700 1 -- 172.21.15.81:0/926103338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c009d00 con 0x7f992419bdd0 2024-05-09T00:15:26.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.371+0000 7f992ad44700 1 --2- 172.21.15.81:0/926103338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992419bdd0 0x7f992419c250 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f991c0077f0 tx=0x7f991c0078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:26.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.371+0000 7f991b7fe700 1 -- 172.21.15.81:0/926103338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c00e040 con 0x7f992419bdd0 2024-05-09T00:15:26.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.371+0000 7f992c7a7700 1 -- 172.21.15.81:0/926103338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99241a4080 con 0x7f992419bdd0 2024-05-09T00:15:26.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.371+0000 7f991b7fe700 1 -- 172.21.15.81:0/926103338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f991c003c10 con 0x7f992419bdd0 2024-05-09T00:15:26.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.371+0000 7f991b7fe700 1 -- 172.21.15.81:0/926103338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c01b710 con 0x7f992419bdd0 2024-05-09T00:15:26.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.371+0000 7f992c7a7700 1 -- 172.21.15.81:0/926103338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99241a44a0 con 0x7f992419bdd0 2024-05-09T00:15:26.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.372+0000 7f992c7a7700 1 -- 172.21.15.81:0/926103338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99241094f0 con 0x7f992419bdd0 2024-05-09T00:15:26.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.373+0000 7f991b7fe700 1 -- 172.21.15.81:0/926103338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f991c0050d0 con 0x7f992419bdd0 2024-05-09T00:15:26.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.374+0000 7f991b7fe700 1 --2- 172.21.15.81:0/926103338 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f99100a1290 0x7f99100a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:26.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.374+0000 7f992a543700 1 --2- 172.21.15.81:0/926103338 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f99100a1290 0x7f99100a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:26.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.374+0000 7f991b7fe700 1 -- 172.21.15.81:0/926103338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f991c0ce810 con 0x7f992419bdd0 2024-05-09T00:15:26.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.374+0000 7f992a543700 1 --2- 172.21.15.81:0/926103338 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f99100a1290 0x7f99100a3750 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9920005fd0 tx=0x7f992000a560 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:26.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.377+0000 7f991b7fe700 1 -- 172.21.15.81:0/926103338 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f991c097cc0 con 0x7f992419bdd0 2024-05-09T00:15:26.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.573+0000 7f992c7a7700 1 -- 172.21.15.81:0/926103338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99241987f0 con 0x7f992419bdd0 2024-05-09T00:15:26.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.573+0000 7f991b7fe700 1 -- 172.21.15.81:0/926103338 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f991c09b2e0 con 0x7f992419bdd0 2024-05-09T00:15:26.572 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-05-09T00:15:26.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.575+0000 7f992c7a7700 1 -- 172.21.15.81:0/926103338 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f99100a1290 msgr2=0x7f99100a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.575+0000 7f992c7a7700 1 --2- 172.21.15.81:0/926103338 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f99100a1290 0x7f99100a3750 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9920005fd0 tx=0x7f992000a560 comp rx=0 tx=0).stop 2024-05-09T00:15:26.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.575+0000 7f992c7a7700 1 -- 172.21.15.81:0/926103338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992419bdd0 msgr2=0x7f992419c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.575+0000 7f992c7a7700 1 --2- 172.21.15.81:0/926103338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992419bdd0 0x7f992419c250 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f991c0077f0 tx=0x7f991c0078d0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.576+0000 7f992c7a7700 1 -- 172.21.15.81:0/926103338 shutdown_connections 2024-05-09T00:15:26.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.576+0000 7f992c7a7700 1 --2- 172.21.15.81:0/926103338 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f99100a1290 0x7f99100a3750 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.576+0000 7f992c7a7700 1 --2- 172.21.15.81:0/926103338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f992419bdd0 0x7f992419c250 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.576+0000 7f992c7a7700 1 --2- 172.21.15.81:0/926103338 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f99240682e0 0x7f99241974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.576+0000 7f992c7a7700 1 --2- 172.21.15.81:0/926103338 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f9924106290 0x7f9924197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.576+0000 7f992c7a7700 1 -- 172.21.15.81:0/926103338 >> 172.21.15.81:0/926103338 conn(0x7f9924076f40 msgr2=0x7f99240fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:26.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.576+0000 7f992c7a7700 1 -- 172.21.15.81:0/926103338 shutdown_connections 2024-05-09T00:15:26.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.576+0000 7f992c7a7700 1 -- 172.21.15.81:0/926103338 wait complete. 2024-05-09T00:15:26.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-09T00:15:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.711+0000 7f6e811dc700 1 -- 172.21.15.81:0/3203394120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c100a10 msgr2=0x7f6e7c104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.711+0000 7f6e811dc700 1 --2- 172.21.15.81:0/3203394120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c100a10 0x7f6e7c104a40 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f6e64009990 tx=0x7f6e64009ca0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.711+0000 7f6e811dc700 1 -- 172.21.15.81:0/3203394120 shutdown_connections 2024-05-09T00:15:26.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.711+0000 7f6e811dc700 1 --2- 172.21.15.81:0/3203394120 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e7c105170 0x7f6e7c10ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.711+0000 7f6e811dc700 1 --2- 172.21.15.81:0/3203394120 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e7c100060 0x7f6e7c100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.711+0000 7f6e811dc700 1 --2- 172.21.15.81:0/3203394120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c100a10 0x7f6e7c104a40 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.711+0000 7f6e811dc700 1 -- 172.21.15.81:0/3203394120 >> 172.21.15.81:0/3203394120 conn(0x7f6e7c076f30 msgr2=0x7f6e7c077340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.711+0000 7f6e811dc700 1 -- 172.21.15.81:0/3203394120 shutdown_connections 2024-05-09T00:15:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.711+0000 7f6e811dc700 1 -- 172.21.15.81:0/3203394120 wait complete. 2024-05-09T00:15:26.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.712+0000 7f6e811dc700 1 Processor -- start 2024-05-09T00:15:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.712+0000 7f6e811dc700 1 -- start start 2024-05-09T00:15:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.712+0000 7f6e811dc700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e7c100060 0x7f6e7c197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.712+0000 7f6e811dc700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c105170 0x7f6e7c197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.712+0000 7f6e811dc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e7c19bcf0 0x7f6e7c19c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.712+0000 7f6e811dc700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c19c770 con 0x7f6e7c105170 2024-05-09T00:15:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.712+0000 7f6e811dc700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c19c8e0 con 0x7f6e7c100060 2024-05-09T00:15:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.712+0000 7f6e811dc700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c19caa0 con 0x7f6e7c19bcf0 2024-05-09T00:15:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.712+0000 7f6e7a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c105170 0x7f6e7c197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e7a59c700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c105170 0x7f6e7c197950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47550/0 (socket says 172.21.15.81:47550) 2024-05-09T00:15:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e7a59c700 1 -- 172.21.15.81:0/1870539179 learned_addr learned my addr 172.21.15.81:0/1870539179 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e7ad9d700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e7c100060 0x7f6e7c197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e7b59e700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e7c19bcf0 0x7f6e7c19c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e7a59c700 1 -- 172.21.15.81:0/1870539179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e7c19bcf0 msgr2=0x7f6e7c19c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e7a59c700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e7c19bcf0 0x7f6e7c19c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e7a59c700 1 -- 172.21.15.81:0/1870539179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e7c100060 msgr2=0x7f6e7c197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e7a59c700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e7c100060 0x7f6e7c197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e7a59c700 1 -- 172.21.15.81:0/1870539179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e640095f0 con 0x7f6e7c105170 2024-05-09T00:15:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e7ad9d700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e7c100060 0x7f6e7c197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e7a59c700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c105170 0x7f6e7c197950 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f6e640059d0 tx=0x7f6e64005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e73fff700 1 -- 172.21.15.81:0/1870539179 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6401d070 con 0x7f6e7c105170 2024-05-09T00:15:26.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e811dc700 1 -- 172.21.15.81:0/1870539179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7c1a3fa0 con 0x7f6e7c105170 2024-05-09T00:15:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e73fff700 1 -- 172.21.15.81:0/1870539179 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e64022470 con 0x7f6e7c105170 2024-05-09T00:15:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e73fff700 1 -- 172.21.15.81:0/1870539179 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64017650 con 0x7f6e7c105170 2024-05-09T00:15:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.713+0000 7f6e811dc700 1 -- 172.21.15.81:0/1870539179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7c1a43c0 con 0x7f6e7c105170 2024-05-09T00:15:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.714+0000 7f6e811dc700 1 -- 172.21.15.81:0/1870539179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7c109450 con 0x7f6e7c105170 2024-05-09T00:15:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.715+0000 7f6e73fff700 1 -- 172.21.15.81:0/1870539179 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6e640225e0 con 0x7f6e7c105170 2024-05-09T00:15:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.716+0000 7f6e73fff700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6e680a1290 0x7f6e680a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.716+0000 7f6e7ad9d700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6e680a1290 0x7f6e680a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:26.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.716+0000 7f6e73fff700 1 -- 172.21.15.81:0/1870539179 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f6e640ce880 con 0x7f6e7c105170 2024-05-09T00:15:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.716+0000 7f6e7ad9d700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6e680a1290 0x7f6e680a3750 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c005fd0 tx=0x7f6e6c005ee0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:26.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.720+0000 7f6e73fff700 1 -- 172.21.15.81:0/1870539179 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6e64097d30 con 0x7f6e7c105170 2024-05-09T00:15:26.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:26 smithi081 ceph-mon[42474]: pgmap v389: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-09T00:15:26.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:26 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2464247767' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:15:26.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:26 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1137473790' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:15:26.874 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:26 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/926103338' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:15:26.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.933+0000 7f6e811dc700 1 -- 172.21.15.81:0/1870539179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6e7c198710 con 0x7f6e7c105170 2024-05-09T00:15:26.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.934+0000 7f6e73fff700 1 -- 172.21.15.81:0/1870539179 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v95) v1 ==== 81+0+1000 (secure 0 0 0) 0x7f6e6409b350 con 0x7f6e7c105170 2024-05-09T00:15:26.932 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/907969237 2024-05-10T00:02:58.862694+0000 2024-05-09T00:15:26.932 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/468139746 2024-05-09T23:56:25.210832+0000 2024-05-09T00:15:26.932 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/2080304730 2024-05-09T23:56:25.210832+0000 2024-05-09T00:15:26.932 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/4280496150 2024-05-09T23:56:46.209751+0000 2024-05-09T00:15:26.932 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/2902845226 2024-05-09T23:56:25.210832+0000 2024-05-09T00:15:26.932 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/589390516 2024-05-10T00:02:58.862694+0000 2024-05-09T00:15:26.932 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3549875739 2024-05-09T23:56:25.210832+0000 2024-05-09T00:15:26.932 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/2902845226 2024-05-09T23:56:25.210832+0000 2024-05-09T00:15:26.932 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/4280496150 2024-05-09T23:56:46.209751+0000 2024-05-09T00:15:26.933 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6800/1458411552 2024-05-10T00:02:58.862694+0000 2024-05-09T00:15:26.933 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/983907098 2024-05-09T23:56:46.209751+0000 2024-05-09T00:15:26.933 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1352656946 2024-05-09T23:56:46.209751+0000 2024-05-09T00:15:26.933 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1755507053 2024-05-10T00:02:58.862694+0000 2024-05-09T00:15:26.933 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3479615186 2024-05-09T23:56:46.209751+0000 2024-05-09T00:15:26.933 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/3633496844 2024-05-10T00:02:58.862694+0000 2024-05-09T00:15:26.933 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:6801/1458411552 2024-05-10T00:02:58.862694+0000 2024-05-09T00:15:26.933 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81:0/1903231103 2024-05-10T00:02:58.862694+0000 2024-05-09T00:15:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.936+0000 7f6e811dc700 1 -- 172.21.15.81:0/1870539179 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6e680a1290 msgr2=0x7f6e680a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.936+0000 7f6e811dc700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6e680a1290 0x7f6e680a3750 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c005fd0 tx=0x7f6e6c005ee0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.936+0000 7f6e811dc700 1 -- 172.21.15.81:0/1870539179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c105170 msgr2=0x7f6e7c197950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.936+0000 7f6e811dc700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c105170 0x7f6e7c197950 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f6e640059d0 tx=0x7f6e64005e80 comp rx=0 tx=0).stop 2024-05-09T00:15:26.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.936+0000 7f6e811dc700 1 -- 172.21.15.81:0/1870539179 shutdown_connections 2024-05-09T00:15:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.936+0000 7f6e811dc700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f6e680a1290 0x7f6e680a3750 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.936+0000 7f6e811dc700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6e7c100060 0x7f6e7c197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.936+0000 7f6e811dc700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6e7c19bcf0 0x7f6e7c19c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.936+0000 7f6e811dc700 1 --2- 172.21.15.81:0/1870539179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e7c105170 0x7f6e7c197950 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.936+0000 7f6e811dc700 1 -- 172.21.15.81:0/1870539179 >> 172.21.15.81:0/1870539179 conn(0x7f6e7c076f30 msgr2=0x7f6e7c069630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.936+0000 7f6e811dc700 1 -- 172.21.15.81:0/1870539179 shutdown_connections 2024-05-09T00:15:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:26.936+0000 7f6e811dc700 1 -- 172.21.15.81:0/1870539179 wait complete. 2024-05-09T00:15:26.935 INFO:teuthology.orchestra.run.smithi081.stderr:listed 17 entries 2024-05-09T00:15:26.947 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-09T00:15:26.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:15:26.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-09T00:15:27.012 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-05-09T00:15:27.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:15:27.012 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-09T00:15:27.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:15:27.047 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-05-09T00:15:27.105 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-09T00:15:27.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:15:27.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-09T00:15:27.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-09T00:15:27.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-05-09T00:15:27.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:26 smithi150 ceph-mon[46187]: pgmap v389: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-09T00:15:27.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:26 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2464247767' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:15:27.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:26 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1137473790' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:15:27.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:26 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/926103338' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:15:27.281 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-09T00:15:27.292 INFO:tasks.cephadm:Teardown begin 2024-05-09T00:15:27.292 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-09T00:15:27.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:27.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:26 smithi171 ceph-mon[47351]: pgmap v389: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-09T00:15:27.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:26 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2464247767' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-09T00:15:27.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:26 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1137473790' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-09T00:15:27.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:26 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/926103338' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-09T00:15:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.419+0000 7fb386a3d700 1 -- 172.21.15.81:0/2513280818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb380101a10 msgr2=0x7fb380105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.419+0000 7fb386a3d700 1 --2- 172.21.15.81:0/2513280818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb380101a10 0x7fb380105a50 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fb374009990 tx=0x7fb374009ca0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.419+0000 7fb386a3d700 1 -- 172.21.15.81:0/2513280818 shutdown_connections 2024-05-09T00:15:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.419+0000 7fb386a3d700 1 --2- 172.21.15.81:0/2513280818 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb380106180 0x7fb38010dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.419+0000 7fb386a3d700 1 --2- 172.21.15.81:0/2513280818 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb380101060 0x7fb380101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.419+0000 7fb386a3d700 1 --2- 172.21.15.81:0/2513280818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb380101a10 0x7fb380105a50 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.419+0000 7fb386a3d700 1 -- 172.21.15.81:0/2513280818 >> 172.21.15.81:0/2513280818 conn(0x7fb3800fc960 msgr2=0x7fb3800fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:27.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.419+0000 7fb386a3d700 1 -- 172.21.15.81:0/2513280818 shutdown_connections 2024-05-09T00:15:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.419+0000 7fb386a3d700 1 -- 172.21.15.81:0/2513280818 wait complete. 2024-05-09T00:15:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb386a3d700 1 Processor -- start 2024-05-09T00:15:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb386a3d700 1 -- start start 2024-05-09T00:15:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb386a3d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb380101060 0x7fb380197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb386a3d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb380106180 0x7fb3801977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb386a3d700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb38019bb70 0x7fb38019bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb386a3d700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38019c5f0 con 0x7fb380106180 2024-05-09T00:15:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb386a3d700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38019c760 con 0x7fb38019bb70 2024-05-09T00:15:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb386a3d700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38019c920 con 0x7fb380101060 2024-05-09T00:15:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb37f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb380106180 0x7fb3801977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb37f7fe700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb380106180 0x7fb3801977d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47372/0 (socket says 172.21.15.81:47372) 2024-05-09T00:15:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb37f7fe700 1 -- 172.21.15.81:0/4165749183 learned_addr learned my addr 172.21.15.81:0/4165749183 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:27.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb384fda700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb38019bb70 0x7fb38019bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb37ffff700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb380101060 0x7fb380197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb37f7fe700 1 -- 172.21.15.81:0/4165749183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb380101060 msgr2=0x7fb380197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb37f7fe700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb380101060 0x7fb380197290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb37f7fe700 1 -- 172.21.15.81:0/4165749183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb38019bb70 msgr2=0x7fb38019bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.420+0000 7fb37f7fe700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb38019bb70 0x7fb38019bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.421+0000 7fb37f7fe700 1 -- 172.21.15.81:0/4165749183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3740095f0 con 0x7fb380106180 2024-05-09T00:15:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.421+0000 7fb384fda700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb38019bb70 0x7fb38019bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:15:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.421+0000 7fb37f7fe700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb380106180 0x7fb3801977d0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fb374005770 tx=0x7fb3740057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.421+0000 7fb37d7fa700 1 -- 172.21.15.81:0/4165749183 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37401d070 con 0x7fb380106180 2024-05-09T00:15:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.421+0000 7fb37d7fa700 1 -- 172.21.15.81:0/4165749183 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb37400fdd0 con 0x7fb380106180 2024-05-09T00:15:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.421+0000 7fb386a3d700 1 -- 172.21.15.81:0/4165749183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3801a3e20 con 0x7fb380106180 2024-05-09T00:15:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.421+0000 7fb37d7fa700 1 -- 172.21.15.81:0/4165749183 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb374022e20 con 0x7fb380106180 2024-05-09T00:15:27.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.421+0000 7fb386a3d700 1 -- 172.21.15.81:0/4165749183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3801a4240 con 0x7fb380106180 2024-05-09T00:15:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.422+0000 7fb386a3d700 1 -- 172.21.15.81:0/4165749183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb380109450 con 0x7fb380106180 2024-05-09T00:15:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.423+0000 7fb37d7fa700 1 -- 172.21.15.81:0/4165749183 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fb37400f910 con 0x7fb380106180 2024-05-09T00:15:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.423+0000 7fb37d7fa700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb3680a1290 0x7fb3680a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.423+0000 7fb37ffff700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb3680a1290 0x7fb3680a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:27.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.423+0000 7fb37d7fa700 1 -- 172.21.15.81:0/4165749183 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fb3740ce850 con 0x7fb380106180 2024-05-09T00:15:27.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.424+0000 7fb37ffff700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb3680a1290 0x7fb3680a3750 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb37000ba60 tx=0x7fb370005d50 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:27.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.427+0000 7fb37d7fa700 1 -- 172.21.15.81:0/4165749183 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb374097d00 con 0x7fb380106180 2024-05-09T00:15:27.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.672+0000 7fb386a3d700 1 -- 172.21.15.81:0/4165749183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3801985c0 con 0x7fb380106180 2024-05-09T00:15:27.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.673+0000 7fb37d7fa700 1 -- 172.21.15.81:0/4165749183 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7fb37409b320 con 0x7fb380106180 2024-05-09T00:15:27.671 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:15:27.671 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:15:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.675+0000 7fb386a3d700 1 -- 172.21.15.81:0/4165749183 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb3680a1290 msgr2=0x7fb3680a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.675+0000 7fb386a3d700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb3680a1290 0x7fb3680a3750 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb37000ba60 tx=0x7fb370005d50 comp rx=0 tx=0).stop 2024-05-09T00:15:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.675+0000 7fb386a3d700 1 -- 172.21.15.81:0/4165749183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb380106180 msgr2=0x7fb3801977d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:27.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.675+0000 7fb386a3d700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb380106180 0x7fb3801977d0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7fb374005770 tx=0x7fb3740057a0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.675+0000 7fb386a3d700 1 -- 172.21.15.81:0/4165749183 shutdown_connections 2024-05-09T00:15:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.675+0000 7fb386a3d700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fb3680a1290 0x7fb3680a3750 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.675+0000 7fb386a3d700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fb38019bb70 0x7fb38019bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.675+0000 7fb386a3d700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb380101060 0x7fb380197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.675+0000 7fb386a3d700 1 --2- 172.21.15.81:0/4165749183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb380106180 0x7fb3801977d0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.675+0000 7fb386a3d700 1 -- 172.21.15.81:0/4165749183 >> 172.21.15.81:0/4165749183 conn(0x7fb3800fc960 msgr2=0x7fb3800fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.675+0000 7fb386a3d700 1 -- 172.21.15.81:0/4165749183 shutdown_connections 2024-05-09T00:15:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.675+0000 7fb386a3d700 1 -- 172.21.15.81:0/4165749183 wait complete. 2024-05-09T00:15:27.674 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:15:27.686 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-09T00:15:27.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.810+0000 7f617d143700 1 -- 172.21.15.81:0/3675584908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6178105060 msgr2=0x7f617810cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:27.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.810+0000 7f617d143700 1 --2- 172.21.15.81:0/3675584908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6178105060 0x7f617810cbe0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f6168009990 tx=0x7f6168009ca0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.810+0000 7f617d143700 1 -- 172.21.15.81:0/3675584908 shutdown_connections 2024-05-09T00:15:27.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.810+0000 7f617d143700 1 --2- 172.21.15.81:0/3675584908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6178105060 0x7f617810cbe0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.810+0000 7f617d143700 1 --2- 172.21.15.81:0/3675584908 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f61780fff40 0x7f6178100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.810+0000 7f617d143700 1 --2- 172.21.15.81:0/3675584908 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f61781008f0 0x7f6178104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.810+0000 7f617d143700 1 -- 172.21.15.81:0/3675584908 >> 172.21.15.81:0/3675584908 conn(0x7f61780fb7e0 msgr2=0x7f61780fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:27.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.810+0000 7f617d143700 1 -- 172.21.15.81:0/3675584908 shutdown_connections 2024-05-09T00:15:27.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.810+0000 7f617d143700 1 -- 172.21.15.81:0/3675584908 wait complete. 2024-05-09T00:15:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.811+0000 7f617d143700 1 Processor -- start 2024-05-09T00:15:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.811+0000 7f617d143700 1 -- start start 2024-05-09T00:15:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.811+0000 7f617d143700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61780fff40 0x7f6178196200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.811+0000 7f617d143700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6178105060 0x7f6178196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:27.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.811+0000 7f617d143700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f617819aae0 0x7f617819af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.811+0000 7f617d143700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617819b560 con 0x7f61780fff40 2024-05-09T00:15:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.811+0000 7f617d143700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617819b6d0 con 0x7f6178105060 2024-05-09T00:15:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.811+0000 7f617d143700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617819b890 con 0x7f617819aae0 2024-05-09T00:15:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.811+0000 7f6176d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61780fff40 0x7f6178196200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.811+0000 7f6176d9d700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61780fff40 0x7f6178196200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47388/0 (socket says 172.21.15.81:47388) 2024-05-09T00:15:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.811+0000 7f6176d9d700 1 -- 172.21.15.81:0/3832713643 learned_addr learned my addr 172.21.15.81:0/3832713643 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.812+0000 7f617659c700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6178105060 0x7f6178196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.812+0000 7f617759e700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f617819aae0 0x7f617819af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.812+0000 7f6176d9d700 1 -- 172.21.15.81:0/3832713643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f617819aae0 msgr2=0x7f617819af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.812+0000 7f6176d9d700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f617819aae0 0x7f617819af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.812+0000 7f6176d9d700 1 -- 172.21.15.81:0/3832713643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6178105060 msgr2=0x7f6178196740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.812+0000 7f6176d9d700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6178105060 0x7f6178196740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.812+0000 7f6176d9d700 1 -- 172.21.15.81:0/3832713643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61680095f0 con 0x7f61780fff40 2024-05-09T00:15:27.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.812+0000 7f617759e700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f617819aae0 0x7f617819af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.812+0000 7f6176d9d700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61780fff40 0x7f6178196200 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f61700060b0 tx=0x7f6170007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.812+0000 7f616ffff700 1 -- 172.21.15.81:0/3832713643 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000de20 con 0x7f61780fff40 2024-05-09T00:15:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.812+0000 7f616ffff700 1 -- 172.21.15.81:0/3832713643 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f617000f040 con 0x7f61780fff40 2024-05-09T00:15:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.812+0000 7f617d143700 1 -- 172.21.15.81:0/3832713643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61781a2df0 con 0x7f61780fff40 2024-05-09T00:15:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.812+0000 7f616ffff700 1 -- 172.21.15.81:0/3832713643 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61700146e0 con 0x7f61780fff40 2024-05-09T00:15:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.812+0000 7f617d143700 1 -- 172.21.15.81:0/3832713643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61781a3270 con 0x7f61780fff40 2024-05-09T00:15:27.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.813+0000 7f617d143700 1 -- 172.21.15.81:0/3832713643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6178108330 con 0x7f61780fff40 2024-05-09T00:15:27.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.814+0000 7f616ffff700 1 -- 172.21.15.81:0/3832713643 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6170015a30 con 0x7f61780fff40 2024-05-09T00:15:27.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.815+0000 7f616ffff700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f61640a1290 0x7f61640a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:27.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.815+0000 7f617659c700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f61640a1290 0x7f61640a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:27.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.815+0000 7f616ffff700 1 -- 172.21.15.81:0/3832713643 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f61700ccc00 con 0x7f61780fff40 2024-05-09T00:15:27.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.815+0000 7f617659c700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f61640a1290 0x7f61640a3750 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6160005950 tx=0x7f61600058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:27.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:27.819+0000 7f616ffff700 1 -- 172.21.15.81:0/3832713643 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6170096020 con 0x7f61780fff40 2024-05-09T00:15:28.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.062+0000 7f617d143700 1 -- 172.21.15.81:0/3832713643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6178067c40 con 0x7f61780fff40 2024-05-09T00:15:28.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.063+0000 7f616ffff700 1 -- 172.21.15.81:0/3832713643 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+10867 (secure 0 0 0) 0x7f6170024090 con 0x7f61780fff40 2024-05-09T00:15:28.061 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:15:28.061 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3510747883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3510747883},{"type":"v1","addr":"172.21.15.81:6835","nonce":3510747883}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/1631947486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6836","nonce":1631947486},{"type":"v1","addr":"172.21.15.81:6837","nonce":1631947486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6839/567553409","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6838","nonce":567553409},{"type":"v1","addr":"172.21.15.81:6839","nonce":567553409}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6841/447183521","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6840","nonce":447183521},{"type":"v1","addr":"172.21.15.81:6841","nonce":447183521}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6833/1750853748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1750853748},{"type":"v1","addr":"172.21.15.171:6833","nonce":1750853748}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.150:6833/3794539364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3794539364},{"type":"v1","addr":"172.21.15.150:6833","nonce":3794539364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-09T00:01:45.018539+0000","modified":"2024-05-09T00:04:16.558845+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24506,"mds_1":24487,"mds_2":24476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24451":{"gid":24451,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6835/259351107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6834","nonce":259351107},{"type":"v1","addr":"172.21.15.171:6835","nonce":259351107}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24452":{"gid":24452,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.150:6835/2480381166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6834","nonce":2480381166},{"type":"v1","addr":"172.21.15.150:6835","nonce":2480381166}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24476":{"gid":24476,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.150:6837/2308594773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6836","nonce":2308594773},{"type":"v1","addr":"172.21.15.150:6837","nonce":2308594773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24487":{"gid":24487,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.171:6839/932961693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6838","nonce":932961693},{"type":"v1","addr":"172.21.15.171:6839","nonce":932961693}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.150:6839/1233365858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6838","nonce":1233365858},{"type":"v1","addr":"172.21.15.150:6839","nonce":1233365858}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25345":{"gid":25345,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.171:6837/1110919655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6836","nonce":1110919655},{"type":"v1","addr":"172.21.15.171:6837","nonce":1110919655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-09T00:15:28.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.065+0000 7f617d143700 1 -- 172.21.15.81:0/3832713643 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f61640a1290 msgr2=0x7f61640a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.065+0000 7f617d143700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f61640a1290 0x7f61640a3750 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6160005950 tx=0x7f61600058e0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.065+0000 7f617d143700 1 -- 172.21.15.81:0/3832713643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61780fff40 msgr2=0x7f6178196200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.065+0000 7f617d143700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61780fff40 0x7f6178196200 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f61700060b0 tx=0x7f6170007f90 comp rx=0 tx=0).stop 2024-05-09T00:15:28.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.065+0000 7f617d143700 1 -- 172.21.15.81:0/3832713643 shutdown_connections 2024-05-09T00:15:28.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.065+0000 7f617d143700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f61640a1290 0x7f61640a3750 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.065+0000 7f617d143700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f617819aae0 0x7f617819af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.065+0000 7f617d143700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61780fff40 0x7f6178196200 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.065+0000 7f617d143700 1 --2- 172.21.15.81:0/3832713643 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f6178105060 0x7f6178196740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.065+0000 7f617d143700 1 -- 172.21.15.81:0/3832713643 >> 172.21.15.81:0/3832713643 conn(0x7f61780fb7e0 msgr2=0x7f61780fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.065+0000 7f617d143700 1 -- 172.21.15.81:0/3832713643 shutdown_connections 2024-05-09T00:15:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.065+0000 7f617d143700 1 -- 172.21.15.81:0/3832713643 wait complete. 2024-05-09T00:15:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 26 2024-05-09T00:15:28.074 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:27 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1870539179' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T00:15:28.074 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:27 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/4165749183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:15:28.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-09T00:15:28.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.200+0000 7fe1312b6700 1 -- 172.21.15.81:0/2901775970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe12c0ff5f0 msgr2=0x7fe12c0ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.200+0000 7fe1312b6700 1 --2- 172.21.15.81:0/2901775970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe12c0ff5f0 0x7fe12c0ff9d0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fe120009990 tx=0x7fe120009ca0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.200+0000 7fe1312b6700 1 -- 172.21.15.81:0/2901775970 shutdown_connections 2024-05-09T00:15:28.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.200+0000 7fe1312b6700 1 --2- 172.21.15.81:0/2901775970 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe12c106200 0x7fe12c10dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.200+0000 7fe1312b6700 1 --2- 172.21.15.81:0/2901775970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe12c0ff5f0 0x7fe12c0ff9d0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.200+0000 7fe1312b6700 1 --2- 172.21.15.81:0/2901775970 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe12c0fffa0 0x7fe12c105ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.200+0000 7fe1312b6700 1 -- 172.21.15.81:0/2901775970 >> 172.21.15.81:0/2901775970 conn(0x7fe12c076240 msgr2=0x7fe12c0fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:28.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.200+0000 7fe1312b6700 1 -- 172.21.15.81:0/2901775970 shutdown_connections 2024-05-09T00:15:28.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.200+0000 7fe1312b6700 1 -- 172.21.15.81:0/2901775970 wait complete. 2024-05-09T00:15:28.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.201+0000 7fe1312b6700 1 Processor -- start 2024-05-09T00:15:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.201+0000 7fe1312b6700 1 -- start start 2024-05-09T00:15:28.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.201+0000 7fe1312b6700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe12c0ff5f0 0x7fe12c1972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.201+0000 7fe1312b6700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe12c106200 0x7fe12c197810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.201+0000 7fe1312b6700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe12c19bbb0 0x7fe12c19c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.201+0000 7fe1312b6700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c19c630 con 0x7fe12c0ff5f0 2024-05-09T00:15:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.201+0000 7fe1312b6700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c19c7a0 con 0x7fe12c106200 2024-05-09T00:15:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.201+0000 7fe1312b6700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c19c960 con 0x7fe12c19bbb0 2024-05-09T00:15:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.201+0000 7fe12affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe12c0ff5f0 0x7fe12c1972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.201+0000 7fe12affd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe12c0ff5f0 0x7fe12c1972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47398/0 (socket says 172.21.15.81:47398) 2024-05-09T00:15:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.201+0000 7fe12affd700 1 -- 172.21.15.81:0/2563240470 learned_addr learned my addr 172.21.15.81:0/2563240470 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.201+0000 7fe12b7fe700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe12c19bbb0 0x7fe12c19c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.201+0000 7fe12a7fc700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe12c106200 0x7fe12c197810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.202+0000 7fe12affd700 1 -- 172.21.15.81:0/2563240470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe12c19bbb0 msgr2=0x7fe12c19c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.202+0000 7fe12affd700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe12c19bbb0 0x7fe12c19c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.202+0000 7fe12affd700 1 -- 172.21.15.81:0/2563240470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe12c106200 msgr2=0x7fe12c197810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.202+0000 7fe12affd700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe12c106200 0x7fe12c197810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.202+0000 7fe12affd700 1 -- 172.21.15.81:0/2563240470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1200095f0 con 0x7fe12c0ff5f0 2024-05-09T00:15:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.202+0000 7fe12a7fc700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe12c106200 0x7fe12c197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-09T00:15:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.202+0000 7fe12affd700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe12c0ff5f0 0x7fe12c1972d0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fe120004760 tx=0x7fe120004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.202+0000 7fe113fff700 1 -- 172.21.15.81:0/2563240470 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12001d070 con 0x7fe12c0ff5f0 2024-05-09T00:15:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.202+0000 7fe113fff700 1 -- 172.21.15.81:0/2563240470 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe120022470 con 0x7fe12c0ff5f0 2024-05-09T00:15:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.202+0000 7fe1312b6700 1 -- 172.21.15.81:0/2563240470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12c1a3e60 con 0x7fe12c0ff5f0 2024-05-09T00:15:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.202+0000 7fe113fff700 1 -- 172.21.15.81:0/2563240470 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe120017650 con 0x7fe12c0ff5f0 2024-05-09T00:15:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.202+0000 7fe1312b6700 1 -- 172.21.15.81:0/2563240470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12c1a4220 con 0x7fe12c0ff5f0 2024-05-09T00:15:28.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.203+0000 7fe1312b6700 1 -- 172.21.15.81:0/2563240470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12c109440 con 0x7fe12c0ff5f0 2024-05-09T00:15:28.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.204+0000 7fe113fff700 1 -- 172.21.15.81:0/2563240470 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe1200225e0 con 0x7fe12c0ff5f0 2024-05-09T00:15:28.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.205+0000 7fe113fff700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1140a1290 0x7fe1140a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:28.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.205+0000 7fe12a7fc700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1140a1290 0x7fe1140a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:28.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.205+0000 7fe113fff700 1 -- 172.21.15.81:0/2563240470 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8572+0+0 (secure 0 0 0) 0x7fe1200ce0f0 con 0x7fe12c0ff5f0 2024-05-09T00:15:28.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.205+0000 7fe12a7fc700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1140a1290 0x7fe1140a3750 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe11c005950 tx=0x7fe11c0058e0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:28.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.208+0000 7fe113fff700 1 -- 172.21.15.81:0/2563240470 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe120097640 con 0x7fe12c0ff5f0 2024-05-09T00:15:28.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:27 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1870539179' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T00:15:28.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:27 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/4165749183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:15:28.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:27 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1870539179' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-09T00:15:28.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:27 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/4165749183' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:15:28.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.407+0000 7fe1312b6700 1 -- 172.21.15.81:0/2563240470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe12c1026a0 con 0x7fe12c0ff5f0 2024-05-09T00:15:28.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.408+0000 7fe113fff700 1 -- 172.21.15.81:0/2563240470 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+23093 (secure 0 0 0) 0x7fe12009ac60 con 0x7fe12c0ff5f0 2024-05-09T00:15:28.407 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-05-09T00:15:28.407 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":95,"fsid":"6c93ddc4-0d96-11ef-bc97-c7b262605968","created":"2024-05-08T23:55:58.923433+0000","modified":"2024-05-09T00:15:17.800854+0000","last_up_change":"2024-05-09T00:01:12.394362+0000","last_in_change":"2024-05-09T00:00:55.884591+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T23:58:34.523249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-09T00:01:43.149260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-09T00:01:44.182730+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":19,"snap_epoch":94,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5eca74f4-ec24-4e6b-a18e-aff734ea3087","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6803","nonce":870674145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6805","nonce":870674145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6809","nonce":870674145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":870674145},{"type":"v1","addr":"172.21.15.81:6807","nonce":870674145}]},"public_addr":"172.21.15.81:6803/870674145","cluster_addr":"172.21.15.81:6805/870674145","heartbeat_back_addr":"172.21.15.81:6809/870674145","heartbeat_front_addr":"172.21.15.81:6807/870674145","state":["exists","up"]},{"osd":1,"uuid":"6663424d-1532-4800-8fd7-b969cf177bc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6801","nonce":149811112}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6803","nonce":149811112}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6807","nonce":149811112}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":149811112},{"type":"v1","addr":"172.21.15.150:6805","nonce":149811112}]},"public_addr":"172.21.15.150:6801/149811112","cluster_addr":"172.21.15.150:6803/149811112","heartbeat_back_addr":"172.21.15.150:6807/149811112","heartbeat_front_addr":"172.21.15.150:6805/149811112","state":["exists","up"]},{"osd":2,"uuid":"c8943079-f99e-4886-ae7f-69ea2917b744","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6801","nonce":1178354999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6803","nonce":1178354999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6807","nonce":1178354999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1178354999},{"type":"v1","addr":"172.21.15.171:6805","nonce":1178354999}]},"public_addr":"172.21.15.171:6801/1178354999","cluster_addr":"172.21.15.171:6803/1178354999","heartbeat_back_addr":"172.21.15.171:6807/1178354999","heartbeat_front_addr":"172.21.15.171:6805/1178354999","state":["exists","up"]},{"osd":3,"uuid":"db48419f-e889-4126-9b11-9f40dee85d82","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6811","nonce":1225293729}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6813","nonce":1225293729}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6817","nonce":1225293729}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1225293729},{"type":"v1","addr":"172.21.15.81:6815","nonce":1225293729}]},"public_addr":"172.21.15.81:6811/1225293729","cluster_addr":"172.21.15.81:6813/1225293729","heartbeat_back_addr":"172.21.15.81:6817/1225293729","heartbeat_front_addr":"172.21.15.81:6815/1225293729","state":["exists","up"]},{"osd":4,"uuid":"72f26a22-e6f4-4e40-85e3-e4907cf5ca9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6809","nonce":2025740814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6811","nonce":2025740814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6815","nonce":2025740814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2025740814},{"type":"v1","addr":"172.21.15.150:6813","nonce":2025740814}]},"public_addr":"172.21.15.150:6809/2025740814","cluster_addr":"172.21.15.150:6811/2025740814","heartbeat_back_addr":"172.21.15.150:6815/2025740814","heartbeat_front_addr":"172.21.15.150:6813/2025740814","state":["exists","up"]},{"osd":5,"uuid":"d6eb056b-a97c-4a6e-9716-4d18d740f456","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6809","nonce":3861165436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6811","nonce":3861165436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6815","nonce":3861165436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":3861165436},{"type":"v1","addr":"172.21.15.171:6813","nonce":3861165436}]},"public_addr":"172.21.15.171:6809/3861165436","cluster_addr":"172.21.15.171:6811/3861165436","heartbeat_back_addr":"172.21.15.171:6815/3861165436","heartbeat_front_addr":"172.21.15.171:6813/3861165436","state":["exists","up"]},{"osd":6,"uuid":"228afbcd-479c-407b-83f2-a51afec0076c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6819","nonce":2589726822}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6821","nonce":2589726822}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6825","nonce":2589726822}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2589726822},{"type":"v1","addr":"172.21.15.81:6823","nonce":2589726822}]},"public_addr":"172.21.15.81:6819/2589726822","cluster_addr":"172.21.15.81:6821/2589726822","heartbeat_back_addr":"172.21.15.81:6825/2589726822","heartbeat_front_addr":"172.21.15.81:6823/2589726822","state":["exists","up"]},{"osd":7,"uuid":"fc45d82f-490e-4708-b8c3-19befc6c6c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6817","nonce":643513018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6819","nonce":643513018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6823","nonce":643513018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":643513018},{"type":"v1","addr":"172.21.15.150:6821","nonce":643513018}]},"public_addr":"172.21.15.150:6817/643513018","cluster_addr":"172.21.15.150:6819/643513018","heartbeat_back_addr":"172.21.15.150:6823/643513018","heartbeat_front_addr":"172.21.15.150:6821/643513018","state":["exists","up"]},{"osd":8,"uuid":"6bec428c-7cf2-4eda-8fab-d2101e275491","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6817","nonce":1718824617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6819","nonce":1718824617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6823","nonce":1718824617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":1718824617},{"type":"v1","addr":"172.21.15.171:6821","nonce":1718824617}]},"public_addr":"172.21.15.171:6817/1718824617","cluster_addr":"172.21.15.171:6819/1718824617","heartbeat_back_addr":"172.21.15.171:6823/1718824617","heartbeat_front_addr":"172.21.15.171:6821/1718824617","state":["exists","up"]},{"osd":9,"uuid":"b5283c55-1261-430c-a956-40670f7470e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6827","nonce":2430864324}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6829","nonce":2430864324}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6833","nonce":2430864324}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2430864324},{"type":"v1","addr":"172.21.15.81:6831","nonce":2430864324}]},"public_addr":"172.21.15.81:6827/2430864324","cluster_addr":"172.21.15.81:6829/2430864324","heartbeat_back_addr":"172.21.15.81:6833/2430864324","heartbeat_front_addr":"172.21.15.81:6831/2430864324","state":["exists","up"]},{"osd":10,"uuid":"ae235e47-d35f-4171-bf0d-a983f53e99b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6825","nonce":867287800}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6827","nonce":867287800}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6831","nonce":867287800}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":867287800},{"type":"v1","addr":"172.21.15.150:6829","nonce":867287800}]},"public_addr":"172.21.15.150:6825/867287800","cluster_addr":"172.21.15.150:6827/867287800","heartbeat_back_addr":"172.21.15.150:6831/867287800","heartbeat_front_addr":"172.21.15.150:6829/867287800","state":["exists","up"]},{"osd":11,"uuid":"d5d8e25c-eca9-4bd7-8d8b-6e8b8f130f5f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6825","nonce":674529273}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6827","nonce":674529273}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6831","nonce":674529273}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":674529273},{"type":"v1","addr":"172.21.15.171:6829","nonce":674529273}]},"public_addr":"172.21.15.171:6825/674529273","cluster_addr":"172.21.15.171:6827/674529273","heartbeat_back_addr":"172.21.15.171:6831/674529273","heartbeat_front_addr":"172.21.15.171:6829/674529273","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:57:56.392868+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:13.901273+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:31.290518+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:58:48.605967+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:06.062259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:25.004985+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:41.783576+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T23:59:59.538537+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:17.485537+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:35.302200+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:00:52.991939+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-09T00:01:10.680469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11},{"from":2,"to":1}]},{"pgid":"3.e","mappings":[{"from":4,"to":6}]},{"pgid":"3.10","mappings":[{"from":5,"to":9}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":7},{"from":5,"to":9}]},{"pgid":"3.1d","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:0/907969237":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/468139746":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/2080304730":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6801/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:0/589390516":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/3549875739":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6800/2902845226":"2024-05-09T23:56:25.210832+0000","172.21.15.81:6801/4280496150":"2024-05-09T23:56:46.209751+0000","172.21.15.81:6800/1458411552":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/983907098":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1352656946":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/1755507053":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/3479615186":"2024-05-09T23:56:46.209751+0000","172.21.15.81:0/3633496844":"2024-05-10T00:02:58.862694+0000","172.21.15.81:6801/1458411552":"2024-05-10T00:02:58.862694+0000","172.21.15.81:0/1903231103":"2024-05-10T00:02:58.862694+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":7,"length":1},{"begin":19,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-09T00:15:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.410+0000 7fe1312b6700 1 -- 172.21.15.81:0/2563240470 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1140a1290 msgr2=0x7fe1140a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.410+0000 7fe1312b6700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1140a1290 0x7fe1140a3750 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe11c005950 tx=0x7fe11c0058e0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.410+0000 7fe1312b6700 1 -- 172.21.15.81:0/2563240470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe12c0ff5f0 msgr2=0x7fe12c1972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.410+0000 7fe1312b6700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe12c0ff5f0 0x7fe12c1972d0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fe120004760 tx=0x7fe120004790 comp rx=0 tx=0).stop 2024-05-09T00:15:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.410+0000 7fe1312b6700 1 -- 172.21.15.81:0/2563240470 shutdown_connections 2024-05-09T00:15:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.410+0000 7fe1312b6700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7fe1140a1290 0x7fe1140a3750 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.410+0000 7fe1312b6700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe12c19bbb0 0x7fe12c19c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.410+0000 7fe1312b6700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe12c0ff5f0 0x7fe12c1972d0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.410+0000 7fe1312b6700 1 --2- 172.21.15.81:0/2563240470 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7fe12c106200 0x7fe12c197810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.410+0000 7fe1312b6700 1 -- 172.21.15.81:0/2563240470 >> 172.21.15.81:0/2563240470 conn(0x7fe12c076240 msgr2=0x7fe12c104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.410+0000 7fe1312b6700 1 -- 172.21.15.81:0/2563240470 shutdown_connections 2024-05-09T00:15:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.410+0000 7fe1312b6700 1 -- 172.21.15.81:0/2563240470 wait complete. 2024-05-09T00:15:28.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-09T00:15:28.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.547+0000 7f4acde96700 1 -- 172.21.15.81:0/609809704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac80ffad0 msgr2=0x7f4ac80ffeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.547+0000 7f4acde96700 1 --2- 172.21.15.81:0/609809704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac80ffad0 0x7f4ac80ffeb0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009990 tx=0x7f4abc009ca0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.547+0000 7f4acde96700 1 -- 172.21.15.81:0/609809704 shutdown_connections 2024-05-09T00:15:28.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.547+0000 7f4acde96700 1 --2- 172.21.15.81:0/609809704 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac81062e0 0x7f4ac810dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.547+0000 7f4acde96700 1 --2- 172.21.15.81:0/609809704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac80ffad0 0x7f4ac80ffeb0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.547+0000 7f4acde96700 1 --2- 172.21.15.81:0/609809704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ac8100480 0x7f4ac8105bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.547+0000 7f4acde96700 1 -- 172.21.15.81:0/609809704 >> 172.21.15.81:0/609809704 conn(0x7f4ac80750c0 msgr2=0x7f4ac80754d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:28.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.547+0000 7f4acde96700 1 -- 172.21.15.81:0/609809704 shutdown_connections 2024-05-09T00:15:28.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.547+0000 7f4acde96700 1 -- 172.21.15.81:0/609809704 wait complete. 2024-05-09T00:15:28.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.547+0000 7f4acde96700 1 Processor -- start 2024-05-09T00:15:28.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4acde96700 1 -- start start 2024-05-09T00:15:28.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4acde96700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ac80ffad0 0x7f4ac81974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:28.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4acde96700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac81062e0 0x7f4ac8197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:28.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4acde96700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac819bdd0 0x7f4ac819c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:28.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4acde96700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac819c850 con 0x7f4ac81062e0 2024-05-09T00:15:28.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4acde96700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac819c9c0 con 0x7f4ac819bdd0 2024-05-09T00:15:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4acde96700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac819cb80 con 0x7f4ac80ffad0 2024-05-09T00:15:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac81062e0 0x7f4ac8197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac6ffd700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac81062e0 0x7f4ac8197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47410/0 (socket says 172.21.15.81:47410) 2024-05-09T00:15:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac6ffd700 1 -- 172.21.15.81:0/205535468 learned_addr learned my addr 172.21.15.81:0/205535468 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac7fff700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac819bdd0 0x7f4ac819c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac77fe700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ac80ffad0 0x7f4ac81974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac6ffd700 1 -- 172.21.15.81:0/205535468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ac80ffad0 msgr2=0x7f4ac81974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac6ffd700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ac80ffad0 0x7f4ac81974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac6ffd700 1 -- 172.21.15.81:0/205535468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac819bdd0 msgr2=0x7f4ac819c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac6ffd700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac819bdd0 0x7f4ac819c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac6ffd700 1 -- 172.21.15.81:0/205535468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc0095f0 con 0x7f4ac81062e0 2024-05-09T00:15:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac7fff700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac819bdd0 0x7f4ac819c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac6ffd700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac81062e0 0x7f4ac8197a30 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800b500 tx=0x7f4ab800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:28.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac4ff9700 1 -- 172.21.15.81:0/205535468 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8011830 con 0x7f4ac81062e0 2024-05-09T00:15:28.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac4ff9700 1 -- 172.21.15.81:0/205535468 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ab8011e50 con 0x7f4ac81062e0 2024-05-09T00:15:28.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4ac4ff9700 1 -- 172.21.15.81:0/205535468 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab800f2e0 con 0x7f4ac81062e0 2024-05-09T00:15:28.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.548+0000 7f4acde96700 1 -- 172.21.15.81:0/205535468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac81a40e0 con 0x7f4ac81062e0 2024-05-09T00:15:28.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.549+0000 7f4acde96700 1 -- 172.21.15.81:0/205535468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac81a4570 con 0x7f4ac81062e0 2024-05-09T00:15:28.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.549+0000 7f4acde96700 1 -- 172.21.15.81:0/205535468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac8109520 con 0x7f4ac81062e0 2024-05-09T00:15:28.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.551+0000 7f4ac4ff9700 1 -- 172.21.15.81:0/205535468 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4ab80105a0 con 0x7f4ac81062e0 2024-05-09T00:15:28.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.551+0000 7f4ac4ff9700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4ab00a1290 0x7f4ab00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:28.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.551+0000 7f4ac77fe700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4ab00a1290 0x7f4ab00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:28.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.551+0000 7f4ac4ff9700 1 -- 172.21.15.81:0/205535468 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8572+0+0 (secure 0 0 0) 0x7f4ab80cccb0 con 0x7f4ac81062e0 2024-05-09T00:15:28.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.552+0000 7f4ac77fe700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4ab00a1290 0x7f4ab00a3750 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00b5c0 tx=0x7f4abc005fb0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:28.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.555+0000 7f4ac4ff9700 1 -- 172.21.15.81:0/205535468 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4ab80961e0 con 0x7f4ac81062e0 2024-05-09T00:15:28.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.800+0000 7f4acde96700 1 -- 172.21.15.81:0/205535468 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4ac8068ff0 con 0x7f4ac81062e0 2024-05-09T00:15:28.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.809+0000 7f4ac4ff9700 1 -- 172.21.15.81:0/205535468 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4ab8099800 con 0x7f4ac81062e0 2024-05-09T00:15:28.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.812+0000 7f4acde96700 1 -- 172.21.15.81:0/205535468 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4ab00a1290 msgr2=0x7f4ab00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.812+0000 7f4acde96700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4ab00a1290 0x7f4ab00a3750 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00b5c0 tx=0x7f4abc005fb0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.812+0000 7f4acde96700 1 -- 172.21.15.81:0/205535468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac81062e0 msgr2=0x7f4ac8197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.812+0000 7f4acde96700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac81062e0 0x7f4ac8197a30 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800b500 tx=0x7f4ab800b8c0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.812+0000 7f4acde96700 1 -- 172.21.15.81:0/205535468 shutdown_connections 2024-05-09T00:15:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.812+0000 7f4acde96700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f4ab00a1290 0x7f4ab00a3750 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.812+0000 7f4acde96700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f4ac819bdd0 0x7f4ac819c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.812+0000 7f4acde96700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4ac80ffad0 0x7f4ac81974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.812+0000 7f4acde96700 1 --2- 172.21.15.81:0/205535468 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4ac81062e0 0x7f4ac8197a30 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.812+0000 7f4acde96700 1 -- 172.21.15.81:0/205535468 >> 172.21.15.81:0/205535468 conn(0x7f4ac80750c0 msgr2=0x7f4ac80fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.812+0000 7f4acde96700 1 -- 172.21.15.81:0/205535468 shutdown_connections 2024-05-09T00:15:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.812+0000 7f4acde96700 1 -- 172.21.15.81:0/205535468 wait complete. 2024-05-09T00:15:28.811 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-09T00:15:28.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-09T00:15:28.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.950+0000 7f7f5cda8700 1 -- 172.21.15.81:0/2813856406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f58100060 msgr2=0x7f7f58100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.950+0000 7f7f5cda8700 1 --2- 172.21.15.81:0/2813856406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f58100060 0x7f7f58100440 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009990 tx=0x7f7f48009ca0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.950+0000 7f7f5cda8700 1 -- 172.21.15.81:0/2813856406 shutdown_connections 2024-05-09T00:15:28.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.950+0000 7f7f5cda8700 1 --2- 172.21.15.81:0/2813856406 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f58105160 0x7f7f5810cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.950+0000 7f7f5cda8700 1 --2- 172.21.15.81:0/2813856406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f58100060 0x7f7f58100440 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.950+0000 7f7f5cda8700 1 --2- 172.21.15.81:0/2813856406 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f58100a10 0x7f7f58104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.950+0000 7f7f5cda8700 1 -- 172.21.15.81:0/2813856406 >> 172.21.15.81:0/2813856406 conn(0x7f7f58076f40 msgr2=0x7f7f58077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:28.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.951+0000 7f7f5cda8700 1 -- 172.21.15.81:0/2813856406 shutdown_connections 2024-05-09T00:15:28.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.951+0000 7f7f5cda8700 1 -- 172.21.15.81:0/2813856406 wait complete. 2024-05-09T00:15:28.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.951+0000 7f7f5cda8700 1 Processor -- start 2024-05-09T00:15:28.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.951+0000 7f7f5cda8700 1 -- start start 2024-05-09T00:15:28.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.951+0000 7f7f5cda8700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f58100060 0x7f7f58196230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:28.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.951+0000 7f7f5cda8700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f58105160 0x7f7f58196770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:28.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.951+0000 7f7f5cda8700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f5819ab10 0x7f7f5819af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.951+0000 7f7f5cda8700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5819b590 con 0x7f7f58105160 2024-05-09T00:15:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f5cda8700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5819b700 con 0x7f7f5819ab10 2024-05-09T00:15:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f5cda8700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5819b8c0 con 0x7f7f58100060 2024-05-09T00:15:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f55d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f58105160 0x7f7f58196770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f55d9b700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f58105160 0x7f7f58196770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47418/0 (socket says 172.21.15.81:47418) 2024-05-09T00:15:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f55d9b700 1 -- 172.21.15.81:0/4245469896 learned_addr learned my addr 172.21.15.81:0/4245469896 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f5659c700 1 --2- 172.21.15.81:0/4245469896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f58100060 0x7f7f58196230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f56d9d700 1 --2- 172.21.15.81:0/4245469896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f5819ab10 0x7f7f5819af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f55d9b700 1 -- 172.21.15.81:0/4245469896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f58100060 msgr2=0x7f7f58196230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f55d9b700 1 --2- 172.21.15.81:0/4245469896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f58100060 0x7f7f58196230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f55d9b700 1 -- 172.21.15.81:0/4245469896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f5819ab10 msgr2=0x7f7f5819af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f55d9b700 1 --2- 172.21.15.81:0/4245469896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f5819ab10 0x7f7f5819af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:28.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f55d9b700 1 -- 172.21.15.81:0/4245469896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f480095f0 con 0x7f7f58105160 2024-05-09T00:15:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f55d9b700 1 --2- 172.21.15.81:0/4245469896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f58105160 0x7f7f58196770 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00c9e0 tx=0x7f7f4c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f477fe700 1 -- 172.21.15.81:0/4245469896 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c007aa0 con 0x7f7f58105160 2024-05-09T00:15:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f5cda8700 1 -- 172.21.15.81:0/4245469896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f581a2e20 con 0x7f7f58105160 2024-05-09T00:15:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f477fe700 1 -- 172.21.15.81:0/4245469896 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f4c007c00 con 0x7f7f58105160 2024-05-09T00:15:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f477fe700 1 -- 172.21.15.81:0/4245469896 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c018660 con 0x7f7f58105160 2024-05-09T00:15:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.952+0000 7f7f5cda8700 1 -- 172.21.15.81:0/4245469896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f581a32a0 con 0x7f7f58105160 2024-05-09T00:15:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.953+0000 7f7f5cda8700 1 -- 172.21.15.81:0/4245469896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f581083d0 con 0x7f7f58105160 2024-05-09T00:15:28.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.954+0000 7f7f477fe700 1 -- 172.21.15.81:0/4245469896 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f7f4c00f450 con 0x7f7f58105160 2024-05-09T00:15:28.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.955+0000 7f7f477fe700 1 --2- 172.21.15.81:0/4245469896 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7f400a1290 0x7f7f400a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:28.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.955+0000 7f7f5659c700 1 --2- 172.21.15.81:0/4245469896 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7f400a1290 0x7f7f400a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:28.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.955+0000 7f7f477fe700 1 -- 172.21.15.81:0/4245469896 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8786+0+0 (secure 0 0 0) 0x7f7f4c0ccd80 con 0x7f7f58105160 2024-05-09T00:15:28.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.955+0000 7f7f5659c700 1 --2- 172.21.15.81:0/4245469896 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7f400a1290 0x7f7f400a3750 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800b2e0 tx=0x7f7f48005960 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:28.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:28.959+0000 7f7f477fe700 1 -- 172.21.15.81:0/4245469896 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7f4c0960c0 con 0x7f7f58105160 2024-05-09T00:15:29.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:28 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mon-a[42451]: 2024-05-09T00:15:28.801+0000 7f1f4486a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:15:29.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:28 smithi081 ceph-mon[42474]: pgmap v390: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-09T00:15:29.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:28 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/3832713643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:15:29.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:28 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2563240470' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:15:29.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:28 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/205535468' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-09T00:15:29.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:28 smithi081 ceph-mon[42474]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T00:15:29.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:28 smithi081 ceph-mon[42474]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:15:29.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:28 smithi081 ceph-mon[42474]: osdmap e96: 12 total, 12 up, 12 in 2024-05-09T00:15:29.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:28 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/205535468' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-09T00:15:29.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:28 smithi081 ceph-mon[42474]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-09T00:15:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.207+0000 7f7f5cda8700 1 -- 172.21.15.81:0/4245469896 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7f58197530 con 0x7f7f58105160 2024-05-09T00:15:29.268 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:15:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-b[81423]: ignoring --setuser ceph since I am not root 2024-05-09T00:15:29.268 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:15:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-b[81423]: ignoring --setgroup ceph since I am not root 2024-05-09T00:15:29.268 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:15:28 smithi150 ceph-mds[81446]: -- 172.21.15.150:0/3413544623 <== mon.2 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557708ed01a0 con 0x557708ea6c00 2024-05-09T00:15:29.268 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:15:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-b[81423]: starting mds.b at 2024-05-09T00:15:29.269 INFO:journalctl@ceph.mds.e.smithi150.stdout:May 09 00:15:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-e[80742]: ignoring --setuser ceph since I am not root 2024-05-09T00:15:29.269 INFO:journalctl@ceph.mds.e.smithi150.stdout:May 09 00:15:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-e[80742]: ignoring --setgroup ceph since I am not root 2024-05-09T00:15:29.269 INFO:journalctl@ceph.mds.e.smithi150.stdout:May 09 00:15:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-e[80742]: starting mds.e at 2024-05-09T00:15:29.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:28 smithi150 ceph-mon[46187]: pgmap v390: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-09T00:15:29.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:28 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/3832713643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:15:29.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:28 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2563240470' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:15:29.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:28 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/205535468' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-09T00:15:29.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:28 smithi150 ceph-mon[46187]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T00:15:29.270 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:28 smithi150 ceph-mon[46187]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:15:29.270 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:28 smithi150 ceph-mon[46187]: osdmap e96: 12 total, 12 up, 12 in 2024-05-09T00:15:29.270 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:28 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/205535468' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-09T00:15:29.270 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:28 smithi150 ceph-mon[46187]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-09T00:15:29.270 INFO:journalctl@ceph.mds.h.smithi150.stdout:May 09 00:15:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-h[81084]: ignoring --setuser ceph since I am not root 2024-05-09T00:15:29.270 INFO:journalctl@ceph.mds.h.smithi150.stdout:May 09 00:15:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-h[81084]: ignoring --setgroup ceph since I am not root 2024-05-09T00:15:29.270 INFO:journalctl@ceph.mds.h.smithi150.stdout:May 09 00:15:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-h[81084]: starting mds.h at 2024-05-09T00:15:29.306 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 09 00:15:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-f[83563]: ignoring --setuser ceph since I am not root 2024-05-09T00:15:29.306 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 09 00:15:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-f[83563]: ignoring --setgroup ceph since I am not root 2024-05-09T00:15:29.307 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 09 00:15:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-f[83563]: starting mds.f at 2024-05-09T00:15:29.307 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:15:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-i[84249]: ignoring --setuser ceph since I am not root 2024-05-09T00:15:29.307 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:15:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-i[84249]: ignoring --setgroup ceph since I am not root 2024-05-09T00:15:29.307 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:15:28 smithi171 ceph-mds[84272]: -- 172.21.15.171:0/615582063 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d59c87c1a0 con 0x55d59c852800 2024-05-09T00:15:29.307 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:15:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-i[84249]: starting mds.i at 2024-05-09T00:15:29.307 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:15:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[87460]: ignoring --setuser ceph since I am not root 2024-05-09T00:15:29.307 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:15:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[87460]: ignoring --setgroup ceph since I am not root 2024-05-09T00:15:29.307 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:15:28 smithi171 ceph-mds[87483]: -- 172.21.15.171:0/901850677 <== mon.1 v2:172.21.15.171:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f3873821a0 con 0x55f387359000 2024-05-09T00:15:29.308 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:15:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[87460]: starting mds.c at 2024-05-09T00:15:29.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:28 smithi171 ceph-mon[47351]: pgmap v390: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-09T00:15:29.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:28 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/3832713643' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-09T00:15:29.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:28 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2563240470' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-09T00:15:29.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:28 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/205535468' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-09T00:15:29.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:28 smithi171 ceph-mon[47351]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-09T00:15:29.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:28 smithi171 ceph-mon[47351]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-09T00:15:29.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:28 smithi171 ceph-mon[47351]: osdmap e96: 12 total, 12 up, 12 in 2024-05-09T00:15:29.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:28 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/205535468' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-09T00:15:29.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:28 smithi171 ceph-mon[47351]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-09T00:15:29.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.840+0000 7f7f477fe700 1 -- 172.21.15.81:0/4245469896 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7f4c0996e0 con 0x7f7f58105160 2024-05-09T00:15:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.842+0000 7f7f5cda8700 1 -- 172.21.15.81:0/4245469896 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7f400a1290 msgr2=0x7f7f400a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.842+0000 7f7f5cda8700 1 --2- 172.21.15.81:0/4245469896 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7f400a1290 0x7f7f400a3750 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7f4800b2e0 tx=0x7f7f48005960 comp rx=0 tx=0).stop 2024-05-09T00:15:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.842+0000 7f7f5cda8700 1 -- 172.21.15.81:0/4245469896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f58105160 msgr2=0x7f7f58196770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.842+0000 7f7f5cda8700 1 --2- 172.21.15.81:0/4245469896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f58105160 0x7f7f58196770 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c00c9e0 tx=0x7f7f4c00ccf0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.842+0000 7f7f5cda8700 1 -- 172.21.15.81:0/4245469896 shutdown_connections 2024-05-09T00:15:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.843+0000 7f7f5cda8700 1 --2- 172.21.15.81:0/4245469896 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f7f400a1290 0x7f7f400a3750 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.843+0000 7f7f5cda8700 1 --2- 172.21.15.81:0/4245469896 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f7f5819ab10 0x7f7f5819af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.843+0000 7f7f5cda8700 1 --2- 172.21.15.81:0/4245469896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7f58100060 0x7f7f58196230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.843+0000 7f7f5cda8700 1 --2- 172.21.15.81:0/4245469896 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7f58105160 0x7f7f58196770 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.843+0000 7f7f5cda8700 1 -- 172.21.15.81:0/4245469896 >> 172.21.15.81:0/4245469896 conn(0x7f7f58076f40 msgr2=0x7f7f580fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.843+0000 7f7f5cda8700 1 -- 172.21.15.81:0/4245469896 shutdown_connections 2024-05-09T00:15:29.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.843+0000 7f7f5cda8700 1 -- 172.21.15.81:0/4245469896 wait complete. 2024-05-09T00:15:29.857 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-09T00:15:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.992+0000 7f3173169700 1 -- 172.21.15.81:0/889991559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c106290 msgr2=0x7f316c10de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:29.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.992+0000 7f3173169700 1 --2- 172.21.15.81:0/889991559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c106290 0x7f316c10de10 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f316400b0d0 tx=0x7f316400b3e0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.992+0000 7f3173169700 1 -- 172.21.15.81:0/889991559 shutdown_connections 2024-05-09T00:15:29.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.992+0000 7f3173169700 1 --2- 172.21.15.81:0/889991559 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f316c0682e0 0x7f316c0686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.992+0000 7f3173169700 1 --2- 172.21.15.81:0/889991559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c106290 0x7f316c10de10 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.992+0000 7f3173169700 1 --2- 172.21.15.81:0/889991559 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316c068c90 0x7f316c105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.992+0000 7f3173169700 1 -- 172.21.15.81:0/889991559 >> 172.21.15.81:0/889991559 conn(0x7f316c076f40 msgr2=0x7f316c077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:29.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.992+0000 7f3173169700 1 -- 172.21.15.81:0/889991559 shutdown_connections 2024-05-09T00:15:29.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.992+0000 7f3173169700 1 -- 172.21.15.81:0/889991559 wait complete. 2024-05-09T00:15:29.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.992+0000 7f3173169700 1 Processor -- start 2024-05-09T00:15:29.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.992+0000 7f3173169700 1 -- start start 2024-05-09T00:15:29.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3173169700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f316c0682e0 0x7f316c197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3173169700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316c106290 0x7f316c1979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3173169700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c19bd60 0x7f316c19c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3173169700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c19c7e0 con 0x7f316c19bd60 2024-05-09T00:15:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3173169700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c19c950 con 0x7f316c0682e0 2024-05-09T00:15:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3173169700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c19cb10 con 0x7f316c106290 2024-05-09T00:15:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3171706700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c19bd60 0x7f316c19c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3171706700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c19bd60 0x7f316c19c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47426/0 (socket says 172.21.15.81:47426) 2024-05-09T00:15:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3171706700 1 -- 172.21.15.81:0/2004567762 learned_addr learned my addr 172.21.15.81:0/2004567762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3171706700 1 -- 172.21.15.81:0/2004567762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316c106290 msgr2=0x7f316c1979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3171706700 1 --2- 172.21.15.81:0/2004567762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316c106290 0x7f316c1979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3170f05700 1 --2- 172.21.15.81:0/2004567762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f316c0682e0 0x7f316c197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:29.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3171706700 1 -- 172.21.15.81:0/2004567762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f316c0682e0 msgr2=0x7f316c197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:29.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3171706700 1 --2- 172.21.15.81:0/2004567762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f316c0682e0 0x7f316c197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:29.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3171706700 1 -- 172.21.15.81:0/2004567762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3164009d00 con 0x7f316c19bd60 2024-05-09T00:15:29.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3170f05700 1 --2- 172.21.15.81:0/2004567762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f316c0682e0 0x7f316c197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-09T00:15:29.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3171706700 1 --2- 172.21.15.81:0/2004567762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c19bd60 0x7f316c19c1e0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f31640094c0 tx=0x7f31640095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:29.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3169ffb700 1 -- 172.21.15.81:0/2004567762 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316400e040 con 0x7f316c19bd60 2024-05-09T00:15:29.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3169ffb700 1 -- 172.21.15.81:0/2004567762 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f316401db40 con 0x7f316c19bd60 2024-05-09T00:15:29.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3173169700 1 -- 172.21.15.81:0/2004567762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316c1a4010 con 0x7f316c19bd60 2024-05-09T00:15:29.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.993+0000 7f3169ffb700 1 -- 172.21.15.81:0/2004567762 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316401baf0 con 0x7f316c19bd60 2024-05-09T00:15:29.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.994+0000 7f3173169700 1 -- 172.21.15.81:0/2004567762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316c1a44e0 con 0x7f316c19bd60 2024-05-09T00:15:29.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.995+0000 7f3173169700 1 -- 172.21.15.81:0/2004567762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316c1094f0 con 0x7f316c19bd60 2024-05-09T00:15:29.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.995+0000 7f3169ffb700 1 -- 172.21.15.81:0/2004567762 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f316401dcb0 con 0x7f316c19bd60 2024-05-09T00:15:29.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.996+0000 7f3169ffb700 1 --2- 172.21.15.81:0/2004567762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f315c0a1310 0x7f315c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:29.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.996+0000 7f3169ffb700 1 -- 172.21.15.81:0/2004567762 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8786+0+0 (secure 0 0 0) 0x7f31640ce690 con 0x7f316c19bd60 2024-05-09T00:15:29.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.996+0000 7f3170f05700 1 --2- 172.21.15.81:0/2004567762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f315c0a1310 0x7f315c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:29.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:29.996+0000 7f3170f05700 1 --2- 172.21.15.81:0/2004567762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f315c0a1310 0x7f315c0a37d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3160005fd0 tx=0x7f3160005ee0 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:29.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.000+0000 7f3169ffb700 1 -- 172.21.15.81:0/2004567762 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3164097a60 con 0x7f316c19bd60 2024-05-09T00:15:30.123 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:29 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/4245469896' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:15:30.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.199+0000 7f3173169700 1 -- 172.21.15.81:0/2004567762 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f316c067d20 con 0x7f316c19bd60 2024-05-09T00:15:30.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:29 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/4245469896' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:15:30.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:29 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/4245469896' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-09T00:15:30.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.846+0000 7f3169ffb700 1 -- 172.21.15.81:0/2004567762 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) v1 ==== 181+0+0 (secure 0 0 0) 0x7f316409b080 con 0x7f316c19bd60 2024-05-09T00:15:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.850+0000 7f3173169700 1 -- 172.21.15.81:0/2004567762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f315c0a1310 msgr2=0x7f315c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.850+0000 7f3173169700 1 --2- 172.21.15.81:0/2004567762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f315c0a1310 0x7f315c0a37d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3160005fd0 tx=0x7f3160005ee0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.850+0000 7f3173169700 1 -- 172.21.15.81:0/2004567762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c19bd60 msgr2=0x7f316c19c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:30.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.850+0000 7f3173169700 1 --2- 172.21.15.81:0/2004567762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c19bd60 0x7f316c19c1e0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f31640094c0 tx=0x7f31640095a0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.850+0000 7f3173169700 1 -- 172.21.15.81:0/2004567762 shutdown_connections 2024-05-09T00:15:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.850+0000 7f3173169700 1 --2- 172.21.15.81:0/2004567762 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f315c0a1310 0x7f315c0a37d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.850+0000 7f3173169700 1 --2- 172.21.15.81:0/2004567762 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f316c0682e0 0x7f316c197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.850+0000 7f3173169700 1 --2- 172.21.15.81:0/2004567762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f316c19bd60 0x7f316c19c1e0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.850+0000 7f3173169700 1 --2- 172.21.15.81:0/2004567762 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f316c106290 0x7f316c1979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.850+0000 7f3173169700 1 -- 172.21.15.81:0/2004567762 >> 172.21.15.81:0/2004567762 conn(0x7f316c076f40 msgr2=0x7f316c0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.850+0000 7f3173169700 1 -- 172.21.15.81:0/2004567762 shutdown_connections 2024-05-09T00:15:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.850+0000 7f3173169700 1 -- 172.21.15.81:0/2004567762 wait complete. 2024-05-09T00:15:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-05-09T00:15:30.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-09T00:15:30.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.997+0000 7f804c1c9700 1 -- 172.21.15.81:0/2722958826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8044100a10 msgr2=0x7f8044104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.997+0000 7f804c1c9700 1 --2- 172.21.15.81:0/2722958826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8044100a10 0x7f8044104a30 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f8040009990 tx=0x7f8040009ca0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.997+0000 7f804c1c9700 1 -- 172.21.15.81:0/2722958826 shutdown_connections 2024-05-09T00:15:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.997+0000 7f804c1c9700 1 --2- 172.21.15.81:0/2722958826 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8044100060 0x7f8044100440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.997+0000 7f804c1c9700 1 --2- 172.21.15.81:0/2722958826 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8044105160 0x7f804410cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.997+0000 7f804c1c9700 1 --2- 172.21.15.81:0/2722958826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8044100a10 0x7f8044104a30 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.997+0000 7f804c1c9700 1 -- 172.21.15.81:0/2722958826 >> 172.21.15.81:0/2722958826 conn(0x7f8044076f40 msgr2=0x7f8044077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.997+0000 7f804c1c9700 1 -- 172.21.15.81:0/2722958826 shutdown_connections 2024-05-09T00:15:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.997+0000 7f804c1c9700 1 -- 172.21.15.81:0/2722958826 wait complete. 2024-05-09T00:15:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f804c1c9700 1 Processor -- start 2024-05-09T00:15:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f804c1c9700 1 -- start start 2024-05-09T00:15:30.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f804c1c9700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8044100060 0x7f80441962d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:30.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f804c1c9700 1 --2- >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8044105160 0x7f8044196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:30.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f804c1c9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f804419abb0 0x7f804419b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:30.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f804c1c9700 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804419b630 con 0x7f8044100060 2024-05-09T00:15:30.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f804c1c9700 1 -- --> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804419b7a0 con 0x7f8044105160 2024-05-09T00:15:30.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f804c1c9700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804419b960 con 0x7f804419abb0 2024-05-09T00:15:30.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f8049f65700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8044100060 0x7f80441962d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:30.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f8049f65700 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8044100060 0x7f80441962d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47446/0 (socket says 172.21.15.81:47446) 2024-05-09T00:15:30.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f8049f65700 1 -- 172.21.15.81:0/1619851569 learned_addr learned my addr 172.21.15.81:0/1619851569 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-05-09T00:15:30.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f804a766700 1 --2- 172.21.15.81:0/1619851569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f804419abb0 0x7f804419b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:30.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f8049764700 1 --2- 172.21.15.81:0/1619851569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8044105160 0x7f8044196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:30.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f8049f65700 1 -- 172.21.15.81:0/1619851569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f804419abb0 msgr2=0x7f804419b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f8049f65700 1 --2- 172.21.15.81:0/1619851569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f804419abb0 0x7f804419b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f8049f65700 1 -- 172.21.15.81:0/1619851569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8044105160 msgr2=0x7f8044196810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f8049f65700 1 --2- 172.21.15.81:0/1619851569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8044105160 0x7f8044196810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f8049f65700 1 -- 172.21.15.81:0/1619851569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80400095f0 con 0x7f8044100060 2024-05-09T00:15:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f8049f65700 1 --2- 172.21.15.81:0/1619851569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8044100060 0x7f80441962d0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f8034009970 tx=0x7f8034009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.998+0000 7f803affd700 1 -- 172.21.15.81:0/1619851569 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8034012070 con 0x7f8044100060 2024-05-09T00:15:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.999+0000 7f803affd700 1 -- 172.21.15.81:0/1619851569 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f803400d260 con 0x7f8044100060 2024-05-09T00:15:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.999+0000 7f804c1c9700 1 -- 172.21.15.81:0/1619851569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8044068050 con 0x7f8044100060 2024-05-09T00:15:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.999+0000 7f803affd700 1 -- 172.21.15.81:0/1619851569 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80340179d0 con 0x7f8044100060 2024-05-09T00:15:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.999+0000 7f804c1c9700 1 -- 172.21.15.81:0/1619851569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80440685b0 con 0x7f8044100060 2024-05-09T00:15:31.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:30.999+0000 7f804c1c9700 1 -- 172.21.15.81:0/1619851569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8044101510 con 0x7f8044100060 2024-05-09T00:15:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.001+0000 7f803affd700 1 -- 172.21.15.81:0/1619851569 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f8034007c00 con 0x7f8044100060 2024-05-09T00:15:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.002+0000 7f803affd700 1 --2- 172.21.15.81:0/1619851569 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f80300a1310 0x7f80300a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-09T00:15:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.002+0000 7f8049764700 1 --2- 172.21.15.81:0/1619851569 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f80300a1310 0x7f80300a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-09T00:15:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.002+0000 7f803affd700 1 -- 172.21.15.81:0/1619851569 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8253+0+0 (secure 0 0 0) 0x7f80340cdea0 con 0x7f8044100060 2024-05-09T00:15:31.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.002+0000 7f8049764700 1 --2- 172.21.15.81:0/1619851569 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f80300a1310 0x7f80300a37d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8040006010 tx=0x7f804000b540 comp rx=0 tx=0).ready entity=mgr.15285 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-09T00:15:31.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.005+0000 7f803affd700 1 -- 172.21.15.81:0/1619851569 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8034097400 con 0x7f8044100060 2024-05-09T00:15:31.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: pgmap v392: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-09T00:15:31.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T00:15:31.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T00:15:31.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: Cluster is now healthy 2024-05-09T00:15:31.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.150:6836/3434584582,v1:172.21.15.150:6839/3434584582] up:boot 2024-05-09T00:15:31.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.171:6836/3725123052,v1:172.21.15.171:6838/3725123052] up:boot 2024-05-09T00:15:31.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.171:6834/1158326056,v1:172.21.15.171:6835/1158326056] up:boot 2024-05-09T00:15:31.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.150:6834/276681878,v1:172.21.15.150:6837/276681878] up:boot 2024-05-09T00:15:31.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.150:6835/3456256315,v1:172.21.15.150:6838/3456256315] up:boot 2024-05-09T00:15:31.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: mds.? [v2:172.21.15.171:6837/1740193231,v1:172.21.15.171:6839/1740193231] up:boot 2024-05-09T00:15:31.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/4245469896' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-09T00:15:31.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: fsmap 12 up:standby 2024-05-09T00:15:31.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T00:15:31.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T00:15:31.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T00:15:31.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T00:15:31.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T00:15:31.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:15:31.125 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:30 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2004567762' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T00:15:31.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.203+0000 7f804c1c9700 1 -- 172.21.15.81:0/1619851569 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8044067cf0 con 0x7f8044100060 2024-05-09T00:15:31.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: pgmap v392: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-09T00:15:31.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T00:15:31.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T00:15:31.268 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: Cluster is now healthy 2024-05-09T00:15:31.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.150:6836/3434584582,v1:172.21.15.150:6839/3434584582] up:boot 2024-05-09T00:15:31.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.171:6836/3725123052,v1:172.21.15.171:6838/3725123052] up:boot 2024-05-09T00:15:31.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.171:6834/1158326056,v1:172.21.15.171:6835/1158326056] up:boot 2024-05-09T00:15:31.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.150:6834/276681878,v1:172.21.15.150:6837/276681878] up:boot 2024-05-09T00:15:31.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.150:6835/3456256315,v1:172.21.15.150:6838/3456256315] up:boot 2024-05-09T00:15:31.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: mds.? [v2:172.21.15.171:6837/1740193231,v1:172.21.15.171:6839/1740193231] up:boot 2024-05-09T00:15:31.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/4245469896' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-09T00:15:31.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: fsmap 12 up:standby 2024-05-09T00:15:31.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T00:15:31.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T00:15:31.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T00:15:31.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T00:15:31.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T00:15:31.269 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:15:31.270 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:30 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2004567762' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T00:15:31.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: pgmap v392: 97 pgs: 97 active+clean; 3.1 MiB data, 429 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-05-09T00:15:31.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-09T00:15:31.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-09T00:15:31.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: Cluster is now healthy 2024-05-09T00:15:31.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.150:6836/3434584582,v1:172.21.15.150:6839/3434584582] up:boot 2024-05-09T00:15:31.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.171:6836/3725123052,v1:172.21.15.171:6838/3725123052] up:boot 2024-05-09T00:15:31.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.171:6834/1158326056,v1:172.21.15.171:6835/1158326056] up:boot 2024-05-09T00:15:31.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.150:6834/276681878,v1:172.21.15.150:6837/276681878] up:boot 2024-05-09T00:15:31.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.150:6835/3456256315,v1:172.21.15.150:6838/3456256315] up:boot 2024-05-09T00:15:31.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: mds.? [v2:172.21.15.171:6837/1740193231,v1:172.21.15.171:6839/1740193231] up:boot 2024-05-09T00:15:31.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/4245469896' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-09T00:15:31.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: fsmap 12 up:standby 2024-05-09T00:15:31.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-09T00:15:31.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-09T00:15:31.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-09T00:15:31.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-09T00:15:31.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-09T00:15:31.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: from='mgr.15285 172.21.15.81:0/50284330' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-09T00:15:31.308 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:30 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2004567762' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T00:15:31.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.854+0000 7f803affd700 1 -- 172.21.15.81:0/1619851569 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) v1 ==== 169+0+0 (secure 0 0 0) 0x7f803401c0d0 con 0x7f8044100060 2024-05-09T00:15:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.858+0000 7f804c1c9700 1 -- 172.21.15.81:0/1619851569 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f80300a1310 msgr2=0x7f80300a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.858+0000 7f804c1c9700 1 --2- 172.21.15.81:0/1619851569 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f80300a1310 0x7f80300a37d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8040006010 tx=0x7f804000b540 comp rx=0 tx=0).stop 2024-05-09T00:15:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.858+0000 7f804c1c9700 1 -- 172.21.15.81:0/1619851569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8044100060 msgr2=0x7f80441962d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-09T00:15:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.858+0000 7f804c1c9700 1 --2- 172.21.15.81:0/1619851569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8044100060 0x7f80441962d0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f8034009970 tx=0x7f8034009c80 comp rx=0 tx=0).stop 2024-05-09T00:15:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.858+0000 7f804c1c9700 1 -- 172.21.15.81:0/1619851569 shutdown_connections 2024-05-09T00:15:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.858+0000 7f804c1c9700 1 --2- 172.21.15.81:0/1619851569 >> [v2:172.21.15.81:6800/2111088526,v1:172.21.15.81:6801/2111088526] conn(0x7f80300a1310 0x7f80300a37d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.858+0000 7f804c1c9700 1 --2- 172.21.15.81:0/1619851569 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f804419abb0 0x7f804419b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.858+0000 7f804c1c9700 1 --2- 172.21.15.81:0/1619851569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8044100060 0x7f80441962d0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.858+0000 7f804c1c9700 1 --2- 172.21.15.81:0/1619851569 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x7f8044105160 0x7f8044196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-09T00:15:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.858+0000 7f804c1c9700 1 -- 172.21.15.81:0/1619851569 >> 172.21.15.81:0/1619851569 conn(0x7f8044076f40 msgr2=0x7f80440fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-09T00:15:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.858+0000 7f804c1c9700 1 -- 172.21.15.81:0/1619851569 shutdown_connections 2024-05-09T00:15:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-05-09T00:15:31.858+0000 7f804c1c9700 1 -- 172.21.15.81:0/1619851569 wait complete. 2024-05-09T00:15:31.859 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-05-09T00:15:31.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T00:15:31.904 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T00:15:31.943 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T00:15:31.981 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-09T00:15:31.981 DEBUG:teuthology.orchestra.run.smithi081:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T00:15:32.000 DEBUG:teuthology.orchestra.run.smithi150:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T00:15:32.019 DEBUG:teuthology.orchestra.run.smithi171:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-09T00:15:32.041 INFO:tasks.cephadm:Stopping all daemons... 2024-05-09T00:15:32.041 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-09T00:15:32.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mon.a 2024-05-09T00:15:32.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:31 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/2004567762' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T00:15:32.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:31 smithi081 ceph-mon[42474]: osdmap e97: 12 total, 12 up, 12 in 2024-05-09T00:15:32.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:31 smithi081 ceph-mon[42474]: from='client.? 172.21.15.81:0/1619851569' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T00:15:32.124 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:32 smithi081 systemd[1]: Stopping Ceph mon.a for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:15:32.270 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:31 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/2004567762' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T00:15:32.270 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:31 smithi150 ceph-mon[46187]: osdmap e97: 12 total, 12 up, 12 in 2024-05-09T00:15:32.270 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:31 smithi150 ceph-mon[46187]: from='client.? 172.21.15.81:0/1619851569' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T00:15:32.306 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:31 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/2004567762' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-09T00:15:32.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:31 smithi171 ceph-mon[47351]: osdmap e97: 12 total, 12 up, 12 in 2024-05-09T00:15:32.307 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:31 smithi171 ceph-mon[47351]: from='client.? 172.21.15.81:0/1619851569' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-09T00:15:32.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:32 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mon-a[42451]: 2024-05-09T00:15:32.267+0000 7f1f4a075700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:15:32.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:32 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mon-a[42451]: 2024-05-09T00:15:32.267+0000 7f1f4a075700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-09T00:15:32.624 INFO:journalctl@ceph.mon.a.smithi081.stdout:May 09 00:15:32 smithi081 bash[125411]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mon-a 2024-05-09T00:15:32.676 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mon.a.service' 2024-05-09T00:15:32.719 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:15:32.720 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-09T00:15:32.720 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-09T00:15:32.720 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mon.b 2024-05-09T00:15:33.018 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:32 smithi150 systemd[1]: Stopping Ceph mon.b for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:15:33.018 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:32 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mon-b[46164]: 2024-05-09T00:15:32.961+0000 7fe2a0690700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:15:33.018 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:32 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mon-b[46164]: 2024-05-09T00:15:32.961+0000 7fe2a0690700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-09T00:15:33.385 INFO:journalctl@ceph.mon.b.smithi150.stdout:May 09 00:15:33 smithi150 bash[87351]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mon-b 2024-05-09T00:15:33.395 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mon.b.service' 2024-05-09T00:15:33.456 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:15:33.457 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-09T00:15:33.457 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-09T00:15:33.457 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mon.c 2024-05-09T00:15:33.806 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:33 smithi171 systemd[1]: Stopping Ceph mon.c for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:15:33.807 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:33 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mon-c[47328]: 2024-05-09T00:15:33.709+0000 7f17f0657700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:15:33.807 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:33 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mon-c[47328]: 2024-05-09T00:15:33.709+0000 7f17f0657700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-09T00:15:34.251 INFO:journalctl@ceph.mon.c.smithi171.stdout:May 09 00:15:33 smithi171 bash[90994]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mon-c 2024-05-09T00:15:34.258 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mon.c.service' 2024-05-09T00:15:34.312 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:15:34.312 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-09T00:15:34.312 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-09T00:15:34.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.x 2024-05-09T00:15:34.616 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:15:34 smithi081 systemd[1]: Stopping Ceph mgr.x for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:15:34.874 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:15:34 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x[42726]: 2024-05-09T00:15:34.617+0000 7fd0ab759700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:15:34.874 INFO:journalctl@ceph.mgr.x.smithi081.stdout:May 09 00:15:34 smithi081 bash[125550]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-x 2024-05-09T00:15:35.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.x.service' 2024-05-09T00:15:35.113 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:15:35.113 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-09T00:15:35.113 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-09T00:15:35.113 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.y 2024-05-09T00:15:35.490 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:15:35 smithi150 systemd[1]: Stopping Ceph mgr.y for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:15:35.768 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:15:35 smithi150 bash[87490]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-y 2024-05-09T00:15:35.768 INFO:journalctl@ceph.mgr.y.smithi150.stdout:May 09 00:15:35 smithi150 systemd[1]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-09T00:15:35.807 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.y.service' 2024-05-09T00:15:35.844 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:15:35.844 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-09T00:15:35.845 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-09T00:15:35.845 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.z 2024-05-09T00:15:36.238 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:15:35 smithi171 systemd[1]: Stopping Ceph mgr.z for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:15:36.546 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:15:36 smithi171 bash[91133]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mgr-z 2024-05-09T00:15:36.546 INFO:journalctl@ceph.mgr.z.smithi171.stdout:May 09 00:15:36 smithi171 systemd[1]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-05-09T00:15:36.551 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mgr.z.service' 2024-05-09T00:15:36.588 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:15:36.588 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-09T00:15:36.588 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-09T00:15:36.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.0 2024-05-09T00:15:36.874 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 09 00:15:36 smithi081 systemd[1]: Stopping Ceph osd.0 for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:15:37.306 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 09 00:15:36 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-0[60150]: 2024-05-09T00:15:36.882+0000 7f630844b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:15:37.306 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 09 00:15:36 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-0[60150]: 2024-05-09T00:15:36.882+0000 7f630844b700 -1 osd.0 98 *** Got signal Terminated *** 2024-05-09T00:15:37.306 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 09 00:15:36 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-0[60150]: 2024-05-09T00:15:36.882+0000 7f630844b700 -1 osd.0 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:15:42.874 INFO:journalctl@ceph.osd.0.smithi081.stdout:May 09 00:15:42 smithi081 bash[125699]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-0 2024-05-09T00:15:43.770 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.0.service' 2024-05-09T00:15:43.810 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:15:43.810 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-09T00:15:43.811 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-09T00:15:43.811 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.1 2024-05-09T00:15:44.268 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 09 00:15:43 smithi150 systemd[1]: Stopping Ceph osd.1 for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:15:44.269 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 09 00:15:44 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-1[51153]: 2024-05-09T00:15:44.053+0000 7f28f547f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:15:44.269 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 09 00:15:44 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-1[51153]: 2024-05-09T00:15:44.053+0000 7f28f547f700 -1 osd.1 98 *** Got signal Terminated *** 2024-05-09T00:15:44.269 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 09 00:15:44 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-1[51153]: 2024-05-09T00:15:44.053+0000 7f28f547f700 -1 osd.1 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:15:49.769 INFO:journalctl@ceph.osd.1.smithi150.stdout:May 09 00:15:49 smithi150 bash[87630]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-1 2024-05-09T00:15:50.789 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.1.service' 2024-05-09T00:15:50.830 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:15:50.830 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-09T00:15:50.831 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-09T00:15:50.831 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.2 2024-05-09T00:15:51.119 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 09 00:15:50 smithi171 systemd[1]: Stopping Ceph osd.2 for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:15:51.556 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 09 00:15:51 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-2[53103]: 2024-05-09T00:15:51.120+0000 7f19c0e47700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:15:51.557 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 09 00:15:51 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-2[53103]: 2024-05-09T00:15:51.120+0000 7f19c0e47700 -1 osd.2 98 *** Got signal Terminated *** 2024-05-09T00:15:51.557 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 09 00:15:51 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-2[53103]: 2024-05-09T00:15:51.120+0000 7f19c0e47700 -1 osd.2 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:15:57.057 INFO:journalctl@ceph.osd.2.smithi171.stdout:May 09 00:15:56 smithi171 bash[91276]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-2 2024-05-09T00:15:58.058 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.2.service' 2024-05-09T00:15:58.099 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:15:58.100 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-09T00:15:58.100 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-09T00:15:58.100 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.3 2024-05-09T00:15:58.429 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 09 00:15:58 smithi081 systemd[1]: Stopping Ceph osd.3 for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:15:58.873 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 09 00:15:58 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-3[68226]: 2024-05-09T00:15:58.430+0000 7f2980644700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:15:58.874 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 09 00:15:58 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-3[68226]: 2024-05-09T00:15:58.430+0000 7f2980644700 -1 osd.3 98 *** Got signal Terminated *** 2024-05-09T00:15:58.874 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 09 00:15:58 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-3[68226]: 2024-05-09T00:15:58.430+0000 7f2980644700 -1 osd.3 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:16:03.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:02 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:02.855+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:03.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:02 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:02.839+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:03.788 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:03 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:03.523+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:04.056 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:03 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:03.789+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:04.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:03 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:03.851+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:04.124 INFO:journalctl@ceph.osd.3.smithi081.stdout:May 09 00:16:03 smithi081 bash[125962]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-3 2024-05-09T00:16:04.807 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:04.538+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:04.807 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:04 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:04.758+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:05.109 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:04 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:04.878+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:05.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.3.service' 2024-05-09T00:16:05.157 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:16:05.157 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-09T00:16:05.158 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-09T00:16:05.158 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.4 2024-05-09T00:16:05.398 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 09 00:16:05 smithi150 systemd[1]: Stopping Ceph osd.4 for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:16:05.398 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:05 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:05.078+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:05.768 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 09 00:16:05 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-4[59216]: 2024-05-09T00:16:05.399+0000 7ff6c5d1e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:16:05.768 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 09 00:16:05 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-4[59216]: 2024-05-09T00:16:05.399+0000 7ff6c5d1e700 -1 osd.4 98 *** Got signal Terminated *** 2024-05-09T00:16:05.768 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 09 00:16:05 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-4[59216]: 2024-05-09T00:16:05.399+0000 7ff6c5d1e700 -1 osd.4 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:16:05.788 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:05 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:05.532+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:05.840 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:05 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:05.530+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:06.056 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:05 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:05.789+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:06.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:05 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:05.842+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:06.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:06 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:06.092+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:06.807 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:06 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:06.756+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:06.807 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:06 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:06.545+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:06.838 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:06 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:06.574+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:07.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:06 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:06.839+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:07.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:06 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:06.860+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:07.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:07 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:07.060+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:07.807 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:07 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:07.536+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:07.807 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:07 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:07.775+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:07.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:07 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:07.554+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:07.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:07 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:07.793+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:08.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:07 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:07.854+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:08.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:08 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:08.056+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:08.802 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:08 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:08.553+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:08.875 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:08 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:08.582+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:08.875 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:08 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:08.792+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:09.057 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:08 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:08.904+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:09.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:08 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:08.803+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:09.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:09 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:09.074+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:09.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:09 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:09.585+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:09.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:09 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:09.795+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:09.933 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:09 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:09.588+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:09.933 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:09 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:09.837+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:10.309 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:09 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:09.934+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:10.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:10 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:10.033+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:10.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:10 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:10.033+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:10.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:10 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:10.581+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:10.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:10 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:10.770+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:10.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:10 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:10.770+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.141301+0000 front 2024-05-09T00:15:46.141201+0000 (oldest deadline 2024-05-09T00:16:10.241098+0000) 2024-05-09T00:16:10.892 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:10 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:10.813+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:10.893 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:10 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:10.572+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:10.893 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:10 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:10.572+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.155620+0000 front 2024-05-09T00:15:48.155492+0000 (oldest deadline 2024-05-09T00:16:10.455307+0000) 2024-05-09T00:16:11.268 INFO:journalctl@ceph.osd.4.smithi150.stdout:May 09 00:16:11 smithi150 bash[87900]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-4 2024-05-09T00:16:11.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:10 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:10.854+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:11.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:11 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:11.056+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:11.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:11 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:11.056+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:11.306 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:10 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:10.894+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:11.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:11 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:11.757+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:11.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:11 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:11.757+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.141301+0000 front 2024-05-09T00:15:46.141201+0000 (oldest deadline 2024-05-09T00:16:10.241098+0000) 2024-05-09T00:16:11.875 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:11 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:11.537+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:11.875 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:11 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:11.537+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:11.934 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:11 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:11.793+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:11.934 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:11 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:11.793+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:11.934 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:11 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:11.620+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:11.934 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:11 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:11.620+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.155620+0000 front 2024-05-09T00:15:48.155492+0000 (oldest deadline 2024-05-09T00:16:10.455307+0000) 2024-05-09T00:16:11.946 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:11 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:11.811+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:12.268 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:12 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:12.023+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:12.268 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:12 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:12.023+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:12.292 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.4.service' 2024-05-09T00:16:12.306 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:11 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:11.935+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:12.334 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:16:12.335 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-09T00:16:12.335 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-09T00:16:12.335 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.5 2024-05-09T00:16:12.669 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:12 smithi171 systemd[1]: Stopping Ceph osd.5 for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:16:12.669 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:12 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:12.598+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:12.669 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:12 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:12.598+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.155620+0000 front 2024-05-09T00:15:48.155492+0000 (oldest deadline 2024-05-09T00:16:10.455307+0000) 2024-05-09T00:16:12.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:12 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:12.745+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:12.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:12 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:12.745+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.141301+0000 front 2024-05-09T00:15:46.141201+0000 (oldest deadline 2024-05-09T00:16:10.241098+0000) 2024-05-09T00:16:12.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:12 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:12.576+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:12.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:12 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:12.576+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:13.057 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:12 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:12.669+0000 7fbe5ac9a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:16:13.057 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:12 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:12.669+0000 7fbe5ac9a700 -1 osd.5 98 *** Got signal Terminated *** 2024-05-09T00:16:13.057 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:12 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:12.669+0000 7fbe5ac9a700 -1 osd.5 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:16:13.057 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:12 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:12.904+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:13.057 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:12 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:12.904+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:13.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:12 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:12.837+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:13.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:12 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:12.837+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:13.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:12 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:12.779+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:13.268 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:13 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:13.026+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:13.268 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:13 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:13.026+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:13.855 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:13 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:13.567+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:13.855 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:13 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:13.567+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.155620+0000 front 2024-05-09T00:15:48.155492+0000 (oldest deadline 2024-05-09T00:16:10.455307+0000) 2024-05-09T00:16:13.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:13 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:13.773+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:13.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:13 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:13.773+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.141301+0000 front 2024-05-09T00:15:46.141201+0000 (oldest deadline 2024-05-09T00:16:10.241098+0000) 2024-05-09T00:16:13.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:13 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:13.559+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:13.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:13 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:13.559+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:14.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:13 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:13.805+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:14.268 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:14 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:14.024+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:14.268 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:14 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:14.024+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:14.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:13 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:13.944+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:14.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:13 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:13.944+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:14.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:13 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:13.855+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:14.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:13 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:13.855+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:14.807 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:14 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:14.533+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:14.807 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:14 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:14.533+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.155620+0000 front 2024-05-09T00:15:48.155492+0000 (oldest deadline 2024-05-09T00:16:10.455307+0000) 2024-05-09T00:16:14.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:14 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:14.744+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:14.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:14 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:14.744+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.141301+0000 front 2024-05-09T00:15:46.141201+0000 (oldest deadline 2024-05-09T00:16:10.241098+0000) 2024-05-09T00:16:14.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:14 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:14.524+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:14.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:14 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:14.524+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:15.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:14 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:14.843+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:15.268 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:14 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:14.987+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:15.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:14 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:14.987+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:15.306 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:14 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:14.908+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:15.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:14 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:14.908+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:15.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:14 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:14.830+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:15.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:14 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:14.830+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:15.789 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:15 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:15.493+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:15.789 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:15 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:15.493+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:15.804 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:15 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:15.529+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:15.805 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:15 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:15.529+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.155620+0000 front 2024-05-09T00:15:48.155492+0000 (oldest deadline 2024-05-09T00:16:10.455307+0000) 2024-05-09T00:16:16.057 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:15 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:15.945+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:16.057 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:15 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:15.945+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:16.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:15 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:15.806+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:16.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:15 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:15.806+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:16.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:15 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:15.790+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:16.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:15 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:15.790+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.141301+0000 front 2024-05-09T00:15:46.141201+0000 (oldest deadline 2024-05-09T00:16:10.241098+0000) 2024-05-09T00:16:16.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:15 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:15.845+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:16.268 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:15 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:15.989+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:16.268 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:15 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:15.989+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:16.743 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:16 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:16.447+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:16.744 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:16 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:16.447+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:16.806 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:16 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:16.548+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:16.807 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:16 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:16.548+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.155620+0000 front 2024-05-09T00:15:48.155492+0000 (oldest deadline 2024-05-09T00:16:10.455307+0000) 2024-05-09T00:16:17.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:16 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:16.745+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:17.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:16 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:16.745+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.141301+0000 front 2024-05-09T00:15:46.141201+0000 (oldest deadline 2024-05-09T00:16:10.241098+0000) 2024-05-09T00:16:17.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:16 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:16.745+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.341995+0000 front 2024-05-09T00:15:51.342031+0000 (oldest deadline 2024-05-09T00:16:16.641934+0000) 2024-05-09T00:16:17.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:16 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:16.874+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:17.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:16 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:16.939+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:17.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:16 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:16.939+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:17.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:16 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:16.952+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:17.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:16 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:16.952+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:17.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:16 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:16.952+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:17.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:16 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:16.847+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:17.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:16 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:16.847+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:17.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:16 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:16.847+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:17.807 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:17 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:17.547+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:39.954256+0000 front 2024-05-09T00:15:39.954307+0000 (oldest deadline 2024-05-09T00:16:03.454317+0000) 2024-05-09T00:16:17.807 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:17 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5[60947]: 2024-05-09T00:16:17.547+0000 7fbe53288700 -1 osd.5 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.155620+0000 front 2024-05-09T00:15:48.155492+0000 (oldest deadline 2024-05-09T00:16:10.455307+0000) 2024-05-09T00:16:17.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:17 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:17.700+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:17.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:17 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:17.700+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.141301+0000 front 2024-05-09T00:15:46.141201+0000 (oldest deadline 2024-05-09T00:16:10.241098+0000) 2024-05-09T00:16:17.874 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:17 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:17.700+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.341995+0000 front 2024-05-09T00:15:51.342031+0000 (oldest deadline 2024-05-09T00:16:16.641934+0000) 2024-05-09T00:16:17.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:17 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:17.456+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:17.875 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:17 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:17.456+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:18.146 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:17 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:17.909+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:18.147 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:17 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:17.909+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:18.147 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:17 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:17.909+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:18.147 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:17 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:17.869+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:18.147 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:17 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:17.869+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:18.147 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:17 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:17.869+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:18.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:17 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:17.884+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:18.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:17 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:17.884+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.434107+0000 front 2024-05-09T00:15:55.433998+0000 (oldest deadline 2024-05-09T00:16:17.133925+0000) 2024-05-09T00:16:18.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:17 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:17.923+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:18.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:17 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:17.923+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:18.557 INFO:journalctl@ceph.osd.5.smithi171.stdout:May 09 00:16:18 smithi171 bash[91540]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-5 2024-05-09T00:16:18.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:18 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:18.430+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:18.739 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:18 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:18.430+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:19.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:18 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:18.741+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:19.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:18 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:18.741+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.141301+0000 front 2024-05-09T00:15:46.141201+0000 (oldest deadline 2024-05-09T00:16:10.241098+0000) 2024-05-09T00:16:19.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:18 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:18.741+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.341995+0000 front 2024-05-09T00:15:51.342031+0000 (oldest deadline 2024-05-09T00:16:16.641934+0000) 2024-05-09T00:16:19.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:18 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:18.903+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:19.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:18 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:18.903+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.434107+0000 front 2024-05-09T00:15:55.433998+0000 (oldest deadline 2024-05-09T00:16:17.133925+0000) 2024-05-09T00:16:19.268 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:18 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:18.887+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:19.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:18 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:18.887+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:19.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:18 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:18.887+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:19.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:18 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:18.877+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:19.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:18 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:18.877+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:19.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:18 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:18.877+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:19.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:18 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:18.912+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:19.309 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:18 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:18.912+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:19.309 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:18 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:18.912+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:19.322 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.5.service' 2024-05-09T00:16:19.363 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:16:19.363 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-09T00:16:19.363 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-09T00:16:19.363 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.6 2024-05-09T00:16:19.756 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:19 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:19.403+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:19.756 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:19 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:19.403+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:19.756 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:19 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:19.403+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:19.756 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:19 smithi081 systemd[1]: Stopping Ceph osd.6 for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:16:19.756 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:19 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:19.602+0000 7f195af5f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:16:19.756 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:19 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:19.602+0000 7f195af5f700 -1 osd.6 98 *** Got signal Terminated *** 2024-05-09T00:16:19.757 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:19 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:19.602+0000 7f195af5f700 -1 osd.6 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:16:20.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:19 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:19.757+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:20.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:19 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:19.757+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.141301+0000 front 2024-05-09T00:15:46.141201+0000 (oldest deadline 2024-05-09T00:16:10.241098+0000) 2024-05-09T00:16:20.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:19 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:19.757+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.341995+0000 front 2024-05-09T00:15:51.342031+0000 (oldest deadline 2024-05-09T00:16:16.641934+0000) 2024-05-09T00:16:20.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:19 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:19.900+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:20.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:19 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:19.900+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.434107+0000 front 2024-05-09T00:15:55.433998+0000 (oldest deadline 2024-05-09T00:16:17.133925+0000) 2024-05-09T00:16:20.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:19 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:19.903+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:20.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:19 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:19.903+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:20.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:19 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:19.904+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:20.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:19 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:19.885+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:20.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:19 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:19.885+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:20.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:19 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:19.885+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:20.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:19 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:19.899+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:20.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:19 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:19.899+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:20.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:19 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:19.899+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:20.752 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:20 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:20.417+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:20.752 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:20 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:20.417+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:20.753 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:20 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:20.417+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:21.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:20 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:20.754+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:21.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:20 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:20.754+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.141301+0000 front 2024-05-09T00:15:46.141201+0000 (oldest deadline 2024-05-09T00:16:10.241098+0000) 2024-05-09T00:16:21.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:20 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:20.754+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.341995+0000 front 2024-05-09T00:15:51.342031+0000 (oldest deadline 2024-05-09T00:16:16.641934+0000) 2024-05-09T00:16:21.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:20 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:20.875+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:21.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:20 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:20.875+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.434107+0000 front 2024-05-09T00:15:55.433998+0000 (oldest deadline 2024-05-09T00:16:17.133925+0000) 2024-05-09T00:16:21.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:20 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:20.929+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:21.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:20 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:20.929+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:21.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:20 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:20.929+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:21.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:20 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:20.915+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:21.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:20 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:20.915+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:21.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:20 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:20.915+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:21.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:20 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:20.894+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:21.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:20 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:20.894+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:21.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:20 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:20.894+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:21.787 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:21 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:21.435+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:21.787 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:21 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:21.435+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:21.787 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:21 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:21.435+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:22.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:21 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:21.789+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:22.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:21 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:21.789+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.141301+0000 front 2024-05-09T00:15:46.141201+0000 (oldest deadline 2024-05-09T00:16:10.241098+0000) 2024-05-09T00:16:22.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:21 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:21.789+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.341995+0000 front 2024-05-09T00:15:51.342031+0000 (oldest deadline 2024-05-09T00:16:16.641934+0000) 2024-05-09T00:16:22.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:21 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:21.891+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:22.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:21 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:21.891+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.434107+0000 front 2024-05-09T00:15:55.433998+0000 (oldest deadline 2024-05-09T00:16:17.133925+0000) 2024-05-09T00:16:22.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:21 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:21.964+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:22.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:21 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:21.964+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:22.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:21 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:21.964+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:22.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:21 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:21.925+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:22.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:21 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:21.925+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:22.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:21 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:21.925+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:22.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:21 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:21.917+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:22.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:21 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:21.917+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:22.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:21 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:21.917+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:22.752 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:22 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:22.446+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:22.752 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:22 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:22.446+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:22.753 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:22 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:22.446+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:23.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:22 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:22.754+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:23.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:22 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:22.754+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.141301+0000 front 2024-05-09T00:15:46.141201+0000 (oldest deadline 2024-05-09T00:16:10.241098+0000) 2024-05-09T00:16:23.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:22 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:22.754+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.341995+0000 front 2024-05-09T00:15:51.342031+0000 (oldest deadline 2024-05-09T00:16:16.641934+0000) 2024-05-09T00:16:23.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:22 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:22.858+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:23.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:22 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:22.858+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.434107+0000 front 2024-05-09T00:15:55.433998+0000 (oldest deadline 2024-05-09T00:16:17.133925+0000) 2024-05-09T00:16:23.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:22 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:22.983+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:23.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:22 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:22.983+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:23.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:22 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:22.983+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:23.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:22 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:22.936+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:23.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:22 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:22.936+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:23.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:22 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:22.936+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:23.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:22 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:22.934+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:23.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:22 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:22.934+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:23.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:22 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:22.934+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:23.793 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:23 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:23.429+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:23.793 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:23 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:23.429+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:23.793 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:23 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:23.429+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:24.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:23 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:23.794+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.039407+0000 front 2024-05-09T00:15:41.039447+0000 (oldest deadline 2024-05-09T00:16:02.739573+0000) 2024-05-09T00:16:24.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:23 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:23.794+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.141301+0000 front 2024-05-09T00:15:46.141201+0000 (oldest deadline 2024-05-09T00:16:10.241098+0000) 2024-05-09T00:16:24.124 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:23 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6[76295]: 2024-05-09T00:16:23.794+0000 7f195354d700 -1 osd.6 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.341995+0000 front 2024-05-09T00:15:51.342031+0000 (oldest deadline 2024-05-09T00:16:16.641934+0000) 2024-05-09T00:16:24.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:23 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:23.907+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:24.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:23 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:23.907+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.434107+0000 front 2024-05-09T00:15:55.433998+0000 (oldest deadline 2024-05-09T00:16:17.133925+0000) 2024-05-09T00:16:24.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:24 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:24.014+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:24.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:24 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:24.014+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:24.270 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:24 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:24.014+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:24.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:23 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:23.950+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:24.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:23 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:23.950+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:24.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:23 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:23.950+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:24.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:23 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:23.979+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:24.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:23 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:23.979+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:24.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:23 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:23.979+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:24.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:24 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:24.453+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:24.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:24 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:24.453+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:24.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:24 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:24.453+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:25.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:24 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:24.940+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:25.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:24 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:24.940+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.434107+0000 front 2024-05-09T00:15:55.433998+0000 (oldest deadline 2024-05-09T00:16:17.133925+0000) 2024-05-09T00:16:25.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:24 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:24.940+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.935481+0000 front 2024-05-09T00:15:59.935508+0000 (oldest deadline 2024-05-09T00:16:24.635471+0000) 2024-05-09T00:16:25.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:25 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:25.039+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:25.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:25 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:25.039+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:25.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:25 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:25.039+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:25.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:25 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:25.039+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:25.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:24 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:24.945+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:25.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:24 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:24.945+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:25.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:24 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:24.945+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:25.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:24 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:24.927+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:25.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:24 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:24.927+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:25.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:24 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:24.927+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:25.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:24 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:24.927+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:02.529884+0000 front 2024-05-09T00:16:02.530027+0000 (oldest deadline 2024-05-09T00:16:24.829898+0000) 2024-05-09T00:16:25.374 INFO:journalctl@ceph.osd.6.smithi081.stdout:May 09 00:16:25 smithi081 bash[126222]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-6 2024-05-09T00:16:25.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:25 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:25.407+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:25.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:25 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:25.407+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:25.875 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:25 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:25.407+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:25.875 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:25 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:25.407+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:26.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:25 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:25.990+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:26.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:25 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:25.990+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.434107+0000 front 2024-05-09T00:15:55.433998+0000 (oldest deadline 2024-05-09T00:16:17.133925+0000) 2024-05-09T00:16:26.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:25 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:25.990+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.935481+0000 front 2024-05-09T00:15:59.935508+0000 (oldest deadline 2024-05-09T00:16:24.635471+0000) 2024-05-09T00:16:26.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:26 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:26.043+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:26.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:26 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:26.043+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:26.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:26 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:26.043+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:26.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:26 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:26.043+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:26.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.6.service' 2024-05-09T00:16:26.306 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:25 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:25.906+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:26.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:25 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:25.906+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:26.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:25 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:25.906+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:26.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:25 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:25.888+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:26.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:25 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:25.888+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:26.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:25 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:25.888+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:26.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:25 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:25.888+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:02.529884+0000 front 2024-05-09T00:16:02.530027+0000 (oldest deadline 2024-05-09T00:16:24.829898+0000) 2024-05-09T00:16:26.311 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:16:26.311 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-09T00:16:26.311 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-09T00:16:26.311 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.7 2024-05-09T00:16:26.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:26 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:26.362+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:26.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:26 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:26.362+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:26.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:26 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:26.362+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:26.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:26 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:26.362+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:26.769 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:26 smithi150 systemd[1]: Stopping Ceph osd.7 for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:16:26.769 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:26 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:26.555+0000 7f59bfd04700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:16:26.769 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:26 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:26.555+0000 7f59bfd04700 -1 osd.7 98 *** Got signal Terminated *** 2024-05-09T00:16:26.769 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:26 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:26.555+0000 7f59bfd04700 -1 osd.7 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:16:27.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:26 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:26.985+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:27.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:26 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:26.985+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.434107+0000 front 2024-05-09T00:15:55.433998+0000 (oldest deadline 2024-05-09T00:16:17.133925+0000) 2024-05-09T00:16:27.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:26 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:26.985+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.935481+0000 front 2024-05-09T00:15:59.935508+0000 (oldest deadline 2024-05-09T00:16:24.635471+0000) 2024-05-09T00:16:27.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:27 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:27.045+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:27.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:27 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:27.045+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:27.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:27 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:27.045+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:27.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:27 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:27.045+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:27.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:26 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:26.859+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:27.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:26 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:26.859+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:27.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:26 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:26.859+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:27.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:26 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:26.933+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:27.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:26 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:26.933+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:27.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:26 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:26.933+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:27.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:26 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:26.933+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:02.529884+0000 front 2024-05-09T00:16:02.530027+0000 (oldest deadline 2024-05-09T00:16:24.829898+0000) 2024-05-09T00:16:27.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:27 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:27.391+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:27.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:27 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:27.391+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:27.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:27 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:27.391+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:27.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:27 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:27.391+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:28.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:27 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:27.817+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:28.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:27 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:27.817+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:28.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:27 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:27.817+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:28.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:27 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:27.888+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:28.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:27 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:27.888+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:28.308 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:27 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:27.888+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:28.308 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:27 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:27.888+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:02.529884+0000 front 2024-05-09T00:16:02.530027+0000 (oldest deadline 2024-05-09T00:16:24.829898+0000) 2024-05-09T00:16:28.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:28.029+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:28.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:28.029+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:28.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:28.029+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:28.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:28.029+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:28.519 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:28.021+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:28.519 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:28.021+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.434107+0000 front 2024-05-09T00:15:55.433998+0000 (oldest deadline 2024-05-09T00:16:17.133925+0000) 2024-05-09T00:16:28.519 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:28 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:28.021+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.935481+0000 front 2024-05-09T00:15:59.935508+0000 (oldest deadline 2024-05-09T00:16:24.635471+0000) 2024-05-09T00:16:28.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:28 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:28.355+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:28.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:28 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:28.355+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:28.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:28 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:28.355+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:28.625 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:28 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:28.355+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:29.268 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:29 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:29.048+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:29.268 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:29 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:29.048+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:29.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:29 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:29.048+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:29.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:29 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:29.048+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:29.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:29 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:29.004+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:29.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:29 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:29.004+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.434107+0000 front 2024-05-09T00:15:55.433998+0000 (oldest deadline 2024-05-09T00:16:17.133925+0000) 2024-05-09T00:16:29.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:29 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:29.004+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.935481+0000 front 2024-05-09T00:15:59.935508+0000 (oldest deadline 2024-05-09T00:16:24.635471+0000) 2024-05-09T00:16:29.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:28.859+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:29.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:28.859+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:29.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:28.859+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:29.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:28.859+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:02.529884+0000 front 2024-05-09T00:16:02.530027+0000 (oldest deadline 2024-05-09T00:16:24.829898+0000) 2024-05-09T00:16:29.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:28.860+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:29.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:28.860+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:29.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:28 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:28.860+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:29.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:29.337+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:29.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:29.337+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:29.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:29.337+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:29.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:29 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:29.337+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:30.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:29 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:29.966+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:30.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:29 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:29.966+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.434107+0000 front 2024-05-09T00:15:55.433998+0000 (oldest deadline 2024-05-09T00:16:17.133925+0000) 2024-05-09T00:16:30.269 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:29 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:29.966+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.935481+0000 front 2024-05-09T00:15:59.935508+0000 (oldest deadline 2024-05-09T00:16:24.635471+0000) 2024-05-09T00:16:30.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:30 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:30.084+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:30.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:30 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:30.084+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:30.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:30 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:30.084+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:30.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:30 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:30.084+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:30.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:29 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:29.847+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:30.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:29 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:29.847+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:30.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:29 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:29.847+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:30.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:29 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:29.856+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:30.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:29 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:29.856+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:30.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:29 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:29.856+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:30.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:29 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:29.856+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:02.529884+0000 front 2024-05-09T00:16:02.530027+0000 (oldest deadline 2024-05-09T00:16:24.829898+0000) 2024-05-09T00:16:30.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:30 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:30.359+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:30.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:30 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:30.359+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:30.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:30 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:30.359+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:30.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:30 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:30.359+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:31.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:30 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:30.976+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.831300+0000 front 2024-05-09T00:15:46.831282+0000 (oldest deadline 2024-05-09T00:16:10.231975+0000) 2024-05-09T00:16:31.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:30 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:30.976+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.434107+0000 front 2024-05-09T00:15:55.433998+0000 (oldest deadline 2024-05-09T00:16:17.133925+0000) 2024-05-09T00:16:31.268 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:30 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7[67141]: 2024-05-09T00:16:30.976+0000 7f59b82f2700 -1 osd.7 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.935481+0000 front 2024-05-09T00:15:59.935508+0000 (oldest deadline 2024-05-09T00:16:24.635471+0000) 2024-05-09T00:16:31.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:31 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:31.134+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:31.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:31 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:31.134+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:31.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:31 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:31.134+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:31.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:31 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:31.134+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:31.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:30 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:30.847+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:31.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:30 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:30.847+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:31.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:30 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:30.847+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:31.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:30 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:30.830+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:31.308 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:30 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:30.831+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:31.308 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:30 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:30.831+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:31.308 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:30 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:30.831+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:02.529884+0000 front 2024-05-09T00:16:02.530027+0000 (oldest deadline 2024-05-09T00:16:24.829898+0000) 2024-05-09T00:16:31.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:31 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:31.369+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:31.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:31 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:31.369+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:31.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:31 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:31.369+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:31.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:31 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:31.369+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:32.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:31 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:31.836+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:32.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:31 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:31.836+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:32.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:31 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:31.836+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:32.308 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:31 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:31.846+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:32.308 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:31 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:31.846+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:32.308 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:31 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:31.846+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:32.308 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:31 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:31.846+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:02.529884+0000 front 2024-05-09T00:16:02.530027+0000 (oldest deadline 2024-05-09T00:16:24.829898+0000) 2024-05-09T00:16:32.518 INFO:journalctl@ceph.osd.7.smithi150.stdout:May 09 00:16:32 smithi150 bash[88158]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-7 2024-05-09T00:16:32.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:32 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:32.108+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:32.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:32 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:32.108+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:32.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:32 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:32.108+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:32.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:32 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:32.108+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:32.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:32 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:32.386+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:32.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:32 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:32.386+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:32.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:32 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:32.386+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:32.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:32 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:32.386+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:33.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:32 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:32.882+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:33.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:32 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:32.882+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:33.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:32 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:32.882+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:33.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:32 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:32.882+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:02.529884+0000 front 2024-05-09T00:16:02.530027+0000 (oldest deadline 2024-05-09T00:16:24.829898+0000) 2024-05-09T00:16:33.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:32 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:32.882+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:33.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:32 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:32.882+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:33.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:32 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:32.882+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:33.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:32 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:32.882+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:33.407 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:33 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:33.158+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:33.408 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:33 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:33.158+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:33.408 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:33 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:33.158+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:33.408 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:33 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:33.158+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:33.415 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.7.service' 2024-05-09T00:16:33.455 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:16:33.456 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-09T00:16:33.456 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-09T00:16:33.456 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.8 2024-05-09T00:16:33.807 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:33 smithi171 systemd[1]: Stopping Ceph osd.8 for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:16:33.807 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:33 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:33.692+0000 7f9bf2c99700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:16:33.807 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:33 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:33.692+0000 7f9bf2c99700 -1 osd.8 98 *** Got signal Terminated *** 2024-05-09T00:16:33.807 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:33 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:33.692+0000 7f9bf2c99700 -1 osd.8 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:16:33.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:33 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:33.409+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:33.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:33 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:33.409+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:33.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:33 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:33.409+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:33.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:33 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:33.409+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:34.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:33 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:33.845+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:34.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:33 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:33.845+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:34.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:33 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:33.845+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:34.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:33 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:33.845+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:02.529884+0000 front 2024-05-09T00:16:02.530027+0000 (oldest deadline 2024-05-09T00:16:24.829898+0000) 2024-05-09T00:16:34.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:33 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:33.894+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:34.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:33 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:33.894+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:34.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:33 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:33.894+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:34.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:33 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:33.894+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:34.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:34 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:34.179+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:34.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:34 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:34.179+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:34.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:34 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:34.179+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:34.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:34 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:34.179+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:34.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:34 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:34.388+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:34.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:34 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:34.388+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:34.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:34 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:34.388+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:34.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:34 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:34.388+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:35.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:34 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:34.867+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:35.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:34 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:34.867+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:35.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:34 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:34.867+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:35.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:34 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:34.867+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:02.529884+0000 front 2024-05-09T00:16:02.530027+0000 (oldest deadline 2024-05-09T00:16:24.829898+0000) 2024-05-09T00:16:35.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:34 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:34.937+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:35.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:34 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:34.937+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:35.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:34 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:34.937+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:35.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:34 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:34.937+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:35.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:35 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:35.146+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:35.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:35 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:35.146+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:35.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:35 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:35.146+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:35.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:35 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:35.146+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:35.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:35 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:35.407+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:35.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:35 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:35.407+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:35.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:35 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:35.407+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:35.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:35 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:35.407+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:36.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:35 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:35.882+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:36.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:35 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:35.882+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:36.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:35 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:35.882+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:36.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:35 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:35.882+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:02.529884+0000 front 2024-05-09T00:16:02.530027+0000 (oldest deadline 2024-05-09T00:16:24.829898+0000) 2024-05-09T00:16:36.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:35 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:35.889+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:36.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:35 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:35.889+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:36.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:35 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:35.889+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:36.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:35 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:35.889+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:36.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:36 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:36.152+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:36.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:36 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:36.152+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:36.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:36 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:36.152+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:36.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:36 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:36.152+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:36.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:36 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:36.368+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:36.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:36 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:36.368+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:36.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:36 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:36.368+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:36.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:36 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:36.368+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:37.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:36 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:36.894+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:37.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:36 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:36.894+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:37.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:36 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:36.894+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:37.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:36 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:36.894+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:02.529884+0000 front 2024-05-09T00:16:02.530027+0000 (oldest deadline 2024-05-09T00:16:24.829898+0000) 2024-05-09T00:16:37.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:36 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:36.903+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:37.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:36 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:36.903+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:37.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:36 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:36.903+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:37.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:36 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:36.903+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:37.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:37 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:37.142+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:37.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:37 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:37.142+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:37.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:37 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:37.142+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:37.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:37 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:37.142+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:37.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:37 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:37.142+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:37.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:37 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:37.385+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:37.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:37 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:37.385+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:37.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:37 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:37.385+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:37.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:37 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:37.386+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:37.875 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:37 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:37.386+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:05.930368+0000 front 2024-05-09T00:16:05.930329+0000 (oldest deadline 2024-05-09T00:16:36.530748+0000) 2024-05-09T00:16:38.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:37.913+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:40.426104+0000 front 2024-05-09T00:15:40.426074+0000 (oldest deadline 2024-05-09T00:16:06.326094+0000) 2024-05-09T00:16:38.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:37.913+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:48.528077+0000 front 2024-05-09T00:15:48.528110+0000 (oldest deadline 2024-05-09T00:16:12.028123+0000) 2024-05-09T00:16:38.307 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:37.913+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:52.028478+0000 front 2024-05-09T00:15:52.028439+0000 (oldest deadline 2024-05-09T00:16:16.728601+0000) 2024-05-09T00:16:38.308 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8[69058]: 2024-05-09T00:16:37.913+0000 7f9beb287700 -1 osd.8 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:02.529884+0000 front 2024-05-09T00:16:02.530027+0000 (oldest deadline 2024-05-09T00:16:24.829898+0000) 2024-05-09T00:16:38.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:37.903+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:38.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:37.903+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:38.308 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:37.903+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:38.309 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:37.903+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:38.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:38 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:38.142+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:38.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:38 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:38.142+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:38.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:38 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:38.142+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:38.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:38 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:38.142+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:38.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:38 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:38.142+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:38.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:38 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:38.142+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:38.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:38 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:38.402+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:38.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:38 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:38.402+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:38.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:38 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:38.402+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:38.875 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:38 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:38.402+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:38.875 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:38 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:38.402+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:05.930368+0000 front 2024-05-09T00:16:05.930329+0000 (oldest deadline 2024-05-09T00:16:36.530748+0000) 2024-05-09T00:16:39.270 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:38 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:38.915+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:39.270 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:38 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:38.915+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:39.270 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:38 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:38.915+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:39.270 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:38 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:38.915+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:39.270 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:38 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:38.915+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:39.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:39 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:39.173+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:39.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:39 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:39.173+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:39.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:39 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:39.173+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:39.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:39 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:39.173+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:39.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:39 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:39.173+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:39.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:39 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:39.173+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:39.556 INFO:journalctl@ceph.osd.8.smithi171.stdout:May 09 00:16:39 smithi171 bash[91795]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-8 2024-05-09T00:16:39.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:39 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:39.378+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:39.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:39 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:39.378+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:39.875 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:39 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:39.378+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:39.875 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:39 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:39.378+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:39.875 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:39 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:39.378+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:05.930368+0000 front 2024-05-09T00:16:05.930329+0000 (oldest deadline 2024-05-09T00:16:36.530748+0000) 2024-05-09T00:16:40.213 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:39 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:39.900+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:40.213 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:39 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:39.900+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:40.213 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:39 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:39.900+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:40.213 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:39 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:39.900+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:40.213 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:39 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:39.900+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:40.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:40 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:40.185+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:40.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:40 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:40.185+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:40.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:40 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:40.185+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:40.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:40 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:40.185+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:40.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:40 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:40.185+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:40.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:40 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:40.185+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:40.536 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.8.service' 2024-05-09T00:16:40.575 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:16:40.575 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-09T00:16:40.575 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-09T00:16:40.576 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.9 2024-05-09T00:16:40.608 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:40 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:40.343+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:40.608 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:40 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:40.343+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:40.608 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:40 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:40.343+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:40.608 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:40 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:40.343+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:40.608 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:40 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:40.343+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:05.930368+0000 front 2024-05-09T00:16:05.930329+0000 (oldest deadline 2024-05-09T00:16:36.530748+0000) 2024-05-09T00:16:40.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:40 smithi081 systemd[1]: Stopping Ceph osd.9 for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:16:40.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:40 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:40.815+0000 7f4e36d1a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:16:40.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:40 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:40.815+0000 7f4e36d1a700 -1 osd.9 98 *** Got signal Terminated *** 2024-05-09T00:16:40.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:40 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:40.815+0000 7f4e36d1a700 -1 osd.9 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:16:41.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:40 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:40.906+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:41.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:40 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:40.906+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:41.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:40 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:40.906+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:41.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:40 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:40.906+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:41.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:40 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:40.906+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:41.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:41 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:41.221+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:41.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:41 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:41.221+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:41.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:41 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:41.221+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:41.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:41 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:41.221+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:41.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:41 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:41.221+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:41.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:41 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:41.221+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:41.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:41 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:41.386+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:41.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:41 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:41.386+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:41.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:41 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:41.386+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:41.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:41 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:41.386+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:41.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:41 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:41.386+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:05.930368+0000 front 2024-05-09T00:16:05.930329+0000 (oldest deadline 2024-05-09T00:16:36.530748+0000) 2024-05-09T00:16:42.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:41 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:41.879+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:42.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:41 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:41.879+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:42.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:41 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:41.879+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:42.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:41 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:41.879+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:42.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:41 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:41.879+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:42.768 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:42 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:42.269+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:42.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:42 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:42.269+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:42.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:42 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:42.269+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:42.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:42 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:42.269+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:42.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:42 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:42.269+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:42.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:42 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:42.269+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:42.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:42 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:42.398+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:42.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:42 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:42.398+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:42.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:42 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:42.398+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:42.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:42 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:42.398+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:42.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:42 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:42.398+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:05.930368+0000 front 2024-05-09T00:16:05.930329+0000 (oldest deadline 2024-05-09T00:16:36.530748+0000) 2024-05-09T00:16:42.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:42 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:42.398+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.531421+0000 front 2024-05-09T00:16:16.531500+0000 (oldest deadline 2024-05-09T00:16:41.831273+0000) 2024-05-09T00:16:43.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:42 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:42.896+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:43.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:42 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:42.896+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:43.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:42 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:42.896+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:43.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:42 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:42.896+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:43.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:42 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:42.896+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:43.768 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:43 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:43.284+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:43.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:43 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:43.284+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:43.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:43 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:43.284+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:43.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:43 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:43.284+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:43.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:43 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:43.284+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:43.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:43 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:43.284+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:43.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:43 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:43.410+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:43.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:43 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:43.410+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:43.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:43 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:43.410+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:43.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:43 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:43.410+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:43.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:43 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:43.410+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:05.930368+0000 front 2024-05-09T00:16:05.930329+0000 (oldest deadline 2024-05-09T00:16:36.530748+0000) 2024-05-09T00:16:43.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:43 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:43.410+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.531421+0000 front 2024-05-09T00:16:16.531500+0000 (oldest deadline 2024-05-09T00:16:41.831273+0000) 2024-05-09T00:16:44.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:43 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:43.917+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:44.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:43 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:43.917+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:44.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:43 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:43.917+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:44.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:43 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:43.917+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:44.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:43 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:43.917+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:44.768 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:44 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:44.314+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:44.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:44 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:44.314+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:44.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:44 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:44.314+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:44.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:44 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:44.314+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:44.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:44 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:44.314+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:44.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:44 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:44.314+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:44.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:44 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:44.426+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:44.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:44 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:44.426+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:44.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:44 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:44.426+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:44.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:44 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:44.426+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:44.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:44 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:44.426+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:05.930368+0000 front 2024-05-09T00:16:05.930329+0000 (oldest deadline 2024-05-09T00:16:36.530748+0000) 2024-05-09T00:16:44.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:44 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:44.426+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.531421+0000 front 2024-05-09T00:16:16.531500+0000 (oldest deadline 2024-05-09T00:16:41.831273+0000) 2024-05-09T00:16:45.310 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:44 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:44.922+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:45.310 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:44 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:44.922+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:45.310 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:44 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:44.922+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:45.310 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:44 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:44.922+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:45.310 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:44 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:44.922+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:45.768 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:45 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:45.340+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:45.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:45 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:45.340+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:45.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:45 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:45.340+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:45.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:45 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:45.340+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:45.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:45 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:45.340+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:45.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:45 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:45.340+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:45.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:45 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:45.406+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:41.525858+0000 front 2024-05-09T00:15:41.526169+0000 (oldest deadline 2024-05-09T00:16:05.026068+0000) 2024-05-09T00:16:45.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:45 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:45.406+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:46.727502+0000 front 2024-05-09T00:15:46.727269+0000 (oldest deadline 2024-05-09T00:16:10.827363+0000) 2024-05-09T00:16:45.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:45 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:45.406+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:54.328572+0000 front 2024-05-09T00:15:54.328685+0000 (oldest deadline 2024-05-09T00:16:19.028545+0000) 2024-05-09T00:16:45.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:45 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:45.406+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:15:59.028904+0000 front 2024-05-09T00:15:59.028958+0000 (oldest deadline 2024-05-09T00:16:24.829465+0000) 2024-05-09T00:16:45.874 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:45 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:45.406+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:05.930368+0000 front 2024-05-09T00:16:05.930329+0000 (oldest deadline 2024-05-09T00:16:36.530748+0000) 2024-05-09T00:16:45.875 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:45 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9[85083]: 2024-05-09T00:16:45.406+0000 7f4e2f308700 -1 osd.9 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.531421+0000 front 2024-05-09T00:16:16.531500+0000 (oldest deadline 2024-05-09T00:16:41.831273+0000) 2024-05-09T00:16:46.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:45 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:45.919+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:46.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:45 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:45.919+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:46.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:45 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:45.919+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:46.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:45 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:45.919+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:46.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:45 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:45.919+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:46.624 INFO:journalctl@ceph.osd.9.smithi081.stdout:May 09 00:16:46 smithi081 bash[126486]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-9 2024-05-09T00:16:46.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:46 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:46.318+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:46.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:46 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:46.318+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:46.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:46 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:46.318+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:46.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:46 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:46.318+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:46.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:46 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:46.318+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:46.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:46 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:46.318+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:46.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:46 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:46.318+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:22.211514+0000 front 2024-05-09T00:16:22.211609+0000 (oldest deadline 2024-05-09T00:16:46.311445+0000) 2024-05-09T00:16:47.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:46 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:46.962+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:47.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:46 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:46.962+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:47.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:46 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:46.962+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:47.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:46 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:46.962+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:47.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:46 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:46.962+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:47.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:46 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:46.962+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:20.817777+0000 front 2024-05-09T00:16:20.817757+0000 (oldest deadline 2024-05-09T00:16:46.717648+0000) 2024-05-09T00:16:47.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.9.service' 2024-05-09T00:16:47.533 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:16:47.533 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-09T00:16:47.533 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-09T00:16:47.533 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.10 2024-05-09T00:16:47.768 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:47 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:47.328+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:47.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:47 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:47.328+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:47.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:47 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:47.328+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:47.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:47 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:47.328+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:47.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:47 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:47.328+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:47.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:47 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:47.328+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:47.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:47 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:47.328+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:22.211514+0000 front 2024-05-09T00:16:22.211609+0000 (oldest deadline 2024-05-09T00:16:46.311445+0000) 2024-05-09T00:16:47.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:47 smithi150 systemd[1]: Stopping Ceph osd.10 for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:16:48.268 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:47 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:47.794+0000 7f579a05f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:16:48.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:47 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:47.794+0000 7f579a05f700 -1 osd.10 98 *** Got signal Terminated *** 2024-05-09T00:16:48.269 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:47 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:47.794+0000 7f579a05f700 -1 osd.10 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:16:48.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:47 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:47.927+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:48.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:47 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:47.927+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:48.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:47 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:47.927+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:48.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:47 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:47.927+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:48.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:47 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:47.927+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:48.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:47 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:47.927+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:20.817777+0000 front 2024-05-09T00:16:20.817757+0000 (oldest deadline 2024-05-09T00:16:46.717648+0000) 2024-05-09T00:16:48.768 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:48 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:48.293+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:48.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:48 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:48.293+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:48.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:48 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:48.293+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:48.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:48 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:48.293+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:48.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:48 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:48.293+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:48.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:48 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:48.293+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:48.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:48 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:48.293+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:22.211514+0000 front 2024-05-09T00:16:22.211609+0000 (oldest deadline 2024-05-09T00:16:46.311445+0000) 2024-05-09T00:16:49.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:48 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:48.900+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:49.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:48 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:48.900+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:49.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:48 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:48.900+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:49.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:48 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:48.900+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:49.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:48 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:48.900+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:49.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:48 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:48.900+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:20.817777+0000 front 2024-05-09T00:16:20.817757+0000 (oldest deadline 2024-05-09T00:16:46.717648+0000) 2024-05-09T00:16:49.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:49 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:49.263+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:49.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:49 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:49.263+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:49.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:49 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:49.263+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:49.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:49 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:49.263+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:49.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:49 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:49.263+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:49.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:49 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:49.263+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:49.519 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:49 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:49.263+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:22.211514+0000 front 2024-05-09T00:16:22.211609+0000 (oldest deadline 2024-05-09T00:16:46.311445+0000) 2024-05-09T00:16:50.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:49 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:49.877+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:50.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:49 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:49.877+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:50.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:49 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:49.877+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:50.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:49 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:49.877+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:50.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:49 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:49.877+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:50.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:49 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:49.877+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:20.817777+0000 front 2024-05-09T00:16:20.817757+0000 (oldest deadline 2024-05-09T00:16:46.717648+0000) 2024-05-09T00:16:50.768 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:50 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:50.299+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:50.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:50 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:50.299+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:50.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:50 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:50.299+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:50.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:50 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:50.299+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:50.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:50 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:50.299+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:50.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:50 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:50.299+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:50.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:50 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:50.299+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:22.211514+0000 front 2024-05-09T00:16:22.211609+0000 (oldest deadline 2024-05-09T00:16:46.311445+0000) 2024-05-09T00:16:51.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:50 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:50.916+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:51.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:50 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:50.916+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:51.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:50 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:50.916+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:51.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:50 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:50.916+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:51.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:50 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:50.916+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:51.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:50 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:50.916+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:20.817777+0000 front 2024-05-09T00:16:20.817757+0000 (oldest deadline 2024-05-09T00:16:46.717648+0000) 2024-05-09T00:16:51.768 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:51 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:51.274+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:51.768 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:51 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:51.274+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:51.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:51 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:51.274+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:51.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:51 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:51.274+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:51.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:51 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:51.274+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:51.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:51 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:51.274+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:51.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:51 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:51.274+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:22.211514+0000 front 2024-05-09T00:16:22.211609+0000 (oldest deadline 2024-05-09T00:16:46.311445+0000) 2024-05-09T00:16:52.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:51 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:51.878+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:52.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:51 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:51.878+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:52.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:51 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:51.878+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:52.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:51 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:51.878+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:52.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:51 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:51.878+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:52.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:51 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:51.878+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:20.817777+0000 front 2024-05-09T00:16:20.817757+0000 (oldest deadline 2024-05-09T00:16:46.717648+0000) 2024-05-09T00:16:52.768 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:52 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:52.323+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.405193+0000 front 2024-05-09T00:15:38.405111+0000 (oldest deadline 2024-05-09T00:16:04.304978+0000) 2024-05-09T00:16:52.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:52 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:52.323+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:44.805722+0000 front 2024-05-09T00:15:44.805744+0000 (oldest deadline 2024-05-09T00:16:09.505991+0000) 2024-05-09T00:16:52.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:52 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:52.323+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:55.407002+0000 front 2024-05-09T00:15:55.407065+0000 (oldest deadline 2024-05-09T00:16:18.306933+0000) 2024-05-09T00:16:52.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:52 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:52.323+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6814 osd.3 since back 2024-05-09T00:16:00.608086+0000 front 2024-05-09T00:16:00.608235+0000 (oldest deadline 2024-05-09T00:16:24.107985+0000) 2024-05-09T00:16:52.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:52 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:52.323+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:08.808836+0000 front 2024-05-09T00:16:08.808884+0000 (oldest deadline 2024-05-09T00:16:36.409595+0000) 2024-05-09T00:16:52.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:52 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:52.323+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:16.410414+0000 front 2024-05-09T00:16:16.410469+0000 (oldest deadline 2024-05-09T00:16:38.110319+0000) 2024-05-09T00:16:52.769 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:52 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10[75160]: 2024-05-09T00:16:52.323+0000 7f579264d700 -1 osd.10 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:22.211514+0000 front 2024-05-09T00:16:22.211609+0000 (oldest deadline 2024-05-09T00:16:46.311445+0000) 2024-05-09T00:16:53.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:52 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:52.845+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:53.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:52 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:52.845+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:53.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:52 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:52.845+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:53.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:52 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:52.845+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:53.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:52 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:52.845+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:53.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:52 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:52.845+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:20.817777+0000 front 2024-05-09T00:16:20.817757+0000 (oldest deadline 2024-05-09T00:16:46.717648+0000) 2024-05-09T00:16:53.518 INFO:journalctl@ceph.osd.10.smithi150.stdout:May 09 00:16:53 smithi150 bash[88422]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-10 2024-05-09T00:16:54.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:53 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:53.829+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:54.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:53 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:53.829+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:54.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:53 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:53.829+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:54.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:53 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:53.829+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:54.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:53 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:53.829+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:54.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:53 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:53.829+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:20.817777+0000 front 2024-05-09T00:16:20.817757+0000 (oldest deadline 2024-05-09T00:16:46.717648+0000) 2024-05-09T00:16:54.629 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.10.service' 2024-05-09T00:16:54.669 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:16:54.670 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-09T00:16:54.670 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-09T00:16:54.670 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.11 2024-05-09T00:16:55.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:54 smithi171 systemd[1]: Stopping Ceph osd.11 for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:16:55.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:54 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:54.819+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:55.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:54 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:54.819+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:55.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:54 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:54.819+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:55.058 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:54 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:54.819+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:55.058 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:54 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:54.819+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:55.058 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:54 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:54.819+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:20.817777+0000 front 2024-05-09T00:16:20.817757+0000 (oldest deadline 2024-05-09T00:16:46.717648+0000) 2024-05-09T00:16:55.058 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:54 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:54.819+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-05-09T00:16:31.319398+0000 front 2024-05-09T00:16:31.319295+0000 (oldest deadline 2024-05-09T00:16:54.219283+0000) 2024-05-09T00:16:55.058 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:54 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:54.905+0000 7f8a14576700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:16:55.058 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:54 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:54.905+0000 7f8a14576700 -1 osd.11 98 *** Got signal Terminated *** 2024-05-09T00:16:55.058 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:54 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:54.905+0000 7f8a14576700 -1 osd.11 98 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-09T00:16:56.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:55 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:55.849+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:56.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:55 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:55.849+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:56.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:55 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:55.849+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:56.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:55 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:55.849+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:56.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:55 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:55.849+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:56.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:55 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:55.849+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:20.817777+0000 front 2024-05-09T00:16:20.817757+0000 (oldest deadline 2024-05-09T00:16:46.717648+0000) 2024-05-09T00:16:56.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:55 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:55.849+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-05-09T00:16:31.319398+0000 front 2024-05-09T00:16:31.319295+0000 (oldest deadline 2024-05-09T00:16:54.219283+0000) 2024-05-09T00:16:57.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:56 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:56.814+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:57.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:56 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:56.814+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:57.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:56 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:56.814+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:57.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:56 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:56.814+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:57.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:56 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:56.814+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:57.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:56 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:56.814+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:20.817777+0000 front 2024-05-09T00:16:20.817757+0000 (oldest deadline 2024-05-09T00:16:46.717648+0000) 2024-05-09T00:16:57.307 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:56 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:56.814+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-05-09T00:16:31.319398+0000 front 2024-05-09T00:16:31.319295+0000 (oldest deadline 2024-05-09T00:16:54.219283+0000) 2024-05-09T00:16:58.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:57 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:57.792+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:58.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:57 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:57.792+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:58.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:57 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:57.792+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:58.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:57 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:57.792+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:58.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:57 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:57.792+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:58.058 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:57 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:57.792+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:20.817777+0000 front 2024-05-09T00:16:20.817757+0000 (oldest deadline 2024-05-09T00:16:46.717648+0000) 2024-05-09T00:16:58.058 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:57 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:57.792+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-05-09T00:16:31.319398+0000 front 2024-05-09T00:16:31.319295+0000 (oldest deadline 2024-05-09T00:16:54.219283+0000) 2024-05-09T00:16:59.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:58 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:58.761+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:16:59.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:58 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:58.761+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:16:59.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:58 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:58.761+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:16:59.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:58 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:58.761+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:16:59.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:58 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:58.761+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:16:59.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:58 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:58.761+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:20.817777+0000 front 2024-05-09T00:16:20.817757+0000 (oldest deadline 2024-05-09T00:16:46.717648+0000) 2024-05-09T00:16:59.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:58 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:58.761+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-05-09T00:16:31.319398+0000 front 2024-05-09T00:16:31.319295+0000 (oldest deadline 2024-05-09T00:16:54.219283+0000) 2024-05-09T00:17:00.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:59 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:59.740+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6806 osd.0 since back 2024-05-09T00:15:38.510029+0000 front 2024-05-09T00:15:38.509975+0000 (oldest deadline 2024-05-09T00:16:02.610126+0000) 2024-05-09T00:17:00.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:59 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:59.740+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6804 osd.1 since back 2024-05-09T00:15:45.912314+0000 front 2024-05-09T00:15:45.912279+0000 (oldest deadline 2024-05-09T00:16:11.212299+0000) 2024-05-09T00:17:00.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:59 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:59.740+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6804 osd.2 since back 2024-05-09T00:15:51.212613+0000 front 2024-05-09T00:15:51.212579+0000 (oldest deadline 2024-05-09T00:16:16.512753+0000) 2024-05-09T00:17:00.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:59 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:59.740+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6812 osd.4 since back 2024-05-09T00:16:09.815571+0000 front 2024-05-09T00:16:09.815611+0000 (oldest deadline 2024-05-09T00:16:32.115581+0000) 2024-05-09T00:17:00.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:59 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:59.740+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.171:6812 osd.5 since back 2024-05-09T00:16:17.416556+0000 front 2024-05-09T00:16:17.416601+0000 (oldest deadline 2024-05-09T00:16:38.516667+0000) 2024-05-09T00:17:00.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:59 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:59.740+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.81:6822 osd.6 since back 2024-05-09T00:16:20.817777+0000 front 2024-05-09T00:16:20.817757+0000 (oldest deadline 2024-05-09T00:16:46.717648+0000) 2024-05-09T00:17:00.057 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:16:59 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11[77059]: 2024-05-09T00:16:59.740+0000 7f8a10b6c700 -1 osd.11 98 heartbeat_check: no reply from 172.21.15.150:6820 osd.7 since back 2024-05-09T00:16:31.319398+0000 front 2024-05-09T00:16:31.319295+0000 (oldest deadline 2024-05-09T00:16:54.219283+0000) 2024-05-09T00:17:00.807 INFO:journalctl@ceph.osd.11.smithi171.stdout:May 09 00:17:00 smithi171 bash[92047]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-osd-11 2024-05-09T00:17:01.674 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@osd.11.service' 2024-05-09T00:17:01.714 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:17:01.714 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-09T00:17:01.714 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-09T00:17:01.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.a 2024-05-09T00:17:02.021 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 09 00:17:01 smithi081 systemd[1]: Stopping Ceph mds.a for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:17:02.374 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 09 00:17:02 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-a[92829]: 2024-05-09T00:17:02.022+0000 7f29c1490700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:17:02.374 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 09 00:17:02 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-a[92829]: 2024-05-09T00:17:02.022+0000 7f29c1490700 -1 mds.a *** got signal Terminated *** 2024-05-09T00:17:06.297 INFO:journalctl@ceph.mds.a.smithi081.stdout:May 09 00:17:06 smithi081 bash[126742]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-a 2024-05-09T00:17:06.304 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.a.service' 2024-05-09T00:17:06.339 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:17:06.340 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-09T00:17:06.340 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-09T00:17:06.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.d 2024-05-09T00:17:06.596 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 09 00:17:06 smithi081 systemd[1]: Stopping Ceph mds.d for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:17:06.874 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 09 00:17:06 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-d[91912]: 2024-05-09T00:17:06.596+0000 7fc24b761700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:17:06.875 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 09 00:17:06 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-d[91912]: 2024-05-09T00:17:06.596+0000 7fc24b761700 -1 mds.d *** got signal Terminated *** 2024-05-09T00:17:09.817 INFO:journalctl@ceph.mds.d.smithi081.stdout:May 09 00:17:09 smithi081 bash[126880]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-d 2024-05-09T00:17:09.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.d.service' 2024-05-09T00:17:09.857 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:17:09.858 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-09T00:17:09.858 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-09T00:17:09.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.g 2024-05-09T00:17:10.102 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 09 00:17:09 smithi081 systemd[1]: Stopping Ceph mds.g for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:17:10.374 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 09 00:17:10 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-g[92436]: 2024-05-09T00:17:10.103+0000 7f527a676700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:17:10.374 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 09 00:17:10 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-g[92436]: 2024-05-09T00:17:10.103+0000 7f527a676700 -1 mds.g *** got signal Terminated *** 2024-05-09T00:17:12.502 INFO:journalctl@ceph.mds.g.smithi081.stdout:May 09 00:17:12 smithi081 bash[127020]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-g 2024-05-09T00:17:12.507 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.g.service' 2024-05-09T00:17:12.541 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:17:12.541 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-09T00:17:12.542 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-09T00:17:12.542 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.j 2024-05-09T00:17:12.794 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 09 00:17:12 smithi081 systemd[1]: Stopping Ceph mds.j for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:17:13.124 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 09 00:17:12 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-j[91531]: 2024-05-09T00:17:12.795+0000 7fd4218bf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:17:13.124 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 09 00:17:12 smithi081 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-j[91531]: 2024-05-09T00:17:12.795+0000 7fd4218bf700 -1 mds.j *** got signal Terminated *** 2024-05-09T00:17:16.105 INFO:journalctl@ceph.mds.j.smithi081.stdout:May 09 00:17:15 smithi081 bash[127158]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-j 2024-05-09T00:17:16.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.j.service' 2024-05-09T00:17:16.143 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:17:16.143 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-09T00:17:16.143 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-09T00:17:16.144 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.b 2024-05-09T00:17:16.518 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:17:16 smithi150 systemd[1]: Stopping Ceph mds.b for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:17:16.519 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:17:16 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-b[81423]: 2024-05-09T00:17:16.381+0000 7fb8bf707700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:17:16.519 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:17:16 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-b[81423]: 2024-05-09T00:17:16.381+0000 7fb8bf707700 -1 mds.b *** got signal Terminated *** 2024-05-09T00:17:20.880 INFO:journalctl@ceph.mds.b.smithi150.stdout:May 09 00:17:20 smithi150 bash[88677]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-b 2024-05-09T00:17:20.885 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.b.service' 2024-05-09T00:17:20.922 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:17:20.922 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-09T00:17:20.922 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-09T00:17:20.922 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.e 2024-05-09T00:17:21.179 INFO:journalctl@ceph.mds.e.smithi150.stdout:May 09 00:17:20 smithi150 systemd[1]: Stopping Ceph mds.e for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:17:21.518 INFO:journalctl@ceph.mds.e.smithi150.stdout:May 09 00:17:21 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-e[80742]: 2024-05-09T00:17:21.180+0000 7f75d72e4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:17:21.519 INFO:journalctl@ceph.mds.e.smithi150.stdout:May 09 00:17:21 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-e[80742]: 2024-05-09T00:17:21.180+0000 7f75d72e4700 -1 mds.e *** got signal Terminated *** 2024-05-09T00:17:25.268 INFO:journalctl@ceph.mds.e.smithi150.stdout:May 09 00:17:25 smithi150 bash[88817]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-e 2024-05-09T00:17:25.286 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.e.service' 2024-05-09T00:17:25.321 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:17:25.321 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-09T00:17:25.322 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-09T00:17:25.322 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.h 2024-05-09T00:17:25.579 INFO:journalctl@ceph.mds.h.smithi150.stdout:May 09 00:17:25 smithi150 systemd[1]: Stopping Ceph mds.h for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:17:26.018 INFO:journalctl@ceph.mds.h.smithi150.stdout:May 09 00:17:25 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-h[81084]: 2024-05-09T00:17:25.580+0000 7ff4d2f2a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:17:26.019 INFO:journalctl@ceph.mds.h.smithi150.stdout:May 09 00:17:25 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-h[81084]: 2024-05-09T00:17:25.580+0000 7ff4d2f2a700 -1 mds.h *** got signal Terminated *** 2024-05-09T00:17:29.243 INFO:journalctl@ceph.mds.h.smithi150.stdout:May 09 00:17:29 smithi150 bash[88956]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-h 2024-05-09T00:17:29.243 INFO:journalctl@ceph.mds.h.smithi150.stdout:May 09 00:17:29 smithi150 systemd[1]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.h.service: Succeeded. 2024-05-09T00:17:29.243 INFO:journalctl@ceph.mds.h.smithi150.stdout:May 09 00:17:29 smithi150 systemd[1]: Stopped Ceph mds.h for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:17:29.244 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.h.service' 2024-05-09T00:17:29.278 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:17:29.279 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-09T00:17:29.279 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-09T00:17:29.279 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.k 2024-05-09T00:17:29.518 INFO:journalctl@ceph.mds.k.smithi150.stdout:May 09 00:17:29 smithi150 systemd[1]: Stopping Ceph mds.k for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:17:30.018 INFO:journalctl@ceph.mds.k.smithi150.stdout:May 09 00:17:29 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-k[80399]: 2024-05-09T00:17:29.547+0000 7ff4eb9e9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:17:30.019 INFO:journalctl@ceph.mds.k.smithi150.stdout:May 09 00:17:29 smithi150 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-k[80399]: 2024-05-09T00:17:29.547+0000 7ff4eb9e9700 -1 mds.k *** got signal Terminated *** 2024-05-09T00:17:33.986 INFO:journalctl@ceph.mds.k.smithi150.stdout:May 09 00:17:33 smithi150 bash[89094]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-k 2024-05-09T00:17:33.991 DEBUG:teuthology.orchestra.run.smithi150:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.k.service' 2024-05-09T00:17:34.024 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:17:34.024 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-09T00:17:34.025 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-09T00:17:34.025 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.c 2024-05-09T00:17:34.307 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:17:34 smithi171 systemd[1]: Stopping Ceph mds.c for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:17:34.307 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:17:34 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[87460]: 2024-05-09T00:17:34.256+0000 7f006341b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:17:34.307 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:17:34 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c[87460]: 2024-05-09T00:17:34.256+0000 7f006341b700 -1 mds.c *** got signal Terminated *** 2024-05-09T00:17:37.378 INFO:journalctl@ceph.mds.c.smithi171.stdout:May 09 00:17:37 smithi171 bash[92309]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-c 2024-05-09T00:17:37.381 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.c.service' 2024-05-09T00:17:37.423 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:17:37.424 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-09T00:17:37.424 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-09T00:17:37.424 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.f 2024-05-09T00:17:37.690 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 09 00:17:37 smithi171 systemd[1]: Stopping Ceph mds.f for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:17:38.057 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 09 00:17:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-f[83563]: 2024-05-09T00:17:37.688+0000 7f1deb15d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:17:38.057 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 09 00:17:37 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-f[83563]: 2024-05-09T00:17:37.689+0000 7f1deb15d700 -1 mds.f *** got signal Terminated *** 2024-05-09T00:17:41.307 INFO:journalctl@ceph.mds.f.smithi171.stdout:May 09 00:17:41 smithi171 bash[92447]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-f 2024-05-09T00:17:41.470 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.f.service' 2024-05-09T00:17:41.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:17:41.506 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-09T00:17:41.506 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-09T00:17:41.506 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.i 2024-05-09T00:17:41.763 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:17:41 smithi171 systemd[1]: Stopping Ceph mds.i for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:17:42.057 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:17:41 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-i[84249]: 2024-05-09T00:17:41.763+0000 7f13d3329700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:17:42.057 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:17:41 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-i[84249]: 2024-05-09T00:17:41.763+0000 7f13d3329700 -1 mds.i *** got signal Terminated *** 2024-05-09T00:17:45.292 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.i.service' 2024-05-09T00:17:45.307 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:17:45 smithi171 bash[92586]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-i 2024-05-09T00:17:45.307 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:17:45 smithi171 systemd[1]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.i.service: Succeeded. 2024-05-09T00:17:45.307 INFO:journalctl@ceph.mds.i.smithi171.stdout:May 09 00:17:45 smithi171 systemd[1]: Stopped Ceph mds.i for 6c93ddc4-0d96-11ef-bc97-c7b262605968. 2024-05-09T00:17:45.325 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:17:45.325 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-09T00:17:45.326 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-09T00:17:45.326 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.l 2024-05-09T00:17:45.586 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 09 00:17:45 smithi171 systemd[1]: Stopping Ceph mds.l for 6c93ddc4-0d96-11ef-bc97-c7b262605968... 2024-05-09T00:17:46.057 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 09 00:17:45 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-l[83218]: 2024-05-09T00:17:45.587+0000 7faca10c6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-09T00:17:46.057 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 09 00:17:45 smithi171 ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-l[83218]: 2024-05-09T00:17:45.587+0000 7faca10c6700 -1 mds.l *** got signal Terminated *** 2024-05-09T00:17:48.519 INFO:journalctl@ceph.mds.l.smithi171.stdout:May 09 00:17:48 smithi171 bash[92726]: ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968-mds-l 2024-05-09T00:17:48.524 DEBUG:teuthology.orchestra.run.smithi171:> sudo pkill -f 'journalctl -f -n 0 -u ceph-6c93ddc4-0d96-11ef-bc97-c7b262605968@mds.l.service' 2024-05-09T00:17:48.558 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-09T00:17:48.558 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-09T00:17:48.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T00:17:48.743 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-09T00:17:50.113 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T00:17:50.300 INFO:teuthology.orchestra.run.smithi150.stdout:Deleting cluster with fsid: 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-09T00:17:51.673 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-09T00:17:51.864 INFO:teuthology.orchestra.run.smithi171.stdout:Deleting cluster with fsid: 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-09T00:17:53.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T00:17:53.282 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T00:17:53.320 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-09T00:17:53.351 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-09T00:17:53.353 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199/remote/smithi081/crash 2024-05-09T00:17:53.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/crash -- . 2024-05-09T00:17:53.475 INFO:teuthology.orchestra.run.smithi081.stderr:tar: /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T00:17:53.475 INFO:teuthology.orchestra.run.smithi081.stderr:tar: Error is not recoverable: exiting now 2024-05-09T00:17:53.477 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199/remote/smithi150/crash 2024-05-09T00:17:53.478 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/crash -- . 2024-05-09T00:17:53.523 INFO:teuthology.orchestra.run.smithi150.stderr:tar: /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T00:17:53.524 INFO:teuthology.orchestra.run.smithi150.stderr:tar: Error is not recoverable: exiting now 2024-05-09T00:17:53.525 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199/remote/smithi171/crash 2024-05-09T00:17:53.526 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/crash -- . 2024-05-09T00:17:53.561 INFO:teuthology.orchestra.run.smithi171.stderr:tar: /var/lib/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-09T00:17:53.561 INFO:teuthology.orchestra.run.smithi171.stderr:tar: Error is not recoverable: exiting now 2024-05-09T00:17:53.562 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-09T00:17:53.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-09T00:17:53.598 INFO:teuthology.orchestra.run.smithi081.stderr:grep: /var/log/ceph/6c93ddc4-0d96-11ef-bc97-c7b262605968/ceph.log: No such file or directory 2024-05-09T00:17:53.600 INFO:tasks.cephadm:Compressing logs... 2024-05-09T00:17:53.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T00:17:53.644 DEBUG:teuthology.orchestra.run.smithi150:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T00:17:53.646 DEBUG:teuthology.orchestra.run.smithi171:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T00:17:53.670 INFO:teuthology.orchestra.run.smithi081.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-09T00:17:53.673 INFO:teuthology.orchestra.run.smithi171.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-09T00:17:53.675 INFO:teuthology.orchestra.run.smithi150.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-09T00:18:02.879 INFO:tasks.cephadm:Archiving logs... 2024-05-09T00:18:02.880 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199/remote/smithi081/log 2024-05-09T00:18:02.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T00:18:04.030 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199/remote/smithi150/log 2024-05-09T00:18:04.031 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T00:18:05.810 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199/remote/smithi171/log 2024-05-09T00:18:05.811 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-09T00:18:06.691 INFO:tasks.cephadm:Removing cluster... 2024-05-09T00:18:06.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 --force 2024-05-09T00:18:06.877 INFO:teuthology.orchestra.run.smithi081.stdout:Deleting cluster with fsid: 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-09T00:18:07.120 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 --force 2024-05-09T00:18:07.302 INFO:teuthology.orchestra.run.smithi150.stdout:Deleting cluster with fsid: 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-09T00:18:07.537 DEBUG:teuthology.orchestra.run.smithi171:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 6c93ddc4-0d96-11ef-bc97-c7b262605968 --force 2024-05-09T00:18:07.725 INFO:teuthology.orchestra.run.smithi171.stdout:Deleting cluster with fsid: 6c93ddc4-0d96-11ef-bc97-c7b262605968 2024-05-09T00:18:07.961 INFO:tasks.cephadm:Removing cephadm ... 2024-05-09T00:18:07.962 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T00:18:07.987 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T00:18:08.006 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-09T00:18:08.024 INFO:tasks.cephadm:Teardown complete 2024-05-09T00:18:08.024 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-09T00:18:08.037 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-09T00:18:08.038 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T00:18:08.041 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T00:18:08.048 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-09T00:18:08.165 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-09T00:18:08.176 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-09T00:18:08.177 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T00:18:08.180 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T00:18:08.182 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-09T00:18:08.196 INFO:teuthology.orchestra.run.smithi150.stderr:bash: ntpq: command not found 2024-05-09T00:18:08.196 INFO:teuthology.orchestra.run.smithi081.stderr:bash: ntpq: command not found 2024-05-09T00:18:08.198 INFO:teuthology.orchestra.run.smithi171.stderr:bash: ntpq: command not found 2024-05-09T00:18:08.201 INFO:teuthology.orchestra.run.smithi150.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T00:18:08.201 INFO:teuthology.orchestra.run.smithi150.stdout:=============================================================================== 2024-05-09T00:18:08.201 INFO:teuthology.orchestra.run.smithi150.stdout:^* hv01.front.sepia.ceph.com 3 6 377 40 +870us[ +873us] +/- 54ms 2024-05-09T00:18:08.201 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 -953us[ -953us] +/- 62ms 2024-05-09T00:18:08.201 INFO:teuthology.orchestra.run.smithi150.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 -163us[ -159us] +/- 62ms 2024-05-09T00:18:08.201 INFO:teuthology.orchestra.run.smithi150.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:18:08.202 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T00:18:08.202 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-05-09T00:18:08.203 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +879us[ +891us] +/- 54ms 2024-05-09T00:18:08.203 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 40 -963us[ -950us] +/- 62ms 2024-05-09T00:18:08.203 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 -175us[ -175us] +/- 62ms 2024-05-09T00:18:08.203 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:18:08.204 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-09T00:18:08.204 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-05-09T00:18:08.204 INFO:teuthology.orchestra.run.smithi171.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +909us[ +903us] +/- 54ms 2024-05-09T00:18:08.204 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 43 -910us[ -916us] +/- 62ms 2024-05-09T00:18:08.204 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 -136us[ -142us] +/- 62ms 2024-05-09T00:18:08.204 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-09T00:18:08.204 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-09T00:18:08.217 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-09T00:18:08.218 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-09T00:18:08.229 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T00:18:08.324 DEBUG:teuthology.orchestra.run.smithi150:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T00:18:08.392 DEBUG:teuthology.orchestra.run.smithi171:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-09T00:18:08.462 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-09T00:18:08.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:18:08.494 DEBUG:teuthology.orchestra.run.smithi150:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-09T00:18:08.525 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:18:08.525 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-09T00:18:08.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:18:08.699 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-09T00:18:08.737 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-09T00:18:08.751 INFO:teuthology.task.internal:Duration was 2216.357193 seconds 2024-05-09T00:18:08.752 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-09T00:18:08.764 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-09T00:18:08.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T00:18:08.767 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T00:18:08.769 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-09T00:18:08.814 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T00:18:08.815 INFO:teuthology.orchestra.run.smithi150.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T00:18:08.817 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-09T00:18:09.283 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-09T00:18:09.283 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-05-09T00:18:09.283 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T00:18:09.307 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2024-05-09T00:18:09.307 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T00:18:09.331 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-05-09T00:18:09.331 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-09T00:18:09.354 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-09T00:18:09.354 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T00:18:09.357 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T00:18:09.373 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-09T00:18:09.447 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-09T00:18:09.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T00:18:09.449 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T00:18:09.452 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-09T00:18:09.561 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-09T00:18:09.573 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-09T00:18:09.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T00:18:09.600 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T00:18:09.628 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-09T00:18:09.655 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-09T00:18:09.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T00:18:09.671 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T00:18:09.674 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-09T00:18:09.695 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-05-09T00:18:09.698 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2024-05-09T00:18:09.721 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-05-09T00:18:09.744 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T00:18:09.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:18:09.766 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T00:18:09.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:18:09.782 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-09T00:18:09.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-09T00:18:09.801 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-09T00:18:09.813 INFO:teuthology.task.internal:Transferring archived files... 2024-05-09T00:18:09.814 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199/remote/smithi081 2024-05-09T00:18:09.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T00:18:09.858 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199/remote/smithi150 2024-05-09T00:18:09.858 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T00:18:09.899 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7698199/remote/smithi171 2024-05-09T00:18:09.899 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-09T00:18:09.940 INFO:teuthology.task.internal:Removing archive directory... 2024-05-09T00:18:09.940 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T00:18:09.942 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T00:18:09.945 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-09T00:18:09.991 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-09T00:18:10.005 INFO:teuthology.task.internal:Not uploading archives. 2024-05-09T00:18:10.005 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-09T00:18:10.017 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-09T00:18:10.017 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T00:18:10.019 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T00:18:10.021 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-09T00:18:10.033 INFO:teuthology.orchestra.run.smithi081.stdout: 262158 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 00:18 /home/ubuntu/cephtest 2024-05-09T00:18:10.035 INFO:teuthology.orchestra.run.smithi150.stdout: 262164 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 00:18 /home/ubuntu/cephtest 2024-05-09T00:18:10.047 INFO:teuthology.orchestra.run.smithi171.stdout: 262164 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 9 00:18 /home/ubuntu/cephtest 2024-05-09T00:18:10.049 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-09T00:18:10.061 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-09T00:18:10.091 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/test_o_trunc}} duration: 2216.3571932315826 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-09T00:18:10.091 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-09T00:18:10.175 INFO:teuthology.run:pass